2024-07-24T21:44:30.566 INFO:root:teuthology version: 0.0.1.dev373+ga8aed60 2024-07-24T21:44:30.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-07-24T21:44:30.684 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816857 branch: main description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iogen}} email: vshankar@redhat.com first_in_suite: false job_id: '7816857' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 7bc81acc946e36bfc3ec8313b59200005ddf3f73 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: max_mds: 1 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 86385b1daf5235400bbcd34a02515d168bde88e2 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 86385b1daf5235400bbcd34a02515d168bde88e2 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1368 sha1: 86385b1daf5235400bbcd34a02515d168bde88e2 sleep_before_teardown: 0 subset: 738/1024 suite: fs suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOjSEUhvQwfGuiGtZLLZxar230XyUkKJOkBB9pFWMSkB1jzCe9NYLtWXx7pY0WZiVJplGKRjFuZZbh8lJgKCOO4= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOF94QL7PH5uoDtL5ARD0iWnCou04uHeiq42vxDP5BPkRXLCb7Wfhgd3ZVSl3MIEoU7p5IqrGED/MdPhhkkBnWg= smithi188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPHxsZLCN2bf+BK8dSIPijwhTSDLb2Hc/C3RwpkmzRM/4z8IBKZzRCAIZhecr/CC/g398ezKakX2qLR0HmU9LSE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: a8aed60fc62d4ff39d2216b360f018eba7518cfe timestamp: 2024-07-24_14:14:53 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.4074525 2024-07-24T21:44:30.684 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-07-24T21:44:30.685 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-07-24T21:44:30.685 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-07-24T21:44:30.687 INFO:teuthology.task.internal:Checking packages... 2024-07-24T21:44:30.708 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '86385b1daf5235400bbcd34a02515d168bde88e2' 2024-07-24T21:44:30.708 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-07-24T21:44:30.708 INFO:teuthology.packaging:ref: None 2024-07-24T21:44:30.708 INFO:teuthology.packaging:tag: None 2024-07-24T21:44:30.708 INFO:teuthology.packaging:branch: main 2024-07-24T21:44:30.708 INFO:teuthology.packaging:sha1: 86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T21:44:30.709 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-07-24T21:44:30.930 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-5272.g6e8aab47 2024-07-24T21:44:30.931 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-07-24T21:44:30.938 INFO:teuthology.task.internal:no buildpackages task found 2024-07-24T21:44:30.938 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-07-24T21:44:30.974 INFO:teuthology.task.internal:Saving configuration 2024-07-24T21:44:30.994 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-07-24T21:44:31.001 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-07-24T21:44:31.026 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816857', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-07-24 21:39:20.769646', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOjSEUhvQwfGuiGtZLLZxar230XyUkKJOkBB9pFWMSkB1jzCe9NYLtWXx7pY0WZiVJplGKRjFuZZbh8lJgKCOO4='} 2024-07-24T21:44:31.051 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816857', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-07-24 21:39:20.768526', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOF94QL7PH5uoDtL5ARD0iWnCou04uHeiq42vxDP5BPkRXLCb7Wfhgd3ZVSl3MIEoU7p5IqrGED/MdPhhkkBnWg='} 2024-07-24T21:44:31.072 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816857', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-07-24 21:39:20.766764', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPHxsZLCN2bf+BK8dSIPijwhTSDLb2Hc/C3RwpkmzRM/4z8IBKZzRCAIZhecr/CC/g398ezKakX2qLR0HmU9LSE='} 2024-07-24T21:44:31.072 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-07-24T21:44:31.081 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-07-24T21:44:31.081 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-07-24T21:44:31.081 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-07-24T21:44:31.081 INFO:teuthology.run_tasks:Running task console_log... 2024-07-24T21:44:31.178 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff8ac823010>, signals=[15]) 2024-07-24T21:44:31.179 INFO:teuthology.run_tasks:Running task internal.connect... 2024-07-24T21:44:31.185 INFO:teuthology.task.internal:Opening connections... 2024-07-24T21:44:31.185 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-07-24T21:44:31.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T21:44:31.265 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2024-07-24T21:44:31.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T21:44:31.349 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2024-07-24T21:44:31.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T21:44:31.466 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-07-24T21:44:31.473 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-07-24T21:44:31.491 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-07-24T21:44:31.491 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-07-24T21:44:31.549 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-07-24T21:44:31.550 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-07-24T21:44:31.550 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-07-24T21:44:31.550 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-07-24T21:44:31.550 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-07-24T21:44:31.550 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-07-24T21:44:31.550 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-07-24T21:44:31.550 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-07-24T21:44:31.550 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-07-24T21:44:31.550 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-07-24T21:44:31.550 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-07-24T21:44:31.550 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-07-24T21:44:31.550 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-07-24T21:44:31.550 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-07-24T21:44:31.551 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-07-24T21:44:31.575 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2024-07-24T21:44:31.593 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2024-07-24T21:44:31.593 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-07-24T21:44:31.650 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2024-07-24T21:44:31.651 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2024-07-24T21:44:31.651 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2024-07-24T21:44:31.651 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2024-07-24T21:44:31.651 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2024-07-24T21:44:31.651 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2024-07-24T21:44:31.651 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2024-07-24T21:44:31.651 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-07-24T21:44:31.651 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2024-07-24T21:44:31.651 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-07-24T21:44:31.651 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2024-07-24T21:44:31.651 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-07-24T21:44:31.651 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-07-24T21:44:31.652 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-07-24T21:44:31.652 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-07-24T21:44:31.675 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-07-24T21:44:31.693 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-07-24T21:44:31.693 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-07-24T21:44:31.749 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2024-07-24T21:44:31.750 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2024-07-24T21:44:31.750 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2024-07-24T21:44:31.750 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2024-07-24T21:44:31.750 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2024-07-24T21:44:31.750 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2024-07-24T21:44:31.750 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2024-07-24T21:44:31.750 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2024-07-24T21:44:31.750 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2024-07-24T21:44:31.750 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-07-24T21:44:31.750 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2024-07-24T21:44:31.751 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-07-24T21:44:31.751 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-07-24T21:44:31.751 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-07-24T21:44:31.751 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-07-24T21:44:31.775 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-07-24T21:44:31.784 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-07-24T21:44:31.798 INFO:teuthology.task.internal:Checking for old test directory... 2024-07-24T21:44:31.799 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-07-24T21:44:31.801 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2024-07-24T21:44:31.804 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2024-07-24T21:44:31.819 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-07-24T21:44:31.825 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-07-24T21:44:31.825 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-07-24T21:44:31.859 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2024-07-24T21:44:31.861 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2024-07-24T21:44:31.896 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-07-24T21:44:31.971 INFO:teuthology.run_tasks:Running task kernel... 2024-07-24T21:44:31.986 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '7bc81acc946e36bfc3ec8313b59200005ddf3f73'} 2024-07-24T21:44:31.986 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-07-24T21:44:31.987 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-07-24T21:44:31.987 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-07-24T21:44:32.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T21:44:32.005 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-07-24T21:44:32.064 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-437.el9.x86_64 2024-07-24T21:44:32.064 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.14.0-437.el9.x86_64 2024-07-24T21:44:32.064 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y kernel 2024-07-24T21:44:34.518 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-07-24T21:44:36.328 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-07-24T21:44:40.778 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-07-24T21:44:42.468 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 18 kB 00:00 2024-07-24T21:44:43.447 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 26 MB/s | 22 MB 00:00 2024-07-24T21:44:49.044 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-07-24T21:44:51.100 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-07-24T21:44:51.101 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-07-24T21:44:51.210 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-07-24T21:44:51.217 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-07-24T21:44:51.217 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-07-24T21:44:51.217 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-07-24T21:44:51.217 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-07-24T21:44:51.217 INFO:teuthology.orchestra.run.smithi047.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-07-24T21:44:51.217 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-07-24T21:44:51.217 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core x86_64 5.14.0-480.el9 baseos 17 M 2024-07-24T21:44:51.217 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules x86_64 5.14.0-480.el9 baseos 36 M 2024-07-24T21:44:51.217 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core x86_64 5.14.0-480.el9 baseos 30 M 2024-07-24T21:44:51.218 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:44:51.218 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-07-24T21:44:51.218 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-07-24T21:44:51.218 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-07-24T21:44:51.218 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:44:51.218 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 84 M 2024-07-24T21:44:51.219 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 126 M 2024-07-24T21:44:51.219 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-07-24T21:44:51.787 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): kernel-5.14.0-480.el9.x86_64.rpm 7.6 MB/s | 1.5 MB 00:00 2024-07-24T21:44:52.171 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): kernel-core-5.14.0-480.el9.x86_64.rpm 29 MB/s | 17 MB 00:00 2024-07-24T21:44:52.580 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): kernel-modules-5.14.0-480.el9.x86_64.rpm 36 MB/s | 36 MB 00:00 2024-07-24T21:44:52.871 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): kernel-modules-core-5.14.0-480.el9.x86_6 28 MB/s | 30 MB 00:01 2024-07-24T21:44:52.874 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-07-24T21:44:52.874 INFO:teuthology.orchestra.run.smithi047.stdout:Total 51 MB/s | 84 MB 00:01 2024-07-24T21:44:53.640 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-07-24T21:44:54.049 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-07-24T21:44:54.049 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-07-24T21:44:55.092 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-07-24T21:44:55.093 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-07-24T21:44:57.696 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-07-24T21:44:58.373 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-core-5.14.0-480.el9.x86_64 1/4 2024-07-24T21:44:58.463 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-24T21:45:01.268 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-24T21:45:01.415 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-24T21:45:06.630 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-24T21:45:06.708 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-5.14.0-480.el9.x86_64 4/4 2024-07-24T21:45:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-07-24T21:45:43.226 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 4/4 2024-07-24T21:45:43.268 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 4/4 2024-07-24T21:45:43.577 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 4/4 2024-07-24T21:45:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/4 2024-07-24T21:45:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-24T21:45:43.578 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-24T21:45:44.357 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-07-24T21:45:44.358 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:45:44.358 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-07-24T21:45:44.358 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-5.14.0-480.el9.x86_64 2024-07-24T21:45:44.358 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core-5.14.0-480.el9.x86_64 2024-07-24T21:45:44.358 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-5.14.0-480.el9.x86_64 2024-07-24T21:45:44.358 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core-5.14.0-480.el9.x86_64 2024-07-24T21:45:44.358 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:45:44.358 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-07-24T21:45:44.733 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-07-24T21:45:44.823 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-480.el9.x86_64 2024-07-24T21:45:44.823 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-07-24T21:45:44.823 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-480.el9.x86_64 2024-07-24T21:45:44.823 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-07-24T21:45:44.823 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-07-24T21:45:44.823 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-07-24T21:45:44.823 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-07-24T21:45:44.824 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-07-24T21:45:44.881 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-480.el9.x86_64 2024-07-24T21:45:44.882 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-07-24T21:45:44.882 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-07-24T21:45:44.912 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-07-24T21:45:44.913 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-07-24T21:45:44.913 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-07-24T21:45:44.913 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 68.el9 2024-07-24T21:45:44.913 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-07-24T21:45:44.913 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-07-24T21:45:44.913 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-07-24T21:45:44.913 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8264254 2024-07-24T21:45:44.913 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-07-24T21:45:44.913 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-07-24T21:45:44.913 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-07-24T21:45:44.913 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-07-24T21:45:44.914 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-07-24T21:45:44.914 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-07-24T21:45:44.914 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-07-24T21:45:44.914 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-07-24T21:45:44.914 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-07-24T21:45:44.914 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-07-24T21:45:44.914 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:45:44.914 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-07-24T21:45:44.914 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-07-24T21:45:44.914 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-07-24T21:45:44.914 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-07-24T21:45:44.914 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:45:44.914 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-07-24T21:45:44.915 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-07-24T21:45:44.916 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 5.14.0-480.el9.x86_64 2024-07-24T21:45:44.916 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-07-24T21:45:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-07-24T21:45:46.980 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-07-24T21:45:47.006 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-07-24T21:45:47.008 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-07-24T21:45:47.068 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.h6t7hBcIVZ 2024-07-24T21:45:47.068 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.h6t7hBcIVZ 2024-07-24T21:45:47.140 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.h6t7hBcIVZ 2024-07-24T21:45:47.276 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.h6t7hBcIVZ is 6KB 2024-07-24T21:45:47.324 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.h6t7hBcIVZ 2024-07-24T21:45:47.339 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-07-24T21:45:47.401 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-07-24T21:45:47.402 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-07-24T21:45:47.402 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-07-24T21:45:47.402 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64.conf 2024-07-24T21:45:47.403 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64 2024-07-24T21:45:47.555 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-07-24T21:46:17.558 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-07-24T21:46:17.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-07-24T21:46:17.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T21:46:36.131 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-07-24T21:46:45.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-07-24T21:46:45.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T21:47:45.137 DEBUG:teuthology.orchestra.remote:timed out 2024-07-24T21:47:57.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-07-24T21:47:57.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T21:47:57.406 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-07-24T21:47:57.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-07-24T21:47:57.756 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-480.el9.x86_64"... 2024-07-24T21:47:57.757 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-07-24T21:47:57.773 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-480.el9.x86_64 2024-07-24T21:47:57.773 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-480.el9.x86_64 vs 5.14.0-480.el9.x86_64 2024-07-24T21:47:57.773 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-07-24T21:47:57.773 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-07-24T21:47:58.774 DEBUG:teuthology.parallel:result is None 2024-07-24T21:47:58.775 INFO:teuthology.run_tasks:Running task internal.base... 2024-07-24T21:47:58.782 INFO:teuthology.task.internal:Creating test directory... 2024-07-24T21:47:58.782 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-07-24T21:47:58.785 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-07-24T21:47:58.788 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-07-24T21:47:58.806 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-07-24T21:47:58.818 INFO:teuthology.run_tasks:Running task internal.archive... 2024-07-24T21:47:58.851 INFO:teuthology.task.internal:Creating archive directory... 2024-07-24T21:47:58.852 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-07-24T21:47:58.854 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-07-24T21:47:58.857 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-07-24T21:47:58.972 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-07-24T21:47:58.979 INFO:teuthology.task.internal:Enabling coredump saving... 2024-07-24T21:47:58.979 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2024-07-24T21:47:58.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T21:47:58.996 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2024-07-24T21:47:59.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T21:47:59.012 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-07-24T21:47:59.015 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-07-24T21:47:59.039 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-07-24T21:47:59.074 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-24T21:47:59.079 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-24T21:47:59.095 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-24T21:47:59.099 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-24T21:47:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-24T21:47:59.121 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-24T21:47:59.123 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-07-24T21:47:59.133 INFO:teuthology.task.internal:Configuring sudo... 2024-07-24T21:47:59.134 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-07-24T21:47:59.136 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-07-24T21:47:59.143 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-07-24T21:47:59.181 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-07-24T21:47:59.190 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-07-24T21:47:59.190 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-07-24T21:47:59.205 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-07-24T21:47:59.210 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-07-24T21:47:59.237 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-24T21:47:59.301 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-24T21:47:59.357 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-24T21:47:59.439 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-24T21:47:59.488 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:47:59.489 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-07-24T21:47:59.557 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-24T21:47:59.598 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-24T21:47:59.654 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-24T21:47:59.746 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-24T21:47:59.777 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-07-24T21:47:59.777 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-07-24T21:47:59.842 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-24T21:47:59.884 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-24T21:47:59.946 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-24T21:48:00.026 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-24T21:48:00.071 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-07-24T21:48:00.071 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-07-24T21:48:00.136 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-07-24T21:48:00.138 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2024-07-24T21:48:00.141 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2024-07-24T21:48:00.172 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-24T21:48:00.185 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-24T21:48:00.211 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-24T21:48:00.587 INFO:teuthology.run_tasks:Running task internal.timer... 2024-07-24T21:48:00.595 INFO:teuthology.task.internal:Starting timer... 2024-07-24T21:48:00.595 INFO:teuthology.run_tasks:Running task pcp... 2024-07-24T21:48:00.622 INFO:teuthology.run_tasks:Running task selinux... 2024-07-24T21:48:00.654 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-07-24T21:48:00.654 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-07-24T21:48:00.731 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-07-24T21:48:00.733 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2024-07-24T21:48:00.794 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: 2024-07-24T21:48:00.796 DEBUG:teuthology.orchestra.run.smithi188:> sudo service auditd rotate 2024-07-24T21:48:00.861 INFO:teuthology.orchestra.run.smithi188.stdout:Rotating logs: 2024-07-24T21:48:00.862 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-07-24T21:48:00.863 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-07-24T21:48:00.891 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-07-24T21:48:00.891 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2024-07-24T21:48:00.909 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2024-07-24T21:48:00.910 DEBUG:teuthology.orchestra.run.smithi188:> /usr/sbin/getenforce 2024-07-24T21:48:00.934 INFO:teuthology.orchestra.run.smithi188.stdout:Permissive 2024-07-24T21:48:00.934 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi188.front.sepia.ceph.com': 'permissive'} 2024-07-24T21:48:00.934 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-24T21:48:00.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T21:48:00.964 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-24T21:48:00.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T21:48:00.990 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-24T21:48:01.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T21:48:01.016 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-07-24T21:48:01.016 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-07-24T21:48:01.044 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2024-07-24T21:48:01.069 DEBUG:teuthology.orchestra.run.smithi188:> sudo /usr/sbin/setenforce permissive 2024-07-24T21:48:01.094 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-07-24T21:48:01.107 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-07-24T21:48:01.117 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-07-24T21:48:01.118 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi183.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-07-24T21:52:38.157 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2024-07-24T21:52:38.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-07-24T21:52:38.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T21:52:38.246 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-07-24T21:52:38.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-07-24T21:52:38.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-07-24T21:52:38.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T21:52:38.412 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-07-24T21:52:38.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-07-24T21:52:38.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-07-24T21:52:38.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T21:52:38.573 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-07-24T21:52:38.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-07-24T21:52:38.655 INFO:teuthology.run_tasks:Running task clock... 2024-07-24T21:52:38.665 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-07-24T21:52:38.665 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-07-24T21:52:38.666 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-24T21:52:38.668 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-07-24T21:52:38.668 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-24T21:52:38.670 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-07-24T21:52:38.671 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-24T21:52:38.697 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-07-24T21:52:38.701 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-07-24T21:52:38.710 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-07-24T21:52:38.718 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-07-24T21:52:38.723 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-07-24T21:52:38.732 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2024-07-24T21:52:38.737 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-07-24T21:52:38.742 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2024-07-24T21:52:38.745 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-07-24T21:52:38.755 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-07-24T21:52:38.757 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-07-24T21:52:38.760 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: ntpd: command not found 2024-07-24T21:52:38.768 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-07-24T21:52:38.770 INFO:teuthology.orchestra.run.smithi188.stdout:506 Cannot talk to daemon 2024-07-24T21:52:38.773 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-07-24T21:52:38.784 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-07-24T21:52:38.789 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-07-24T21:52:38.797 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-07-24T21:52:38.826 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2024-07-24T21:52:38.829 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-24T21:52:38.829 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-07-24T21:52:38.829 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T21:52:38.829 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T21:52:38.829 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T21:52:38.829 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T21:52:38.850 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-07-24T21:52:38.851 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2024-07-24T21:52:38.854 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-24T21:52:38.854 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2024-07-24T21:52:38.854 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T21:52:38.854 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T21:52:38.854 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T21:52:38.854 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T21:52:38.855 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-24T21:52:38.855 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-07-24T21:52:38.855 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T21:52:38.855 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T21:52:38.855 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T21:52:38.855 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T21:52:38.856 INFO:teuthology.run_tasks:Running task install... 2024-07-24T21:52:38.865 DEBUG:teuthology.task.install:project ceph 2024-07-24T21:52:38.865 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2'}} 2024-07-24T21:52:38.866 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2'} 2024-07-24T21:52:38.866 INFO:teuthology.task.install:Using flavor: default 2024-07-24T21:52:38.871 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-07-24T21:52:38.871 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-07-24T21:52:38.871 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2', 'tag': None, 'wait_for_package': False} 2024-07-24T21:52:38.872 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T21:52:38.874 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2', 'tag': None, 'wait_for_package': False} 2024-07-24T21:52:38.874 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T21:52:38.875 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2', 'tag': None, 'wait_for_package': False} 2024-07-24T21:52:38.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T21:52:39.028 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/ 2024-07-24T21:52:39.029 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5197.g86385b1d 2024-07-24T21:52:39.034 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/ 2024-07-24T21:52:39.035 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5197.g86385b1d 2024-07-24T21:52:39.037 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/ 2024-07-24T21:52:39.037 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5197.g86385b1d 2024-07-24T21:52:39.138 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-07-24T21:52:39.139 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-07-24T21:52:39.139 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-07-24T21:52:39.145 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-07-24T21:52:39.145 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:52:39.145 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-07-24T21:52:39.151 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-07-24T21:52:39.152 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-07-24T21:52:39.152 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-07-24T21:52:39.163 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-07-24T21:52:39.163 DEBUG:teuthology.orchestra.run.smithi188:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/86385b1daf5235400bbcd34a02515d168bde88e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-07-24T21:52:39.173 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-07-24T21:52:39.173 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/86385b1daf5235400bbcd34a02515d168bde88e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-07-24T21:52:39.176 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-07-24T21:52:39.176 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/86385b1daf5235400bbcd34a02515d168bde88e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-07-24T21:52:39.228 DEBUG:teuthology.orchestra.run.smithi188:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-07-24T21:52:39.240 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-07-24T21:52:39.241 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-07-24T21:52:39.300 DEBUG:teuthology.orchestra.run.smithi188:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-07-24T21:52:39.313 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-07-24T21:52:39.320 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-07-24T21:52:39.363 INFO:teuthology.orchestra.run.smithi188.stdout:check_obsoletes = 1 2024-07-24T21:52:39.365 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum clean all 2024-07-24T21:52:39.377 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2024-07-24T21:52:39.378 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2024-07-24T21:52:39.385 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-07-24T21:52:39.387 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-07-24T21:52:39.589 INFO:teuthology.orchestra.run.smithi188.stdout:45 files removed 2024-07-24T21:52:39.602 INFO:teuthology.orchestra.run.smithi183.stdout:45 files removed 2024-07-24T21:52:39.616 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-07-24T21:52:39.629 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-07-24T21:52:39.632 INFO:teuthology.orchestra.run.smithi047.stdout:45 files removed 2024-07-24T21:52:39.660 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-07-24T21:52:40.211 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 260 kB/s | 83 kB 00:00 2024-07-24T21:52:40.213 INFO:teuthology.orchestra.run.smithi188.stdout:ceph packages for x86_64 251 kB/s | 83 kB 00:00 2024-07-24T21:52:40.277 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 260 kB/s | 83 kB 00:00 2024-07-24T21:52:40.547 INFO:teuthology.orchestra.run.smithi188.stdout:ceph noarch packages 82 kB/s | 24 kB 00:00 2024-07-24T21:52:40.553 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 80 kB/s | 24 kB 00:00 2024-07-24T21:52:40.644 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 77 kB/s | 24 kB 00:00 2024-07-24T21:52:40.864 INFO:teuthology.orchestra.run.smithi188.stdout:ceph source packages 6.8 kB/s | 1.9 kB 00:00 2024-07-24T21:52:40.887 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 6.4 kB/s | 1.9 kB 00:00 2024-07-24T21:52:40.978 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 6.6 kB/s | 1.9 kB 00:00 2024-07-24T21:52:41.325 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-07-24T21:52:41.581 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-07-24T21:52:41.766 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-07-24T21:52:43.243 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-07-24T21:52:43.341 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-07-24T21:52:43.718 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-07-24T21:52:47.485 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-07-24T21:52:47.658 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-07-24T21:52:48.444 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 6.5 MB 00:00 2024-07-24T21:52:49.110 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 18 kB 00:00 2024-07-24T21:52:49.439 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 18 kB 00:00 2024-07-24T21:52:49.925 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 18 kB 00:00 2024-07-24T21:52:50.088 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 26 MB/s | 22 MB 00:00 2024-07-24T21:52:50.719 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 19 MB/s | 22 MB 00:01 2024-07-24T21:52:50.854 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 28 MB/s | 22 MB 00:00 2024-07-24T21:52:55.443 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-07-24T21:52:56.016 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-07-24T21:52:56.527 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-07-24T21:52:57.694 INFO:teuthology.orchestra.run.smithi188.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-24T21:52:57.694 INFO:teuthology.orchestra.run.smithi188.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-24T21:52:57.706 INFO:teuthology.orchestra.run.smithi188.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-07-24T21:52:57.707 INFO:teuthology.orchestra.run.smithi188.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-07-24T21:52:57.708 INFO:teuthology.orchestra.run.smithi188.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-07-24T21:52:57.708 INFO:teuthology.orchestra.run.smithi188.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-07-24T21:52:57.710 INFO:teuthology.orchestra.run.smithi188.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-07-24T21:52:57.712 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-07-24T21:52:57.713 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-07-24T21:52:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-07-24T21:52:57.799 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================= 2024-07-24T21:52:57.799 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-07-24T21:52:57.799 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================= 2024-07-24T21:52:57.799 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-07-24T21:52:57.799 INFO:teuthology.orchestra.run.smithi188.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-07-24T21:52:57.800 INFO:teuthology.orchestra.run.smithi188.stdout: ceph x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 6.6 k 2024-07-24T21:52:57.800 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 5.4 M 2024-07-24T21:52:57.800 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 903 k 2024-07-24T21:52:57.800 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 145 k 2024-07-24T21:52:57.800 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 1.5 M 2024-07-24T21:52:57.800 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 149 k 2024-07-24T21:52:57.800 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 14 M 2024-07-24T21:52:57.800 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 7.4 M 2024-07-24T21:52:57.800 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 49 k 2024-07-24T21:52:57.800 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 11 M 2024-07-24T21:52:57.800 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 50 M 2024-07-24T21:52:57.801 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 274 k 2024-07-24T21:52:57.801 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 771 k 2024-07-24T21:52:57.801 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-mirror x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 228 k 2024-07-24T21:52:57.801 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-shell x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 27 k 2024-07-24T21:52:57.801 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-top noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 18 k 2024-07-24T21:52:57.801 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-07-24T21:52:57.801 INFO:teuthology.orchestra.run.smithi188.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-07-24T21:52:57.801 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-07-24T21:52:57.801 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 32 k 2024-07-24T21:52:57.801 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 758 k 2024-07-24T21:52:57.801 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 127 k 2024-07-24T21:52:57.801 INFO:teuthology.orchestra.run.smithi188.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-07-24T21:52:57.802 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-07-24T21:52:57.802 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-07-24T21:52:57.802 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-07-24T21:52:57.802 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-07-24T21:52:57.802 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-07-24T21:52:57.802 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 161 k 2024-07-24T21:52:57.802 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 321 k 2024-07-24T21:52:57.802 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 303 k 2024-07-24T21:52:57.802 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 99 k 2024-07-24T21:52:57.802 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 85 k 2024-07-24T21:52:57.802 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.2 M 2024-07-24T21:52:57.802 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 170 k 2024-07-24T21:52:57.803 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-07-24T21:52:57.803 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2024-07-24T21:52:57.803 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-07-24T21:52:57.803 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-07-24T21:52:57.803 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-07-24T21:52:57.803 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-07-24T21:52:57.803 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-07-24T21:52:57.803 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout: librados2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.4 M 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.2 M 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 21 M 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 34 k 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 2.4 M 2024-07-24T21:52:57.804 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 284 k 2024-07-24T21:52:57.805 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 4.7 M 2024-07-24T21:52:57.805 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 17 M 2024-07-24T21:52:57.805 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 16 k 2024-07-24T21:52:57.805 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 25 k 2024-07-24T21:52:57.805 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-07-24T21:52:57.805 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-07-24T21:52:57.805 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-07-24T21:52:57.805 INFO:teuthology.orchestra.run.smithi188.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-07-24T21:52:57.805 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-07-24T21:52:57.805 INFO:teuthology.orchestra.run.smithi188.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-07-24T21:52:57.805 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-07-24T21:52:57.805 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-07-24T21:52:57.806 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 163 k 2024-07-24T21:52:57.806 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-07-24T21:52:57.806 INFO:teuthology.orchestra.run.smithi188.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-07-24T21:52:57.806 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-07-24T21:52:57.806 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-07-24T21:52:57.806 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-07-24T21:52:57.806 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 510 k 2024-07-24T21:52:57.806 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-07-24T21:52:57.806 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 5.5 M 2024-07-24T21:52:57.806 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-07-24T21:52:57.806 INFO:teuthology.orchestra.run.smithi188.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-07-24T21:52:57.806 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-07-24T21:52:57.807 INFO:teuthology.orchestra.run.smithi188.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-07-24T21:52:57.807 INFO:teuthology.orchestra.run.smithi188.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-07-24T21:52:57.807 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-07-24T21:52:57.807 INFO:teuthology.orchestra.run.smithi188.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-07-24T21:52:57.807 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-07-24T21:52:57.807 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-07-24T21:52:57.807 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-07-24T21:52:57.807 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-07-24T21:52:57.807 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-07-24T21:52:57.807 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-07-24T21:52:57.807 INFO:teuthology.orchestra.run.smithi188.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-07-24T21:52:57.807 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-07-24T21:52:57.808 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-07-24T21:52:57.808 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-07-24T21:52:57.808 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 45 k 2024-07-24T21:52:57.808 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 138 k 2024-07-24T21:52:57.808 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-07-24T21:52:57.808 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-07-24T21:52:57.808 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-07-24T21:52:57.808 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-07-24T21:52:57.808 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-07-24T21:52:57.808 INFO:teuthology.orchestra.run.smithi188.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-07-24T21:52:57.808 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-07-24T21:52:57.808 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-07-24T21:52:57.808 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-07-24T21:52:57.809 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-07-24T21:52:57.810 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-07-24T21:52:57.810 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-07-24T21:52:57.810 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-07-24T21:52:57.810 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-07-24T21:52:57.810 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-07-24T21:52:57.810 INFO:teuthology.orchestra.run.smithi188.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-07-24T21:52:57.810 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-07-24T21:52:57.810 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-07-24T21:52:57.810 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-07-24T21:52:57.810 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-07-24T21:52:57.811 INFO:teuthology.orchestra.run.smithi188.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-07-24T21:52:57.811 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-07-24T21:52:57.811 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-07-24T21:52:57.811 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-07-24T21:52:57.811 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-07-24T21:52:57.811 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-07-24T21:52:57.811 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-07-24T21:52:57.811 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-07-24T21:52:57.811 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-07-24T21:52:57.811 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-07-24T21:52:57.811 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-07-24T21:52:57.812 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-07-24T21:52:57.812 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-07-24T21:52:57.812 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-07-24T21:52:57.812 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-07-24T21:52:57.812 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-07-24T21:52:57.812 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-07-24T21:52:57.812 INFO:teuthology.orchestra.run.smithi188.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-07-24T21:52:57.812 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-07-24T21:52:57.812 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-07-24T21:52:57.812 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-07-24T21:52:57.812 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-07-24T21:52:57.812 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-07-24T21:52:57.812 INFO:teuthology.orchestra.run.smithi188.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-07-24T21:52:57.813 INFO:teuthology.orchestra.run.smithi188.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-07-24T21:52:57.813 INFO:teuthology.orchestra.run.smithi188.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-07-24T21:52:57.813 INFO:teuthology.orchestra.run.smithi188.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-07-24T21:52:57.813 INFO:teuthology.orchestra.run.smithi188.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-07-24T21:52:57.813 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-07-24T21:52:57.813 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-07-24T21:52:57.813 INFO:teuthology.orchestra.run.smithi188.stdout:Installing weak dependencies: 2024-07-24T21:52:57.813 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-07-24T21:52:57.813 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:52:57.814 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-07-24T21:52:57.814 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================= 2024-07-24T21:52:57.814 INFO:teuthology.orchestra.run.smithi188.stdout:Install 148 Packages 2024-07-24T21:52:57.814 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 12 Packages 2024-07-24T21:52:57.814 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:52:57.814 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 240 M 2024-07-24T21:52:57.815 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-07-24T21:52:58.267 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-24T21:52:58.267 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-24T21:52:58.279 INFO:teuthology.orchestra.run.smithi183.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-07-24T21:52:58.280 INFO:teuthology.orchestra.run.smithi183.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-07-24T21:52:58.280 INFO:teuthology.orchestra.run.smithi183.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-07-24T21:52:58.281 INFO:teuthology.orchestra.run.smithi183.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-07-24T21:52:58.283 INFO:teuthology.orchestra.run.smithi183.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-07-24T21:52:58.285 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-07-24T21:52:58.286 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-07-24T21:52:58.351 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-07-24T21:52:58.365 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-07-24T21:52:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-07-24T21:52:58.365 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-07-24T21:52:58.365 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-07-24T21:52:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-07-24T21:52:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 6.6 k 2024-07-24T21:52:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 5.4 M 2024-07-24T21:52:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 903 k 2024-07-24T21:52:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 145 k 2024-07-24T21:52:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 1.5 M 2024-07-24T21:52:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 149 k 2024-07-24T21:52:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 14 M 2024-07-24T21:52:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 7.4 M 2024-07-24T21:52:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 49 k 2024-07-24T21:52:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 11 M 2024-07-24T21:52:58.366 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 50 M 2024-07-24T21:52:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 274 k 2024-07-24T21:52:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 771 k 2024-07-24T21:52:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 228 k 2024-07-24T21:52:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-shell x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 27 k 2024-07-24T21:52:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 18 k 2024-07-24T21:52:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-07-24T21:52:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-07-24T21:52:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-07-24T21:52:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 32 k 2024-07-24T21:52:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 758 k 2024-07-24T21:52:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 127 k 2024-07-24T21:52:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-07-24T21:52:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-07-24T21:52:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-07-24T21:52:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-07-24T21:52:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-07-24T21:52:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-07-24T21:52:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 161 k 2024-07-24T21:52:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 321 k 2024-07-24T21:52:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 303 k 2024-07-24T21:52:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 99 k 2024-07-24T21:52:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 85 k 2024-07-24T21:52:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.2 M 2024-07-24T21:52:58.368 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 170 k 2024-07-24T21:52:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-07-24T21:52:58.369 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2024-07-24T21:52:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-07-24T21:52:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-07-24T21:52:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-07-24T21:52:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-07-24T21:52:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-07-24T21:52:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-07-24T21:52:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-07-24T21:52:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.4 M 2024-07-24T21:52:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.2 M 2024-07-24T21:52:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-07-24T21:52:58.369 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-07-24T21:52:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-07-24T21:52:58.370 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-07-24T21:52:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-07-24T21:52:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-07-24T21:52:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-07-24T21:52:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 21 M 2024-07-24T21:52:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 34 k 2024-07-24T21:52:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 2.4 M 2024-07-24T21:52:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 284 k 2024-07-24T21:52:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 4.7 M 2024-07-24T21:52:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 17 M 2024-07-24T21:52:58.370 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 16 k 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 25 k 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 163 k 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-07-24T21:52:58.371 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-07-24T21:52:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-07-24T21:52:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 510 k 2024-07-24T21:52:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-07-24T21:52:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 5.5 M 2024-07-24T21:52:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-07-24T21:52:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-07-24T21:52:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-07-24T21:52:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-07-24T21:52:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-07-24T21:52:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-07-24T21:52:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-07-24T21:52:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-07-24T21:52:58.372 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 45 k 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 138 k 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-07-24T21:52:58.373 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-07-24T21:52:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-07-24T21:52:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-07-24T21:52:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-07-24T21:52:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-07-24T21:52:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-07-24T21:52:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-07-24T21:52:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-07-24T21:52:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-07-24T21:52:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-07-24T21:52:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-07-24T21:52:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-07-24T21:52:58.374 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-07-24T21:52:58.375 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-07-24T21:52:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-07-24T21:52:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-07-24T21:52:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-07-24T21:52:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-07-24T21:52:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-07-24T21:52:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-07-24T21:52:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-07-24T21:52:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-07-24T21:52:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-07-24T21:52:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-07-24T21:52:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-07-24T21:52:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-07-24T21:52:58.376 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-07-24T21:52:58.377 INFO:teuthology.orchestra.run.smithi183.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-07-24T21:52:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-07-24T21:52:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-07-24T21:52:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-07-24T21:52:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-07-24T21:52:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-07-24T21:52:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-07-24T21:52:58.378 INFO:teuthology.orchestra.run.smithi183.stdout:Installing weak dependencies: 2024-07-24T21:52:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-07-24T21:52:58.378 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:52:58.378 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-07-24T21:52:58.378 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-07-24T21:52:58.378 INFO:teuthology.orchestra.run.smithi183.stdout:Install 148 Packages 2024-07-24T21:52:58.378 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 12 Packages 2024-07-24T21:52:58.379 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:52:58.379 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 240 M 2024-07-24T21:52:58.379 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-07-24T21:52:58.577 INFO:teuthology.orchestra.run.smithi188.stdout:(1/160): ceph-19.0.0-5197.g86385b1d.el9.x86_64. 33 kB/s | 6.6 kB 00:00 2024-07-24T21:52:58.802 INFO:teuthology.orchestra.run.smithi188.stdout:(2/160): ceph-fuse-19.0.0-5197.g86385b1d.el9.x8 3.9 MB/s | 903 kB 00:00 2024-07-24T21:52:58.892 INFO:teuthology.orchestra.run.smithi183.stdout:(1/160): ceph-19.0.0-5197.g86385b1d.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-07-24T21:52:58.903 INFO:teuthology.orchestra.run.smithi188.stdout:(3/160): ceph-base-19.0.0-5197.g86385b1d.el9.x8 10 MB/s | 5.4 MB 00:00 2024-07-24T21:52:58.920 INFO:teuthology.orchestra.run.smithi188.stdout:(4/160): ceph-immutable-object-cache-19.0.0-519 1.2 MB/s | 145 kB 00:00 2024-07-24T21:52:58.942 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-24T21:52:58.942 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-24T21:52:58.954 INFO:teuthology.orchestra.run.smithi047.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-07-24T21:52:58.955 INFO:teuthology.orchestra.run.smithi047.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-07-24T21:52:58.956 INFO:teuthology.orchestra.run.smithi047.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-07-24T21:52:58.957 INFO:teuthology.orchestra.run.smithi047.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-07-24T21:52:58.958 INFO:teuthology.orchestra.run.smithi047.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-07-24T21:52:58.961 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-07-24T21:52:58.962 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-07-24T21:52:59.031 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-07-24T21:52:59.036 INFO:teuthology.orchestra.run.smithi188.stdout:(5/160): ceph-mds-19.0.0-5197.g86385b1d.el9.x86 18 MB/s | 2.4 MB 00:00 2024-07-24T21:52:59.049 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-07-24T21:52:59.049 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-07-24T21:52:59.049 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-07-24T21:52:59.049 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-07-24T21:52:59.050 INFO:teuthology.orchestra.run.smithi047.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-07-24T21:52:59.050 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 6.6 k 2024-07-24T21:52:59.050 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 5.4 M 2024-07-24T21:52:59.050 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 903 k 2024-07-24T21:52:59.050 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 145 k 2024-07-24T21:52:59.050 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 1.5 M 2024-07-24T21:52:59.050 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 149 k 2024-07-24T21:52:59.050 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 14 M 2024-07-24T21:52:59.050 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 7.4 M 2024-07-24T21:52:59.050 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 49 k 2024-07-24T21:52:59.051 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 11 M 2024-07-24T21:52:59.051 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 50 M 2024-07-24T21:52:59.051 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 274 k 2024-07-24T21:52:59.051 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 771 k 2024-07-24T21:52:59.051 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 228 k 2024-07-24T21:52:59.051 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 27 k 2024-07-24T21:52:59.051 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 18 k 2024-07-24T21:52:59.051 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-07-24T21:52:59.051 INFO:teuthology.orchestra.run.smithi047.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-07-24T21:52:59.052 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-07-24T21:52:59.052 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 32 k 2024-07-24T21:52:59.052 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 758 k 2024-07-24T21:52:59.052 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 127 k 2024-07-24T21:52:59.052 INFO:teuthology.orchestra.run.smithi047.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-07-24T21:52:59.052 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-07-24T21:52:59.052 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-07-24T21:52:59.052 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-07-24T21:52:59.052 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-07-24T21:52:59.053 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-07-24T21:52:59.053 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 161 k 2024-07-24T21:52:59.053 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 321 k 2024-07-24T21:52:59.053 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 303 k 2024-07-24T21:52:59.053 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 99 k 2024-07-24T21:52:59.053 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 85 k 2024-07-24T21:52:59.053 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.2 M 2024-07-24T21:52:59.053 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 170 k 2024-07-24T21:52:59.053 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-07-24T21:52:59.054 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-07-24T21:52:59.054 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-07-24T21:52:59.054 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-07-24T21:52:59.054 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-07-24T21:52:59.054 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-07-24T21:52:59.054 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-07-24T21:52:59.054 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-07-24T21:52:59.055 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-07-24T21:52:59.055 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.4 M 2024-07-24T21:52:59.055 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.2 M 2024-07-24T21:52:59.055 INFO:teuthology.orchestra.run.smithi047.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-07-24T21:52:59.055 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-07-24T21:52:59.056 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-07-24T21:52:59.056 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-07-24T21:52:59.056 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-07-24T21:52:59.056 INFO:teuthology.orchestra.run.smithi047.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-07-24T21:52:59.056 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-07-24T21:52:59.056 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 21 M 2024-07-24T21:52:59.056 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 34 k 2024-07-24T21:52:59.056 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 2.4 M 2024-07-24T21:52:59.056 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 284 k 2024-07-24T21:52:59.057 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 4.7 M 2024-07-24T21:52:59.057 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 17 M 2024-07-24T21:52:59.057 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 16 k 2024-07-24T21:52:59.057 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 25 k 2024-07-24T21:52:59.057 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-07-24T21:52:59.057 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-07-24T21:52:59.057 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-07-24T21:52:59.057 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-07-24T21:52:59.057 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-07-24T21:52:59.058 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-07-24T21:52:59.058 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-07-24T21:52:59.058 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-07-24T21:52:59.058 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 163 k 2024-07-24T21:52:59.058 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-07-24T21:52:59.058 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-07-24T21:52:59.058 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-07-24T21:52:59.058 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-07-24T21:52:59.058 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-07-24T21:52:59.058 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 510 k 2024-07-24T21:52:59.059 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-07-24T21:52:59.059 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 5.5 M 2024-07-24T21:52:59.059 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-07-24T21:52:59.059 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-07-24T21:52:59.059 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-07-24T21:52:59.059 INFO:teuthology.orchestra.run.smithi047.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-07-24T21:52:59.059 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-07-24T21:52:59.059 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-07-24T21:52:59.059 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-07-24T21:52:59.059 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-07-24T21:52:59.059 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-07-24T21:52:59.059 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-07-24T21:52:59.059 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-07-24T21:52:59.060 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-07-24T21:52:59.060 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-07-24T21:52:59.060 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-07-24T21:52:59.060 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-07-24T21:52:59.060 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-07-24T21:52:59.060 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-07-24T21:52:59.060 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 45 k 2024-07-24T21:52:59.060 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 138 k 2024-07-24T21:52:59.060 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-07-24T21:52:59.060 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-07-24T21:52:59.061 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-07-24T21:52:59.061 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-07-24T21:52:59.061 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-07-24T21:52:59.061 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-07-24T21:52:59.061 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-07-24T21:52:59.061 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-07-24T21:52:59.061 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-07-24T21:52:59.061 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-07-24T21:52:59.061 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-07-24T21:52:59.063 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-07-24T21:52:59.063 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-07-24T21:52:59.063 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-07-24T21:52:59.063 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-07-24T21:52:59.064 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-07-24T21:52:59.064 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-07-24T21:52:59.064 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-07-24T21:52:59.064 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-07-24T21:52:59.064 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-07-24T21:52:59.064 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-07-24T21:52:59.065 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-07-24T21:52:59.065 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-07-24T21:52:59.065 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-07-24T21:52:59.065 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-07-24T21:52:59.065 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-07-24T21:52:59.065 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-07-24T21:52:59.066 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-07-24T21:52:59.066 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-07-24T21:52:59.066 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-07-24T21:52:59.066 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-07-24T21:52:59.066 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-07-24T21:52:59.066 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-07-24T21:52:59.067 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-07-24T21:52:59.067 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-07-24T21:52:59.067 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-07-24T21:52:59.067 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-07-24T21:52:59.067 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-07-24T21:52:59.068 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-07-24T21:52:59.068 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-07-24T21:52:59.068 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-07-24T21:52:59.068 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-07-24T21:52:59.069 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-07-24T21:52:59.069 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-07-24T21:52:59.069 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-07-24T21:52:59.069 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-07-24T21:52:59.069 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-07-24T21:52:59.069 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-07-24T21:52:59.069 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-07-24T21:52:59.069 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-07-24T21:52:59.070 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-07-24T21:52:59.070 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-07-24T21:52:59.070 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-07-24T21:52:59.070 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-07-24T21:52:59.070 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-07-24T21:52:59.070 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-07-24T21:52:59.071 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-07-24T21:52:59.071 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-07-24T21:52:59.071 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-07-24T21:52:59.071 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-07-24T21:52:59.071 INFO:teuthology.orchestra.run.smithi047.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-07-24T21:52:59.071 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-07-24T21:52:59.072 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-07-24T21:52:59.072 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-07-24T21:52:59.072 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-07-24T21:52:59.072 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:52:59.072 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-07-24T21:52:59.072 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-07-24T21:52:59.073 INFO:teuthology.orchestra.run.smithi047.stdout:Install 148 Packages 2024-07-24T21:52:59.073 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 12 Packages 2024-07-24T21:52:59.073 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:52:59.074 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 240 M 2024-07-24T21:52:59.074 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-07-24T21:52:59.187 INFO:teuthology.orchestra.run.smithi188.stdout:(6/160): ceph-mgr-19.0.0-5197.g86385b1d.el9.x86 5.7 MB/s | 1.5 MB 00:00 2024-07-24T21:52:59.304 INFO:teuthology.orchestra.run.smithi188.stdout:(7/160): ceph-mon-19.0.0-5197.g86385b1d.el9.x86 18 MB/s | 4.7 MB 00:00 2024-07-24T21:52:59.350 INFO:teuthology.orchestra.run.smithi183.stdout:(2/160): ceph-fuse-19.0.0-5197.g86385b1d.el9.x8 1.9 MB/s | 903 kB 00:00 2024-07-24T21:52:59.609 INFO:teuthology.orchestra.run.smithi183.stdout:(3/160): ceph-immutable-object-cache-19.0.0-519 561 kB/s | 145 kB 00:00 2024-07-24T21:52:59.688 INFO:teuthology.orchestra.run.smithi188.stdout:(8/160): ceph-common-19.0.0-5197.g86385b1d.el9. 16 MB/s | 21 MB 00:01 2024-07-24T21:52:59.738 INFO:teuthology.orchestra.run.smithi188.stdout:(9/160): ceph-selinux-19.0.0-5197.g86385b1d.el9 505 kB/s | 25 kB 00:00 2024-07-24T21:52:59.988 INFO:teuthology.orchestra.run.smithi188.stdout:(10/160): ceph-radosgw-19.0.0-5197.g86385b1d.el 16 MB/s | 11 MB 00:00 2024-07-24T21:53:00.047 INFO:teuthology.orchestra.run.smithi188.stdout:(11/160): cephfs-mirror-19.0.0-5197.g86385b1d.e 3.8 MB/s | 228 kB 00:00 2024-07-24T21:53:00.122 INFO:teuthology.orchestra.run.smithi188.stdout:(12/160): cephfs-shell-19.0.0-5197.g86385b1d.el 360 kB/s | 27 kB 00:00 2024-07-24T21:53:00.220 INFO:teuthology.orchestra.run.smithi047.stdout:(1/160): ceph-19.0.0-5197.g86385b1d.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-07-24T21:53:00.222 INFO:teuthology.orchestra.run.smithi188.stdout:(13/160): libcephfs-devel-19.0.0-5197.g86385b1d 318 kB/s | 32 kB 00:00 2024-07-24T21:53:00.315 INFO:teuthology.orchestra.run.smithi188.stdout:(14/160): libcephfs2-19.0.0-5197.g86385b1d.el9. 8.1 MB/s | 758 kB 00:00 2024-07-24T21:53:00.399 INFO:teuthology.orchestra.run.smithi188.stdout:(15/160): libcephsqlite-19.0.0-5197.g86385b1d.e 1.9 MB/s | 163 kB 00:00 2024-07-24T21:53:00.474 INFO:teuthology.orchestra.run.smithi188.stdout:(16/160): librados-devel-19.0.0-5197.g86385b1d. 1.6 MB/s | 127 kB 00:00 2024-07-24T21:53:00.493 INFO:teuthology.orchestra.run.smithi183.stdout:(4/160): ceph-mds-19.0.0-5197.g86385b1d.el9.x86 2.7 MB/s | 2.4 MB 00:00 2024-07-24T21:53:00.566 INFO:teuthology.orchestra.run.smithi188.stdout:(17/160): libradosstriper1-19.0.0-5197.g86385b1 5.4 MB/s | 510 kB 00:00 2024-07-24T21:53:00.629 INFO:teuthology.orchestra.run.smithi047.stdout:(2/160): ceph-fuse-19.0.0-5197.g86385b1d.el9.x8 2.2 MB/s | 903 kB 00:00 2024-07-24T21:53:00.729 INFO:teuthology.orchestra.run.smithi047.stdout:(3/160): ceph-immutable-object-cache-19.0.0-519 1.4 MB/s | 145 kB 00:00 2024-07-24T21:53:01.124 INFO:teuthology.orchestra.run.smithi188.stdout:(18/160): ceph-osd-19.0.0-5197.g86385b1d.el9.x8 8.7 MB/s | 17 MB 00:01 2024-07-24T21:53:01.199 INFO:teuthology.orchestra.run.smithi188.stdout:(19/160): librgw2-19.0.0-5197.g86385b1d.el9.x86 8.7 MB/s | 5.5 MB 00:00 2024-07-24T21:53:01.204 INFO:teuthology.orchestra.run.smithi047.stdout:(4/160): ceph-mds-19.0.0-5197.g86385b1d.el9.x86 5.0 MB/s | 2.4 MB 00:00 2024-07-24T21:53:01.233 INFO:teuthology.orchestra.run.smithi188.stdout:(20/160): python3-ceph-argparse-19.0.0-5197.g86 416 kB/s | 45 kB 00:00 2024-07-24T21:53:01.258 INFO:teuthology.orchestra.run.smithi188.stdout:(21/160): python3-ceph-common-19.0.0-5197.g8638 2.3 MB/s | 138 kB 00:00 2024-07-24T21:53:01.284 INFO:teuthology.orchestra.run.smithi188.stdout:(22/160): python3-cephfs-19.0.0-5197.g86385b1d. 3.1 MB/s | 161 kB 00:00 2024-07-24T21:53:01.292 INFO:teuthology.orchestra.run.smithi183.stdout:(5/160): ceph-mgr-19.0.0-5197.g86385b1d.el9.x86 1.9 MB/s | 1.5 MB 00:00 2024-07-24T21:53:01.317 INFO:teuthology.orchestra.run.smithi188.stdout:(23/160): python3-rados-19.0.0-5197.g86385b1d.e 5.3 MB/s | 321 kB 00:00 2024-07-24T21:53:01.351 INFO:teuthology.orchestra.run.smithi188.stdout:(24/160): python3-rbd-19.0.0-5197.g86385b1d.el9 4.4 MB/s | 303 kB 00:00 2024-07-24T21:53:01.385 INFO:teuthology.orchestra.run.smithi188.stdout:(25/160): python3-rgw-19.0.0-5197.g86385b1d.el9 1.4 MB/s | 99 kB 00:00 2024-07-24T21:53:01.387 INFO:teuthology.orchestra.run.smithi047.stdout:(5/160): ceph-mgr-19.0.0-5197.g86385b1d.el9.x86 8.3 MB/s | 1.5 MB 00:00 2024-07-24T21:53:01.426 INFO:teuthology.orchestra.run.smithi188.stdout:(26/160): rbd-fuse-19.0.0-5197.g86385b1d.el9.x8 1.1 MB/s | 85 kB 00:00 2024-07-24T21:53:01.527 INFO:teuthology.orchestra.run.smithi188.stdout:(27/160): rbd-nbd-19.0.0-5197.g86385b1d.el9.x86 1.7 MB/s | 170 kB 00:00 2024-07-24T21:53:01.636 INFO:teuthology.orchestra.run.smithi188.stdout:(28/160): ceph-grafana-dashboards-19.0.0-5197.g 318 kB/s | 34 kB 00:00 2024-07-24T21:53:01.711 INFO:teuthology.orchestra.run.smithi188.stdout:(29/160): rbd-mirror-19.0.0-5197.g86385b1d.el9. 9.7 MB/s | 3.2 MB 00:00 2024-07-24T21:53:01.736 INFO:teuthology.orchestra.run.smithi188.stdout:(30/160): ceph-mgr-cephadm-19.0.0-5197.g86385b1 1.5 MB/s | 149 kB 00:00 2024-07-24T21:53:01.751 INFO:teuthology.orchestra.run.smithi183.stdout:(6/160): ceph-common-19.0.0-5197.g86385b1d.el9. 7.0 MB/s | 21 MB 00:03 2024-07-24T21:53:02.030 INFO:teuthology.orchestra.run.smithi047.stdout:(6/160): ceph-base-19.0.0-5197.g86385b1d.el9.x8 2.6 MB/s | 5.4 MB 00:02 2024-07-24T21:53:02.097 INFO:teuthology.orchestra.run.smithi047.stdout:(7/160): ceph-mon-19.0.0-5197.g86385b1d.el9.x86 6.6 MB/s | 4.7 MB 00:00 2024-07-24T21:53:02.286 INFO:teuthology.orchestra.run.smithi188.stdout:(31/160): ceph-test-19.0.0-5197.g86385b1d.el9.x 20 MB/s | 50 MB 00:02 2024-07-24T21:53:02.370 INFO:teuthology.orchestra.run.smithi188.stdout:(32/160): ceph-mgr-modules-core-19.0.0-5197.g86 3.3 MB/s | 284 kB 00:00 2024-07-24T21:53:02.445 INFO:teuthology.orchestra.run.smithi188.stdout:(33/160): ceph-mgr-rook-19.0.0-5197.g86385b1d.e 660 kB/s | 49 kB 00:00 2024-07-24T21:53:02.521 INFO:teuthology.orchestra.run.smithi188.stdout:(34/160): ceph-prometheus-alerts-19.0.0-5197.g8 219 kB/s | 16 kB 00:00 2024-07-24T21:53:02.621 INFO:teuthology.orchestra.run.smithi188.stdout:(35/160): ceph-volume-19.0.0-5197.g86385b1d.el9 2.7 MB/s | 274 kB 00:00 2024-07-24T21:53:02.729 INFO:teuthology.orchestra.run.smithi188.stdout:(36/160): cephadm-19.0.0-5197.g86385b1d.el9.noa 7.0 MB/s | 771 kB 00:00 2024-07-24T21:53:02.814 INFO:teuthology.orchestra.run.smithi188.stdout:(37/160): cephfs-top-19.0.0-5197.g86385b1d.el9. 219 kB/s | 18 kB 00:00 2024-07-24T21:53:02.947 INFO:teuthology.orchestra.run.smithi188.stdout:(38/160): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-07-24T21:53:02.997 INFO:teuthology.orchestra.run.smithi047.stdout:(8/160): ceph-radosgw-19.0.0-5197.g86385b1d.el9 12 MB/s | 11 MB 00:00 2024-07-24T21:53:03.039 INFO:teuthology.orchestra.run.smithi047.stdout:(9/160): ceph-selinux-19.0.0-5197.g86385b1d.el9 609 kB/s | 25 kB 00:00 2024-07-24T21:53:03.114 INFO:teuthology.orchestra.run.smithi188.stdout:(39/160): ceph-mgr-dashboard-19.0.0-5197.g86385 10 MB/s | 14 MB 00:01 2024-07-24T21:53:03.139 INFO:teuthology.orchestra.run.smithi188.stdout:(40/160): libgfortran-11.4.1-3.el9.x86_64.rpm 4.1 MB/s | 803 kB 00:00 2024-07-24T21:53:03.164 INFO:teuthology.orchestra.run.smithi188.stdout:(41/160): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 195 kB 00:00 2024-07-24T21:53:03.190 INFO:teuthology.orchestra.run.smithi188.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-07-24T21:53:03.282 INFO:teuthology.orchestra.run.smithi188.stdout:(43/160): ceph-mgr-diskprediction-local-19.0.0- 4.8 MB/s | 7.4 MB 00:01 2024-07-24T21:53:03.307 INFO:teuthology.orchestra.run.smithi188.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 916 kB/s | 106 kB 00:00 2024-07-24T21:53:03.340 INFO:teuthology.orchestra.run.smithi188.stdout:(45/160): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-07-24T21:53:03.365 INFO:teuthology.orchestra.run.smithi188.stdout:(46/160): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-07-24T21:53:03.391 INFO:teuthology.orchestra.run.smithi188.stdout:(47/160): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-07-24T21:53:03.416 INFO:teuthology.orchestra.run.smithi188.stdout:(48/160): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-07-24T21:53:03.450 INFO:teuthology.orchestra.run.smithi188.stdout:(49/160): automake-1.16.2-8.el9.noarch.rpm 8.1 MB/s | 689 kB 00:00 2024-07-24T21:53:03.451 INFO:teuthology.orchestra.run.smithi183.stdout:(7/160): ceph-mon-19.0.0-5197.g86385b1d.el9.x86 2.2 MB/s | 4.7 MB 00:02 2024-07-24T21:53:03.484 INFO:teuthology.orchestra.run.smithi188.stdout:(50/160): bison-3.7.4-5.el9.x86_64.rpm 10 MB/s | 943 kB 00:00 2024-07-24T21:53:03.500 INFO:teuthology.orchestra.run.smithi188.stdout:(51/160): elfutils-libelf-devel-0.191-4.el9.x86 448 kB/s | 22 kB 00:00 2024-07-24T21:53:03.550 INFO:teuthology.orchestra.run.smithi188.stdout:(52/160): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-07-24T21:53:03.576 INFO:teuthology.orchestra.run.smithi188.stdout:(53/160): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-07-24T21:53:03.593 INFO:teuthology.orchestra.run.smithi188.stdout:(54/160): flexiblas-3.0.4-8.el9.x86_64.rpm 358 kB/s | 33 kB 00:00 2024-07-24T21:53:03.610 INFO:teuthology.orchestra.run.smithi188.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 547 kB/s | 18 kB 00:00 2024-07-24T21:53:03.627 INFO:teuthology.orchestra.run.smithi188.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 334 kB/s | 11 kB 00:00 2024-07-24T21:53:03.643 INFO:teuthology.orchestra.run.smithi188.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.8 MB/s | 160 kB 00:00 2024-07-24T21:53:03.660 INFO:teuthology.orchestra.run.smithi188.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-07-24T21:53:03.668 INFO:teuthology.orchestra.run.smithi183.stdout:(8/160): ceph-osd-19.0.0-5197.g86385b1d.el9.x86 8.8 MB/s | 17 MB 00:01 2024-07-24T21:53:03.703 INFO:teuthology.orchestra.run.smithi188.stdout:(59/160): libtool-2.4.6-46.el9.x86_64.rpm 14 MB/s | 581 kB 00:00 2024-07-24T21:53:03.736 INFO:teuthology.orchestra.run.smithi188.stdout:(60/160): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 662 kB 00:00 2024-07-24T21:53:03.739 INFO:teuthology.orchestra.run.smithi047.stdout:(10/160): ceph-osd-19.0.0-5197.g86385b1d.el9.x8 9.9 MB/s | 17 MB 00:01 2024-07-24T21:53:03.752 INFO:teuthology.orchestra.run.smithi183.stdout:(9/160): ceph-base-19.0.0-5197.g86385b1d.el9.x8 1.1 MB/s | 5.4 MB 00:05 2024-07-24T21:53:03.777 INFO:teuthology.orchestra.run.smithi183.stdout:(10/160): ceph-selinux-19.0.0-5197.g86385b1d.el 232 kB/s | 25 kB 00:00 2024-07-24T21:53:03.786 INFO:teuthology.orchestra.run.smithi188.stdout:(61/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-07-24T21:53:03.789 INFO:teuthology.orchestra.run.smithi047.stdout:(11/160): cephfs-mirror-19.0.0-5197.g86385b1d.e 4.5 MB/s | 228 kB 00:00 2024-07-24T21:53:03.803 INFO:teuthology.orchestra.run.smithi188.stdout:(62/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 254 kB/s | 25 kB 00:00 2024-07-24T21:53:03.820 INFO:teuthology.orchestra.run.smithi188.stdout:(63/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 570 kB/s | 47 kB 00:00 2024-07-24T21:53:03.827 INFO:teuthology.orchestra.run.smithi183.stdout:(11/160): cephfs-mirror-19.0.0-5197.g86385b1d.e 4.5 MB/s | 228 kB 00:00 2024-07-24T21:53:03.839 INFO:teuthology.orchestra.run.smithi047.stdout:(12/160): cephfs-shell-19.0.0-5197.g86385b1d.el 540 kB/s | 27 kB 00:00 2024-07-24T21:53:03.845 INFO:teuthology.orchestra.run.smithi188.stdout:(64/160): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-07-24T21:53:03.869 INFO:teuthology.orchestra.run.smithi183.stdout:(12/160): cephfs-shell-19.0.0-5197.g86385b1d.el 650 kB/s | 27 kB 00:00 2024-07-24T21:53:03.870 INFO:teuthology.orchestra.run.smithi188.stdout:(65/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-07-24T21:53:03.882 INFO:teuthology.orchestra.run.smithi047.stdout:(13/160): libcephfs-devel-19.0.0-5197.g86385b1d 759 kB/s | 32 kB 00:00 2024-07-24T21:53:03.887 INFO:teuthology.orchestra.run.smithi188.stdout:(66/160): openblas-0.3.21-2.el9.x86_64.rpm 529 kB/s | 35 kB 00:00 2024-07-24T21:53:03.911 INFO:teuthology.orchestra.run.smithi183.stdout:(13/160): libcephfs-devel-19.0.0-5197.g86385b1d 759 kB/s | 32 kB 00:00 2024-07-24T21:53:03.996 INFO:teuthology.orchestra.run.smithi188.stdout:(67/160): postgresql-13.14-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-07-24T21:53:04.003 INFO:teuthology.orchestra.run.smithi183.stdout:(14/160): libcephfs2-19.0.0-5197.g86385b1d.el9. 8.1 MB/s | 758 kB 00:00 2024-07-24T21:53:04.046 INFO:teuthology.orchestra.run.smithi183.stdout:(15/160): libcephsqlite-19.0.0-5197.g86385b1d.e 3.8 MB/s | 163 kB 00:00 2024-07-24T21:53:04.080 INFO:teuthology.orchestra.run.smithi188.stdout:(68/160): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-07-24T21:53:04.095 INFO:teuthology.orchestra.run.smithi183.stdout:(16/160): librados-devel-19.0.0-5197.g86385b1d. 2.5 MB/s | 127 kB 00:00 2024-07-24T21:53:04.132 INFO:teuthology.orchestra.run.smithi047.stdout:(14/160): ceph-common-19.0.0-5197.g86385b1d.el9 5.2 MB/s | 21 MB 00:04 2024-07-24T21:53:04.139 INFO:teuthology.orchestra.run.smithi188.stdout:(69/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-07-24T21:53:04.163 INFO:teuthology.orchestra.run.smithi183.stdout:(17/160): libradosstriper1-19.0.0-5197.g86385b1 7.5 MB/s | 510 kB 00:00 2024-07-24T21:53:04.164 INFO:teuthology.orchestra.run.smithi188.stdout:(70/160): postgresql-contrib-13.14-1.el9.x86_64 5.3 MB/s | 911 kB 00:00 2024-07-24T21:53:04.174 INFO:teuthology.orchestra.run.smithi047.stdout:(15/160): libcephfs2-19.0.0-5197.g86385b1d.el9. 2.5 MB/s | 758 kB 00:00 2024-07-24T21:53:04.189 INFO:teuthology.orchestra.run.smithi188.stdout:(71/160): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-07-24T21:53:04.199 INFO:teuthology.orchestra.run.smithi047.stdout:(16/160): libcephsqlite-19.0.0-5197.g86385b1d.e 2.4 MB/s | 163 kB 00:00 2024-07-24T21:53:04.223 INFO:teuthology.orchestra.run.smithi188.stdout:(72/160): python3-attrs-20.3.0-7.el9.noarch.rpm 2.6 MB/s | 87 kB 00:00 2024-07-24T21:53:04.224 INFO:teuthology.orchestra.run.smithi047.stdout:(17/160): librados-devel-19.0.0-5197.g86385b1d. 2.5 MB/s | 127 kB 00:00 2024-07-24T21:53:04.256 INFO:teuthology.orchestra.run.smithi188.stdout:(73/160): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-07-24T21:53:04.275 INFO:teuthology.orchestra.run.smithi047.stdout:(18/160): libradosstriper1-19.0.0-5197.g86385b1 6.6 MB/s | 510 kB 00:00 2024-07-24T21:53:04.298 INFO:teuthology.orchestra.run.smithi188.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 1.5 MB/s | 61 kB 00:00 2024-07-24T21:53:04.325 INFO:teuthology.orchestra.run.smithi047.stdout:(19/160): python3-ceph-argparse-19.0.0-5197.g86 909 kB/s | 45 kB 00:00 2024-07-24T21:53:04.374 INFO:teuthology.orchestra.run.smithi188.stdout:(75/160): postgresql-server-13.14-1.el9.x86_64. 28 MB/s | 5.8 MB 00:00 2024-07-24T21:53:04.375 INFO:teuthology.orchestra.run.smithi047.stdout:(20/160): python3-ceph-common-19.0.0-5197.g8638 2.7 MB/s | 138 kB 00:00 2024-07-24T21:53:04.399 INFO:teuthology.orchestra.run.smithi188.stdout:(76/160): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-07-24T21:53:04.442 INFO:teuthology.orchestra.run.smithi047.stdout:(21/160): python3-cephfs-19.0.0-5197.g86385b1d. 2.4 MB/s | 161 kB 00:00 2024-07-24T21:53:04.483 INFO:teuthology.orchestra.run.smithi188.stdout:(77/160): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 6.0 MB 00:00 2024-07-24T21:53:04.508 INFO:teuthology.orchestra.run.smithi188.stdout:(78/160): python3-jinja2-2.11.3-6.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-07-24T21:53:04.533 INFO:teuthology.orchestra.run.smithi188.stdout:(79/160): python3-jsonpatch-1.21-16.el9.noarch. 196 kB/s | 26 kB 00:00 2024-07-24T21:53:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:(22/160): python3-rados-19.0.0-5197.g86385b1d.e 2.9 MB/s | 321 kB 00:00 2024-07-24T21:53:04.558 INFO:teuthology.orchestra.run.smithi188.stdout:(80/160): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-07-24T21:53:04.583 INFO:teuthology.orchestra.run.smithi188.stdout:(81/160): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-07-24T21:53:04.608 INFO:teuthology.orchestra.run.smithi188.stdout:(82/160): python3-markupsafe-1.1.1-12.el9.x86_6 462 kB/s | 35 kB 00:00 2024-07-24T21:53:04.630 INFO:teuthology.orchestra.run.smithi183.stdout:(18/160): librgw2-19.0.0-5197.g86385b1d.el9.x86 12 MB/s | 5.5 MB 00:00 2024-07-24T21:53:04.634 INFO:teuthology.orchestra.run.smithi188.stdout:(83/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-07-24T21:53:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:(23/160): python3-rbd-19.0.0-5197.g86385b1d.el9 3.2 MB/s | 303 kB 00:00 2024-07-24T21:53:04.659 INFO:teuthology.orchestra.run.smithi188.stdout:(84/160): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-07-24T21:53:04.672 INFO:teuthology.orchestra.run.smithi183.stdout:(19/160): python3-ceph-argparse-19.0.0-5197.g86 1.1 MB/s | 45 kB 00:00 2024-07-24T21:53:04.685 INFO:teuthology.orchestra.run.smithi188.stdout:(85/160): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 77 kB 00:00 2024-07-24T21:53:04.701 INFO:teuthology.orchestra.run.smithi188.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 1.1 MB/s | 42 kB 00:00 2024-07-24T21:53:04.722 INFO:teuthology.orchestra.run.smithi183.stdout:(20/160): python3-ceph-common-19.0.0-5197.g8638 2.7 MB/s | 138 kB 00:00 2024-07-24T21:53:04.735 INFO:teuthology.orchestra.run.smithi047.stdout:(24/160): librgw2-19.0.0-5197.g86385b1d.el9.x86 11 MB/s | 5.5 MB 00:00 2024-07-24T21:53:04.760 INFO:teuthology.orchestra.run.smithi047.stdout:(25/160): python3-rgw-19.0.0-5197.g86385b1d.el9 848 kB/s | 99 kB 00:00 2024-07-24T21:53:04.772 INFO:teuthology.orchestra.run.smithi183.stdout:(21/160): python3-cephfs-19.0.0-5197.g86385b1d. 3.2 MB/s | 161 kB 00:00 2024-07-24T21:53:04.777 INFO:teuthology.orchestra.run.smithi188.stdout:(87/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 5.1 MB 00:00 2024-07-24T21:53:04.785 INFO:teuthology.orchestra.run.smithi047.stdout:(26/160): rbd-fuse-19.0.0-5197.g86385b1d.el9.x8 1.7 MB/s | 85 kB 00:00 2024-07-24T21:53:04.827 INFO:teuthology.orchestra.run.smithi188.stdout:(88/160): python3-protobuf-3.14.0-13.el9.noarch 1.9 MB/s | 269 kB 00:00 2024-07-24T21:53:04.831 INFO:teuthology.orchestra.run.smithi183.stdout:(22/160): python3-rados-19.0.0-5197.g86385b1d.e 5.4 MB/s | 321 kB 00:00 2024-07-24T21:53:04.835 INFO:teuthology.orchestra.run.smithi047.stdout:(27/160): rbd-nbd-19.0.0-5197.g86385b1d.el9.x86 3.3 MB/s | 170 kB 00:00 2024-07-24T21:53:04.852 INFO:teuthology.orchestra.run.smithi188.stdout:(89/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-07-24T21:53:04.869 INFO:teuthology.orchestra.run.smithi188.stdout:(90/160): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-07-24T21:53:04.881 INFO:teuthology.orchestra.run.smithi183.stdout:(23/160): python3-rbd-19.0.0-5197.g86385b1d.el9 5.9 MB/s | 303 kB 00:00 2024-07-24T21:53:04.894 INFO:teuthology.orchestra.run.smithi047.stdout:(28/160): ceph-grafana-dashboards-19.0.0-5197.g 588 kB/s | 34 kB 00:00 2024-07-24T21:53:04.895 INFO:teuthology.orchestra.run.smithi188.stdout:(91/160): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-07-24T21:53:04.911 INFO:teuthology.orchestra.run.smithi188.stdout:(92/160): python3-requests-oauthlib-1.3.0-12.el 916 kB/s | 54 kB 00:00 2024-07-24T21:53:04.931 INFO:teuthology.orchestra.run.smithi183.stdout:(24/160): python3-rgw-19.0.0-5197.g86385b1d.el9 1.9 MB/s | 99 kB 00:00 2024-07-24T21:53:04.945 INFO:teuthology.orchestra.run.smithi047.stdout:(29/160): ceph-mgr-cephadm-19.0.0-5197.g86385b1 2.9 MB/s | 149 kB 00:00 2024-07-24T21:53:04.945 INFO:teuthology.orchestra.run.smithi188.stdout:(93/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.4 MB/s | 44 kB 00:00 2024-07-24T21:53:04.962 INFO:teuthology.orchestra.run.smithi188.stdout:(94/160): python3-toml-0.10.2-6.el9.noarch.rpm 876 kB/s | 42 kB 00:00 2024-07-24T21:53:04.982 INFO:teuthology.orchestra.run.smithi183.stdout:(25/160): rbd-fuse-19.0.0-5197.g86385b1d.el9.x8 1.7 MB/s | 85 kB 00:00 2024-07-24T21:53:04.987 INFO:teuthology.orchestra.run.smithi188.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-07-24T21:53:05.004 INFO:teuthology.orchestra.run.smithi188.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 920 kB/s | 36 kB 00:00 2024-07-24T21:53:05.021 INFO:teuthology.orchestra.run.smithi188.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.5 MB/s | 47 kB 00:00 2024-07-24T21:53:05.055 INFO:teuthology.orchestra.run.smithi188.stdout:(98/160): socat-1.7.4.1-6.el9.x86_64.rpm 6.1 MB/s | 304 kB 00:00 2024-07-24T21:53:05.072 INFO:teuthology.orchestra.run.smithi188.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 1.2 MB/s | 58 kB 00:00 2024-07-24T21:53:05.097 INFO:teuthology.orchestra.run.smithi188.stdout:(100/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 2.3 MB/s | 96 kB 00:00 2024-07-24T21:53:05.114 INFO:teuthology.orchestra.run.smithi188.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.6 MB/s | 64 kB 00:00 2024-07-24T21:53:05.140 INFO:teuthology.orchestra.run.smithi188.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-07-24T21:53:05.156 INFO:teuthology.orchestra.run.smithi188.stdout:(103/160): lua-devel-5.4.4-4.el9.x86_64.rpm 577 kB/s | 22 kB 00:00 2024-07-24T21:53:05.215 INFO:teuthology.orchestra.run.smithi188.stdout:(104/160): protobuf-compiler-3.14.0-13.el9.x86_ 11 MB/s | 863 kB 00:00 2024-07-24T21:53:05.299 INFO:teuthology.orchestra.run.smithi183.stdout:(26/160): rbd-mirror-19.0.0-5197.g86385b1d.el9. 10 MB/s | 3.2 MB 00:00 2024-07-24T21:53:05.349 INFO:teuthology.orchestra.run.smithi183.stdout:(27/160): rbd-nbd-19.0.0-5197.g86385b1d.el9.x86 3.3 MB/s | 170 kB 00:00 2024-07-24T21:53:05.399 INFO:teuthology.orchestra.run.smithi183.stdout:(28/160): ceph-grafana-dashboards-19.0.0-5197.g 689 kB/s | 34 kB 00:00 2024-07-24T21:53:05.407 INFO:teuthology.orchestra.run.smithi188.stdout:(105/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-07-24T21:53:05.449 INFO:teuthology.orchestra.run.smithi183.stdout:(29/160): ceph-mgr-cephadm-19.0.0-5197.g86385b1 2.9 MB/s | 149 kB 00:00 2024-07-24T21:53:05.466 INFO:teuthology.orchestra.run.smithi188.stdout:(106/160): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-07-24T21:53:05.500 INFO:teuthology.orchestra.run.smithi188.stdout:(107/160): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-07-24T21:53:05.517 INFO:teuthology.orchestra.run.smithi188.stdout:(108/160): grpc-data-1.46.7-10.el9.noarch.rpm 183 kB/s | 19 kB 00:00 2024-07-24T21:53:05.542 INFO:teuthology.orchestra.run.smithi188.stdout:(109/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 619 kB/s | 26 kB 00:00 2024-07-24T21:53:05.559 INFO:teuthology.orchestra.run.smithi188.stdout:(110/160): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-07-24T21:53:05.584 INFO:teuthology.orchestra.run.smithi188.stdout:(111/160): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-07-24T21:53:05.609 INFO:teuthology.orchestra.run.smithi188.stdout:(112/160): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-07-24T21:53:05.637 INFO:teuthology.orchestra.run.smithi047.stdout:(30/160): ceph-test-19.0.0-5197.g86385b1d.el9.x 19 MB/s | 50 MB 00:02 2024-07-24T21:53:05.659 INFO:teuthology.orchestra.run.smithi188.stdout:(113/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-07-24T21:53:05.685 INFO:teuthology.orchestra.run.smithi188.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-07-24T21:53:05.687 INFO:teuthology.orchestra.run.smithi047.stdout:(31/160): rbd-mirror-19.0.0-5197.g86385b1d.el9. 3.4 MB/s | 3.2 MB 00:00 2024-07-24T21:53:05.710 INFO:teuthology.orchestra.run.smithi188.stdout:(115/160): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-07-24T21:53:05.736 INFO:teuthology.orchestra.run.smithi188.stdout:(116/160): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-07-24T21:53:05.761 INFO:teuthology.orchestra.run.smithi188.stdout:(117/160): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-07-24T21:53:05.778 INFO:teuthology.orchestra.run.smithi188.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-07-24T21:53:05.800 INFO:teuthology.orchestra.run.smithi183.stdout:(30/160): ceph-radosgw-19.0.0-5197.g86385b1d.el 4.6 MB/s | 11 MB 00:02 2024-07-24T21:53:05.804 INFO:teuthology.orchestra.run.smithi047.stdout:(32/160): ceph-mgr-modules-core-19.0.0-5197.g86 2.4 MB/s | 284 kB 00:00 2024-07-24T21:53:05.811 INFO:teuthology.orchestra.run.smithi188.stdout:(119/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-07-24T21:53:05.837 INFO:teuthology.orchestra.run.smithi188.stdout:(120/160): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-07-24T21:53:05.862 INFO:teuthology.orchestra.run.smithi188.stdout:(121/160): python3-google-auth-2.32.0-1.el9.noa 4.2 MB/s | 216 kB 00:00 2024-07-24T21:53:05.870 INFO:teuthology.orchestra.run.smithi047.stdout:(33/160): ceph-mgr-rook-19.0.0-5197.g86385b1d.e 742 kB/s | 49 kB 00:00 2024-07-24T21:53:05.887 INFO:teuthology.orchestra.run.smithi188.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-07-24T21:53:05.913 INFO:teuthology.orchestra.run.smithi188.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-07-24T21:53:05.929 INFO:teuthology.orchestra.run.smithi047.stdout:(34/160): ceph-prometheus-alerts-19.0.0-5197.g8 282 kB/s | 16 kB 00:00 2024-07-24T21:53:05.938 INFO:teuthology.orchestra.run.smithi188.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-07-24T21:53:05.957 INFO:teuthology.orchestra.run.smithi188.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 1.2 MB/s | 23 kB 00:00 2024-07-24T21:53:05.974 INFO:teuthology.orchestra.run.smithi188.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-07-24T21:53:05.991 INFO:teuthology.orchestra.run.smithi188.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-07-24T21:53:06.046 INFO:teuthology.orchestra.run.smithi047.stdout:(35/160): ceph-mgr-diskprediction-local-19.0.0- 18 MB/s | 7.4 MB 00:00 2024-07-24T21:53:06.066 INFO:teuthology.orchestra.run.smithi188.stdout:(128/160): libarrow-9.0.0-11.el9.x86_64.rpm 7.4 MB/s | 4.4 MB 00:00 2024-07-24T21:53:06.071 INFO:teuthology.orchestra.run.smithi047.stdout:(36/160): ceph-volume-19.0.0-5197.g86385b1d.el9 1.9 MB/s | 274 kB 00:00 2024-07-24T21:53:06.083 INFO:teuthology.orchestra.run.smithi188.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-07-24T21:53:06.108 INFO:teuthology.orchestra.run.smithi188.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-07-24T21:53:06.113 INFO:teuthology.orchestra.run.smithi047.stdout:(37/160): cephadm-19.0.0-5197.g86385b1d.el9.noa 11 MB/s | 771 kB 00:00 2024-07-24T21:53:06.130 INFO:teuthology.orchestra.run.smithi047.stdout:(38/160): cephfs-top-19.0.0-5197.g86385b1d.el9. 312 kB/s | 18 kB 00:00 2024-07-24T21:53:06.134 INFO:teuthology.orchestra.run.smithi188.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-07-24T21:53:06.176 INFO:teuthology.orchestra.run.smithi188.stdout:(132/160): python3-grpcio-1.46.7-10.el9.x86_64. 6.0 MB/s | 2.0 MB 00:00 2024-07-24T21:53:06.201 INFO:teuthology.orchestra.run.smithi188.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-07-24T21:53:06.226 INFO:teuthology.orchestra.run.smithi188.stdout:(134/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-07-24T21:53:06.252 INFO:teuthology.orchestra.run.smithi188.stdout:(135/160): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-07-24T21:53:06.277 INFO:teuthology.orchestra.run.smithi188.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-07-24T21:53:06.302 INFO:teuthology.orchestra.run.smithi188.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-07-24T21:53:06.336 INFO:teuthology.orchestra.run.smithi188.stdout:(138/160): python3-kubernetes-26.1.0-2.el9.noar 3.0 MB/s | 1.0 MB 00:00 2024-07-24T21:53:06.356 INFO:teuthology.orchestra.run.smithi047.stdout:(39/160): ceph-mgr-dashboard-19.0.0-5197.g86385 9.9 MB/s | 14 MB 00:01 2024-07-24T21:53:06.361 INFO:teuthology.orchestra.run.smithi188.stdout:(139/160): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-07-24T21:53:06.381 INFO:teuthology.orchestra.run.smithi047.stdout:(40/160): fuse-2.9.9-16.el9.x86_64.rpm 298 kB/s | 80 kB 00:00 2024-07-24T21:53:06.386 INFO:teuthology.orchestra.run.smithi188.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-07-24T21:53:06.412 INFO:teuthology.orchestra.run.smithi188.stdout:(141/160): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-07-24T21:53:06.425 INFO:teuthology.orchestra.run.smithi183.stdout:(31/160): ceph-mgr-dashboard-19.0.0-5197.g86385 14 MB/s | 14 MB 00:00 2024-07-24T21:53:06.431 INFO:teuthology.orchestra.run.smithi047.stdout:(41/160): libquadmath-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 195 kB 00:00 2024-07-24T21:53:06.437 INFO:teuthology.orchestra.run.smithi188.stdout:(142/160): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2024-07-24T21:53:06.462 INFO:teuthology.orchestra.run.smithi188.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-07-24T21:53:06.465 INFO:teuthology.orchestra.run.smithi047.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-07-24T21:53:06.475 INFO:teuthology.orchestra.run.smithi183.stdout:(32/160): ceph-mgr-modules-core-19.0.0-5197.g86 5.6 MB/s | 284 kB 00:00 2024-07-24T21:53:06.490 INFO:teuthology.orchestra.run.smithi188.stdout:(144/160): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-07-24T21:53:06.490 INFO:teuthology.orchestra.run.smithi047.stdout:(43/160): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-07-24T21:53:06.513 INFO:teuthology.orchestra.run.smithi188.stdout:(145/160): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-07-24T21:53:06.525 INFO:teuthology.orchestra.run.smithi183.stdout:(33/160): ceph-mgr-rook-19.0.0-5197.g86385b1d.e 986 kB/s | 49 kB 00:00 2024-07-24T21:53:06.538 INFO:teuthology.orchestra.run.smithi188.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-07-24T21:53:06.541 INFO:teuthology.orchestra.run.smithi047.stdout:(44/160): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-07-24T21:53:06.564 INFO:teuthology.orchestra.run.smithi188.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-07-24T21:53:06.567 INFO:teuthology.orchestra.run.smithi183.stdout:(34/160): ceph-prometheus-alerts-19.0.0-5197.g8 398 kB/s | 16 kB 00:00 2024-07-24T21:53:06.574 INFO:teuthology.orchestra.run.smithi047.stdout:(45/160): python3-ply-3.11-14.el9.noarch.rpm 987 kB/s | 106 kB 00:00 2024-07-24T21:53:06.599 INFO:teuthology.orchestra.run.smithi047.stdout:(46/160): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-07-24T21:53:06.605 INFO:teuthology.orchestra.run.smithi188.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-07-24T21:53:06.618 INFO:teuthology.orchestra.run.smithi183.stdout:(35/160): ceph-volume-19.0.0-5197.g86385b1d.el9 5.4 MB/s | 274 kB 00:00 2024-07-24T21:53:06.625 INFO:teuthology.orchestra.run.smithi047.stdout:(47/160): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-07-24T21:53:06.650 INFO:teuthology.orchestra.run.smithi047.stdout:(48/160): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-07-24T21:53:06.675 INFO:teuthology.orchestra.run.smithi047.stdout:(49/160): automake-1.16.2-8.el9.noarch.rpm 9.0 MB/s | 689 kB 00:00 2024-07-24T21:53:06.685 INFO:teuthology.orchestra.run.smithi183.stdout:(36/160): cephadm-19.0.0-5197.g86385b1d.el9.noa 11 MB/s | 771 kB 00:00 2024-07-24T21:53:06.697 INFO:teuthology.orchestra.run.smithi188.stdout:(149/160): NetworkManager-1.48.2-2.el9.x86_64.r 25 MB/s | 2.3 MB 00:00 2024-07-24T21:53:06.726 INFO:teuthology.orchestra.run.smithi047.stdout:(50/160): bison-3.7.4-5.el9.x86_64.rpm 9.3 MB/s | 943 kB 00:00 2024-07-24T21:53:06.735 INFO:teuthology.orchestra.run.smithi183.stdout:(37/160): cephfs-top-19.0.0-5197.g86385b1d.el9. 366 kB/s | 18 kB 00:00 2024-07-24T21:53:06.751 INFO:teuthology.orchestra.run.smithi047.stdout:(51/160): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-07-24T21:53:06.768 INFO:teuthology.orchestra.run.smithi047.stdout:(52/160): elfutils-libelf-devel-0.191-4.el9.x86 238 kB/s | 22 kB 00:00 2024-07-24T21:53:06.781 INFO:teuthology.orchestra.run.smithi188.stdout:(150/160): NetworkManager-libnm-1.48.2-2.el9.x8 22 MB/s | 1.8 MB 00:00 2024-07-24T21:53:06.801 INFO:teuthology.orchestra.run.smithi047.stdout:(53/160): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-07-24T21:53:06.814 INFO:teuthology.orchestra.run.smithi188.stdout:(151/160): NetworkManager-team-1.48.2-2.el9.x86 1.2 MB/s | 41 kB 00:00 2024-07-24T21:53:06.827 INFO:teuthology.orchestra.run.smithi047.stdout:(54/160): flexiblas-3.0.4-8.el9.x86_64.rpm 566 kB/s | 33 kB 00:00 2024-07-24T21:53:06.828 INFO:teuthology.orchestra.run.smithi183.stdout:(38/160): fuse-2.9.9-16.el9.x86_64.rpm 870 kB/s | 80 kB 00:00 2024-07-24T21:53:06.856 INFO:teuthology.orchestra.run.smithi188.stdout:(152/160): NetworkManager-tui-1.48.2-2.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-07-24T21:53:06.890 INFO:teuthology.orchestra.run.smithi188.stdout:(153/160): elfutils-debuginfod-client-0.191-4.e 1.1 MB/s | 37 kB 00:00 2024-07-24T21:53:06.894 INFO:teuthology.orchestra.run.smithi183.stdout:(39/160): libgfortran-11.4.1-3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2024-07-24T21:53:06.927 INFO:teuthology.orchestra.run.smithi183.stdout:(40/160): libquadmath-11.4.1-3.el9.x86_64.rpm 5.7 MB/s | 195 kB 00:00 2024-07-24T21:53:06.935 INFO:teuthology.orchestra.run.smithi047.stdout:(55/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-07-24T21:53:06.957 INFO:teuthology.orchestra.run.smithi188.stdout:(154/160): librbd1-19.0.0-5197.g86385b1d.el9.x8 8.2 MB/s | 3.2 MB 00:00 2024-07-24T21:53:06.961 INFO:teuthology.orchestra.run.smithi047.stdout:(56/160): flexiblas-openblas-openmp-3.0.4-8.el9 115 kB/s | 18 kB 00:00 2024-07-24T21:53:06.982 INFO:teuthology.orchestra.run.smithi188.stdout:(155/160): elfutils-libelf-0.191-4.el9.x86_64.r 2.2 MB/s | 207 kB 00:00 2024-07-24T21:53:06.986 INFO:teuthology.orchestra.run.smithi047.stdout:(57/160): libaio-devel-0.3.111-13.el9.x86_64.rp 71 kB/s | 11 kB 00:00 2024-07-24T21:53:07.010 INFO:teuthology.orchestra.run.smithi188.stdout:(156/160): elfutils-libs-0.191-4.el9.x86_64.rpm 5.1 MB/s | 260 kB 00:00 2024-07-24T21:53:07.011 INFO:teuthology.orchestra.run.smithi047.stdout:(58/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-07-24T21:53:07.019 INFO:teuthology.orchestra.run.smithi183.stdout:(41/160): ceph-mgr-diskprediction-local-19.0.0- 6.1 MB/s | 7.4 MB 00:01 2024-07-24T21:53:07.036 INFO:teuthology.orchestra.run.smithi047.stdout:(59/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 910 kB/s | 45 kB 00:00 2024-07-24T21:53:07.042 INFO:teuthology.orchestra.run.smithi188.stdout:(157/160): openssl-3.2.2-2.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-07-24T21:53:07.044 INFO:teuthology.orchestra.run.smithi183.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-07-24T21:53:07.070 INFO:teuthology.orchestra.run.smithi047.stdout:(60/160): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-07-24T21:53:07.078 INFO:teuthology.orchestra.run.smithi183.stdout:(43/160): python3-cryptography-36.0.1-4.el9.x86 21 MB/s | 1.2 MB 00:00 2024-07-24T21:53:07.095 INFO:teuthology.orchestra.run.smithi047.stdout:(61/160): libtool-2.4.6-46.el9.x86_64.rpm 6.9 MB/s | 581 kB 00:00 2024-07-24T21:53:07.100 INFO:teuthology.orchestra.run.smithi188.stdout:(158/160): librados2-19.0.0-5197.g86385b1d.el9. 6.1 MB/s | 3.4 MB 00:00 2024-07-24T21:53:07.103 INFO:teuthology.orchestra.run.smithi183.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-07-24T21:53:07.120 INFO:teuthology.orchestra.run.smithi047.stdout:(62/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 308 kB/s | 25 kB 00:00 2024-07-24T21:53:07.129 INFO:teuthology.orchestra.run.smithi183.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-07-24T21:53:07.146 INFO:teuthology.orchestra.run.smithi047.stdout:(63/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-07-24T21:53:07.146 INFO:teuthology.orchestra.run.smithi183.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-07-24T21:53:07.150 INFO:teuthology.orchestra.run.smithi188.stdout:(159/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-07-24T21:53:07.171 INFO:teuthology.orchestra.run.smithi047.stdout:(64/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-07-24T21:53:07.171 INFO:teuthology.orchestra.run.smithi183.stdout:(47/160): python3-urllib3-1.26.5-6.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-07-24T21:53:07.183 INFO:teuthology.orchestra.run.smithi188.stdout:(160/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 7.7 MB/s | 1.1 MB 00:00 2024-07-24T21:53:07.192 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-07-24T21:53:07.192 INFO:teuthology.orchestra.run.smithi188.stdout:Total 26 MB/s | 240 MB 00:09 2024-07-24T21:53:07.196 INFO:teuthology.orchestra.run.smithi047.stdout:(65/160): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-07-24T21:53:07.196 INFO:teuthology.orchestra.run.smithi183.stdout:(48/160): automake-1.16.2-8.el9.noarch.rpm 14 MB/s | 689 kB 00:00 2024-07-24T21:53:07.221 INFO:teuthology.orchestra.run.smithi047.stdout:(66/160): openblas-0.3.21-2.el9.x86_64.rpm 474 kB/s | 35 kB 00:00 2024-07-24T21:53:07.238 INFO:teuthology.orchestra.run.smithi183.stdout:(49/160): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-07-24T21:53:07.255 INFO:teuthology.orchestra.run.smithi183.stdout:(50/160): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-07-24T21:53:07.281 INFO:teuthology.orchestra.run.smithi183.stdout:(51/160): elfutils-libelf-devel-0.191-4.el9.x86 522 kB/s | 22 kB 00:00 2024-07-24T21:53:07.314 INFO:teuthology.orchestra.run.smithi183.stdout:(52/160): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-07-24T21:53:07.339 INFO:teuthology.orchestra.run.smithi183.stdout:(53/160): flexiblas-3.0.4-8.el9.x86_64.rpm 564 kB/s | 33 kB 00:00 2024-07-24T21:53:07.398 INFO:teuthology.orchestra.run.smithi183.stdout:(54/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2024-07-24T21:53:07.405 INFO:teuthology.orchestra.run.smithi047.stdout:(67/160): openblas-openmp-0.3.21-2.el9.x86_64.r 23 MB/s | 4.7 MB 00:00 2024-07-24T21:53:07.447 INFO:teuthology.orchestra.run.smithi047.stdout:(68/160): postgresql-13.14-1.el9.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-07-24T21:53:07.456 INFO:teuthology.orchestra.run.smithi183.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 161 kB/s | 18 kB 00:00 2024-07-24T21:53:07.482 INFO:teuthology.orchestra.run.smithi183.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 11 kB 00:00 2024-07-24T21:53:07.508 INFO:teuthology.orchestra.run.smithi183.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-07-24T21:53:07.522 INFO:teuthology.orchestra.run.smithi047.stdout:(69/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-07-24T21:53:07.533 INFO:teuthology.orchestra.run.smithi183.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-07-24T21:53:07.556 INFO:teuthology.orchestra.run.smithi047.stdout:(70/160): postgresql-contrib-13.14-1.el9.x86_64 6.0 MB/s | 911 kB 00:00 2024-07-24T21:53:07.558 INFO:teuthology.orchestra.run.smithi183.stdout:(59/160): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-07-24T21:53:07.583 INFO:teuthology.orchestra.run.smithi183.stdout:(60/160): libtool-2.4.6-46.el9.x86_64.rpm 12 MB/s | 581 kB 00:00 2024-07-24T21:53:07.590 INFO:teuthology.orchestra.run.smithi047.stdout:(71/160): postgresql-private-libs-13.14-1.el9.x 968 kB/s | 133 kB 00:00 2024-07-24T21:53:07.609 INFO:teuthology.orchestra.run.smithi183.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 517 kB/s | 25 kB 00:00 2024-07-24T21:53:07.634 INFO:teuthology.orchestra.run.smithi183.stdout:(62/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-07-24T21:53:07.640 INFO:teuthology.orchestra.run.smithi047.stdout:(72/160): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-07-24T21:53:07.659 INFO:teuthology.orchestra.run.smithi183.stdout:(63/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-07-24T21:53:07.684 INFO:teuthology.orchestra.run.smithi183.stdout:(64/160): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-07-24T21:53:07.710 INFO:teuthology.orchestra.run.smithi183.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 706 kB/s | 35 kB 00:00 2024-07-24T21:53:07.718 INFO:teuthology.orchestra.run.smithi047.stdout:(73/160): postgresql-server-13.14-1.el9.x86_64. 36 MB/s | 5.8 MB 00:00 2024-07-24T21:53:07.740 INFO:teuthology.orchestra.run.smithi047.stdout:(74/160): python3-attrs-20.3.0-7.el9.noarch.rpm 594 kB/s | 87 kB 00:00 2024-07-24T21:53:07.777 INFO:teuthology.orchestra.run.smithi183.stdout:(66/160): openblas-openmp-0.3.21-2.el9.x86_64.r 52 MB/s | 4.7 MB 00:00 2024-07-24T21:53:07.833 INFO:teuthology.orchestra.run.smithi047.stdout:(75/160): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 6.0 MB 00:00 2024-07-24T21:53:07.844 INFO:teuthology.orchestra.run.smithi183.stdout:(67/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 34 MB/s | 4.4 MB 00:00 2024-07-24T21:53:07.858 INFO:teuthology.orchestra.run.smithi047.stdout:(76/160): python3-colorama-0.4.6-3.el9.noarch.r 539 kB/s | 61 kB 00:00 2024-07-24T21:53:07.883 INFO:teuthology.orchestra.run.smithi047.stdout:(77/160): python3-devel-3.9.18-3.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2024-07-24T21:53:07.886 INFO:teuthology.orchestra.run.smithi183.stdout:(68/160): postgresql-13.14-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-07-24T21:53:07.908 INFO:teuthology.orchestra.run.smithi047.stdout:(78/160): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-07-24T21:53:07.922 INFO:teuthology.orchestra.run.smithi183.stdout:(69/160): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-07-24T21:53:07.934 INFO:teuthology.orchestra.run.smithi047.stdout:(79/160): python3-jsonpatch-1.21-16.el9.noarch. 515 kB/s | 26 kB 00:00 2024-07-24T21:53:07.945 INFO:teuthology.orchestra.run.smithi183.stdout:(70/160): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 133 kB 00:00 2024-07-24T21:53:07.959 INFO:teuthology.orchestra.run.smithi047.stdout:(80/160): python3-jsonpointer-2.0-4.el9.noarch. 256 kB/s | 19 kB 00:00 2024-07-24T21:53:08.009 INFO:teuthology.orchestra.run.smithi047.stdout:(81/160): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-07-24T21:53:08.028 INFO:teuthology.orchestra.run.smithi183.stdout:(71/160): postgresql-server-13.14-1.el9.x86_64. 53 MB/s | 5.8 MB 00:00 2024-07-24T21:53:08.034 INFO:teuthology.orchestra.run.smithi047.stdout:(82/160): python3-markupsafe-1.1.1-12.el9.x86_6 466 kB/s | 35 kB 00:00 2024-07-24T21:53:08.062 INFO:teuthology.orchestra.run.smithi183.stdout:(72/160): protobuf-3.14.0-13.el9.x86_64.rpm 8.9 MB/s | 1.0 MB 00:00 2024-07-24T21:53:08.095 INFO:teuthology.orchestra.run.smithi183.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 2.6 MB/s | 87 kB 00:00 2024-07-24T21:53:08.109 INFO:teuthology.orchestra.run.smithi047.stdout:(83/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-07-24T21:53:08.143 INFO:teuthology.orchestra.run.smithi047.stdout:(84/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.9 MB/s | 250 kB 00:00 2024-07-24T21:53:08.168 INFO:teuthology.orchestra.run.smithi047.stdout:(85/160): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 222 kB 00:00 2024-07-24T21:53:08.194 INFO:teuthology.orchestra.run.smithi047.stdout:(86/160): python3-packaging-20.9-5.el9.noarch.r 932 kB/s | 77 kB 00:00 2024-07-24T21:53:08.196 INFO:teuthology.orchestra.run.smithi183.stdout:(74/160): python3-babel-2.9.1-2.el9.noarch.rpm 45 MB/s | 6.0 MB 00:00 2024-07-24T21:53:08.219 INFO:teuthology.orchestra.run.smithi047.stdout:(87/160): python3-prettytable-0.7.2-27.el9.noar 848 kB/s | 42 kB 00:00 2024-07-24T21:53:08.221 INFO:teuthology.orchestra.run.smithi183.stdout:(75/160): python3-colorama-0.4.6-3.el9.noarch.r 500 kB/s | 61 kB 00:00 2024-07-24T21:53:08.247 INFO:teuthology.orchestra.run.smithi183.stdout:(76/160): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-07-24T21:53:08.252 INFO:teuthology.orchestra.run.smithi047.stdout:(88/160): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-07-24T21:53:08.272 INFO:teuthology.orchestra.run.smithi183.stdout:(77/160): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-07-24T21:53:08.277 INFO:teuthology.orchestra.run.smithi047.stdout:(89/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-07-24T21:53:08.297 INFO:teuthology.orchestra.run.smithi183.stdout:(78/160): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-07-24T21:53:08.303 INFO:teuthology.orchestra.run.smithi047.stdout:(90/160): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-07-24T21:53:08.314 INFO:teuthology.orchestra.run.smithi183.stdout:(79/160): python3-jsonpointer-2.0-4.el9.noarch. 460 kB/s | 19 kB 00:00 2024-07-24T21:53:08.320 INFO:teuthology.orchestra.run.smithi047.stdout:(91/160): python3-pytz-2021.1-5.el9.noarch.rpm 767 kB/s | 51 kB 00:00 2024-07-24T21:53:08.337 INFO:teuthology.orchestra.run.smithi047.stdout:(92/160): python3-requests-oauthlib-1.3.0-12.el 926 kB/s | 54 kB 00:00 2024-07-24T21:53:08.339 INFO:teuthology.orchestra.run.smithi183.stdout:(80/160): python3-mako-1.1.4-6.el9.noarch.rpm 4.1 MB/s | 172 kB 00:00 2024-07-24T21:53:08.356 INFO:teuthology.orchestra.run.smithi183.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 842 kB/s | 35 kB 00:00 2024-07-24T21:53:08.370 INFO:teuthology.orchestra.run.smithi047.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-07-24T21:53:08.412 INFO:teuthology.orchestra.run.smithi047.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 613 kB/s | 44 kB 00:00 2024-07-24T21:53:08.432 INFO:teuthology.orchestra.run.smithi183.stdout:(82/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 55 MB/s | 5.1 MB 00:00 2024-07-24T21:53:08.449 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-07-24T21:53:08.457 INFO:teuthology.orchestra.run.smithi183.stdout:(83/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-07-24T21:53:08.482 INFO:teuthology.orchestra.run.smithi183.stdout:(84/160): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-07-24T21:53:08.507 INFO:teuthology.orchestra.run.smithi183.stdout:(85/160): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-07-24T21:53:08.534 INFO:teuthology.orchestra.run.smithi183.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-07-24T21:53:08.558 INFO:teuthology.orchestra.run.smithi183.stdout:(87/160): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-07-24T21:53:08.583 INFO:teuthology.orchestra.run.smithi183.stdout:(88/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-07-24T21:53:08.662 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-07-24T21:53:08.662 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-07-24T21:53:08.662 INFO:teuthology.orchestra.run.smithi047.stdout:(95/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 59 MB/s | 16 MB 00:00 2024-07-24T21:53:08.663 INFO:teuthology.orchestra.run.smithi047.stdout:(96/160): qatlib-24.02.0-1.el9.x86_64.rpm 893 kB/s | 221 kB 00:00 2024-07-24T21:53:08.663 INFO:teuthology.orchestra.run.smithi047.stdout:(97/160): qatlib-service-24.02.0-1.el9.x86_64.r 156 kB/s | 36 kB 00:00 2024-07-24T21:53:08.663 INFO:teuthology.orchestra.run.smithi183.stdout:(89/160): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-07-24T21:53:08.663 INFO:teuthology.orchestra.run.smithi183.stdout:(90/160): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-07-24T21:53:08.663 INFO:teuthology.orchestra.run.smithi183.stdout:(91/160): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-07-24T21:53:08.672 INFO:teuthology.orchestra.run.smithi047.stdout:(98/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 635 kB/s | 47 kB 00:00 2024-07-24T21:53:08.705 INFO:teuthology.orchestra.run.smithi047.stdout:(99/160): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-07-24T21:53:08.730 INFO:teuthology.orchestra.run.smithi047.stdout:(100/160): uuid-1.6.2-55.el9.x86_64.rpm 693 kB/s | 58 kB 00:00 2024-07-24T21:53:08.751 INFO:teuthology.orchestra.run.smithi183.stdout:(92/160): python3-toml-0.10.2-6.el9.noarch.rpm 470 kB/s | 42 kB 00:00 2024-07-24T21:53:08.755 INFO:teuthology.orchestra.run.smithi047.stdout:(101/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-07-24T21:53:08.781 INFO:teuthology.orchestra.run.smithi047.stdout:(102/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-07-24T21:53:08.806 INFO:teuthology.orchestra.run.smithi047.stdout:(103/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 594 kB/s | 45 kB 00:00 2024-07-24T21:53:08.832 INFO:teuthology.orchestra.run.smithi047.stdout:(104/160): lua-devel-5.4.4-4.el9.x86_64.rpm 296 kB/s | 22 kB 00:00 2024-07-24T21:53:08.873 INFO:teuthology.orchestra.run.smithi047.stdout:(105/160): protobuf-compiler-3.14.0-13.el9.x86_ 13 MB/s | 863 kB 00:00 2024-07-24T21:53:08.909 INFO:teuthology.orchestra.run.smithi183.stdout:(93/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 59 MB/s | 16 MB 00:00 2024-07-24T21:53:08.935 INFO:teuthology.orchestra.run.smithi183.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 243 kB/s | 44 kB 00:00 2024-07-24T21:53:08.960 INFO:teuthology.orchestra.run.smithi183.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-07-24T21:53:08.985 INFO:teuthology.orchestra.run.smithi183.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-07-24T21:53:09.008 INFO:teuthology.orchestra.run.smithi047.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 253 kB/s | 19 kB 00:00 2024-07-24T21:53:09.010 INFO:teuthology.orchestra.run.smithi183.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-07-24T21:53:09.036 INFO:teuthology.orchestra.run.smithi183.stdout:(98/160): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-07-24T21:53:09.041 INFO:teuthology.orchestra.run.smithi047.stdout:(107/160): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-07-24T21:53:09.061 INFO:teuthology.orchestra.run.smithi183.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-07-24T21:53:09.066 INFO:teuthology.orchestra.run.smithi047.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-07-24T21:53:09.087 INFO:teuthology.orchestra.run.smithi183.stdout:(100/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-07-24T21:53:09.091 INFO:teuthology.orchestra.run.smithi047.stdout:(109/160): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-07-24T21:53:09.112 INFO:teuthology.orchestra.run.smithi183.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-07-24T21:53:09.118 INFO:teuthology.orchestra.run.smithi047.stdout:(110/160): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-07-24T21:53:09.138 INFO:teuthology.orchestra.run.smithi183.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-07-24T21:53:09.142 INFO:teuthology.orchestra.run.smithi047.stdout:(111/160): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-07-24T21:53:09.165 INFO:teuthology.orchestra.run.smithi183.stdout:(103/160): lua-devel-5.4.4-4.el9.x86_64.rpm 425 kB/s | 22 kB 00:00 2024-07-24T21:53:09.167 INFO:teuthology.orchestra.run.smithi047.stdout:(112/160): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-07-24T21:53:09.198 INFO:teuthology.orchestra.run.smithi183.stdout:(104/160): protobuf-compiler-3.14.0-13.el9.x86_ 14 MB/s | 863 kB 00:00 2024-07-24T21:53:09.218 INFO:teuthology.orchestra.run.smithi047.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-07-24T21:53:09.243 INFO:teuthology.orchestra.run.smithi047.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-07-24T21:53:09.268 INFO:teuthology.orchestra.run.smithi047.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-07-24T21:53:09.285 INFO:teuthology.orchestra.run.smithi047.stdout:(116/160): python3-certifi-2023.05.07-4.el9.noa 842 kB/s | 14 kB 00:00 2024-07-24T21:53:09.299 INFO:teuthology.orchestra.run.smithi183.stdout:(105/160): abseil-cpp-20211102.0-3.el9.x86_64.r 4.0 MB/s | 548 kB 00:00 2024-07-24T21:53:09.319 INFO:teuthology.orchestra.run.smithi047.stdout:(117/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.6 MB/s | 839 kB 00:00 2024-07-24T21:53:09.324 INFO:teuthology.orchestra.run.smithi183.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-07-24T21:53:09.344 INFO:teuthology.orchestra.run.smithi047.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-07-24T21:53:09.349 INFO:teuthology.orchestra.run.smithi183.stdout:(107/160): gperftools-libs-2.9.1-2.el9.x86_64.r 2.0 MB/s | 309 kB 00:00 2024-07-24T21:53:09.374 INFO:teuthology.orchestra.run.smithi183.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-07-24T21:53:09.378 INFO:teuthology.orchestra.run.smithi047.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-07-24T21:53:09.399 INFO:teuthology.orchestra.run.smithi183.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-07-24T21:53:09.412 INFO:teuthology.orchestra.run.smithi047.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-07-24T21:53:09.425 INFO:teuthology.orchestra.run.smithi183.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-07-24T21:53:09.437 INFO:teuthology.orchestra.run.smithi047.stdout:(121/160): python3-google-auth-2.32.0-1.el9.noa 3.6 MB/s | 216 kB 00:00 2024-07-24T21:53:09.450 INFO:teuthology.orchestra.run.smithi183.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-07-24T21:53:09.470 INFO:teuthology.orchestra.run.smithi047.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-07-24T21:53:09.495 INFO:teuthology.orchestra.run.smithi047.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-07-24T21:53:09.500 INFO:teuthology.orchestra.run.smithi183.stdout:(112/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-07-24T21:53:09.521 INFO:teuthology.orchestra.run.smithi047.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-07-24T21:53:09.534 INFO:teuthology.orchestra.run.smithi183.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-07-24T21:53:09.546 INFO:teuthology.orchestra.run.smithi047.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-07-24T21:53:09.551 INFO:teuthology.orchestra.run.smithi183.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-07-24T21:53:09.568 INFO:teuthology.orchestra.run.smithi183.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-07-24T21:53:09.571 INFO:teuthology.orchestra.run.smithi047.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-07-24T21:53:09.585 INFO:teuthology.orchestra.run.smithi183.stdout:(116/160): python3-certifi-2023.05.07-4.el9.noa 853 kB/s | 14 kB 00:00 2024-07-24T21:53:09.597 INFO:teuthology.orchestra.run.smithi047.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-07-24T21:53:09.610 INFO:teuthology.orchestra.run.smithi183.stdout:(117/160): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-07-24T21:53:09.664 INFO:teuthology.orchestra.run.smithi047.stdout:(128/160): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-07-24T21:53:09.669 INFO:teuthology.orchestra.run.smithi183.stdout:(118/160): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-07-24T21:53:09.689 INFO:teuthology.orchestra.run.smithi047.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-07-24T21:53:09.694 INFO:teuthology.orchestra.run.smithi183.stdout:(119/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2024-07-24T21:53:09.714 INFO:teuthology.orchestra.run.smithi047.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-07-24T21:53:09.719 INFO:teuthology.orchestra.run.smithi183.stdout:(120/160): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-07-24T21:53:09.745 INFO:teuthology.orchestra.run.smithi183.stdout:(121/160): python3-google-auth-2.32.0-1.el9.noa 4.2 MB/s | 216 kB 00:00 2024-07-24T21:53:09.748 INFO:teuthology.orchestra.run.smithi047.stdout:(131/160): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-07-24T21:53:09.761 INFO:teuthology.orchestra.run.smithi183.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 8.6 MB/s | 144 kB 00:00 2024-07-24T21:53:09.773 INFO:teuthology.orchestra.run.smithi047.stdout:(132/160): python3-natsort-7.1.1-5.el9.noarch.r 980 kB/s | 58 kB 00:00 2024-07-24T21:53:09.787 INFO:teuthology.orchestra.run.smithi183.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-07-24T21:53:09.799 INFO:teuthology.orchestra.run.smithi047.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-07-24T21:53:09.812 INFO:teuthology.orchestra.run.smithi183.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-07-24T21:53:09.824 INFO:teuthology.orchestra.run.smithi047.stdout:(134/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-07-24T21:53:09.837 INFO:teuthology.orchestra.run.smithi183.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 934 kB/s | 23 kB 00:00 2024-07-24T21:53:09.862 INFO:teuthology.orchestra.run.smithi183.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-07-24T21:53:09.883 INFO:teuthology.orchestra.run.smithi047.stdout:(135/160): libarrow-9.0.0-11.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2024-07-24T21:53:09.888 INFO:teuthology.orchestra.run.smithi183.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 786 kB/s | 20 kB 00:00 2024-07-24T21:53:09.908 INFO:teuthology.orchestra.run.smithi047.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 337 kB/s | 28 kB 00:00 2024-07-24T21:53:09.933 INFO:teuthology.orchestra.run.smithi047.stdout:(137/160): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-07-24T21:53:09.938 INFO:teuthology.orchestra.run.smithi183.stdout:(128/160): python3-grpcio-1.46.7-10.el9.x86_64. 9.3 MB/s | 2.0 MB 00:00 2024-07-24T21:53:09.959 INFO:teuthology.orchestra.run.smithi047.stdout:(138/160): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-07-24T21:53:09.963 INFO:teuthology.orchestra.run.smithi183.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-07-24T21:53:09.984 INFO:teuthology.orchestra.run.smithi047.stdout:(139/160): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-07-24T21:53:09.988 INFO:teuthology.orchestra.run.smithi183.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-07-24T21:53:10.009 INFO:teuthology.orchestra.run.smithi047.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-07-24T21:53:10.014 INFO:teuthology.orchestra.run.smithi183.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-07-24T21:53:10.034 INFO:teuthology.orchestra.run.smithi047.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-07-24T21:53:10.056 INFO:teuthology.orchestra.run.smithi183.stdout:(132/160): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-07-24T21:53:10.059 INFO:teuthology.orchestra.run.smithi047.stdout:(142/160): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-07-24T21:53:10.081 INFO:teuthology.orchestra.run.smithi183.stdout:(133/160): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-07-24T21:53:10.093 INFO:teuthology.orchestra.run.smithi047.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-07-24T21:53:10.107 INFO:teuthology.orchestra.run.smithi183.stdout:(134/160): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-07-24T21:53:10.118 INFO:teuthology.orchestra.run.smithi047.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-07-24T21:53:10.132 INFO:teuthology.orchestra.run.smithi183.stdout:(135/160): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-07-24T21:53:10.144 INFO:teuthology.orchestra.run.smithi047.stdout:(145/160): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-07-24T21:53:10.169 INFO:teuthology.orchestra.run.smithi183.stdout:(136/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-07-24T21:53:10.170 INFO:teuthology.orchestra.run.smithi047.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-07-24T21:53:10.199 INFO:teuthology.orchestra.run.smithi183.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-07-24T21:53:10.200 INFO:teuthology.orchestra.run.smithi047.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.0 MB/s | 427 kB 00:00 2024-07-24T21:53:10.225 INFO:teuthology.orchestra.run.smithi183.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-07-24T21:53:10.253 INFO:teuthology.orchestra.run.smithi047.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-07-24T21:53:10.258 INFO:teuthology.orchestra.run.smithi183.stdout:(139/160): python3-tempora-5.0.0-2.el9.noarch.r 1.1 MB/s | 36 kB 00:00 2024-07-24T21:53:10.283 INFO:teuthology.orchestra.run.smithi183.stdout:(140/160): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-07-24T21:53:10.308 INFO:teuthology.orchestra.run.smithi183.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-07-24T21:53:10.320 INFO:teuthology.orchestra.run.smithi047.stdout:(149/160): NetworkManager-1.48.2-2.el9.x86_64.r 35 MB/s | 2.3 MB 00:00 2024-07-24T21:53:10.334 INFO:teuthology.orchestra.run.smithi183.stdout:(142/160): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-07-24T21:53:10.359 INFO:teuthology.orchestra.run.smithi183.stdout:(143/160): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-07-24T21:53:10.382 INFO:teuthology.orchestra.run.smithi047.stdout:(150/160): NetworkManager-libnm-1.48.2-2.el9.x8 31 MB/s | 1.8 MB 00:00 2024-07-24T21:53:10.384 INFO:teuthology.orchestra.run.smithi183.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-07-24T21:53:10.410 INFO:teuthology.orchestra.run.smithi183.stdout:(145/160): re2-20211101-3.el9.x86_64.rpm 7.5 MB/s | 192 kB 00:00 2024-07-24T21:53:10.412 INFO:teuthology.orchestra.run.smithi047.stdout:(151/160): NetworkManager-team-1.48.2-2.el9.x86 1.2 MB/s | 41 kB 00:00 2024-07-24T21:53:10.435 INFO:teuthology.orchestra.run.smithi183.stdout:(146/160): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-07-24T21:53:10.471 INFO:teuthology.orchestra.run.smithi047.stdout:(152/160): librados2-19.0.0-5197.g86385b1d.el9. 11 MB/s | 3.4 MB 00:00 2024-07-24T21:53:10.485 INFO:teuthology.orchestra.run.smithi183.stdout:(147/160): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-07-24T21:53:10.496 INFO:teuthology.orchestra.run.smithi047.stdout:(153/160): NetworkManager-tui-1.48.2-2.el9.x86_ 2.9 MB/s | 247 kB 00:00 2024-07-24T21:53:10.513 INFO:teuthology.orchestra.run.smithi047.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 887 kB/s | 37 kB 00:00 2024-07-24T21:53:10.536 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-07-24T21:53:10.536 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-07-24T21:53:10.538 INFO:teuthology.orchestra.run.smithi047.stdout:(155/160): elfutils-libelf-0.191-4.el9.x86_64.r 4.9 MB/s | 207 kB 00:00 2024-07-24T21:53:10.564 INFO:teuthology.orchestra.run.smithi047.stdout:(156/160): elfutils-libs-0.191-4.el9.x86_64.rpm 5.1 MB/s | 260 kB 00:00 2024-07-24T21:53:10.598 INFO:teuthology.orchestra.run.smithi047.stdout:(157/160): openssl-3.2.2-2.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-07-24T21:53:10.648 INFO:teuthology.orchestra.run.smithi047.stdout:(158/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-07-24T21:53:10.690 INFO:teuthology.orchestra.run.smithi047.stdout:(159/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-07-24T21:53:10.749 INFO:teuthology.orchestra.run.smithi047.stdout:(160/160): librbd1-19.0.0-5197.g86385b1d.el9.x8 5.9 MB/s | 3.2 MB 00:00 2024-07-24T21:53:10.757 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-07-24T21:53:10.757 INFO:teuthology.orchestra.run.smithi047.stdout:Total 21 MB/s | 240 MB 00:11 2024-07-24T21:53:10.785 INFO:teuthology.orchestra.run.smithi183.stdout:(148/160): librbd1-19.0.0-5197.g86385b1d.el9.x8 11 MB/s | 3.2 MB 00:00 2024-07-24T21:53:10.853 INFO:teuthology.orchestra.run.smithi183.stdout:(149/160): NetworkManager-1.48.2-2.el9.x86_64.r 35 MB/s | 2.3 MB 00:00 2024-07-24T21:53:10.911 INFO:teuthology.orchestra.run.smithi183.stdout:(150/160): NetworkManager-libnm-1.48.2-2.el9.x8 31 MB/s | 1.8 MB 00:00 2024-07-24T21:53:10.945 INFO:teuthology.orchestra.run.smithi183.stdout:(151/160): NetworkManager-team-1.48.2-2.el9.x86 1.2 MB/s | 41 kB 00:00 2024-07-24T21:53:10.978 INFO:teuthology.orchestra.run.smithi183.stdout:(152/160): NetworkManager-tui-1.48.2-2.el9.x86_ 7.3 MB/s | 247 kB 00:00 2024-07-24T21:53:11.029 INFO:teuthology.orchestra.run.smithi183.stdout:(153/160): librados2-19.0.0-5197.g86385b1d.el9. 5.7 MB/s | 3.4 MB 00:00 2024-07-24T21:53:11.045 INFO:teuthology.orchestra.run.smithi183.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 548 kB/s | 37 kB 00:00 2024-07-24T21:53:11.071 INFO:teuthology.orchestra.run.smithi183.stdout:(155/160): elfutils-libelf-0.191-4.el9.x86_64.r 4.8 MB/s | 207 kB 00:00 2024-07-24T21:53:11.096 INFO:teuthology.orchestra.run.smithi183.stdout:(156/160): elfutils-libs-0.191-4.el9.x86_64.rpm 5.1 MB/s | 260 kB 00:00 2024-07-24T21:53:11.138 INFO:teuthology.orchestra.run.smithi183.stdout:(157/160): openssl-3.2.2-2.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-07-24T21:53:11.189 INFO:teuthology.orchestra.run.smithi183.stdout:(158/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 27 MB/s | 2.4 MB 00:00 2024-07-24T21:53:11.222 INFO:teuthology.orchestra.run.smithi183.stdout:(159/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-07-24T21:53:12.049 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-07-24T21:53:12.181 INFO:teuthology.orchestra.run.smithi183.stdout:(160/160): ceph-test-19.0.0-5197.g86385b1d.el9. 6.0 MB/s | 50 MB 00:08 2024-07-24T21:53:12.188 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-07-24T21:53:12.188 INFO:teuthology.orchestra.run.smithi183.stdout:Total 17 MB/s | 240 MB 00:13 2024-07-24T21:53:12.278 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-07-24T21:53:12.278 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-07-24T21:53:13.427 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-07-24T21:53:13.626 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-07-24T21:53:13.626 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-07-24T21:53:14.637 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-07-24T21:53:14.638 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-07-24T21:53:15.710 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-07-24T21:53:15.711 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-07-24T21:53:16.849 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-07-24T21:53:16.912 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-07-24T21:53:16.950 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-07-24T21:53:17.012 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-07-24T21:53:17.327 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-07-24T21:53:17.436 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 5/172 2024-07-24T21:53:17.559 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 5/172 2024-07-24T21:53:17.588 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T21:53:17.680 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T21:53:17.716 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 7/172 2024-07-24T21:53:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/172 2024-07-24T21:53:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/172 2024-07-24T21:53:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/172 2024-07-24T21:53:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 11/172 2024-07-24T21:53:18.027 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 12/172 2024-07-24T21:53:18.076 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-07-24T21:53:18.096 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T21:53:18.201 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T21:53:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 15/172 2024-07-24T21:53:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 15/172 2024-07-24T21:53:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-24T21:53:18.322 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-24T21:53:18.515 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-24T21:53:18.607 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-24T21:53:18.811 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-07-24T21:53:18.981 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-24T21:53:19.024 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-24T21:53:19.130 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T21:53:19.234 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T21:53:19.428 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T21:53:19.543 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-07-24T21:53:19.580 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-07-24T21:53:19.615 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-07-24T21:53:19.697 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-07-24T21:53:19.750 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-07-24T21:53:19.790 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-07-24T21:53:19.834 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-07-24T21:53:19.865 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-07-24T21:53:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-07-24T21:53:19.961 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-07-24T21:53:20.015 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-07-24T21:53:20.046 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-07-24T21:53:20.082 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-07-24T21:53:20.157 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-07-24T21:53:20.192 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-common-2:19.0.0-5197.g86385b1d.el9. 35/172 2024-07-24T21:53:20.227 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el 36/172 2024-07-24T21:53:20.256 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_6 37/172 2024-07-24T21:53:20.325 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-07-24T21:53:20.371 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-07-24T21:53:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-07-24T21:53:20.578 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-07-24T21:53:20.631 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-07-24T21:53:21.156 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-07-24T21:53:21.235 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-07-24T21:53:21.264 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-07-24T21:53:21.267 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-07-24T21:53:21.300 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-07-24T21:53:21.345 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-07-24T21:53:21.346 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-07-24T21:53:21.384 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/172 2024-07-24T21:53:21.384 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-07-24T21:53:21.430 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_6 49/172 2024-07-24T21:53:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-07-24T21:53:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-07-24T21:53:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 51/172 2024-07-24T21:53:21.732 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-07-24T21:53:21.789 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-07-24T21:53:21.797 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 53/172 2024-07-24T21:53:21.871 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-07-24T21:53:21.902 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 5/172 2024-07-24T21:53:21.908 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-07-24T21:53:21.945 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/172 2024-07-24T21:53:21.992 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-07-24T21:53:22.021 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 5/172 2024-07-24T21:53:22.036 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-07-24T21:53:22.054 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T21:53:22.079 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-07-24T21:53:22.091 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-07-24T21:53:22.122 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-07-24T21:53:22.147 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T21:53:22.160 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-07-24T21:53:22.182 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 7/172 2024-07-24T21:53:22.198 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-07-24T21:53:22.209 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/172 2024-07-24T21:53:22.246 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/172 2024-07-24T21:53:22.251 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-07-24T21:53:22.258 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-07-24T21:53:22.299 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/172 2024-07-24T21:53:22.394 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 11/172 2024-07-24T21:53:22.457 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-07-24T21:53:22.498 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-07-24T21:53:22.568 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-07-24T21:53:22.596 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-07-24T21:53:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 12/172 2024-07-24T21:53:22.631 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-07-24T21:53:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-07-24T21:53:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-07-24T21:53:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T21:53:22.684 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 5/172 2024-07-24T21:53:22.696 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-07-24T21:53:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-07-24T21:53:22.778 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T21:53:22.795 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-07-24T21:53:22.806 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 5/172 2024-07-24T21:53:22.806 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 15/172 2024-07-24T21:53:22.835 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T21:53:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 15/172 2024-07-24T21:53:22.899 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-24T21:53:22.922 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-07-24T21:53:22.924 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-24T21:53:22.943 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T21:53:22.954 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-07-24T21:53:22.973 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-07-24T21:53:22.979 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 7/172 2024-07-24T21:53:23.005 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/172 2024-07-24T21:53:23.007 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-07-24T21:53:23.031 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/172 2024-07-24T21:53:23.046 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-07-24T21:53:23.064 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/172 2024-07-24T21:53:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-24T21:53:23.078 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-07-24T21:53:23.108 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-07-24T21:53:23.140 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 11/172 2024-07-24T21:53:23.142 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-07-24T21:53:23.175 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-07-24T21:53:23.187 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-24T21:53:23.217 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-07-24T21:53:23.277 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-07-24T21:53:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 12/172 2024-07-24T21:53:23.347 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-07-24T21:53:23.363 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-07-24T21:53:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T21:53:23.407 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-07-24T21:53:23.427 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-07-24T21:53:23.438 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-07-24T21:53:23.481 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T21:53:23.502 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 15/172 2024-07-24T21:53:23.541 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-07-24T21:53:23.564 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 15/172 2024-07-24T21:53:23.586 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-24T21:53:23.589 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-24T21:53:23.592 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-24T21:53:23.612 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-24T21:53:23.642 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-24T21:53:23.733 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T21:53:23.804 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-24T21:53:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T21:53:23.905 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-24T21:53:24.034 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T21:53:24.085 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-07-24T21:53:24.145 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-07-24T21:53:24.173 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-07-24T21:53:24.208 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-07-24T21:53:24.261 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-24T21:53:24.285 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-07-24T21:53:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-07-24T21:53:24.312 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-24T21:53:24.344 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-07-24T21:53:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-07-24T21:53:24.392 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-07-24T21:53:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-07-24T21:53:24.413 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T21:53:24.436 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-07-24T21:53:24.477 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-07-24T21:53:24.485 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-07-24T21:53:24.498 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T21:53:24.504 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-07-24T21:53:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-07-24T21:53:24.578 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-07-24T21:53:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-07-24T21:53:24.637 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-07-24T21:53:24.665 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-07-24T21:53:24.666 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-07-24T21:53:24.691 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T21:53:24.710 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-07-24T21:53:24.714 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-07-24T21:53:24.803 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-07-24T21:53:24.805 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-07-24T21:53:24.834 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-07-24T21:53:24.845 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:19.0.0-5197.g86385b1d.el9. 35/172 2024-07-24T21:53:24.869 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-07-24T21:53:24.889 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el 36/172 2024-07-24T21:53:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-07-24T21:53:24.917 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_6 37/172 2024-07-24T21:53:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-07-24T21:53:24.942 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-07-24T21:53:24.993 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-07-24T21:53:24.997 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-07-24T21:53:24.998 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-07-24T21:53:25.035 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-07-24T21:53:25.040 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-07-24T21:53:25.079 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-07-24T21:53:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-07-24T21:53:25.120 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-07-24T21:53:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-07-24T21:53:25.208 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-07-24T21:53:25.269 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-07-24T21:53:25.269 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-07-24T21:53:25.301 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-07-24T21:53:25.320 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-07-24T21:53:25.336 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-07-24T21:53:25.413 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-07-24T21:53:25.455 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:19.0.0-5197.g86385b1d.el9. 35/172 2024-07-24T21:53:25.498 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el 36/172 2024-07-24T21:53:25.527 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_6 37/172 2024-07-24T21:53:25.596 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-07-24T21:53:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-07-24T21:53:25.641 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-07-24T21:53:25.714 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-07-24T21:53:25.760 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-07-24T21:53:25.854 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-07-24T21:53:25.888 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-07-24T21:53:25.910 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-07-24T21:53:25.976 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-07-24T21:53:26.009 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-07-24T21:53:26.052 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-07-24T21:53:26.099 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-07-24T21:53:26.146 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/172 2024-07-24T21:53:26.192 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_6 49/172 2024-07-24T21:53:26.357 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-07-24T21:53:26.419 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 51/172 2024-07-24T21:53:26.447 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-07-24T21:53:26.516 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-07-24T21:53:26.530 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-07-24T21:53:26.577 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 53/172 2024-07-24T21:53:26.583 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-07-24T21:53:26.613 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-07-24T21:53:26.658 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-07-24T21:53:26.696 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/172 2024-07-24T21:53:26.741 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_6 49/172 2024-07-24T21:53:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-07-24T21:53:26.888 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-07-24T21:53:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-07-24T21:53:26.944 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 51/172 2024-07-24T21:53:26.966 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/172 2024-07-24T21:53:26.969 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-07-24T21:53:27.014 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-07-24T21:53:27.034 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-07-24T21:53:27.048 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-07-24T21:53:27.065 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-07-24T21:53:27.091 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 53/172 2024-07-24T21:53:27.092 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-07-24T21:53:27.092 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-07-24T21:53:27.125 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-07-24T21:53:27.134 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-07-24T21:53:27.172 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-07-24T21:53:27.204 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-07-24T21:53:27.241 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/172 2024-07-24T21:53:27.280 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-07-24T21:53:27.286 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-07-24T21:53:27.323 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-07-24T21:53:27.327 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-07-24T21:53:27.366 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-07-24T21:53:27.369 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-07-24T21:53:27.416 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-07-24T21:53:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-07-24T21:53:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-07-24T21:53:27.489 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 104/172 2024-07-24T21:53:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-07-24T21:53:27.550 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-07-24T21:53:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-07-24T21:53:27.579 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 104/172 2024-07-24T21:53:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-07-24T21:53:27.610 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 105/172 2024-07-24T21:53:27.625 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-07-24T21:53:27.646 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-07-24T21:53:27.676 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-07-24T21:53:27.729 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-07-24T21:53:27.866 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-07-24T21:53:27.902 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-07-24T21:53:27.907 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-07-24T21:53:27.935 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-07-24T21:53:27.970 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-07-24T21:53:28.003 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-07-24T21:53:28.009 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-07-24T21:53:28.034 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-07-24T21:53:28.049 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-07-24T21:53:28.075 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-07-24T21:53:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-07-24T21:53:28.113 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-07-24T21:53:28.117 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-07-24T21:53:28.137 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-07-24T21:53:28.141 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-07-24T21:53:28.163 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-07-24T21:53:28.167 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 108/172 2024-07-24T21:53:28.205 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-07-24T21:53:28.217 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-07-24T21:53:28.230 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 108/172 2024-07-24T21:53:28.239 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-07-24T21:53:28.260 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 109/172 2024-07-24T21:53:28.330 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-07-24T21:53:28.341 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-07-24T21:53:28.382 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-07-24T21:53:28.396 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-07-24T21:53:28.409 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-07-24T21:53:28.426 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-07-24T21:53:28.444 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-07-24T21:53:28.483 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-07-24T21:53:28.523 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-07-24T21:53:28.535 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-07-24T21:53:28.553 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-07-24T21:53:28.586 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-24T21:53:28.587 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-07-24T21:53:28.621 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-07-24T21:53:28.662 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-07-24T21:53:28.696 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-07-24T21:53:28.783 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-07-24T21:53:28.835 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-07-24T21:53:28.866 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-07-24T21:53:28.969 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-07-24T21:53:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-24T21:53:29.373 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-07-24T21:53:29.424 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-07-24T21:53:29.466 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-07-24T21:53:29.580 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-07-24T21:53:29.639 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-07-24T21:53:29.684 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-07-24T21:53:29.771 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-07-24T21:53:29.776 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-07-24T21:53:29.810 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-07-24T21:53:29.822 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-07-24T21:53:29.856 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-07-24T21:53:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-07-24T21:53:29.994 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-07-24T21:53:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-07-24T21:53:30.024 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-07-24T21:53:30.055 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-07-24T21:53:30.113 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-07-24T21:53:30.143 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-07-24T21:53:30.183 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-07-24T21:53:30.361 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-07-24T21:53:30.389 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-07-24T21:53:30.468 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-07-24T21:53:30.527 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T21:53:30.556 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T21:53:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-07-24T21:53:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-07-24T21:53:31.102 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T21:53:31.110 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-07-24T21:53:31.158 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 111/172 2024-07-24T21:53:31.228 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-07-24T21:53:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 111/172 2024-07-24T21:53:31.254 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-07-24T21:53:31.254 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-07-24T21:53:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:53:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 112/172 2024-07-24T21:53:32.316 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-07-24T21:53:32.394 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-07-24T21:53:32.422 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-07-24T21:53:32.447 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-07-24T21:53:32.455 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-07-24T21:53:32.525 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-07-24T21:53:32.553 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-07-24T21:53:32.586 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-07-24T21:53:32.806 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-07-24T21:53:32.907 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-07-24T21:53:32.949 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 104/172 2024-07-24T21:53:33.040 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 104/172 2024-07-24T21:53:33.071 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 105/172 2024-07-24T21:53:33.107 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-07-24T21:53:33.143 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 104/172 2024-07-24T21:53:33.253 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 104/172 2024-07-24T21:53:33.282 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 105/172 2024-07-24T21:53:33.318 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-07-24T21:53:33.595 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-07-24T21:53:33.627 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 108/172 2024-07-24T21:53:33.698 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 108/172 2024-07-24T21:53:33.729 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 109/172 2024-07-24T21:53:33.837 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-07-24T21:53:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 108/172 2024-07-24T21:53:33.942 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 108/172 2024-07-24T21:53:33.981 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 109/172 2024-07-24T21:53:36.039 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T21:53:36.070 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T21:53:36.339 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T21:53:36.369 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T21:53:36.617 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T21:53:36.656 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 111/172 2024-07-24T21:53:36.754 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 111/172 2024-07-24T21:53:36.755 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-07-24T21:53:36.755 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-07-24T21:53:36.755 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:53:36.782 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 112/172 2024-07-24T21:53:36.956 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T21:53:37.005 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 111/172 2024-07-24T21:53:37.085 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 111/172 2024-07-24T21:53:37.085 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-07-24T21:53:37.085 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-07-24T21:53:37.085 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:53:37.123 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 112/172 2024-07-24T21:53:43.102 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 112/172 2024-07-24T21:53:43.102 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /sys 2024-07-24T21:53:43.103 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /proc 2024-07-24T21:53:43.103 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /mnt 2024-07-24T21:53:43.103 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /var/tmp 2024-07-24T21:53:43.103 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /home 2024-07-24T21:53:43.103 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /root 2024-07-24T21:53:43.103 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /tmp 2024-07-24T21:53:43.103 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:53:43.280 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 113/172 2024-07-24T21:53:43.296 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 113/172 2024-07-24T21:53:43.296 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:43.296 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-07-24T21:53:43.296 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:53:44.783 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 114/172 2024-07-24T21:53:44.809 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 114/172 2024-07-24T21:53:44.809 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:44.809 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-07-24T21:53:44.809 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-24T21:53:44.809 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-24T21:53:44.809 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:53:45.034 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 115/172 2024-07-24T21:53:45.057 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 115/172 2024-07-24T21:53:45.057 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:45.057 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-07-24T21:53:45.057 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-24T21:53:45.057 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-24T21:53:45.057 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:53:45.501 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 116/172 2024-07-24T21:53:45.524 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 116/172 2024-07-24T21:53:45.524 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:45.524 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-07-24T21:53:45.524 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-24T21:53:45.524 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-24T21:53:45.524 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:53:45.631 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-07-24T21:53:45.688 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-07-24T21:53:45.743 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-07-24T21:53:45.927 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-07-24T21:53:45.977 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-07-24T21:53:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-07-24T21:53:46.142 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-07-24T21:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-07-24T21:53:46.327 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-07-24T21:53:46.359 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-07-24T21:53:46.387 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-07-24T21:53:46.801 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 128/172 2024-07-24T21:53:46.836 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 128/172 2024-07-24T21:53:46.868 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.e 129/172 2024-07-24T21:53:46.933 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d. 130/172 2024-07-24T21:53:46.959 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 131/172 2024-07-24T21:53:48.309 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 112/172 2024-07-24T21:53:48.309 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2024-07-24T21:53:48.309 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2024-07-24T21:53:48.309 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2024-07-24T21:53:48.309 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2024-07-24T21:53:48.309 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2024-07-24T21:53:48.309 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /root 2024-07-24T21:53:48.310 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2024-07-24T21:53:48.310 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:53:48.489 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 113/172 2024-07-24T21:53:48.505 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 113/172 2024-07-24T21:53:48.505 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:48.505 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-07-24T21:53:48.505 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:53:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 112/172 2024-07-24T21:53:49.080 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-07-24T21:53:49.080 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-07-24T21:53:49.080 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-07-24T21:53:49.080 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-07-24T21:53:49.080 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-07-24T21:53:49.080 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-07-24T21:53:49.080 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-07-24T21:53:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:53:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 113/172 2024-07-24T21:53:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 113/172 2024-07-24T21:53:49.275 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:49.276 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-07-24T21:53:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:53:49.967 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 114/172 2024-07-24T21:53:49.993 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 114/172 2024-07-24T21:53:49.993 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:49.994 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-07-24T21:53:49.994 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-24T21:53:49.994 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-24T21:53:49.994 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:53:50.100 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 131/172 2024-07-24T21:53:50.157 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 132/172 2024-07-24T21:53:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 115/172 2024-07-24T21:53:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 115/172 2024-07-24T21:53:50.240 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:50.240 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-07-24T21:53:50.240 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-24T21:53:50.240 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-24T21:53:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:53:50.700 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 116/172 2024-07-24T21:53:50.723 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 116/172 2024-07-24T21:53:50.723 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:50.723 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-07-24T21:53:50.723 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-24T21:53:50.723 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-24T21:53:50.723 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:53:50.828 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 114/172 2024-07-24T21:53:50.831 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-07-24T21:53:50.856 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 114/172 2024-07-24T21:53:50.856 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:50.857 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-07-24T21:53:50.857 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-24T21:53:50.857 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-24T21:53:50.857 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:53:50.889 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-07-24T21:53:50.944 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-07-24T21:53:51.096 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 115/172 2024-07-24T21:53:51.114 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 132/172 2024-07-24T21:53:51.122 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 115/172 2024-07-24T21:53:51.122 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:51.122 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-07-24T21:53:51.122 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-24T21:53:51.122 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-24T21:53:51.122 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:53:51.140 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 133/172 2024-07-24T21:53:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-07-24T21:53:51.194 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-07-24T21:53:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 133/172 2024-07-24T21:53:51.272 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-07-24T21:53:51.362 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-07-24T21:53:51.428 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el 134/172 2024-07-24T21:53:51.459 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 135/172 2024-07-24T21:53:51.482 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 135/172 2024-07-24T21:53:51.482 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:51.482 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-07-24T21:53:51.482 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-24T21:53:51.482 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-24T21:53:51.482 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:53:51.507 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-07-24T21:53:51.526 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 136/172 2024-07-24T21:53:51.538 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 136/172 2024-07-24T21:53:51.560 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-07-24T21:53:51.592 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-07-24T21:53:51.598 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 116/172 2024-07-24T21:53:51.620 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-07-24T21:53:51.623 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 116/172 2024-07-24T21:53:51.623 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:51.623 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-07-24T21:53:51.623 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-24T21:53:51.623 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-24T21:53:51.623 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:53:51.636 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 137/172 2024-07-24T21:53:51.683 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 138/172 2024-07-24T21:53:51.737 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-07-24T21:53:51.795 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-07-24T21:53:51.860 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-07-24T21:53:52.055 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-07-24T21:53:52.059 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 128/172 2024-07-24T21:53:52.085 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 128/172 2024-07-24T21:53:52.108 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-07-24T21:53:52.117 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.e 129/172 2024-07-24T21:53:52.181 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d. 130/172 2024-07-24T21:53:52.189 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-07-24T21:53:52.217 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 131/172 2024-07-24T21:53:52.288 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-07-24T21:53:52.440 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-07-24T21:53:52.483 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-07-24T21:53:52.523 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-07-24T21:53:52.550 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-07-24T21:53:52.629 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-07-24T21:53:52.662 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 140/172 2024-07-24T21:53:52.685 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 140/172 2024-07-24T21:53:52.685 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:52.685 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-07-24T21:53:52.686 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-24T21:53:52.686 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-24T21:53:52.686 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:53:52.730 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5197.g86385 141/172 2024-07-24T21:53:52.751 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5197.g86385 141/172 2024-07-24T21:53:52.752 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:52.752 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-07-24T21:53:52.752 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:53:52.805 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 142/172 2024-07-24T21:53:52.828 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 142/172 2024-07-24T21:53:52.828 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:52.828 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-07-24T21:53:52.828 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-24T21:53:52.828 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-24T21:53:52.828 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:53:52.918 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 128/172 2024-07-24T21:53:52.949 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 128/172 2024-07-24T21:53:52.982 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.e 129/172 2024-07-24T21:53:53.048 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d. 130/172 2024-07-24T21:53:53.080 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 131/172 2024-07-24T21:53:53.148 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 143/172 2024-07-24T21:53:53.170 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 143/172 2024-07-24T21:53:53.171 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:53.171 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-07-24T21:53:53.171 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-24T21:53:53.171 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-24T21:53:53.171 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:53:55.364 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 131/172 2024-07-24T21:53:55.423 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 132/172 2024-07-24T21:53:56.381 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 132/172 2024-07-24T21:53:56.414 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 133/172 2024-07-24T21:53:56.451 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 131/172 2024-07-24T21:53:56.511 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 132/172 2024-07-24T21:53:56.526 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 133/172 2024-07-24T21:53:56.685 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el 134/172 2024-07-24T21:53:56.708 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 135/172 2024-07-24T21:53:56.732 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 135/172 2024-07-24T21:53:56.732 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:56.732 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-07-24T21:53:56.732 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-24T21:53:56.732 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-24T21:53:56.732 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:53:56.776 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 136/172 2024-07-24T21:53:56.787 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 136/172 2024-07-24T21:53:56.885 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 137/172 2024-07-24T21:53:56.941 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 138/172 2024-07-24T21:53:57.529 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 132/172 2024-07-24T21:53:57.562 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 133/172 2024-07-24T21:53:57.681 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 133/172 2024-07-24T21:53:57.842 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 144/172 2024-07-24T21:53:57.849 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el 134/172 2024-07-24T21:53:57.880 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 135/172 2024-07-24T21:53:57.883 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 145/172 2024-07-24T21:53:57.889 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-07-24T21:53:57.906 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 135/172 2024-07-24T21:53:57.906 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:57.906 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-07-24T21:53:57.906 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-24T21:53:57.906 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-24T21:53:57.906 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:53:57.919 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 140/172 2024-07-24T21:53:57.925 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 146/172 2024-07-24T21:53:57.942 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 140/172 2024-07-24T21:53:57.942 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:57.942 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-07-24T21:53:57.942 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-24T21:53:57.942 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-24T21:53:57.942 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:53:57.956 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 136/172 2024-07-24T21:53:57.957 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-07-24T21:53:57.968 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 136/172 2024-07-24T21:53:57.984 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-07-24T21:53:57.987 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5197.g86385 141/172 2024-07-24T21:53:58.010 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5197.g86385 141/172 2024-07-24T21:53:58.010 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:58.010 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-07-24T21:53:58.010 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:53:58.054 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 142/172 2024-07-24T21:53:58.070 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 137/172 2024-07-24T21:53:58.077 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 142/172 2024-07-24T21:53:58.077 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:58.077 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-07-24T21:53:58.077 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-24T21:53:58.077 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-24T21:53:58.078 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:53:58.134 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 138/172 2024-07-24T21:53:58.170 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 149/172 2024-07-24T21:53:58.214 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-07-24T21:53:58.255 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_ 151/172 2024-07-24T21:53:58.304 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-07-24T21:53:58.334 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-07-24T21:53:58.380 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-07-24T21:53:58.397 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 143/172 2024-07-24T21:53:58.420 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 143/172 2024-07-24T21:53:58.420 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:58.420 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-07-24T21:53:58.420 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-24T21:53:58.420 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-24T21:53:58.420 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:53:58.975 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T21:53:59.008 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T21:53:59.029 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T21:53:59.134 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-07-24T21:53:59.167 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 140/172 2024-07-24T21:53:59.192 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 140/172 2024-07-24T21:53:59.192 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:59.192 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-07-24T21:53:59.192 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-24T21:53:59.193 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-24T21:53:59.193 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:53:59.235 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5197.g86385 141/172 2024-07-24T21:53:59.258 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5197.g86385 141/172 2024-07-24T21:53:59.259 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:59.259 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-07-24T21:53:59.259 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:53:59.310 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 142/172 2024-07-24T21:53:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 142/172 2024-07-24T21:53:59.334 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:59.334 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-07-24T21:53:59.335 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-24T21:53:59.335 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-24T21:53:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:53:59.669 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 143/172 2024-07-24T21:53:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 143/172 2024-07-24T21:53:59.694 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T21:53:59.694 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-07-24T21:53:59.694 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-24T21:53:59.694 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-24T21:53:59.694 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:53:59.855 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 156/172 2024-07-24T21:53:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-07-24T21:53:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-07-24T21:54:00.076 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-07-24T21:54:00.116 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-07-24T21:54:00.140 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-07-24T21:54:00.166 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-24T21:54:00.192 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-07-24T21:54:00.193 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-24T21:54:00.277 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-24T21:54:00.310 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-07-24T21:54:00.311 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-24T21:54:00.404 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-24T21:54:00.429 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-07-24T21:54:00.434 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T21:54:00.434 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T21:54:00.630 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T21:54:00.630 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-24T21:54:00.717 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-24T21:54:00.742 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-24T21:54:00.768 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-07-24T21:54:00.832 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T21:54:03.075 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 144/172 2024-07-24T21:54:03.125 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 145/172 2024-07-24T21:54:03.166 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 146/172 2024-07-24T21:54:03.197 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-07-24T21:54:03.225 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-07-24T21:54:03.406 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 149/172 2024-07-24T21:54:03.454 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-07-24T21:54:03.486 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_ 151/172 2024-07-24T21:54:03.527 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-07-24T21:54:03.557 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-07-24T21:54:03.594 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-07-24T21:54:04.246 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T21:54:04.289 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T21:54:04.309 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T21:54:04.689 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 144/172 2024-07-24T21:54:04.731 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 145/172 2024-07-24T21:54:04.773 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 146/172 2024-07-24T21:54:04.804 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-07-24T21:54:04.831 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-07-24T21:54:05.033 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 149/172 2024-07-24T21:54:05.077 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-07-24T21:54:05.109 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_ 151/172 2024-07-24T21:54:05.141 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 156/172 2024-07-24T21:54:05.150 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-07-24T21:54:05.180 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-07-24T21:54:05.226 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-07-24T21:54:05.240 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-07-24T21:54:05.283 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-07-24T21:54:05.366 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-07-24T21:54:05.403 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-07-24T21:54:05.428 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-07-24T21:54:05.454 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-24T21:54:05.480 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-07-24T21:54:05.481 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-24T21:54:05.548 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-24T21:54:05.582 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-07-24T21:54:05.582 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-24T21:54:05.683 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-24T21:54:05.709 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-07-24T21:54:05.713 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T21:54:05.714 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T21:54:05.802 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T21:54:05.840 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T21:54:05.861 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T21:54:05.893 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T21:54:05.893 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-24T21:54:05.978 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-24T21:54:06.002 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-24T21:54:06.028 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-07-24T21:54:06.117 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T21:54:06.760 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 156/172 2024-07-24T21:54:06.862 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-07-24T21:54:06.905 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-07-24T21:54:07.004 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-07-24T21:54:07.048 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-07-24T21:54:07.073 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-07-24T21:54:07.099 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-24T21:54:07.125 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-07-24T21:54:07.125 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-24T21:54:07.181 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T21:54:07.181 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 1/172 2024-07-24T21:54:07.181 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 2/172 2024-07-24T21:54:07.181 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 3/172 2024-07-24T21:54:07.181 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 4/172 2024-07-24T21:54:07.181 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5197.g86385 5/172 2024-07-24T21:54:07.181 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T21:54:07.182 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 7/172 2024-07-24T21:54:07.182 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 8/172 2024-07-24T21:54:07.182 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 9/172 2024-07-24T21:54:07.182 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 10/172 2024-07-24T21:54:07.182 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 11/172 2024-07-24T21:54:07.182 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 12/172 2024-07-24T21:54:07.182 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 13/172 2024-07-24T21:54:07.182 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T21:54:07.182 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_ 15/172 2024-07-24T21:54:07.183 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 16/172 2024-07-24T21:54:07.183 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 17/172 2024-07-24T21:54:07.183 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_6 18/172 2024-07-24T21:54:07.183 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 19/172 2024-07-24T21:54:07.183 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 20/172 2024-07-24T21:54:07.183 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el 21/172 2024-07-24T21:54:07.183 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-common-2:19.0.0-5197.g86385b1d.el9. 22/172 2024-07-24T21:54:07.183 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_6 23/172 2024-07-24T21:54:07.183 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 24/172 2024-07-24T21:54:07.184 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 25/172 2024-07-24T21:54:07.184 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 26/172 2024-07-24T21:54:07.184 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 27/172 2024-07-24T21:54:07.184 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 28/172 2024-07-24T21:54:07.184 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 29/172 2024-07-24T21:54:07.184 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d. 30/172 2024-07-24T21:54:07.184 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 31/172 2024-07-24T21:54:07.184 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 32/172 2024-07-24T21:54:07.184 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 33/172 2024-07-24T21:54:07.184 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el 34/172 2024-07-24T21:54:07.184 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 35/172 2024-07-24T21:54:07.184 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.e 36/172 2024-07-24T21:54:07.184 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 37/172 2024-07-24T21:54:07.185 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 38/172 2024-07-24T21:54:07.185 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 39/172 2024-07-24T21:54:07.185 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-07-24T21:54:07.185 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-07-24T21:54:07.185 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-07-24T21:54:07.185 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-07-24T21:54:07.185 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-07-24T21:54:07.185 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-07-24T21:54:07.185 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-07-24T21:54:07.185 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-07-24T21:54:07.185 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-07-24T21:54:07.186 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-07-24T21:54:07.186 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-07-24T21:54:07.186 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-07-24T21:54:07.186 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-07-24T21:54:07.186 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-07-24T21:54:07.186 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-07-24T21:54:07.186 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-07-24T21:54:07.186 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-07-24T21:54:07.186 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-07-24T21:54:07.186 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-07-24T21:54:07.186 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-07-24T21:54:07.186 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-07-24T21:54:07.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-07-24T21:54:07.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-07-24T21:54:07.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-07-24T21:54:07.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-07-24T21:54:07.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-07-24T21:54:07.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-07-24T21:54:07.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-07-24T21:54:07.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-07-24T21:54:07.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-07-24T21:54:07.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-07-24T21:54:07.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-07-24T21:54:07.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-24T21:54:07.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-07-24T21:54:07.188 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-07-24T21:54:07.189 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-07-24T21:54:07.189 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-07-24T21:54:07.189 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-07-24T21:54:07.189 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-07-24T21:54:07.189 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-07-24T21:54:07.189 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-07-24T21:54:07.189 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-07-24T21:54:07.189 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-07-24T21:54:07.189 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-07-24T21:54:07.190 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-07-24T21:54:07.190 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-07-24T21:54:07.190 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-07-24T21:54:07.190 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-07-24T21:54:07.190 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-07-24T21:54:07.190 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-07-24T21:54:07.190 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-07-24T21:54:07.190 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-07-24T21:54:07.190 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-07-24T21:54:07.191 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-07-24T21:54:07.191 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-07-24T21:54:07.191 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-07-24T21:54:07.191 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-07-24T21:54:07.191 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-07-24T21:54:07.191 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-07-24T21:54:07.191 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-07-24T21:54:07.192 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-07-24T21:54:07.192 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-07-24T21:54:07.192 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-07-24T21:54:07.192 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-07-24T21:54:07.192 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-07-24T21:54:07.192 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-07-24T21:54:07.192 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-07-24T21:54:07.192 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-07-24T21:54:07.192 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-07-24T21:54:07.193 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-07-24T21:54:07.193 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-07-24T21:54:07.193 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-07-24T21:54:07.193 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-07-24T21:54:07.193 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-07-24T21:54:07.193 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-07-24T21:54:07.193 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-07-24T21:54:07.193 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-07-24T21:54:07.193 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-07-24T21:54:07.193 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-07-24T21:54:07.193 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-07-24T21:54:07.194 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-07-24T21:54:07.194 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-07-24T21:54:07.194 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-07-24T21:54:07.194 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-07-24T21:54:07.194 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-07-24T21:54:07.194 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-07-24T21:54:07.194 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-07-24T21:54:07.195 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-07-24T21:54:07.195 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-07-24T21:54:07.195 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-07-24T21:54:07.195 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-07-24T21:54:07.195 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-07-24T21:54:07.195 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-07-24T21:54:07.195 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-07-24T21:54:07.195 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-07-24T21:54:07.195 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-07-24T21:54:07.195 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 149/172 2024-07-24T21:54:07.195 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-07-24T21:54:07.195 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 151/172 2024-07-24T21:54:07.195 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-07-24T21:54:07.196 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-07-24T21:54:07.196 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-07-24T21:54:07.196 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-07-24T21:54:07.196 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-07-24T21:54:07.196 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-07-24T21:54:07.196 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-07-24T21:54:07.196 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-07-24T21:54:07.196 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-07-24T21:54:07.196 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-07-24T21:54:07.196 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-24T21:54:07.196 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-07-24T21:54:07.197 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-07-24T21:54:07.197 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-07-24T21:54:07.197 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-07-24T21:54:07.197 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-07-24T21:54:07.197 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-07-24T21:54:07.197 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-07-24T21:54:07.197 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-24T21:54:07.197 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-07-24T21:54:07.198 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-24T21:54:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-07-24T21:54:07.235 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-24T21:54:07.310 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-24T21:54:07.344 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-07-24T21:54:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T21:54:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T21:54:07.537 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T21:54:07.537 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-24T21:54:07.622 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-24T21:54:07.649 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-24T21:54:07.676 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-07-24T21:54:07.754 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T21:54:09.979 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T21:54:09.979 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:54:09.979 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2024-07-24T21:54:09.979 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-07-24T21:54:09.979 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-07-24T21:54:09.979 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-07-24T21:54:09.979 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-07-24T21:54:09.980 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-07-24T21:54:09.980 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-07-24T21:54:09.980 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-07-24T21:54:09.980 INFO:teuthology.orchestra.run.smithi188.stdout: librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.980 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.980 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-07-24T21:54:09.980 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-07-24T21:54:09.980 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-07-24T21:54:09.980 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-07-24T21:54:09.980 INFO:teuthology.orchestra.run.smithi188.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-07-24T21:54:09.980 INFO:teuthology.orchestra.run.smithi188.stdout: automake-1.16.2-8.el9.noarch 2024-07-24T21:54:09.980 INFO:teuthology.orchestra.run.smithi188.stdout: bison-3.7.4-5.el9.x86_64 2024-07-24T21:54:09.980 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-07-24T21:54:09.981 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.981 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.981 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.981 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.981 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:09.981 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.981 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.981 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.981 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:09.981 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:09.981 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:09.981 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:09.981 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:09.982 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.982 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.982 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:09.982 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.982 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.982 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.982 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:09.982 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:09.982 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.982 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.982 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:09.982 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: flex-2.6.4-9.el9.x86_64 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: fuse-2.9.9-16.el9.x86_64 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: grpc-data-1.46.7-10.el9.noarch 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-9.0.0-11.el9.x86_64 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.983 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: liboath-2.6.7-2.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: libtool-2.4.6-46.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind-1.6.2-1.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-07-24T21:54:09.984 INFO:teuthology.orchestra.run.smithi188.stdout: lua-5.4.4-4.el9.x86_64 2024-07-24T21:54:09.985 INFO:teuthology.orchestra.run.smithi188.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-07-24T21:54:09.985 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks-3.9.2-5.el9.noarch 2024-07-24T21:54:09.985 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-0.3.21-2.el9.x86_64 2024-07-24T21:54:09.985 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-07-24T21:54:09.985 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-07-24T21:54:09.985 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-07-24T21:54:09.985 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-13.14-1.el9.x86_64 2024-07-24T21:54:09.985 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-07-24T21:54:09.985 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-07-24T21:54:09.985 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-server-13.14-1.el9.x86_64 2024-07-24T21:54:09.985 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-3.14.0-13.el9.x86_64 2024-07-24T21:54:09.985 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-07-24T21:54:09.985 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-07-24T21:54:09.986 INFO:teuthology.orchestra.run.smithi188.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-07-24T21:54:09.986 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel-2.9.1-2.el9.noarch 2024-07-24T21:54:09.986 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-07-24T21:54:09.986 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-07-24T21:54:09.986 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.986 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.986 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.986 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-07-24T21:54:09.986 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-07-24T21:54:09.986 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-07-24T21:54:09.986 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-07-24T21:54:09.986 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-07-24T21:54:09.986 INFO:teuthology.orchestra.run.smithi188.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-07-24T21:54:09.987 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-07-24T21:54:09.987 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-07-24T21:54:09.987 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-07-24T21:54:09.987 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-07-24T21:54:09.987 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-07-24T21:54:09.987 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-07-24T21:54:09.987 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-07-24T21:54:09.987 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-07-24T21:54:09.987 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-07-24T21:54:09.987 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-07-24T21:54:09.987 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-07-24T21:54:09.987 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-07-24T21:54:09.987 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-07-24T21:54:09.988 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-07-24T21:54:09.988 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-07-24T21:54:09.988 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako-1.1.4-6.el9.noarch 2024-07-24T21:54:09.988 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-07-24T21:54:09.988 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-07-24T21:54:09.988 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-07-24T21:54:09.988 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-07-24T21:54:09.988 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-07-24T21:54:09.988 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-07-24T21:54:09.988 INFO:teuthology.orchestra.run.smithi188.stdout: python3-packaging-20.9-5.el9.noarch 2024-07-24T21:54:09.988 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-07-24T21:54:09.988 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply-3.11-14.el9.noarch 2024-07-24T21:54:09.988 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend-3.1.0-2.el9.noarch 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser-2.20-6.el9.noarch 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz-2021.1-5.el9.noarch 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-2.25.1-8.el9.noarch 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-07-24T21:54:09.989 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.990 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes-2.5.1-5.el9.noarch 2024-07-24T21:54:09.990 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa-4.9-2.el9.noarch 2024-07-24T21:54:09.990 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-07-24T21:54:09.990 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-07-24T21:54:09.990 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml-0.10.2-6.el9.noarch 2024-07-24T21:54:09.990 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-07-24T21:54:09.990 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-07-24T21:54:09.990 INFO:teuthology.orchestra.run.smithi188.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-07-24T21:54:09.990 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob-1.8.7-6.el9.noarch 2024-07-24T21:54:09.990 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-07-24T21:54:09.990 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-07-24T21:54:09.990 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-07-24T21:54:09.990 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-24.02.0-1.el9.x86_64 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout: re2-1:20211101-3.el9.x86_64 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout: socat-1.7.4.1-6.el9.x86_64 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout: thrift-0.15.0-2.el9.x86_64 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout: uuid-1.6.2-55.el9.x86_64 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:54:09.991 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-07-24T21:54:10.431 DEBUG:teuthology.parallel:result is None 2024-07-24T21:54:12.262 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T21:54:12.262 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 1/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 2/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 3/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 4/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5197.g86385 5/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 7/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 8/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 9/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 10/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 11/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 12/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 13/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_ 15/172 2024-07-24T21:54:12.263 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 16/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 17/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_6 18/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 19/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 20/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el 21/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:19.0.0-5197.g86385b1d.el9. 22/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_6 23/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 24/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 25/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 26/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 27/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 28/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 29/172 2024-07-24T21:54:12.264 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d. 30/172 2024-07-24T21:54:12.277 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 31/172 2024-07-24T21:54:12.277 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 32/172 2024-07-24T21:54:12.277 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 33/172 2024-07-24T21:54:12.277 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el 34/172 2024-07-24T21:54:12.277 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 35/172 2024-07-24T21:54:12.277 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.e 36/172 2024-07-24T21:54:12.277 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 37/172 2024-07-24T21:54:12.277 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 38/172 2024-07-24T21:54:12.278 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 39/172 2024-07-24T21:54:12.278 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-07-24T21:54:12.278 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-07-24T21:54:12.278 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-07-24T21:54:12.278 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-07-24T21:54:12.278 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-07-24T21:54:12.278 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-07-24T21:54:12.278 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-07-24T21:54:12.278 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-07-24T21:54:12.278 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-07-24T21:54:12.278 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-07-24T21:54:12.278 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-07-24T21:54:12.279 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-07-24T21:54:12.280 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-07-24T21:54:12.280 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-07-24T21:54:12.280 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-07-24T21:54:12.280 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-07-24T21:54:12.280 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-07-24T21:54:12.280 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-07-24T21:54:12.280 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-07-24T21:54:12.280 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-07-24T21:54:12.280 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-07-24T21:54:12.280 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-07-24T21:54:12.280 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-07-24T21:54:12.280 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-07-24T21:54:12.280 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-07-24T21:54:12.281 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-07-24T21:54:12.282 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-07-24T21:54:12.282 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-07-24T21:54:12.282 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-07-24T21:54:12.282 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-07-24T21:54:12.282 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-07-24T21:54:12.282 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-07-24T21:54:12.282 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-07-24T21:54:12.282 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-07-24T21:54:12.282 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-07-24T21:54:12.282 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-07-24T21:54:12.282 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-07-24T21:54:12.282 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-07-24T21:54:12.283 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-07-24T21:54:12.283 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-07-24T21:54:12.283 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-07-24T21:54:12.283 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-07-24T21:54:12.283 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-07-24T21:54:12.283 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-07-24T21:54:12.283 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-07-24T21:54:12.283 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-07-24T21:54:12.283 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-07-24T21:54:12.283 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-07-24T21:54:12.283 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-07-24T21:54:12.283 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-07-24T21:54:12.283 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-07-24T21:54:12.284 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-07-24T21:54:12.284 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-07-24T21:54:12.284 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-07-24T21:54:12.284 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-07-24T21:54:12.284 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-07-24T21:54:12.284 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-07-24T21:54:12.284 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-07-24T21:54:12.284 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-07-24T21:54:12.284 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-07-24T21:54:12.284 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-07-24T21:54:12.284 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-07-24T21:54:12.284 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-07-24T21:54:12.284 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-07-24T21:54:12.285 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-07-24T21:54:12.285 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-07-24T21:54:12.285 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-07-24T21:54:12.285 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-07-24T21:54:12.285 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-07-24T21:54:12.285 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-07-24T21:54:12.285 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-07-24T21:54:12.285 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-07-24T21:54:12.285 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-07-24T21:54:12.285 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-07-24T21:54:12.285 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-07-24T21:54:12.285 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-07-24T21:54:12.285 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-07-24T21:54:12.286 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-07-24T21:54:12.286 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-07-24T21:54:12.286 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-07-24T21:54:12.286 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-07-24T21:54:12.286 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-07-24T21:54:12.286 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-07-24T21:54:12.286 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 149/172 2024-07-24T21:54:12.286 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-07-24T21:54:12.286 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 151/172 2024-07-24T21:54:12.286 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-07-24T21:54:12.286 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-07-24T21:54:12.286 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-07-24T21:54:12.286 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-07-24T21:54:12.287 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-07-24T21:54:12.288 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-24T21:54:12.288 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-07-24T21:54:13.718 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T21:54:13.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 1/172 2024-07-24T21:54:13.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 2/172 2024-07-24T21:54:13.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 3/172 2024-07-24T21:54:13.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 4/172 2024-07-24T21:54:13.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5197.g86385 5/172 2024-07-24T21:54:13.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T21:54:13.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 7/172 2024-07-24T21:54:13.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 8/172 2024-07-24T21:54:13.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 9/172 2024-07-24T21:54:13.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 10/172 2024-07-24T21:54:13.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 11/172 2024-07-24T21:54:13.719 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 12/172 2024-07-24T21:54:13.720 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 13/172 2024-07-24T21:54:13.720 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T21:54:13.720 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_ 15/172 2024-07-24T21:54:13.720 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 16/172 2024-07-24T21:54:13.720 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 17/172 2024-07-24T21:54:13.720 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_6 18/172 2024-07-24T21:54:13.720 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 19/172 2024-07-24T21:54:13.720 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 20/172 2024-07-24T21:54:13.720 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el 21/172 2024-07-24T21:54:13.720 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:19.0.0-5197.g86385b1d.el9. 22/172 2024-07-24T21:54:13.720 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_6 23/172 2024-07-24T21:54:13.720 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 24/172 2024-07-24T21:54:13.721 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 25/172 2024-07-24T21:54:13.721 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 26/172 2024-07-24T21:54:13.721 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 27/172 2024-07-24T21:54:13.735 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 28/172 2024-07-24T21:54:13.736 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 29/172 2024-07-24T21:54:13.736 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d. 30/172 2024-07-24T21:54:13.736 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 31/172 2024-07-24T21:54:13.736 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 32/172 2024-07-24T21:54:13.736 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 33/172 2024-07-24T21:54:13.736 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el 34/172 2024-07-24T21:54:13.736 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 35/172 2024-07-24T21:54:13.736 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.e 36/172 2024-07-24T21:54:13.736 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 37/172 2024-07-24T21:54:13.736 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 38/172 2024-07-24T21:54:13.737 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 39/172 2024-07-24T21:54:13.737 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-07-24T21:54:13.737 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-07-24T21:54:13.737 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-07-24T21:54:13.737 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-07-24T21:54:13.737 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-07-24T21:54:13.737 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-07-24T21:54:13.737 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-07-24T21:54:13.737 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-07-24T21:54:13.737 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-07-24T21:54:13.737 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-07-24T21:54:13.737 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-07-24T21:54:13.738 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-07-24T21:54:13.738 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-07-24T21:54:13.738 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-07-24T21:54:13.738 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-07-24T21:54:13.738 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-07-24T21:54:13.738 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-07-24T21:54:13.738 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-07-24T21:54:13.738 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-07-24T21:54:13.738 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-07-24T21:54:13.738 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-07-24T21:54:13.738 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-07-24T21:54:13.738 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-07-24T21:54:13.739 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-07-24T21:54:13.739 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-07-24T21:54:13.739 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-07-24T21:54:13.739 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-07-24T21:54:13.739 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-07-24T21:54:13.739 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-07-24T21:54:13.739 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-07-24T21:54:13.739 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-07-24T21:54:13.739 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-07-24T21:54:13.739 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-07-24T21:54:13.739 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-07-24T21:54:13.739 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-07-24T21:54:13.739 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-07-24T21:54:13.740 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-07-24T21:54:13.740 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-07-24T21:54:13.740 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-07-24T21:54:13.740 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-07-24T21:54:13.740 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-07-24T21:54:13.740 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-07-24T21:54:13.740 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-07-24T21:54:13.740 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-07-24T21:54:13.740 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-07-24T21:54:13.740 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-24T21:54:13.740 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-07-24T21:54:13.740 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-07-24T21:54:13.740 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-07-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-07-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-07-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-07-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-07-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-07-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-07-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-07-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-07-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-07-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-07-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-07-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-07-24T21:54:13.741 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-07-24T21:54:13.742 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-07-24T21:54:13.742 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-07-24T21:54:13.742 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-07-24T21:54:13.742 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-07-24T21:54:13.742 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-07-24T21:54:13.742 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-07-24T21:54:13.742 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-07-24T21:54:13.742 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-07-24T21:54:13.742 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-07-24T21:54:13.742 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-07-24T21:54:13.742 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-07-24T21:54:13.743 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-07-24T21:54:13.743 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-07-24T21:54:13.743 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-07-24T21:54:13.743 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-07-24T21:54:13.743 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-07-24T21:54:13.743 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-07-24T21:54:13.743 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-07-24T21:54:13.743 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-07-24T21:54:13.743 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-07-24T21:54:13.743 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-07-24T21:54:13.743 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-07-24T21:54:13.743 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-07-24T21:54:13.743 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-07-24T21:54:13.744 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-07-24T21:54:13.744 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-07-24T21:54:13.744 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-07-24T21:54:13.744 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-07-24T21:54:13.744 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-07-24T21:54:13.744 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-07-24T21:54:13.744 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-07-24T21:54:13.744 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-07-24T21:54:13.744 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-07-24T21:54:13.744 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-07-24T21:54:13.744 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-07-24T21:54:13.744 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-07-24T21:54:13.745 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-07-24T21:54:13.745 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-07-24T21:54:13.745 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-07-24T21:54:13.745 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-07-24T21:54:13.745 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-07-24T21:54:13.745 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-07-24T21:54:13.745 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-07-24T21:54:13.745 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-07-24T21:54:13.745 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-07-24T21:54:13.745 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-07-24T21:54:13.745 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-07-24T21:54:13.745 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 149/172 2024-07-24T21:54:13.745 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-07-24T21:54:13.746 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 151/172 2024-07-24T21:54:13.746 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-07-24T21:54:13.746 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-07-24T21:54:13.746 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-07-24T21:54:13.746 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-07-24T21:54:13.746 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-07-24T21:54:13.746 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-07-24T21:54:13.746 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-07-24T21:54:13.746 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-07-24T21:54:13.746 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-07-24T21:54:13.746 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-07-24T21:54:13.746 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-24T21:54:13.747 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-07-24T21:54:13.747 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-07-24T21:54:13.747 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-07-24T21:54:13.747 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-07-24T21:54:13.747 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-07-24T21:54:13.747 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-07-24T21:54:13.747 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-07-24T21:54:13.747 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-24T21:54:13.747 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-07-24T21:54:15.172 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T21:54:15.172 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:54:15.172 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2024-07-24T21:54:15.172 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-07-24T21:54:15.172 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-07-24T21:54:15.172 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-07-24T21:54:15.172 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-07-24T21:54:15.172 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-07-24T21:54:15.173 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-07-24T21:54:15.173 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-07-24T21:54:15.173 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.173 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.173 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-07-24T21:54:15.173 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-07-24T21:54:15.173 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-07-24T21:54:15.173 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-07-24T21:54:15.173 INFO:teuthology.orchestra.run.smithi183.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-07-24T21:54:15.173 INFO:teuthology.orchestra.run.smithi183.stdout: automake-1.16.2-8.el9.noarch 2024-07-24T21:54:15.173 INFO:teuthology.orchestra.run.smithi183.stdout: bison-3.7.4-5.el9.x86_64 2024-07-24T21:54:15.173 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-07-24T21:54:15.173 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.174 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.174 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.174 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.174 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:15.174 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.174 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.174 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.174 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:15.174 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:15.174 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:15.174 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:15.174 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:15.174 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: flex-2.6.4-9.el9.x86_64 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-07-24T21:54:15.175 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-07-24T21:54:15.176 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-07-24T21:54:15.176 INFO:teuthology.orchestra.run.smithi183.stdout: fuse-2.9.9-16.el9.x86_64 2024-07-24T21:54:15.176 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-07-24T21:54:15.176 INFO:teuthology.orchestra.run.smithi183.stdout: grpc-data-1.46.7-10.el9.noarch 2024-07-24T21:54:15.176 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-07-24T21:54:15.176 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-9.0.0-11.el9.x86_64 2024-07-24T21:54:15.176 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-07-24T21:54:15.176 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.176 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.176 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.176 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-07-24T21:54:15.176 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.7-2.el9.x86_64 2024-07-24T21:54:15.176 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-07-24T21:54:15.177 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-07-24T21:54:15.177 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-07-24T21:54:15.177 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.177 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.177 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-07-24T21:54:15.177 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.177 INFO:teuthology.orchestra.run.smithi183.stdout: libtool-2.4.6-46.el9.x86_64 2024-07-24T21:54:15.177 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.6.2-1.el9.x86_64 2024-07-24T21:54:15.177 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-07-24T21:54:15.177 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-07-24T21:54:15.177 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-07-24T21:54:15.177 INFO:teuthology.orchestra.run.smithi183.stdout: lua-5.4.4-4.el9.x86_64 2024-07-24T21:54:15.177 INFO:teuthology.orchestra.run.smithi183.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-07-24T21:54:15.178 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks-3.9.2-5.el9.noarch 2024-07-24T21:54:15.178 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-0.3.21-2.el9.x86_64 2024-07-24T21:54:15.178 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-07-24T21:54:15.178 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-07-24T21:54:15.178 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-07-24T21:54:15.178 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-13.14-1.el9.x86_64 2024-07-24T21:54:15.178 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-07-24T21:54:15.178 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-07-24T21:54:15.178 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server-13.14-1.el9.x86_64 2024-07-24T21:54:15.178 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-3.14.0-13.el9.x86_64 2024-07-24T21:54:15.178 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-07-24T21:54:15.178 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-07-24T21:54:15.178 INFO:teuthology.orchestra.run.smithi183.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel-2.9.1-2.el9.noarch 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-07-24T21:54:15.179 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-07-24T21:54:15.180 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.1.4-6.el9.noarch 2024-07-24T21:54:15.181 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-07-24T21:54:15.181 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-07-24T21:54:15.181 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-07-24T21:54:15.181 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-07-24T21:54:15.181 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-07-24T21:54:15.181 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-07-24T21:54:15.181 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging-20.9-5.el9.noarch 2024-07-24T21:54:15.181 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-07-24T21:54:15.181 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply-3.11-14.el9.noarch 2024-07-24T21:54:15.181 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-3.1.0-2.el9.noarch 2024-07-24T21:54:15.181 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-07-24T21:54:15.181 INFO:teuthology.orchestra.run.smithi183.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-07-24T21:54:15.181 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser-2.20-6.el9.noarch 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2021.1-5.el9.noarch 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-2.25.1-8.el9.noarch 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes-2.5.1-5.el9.noarch 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa-4.9-2.el9.noarch 2024-07-24T21:54:15.182 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml-0.10.2-6.el9.noarch 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.7-6.el9.noarch 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-24.02.0-1.el9.x86_64 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.183 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.184 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:15.184 INFO:teuthology.orchestra.run.smithi183.stdout: re2-1:20211101-3.el9.x86_64 2024-07-24T21:54:15.184 INFO:teuthology.orchestra.run.smithi183.stdout: socat-1.7.4.1-6.el9.x86_64 2024-07-24T21:54:15.184 INFO:teuthology.orchestra.run.smithi183.stdout: thrift-0.15.0-2.el9.x86_64 2024-07-24T21:54:15.184 INFO:teuthology.orchestra.run.smithi183.stdout: uuid-1.6.2-55.el9.x86_64 2024-07-24T21:54:15.184 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-07-24T21:54:15.184 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-07-24T21:54:15.184 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-07-24T21:54:15.184 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-07-24T21:54:15.185 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-07-24T21:54:15.623 DEBUG:teuthology.parallel:result is None 2024-07-24T21:54:16.409 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T21:54:16.409 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:54:16.410 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-07-24T21:54:16.410 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-07-24T21:54:16.410 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-07-24T21:54:16.410 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-07-24T21:54:16.410 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-07-24T21:54:16.410 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-07-24T21:54:16.410 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-07-24T21:54:16.411 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-07-24T21:54:16.411 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.411 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.411 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-07-24T21:54:16.411 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-07-24T21:54:16.411 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-07-24T21:54:16.411 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-07-24T21:54:16.411 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-07-24T21:54:16.412 INFO:teuthology.orchestra.run.smithi047.stdout: automake-1.16.2-8.el9.noarch 2024-07-24T21:54:16.412 INFO:teuthology.orchestra.run.smithi047.stdout: bison-3.7.4-5.el9.x86_64 2024-07-24T21:54:16.412 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-07-24T21:54:16.412 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.412 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.412 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.412 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.412 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:16.413 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.413 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.413 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.413 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:16.413 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:16.413 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:16.413 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:16.413 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:16.414 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.414 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.414 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:16.414 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.414 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.414 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.414 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:16.415 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:16.415 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.415 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.415 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T21:54:16.415 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-07-24T21:54:16.415 INFO:teuthology.orchestra.run.smithi047.stdout: flex-2.6.4-9.el9.x86_64 2024-07-24T21:54:16.415 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-07-24T21:54:16.415 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-07-24T21:54:16.416 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-07-24T21:54:16.416 INFO:teuthology.orchestra.run.smithi047.stdout: fuse-2.9.9-16.el9.x86_64 2024-07-24T21:54:16.416 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-07-24T21:54:16.416 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data-1.46.7-10.el9.noarch 2024-07-24T21:54:16.416 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-07-24T21:54:16.416 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-11.el9.x86_64 2024-07-24T21:54:16.417 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-07-24T21:54:16.417 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.417 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.417 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.417 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-07-24T21:54:16.417 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-07-24T21:54:16.417 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-07-24T21:54:16.417 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-07-24T21:54:16.418 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-07-24T21:54:16.418 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.418 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.418 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-07-24T21:54:16.418 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.418 INFO:teuthology.orchestra.run.smithi047.stdout: libtool-2.4.6-46.el9.x86_64 2024-07-24T21:54:16.419 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-07-24T21:54:16.419 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-07-24T21:54:16.419 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-07-24T21:54:16.419 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-07-24T21:54:16.419 INFO:teuthology.orchestra.run.smithi047.stdout: lua-5.4.4-4.el9.x86_64 2024-07-24T21:54:16.419 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-07-24T21:54:16.419 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks-3.9.2-5.el9.noarch 2024-07-24T21:54:16.419 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.21-2.el9.x86_64 2024-07-24T21:54:16.420 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-07-24T21:54:16.420 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-07-24T21:54:16.420 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-07-24T21:54:16.420 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-13.14-1.el9.x86_64 2024-07-24T21:54:16.420 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-07-24T21:54:16.420 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-07-24T21:54:16.420 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server-13.14-1.el9.x86_64 2024-07-24T21:54:16.420 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-3.14.0-13.el9.x86_64 2024-07-24T21:54:16.421 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-07-24T21:54:16.421 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-07-24T21:54:16.421 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-07-24T21:54:16.421 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-07-24T21:54:16.421 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-07-24T21:54:16.421 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-07-24T21:54:16.421 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.421 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.421 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.422 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-07-24T21:54:16.422 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-07-24T21:54:16.422 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-07-24T21:54:16.422 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-07-24T21:54:16.422 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-07-24T21:54:16.422 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-07-24T21:54:16.422 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-07-24T21:54:16.422 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-07-24T21:54:16.422 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-07-24T21:54:16.422 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-07-24T21:54:16.422 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-07-24T21:54:16.423 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-07-24T21:54:16.423 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-07-24T21:54:16.423 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-07-24T21:54:16.423 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-07-24T21:54:16.423 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-07-24T21:54:16.423 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-07-24T21:54:16.423 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-07-24T21:54:16.423 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-07-24T21:54:16.423 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-07-24T21:54:16.423 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-07-24T21:54:16.423 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-07-24T21:54:16.424 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-07-24T21:54:16.424 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-07-24T21:54:16.424 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-07-24T21:54:16.424 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-07-24T21:54:16.425 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-07-24T21:54:16.425 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-07-24T21:54:16.425 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-07-24T21:54:16.425 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-07-24T21:54:16.425 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-07-24T21:54:16.425 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-07-24T21:54:16.425 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-07-24T21:54:16.425 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-07-24T21:54:16.425 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-07-24T21:54:16.425 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-07-24T21:54:16.425 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-07-24T21:54:16.425 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-07-24T21:54:16.425 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-07-24T21:54:16.426 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-07-24T21:54:16.426 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.426 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.426 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-07-24T21:54:16.426 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-07-24T21:54:16.426 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-07-24T21:54:16.426 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.426 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-07-24T21:54:16.426 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-07-24T21:54:16.426 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-07-24T21:54:16.426 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-07-24T21:54:16.426 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.7-6.el9.noarch 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-24.02.0-1.el9.x86_64 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T21:54:16.427 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-3.el9.x86_64 2024-07-24T21:54:16.428 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-6.el9.x86_64 2024-07-24T21:54:16.428 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-07-24T21:54:16.428 INFO:teuthology.orchestra.run.smithi047.stdout: uuid-1.6.2-55.el9.x86_64 2024-07-24T21:54:16.428 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-07-24T21:54:16.428 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-07-24T21:54:16.429 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-07-24T21:54:16.429 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:54:16.429 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-07-24T21:54:16.814 DEBUG:teuthology.parallel:result is None 2024-07-24T21:54:16.815 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T21:54:16.965 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-07-24T21:54:16.988 INFO:teuthology.orchestra.run.smithi047.stdout:19.0.0-5197.g86385b1d.el9 2024-07-24T21:54:16.989 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5197.g86385b1d.el9 2024-07-24T21:54:16.989 INFO:teuthology.task.install:The correct ceph version 19.0.0-5197.g86385b1d is installed. 2024-07-24T21:54:16.991 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T21:54:17.131 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-07-24T21:54:17.156 INFO:teuthology.orchestra.run.smithi183.stdout:19.0.0-5197.g86385b1d.el9 2024-07-24T21:54:17.156 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5197.g86385b1d.el9 2024-07-24T21:54:17.157 INFO:teuthology.task.install:The correct ceph version 19.0.0-5197.g86385b1d is installed. 2024-07-24T21:54:17.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T21:54:17.301 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-07-24T21:54:17.327 INFO:teuthology.orchestra.run.smithi188.stdout:19.0.0-5197.g86385b1d.el9 2024-07-24T21:54:17.328 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5197.g86385b1d.el9 2024-07-24T21:54:17.328 INFO:teuthology.task.install:The correct ceph version 19.0.0-5197.g86385b1d is installed. 2024-07-24T21:54:17.330 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-07-24T21:54:17.330 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:54:17.330 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-07-24T21:54:17.361 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-07-24T21:54:17.361 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-07-24T21:54:17.393 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-07-24T21:54:17.393 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-07-24T21:54:17.423 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-07-24T21:54:17.423 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:54:17.423 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-07-24T21:54:17.452 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-07-24T21:54:17.521 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-07-24T21:54:17.521 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2024-07-24T21:54:17.549 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-07-24T21:54:17.617 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-07-24T21:54:17.617 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2024-07-24T21:54:17.645 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-07-24T21:54:17.712 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-07-24T21:54:17.712 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:54:17.712 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-07-24T21:54:17.744 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-07-24T21:54:17.813 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-07-24T21:54:17.813 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2024-07-24T21:54:17.841 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-07-24T21:54:17.906 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-07-24T21:54:17.907 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2024-07-24T21:54:17.934 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-07-24T21:54:18.001 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-07-24T21:54:18.002 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:54:18.002 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-07-24T21:54:18.033 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-07-24T21:54:18.104 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-07-24T21:54:18.104 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2024-07-24T21:54:18.132 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-07-24T21:54:18.200 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-07-24T21:54:18.200 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2024-07-24T21:54:18.228 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-07-24T21:54:18.296 INFO:teuthology.run_tasks:Running task cephadm... 2024-07-24T21:54:18.394 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug'}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-07-24T21:54:18.394 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T21:54:18.395 INFO:tasks.cephadm:Cluster fsid is 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:54:18.395 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-07-24T21:54:18.395 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.47', 'mon.b': '172.21.15.183', 'mon.c': '172.21.15.188'} 2024-07-24T21:54:18.395 INFO:tasks.cephadm:First mon is mon.a on smithi047 2024-07-24T21:54:18.396 INFO:tasks.cephadm:First mgr is x 2024-07-24T21:54:18.396 INFO:tasks.cephadm:Normalizing hostnames... 2024-07-24T21:54:18.396 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname $(hostname -s) 2024-07-24T21:54:18.427 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname $(hostname -s) 2024-07-24T21:54:18.456 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname $(hostname -s) 2024-07-24T21:54:18.483 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-07-24T21:54:18.483 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T21:54:18.622 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/55672/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-5197-g86385b1d', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-5197.g86385b1d'}, 'url': 'https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-07-22 21:35:01.055497', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'main', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-07-24T21:54:18.759 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref main, sha1 86385b1daf5235400bbcd34a02515d168bde88e2 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T21:54:18.760 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/x86_64/flavors/default/cephadm 2024-07-24T21:54:18.760 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/x86_64/flavors/default/cephadm 2024-07-24T21:54:18.760 DEBUG:teuthology.orchestra.run.smithi047:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-07-24T21:54:19.151 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r--. 1 ubuntu ubuntu 789815 Jul 24 21:54 /home/ubuntu/cephtest/cephadm 2024-07-24T21:54:19.151 DEBUG:teuthology.orchestra.run.smithi183:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-07-24T21:54:19.532 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r--. 1 ubuntu ubuntu 789815 Jul 24 21:54 /home/ubuntu/cephtest/cephadm 2024-07-24T21:54:19.532 DEBUG:teuthology.orchestra.run.smithi188:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-07-24T21:54:19.913 INFO:teuthology.orchestra.run.smithi188.stdout:-rw-r--r--. 1 ubuntu ubuntu 789815 Jul 24 21:54 /home/ubuntu/cephtest/cephadm 2024-07-24T21:54:19.913 DEBUG:teuthology.orchestra.run.smithi047:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-07-24T21:54:19.934 DEBUG:teuthology.orchestra.run.smithi183:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-07-24T21:54:19.953 DEBUG:teuthology.orchestra.run.smithi188:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-07-24T21:54:19.997 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 on all hosts... 2024-07-24T21:54:19.997 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 pull 2024-07-24T21:54:20.000 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 pull 2024-07-24T21:54:20.003 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 pull 2024-07-24T21:54:20.870 INFO:teuthology.orchestra.run.smithi188.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2... 2024-07-24T21:54:20.917 INFO:teuthology.orchestra.run.smithi183.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2... 2024-07-24T21:54:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2... 2024-07-24T21:54:51.017 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T21:54:51.017 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-5197-g86385b1d (86385b1daf5235400bbcd34a02515d168bde88e2) squid (dev)", 2024-07-24T21:54:51.017 INFO:teuthology.orchestra.run.smithi047.stdout: "image_id": "2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0", 2024-07-24T21:54:51.018 INFO:teuthology.orchestra.run.smithi047.stdout: "repo_digests": [ 2024-07-24T21:54:51.018 INFO:teuthology.orchestra.run.smithi047.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb" 2024-07-24T21:54:51.018 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-07-24T21:54:51.018 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T21:55:08.308 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-07-24T21:55:08.309 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_version": "ceph version 19.0.0-5197-g86385b1d (86385b1daf5235400bbcd34a02515d168bde88e2) squid (dev)", 2024-07-24T21:55:08.309 INFO:teuthology.orchestra.run.smithi188.stdout: "image_id": "2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0", 2024-07-24T21:55:08.309 INFO:teuthology.orchestra.run.smithi188.stdout: "repo_digests": [ 2024-07-24T21:55:08.309 INFO:teuthology.orchestra.run.smithi188.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb" 2024-07-24T21:55:08.309 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-07-24T21:55:08.309 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-07-24T21:55:13.257 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-07-24T21:55:13.257 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_version": "ceph version 19.0.0-5197-g86385b1d (86385b1daf5235400bbcd34a02515d168bde88e2) squid (dev)", 2024-07-24T21:55:13.258 INFO:teuthology.orchestra.run.smithi183.stdout: "image_id": "2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0", 2024-07-24T21:55:13.258 INFO:teuthology.orchestra.run.smithi183.stdout: "repo_digests": [ 2024-07-24T21:55:13.258 INFO:teuthology.orchestra.run.smithi183.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb" 2024-07-24T21:55:13.258 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-07-24T21:55:13.258 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-07-24T21:55:13.284 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph 2024-07-24T21:55:13.320 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph 2024-07-24T21:55:13.346 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph 2024-07-24T21:55:13.379 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /etc/ceph 2024-07-24T21:55:13.411 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /etc/ceph 2024-07-24T21:55:13.434 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /etc/ceph 2024-07-24T21:55:13.461 INFO:tasks.cephadm:Writing seed config... 2024-07-24T21:55:13.463 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-07-24T21:55:13.463 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-07-24T21:55:13.463 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-07-24T21:55:13.463 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-07-24T21:55:13.463 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-07-24T21:55:13.463 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-07-24T21:55:13.463 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-07-24T21:55:13.463 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-07-24T21:55:13.464 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-07-24T21:55:13.464 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-07-24T21:55:13.464 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-07-24T21:55:13.464 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-07-24T21:55:13.464 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-07-24T21:55:13.464 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-07-24T21:55:13.464 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-07-24T21:55:13.464 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-07-24T21:55:13.464 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-07-24T21:55:13.464 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-07-24T21:55:13.465 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-07-24T21:55:13.465 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-07-24T21:55:13.465 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-07-24T21:55:13.465 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-07-24T21:55:13.465 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-07-24T21:55:13.465 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-07-24T21:55:13.465 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-07-24T21:55:13.465 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-07-24T21:55:13.466 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:55:13.466 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-07-24T21:55:13.485 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 46bf760a-4a07-11ef-bcad-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-07-24T21:55:13.486 DEBUG:teuthology.orchestra.run.smithi047:mon.a> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.a.service 2024-07-24T21:55:13.529 DEBUG:teuthology.orchestra.run.smithi047:mgr.x> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.x.service 2024-07-24T21:55:13.571 INFO:tasks.cephadm:Bootstrapping... 2024-07-24T21:55:13.571 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 -v bootstrap --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.47 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-07-24T21:55:13.793 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-07-24T21:55:13.793 INFO:teuthology.orchestra.run.smithi047.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', '-v', 'bootstrap', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.47', '--skip-admin-label'] 2024-07-24T21:55:13.794 INFO:teuthology.orchestra.run.smithi047.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-07-24T21:55:13.794 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying podman|docker is present... 2024-07-24T21:55:13.820 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 5.1.2 2024-07-24T21:55:13.820 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying lvm2 is present... 2024-07-24T21:55:13.820 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying time synchronization is in place... 2024-07-24T21:55:13.829 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-07-24T21:55:13.830 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-07-24T21:55:13.837 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-07-24T21:55:13.838 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-07-24T21:55:13.845 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-07-24T21:55:13.852 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-07-24T21:55:13.852 INFO:teuthology.orchestra.run.smithi047.stdout:Unit chronyd.service is enabled and running 2024-07-24T21:55:13.853 INFO:teuthology.orchestra.run.smithi047.stdout:Repeating the final host check... 2024-07-24T21:55:13.878 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 5.1.2 2024-07-24T21:55:13.878 INFO:teuthology.orchestra.run.smithi047.stdout:podman (/bin/podman) version 5.1.2 is present 2024-07-24T21:55:13.878 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl is present 2024-07-24T21:55:13.878 INFO:teuthology.orchestra.run.smithi047.stdout:lvcreate is present 2024-07-24T21:55:13.885 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-07-24T21:55:13.885 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-07-24T21:55:13.892 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-07-24T21:55:13.892 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-07-24T21:55:13.900 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-07-24T21:55:13.908 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-07-24T21:55:13.908 INFO:teuthology.orchestra.run.smithi047.stdout:Unit chronyd.service is enabled and running 2024-07-24T21:55:13.908 INFO:teuthology.orchestra.run.smithi047.stdout:Host looks OK 2024-07-24T21:55:13.908 INFO:teuthology.orchestra.run.smithi047.stdout:Cluster fsid: 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:55:13.908 INFO:teuthology.orchestra.run.smithi047.stdout:Acquiring lock 140540465578816 on /run/cephadm/46bf760a-4a07-11ef-bcad-c7b262605968.lock 2024-07-24T21:55:13.908 INFO:teuthology.orchestra.run.smithi047.stdout:Lock 140540465578816 acquired on /run/cephadm/46bf760a-4a07-11ef-bcad-c7b262605968.lock 2024-07-24T21:55:13.909 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 3300 ... 2024-07-24T21:55:13.909 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 6789 ... 2024-07-24T21:55:13.909 INFO:teuthology.orchestra.run.smithi047.stdout:Base mon IP(s) is [172.21.15.47:3300, 172.21.15.47:6789], mon addrv is [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-07-24T21:55:13.912 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.47 metric 100 2024-07-24T21:55:13.912 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.47 metric 100 2024-07-24T21:55:13.915 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-07-24T21:55:13.915 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-07-24T21:55:13.915 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-07-24T21:55:13.917 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-07-24T21:55:13.917 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-07-24T21:55:13.918 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-07-24T21:55:13.918 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-07-24T21:55:13.918 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-07-24T21:55:13.918 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-07-24T21:55:13.918 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-07-24T21:55:13.918 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-07-24T21:55:13.919 INFO:teuthology.orchestra.run.smithi047.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-07-24T21:55:13.919 INFO:teuthology.orchestra.run.smithi047.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-07-24T21:55:13.920 INFO:teuthology.orchestra.run.smithi047.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2... 2024-07-24T21:55:17.436 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 2024-07-24T21:55:17.437 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2... 2024-07-24T21:55:17.437 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Getting image source signatures 2024-07-24T21:55:17.437 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying blob sha256:ff6978fe3241616ea65cf2dbfa33f964b4d58d6a8a22dca92f46bf44c1c2c5c1 2024-07-24T21:55:17.437 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying blob sha256:a0a261c93a1a3b1a5634697d0569ba314563628d3546bf9326abaa78605cead1 2024-07-24T21:55:17.437 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying config sha256:2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 2024-07-24T21:55:17.437 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Writing manifest to image destination 2024-07-24T21:55:19.483 INFO:teuthology.orchestra.run.smithi047.stdout:ceph: stdout ceph version 19.0.0-5197-g86385b1d (86385b1daf5235400bbcd34a02515d168bde88e2) squid (dev) 2024-07-24T21:55:19.483 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph version: ceph version 19.0.0-5197-g86385b1d (86385b1daf5235400bbcd34a02515d168bde88e2) squid (dev) 2024-07-24T21:55:19.483 INFO:teuthology.orchestra.run.smithi047.stdout:Extracting ceph user uid/gid from container image... 2024-07-24T21:55:20.446 INFO:teuthology.orchestra.run.smithi047.stdout:stat: stdout 167 167 2024-07-24T21:55:20.447 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial keys... 2024-07-24T21:55:21.296 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQBIeKFmAMx/LBAAAs9k0PRS9WXGpe5h9LfXiw== 2024-07-24T21:55:22.210 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQBJeKFmNbPkJBAAWHWgcNgH3NXzfUZG+/P7pg== 2024-07-24T21:55:23.115 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQBKeKFmSWRmIBAAaHOh2FFyQN9R7pcnBXoi5g== 2024-07-24T21:55:23.116 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial monmap... 2024-07-24T21:55:26.541 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-07-24T21:55:26.541 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-07-24T21:55:26.541 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:55:26.541 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-07-24T21:55:26.541 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool for a [v2:172.21.15.47:3300,v1:172.21.15.47:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-07-24T21:55:26.542 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = quincy 2024-07-24T21:55:26.542 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: set fsid to 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:55:26.542 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-07-24T21:55:26.542 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:55:26.542 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mon... 2024-07-24T21:55:27.479 INFO:teuthology.orchestra.run.smithi047.stdout:create mon.a on 2024-07-24T21:55:27.694 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-07-24T21:55:27.848 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-07-24T21:55:28.025 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-46bf760a-4a07-11ef-bcad-c7b262605968.target → /etc/systemd/system/ceph-46bf760a-4a07-11ef-bcad-c7b262605968.target. 2024-07-24T21:55:28.025 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-46bf760a-4a07-11ef-bcad-c7b262605968.target → /etc/systemd/system/ceph-46bf760a-4a07-11ef-bcad-c7b262605968.target. 2024-07-24T21:55:28.278 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.a 2024-07-24T21:55:28.278 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.a.service: Unit ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.a.service not loaded. 2024-07-24T21:55:28.460 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-46bf760a-4a07-11ef-bcad-c7b262605968.target.wants/ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.a.service → /etc/systemd/system/ceph-46bf760a-4a07-11ef-bcad-c7b262605968@.service. 2024-07-24T21:55:29.004 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-07-24T21:55:29.004 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-07-24T21:55:29.011 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-07-24T21:55:29.011 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-07-24T21:55:29.011 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-07-24T21:55:29.011 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-07-24T21:55:29.012 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon to start... 2024-07-24T21:55:29.012 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon... 2024-07-24T21:55:30.029 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:29 smithi047 ceph-mon[32187]: from='client.? 172.21.15.47:0/4178110353' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-07-24T21:55:30.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout cluster: 2024-07-24T21:55:30.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout id: 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:55:30.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-07-24T21:55:30.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-07-24T21:55:30.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout services: 2024-07-24T21:55:30.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.526256s) 2024-07-24T21:55:30.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-07-24T21:55:30.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-07-24T21:55:30.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-07-24T21:55:30.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout data: 2024-07-24T21:55:30.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-07-24T21:55:30.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-07-24T21:55:30.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-07-24T21:55:30.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pgs: 2024-07-24T21:55:30.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-07-24T21:55:30.034 INFO:teuthology.orchestra.run.smithi047.stdout:mon is available 2024-07-24T21:55:30.034 INFO:teuthology.orchestra.run.smithi047.stdout:Assimilating anything we can from ceph.conf... 2024-07-24T21:55:30.931 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-07-24T21:55:30.931 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-07-24T21:55:30.931 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-07-24T21:55:30.932 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-07-24T21:55:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-07-24T21:55:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-07-24T21:55:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-07-24T21:55:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:Generating new minimal ceph.conf... 2024-07-24T21:55:31.052 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:30 smithi047 ceph-mon[32187]: from='client.? 172.21.15.47:0/2725044956' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-07-24T21:55:31.052 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:30 smithi047 ceph-mon[32187]: from='client.? 172.21.15.47:0/2725044956' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-07-24T21:55:32.291 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:31 smithi047 ceph-mon[32187]: from='client.? 172.21.15.47:0/1294403982' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:55:32.294 INFO:teuthology.orchestra.run.smithi047.stdout:Restarting the monitor... 2024-07-24T21:55:32.579 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:32 smithi047 systemd[1]: Stopping Ceph mon.a for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T21:55:32.894 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:32 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a[32183]: 2024-07-24T21:55:32.576+0000 7f8d05a35640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T21:55:32.894 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:32 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a[32183]: 2024-07-24T21:55:32.576+0000 7f8d05a35640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-07-24T21:55:32.895 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:32 smithi047 podman[32431]: 2024-07-24 21:55:32.63851887 +0000 UTC m=+0.166025931 container died 7683395c9342bf9ecbd1b2ae79d5f7943b811478943b7688bb2dae2b6d91296c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-07-24T21:55:33.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:32 smithi047 podman[32431]: 2024-07-24 21:55:32.993017642 +0000 UTC m=+0.520524695 container cleanup 7683395c9342bf9ecbd1b2ae79d5f7943b811478943b7688bb2dae2b6d91296c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240716) 2024-07-24T21:55:33.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:32 smithi047 bash[32431]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a 2024-07-24T21:55:33.637 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 podman[32442]: 2024-07-24 21:55:33.285412767 +0000 UTC m=+0.644983740 container remove 7683395c9342bf9ecbd1b2ae79d5f7943b811478943b7688bb2dae2b6d91296c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-07-24T21:55:33.637 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 systemd[1]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.a.service: Deactivated successfully. 2024-07-24T21:55:33.637 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 systemd[1]: Stopped Ceph mon.a for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T21:55:33.637 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 systemd[1]: Starting Ceph mon.a for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T21:55:33.906 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 podman[32532]: 2024-07-24 21:55:33.636320793 +0000 UTC m=+0.108979117 container create 12081d7d286632835344303506eeda503a8f0642777a6906bf64cc3a68d4e135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a, GIT_BRANCH=HEAD, RELEASE=main-86385b1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-24T21:55:33.906 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 podman[32532]: 2024-07-24 21:55:33.545054436 +0000 UTC m=+0.017712773 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T21:55:33.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 podman[32532]: 2024-07-24 21:55:33.822361701 +0000 UTC m=+0.295020038 container init 12081d7d286632835344303506eeda503a8f0642777a6906bf64cc3a68d4e135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240716, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1) 2024-07-24T21:55:33.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 podman[32532]: 2024-07-24 21:55:33.825490723 +0000 UTC m=+0.298149042 container start 12081d7d286632835344303506eeda503a8f0642777a6906bf64cc3a68d4e135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240716, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=main-86385b1, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-07-24T21:55:33.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: set uid:gid to 167:167 (ceph:ceph) 2024-07-24T21:55:33.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: ceph version 19.0.0-5197-g86385b1d (86385b1daf5235400bbcd34a02515d168bde88e2) squid (dev), process ceph-mon, pid 2 2024-07-24T21:55:33.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: pidfile_write: ignore empty --pid-file 2024-07-24T21:55:33.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: load: jerasure load: lrc 2024-07-24T21:55:33.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: RocksDB version: 7.9.2 2024-07-24T21:55:33.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Git sha 0 2024-07-24T21:55:33.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Compile date 2024-07-22 20:32:46 2024-07-24T21:55:33.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: DB SUMMARY 2024-07-24T21:55:33.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: DB Session ID: E1GQIPH48P32RS64HV6N 2024-07-24T21:55:33.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: CURRENT file: CURRENT 2024-07-24T21:55:33.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: IDENTITY file: IDENTITY 2024-07-24T21:55:33.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-07-24T21:55:33.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-07-24T21:55:33.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94771 ; 2024-07-24T21:55:33.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.error_if_exists: 0 2024-07-24T21:55:33.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.create_if_missing: 0 2024-07-24T21:55:33.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.paranoid_checks: 1 2024-07-24T21:55:33.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.flush_verify_memtable_count: 1 2024-07-24T21:55:33.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-07-24T21:55:33.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-07-24T21:55:33.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.env: 0x56427a420840 2024-07-24T21:55:33.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.fs: PosixFileSystem 2024-07-24T21:55:33.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.info_log: 0x56427b1074c0 2024-07-24T21:55:33.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_file_opening_threads: 16 2024-07-24T21:55:33.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.statistics: (nil) 2024-07-24T21:55:33.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.use_fsync: 0 2024-07-24T21:55:33.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_log_file_size: 0 2024-07-24T21:55:33.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-07-24T21:55:33.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.log_file_time_to_roll: 0 2024-07-24T21:55:33.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.keep_log_file_num: 1000 2024-07-24T21:55:33.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.recycle_log_file_num: 0 2024-07-24T21:55:33.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.allow_fallocate: 1 2024-07-24T21:55:33.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.allow_mmap_reads: 0 2024-07-24T21:55:33.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.allow_mmap_writes: 0 2024-07-24T21:55:33.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.use_direct_reads: 0 2024-07-24T21:55:33.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-07-24T21:55:33.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.create_missing_column_families: 0 2024-07-24T21:55:33.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.db_log_dir: 2024-07-24T21:55:33.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.wal_dir: 2024-07-24T21:55:33.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.table_cache_numshardbits: 6 2024-07-24T21:55:33.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.WAL_ttl_seconds: 0 2024-07-24T21:55:33.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.WAL_size_limit_MB: 0 2024-07-24T21:55:33.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-07-24T21:55:33.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-07-24T21:55:33.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.is_fd_close_on_exec: 1 2024-07-24T21:55:33.910 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.advise_random_on_open: 1 2024-07-24T21:55:33.911 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.db_write_buffer_size: 0 2024-07-24T21:55:33.911 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.write_buffer_manager: 0x56427b10ae60 2024-07-24T21:55:33.911 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-07-24T21:55:33.911 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-07-24T21:55:33.911 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.use_adaptive_mutex: 0 2024-07-24T21:55:33.911 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.rate_limiter: (nil) 2024-07-24T21:55:33.911 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-07-24T21:55:33.911 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.wal_recovery_mode: 2 2024-07-24T21:55:33.912 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.enable_thread_tracking: 0 2024-07-24T21:55:33.913 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.enable_pipelined_write: 0 2024-07-24T21:55:33.913 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.unordered_write: 0 2024-07-24T21:55:33.913 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-07-24T21:55:33.913 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-07-24T21:55:33.913 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-07-24T21:55:33.913 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-07-24T21:55:33.913 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.row_cache: None 2024-07-24T21:55:33.913 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.wal_filter: None 2024-07-24T21:55:33.913 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-07-24T21:55:33.913 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.allow_ingest_behind: 0 2024-07-24T21:55:33.913 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.two_write_queues: 0 2024-07-24T21:55:33.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.manual_wal_flush: 0 2024-07-24T21:55:33.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.wal_compression: 0 2024-07-24T21:55:33.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.atomic_flush: 0 2024-07-24T21:55:33.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-07-24T21:55:33.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.persist_stats_to_disk: 0 2024-07-24T21:55:33.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.write_dbid_to_manifest: 0 2024-07-24T21:55:33.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.log_readahead_size: 0 2024-07-24T21:55:33.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-07-24T21:55:33.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.best_efforts_recovery: 0 2024-07-24T21:55:33.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-07-24T21:55:33.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-07-24T21:55:33.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.allow_data_in_errors: 0 2024-07-24T21:55:33.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.db_host_id: __hostname__ 2024-07-24T21:55:33.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.enforce_single_del_contracts: true 2024-07-24T21:55:33.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_background_jobs: 2 2024-07-24T21:55:33.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_background_compactions: -1 2024-07-24T21:55:33.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_subcompactions: 1 2024-07-24T21:55:33.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-07-24T21:55:33.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-07-24T21:55:33.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.delayed_write_rate : 16777216 2024-07-24T21:55:33.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_total_wal_size: 0 2024-07-24T21:55:33.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-07-24T21:55:33.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.stats_dump_period_sec: 600 2024-07-24T21:55:33.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.stats_persist_period_sec: 600 2024-07-24T21:55:33.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-07-24T21:55:33.916 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_open_files: -1 2024-07-24T21:55:33.916 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.bytes_per_sync: 0 2024-07-24T21:55:33.916 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.wal_bytes_per_sync: 0 2024-07-24T21:55:33.916 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.strict_bytes_per_sync: 0 2024-07-24T21:55:33.916 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compaction_readahead_size: 0 2024-07-24T21:55:33.916 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_background_flushes: -1 2024-07-24T21:55:33.916 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Compression algorithms supported: 2024-07-24T21:55:33.916 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: kZSTD supported: 0 2024-07-24T21:55:33.916 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: kXpressCompression supported: 0 2024-07-24T21:55:33.916 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: kBZip2Compression supported: 0 2024-07-24T21:55:33.916 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-07-24T21:55:33.916 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: kLZ4Compression supported: 1 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: kZlibCompression supported: 1 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: kLZ4HCCompression supported: 1 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: kSnappyCompression supported: 1 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Fast CRC32 supported: Supported on x86 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: DMutex implementation: pthread_mutex_t 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.merge_operator: 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compaction_filter: None 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compaction_filter_factory: None 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.sst_partitioner_factory: None 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.memtable_factory: SkipListFactory 2024-07-24T21:55:33.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.table_factory: BlockBasedTable 2024-07-24T21:55:33.918 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56427b1070e0) 2024-07-24T21:55:33.918 INFO:journalctl@ceph.mon.a.smithi047.stdout: cache_index_and_filter_blocks: 1 2024-07-24T21:55:33.918 INFO:journalctl@ceph.mon.a.smithi047.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-07-24T21:55:33.918 INFO:journalctl@ceph.mon.a.smithi047.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-07-24T21:55:33.918 INFO:journalctl@ceph.mon.a.smithi047.stdout: pin_top_level_index_and_filter: 1 2024-07-24T21:55:33.918 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_type: 0 2024-07-24T21:55:33.918 INFO:journalctl@ceph.mon.a.smithi047.stdout: data_block_index_type: 0 2024-07-24T21:55:33.918 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_shortening: 1 2024-07-24T21:55:33.918 INFO:journalctl@ceph.mon.a.smithi047.stdout: data_block_hash_table_util_ratio: 0.750000 2024-07-24T21:55:33.918 INFO:journalctl@ceph.mon.a.smithi047.stdout: checksum: 4 2024-07-24T21:55:33.918 INFO:journalctl@ceph.mon.a.smithi047.stdout: no_block_cache: 0 2024-07-24T21:55:33.918 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache: 0x56427b0fb610 2024-07-24T21:55:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_name: BinnedLRUCache 2024-07-24T21:55:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_options: 2024-07-24T21:55:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout: capacity : 536870912 2024-07-24T21:55:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout: num_shard_bits : 4 2024-07-24T21:55:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout: strict_capacity_limit : 0 2024-07-24T21:55:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout: high_pri_pool_ratio: 0.000 2024-07-24T21:55:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_compressed: (nil) 2024-07-24T21:55:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout: persistent_cache: (nil) 2024-07-24T21:55:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_size: 4096 2024-07-24T21:55:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_size_deviation: 10 2024-07-24T21:55:33.920 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_restart_interval: 16 2024-07-24T21:55:33.920 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_block_restart_interval: 1 2024-07-24T21:55:33.920 INFO:journalctl@ceph.mon.a.smithi047.stdout: metadata_block_size: 4096 2024-07-24T21:55:33.920 INFO:journalctl@ceph.mon.a.smithi047.stdout: partition_filters: 0 2024-07-24T21:55:33.920 INFO:journalctl@ceph.mon.a.smithi047.stdout: use_delta_encoding: 1 2024-07-24T21:55:33.920 INFO:journalctl@ceph.mon.a.smithi047.stdout: filter_policy: bloomfilter 2024-07-24T21:55:33.920 INFO:journalctl@ceph.mon.a.smithi047.stdout: whole_key_filtering: 1 2024-07-24T21:55:33.920 INFO:journalctl@ceph.mon.a.smithi047.stdout: verify_compression: 0 2024-07-24T21:55:33.920 INFO:journalctl@ceph.mon.a.smithi047.stdout: read_amp_bytes_per_bit: 0 2024-07-24T21:55:33.920 INFO:journalctl@ceph.mon.a.smithi047.stdout: format_version: 5 2024-07-24T21:55:33.920 INFO:journalctl@ceph.mon.a.smithi047.stdout: enable_index_compression: 1 2024-07-24T21:55:33.920 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_align: 0 2024-07-24T21:55:33.920 INFO:journalctl@ceph.mon.a.smithi047.stdout: max_auto_readahead_size: 262144 2024-07-24T21:55:33.921 INFO:journalctl@ceph.mon.a.smithi047.stdout: prepopulate_block_cache: 0 2024-07-24T21:55:33.921 INFO:journalctl@ceph.mon.a.smithi047.stdout: initial_auto_readahead_size: 8192 2024-07-24T21:55:33.921 INFO:journalctl@ceph.mon.a.smithi047.stdout: num_file_reads_for_auto_readahead: 2 2024-07-24T21:55:33.921 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.write_buffer_size: 33554432 2024-07-24T21:55:33.921 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_write_buffer_number: 2 2024-07-24T21:55:33.921 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compression: NoCompression 2024-07-24T21:55:33.921 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.bottommost_compression: Disabled 2024-07-24T21:55:33.921 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.prefix_extractor: nullptr 2024-07-24T21:55:33.921 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-07-24T21:55:33.921 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.num_levels: 7 2024-07-24T21:55:33.921 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-07-24T21:55:33.921 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-07-24T21:55:33.921 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compression_opts.window_bits: -14 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compression_opts.level: 32767 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compression_opts.strategy: 0 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-07-24T21:55:33.922 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-07-24T21:55:33.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-07-24T21:55:33.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-07-24T21:55:33.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compression_opts.enabled: false 2024-07-24T21:55:33.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-07-24T21:55:33.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-07-24T21:55:33.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-07-24T21:55:33.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-07-24T21:55:33.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.target_file_size_base: 67108864 2024-07-24T21:55:33.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.target_file_size_multiplier: 1 2024-07-24T21:55:33.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-07-24T21:55:33.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-07-24T21:55:33.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-07-24T21:55:33.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-07-24T21:55:33.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-07-24T21:55:33.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-07-24T21:55:33.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-07-24T21:55:33.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-07-24T21:55:33.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-07-24T21:55:33.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-07-24T21:55:33.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-07-24T21:55:33.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-07-24T21:55:33.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-07-24T21:55:33.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.arena_block_size: 1048576 2024-07-24T21:55:33.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-07-24T21:55:33.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-07-24T21:55:33.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.disable_auto_compactions: 0 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.inplace_update_support: 0 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.inplace_update_num_locks: 10000 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-07-24T21:55:33.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-07-24T21:55:33.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.memtable_huge_page_size: 0 2024-07-24T21:55:33.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.bloom_locality: 0 2024-07-24T21:55:33.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.max_successive_merges: 0 2024-07-24T21:55:33.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.optimize_filters_for_hits: 0 2024-07-24T21:55:33.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.paranoid_file_checks: 0 2024-07-24T21:55:33.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.force_consistency_checks: 1 2024-07-24T21:55:33.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.report_bg_io_stats: 0 2024-07-24T21:55:33.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.ttl: 2592000 2024-07-24T21:55:33.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.periodic_compaction_seconds: 0 2024-07-24T21:55:33.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-07-24T21:55:33.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-07-24T21:55:33.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.enable_blob_files: false 2024-07-24T21:55:33.927 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.min_blob_size: 0 2024-07-24T21:55:33.927 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.blob_file_size: 268435456 2024-07-24T21:55:33.927 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.blob_compression_type: NoCompression 2024-07-24T21:55:33.927 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.enable_blob_garbage_collection: false 2024-07-24T21:55:33.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-07-24T21:55:33.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-07-24T21:55:33.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-07-24T21:55:33.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.blob_file_starting_level: 0 2024-07-24T21:55:33.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-07-24T21:55:33.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-07-24T21:55:33.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-07-24T21:55:33.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7348d917-bc18-469e-9319-772d4cb9fc33 2024-07-24T21:55:33.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721858133852653, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-07-24T21:55:33.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-07-24T21:55:33.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721858133853678, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 90945, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 282, "table_properties": {"data_size": 88986, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11589, "raw_average_key_size": 48, "raw_value_size": 82474, "raw_average_value_size": 342, "num_data_blocks": 12, "num_entries": 241, "num_filter_entries": 241, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1721858133, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7348d917-bc18-469e-9319-772d4cb9fc33", "db_session_id": "E1GQIPH48P32RS64HV6N", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-07-24T21:55:33.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721858133853777, "job": 1, "event": "recovery_finished"} 2024-07-24T21:55:33.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-07-24T21:55:33.929 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-07-24T21:55:33.929 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56427b128e00 2024-07-24T21:55:33.929 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: DB pointer 0x56427b220000 2024-07-24T21:55:33.929 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-07-24T21:55:33.929 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-07-24T21:55:33.929 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** DB Stats ** 2024-07-24T21:55:33.929 INFO:journalctl@ceph.mon.a.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-07-24T21:55:33.929 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-07-24T21:55:33.929 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-07-24T21:55:33.929 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-07-24T21:55:33.929 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-07-24T21:55:33.929 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-07-24T21:55:33.929 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-07-24T21:55:33.930 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-07-24T21:55:33.930 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** Compaction Stats [default] ** 2024-07-24T21:55:33.930 INFO:journalctl@ceph.mon.a.smithi047.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-07-24T21:55:33.930 INFO:journalctl@ceph.mon.a.smithi047.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-07-24T21:55:33.930 INFO:journalctl@ceph.mon.a.smithi047.stdout: L0 2/0 90.67 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-07-24T21:55:33.930 INFO:journalctl@ceph.mon.a.smithi047.stdout: Sum 2/0 90.67 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-07-24T21:55:33.930 INFO:journalctl@ceph.mon.a.smithi047.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-07-24T21:55:33.930 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-07-24T21:55:33.930 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** Compaction Stats [default] ** 2024-07-24T21:55:33.930 INFO:journalctl@ceph.mon.a.smithi047.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-07-24T21:55:33.930 INFO:journalctl@ceph.mon.a.smithi047.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-07-24T21:55:33.930 INFO:journalctl@ceph.mon.a.smithi047.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 131.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-07-24T21:55:33.930 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(Keys): cumulative 0, interval 0 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative compaction: 0.00 GB write, 26.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval compaction: 0.00 GB write, 26.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: Block cache BinnedLRUCache@0x56427b0fb610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-07-24T21:55:33.931 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-07-24T21:55:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** File Read Latency Histogram By Level [default] ** 2024-07-24T21:55:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: starting mon.a rank 0 at public addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] at bind addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:55:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: mon.a@-1(???) e1 preinit fsid 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:55:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: mon.a@-1(???).mds e1 new map 2024-07-24T21:55:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: mon.a@-1(???).mds e1 print_map 2024-07-24T21:55:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout: e1 2024-07-24T21:55:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout: btime 2024-07-24T21:55:28:945758+0000 2024-07-24T21:55:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-07-24T21:55:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-07-24T21:55:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout: legacy client fscid: -1 2024-07-24T21:55:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-07-24T21:55:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout: No filesystems configured 2024-07-24T21:55:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-07-24T21:55:33.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-07-24T21:55:33.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-07-24T21:55:33.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-07-24T21:55:33.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-07-24T21:55:33.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 bash[32532]: 12081d7d286632835344303506eeda503a8f0642777a6906bf64cc3a68d4e135 2024-07-24T21:55:33.933 INFO:teuthology.orchestra.run.smithi047.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-07-24T21:55:34.165 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 systemd[1]: Started Ceph mon.a for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T21:55:34.165 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: mon.a is new leader, mons a in quorum (ranks 0) 2024-07-24T21:55:34.165 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: monmap epoch 1 2024-07-24T21:55:34.165 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: fsid 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:55:34.165 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: last_changed 2024-07-24T21:55:23.454131+0000 2024-07-24T21:55:34.165 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: created 2024-07-24T21:55:23.454131+0000 2024-07-24T21:55:34.166 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: min_mon_release 19 (squid) 2024-07-24T21:55:34.166 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: election_strategy: 1 2024-07-24T21:55:34.166 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-07-24T21:55:34.166 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: fsmap 2024-07-24T21:55:34.166 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: osdmap e1: 0 total, 0 up, 0 in 2024-07-24T21:55:34.166 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:33 smithi047 ceph-mon[32551]: mgrmap e1: no daemons active 2024-07-24T21:55:34.924 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote config to /etc/ceph/ceph.conf 2024-07-24T21:55:34.945 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-07-24T21:55:34.945 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mgr... 2024-07-24T21:55:34.946 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying port 0.0.0.0:9283 ... 2024-07-24T21:55:34.946 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying port 0.0.0.0:8765 ... 2024-07-24T21:55:35.203 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.x 2024-07-24T21:55:35.203 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.x.service: Unit ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.x.service not loaded. 2024-07-24T21:55:35.361 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-46bf760a-4a07-11ef-bcad-c7b262605968.target.wants/ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-46bf760a-4a07-11ef-bcad-c7b262605968@.service. 2024-07-24T21:55:35.598 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:35 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2233492841' entity='client.admin' 2024-07-24T21:55:35.916 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:35 smithi047 podman[32762]: 2024-07-24 21:55:35.835399748 +0000 UTC m=+0.348132389 container start f03081798de4079aba41f78865391d842126d12d801825db6d5154818dae4cc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=main-86385b1, GIT_CLEAN=True, org.label-schema.build-date=20240716) 2024-07-24T21:55:35.917 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:35 smithi047 bash[32762]: f03081798de4079aba41f78865391d842126d12d801825db6d5154818dae4cc8 2024-07-24T21:55:35.931 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-07-24T21:55:35.931 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-07-24T21:55:35.939 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-07-24T21:55:35.939 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-07-24T21:55:35.939 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-07-24T21:55:35.939 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-07-24T21:55:35.948 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-07-24T21:55:35.948 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-07-24T21:55:35.956 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-07-24T21:55:35.956 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-07-24T21:55:35.956 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-07-24T21:55:35.956 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-07-24T21:55:35.957 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr to start... 2024-07-24T21:55:35.957 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr... 2024-07-24T21:55:36.186 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:35 smithi047 systemd[1]: Started Ceph mgr.x for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T21:55:36.772 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:36 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/511834084' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-07-24T21:55:37.025 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-07-24T21:55:37.028 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-07-24T21:55:37.028 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "46bf760a-4a07-11ef-bcad-c7b262605968", 2024-07-24T21:55:37.028 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-07-24T21:55:37.028 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-07-24T21:55:37.028 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-07-24T21:55:37.028 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-07-24T21:55:37.028 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:37.029 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-07-24T21:55:37.030 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-24T21:55:37.030 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-07-24T21:55:37.030 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-07-24T21:55:37.030 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-07-24T21:55:37.030 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-07-24T21:55:37.030 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-07-24T21:55:37.030 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-07-24T21:55:37.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:37.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-07-24T21:55:37.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-07-24T21:55:37.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-07-24T21:55:37.033 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-07-24T21:55:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-07-24T21:55:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-07-24T21:55:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-07-24T21:55:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-07-24T21:55:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-07-24T21:55:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-07-24T21:55:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-24T21:55:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "btime": "2024-07-24T21:55:28:945758+0000", 2024-07-24T21:55:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-07-24T21:55:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-07-24T21:55:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-07-24T21:55:28.946394+0000", 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-07-24T21:55:37.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-07-24T21:55:37.036 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (1/15)... 2024-07-24T21:55:39.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:39 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1024690420' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-07-24T21:55:40.084 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-07-24T21:55:40.084 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-07-24T21:55:40.084 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "46bf760a-4a07-11ef-bcad-c7b262605968", 2024-07-24T21:55:40.084 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-07-24T21:55:40.084 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-07-24T21:55:40.084 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-07-24T21:55:40.085 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-07-24T21:55:40.085 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:40.085 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-07-24T21:55:40.085 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-07-24T21:55:40.085 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-07-24T21:55:40.085 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-07-24T21:55:40.085 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-07-24T21:55:40.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-07-24T21:55:40.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-07-24T21:55:40.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-07-24T21:55:40.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-07-24T21:55:40.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-24T21:55:40.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-07-24T21:55:40.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-07-24T21:55:40.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:40.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-07-24T21:55:40.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-24T21:55:40.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-07-24T21:55:40.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-07-24T21:55:40.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-07-24T21:55:40.087 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-07-24T21:55:40.087 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-07-24T21:55:40.087 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-07-24T21:55:40.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "btime": "2024-07-24T21:55:28:945758+0000", 2024-07-24T21:55:40.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-07-24T21:55:40.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-24T21:55:40.093 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-07-24T21:55:28.946394+0000", 2024-07-24T21:55:40.093 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-24T21:55:40.093 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:40.093 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-07-24T21:55:40.093 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-07-24T21:55:40.093 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (2/15)... 2024-07-24T21:55:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:41 smithi047 ceph-mon[32551]: Activating manager daemon x 2024-07-24T21:55:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:41 smithi047 ceph-mon[32551]: mgrmap e2: x(active, starting, since 0.00336389s) 2024-07-24T21:55:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:41 smithi047 ceph-mon[32551]: from='mgr.14100 172.21.15.47:0/3557081257' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-24T21:55:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:41 smithi047 ceph-mon[32551]: from='mgr.14100 172.21.15.47:0/3557081257' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-24T21:55:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:41 smithi047 ceph-mon[32551]: from='mgr.14100 172.21.15.47:0/3557081257' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-24T21:55:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:41 smithi047 ceph-mon[32551]: from='mgr.14100 172.21.15.47:0/3557081257' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:55:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:41 smithi047 ceph-mon[32551]: from='mgr.14100 172.21.15.47:0/3557081257' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-24T21:55:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:41 smithi047 ceph-mon[32551]: Manager daemon x is now available 2024-07-24T21:55:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:41 smithi047 ceph-mon[32551]: from='mgr.14100 172.21.15.47:0/3557081257' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-24T21:55:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:41 smithi047 ceph-mon[32551]: from='mgr.14100 172.21.15.47:0/3557081257' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-24T21:55:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:41 smithi047 ceph-mon[32551]: from='mgr.14100 172.21.15.47:0/3557081257' entity='mgr.x' 2024-07-24T21:55:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:41 smithi047 ceph-mon[32551]: from='mgr.14100 172.21.15.47:0/3557081257' entity='mgr.x' 2024-07-24T21:55:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:41 smithi047 ceph-mon[32551]: from='mgr.14100 172.21.15.47:0/3557081257' entity='mgr.x' 2024-07-24T21:55:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-07-24T21:55:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-07-24T21:55:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "46bf760a-4a07-11ef-bcad-c7b262605968", 2024-07-24T21:55:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-07-24T21:55:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-07-24T21:55:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-07-24T21:55:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-07-24T21:55:43.278 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:43.278 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-07-24T21:55:43.278 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-07-24T21:55:43.278 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-07-24T21:55:43.278 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-07-24T21:55:43.278 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-07-24T21:55:43.278 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-07-24T21:55:43.278 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-07-24T21:55:43.278 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-07-24T21:55:43.278 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-07-24T21:55:43.278 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-24T21:55:43.278 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-07-24T21:55:43.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-07-24T21:55:43.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:43.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-07-24T21:55:43.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-24T21:55:43.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-07-24T21:55:43.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-07-24T21:55:43.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-07-24T21:55:43.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-07-24T21:55:43.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-07-24T21:55:43.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-07-24T21:55:43.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:43.279 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "btime": "2024-07-24T21:55:28:945758+0000", 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-07-24T21:55:43.280 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-07-24T21:55:28.946394+0000", 2024-07-24T21:55:43.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-24T21:55:43.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-07-24T21:55:43.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-07-24T21:55:43.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-07-24T21:55:43.282 INFO:teuthology.orchestra.run.smithi047.stdout:mgr is available 2024-07-24T21:55:43.394 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:43 smithi047 ceph-mon[32551]: mgrmap e3: x(active, since 1.0076s) 2024-07-24T21:55:43.394 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:43 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/4133942759' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-07-24T21:55:44.408 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:44 smithi047 ceph-mon[32551]: mgrmap e4: x(active, since 2s) 2024-07-24T21:55:44.408 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:44 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3017619254' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-07-24T21:55:44.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-07-24T21:55:44.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-07-24T21:55:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:55:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-07-24T21:55:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-07-24T21:55:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-07-24T21:55:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-07-24T21:55:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-07-24T21:55:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-07-24T21:55:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-07-24T21:55:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-07-24T21:55:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-07-24T21:55:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-07-24T21:55:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-07-24T21:55:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-07-24T21:55:44.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-07-24T21:55:44.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-07-24T21:55:44.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-07-24T21:55:44.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-07-24T21:55:44.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-07-24T21:55:44.414 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling cephadm module... 2024-07-24T21:55:45.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:45 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1983263016' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-07-24T21:55:45.436 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:45 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: ignoring --setuser ceph since I am not root 2024-07-24T21:55:45.437 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:45 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: ignoring --setgroup ceph since I am not root 2024-07-24T21:55:46.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:46 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1983263016' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-07-24T21:55:46.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:46 smithi047 ceph-mon[32551]: mgrmap e5: x(active, since 4s) 2024-07-24T21:55:47.157 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-07-24T21:55:47.157 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-07-24T21:55:47.158 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-07-24T21:55:47.158 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-07-24T21:55:47.158 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-07-24T21:55:47.158 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-07-24T21:55:47.158 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-07-24T21:55:47.158 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 5... 2024-07-24T21:55:47.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:47 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1543947298' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-07-24T21:55:51.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: Active manager daemon x restarted 2024-07-24T21:55:51.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: Activating manager daemon x 2024-07-24T21:55:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: osdmap e2: 0 total, 0 up, 0 in 2024-07-24T21:55:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: mgrmap e6: x(active, starting, since 0.00340241s) 2024-07-24T21:55:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:55:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-24T21:55:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-24T21:55:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-24T21:55:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-24T21:55:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: Manager daemon x is now available 2024-07-24T21:55:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:55:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:55:51.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:55:51.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:55:51.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-24T21:55:51.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:50 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-24T21:55:51.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:51 smithi047 ceph-mon[32551]: Found migration_current of "None". Setting to last migration. 2024-07-24T21:55:51.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:51 smithi047 ceph-mon[32551]: mgrmap e7: x(active, since 1.00588s) 2024-07-24T21:55:52.330 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-07-24T21:55:52.331 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-07-24T21:55:52.331 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-07-24T21:55:52.331 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-07-24T21:55:52.331 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 5 is available 2024-07-24T21:55:52.331 INFO:teuthology.orchestra.run.smithi047.stdout:Setting orchestrator backend to cephadm... 2024-07-24T21:55:52.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:52 smithi047 ceph-mon[32551]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-07-24T21:55:52.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:52 smithi047 ceph-mon[32551]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-07-24T21:55:52.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:52 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:55:52.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:52 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:55:54.069 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:53 smithi047 ceph-mon[32551]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:55:54.069 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:53 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:55:54.069 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:53 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:55:54.069 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:53 smithi047 ceph-mon[32551]: mgrmap e8: x(active, since 2s) 2024-07-24T21:55:54.381 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T21:55:54.094+0000 7f1942fbb640 -1 log_channel(cephadm) log [ERR] : [24/Jul/2024:21:55:54] ENGINE Error in HTTPServer.serve 2024-07-24T21:55:54.381 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: Traceback (most recent call last): 2024-07-24T21:55:54.381 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-24T21:55:54.381 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: self._connections.run(self.expiration_interval) 2024-07-24T21:55:54.382 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-24T21:55:54.382 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: self._run(expiration_interval) 2024-07-24T21:55:54.382 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-24T21:55:54.382 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: new_conn = self._from_server_socket(self.server.socket) 2024-07-24T21:55:54.382 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-24T21:55:54.382 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-24T21:55:54.382 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-24T21:55:54.382 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: s = self.context.wrap_socket( 2024-07-24T21:55:54.382 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-24T21:55:54.382 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: return self.sslsocket_class._create( 2024-07-24T21:55:54.382 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-24T21:55:54.382 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: self.do_handshake() 2024-07-24T21:55:54.383 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-24T21:55:54.383 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: self._sslobj.do_handshake() 2024-07-24T21:55:54.383 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-24T21:55:54.383 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T21:55:54.651 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout value unchanged 2024-07-24T21:55:54.651 INFO:teuthology.orchestra.run.smithi047.stdout:Generating ssh key... 2024-07-24T21:55:55.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-mon[32551]: [24/Jul/2024:21:55:53] ENGINE Bus STARTING 2024-07-24T21:55:55.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-mon[32551]: [24/Jul/2024:21:55:53] ENGINE Serving on http://172.21.15.47:8765 2024-07-24T21:55:55.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-mon[32551]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:55:55.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-mon[32551]: [24/Jul/2024:21:55:54] ENGINE Serving on https://172.21.15.47:7150 2024-07-24T21:55:55.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-mon[32551]: [24/Jul/2024:21:55:54] ENGINE Bus STARTED 2024-07-24T21:55:55.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:55:55.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:54 smithi047 ceph-mon[32551]: [24/Jul/2024:21:55:54] ENGINE Error in HTTPServer.serve 2024-07-24T21:55:55.186 INFO:journalctl@ceph.mon.a.smithi047.stdout: Traceback (most recent call last): 2024-07-24T21:55:55.187 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-24T21:55:55.187 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._connections.run(self.expiration_interval) 2024-07-24T21:55:55.187 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-24T21:55:55.187 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._run(expiration_interval) 2024-07-24T21:55:55.187 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-24T21:55:55.187 INFO:journalctl@ceph.mon.a.smithi047.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-07-24T21:55:55.187 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-24T21:55:55.187 INFO:journalctl@ceph.mon.a.smithi047.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-24T21:55:55.187 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-24T21:55:55.187 INFO:journalctl@ceph.mon.a.smithi047.stdout: s = self.context.wrap_socket( 2024-07-24T21:55:55.187 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-24T21:55:55.187 INFO:journalctl@ceph.mon.a.smithi047.stdout: return self.sslsocket_class._create( 2024-07-24T21:55:55.187 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-24T21:55:55.188 INFO:journalctl@ceph.mon.a.smithi047.stdout: self.do_handshake() 2024-07-24T21:55:55.188 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-24T21:55:55.188 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._sslobj.do_handshake() 2024-07-24T21:55:55.188 INFO:journalctl@ceph.mon.a.smithi047.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-24T21:55:55.686 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: Generating public/private rsa key pair. 2024-07-24T21:55:55.686 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: Your identification has been saved in /tmp/tmpf3382uf3/key 2024-07-24T21:55:55.687 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: Your public key has been saved in /tmp/tmpf3382uf3/key.pub 2024-07-24T21:55:55.687 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: The key fingerprint is: 2024-07-24T21:55:55.687 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: SHA256:ItCGUjMiDVbcze+z4fxAMEg+6rB/ks3CHSCwNKaHa1o ceph-46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:55:55.687 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: The key's randomart image is: 2024-07-24T21:55:55.687 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: +---[RSA 3072]----+ 2024-07-24T21:55:55.687 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: |++*...o | 2024-07-24T21:55:55.687 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: |+*.*o..o | 2024-07-24T21:55:55.687 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: |*o+ o+ o. | 2024-07-24T21:55:55.687 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: |+o.+. . o. | 2024-07-24T21:55:55.687 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: | +..o . S. | 2024-07-24T21:55:55.687 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: |..E o ..+ | 2024-07-24T21:55:55.688 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: |oo..= . o.+ | 2024-07-24T21:55:55.688 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: |. .= = +. | 2024-07-24T21:55:55.688 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: | .+ .. | 2024-07-24T21:55:55.688 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: +----[SHA256]-----+ 2024-07-24T21:55:56.046 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-mon[32551]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:55:56.046 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-mon[32551]: Generating ssh key... 2024-07-24T21:55:56.047 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:55:56.047 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:55 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:55:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRJUQ73FSZexVwhkRp8fZijs3Jp249qvxjzZM03eWdgtVQ/+P54Kqx5V6sBnbH2kyEWf46R6r4qajBp/knFv18wMQEU4fTLeyIvMCSY/MeGcLa1hXgUsejnNhUKytooUUXE3eKIqT/2Whzw6lg45vhvVzhFsyXV32uzhfZptf/Xvb+T5Or4Ig4suvNZ4DeZEw1SCkFILNTGeq9ECLtwxZgcTTkxGQY71ix0bHAeYeHcVh6775+lcn1e2j74xDwnLxCt83jnSLDC9EuDkYtbIwaQS3S0BYCOdIlGGfrbjfvKB/JYZnsxO/g7bUzR+HHSF5FY2HDbfG75x8j6sffqaWxzwwX11eT3XtfsN5/Isu9D1Qt20tZvNDiKXDphQZF+VhGqkBXQJNqIpt13e5r0j2J6IetALb7zbOFdoMTyDH+94xVg1OdErunDK3qgf1UOZykXJPHtduhVadL5Esy2nEgpbt9grs9mUk8yhDQcwY5lCrYx474UiTA5Fbz77Mc9Hs= ceph-46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:55:57.189 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-07-24T21:55:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:Adding key to root@localhost authorized_keys... 2024-07-24T21:55:57.190 INFO:teuthology.orchestra.run.smithi047.stdout:Adding host smithi047... 2024-07-24T21:55:57.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:57 smithi047 ceph-mon[32551]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:55:58.502 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:58 smithi047 ceph-mon[32551]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi047", "addr": "172.21.15.47", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:55:59.428 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:55:59 smithi047 ceph-mon[32551]: Deploying cephadm binary to smithi047 2024-07-24T21:56:02.355 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Added host 'smithi047' with addr '172.21.15.47' 2024-07-24T21:56:02.355 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying unmanaged mon service... 2024-07-24T21:56:03.017 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:02 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:56:03.017 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:02 smithi047 ceph-mon[32551]: Added host smithi047 2024-07-24T21:56:03.017 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:02 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:56:03.606 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-07-24T21:56:03.606 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying unmanaged mgr service... 2024-07-24T21:56:04.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:04 smithi047 ceph-mon[32551]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:56:04.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:04 smithi047 ceph-mon[32551]: Saving service mon spec with placement count:5 2024-07-24T21:56:04.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:04 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:56:05.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:05 smithi047 ceph-mon[32551]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:56:05.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:05 smithi047 ceph-mon[32551]: Saving service mgr spec with placement count:2 2024-07-24T21:56:05.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:05 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:56:05.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:05 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:56:05.626 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-07-24T21:56:06.898 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:06 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:56:06.898 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:06 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1239951789' entity='client.admin' 2024-07-24T21:56:08.116 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling the dashboard module... 2024-07-24T21:56:08.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:08 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1186167290' entity='client.admin' 2024-07-24T21:56:09.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:09 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:56:09.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:09 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/997844395' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-07-24T21:56:09.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:09 smithi047 ceph-mon[32551]: from='mgr.14118 172.21.15.47:0/2356911974' entity='mgr.x' 2024-07-24T21:56:09.936 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:09 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: ignoring --setuser ceph since I am not root 2024-07-24T21:56:09.936 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:09 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: ignoring --setgroup ceph since I am not root 2024-07-24T21:56:10.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:10 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/997844395' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-07-24T21:56:10.742 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:10 smithi047 ceph-mon[32551]: mgrmap e9: x(active, since 18s) 2024-07-24T21:56:11.905 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:11 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3777513822' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-07-24T21:56:12.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-07-24T21:56:12.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-07-24T21:56:12.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-07-24T21:56:12.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-07-24T21:56:12.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-07-24T21:56:12.370 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-07-24T21:56:12.370 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-07-24T21:56:12.370 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 9... 2024-07-24T21:56:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:15 smithi047 ceph-mon[32551]: Active manager daemon x restarted 2024-07-24T21:56:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:15 smithi047 ceph-mon[32551]: Activating manager daemon x 2024-07-24T21:56:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:15 smithi047 ceph-mon[32551]: osdmap e3: 0 total, 0 up, 0 in 2024-07-24T21:56:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:15 smithi047 ceph-mon[32551]: mgrmap e10: x(active, starting, since 0.00349792s) 2024-07-24T21:56:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:56:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-24T21:56:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-24T21:56:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-24T21:56:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-24T21:56:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:15 smithi047 ceph-mon[32551]: Manager daemon x is now available 2024-07-24T21:56:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:56:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-24T21:56:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-24T21:56:16.669 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-07-24T21:56:16.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-07-24T21:56:16.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-07-24T21:56:16.670 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-07-24T21:56:16.670 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 9 is available 2024-07-24T21:56:16.670 INFO:teuthology.orchestra.run.smithi047.stdout:Generating a dashboard self-signed certificate... 2024-07-24T21:56:16.920 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T21:56:16.703+0000 7ff7b1ee8640 -1 log_channel(cephadm) log [ERR] : [24/Jul/2024:21:56:16] ENGINE Error in HTTPServer.serve 2024-07-24T21:56:16.920 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: Traceback (most recent call last): 2024-07-24T21:56:16.920 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-24T21:56:16.920 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: self._connections.run(self.expiration_interval) 2024-07-24T21:56:16.920 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-24T21:56:16.920 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: self._run(expiration_interval) 2024-07-24T21:56:16.920 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-24T21:56:16.920 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: new_conn = self._from_server_socket(self.server.socket) 2024-07-24T21:56:16.920 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-24T21:56:16.921 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-24T21:56:16.921 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-24T21:56:16.921 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: s = self.context.wrap_socket( 2024-07-24T21:56:16.921 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-24T21:56:16.921 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: return self.sslsocket_class._create( 2024-07-24T21:56:16.921 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-24T21:56:16.921 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: self.do_handshake() 2024-07-24T21:56:16.921 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-24T21:56:16.921 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: self._sslobj.do_handshake() 2024-07-24T21:56:16.921 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-24T21:56:16.922 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:56:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T21:56:17.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:17 smithi047 ceph-mon[32551]: mgrmap e11: x(active, since 1.00765s) 2024-07-24T21:56:17.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:17 smithi047 ceph-mon[32551]: [24/Jul/2024:21:56:16] ENGINE Bus STARTING 2024-07-24T21:56:17.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:17 smithi047 ceph-mon[32551]: [24/Jul/2024:21:56:16] ENGINE Serving on http://172.21.15.47:8765 2024-07-24T21:56:18.101 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-07-24T21:56:18.101 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial admin user... 2024-07-24T21:56:18.294 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:18 smithi047 ceph-mon[32551]: [24/Jul/2024:21:56:16] ENGINE Serving on https://172.21.15.47:7150 2024-07-24T21:56:18.294 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:18 smithi047 ceph-mon[32551]: [24/Jul/2024:21:56:16] ENGINE Bus STARTED 2024-07-24T21:56:18.294 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:18 smithi047 ceph-mon[32551]: [24/Jul/2024:21:56:16] ENGINE Error in HTTPServer.serve 2024-07-24T21:56:18.294 INFO:journalctl@ceph.mon.a.smithi047.stdout: Traceback (most recent call last): 2024-07-24T21:56:18.294 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-24T21:56:18.294 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._connections.run(self.expiration_interval) 2024-07-24T21:56:18.294 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-24T21:56:18.294 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._run(expiration_interval) 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout: s = self.context.wrap_socket( 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout: return self.sslsocket_class._create( 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout: self.do_handshake() 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._sslobj.do_handshake() 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-24T21:56:18.295 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:18 smithi047 ceph-mon[32551]: mgrmap e12: x(active, since 2s) 2024-07-24T21:56:18.296 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:18 smithi047 ceph-mon[32551]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:56:18.296 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:18 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:18.296 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:18 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:19.525 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$5Jfpf6bMeLPI8ecKIC9WBeWFXo5iLcViOg4VyQhtIh8M7uWnlcnKu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1721858178, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-07-24T21:56:19.525 INFO:teuthology.orchestra.run.smithi047.stdout:Fetching dashboard port number... 2024-07-24T21:56:19.894 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:19 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:19.894 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:19 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:19.894 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:19 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:20.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:20 smithi047 ceph-mon[32551]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:56:20.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:20 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/291430103' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-07-24T21:56:21.187 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 8443 2024-07-24T21:56:21.198 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-07-24T21:56:21.198 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-07-24T21:56:21.206 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-07-24T21:56:21.206 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-07-24T21:56:21.206 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-07-24T21:56:21.206 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-07-24T21:56:21.208 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph Dashboard is now available at: 2024-07-24T21:56:21.208 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:56:21.208 INFO:teuthology.orchestra.run.smithi047.stdout: URL: https://smithi047.front.sepia.ceph.com:8443/ 2024-07-24T21:56:21.208 INFO:teuthology.orchestra.run.smithi047.stdout: User: admin 2024-07-24T21:56:21.208 INFO:teuthology.orchestra.run.smithi047.stdout: Password: n9xks4fm31 2024-07-24T21:56:21.208 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:56:21.209 INFO:teuthology.orchestra.run.smithi047.stdout:Saving cluster configuration to /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config directory 2024-07-24T21:56:22.511 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-07-24T21:56:22.511 INFO:teuthology.orchestra.run.smithi047.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-07-24T21:56:22.511 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:56:22.511 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-07-24T21:56:22.511 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:56:22.511 INFO:teuthology.orchestra.run.smithi047.stdout:Or, if you are only running a single cluster on this host: 2024-07-24T21:56:22.511 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:56:22.511 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-07-24T21:56:22.512 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:56:22.512 INFO:teuthology.orchestra.run.smithi047.stdout:Please consider enabling telemetry to help improve Ceph: 2024-07-24T21:56:22.512 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:56:22.512 INFO:teuthology.orchestra.run.smithi047.stdout: ceph telemetry on 2024-07-24T21:56:22.512 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:56:22.512 INFO:teuthology.orchestra.run.smithi047.stdout:For more information see: 2024-07-24T21:56:22.512 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:56:22.512 INFO:teuthology.orchestra.run.smithi047.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-07-24T21:56:22.512 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:56:22.512 INFO:teuthology.orchestra.run.smithi047.stdout:Bootstrap complete. 2024-07-24T21:56:22.555 INFO:tasks.cephadm:Fetching config... 2024-07-24T21:56:22.555 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:56:22.555 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-07-24T21:56:22.573 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-07-24T21:56:22.573 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:56:22.573 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-07-24T21:56:22.628 INFO:tasks.cephadm:Fetching mon keyring... 2024-07-24T21:56:22.628 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:56:22.628 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/keyring of=/dev/stdout 2024-07-24T21:56:22.694 INFO:tasks.cephadm:Fetching pub ssh key... 2024-07-24T21:56:22.694 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:56:22.694 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-07-24T21:56:22.750 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-07-24T21:56:22.751 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRJUQ73FSZexVwhkRp8fZijs3Jp249qvxjzZM03eWdgtVQ/+P54Kqx5V6sBnbH2kyEWf46R6r4qajBp/knFv18wMQEU4fTLeyIvMCSY/MeGcLa1hXgUsejnNhUKytooUUXE3eKIqT/2Whzw6lg45vhvVzhFsyXV32uzhfZptf/Xvb+T5Or4Ig4suvNZ4DeZEw1SCkFILNTGeq9ECLtwxZgcTTkxGQY71ix0bHAeYeHcVh6775+lcn1e2j74xDwnLxCt83jnSLDC9EuDkYtbIwaQS3S0BYCOdIlGGfrbjfvKB/JYZnsxO/g7bUzR+HHSF5FY2HDbfG75x8j6sffqaWxzwwX11eT3XtfsN5/Isu9D1Qt20tZvNDiKXDphQZF+VhGqkBXQJNqIpt13e5r0j2J6IetALb7zbOFdoMTyDH+94xVg1OdErunDK3qgf1UOZykXJPHtduhVadL5Esy2nEgpbt9grs9mUk8yhDQcwY5lCrYx474UiTA5Fbz77Mc9Hs= ceph-46bf760a-4a07-11ef-bcad-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-07-24T21:56:22.813 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:22 smithi047 ceph-mon[32551]: mgrmap e13: x(active, since 6s) 2024-07-24T21:56:22.813 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:22 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/173875400' entity='client.admin' 2024-07-24T21:56:22.827 INFO:teuthology.orchestra.run.smithi047.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRJUQ73FSZexVwhkRp8fZijs3Jp249qvxjzZM03eWdgtVQ/+P54Kqx5V6sBnbH2kyEWf46R6r4qajBp/knFv18wMQEU4fTLeyIvMCSY/MeGcLa1hXgUsejnNhUKytooUUXE3eKIqT/2Whzw6lg45vhvVzhFsyXV32uzhfZptf/Xvb+T5Or4Ig4suvNZ4DeZEw1SCkFILNTGeq9ECLtwxZgcTTkxGQY71ix0bHAeYeHcVh6775+lcn1e2j74xDwnLxCt83jnSLDC9EuDkYtbIwaQS3S0BYCOdIlGGfrbjfvKB/JYZnsxO/g7bUzR+HHSF5FY2HDbfG75x8j6sffqaWxzwwX11eT3XtfsN5/Isu9D1Qt20tZvNDiKXDphQZF+VhGqkBXQJNqIpt13e5r0j2J6IetALb7zbOFdoMTyDH+94xVg1OdErunDK3qgf1UOZykXJPHtduhVadL5Esy2nEgpbt9grs9mUk8yhDQcwY5lCrYx474UiTA5Fbz77Mc9Hs= ceph-46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:56:22.838 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRJUQ73FSZexVwhkRp8fZijs3Jp249qvxjzZM03eWdgtVQ/+P54Kqx5V6sBnbH2kyEWf46R6r4qajBp/knFv18wMQEU4fTLeyIvMCSY/MeGcLa1hXgUsejnNhUKytooUUXE3eKIqT/2Whzw6lg45vhvVzhFsyXV32uzhfZptf/Xvb+T5Or4Ig4suvNZ4DeZEw1SCkFILNTGeq9ECLtwxZgcTTkxGQY71ix0bHAeYeHcVh6775+lcn1e2j74xDwnLxCt83jnSLDC9EuDkYtbIwaQS3S0BYCOdIlGGfrbjfvKB/JYZnsxO/g7bUzR+HHSF5FY2HDbfG75x8j6sffqaWxzwwX11eT3XtfsN5/Isu9D1Qt20tZvNDiKXDphQZF+VhGqkBXQJNqIpt13e5r0j2J6IetALb7zbOFdoMTyDH+94xVg1OdErunDK3qgf1UOZykXJPHtduhVadL5Esy2nEgpbt9grs9mUk8yhDQcwY5lCrYx474UiTA5Fbz77Mc9Hs= ceph-46bf760a-4a07-11ef-bcad-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-07-24T21:56:22.878 INFO:teuthology.orchestra.run.smithi183.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRJUQ73FSZexVwhkRp8fZijs3Jp249qvxjzZM03eWdgtVQ/+P54Kqx5V6sBnbH2kyEWf46R6r4qajBp/knFv18wMQEU4fTLeyIvMCSY/MeGcLa1hXgUsejnNhUKytooUUXE3eKIqT/2Whzw6lg45vhvVzhFsyXV32uzhfZptf/Xvb+T5Or4Ig4suvNZ4DeZEw1SCkFILNTGeq9ECLtwxZgcTTkxGQY71ix0bHAeYeHcVh6775+lcn1e2j74xDwnLxCt83jnSLDC9EuDkYtbIwaQS3S0BYCOdIlGGfrbjfvKB/JYZnsxO/g7bUzR+HHSF5FY2HDbfG75x8j6sffqaWxzwwX11eT3XtfsN5/Isu9D1Qt20tZvNDiKXDphQZF+VhGqkBXQJNqIpt13e5r0j2J6IetALb7zbOFdoMTyDH+94xVg1OdErunDK3qgf1UOZykXJPHtduhVadL5Esy2nEgpbt9grs9mUk8yhDQcwY5lCrYx474UiTA5Fbz77Mc9Hs= ceph-46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:56:22.889 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRJUQ73FSZexVwhkRp8fZijs3Jp249qvxjzZM03eWdgtVQ/+P54Kqx5V6sBnbH2kyEWf46R6r4qajBp/knFv18wMQEU4fTLeyIvMCSY/MeGcLa1hXgUsejnNhUKytooUUXE3eKIqT/2Whzw6lg45vhvVzhFsyXV32uzhfZptf/Xvb+T5Or4Ig4suvNZ4DeZEw1SCkFILNTGeq9ECLtwxZgcTTkxGQY71ix0bHAeYeHcVh6775+lcn1e2j74xDwnLxCt83jnSLDC9EuDkYtbIwaQS3S0BYCOdIlGGfrbjfvKB/JYZnsxO/g7bUzR+HHSF5FY2HDbfG75x8j6sffqaWxzwwX11eT3XtfsN5/Isu9D1Qt20tZvNDiKXDphQZF+VhGqkBXQJNqIpt13e5r0j2J6IetALb7zbOFdoMTyDH+94xVg1OdErunDK3qgf1UOZykXJPHtduhVadL5Esy2nEgpbt9grs9mUk8yhDQcwY5lCrYx474UiTA5Fbz77Mc9Hs= ceph-46bf760a-4a07-11ef-bcad-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-07-24T21:56:22.929 INFO:teuthology.orchestra.run.smithi188.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRJUQ73FSZexVwhkRp8fZijs3Jp249qvxjzZM03eWdgtVQ/+P54Kqx5V6sBnbH2kyEWf46R6r4qajBp/knFv18wMQEU4fTLeyIvMCSY/MeGcLa1hXgUsejnNhUKytooUUXE3eKIqT/2Whzw6lg45vhvVzhFsyXV32uzhfZptf/Xvb+T5Or4Ig4suvNZ4DeZEw1SCkFILNTGeq9ECLtwxZgcTTkxGQY71ix0bHAeYeHcVh6775+lcn1e2j74xDwnLxCt83jnSLDC9EuDkYtbIwaQS3S0BYCOdIlGGfrbjfvKB/JYZnsxO/g7bUzR+HHSF5FY2HDbfG75x8j6sffqaWxzwwX11eT3XtfsN5/Isu9D1Qt20tZvNDiKXDphQZF+VhGqkBXQJNqIpt13e5r0j2J6IetALb7zbOFdoMTyDH+94xVg1OdErunDK3qgf1UOZykXJPHtduhVadL5Esy2nEgpbt9grs9mUk8yhDQcwY5lCrYx474UiTA5Fbz77Mc9Hs= ceph-46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:56:22.941 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-07-24T21:56:23.206 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:56:25.879 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:25 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:25.879 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:25 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:25.879 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:25 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:56:25.879 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:25 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:25.879 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:25 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:56:25.879 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:25 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:26.882 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:26 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/811374903' entity='client.admin' 2024-07-24T21:56:26.883 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:26 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:56:26.883 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:26 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:26.884 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-07-24T21:56:26.884 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-07-24T21:56:27.144 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:56:29.525 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi183 2024-07-24T21:56:29.525 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-07-24T21:56:29.526 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/etc/ceph/ceph.conf 2024-07-24T21:56:29.547 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-07-24T21:56:29.548 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:56:29.605 INFO:tasks.cephadm:Adding host smithi183 to orchestrator... 2024-07-24T21:56:29.605 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch host add smithi183 2024-07-24T21:56:29.869 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:56:30.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:29 smithi047 ceph-mon[32551]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:56:30.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:29 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:30.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:29 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:56:30.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:29 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:56:30.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:29 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:56:30.085 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:29 smithi047 ceph-mon[32551]: Updating smithi047:/etc/ceph/ceph.conf 2024-07-24T21:56:30.085 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:29 smithi047 ceph-mon[32551]: Updating smithi047:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:56:30.085 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:29 smithi047 ceph-mon[32551]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:56:30.085 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:29 smithi047 ceph-mon[32551]: Updating smithi047:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.client.admin.keyring 2024-07-24T21:56:30.085 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:29 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:30.085 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:29 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:30.085 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:29 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:32.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:31 smithi047 ceph-mon[32551]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi183", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:56:34.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:33 smithi047 ceph-mon[32551]: Deploying cephadm binary to smithi183 2024-07-24T21:56:35.579 INFO:teuthology.orchestra.run.smithi047.stdout:Added host 'smithi183' with addr '172.21.15.183' 2024-07-24T21:56:36.231 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch host ls --format=json 2024-07-24T21:56:36.492 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:56:36.885 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:36 smithi047 ceph-mon[32551]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:36.885 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:36 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:36.885 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:36 smithi047 ceph-mon[32551]: Added host smithi183 2024-07-24T21:56:36.885 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:36 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:56:36.885 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:36 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:36.885 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:36 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:38.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:37 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:38.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:37 smithi047 ceph-mon[32551]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:38.204 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:56:38.204 INFO:teuthology.orchestra.run.smithi047.stdout:[{"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}, {"addr": "172.21.15.183", "hostname": "smithi183", "labels": [], "status": ""}] 2024-07-24T21:56:38.697 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi188 2024-07-24T21:56:38.697 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-07-24T21:56:38.698 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/etc/ceph/ceph.conf 2024-07-24T21:56:38.715 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-07-24T21:56:38.716 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:56:38.773 INFO:tasks.cephadm:Adding host smithi188 to orchestrator... 2024-07-24T21:56:38.773 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch host add smithi188 2024-07-24T21:56:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:56:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:38 smithi047 ceph-mon[32551]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T21:56:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:39 smithi047 ceph-mon[32551]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:39 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:39 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:39 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:39 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:39 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi183", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:56:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:39 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:56:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:39 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:56:41.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:40 smithi047 ceph-mon[32551]: Updating smithi183:/etc/ceph/ceph.conf 2024-07-24T21:56:41.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:40 smithi047 ceph-mon[32551]: Updating smithi183:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:56:41.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:40 smithi047 ceph-mon[32551]: Updating smithi183:/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:56:41.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:40 smithi047 ceph-mon[32551]: Updating smithi183:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.client.admin.keyring 2024-07-24T21:56:41.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:40 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:41.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:40 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:41.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:40 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:42.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:41 smithi047 ceph-mon[32551]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi188", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:56:42.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:41 smithi047 ceph-mon[32551]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:43.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:42 smithi047 ceph-mon[32551]: Deploying cephadm binary to smithi188 2024-07-24T21:56:44.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:43 smithi047 ceph-mon[32551]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:44.767 INFO:teuthology.orchestra.run.smithi047.stdout:Added host 'smithi188' with addr '172.21.15.188' 2024-07-24T21:56:45.390 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch host ls --format=json 2024-07-24T21:56:45.652 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:56:46.068 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:45 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:46.068 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:45 smithi047 ceph-mon[32551]: Added host smithi188 2024-07-24T21:56:46.068 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:45 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:56:46.068 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:45 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:46.069 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:45 smithi047 ceph-mon[32551]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:46.069 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:45 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:47.274 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T21:56:47.274 INFO:teuthology.orchestra.run.smithi047.stdout:[{"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}, {"addr": "172.21.15.183", "hostname": "smithi183", "labels": [], "status": ""}, {"addr": "172.21.15.188", "hostname": "smithi188", "labels": [], "status": ""}] 2024-07-24T21:56:47.324 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:47 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:47.894 INFO:tasks.cephadm:Setting crush tunables to default 2024-07-24T21:56:47.895 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd crush tunables default 2024-07-24T21:56:48.158 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:56:48.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:48 smithi047 ceph-mon[32551]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:48.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:48 smithi047 ceph-mon[32551]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T21:56:50.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:50.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:50.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:50.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:50.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi188", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:56:50.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:56:50.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:56:50.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: Updating smithi188:/etc/ceph/ceph.conf 2024-07-24T21:56:50.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:50.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: Updating smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:56:50.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:56:50.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: Updating smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.client.admin.keyring 2024-07-24T21:56:50.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:50.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:50.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:50.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:49 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3227243398' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-07-24T21:56:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-07-24T21:56:51.390 INFO:tasks.cephadm:Adding mon.a on smithi047 2024-07-24T21:56:51.390 INFO:tasks.cephadm:Adding mon.b on smithi183 2024-07-24T21:56:51.390 INFO:tasks.cephadm:Adding mon.c on smithi188 2024-07-24T21:56:51.391 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch apply mon '3;smithi047:172.21.15.47=a;smithi183:172.21.15.183=b;smithi188:172.21.15.188=c' 2024-07-24T21:56:51.641 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:56:52.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:51 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3227243398' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-07-24T21:56:52.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:51 smithi047 ceph-mon[32551]: osdmap e4: 0 total, 0 up, 0 in 2024-07-24T21:56:52.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:51 smithi047 ceph-mon[32551]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:53.226 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled mon update... 2024-07-24T21:56:53.821 DEBUG:teuthology.orchestra.run.smithi183:mon.b> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.b.service 2024-07-24T21:56:53.825 DEBUG:teuthology.orchestra.run.smithi188:mon.c> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.c.service 2024-07-24T21:56:53.828 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-07-24T21:56:53.828 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph mon dump -f json 2024-07-24T21:56:54.578 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:56:54.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:54 smithi047 ceph-mon[32551]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:54.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:54 smithi047 ceph-mon[32551]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi183:172.21.15.183=b;smithi188:172.21.15.188=c", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:56:54.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:54 smithi047 ceph-mon[32551]: Saving service mon spec with placement smithi047:172.21.15.47=a;smithi183:172.21.15.183=b;smithi188:172.21.15.188=c;count:3 2024-07-24T21:56:54.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:54 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:54.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:54 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:56:54.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:54 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:56:54.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:54 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:56:54.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:54 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:54.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:54 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-24T21:56:54.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:54 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:56:54.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:54 smithi047 ceph-mon[32551]: Deploying daemon mon.c on smithi188 2024-07-24T21:56:56.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:56 smithi047 ceph-mon[32551]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":1,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","modified":"2024-07-24T21:55:23.454131Z","created":"2024-07-24T21:55:23.454131Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-07-24T21:56:57.682 INFO:teuthology.orchestra.run.smithi188.stderr:dumped monmap epoch 1 2024-07-24T21:56:58.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 podman[37361]: 2024-07-24 21:56:58.462830477 +0000 UTC m=+0.118963653 container create 6e0df7c9206f07fa44440cb8425426c626e124f47ef3c1fe6a3719c93aab76a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240716, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, maintainer=Guillaume Abrioux ) 2024-07-24T21:56:58.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:58 smithi047 ceph-mon[32551]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:58.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:56:58 smithi047 ceph-mon[32551]: from='client.? 172.21.15.188:0/2564280193' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-24T21:56:59.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 podman[37361]: 2024-07-24 21:56:58.648640743 +0000 UTC m=+0.304773920 container init 6e0df7c9206f07fa44440cb8425426c626e124f47ef3c1fe6a3719c93aab76a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=main-86385b1, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240716, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-07-24T21:56:59.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 podman[37361]: 2024-07-24 21:56:58.652460795 +0000 UTC m=+0.308593973 container start 6e0df7c9206f07fa44440cb8425426c626e124f47ef3c1fe6a3719c93aab76a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-07-24T21:56:59.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: set uid:gid to 167:167 (ceph:ceph) 2024-07-24T21:56:59.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: ceph version 19.0.0-5197-g86385b1d (86385b1daf5235400bbcd34a02515d168bde88e2) squid (dev), process ceph-mon, pid 2 2024-07-24T21:56:59.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: pidfile_write: ignore empty --pid-file 2024-07-24T21:56:59.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: load: jerasure load: lrc 2024-07-24T21:56:59.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: RocksDB version: 7.9.2 2024-07-24T21:56:59.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Git sha 0 2024-07-24T21:56:59.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Compile date 2024-07-22 20:32:46 2024-07-24T21:56:59.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: DB SUMMARY 2024-07-24T21:56:59.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: DB Session ID: L9S700OH4XZXS1R6DXKK 2024-07-24T21:56:59.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: CURRENT file: CURRENT 2024-07-24T21:56:59.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: IDENTITY file: IDENTITY 2024-07-24T21:56:59.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-07-24T21:56:59.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-07-24T21:56:59.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-07-24T21:56:59.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.error_if_exists: 0 2024-07-24T21:56:59.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.create_if_missing: 0 2024-07-24T21:56:59.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.paranoid_checks: 1 2024-07-24T21:56:59.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.flush_verify_memtable_count: 1 2024-07-24T21:56:59.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-07-24T21:56:59.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-07-24T21:56:59.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.env: 0x55af5d641840 2024-07-24T21:56:59.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.fs: PosixFileSystem 2024-07-24T21:56:59.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.info_log: 0x55af5fd8d4c0 2024-07-24T21:56:59.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_file_opening_threads: 16 2024-07-24T21:56:59.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.statistics: (nil) 2024-07-24T21:56:59.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.use_fsync: 0 2024-07-24T21:56:59.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_log_file_size: 0 2024-07-24T21:56:59.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-07-24T21:56:59.052 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.log_file_time_to_roll: 0 2024-07-24T21:56:59.052 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.keep_log_file_num: 1000 2024-07-24T21:56:59.052 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.recycle_log_file_num: 0 2024-07-24T21:56:59.052 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.allow_fallocate: 1 2024-07-24T21:56:59.052 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.allow_mmap_reads: 0 2024-07-24T21:56:59.052 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.allow_mmap_writes: 0 2024-07-24T21:56:59.052 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.use_direct_reads: 0 2024-07-24T21:56:59.052 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-07-24T21:56:59.052 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.create_missing_column_families: 0 2024-07-24T21:56:59.052 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.db_log_dir: 2024-07-24T21:56:59.052 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.wal_dir: 2024-07-24T21:56:59.052 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.table_cache_numshardbits: 6 2024-07-24T21:56:59.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.WAL_ttl_seconds: 0 2024-07-24T21:56:59.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.WAL_size_limit_MB: 0 2024-07-24T21:56:59.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-07-24T21:56:59.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-07-24T21:56:59.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.is_fd_close_on_exec: 1 2024-07-24T21:56:59.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.advise_random_on_open: 1 2024-07-24T21:56:59.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.db_write_buffer_size: 0 2024-07-24T21:56:59.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.write_buffer_manager: 0x55af5fd90e60 2024-07-24T21:56:59.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-07-24T21:56:59.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-07-24T21:56:59.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.use_adaptive_mutex: 0 2024-07-24T21:56:59.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.rate_limiter: (nil) 2024-07-24T21:56:59.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-07-24T21:56:59.054 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.wal_recovery_mode: 2 2024-07-24T21:56:59.054 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.enable_thread_tracking: 0 2024-07-24T21:56:59.054 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.enable_pipelined_write: 0 2024-07-24T21:56:59.054 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.unordered_write: 0 2024-07-24T21:56:59.054 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-07-24T21:56:59.054 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-07-24T21:56:59.054 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-07-24T21:56:59.054 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-07-24T21:56:59.054 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.row_cache: None 2024-07-24T21:56:59.054 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.wal_filter: None 2024-07-24T21:56:59.056 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-07-24T21:56:59.056 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.allow_ingest_behind: 0 2024-07-24T21:56:59.056 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.two_write_queues: 0 2024-07-24T21:56:59.056 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.manual_wal_flush: 0 2024-07-24T21:56:59.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.wal_compression: 0 2024-07-24T21:56:59.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.atomic_flush: 0 2024-07-24T21:56:59.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-07-24T21:56:59.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.persist_stats_to_disk: 0 2024-07-24T21:56:59.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.write_dbid_to_manifest: 0 2024-07-24T21:56:59.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.log_readahead_size: 0 2024-07-24T21:56:59.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-07-24T21:56:59.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.best_efforts_recovery: 0 2024-07-24T21:56:59.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-07-24T21:56:59.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-07-24T21:56:59.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.allow_data_in_errors: 0 2024-07-24T21:56:59.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.db_host_id: __hostname__ 2024-07-24T21:56:59.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.enforce_single_del_contracts: true 2024-07-24T21:56:59.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_background_jobs: 2 2024-07-24T21:56:59.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_background_compactions: -1 2024-07-24T21:56:59.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_subcompactions: 1 2024-07-24T21:56:59.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-07-24T21:56:59.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-07-24T21:56:59.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.delayed_write_rate : 16777216 2024-07-24T21:56:59.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_total_wal_size: 0 2024-07-24T21:56:59.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-07-24T21:56:59.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.stats_dump_period_sec: 600 2024-07-24T21:56:59.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.stats_persist_period_sec: 600 2024-07-24T21:56:59.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-07-24T21:56:59.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_open_files: -1 2024-07-24T21:56:59.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.bytes_per_sync: 0 2024-07-24T21:56:59.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.wal_bytes_per_sync: 0 2024-07-24T21:56:59.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.strict_bytes_per_sync: 0 2024-07-24T21:56:59.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compaction_readahead_size: 0 2024-07-24T21:56:59.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_background_flushes: -1 2024-07-24T21:56:59.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Compression algorithms supported: 2024-07-24T21:56:59.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: kZSTD supported: 0 2024-07-24T21:56:59.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: kXpressCompression supported: 0 2024-07-24T21:56:59.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: kBZip2Compression supported: 0 2024-07-24T21:56:59.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-07-24T21:56:59.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: kLZ4Compression supported: 1 2024-07-24T21:56:59.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: kZlibCompression supported: 1 2024-07-24T21:56:59.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: kLZ4HCCompression supported: 1 2024-07-24T21:56:59.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: kSnappyCompression supported: 1 2024-07-24T21:56:59.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Fast CRC32 supported: Supported on x86 2024-07-24T21:56:59.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: DMutex implementation: pthread_mutex_t 2024-07-24T21:56:59.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-07-24T21:56:59.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-07-24T21:56:59.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-07-24T21:56:59.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.merge_operator: 2024-07-24T21:56:59.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compaction_filter: None 2024-07-24T21:56:59.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compaction_filter_factory: None 2024-07-24T21:56:59.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.sst_partitioner_factory: None 2024-07-24T21:56:59.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.memtable_factory: SkipListFactory 2024-07-24T21:56:59.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.table_factory: BlockBasedTable 2024-07-24T21:56:59.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55af5fd8d0e0) 2024-07-24T21:56:59.061 INFO:journalctl@ceph.mon.c.smithi188.stdout: cache_index_and_filter_blocks: 1 2024-07-24T21:56:59.061 INFO:journalctl@ceph.mon.c.smithi188.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-07-24T21:56:59.061 INFO:journalctl@ceph.mon.c.smithi188.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-07-24T21:56:59.061 INFO:journalctl@ceph.mon.c.smithi188.stdout: pin_top_level_index_and_filter: 1 2024-07-24T21:56:59.061 INFO:journalctl@ceph.mon.c.smithi188.stdout: index_type: 0 2024-07-24T21:56:59.061 INFO:journalctl@ceph.mon.c.smithi188.stdout: data_block_index_type: 0 2024-07-24T21:56:59.061 INFO:journalctl@ceph.mon.c.smithi188.stdout: index_shortening: 1 2024-07-24T21:56:59.061 INFO:journalctl@ceph.mon.c.smithi188.stdout: data_block_hash_table_util_ratio: 0.750000 2024-07-24T21:56:59.061 INFO:journalctl@ceph.mon.c.smithi188.stdout: checksum: 4 2024-07-24T21:56:59.061 INFO:journalctl@ceph.mon.c.smithi188.stdout: no_block_cache: 0 2024-07-24T21:56:59.061 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_cache: 0x55af5fd81610 2024-07-24T21:56:59.061 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_cache_name: BinnedLRUCache 2024-07-24T21:56:59.062 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_cache_options: 2024-07-24T21:56:59.062 INFO:journalctl@ceph.mon.c.smithi188.stdout: capacity : 536870912 2024-07-24T21:56:59.062 INFO:journalctl@ceph.mon.c.smithi188.stdout: num_shard_bits : 4 2024-07-24T21:56:59.062 INFO:journalctl@ceph.mon.c.smithi188.stdout: strict_capacity_limit : 0 2024-07-24T21:56:59.062 INFO:journalctl@ceph.mon.c.smithi188.stdout: high_pri_pool_ratio: 0.000 2024-07-24T21:56:59.062 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_cache_compressed: (nil) 2024-07-24T21:56:59.062 INFO:journalctl@ceph.mon.c.smithi188.stdout: persistent_cache: (nil) 2024-07-24T21:56:59.062 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_size: 4096 2024-07-24T21:56:59.062 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_size_deviation: 10 2024-07-24T21:56:59.062 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_restart_interval: 16 2024-07-24T21:56:59.062 INFO:journalctl@ceph.mon.c.smithi188.stdout: index_block_restart_interval: 1 2024-07-24T21:56:59.062 INFO:journalctl@ceph.mon.c.smithi188.stdout: metadata_block_size: 4096 2024-07-24T21:56:59.062 INFO:journalctl@ceph.mon.c.smithi188.stdout: partition_filters: 0 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout: use_delta_encoding: 1 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout: filter_policy: bloomfilter 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout: whole_key_filtering: 1 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout: verify_compression: 0 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout: read_amp_bytes_per_bit: 0 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout: format_version: 5 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout: enable_index_compression: 1 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_align: 0 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout: max_auto_readahead_size: 262144 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout: prepopulate_block_cache: 0 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout: initial_auto_readahead_size: 8192 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout: num_file_reads_for_auto_readahead: 2 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.write_buffer_size: 33554432 2024-07-24T21:56:59.063 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_write_buffer_number: 2 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compression: NoCompression 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.bottommost_compression: Disabled 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.prefix_extractor: nullptr 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.num_levels: 7 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-07-24T21:56:59.064 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compression_opts.window_bits: -14 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compression_opts.level: 32767 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compression_opts.strategy: 0 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compression_opts.enabled: false 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-07-24T21:56:59.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-07-24T21:56:59.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-07-24T21:56:59.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.target_file_size_base: 67108864 2024-07-24T21:56:59.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.target_file_size_multiplier: 1 2024-07-24T21:56:59.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-07-24T21:56:59.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-07-24T21:56:59.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-07-24T21:56:59.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-07-24T21:56:59.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-07-24T21:56:59.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-07-24T21:56:59.067 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-07-24T21:56:59.067 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-07-24T21:56:59.067 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-07-24T21:56:59.067 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-07-24T21:56:59.067 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-07-24T21:56:59.067 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-07-24T21:56:59.067 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-07-24T21:56:59.067 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.arena_block_size: 1048576 2024-07-24T21:56:59.067 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-07-24T21:56:59.067 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-07-24T21:56:59.067 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.disable_auto_compactions: 0 2024-07-24T21:56:59.067 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-07-24T21:56:59.067 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-07-24T21:56:59.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-07-24T21:56:59.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-07-24T21:56:59.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-07-24T21:56:59.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-07-24T21:56:59.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-07-24T21:56:59.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-07-24T21:56:59.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-07-24T21:56:59.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-07-24T21:56:59.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-07-24T21:56:59.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.inplace_update_support: 0 2024-07-24T21:56:59.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.inplace_update_num_locks: 10000 2024-07-24T21:56:59.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-07-24T21:56:59.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.memtable_huge_page_size: 0 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.bloom_locality: 0 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.max_successive_merges: 0 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.optimize_filters_for_hits: 0 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.paranoid_file_checks: 0 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.force_consistency_checks: 1 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.report_bg_io_stats: 0 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.ttl: 2592000 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.periodic_compaction_seconds: 0 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.enable_blob_files: false 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.min_blob_size: 0 2024-07-24T21:56:59.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.blob_file_size: 268435456 2024-07-24T21:56:59.070 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.blob_compression_type: NoCompression 2024-07-24T21:56:59.070 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.enable_blob_garbage_collection: false 2024-07-24T21:56:59.070 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-07-24T21:56:59.070 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-07-24T21:56:59.070 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-07-24T21:56:59.070 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.blob_file_starting_level: 0 2024-07-24T21:56:59.070 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-07-24T21:56:59.070 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-07-24T21:56:59.070 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-07-24T21:56:59.070 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: edfa634b-6a12-4b3a-b23e-977a95995f73 2024-07-24T21:56:59.070 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721858218678782, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-07-24T21:56:59.070 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-07-24T21:56:59.070 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721858218679173, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1721858218, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "edfa634b-6a12-4b3a-b23e-977a95995f73", "db_session_id": "L9S700OH4XZXS1R6DXKK", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721858218679277, "job": 1, "event": "recovery_finished"} 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55af5fdaee00 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: DB pointer 0x55af5fea6000 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout: ** DB Stats ** 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-07-24T21:56:59.071 INFO:journalctl@ceph.mon.c.smithi188.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-07-24T21:56:59.072 INFO:journalctl@ceph.mon.c.smithi188.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-07-24T21:56:59.072 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-07-24T21:56:59.072 INFO:journalctl@ceph.mon.c.smithi188.stdout: ** Compaction Stats [default] ** 2024-07-24T21:56:59.072 INFO:journalctl@ceph.mon.c.smithi188.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-07-24T21:56:59.072 INFO:journalctl@ceph.mon.c.smithi188.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-07-24T21:56:59.072 INFO:journalctl@ceph.mon.c.smithi188.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-07-24T21:56:59.072 INFO:journalctl@ceph.mon.c.smithi188.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-07-24T21:56:59.072 INFO:journalctl@ceph.mon.c.smithi188.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-07-24T21:56:59.072 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-07-24T21:56:59.072 INFO:journalctl@ceph.mon.c.smithi188.stdout: ** Compaction Stats [default] ** 2024-07-24T21:56:59.072 INFO:journalctl@ceph.mon.c.smithi188.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-07-24T21:56:59.072 INFO:journalctl@ceph.mon.c.smithi188.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-07-24T21:56:59.072 INFO:journalctl@ceph.mon.c.smithi188.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: AddFile(Keys): cumulative 0, interval 0 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: Block cache BinnedLRUCache@0x55af5fd81610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-07-24T21:56:59.073 INFO:journalctl@ceph.mon.c.smithi188.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-07-24T21:56:59.074 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-07-24T21:56:59.074 INFO:journalctl@ceph.mon.c.smithi188.stdout: ** File Read Latency Histogram By Level [default] ** 2024-07-24T21:56:59.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-07-24T21:56:59.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: using public_addr v2:172.21.15.188:0/0 -> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] 2024-07-24T21:56:59.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: starting mon.c rank -1 at public addrs [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] at bind addrs [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:56:59.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(???) e0 preinit fsid 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:56:59.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(synchronizing).mds e1 new map 2024-07-24T21:56:59.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(synchronizing).mds e1 print_map 2024-07-24T21:56:59.074 INFO:journalctl@ceph.mon.c.smithi188.stdout: e1 2024-07-24T21:56:59.074 INFO:journalctl@ceph.mon.c.smithi188.stdout: btime 2024-07-24T21:55:28:945758+0000 2024-07-24T21:56:59.074 INFO:journalctl@ceph.mon.c.smithi188.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-07-24T21:56:59.074 INFO:journalctl@ceph.mon.c.smithi188.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-07-24T21:56:59.074 INFO:journalctl@ceph.mon.c.smithi188.stdout: legacy client fscid: -1 2024-07-24T21:56:59.075 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-07-24T21:56:59.075 INFO:journalctl@ceph.mon.c.smithi188.stdout: No filesystems configured 2024-07-24T21:56:59.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-07-24T21:56:59.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-07-24T21:56:59.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-07-24T21:56:59.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-07-24T21:56:59.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-07-24T21:56:59.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-07-24T21:56:59.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-07-24T21:56:59.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-07-24T21:56:59.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-07-24T21:56:59.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-07-24T21:56:59.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:59.076 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: Added host smithi188 2024-07-24T21:56:59.076 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:56:59.076 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:59.076 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:59.076 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:59.076 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:59.076 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:59.076 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T21:56:59.076 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:59.076 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:59.076 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:59.076 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:59.076 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi188", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: Updating smithi188:/etc/ceph/ceph.conf 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: Updating smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: Updating smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.client.admin.keyring 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3227243398' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3227243398' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: osdmap e4: 0 total, 0 up, 0 in 2024-07-24T21:56:59.077 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi183:172.21.15.183=b;smithi188:172.21.15.188=c", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: Saving service mon spec with placement smithi047:172.21.15.47=a;smithi183:172.21.15.183=b;smithi188:172.21.15.188=c;count:3 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: Deploying daemon mon.c on smithi188 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:56:59.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: from='client.? 172.21.15.188:0/2564280193' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-24T21:56:59.079 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 ceph-mon[37380]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-07-24T21:56:59.079 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 bash[37361]: 6e0df7c9206f07fa44440cb8425426c626e124f47ef3c1fe6a3719c93aab76a4 2024-07-24T21:56:59.079 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:56:58 smithi188 systemd[1]: Started Ceph mon.c for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T21:56:59.276 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-07-24T21:56:59.276 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph mon dump -f json 2024-07-24T21:56:59.526 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T21:57:04.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:57:04.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: mon.a calling monitor election 2024-07-24T21:57:04.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:04.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:04.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:04.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:04.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: mon.c calling monitor election 2024-07-24T21:57:04.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:04.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:04.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:04.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:04.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:04.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-07-24T21:57:04.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: monmap epoch 2 2024-07-24T21:57:04.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: fsid 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:57:04.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: last_changed 2024-07-24T21:56:58.704661+0000 2024-07-24T21:57:04.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: created 2024-07-24T21:55:23.454131+0000 2024-07-24T21:57:04.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: min_mon_release 19 (squid) 2024-07-24T21:57:04.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: election_strategy: 1 2024-07-24T21:57:04.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-07-24T21:57:04.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-07-24T21:57:04.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: fsmap 2024-07-24T21:57:04.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: osdmap e4: 0 total, 0 up, 0 in 2024-07-24T21:57:04.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: mgrmap e13: x(active, since 48s) 2024-07-24T21:57:04.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: overall HEALTH_OK 2024-07-24T21:57:04.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:04.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:04.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:04.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-24T21:57:04.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:03 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:04.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:57:04.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: mon.a calling monitor election 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: mon.c calling monitor election 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: monmap epoch 2 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: fsid 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:57:04.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: last_changed 2024-07-24T21:56:58.704661+0000 2024-07-24T21:57:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: created 2024-07-24T21:55:23.454131+0000 2024-07-24T21:57:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: min_mon_release 19 (squid) 2024-07-24T21:57:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: election_strategy: 1 2024-07-24T21:57:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-07-24T21:57:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-07-24T21:57:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: fsmap 2024-07-24T21:57:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: osdmap e4: 0 total, 0 up, 0 in 2024-07-24T21:57:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: mgrmap e13: x(active, since 48s) 2024-07-24T21:57:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: overall HEALTH_OK 2024-07-24T21:57:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-24T21:57:04.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:03 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:04.200 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:57:04.200 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":2,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","modified":"2024-07-24T21:56:58.704661Z","created":"2024-07-24T21:55:23.454131Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:3300","nonce":0},{"type":"v1","addr":"172.21.15.188:6789","nonce":0}]},"addr":"172.21.15.188:6789/0","public_addr":"172.21.15.188:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-07-24T21:57:04.200 INFO:teuthology.orchestra.run.smithi188.stderr:dumped monmap epoch 2 2024-07-24T21:57:05.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:04 smithi188 ceph-mon[37380]: Deploying daemon mon.b on smithi183 2024-07-24T21:57:05.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:04 smithi188 ceph-mon[37380]: from='client.? 172.21.15.188:0/1656526386' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-24T21:57:05.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:04 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:05.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:04 smithi047 ceph-mon[32551]: Deploying daemon mon.b on smithi183 2024-07-24T21:57:05.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:04 smithi047 ceph-mon[32551]: from='client.? 172.21.15.188:0/1656526386' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-24T21:57:05.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:04 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:05.790 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-07-24T21:57:05.790 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph mon dump -f json 2024-07-24T21:57:06.047 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T21:57:06.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:05 smithi188 ceph-mon[37380]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:06.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:05 smithi047 ceph-mon[32551]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:07.343 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:07 smithi183 ceph-mon[37007]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-07-24T21:57:07.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:07 smithi183 bash[36987]: c19ff3c845192e37187780cff5bd6eb2b22be7c51b2b5df37c77a444c51dd92e 2024-07-24T21:57:07.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:07 smithi183 systemd[1]: Started Ceph mon.b for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T21:57:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:57:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: mon.a calling monitor election 2024-07-24T21:57:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: mon.c calling monitor election 2024-07-24T21:57:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: mon.b calling monitor election 2024-07-24T21:57:12.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:12.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-07-24T21:57:12.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: monmap epoch 3 2024-07-24T21:57:12.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: fsid 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:57:12.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: last_changed 2024-07-24T21:57:07.326138+0000 2024-07-24T21:57:12.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: created 2024-07-24T21:55:23.454131+0000 2024-07-24T21:57:12.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: min_mon_release 19 (squid) 2024-07-24T21:57:12.664 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: election_strategy: 1 2024-07-24T21:57:12.664 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-07-24T21:57:12.664 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-07-24T21:57:12.664 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: 2: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.b 2024-07-24T21:57:12.664 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: fsmap 2024-07-24T21:57:12.664 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: osdmap e4: 0 total, 0 up, 0 in 2024-07-24T21:57:12.664 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: mgrmap e13: x(active, since 57s) 2024-07-24T21:57:12.664 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: overall HEALTH_OK 2024-07-24T21:57:12.664 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:12.664 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:12.664 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:12.664 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:12 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:12.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:12.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:57:12.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: mon.a calling monitor election 2024-07-24T21:57:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: mon.c calling monitor election 2024-07-24T21:57:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: mon.b calling monitor election 2024-07-24T21:57:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-07-24T21:57:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: monmap epoch 3 2024-07-24T21:57:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: fsid 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:57:12.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: last_changed 2024-07-24T21:57:07.326138+0000 2024-07-24T21:57:12.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: created 2024-07-24T21:55:23.454131+0000 2024-07-24T21:57:12.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: min_mon_release 19 (squid) 2024-07-24T21:57:12.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: election_strategy: 1 2024-07-24T21:57:12.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-07-24T21:57:12.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-07-24T21:57:12.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: 2: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.b 2024-07-24T21:57:12.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: fsmap 2024-07-24T21:57:12.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: osdmap e4: 0 total, 0 up, 0 in 2024-07-24T21:57:12.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: mgrmap e13: x(active, since 57s) 2024-07-24T21:57:12.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: overall HEALTH_OK 2024-07-24T21:57:12.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:12.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:12.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:12.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:12 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:12.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:12.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:57:12.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:12.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: mon.a calling monitor election 2024-07-24T21:57:12.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: mon.c calling monitor election 2024-07-24T21:57:12.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: mon.b calling monitor election 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: monmap epoch 3 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: fsid 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: last_changed 2024-07-24T21:57:07.326138+0000 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: created 2024-07-24T21:55:23.454131+0000 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: min_mon_release 19 (squid) 2024-07-24T21:57:12.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: election_strategy: 1 2024-07-24T21:57:12.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-07-24T21:57:12.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: 1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2024-07-24T21:57:12.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: 2: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.b 2024-07-24T21:57:12.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: fsmap 2024-07-24T21:57:12.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: osdmap e4: 0 total, 0 up, 0 in 2024-07-24T21:57:12.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: mgrmap e13: x(active, since 57s) 2024-07-24T21:57:12.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: overall HEALTH_OK 2024-07-24T21:57:12.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:12.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:12.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:12.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:12 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:13.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:13 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:13 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:13.685 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:13 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:13.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:13 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-07-24T21:57:13.751 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":3,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","modified":"2024-07-24T21:57:07.326138Z","created":"2024-07-24T21:55:23.454131Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:3300","nonce":0},{"type":"v1","addr":"172.21.15.188:6789","nonce":0}]},"addr":"172.21.15.188:6789/0","public_addr":"172.21.15.188:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:3300","nonce":0},{"type":"v1","addr":"172.21.15.183:6789","nonce":0}]},"addr":"172.21.15.183:6789/0","public_addr":"172.21.15.183:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-07-24T21:57:13.751 INFO:teuthology.orchestra.run.smithi188.stderr:dumped monmap epoch 3 2024-07-24T21:57:13.751 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:13 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:13.752 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:13 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:14.395 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-07-24T21:57:14.395 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config generate-minimal-conf 2024-07-24T21:57:14.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:14.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:14.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:14.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: Updating smithi047:/etc/ceph/ceph.conf 2024-07-24T21:57:14.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: Updating smithi183:/etc/ceph/ceph.conf 2024-07-24T21:57:14.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: Updating smithi188:/etc/ceph/ceph.conf 2024-07-24T21:57:14.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='client.? 172.21.15.188:0/3888860269' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-24T21:57:14.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-24T21:57:14.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-24T21:57:14.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:14 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:14.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:14.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:14.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:14.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: Updating smithi047:/etc/ceph/ceph.conf 2024-07-24T21:57:14.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: Updating smithi183:/etc/ceph/ceph.conf 2024-07-24T21:57:14.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: Updating smithi188:/etc/ceph/ceph.conf 2024-07-24T21:57:14.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='client.? 172.21.15.188:0/3888860269' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-24T21:57:14.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-24T21:57:14.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-24T21:57:14.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:14 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:14.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:14.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:14.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:14.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: Updating smithi047:/etc/ceph/ceph.conf 2024-07-24T21:57:14.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: Updating smithi183:/etc/ceph/ceph.conf 2024-07-24T21:57:14.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: Updating smithi188:/etc/ceph/ceph.conf 2024-07-24T21:57:14.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='client.? 172.21.15.188:0/3888860269' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-24T21:57:14.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:14.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-24T21:57:14.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-24T21:57:14.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:14 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:14.990 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:15.731 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:15 smithi183 ceph-mon[37007]: Updating smithi183:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:15.731 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:15 smithi183 ceph-mon[37007]: Updating smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:15.731 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:15 smithi183 ceph-mon[37007]: Updating smithi047:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:15.731 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:15 smithi183 ceph-mon[37007]: Reconfiguring mon.a (unknown last config time)... 2024-07-24T21:57:15.731 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:15 smithi183 ceph-mon[37007]: Reconfiguring daemon mon.a on smithi047 2024-07-24T21:57:15.731 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:15 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:15.731 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:15 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:15.731 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:15 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:15.731 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:15 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-24T21:57:15.731 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:15 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-24T21:57:15.731 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:15 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:15.778 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:15 smithi047 ceph-mon[32551]: Updating smithi183:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:15.779 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:15 smithi047 ceph-mon[32551]: Updating smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:15.779 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:15 smithi047 ceph-mon[32551]: Updating smithi047:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:15.779 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:15 smithi047 ceph-mon[32551]: Reconfiguring mon.a (unknown last config time)... 2024-07-24T21:57:15.779 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:15 smithi047 ceph-mon[32551]: Reconfiguring daemon mon.a on smithi047 2024-07-24T21:57:15.779 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:15.779 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:15.779 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:15.779 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-24T21:57:15.779 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-24T21:57:15.779 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:15 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:15.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:15 smithi188 ceph-mon[37380]: Updating smithi183:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:15 smithi188 ceph-mon[37380]: Updating smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:15 smithi188 ceph-mon[37380]: Updating smithi047:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:15 smithi188 ceph-mon[37380]: Reconfiguring mon.a (unknown last config time)... 2024-07-24T21:57:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:15 smithi188 ceph-mon[37380]: Reconfiguring daemon mon.a on smithi047 2024-07-24T21:57:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:15 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:15 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:15 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:15 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-24T21:57:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:15 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-24T21:57:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:15 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:16.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:16 smithi047 ceph-mon[32551]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:16.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:16 smithi047 ceph-mon[32551]: Reconfiguring mon.b (monmap changed)... 2024-07-24T21:57:16.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:16 smithi047 ceph-mon[32551]: Reconfiguring daemon mon.b on smithi183 2024-07-24T21:57:16.733 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:16 smithi183 ceph-mon[37007]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:16.734 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:16 smithi183 ceph-mon[37007]: Reconfiguring mon.b (monmap changed)... 2024-07-24T21:57:16.734 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:16 smithi183 ceph-mon[37007]: Reconfiguring daemon mon.b on smithi183 2024-07-24T21:57:16.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:16 smithi188 ceph-mon[37380]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:16.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:16 smithi188 ceph-mon[37380]: Reconfiguring mon.b (monmap changed)... 2024-07-24T21:57:16.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:16 smithi188 ceph-mon[37380]: Reconfiguring daemon mon.b on smithi183 2024-07-24T21:57:17.138 INFO:teuthology.orchestra.run.smithi047.stdout:# minimal ceph.conf for 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:57:17.138 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-07-24T21:57:17.138 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T21:57:17.138 INFO:teuthology.orchestra.run.smithi047.stdout: mon_host = [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] 2024-07-24T21:57:17.734 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-07-24T21:57:17.734 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:57:17.734 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.conf 2024-07-24T21:57:17.758 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:17 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:17.758 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:17 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:17.758 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:17 smithi047 ceph-mon[32551]: Reconfiguring mon.c (monmap changed)... 2024-07-24T21:57:17.758 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:17 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-24T21:57:17.758 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:17 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-24T21:57:17.758 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:17 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:17.758 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:17 smithi047 ceph-mon[32551]: Reconfiguring daemon mon.c on smithi188 2024-07-24T21:57:17.759 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:17 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2831306396' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:17.764 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:57:17.764 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:57:17.829 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-07-24T21:57:17.829 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.conf 2024-07-24T21:57:17.856 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:17 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:17.856 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:17 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:17.856 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:17 smithi183 ceph-mon[37007]: Reconfiguring mon.c (monmap changed)... 2024-07-24T21:57:17.856 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:17 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-24T21:57:17.856 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:17 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-24T21:57:17.857 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:17 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:17.857 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:17 smithi183 ceph-mon[37007]: Reconfiguring daemon mon.c on smithi188 2024-07-24T21:57:17.857 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:17 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2831306396' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:17.861 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-07-24T21:57:17.862 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:57:17.914 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:17 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:17.915 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:17 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:17.915 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:17 smithi188 ceph-mon[37380]: Reconfiguring mon.c (monmap changed)... 2024-07-24T21:57:17.915 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:17 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-24T21:57:17.915 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:17 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-24T21:57:17.915 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:17 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:17.915 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:17 smithi188 ceph-mon[37380]: Reconfiguring daemon mon.c on smithi188 2024-07-24T21:57:17.915 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:17 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2831306396' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:17.929 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-07-24T21:57:17.930 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.conf 2024-07-24T21:57:17.959 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-07-24T21:57:17.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:57:18.024 INFO:tasks.cephadm:enabling module snap_schedule 2024-07-24T21:57:18.024 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-07-24T21:57:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:18.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:18 smithi047 ceph-mon[32551]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:18.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:18 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:18.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:18 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:18.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:18 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:18.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:18 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:18.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:18 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:18.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:18 smithi047 ceph-mon[32551]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:18.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:18 smithi183 ceph-mon[37007]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:18.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:18 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:18.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:18 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:18.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:18 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:18.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:18 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:18.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:18 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:18.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:18 smithi183 ceph-mon[37007]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:19.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:18 smithi188 ceph-mon[37380]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:19.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:18 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:19.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:18 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:19.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:18 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:19.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:18 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:19.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:18 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:19.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:18 smithi188 ceph-mon[37380]: from='mgr.14150 172.21.15.47:0/765402697' entity='mgr.x' 2024-07-24T21:57:20.900 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:20 smithi047 ceph-mon[32551]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:20.901 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:20 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3578167147' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-24T21:57:20.901 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:20 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: ignoring --setuser ceph since I am not root 2024-07-24T21:57:20.901 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:20 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: ignoring --setgroup ceph since I am not root 2024-07-24T21:57:20.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:20 smithi183 ceph-mon[37007]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:20.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:20 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3578167147' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-24T21:57:21.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:20 smithi188 ceph-mon[37380]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:21.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:20 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3578167147' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-24T21:57:21.180 INFO:tasks.cephadm:Adding mgr.x on smithi047 2024-07-24T21:57:21.181 INFO:tasks.cephadm:Adding mgr.y on smithi183 2024-07-24T21:57:21.181 INFO:tasks.cephadm:Adding mgr.z on smithi188 2024-07-24T21:57:21.181 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch apply mgr '3;smithi047=x;smithi183=y;smithi188=z' 2024-07-24T21:57:21.440 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T21:57:21.851 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:21 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3578167147' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-07-24T21:57:21.851 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:21 smithi188 ceph-mon[37380]: mgrmap e14: x(active, since 65s) 2024-07-24T21:57:21.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:21 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3578167147' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-07-24T21:57:21.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:21 smithi183 ceph-mon[37007]: mgrmap e14: x(active, since 65s) 2024-07-24T21:57:21.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:21 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3578167147' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-07-24T21:57:21.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:21 smithi047 ceph-mon[32551]: mgrmap e14: x(active, since 65s) 2024-07-24T21:57:26.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: Active manager daemon x restarted 2024-07-24T21:57:26.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: Activating manager daemon x 2024-07-24T21:57:26.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: osdmap e5: 0 total, 0 up, 0 in 2024-07-24T21:57:26.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: mgrmap e15: x(active, starting, since 0.00428056s) 2024-07-24T21:57:26.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:57:26.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:26.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:26.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-24T21:57:26.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-24T21:57:26.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-24T21:57:26.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-24T21:57:26.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: Manager daemon x is now available 2024-07-24T21:57:26.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:26.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-24T21:57:26.350 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: Active manager daemon x restarted 2024-07-24T21:57:26.350 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: Activating manager daemon x 2024-07-24T21:57:26.350 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: osdmap e5: 0 total, 0 up, 0 in 2024-07-24T21:57:26.350 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: mgrmap e15: x(active, starting, since 0.00428056s) 2024-07-24T21:57:26.350 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:57:26.351 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:26.351 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:26.351 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-24T21:57:26.351 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-24T21:57:26.351 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-24T21:57:26.351 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-24T21:57:26.351 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: Manager daemon x is now available 2024-07-24T21:57:26.351 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:26.351 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-24T21:57:26.372 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: Active manager daemon x restarted 2024-07-24T21:57:26.372 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: Activating manager daemon x 2024-07-24T21:57:26.372 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: osdmap e5: 0 total, 0 up, 0 in 2024-07-24T21:57:26.372 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: mgrmap e15: x(active, starting, since 0.00428056s) 2024-07-24T21:57:26.372 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:57:26.372 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:57:26.373 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:57:26.373 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-24T21:57:26.373 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-24T21:57:26.373 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-24T21:57:26.373 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-24T21:57:26.373 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: Manager daemon x is now available 2024-07-24T21:57:26.373 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:26.373 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-24T21:57:27.012 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled mgr update... 2024-07-24T21:57:27.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-24T21:57:27.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:27 smithi188 ceph-mon[37380]: mgrmap e16: x(active, since 1.00895s) 2024-07-24T21:57:27.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:27.321 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-24T21:57:27.321 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:27 smithi047 ceph-mon[32551]: mgrmap e16: x(active, since 1.00895s) 2024-07-24T21:57:27.321 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:27.354 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-24T21:57:27.354 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:27 smithi183 ceph-mon[37007]: mgrmap e16: x(active, since 1.00895s) 2024-07-24T21:57:27.354 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.181 DEBUG:teuthology.orchestra.run.smithi183:mgr.y> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.y.service 2024-07-24T21:57:28.183 DEBUG:teuthology.orchestra.run.smithi188:mgr.z> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.z.service 2024-07-24T21:57:28.185 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-07-24T21:57:28.185 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-07-24T21:57:28.188 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-07-24T21:57:28.188 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set client debug_client 20 2024-07-24T21:57:28.230 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-07-24T21:57:28.231 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set client debug_ms 1 2024-07-24T21:57:28.251 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T21:57:28.220+0000 7ff141eb7640 -1 log_channel(cephadm) log [ERR] : [24/Jul/2024:21:57:28] ENGINE Error in HTTPServer.serve 2024-07-24T21:57:28.251 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: Traceback (most recent call last): 2024-07-24T21:57:28.251 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-24T21:57:28.252 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: self._connections.run(self.expiration_interval) 2024-07-24T21:57:28.252 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-24T21:57:28.252 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: self._run(expiration_interval) 2024-07-24T21:57:28.252 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-24T21:57:28.252 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: new_conn = self._from_server_socket(self.server.socket) 2024-07-24T21:57:28.252 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-24T21:57:28.252 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-24T21:57:28.252 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-24T21:57:28.252 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: s = self.context.wrap_socket( 2024-07-24T21:57:28.252 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-24T21:57:28.253 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: return self.sslsocket_class._create( 2024-07-24T21:57:28.253 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-24T21:57:28.253 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: self.do_handshake() 2024-07-24T21:57:28.253 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-24T21:57:28.253 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: self._sslobj.do_handshake() 2024-07-24T21:57:28.253 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-24T21:57:28.253 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T21:57:28.253 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-07-24T21:57:28.254 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-07-24T21:57:28.296 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-07-24T21:57:28.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-07-24T21:57:28.339 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-07-24T21:57:28.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds debug_mds 20 2024-07-24T21:57:28.383 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-07-24T21:57:28.383 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-07-24T21:57:28.426 INFO:tasks.cephadm:setting config [mds] debug_ms = 1 2024-07-24T21:57:28.427 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds debug_ms 1 2024-07-24T21:57:28.470 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-07-24T21:57:28.470 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-07-24T21:57:28.514 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-07-24T21:57:28.514 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-07-24T21:57:28.559 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-07-24T21:57:28.559 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-07-24T21:57:28.609 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-07-24T21:57:28.610 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-07-24T21:57:28.610 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:28.611 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:28.658 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-07-24T21:57:28.658 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-07-24T21:57:28.676 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:28.695 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-07-24T21:57:28.695 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-07-24T21:57:28.761 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-07-24T21:57:28.761 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-07-24T21:57:28.780 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-mon[32551]: Saving service mgr spec with placement smithi047=x;smithi183=y;smithi188=z;count:3 2024-07-24T21:57:28.780 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:57:28.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi183", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:57:28.782 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-07-24T21:57:28.782 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-07-24T21:57:28.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:28 smithi188 ceph-mon[37380]: Saving service mgr spec with placement smithi047=x;smithi183=y;smithi188=z;count:3 2024-07-24T21:57:28.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:57:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi183", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:57:28.836 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-07-24T21:57:28.836 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-07-24T21:57:28.884 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-07-24T21:57:28.884 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-07-24T21:57:28.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:28 smithi183 ceph-mon[37007]: Saving service mgr spec with placement smithi047=x;smithi183=y;smithi188=z;count:3 2024-07-24T21:57:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:57:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi183", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:57:28.939 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-07-24T21:57:28.939 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-07-24T21:57:28.993 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-07-24T21:57:28.993 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mgr debug_cephsqlite 20 2024-07-24T21:57:29.043 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-07-24T21:57:29.043 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-07-24T21:57:29.098 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-07-24T21:57:29.098 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-07-24T21:57:29.151 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-07-24T21:57:29.151 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-07-24T21:57:29.202 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-07-24T21:57:29.202 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-07-24T21:57:29.253 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-07-24T21:57:29.253 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-07-24T21:57:29.304 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-07-24T21:57:29.304 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-07-24T21:57:29.355 DEBUG:tasks.cephadm:set 26 configs 2024-07-24T21:57:29.355 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi047') 2024-07-24T21:57:29.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: [24/Jul/2024:21:57:28] ENGINE Bus STARTING 2024-07-24T21:57:29.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: [24/Jul/2024:21:57:28] ENGINE Serving on https://172.21.15.47:7150 2024-07-24T21:57:29.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: [24/Jul/2024:21:57:28] ENGINE Error in HTTPServer.serve 2024-07-24T21:57:29.624 INFO:journalctl@ceph.mon.a.smithi047.stdout: Traceback (most recent call last): 2024-07-24T21:57:29.624 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-24T21:57:29.624 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._connections.run(self.expiration_interval) 2024-07-24T21:57:29.624 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-24T21:57:29.624 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._run(expiration_interval) 2024-07-24T21:57:29.624 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-24T21:57:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-07-24T21:57:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-24T21:57:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-24T21:57:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-24T21:57:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: s = self.context.wrap_socket( 2024-07-24T21:57:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-24T21:57:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: return self.sslsocket_class._create( 2024-07-24T21:57:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-24T21:57:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: self.do_handshake() 2024-07-24T21:57:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-24T21:57:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._sslobj.do_handshake() 2024-07-24T21:57:29.625 INFO:journalctl@ceph.mon.a.smithi047.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-24T21:57:29.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: [24/Jul/2024:21:57:28] ENGINE Serving on http://172.21.15.47:8765 2024-07-24T21:57:29.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: [24/Jul/2024:21:57:28] ENGINE Bus STARTED 2024-07-24T21:57:29.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:29.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:29.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi188", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:57:29.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:29.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:29.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: Updating smithi047:/etc/ceph/ceph.conf 2024-07-24T21:57:29.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: Updating smithi183:/etc/ceph/ceph.conf 2024-07-24T21:57:29.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: Updating smithi188:/etc/ceph/ceph.conf 2024-07-24T21:57:29.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:29 smithi047 ceph-mon[32551]: mgrmap e17: x(active, since 2s) 2024-07-24T21:57:29.676 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:29.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: [24/Jul/2024:21:57:28] ENGINE Bus STARTING 2024-07-24T21:57:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: [24/Jul/2024:21:57:28] ENGINE Serving on https://172.21.15.47:7150 2024-07-24T21:57:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: [24/Jul/2024:21:57:28] ENGINE Error in HTTPServer.serve 2024-07-24T21:57:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout: Traceback (most recent call last): 2024-07-24T21:57:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-24T21:57:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout: self._connections.run(self.expiration_interval) 2024-07-24T21:57:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-24T21:57:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout: self._run(expiration_interval) 2024-07-24T21:57:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-24T21:57:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-07-24T21:57:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-24T21:57:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-24T21:57:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-24T21:57:29.913 INFO:journalctl@ceph.mon.b.smithi183.stdout: s = self.context.wrap_socket( 2024-07-24T21:57:29.913 INFO:journalctl@ceph.mon.b.smithi183.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-24T21:57:29.913 INFO:journalctl@ceph.mon.b.smithi183.stdout: return self.sslsocket_class._create( 2024-07-24T21:57:29.913 INFO:journalctl@ceph.mon.b.smithi183.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-24T21:57:29.913 INFO:journalctl@ceph.mon.b.smithi183.stdout: self.do_handshake() 2024-07-24T21:57:29.913 INFO:journalctl@ceph.mon.b.smithi183.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-24T21:57:29.913 INFO:journalctl@ceph.mon.b.smithi183.stdout: self._sslobj.do_handshake() 2024-07-24T21:57:29.913 INFO:journalctl@ceph.mon.b.smithi183.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-24T21:57:29.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: [24/Jul/2024:21:57:28] ENGINE Serving on http://172.21.15.47:8765 2024-07-24T21:57:29.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: [24/Jul/2024:21:57:28] ENGINE Bus STARTED 2024-07-24T21:57:29.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:29.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:29.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi188", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:57:29.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:29.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:29.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: Updating smithi047:/etc/ceph/ceph.conf 2024-07-24T21:57:29.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: Updating smithi183:/etc/ceph/ceph.conf 2024-07-24T21:57:29.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: Updating smithi188:/etc/ceph/ceph.conf 2024-07-24T21:57:29.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:29 smithi183 ceph-mon[37007]: mgrmap e17: x(active, since 2s) 2024-07-24T21:57:30.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: [24/Jul/2024:21:57:28] ENGINE Bus STARTING 2024-07-24T21:57:30.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: [24/Jul/2024:21:57:28] ENGINE Serving on https://172.21.15.47:7150 2024-07-24T21:57:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: [24/Jul/2024:21:57:28] ENGINE Error in HTTPServer.serve 2024-07-24T21:57:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout: Traceback (most recent call last): 2024-07-24T21:57:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-24T21:57:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout: self._connections.run(self.expiration_interval) 2024-07-24T21:57:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-24T21:57:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout: self._run(expiration_interval) 2024-07-24T21:57:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-24T21:57:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-07-24T21:57:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-24T21:57:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-24T21:57:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-24T21:57:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout: s = self.context.wrap_socket( 2024-07-24T21:57:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout: return self.sslsocket_class._create( 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout: self.do_handshake() 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout: self._sslobj.do_handshake() 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: [24/Jul/2024:21:57:28] ENGINE Serving on http://172.21.15.47:8765 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: [24/Jul/2024:21:57:28] ENGINE Bus STARTED 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi188", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: Updating smithi047:/etc/ceph/ceph.conf 2024-07-24T21:57:30.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: Updating smithi183:/etc/ceph/ceph.conf 2024-07-24T21:57:30.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: Updating smithi188:/etc/ceph/ceph.conf 2024-07-24T21:57:30.051 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:29 smithi188 ceph-mon[37380]: mgrmap e17: x(active, since 2s) 2024-07-24T21:57:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: Updating smithi183:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: Updating smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: Updating smithi183:/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:57:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:57:30.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: Updating smithi183:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.client.admin.keyring 2024-07-24T21:57:30.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: Updating smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.client.admin.keyring 2024-07-24T21:57:30.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-24T21:57:30.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-24T21:57:30.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-24T21:57:30.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:30.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: Updating smithi183:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:30.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: Updating smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:30.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: Updating smithi183:/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:57:30.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:57:30.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: Updating smithi183:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.client.admin.keyring 2024-07-24T21:57:30.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: Updating smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.client.admin.keyring 2024-07-24T21:57:30.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-24T21:57:30.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-24T21:57:30.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-24T21:57:30.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:30.974 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: Updating smithi183:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:30.975 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: Updating smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:30.975 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: Updating smithi183:/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:57:30.975 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:57:30.976 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: Updating smithi183:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.client.admin.keyring 2024-07-24T21:57:30.976 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: Updating smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.client.admin.keyring 2024-07-24T21:57:30.976 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.976 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.976 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.977 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.977 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.977 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.977 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:30.977 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-24T21:57:30.978 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-24T21:57:30.978 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-24T21:57:30.978 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:31.643 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:31 smithi047 ceph-mon[32551]: Updating smithi047:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:31.643 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:31 smithi047 ceph-mon[32551]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:57:31.643 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:31 smithi047 ceph-mon[32551]: Updating smithi047:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.client.admin.keyring 2024-07-24T21:57:31.643 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:31 smithi047 ceph-mon[32551]: Deploying daemon mgr.z on smithi188 2024-07-24T21:57:31.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:31 smithi183 ceph-mon[37007]: Updating smithi047:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:31.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:31 smithi183 ceph-mon[37007]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:57:31.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:31 smithi183 ceph-mon[37007]: Updating smithi047:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.client.admin.keyring 2024-07-24T21:57:31.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:31 smithi183 ceph-mon[37007]: Deploying daemon mgr.z on smithi188 2024-07-24T21:57:31.978 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:31 smithi188 ceph-mon[37380]: Updating smithi047:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.conf 2024-07-24T21:57:31.978 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:31 smithi188 ceph-mon[37380]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-07-24T21:57:31.979 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:31 smithi188 ceph-mon[37380]: Updating smithi047:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/config/ceph.client.admin.keyring 2024-07-24T21:57:31.979 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:31 smithi188 ceph-mon[37380]: Deploying daemon mgr.z on smithi188 2024-07-24T21:57:32.548 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Jul 24 21:57:32 smithi188 systemd[1]: Starting Ceph mgr.z for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T21:57:32.904 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Jul 24 21:57:32 smithi188 podman[40191]: 2024-07-24 21:57:32.519534392 +0000 UTC m=+0.017437487 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T21:57:32.904 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Jul 24 21:57:32 smithi188 podman[40191]: 2024-07-24 21:57:32.79587158 +0000 UTC m=+0.293774710 container create 1ea1a7fc455fdff6cf67c5d295aad769c07cd53028aca9e85cec86cbd1ede924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=main-86385b1, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-07-24T21:57:33.298 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Jul 24 21:57:32 smithi188 podman[40191]: 2024-07-24 21:57:32.997925262 +0000 UTC m=+0.495828349 container init 1ea1a7fc455fdff6cf67c5d295aad769c07cd53028aca9e85cec86cbd1ede924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-07-24T21:57:33.299 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Jul 24 21:57:33 smithi188 podman[40191]: 2024-07-24 21:57:33.000464255 +0000 UTC m=+0.498367354 container start 1ea1a7fc455fdff6cf67c5d295aad769c07cd53028aca9e85cec86cbd1ede924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=main-86385b1, ceph=True) 2024-07-24T21:57:33.299 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Jul 24 21:57:33 smithi188 ceph-mgr[40210]: -- 172.21.15.188:0/3187923909 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5615aa0450e0 con 0x5615aa023400 2024-07-24T21:57:33.299 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Jul 24 21:57:33 smithi188 bash[40191]: 1ea1a7fc455fdff6cf67c5d295aad769c07cd53028aca9e85cec86cbd1ede924 2024-07-24T21:57:33.299 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Jul 24 21:57:33 smithi188 systemd[1]: Started Ceph mgr.z for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T21:57:33.871 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi047') 2024-07-24T21:57:34.279 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:34.288 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:34.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:34.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:34.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:34.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-24T21:57:34.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-24T21:57:34.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-24T21:57:34.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:34.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:34 smithi188 ceph-mon[37380]: Deploying daemon mgr.y on smithi183 2024-07-24T21:57:34.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:34 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3633520539' entity='client.admin' 2024-07-24T21:57:34.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:34.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:34.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:34.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-24T21:57:34.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-24T21:57:34.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-24T21:57:34.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:34.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:34 smithi183 ceph-mon[37007]: Deploying daemon mgr.y on smithi183 2024-07-24T21:57:34.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:34 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3633520539' entity='client.admin' 2024-07-24T21:57:34.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:34.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:34.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:34.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-24T21:57:34.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-24T21:57:34.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-24T21:57:34.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:34.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:34 smithi047 ceph-mon[32551]: Deploying daemon mgr.y on smithi183 2024-07-24T21:57:34.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:34 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3633520539' entity='client.admin' 2024-07-24T21:57:34.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:34.692+0000 7f6a8501a640 1 -- 172.21.15.47:0/1593674236 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6a6803edb0 msgr2=0x7f6a68041270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:34.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:34.692+0000 7f6a8501a640 1 --2- 172.21.15.47:0/1593674236 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6a6803edb0 0x7f6a68041270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6a70005fd0 tx=0x7f6a70009260 comp rx=0 tx=0).stop 2024-07-24T21:57:34.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:34.692+0000 7f6a8501a640 1 -- 172.21.15.47:0/1593674236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a80108b20 msgr2=0x7f6a8019e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:34.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:34.692+0000 7f6a8501a640 1 --2- 172.21.15.47:0/1593674236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a80108b20 0x7f6a8019e2c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6a78004af0 tx=0x7f6a78030b00 comp rx=0 tx=0).stop 2024-07-24T21:57:34.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:34.692+0000 7f6a8501a640 1 -- 172.21.15.47:0/1593674236 shutdown_connections 2024-07-24T21:57:34.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:34.692+0000 7f6a8501a640 1 --2- 172.21.15.47:0/1593674236 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6a6803edb0 0x7f6a68041270 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:34.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:34.692+0000 7f6a8501a640 1 --2- 172.21.15.47:0/1593674236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a80108b20 0x7f6a8019e2c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:34.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:34.692+0000 7f6a8501a640 1 --2- 172.21.15.47:0/1593674236 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a801081a0 0x7f6a80198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:34.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:34.692+0000 7f6a8501a640 1 --2- 172.21.15.47:0/1593674236 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a80102790 0x7f6a801989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:34.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:34.692+0000 7f6a8501a640 1 -- 172.21.15.47:0/1593674236 >> 172.21.15.47:0/1593674236 conn(0x7f6a800fe200 msgr2=0x7f6a801005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:34.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:34.692+0000 7f6a8501a640 1 -- 172.21.15.47:0/1593674236 shutdown_connections 2024-07-24T21:57:34.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:34.692+0000 7f6a8501a640 1 -- 172.21.15.47:0/1593674236 wait complete. 2024-07-24T21:57:35.072 INFO:journalctl@ceph.mgr.y.smithi183.stdout:Jul 24 21:57:34 smithi183 systemd[1]: Starting Ceph mgr.y for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T21:57:35.348 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:35 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1546078617' entity='client.admin' 2024-07-24T21:57:35.349 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:35 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1593674236' entity='client.admin' 2024-07-24T21:57:35.349 INFO:journalctl@ceph.mgr.y.smithi183.stdout:Jul 24 21:57:35 smithi183 podman[39350]: 2024-07-24 21:57:35.070322557 +0000 UTC m=+0.105941824 container create 6f53b628aace57fb90833805a7267c4e0d3737ac6d13524f0f1a1b583cf71de3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240716) 2024-07-24T21:57:35.349 INFO:journalctl@ceph.mgr.y.smithi183.stdout:Jul 24 21:57:35 smithi183 podman[39350]: 2024-07-24 21:57:34.981749397 +0000 UTC m=+0.017368637 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T21:57:35.349 INFO:journalctl@ceph.mgr.y.smithi183.stdout:Jul 24 21:57:35 smithi183 podman[39350]: 2024-07-24 21:57:35.280849103 +0000 UTC m=+0.316468327 container init 6f53b628aace57fb90833805a7267c4e0d3737ac6d13524f0f1a1b583cf71de3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240716) 2024-07-24T21:57:35.349 INFO:journalctl@ceph.mgr.y.smithi183.stdout:Jul 24 21:57:35 smithi183 podman[39350]: 2024-07-24 21:57:35.284170801 +0000 UTC m=+0.319790025 container start 6f53b628aace57fb90833805a7267c4e0d3737ac6d13524f0f1a1b583cf71de3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240716, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T21:57:35.349 INFO:journalctl@ceph.mgr.y.smithi183.stdout:Jul 24 21:57:35 smithi183 ceph-mgr[39370]: -- 172.21.15.183:0/1567209525 <== mon.2 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a28060b0e0 con 0x55a2805e9400 2024-07-24T21:57:35.349 INFO:journalctl@ceph.mgr.y.smithi183.stdout:Jul 24 21:57:35 smithi183 bash[39350]: 6f53b628aace57fb90833805a7267c4e0d3737ac6d13524f0f1a1b583cf71de3 2024-07-24T21:57:35.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:35 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1546078617' entity='client.admin' 2024-07-24T21:57:35.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:35 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1593674236' entity='client.admin' 2024-07-24T21:57:35.442 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:35.443 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:35.443 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:35.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:35 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1546078617' entity='client.admin' 2024-07-24T21:57:35.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:35 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1593674236' entity='client.admin' 2024-07-24T21:57:35.661 INFO:journalctl@ceph.mgr.y.smithi183.stdout:Jul 24 21:57:35 smithi183 systemd[1]: Started Ceph mgr.y for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T21:57:35.853 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi047') 2024-07-24T21:57:36.362 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:36.363 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:36.364 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:36.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:36 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:36 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:36 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:36 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:36 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:36.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:36 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:36 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:36 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:36 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:36 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:36 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:36.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:36 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:36 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:36 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:36 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:36 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:36.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:36 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:36.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:36 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:37.623 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:37.624 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:37.809 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:37.809 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:37.877 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:37 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:37.877 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:37 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:37.877 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:37 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:37.878 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:37 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:37.878 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:37 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:37.878 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:37 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:37.878 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:37 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:37.878 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:37 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-24T21:57:37.878 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:37 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-24T21:57:37.878 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:37 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:37.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:37 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:37 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:37 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:37 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:37 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:37 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:37 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:37 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-24T21:57:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:37 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-24T21:57:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:37 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:38.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:37 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:38.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:37 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:38.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:37 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:38.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:37 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:38.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:37 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:38.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:37 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:38.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:37 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:38.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:37 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-24T21:57:38.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:37 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-24T21:57:38.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:37 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:38.140 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:38.141 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:38.774 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:38 smithi047 ceph-mon[32551]: Reconfiguring mgr.x (unknown last config time)... 2024-07-24T21:57:38.774 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:38 smithi047 ceph-mon[32551]: Reconfiguring daemon mgr.x on smithi047 2024-07-24T21:57:38.774 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:38 smithi047 ceph-mon[32551]: Standby manager daemon z started 2024-07-24T21:57:38.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:38 smithi047 ceph-mon[32551]: from='mgr.? 172.21.15.188:0/3897082119' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-07-24T21:57:38.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:38 smithi047 ceph-mon[32551]: from='mgr.? 172.21.15.188:0/3897082119' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-24T21:57:38.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:38 smithi047 ceph-mon[32551]: from='mgr.? 172.21.15.188:0/3897082119' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-07-24T21:57:38.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:38 smithi047 ceph-mon[32551]: from='mgr.? 172.21.15.188:0/3897082119' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-24T21:57:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:38 smithi183 ceph-mon[37007]: Reconfiguring mgr.x (unknown last config time)... 2024-07-24T21:57:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:38 smithi183 ceph-mon[37007]: Reconfiguring daemon mgr.x on smithi047 2024-07-24T21:57:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:38 smithi183 ceph-mon[37007]: Standby manager daemon z started 2024-07-24T21:57:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:38 smithi183 ceph-mon[37007]: from='mgr.? 172.21.15.188:0/3897082119' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-07-24T21:57:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:38 smithi183 ceph-mon[37007]: from='mgr.? 172.21.15.188:0/3897082119' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-24T21:57:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:38 smithi183 ceph-mon[37007]: from='mgr.? 172.21.15.188:0/3897082119' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-07-24T21:57:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:38 smithi183 ceph-mon[37007]: from='mgr.? 172.21.15.188:0/3897082119' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-24T21:57:39.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:38 smithi188 ceph-mon[37380]: Reconfiguring mgr.x (unknown last config time)... 2024-07-24T21:57:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:38 smithi188 ceph-mon[37380]: Reconfiguring daemon mgr.x on smithi047 2024-07-24T21:57:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:38 smithi188 ceph-mon[37380]: Standby manager daemon z started 2024-07-24T21:57:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:38 smithi188 ceph-mon[37380]: from='mgr.? 172.21.15.188:0/3897082119' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-07-24T21:57:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:38 smithi188 ceph-mon[37380]: from='mgr.? 172.21.15.188:0/3897082119' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-24T21:57:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:38 smithi188 ceph-mon[37380]: from='mgr.? 172.21.15.188:0/3897082119' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-07-24T21:57:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:38 smithi188 ceph-mon[37380]: from='mgr.? 172.21.15.188:0/3897082119' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-24T21:57:39.566 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi047') 2024-07-24T21:57:39.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:39 smithi183 ceph-mon[37007]: mgrmap e18: x(active, since 12s), standbys: z 2024-07-24T21:57:39.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:39 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-07-24T21:57:39.927 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:39 smithi047 ceph-mon[32551]: mgrmap e18: x(active, since 12s), standbys: z 2024-07-24T21:57:39.927 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:39 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-07-24T21:57:40.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:39 smithi188 ceph-mon[37380]: mgrmap e18: x(active, since 12s), standbys: z 2024-07-24T21:57:40.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:39 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-07-24T21:57:40.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.412+0000 7f69ec194640 1 -- 172.21.15.47:0/2464960677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69e410cb00 msgr2=0x7f69e410ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:40.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.412+0000 7f69ec194640 1 --2- 172.21.15.47:0/2464960677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69e410cb00 0x7f69e410ef60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009ca0 tx=0x7f69dc02a8c0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.413+0000 7f69ec194640 1 -- 172.21.15.47:0/2464960677 shutdown_connections 2024-07-24T21:57:40.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.413+0000 7f69ec194640 1 --2- 172.21.15.47:0/2464960677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69e410cb00 0x7f69e410ef60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.413+0000 7f69ec194640 1 --2- 172.21.15.47:0/2464960677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69e4103fc0 0x7f69e410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.413+0000 7f69ec194640 1 --2- 172.21.15.47:0/2464960677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e41036a0 0x7f69e4103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.413+0000 7f69ec194640 1 -- 172.21.15.47:0/2464960677 >> 172.21.15.47:0/2464960677 conn(0x7f69e40fd100 msgr2=0x7f69e40ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:40.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.413+0000 7f69ec194640 1 -- 172.21.15.47:0/2464960677 shutdown_connections 2024-07-24T21:57:40.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.413+0000 7f69ec194640 1 -- 172.21.15.47:0/2464960677 wait complete. 2024-07-24T21:57:40.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.414+0000 7f69ec194640 1 Processor -- start 2024-07-24T21:57:40.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.414+0000 7f69ec194640 1 -- start start 2024-07-24T21:57:40.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.414+0000 7f69ec194640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69e41036a0 0x7f69e4102e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:40.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.414+0000 7f69ec194640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e4103fc0 0x7f69e4101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:40.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.414+0000 7f69ec194640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69e410cb00 0x7f69e4101980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:40.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.414+0000 7f69ec194640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69e4112490 con 0x7f69e41036a0 2024-07-24T21:57:40.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.414+0000 7f69ec194640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f69e4112310 con 0x7f69e410cb00 2024-07-24T21:57:40.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.414+0000 7f69ec194640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f69e4112610 con 0x7f69e4103fc0 2024-07-24T21:57:40.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.415+0000 7f69ea731640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69e410cb00 0x7f69e4101980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:40.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.415+0000 7f69e9f30640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69e41036a0 0x7f69e4102e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:40.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.415+0000 7f69e972f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e4103fc0 0x7f69e4101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:40.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.415+0000 7f69e972f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e4103fc0 0x7f69e4101350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:49674/0 (socket says 172.21.15.47:49674) 2024-07-24T21:57:40.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.415+0000 7f69e9f30640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69e41036a0 0x7f69e4102e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47226/0 (socket says 172.21.15.47:47226) 2024-07-24T21:57:40.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.415+0000 7f69e972f640 1 -- 172.21.15.47:0/2070598849 learned_addr learned my addr 172.21.15.47:0/2070598849 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:57:40.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.415+0000 7f69e972f640 1 -- 172.21.15.47:0/2070598849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69e410cb00 msgr2=0x7f69e4101980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:40.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.415+0000 7f69e972f640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69e410cb00 0x7f69e4101980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.415+0000 7f69e972f640 1 -- 172.21.15.47:0/2070598849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69e41036a0 msgr2=0x7f69e4102e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:40.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.415+0000 7f69e972f640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69e41036a0 0x7f69e4102e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.415+0000 7f69e972f640 1 -- 172.21.15.47:0/2070598849 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e419cb80 con 0x7f69e4103fc0 2024-07-24T21:57:40.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.415+0000 7f69ea731640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69e410cb00 0x7f69e4101980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T21:57:40.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.415+0000 7f69e9f30640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69e41036a0 0x7f69e4102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T21:57:40.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.416+0000 7f69e972f640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e4103fc0 0x7f69e4101350 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f69d400d740 tx=0x7f69d400dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:40.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.416+0000 7f69daffd640 1 -- 172.21.15.47:0/2070598849 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4017020 con 0x7f69e4103fc0 2024-07-24T21:57:40.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.416+0000 7f69ec194640 1 -- 172.21.15.47:0/2070598849 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e419ce70 con 0x7f69e4103fc0 2024-07-24T21:57:40.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.416+0000 7f69daffd640 1 -- 172.21.15.47:0/2070598849 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f69d400de50 con 0x7f69e4103fc0 2024-07-24T21:57:40.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.416+0000 7f69daffd640 1 -- 172.21.15.47:0/2070598849 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d400f620 con 0x7f69e4103fc0 2024-07-24T21:57:40.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.416+0000 7f69ec194640 1 -- 172.21.15.47:0/2070598849 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e419d3b0 con 0x7f69e4103fc0 2024-07-24T21:57:40.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.417+0000 7f69ec194640 1 -- 172.21.15.47:0/2070598849 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e406b550 con 0x7f69e4103fc0 2024-07-24T21:57:40.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.418+0000 7f69daffd640 1 -- 172.21.15.47:0/2070598849 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 18) ==== 100892+0+0 (secure 0 0 0) 0x7f69d401a020 con 0x7f69e4103fc0 2024-07-24T21:57:40.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.419+0000 7f69daffd640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69d00794a0 0x7f69d007b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:40.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.419+0000 7f69e9f30640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69d00794a0 0x7f69d007b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:40.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.419+0000 7f69daffd640 1 -- 172.21.15.47:0/2070598849 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f69d409a7f0 con 0x7f69e4103fc0 2024-07-24T21:57:40.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.419+0000 7f69e9f30640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69d00794a0 0x7f69d007b960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f69e0005fd0 tx=0x7f69e000b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:40.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.423+0000 7f69daffd640 1 -- 172.21.15.47:0/2070598849 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f69d4021020 con 0x7f69e4103fc0 2024-07-24T21:57:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.621+0000 7f69ec194640 1 -- 172.21.15.47:0/2070598849 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f69e41026f0 con 0x7f69e4103fc0 2024-07-24T21:57:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.625+0000 7f66267f3640 1 -- 172.21.15.47:0/3447915747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f662010cb40 msgr2=0x7f662010ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.625+0000 7f66267f3640 1 --2- 172.21.15.47:0/3447915747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f662010cb40 0x7f662010ef50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6618009ca0 tx=0x7f661802a8c0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.625+0000 7f66267f3640 1 -- 172.21.15.47:0/3447915747 shutdown_connections 2024-07-24T21:57:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.625+0000 7f66267f3640 1 --2- 172.21.15.47:0/3447915747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f662010cb40 0x7f662010ef50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.625+0000 7f66267f3640 1 --2- 172.21.15.47:0/3447915747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6620103f90 0x7f662010c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.625+0000 7f66267f3640 1 --2- 172.21.15.47:0/3447915747 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6620103590 0x7f6620103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.625+0000 7f66267f3640 1 -- 172.21.15.47:0/3447915747 >> 172.21.15.47:0/3447915747 conn(0x7f66200fd100 msgr2=0x7f66200ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.625+0000 7f66267f3640 1 -- 172.21.15.47:0/3447915747 shutdown_connections 2024-07-24T21:57:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.625+0000 7f66267f3640 1 -- 172.21.15.47:0/3447915747 wait complete. 2024-07-24T21:57:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.626+0000 7f66267f3640 1 Processor -- start 2024-07-24T21:57:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.626+0000 7f66267f3640 1 -- start start 2024-07-24T21:57:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f66267f3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6620103590 0x7f6620101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f66267f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6620103f90 0x7f6620101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f66267f3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f662010cb40 0x7f6620101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f66267f3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6620112510 con 0x7f662010cb40 2024-07-24T21:57:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f66267f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6620112390 con 0x7f6620103f90 2024-07-24T21:57:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f66267f3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6620112690 con 0x7f6620103590 2024-07-24T21:57:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f6624d90640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f662010cb40 0x7f6620101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f6624d90640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f662010cb40 0x7f6620101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47250/0 (socket says 172.21.15.47:47250) 2024-07-24T21:57:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f6624d90640 1 -- 172.21.15.47:0/2637189033 learned_addr learned my addr 172.21.15.47:0/2637189033 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:57:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f661ffff640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6620103590 0x7f6620101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f661f7fe640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6620103f90 0x7f6620101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f6624d90640 1 -- 172.21.15.47:0/2637189033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6620103590 msgr2=0x7f6620101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f6624d90640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6620103590 0x7f6620101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f6624d90640 1 -- 172.21.15.47:0/2637189033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6620103f90 msgr2=0x7f6620101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f6624d90640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6620103f90 0x7f6620101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f6624d90640 1 -- 172.21.15.47:0/2637189033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66201a6ec0 con 0x7f662010cb40 2024-07-24T21:57:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f661f7fe640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6620103f90 0x7f6620101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T21:57:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.627+0000 7f6624d90640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f662010cb40 0x7f6620101e90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6618005e30 tx=0x7f6618009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.631+0000 7f69daffd640 1 -- 172.21.15.47:0/2070598849 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f69d405f6f0 con 0x7f69e4103fc0 2024-07-24T21:57:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.632+0000 7f661d7fa640 1 -- 172.21.15.47:0/2637189033 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618003c70 con 0x7f662010cb40 2024-07-24T21:57:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.632+0000 7f66267f3640 1 -- 172.21.15.47:0/2637189033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66201a7150 con 0x7f662010cb40 2024-07-24T21:57:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.633+0000 7f661d7fa640 1 -- 172.21.15.47:0/2637189033 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f6618003e10 con 0x7f662010cb40 2024-07-24T21:57:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.633+0000 7f661d7fa640 1 -- 172.21.15.47:0/2637189033 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618030b00 con 0x7f662010cb40 2024-07-24T21:57:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.633+0000 7f66267f3640 1 -- 172.21.15.47:0/2637189033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66201a76e0 con 0x7f662010cb40 2024-07-24T21:57:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.634+0000 7f66267f3640 1 -- 172.21.15.47:0/2637189033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6620103970 con 0x7f662010cb40 2024-07-24T21:57:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.635+0000 7f661d7fa640 1 -- 172.21.15.47:0/2637189033 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f6618004700 con 0x7f662010cb40 2024-07-24T21:57:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.636+0000 7f661d7fa640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f66080b3b90 0x7f66080b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:40.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.636+0000 7f661ffff640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f66080b3b90 0x7f66080b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:40.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.636+0000 7f661d7fa640 1 -- 172.21.15.47:0/2637189033 <== mon.0 v2:172.21.15.47:3300/0 5 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6618108080 con 0x7f662010cb40 2024-07-24T21:57:40.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.637+0000 7f661d7fa640 1 -- 172.21.15.47:0/2637189033 <== mon.0 v2:172.21.15.47:3300/0 6 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f66180c84c0 con 0x7f662010cb40 2024-07-24T21:57:40.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.637+0000 7f69daffd640 1 -- 172.21.15.47:0/2070598849 <== mon.1 v2:172.21.15.188:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f69d40a0080 con 0x7f69e4103fc0 2024-07-24T21:57:40.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.637+0000 7f69daffd640 1 -- 172.21.15.47:0/2070598849 <== mon.1 v2:172.21.15.188:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f69d4063b60 con 0x7f69e4103fc0 2024-07-24T21:57:40.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.637+0000 7f661ffff640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f66080b3b90 0x7f66080b6050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6610009bd0 tx=0x7f6610005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:40.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.639+0000 7f69ec194640 1 -- 172.21.15.47:0/2070598849 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69d00794a0 msgr2=0x7f69d007b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:40.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.639+0000 7f69ec194640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69d00794a0 0x7f69d007b960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f69e0005fd0 tx=0x7f69e000b390 comp rx=0 tx=0).stop 2024-07-24T21:57:40.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.639+0000 7f69ec194640 1 -- 172.21.15.47:0/2070598849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e4103fc0 msgr2=0x7f69e4101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:40.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.639+0000 7f69ec194640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e4103fc0 0x7f69e4101350 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f69d400d740 tx=0x7f69d400dc00 comp rx=0 tx=0).stop 2024-07-24T21:57:40.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.639+0000 7f69ec194640 1 -- 172.21.15.47:0/2070598849 shutdown_connections 2024-07-24T21:57:40.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.639+0000 7f69ec194640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69d00794a0 0x7f69d007b960 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.639+0000 7f69ec194640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69e410cb00 0x7f69e4101980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.639+0000 7f69ec194640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e4103fc0 0x7f69e4101350 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.639+0000 7f69ec194640 1 --2- 172.21.15.47:0/2070598849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69e41036a0 0x7f69e4102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.639+0000 7f69ec194640 1 -- 172.21.15.47:0/2070598849 >> 172.21.15.47:0/2070598849 conn(0x7f69e40fd100 msgr2=0x7f69e40fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:40.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.639+0000 7f69ec194640 1 -- 172.21.15.47:0/2070598849 shutdown_connections 2024-07-24T21:57:40.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.639+0000 7f69ec194640 1 -- 172.21.15.47:0/2070598849 wait complete. 2024-07-24T21:57:40.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.642+0000 7f661d7fa640 1 -- 172.21.15.47:0/2637189033 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f66180cc5d0 con 0x7f662010cb40 2024-07-24T21:57:40.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.840+0000 7f66267f3640 1 -- 172.21.15.47:0/2637189033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f6620107c30 con 0x7f662010cb40 2024-07-24T21:57:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:40 smithi047 ceph-mon[32551]: Standby manager daemon y started 2024-07-24T21:57:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:40 smithi047 ceph-mon[32551]: from='mgr.? 172.21.15.183:0/610534078' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-07-24T21:57:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:40 smithi047 ceph-mon[32551]: from='mgr.? 172.21.15.183:0/610534078' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-24T21:57:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:40 smithi047 ceph-mon[32551]: from='mgr.? 172.21.15.183:0/610534078' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-07-24T21:57:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:40 smithi047 ceph-mon[32551]: from='mgr.? 172.21.15.183:0/610534078' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-24T21:57:40.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.844+0000 7f661d7fa640 1 -- 172.21.15.47:0/2637189033 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v14)=0 v14) ==== 117+0+0 (secure 0 0 0) 0x7f66180cbed0 con 0x7f662010cb40 2024-07-24T21:57:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.846+0000 7f66267f3640 1 -- 172.21.15.47:0/2637189033 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f66080b3b90 msgr2=0x7f66080b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.846+0000 7f66267f3640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f66080b3b90 0x7f66080b6050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6610009bd0 tx=0x7f6610005f90 comp rx=0 tx=0).stop 2024-07-24T21:57:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.846+0000 7f66267f3640 1 -- 172.21.15.47:0/2637189033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f662010cb40 msgr2=0x7f6620101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.846+0000 7f66267f3640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f662010cb40 0x7f6620101e90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6618005e30 tx=0x7f6618009360 comp rx=0 tx=0).stop 2024-07-24T21:57:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.846+0000 7f66267f3640 1 -- 172.21.15.47:0/2637189033 shutdown_connections 2024-07-24T21:57:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.846+0000 7f66267f3640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f66080b3b90 0x7f66080b6050 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.846+0000 7f66267f3640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f662010cb40 0x7f6620101e90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.846+0000 7f66267f3640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6620103f90 0x7f6620101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.846+0000 7f66267f3640 1 --2- 172.21.15.47:0/2637189033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6620103590 0x7f6620101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:40.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.846+0000 7f66267f3640 1 -- 172.21.15.47:0/2637189033 >> 172.21.15.47:0/2637189033 conn(0x7f66200fd100 msgr2=0x7f66200fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:40.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.846+0000 7f66267f3640 1 -- 172.21.15.47:0/2637189033 shutdown_connections 2024-07-24T21:57:40.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:40.846+0000 7f66267f3640 1 -- 172.21.15.47:0/2637189033 wait complete. 2024-07-24T21:57:40.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:40 smithi183 ceph-mon[37007]: Standby manager daemon y started 2024-07-24T21:57:40.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:40 smithi183 ceph-mon[37007]: from='mgr.? 172.21.15.183:0/610534078' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-07-24T21:57:40.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:40 smithi183 ceph-mon[37007]: from='mgr.? 172.21.15.183:0/610534078' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-24T21:57:40.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:40 smithi183 ceph-mon[37007]: from='mgr.? 172.21.15.183:0/610534078' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-07-24T21:57:40.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:40 smithi183 ceph-mon[37007]: from='mgr.? 172.21.15.183:0/610534078' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-24T21:57:41.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:40 smithi188 ceph-mon[37380]: Standby manager daemon y started 2024-07-24T21:57:41.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:40 smithi188 ceph-mon[37380]: from='mgr.? 172.21.15.183:0/610534078' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-07-24T21:57:41.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:40 smithi188 ceph-mon[37380]: from='mgr.? 172.21.15.183:0/610534078' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-24T21:57:41.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:40 smithi188 ceph-mon[37380]: from='mgr.? 172.21.15.183:0/610534078' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-07-24T21:57:41.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:40 smithi188 ceph-mon[37380]: from='mgr.? 172.21.15.183:0/610534078' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-24T21:57:41.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:41 smithi183 ceph-mon[37007]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-07-24T21:57:41.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:41 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-07-24T21:57:41.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:41 smithi183 ceph-mon[37007]: from='client.? ' entity='client.admin' 2024-07-24T21:57:41.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:41 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2637189033' entity='client.admin' 2024-07-24T21:57:41.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:41 smithi047 ceph-mon[32551]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-07-24T21:57:41.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:41 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-07-24T21:57:41.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:41 smithi047 ceph-mon[32551]: from='client.? ' entity='client.admin' 2024-07-24T21:57:41.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:41 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2637189033' entity='client.admin' 2024-07-24T21:57:42.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:41 smithi188 ceph-mon[37380]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-07-24T21:57:42.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:41 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-07-24T21:57:42.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:41 smithi188 ceph-mon[37380]: from='client.? ' entity='client.admin' 2024-07-24T21:57:42.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:41 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2637189033' entity='client.admin' 2024-07-24T21:57:43.385 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:43.385 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:57:47.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:47 smithi047 ceph-mon[32551]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:47.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:47 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:47.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:47 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:47.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:47 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:47.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:47 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:47.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:47 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:47.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:47 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:47.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:47 smithi183 ceph-mon[37007]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:47 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:47 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:47 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:47 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:47 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:47 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:47.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:47 smithi188 ceph-mon[37380]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:47.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:47 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:47.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:47 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:47.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:47 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:47.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:47 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:47.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:47 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:47.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:47 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:48.813 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi047') 2024-07-24T21:57:49.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:49 smithi047 ceph-mon[32551]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:49.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:49 smithi183 ceph-mon[37007]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:49.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:49 smithi188 ceph-mon[37380]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:50.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.785+0000 7f0f04395640 1 -- 172.21.15.47:0/858030336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0efc10cae0 msgr2=0x7f0efc10ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:50.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.785+0000 7f0f04395640 1 --2- 172.21.15.47:0/858030336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0efc10cae0 0x7f0efc10ef40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009900 tx=0x7f0ef402a410 comp rx=0 tx=0).stop 2024-07-24T21:57:50.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.785+0000 7f0f04395640 1 -- 172.21.15.47:0/858030336 shutdown_connections 2024-07-24T21:57:50.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.785+0000 7f0f04395640 1 --2- 172.21.15.47:0/858030336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0efc10cae0 0x7f0efc10ef40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:50.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.785+0000 7f0f04395640 1 --2- 172.21.15.47:0/858030336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0efc103fa0 0x7f0efc10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:50.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.785+0000 7f0f04395640 1 --2- 172.21.15.47:0/858030336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0efc103680 0x7f0efc103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:50.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.785+0000 7f0f04395640 1 -- 172.21.15.47:0/858030336 >> 172.21.15.47:0/858030336 conn(0x7f0efc0fd0e0 msgr2=0x7f0efc0ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:50.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.785+0000 7f0f04395640 1 -- 172.21.15.47:0/858030336 shutdown_connections 2024-07-24T21:57:50.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.785+0000 7f0f04395640 1 -- 172.21.15.47:0/858030336 wait complete. 2024-07-24T21:57:50.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.786+0000 7f0f04395640 1 Processor -- start 2024-07-24T21:57:50.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.786+0000 7f0f04395640 1 -- start start 2024-07-24T21:57:50.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.786+0000 7f0f04395640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0efc103680 0x7f0efc198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:50.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.786+0000 7f0f04395640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0efc103fa0 0x7f0efc199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:50.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.786+0000 7f0f04395640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0efc10cae0 0x7f0efc19e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.786+0000 7f0f04395640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc112680 con 0x7f0efc10cae0 2024-07-24T21:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.786+0000 7f0f04395640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc112500 con 0x7f0efc103fa0 2024-07-24T21:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.786+0000 7f0f04395640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc112800 con 0x7f0efc103680 2024-07-24T21:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.786+0000 7f0f02932640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0efc10cae0 0x7f0efc19e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.786+0000 7f0f02932640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0efc10cae0 0x7f0efc19e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52520/0 (socket says 172.21.15.47:52520) 2024-07-24T21:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.786+0000 7f0f02932640 1 -- 172.21.15.47:0/3572389372 learned_addr learned my addr 172.21.15.47:0/3572389372 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.786+0000 7f0f01930640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0efc103fa0 0x7f0efc199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.786+0000 7f0f02131640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0efc103680 0x7f0efc198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.787+0000 7f0f02932640 1 -- 172.21.15.47:0/3572389372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0efc103680 msgr2=0x7f0efc198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.787+0000 7f0f02932640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0efc103680 0x7f0efc198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.787+0000 7f0f02932640 1 -- 172.21.15.47:0/3572389372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0efc103fa0 msgr2=0x7f0efc199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.787+0000 7f0f02932640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0efc103fa0 0x7f0efc199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.787+0000 7f0f02932640 1 -- 172.21.15.47:0/3572389372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0efc19ecc0 con 0x7f0efc10cae0 2024-07-24T21:57:50.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.787+0000 7f0f02932640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0efc10cae0 0x7f0efc19e4f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4005ab0 tx=0x7f0ef4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:50.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.787+0000 7f0efb7fe640 1 -- 172.21.15.47:0/3572389372 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef403f030 con 0x7f0efc10cae0 2024-07-24T21:57:50.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.787+0000 7f0efb7fe640 1 -- 172.21.15.47:0/3572389372 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0ef4003a80 con 0x7f0efc10cae0 2024-07-24T21:57:50.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.787+0000 7f0f04395640 1 -- 172.21.15.47:0/3572389372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0efc19ef50 con 0x7f0efc10cae0 2024-07-24T21:57:50.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.787+0000 7f0efb7fe640 1 -- 172.21.15.47:0/3572389372 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4035070 con 0x7f0efc10cae0 2024-07-24T21:57:50.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.787+0000 7f0f04395640 1 -- 172.21.15.47:0/3572389372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0efc1a5670 con 0x7f0efc10cae0 2024-07-24T21:57:50.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.788+0000 7f0f04395640 1 -- 172.21.15.47:0/3572389372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0efc103a60 con 0x7f0efc10cae0 2024-07-24T21:57:50.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.789+0000 7f0efb7fe640 1 -- 172.21.15.47:0/3572389372 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f0ef4042030 con 0x7f0efc10cae0 2024-07-24T21:57:50.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.790+0000 7f0efb7fe640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0ee40b3c10 0x7f0ee40b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:50.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.790+0000 7f0f02131640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0ee40b3c10 0x7f0ee40b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:50.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.790+0000 7f0efb7fe640 1 -- 172.21.15.47:0/3572389372 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0ef41026d0 con 0x7f0efc10cae0 2024-07-24T21:57:50.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.791+0000 7f0f02131640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0ee40b3c10 0x7f0ee40b60d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009f20 tx=0x7f0eec0094f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:50.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.794+0000 7f0efb7fe640 1 -- 172.21.15.47:0/3572389372 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f0ef40cb880 con 0x7f0efc10cae0 2024-07-24T21:57:50.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.993+0000 7f0f04395640 1 -- 172.21.15.47:0/3572389372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f0efc107b60 con 0x7f0efc10cae0 2024-07-24T21:57:50.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.997+0000 7f0efb7fe640 1 -- 172.21.15.47:0/3572389372 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v15)=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f0ef40cb180 con 0x7f0efc10cae0 2024-07-24T21:57:51.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.999+0000 7f0f04395640 1 -- 172.21.15.47:0/3572389372 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0ee40b3c10 msgr2=0x7f0ee40b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:51.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.999+0000 7f0f04395640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0ee40b3c10 0x7f0ee40b60d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009f20 tx=0x7f0eec0094f0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.999+0000 7f0f04395640 1 -- 172.21.15.47:0/3572389372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0efc10cae0 msgr2=0x7f0efc19e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:51.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.999+0000 7f0f04395640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0efc10cae0 0x7f0efc19e4f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4005ab0 tx=0x7f0ef4004270 comp rx=0 tx=0).stop 2024-07-24T21:57:51.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.999+0000 7f0f04395640 1 -- 172.21.15.47:0/3572389372 shutdown_connections 2024-07-24T21:57:51.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.999+0000 7f0f04395640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0ee40b3c10 0x7f0ee40b60d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.999+0000 7f0f04395640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0efc10cae0 0x7f0efc19e4f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.999+0000 7f0f04395640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0efc103fa0 0x7f0efc199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.999+0000 7f0f04395640 1 --2- 172.21.15.47:0/3572389372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0efc103680 0x7f0efc198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:50.999+0000 7f0f04395640 1 -- 172.21.15.47:0/3572389372 >> 172.21.15.47:0/3572389372 conn(0x7f0efc0fd0e0 msgr2=0x7f0efc0fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:51.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.000+0000 7f0f04395640 1 -- 172.21.15.47:0/3572389372 shutdown_connections 2024-07-24T21:57:51.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.000+0000 7f0f04395640 1 -- 172.21.15.47:0/3572389372 wait complete. 2024-07-24T21:57:51.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:51 smithi047 ceph-mon[32551]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:51.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:51 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3572389372' entity='client.admin' 2024-07-24T21:57:51.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:51 smithi183 ceph-mon[37007]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:51 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3572389372' entity='client.admin' 2024-07-24T21:57:51.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:51 smithi188 ceph-mon[37380]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:51.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:51 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3572389372' entity='client.admin' 2024-07-24T21:57:51.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.657+0000 7f175ab24640 1 -- 172.21.15.47:0/2667329142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754103f80 msgr2=0x7f175410c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:51.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.657+0000 7f175ab24640 1 --2- 172.21.15.47:0/2667329142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754103f80 0x7f175410c470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1740009900 tx=0x7f174002a410 comp rx=0 tx=0).stop 2024-07-24T21:57:51.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.657+0000 7f175ab24640 1 -- 172.21.15.47:0/2667329142 shutdown_connections 2024-07-24T21:57:51.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.657+0000 7f175ab24640 1 --2- 172.21.15.47:0/2667329142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f175410cac0 0x7f175410ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.657+0000 7f175ab24640 1 --2- 172.21.15.47:0/2667329142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754103f80 0x7f175410c470 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.657+0000 7f175ab24640 1 --2- 172.21.15.47:0/2667329142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1754103660 0x7f1754103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.657+0000 7f175ab24640 1 -- 172.21.15.47:0/2667329142 >> 172.21.15.47:0/2667329142 conn(0x7f17540fd0c0 msgr2=0x7f17540ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:51.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.657+0000 7f175ab24640 1 -- 172.21.15.47:0/2667329142 shutdown_connections 2024-07-24T21:57:51.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.657+0000 7f175ab24640 1 -- 172.21.15.47:0/2667329142 wait complete. 2024-07-24T21:57:51.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.657+0000 7f175ab24640 1 Processor -- start 2024-07-24T21:57:51.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.657+0000 7f175ab24640 1 -- start start 2024-07-24T21:57:51.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f175ab24640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754103660 0x7f1754198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f175ab24640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1754103f80 0x7f1754199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f175ab24640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f175410cac0 0x7f175419e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f175ab24640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f17541125d0 con 0x7f1754103660 2024-07-24T21:57:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f175ab24640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1754112450 con 0x7f1754103f80 2024-07-24T21:57:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f175ab24640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1754112750 con 0x7f175410cac0 2024-07-24T21:57:51.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f17588c0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754103660 0x7f1754198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:51.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f17588c0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754103660 0x7f1754198c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52546/0 (socket says 172.21.15.47:52546) 2024-07-24T21:57:51.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f17588c0640 1 -- 172.21.15.47:0/397409702 learned_addr learned my addr 172.21.15.47:0/397409702 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:57:51.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f17590c1640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f175410cac0 0x7f175419e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:51.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f1753fff640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1754103f80 0x7f1754199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:51.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f17588c0640 1 -- 172.21.15.47:0/397409702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f175410cac0 msgr2=0x7f175419e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:51.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f17588c0640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f175410cac0 0x7f175419e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f17588c0640 1 -- 172.21.15.47:0/397409702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1754103f80 msgr2=0x7f1754199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:51.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f17588c0640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1754103f80 0x7f1754199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f17588c0640 1 -- 172.21.15.47:0/397409702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175419ecd0 con 0x7f1754103660 2024-07-24T21:57:51.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f1753fff640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1754103f80 0x7f1754199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T21:57:51.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f17588c0640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754103660 0x7f1754198c20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f174800e9f0 tx=0x7f174800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:51.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f1751ffb640 1 -- 172.21.15.47:0/397409702 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174800cd80 con 0x7f1754103660 2024-07-24T21:57:51.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f1751ffb640 1 -- 172.21.15.47:0/397409702 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f17480054b0 con 0x7f1754103660 2024-07-24T21:57:51.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f1751ffb640 1 -- 172.21.15.47:0/397409702 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748010430 con 0x7f1754103660 2024-07-24T21:57:51.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.658+0000 7f175ab24640 1 -- 172.21.15.47:0/397409702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175419efc0 con 0x7f1754103660 2024-07-24T21:57:51.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.659+0000 7f175ab24640 1 -- 172.21.15.47:0/397409702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17541a5680 con 0x7f1754103660 2024-07-24T21:57:51.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.660+0000 7f175ab24640 1 -- 172.21.15.47:0/397409702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1754103a40 con 0x7f1754103660 2024-07-24T21:57:51.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.661+0000 7f1751ffb640 1 -- 172.21.15.47:0/397409702 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f17480046c0 con 0x7f1754103660 2024-07-24T21:57:51.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.661+0000 7f1751ffb640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17440b3b90 0x7f17440b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:51.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.662+0000 7f1753fff640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17440b3b90 0x7f17440b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:51.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.662+0000 7f1751ffb640 1 -- 172.21.15.47:0/397409702 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f17480e2500 con 0x7f1754103660 2024-07-24T21:57:51.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.662+0000 7f1753fff640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17440b3b90 0x7f17440b6050 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1740005ab0 tx=0x7f1740032d00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:51.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.666+0000 7f1751ffb640 1 -- 172.21.15.47:0/397409702 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f17480ab750 con 0x7f1754103660 2024-07-24T21:57:51.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.863+0000 7f175ab24640 1 -- 172.21.15.47:0/397409702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f175402e000 con 0x7f1754103660 2024-07-24T21:57:51.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.867+0000 7f1751ffb640 1 -- 172.21.15.47:0/397409702 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f17480ab050 con 0x7f1754103660 2024-07-24T21:57:51.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.869+0000 7f175ab24640 1 -- 172.21.15.47:0/397409702 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17440b3b90 msgr2=0x7f17440b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:51.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.869+0000 7f175ab24640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17440b3b90 0x7f17440b6050 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1740005ab0 tx=0x7f1740032d00 comp rx=0 tx=0).stop 2024-07-24T21:57:51.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.869+0000 7f175ab24640 1 -- 172.21.15.47:0/397409702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754103660 msgr2=0x7f1754198c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:51.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.869+0000 7f175ab24640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754103660 0x7f1754198c20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f174800e9f0 tx=0x7f174800edf0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.869+0000 7f175ab24640 1 -- 172.21.15.47:0/397409702 shutdown_connections 2024-07-24T21:57:51.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.869+0000 7f175ab24640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17440b3b90 0x7f17440b6050 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.869+0000 7f175ab24640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f175410cac0 0x7f175419e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.869+0000 7f175ab24640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1754103f80 0x7f1754199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.869+0000 7f175ab24640 1 --2- 172.21.15.47:0/397409702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754103660 0x7f1754198c20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:51.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.869+0000 7f175ab24640 1 -- 172.21.15.47:0/397409702 >> 172.21.15.47:0/397409702 conn(0x7f17540fd0c0 msgr2=0x7f17540fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:51.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.869+0000 7f175ab24640 1 -- 172.21.15.47:0/397409702 shutdown_connections 2024-07-24T21:57:51.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:51.869+0000 7f175ab24640 1 -- 172.21.15.47:0/397409702 wait complete. 2024-07-24T21:57:52.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:52 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/397409702' entity='client.admin' 2024-07-24T21:57:52.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:52 smithi047 ceph-mon[32551]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:53.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:52 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/397409702' entity='client.admin' 2024-07-24T21:57:53.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:52 smithi183 ceph-mon[37007]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:53.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:52 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/397409702' entity='client.admin' 2024-07-24T21:57:53.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:52 smithi188 ceph-mon[37380]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:55.163 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:55 smithi047 ceph-mon[32551]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:55.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:55 smithi183 ceph-mon[37007]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:55.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.497+0000 7fa768456640 1 -- 172.21.15.47:0/531483280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa760103570 msgr2=0x7fa760103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:55.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.497+0000 7fa768456640 1 --2- 172.21.15.47:0/531483280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa760103570 0x7fa760103950 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009900 tx=0x7fa75c02a410 comp rx=0 tx=0).stop 2024-07-24T21:57:55.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.497+0000 7fa768456640 1 -- 172.21.15.47:0/531483280 shutdown_connections 2024-07-24T21:57:55.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.497+0000 7fa768456640 1 --2- 172.21.15.47:0/531483280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa76010cb20 0x7fa76010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:55.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.498+0000 7fa768456640 1 --2- 172.21.15.47:0/531483280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa760103f70 0x7fa76010c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:55.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.498+0000 7fa768456640 1 --2- 172.21.15.47:0/531483280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa760103570 0x7fa760103950 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:55.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.498+0000 7fa768456640 1 -- 172.21.15.47:0/531483280 >> 172.21.15.47:0/531483280 conn(0x7fa7600fd100 msgr2=0x7fa7600ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.498+0000 7fa768456640 1 -- 172.21.15.47:0/531483280 shutdown_connections 2024-07-24T21:57:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.498+0000 7fa768456640 1 -- 172.21.15.47:0/531483280 wait complete. 2024-07-24T21:57:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.498+0000 7fa768456640 1 Processor -- start 2024-07-24T21:57:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.498+0000 7fa768456640 1 -- start start 2024-07-24T21:57:55.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa768456640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa760103570 0x7fa760198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:55.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa768456640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa760103f70 0x7fa760199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:55.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa768456640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa76010cb20 0x7fa76019e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:55.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa768456640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa760112620 con 0x7fa760103f70 2024-07-24T21:57:55.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa768456640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa7601124a0 con 0x7fa76010cb20 2024-07-24T21:57:55.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa768456640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa7601127a0 con 0x7fa760103570 2024-07-24T21:57:55.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7659f1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa760103f70 0x7fa760199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:55.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7659f1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa760103f70 0x7fa760199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47168/0 (socket says 172.21.15.47:47168) 2024-07-24T21:57:55.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7659f1640 1 -- 172.21.15.47:0/483667348 learned_addr learned my addr 172.21.15.47:0/483667348 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:57:55.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7669f3640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa76010cb20 0x7fa76019e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:55.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7661f2640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa760103570 0x7fa760198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:55.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7659f1640 1 -- 172.21.15.47:0/483667348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa760103570 msgr2=0x7fa760198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:55.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7659f1640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa760103570 0x7fa760198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:55.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7659f1640 1 -- 172.21.15.47:0/483667348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa76010cb20 msgr2=0x7fa76019e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:55.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7659f1640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa76010cb20 0x7fa76019e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:55.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7659f1640 1 -- 172.21.15.47:0/483667348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76019eca0 con 0x7fa760103f70 2024-07-24T21:57:55.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7661f2640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa760103570 0x7fa760198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T21:57:55.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7659f1640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa760103f70 0x7fa760199130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa75000c970 tx=0x7fa75000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:55.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7577fe640 1 -- 172.21.15.47:0/483667348 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750007bb0 con 0x7fa760103f70 2024-07-24T21:57:55.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa768456640 1 -- 172.21.15.47:0/483667348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76019ef90 con 0x7fa760103f70 2024-07-24T21:57:55.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.499+0000 7fa7577fe640 1 -- 172.21.15.47:0/483667348 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa750007d50 con 0x7fa760103f70 2024-07-24T21:57:55.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.500+0000 7fa7577fe640 1 -- 172.21.15.47:0/483667348 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750004e50 con 0x7fa760103f70 2024-07-24T21:57:55.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.500+0000 7fa768456640 1 -- 172.21.15.47:0/483667348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7601a5650 con 0x7fa760103f70 2024-07-24T21:57:55.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.500+0000 7fa768456640 1 -- 172.21.15.47:0/483667348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa760103950 con 0x7fa760103f70 2024-07-24T21:57:55.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.502+0000 7fa7577fe640 1 -- 172.21.15.47:0/483667348 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fa750005000 con 0x7fa760103f70 2024-07-24T21:57:55.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.503+0000 7fa7577fe640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa74c0b3d30 0x7fa74c0b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:55.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.503+0000 7fa7661f2640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa74c0b3d30 0x7fa74c0b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:55.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.503+0000 7fa7577fe640 1 -- 172.21.15.47:0/483667348 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa7500e2160 con 0x7fa760103f70 2024-07-24T21:57:55.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.503+0000 7fa7661f2640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa74c0b3d30 0x7fa74c0b61f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa75c005ab0 tx=0x7fa75c005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:55.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.505+0000 7fa7577fe640 1 -- 172.21.15.47:0/483667348 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fa750014030 con 0x7fa760103f70 2024-07-24T21:57:55.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:55 smithi188 ceph-mon[37380]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:55.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.711+0000 7fa768456640 1 -- 172.21.15.47:0/483667348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fa760199d20 con 0x7fa760103f70 2024-07-24T21:57:55.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.715+0000 7fa7577fe640 1 -- 172.21.15.47:0/483667348 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v17)=0 v17) ==== 116+0+0 (secure 0 0 0) 0x7fa760199d20 con 0x7fa760103f70 2024-07-24T21:57:55.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.718+0000 7fa768456640 1 -- 172.21.15.47:0/483667348 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa74c0b3d30 msgr2=0x7fa74c0b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:55.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.718+0000 7fa768456640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa74c0b3d30 0x7fa74c0b61f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa75c005ab0 tx=0x7fa75c005a20 comp rx=0 tx=0).stop 2024-07-24T21:57:55.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.718+0000 7fa768456640 1 -- 172.21.15.47:0/483667348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa760103f70 msgr2=0x7fa760199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:55.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.718+0000 7fa768456640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa760103f70 0x7fa760199130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa75000c970 tx=0x7fa75000ce30 comp rx=0 tx=0).stop 2024-07-24T21:57:55.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.718+0000 7fa768456640 1 -- 172.21.15.47:0/483667348 shutdown_connections 2024-07-24T21:57:55.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.718+0000 7fa768456640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa74c0b3d30 0x7fa74c0b61f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:55.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.718+0000 7fa768456640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa76010cb20 0x7fa76019e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:55.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.718+0000 7fa768456640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa760103f70 0x7fa760199130 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:55.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.718+0000 7fa768456640 1 --2- 172.21.15.47:0/483667348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa760103570 0x7fa760198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:55.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.718+0000 7fa768456640 1 -- 172.21.15.47:0/483667348 >> 172.21.15.47:0/483667348 conn(0x7fa7600fd100 msgr2=0x7fa7600fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:55.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.718+0000 7fa768456640 1 -- 172.21.15.47:0/483667348 shutdown_connections 2024-07-24T21:57:55.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:55.718+0000 7fa768456640 1 -- 172.21.15.47:0/483667348 wait complete. 2024-07-24T21:57:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.206+0000 7f9aefca8640 1 -- 172.21.15.47:0/3802511633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ae8101690 msgr2=0x7f9ae8101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.206+0000 7f9aefca8640 1 --2- 172.21.15.47:0/3802511633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ae8101690 0x7f9ae8101a70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4009900 tx=0x7f9ae402a410 comp rx=0 tx=0).stop 2024-07-24T21:57:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.206+0000 7f9aefca8640 1 -- 172.21.15.47:0/3802511633 shutdown_connections 2024-07-24T21:57:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.206+0000 7f9aefca8640 1 --2- 172.21.15.47:0/3802511633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ae8107a20 0x7f9ae810e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.206+0000 7f9aefca8640 1 --2- 172.21.15.47:0/3802511633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ae81070a0 0x7f9ae81074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.206+0000 7f9aefca8640 1 --2- 172.21.15.47:0/3802511633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ae8101690 0x7f9ae8101a70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.206+0000 7f9aefca8640 1 -- 172.21.15.47:0/3802511633 >> 172.21.15.47:0/3802511633 conn(0x7f9ae80fd100 msgr2=0x7f9ae80ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.206+0000 7f9aefca8640 1 -- 172.21.15.47:0/3802511633 shutdown_connections 2024-07-24T21:57:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.206+0000 7f9aefca8640 1 -- 172.21.15.47:0/3802511633 wait complete. 2024-07-24T21:57:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.207+0000 7f9aefca8640 1 Processor -- start 2024-07-24T21:57:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.207+0000 7f9aefca8640 1 -- start start 2024-07-24T21:57:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.207+0000 7f9aefca8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ae8101690 0x7f9ae80ff0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.207+0000 7f9aefca8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ae81070a0 0x7f9ae80fd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.207+0000 7f9aefca8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ae8107a20 0x7f9ae80fdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.207+0000 7f9aefca8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae8111560 con 0x7f9ae8101690 2024-07-24T21:57:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.207+0000 7f9aefca8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae81113e0 con 0x7f9ae8107a20 2024-07-24T21:57:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.207+0000 7f9aefca8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae81116e0 con 0x7f9ae81070a0 2024-07-24T21:57:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.207+0000 7f9aeda44640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ae8101690 0x7f9ae80ff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.207+0000 7f9aeda44640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ae8101690 0x7f9ae80ff0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47186/0 (socket says 172.21.15.47:47186) 2024-07-24T21:57:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.207+0000 7f9aeda44640 1 -- 172.21.15.47:0/2345301899 learned_addr learned my addr 172.21.15.47:0/2345301899 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:57:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.207+0000 7f9aed243640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ae81070a0 0x7f9ae80fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.207+0000 7f9aee245640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ae8107a20 0x7f9ae80fdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.208+0000 7f9aeda44640 1 -- 172.21.15.47:0/2345301899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ae81070a0 msgr2=0x7f9ae80fd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.208+0000 7f9aeda44640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ae81070a0 0x7f9ae80fd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.208+0000 7f9aeda44640 1 -- 172.21.15.47:0/2345301899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ae8107a20 msgr2=0x7f9ae80fdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:56.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.208+0000 7f9aeda44640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ae8107a20 0x7f9ae80fdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.208+0000 7f9aeda44640 1 -- 172.21.15.47:0/2345301899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae81ab470 con 0x7f9ae8101690 2024-07-24T21:57:56.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.208+0000 7f9aed243640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ae81070a0 0x7f9ae80fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T21:57:56.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.208+0000 7f9aeda44640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ae8101690 0x7f9ae80ff0b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4006010 tx=0x7f9ae4003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:56.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.208+0000 7f9adeffd640 1 -- 172.21.15.47:0/2345301899 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae403f070 con 0x7f9ae8101690 2024-07-24T21:57:56.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.208+0000 7f9aefca8640 1 -- 172.21.15.47:0/2345301899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae81ab640 con 0x7f9ae8101690 2024-07-24T21:57:56.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.208+0000 7f9adeffd640 1 -- 172.21.15.47:0/2345301899 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9ae403bd00 con 0x7f9ae8101690 2024-07-24T21:57:56.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.208+0000 7f9adeffd640 1 -- 172.21.15.47:0/2345301899 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4035030 con 0x7f9ae8101690 2024-07-24T21:57:56.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.208+0000 7f9aefca8640 1 -- 172.21.15.47:0/2345301899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae81aba90 con 0x7f9ae8101690 2024-07-24T21:57:56.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.209+0000 7f9aefca8640 1 -- 172.21.15.47:0/2345301899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae8101a70 con 0x7f9ae8101690 2024-07-24T21:57:56.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.211+0000 7f9adeffd640 1 -- 172.21.15.47:0/2345301899 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f9ae4042070 con 0x7f9ae8101690 2024-07-24T21:57:56.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.211+0000 7f9adeffd640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9ad40b3b90 0x7f9ad40b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:56.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.212+0000 7f9aed243640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9ad40b3b90 0x7f9ad40b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:56.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.212+0000 7f9adeffd640 1 -- 172.21.15.47:0/2345301899 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9ae4102860 con 0x7f9ae8101690 2024-07-24T21:57:56.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.212+0000 7f9aed243640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9ad40b3b90 0x7f9ad40b6050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9ae819c9e0 tx=0x7f9ad800a250 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:56.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.215+0000 7f9adeffd640 1 -- 172.21.15.47:0/2345301899 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f9ae40cb460 con 0x7f9ae8101690 2024-07-24T21:57:56.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.391+0000 7fb0fa56e640 1 -- 172.21.15.47:0/1655724859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f4103f80 msgr2=0x7fb0f410c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:56.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.391+0000 7fb0fa56e640 1 --2- 172.21.15.47:0/1655724859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f4103f80 0x7fb0f410c470 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009900 tx=0x7fb0dc02a410 comp rx=0 tx=0).stop 2024-07-24T21:57:56.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.392+0000 7fb0fa56e640 1 -- 172.21.15.47:0/1655724859 shutdown_connections 2024-07-24T21:57:56.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.392+0000 7fb0fa56e640 1 --2- 172.21.15.47:0/1655724859 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0f410cac0 0x7fb0f410ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.392+0000 7fb0fa56e640 1 --2- 172.21.15.47:0/1655724859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f4103f80 0x7fb0f410c470 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.392+0000 7fb0fa56e640 1 --2- 172.21.15.47:0/1655724859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0f4103660 0x7fb0f4103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.392+0000 7fb0fa56e640 1 -- 172.21.15.47:0/1655724859 >> 172.21.15.47:0/1655724859 conn(0x7fb0f40fd0c0 msgr2=0x7fb0f40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:56.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.392+0000 7fb0fa56e640 1 -- 172.21.15.47:0/1655724859 shutdown_connections 2024-07-24T21:57:56.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.392+0000 7fb0fa56e640 1 -- 172.21.15.47:0/1655724859 wait complete. 2024-07-24T21:57:56.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.393+0000 7fb0fa56e640 1 Processor -- start 2024-07-24T21:57:56.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.393+0000 7fb0fa56e640 1 -- start start 2024-07-24T21:57:56.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.393+0000 7fb0fa56e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0f4103660 0x7fb0f4198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:56.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.393+0000 7fb0fa56e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f410cac0 0x7fb0f41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:56.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.393+0000 7fb0fa56e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0f419e690 0x7fb0f419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:56.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.393+0000 7fb0fa56e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f4112610 con 0x7fb0f410cac0 2024-07-24T21:57:56.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.393+0000 7fb0fa56e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f4112490 con 0x7fb0f4103660 2024-07-24T21:57:56.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.393+0000 7fb0fa56e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f4112790 con 0x7fb0f419e690 2024-07-24T21:57:56.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.393+0000 7fb0ebfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f410cac0 0x7fb0f41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:56.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.393+0000 7fb0ebfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f410cac0 0x7fb0f41992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47204/0 (socket says 172.21.15.47:47204) 2024-07-24T21:57:56.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.393+0000 7fb0ebfff640 1 -- 172.21.15.47:0/37342665 learned_addr learned my addr 172.21.15.47:0/37342665 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:57:56.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.394+0000 7fb0f8b0b640 1 --2- 172.21.15.47:0/37342665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0f419e690 0x7fb0f419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:56.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.394+0000 7fb0ebfff640 1 -- 172.21.15.47:0/37342665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0f419e690 msgr2=0x7fb0f419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:56.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.394+0000 7fb0ebfff640 1 --2- 172.21.15.47:0/37342665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0f419e690 0x7fb0f419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.394+0000 7fb0ebfff640 1 -- 172.21.15.47:0/37342665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0f4103660 msgr2=0x7fb0f4198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:56.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.394+0000 7fb0ebfff640 1 --2- 172.21.15.47:0/37342665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0f4103660 0x7fb0f4198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.394+0000 7fb0ebfff640 1 -- 172.21.15.47:0/37342665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f419f220 con 0x7fb0f410cac0 2024-07-24T21:57:56.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.394+0000 7fb0ebfff640 1 --2- 172.21.15.47:0/37342665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f410cac0 0x7fb0f41992f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc02aa00 tx=0x7fb0dc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:56.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.395+0000 7fb0f1ffb640 1 -- 172.21.15.47:0/37342665 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc03f020 con 0x7fb0f410cac0 2024-07-24T21:57:56.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.395+0000 7fb0fa56e640 1 -- 172.21.15.47:0/37342665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f419f4b0 con 0x7fb0f410cac0 2024-07-24T21:57:56.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.395+0000 7fb0fa56e640 1 -- 172.21.15.47:0/37342665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f41a5af0 con 0x7fb0f410cac0 2024-07-24T21:57:56.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.395+0000 7fb0f1ffb640 1 -- 172.21.15.47:0/37342665 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb0dc03bb00 con 0x7fb0f410cac0 2024-07-24T21:57:56.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.395+0000 7fb0f1ffb640 1 -- 172.21.15.47:0/37342665 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc035070 con 0x7fb0f410cac0 2024-07-24T21:57:56.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.398+0000 7fb0fa56e640 1 -- 172.21.15.47:0/37342665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d40052c0 con 0x7fb0f410cac0 2024-07-24T21:57:56.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.398+0000 7fb0f1ffb640 1 -- 172.21.15.47:0/37342665 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fb0dc042020 con 0x7fb0f410cac0 2024-07-24T21:57:56.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.399+0000 7fb0f1ffb640 1 --2- 172.21.15.47:0/37342665 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb0e00b3c10 0x7fb0e00b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:56.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.399+0000 7fb0f3fff640 1 --2- 172.21.15.47:0/37342665 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb0e00b3c10 0x7fb0e00b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:56.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.400+0000 7fb0f1ffb640 1 -- 172.21.15.47:0/37342665 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb0dc1026b0 con 0x7fb0f410cac0 2024-07-24T21:57:56.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.400+0000 7fb0f3fff640 1 --2- 172.21.15.47:0/37342665 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb0e00b3c10 0x7fb0e00b60d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4005fd0 tx=0x7fb0e4005850 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:56.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.404+0000 7fb0f1ffb640 1 -- 172.21.15.47:0/37342665 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fb0dc049020 con 0x7fb0f410cac0 2024-07-24T21:57:56.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.418+0000 7f9aefca8640 1 -- 172.21.15.47:0/2345301899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f9ae802e000 con 0x7f9ae8101690 2024-07-24T21:57:56.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.422+0000 7f9adeffd640 1 -- 172.21.15.47:0/2345301899 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v18)=0 v18) ==== 115+0+0 (secure 0 0 0) 0x7f9ae40cf9b0 con 0x7f9ae8101690 2024-07-24T21:57:56.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.424+0000 7f9aefca8640 1 -- 172.21.15.47:0/2345301899 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9ad40b3b90 msgr2=0x7f9ad40b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:56.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.424+0000 7f9aefca8640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9ad40b3b90 0x7f9ad40b6050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9ae819c9e0 tx=0x7f9ad800a250 comp rx=0 tx=0).stop 2024-07-24T21:57:56.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.424+0000 7f9aefca8640 1 -- 172.21.15.47:0/2345301899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ae8101690 msgr2=0x7f9ae80ff0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:56.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.424+0000 7f9aefca8640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ae8101690 0x7f9ae80ff0b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4006010 tx=0x7f9ae4003d50 comp rx=0 tx=0).stop 2024-07-24T21:57:56.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.424+0000 7f9aefca8640 1 -- 172.21.15.47:0/2345301899 shutdown_connections 2024-07-24T21:57:56.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.424+0000 7f9aefca8640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9ad40b3b90 0x7f9ad40b6050 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.424+0000 7f9aefca8640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ae8107a20 0x7f9ae80fdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.424+0000 7f9aefca8640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ae81070a0 0x7f9ae80fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.424+0000 7f9aefca8640 1 --2- 172.21.15.47:0/2345301899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ae8101690 0x7f9ae80ff0b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.424+0000 7f9aefca8640 1 -- 172.21.15.47:0/2345301899 >> 172.21.15.47:0/2345301899 conn(0x7f9ae80fd100 msgr2=0x7f9ae806b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:56.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.424+0000 7f9aefca8640 1 -- 172.21.15.47:0/2345301899 shutdown_connections 2024-07-24T21:57:56.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.424+0000 7f9aefca8640 1 -- 172.21.15.47:0/2345301899 wait complete. 2024-07-24T21:57:56.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.605+0000 7fb0fa56e640 1 -- 172.21.15.47:0/37342665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7fb0d40055b0 con 0x7fb0f410cac0 2024-07-24T21:57:56.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.608+0000 7fb0f1ffb640 1 -- 172.21.15.47:0/37342665 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v19)=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7fb0dc0cb900 con 0x7fb0f410cac0 2024-07-24T21:57:56.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.611+0000 7fb0fa56e640 1 -- 172.21.15.47:0/37342665 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb0e00b3c10 msgr2=0x7fb0e00b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:56.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.611+0000 7fb0fa56e640 1 --2- 172.21.15.47:0/37342665 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb0e00b3c10 0x7fb0e00b60d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4005fd0 tx=0x7fb0e4005850 comp rx=0 tx=0).stop 2024-07-24T21:57:56.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.611+0000 7fb0fa56e640 1 -- 172.21.15.47:0/37342665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f410cac0 msgr2=0x7fb0f41992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:56.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.611+0000 7fb0fa56e640 1 --2- 172.21.15.47:0/37342665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f410cac0 0x7fb0f41992f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc02aa00 tx=0x7fb0dc003c10 comp rx=0 tx=0).stop 2024-07-24T21:57:56.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.611+0000 7fb0fa56e640 1 -- 172.21.15.47:0/37342665 shutdown_connections 2024-07-24T21:57:56.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.611+0000 7fb0fa56e640 1 --2- 172.21.15.47:0/37342665 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb0e00b3c10 0x7fb0e00b60d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.611+0000 7fb0fa56e640 1 --2- 172.21.15.47:0/37342665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0f419e690 0x7fb0f419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.611+0000 7fb0fa56e640 1 --2- 172.21.15.47:0/37342665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f410cac0 0x7fb0f41992f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.611+0000 7fb0fa56e640 1 --2- 172.21.15.47:0/37342665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0f4103660 0x7fb0f4198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:56.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.611+0000 7fb0fa56e640 1 -- 172.21.15.47:0/37342665 >> 172.21.15.47:0/37342665 conn(0x7fb0f40fd0c0 msgr2=0x7fb0f40fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:56.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.611+0000 7fb0fa56e640 1 -- 172.21.15.47:0/37342665 shutdown_connections 2024-07-24T21:57:56.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:56.611+0000 7fb0fa56e640 1 -- 172.21.15.47:0/37342665 wait complete. 2024-07-24T21:57:56.929 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:56 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/483667348' entity='client.admin' 2024-07-24T21:57:56.929 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:56 smithi047 ceph-mon[32551]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:56.929 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:56 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2345301899' entity='client.admin' 2024-07-24T21:57:56.930 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:56 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/37342665' entity='client.admin' 2024-07-24T21:57:56.930 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:56 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:56.930 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:56 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:56.930 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:56 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:56.930 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:56 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:57.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:56 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/483667348' entity='client.admin' 2024-07-24T21:57:57.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:56 smithi188 ceph-mon[37380]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:57.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:56 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2345301899' entity='client.admin' 2024-07-24T21:57:57.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:56 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/37342665' entity='client.admin' 2024-07-24T21:57:57.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:56 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:57.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:56 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:57.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:56 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:57.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:56 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:57.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:56 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/483667348' entity='client.admin' 2024-07-24T21:57:57.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:56 smithi183 ceph-mon[37007]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:57.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:56 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2345301899' entity='client.admin' 2024-07-24T21:57:57.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:56 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/37342665' entity='client.admin' 2024-07-24T21:57:57.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:56 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:57:57.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:56 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:57:57.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:56 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:57:57.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:56 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:57:59.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.449+0000 7ffbec4d1640 1 -- 172.21.15.47:0/1756001694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe410caa0 msgr2=0x7ffbe410ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:59.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.449+0000 7ffbec4d1640 1 --2- 172.21.15.47:0/1756001694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe410caa0 0x7ffbe410ef10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc009ca0 tx=0x7ffbdc02a8c0 comp rx=0 tx=0).stop 2024-07-24T21:57:59.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.449+0000 7ffbec4d1640 1 -- 172.21.15.47:0/1756001694 shutdown_connections 2024-07-24T21:57:59.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.449+0000 7ffbec4d1640 1 --2- 172.21.15.47:0/1756001694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe410caa0 0x7ffbe410ef10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:59.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.449+0000 7ffbec4d1640 1 --2- 172.21.15.47:0/1756001694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbe4103ef0 0x7ffbe410c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:59.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.449+0000 7ffbec4d1640 1 --2- 172.21.15.47:0/1756001694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbe41034f0 0x7ffbe41038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:59.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.449+0000 7ffbec4d1640 1 -- 172.21.15.47:0/1756001694 >> 172.21.15.47:0/1756001694 conn(0x7ffbe40fd0c0 msgr2=0x7ffbe40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:59.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.450+0000 7ffbec4d1640 1 -- 172.21.15.47:0/1756001694 shutdown_connections 2024-07-24T21:57:59.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.450+0000 7ffbec4d1640 1 -- 172.21.15.47:0/1756001694 wait complete. 2024-07-24T21:57:59.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.450+0000 7ffbec4d1640 1 Processor -- start 2024-07-24T21:57:59.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.450+0000 7ffbec4d1640 1 -- start start 2024-07-24T21:57:59.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.450+0000 7ffbec4d1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbe41034f0 0x7ffbe4198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:59.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.450+0000 7ffbec4d1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbe4103ef0 0x7ffbe4198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:59.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.450+0000 7ffbec4d1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe410caa0 0x7ffbe419e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:59.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.450+0000 7ffbec4d1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe41125d0 con 0x7ffbe410caa0 2024-07-24T21:57:59.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.450+0000 7ffbec4d1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe4112450 con 0x7ffbe4103ef0 2024-07-24T21:57:59.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.450+0000 7ffbec4d1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe4112750 con 0x7ffbe41034f0 2024-07-24T21:57:59.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.450+0000 7ffbeaa6e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe410caa0 0x7ffbe419e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:59.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.450+0000 7ffbeaa6e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe410caa0 0x7ffbe419e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47226/0 (socket says 172.21.15.47:47226) 2024-07-24T21:57:59.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbeaa6e640 1 -- 172.21.15.47:0/411070536 learned_addr learned my addr 172.21.15.47:0/411070536 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:57:59.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbea26d640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbe41034f0 0x7ffbe4198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:59.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbe9a6c640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbe4103ef0 0x7ffbe4198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:59.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbeaa6e640 1 -- 172.21.15.47:0/411070536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbe41034f0 msgr2=0x7ffbe4198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbeaa6e640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbe41034f0 0x7ffbe4198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbeaa6e640 1 -- 172.21.15.47:0/411070536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbe4103ef0 msgr2=0x7ffbe4198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbeaa6e640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbe4103ef0 0x7ffbe4198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbeaa6e640 1 -- 172.21.15.47:0/411070536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe419eb50 con 0x7ffbe410caa0 2024-07-24T21:57:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbeaa6e640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe410caa0 0x7ffbe419e380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc031040 tx=0x7ffbdc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbdb7fe640 1 -- 172.21.15.47:0/411070536 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc003ce0 con 0x7ffbe410caa0 2024-07-24T21:57:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbdb7fe640 1 -- 172.21.15.47:0/411070536 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ffbdc0044d0 con 0x7ffbe410caa0 2024-07-24T21:57:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbec4d1640 1 -- 172.21.15.47:0/411070536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe419ede0 con 0x7ffbe410caa0 2024-07-24T21:57:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbdb7fe640 1 -- 172.21.15.47:0/411070536 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc030b60 con 0x7ffbe410caa0 2024-07-24T21:57:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.451+0000 7ffbec4d1640 1 -- 172.21.15.47:0/411070536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe41a5500 con 0x7ffbe410caa0 2024-07-24T21:57:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.452+0000 7ffbec4d1640 1 -- 172.21.15.47:0/411070536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe41038d0 con 0x7ffbe410caa0 2024-07-24T21:57:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.454+0000 7ffbdb7fe640 1 -- 172.21.15.47:0/411070536 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7ffbdc030d00 con 0x7ffbe410caa0 2024-07-24T21:57:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.454+0000 7ffbdb7fe640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffbd00b3b90 0x7ffbd00b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:57:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.455+0000 7ffbea26d640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffbd00b3b90 0x7ffbd00b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:57:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.455+0000 7ffbdb7fe640 1 -- 172.21.15.47:0/411070536 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ffbdc1036c0 con 0x7ffbe410caa0 2024-07-24T21:57:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.455+0000 7ffbea26d640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffbd00b3b90 0x7ffbd00b6050 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0005e10 tx=0x7ffbe0005da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:57:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.457+0000 7ffbdb7fe640 1 -- 172.21.15.47:0/411070536 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7ffbdc0cc910 con 0x7ffbe410caa0 2024-07-24T21:57:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.653+0000 7ffbec4d1640 1 -- 172.21.15.47:0/411070536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7ffbe4199bd0 con 0x7ffbe410caa0 2024-07-24T21:57:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.657+0000 7ffbdb7fe640 1 -- 172.21.15.47:0/411070536 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7ffbdc0098b0 con 0x7ffbe410caa0 2024-07-24T21:57:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.659+0000 7ffbec4d1640 1 -- 172.21.15.47:0/411070536 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffbd00b3b90 msgr2=0x7ffbd00b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.659+0000 7ffbec4d1640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffbd00b3b90 0x7ffbd00b6050 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0005e10 tx=0x7ffbe0005da0 comp rx=0 tx=0).stop 2024-07-24T21:57:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.659+0000 7ffbec4d1640 1 -- 172.21.15.47:0/411070536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe410caa0 msgr2=0x7ffbe419e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:57:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.659+0000 7ffbec4d1640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe410caa0 0x7ffbe419e380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc031040 tx=0x7ffbdc003970 comp rx=0 tx=0).stop 2024-07-24T21:57:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.659+0000 7ffbec4d1640 1 -- 172.21.15.47:0/411070536 shutdown_connections 2024-07-24T21:57:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.659+0000 7ffbec4d1640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffbd00b3b90 0x7ffbd00b6050 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.659+0000 7ffbec4d1640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe410caa0 0x7ffbe419e380 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:59.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.659+0000 7ffbec4d1640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbe4103ef0 0x7ffbe4198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:59.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.659+0000 7ffbec4d1640 1 --2- 172.21.15.47:0/411070536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbe41034f0 0x7ffbe4198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:57:59.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.659+0000 7ffbec4d1640 1 -- 172.21.15.47:0/411070536 >> 172.21.15.47:0/411070536 conn(0x7ffbe40fd0c0 msgr2=0x7ffbe40fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:57:59.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.659+0000 7ffbec4d1640 1 -- 172.21.15.47:0/411070536 shutdown_connections 2024-07-24T21:57:59.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:57:58.659+0000 7ffbec4d1640 1 -- 172.21.15.47:0/411070536 wait complete. 2024-07-24T21:57:59.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:59 smithi047 ceph-mon[32551]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:59.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:57:59 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/411070536' entity='client.admin' 2024-07-24T21:57:59.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:59 smithi183 ceph-mon[37007]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:57:59.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:57:59 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/411070536' entity='client.admin' 2024-07-24T21:58:00.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:59 smithi188 ceph-mon[37380]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:00.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:57:59 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/411070536' entity='client.admin' 2024-07-24T21:58:00.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.531+0000 7f94b6d50640 1 -- 172.21.15.47:0/2468616022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94b010ee00 msgr2=0x7f94b01111f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:00.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.531+0000 7f94b6d50640 1 --2- 172.21.15.47:0/2468616022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94b010ee00 0x7f94b01111f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009ca0 tx=0x7f94a802a950 comp rx=0 tx=0).stop 2024-07-24T21:58:00.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.532+0000 7f94b6d50640 1 -- 172.21.15.47:0/2468616022 shutdown_connections 2024-07-24T21:58:00.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.532+0000 7f94b6d50640 1 --2- 172.21.15.47:0/2468616022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94b010ee00 0x7f94b01111f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.532+0000 7f94b6d50640 1 --2- 172.21.15.47:0/2468616022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94b0101b70 0x7f94b010e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.532+0000 7f94b6d50640 1 --2- 172.21.15.47:0/2468616022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94b0101250 0x7f94b0101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.532+0000 7f94b6d50640 1 -- 172.21.15.47:0/2468616022 >> 172.21.15.47:0/2468616022 conn(0x7f94b00fd0c0 msgr2=0x7f94b00ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:00.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.532+0000 7f94b6d50640 1 -- 172.21.15.47:0/2468616022 shutdown_connections 2024-07-24T21:58:00.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.532+0000 7f94b6d50640 1 -- 172.21.15.47:0/2468616022 wait complete. 2024-07-24T21:58:00.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.532+0000 7f94b6d50640 1 Processor -- start 2024-07-24T21:58:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b6d50640 1 -- start start 2024-07-24T21:58:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b6d50640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94b0101250 0x7f94b019ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b6d50640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94b0101b70 0x7f94b019b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b6d50640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94b010ee00 0x7f94b01a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b6d50640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0114820 con 0x7f94b0101250 2024-07-24T21:58:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b6d50640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f94b01146a0 con 0x7f94b0101b70 2024-07-24T21:58:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b6d50640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f94b01149a0 con 0x7f94b010ee00 2024-07-24T21:58:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b4aec640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94b0101250 0x7f94b019ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b4aec640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94b0101250 0x7f94b019ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47280/0 (socket says 172.21.15.47:47280) 2024-07-24T21:58:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b4aec640 1 -- 172.21.15.47:0/1410273878 learned_addr learned my addr 172.21.15.47:0/1410273878 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b52ed640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94b010ee00 0x7f94b01a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:00.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94affff640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94b0101b70 0x7f94b019b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b4aec640 1 -- 172.21.15.47:0/1410273878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94b010ee00 msgr2=0x7f94b01a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b4aec640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94b010ee00 0x7f94b01a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b4aec640 1 -- 172.21.15.47:0/1410273878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94b0101b70 msgr2=0x7f94b019b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b4aec640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94b0101b70 0x7f94b019b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b4aec640 1 -- 172.21.15.47:0/1410273878 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b01a0de0 con 0x7f94b0101250 2024-07-24T21:58:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.533+0000 7f94b52ed640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94b010ee00 0x7f94b01a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T21:58:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.534+0000 7f94b4aec640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94b0101250 0x7f94b019ad30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f94a400d950 tx=0x7f94a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.534+0000 7f94adffb640 1 -- 172.21.15.47:0/1410273878 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4017070 con 0x7f94b0101250 2024-07-24T21:58:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.534+0000 7f94adffb640 1 -- 172.21.15.47:0/1410273878 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f94a4009c30 con 0x7f94b0101250 2024-07-24T21:58:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.534+0000 7f94b6d50640 1 -- 172.21.15.47:0/1410273878 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b01a10d0 con 0x7f94b0101250 2024-07-24T21:58:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.534+0000 7f94adffb640 1 -- 172.21.15.47:0/1410273878 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a400f620 con 0x7f94b0101250 2024-07-24T21:58:00.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.534+0000 7f94b6d50640 1 -- 172.21.15.47:0/1410273878 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b01a7960 con 0x7f94b0101250 2024-07-24T21:58:00.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.535+0000 7f94b6d50640 1 -- 172.21.15.47:0/1410273878 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b0101630 con 0x7f94b0101250 2024-07-24T21:58:00.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.538+0000 7f94adffb640 1 -- 172.21.15.47:0/1410273878 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f94a4010460 con 0x7f94b0101250 2024-07-24T21:58:00.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.538+0000 7f94adffb640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94a00b3c10 0x7f94a00b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:00.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.539+0000 7f94adffb640 1 -- 172.21.15.47:0/1410273878 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f94a40e1ca0 con 0x7f94b0101250 2024-07-24T21:58:00.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.539+0000 7f94affff640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94a00b3c10 0x7f94a00b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:00.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.539+0000 7f94affff640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94a00b3c10 0x7f94a00b60d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f94b0111570 tx=0x7f949c005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:00.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.546+0000 7f94adffb640 1 -- 172.21.15.47:0/1410273878 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f94a40aaef0 con 0x7f94b0101250 2024-07-24T21:58:00.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.436+0000 7f7239980640 1 -- 172.21.15.47:0/2112389249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f723410a370 msgr2=0x7f723410a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:00.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.436+0000 7f7239980640 1 --2- 172.21.15.47:0/2112389249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f723410a370 0x7f723410a7b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f721c009860 tx=0x7f721c02a340 comp rx=0 tx=0).stop 2024-07-24T21:58:00.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.436+0000 7f7239980640 1 -- 172.21.15.47:0/2112389249 shutdown_connections 2024-07-24T21:58:00.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.436+0000 7f7239980640 1 --2- 172.21.15.47:0/2112389249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f723410acf0 0x7f72341114f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.436+0000 7f7239980640 1 --2- 172.21.15.47:0/2112389249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f723410a370 0x7f723410a7b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.436+0000 7f7239980640 1 --2- 172.21.15.47:0/2112389249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7234104960 0x7f7234104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.436+0000 7f7239980640 1 -- 172.21.15.47:0/2112389249 >> 172.21.15.47:0/2112389249 conn(0x7f72341003b0 msgr2=0x7f72341027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:00.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.436+0000 7f7239980640 1 -- 172.21.15.47:0/2112389249 shutdown_connections 2024-07-24T21:58:00.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.436+0000 7f7239980640 1 -- 172.21.15.47:0/2112389249 wait complete. 2024-07-24T21:58:00.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.437+0000 7f7239980640 1 Processor -- start 2024-07-24T21:58:00.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.437+0000 7f7239980640 1 -- start start 2024-07-24T21:58:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f7239980640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234104960 0x7f723419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f7239980640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f723410a370 0x7f723419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f7239980640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f723410acf0 0x7f72341a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f7239980640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7234114820 con 0x7f7234104960 2024-07-24T21:58:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f7239980640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f72341146a0 con 0x7f723410acf0 2024-07-24T21:58:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f7239980640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f72341149a0 con 0x7f723410a370 2024-07-24T21:58:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f7232ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234104960 0x7f723419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f722bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f723410a370 0x7f723419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f722bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f723410a370 0x7f723419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:60394/0 (socket says 172.21.15.47:60394) 2024-07-24T21:58:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f722bfff640 1 -- 172.21.15.47:0/1675704530 learned_addr learned my addr 172.21.15.47:0/1675704530 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f72337fe640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f723410acf0 0x7f72341a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:00.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f722bfff640 1 -- 172.21.15.47:0/1675704530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f723410acf0 msgr2=0x7f72341a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f722bfff640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f723410acf0 0x7f72341a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f722bfff640 1 -- 172.21.15.47:0/1675704530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234104960 msgr2=0x7f723419ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f722bfff640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234104960 0x7f723419ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f722bfff640 1 -- 172.21.15.47:0/1675704530 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72341a0ec0 con 0x7f723410a370 2024-07-24T21:58:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f72337fe640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f723410acf0 0x7f72341a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T21:58:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.438+0000 7f7232ffd640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234104960 0x7f723419ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T21:58:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.439+0000 7f722bfff640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f723410a370 0x7f723419b350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f721c035040 tx=0x7f721c030d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.439+0000 7f723897e640 1 -- 172.21.15.47:0/1675704530 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c03f020 con 0x7f723410a370 2024-07-24T21:58:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.439+0000 7f723897e640 1 -- 172.21.15.47:0/1675704530 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f721c0044d0 con 0x7f723410a370 2024-07-24T21:58:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.439+0000 7f723897e640 1 -- 172.21.15.47:0/1675704530 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c037040 con 0x7f723410a370 2024-07-24T21:58:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.440+0000 7f7239980640 1 -- 172.21.15.47:0/1675704530 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72341a1150 con 0x7f723410a370 2024-07-24T21:58:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.440+0000 7f7239980640 1 -- 172.21.15.47:0/1675704530 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72341a7870 con 0x7f723410a370 2024-07-24T21:58:00.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.441+0000 7f7239980640 1 -- 172.21.15.47:0/1675704530 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7234104d40 con 0x7f723410a370 2024-07-24T21:58:00.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.442+0000 7f723897e640 1 -- 172.21.15.47:0/1675704530 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f721c042020 con 0x7f723410a370 2024-07-24T21:58:00.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.443+0000 7f723897e640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f72200b3c10 0x7f72200b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:00.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.443+0000 7f7232ffd640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f72200b3c10 0x7f72200b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:00.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.443+0000 7f723897e640 1 -- 172.21.15.47:0/1675704530 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f721c101e00 con 0x7f723410a370 2024-07-24T21:58:00.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.444+0000 7f7232ffd640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f72200b3c10 0x7f72200b60d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f722400bfd0 tx=0x7f722400b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:00.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.447+0000 7f723897e640 1 -- 172.21.15.47:0/1675704530 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f721c106070 con 0x7f723410a370 2024-07-24T21:58:00.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.673+0000 7f7239980640 1 -- 172.21.15.47:0/1675704530 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f723410cb00 con 0x7f723410a370 2024-07-24T21:58:00.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.680+0000 7f723897e640 1 -- 172.21.15.47:0/1675704530 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v22)=0 v22) ==== 116+0+0 (secure 0 0 0) 0x7f721c049020 con 0x7f723410a370 2024-07-24T21:58:00.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.682+0000 7f7239980640 1 -- 172.21.15.47:0/1675704530 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f72200b3c10 msgr2=0x7f72200b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:00.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.682+0000 7f7239980640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f72200b3c10 0x7f72200b60d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f722400bfd0 tx=0x7f722400b390 comp rx=0 tx=0).stop 2024-07-24T21:58:00.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.682+0000 7f7239980640 1 -- 172.21.15.47:0/1675704530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f723410a370 msgr2=0x7f723419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:00.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.682+0000 7f7239980640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f723410a370 0x7f723419b350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f721c035040 tx=0x7f721c030d40 comp rx=0 tx=0).stop 2024-07-24T21:58:00.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.682+0000 7f7239980640 1 -- 172.21.15.47:0/1675704530 shutdown_connections 2024-07-24T21:58:00.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.682+0000 7f7239980640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f72200b3c10 0x7f72200b60d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.682+0000 7f7239980640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f723410acf0 0x7f72341a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.682+0000 7f7239980640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f723410a370 0x7f723419b350 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.682+0000 7f7239980640 1 --2- 172.21.15.47:0/1675704530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7234104960 0x7f723419ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.682+0000 7f7239980640 1 -- 172.21.15.47:0/1675704530 >> 172.21.15.47:0/1675704530 conn(0x7f72341003b0 msgr2=0x7f72341027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:00.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.682+0000 7f7239980640 1 -- 172.21.15.47:0/1675704530 shutdown_connections 2024-07-24T21:58:00.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.682+0000 7f7239980640 1 -- 172.21.15.47:0/1675704530 wait complete. 2024-07-24T21:58:00.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.759+0000 7f94b6d50640 1 -- 172.21.15.47:0/1410273878 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f94b019be60 con 0x7f94b0101250 2024-07-24T21:58:00.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.762+0000 7f94adffb640 1 -- 172.21.15.47:0/1410273878 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v23)=0 v23) ==== 133+0+0 (secure 0 0 0) 0x7f94a4009de0 con 0x7f94b0101250 2024-07-24T21:58:00.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.765+0000 7f94b6d50640 1 -- 172.21.15.47:0/1410273878 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94a00b3c10 msgr2=0x7f94a00b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:00.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.765+0000 7f94b6d50640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94a00b3c10 0x7f94a00b60d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f94b0111570 tx=0x7f949c005f90 comp rx=0 tx=0).stop 2024-07-24T21:58:00.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.765+0000 7f94b6d50640 1 -- 172.21.15.47:0/1410273878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94b0101250 msgr2=0x7f94b019ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:00.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.765+0000 7f94b6d50640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94b0101250 0x7f94b019ad30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f94a400d950 tx=0x7f94a400de10 comp rx=0 tx=0).stop 2024-07-24T21:58:00.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.765+0000 7f94b6d50640 1 -- 172.21.15.47:0/1410273878 shutdown_connections 2024-07-24T21:58:00.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.765+0000 7f94b6d50640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94a00b3c10 0x7f94a00b60d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.765+0000 7f94b6d50640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94b010ee00 0x7f94b01a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.765+0000 7f94b6d50640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94b0101b70 0x7f94b019b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.765+0000 7f94b6d50640 1 --2- 172.21.15.47:0/1410273878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94b0101250 0x7f94b019ad30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:00.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.765+0000 7f94b6d50640 1 -- 172.21.15.47:0/1410273878 >> 172.21.15.47:0/1410273878 conn(0x7f94b00fd0c0 msgr2=0x7f94b00ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:00.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.765+0000 7f94b6d50640 1 -- 172.21.15.47:0/1410273878 shutdown_connections 2024-07-24T21:58:00.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.765+0000 7f94b6d50640 1 -- 172.21.15.47:0/1410273878 wait complete. 2024-07-24T21:58:01.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.587+0000 7f4104933640 1 -- 172.21.15.47:0/94639410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4100103ef0 msgr2=0x7f410010c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:01.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.587+0000 7f4104933640 1 --2- 172.21.15.47:0/94639410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4100103ef0 0x7f410010c4d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009900 tx=0x7f40f402a410 comp rx=0 tx=0).stop 2024-07-24T21:58:01.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.587+0000 7f4104933640 1 -- 172.21.15.47:0/94639410 shutdown_connections 2024-07-24T21:58:01.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.587+0000 7f4104933640 1 --2- 172.21.15.47:0/94639410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f410010caa0 0x7f410010ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:01.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.587+0000 7f4104933640 1 --2- 172.21.15.47:0/94639410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4100103ef0 0x7f410010c4d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:01.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.587+0000 7f4104933640 1 --2- 172.21.15.47:0/94639410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41001034f0 0x7f41001038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:01.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.587+0000 7f4104933640 1 -- 172.21.15.47:0/94639410 >> 172.21.15.47:0/94639410 conn(0x7f41000fd0c0 msgr2=0x7f41000ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:01.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.587+0000 7f4104933640 1 -- 172.21.15.47:0/94639410 shutdown_connections 2024-07-24T21:58:01.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.587+0000 7f4104933640 1 -- 172.21.15.47:0/94639410 wait complete. 2024-07-24T21:58:01.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.588+0000 7f4104933640 1 Processor -- start 2024-07-24T21:58:01.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.588+0000 7f4104933640 1 -- start start 2024-07-24T21:58:01.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.588+0000 7f4104933640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41001034f0 0x7f4100198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:01.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.588+0000 7f4104933640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4100103ef0 0x7f41001990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:01.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.588+0000 7f4104933640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410010caa0 0x7f410019e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:01.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.588+0000 7f4104933640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41001125b0 con 0x7f410010caa0 2024-07-24T21:58:01.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.588+0000 7f4104933640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4100112430 con 0x7f41001034f0 2024-07-24T21:58:01.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.588+0000 7f4104933640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4100112730 con 0x7f4100103ef0 2024-07-24T21:58:01.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f40fed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410010caa0 0x7f410019e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:01.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f40fed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410010caa0 0x7f410019e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47322/0 (socket says 172.21.15.47:47322) 2024-07-24T21:58:01.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f40fed9d640 1 -- 172.21.15.47:0/803560919 learned_addr learned my addr 172.21.15.47:0/803560919 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:01.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f40fdd9b640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4100103ef0 0x7f41001990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:01.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f40fe59c640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41001034f0 0x7f4100198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:01.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f40fed9d640 1 -- 172.21.15.47:0/803560919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4100103ef0 msgr2=0x7f41001990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:01.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f40fed9d640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4100103ef0 0x7f41001990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:01.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f40fed9d640 1 -- 172.21.15.47:0/803560919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41001034f0 msgr2=0x7f4100198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:01.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f40fed9d640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41001034f0 0x7f4100198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:01.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f40fed9d640 1 -- 172.21.15.47:0/803560919 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410019ec10 con 0x7f410010caa0 2024-07-24T21:58:01.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f40fed9d640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410010caa0 0x7f410019e440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f40f800cad0 tx=0x7f40f800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:01.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f40ef7fe640 1 -- 172.21.15.47:0/803560919 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f800ae20 con 0x7f410010caa0 2024-07-24T21:58:01.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f40ef7fe640 1 -- 172.21.15.47:0/803560919 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f40f8005020 con 0x7f410010caa0 2024-07-24T21:58:01.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f4104933640 1 -- 172.21.15.47:0/803560919 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f410019ef00 con 0x7f410010caa0 2024-07-24T21:58:01.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.589+0000 7f4104933640 1 -- 172.21.15.47:0/803560919 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41001a55c0 con 0x7f410010caa0 2024-07-24T21:58:01.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.590+0000 7f40ef7fe640 1 -- 172.21.15.47:0/803560919 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f800f6b0 con 0x7f410010caa0 2024-07-24T21:58:01.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.591+0000 7f4104933640 1 -- 172.21.15.47:0/803560919 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41001038d0 con 0x7f410010caa0 2024-07-24T21:58:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.592+0000 7f40ef7fe640 1 -- 172.21.15.47:0/803560919 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f40f8004a40 con 0x7f410010caa0 2024-07-24T21:58:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.593+0000 7f40ef7fe640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40e80b3c90 0x7f40e80b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.593+0000 7f40fe59c640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40e80b3c90 0x7f40e80b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.593+0000 7f40ef7fe640 1 -- 172.21.15.47:0/803560919 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f40f80e23d0 con 0x7f410010caa0 2024-07-24T21:58:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.593+0000 7f40fe59c640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40e80b3c90 0x7f40e80b6150 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40f00058c0 tx=0x7f40f000a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:01.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.596+0000 7f40ef7fe640 1 -- 172.21.15.47:0/803560919 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f40f8014030 con 0x7f410010caa0 2024-07-24T21:58:01.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:01 smithi047 ceph-mon[32551]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:01.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:01 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/335385822' entity='client.admin' 2024-07-24T21:58:01.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:01 smithi047 ceph-mon[32551]: from='client.? ' entity='client.admin' 2024-07-24T21:58:01.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:01 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1410273878' entity='client.admin' 2024-07-24T21:58:01.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:01.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:01.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:01.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:01.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.812+0000 7f4104933640 1 -- 172.21.15.47:0/803560919 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f410002e000 con 0x7f410010caa0 2024-07-24T21:58:01.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.824+0000 7f40ef7fe640 1 -- 172.21.15.47:0/803560919 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f40f80aafb0 con 0x7f410010caa0 2024-07-24T21:58:01.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.826+0000 7f4104933640 1 -- 172.21.15.47:0/803560919 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40e80b3c90 msgr2=0x7f40e80b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:01.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.826+0000 7f4104933640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40e80b3c90 0x7f40e80b6150 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40f00058c0 tx=0x7f40f000a2d0 comp rx=0 tx=0).stop 2024-07-24T21:58:01.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.826+0000 7f4104933640 1 -- 172.21.15.47:0/803560919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410010caa0 msgr2=0x7f410019e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:01.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.826+0000 7f4104933640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410010caa0 0x7f410019e440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f40f800cad0 tx=0x7f40f800cf90 comp rx=0 tx=0).stop 2024-07-24T21:58:01.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.826+0000 7f4104933640 1 -- 172.21.15.47:0/803560919 shutdown_connections 2024-07-24T21:58:01.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.826+0000 7f4104933640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40e80b3c90 0x7f40e80b6150 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:01.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.826+0000 7f4104933640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410010caa0 0x7f410019e440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:01.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.826+0000 7f4104933640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4100103ef0 0x7f41001990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:01.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.826+0000 7f4104933640 1 --2- 172.21.15.47:0/803560919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41001034f0 0x7f4100198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:01.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.826+0000 7f4104933640 1 -- 172.21.15.47:0/803560919 >> 172.21.15.47:0/803560919 conn(0x7f41000fd0c0 msgr2=0x7f41000fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:01.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.826+0000 7f4104933640 1 -- 172.21.15.47:0/803560919 shutdown_connections 2024-07-24T21:58:01.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.826+0000 7f4104933640 1 -- 172.21.15.47:0/803560919 wait complete. 2024-07-24T21:58:01.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:01 smithi183 ceph-mon[37007]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:01.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:01 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/335385822' entity='client.admin' 2024-07-24T21:58:01.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:01 smithi183 ceph-mon[37007]: from='client.? ' entity='client.admin' 2024-07-24T21:58:01.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:01 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1410273878' entity='client.admin' 2024-07-24T21:58:01.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:01.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:01.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:01.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:02.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:01 smithi188 ceph-mon[37380]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:02.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:01 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/335385822' entity='client.admin' 2024-07-24T21:58:02.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:01 smithi188 ceph-mon[37380]: from='client.? ' entity='client.admin' 2024-07-24T21:58:02.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:01 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1410273878' entity='client.admin' 2024-07-24T21:58:02.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:02.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:02.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:02.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:02.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.492+0000 7fbfb6952640 1 -- 172.21.15.47:0/2897834983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb0101670 msgr2=0x7fbfb0101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:02.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.492+0000 7fbfb6952640 1 --2- 172.21.15.47:0/2897834983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb0101670 0x7fbfb0101a50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009900 tx=0x7fbfa002a410 comp rx=0 tx=0).stop 2024-07-24T21:58:02.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.492+0000 7fbfb6952640 1 -- 172.21.15.47:0/2897834983 shutdown_connections 2024-07-24T21:58:02.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.492+0000 7fbfb6952640 1 --2- 172.21.15.47:0/2897834983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbfb0107a00 0x7fbfb010e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:02.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.492+0000 7fbfb6952640 1 --2- 172.21.15.47:0/2897834983 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfb0107080 0x7fbfb01074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:02.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.492+0000 7fbfb6952640 1 --2- 172.21.15.47:0/2897834983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb0101670 0x7fbfb0101a50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:02.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.493+0000 7fbfb6952640 1 -- 172.21.15.47:0/2897834983 >> 172.21.15.47:0/2897834983 conn(0x7fbfb00fd0e0 msgr2=0x7fbfb00ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:02.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.493+0000 7fbfb6952640 1 -- 172.21.15.47:0/2897834983 shutdown_connections 2024-07-24T21:58:02.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.493+0000 7fbfb6952640 1 -- 172.21.15.47:0/2897834983 wait complete. 2024-07-24T21:58:02.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.493+0000 7fbfb6952640 1 Processor -- start 2024-07-24T21:58:02.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.493+0000 7fbfb6952640 1 -- start start 2024-07-24T21:58:02.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.493+0000 7fbfb6952640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbfb0101670 0x7fbfb0198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:02.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.493+0000 7fbfb6952640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb0107080 0x7fbfb0199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:02.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.493+0000 7fbfb6952640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfb0107a00 0x7fbfb019e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:02.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.493+0000 7fbfb6952640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb0111540 con 0x7fbfb0107080 2024-07-24T21:58:02.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.493+0000 7fbfb6952640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01113c0 con 0x7fbfb0107a00 2024-07-24T21:58:02.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.493+0000 7fbfb6952640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01116c0 con 0x7fbfb0101670 2024-07-24T21:58:02.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfa7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb0107080 0x7fbfb0199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfa7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb0107080 0x7fbfb0199060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47336/0 (socket says 172.21.15.47:47336) 2024-07-24T21:58:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfa7fff640 1 -- 172.21.15.47:0/4097545860 learned_addr learned my addr 172.21.15.47:0/4097545860 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfaffff640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbfb0101670 0x7fbfb0198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfb4eef640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfb0107a00 0x7fbfb019e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfa7fff640 1 -- 172.21.15.47:0/4097545860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbfb0101670 msgr2=0x7fbfb0198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfa7fff640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbfb0101670 0x7fbfb0198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfa7fff640 1 -- 172.21.15.47:0/4097545860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfb0107a00 msgr2=0x7fbfb019e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfa7fff640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfb0107a00 0x7fbfb019e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfa7fff640 1 -- 172.21.15.47:0/4097545860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb019ebd0 con 0x7fbfb0107080 2024-07-24T21:58:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfb4eef640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfb0107a00 0x7fbfb019e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T21:58:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfa7fff640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb0107080 0x7fbfb0199060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800c920 tx=0x7fbf9800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfadffb640 1 -- 172.21.15.47:0/4097545860 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf98007c70 con 0x7fbfb0107080 2024-07-24T21:58:02.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfadffb640 1 -- 172.21.15.47:0/4097545860 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbf98007e10 con 0x7fbfb0107080 2024-07-24T21:58:02.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfb6952640 1 -- 172.21.15.47:0/4097545860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb019eec0 con 0x7fbfb0107080 2024-07-24T21:58:02.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfadffb640 1 -- 172.21.15.47:0/4097545860 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf98018720 con 0x7fbfb0107080 2024-07-24T21:58:02.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.494+0000 7fbfb6952640 1 -- 172.21.15.47:0/4097545860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb01a5580 con 0x7fbfb0107080 2024-07-24T21:58:02.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.495+0000 7fbfb6952640 1 -- 172.21.15.47:0/4097545860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb0101a50 con 0x7fbfb0107080 2024-07-24T21:58:02.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.497+0000 7fbfadffb640 1 -- 172.21.15.47:0/4097545860 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fbf9800f450 con 0x7fbfb0107080 2024-07-24T21:58:02.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.497+0000 7fbfadffb640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf9c0b3b90 0x7fbf9c0b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:02.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.498+0000 7fbfaffff640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf9c0b3b90 0x7fbf9c0b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:02.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.498+0000 7fbfadffb640 1 -- 172.21.15.47:0/4097545860 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fbf980e2480 con 0x7fbfb0107080 2024-07-24T21:58:02.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.498+0000 7fbfaffff640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf9c0b3b90 0x7fbf9c0b6050 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0000c00 tx=0x7fbfa0005e80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:02.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.500+0000 7fbfadffb640 1 -- 172.21.15.47:0/4097545860 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fbf98014030 con 0x7fbfb0107080 2024-07-24T21:58:02.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:02 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1980310259' entity='client.admin' 2024-07-24T21:58:02.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:02 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/803560919' entity='client.admin' 2024-07-24T21:58:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.703+0000 7fbfb6952640 1 -- 172.21.15.47:0/4097545860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fbfb0199c50 con 0x7fbfb0107080 2024-07-24T21:58:02.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.706+0000 7fbfadffb640 1 -- 172.21.15.47:0/4097545860 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v26)=0 v26) ==== 120+0+0 (secure 0 0 0) 0x7fbf980ab760 con 0x7fbfb0107080 2024-07-24T21:58:02.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.708+0000 7fbfb6952640 1 -- 172.21.15.47:0/4097545860 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf9c0b3b90 msgr2=0x7fbf9c0b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:02.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.708+0000 7fbfb6952640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf9c0b3b90 0x7fbf9c0b6050 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0000c00 tx=0x7fbfa0005e80 comp rx=0 tx=0).stop 2024-07-24T21:58:02.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.709+0000 7fbfb6952640 1 -- 172.21.15.47:0/4097545860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb0107080 msgr2=0x7fbfb0199060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:02.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.709+0000 7fbfb6952640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb0107080 0x7fbfb0199060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800c920 tx=0x7fbf9800cde0 comp rx=0 tx=0).stop 2024-07-24T21:58:02.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.709+0000 7fbfb6952640 1 -- 172.21.15.47:0/4097545860 shutdown_connections 2024-07-24T21:58:02.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.709+0000 7fbfb6952640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf9c0b3b90 0x7fbf9c0b6050 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:02.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.709+0000 7fbfb6952640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfb0107a00 0x7fbfb019e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:02.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.709+0000 7fbfb6952640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb0107080 0x7fbfb0199060 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:02.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.709+0000 7fbfb6952640 1 --2- 172.21.15.47:0/4097545860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbfb0101670 0x7fbfb0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:02.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.709+0000 7fbfb6952640 1 -- 172.21.15.47:0/4097545860 >> 172.21.15.47:0/4097545860 conn(0x7fbfb00fd0e0 msgr2=0x7fbfb006b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:02.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.709+0000 7fbfb6952640 1 -- 172.21.15.47:0/4097545860 shutdown_connections 2024-07-24T21:58:02.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:02.709+0000 7fbfb6952640 1 -- 172.21.15.47:0/4097545860 wait complete. 2024-07-24T21:58:02.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:02 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1980310259' entity='client.admin' 2024-07-24T21:58:02.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:02 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/803560919' entity='client.admin' 2024-07-24T21:58:03.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:02 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1980310259' entity='client.admin' 2024-07-24T21:58:03.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:02 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/803560919' entity='client.admin' 2024-07-24T21:58:03.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.804+0000 7fc7201d5640 1 -- 172.21.15.47:0/113243065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc71810ede0 msgr2=0x7fc7181111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:03.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.804+0000 7fc7201d5640 1 --2- 172.21.15.47:0/113243065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc71810ede0 0x7fc7181111d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc710009ca0 tx=0x7fc71002a950 comp rx=0 tx=0).stop 2024-07-24T21:58:03.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.804+0000 7fc7201d5640 1 -- 172.21.15.47:0/113243065 shutdown_connections 2024-07-24T21:58:03.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.804+0000 7fc7201d5640 1 --2- 172.21.15.47:0/113243065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc71810ede0 0x7fc7181111d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.804+0000 7fc7201d5640 1 --2- 172.21.15.47:0/113243065 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc718101b50 0x7fc71810e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.804+0000 7fc7201d5640 1 --2- 172.21.15.47:0/113243065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc718101230 0x7fc718101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.804+0000 7fc7201d5640 1 -- 172.21.15.47:0/113243065 >> 172.21.15.47:0/113243065 conn(0x7fc7180fd100 msgr2=0x7fc7180ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:03.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.805+0000 7fc7201d5640 1 -- 172.21.15.47:0/113243065 shutdown_connections 2024-07-24T21:58:03.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.805+0000 7fc7201d5640 1 -- 172.21.15.47:0/113243065 wait complete. 2024-07-24T21:58:03.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.805+0000 7fc7201d5640 1 Processor -- start 2024-07-24T21:58:03.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.805+0000 7fc7201d5640 1 -- start start 2024-07-24T21:58:03.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.805+0000 7fc7201d5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc718101230 0x7fc71819ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:03.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.805+0000 7fc7201d5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc718101b50 0x7fc71819b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:03.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.805+0000 7fc7201d5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc71810ede0 0x7fc7181a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:03.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.805+0000 7fc7201d5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc718114860 con 0x7fc71810ede0 2024-07-24T21:58:03.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.805+0000 7fc7201d5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181146e0 con 0x7fc718101b50 2024-07-24T21:58:03.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.805+0000 7fc7201d5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181149e0 con 0x7fc718101230 2024-07-24T21:58:03.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.805+0000 7fc71e772640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc71810ede0 0x7fc7181a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:03.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.805+0000 7fc71e772640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc71810ede0 0x7fc7181a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47350/0 (socket says 172.21.15.47:47350) 2024-07-24T21:58:03.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.805+0000 7fc71e772640 1 -- 172.21.15.47:0/1702544163 learned_addr learned my addr 172.21.15.47:0/1702544163 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:03.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc71df71640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc718101230 0x7fc71819ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:03.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc71e772640 1 -- 172.21.15.47:0/1702544163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc718101230 msgr2=0x7fc71819ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:03.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc71d770640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc718101b50 0x7fc71819b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:03.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc71e772640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc718101230 0x7fc71819ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc71e772640 1 -- 172.21.15.47:0/1702544163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc718101b50 msgr2=0x7fc71819b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:03.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc71e772640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc718101b50 0x7fc71819b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc71e772640 1 -- 172.21.15.47:0/1702544163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7181a0ec0 con 0x7fc71810ede0 2024-07-24T21:58:03.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc71df71640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc718101230 0x7fc71819ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T21:58:03.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc71d770640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc718101b50 0x7fc71819b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T21:58:03.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc71e772640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc71810ede0 0x7fc7181a06f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc71002ae70 tx=0x7fc710003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:03.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc70effd640 1 -- 172.21.15.47:0/1702544163 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710034040 con 0x7fc71810ede0 2024-07-24T21:58:03.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc7201d5640 1 -- 172.21.15.47:0/1702544163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7181a1150 con 0x7fc71810ede0 2024-07-24T21:58:03.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc70effd640 1 -- 172.21.15.47:0/1702544163 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc71002fd90 con 0x7fc71810ede0 2024-07-24T21:58:03.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc70effd640 1 -- 172.21.15.47:0/1702544163 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7100045e0 con 0x7fc71810ede0 2024-07-24T21:58:03.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.806+0000 7fc7201d5640 1 -- 172.21.15.47:0/1702544163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7181a7870 con 0x7fc71810ede0 2024-07-24T21:58:03.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.807+0000 7fc7201d5640 1 -- 172.21.15.47:0/1702544163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc718101610 con 0x7fc71810ede0 2024-07-24T21:58:03.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.809+0000 7fc70effd640 1 -- 172.21.15.47:0/1702544163 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fc710037020 con 0x7fc71810ede0 2024-07-24T21:58:03.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.810+0000 7fc70effd640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7040b3b90 0x7fc7040b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:03.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.810+0000 7fc71df71640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7040b3b90 0x7fc7040b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:03.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.810+0000 7fc70effd640 1 -- 172.21.15.47:0/1702544163 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc710103410 con 0x7fc71810ede0 2024-07-24T21:58:03.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.810+0000 7fc71df71640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7040b3b90 0x7fc7040b6050 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc714006fd0 tx=0x7fc714008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:03.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:03.813+0000 7fc70effd640 1 -- 172.21.15.47:0/1702544163 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fc7100cc660 con 0x7fc71810ede0 2024-07-24T21:58:03.893 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:03 smithi047 ceph-mon[32551]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:03.893 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:03 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/4097545860' entity='client.admin' 2024-07-24T21:58:03.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:03 smithi183 ceph-mon[37007]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:03.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:03 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/4097545860' entity='client.admin' 2024-07-24T21:58:03.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.333+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/3014877755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0cc102790 msgr2=0x7fd0cc102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:03.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.333+0000 7fd0d1ccb640 1 --2- 172.21.15.47:0/3014877755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0cc102790 0x7fd0cc102b70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009900 tx=0x7fd0bc02a410 comp rx=0 tx=0).stop 2024-07-24T21:58:03.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.333+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/3014877755 shutdown_connections 2024-07-24T21:58:03.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.333+0000 7fd0d1ccb640 1 --2- 172.21.15.47:0/3014877755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0cc108b20 0x7fd0cc10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.333+0000 7fd0d1ccb640 1 --2- 172.21.15.47:0/3014877755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0cc1081a0 0x7fd0cc1085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.333+0000 7fd0d1ccb640 1 --2- 172.21.15.47:0/3014877755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0cc102790 0x7fd0cc102b70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.333+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/3014877755 >> 172.21.15.47:0/3014877755 conn(0x7fd0cc0fe200 msgr2=0x7fd0cc100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:03.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.333+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/3014877755 shutdown_connections 2024-07-24T21:58:03.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.333+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/3014877755 wait complete. 2024-07-24T21:58:03.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0d1ccb640 1 Processor -- start 2024-07-24T21:58:03.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0d1ccb640 1 -- start start 2024-07-24T21:58:03.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0d1ccb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0cc102790 0x7fd0cc198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:03.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0d1ccb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0cc1081a0 0x7fd0cc199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:03.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0d1ccb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0cc108b20 0x7fd0cc19e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0d1ccb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc112660 con 0x7fd0cc108b20 2024-07-24T21:58:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0d1ccb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1124e0 con 0x7fd0cc102790 2024-07-24T21:58:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0d1ccb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1127e0 con 0x7fd0cc1081a0 2024-07-24T21:58:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0cbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0cc108b20 0x7fd0cc19e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0cbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0cc108b20 0x7fd0cc19e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47242/0 (socket says 172.21.15.47:47242) 2024-07-24T21:58:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0cbfff640 1 -- 172.21.15.47:0/335385822 learned_addr learned my addr 172.21.15.47:0/335385822 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0caffd640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0cc1081a0 0x7fd0cc199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0cb7fe640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0cc102790 0x7fd0cc198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.334+0000 7fd0cbfff640 1 -- 172.21.15.47:0/335385822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0cc1081a0 msgr2=0x7fd0cc199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.335+0000 7fd0cbfff640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0cc1081a0 0x7fd0cc199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.335+0000 7fd0cbfff640 1 -- 172.21.15.47:0/335385822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0cc102790 msgr2=0x7fd0cc198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:03.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.335+0000 7fd0cbfff640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0cc102790 0x7fd0cc198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.335+0000 7fd0cbfff640 1 -- 172.21.15.47:0/335385822 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0cc19ec00 con 0x7fd0cc108b20 2024-07-24T21:58:03.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.335+0000 7fd0cbfff640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0cc108b20 0x7fd0cc19e430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400b970 tx=0x7fd0c400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:03.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.335+0000 7fd0c8ff9640 1 -- 172.21.15.47:0/335385822 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4019070 con 0x7fd0cc108b20 2024-07-24T21:58:03.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.335+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/335385822 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0cc19eef0 con 0x7fd0cc108b20 2024-07-24T21:58:03.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.335+0000 7fd0c8ff9640 1 -- 172.21.15.47:0/335385822 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd0c4014440 con 0x7fd0cc108b20 2024-07-24T21:58:03.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.335+0000 7fd0c8ff9640 1 -- 172.21.15.47:0/335385822 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40075d0 con 0x7fd0cc108b20 2024-07-24T21:58:03.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.335+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/335385822 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0cc1a5630 con 0x7fd0cc108b20 2024-07-24T21:58:03.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.336+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/335385822 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0cc102b70 con 0x7fd0cc108b20 2024-07-24T21:58:03.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.337+0000 7fd0c8ff9640 1 -- 172.21.15.47:0/335385822 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fd0c401c070 con 0x7fd0cc108b20 2024-07-24T21:58:03.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.338+0000 7fd0c8ff9640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd0b40b3b90 0x7fd0b40b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:03.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.338+0000 7fd0cb7fe640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd0b40b3b90 0x7fd0b40b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:03.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.339+0000 7fd0c8ff9640 1 -- 172.21.15.47:0/335385822 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd0c40e1a60 con 0x7fd0cc108b20 2024-07-24T21:58:03.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.339+0000 7fd0cb7fe640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd0b40b3b90 0x7fd0b40b6050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009230 tx=0x7fd0bc0058d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.341+0000 7fd0c8ff9640 1 -- 172.21.15.47:0/335385822 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fd0c40aa5c0 con 0x7fd0cc108b20 2024-07-24T21:58:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.549+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/335385822 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fd0cc199c80 con 0x7fd0cc108b20 2024-07-24T21:58:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.554+0000 7fd0c8ff9640 1 -- 172.21.15.47:0/335385822 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fd0cc199c80 con 0x7fd0cc108b20 2024-07-24T21:58:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.556+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/335385822 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd0b40b3b90 msgr2=0x7fd0b40b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.556+0000 7fd0d1ccb640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd0b40b3b90 0x7fd0b40b6050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009230 tx=0x7fd0bc0058d0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.556+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/335385822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0cc108b20 msgr2=0x7fd0cc19e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.556+0000 7fd0d1ccb640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0cc108b20 0x7fd0cc19e430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400b970 tx=0x7fd0c400bd70 comp rx=0 tx=0).stop 2024-07-24T21:58:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.556+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/335385822 shutdown_connections 2024-07-24T21:58:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.556+0000 7fd0d1ccb640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd0b40b3b90 0x7fd0b40b6050 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.556+0000 7fd0d1ccb640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0cc108b20 0x7fd0cc19e430 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.556+0000 7fd0d1ccb640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0cc1081a0 0x7fd0cc199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.557+0000 7fd0d1ccb640 1 --2- 172.21.15.47:0/335385822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0cc102790 0x7fd0cc198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.557+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/335385822 >> 172.21.15.47:0/335385822 conn(0x7fd0cc0fe200 msgr2=0x7fd0cc1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:03.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.557+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/335385822 shutdown_connections 2024-07-24T21:58:03.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:00.557+0000 7fd0d1ccb640 1 -- 172.21.15.47:0/335385822 wait complete. 2024-07-24T21:58:04.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.021+0000 7fc7201d5640 1 -- 172.21.15.47:0/1702544163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fc71819bf40 con 0x7fc71810ede0 2024-07-24T21:58:04.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.025+0000 7fc70effd640 1 -- 172.21.15.47:0/1702544163 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v27)=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7fc7100cbf60 con 0x7fc71810ede0 2024-07-24T21:58:04.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.027+0000 7fc7201d5640 1 -- 172.21.15.47:0/1702544163 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7040b3b90 msgr2=0x7fc7040b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:04.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.027+0000 7fc7201d5640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7040b3b90 0x7fc7040b6050 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc714006fd0 tx=0x7fc714008040 comp rx=0 tx=0).stop 2024-07-24T21:58:04.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.027+0000 7fc7201d5640 1 -- 172.21.15.47:0/1702544163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc71810ede0 msgr2=0x7fc7181a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:04.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.027+0000 7fc7201d5640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc71810ede0 0x7fc7181a06f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc71002ae70 tx=0x7fc710003f10 comp rx=0 tx=0).stop 2024-07-24T21:58:04.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.028+0000 7fc7201d5640 1 -- 172.21.15.47:0/1702544163 shutdown_connections 2024-07-24T21:58:04.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.028+0000 7fc7201d5640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7040b3b90 0x7fc7040b6050 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:04.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.028+0000 7fc7201d5640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc71810ede0 0x7fc7181a06f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:04.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.028+0000 7fc7201d5640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc718101b50 0x7fc71819b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:04.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.028+0000 7fc7201d5640 1 --2- 172.21.15.47:0/1702544163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc718101230 0x7fc71819ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:04.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.028+0000 7fc7201d5640 1 -- 172.21.15.47:0/1702544163 >> 172.21.15.47:0/1702544163 conn(0x7fc7180fd100 msgr2=0x7fc7180ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:04.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.028+0000 7fc7201d5640 1 -- 172.21.15.47:0/1702544163 shutdown_connections 2024-07-24T21:58:04.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:04.028+0000 7fc7201d5640 1 -- 172.21.15.47:0/1702544163 wait complete. 2024-07-24T21:58:04.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:03 smithi188 ceph-mon[37380]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:04.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:03 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/4097545860' entity='client.admin' 2024-07-24T21:58:04.789 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:58:05.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:05 smithi047 ceph-mon[32551]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:05.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:05 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1702544163' entity='client.admin' 2024-07-24T21:58:05.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:05 smithi188 ceph-mon[37380]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:05.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:05 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1702544163' entity='client.admin' 2024-07-24T21:58:05.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:05 smithi183 ceph-mon[37007]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:05.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:05 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1702544163' entity='client.admin' 2024-07-24T21:58:06.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.322+0000 7fb2c5315640 1 -- 172.21.15.47:0/609452783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c01081a0 msgr2=0x7fb2c01085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:06.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.322+0000 7fb2c5315640 1 --2- 172.21.15.47:0/609452783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c01081a0 0x7fb2c01085e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4009900 tx=0x7fb2b402a410 comp rx=0 tx=0).stop 2024-07-24T21:58:06.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.322+0000 7fb2c5315640 1 -- 172.21.15.47:0/609452783 shutdown_connections 2024-07-24T21:58:06.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.322+0000 7fb2c5315640 1 --2- 172.21.15.47:0/609452783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2c0108b20 0x7fb2c010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.322+0000 7fb2c5315640 1 --2- 172.21.15.47:0/609452783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c01081a0 0x7fb2c01085e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.322+0000 7fb2c5315640 1 --2- 172.21.15.47:0/609452783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb2c0102790 0x7fb2c0102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.322+0000 7fb2c5315640 1 -- 172.21.15.47:0/609452783 >> 172.21.15.47:0/609452783 conn(0x7fb2c00fe200 msgr2=0x7fb2c0100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.322+0000 7fb2c5315640 1 -- 172.21.15.47:0/609452783 shutdown_connections 2024-07-24T21:58:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.322+0000 7fb2c5315640 1 -- 172.21.15.47:0/609452783 wait complete. 2024-07-24T21:58:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.323+0000 7fb2c5315640 1 Processor -- start 2024-07-24T21:58:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.323+0000 7fb2c5315640 1 -- start start 2024-07-24T21:58:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.323+0000 7fb2c5315640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2c0102790 0x7fb2c0074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.323+0000 7fb2c5315640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c01081a0 0x7fb2c00753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.323+0000 7fb2c5315640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb2c0108b20 0x7fb2c0075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.323+0000 7fb2c5315640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01125f0 con 0x7fb2c01081a0 2024-07-24T21:58:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.323+0000 7fb2c5315640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0112470 con 0x7fb2c0102790 2024-07-24T21:58:06.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.323+0000 7fb2c5315640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0112770 con 0x7fb2c0108b20 2024-07-24T21:58:06.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.323+0000 7fb2be7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c01081a0 0x7fb2c00753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:06.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.323+0000 7fb2be7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c01081a0 0x7fb2c00753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54984/0 (socket says 172.21.15.47:54984) 2024-07-24T21:58:06.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.323+0000 7fb2be7fc640 1 -- 172.21.15.47:0/1732244782 learned_addr learned my addr 172.21.15.47:0/1732244782 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:06.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.323+0000 7fb2beffd640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2c0102790 0x7fb2c0074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:06.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.324+0000 7fb2bf7fe640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb2c0108b20 0x7fb2c0075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:06.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.324+0000 7fb2be7fc640 1 -- 172.21.15.47:0/1732244782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb2c0108b20 msgr2=0x7fb2c0075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:06.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.324+0000 7fb2be7fc640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb2c0108b20 0x7fb2c0075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.324+0000 7fb2be7fc640 1 -- 172.21.15.47:0/1732244782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2c0102790 msgr2=0x7fb2c0074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:06.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.324+0000 7fb2be7fc640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2c0102790 0x7fb2c0074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.324+0000 7fb2be7fc640 1 -- 172.21.15.47:0/1732244782 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c01a6f20 con 0x7fb2c01081a0 2024-07-24T21:58:06.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.324+0000 7fb2be7fc640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c01081a0 0x7fb2c00753d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4006010 tx=0x7fb2b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:06.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.324+0000 7fb2a7fff640 1 -- 172.21.15.47:0/1732244782 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b403f070 con 0x7fb2c01081a0 2024-07-24T21:58:06.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.324+0000 7fb2a7fff640 1 -- 172.21.15.47:0/1732244782 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb2b4003a80 con 0x7fb2c01081a0 2024-07-24T21:58:06.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.324+0000 7fb2c5315640 1 -- 172.21.15.47:0/1732244782 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c01a71b0 con 0x7fb2c01081a0 2024-07-24T21:58:06.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.324+0000 7fb2a7fff640 1 -- 172.21.15.47:0/1732244782 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4035030 con 0x7fb2c01081a0 2024-07-24T21:58:06.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.324+0000 7fb2c5315640 1 -- 172.21.15.47:0/1732244782 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c01a76e0 con 0x7fb2c01081a0 2024-07-24T21:58:06.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.325+0000 7fb2c5315640 1 -- 172.21.15.47:0/1732244782 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c0102b70 con 0x7fb2c01081a0 2024-07-24T21:58:06.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.327+0000 7fb2a7fff640 1 -- 172.21.15.47:0/1732244782 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fb2b4042070 con 0x7fb2c01081a0 2024-07-24T21:58:06.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.327+0000 7fb2a7fff640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb2a80b3c10 0x7fb2a80b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:06.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.327+0000 7fb2beffd640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb2a80b3c10 0x7fb2a80b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:06.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.328+0000 7fb2a7fff640 1 -- 172.21.15.47:0/1732244782 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb2b4102e80 con 0x7fb2c01081a0 2024-07-24T21:58:06.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.328+0000 7fb2beffd640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb2a80b3c10 0x7fb2a80b60d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00058c0 tx=0x7fb2b000a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:06.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.330+0000 7fb2a7fff640 1 -- 172.21.15.47:0/1732244782 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fb2b40cc0d0 con 0x7fb2c01081a0 2024-07-24T21:58:06.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.442+0000 7fb2a7fff640 1 -- 172.21.15.47:0/1732244782 <== mon.0 v2:172.21.15.47:3300/0 7 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2b40cb4e0 con 0x7fb2c01081a0 2024-07-24T21:58:06.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.393+0000 7f743fffa640 1 -- 172.21.15.47:0/511528531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7438075850 msgr2=0x7f7438112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:06.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.393+0000 7f743fffa640 1 --2- 172.21.15.47:0/511528531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7438075850 0x7f7438112fb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7428009900 tx=0x7f742802a410 comp rx=0 tx=0).stop 2024-07-24T21:58:06.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.393+0000 7f743fffa640 1 -- 172.21.15.47:0/511528531 shutdown_connections 2024-07-24T21:58:06.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.393+0000 7f743fffa640 1 --2- 172.21.15.47:0/511528531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74381134f0 0x7f74381158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.393+0000 7f743fffa640 1 --2- 172.21.15.47:0/511528531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7438075850 0x7f7438112fb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.393+0000 7f743fffa640 1 --2- 172.21.15.47:0/511528531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7438074f30 0x7f7438075310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.393+0000 7f743fffa640 1 -- 172.21.15.47:0/511528531 >> 172.21.15.47:0/511528531 conn(0x7f74380fe200 msgr2=0x7f7438100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:06.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.393+0000 7f743fffa640 1 -- 172.21.15.47:0/511528531 shutdown_connections 2024-07-24T21:58:06.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.393+0000 7f743fffa640 1 -- 172.21.15.47:0/511528531 wait complete. 2024-07-24T21:58:06.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.394+0000 7f743fffa640 1 Processor -- start 2024-07-24T21:58:06.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.394+0000 7f743fffa640 1 -- start start 2024-07-24T21:58:06.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.394+0000 7f743fffa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7438074f30 0x7f743819f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:06.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.394+0000 7f743fffa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7438075850 0x7f743819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:06.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.394+0000 7f743fffa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74381134f0 0x7f74381a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:06.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.394+0000 7f743fffa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7438118d60 con 0x7f7438074f30 2024-07-24T21:58:06.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.394+0000 7f743fffa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7438118be0 con 0x7f7438075850 2024-07-24T21:58:06.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.394+0000 7f743fffa640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7438118ee0 con 0x7f74381134f0 2024-07-24T21:58:06.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743dd96640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7438074f30 0x7f743819f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:06.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743dd96640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7438074f30 0x7f743819f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47306/0 (socket says 172.21.15.47:47306) 2024-07-24T21:58:06.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743dd96640 1 -- 172.21.15.47:0/1980310259 learned_addr learned my addr 172.21.15.47:0/1980310259 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:06.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743d595640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7438075850 0x7f743819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:06.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743e597640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74381134f0 0x7f74381a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:06.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743dd96640 1 -- 172.21.15.47:0/1980310259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74381134f0 msgr2=0x7f74381a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:06.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743dd96640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74381134f0 0x7f74381a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743dd96640 1 -- 172.21.15.47:0/1980310259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7438075850 msgr2=0x7f743819f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:06.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743dd96640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7438075850 0x7f743819f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743dd96640 1 -- 172.21.15.47:0/1980310259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74381a5400 con 0x7f7438074f30 2024-07-24T21:58:06.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743e597640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74381134f0 0x7f74381a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T21:58:06.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743dd96640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7438074f30 0x7f743819f350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f743400ba50 tx=0x7f743400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:06.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f742effd640 1 -- 172.21.15.47:0/1980310259 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7434019070 con 0x7f7438074f30 2024-07-24T21:58:06.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743fffa640 1 -- 172.21.15.47:0/1980310259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74381a56f0 con 0x7f7438074f30 2024-07-24T21:58:06.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f742effd640 1 -- 172.21.15.47:0/1980310259 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f743400cbe0 con 0x7f7438074f30 2024-07-24T21:58:06.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f742effd640 1 -- 172.21.15.47:0/1980310259 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74340075d0 con 0x7f7438074f30 2024-07-24T21:58:06.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.395+0000 7f743fffa640 1 -- 172.21.15.47:0/1980310259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74381abe30 con 0x7f7438074f30 2024-07-24T21:58:06.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.396+0000 7f743fffa640 1 -- 172.21.15.47:0/1980310259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7438075390 con 0x7f7438074f30 2024-07-24T21:58:06.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.398+0000 7f742effd640 1 -- 172.21.15.47:0/1980310259 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f743401c070 con 0x7f7438074f30 2024-07-24T21:58:06.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.399+0000 7f742effd640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f74240b3b90 0x7f74240b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:06.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.399+0000 7f743d595640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f74240b3b90 0x7f74240b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:06.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.399+0000 7f742effd640 1 -- 172.21.15.47:0/1980310259 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f74340e1800 con 0x7f7438074f30 2024-07-24T21:58:06.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.399+0000 7f743d595640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f74240b3b90 0x7f74240b6050 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7428000c00 tx=0x7f7428005e80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:06.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.403+0000 7f742effd640 1 -- 172.21.15.47:0/1980310259 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f74340525e0 con 0x7f7438074f30 2024-07-24T21:58:06.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.603+0000 7f743fffa640 1 -- 172.21.15.47:0/1980310259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f7438105960 con 0x7f7438074f30 2024-07-24T21:58:06.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.607+0000 7f742effd640 1 -- 172.21.15.47:0/1980310259 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v24)=0 v24) ==== 125+0+0 (secure 0 0 0) 0x7f74340aaa50 con 0x7f7438074f30 2024-07-24T21:58:06.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.610+0000 7f743fffa640 1 -- 172.21.15.47:0/1980310259 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f74240b3b90 msgr2=0x7f74240b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:06.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.610+0000 7f743fffa640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f74240b3b90 0x7f74240b6050 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7428000c00 tx=0x7f7428005e80 comp rx=0 tx=0).stop 2024-07-24T21:58:06.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.610+0000 7f743fffa640 1 -- 172.21.15.47:0/1980310259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7438074f30 msgr2=0x7f743819f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:06.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.610+0000 7f743fffa640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7438074f30 0x7f743819f350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f743400ba50 tx=0x7f743400bf10 comp rx=0 tx=0).stop 2024-07-24T21:58:06.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.610+0000 7f743fffa640 1 -- 172.21.15.47:0/1980310259 shutdown_connections 2024-07-24T21:58:06.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.610+0000 7f743fffa640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f74240b3b90 0x7f74240b6050 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.610+0000 7f743fffa640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74381134f0 0x7f74381a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.610+0000 7f743fffa640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7438075850 0x7f743819f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.610+0000 7f743fffa640 1 --2- 172.21.15.47:0/1980310259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7438074f30 0x7f743819f350 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.610+0000 7f743fffa640 1 -- 172.21.15.47:0/1980310259 >> 172.21.15.47:0/1980310259 conn(0x7f74380fe200 msgr2=0x7f74380fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:06.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.610+0000 7f743fffa640 1 -- 172.21.15.47:0/1980310259 shutdown_connections 2024-07-24T21:58:06.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:01.610+0000 7f743fffa640 1 -- 172.21.15.47:0/1980310259 wait complete. 2024-07-24T21:58:06.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.553+0000 7fb2c5315640 1 -- 172.21.15.47:0/1732244782 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fb2c0076190 con 0x7fb2c01081a0 2024-07-24T21:58:06.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.556+0000 7fb2a7fff640 1 -- 172.21.15.47:0/1732244782 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v29)=0 v29) ==== 108+0+0 (secure 0 0 0) 0x7fb2c0076190 con 0x7fb2c01081a0 2024-07-24T21:58:06.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.558+0000 7fb2c5315640 1 -- 172.21.15.47:0/1732244782 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb2a80b3c10 msgr2=0x7fb2a80b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.558+0000 7fb2c5315640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb2a80b3c10 0x7fb2a80b60d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00058c0 tx=0x7fb2b000a2d0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.558+0000 7fb2c5315640 1 -- 172.21.15.47:0/1732244782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c01081a0 msgr2=0x7fb2c00753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.558+0000 7fb2c5315640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c01081a0 0x7fb2c00753d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4006010 tx=0x7fb2b40042f0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.559+0000 7fb2c5315640 1 -- 172.21.15.47:0/1732244782 shutdown_connections 2024-07-24T21:58:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.559+0000 7fb2c5315640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb2a80b3c10 0x7fb2a80b60d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.559+0000 7fb2c5315640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb2c0108b20 0x7fb2c0075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.559+0000 7fb2c5315640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c01081a0 0x7fb2c00753d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.559+0000 7fb2c5315640 1 --2- 172.21.15.47:0/1732244782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2c0102790 0x7fb2c0074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.559+0000 7fb2c5315640 1 -- 172.21.15.47:0/1732244782 >> 172.21.15.47:0/1732244782 conn(0x7fb2c00fe200 msgr2=0x7fb2c01005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.559+0000 7fb2c5315640 1 -- 172.21.15.47:0/1732244782 shutdown_connections 2024-07-24T21:58:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.559+0000 7fb2c5315640 1 -- 172.21.15.47:0/1732244782 wait complete. 2024-07-24T21:58:07.749 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:07 smithi047 ceph-mon[32551]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:07.749 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:07 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1949374883' entity='client.admin' 2024-07-24T21:58:07.749 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:07 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1732244782' entity='client.admin' 2024-07-24T21:58:07.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:07 smithi188 ceph-mon[37380]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:07.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:07 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1949374883' entity='client.admin' 2024-07-24T21:58:07.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:07 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1732244782' entity='client.admin' 2024-07-24T21:58:07.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:07 smithi183 ceph-mon[37007]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:07.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:07 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1949374883' entity='client.admin' 2024-07-24T21:58:07.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:07 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1732244782' entity='client.admin' 2024-07-24T21:58:08.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.118+0000 7f55db2ed640 1 -- 172.21.15.47:0/3885307596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d4103f80 msgr2=0x7f55d410c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:08.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.118+0000 7f55db2ed640 1 --2- 172.21.15.47:0/3885307596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d4103f80 0x7f55d410c470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009900 tx=0x7f55c802a410 comp rx=0 tx=0).stop 2024-07-24T21:58:08.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.118+0000 7f55db2ed640 1 -- 172.21.15.47:0/3885307596 shutdown_connections 2024-07-24T21:58:08.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.118+0000 7f55db2ed640 1 --2- 172.21.15.47:0/3885307596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55d410cac0 0x7f55d410ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.118+0000 7f55db2ed640 1 --2- 172.21.15.47:0/3885307596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d4103f80 0x7f55d410c470 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.118+0000 7f55db2ed640 1 --2- 172.21.15.47:0/3885307596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55d4103660 0x7f55d4103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.118+0000 7f55db2ed640 1 -- 172.21.15.47:0/3885307596 >> 172.21.15.47:0/3885307596 conn(0x7f55d40fd0c0 msgr2=0x7f55d40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:08.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.118+0000 7f55db2ed640 1 -- 172.21.15.47:0/3885307596 shutdown_connections 2024-07-24T21:58:08.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.118+0000 7f55db2ed640 1 -- 172.21.15.47:0/3885307596 wait complete. 2024-07-24T21:58:08.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55db2ed640 1 Processor -- start 2024-07-24T21:58:08.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55db2ed640 1 -- start start 2024-07-24T21:58:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55db2ed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d4103660 0x7f55d419ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55db2ed640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55d4103f80 0x7f55d419b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55db2ed640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55d410cac0 0x7f55d41a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55db2ed640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f55d4112770 con 0x7f55d4103660 2024-07-24T21:58:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55db2ed640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f55d41125f0 con 0x7f55d410cac0 2024-07-24T21:58:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55db2ed640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f55d41128f0 con 0x7f55d4103f80 2024-07-24T21:58:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55d9089640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d4103660 0x7f55d419ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55d9089640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d4103660 0x7f55d419ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55022/0 (socket says 172.21.15.47:55022) 2024-07-24T21:58:08.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55d9089640 1 -- 172.21.15.47:0/2891236210 learned_addr learned my addr 172.21.15.47:0/2891236210 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55d8888640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55d4103f80 0x7f55d419b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55d988a640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55d410cac0 0x7f55d41a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55d9089640 1 -- 172.21.15.47:0/2891236210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55d4103f80 msgr2=0x7f55d419b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55d9089640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55d4103f80 0x7f55d419b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55d9089640 1 -- 172.21.15.47:0/2891236210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55d410cac0 msgr2=0x7f55d41a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55d9089640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55d410cac0 0x7f55d41a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55d9089640 1 -- 172.21.15.47:0/2891236210 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d41a0f30 con 0x7f55d4103660 2024-07-24T21:58:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.119+0000 7f55d988a640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55d410cac0 0x7f55d41a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T21:58:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.120+0000 7f55d9089640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d4103660 0x7f55d419ae80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f55c400cce0 tx=0x7f55c400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.120+0000 7f55d27fc640 1 -- 172.21.15.47:0/2891236210 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c4004b20 con 0x7f55d4103660 2024-07-24T21:58:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.120+0000 7f55db2ed640 1 -- 172.21.15.47:0/2891236210 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d41a1220 con 0x7f55d4103660 2024-07-24T21:58:08.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.120+0000 7f55d27fc640 1 -- 172.21.15.47:0/2891236210 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55c4004cc0 con 0x7f55d4103660 2024-07-24T21:58:08.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.120+0000 7f55d27fc640 1 -- 172.21.15.47:0/2891236210 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c400f6b0 con 0x7f55d4103660 2024-07-24T21:58:08.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.120+0000 7f55db2ed640 1 -- 172.21.15.47:0/2891236210 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d41a78e0 con 0x7f55d4103660 2024-07-24T21:58:08.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.121+0000 7f55db2ed640 1 -- 172.21.15.47:0/2891236210 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d406ab70 con 0x7f55d4103660 2024-07-24T21:58:08.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.122+0000 7f55d27fc640 1 -- 172.21.15.47:0/2891236210 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f55c400f850 con 0x7f55d4103660 2024-07-24T21:58:08.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.123+0000 7f55d27fc640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f55bc0b3c10 0x7f55bc0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:08.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.123+0000 7f55d8888640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f55bc0b3c10 0x7f55bc0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:08.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.123+0000 7f55d27fc640 1 -- 172.21.15.47:0/2891236210 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f55c40e2110 con 0x7f55d4103660 2024-07-24T21:58:08.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.124+0000 7f55d8888640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f55bc0b3c10 0x7f55bc0b60d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f55c8031440 tx=0x7f55c8005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:08.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.127+0000 7f55d27fc640 1 -- 172.21.15.47:0/2891236210 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f55c4014030 con 0x7f55d4103660 2024-07-24T21:58:08.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.323+0000 7f55db2ed640 1 -- 172.21.15.47:0/2891236210 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f55d419c030 con 0x7f55d4103660 2024-07-24T21:58:08.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.327+0000 7f55d27fc640 1 -- 172.21.15.47:0/2891236210 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) ==== 138+0+0 (secure 0 0 0) 0x7f55c40ab2c0 con 0x7f55d4103660 2024-07-24T21:58:08.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.329+0000 7f55db2ed640 1 -- 172.21.15.47:0/2891236210 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f55bc0b3c10 msgr2=0x7f55bc0b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:08.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.329+0000 7f55db2ed640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f55bc0b3c10 0x7f55bc0b60d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f55c8031440 tx=0x7f55c8005a20 comp rx=0 tx=0).stop 2024-07-24T21:58:08.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.329+0000 7f55db2ed640 1 -- 172.21.15.47:0/2891236210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d4103660 msgr2=0x7f55d419ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:08.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.329+0000 7f55db2ed640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d4103660 0x7f55d419ae80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f55c400cce0 tx=0x7f55c400a620 comp rx=0 tx=0).stop 2024-07-24T21:58:08.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.329+0000 7f55db2ed640 1 -- 172.21.15.47:0/2891236210 shutdown_connections 2024-07-24T21:58:08.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.329+0000 7f55db2ed640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f55bc0b3c10 0x7f55bc0b60d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.329+0000 7f55db2ed640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55d410cac0 0x7f55d41a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.329+0000 7f55db2ed640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55d4103f80 0x7f55d419b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.329+0000 7f55db2ed640 1 --2- 172.21.15.47:0/2891236210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d4103660 0x7f55d419ae80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.329+0000 7f55db2ed640 1 -- 172.21.15.47:0/2891236210 >> 172.21.15.47:0/2891236210 conn(0x7f55d40fd0c0 msgr2=0x7f55d410ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:08.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.329+0000 7f55db2ed640 1 -- 172.21.15.47:0/2891236210 shutdown_connections 2024-07-24T21:58:08.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:08.329+0000 7f55db2ed640 1 -- 172.21.15.47:0/2891236210 wait complete. 2024-07-24T21:58:08.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.226+0000 7fa333c96640 1 -- 172.21.15.47:0/2693323580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa32c108b20 msgr2=0x7fa32c10f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:08.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.226+0000 7fa333c96640 1 --2- 172.21.15.47:0/2693323580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa32c108b20 0x7fa32c10f320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa324009ca0 tx=0x7fa32402a8c0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.226+0000 7fa333c96640 1 -- 172.21.15.47:0/2693323580 shutdown_connections 2024-07-24T21:58:08.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.226+0000 7fa333c96640 1 --2- 172.21.15.47:0/2693323580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa32c108b20 0x7fa32c10f320 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.226+0000 7fa333c96640 1 --2- 172.21.15.47:0/2693323580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa32c1081a0 0x7fa32c1085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.226+0000 7fa333c96640 1 --2- 172.21.15.47:0/2693323580 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa32c102790 0x7fa32c102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.226+0000 7fa333c96640 1 -- 172.21.15.47:0/2693323580 >> 172.21.15.47:0/2693323580 conn(0x7fa32c0fe200 msgr2=0x7fa32c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:08.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.226+0000 7fa333c96640 1 -- 172.21.15.47:0/2693323580 shutdown_connections 2024-07-24T21:58:08.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.227+0000 7fa333c96640 1 -- 172.21.15.47:0/2693323580 wait complete. 2024-07-24T21:58:08.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.227+0000 7fa333c96640 1 Processor -- start 2024-07-24T21:58:08.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.227+0000 7fa333c96640 1 -- start start 2024-07-24T21:58:08.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa333c96640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa32c102790 0x7fa32c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa333c96640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa32c1081a0 0x7fa32c198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa333c96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa32c108b20 0x7fa32c19e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa333c96640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c112620 con 0x7fa32c102790 2024-07-24T21:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa333c96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c1124a0 con 0x7fa32c108b20 2024-07-24T21:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa333c96640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c1127a0 con 0x7fa32c1081a0 2024-07-24T21:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa331a32640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa32c102790 0x7fa32c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa331a32640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa32c102790 0x7fa32c198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54956/0 (socket says 172.21.15.47:54956) 2024-07-24T21:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa331a32640 1 -- 172.21.15.47:0/1949374883 learned_addr learned my addr 172.21.15.47:0/1949374883 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa331231640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa32c1081a0 0x7fa32c198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa332233640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa32c108b20 0x7fa32c19e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa331a32640 1 -- 172.21.15.47:0/1949374883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa32c1081a0 msgr2=0x7fa32c198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa331a32640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa32c1081a0 0x7fa32c198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa331a32640 1 -- 172.21.15.47:0/1949374883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa32c108b20 msgr2=0x7fa32c19e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa331a32640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa32c108b20 0x7fa32c19e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa331a32640 1 -- 172.21.15.47:0/1949374883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c19eb20 con 0x7fa32c102790 2024-07-24T21:58:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa332233640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa32c108b20 0x7fa32c19e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T21:58:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa331a32640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa32c102790 0x7fa32c198a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa32800c920 tx=0x7fa32800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa322ffd640 1 -- 172.21.15.47:0/1949374883 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa328007c70 con 0x7fa32c102790 2024-07-24T21:58:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa333c96640 1 -- 172.21.15.47:0/1949374883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32c19ee10 con 0x7fa32c102790 2024-07-24T21:58:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.228+0000 7fa322ffd640 1 -- 172.21.15.47:0/1949374883 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa328007e10 con 0x7fa32c102790 2024-07-24T21:58:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.229+0000 7fa322ffd640 1 -- 172.21.15.47:0/1949374883 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa328018720 con 0x7fa32c102790 2024-07-24T21:58:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.229+0000 7fa333c96640 1 -- 172.21.15.47:0/1949374883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa32c1a54d0 con 0x7fa32c102790 2024-07-24T21:58:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.230+0000 7fa333c96640 1 -- 172.21.15.47:0/1949374883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa32c102b70 con 0x7fa32c102790 2024-07-24T21:58:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.231+0000 7fa322ffd640 1 -- 172.21.15.47:0/1949374883 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fa32800f450 con 0x7fa32c102790 2024-07-24T21:58:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.232+0000 7fa322ffd640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa3180b3b90 0x7fa3180b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.232+0000 7fa331231640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa3180b3b90 0x7fa3180b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.232+0000 7fa322ffd640 1 -- 172.21.15.47:0/1949374883 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa3280e2520 con 0x7fa32c102790 2024-07-24T21:58:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.232+0000 7fa331231640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa3180b3b90 0x7fa3180b6050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa32c1047a0 tx=0x7fa31c00b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.235+0000 7fa322ffd640 1 -- 172.21.15.47:0/1949374883 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fa328014030 con 0x7fa32c102790 2024-07-24T21:58:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.437+0000 7fa333c96640 1 -- 172.21.15.47:0/1949374883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fa32c199ba0 con 0x7fa32c102790 2024-07-24T21:58:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.441+0000 7fa322ffd640 1 -- 172.21.15.47:0/1949374883 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v28)=0 v28) ==== 123+0+0 (secure 0 0 0) 0x7fa3280ab760 con 0x7fa32c102790 2024-07-24T21:58:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.442+0000 7fa322ffd640 1 -- 172.21.15.47:0/1949374883 <== mon.0 v2:172.21.15.47:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3280aab70 con 0x7fa32c102790 2024-07-24T21:58:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.445+0000 7fa333c96640 1 -- 172.21.15.47:0/1949374883 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa3180b3b90 msgr2=0x7fa3180b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.445+0000 7fa333c96640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa3180b3b90 0x7fa3180b6050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa32c1047a0 tx=0x7fa31c00b390 comp rx=0 tx=0).stop 2024-07-24T21:58:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.445+0000 7fa333c96640 1 -- 172.21.15.47:0/1949374883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa32c102790 msgr2=0x7fa32c198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.445+0000 7fa333c96640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa32c102790 0x7fa32c198a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa32800c920 tx=0x7fa32800cde0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.445+0000 7fa333c96640 1 -- 172.21.15.47:0/1949374883 shutdown_connections 2024-07-24T21:58:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.445+0000 7fa333c96640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa3180b3b90 0x7fa3180b6050 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.445+0000 7fa333c96640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa32c108b20 0x7fa32c19e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.445+0000 7fa333c96640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa32c1081a0 0x7fa32c198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.445+0000 7fa333c96640 1 --2- 172.21.15.47:0/1949374883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa32c102790 0x7fa32c198a70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:08.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.445+0000 7fa333c96640 1 -- 172.21.15.47:0/1949374883 >> 172.21.15.47:0/1949374883 conn(0x7fa32c0fe200 msgr2=0x7fa32c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:08.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.445+0000 7fa333c96640 1 -- 172.21.15.47:0/1949374883 shutdown_connections 2024-07-24T21:58:08.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:06.445+0000 7fa333c96640 1 -- 172.21.15.47:0/1949374883 wait complete. 2024-07-24T21:58:08.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:08 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1712831283' entity='client.admin' 2024-07-24T21:58:08.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:08 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2891236210' entity='client.admin' 2024-07-24T21:58:08.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:08.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:08.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:08.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:08 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1712831283' entity='client.admin' 2024-07-24T21:58:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:08 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2891236210' entity='client.admin' 2024-07-24T21:58:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:09.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:08 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1712831283' entity='client.admin' 2024-07-24T21:58:09.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:08 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2891236210' entity='client.admin' 2024-07-24T21:58:09.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:09.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:09.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:09.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:09.113 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi047') 2024-07-24T21:58:09.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.342+0000 7feaa9661640 1 -- 172.21.15.47:0/1959592459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4108180 msgr2=0x7feaa41085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:09.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.342+0000 7feaa9661640 1 --2- 172.21.15.47:0/1959592459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4108180 0x7feaa41085c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009900 tx=0x7fea8c02a410 comp rx=0 tx=0).stop 2024-07-24T21:58:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.342+0000 7feaa9661640 1 -- 172.21.15.47:0/1959592459 shutdown_connections 2024-07-24T21:58:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.342+0000 7feaa9661640 1 --2- 172.21.15.47:0/1959592459 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaa4108b00 0x7feaa410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.342+0000 7feaa9661640 1 --2- 172.21.15.47:0/1959592459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4108180 0x7feaa41085c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.342+0000 7feaa9661640 1 --2- 172.21.15.47:0/1959592459 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa4102770 0x7feaa4102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.342+0000 7feaa9661640 1 -- 172.21.15.47:0/1959592459 >> 172.21.15.47:0/1959592459 conn(0x7feaa40fe1c0 msgr2=0x7feaa41005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.342+0000 7feaa9661640 1 -- 172.21.15.47:0/1959592459 shutdown_connections 2024-07-24T21:58:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.342+0000 7feaa9661640 1 -- 172.21.15.47:0/1959592459 wait complete. 2024-07-24T21:58:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.343+0000 7feaa9661640 1 Processor -- start 2024-07-24T21:58:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.343+0000 7feaa9661640 1 -- start start 2024-07-24T21:58:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.343+0000 7feaa9661640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4102770 0x7feaa4198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.343+0000 7feaa9661640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa4108180 0x7feaa41990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.343+0000 7feaa9661640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaa4108b00 0x7feaa419e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:09.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.343+0000 7feaa9661640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feaa4112750 con 0x7feaa4102770 2024-07-24T21:58:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.343+0000 7feaa9661640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41125d0 con 0x7feaa4108180 2024-07-24T21:58:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.343+0000 7feaa9661640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41128d0 con 0x7feaa4108b00 2024-07-24T21:58:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.343+0000 7feaa2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4102770 0x7feaa4198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7feaa2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4102770 0x7feaa4198ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55012/0 (socket says 172.21.15.47:55012) 2024-07-24T21:58:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7feaa2ffd640 1 -- 172.21.15.47:0/1712831283 learned_addr learned my addr 172.21.15.47:0/1712831283 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7feaa37fe640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaa4108b00 0x7feaa419e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7feaa27fc640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa4108180 0x7feaa41990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7feaa2ffd640 1 -- 172.21.15.47:0/1712831283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaa4108b00 msgr2=0x7feaa419e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7feaa2ffd640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaa4108b00 0x7feaa419e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7feaa2ffd640 1 -- 172.21.15.47:0/1712831283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa4108180 msgr2=0x7feaa41990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7feaa2ffd640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa4108180 0x7feaa41990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:09.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7feaa2ffd640 1 -- 172.21.15.47:0/1712831283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa419ec50 con 0x7feaa4102770 2024-07-24T21:58:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7feaa2ffd640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4102770 0x7feaa4198ba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00e9f0 tx=0x7fea9c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7fea9bfff640 1 -- 172.21.15.47:0/1712831283 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00cd80 con 0x7feaa4102770 2024-07-24T21:58:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7fea9bfff640 1 -- 172.21.15.47:0/1712831283 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea9c0108e0 con 0x7feaa4102770 2024-07-24T21:58:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7feaa9661640 1 -- 172.21.15.47:0/1712831283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa419ef40 con 0x7feaa4102770 2024-07-24T21:58:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7fea9bfff640 1 -- 172.21.15.47:0/1712831283 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c018980 con 0x7feaa4102770 2024-07-24T21:58:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.344+0000 7feaa9661640 1 -- 172.21.15.47:0/1712831283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa41a57d0 con 0x7feaa4102770 2024-07-24T21:58:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.345+0000 7feaa9661640 1 -- 172.21.15.47:0/1712831283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa4102b50 con 0x7feaa4102770 2024-07-24T21:58:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.347+0000 7fea9bfff640 1 -- 172.21.15.47:0/1712831283 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fea9c010430 con 0x7feaa4102770 2024-07-24T21:58:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.347+0000 7fea9bfff640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fea900b3c10 0x7fea900b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.348+0000 7feaa27fc640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fea900b3c10 0x7fea900b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.348+0000 7fea9bfff640 1 -- 172.21.15.47:0/1712831283 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fea9c0e2820 con 0x7feaa4102770 2024-07-24T21:58:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.348+0000 7feaa27fc640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fea900b3c10 0x7fea900b60d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fea8c000c00 tx=0x7fea8c031400 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:09.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.350+0000 7fea9bfff640 1 -- 172.21.15.47:0/1712831283 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fea9c0aba70 con 0x7feaa4102770 2024-07-24T21:58:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.549+0000 7feaa9661640 1 -- 172.21.15.47:0/1712831283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7feaa410a940 con 0x7feaa4102770 2024-07-24T21:58:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.552+0000 7fea9bfff640 1 -- 172.21.15.47:0/1712831283 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v30)=0 v30) ==== 119+0+0 (secure 0 0 0) 0x7fea9c0ab370 con 0x7feaa4102770 2024-07-24T21:58:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.555+0000 7feaa9661640 1 -- 172.21.15.47:0/1712831283 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fea900b3c10 msgr2=0x7fea900b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.555+0000 7feaa9661640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fea900b3c10 0x7fea900b60d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fea8c000c00 tx=0x7fea8c031400 comp rx=0 tx=0).stop 2024-07-24T21:58:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.555+0000 7feaa9661640 1 -- 172.21.15.47:0/1712831283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4102770 msgr2=0x7feaa4198ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.555+0000 7feaa9661640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4102770 0x7feaa4198ba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00e9f0 tx=0x7fea9c00eeb0 comp rx=0 tx=0).stop 2024-07-24T21:58:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.555+0000 7feaa9661640 1 -- 172.21.15.47:0/1712831283 shutdown_connections 2024-07-24T21:58:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.555+0000 7feaa9661640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fea900b3c10 0x7fea900b60d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.555+0000 7feaa9661640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaa4108b00 0x7feaa419e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.555+0000 7feaa9661640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa4108180 0x7feaa41990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.555+0000 7feaa9661640 1 --2- 172.21.15.47:0/1712831283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4102770 0x7feaa4198ba0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:09.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.555+0000 7feaa9661640 1 -- 172.21.15.47:0/1712831283 >> 172.21.15.47:0/1712831283 conn(0x7feaa40fe1c0 msgr2=0x7feaa41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:09.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.555+0000 7feaa9661640 1 -- 172.21.15.47:0/1712831283 shutdown_connections 2024-07-24T21:58:09.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:07.555+0000 7feaa9661640 1 -- 172.21.15.47:0/1712831283 wait complete. 2024-07-24T21:58:09.145 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:58:09.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:09 smithi047 ceph-mon[32551]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:09.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:09 smithi183 ceph-mon[37007]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:10.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:09 smithi188 ceph-mon[37380]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:10.567 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi047') 2024-07-24T21:58:10.567 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi047') 2024-07-24T21:58:11.764 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:58:11.886 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:11 smithi047 ceph-mon[32551]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:11.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:11 smithi183 ceph-mon[37007]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:12.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:11 smithi188 ceph-mon[37380]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:12.149 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:58:13.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:13 smithi047 ceph-mon[32551]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:13.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:13 smithi183 ceph-mon[37007]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:14.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:13 smithi188 ceph-mon[37380]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.590+0000 7f8688a4b640 1 -- 172.21.15.47:0/583705719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8684101690 msgr2=0x7f8684101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.590+0000 7f8688a4b640 1 --2- 172.21.15.47:0/583705719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8684101690 0x7f8684101a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8674009900 tx=0x7f867402a410 comp rx=0 tx=0).stop 2024-07-24T21:58:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.590+0000 7f8688a4b640 1 -- 172.21.15.47:0/583705719 shutdown_connections 2024-07-24T21:58:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.590+0000 7f8688a4b640 1 --2- 172.21.15.47:0/583705719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8684107a20 0x7f868410e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.590+0000 7f8688a4b640 1 --2- 172.21.15.47:0/583705719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86841070a0 0x7f86841074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.590+0000 7f8688a4b640 1 --2- 172.21.15.47:0/583705719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8684101690 0x7f8684101a70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.590+0000 7f8688a4b640 1 -- 172.21.15.47:0/583705719 >> 172.21.15.47:0/583705719 conn(0x7f86840fd100 msgr2=0x7f86840ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.590+0000 7f8688a4b640 1 -- 172.21.15.47:0/583705719 shutdown_connections 2024-07-24T21:58:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.590+0000 7f8688a4b640 1 -- 172.21.15.47:0/583705719 wait complete. 2024-07-24T21:58:14.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.591+0000 7f8688a4b640 1 Processor -- start 2024-07-24T21:58:14.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.591+0000 7f8688a4b640 1 -- start start 2024-07-24T21:58:14.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.591+0000 7f8688a4b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8684101690 0x7f86840fd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:14.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.591+0000 7f8688a4b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86841070a0 0x7f86840fdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:14.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.591+0000 7f8688a4b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8684107a20 0x7f86840fe080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:14.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.591+0000 7f8688a4b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86841116b0 con 0x7f86841070a0 2024-07-24T21:58:14.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.591+0000 7f8688a4b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8684111530 con 0x7f8684101690 2024-07-24T21:58:14.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.591+0000 7f8688a4b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8684111830 con 0x7f8684107a20 2024-07-24T21:58:14.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f867bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86841070a0 0x7f86840fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:14.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f867bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86841070a0 0x7f86840fdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55032/0 (socket says 172.21.15.47:55032) 2024-07-24T21:58:14.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f867bfff640 1 -- 172.21.15.47:0/2826142835 learned_addr learned my addr 172.21.15.47:0/2826142835 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:14.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f868259c640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8684101690 0x7f86840fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:14.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f8682d9d640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8684107a20 0x7f86840fe080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f867bfff640 1 -- 172.21.15.47:0/2826142835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8684107a20 msgr2=0x7f86840fe080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f867bfff640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8684107a20 0x7f86840fe080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f867bfff640 1 -- 172.21.15.47:0/2826142835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8684101690 msgr2=0x7f86840fd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f867bfff640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8684101690 0x7f86840fd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f867bfff640 1 -- 172.21.15.47:0/2826142835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86841a70d0 con 0x7f86841070a0 2024-07-24T21:58:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f8682d9d640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8684107a20 0x7f86840fe080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T21:58:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f867bfff640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86841070a0 0x7f86840fdb40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f866c00c890 tx=0x7f866c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f867b7fe640 1 -- 172.21.15.47:0/2826142835 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c004220 con 0x7f86841070a0 2024-07-24T21:58:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f8688a4b640 1 -- 172.21.15.47:0/2826142835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86841a73c0 con 0x7f86841070a0 2024-07-24T21:58:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f867b7fe640 1 -- 172.21.15.47:0/2826142835 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f866c0043c0 con 0x7f86841070a0 2024-07-24T21:58:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.592+0000 7f867b7fe640 1 -- 172.21.15.47:0/2826142835 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c004a00 con 0x7f86841070a0 2024-07-24T21:58:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.593+0000 7f8688a4b640 1 -- 172.21.15.47:0/2826142835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86841a7980 con 0x7f86841070a0 2024-07-24T21:58:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.593+0000 7f8688a4b640 1 -- 172.21.15.47:0/2826142835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8684101a70 con 0x7f86841070a0 2024-07-24T21:58:14.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.595+0000 7f867b7fe640 1 -- 172.21.15.47:0/2826142835 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f866c0079b0 con 0x7f86841070a0 2024-07-24T21:58:14.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.596+0000 7f867b7fe640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86700b3b90 0x7f86700b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:14.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.596+0000 7f868259c640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86700b3b90 0x7f86700b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:14.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.596+0000 7f867b7fe640 1 -- 172.21.15.47:0/2826142835 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f866c0e1e30 con 0x7f86841070a0 2024-07-24T21:58:14.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.596+0000 7f868259c640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86700b3b90 0x7f86700b6050 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8674031440 tx=0x7f8674005e80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:14.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.600+0000 7f867b7fe640 1 -- 172.21.15.47:0/2826142835 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f866c014030 con 0x7f86841070a0 2024-07-24T21:58:14.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.795+0000 7f8688a4b640 1 -- 172.21.15.47:0/2826142835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f868402e000 con 0x7f86841070a0 2024-07-24T21:58:14.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.799+0000 7f867b7fe640 1 -- 172.21.15.47:0/2826142835 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v32)=0 v32) ==== 120+0+0 (secure 0 0 0) 0x7f866c0aafe0 con 0x7f86841070a0 2024-07-24T21:58:14.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.801+0000 7f8688a4b640 1 -- 172.21.15.47:0/2826142835 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86700b3b90 msgr2=0x7f86700b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:14.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.801+0000 7f8688a4b640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86700b3b90 0x7f86700b6050 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8674031440 tx=0x7f8674005e80 comp rx=0 tx=0).stop 2024-07-24T21:58:14.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.801+0000 7f8688a4b640 1 -- 172.21.15.47:0/2826142835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86841070a0 msgr2=0x7f86840fdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:14.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.801+0000 7f8688a4b640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86841070a0 0x7f86840fdb40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f866c00c890 tx=0x7f866c00cd50 comp rx=0 tx=0).stop 2024-07-24T21:58:14.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.801+0000 7f8688a4b640 1 -- 172.21.15.47:0/2826142835 shutdown_connections 2024-07-24T21:58:14.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.801+0000 7f8688a4b640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86700b3b90 0x7f86700b6050 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:14.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.801+0000 7f8688a4b640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8684107a20 0x7f86840fe080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:14.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.801+0000 7f8688a4b640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86841070a0 0x7f86840fdb40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:14.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.801+0000 7f8688a4b640 1 --2- 172.21.15.47:0/2826142835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8684101690 0x7f86840fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:14.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.801+0000 7f8688a4b640 1 -- 172.21.15.47:0/2826142835 >> 172.21.15.47:0/2826142835 conn(0x7f86840fd100 msgr2=0x7f868406b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:14.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.801+0000 7f8688a4b640 1 -- 172.21.15.47:0/2826142835 shutdown_connections 2024-07-24T21:58:14.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:14.801+0000 7f8688a4b640 1 -- 172.21.15.47:0/2826142835 wait complete. 2024-07-24T21:58:15.818 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:15 smithi047 ceph-mon[32551]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:15.818 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:15 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2826142835' entity='client.admin' 2024-07-24T21:58:15.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:15 smithi183 ceph-mon[37007]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:15.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:15 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2826142835' entity='client.admin' 2024-07-24T21:58:16.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:15 smithi188 ceph-mon[37380]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:16.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:15 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2826142835' entity='client.admin' 2024-07-24T21:58:17.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.136+0000 7fea3873c640 1 -- 172.21.15.47:0/2097435562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea30107a00 msgr2=0x7fea3010e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.136+0000 7fea3873c640 1 --2- 172.21.15.47:0/2097435562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea30107a00 0x7fea3010e200 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea28009ca0 tx=0x7fea2802a8c0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.136+0000 7fea3873c640 1 -- 172.21.15.47:0/2097435562 shutdown_connections 2024-07-24T21:58:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.136+0000 7fea3873c640 1 --2- 172.21.15.47:0/2097435562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea30107a00 0x7fea3010e200 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.136+0000 7fea3873c640 1 --2- 172.21.15.47:0/2097435562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea30107080 0x7fea301074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.136+0000 7fea3873c640 1 --2- 172.21.15.47:0/2097435562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea30101670 0x7fea30101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.136+0000 7fea3873c640 1 -- 172.21.15.47:0/2097435562 >> 172.21.15.47:0/2097435562 conn(0x7fea300fd0e0 msgr2=0x7fea300ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.136+0000 7fea3873c640 1 -- 172.21.15.47:0/2097435562 shutdown_connections 2024-07-24T21:58:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.136+0000 7fea3873c640 1 -- 172.21.15.47:0/2097435562 wait complete. 2024-07-24T21:58:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.136+0000 7fea3873c640 1 Processor -- start 2024-07-24T21:58:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea3873c640 1 -- start start 2024-07-24T21:58:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea3873c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea30101670 0x7fea300fd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:17.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea3873c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea30107080 0x7fea300fdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea3873c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea30107a00 0x7fea300fe060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea3873c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fea30111630 con 0x7fea30101670 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea3873c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fea301114b0 con 0x7fea30107a00 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea3873c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fea301117b0 con 0x7fea30107080 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea364d8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea30101670 0x7fea300fd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea364d8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea30101670 0x7fea300fd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47050/0 (socket says 172.21.15.47:47050) 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea364d8640 1 -- 172.21.15.47:0/2259748448 learned_addr learned my addr 172.21.15.47:0/2259748448 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea36cd9640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea30107a00 0x7fea300fe060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea35cd7640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea30107080 0x7fea300fdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea364d8640 1 -- 172.21.15.47:0/2259748448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea30107080 msgr2=0x7fea300fdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea364d8640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea30107080 0x7fea300fdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea364d8640 1 -- 172.21.15.47:0/2259748448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea30107a00 msgr2=0x7fea300fe060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea364d8640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea30107a00 0x7fea300fe060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea364d8640 1 -- 172.21.15.47:0/2259748448 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea301a6ff0 con 0x7fea30101670 2024-07-24T21:58:17.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.137+0000 7fea364d8640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea30101670 0x7fea300fd5e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00d950 tx=0x7fea2c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:17.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.138+0000 7fea277fe640 1 -- 172.21.15.47:0/2259748448 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c017070 con 0x7fea30101670 2024-07-24T21:58:17.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.138+0000 7fea277fe640 1 -- 172.21.15.47:0/2259748448 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea2c009c30 con 0x7fea30101670 2024-07-24T21:58:17.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.138+0000 7fea277fe640 1 -- 172.21.15.47:0/2259748448 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00f620 con 0x7fea30101670 2024-07-24T21:58:17.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.138+0000 7fea3873c640 1 -- 172.21.15.47:0/2259748448 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea301a72e0 con 0x7fea30101670 2024-07-24T21:58:17.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.138+0000 7fea3873c640 1 -- 172.21.15.47:0/2259748448 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea301a7870 con 0x7fea30101670 2024-07-24T21:58:17.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.139+0000 7fea3873c640 1 -- 172.21.15.47:0/2259748448 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea30101a50 con 0x7fea30101670 2024-07-24T21:58:17.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.140+0000 7fea277fe640 1 -- 172.21.15.47:0/2259748448 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fea2c010460 con 0x7fea30101670 2024-07-24T21:58:17.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.141+0000 7fea277fe640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fea1c0b3c90 0x7fea1c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:17.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.141+0000 7fea35cd7640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fea1c0b3c90 0x7fea1c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:17.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.141+0000 7fea277fe640 1 -- 172.21.15.47:0/2259748448 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fea2c0e1bb0 con 0x7fea30101670 2024-07-24T21:58:17.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.142+0000 7fea35cd7640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fea1c0b3c90 0x7fea1c0b6150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea300ff0d0 tx=0x7fea2000b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:17.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.144+0000 7fea277fe640 1 -- 172.21.15.47:0/2259748448 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fea2c009de0 con 0x7fea30101670 2024-07-24T21:58:17.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.316+0000 7f67fed37640 1 -- 172.21.15.47:0/2656410861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f8103f80 msgr2=0x7f67f810c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:17.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.316+0000 7f67fed37640 1 --2- 172.21.15.47:0/2656410861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f8103f80 0x7f67f810c470 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009900 tx=0x7f67e402a410 comp rx=0 tx=0).stop 2024-07-24T21:58:17.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.316+0000 7f67fed37640 1 -- 172.21.15.47:0/2656410861 shutdown_connections 2024-07-24T21:58:17.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.316+0000 7f67fed37640 1 --2- 172.21.15.47:0/2656410861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67f810cac0 0x7f67f810ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.316+0000 7f67fed37640 1 --2- 172.21.15.47:0/2656410861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f8103f80 0x7f67f810c470 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.316+0000 7f67fed37640 1 --2- 172.21.15.47:0/2656410861 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67f8103660 0x7f67f8103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.316+0000 7f67fed37640 1 -- 172.21.15.47:0/2656410861 >> 172.21.15.47:0/2656410861 conn(0x7f67f80fd0c0 msgr2=0x7f67f80ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:17.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.316+0000 7f67fed37640 1 -- 172.21.15.47:0/2656410861 shutdown_connections 2024-07-24T21:58:17.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.316+0000 7f67fed37640 1 -- 172.21.15.47:0/2656410861 wait complete. 2024-07-24T21:58:17.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.318+0000 7f67fed37640 1 Processor -- start 2024-07-24T21:58:17.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.318+0000 7f67fed37640 1 -- start start 2024-07-24T21:58:17.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.318+0000 7f67fed37640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67f8103660 0x7f67f8198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:17.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.318+0000 7f67fed37640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f8103f80 0x7f67f8199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:17.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.318+0000 7f67f7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f8103f80 0x7f67f8199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:17.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.318+0000 7f67f7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f8103f80 0x7f67f8199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47070/0 (socket says 172.21.15.47:47070) 2024-07-24T21:58:17.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.318+0000 7f67f7fff640 1 -- 172.21.15.47:0/518562882 learned_addr learned my addr 172.21.15.47:0/518562882 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:17.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.318+0000 7f67fed37640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67f810cac0 0x7f67f819e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:17.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.318+0000 7f67fed37640 1 -- 172.21.15.47:0/518562882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f67f8112790 con 0x7f67f8103f80 2024-07-24T21:58:17.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.318+0000 7f67fed37640 1 -- 172.21.15.47:0/518562882 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f67f8112610 con 0x7f67f810cac0 2024-07-24T21:58:17.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.318+0000 7f67fed37640 1 -- 172.21.15.47:0/518562882 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f67f8112910 con 0x7f67f8103660 2024-07-24T21:58:17.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.319+0000 7f67fd2d4640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67f810cac0 0x7f67f819e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:17.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.319+0000 7f67f7fff640 1 -- 172.21.15.47:0/518562882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67f8103660 msgr2=0x7f67f8198d20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T21:58:17.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.319+0000 7f67f7fff640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67f8103660 0x7f67f8198d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.319+0000 7f67f7fff640 1 -- 172.21.15.47:0/518562882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67f810cac0 msgr2=0x7f67f819e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:17.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.319+0000 7f67f7fff640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67f810cac0 0x7f67f819e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.319+0000 7f67f7fff640 1 -- 172.21.15.47:0/518562882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f819edd0 con 0x7f67f8103f80 2024-07-24T21:58:17.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.319+0000 7f67fd2d4640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67f810cac0 0x7f67f819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T21:58:17.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.319+0000 7f67f7fff640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f8103f80 0x7f67f8199260 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f67e4006010 tx=0x7f67e4004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:17.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.319+0000 7f67f5ffb640 1 -- 172.21.15.47:0/518562882 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e403f030 con 0x7f67f8103f80 2024-07-24T21:58:17.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.319+0000 7f67f5ffb640 1 -- 172.21.15.47:0/518562882 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67e4003aa0 con 0x7f67f8103f80 2024-07-24T21:58:17.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.319+0000 7f67f5ffb640 1 -- 172.21.15.47:0/518562882 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e4035070 con 0x7f67f8103f80 2024-07-24T21:58:17.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.319+0000 7f67fed37640 1 -- 172.21.15.47:0/518562882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f819f060 con 0x7f67f8103f80 2024-07-24T21:58:17.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.320+0000 7f67fed37640 1 -- 172.21.15.47:0/518562882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f81011f0 con 0x7f67f8103f80 2024-07-24T21:58:17.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.321+0000 7f67fed37640 1 -- 172.21.15.47:0/518562882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67f8103a40 con 0x7f67f8103f80 2024-07-24T21:58:17.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.323+0000 7f67f5ffb640 1 -- 172.21.15.47:0/518562882 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f67e4042030 con 0x7f67f8103f80 2024-07-24T21:58:17.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.324+0000 7f67f5ffb640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f67e80b7fa0 0x7f67e80ba460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:17.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.324+0000 7f67fcad3640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f67e80b7fa0 0x7f67e80ba460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:17.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.324+0000 7f67f5ffb640 1 -- 172.21.15.47:0/518562882 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f67e41029b0 con 0x7f67f8103f80 2024-07-24T21:58:17.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.324+0000 7f67fcad3640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f67e80b7fa0 0x7f67e80ba460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009670 tx=0x7f67ec006bd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:17.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.330+0000 7f67f5ffb640 1 -- 172.21.15.47:0/518562882 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f67e40cbb60 con 0x7f67f8103f80 2024-07-24T21:58:17.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.353+0000 7fea3873c640 1 -- 172.21.15.47:0/2259748448 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fea300fe8e0 con 0x7fea30101670 2024-07-24T21:58:17.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.357+0000 7fea277fe640 1 -- 172.21.15.47:0/2259748448 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v33)=0 v33) ==== 127+0+0 (secure 0 0 0) 0x7fea2c0aa790 con 0x7fea30101670 2024-07-24T21:58:17.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.359+0000 7fea3873c640 1 -- 172.21.15.47:0/2259748448 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fea1c0b3c90 msgr2=0x7fea1c0b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:17.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.359+0000 7fea3873c640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fea1c0b3c90 0x7fea1c0b6150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea300ff0d0 tx=0x7fea2000b390 comp rx=0 tx=0).stop 2024-07-24T21:58:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.359+0000 7fea3873c640 1 -- 172.21.15.47:0/2259748448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea30101670 msgr2=0x7fea300fd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.359+0000 7fea3873c640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea30101670 0x7fea300fd5e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00d950 tx=0x7fea2c00de10 comp rx=0 tx=0).stop 2024-07-24T21:58:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.360+0000 7fea3873c640 1 -- 172.21.15.47:0/2259748448 shutdown_connections 2024-07-24T21:58:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.360+0000 7fea3873c640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fea1c0b3c90 0x7fea1c0b6150 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.360+0000 7fea3873c640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea30107a00 0x7fea300fe060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.360+0000 7fea3873c640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea30107080 0x7fea300fdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.360+0000 7fea3873c640 1 --2- 172.21.15.47:0/2259748448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea30101670 0x7fea300fd5e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.360+0000 7fea3873c640 1 -- 172.21.15.47:0/2259748448 >> 172.21.15.47:0/2259748448 conn(0x7fea300fd0e0 msgr2=0x7fea3006af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.360+0000 7fea3873c640 1 -- 172.21.15.47:0/2259748448 shutdown_connections 2024-07-24T21:58:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.360+0000 7fea3873c640 1 -- 172.21.15.47:0/2259748448 wait complete. 2024-07-24T21:58:17.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.533+0000 7f67fed37640 1 -- 172.21.15.47:0/518562882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f67f8199e50 con 0x7f67f8103f80 2024-07-24T21:58:17.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.537+0000 7f67f5ffb640 1 -- 172.21.15.47:0/518562882 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v34)=0 v34) ==== 129+0+0 (secure 0 0 0) 0x7f67e40cb460 con 0x7f67f8103f80 2024-07-24T21:58:17.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.539+0000 7f67fed37640 1 -- 172.21.15.47:0/518562882 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f67e80b7fa0 msgr2=0x7f67e80ba460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:17.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.539+0000 7f67fed37640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f67e80b7fa0 0x7f67e80ba460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009670 tx=0x7f67ec006bd0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.539+0000 7f67fed37640 1 -- 172.21.15.47:0/518562882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f8103f80 msgr2=0x7f67f8199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:17.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.539+0000 7f67fed37640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f8103f80 0x7f67f8199260 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f67e4006010 tx=0x7f67e4004060 comp rx=0 tx=0).stop 2024-07-24T21:58:17.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.539+0000 7f67fed37640 1 -- 172.21.15.47:0/518562882 shutdown_connections 2024-07-24T21:58:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.539+0000 7f67fed37640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f67e80b7fa0 0x7f67e80ba460 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.539+0000 7f67fed37640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67f810cac0 0x7f67f819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.539+0000 7f67fed37640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f8103f80 0x7f67f8199260 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.539+0000 7f67fed37640 1 --2- 172.21.15.47:0/518562882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67f8103660 0x7f67f8198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.539+0000 7f67fed37640 1 -- 172.21.15.47:0/518562882 >> 172.21.15.47:0/518562882 conn(0x7f67f80fd0c0 msgr2=0x7f67f80fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.540+0000 7f67fed37640 1 -- 172.21.15.47:0/518562882 shutdown_connections 2024-07-24T21:58:17.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:17.540+0000 7f67fed37640 1 -- 172.21.15.47:0/518562882 wait complete. 2024-07-24T21:58:17.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:17 smithi183 ceph-mon[37007]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:17.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:17 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2259748448' entity='client.admin' 2024-07-24T21:58:17.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:17 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/518562882' entity='client.admin' 2024-07-24T21:58:17.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:17.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:17.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:17.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:17 smithi047 ceph-mon[32551]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:17 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2259748448' entity='client.admin' 2024-07-24T21:58:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:17 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/518562882' entity='client.admin' 2024-07-24T21:58:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:18.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:17 smithi188 ceph-mon[37380]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:18.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:17 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2259748448' entity='client.admin' 2024-07-24T21:58:18.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:17 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/518562882' entity='client.admin' 2024-07-24T21:58:18.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:18.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:18.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:18.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:18.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.446+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2356703297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd004102770 msgr2=0x7fd004102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:18.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.446+0000 7fd00a6a7640 1 --2- 172.21.15.47:0/2356703297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd004102770 0x7fd004102b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009900 tx=0x7fcff402a410 comp rx=0 tx=0).stop 2024-07-24T21:58:18.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.446+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2356703297 shutdown_connections 2024-07-24T21:58:18.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.446+0000 7fd00a6a7640 1 --2- 172.21.15.47:0/2356703297 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd004108b00 0x7fd00410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.446+0000 7fd00a6a7640 1 --2- 172.21.15.47:0/2356703297 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd004108180 0x7fd0041085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.446+0000 7fd00a6a7640 1 --2- 172.21.15.47:0/2356703297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd004102770 0x7fd004102b50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.446+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2356703297 >> 172.21.15.47:0/2356703297 conn(0x7fd0040fe240 msgr2=0x7fd004100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.446+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2356703297 shutdown_connections 2024-07-24T21:58:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.446+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2356703297 wait complete. 2024-07-24T21:58:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.447+0000 7fd00a6a7640 1 Processor -- start 2024-07-24T21:58:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.447+0000 7fd00a6a7640 1 -- start start 2024-07-24T21:58:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.447+0000 7fd00a6a7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd004102770 0x7fd00419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.447+0000 7fd00a6a7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd004108180 0x7fd00419b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.447+0000 7fd00a6a7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd004108b00 0x7fd0041a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.447+0000 7fd00a6a7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd004112780 con 0x7fd004108180 2024-07-24T21:58:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.447+0000 7fd00a6a7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd004112600 con 0x7fd004108b00 2024-07-24T21:58:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.447+0000 7fd00a6a7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd004112900 con 0x7fd004102770 2024-07-24T21:58:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.447+0000 7fd0037fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd004108180 0x7fd00419b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.447+0000 7fd0037fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd004108180 0x7fd00419b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47094/0 (socket says 172.21.15.47:47094) 2024-07-24T21:58:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.447+0000 7fd0037fe640 1 -- 172.21.15.47:0/2887376037 learned_addr learned my addr 172.21.15.47:0/2887376037 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.447+0000 7fd008c44640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd004108b00 0x7fd0041a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.448+0000 7fd003fff640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd004102770 0x7fd00419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.448+0000 7fd0037fe640 1 -- 172.21.15.47:0/2887376037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd004102770 msgr2=0x7fd00419aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.448+0000 7fd0037fe640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd004102770 0x7fd00419aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.448+0000 7fd0037fe640 1 -- 172.21.15.47:0/2887376037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd004108b00 msgr2=0x7fd0041a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.448+0000 7fd0037fe640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd004108b00 0x7fd0041a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.448+0000 7fd0037fe640 1 -- 172.21.15.47:0/2887376037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0041a0f50 con 0x7fd004108180 2024-07-24T21:58:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.448+0000 7fd0037fe640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd004108180 0x7fd00419b3e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcff800c970 tx=0x7fcff800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.448+0000 7fd0017fa640 1 -- 172.21.15.47:0/2887376037 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff8007bb0 con 0x7fd004108180 2024-07-24T21:58:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.448+0000 7fd0017fa640 1 -- 172.21.15.47:0/2887376037 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcff8007d50 con 0x7fd004108180 2024-07-24T21:58:18.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.448+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2887376037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0041a1240 con 0x7fd004108180 2024-07-24T21:58:18.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.448+0000 7fd0017fa640 1 -- 172.21.15.47:0/2887376037 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff800f450 con 0x7fd004108180 2024-07-24T21:58:18.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.448+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2887376037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0041a7900 con 0x7fd004108180 2024-07-24T21:58:18.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.449+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2887376037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd004102b50 con 0x7fd004108180 2024-07-24T21:58:18.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.451+0000 7fd0017fa640 1 -- 172.21.15.47:0/2887376037 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fcff8004f00 con 0x7fd004108180 2024-07-24T21:58:18.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.452+0000 7fd0017fa640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcfec0b3c10 0x7fcfec0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:18.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.452+0000 7fd003fff640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcfec0b3c10 0x7fcfec0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:18.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.452+0000 7fd0017fa640 1 -- 172.21.15.47:0/2887376037 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fcff80e2050 con 0x7fd004108180 2024-07-24T21:58:18.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.453+0000 7fd003fff640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcfec0b3c10 0x7fcfec0b60d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcff4005ab0 tx=0x7fcff4005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:18.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.455+0000 7fd0017fa640 1 -- 172.21.15.47:0/2887376037 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fcff8014030 con 0x7fd004108180 2024-07-24T21:58:18.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.651+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2887376037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fd00419bfd0 con 0x7fd004108180 2024-07-24T21:58:18.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.655+0000 7fd0017fa640 1 -- 172.21.15.47:0/2887376037 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v35)=0 v35) ==== 106+0+0 (secure 0 0 0) 0x7fd00419bfd0 con 0x7fd004108180 2024-07-24T21:58:18.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.657+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2887376037 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcfec0b3c10 msgr2=0x7fcfec0b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:18.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.657+0000 7fd00a6a7640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcfec0b3c10 0x7fcfec0b60d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcff4005ab0 tx=0x7fcff4005a20 comp rx=0 tx=0).stop 2024-07-24T21:58:18.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.657+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2887376037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd004108180 msgr2=0x7fd00419b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:18.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.657+0000 7fd00a6a7640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd004108180 0x7fd00419b3e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcff800c970 tx=0x7fcff800ce30 comp rx=0 tx=0).stop 2024-07-24T21:58:18.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.657+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2887376037 shutdown_connections 2024-07-24T21:58:18.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.657+0000 7fd00a6a7640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcfec0b3c10 0x7fcfec0b60d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:18.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.657+0000 7fd00a6a7640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd004108b00 0x7fd0041a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:18.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.657+0000 7fd00a6a7640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd004108180 0x7fd00419b3e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:18.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.657+0000 7fd00a6a7640 1 --2- 172.21.15.47:0/2887376037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd004102770 0x7fd00419aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:18.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.657+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2887376037 >> 172.21.15.47:0/2887376037 conn(0x7fd0040fe240 msgr2=0x7fd0041067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:18.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.657+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2887376037 shutdown_connections 2024-07-24T21:58:18.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:18.657+0000 7fd00a6a7640 1 -- 172.21.15.47:0/2887376037 wait complete. 2024-07-24T21:58:19.364 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.365 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.365 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.365 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.365 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.365 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.365 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.365 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.366 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.366 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.366 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.366 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.366 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.366 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.366 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.366 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.366 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.367 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '46bf760a-4a07-11ef-bcad-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi047') 2024-07-24T21:58:19.367 INFO:tasks.cephadm:Deploying OSDs... 2024-07-24T21:58:19.367 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T21:58:19.367 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-07-24T21:58:19.384 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-07-24T21:58:19.385 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-07-24T21:58:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-07-24T21:58:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T21:58:19.441 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-07-24T21:58:19.441 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T21:58:19.441 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T21:58:19.441 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-07-24 21:56:25.777184460 +0000 2024-07-24T21:58:19.442 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-07-24 21:51:53.365178266 +0000 2024-07-24T21:58:19.442 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-07-24 21:51:53.365178266 +0000 2024-07-24T21:58:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-07-24 21:51:53.365178266 +0000 2024-07-24T21:58:19.442 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-07-24T21:58:19.508 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-07-24T21:58:19.508 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-07-24T21:58:19.508 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000118577 s, 4.3 MB/s 2024-07-24T21:58:19.509 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-07-24T21:58:19.566 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-07-24T21:58:19.622 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-07-24T21:58:19.623 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T21:58:19.623 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 693 Links: 1 2024-07-24T21:58:19.623 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T21:58:19.623 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T21:58:19.623 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-07-24 21:56:25.813183716 +0000 2024-07-24T21:58:19.623 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-07-24 21:51:53.692171295 +0000 2024-07-24T21:58:19.623 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-07-24 21:51:53.692171295 +0000 2024-07-24T21:58:19.623 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-07-24 21:51:53.692171295 +0000 2024-07-24T21:58:19.623 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-07-24T21:58:19.687 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-07-24T21:58:19.687 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-07-24T21:58:19.687 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000110235 s, 4.6 MB/s 2024-07-24T21:58:19.688 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-07-24T21:58:19.745 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-07-24T21:58:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-07-24T21:58:19.801 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T21:58:19.801 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 710 Links: 1 2024-07-24T21:58:19.802 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T21:58:19.802 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T21:58:19.802 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-07-24 21:56:25.847183013 +0000 2024-07-24T21:58:19.802 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-07-24 21:51:54.051163643 +0000 2024-07-24T21:58:19.802 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-07-24 21:51:54.051163643 +0000 2024-07-24T21:58:19.802 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-07-24 21:51:54.051163643 +0000 2024-07-24T21:58:19.802 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-07-24T21:58:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-07-24T21:58:19.866 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-07-24T21:58:19.866 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000109476 s, 4.7 MB/s 2024-07-24T21:58:19.867 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-07-24T21:58:19.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:19 smithi183 ceph-mon[37007]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:19 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2887376037' entity='client.admin' 2024-07-24T21:58:19.924 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-07-24T21:58:19.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:19 smithi047 ceph-mon[32551]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:19.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:19 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2887376037' entity='client.admin' 2024-07-24T21:58:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-07-24T21:58:19.951 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T21:58:19.951 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 729 Links: 1 2024-07-24T21:58:19.951 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T21:58:19.951 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T21:58:19.951 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-07-24 21:56:25.890182124 +0000 2024-07-24T21:58:19.951 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-07-24 21:51:54.388156460 +0000 2024-07-24T21:58:19.951 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-07-24 21:51:54.388156460 +0000 2024-07-24T21:58:19.952 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-07-24 21:51:54.388156460 +0000 2024-07-24T21:58:19.952 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-07-24T21:58:20.015 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-07-24T21:58:20.016 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-07-24T21:58:20.016 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000110469 s, 4.6 MB/s 2024-07-24T21:58:20.017 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-07-24T21:58:20.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:19 smithi188 ceph-mon[37380]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:20.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:19 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2887376037' entity='client.admin' 2024-07-24T21:58:20.074 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-07-24T21:58:20.074 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2024-07-24T21:58:20.094 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-07-24T21:58:20.095 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2024-07-24T21:58:20.153 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-07-24T21:58:20.153 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T21:58:20.153 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-07-24T21:58:20.154 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T21:58:20.154 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T21:58:20.154 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-07-24 21:57:34.804737983 +0000 2024-07-24T21:58:20.154 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-07-24 21:51:55.803175283 +0000 2024-07-24T21:58:20.154 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-07-24 21:51:55.803175283 +0000 2024-07-24T21:58:20.154 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-07-24 21:51:55.803175283 +0000 2024-07-24T21:58:20.154 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-07-24T21:58:20.224 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-07-24T21:58:20.224 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-07-24T21:58:20.224 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000261791 s, 2.0 MB/s 2024-07-24T21:58:20.225 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-07-24T21:58:20.284 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2024-07-24T21:58:20.343 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-07-24T21:58:20.343 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T21:58:20.343 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-07-24T21:58:20.343 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T21:58:20.343 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T21:58:20.343 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-07-24 21:57:34.804737983 +0000 2024-07-24T21:58:20.343 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-07-24 21:51:56.129166439 +0000 2024-07-24T21:58:20.344 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-07-24 21:51:56.129166439 +0000 2024-07-24T21:58:20.344 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-07-24 21:51:56.129166439 +0000 2024-07-24T21:58:20.344 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-07-24T21:58:20.410 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-07-24T21:58:20.499 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-07-24T21:58:20.502 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000221048 s, 2.3 MB/s 2024-07-24T21:58:20.504 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-07-24T21:58:20.569 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2024-07-24T21:58:20.629 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-07-24T21:58:20.629 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T21:58:20.629 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-07-24T21:58:20.629 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T21:58:20.629 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T21:58:20.629 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-07-24 21:57:34.805737956 +0000 2024-07-24T21:58:20.629 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-07-24 21:51:56.451157704 +0000 2024-07-24T21:58:20.629 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-07-24 21:51:56.451157704 +0000 2024-07-24T21:58:20.629 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-07-24 21:51:56.451157704 +0000 2024-07-24T21:58:20.630 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-07-24T21:58:20.696 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-07-24T21:58:20.697 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-07-24T21:58:20.697 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000260027 s, 2.0 MB/s 2024-07-24T21:58:20.698 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-07-24T21:58:20.756 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2024-07-24T21:58:20.813 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-07-24T21:58:20.813 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T21:58:20.813 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-07-24T21:58:20.813 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T21:58:20.813 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T21:58:20.814 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-07-24 21:57:34.805737956 +0000 2024-07-24T21:58:20.814 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-07-24 21:51:56.776148888 +0000 2024-07-24T21:58:20.814 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-07-24 21:51:56.776148888 +0000 2024-07-24T21:58:20.814 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-07-24 21:51:56.776148888 +0000 2024-07-24T21:58:20.814 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-07-24T21:58:20.876 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-07-24T21:58:20.876 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-07-24T21:58:20.877 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000221638 s, 2.3 MB/s 2024-07-24T21:58:20.878 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-07-24T21:58:20.934 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-07-24T21:58:20.934 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/scratch_devs of=/dev/stdout 2024-07-24T21:58:20.954 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-07-24T21:58:20.954 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_1 2024-07-24T21:58:21.012 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-07-24T21:58:21.012 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T21:58:21.012 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-07-24T21:58:21.012 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T21:58:21.012 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T21:58:21.012 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-07-24 21:57:32.343659667 +0000 2024-07-24T21:58:21.012 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-07-24 21:51:58.369851833 +0000 2024-07-24T21:58:21.012 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-07-24 21:51:58.369851833 +0000 2024-07-24T21:58:21.012 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-07-24 21:51:58.369851833 +0000 2024-07-24T21:58:21.013 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-07-24T21:58:21.080 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-07-24T21:58:21.080 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-07-24T21:58:21.080 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000302466 s, 1.7 MB/s 2024-07-24T21:58:21.082 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-07-24T21:58:21.140 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_2 2024-07-24T21:58:21.196 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-07-24T21:58:21.196 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T21:58:21.197 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-07-24T21:58:21.197 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T21:58:21.197 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T21:58:21.197 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-07-24 21:57:32.343659667 +0000 2024-07-24T21:58:21.197 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-07-24 21:51:58.695845502 +0000 2024-07-24T21:58:21.197 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-07-24 21:51:58.695845502 +0000 2024-07-24T21:58:21.197 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-07-24 21:51:58.695845502 +0000 2024-07-24T21:58:21.198 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-07-24T21:58:21.261 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-07-24T21:58:21.261 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-07-24T21:58:21.262 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000230425 s, 2.2 MB/s 2024-07-24T21:58:21.262 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-07-24T21:58:21.319 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_3 2024-07-24T21:58:21.375 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-07-24T21:58:21.375 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T21:58:21.375 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-07-24T21:58:21.376 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T21:58:21.376 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T21:58:21.376 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-07-24 21:57:32.343659667 +0000 2024-07-24T21:58:21.376 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-07-24 21:51:59.027839056 +0000 2024-07-24T21:58:21.376 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-07-24 21:51:59.027839056 +0000 2024-07-24T21:58:21.376 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-07-24 21:51:59.027839056 +0000 2024-07-24T21:58:21.376 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-07-24T21:58:21.439 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-07-24T21:58:21.439 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-07-24T21:58:21.439 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000266245 s, 1.9 MB/s 2024-07-24T21:58:21.440 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-07-24T21:58:21.496 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_4 2024-07-24T21:58:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-07-24T21:58:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T21:58:21.551 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-07-24T21:58:21.552 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T21:58:21.552 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T21:58:21.552 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-07-24 21:57:32.344659649 +0000 2024-07-24T21:58:21.552 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-07-24 21:51:59.350832784 +0000 2024-07-24T21:58:21.552 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-07-24 21:51:59.350832784 +0000 2024-07-24T21:58:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-07-24 21:51:59.350832784 +0000 2024-07-24T21:58:21.552 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-07-24T21:58:21.614 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-07-24T21:58:21.614 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-07-24T21:58:21.614 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000201422 s, 2.5 MB/s 2024-07-24T21:58:21.615 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-07-24T21:58:21.671 INFO:tasks.cephadm:Deploying osd.0 on smithi047 with /dev/vg_nvme/lv_4... 2024-07-24T21:58:21.671 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-07-24T21:58:21.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:21 smithi188 ceph-mon[37380]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:21.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:21 smithi183 ceph-mon[37007]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:21.939 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:21 smithi047 ceph-mon[32551]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:21.942 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:58:23.506 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-07-24T21:58:23.603 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-07-24T21:58:23.613 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-07-24T21:58:23.613 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-07-24T21:58:23.613 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00848629 s, 1.2 GB/s 2024-07-24T21:58:23.614 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-07-24T21:58:23.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:23 smithi047 ceph-mon[32551]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:24.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:23 smithi188 ceph-mon[37380]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:24.140 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_4 2024-07-24T21:58:24.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:23 smithi183 ceph-mon[37007]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:24.403 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:58:24.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:24 smithi047 ceph-mon[32551]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:25.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:24 smithi188 ceph-mon[37380]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:25.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:24 smithi183 ceph-mon[37007]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:25.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.921+0000 7fcd0f319640 1 -- 172.21.15.47:0/1587676292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd081079e0 msgr2=0x7fcd0810e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:25.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.921+0000 7fcd0f319640 1 --2- 172.21.15.47:0/1587676292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd081079e0 0x7fcd0810e1e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009900 tx=0x7fcd0002a410 comp rx=0 tx=0).stop 2024-07-24T21:58:25.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.921+0000 7fcd0f319640 1 -- 172.21.15.47:0/1587676292 shutdown_connections 2024-07-24T21:58:25.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.921+0000 7fcd0f319640 1 --2- 172.21.15.47:0/1587676292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd081079e0 0x7fcd0810e1e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:25.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.921+0000 7fcd0f319640 1 --2- 172.21.15.47:0/1587676292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd08107060 0x7fcd081074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:25.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.921+0000 7fcd0f319640 1 --2- 172.21.15.47:0/1587676292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd08101650 0x7fcd08101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:25.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.921+0000 7fcd0f319640 1 -- 172.21.15.47:0/1587676292 >> 172.21.15.47:0/1587676292 conn(0x7fcd080fd0c0 msgr2=0x7fcd080ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:25.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.921+0000 7fcd0f319640 1 -- 172.21.15.47:0/1587676292 shutdown_connections 2024-07-24T21:58:25.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.921+0000 7fcd0f319640 1 -- 172.21.15.47:0/1587676292 wait complete. 2024-07-24T21:58:25.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0f319640 1 Processor -- start 2024-07-24T21:58:25.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0f319640 1 -- start start 2024-07-24T21:58:25.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0f319640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd08101650 0x7fcd08198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:25.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0f319640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd08107060 0x7fcd081990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:25.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0f319640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd081079e0 0x7fcd0819e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:25.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0f319640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcd08111610 con 0x7fcd08107060 2024-07-24T21:58:25.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0f319640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcd08111490 con 0x7fcd08101650 2024-07-24T21:58:25.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0f319640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcd08111790 con 0x7fcd081079e0 2024-07-24T21:58:25.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0c8b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd08107060 0x7fcd081990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:25.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0c8b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd08107060 0x7fcd081990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53558/0 (socket says 172.21.15.47:53558) 2024-07-24T21:58:25.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0c8b4640 1 -- 172.21.15.47:0/567506587 learned_addr learned my addr 172.21.15.47:0/567506587 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:58:25.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0d8b6640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd081079e0 0x7fcd0819e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:25.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0d0b5640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd08101650 0x7fcd08198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:25.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0c8b4640 1 -- 172.21.15.47:0/567506587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd081079e0 msgr2=0x7fcd0819e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:25.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0c8b4640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd081079e0 0x7fcd0819e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:25.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0c8b4640 1 -- 172.21.15.47:0/567506587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd08101650 msgr2=0x7fcd08198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:25.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0c8b4640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd08101650 0x7fcd08198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:25.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.922+0000 7fcd0c8b4640 1 -- 172.21.15.47:0/567506587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0819ec20 con 0x7fcd08107060 2024-07-24T21:58:25.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.923+0000 7fcd0c8b4640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd08107060 0x7fcd081990b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c920 tx=0x7fccfc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:25.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.923+0000 7fcd067fc640 1 -- 172.21.15.47:0/567506587 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc007c70 con 0x7fcd08107060 2024-07-24T21:58:25.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.923+0000 7fcd067fc640 1 -- 172.21.15.47:0/567506587 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccfc007e10 con 0x7fcd08107060 2024-07-24T21:58:25.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.923+0000 7fcd0f319640 1 -- 172.21.15.47:0/567506587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0819ef10 con 0x7fcd08107060 2024-07-24T21:58:25.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.923+0000 7fcd067fc640 1 -- 172.21.15.47:0/567506587 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc018820 con 0x7fcd08107060 2024-07-24T21:58:25.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.923+0000 7fcd0f319640 1 -- 172.21.15.47:0/567506587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd081a55d0 con 0x7fcd08107060 2024-07-24T21:58:25.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.924+0000 7fcd0f319640 1 -- 172.21.15.47:0/567506587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd08101a30 con 0x7fcd08107060 2024-07-24T21:58:25.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.925+0000 7fcd067fc640 1 -- 172.21.15.47:0/567506587 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fccfc00f450 con 0x7fcd08107060 2024-07-24T21:58:25.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.926+0000 7fcd067fc640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fccf00b3c10 0x7fccf00b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:25.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.926+0000 7fcd0d0b5640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fccf00b3c10 0x7fccf00b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:25.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.926+0000 7fcd067fc640 1 -- 172.21.15.47:0/567506587 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fccfc0e2490 con 0x7fcd08107060 2024-07-24T21:58:25.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.926+0000 7fcd0d0b5640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fccf00b3c10 0x7fccf00b60d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fccf8005fd0 tx=0x7fccf8009500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:25.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:25.929+0000 7fcd067fc640 1 -- 172.21.15.47:0/567506587 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fccfc014030 con 0x7fcd08107060 2024-07-24T21:58:26.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:26.132+0000 7fcd0f319640 1 -- 172.21.15.47:0/567506587 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fcd08062f80 con 0x7fccf00b3c10 2024-07-24T21:58:27.115 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:27 smithi047 ceph-mon[32551]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:27.116 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:27 smithi047 ceph-mon[32551]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:58:27.116 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:58:27.116 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:58:27.116 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:27.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:27 smithi183 ceph-mon[37007]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:27.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:27 smithi183 ceph-mon[37007]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:58:27.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:58:27.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:58:27.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:27.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:27 smithi188 ceph-mon[37380]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:27.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:27 smithi188 ceph-mon[37380]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:58:27.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:58:27.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:58:27.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:29 smithi183 ceph-mon[37007]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:29 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1252529844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60de2c3d-e4b7-4878-bdbb-ce3257e3706c"}]: dispatch 2024-07-24T21:58:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:29 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1252529844' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60de2c3d-e4b7-4878-bdbb-ce3257e3706c"}]': finished 2024-07-24T21:58:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:29 smithi183 ceph-mon[37007]: osdmap e6: 1 total, 0 up, 1 in 2024-07-24T21:58:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:29 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:29 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/685257048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:58:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:29 smithi047 ceph-mon[32551]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:29 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1252529844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60de2c3d-e4b7-4878-bdbb-ce3257e3706c"}]: dispatch 2024-07-24T21:58:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:29 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1252529844' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60de2c3d-e4b7-4878-bdbb-ce3257e3706c"}]': finished 2024-07-24T21:58:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:29 smithi047 ceph-mon[32551]: osdmap e6: 1 total, 0 up, 1 in 2024-07-24T21:58:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:29 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:29 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/685257048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:58:29.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:29 smithi188 ceph-mon[37380]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:29.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:29 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1252529844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60de2c3d-e4b7-4878-bdbb-ce3257e3706c"}]: dispatch 2024-07-24T21:58:29.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:29 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1252529844' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60de2c3d-e4b7-4878-bdbb-ce3257e3706c"}]': finished 2024-07-24T21:58:29.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:29 smithi188 ceph-mon[37380]: osdmap e6: 1 total, 0 up, 1 in 2024-07-24T21:58:29.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:29 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:29.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:29 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/685257048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:58:31.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:31 smithi183 ceph-mon[37007]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:31.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:31 smithi047 ceph-mon[32551]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:31.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:31 smithi188 ceph-mon[37380]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:33.269 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:33 smithi047 ceph-mon[32551]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:33.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:33 smithi183 ceph-mon[37007]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:33.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:33 smithi188 ceph-mon[37380]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:35.393 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:35 smithi047 ceph-mon[32551]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:35.394 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-07-24T21:58:35.394 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:35.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:35 smithi183 ceph-mon[37007]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:35.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-07-24T21:58:35.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:35.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:35 smithi188 ceph-mon[37380]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:35.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-07-24T21:58:35.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:36.315 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:36 smithi047 ceph-mon[32551]: Deploying daemon osd.0 on smithi047 2024-07-24T21:58:36.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:36 smithi183 ceph-mon[37007]: Deploying daemon osd.0 on smithi047 2024-07-24T21:58:36.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:36 smithi188 ceph-mon[37380]: Deploying daemon osd.0 on smithi047 2024-07-24T21:58:37.403 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:37 smithi047 ceph-mon[32551]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:37.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:37 smithi183 ceph-mon[37007]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:37.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:37 smithi188 ceph-mon[37380]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:39.384 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:39 smithi047 ceph-mon[32551]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:39.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:39 smithi183 ceph-mon[37007]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:39.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:39 smithi188 ceph-mon[37380]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:40.183 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:40 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:40.183 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:40 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:40.183 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:40 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:40.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:40 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:40.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:40 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:40.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:40 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:40.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:40 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:40.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:40 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:40.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:40 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:41 smithi047 ceph-mon[32551]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:41.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:41 smithi188 ceph-mon[37380]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:41.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:41 smithi183 ceph-mon[37007]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:42.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:42.633+0000 7fcd067fc640 1 -- 172.21.15.47:0/567506587 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcd08062f80 con 0x7fccf00b3c10 2024-07-24T21:58:42.636 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 0 on host 'smithi047' 2024-07-24T21:58:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:42.636+0000 7fcd0f319640 1 -- 172.21.15.47:0/567506587 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fccf00b3c10 msgr2=0x7fccf00b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:42.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:42.636+0000 7fcd0f319640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fccf00b3c10 0x7fccf00b60d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fccf8005fd0 tx=0x7fccf8009500 comp rx=0 tx=0).stop 2024-07-24T21:58:42.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:42.636+0000 7fcd0f319640 1 -- 172.21.15.47:0/567506587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd08107060 msgr2=0x7fcd081990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:42.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:42.636+0000 7fcd0f319640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd08107060 0x7fcd081990b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c920 tx=0x7fccfc00cde0 comp rx=0 tx=0).stop 2024-07-24T21:58:42.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:42.637+0000 7fcd0f319640 1 -- 172.21.15.47:0/567506587 shutdown_connections 2024-07-24T21:58:42.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:42.637+0000 7fcd0f319640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fccf00b3c10 0x7fccf00b60d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:42.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:42.637+0000 7fcd0f319640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd081079e0 0x7fcd0819e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:42.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:42.637+0000 7fcd0f319640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd08107060 0x7fcd081990b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:42.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:42.637+0000 7fcd0f319640 1 --2- 172.21.15.47:0/567506587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd08101650 0x7fcd08198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:42.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:42.637+0000 7fcd0f319640 1 -- 172.21.15.47:0/567506587 >> 172.21.15.47:0/567506587 conn(0x7fcd080fd0c0 msgr2=0x7fcd0806a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:42.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:42.637+0000 7fcd0f319640 1 -- 172.21.15.47:0/567506587 shutdown_connections 2024-07-24T21:58:42.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:58:42.637+0000 7fcd0f319640 1 -- 172.21.15.47:0/567506587 wait complete. 2024-07-24T21:58:42.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:42.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:42.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:42 smithi047 ceph-mon[32551]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:42.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:42.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:42.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:42.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:42.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:42.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:43.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:42 smithi183 ceph-mon[37007]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:43.247 DEBUG:teuthology.orchestra.run.smithi047:osd.0> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.0.service 2024-07-24T21:58:43.249 INFO:tasks.cephadm:Deploying osd.1 on smithi183 with /dev/vg_nvme/lv_4... 2024-07-24T21:58:43.250 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-07-24T21:58:43.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:43.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:43.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:42 smithi188 ceph-mon[37380]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:43.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:43.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:43.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:43.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:58:43.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:43.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:43.505 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 21:58:43 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0[52403]: 2024-07-24T21:58:43.400+0000 7f00cfc68640 -1 osd.0 0 log_to_monitors true 2024-07-24T21:58:43.513 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.b/config 2024-07-24T21:58:43.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:43 smithi183 ceph-mon[37007]: from='osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-07-24T21:58:44.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:43 smithi047 ceph-mon[32551]: from='osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-07-24T21:58:44.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:43 smithi188 ceph-mon[37380]: from='osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-07-24T21:58:45.024 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-07-24T21:58:45.110 INFO:teuthology.orchestra.run.smithi183.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-07-24T21:58:45.126 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10+0 records in 2024-07-24T21:58:45.126 INFO:teuthology.orchestra.run.smithi183.stderr:10+0 records out 2024-07-24T21:58:45.126 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0139675 s, 751 MB/s 2024-07-24T21:58:45.126 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping successful for: 2024-07-24T21:58:45.127 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:44 smithi183 ceph-mon[37007]: from='osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-07-24T21:58:45.127 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:44 smithi183 ceph-mon[37007]: osdmap e7: 1 total, 0 up, 1 in 2024-07-24T21:58:45.127 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:44 smithi183 ceph-mon[37007]: from='osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-07-24T21:58:45.127 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:44 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:45.127 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:44 smithi183 ceph-mon[37007]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:45.160 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 21:58:44 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0[52403]: 2024-07-24T21:58:44.880+0000 7f00cbbeb640 -1 osd.0 0 waiting for initial osdmap 2024-07-24T21:58:45.160 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 21:58:44 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0[52403]: 2024-07-24T21:58:44.883+0000 7f00c7a12640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T21:58:45.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:44 smithi047 ceph-mon[32551]: from='osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-07-24T21:58:45.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:44 smithi047 ceph-mon[32551]: osdmap e7: 1 total, 0 up, 1 in 2024-07-24T21:58:45.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:44 smithi047 ceph-mon[32551]: from='osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-07-24T21:58:45.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:44 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:45.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:44 smithi047 ceph-mon[32551]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:45.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:44 smithi188 ceph-mon[37380]: from='osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-07-24T21:58:45.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:44 smithi188 ceph-mon[37380]: osdmap e7: 1 total, 0 up, 1 in 2024-07-24T21:58:45.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:44 smithi188 ceph-mon[37380]: from='osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-07-24T21:58:45.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:44 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:45.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:44 smithi188 ceph-mon[37380]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:45.736 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_4 2024-07-24T21:58:46.001 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.b/config 2024-07-24T21:58:46.123 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:45 smithi183 ceph-mon[37007]: from='osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-07-24T21:58:46.123 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:45 smithi183 ceph-mon[37007]: osdmap e8: 1 total, 0 up, 1 in 2024-07-24T21:58:46.123 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:46.123 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:46.124 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:46.124 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:46.124 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:58:46.124 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:46.124 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:46.124 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:46.124 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:46.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:45 smithi047 ceph-mon[32551]: from='osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-07-24T21:58:46.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:45 smithi047 ceph-mon[32551]: osdmap e8: 1 total, 0 up, 1 in 2024-07-24T21:58:46.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:46.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:46.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:46.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:46.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:58:46.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:46.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:46.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:46.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:46.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:45 smithi188 ceph-mon[37380]: from='osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-07-24T21:58:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:45 smithi188 ceph-mon[37380]: osdmap e8: 1 total, 0 up, 1 in 2024-07-24T21:58:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:58:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:58:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:58:47.136 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:46 smithi183 ceph-mon[37007]: purged_snaps scrub starts 2024-07-24T21:58:47.137 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:46 smithi183 ceph-mon[37007]: purged_snaps scrub ok 2024-07-24T21:58:47.137 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:46 smithi183 ceph-mon[37007]: Detected new or changed devices on smithi047 2024-07-24T21:58:47.137 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:46 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi047 to 17092M 2024-07-24T21:58:47.137 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:46 smithi183 ceph-mon[37007]: osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913] boot 2024-07-24T21:58:47.137 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:46 smithi183 ceph-mon[37007]: osdmap e9: 1 total, 1 up, 1 in 2024-07-24T21:58:47.137 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:47.137 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:46 smithi183 ceph-mon[37007]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:47.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:46 smithi047 ceph-mon[32551]: purged_snaps scrub starts 2024-07-24T21:58:47.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:46 smithi047 ceph-mon[32551]: purged_snaps scrub ok 2024-07-24T21:58:47.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:46 smithi047 ceph-mon[32551]: Detected new or changed devices on smithi047 2024-07-24T21:58:47.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:46 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi047 to 17092M 2024-07-24T21:58:47.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:46 smithi047 ceph-mon[32551]: osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913] boot 2024-07-24T21:58:47.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:46 smithi047 ceph-mon[32551]: osdmap e9: 1 total, 1 up, 1 in 2024-07-24T21:58:47.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:47.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:46 smithi047 ceph-mon[32551]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:47.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:46 smithi188 ceph-mon[37380]: purged_snaps scrub starts 2024-07-24T21:58:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:46 smithi188 ceph-mon[37380]: purged_snaps scrub ok 2024-07-24T21:58:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:46 smithi188 ceph-mon[37380]: Detected new or changed devices on smithi047 2024-07-24T21:58:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:46 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi047 to 17092M 2024-07-24T21:58:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:46 smithi188 ceph-mon[37380]: osd.0 [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913] boot 2024-07-24T21:58:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:46 smithi188 ceph-mon[37380]: osdmap e9: 1 total, 1 up, 1 in 2024-07-24T21:58:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-24T21:58:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:46 smithi188 ceph-mon[37380]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-24T21:58:47.459 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.456+0000 7fede74fe640 1 -- 172.21.15.183:0/3987042602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fede01134d0 msgr2=0x7fede01158c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:47.459 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.456+0000 7fede74fe640 1 --2- 172.21.15.183:0/3987042602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fede01134d0 0x7fede01158c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009ca0 tx=0x7fedd802a8c0 comp rx=0 tx=0).stop 2024-07-24T21:58:47.459 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.456+0000 7fede74fe640 1 -- 172.21.15.183:0/3987042602 shutdown_connections 2024-07-24T21:58:47.459 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.456+0000 7fede74fe640 1 --2- 172.21.15.183:0/3987042602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fede01134d0 0x7fede01158c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:47.459 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.456+0000 7fede74fe640 1 --2- 172.21.15.183:0/3987042602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fede0075850 0x7fede0112f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:47.459 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.456+0000 7fede74fe640 1 --2- 172.21.15.183:0/3987042602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede0074f30 0x7fede0075310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:47.459 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.456+0000 7fede74fe640 1 -- 172.21.15.183:0/3987042602 >> 172.21.15.183:0/3987042602 conn(0x7fede00fe1c0 msgr2=0x7fede01005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:58:47.459 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.456+0000 7fede74fe640 1 -- 172.21.15.183:0/3987042602 shutdown_connections 2024-07-24T21:58:47.460 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.456+0000 7fede74fe640 1 -- 172.21.15.183:0/3987042602 wait complete. 2024-07-24T21:58:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.457+0000 7fede74fe640 1 Processor -- start 2024-07-24T21:58:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.457+0000 7fede74fe640 1 -- start start 2024-07-24T21:58:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.457+0000 7fede74fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fede0074f30 0x7fede019f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.457+0000 7fede74fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fede0075850 0x7fede019f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.457+0000 7fede74fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede01134d0 0x7fede01a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.457+0000 7fede74fe640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fede0118d50 con 0x7fede01134d0 2024-07-24T21:58:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.457+0000 7fede74fe640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fede0118bd0 con 0x7fede0075850 2024-07-24T21:58:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.457+0000 7fede74fe640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fede0118ed0 con 0x7fede0074f30 2024-07-24T21:58:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.457+0000 7fede4a99640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fede0075850 0x7fede019f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.457+0000 7fede4a99640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fede0075850 0x7fede019f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:56102/0 (socket says 172.21.15.183:56102) 2024-07-24T21:58:47.462 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.457+0000 7fede4a99640 1 -- 172.21.15.183:0/3913294533 learned_addr learned my addr 172.21.15.183:0/3913294533 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-07-24T21:58:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.457+0000 7fede529a640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fede0074f30 0x7fede019f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.457+0000 7fede5a9b640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede01134d0 0x7fede01a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.458+0000 7fede4a99640 1 -- 172.21.15.183:0/3913294533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fede0074f30 msgr2=0x7fede019f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.458+0000 7fede4a99640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fede0074f30 0x7fede019f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.458+0000 7fede4a99640 1 -- 172.21.15.183:0/3913294533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede01134d0 msgr2=0x7fede01a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:58:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.458+0000 7fede4a99640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede01134d0 0x7fede01a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:58:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.458+0000 7fede4a99640 1 -- 172.21.15.183:0/3913294533 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede01a52f0 con 0x7fede0075850 2024-07-24T21:58:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.458+0000 7fede4a99640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fede0075850 0x7fede019f780 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fedd000d770 tx=0x7fedd000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.458+0000 7fedd67fc640 1 -- 172.21.15.183:0/3913294533 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd0017070 con 0x7fede0075850 2024-07-24T21:58:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.458+0000 7fede74fe640 1 -- 172.21.15.183:0/3913294533 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede01a55e0 con 0x7fede0075850 2024-07-24T21:58:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.458+0000 7fedd67fc640 1 -- 172.21.15.183:0/3913294533 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedd00054d0 con 0x7fede0075850 2024-07-24T21:58:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.458+0000 7fedd67fc640 1 -- 172.21.15.183:0/3913294533 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd0004c30 con 0x7fede0075850 2024-07-24T21:58:47.463 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.458+0000 7fede74fe640 1 -- 172.21.15.183:0/3913294533 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede01abca0 con 0x7fede0075850 2024-07-24T21:58:47.464 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.459+0000 7fede74fe640 1 -- 172.21.15.183:0/3913294533 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede0075310 con 0x7fede0075850 2024-07-24T21:58:47.464 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.460+0000 7fedd67fc640 1 -- 172.21.15.183:0/3913294533 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fedd0004e10 con 0x7fede0075850 2024-07-24T21:58:47.464 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.461+0000 7fedd67fc640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fedcc0b3b90 0x7fedcc0b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:58:47.464 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.461+0000 7fedd67fc640 1 -- 172.21.15.183:0/3913294533 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7fedd00e1ce0 con 0x7fede0075850 2024-07-24T21:58:47.465 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.461+0000 7fede529a640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fedcc0b3b90 0x7fedcc0b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:58:47.465 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.462+0000 7fede529a640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fedcc0b3b90 0x7fedcc0b6050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feddc0058c0 tx=0x7feddc00a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:58:47.467 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.465+0000 7fedd67fc640 1 -- 172.21.15.183:0/3913294533 <== mon.2 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fedd00aa680 con 0x7fede0075850 2024-07-24T21:58:47.663 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:58:47.660+0000 7fede74fe640 1 -- 172.21.15.183:0/3913294533 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fede01004e0 con 0x7fedcc0b3b90 2024-07-24T21:58:48.152 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:47 smithi183 ceph-mon[37007]: osdmap e10: 1 total, 1 up, 1 in 2024-07-24T21:58:48.152 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:47 smithi183 ceph-mon[37007]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:58:48.152 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:47 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:58:48.153 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:47 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:58:48.153 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:47 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:48.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:47 smithi047 ceph-mon[32551]: osdmap e10: 1 total, 1 up, 1 in 2024-07-24T21:58:48.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:47 smithi047 ceph-mon[32551]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:58:48.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:47 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:58:48.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:47 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:58:48.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:47 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:48.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:47 smithi188 ceph-mon[37380]: osdmap e10: 1 total, 1 up, 1 in 2024-07-24T21:58:48.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:47 smithi188 ceph-mon[37380]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:58:48.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:47 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:58:48.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:47 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:58:48.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:47 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:49.081 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:48 smithi183 ceph-mon[37007]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:49.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:48 smithi047 ceph-mon[32551]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:49.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:48 smithi188 ceph-mon[37380]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:50.158 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:49 smithi183 ceph-mon[37007]: from='client.? 172.21.15.183:0/2808368021' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f086675-3bed-47ca-a93f-fab9580068b4"}]: dispatch 2024-07-24T21:58:50.158 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:49 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f086675-3bed-47ca-a93f-fab9580068b4"}]: dispatch 2024-07-24T21:58:50.158 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:49 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7f086675-3bed-47ca-a93f-fab9580068b4"}]': finished 2024-07-24T21:58:50.158 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:49 smithi183 ceph-mon[37007]: osdmap e11: 2 total, 1 up, 2 in 2024-07-24T21:58:50.158 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:58:50.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:49 smithi047 ceph-mon[32551]: from='client.? 172.21.15.183:0/2808368021' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f086675-3bed-47ca-a93f-fab9580068b4"}]: dispatch 2024-07-24T21:58:50.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:49 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f086675-3bed-47ca-a93f-fab9580068b4"}]: dispatch 2024-07-24T21:58:50.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:49 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7f086675-3bed-47ca-a93f-fab9580068b4"}]': finished 2024-07-24T21:58:50.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:49 smithi047 ceph-mon[32551]: osdmap e11: 2 total, 1 up, 2 in 2024-07-24T21:58:50.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:58:50.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:49 smithi188 ceph-mon[37380]: from='client.? 172.21.15.183:0/2808368021' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f086675-3bed-47ca-a93f-fab9580068b4"}]: dispatch 2024-07-24T21:58:50.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:49 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7f086675-3bed-47ca-a93f-fab9580068b4"}]: dispatch 2024-07-24T21:58:50.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:49 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7f086675-3bed-47ca-a93f-fab9580068b4"}]': finished 2024-07-24T21:58:50.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:49 smithi188 ceph-mon[37380]: osdmap e11: 2 total, 1 up, 2 in 2024-07-24T21:58:50.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:58:51.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:50 smithi183 ceph-mon[37007]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:51.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:50 smithi183 ceph-mon[37007]: from='client.? 172.21.15.183:0/1351590860' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:58:51.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:50 smithi047 ceph-mon[32551]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:51.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:50 smithi047 ceph-mon[32551]: from='client.? 172.21.15.183:0/1351590860' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:58:51.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:50 smithi188 ceph-mon[37380]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:51.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:50 smithi188 ceph-mon[37380]: from='client.? 172.21.15.183:0/1351590860' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:58:53.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:53 smithi183 ceph-mon[37007]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:53.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:53 smithi047 ceph-mon[32551]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:53.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:53 smithi188 ceph-mon[37380]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:55.350 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:55 smithi188 ceph-mon[37380]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:55.393 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:55 smithi183 ceph-mon[37007]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:55.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:55 smithi047 ceph-mon[32551]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:57.351 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:57 smithi183 ceph-mon[37007]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:57.351 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:57 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-07-24T21:58:57.351 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:57 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:57.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:57 smithi047 ceph-mon[32551]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:57.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:57 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-07-24T21:58:57.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:57 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:57 smithi188 ceph-mon[37380]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:57 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-07-24T21:58:57.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:57 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:58:58.375 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:58 smithi183 ceph-mon[37007]: Deploying daemon osd.1 on smithi183 2024-07-24T21:58:58.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:58 smithi047 ceph-mon[32551]: Deploying daemon osd.1 on smithi183 2024-07-24T21:58:58.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:58 smithi188 ceph-mon[37380]: Deploying daemon osd.1 on smithi183 2024-07-24T21:58:59.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:58:59 smithi183 ceph-mon[37007]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:59.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:58:59 smithi047 ceph-mon[32551]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:58:59.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:58:59 smithi188 ceph-mon[37380]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:01.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:01 smithi183 ceph-mon[37007]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:01.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:01 smithi047 ceph-mon[32551]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:01.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:01 smithi188 ceph-mon[37380]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:02.349 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:02 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:02.349 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:02 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:02.349 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:02 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:02.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:02 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:02.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:02 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:02.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:02 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:02.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:02 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:02.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:02 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:02.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:02 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:03.316 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:03 smithi183 ceph-mon[37007]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:03.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:03 smithi047 ceph-mon[32551]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:03.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:03 smithi188 ceph-mon[37380]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:04.892 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:04.890+0000 7fedd67fc640 1 -- 172.21.15.183:0/3913294533 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fede01004e0 con 0x7fedcc0b3b90 2024-07-24T21:59:04.892 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 1 on host 'smithi183' 2024-07-24T21:59:04.894 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:04.893+0000 7fede74fe640 1 -- 172.21.15.183:0/3913294533 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fedcc0b3b90 msgr2=0x7fedcc0b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:04.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:04.893+0000 7fede74fe640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fedcc0b3b90 0x7fedcc0b6050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feddc0058c0 tx=0x7feddc00a2d0 comp rx=0 tx=0).stop 2024-07-24T21:59:04.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:04.893+0000 7fede74fe640 1 -- 172.21.15.183:0/3913294533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fede0075850 msgr2=0x7fede019f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:04.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:04.893+0000 7fede74fe640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fede0075850 0x7fede019f780 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fedd000d770 tx=0x7fedd000dc30 comp rx=0 tx=0).stop 2024-07-24T21:59:04.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:04.893+0000 7fede74fe640 1 -- 172.21.15.183:0/3913294533 shutdown_connections 2024-07-24T21:59:04.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:04.893+0000 7fede74fe640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fedcc0b3b90 0x7fedcc0b6050 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:04.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:04.893+0000 7fede74fe640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fede01134d0 0x7fede01a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:04.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:04.893+0000 7fede74fe640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fede0075850 0x7fede019f780 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:04.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:04.893+0000 7fede74fe640 1 --2- 172.21.15.183:0/3913294533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fede0074f30 0x7fede019f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:04.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:04.893+0000 7fede74fe640 1 -- 172.21.15.183:0/3913294533 >> 172.21.15.183:0/3913294533 conn(0x7fede00fe1c0 msgr2=0x7fede00fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:59:04.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:04.893+0000 7fede74fe640 1 -- 172.21.15.183:0/3913294533 shutdown_connections 2024-07-24T21:59:04.895 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:04.893+0000 7fede74fe640 1 -- 172.21.15.183:0/3913294533 wait complete. 2024-07-24T21:59:05.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:05 smithi047 ceph-mon[32551]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:05.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:05 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:05 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:05 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:05.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:05 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:05.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:05 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:05 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:05.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:05 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:05 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.532 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:05 smithi183 ceph-mon[37007]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:05.532 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:05 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.532 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:05 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.532 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:05 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:05.532 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:05 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:05.532 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:05 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.532 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:05 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:05.533 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:05 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.533 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:05 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:05 smithi188 ceph-mon[37380]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:05.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:05 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:05 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:05 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:05.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:05 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:05.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:05 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:05 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:05.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:05 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:05 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:05.563 DEBUG:teuthology.orchestra.run.smithi183:osd.1> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.1.service 2024-07-24T21:59:05.565 INFO:tasks.cephadm:Deploying osd.2 on smithi188 with /dev/vg_nvme/lv_4... 2024-07-24T21:59:05.565 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-07-24T21:59:05.823 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T21:59:06.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:06 smithi188 ceph-mon[37380]: from='osd.1 [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-24T21:59:06.232 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:06 smithi188 ceph-mon[37380]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-24T21:59:06.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:06 smithi047 ceph-mon[32551]: from='osd.1 [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-24T21:59:06.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:06 smithi047 ceph-mon[32551]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-24T21:59:06.445 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:06 smithi183 ceph-mon[37007]: from='osd.1 [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-24T21:59:06.446 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:06 smithi183 ceph-mon[37007]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-24T21:59:07.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:07 smithi183 ceph-mon[37007]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:07.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:07 smithi183 ceph-mon[37007]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-07-24T21:59:07.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:07 smithi183 ceph-mon[37007]: from='osd.1 [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T21:59:07.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:07 smithi183 ceph-mon[37007]: osdmap e12: 2 total, 1 up, 2 in 2024-07-24T21:59:07.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:07.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:07 smithi183 ceph-mon[37007]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T21:59:07.413 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 21:59:07 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1[42876]: 2024-07-24T21:59:07.196+0000 7f9aa22f2640 -1 osd.1 0 waiting for initial osdmap 2024-07-24T21:59:07.413 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 21:59:07 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1[42876]: 2024-07-24T21:59:07.199+0000 7f9a9e119640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T21:59:07.460 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:07 smithi188 ceph-mon[37380]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:07.460 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:07 smithi188 ceph-mon[37380]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-07-24T21:59:07.460 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:07 smithi188 ceph-mon[37380]: from='osd.1 [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T21:59:07.460 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:07 smithi188 ceph-mon[37380]: osdmap e12: 2 total, 1 up, 2 in 2024-07-24T21:59:07.460 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:07.460 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:07 smithi188 ceph-mon[37380]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T21:59:07.461 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-07-24T21:59:07.546 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-07-24T21:59:07.559 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-07-24T21:59:07.559 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-07-24T21:59:07.559 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011314 s, 927 MB/s 2024-07-24T21:59:07.560 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-07-24T21:59:07.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:07 smithi047 ceph-mon[32551]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:07.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:07 smithi047 ceph-mon[32551]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-07-24T21:59:07.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:07 smithi047 ceph-mon[32551]: from='osd.1 [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T21:59:07.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:07 smithi047 ceph-mon[32551]: osdmap e12: 2 total, 1 up, 2 in 2024-07-24T21:59:07.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:07.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:07 smithi047 ceph-mon[32551]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T21:59:08.146 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch daemon add osd smithi188:vg_nvme/lv_4 2024-07-24T21:59:08.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:08 smithi188 ceph-mon[37380]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-07-24T21:59:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:08 smithi188 ceph-mon[37380]: osdmap e13: 2 total, 1 up, 2 in 2024-07-24T21:59:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:08.302 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:08 smithi183 ceph-mon[37007]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-07-24T21:59:08.302 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:08 smithi183 ceph-mon[37007]: osdmap e13: 2 total, 1 up, 2 in 2024-07-24T21:59:08.303 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:08.303 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:08.399 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T21:59:08.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:08 smithi047 ceph-mon[32551]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-07-24T21:59:08.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:08 smithi047 ceph-mon[32551]: osdmap e13: 2 total, 1 up, 2 in 2024-07-24T21:59:08.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:08.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:09.497 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: purged_snaps scrub starts 2024-07-24T21:59:09.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: purged_snaps scrub ok 2024-07-24T21:59:09.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:09.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:09.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: osd.1 [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228] boot 2024-07-24T21:59:09.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: osdmap e14: 2 total, 2 up, 2 in 2024-07-24T21:59:09.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:09.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: Detected new or changed devices on smithi183 2024-07-24T21:59:09.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:09.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:09.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:59:09.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi183 to 17088M 2024-07-24T21:59:09.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:09.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:09.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:09.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:09 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:09.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: purged_snaps scrub starts 2024-07-24T21:59:09.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: purged_snaps scrub ok 2024-07-24T21:59:09.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:09.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:09.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: osd.1 [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228] boot 2024-07-24T21:59:09.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: osdmap e14: 2 total, 2 up, 2 in 2024-07-24T21:59:09.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:09.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: Detected new or changed devices on smithi183 2024-07-24T21:59:09.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:09.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:09.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:59:09.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi183 to 17088M 2024-07-24T21:59:09.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:09.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:09.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:09.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:09 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:09.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: purged_snaps scrub starts 2024-07-24T21:59:09.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: purged_snaps scrub ok 2024-07-24T21:59:09.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-24T21:59:09.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:09.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: osd.1 [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228] boot 2024-07-24T21:59:09.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: osdmap e14: 2 total, 2 up, 2 in 2024-07-24T21:59:09.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-24T21:59:09.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: Detected new or changed devices on smithi183 2024-07-24T21:59:09.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:09.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:09.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:59:09.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi183 to 17088M 2024-07-24T21:59:09.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:09.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:09.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:09.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:09 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:09.960 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.956+0000 7fbfa1742640 1 -- 172.21.15.188:0/3855099811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9c102770 msgr2=0x7fbf9c102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:09.960 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.956+0000 7fbfa1742640 1 --2- 172.21.15.188:0/3855099811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9c102770 0x7fbf9c102b50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009ca0 tx=0x7fbf8c02a8c0 comp rx=0 tx=0).stop 2024-07-24T21:59:09.960 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.956+0000 7fbfa1742640 1 -- 172.21.15.188:0/3855099811 shutdown_connections 2024-07-24T21:59:09.960 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.956+0000 7fbfa1742640 1 --2- 172.21.15.188:0/3855099811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf9c108b00 0x7fbf9c10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:09.961 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.956+0000 7fbfa1742640 1 --2- 172.21.15.188:0/3855099811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9c108180 0x7fbf9c1085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:09.961 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.956+0000 7fbfa1742640 1 --2- 172.21.15.188:0/3855099811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9c102770 0x7fbf9c102b50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:09.961 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.956+0000 7fbfa1742640 1 -- 172.21.15.188:0/3855099811 >> 172.21.15.188:0/3855099811 conn(0x7fbf9c0fe1c0 msgr2=0x7fbf9c1005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:59:09.961 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.956+0000 7fbfa1742640 1 -- 172.21.15.188:0/3855099811 shutdown_connections 2024-07-24T21:59:09.961 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.956+0000 7fbfa1742640 1 -- 172.21.15.188:0/3855099811 wait complete. 2024-07-24T21:59:09.961 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.956+0000 7fbfa1742640 1 Processor -- start 2024-07-24T21:59:09.961 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbfa1742640 1 -- start start 2024-07-24T21:59:09.961 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbfa1742640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf9c102770 0x7fbf9c198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:59:09.961 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbfa1742640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9c108180 0x7fbf9c1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:59:09.961 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbfa1742640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9c108b00 0x7fbf9c19e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:59:09.961 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbfa1742640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c112790 con 0x7fbf9c108b00 2024-07-24T21:59:09.961 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbfa1742640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c112610 con 0x7fbf9c102770 2024-07-24T21:59:09.962 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbfa1742640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c112910 con 0x7fbf9c108180 2024-07-24T21:59:09.962 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbf9a7fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9c108180 0x7fbf9c1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:59:09.962 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbf9a7fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9c108180 0x7fbf9c1991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:49098/0 (socket says 172.21.15.188:49098) 2024-07-24T21:59:09.962 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbf9a7fc640 1 -- 172.21.15.188:0/1492461508 learned_addr learned my addr 172.21.15.188:0/1492461508 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-07-24T21:59:09.962 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbf9affd640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf9c102770 0x7fbf9c198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:59:09.962 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbf9b7fe640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9c108b00 0x7fbf9c19e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:59:09.962 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbf9a7fc640 1 -- 172.21.15.188:0/1492461508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf9c102770 msgr2=0x7fbf9c198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:09.962 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbf9a7fc640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf9c102770 0x7fbf9c198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:09.962 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbf9a7fc640 1 -- 172.21.15.188:0/1492461508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9c108b00 msgr2=0x7fbf9c19e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:09.962 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbf9a7fc640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9c108b00 0x7fbf9c19e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:09.962 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbf9a7fc640 1 -- 172.21.15.188:0/1492461508 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9c19ed10 con 0x7fbf9c108180 2024-07-24T21:59:09.962 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbf9b7fe640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9c108b00 0x7fbf9c19e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T21:59:09.963 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.957+0000 7fbf9a7fc640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9c108180 0x7fbf9c1991a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000c920 tx=0x7fbf9000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:59:09.963 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.958+0000 7fbf83fff640 1 -- 172.21.15.188:0/1492461508 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90007c70 con 0x7fbf9c108180 2024-07-24T21:59:09.963 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.958+0000 7fbf83fff640 1 -- 172.21.15.188:0/1492461508 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf90007e10 con 0x7fbf9c108180 2024-07-24T21:59:09.963 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.958+0000 7fbfa1742640 1 -- 172.21.15.188:0/1492461508 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9c19f000 con 0x7fbf9c108180 2024-07-24T21:59:09.963 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.958+0000 7fbf83fff640 1 -- 172.21.15.188:0/1492461508 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90018820 con 0x7fbf9c108180 2024-07-24T21:59:09.963 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.958+0000 7fbfa1742640 1 -- 172.21.15.188:0/1492461508 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf9c1a5740 con 0x7fbf9c108180 2024-07-24T21:59:09.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.959+0000 7fbfa1742640 1 -- 172.21.15.188:0/1492461508 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf9c102b50 con 0x7fbf9c108180 2024-07-24T21:59:09.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.960+0000 7fbf83fff640 1 -- 172.21.15.188:0/1492461508 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7fbf9000f450 con 0x7fbf9c108180 2024-07-24T21:59:09.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.961+0000 7fbf83fff640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf840b3b90 0x7fbf840b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:59:09.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.961+0000 7fbf83fff640 1 -- 172.21.15.188:0/1492461508 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2524+0+0 (secure 0 0 0) 0x7fbf900e2870 con 0x7fbf9c108180 2024-07-24T21:59:09.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.961+0000 7fbf9affd640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf840b3b90 0x7fbf840b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:59:09.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.961+0000 7fbf9affd640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf840b3b90 0x7fbf840b6050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0098d0 tx=0x7fbf8c009900 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:59:09.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:09.964+0000 7fbf83fff640 1 -- 172.21.15.188:0/1492461508 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fbf90014030 con 0x7fbf9c108180 2024-07-24T21:59:10.160 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:10.158+0000 7fbfa1742640 1 -- 172.21.15.188:0/1492461508 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fbf9c062f80 con 0x7fbf840b3b90 2024-07-24T21:59:10.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:10 smithi188 ceph-mon[37380]: osdmap e15: 2 total, 2 up, 2 in 2024-07-24T21:59:10.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:10 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:59:10.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:10 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:59:10.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:10 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:10.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:10 smithi183 ceph-mon[37007]: osdmap e15: 2 total, 2 up, 2 in 2024-07-24T21:59:10.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:10 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:59:10.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:10 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:59:10.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:10 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:10.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:10 smithi047 ceph-mon[32551]: osdmap e15: 2 total, 2 up, 2 in 2024-07-24T21:59:10.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:10 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:59:10.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:10 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:59:10.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:10 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:11.448 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:11 smithi188 ceph-mon[37380]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:11.448 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:11 smithi188 ceph-mon[37380]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:59:11.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:11 smithi183 ceph-mon[37007]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:11.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:11 smithi183 ceph-mon[37007]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:59:11.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:11 smithi047 ceph-mon[32551]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:11.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:11 smithi047 ceph-mon[32551]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:59:13.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:13 smithi183 ceph-mon[37007]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:13 smithi183 ceph-mon[37007]: from='client.? 172.21.15.188:0/4229835099' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "040fff27-6fa6-48de-9365-fcced8f89e98"}]: dispatch 2024-07-24T21:59:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:13 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "040fff27-6fa6-48de-9365-fcced8f89e98"}]: dispatch 2024-07-24T21:59:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:13 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "040fff27-6fa6-48de-9365-fcced8f89e98"}]': finished 2024-07-24T21:59:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:13 smithi183 ceph-mon[37007]: osdmap e16: 3 total, 2 up, 3 in 2024-07-24T21:59:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:13 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:13 smithi183 ceph-mon[37007]: from='client.? 172.21.15.188:0/3619047575' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:59:13.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:13 smithi047 ceph-mon[32551]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:13.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:13 smithi047 ceph-mon[32551]: from='client.? 172.21.15.188:0/4229835099' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "040fff27-6fa6-48de-9365-fcced8f89e98"}]: dispatch 2024-07-24T21:59:13.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:13 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "040fff27-6fa6-48de-9365-fcced8f89e98"}]: dispatch 2024-07-24T21:59:13.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:13 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "040fff27-6fa6-48de-9365-fcced8f89e98"}]': finished 2024-07-24T21:59:13.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:13 smithi047 ceph-mon[32551]: osdmap e16: 3 total, 2 up, 3 in 2024-07-24T21:59:13.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:13 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:13.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:13 smithi047 ceph-mon[32551]: from='client.? 172.21.15.188:0/3619047575' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:59:13.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:13 smithi188 ceph-mon[37380]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:13.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:13 smithi188 ceph-mon[37380]: from='client.? 172.21.15.188:0/4229835099' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "040fff27-6fa6-48de-9365-fcced8f89e98"}]: dispatch 2024-07-24T21:59:13.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:13 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "040fff27-6fa6-48de-9365-fcced8f89e98"}]: dispatch 2024-07-24T21:59:13.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:13 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "040fff27-6fa6-48de-9365-fcced8f89e98"}]': finished 2024-07-24T21:59:13.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:13 smithi188 ceph-mon[37380]: osdmap e16: 3 total, 2 up, 3 in 2024-07-24T21:59:13.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:13 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:13.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:13 smithi188 ceph-mon[37380]: from='client.? 172.21.15.188:0/3619047575' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:59:15.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:15 smithi183 ceph-mon[37007]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:15.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:15 smithi047 ceph-mon[32551]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:15.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:15 smithi188 ceph-mon[37380]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:17.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:17 smithi188 ceph-mon[37380]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:17.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:17 smithi183 ceph-mon[37007]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:17.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:17 smithi047 ceph-mon[32551]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:19.650 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:19 smithi188 ceph-mon[37380]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:19.650 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-07-24T21:59:19.650 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:19.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:19 smithi183 ceph-mon[37007]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:19.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-07-24T21:59:19.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:19.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:19 smithi047 ceph-mon[32551]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:19.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-07-24T21:59:19.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:20.535 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:20 smithi188 ceph-mon[37380]: Deploying daemon osd.2 on smithi188 2024-07-24T21:59:20.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:20 smithi183 ceph-mon[37007]: Deploying daemon osd.2 on smithi188 2024-07-24T21:59:20.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:20 smithi047 ceph-mon[32551]: Deploying daemon osd.2 on smithi188 2024-07-24T21:59:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:21 smithi183 ceph-mon[37007]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:21.685 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:21 smithi188 ceph-mon[37380]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:21.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:21 smithi047 ceph-mon[32551]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:23.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:23 smithi188 ceph-mon[37380]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:23.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:23 smithi183 ceph-mon[37007]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:23.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:23 smithi047 ceph-mon[32551]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:24.485 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:24 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:24.485 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:24 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:24.485 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:24 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:24.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:24 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:24.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:24 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:24.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:24 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:24.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:24 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:24.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:24 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:24.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:24 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:25.598 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:25 smithi188 ceph-mon[37380]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:25.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:25 smithi183 ceph-mon[37007]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:25.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:25 smithi047 ceph-mon[32551]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:27.138 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:27.136+0000 7fbf83fff640 1 -- 172.21.15.188:0/1492461508 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbf9c062f80 con 0x7fbf840b3b90 2024-07-24T21:59:27.139 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 2 on host 'smithi188' 2024-07-24T21:59:27.141 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:27.138+0000 7fbfa1742640 1 -- 172.21.15.188:0/1492461508 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf840b3b90 msgr2=0x7fbf840b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:27.141 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:27.138+0000 7fbfa1742640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf840b3b90 0x7fbf840b6050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0098d0 tx=0x7fbf8c009900 comp rx=0 tx=0).stop 2024-07-24T21:59:27.141 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:27.138+0000 7fbfa1742640 1 -- 172.21.15.188:0/1492461508 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9c108180 msgr2=0x7fbf9c1991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:27.141 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:27.138+0000 7fbfa1742640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9c108180 0x7fbf9c1991a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000c920 tx=0x7fbf9000cde0 comp rx=0 tx=0).stop 2024-07-24T21:59:27.141 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:27.138+0000 7fbfa1742640 1 -- 172.21.15.188:0/1492461508 shutdown_connections 2024-07-24T21:59:27.141 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:27.138+0000 7fbfa1742640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf840b3b90 0x7fbf840b6050 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:27.141 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:27.138+0000 7fbfa1742640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9c108b00 0x7fbf9c19e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:27.141 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:27.138+0000 7fbfa1742640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9c108180 0x7fbf9c1991a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:27.141 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:27.138+0000 7fbfa1742640 1 --2- 172.21.15.188:0/1492461508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf9c102770 0x7fbf9c198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:27.141 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:27.138+0000 7fbfa1742640 1 -- 172.21.15.188:0/1492461508 >> 172.21.15.188:0/1492461508 conn(0x7fbf9c0fe1c0 msgr2=0x7fbf9c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:59:27.142 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:27.139+0000 7fbfa1742640 1 -- 172.21.15.188:0/1492461508 shutdown_connections 2024-07-24T21:59:27.142 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T21:59:27.139+0000 7fbfa1742640 1 -- 172.21.15.188:0/1492461508 wait complete. 2024-07-24T21:59:27.344 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:27 smithi188 ceph-mon[37380]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:27.345 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:27.345 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:27.345 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:27.345 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:27.345 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:27.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:27 smithi183 ceph-mon[37007]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:27.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:27.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:27.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:27.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:27.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:27.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:27 smithi047 ceph-mon[32551]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:27.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:27.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:27.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:27.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:27.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:27.762 DEBUG:teuthology.orchestra.run.smithi188:osd.2> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.2.service 2024-07-24T21:59:27.764 INFO:tasks.cephadm:Deploying osd.3 on smithi047 with /dev/vg_nvme/lv_3... 2024-07-24T21:59:27.764 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-07-24T21:59:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:59:28.254 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:28.254 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:28.255 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:28.255 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:28 smithi188 ceph-mon[37380]: from='osd.2 [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-24T21:59:28.255 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:28 smithi188 ceph-mon[37380]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-24T21:59:28.384 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:28.384 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:28.385 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:28.385 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:28 smithi047 ceph-mon[32551]: from='osd.2 [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-24T21:59:28.385 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:28 smithi047 ceph-mon[32551]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-24T21:59:28.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:28.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:28.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:28.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:28 smithi183 ceph-mon[37007]: from='osd.2 [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-24T21:59:28.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:28 smithi183 ceph-mon[37007]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-24T21:59:29.238 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:29 smithi047 ceph-mon[32551]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:29.239 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:29 smithi047 ceph-mon[32551]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-07-24T21:59:29.239 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:29 smithi047 ceph-mon[32551]: osdmap e17: 3 total, 2 up, 3 in 2024-07-24T21:59:29.239 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:29 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:29.239 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:29 smithi047 ceph-mon[32551]: from='osd.2 [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T21:59:29.239 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:29 smithi047 ceph-mon[32551]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T21:59:29.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:29 smithi183 ceph-mon[37007]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:29 smithi183 ceph-mon[37007]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-07-24T21:59:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:29 smithi183 ceph-mon[37007]: osdmap e17: 3 total, 2 up, 3 in 2024-07-24T21:59:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:29 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:29 smithi183 ceph-mon[37007]: from='osd.2 [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T21:59:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:29 smithi183 ceph-mon[37007]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T21:59:29.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:29 smithi188 ceph-mon[37380]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:29.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:29 smithi188 ceph-mon[37380]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-07-24T21:59:29.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:29 smithi188 ceph-mon[37380]: osdmap e17: 3 total, 2 up, 3 in 2024-07-24T21:59:29.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:29 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:29.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:29 smithi188 ceph-mon[37380]: from='osd.2 [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T21:59:29.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:29 smithi188 ceph-mon[37380]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T21:59:29.549 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 21:59:29 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2[43766]: 2024-07-24T21:59:29.154+0000 7f28a22ec640 -1 osd.2 0 waiting for initial osdmap 2024-07-24T21:59:29.549 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 21:59:29 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2[43766]: 2024-07-24T21:59:29.158+0000 7f289e113640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T21:59:29.596 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-07-24T21:59:29.681 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-07-24T21:59:29.691 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-07-24T21:59:29.691 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-07-24T21:59:29.691 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00820954 s, 1.3 GB/s 2024-07-24T21:59:29.691 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-07-24T21:59:30.287 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_3 2024-07-24T21:59:30.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:30 smithi183 ceph-mon[37007]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-07-24T21:59:30.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:30 smithi183 ceph-mon[37007]: osdmap e18: 3 total, 2 up, 3 in 2024-07-24T21:59:30.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:30.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:30.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:30 smithi047 ceph-mon[32551]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-07-24T21:59:30.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:30 smithi047 ceph-mon[32551]: osdmap e18: 3 total, 2 up, 3 in 2024-07-24T21:59:30.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:30.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:30.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:30 smithi188 ceph-mon[37380]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-07-24T21:59:30.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:30 smithi188 ceph-mon[37380]: osdmap e18: 3 total, 2 up, 3 in 2024-07-24T21:59:30.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:30.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:30.564 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T21:59:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: purged_snaps scrub starts 2024-07-24T21:59:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: purged_snaps scrub ok 2024-07-24T21:59:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: osd.2 [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281] boot 2024-07-24T21:59:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: osdmap e19: 3 total, 3 up, 3 in 2024-07-24T21:59:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: Detected new or changed devices on smithi188 2024-07-24T21:59:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:59:31.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi188 to 17088M 2024-07-24T21:59:31.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:31.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:31.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:31.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:31.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: purged_snaps scrub starts 2024-07-24T21:59:31.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: purged_snaps scrub ok 2024-07-24T21:59:31.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:31.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: osd.2 [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281] boot 2024-07-24T21:59:31.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: osdmap e19: 3 total, 3 up, 3 in 2024-07-24T21:59:31.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:31.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: Detected new or changed devices on smithi188 2024-07-24T21:59:31.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:31.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:31.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:59:31.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi188 to 17088M 2024-07-24T21:59:31.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:31.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:31.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:31.439 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:31.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: purged_snaps scrub starts 2024-07-24T21:59:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: purged_snaps scrub ok 2024-07-24T21:59:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-07-24T21:59:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: osd.2 [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281] boot 2024-07-24T21:59:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: osdmap e19: 3 total, 3 up, 3 in 2024-07-24T21:59:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-24T21:59:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: Detected new or changed devices on smithi188 2024-07-24T21:59:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:59:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi188 to 17088M 2024-07-24T21:59:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:31.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:31.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:31.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.989+0000 7f95a4baa640 1 -- 172.21.15.47:0/3182305627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a010cb00 msgr2=0x7f95a010ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:31.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.989+0000 7f95a4baa640 1 --2- 172.21.15.47:0/3182305627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a010cb00 0x7f95a010ef60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9598009ca0 tx=0x7f959802a8c0 comp rx=0 tx=0).stop 2024-07-24T21:59:31.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.989+0000 7f95a4baa640 1 -- 172.21.15.47:0/3182305627 shutdown_connections 2024-07-24T21:59:31.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.989+0000 7f95a4baa640 1 --2- 172.21.15.47:0/3182305627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a010cb00 0x7f95a010ef60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:31.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.989+0000 7f95a4baa640 1 --2- 172.21.15.47:0/3182305627 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a0103fc0 0x7f95a010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:31.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.989+0000 7f95a4baa640 1 --2- 172.21.15.47:0/3182305627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95a01036a0 0x7f95a0103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:31.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.989+0000 7f95a4baa640 1 -- 172.21.15.47:0/3182305627 >> 172.21.15.47:0/3182305627 conn(0x7f95a00fd100 msgr2=0x7f95a00ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:59:31.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.989+0000 7f95a4baa640 1 -- 172.21.15.47:0/3182305627 shutdown_connections 2024-07-24T21:59:31.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.989+0000 7f95a4baa640 1 -- 172.21.15.47:0/3182305627 wait complete. 2024-07-24T21:59:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.990+0000 7f95a4baa640 1 Processor -- start 2024-07-24T21:59:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.990+0000 7f95a4baa640 1 -- start start 2024-07-24T21:59:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.990+0000 7f95a4baa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95a01036a0 0x7f95a0198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:59:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.990+0000 7f95a4baa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a0103fc0 0x7f95a0199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:59:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.990+0000 7f95a4baa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a010cb00 0x7f95a019e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:59:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.990+0000 7f95a4baa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f95a0112850 con 0x7f95a0103fc0 2024-07-24T21:59:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.990+0000 7f95a4baa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f95a01126d0 con 0x7f95a010cb00 2024-07-24T21:59:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.990+0000 7f95a4baa640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f95a01129d0 con 0x7f95a01036a0 2024-07-24T21:59:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f959dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a0103fc0 0x7f95a0199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:59:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f959dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a0103fc0 0x7f95a0199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45014/0 (socket says 172.21.15.47:45014) 2024-07-24T21:59:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f959dd9b640 1 -- 172.21.15.47:0/2745176447 learned_addr learned my addr 172.21.15.47:0/2745176447 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T21:59:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f959ed9d640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a010cb00 0x7f95a019e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:59:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f959e59c640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95a01036a0 0x7f95a0198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:59:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f959dd9b640 1 -- 172.21.15.47:0/2745176447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95a01036a0 msgr2=0x7f95a0198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f959dd9b640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95a01036a0 0x7f95a0198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f959dd9b640 1 -- 172.21.15.47:0/2745176447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a010cb00 msgr2=0x7f95a019e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f959dd9b640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a010cb00 0x7f95a019e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f959dd9b640 1 -- 172.21.15.47:0/2745176447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a019ee70 con 0x7f95a0103fc0 2024-07-24T21:59:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f959ed9d640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a010cb00 0x7f95a019e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T21:59:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f959dd9b640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a0103fc0 0x7f95a0199300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f959400b3c0 tx=0x7f959400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:59:31.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f958f7fe640 1 -- 172.21.15.47:0/2745176447 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594015020 con 0x7f95a0103fc0 2024-07-24T21:59:31.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f95a4baa640 1 -- 172.21.15.47:0/2745176447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a019f160 con 0x7f95a0103fc0 2024-07-24T21:59:31.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f958f7fe640 1 -- 172.21.15.47:0/2745176447 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9594011ce0 con 0x7f95a0103fc0 2024-07-24T21:59:31.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f958f7fe640 1 -- 172.21.15.47:0/2745176447 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959400f2e0 con 0x7f95a0103fc0 2024-07-24T21:59:31.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.991+0000 7f95a4baa640 1 -- 172.21.15.47:0/2745176447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a01a59f0 con 0x7f95a0103fc0 2024-07-24T21:59:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.992+0000 7f95a4baa640 1 -- 172.21.15.47:0/2745176447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a0103b00 con 0x7f95a0103fc0 2024-07-24T21:59:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.994+0000 7f958f7fe640 1 -- 172.21.15.47:0/2745176447 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 151020+0+0 (secure 0 0 0) 0x7f9594018020 con 0x7f95a0103fc0 2024-07-24T21:59:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.994+0000 7f958f7fe640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95880b3b90 0x7f95880b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:59:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.995+0000 7f959e59c640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95880b3b90 0x7f95880b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:59:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.995+0000 7f958f7fe640 1 -- 172.21.15.47:0/2745176447 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3066+0+0 (secure 0 0 0) 0x7f95940e2560 con 0x7f95a0103fc0 2024-07-24T21:59:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.995+0000 7f959e59c640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95880b3b90 0x7f95880b6050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9590009990 tx=0x7f9590009110 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:59:31.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:31.997+0000 7f958f7fe640 1 -- 172.21.15.47:0/2745176447 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f959401f020 con 0x7f95a0103fc0 2024-07-24T21:59:32.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:32.206+0000 7f95a4baa640 1 -- 172.21.15.47:0/2745176447 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f95a0062f80 con 0x7f95880b3b90 2024-07-24T21:59:32.629 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:32 smithi047 ceph-mon[32551]: osdmap e20: 3 total, 3 up, 3 in 2024-07-24T21:59:32.630 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-07-24T21:59:32.630 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:59:32.630 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:59:32.630 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:32.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:32 smithi188 ceph-mon[37380]: osdmap e20: 3 total, 3 up, 3 in 2024-07-24T21:59:32.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-07-24T21:59:32.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:59:32.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:59:32.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:32.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:32 smithi183 ceph-mon[37007]: osdmap e20: 3 total, 3 up, 3 in 2024-07-24T21:59:32.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-07-24T21:59:32.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:59:32.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:59:32.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:33.569 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:33 smithi047 ceph-mon[32551]: pgmap v71: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:33.569 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:33 smithi047 ceph-mon[32551]: from='client.14475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:59:33.569 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:33 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-07-24T21:59:33.569 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:33 smithi047 ceph-mon[32551]: osdmap e21: 3 total, 3 up, 3 in 2024-07-24T21:59:33.569 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:33 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-07-24T21:59:33.570 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56911]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-24T21:59:33.570 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56911]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-24T21:59:33.570 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-24T21:59:33.570 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56911]: pam_unix(sudo:session): session closed for user root 2024-07-24T21:59:33.570 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56914]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-24T21:59:33.570 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56914]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-24T21:59:33.570 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-24T21:59:33.570 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56914]: pam_unix(sudo:session): session closed for user root 2024-07-24T21:59:33.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:33 smithi188 ceph-mon[37380]: pgmap v71: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:33.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:33 smithi188 ceph-mon[37380]: from='client.14475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:59:33.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:33 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-07-24T21:59:33.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:33 smithi188 ceph-mon[37380]: osdmap e21: 3 total, 3 up, 3 in 2024-07-24T21:59:33.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:33 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-07-24T21:59:33.713 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47402]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-24T21:59:33.713 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47402]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-24T21:59:33.713 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-24T21:59:33.713 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47402]: pam_unix(sudo:session): session closed for user root 2024-07-24T21:59:33.713 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47405]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-24T21:59:33.713 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47405]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-24T21:59:33.713 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-24T21:59:33.713 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47405]: pam_unix(sudo:session): session closed for user root 2024-07-24T21:59:33.750 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:33 smithi183 ceph-mon[37007]: pgmap v71: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:33.750 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:33 smithi183 ceph-mon[37007]: from='client.14475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:59:33.750 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:33 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-07-24T21:59:33.750 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:33 smithi183 ceph-mon[37007]: osdmap e21: 3 total, 3 up, 3 in 2024-07-24T21:59:33.750 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:33 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-07-24T21:59:33.750 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46549]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-24T21:59:33.750 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46549]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-24T21:59:33.751 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-24T21:59:33.751 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46549]: pam_unix(sudo:session): session closed for user root 2024-07-24T21:59:33.751 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46552]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-24T21:59:33.751 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46552]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-24T21:59:33.751 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-24T21:59:33.751 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46552]: pam_unix(sudo:session): session closed for user root 2024-07-24T21:59:33.848 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56938]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-24T21:59:33.848 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56938]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-24T21:59:33.848 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-24T21:59:33.848 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56938]: pam_unix(sudo:session): session closed for user root 2024-07-24T21:59:33.848 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56941]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-24T21:59:33.849 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56941]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-24T21:59:33.849 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-24T21:59:33.849 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:33 smithi047 sudo[56941]: pam_unix(sudo:session): session closed for user root 2024-07-24T21:59:34.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47408]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-24T21:59:34.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47408]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-24T21:59:34.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-24T21:59:34.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47408]: pam_unix(sudo:session): session closed for user root 2024-07-24T21:59:34.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47411]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-24T21:59:34.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47411]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-24T21:59:34.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-24T21:59:34.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:33 smithi188 sudo[47411]: pam_unix(sudo:session): session closed for user root 2024-07-24T21:59:34.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46555]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-24T21:59:34.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46555]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-24T21:59:34.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-24T21:59:34.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46555]: pam_unix(sudo:session): session closed for user root 2024-07-24T21:59:34.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46558]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-24T21:59:34.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46558]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-24T21:59:34.163 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-24T21:59:34.163 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:33 smithi183 sudo[46558]: pam_unix(sudo:session): session closed for user root 2024-07-24T21:59:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:34.670+0000 7f958f7fe640 1 -- 172.21.15.47:0/2745176447 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f95940a6ca0 con 0x7f95a0103fc0 2024-07-24T21:59:34.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-07-24T21:59:34.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: osdmap e22: 3 total, 3 up, 3 in 2024-07-24T21:59:34.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:34.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:34.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:34.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-24T21:59:34.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-24T21:59:34.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:59:34.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:59:34.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:59:34.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-24T21:59:34.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:59:34.674 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:59:34.674 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:59:34.674 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-24T21:59:34.674 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-24T21:59:34.674 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:59:34.674 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:59:34.674 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:59:34.674 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:34 smithi047 ceph-mon[32551]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-24T21:59:34.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-07-24T21:59:34.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: osdmap e22: 3 total, 3 up, 3 in 2024-07-24T21:59:34.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:34.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:34.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:34.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-24T21:59:34.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-24T21:59:34.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:59:34.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:59:34.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:59:34.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-24T21:59:34.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:59:34.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:59:34.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:59:34.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-24T21:59:34.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-24T21:59:34.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:59:34.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:59:34.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:59:34.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:34 smithi188 ceph-mon[37380]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-24T21:59:34.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-07-24T21:59:34.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: osdmap e22: 3 total, 3 up, 3 in 2024-07-24T21:59:34.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:34.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:34.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:34.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-24T21:59:34.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-24T21:59:34.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:59:34.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:59:34.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:59:34.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-24T21:59:34.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:59:34.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:59:34.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:59:34.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-24T21:59:34.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-24T21:59:34.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-24T21:59:34.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-24T21:59:34.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-24T21:59:34.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:34 smithi183 ceph-mon[37007]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-24T21:59:35.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:35 smithi047 ceph-mon[32551]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:35.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:35 smithi047 ceph-mon[32551]: osdmap e23: 3 total, 3 up, 3 in 2024-07-24T21:59:35.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:35 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/854894836' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e129321a-9566-4bea-b982-34f7ddd1ae1d"}]: dispatch 2024-07-24T21:59:35.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:35 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/854894836' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e129321a-9566-4bea-b982-34f7ddd1ae1d"}]': finished 2024-07-24T21:59:35.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:35 smithi047 ceph-mon[32551]: osdmap e24: 4 total, 3 up, 4 in 2024-07-24T21:59:35.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:35.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:35 smithi047 ceph-mon[32551]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-07-24T21:59:35.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:35 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3024252907' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:59:35.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:35 smithi188 ceph-mon[37380]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:35.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:35 smithi188 ceph-mon[37380]: osdmap e23: 3 total, 3 up, 3 in 2024-07-24T21:59:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:35 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/854894836' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e129321a-9566-4bea-b982-34f7ddd1ae1d"}]: dispatch 2024-07-24T21:59:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:35 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/854894836' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e129321a-9566-4bea-b982-34f7ddd1ae1d"}]': finished 2024-07-24T21:59:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:35 smithi188 ceph-mon[37380]: osdmap e24: 4 total, 3 up, 4 in 2024-07-24T21:59:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:35 smithi188 ceph-mon[37380]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-07-24T21:59:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:35 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3024252907' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:59:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:35 smithi183 ceph-mon[37007]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:35 smithi183 ceph-mon[37007]: osdmap e23: 3 total, 3 up, 3 in 2024-07-24T21:59:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:35 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/854894836' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e129321a-9566-4bea-b982-34f7ddd1ae1d"}]: dispatch 2024-07-24T21:59:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:35 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/854894836' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e129321a-9566-4bea-b982-34f7ddd1ae1d"}]': finished 2024-07-24T21:59:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:35 smithi183 ceph-mon[37007]: osdmap e24: 4 total, 3 up, 4 in 2024-07-24T21:59:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:35 smithi183 ceph-mon[37007]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-07-24T21:59:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:35 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3024252907' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:59:37.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:37 smithi047 ceph-mon[32551]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:37.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:37 smithi188 ceph-mon[37380]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:37.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:37 smithi183 ceph-mon[37007]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:39.664 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:39 smithi047 ceph-mon[32551]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:39.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:39 smithi188 ceph-mon[37380]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:39.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:39 smithi183 ceph-mon[37007]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:41 smithi047 ceph-mon[32551]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:41 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-07-24T21:59:41.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:41 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:41.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:41 smithi188 ceph-mon[37380]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:41.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:41 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-07-24T21:59:41.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:41 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:41.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:41 smithi183 ceph-mon[37007]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:41.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:41 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-07-24T21:59:41.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:41 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:42.758 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:42 smithi047 ceph-mon[32551]: Deploying daemon osd.3 on smithi047 2024-07-24T21:59:42.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:42 smithi188 ceph-mon[37380]: Deploying daemon osd.3 on smithi047 2024-07-24T21:59:42.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:42 smithi183 ceph-mon[37007]: Deploying daemon osd.3 on smithi047 2024-07-24T21:59:43.787 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:43 smithi047 ceph-mon[32551]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:43.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:43 smithi188 ceph-mon[37380]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:43.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:43 smithi183 ceph-mon[37007]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:45.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:45 smithi047 ceph-mon[32551]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:45.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:45 smithi188 ceph-mon[37380]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:45.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:45 smithi183 ceph-mon[37007]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:46.576 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:46.576 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:46.576 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:46.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:46.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:46.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:46.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:46.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:46.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:47.573 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:47 smithi047 ceph-mon[32551]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:47.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:47 smithi188 ceph-mon[37380]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:47.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:47 smithi183 ceph-mon[37007]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:49.404 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 3 on host 'smithi047' 2024-07-24T21:59:49.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:49.401+0000 7f958f7fe640 1 -- 172.21.15.47:0/2745176447 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f95a0062f80 con 0x7f95880b3b90 2024-07-24T21:59:49.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:49.405+0000 7f95a4baa640 1 -- 172.21.15.47:0/2745176447 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95880b3b90 msgr2=0x7f95880b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:49.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:49.405+0000 7f95a4baa640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95880b3b90 0x7f95880b6050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9590009990 tx=0x7f9590009110 comp rx=0 tx=0).stop 2024-07-24T21:59:49.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:49.405+0000 7f95a4baa640 1 -- 172.21.15.47:0/2745176447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a0103fc0 msgr2=0x7f95a0199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:49.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:49.405+0000 7f95a4baa640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a0103fc0 0x7f95a0199300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f959400b3c0 tx=0x7f959400b7c0 comp rx=0 tx=0).stop 2024-07-24T21:59:49.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:49.405+0000 7f95a4baa640 1 -- 172.21.15.47:0/2745176447 shutdown_connections 2024-07-24T21:59:49.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:49.405+0000 7f95a4baa640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95880b3b90 0x7f95880b6050 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:49.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:49.405+0000 7f95a4baa640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a010cb00 0x7f95a019e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:49.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:49.405+0000 7f95a4baa640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a0103fc0 0x7f95a0199300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:49.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:49.405+0000 7f95a4baa640 1 --2- 172.21.15.47:0/2745176447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95a01036a0 0x7f95a0198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:49.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:49.405+0000 7f95a4baa640 1 -- 172.21.15.47:0/2745176447 >> 172.21.15.47:0/2745176447 conn(0x7f95a00fd100 msgr2=0x7f95a00fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:59:49.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:49.405+0000 7f95a4baa640 1 -- 172.21.15.47:0/2745176447 shutdown_connections 2024-07-24T21:59:49.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T21:59:49.405+0000 7f95a4baa640 1 -- 172.21.15.47:0/2745176447 wait complete. 2024-07-24T21:59:49.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:49 smithi047 ceph-mon[32551]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:49.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:49.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:49.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:49.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:49 smithi188 ceph-mon[37380]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:49 smithi183 ceph-mon[37007]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T21:59:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:49.969 DEBUG:teuthology.orchestra.run.smithi047:osd.3> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.3.service 2024-07-24T21:59:49.972 INFO:tasks.cephadm:Deploying osd.4 on smithi183 with /dev/vg_nvme/lv_3... 2024-07-24T21:59:49.972 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-07-24T21:59:50.230 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.b/config 2024-07-24T21:59:50.651 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:50 smithi183 ceph-mon[37007]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-07-24T21:59:50.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:50 smithi047 ceph-mon[32551]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-07-24T21:59:50.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:50 smithi188 ceph-mon[37380]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-07-24T21:59:51.517 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:51 smithi183 ceph-mon[37007]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:51.517 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:51 smithi183 ceph-mon[37007]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-07-24T21:59:51.517 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:51 smithi183 ceph-mon[37007]: osdmap e25: 4 total, 3 up, 4 in 2024-07-24T21:59:51.517 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:51 smithi183 ceph-mon[37007]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-07-24T21:59:51.517 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:51 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:51.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:51 smithi188 ceph-mon[37380]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:51.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:51 smithi188 ceph-mon[37380]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-07-24T21:59:51.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:51 smithi188 ceph-mon[37380]: osdmap e25: 4 total, 3 up, 4 in 2024-07-24T21:59:51.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:51 smithi188 ceph-mon[37380]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-07-24T21:59:51.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:51 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:51.856 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-07-24T21:59:51.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:51 smithi047 ceph-mon[32551]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:51.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:51 smithi047 ceph-mon[32551]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-07-24T21:59:51.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:51 smithi047 ceph-mon[32551]: osdmap e25: 4 total, 3 up, 4 in 2024-07-24T21:59:51.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:51 smithi047 ceph-mon[32551]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-07-24T21:59:51.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:51 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:51.954 INFO:teuthology.orchestra.run.smithi183.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-07-24T21:59:51.967 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10+0 records in 2024-07-24T21:59:51.968 INFO:teuthology.orchestra.run.smithi183.stderr:10+0 records out 2024-07-24T21:59:51.968 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113599 s, 923 MB/s 2024-07-24T21:59:51.968 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping successful for: 2024-07-24T21:59:52.607 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:52 smithi047 ceph-mon[32551]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-07-24T21:59:52.608 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:52 smithi047 ceph-mon[32551]: osdmap e26: 4 total, 3 up, 4 in 2024-07-24T21:59:52.608 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:52 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:52.608 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:52 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:52.608 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:52 smithi047 ceph-mon[32551]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' 2024-07-24T21:59:52.608 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:52 smithi047 ceph-mon[32551]: osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130] boot 2024-07-24T21:59:52.608 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:52 smithi047 ceph-mon[32551]: osdmap e27: 4 total, 4 up, 4 in 2024-07-24T21:59:52.608 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:52 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:52.608 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 21:59:52 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3[59008]: 2024-07-24T21:59:52.303+0000 7ff339618640 -1 osd.3 0 waiting for initial osdmap 2024-07-24T21:59:52.608 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 21:59:52 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3[59008]: 2024-07-24T21:59:52.311+0000 7ff331437640 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T21:59:52.653 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:52 smithi183 ceph-mon[37007]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-07-24T21:59:52.653 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:52 smithi183 ceph-mon[37007]: osdmap e26: 4 total, 3 up, 4 in 2024-07-24T21:59:52.653 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:52 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:52.653 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:52 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:52.653 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:52 smithi183 ceph-mon[37007]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' 2024-07-24T21:59:52.653 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:52 smithi183 ceph-mon[37007]: osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130] boot 2024-07-24T21:59:52.653 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:52 smithi183 ceph-mon[37007]: osdmap e27: 4 total, 4 up, 4 in 2024-07-24T21:59:52.653 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:52 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:52.682 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_3 2024-07-24T21:59:52.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:52 smithi188 ceph-mon[37380]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-07-24T21:59:52.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:52 smithi188 ceph-mon[37380]: osdmap e26: 4 total, 3 up, 4 in 2024-07-24T21:59:52.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:52 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:52.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:52 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:52.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:52 smithi188 ceph-mon[37380]: from='osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130]' entity='osd.3' 2024-07-24T21:59:52.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:52 smithi188 ceph-mon[37380]: osd.3 [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130] boot 2024-07-24T21:59:52.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:52 smithi188 ceph-mon[37380]: osdmap e27: 4 total, 4 up, 4 in 2024-07-24T21:59:52.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:52 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-24T21:59:52.936 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.b/config 2024-07-24T21:59:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:53 smithi183 ceph-mon[37007]: purged_snaps scrub starts 2024-07-24T21:59:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:53 smithi183 ceph-mon[37007]: purged_snaps scrub ok 2024-07-24T21:59:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:53 smithi183 ceph-mon[37007]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:53 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:53 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:53 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:59:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:53 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:59:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:53 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:53 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:53 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:53.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:53 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:53.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:53 smithi183 ceph-mon[37007]: osdmap e28: 4 total, 4 up, 4 in 2024-07-24T21:59:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:53 smithi188 ceph-mon[37380]: purged_snaps scrub starts 2024-07-24T21:59:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:53 smithi188 ceph-mon[37380]: purged_snaps scrub ok 2024-07-24T21:59:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:53 smithi188 ceph-mon[37380]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:53 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:53 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:53 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:59:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:53 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:59:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:53 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:53 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:53 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:53.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:53 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:53.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:53 smithi188 ceph-mon[37380]: osdmap e28: 4 total, 4 up, 4 in 2024-07-24T21:59:53.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:53 smithi047 ceph-mon[32551]: purged_snaps scrub starts 2024-07-24T21:59:53.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:53 smithi047 ceph-mon[32551]: purged_snaps scrub ok 2024-07-24T21:59:53.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:53 smithi047 ceph-mon[32551]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-07-24T21:59:53.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:53 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:53.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:53 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:53.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:53 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:59:53.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:53 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-24T21:59:53.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:53 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:53.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:53 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:53.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:53 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T21:59:53.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:53 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T21:59:53.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:53 smithi047 ceph-mon[32551]: osdmap e28: 4 total, 4 up, 4 in 2024-07-24T21:59:54.570 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.557+0000 7fb9a8667640 1 -- 172.21.15.183:0/984523601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0107a00 msgr2=0x7fb9a010e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:54.570 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.557+0000 7fb9a8667640 1 --2- 172.21.15.183:0/984523601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0107a00 0x7fb9a010e200 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb998009ca0 tx=0x7fb99802a8c0 comp rx=0 tx=0).stop 2024-07-24T21:59:54.570 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.557+0000 7fb9a8667640 1 -- 172.21.15.183:0/984523601 shutdown_connections 2024-07-24T21:59:54.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.557+0000 7fb9a8667640 1 --2- 172.21.15.183:0/984523601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0107a00 0x7fb9a010e200 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:54.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.557+0000 7fb9a8667640 1 --2- 172.21.15.183:0/984523601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9a0107080 0x7fb9a01074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:54.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.557+0000 7fb9a8667640 1 --2- 172.21.15.183:0/984523601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9a0101670 0x7fb9a0101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:54.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.557+0000 7fb9a8667640 1 -- 172.21.15.183:0/984523601 >> 172.21.15.183:0/984523601 conn(0x7fb9a00fd0e0 msgr2=0x7fb9a00ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T21:59:54.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.557+0000 7fb9a8667640 1 -- 172.21.15.183:0/984523601 shutdown_connections 2024-07-24T21:59:54.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.557+0000 7fb9a8667640 1 -- 172.21.15.183:0/984523601 wait complete. 2024-07-24T21:59:54.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a8667640 1 Processor -- start 2024-07-24T21:59:54.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a8667640 1 -- start start 2024-07-24T21:59:54.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a8667640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9a0101670 0x7fb9a0198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:59:54.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a8667640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0107080 0x7fb9a0199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:59:54.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a8667640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9a0107a00 0x7fb9a019e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:59:54.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a8667640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a0111680 con 0x7fb9a0101670 2024-07-24T21:59:54.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a8667640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a0111500 con 0x7fb9a0107080 2024-07-24T21:59:54.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a8667640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a0111800 con 0x7fb9a0107a00 2024-07-24T21:59:54.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a5c02640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0107080 0x7fb9a0199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:59:54.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a5c02640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0107080 0x7fb9a0199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:50216/0 (socket says 172.21.15.183:50216) 2024-07-24T21:59:54.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a5c02640 1 -- 172.21.15.183:0/3072105912 learned_addr learned my addr 172.21.15.183:0/3072105912 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-07-24T21:59:54.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a6403640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9a0101670 0x7fb9a0198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:59:54.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a6c04640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9a0107a00 0x7fb9a019e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:59:54.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a5c02640 1 -- 172.21.15.183:0/3072105912 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9a0107a00 msgr2=0x7fb9a019e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:54.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a5c02640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9a0107a00 0x7fb9a019e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:54.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a5c02640 1 -- 172.21.15.183:0/3072105912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9a0101670 msgr2=0x7fb9a0198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T21:59:54.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a5c02640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9a0101670 0x7fb9a0198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T21:59:54.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a5c02640 1 -- 172.21.15.183:0/3072105912 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a019ecb0 con 0x7fb9a0107080 2024-07-24T21:59:54.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a6403640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9a0101670 0x7fb9a0198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T21:59:54.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.558+0000 7fb9a5c02640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0107080 0x7fb9a0199140 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb99000d950 tx=0x7fb99000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:59:54.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.559+0000 7fb9977fe640 1 -- 172.21.15.183:0/3072105912 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990017070 con 0x7fb9a0107080 2024-07-24T21:59:54.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.559+0000 7fb9a8667640 1 -- 172.21.15.183:0/3072105912 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a019efa0 con 0x7fb9a0107080 2024-07-24T21:59:54.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.559+0000 7fb9977fe640 1 -- 172.21.15.183:0/3072105912 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb990009c30 con 0x7fb9a0107080 2024-07-24T21:59:54.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.559+0000 7fb9977fe640 1 -- 172.21.15.183:0/3072105912 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99000f620 con 0x7fb9a0107080 2024-07-24T21:59:54.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.559+0000 7fb9a8667640 1 -- 172.21.15.183:0/3072105912 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a01a5830 con 0x7fb9a0107080 2024-07-24T21:59:54.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.560+0000 7fb9a8667640 1 -- 172.21.15.183:0/3072105912 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a0102920 con 0x7fb9a0107080 2024-07-24T21:59:54.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.561+0000 7fb9977fe640 1 -- 172.21.15.183:0/3072105912 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fb990010460 con 0x7fb9a0107080 2024-07-24T21:59:54.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.562+0000 7fb9977fe640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb98c0b3c20 0x7fb98c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T21:59:54.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.562+0000 7fb9977fe640 1 -- 172.21.15.183:0/3072105912 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3884+0+0 (secure 0 0 0) 0x7fb9900e2790 con 0x7fb9a0107080 2024-07-24T21:59:54.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.562+0000 7fb9a6403640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb98c0b3c20 0x7fb98c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T21:59:54.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.562+0000 7fb9a6403640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb98c0b3c20 0x7fb98c0b60e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00abe0 tx=0x7fb99c00a5c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T21:59:54.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.565+0000 7fb9977fe640 1 -- 172.21.15.183:0/3072105912 <== mon.2 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fb9900aaf30 con 0x7fb9a0107080 2024-07-24T21:59:54.759 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T21:59:54.758+0000 7fb9a8667640 1 -- 172.21.15.183:0/3072105912 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb9a0062f80 con 0x7fb98c0b3c20 2024-07-24T21:59:54.760 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:54 smithi183 ceph-mon[37007]: Detected new or changed devices on smithi047 2024-07-24T21:59:54.760 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:54 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi047 to 8546M 2024-07-24T21:59:54.760 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:54 smithi183 ceph-mon[37007]: osdmap e29: 4 total, 4 up, 4 in 2024-07-24T21:59:54.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:54 smithi188 ceph-mon[37380]: Detected new or changed devices on smithi047 2024-07-24T21:59:54.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:54 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi047 to 8546M 2024-07-24T21:59:54.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:54 smithi188 ceph-mon[37380]: osdmap e29: 4 total, 4 up, 4 in 2024-07-24T21:59:54.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:54 smithi047 ceph-mon[32551]: Detected new or changed devices on smithi047 2024-07-24T21:59:54.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:54 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi047 to 8546M 2024-07-24T21:59:54.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:54 smithi047 ceph-mon[32551]: osdmap e29: 4 total, 4 up, 4 in 2024-07-24T21:59:55.751 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:55 smithi183 ceph-mon[37007]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail 2024-07-24T21:59:55.751 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:59:55.751 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:59:55.751 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:55.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:55 smithi188 ceph-mon[37380]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail 2024-07-24T21:59:55.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:59:55.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:59:55.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:55.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:55 smithi047 ceph-mon[32551]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail 2024-07-24T21:59:55.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T21:59:55.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T21:59:55.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T21:59:56.623 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:56 smithi183 ceph-mon[37007]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:59:56.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:56 smithi188 ceph-mon[37380]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:59:56.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:56 smithi047 ceph-mon[32551]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T21:59:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:57 smithi047 ceph-mon[32551]: pgmap v92: 1 pgs: 1 peering; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail 2024-07-24T21:59:57.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:57 smithi047 ceph-mon[32551]: from='client.? 172.21.15.183:0/309089175' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f969fba7-b0ff-4ea6-83bd-38aba32b1be1"}]: dispatch 2024-07-24T21:59:57.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:57 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f969fba7-b0ff-4ea6-83bd-38aba32b1be1"}]: dispatch 2024-07-24T21:59:57.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:57 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f969fba7-b0ff-4ea6-83bd-38aba32b1be1"}]': finished 2024-07-24T21:59:57.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:57 smithi047 ceph-mon[32551]: osdmap e30: 5 total, 4 up, 5 in 2024-07-24T21:59:57.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:57 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T21:59:57.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:57 smithi188 ceph-mon[37380]: pgmap v92: 1 pgs: 1 peering; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail 2024-07-24T21:59:57.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:57 smithi188 ceph-mon[37380]: from='client.? 172.21.15.183:0/309089175' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f969fba7-b0ff-4ea6-83bd-38aba32b1be1"}]: dispatch 2024-07-24T21:59:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:57 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f969fba7-b0ff-4ea6-83bd-38aba32b1be1"}]: dispatch 2024-07-24T21:59:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:57 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f969fba7-b0ff-4ea6-83bd-38aba32b1be1"}]': finished 2024-07-24T21:59:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:57 smithi188 ceph-mon[37380]: osdmap e30: 5 total, 4 up, 5 in 2024-07-24T21:59:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:57 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T21:59:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:57 smithi183 ceph-mon[37007]: pgmap v92: 1 pgs: 1 peering; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail 2024-07-24T21:59:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:57 smithi183 ceph-mon[37007]: from='client.? 172.21.15.183:0/309089175' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f969fba7-b0ff-4ea6-83bd-38aba32b1be1"}]: dispatch 2024-07-24T21:59:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:57 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f969fba7-b0ff-4ea6-83bd-38aba32b1be1"}]: dispatch 2024-07-24T21:59:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:57 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f969fba7-b0ff-4ea6-83bd-38aba32b1be1"}]': finished 2024-07-24T21:59:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:57 smithi183 ceph-mon[37007]: osdmap e30: 5 total, 4 up, 5 in 2024-07-24T21:59:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:57 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T21:59:58.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:58 smithi188 ceph-mon[37380]: from='client.? 172.21.15.183:0/2476206297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:59:58.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:58 smithi183 ceph-mon[37007]: from='client.? 172.21.15.183:0/2476206297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:59:58.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:58 smithi047 ceph-mon[32551]: from='client.? 172.21.15.183:0/2476206297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T21:59:59.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 21:59:59 smithi188 ceph-mon[37380]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-24T21:59:59.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 21:59:59 smithi183 ceph-mon[37007]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-24T21:59:59.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 21:59:59 smithi047 ceph-mon[32551]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-24T22:00:00.778 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:00 smithi183 ceph-mon[37007]: overall HEALTH_OK 2024-07-24T22:00:00.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:00 smithi188 ceph-mon[37380]: overall HEALTH_OK 2024-07-24T22:00:00.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:00 smithi047 ceph-mon[32551]: overall HEALTH_OK 2024-07-24T22:00:01.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:01 smithi183 ceph-mon[37007]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-07-24T22:00:01.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:01 smithi188 ceph-mon[37380]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-07-24T22:00:01.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:01 smithi047 ceph-mon[32551]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-07-24T22:00:03.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:03 smithi188 ceph-mon[37380]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-24T22:00:03.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:03 smithi183 ceph-mon[37007]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-24T22:00:03.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:03 smithi047 ceph-mon[32551]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-24T22:00:04.707 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:04 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-07-24T22:00:04.707 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:04 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:04.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:04 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-07-24T22:00:04.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:04 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:04.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:04 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-07-24T22:00:04.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:04 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:05.743 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:05 smithi183 ceph-mon[37007]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-07-24T22:00:05.744 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:05 smithi183 ceph-mon[37007]: Deploying daemon osd.4 on smithi183 2024-07-24T22:00:05.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:05 smithi188 ceph-mon[37380]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-07-24T22:00:05.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:05 smithi188 ceph-mon[37380]: Deploying daemon osd.4 on smithi183 2024-07-24T22:00:05.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:05 smithi047 ceph-mon[32551]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-07-24T22:00:05.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:05 smithi047 ceph-mon[32551]: Deploying daemon osd.4 on smithi183 2024-07-24T22:00:07.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:07 smithi188 ceph-mon[37380]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-24T22:00:07.818 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:07 smithi183 ceph-mon[37007]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-24T22:00:07.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:07 smithi047 ceph-mon[32551]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-24T22:00:09.730 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:09 smithi183 ceph-mon[37007]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-07-24T22:00:09.730 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:09 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:09.730 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:09 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:09.730 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:09 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:09.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:09 smithi188 ceph-mon[37380]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-07-24T22:00:09.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:09 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:09.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:09 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:09.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:09 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:09.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:09 smithi047 ceph-mon[32551]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-07-24T22:00:09.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:09 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:09.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:09 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:09.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:09 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:11.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:11 smithi188 ceph-mon[37380]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:00:11.823 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:11 smithi183 ceph-mon[37007]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:00:11.823 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:00:11.821+0000 7fb9977fe640 1 -- 172.21.15.183:0/3072105912 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb9a0062f80 con 0x7fb98c0b3c20 2024-07-24T22:00:11.824 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 4 on host 'smithi183' 2024-07-24T22:00:11.826 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:00:11.823+0000 7fb9a8667640 1 -- 172.21.15.183:0/3072105912 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb98c0b3c20 msgr2=0x7fb98c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:00:11.826 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:00:11.823+0000 7fb9a8667640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb98c0b3c20 0x7fb98c0b60e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00abe0 tx=0x7fb99c00a5c0 comp rx=0 tx=0).stop 2024-07-24T22:00:11.826 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:00:11.823+0000 7fb9a8667640 1 -- 172.21.15.183:0/3072105912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0107080 msgr2=0x7fb9a0199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:00:11.826 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:00:11.823+0000 7fb9a8667640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0107080 0x7fb9a0199140 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb99000d950 tx=0x7fb99000de10 comp rx=0 tx=0).stop 2024-07-24T22:00:11.826 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:00:11.823+0000 7fb9a8667640 1 -- 172.21.15.183:0/3072105912 shutdown_connections 2024-07-24T22:00:11.826 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:00:11.823+0000 7fb9a8667640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb98c0b3c20 0x7fb98c0b60e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:11.826 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:00:11.823+0000 7fb9a8667640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9a0107a00 0x7fb9a019e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:11.826 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:00:11.823+0000 7fb9a8667640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a0107080 0x7fb9a0199140 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:11.826 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:00:11.823+0000 7fb9a8667640 1 --2- 172.21.15.183:0/3072105912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9a0101670 0x7fb9a0198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:11.827 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:00:11.823+0000 7fb9a8667640 1 -- 172.21.15.183:0/3072105912 >> 172.21.15.183:0/3072105912 conn(0x7fb9a00fd0e0 msgr2=0x7fb9a006b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:00:11.827 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:00:11.823+0000 7fb9a8667640 1 -- 172.21.15.183:0/3072105912 shutdown_connections 2024-07-24T22:00:11.827 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:00:11.823+0000 7fb9a8667640 1 -- 172.21.15.183:0/3072105912 wait complete. 2024-07-24T22:00:11.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:11 smithi047 ceph-mon[32551]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:00:12.879 DEBUG:teuthology.orchestra.run.smithi183:osd.4> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.4.service 2024-07-24T22:00:12.882 INFO:tasks.cephadm:Deploying osd.5 on smithi188 with /dev/vg_nvme/lv_3... 2024-07-24T22:00:12.882 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-07-24T22:00:13.146 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T22:00:13.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:13.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:13.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:12 smithi183 ceph-mon[37007]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-24T22:00:13.162 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:00:12 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4[49350]: 2024-07-24T22:00:12.938+0000 7f2b4b7e2640 -1 osd.4 0 log_to_monitors true 2024-07-24T22:00:13.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:13.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:13.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:12 smithi047 ceph-mon[32551]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-24T22:00:13.269 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:13.269 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:13.269 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:12 smithi188 ceph-mon[37380]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-24T22:00:14.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:13 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:14.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:13 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:14.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:13 smithi183 ceph-mon[37007]: from='osd.4 [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-24T22:00:14.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:13 smithi183 ceph-mon[37007]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-24T22:00:14.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:13 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:14.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:13 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:14.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:13 smithi047 ceph-mon[32551]: from='osd.4 [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-24T22:00:14.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:13 smithi047 ceph-mon[32551]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-24T22:00:14.189 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:13 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:14.189 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:13 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:14.189 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:13 smithi188 ceph-mon[37380]: from='osd.4 [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-24T22:00:14.190 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:13 smithi188 ceph-mon[37380]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-24T22:00:14.817 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-07-24T22:00:14.911 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-07-24T22:00:14.930 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-07-24T22:00:14.930 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-07-24T22:00:14.930 INFO:teuthology.orchestra.run.smithi188.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.016914 s, 620 MB/s 2024-07-24T22:00:14.930 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-07-24T22:00:15.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:14 smithi047 ceph-mon[32551]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-07-24T22:00:15.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:14 smithi047 ceph-mon[32551]: osdmap e31: 5 total, 4 up, 5 in 2024-07-24T22:00:15.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:14 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T22:00:15.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:14 smithi047 ceph-mon[32551]: from='osd.4 [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:00:15.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:14 smithi047 ceph-mon[32551]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:00:15.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:14 smithi047 ceph-mon[32551]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-24T22:00:15.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:14 smithi188 ceph-mon[37380]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-07-24T22:00:15.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:14 smithi188 ceph-mon[37380]: osdmap e31: 5 total, 4 up, 5 in 2024-07-24T22:00:15.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:14 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T22:00:15.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:14 smithi188 ceph-mon[37380]: from='osd.4 [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:00:15.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:14 smithi188 ceph-mon[37380]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:00:15.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:14 smithi188 ceph-mon[37380]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-24T22:00:15.377 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:00:14 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4[49350]: 2024-07-24T22:00:14.920+0000 7f2b47765640 -1 osd.4 0 waiting for initial osdmap 2024-07-24T22:00:15.377 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:00:14 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4[49350]: 2024-07-24T22:00:14.929+0000 7f2b4358c640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T22:00:15.377 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:14 smithi183 ceph-mon[37007]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-07-24T22:00:15.377 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:14 smithi183 ceph-mon[37007]: osdmap e31: 5 total, 4 up, 5 in 2024-07-24T22:00:15.377 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:14 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T22:00:15.377 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:14 smithi183 ceph-mon[37007]: from='osd.4 [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:00:15.377 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:14 smithi183 ceph-mon[37007]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:00:15.377 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:14 smithi183 ceph-mon[37007]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-24T22:00:15.517 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch daemon add osd smithi188:vg_nvme/lv_3 2024-07-24T22:00:15.784 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T22:00:16.073 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-07-24T22:00:16.073 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: osdmap e32: 5 total, 4 up, 5 in 2024-07-24T22:00:16.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T22:00:16.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T22:00:16.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:00:16.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:00:16.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:16.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:16.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:16.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:16.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:16.075 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-07-24T22:00:16.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: osdmap e32: 5 total, 4 up, 5 in 2024-07-24T22:00:16.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T22:00:16.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T22:00:16.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:00:16.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:00:16.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:16.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:16.077 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.077 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:16.077 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:16.077 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:16.077 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-07-24T22:00:16.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: osdmap e32: 5 total, 4 up, 5 in 2024-07-24T22:00:16.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T22:00:16.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T22:00:16.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:00:16.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:00:16.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.163 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:16.163 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:16.163 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:16.163 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:16.163 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:16.163 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:16.163 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:17.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:16 smithi047 ceph-mon[32551]: purged_snaps scrub starts 2024-07-24T22:00:17.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:16 smithi047 ceph-mon[32551]: purged_snaps scrub ok 2024-07-24T22:00:17.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:16 smithi047 ceph-mon[32551]: Detected new or changed devices on smithi183 2024-07-24T22:00:17.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:16 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi183 to 8544M 2024-07-24T22:00:17.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:16 smithi047 ceph-mon[32551]: osd.4 [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107] boot 2024-07-24T22:00:17.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:16 smithi047 ceph-mon[32551]: osdmap e33: 5 total, 5 up, 5 in 2024-07-24T22:00:17.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:16 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T22:00:17.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:16 smithi047 ceph-mon[32551]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-24T22:00:17.188 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:16 smithi188 ceph-mon[37380]: purged_snaps scrub starts 2024-07-24T22:00:17.188 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:16 smithi188 ceph-mon[37380]: purged_snaps scrub ok 2024-07-24T22:00:17.189 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:16 smithi188 ceph-mon[37380]: Detected new or changed devices on smithi183 2024-07-24T22:00:17.189 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:16 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi183 to 8544M 2024-07-24T22:00:17.189 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:16 smithi188 ceph-mon[37380]: osd.4 [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107] boot 2024-07-24T22:00:17.189 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:16 smithi188 ceph-mon[37380]: osdmap e33: 5 total, 5 up, 5 in 2024-07-24T22:00:17.189 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:16 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T22:00:17.189 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:16 smithi188 ceph-mon[37380]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-24T22:00:17.271 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.268+0000 7fba751aa640 1 -- 172.21.15.188:0/4243556457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba70108170 msgr2=0x7fba701085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:00:17.271 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.268+0000 7fba751aa640 1 --2- 172.21.15.188:0/4243556457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba70108170 0x7fba701085b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fba64009900 tx=0x7fba6402a410 comp rx=0 tx=0).stop 2024-07-24T22:00:17.271 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.268+0000 7fba751aa640 1 -- 172.21.15.188:0/4243556457 shutdown_connections 2024-07-24T22:00:17.271 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.269+0000 7fba751aa640 1 --2- 172.21.15.188:0/4243556457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba70108af0 0x7fba7010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:17.271 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.269+0000 7fba751aa640 1 --2- 172.21.15.188:0/4243556457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba70108170 0x7fba701085b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:17.271 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.269+0000 7fba751aa640 1 --2- 172.21.15.188:0/4243556457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba70102760 0x7fba70102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:17.272 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.269+0000 7fba751aa640 1 -- 172.21.15.188:0/4243556457 >> 172.21.15.188:0/4243556457 conn(0x7fba700fe210 msgr2=0x7fba70100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:00:17.272 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.269+0000 7fba751aa640 1 -- 172.21.15.188:0/4243556457 shutdown_connections 2024-07-24T22:00:17.272 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.269+0000 7fba751aa640 1 -- 172.21.15.188:0/4243556457 wait complete. 2024-07-24T22:00:17.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.269+0000 7fba751aa640 1 Processor -- start 2024-07-24T22:00:17.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba751aa640 1 -- start start 2024-07-24T22:00:17.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba751aa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba70102760 0x7fba70074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:00:17.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba751aa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba70108170 0x7fba700753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:00:17.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba751aa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba70108af0 0x7fba70075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:00:17.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba751aa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fba70112720 con 0x7fba70108170 2024-07-24T22:00:17.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba751aa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fba701125a0 con 0x7fba70108af0 2024-07-24T22:00:17.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba751aa640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fba701128a0 con 0x7fba70102760 2024-07-24T22:00:17.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba6ed9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba70102760 0x7fba70074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:00:17.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba6ed9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba70102760 0x7fba70074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:55106/0 (socket says 172.21.15.188:55106) 2024-07-24T22:00:17.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba6ed9d640 1 -- 172.21.15.188:0/3554217314 learned_addr learned my addr 172.21.15.188:0/3554217314 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-07-24T22:00:17.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba6f59e640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba70108af0 0x7fba70075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:00:17.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba6e59c640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba70108170 0x7fba700753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:00:17.277 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba6ed9d640 1 -- 172.21.15.188:0/3554217314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba70108af0 msgr2=0x7fba70075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:00:17.277 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba6ed9d640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba70108af0 0x7fba70075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:17.277 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba6ed9d640 1 -- 172.21.15.188:0/3554217314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba70108170 msgr2=0x7fba700753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:00:17.277 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba6ed9d640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba70108170 0x7fba700753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:17.277 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba6ed9d640 1 -- 172.21.15.188:0/3554217314 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba701a7070 con 0x7fba70102760 2024-07-24T22:00:17.277 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.270+0000 7fba6ed9d640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba70102760 0x7fba70074e90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba6000d950 tx=0x7fba6000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:00:17.277 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.271+0000 7fba57fff640 1 -- 172.21.15.188:0/3554217314 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba60017030 con 0x7fba70102760 2024-07-24T22:00:17.278 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.271+0000 7fba57fff640 1 -- 172.21.15.188:0/3554217314 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba60004020 con 0x7fba70102760 2024-07-24T22:00:17.278 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.271+0000 7fba751aa640 1 -- 172.21.15.188:0/3554217314 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba701a7360 con 0x7fba70102760 2024-07-24T22:00:17.278 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.271+0000 7fba57fff640 1 -- 172.21.15.188:0/3554217314 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba600047a0 con 0x7fba70102760 2024-07-24T22:00:17.278 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.271+0000 7fba751aa640 1 -- 172.21.15.188:0/3554217314 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba701a7870 con 0x7fba70102760 2024-07-24T22:00:17.278 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.272+0000 7fba751aa640 1 -- 172.21.15.188:0/3554217314 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba70102b40 con 0x7fba70102760 2024-07-24T22:00:17.278 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.273+0000 7fba57fff640 1 -- 172.21.15.188:0/3554217314 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fba60009a30 con 0x7fba70102760 2024-07-24T22:00:17.279 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.273+0000 7fba57fff640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fba580b3c20 0x7fba580b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:00:17.279 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.274+0000 7fba6e59c640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fba580b3c20 0x7fba580b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:00:17.279 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.274+0000 7fba57fff640 1 -- 172.21.15.188:0/3554217314 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4316+0+0 (secure 0 0 0) 0x7fba600e2ec0 con 0x7fba70102760 2024-07-24T22:00:17.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.274+0000 7fba6e59c640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fba580b3c20 0x7fba580b60e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fba64031440 tx=0x7fba640095f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:00:17.280 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.277+0000 7fba57fff640 1 -- 172.21.15.188:0/3554217314 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fba600ab410 con 0x7fba70102760 2024-07-24T22:00:17.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:16 smithi183 ceph-mon[37007]: purged_snaps scrub starts 2024-07-24T22:00:17.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:16 smithi183 ceph-mon[37007]: purged_snaps scrub ok 2024-07-24T22:00:17.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:16 smithi183 ceph-mon[37007]: Detected new or changed devices on smithi183 2024-07-24T22:00:17.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:16 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi183 to 8544M 2024-07-24T22:00:17.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:16 smithi183 ceph-mon[37007]: osd.4 [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107] boot 2024-07-24T22:00:17.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:16 smithi183 ceph-mon[37007]: osdmap e33: 5 total, 5 up, 5 in 2024-07-24T22:00:17.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:16 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-24T22:00:17.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:16 smithi183 ceph-mon[37007]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-24T22:00:17.473 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:17.471+0000 7fba751aa640 1 -- 172.21.15.188:0/3554217314 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fba70062f80 con 0x7fba580b3c20 2024-07-24T22:00:18.166 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:17 smithi188 ceph-mon[37380]: osdmap e34: 5 total, 5 up, 5 in 2024-07-24T22:00:18.166 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:17 smithi188 ceph-mon[37380]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:00:18.166 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:00:18.166 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:00:18.166 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:18.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:17 smithi047 ceph-mon[32551]: osdmap e34: 5 total, 5 up, 5 in 2024-07-24T22:00:18.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:17 smithi047 ceph-mon[32551]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:00:18.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:00:18.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:00:18.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:18.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:17 smithi183 ceph-mon[37007]: osdmap e34: 5 total, 5 up, 5 in 2024-07-24T22:00:18.414 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:17 smithi183 ceph-mon[37007]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:00:18.414 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:00:18.414 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:00:18.414 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:19.191 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:18 smithi188 ceph-mon[37380]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:19.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:18 smithi183 ceph-mon[37007]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:19.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:18 smithi047 ceph-mon[32551]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:20.214 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:19 smithi188 ceph-mon[37380]: from='client.? 172.21.15.188:0/2485892528' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3799c912-3d9f-4efd-9b36-569c385e4c33"}]: dispatch 2024-07-24T22:00:20.214 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:19 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3799c912-3d9f-4efd-9b36-569c385e4c33"}]: dispatch 2024-07-24T22:00:20.214 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:19 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3799c912-3d9f-4efd-9b36-569c385e4c33"}]': finished 2024-07-24T22:00:20.214 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:19 smithi188 ceph-mon[37380]: osdmap e35: 6 total, 5 up, 6 in 2024-07-24T22:00:20.214 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:20.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:19 smithi183 ceph-mon[37007]: from='client.? 172.21.15.188:0/2485892528' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3799c912-3d9f-4efd-9b36-569c385e4c33"}]: dispatch 2024-07-24T22:00:20.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:19 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3799c912-3d9f-4efd-9b36-569c385e4c33"}]: dispatch 2024-07-24T22:00:20.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:19 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3799c912-3d9f-4efd-9b36-569c385e4c33"}]': finished 2024-07-24T22:00:20.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:19 smithi183 ceph-mon[37007]: osdmap e35: 6 total, 5 up, 6 in 2024-07-24T22:00:20.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:20.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:19 smithi047 ceph-mon[32551]: from='client.? 172.21.15.188:0/2485892528' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3799c912-3d9f-4efd-9b36-569c385e4c33"}]: dispatch 2024-07-24T22:00:20.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:19 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3799c912-3d9f-4efd-9b36-569c385e4c33"}]: dispatch 2024-07-24T22:00:20.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:19 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3799c912-3d9f-4efd-9b36-569c385e4c33"}]': finished 2024-07-24T22:00:20.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:19 smithi047 ceph-mon[32551]: osdmap e35: 6 total, 5 up, 6 in 2024-07-24T22:00:20.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:21.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:20 smithi188 ceph-mon[37380]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:21.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:20 smithi188 ceph-mon[37380]: from='client.? 172.21.15.188:0/1931613925' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:00:21.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:20 smithi183 ceph-mon[37007]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:21.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:20 smithi183 ceph-mon[37007]: from='client.? 172.21.15.188:0/1931613925' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:00:21.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:20 smithi047 ceph-mon[32551]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:21.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:20 smithi047 ceph-mon[32551]: from='client.? 172.21.15.188:0/1931613925' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:00:23.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:23 smithi183 ceph-mon[37007]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:23.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:23 smithi047 ceph-mon[32551]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:23.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:23 smithi188 ceph-mon[37380]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:25.140 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:25 smithi188 ceph-mon[37380]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:25.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:25 smithi183 ceph-mon[37007]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:25.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:25 smithi047 ceph-mon[32551]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:27.414 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:27 smithi183 ceph-mon[37007]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:27.414 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-07-24T22:00:27.414 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:27.429 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:27 smithi188 ceph-mon[37380]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:27.429 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-07-24T22:00:27.429 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:27.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:27 smithi047 ceph-mon[32551]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:27.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-07-24T22:00:27.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:28.259 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:28 smithi188 ceph-mon[37380]: Deploying daemon osd.5 on smithi188 2024-07-24T22:00:28.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:28 smithi183 ceph-mon[37007]: Deploying daemon osd.5 on smithi188 2024-07-24T22:00:28.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:28 smithi047 ceph-mon[32551]: Deploying daemon osd.5 on smithi188 2024-07-24T22:00:29.366 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:29 smithi188 ceph-mon[37380]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:29.410 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:29 smithi183 ceph-mon[37007]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:29 smithi047 ceph-mon[32551]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:31 smithi183 ceph-mon[37007]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:31.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:31 smithi047 ceph-mon[32551]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:31.466 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:31 smithi188 ceph-mon[37380]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:32.422 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:32.422 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:32.422 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:32.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:32.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:32.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:33.251 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:33 smithi188 ceph-mon[37380]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:33.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:33 smithi183 ceph-mon[37007]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:33.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:33 smithi047 ceph-mon[32551]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:34.654 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:34.652+0000 7fba57fff640 1 -- 172.21.15.188:0/3554217314 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fba70062f80 con 0x7fba580b3c20 2024-07-24T22:00:34.654 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 5 on host 'smithi188' 2024-07-24T22:00:34.656 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:34.654+0000 7fba751aa640 1 -- 172.21.15.188:0/3554217314 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fba580b3c20 msgr2=0x7fba580b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:00:34.656 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:34.654+0000 7fba751aa640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fba580b3c20 0x7fba580b60e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fba64031440 tx=0x7fba640095f0 comp rx=0 tx=0).stop 2024-07-24T22:00:34.656 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:34.654+0000 7fba751aa640 1 -- 172.21.15.188:0/3554217314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba70102760 msgr2=0x7fba70074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:00:34.657 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:34.654+0000 7fba751aa640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba70102760 0x7fba70074e90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba6000d950 tx=0x7fba6000de10 comp rx=0 tx=0).stop 2024-07-24T22:00:34.657 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:34.654+0000 7fba751aa640 1 -- 172.21.15.188:0/3554217314 shutdown_connections 2024-07-24T22:00:34.657 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:34.654+0000 7fba751aa640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fba580b3c20 0x7fba580b60e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:34.657 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:34.654+0000 7fba751aa640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba70108af0 0x7fba70075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:34.657 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:34.654+0000 7fba751aa640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba70108170 0x7fba700753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:34.657 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:34.654+0000 7fba751aa640 1 --2- 172.21.15.188:0/3554217314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba70102760 0x7fba70074e90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:34.657 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:34.654+0000 7fba751aa640 1 -- 172.21.15.188:0/3554217314 >> 172.21.15.188:0/3554217314 conn(0x7fba700fe210 msgr2=0x7fba70100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:00:34.657 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:34.654+0000 7fba751aa640 1 -- 172.21.15.188:0/3554217314 shutdown_connections 2024-07-24T22:00:34.657 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:00:34.654+0000 7fba751aa640 1 -- 172.21.15.188:0/3554217314 wait complete. 2024-07-24T22:00:35.235 DEBUG:teuthology.orchestra.run.smithi188:osd.5> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.5.service 2024-07-24T22:00:35.237 INFO:tasks.cephadm:Deploying osd.6 on smithi047 with /dev/vg_nvme/lv_2... 2024-07-24T22:00:35.238 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-07-24T22:00:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:00:35.898 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:35 smithi188 ceph-mon[37380]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:35.898 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:35.898 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:35.898 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:35.898 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:35.899 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:00:35 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:00:35.667+0000 7ff4ad5b0640 -1 osd.5 0 log_to_monitors true 2024-07-24T22:00:35.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:35 smithi183 ceph-mon[37007]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:35.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:35.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:35 smithi047 ceph-mon[32551]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:35.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:35.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:35.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:35.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:36.763 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:36 smithi047 ceph-mon[32551]: from='osd.5 [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-24T22:00:36.764 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:36 smithi047 ceph-mon[32551]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-24T22:00:36.790 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:36 smithi188 ceph-mon[37380]: from='osd.5 [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-24T22:00:36.791 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:36 smithi188 ceph-mon[37380]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-24T22:00:36.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:36 smithi183 ceph-mon[37007]: from='osd.5 [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-24T22:00:36.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:36 smithi183 ceph-mon[37007]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-24T22:00:37.380 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-07-24T22:00:37.468 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-07-24T22:00:37.478 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-07-24T22:00:37.478 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-07-24T22:00:37.478 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00818199 s, 1.3 GB/s 2024-07-24T22:00:37.478 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-07-24T22:00:37.895 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:00:37 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:00:37.661+0000 7ff4a9533640 -1 osd.5 0 waiting for initial osdmap 2024-07-24T22:00:37.895 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:00:37 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:00:37.668+0000 7ff4a535a640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T22:00:37.895 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:37 smithi188 ceph-mon[37380]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:37.895 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:37 smithi188 ceph-mon[37380]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-07-24T22:00:37.895 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:37 smithi188 ceph-mon[37380]: from='osd.5 [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:00:37.895 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:37 smithi188 ceph-mon[37380]: osdmap e36: 6 total, 5 up, 6 in 2024-07-24T22:00:37.896 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:37 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:37.896 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:37 smithi188 ceph-mon[37380]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:00:37.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:37 smithi183 ceph-mon[37007]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:37 smithi183 ceph-mon[37007]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-07-24T22:00:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:37 smithi183 ceph-mon[37007]: from='osd.5 [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:00:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:37 smithi183 ceph-mon[37007]: osdmap e36: 6 total, 5 up, 6 in 2024-07-24T22:00:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:37 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:37 smithi183 ceph-mon[37007]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:00:37.934 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:37 smithi047 ceph-mon[32551]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:37.934 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:37 smithi047 ceph-mon[32551]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-07-24T22:00:37.934 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:37 smithi047 ceph-mon[32551]: from='osd.5 [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:00:37.934 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:37 smithi047 ceph-mon[32551]: osdmap e36: 6 total, 5 up, 6 in 2024-07-24T22:00:37.934 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:37 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:37.934 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:37 smithi047 ceph-mon[32551]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:00:38.090 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_2 2024-07-24T22:00:38.358 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:00:38.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-07-24T22:00:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: osdmap e37: 6 total, 5 up, 6 in 2024-07-24T22:00:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:00:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:00:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:38.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:38.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:38.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:38.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:38.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-07-24T22:00:38.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: osdmap e37: 6 total, 5 up, 6 in 2024-07-24T22:00:38.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:38.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:38.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:38.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:38.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:00:38.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:00:38.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:38.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:38.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:38.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:38.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:38.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:38.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:38.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:39.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-07-24T22:00:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: osdmap e37: 6 total, 5 up, 6 in 2024-07-24T22:00:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:00:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:00:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:39.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:39.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:39.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:39.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:39.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.757+0000 7fc89c5c8640 1 -- 172.21.15.47:0/2146575702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc894108180 msgr2=0x7fc8941085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:00:39.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.757+0000 7fc89c5c8640 1 --2- 172.21.15.47:0/2146575702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc894108180 0x7fc8941085c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc884009900 tx=0x7fc88402a3f0 comp rx=0 tx=0).stop 2024-07-24T22:00:39.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.758+0000 7fc89c5c8640 1 -- 172.21.15.47:0/2146575702 shutdown_connections 2024-07-24T22:00:39.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.758+0000 7fc89c5c8640 1 --2- 172.21.15.47:0/2146575702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc894108b00 0x7fc89410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:39.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.758+0000 7fc89c5c8640 1 --2- 172.21.15.47:0/2146575702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc894108180 0x7fc8941085c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:39.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.758+0000 7fc89c5c8640 1 --2- 172.21.15.47:0/2146575702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc894102770 0x7fc894102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:39.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.758+0000 7fc89c5c8640 1 -- 172.21.15.47:0/2146575702 >> 172.21.15.47:0/2146575702 conn(0x7fc8940fe1c0 msgr2=0x7fc8941005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:00:39.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.758+0000 7fc89c5c8640 1 -- 172.21.15.47:0/2146575702 shutdown_connections 2024-07-24T22:00:39.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.758+0000 7fc89c5c8640 1 -- 172.21.15.47:0/2146575702 wait complete. 2024-07-24T22:00:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.758+0000 7fc89c5c8640 1 Processor -- start 2024-07-24T22:00:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.758+0000 7fc89c5c8640 1 -- start start 2024-07-24T22:00:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc89c5c8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc894102770 0x7fc894198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:00:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc89c5c8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc894108180 0x7fc894199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:00:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc89c5c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc894108b00 0x7fc89419e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:00:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc89c5c8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc894112700 con 0x7fc894108180 2024-07-24T22:00:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc89c5c8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc894112580 con 0x7fc894102770 2024-07-24T22:00:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc89c5c8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc894112880 con 0x7fc894108b00 2024-07-24T22:00:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc899b63640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc894108180 0x7fc894199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:00:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc899b63640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc894108180 0x7fc894199030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58622/0 (socket says 172.21.15.47:58622) 2024-07-24T22:00:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc899b63640 1 -- 172.21.15.47:0/842044878 learned_addr learned my addr 172.21.15.47:0/842044878 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:00:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc89a364640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc894102770 0x7fc894198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:00:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc89ab65640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc894108b00 0x7fc89419e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:00:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc899b63640 1 -- 172.21.15.47:0/842044878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc894108b00 msgr2=0x7fc89419e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:00:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc899b63640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc894108b00 0x7fc89419e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc899b63640 1 -- 172.21.15.47:0/842044878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc894102770 msgr2=0x7fc894198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:00:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc899b63640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc894102770 0x7fc894198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc899b63640 1 -- 172.21.15.47:0/842044878 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89419eba0 con 0x7fc894108180 2024-07-24T22:00:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.759+0000 7fc899b63640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc894108180 0x7fc894199030 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc884006010 tx=0x7fc8840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:00:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.760+0000 7fc88b7fe640 1 -- 172.21.15.47:0/842044878 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88403f030 con 0x7fc894108180 2024-07-24T22:00:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.760+0000 7fc89c5c8640 1 -- 172.21.15.47:0/842044878 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89419ee30 con 0x7fc894108180 2024-07-24T22:00:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.760+0000 7fc88b7fe640 1 -- 172.21.15.47:0/842044878 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc884003800 con 0x7fc894108180 2024-07-24T22:00:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.760+0000 7fc88b7fe640 1 -- 172.21.15.47:0/842044878 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc884035070 con 0x7fc894108180 2024-07-24T22:00:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.760+0000 7fc89c5c8640 1 -- 172.21.15.47:0/842044878 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8941a5550 con 0x7fc894108180 2024-07-24T22:00:39.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.761+0000 7fc89c5c8640 1 -- 172.21.15.47:0/842044878 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc894102b50 con 0x7fc894108180 2024-07-24T22:00:39.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.763+0000 7fc88b7fe640 1 -- 172.21.15.47:0/842044878 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fc884003cb0 con 0x7fc894108180 2024-07-24T22:00:39.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.764+0000 7fc88b7fe640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8800b3c20 0x7fc8800b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:00:39.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.764+0000 7fc89a364640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8800b3c20 0x7fc8800b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:00:39.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.764+0000 7fc88b7fe640 1 -- 172.21.15.47:0/842044878 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4748+0+0 (secure 0 0 0) 0x7fc884103a30 con 0x7fc894108180 2024-07-24T22:00:39.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.764+0000 7fc89a364640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8800b3c20 0x7fc8800b60e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc89000abe0 tx=0x7fc89000a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:00:39.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.767+0000 7fc88b7fe640 1 -- 172.21.15.47:0/842044878 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fc8840cbdd0 con 0x7fc894108180 2024-07-24T22:00:39.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:39 smithi183 ceph-mon[37007]: purged_snaps scrub starts 2024-07-24T22:00:39.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:39 smithi183 ceph-mon[37007]: purged_snaps scrub ok 2024-07-24T22:00:39.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:39 smithi183 ceph-mon[37007]: Detected new or changed devices on smithi188 2024-07-24T22:00:39.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:39 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi188 to 8544M 2024-07-24T22:00:39.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:39 smithi183 ceph-mon[37007]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:39.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:39 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:39.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:39 smithi183 ceph-mon[37007]: osd.5 [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083] boot 2024-07-24T22:00:39.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:39 smithi183 ceph-mon[37007]: osdmap e38: 6 total, 6 up, 6 in 2024-07-24T22:00:39.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:39 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:39.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:39 smithi183 ceph-mon[37007]: osdmap e39: 6 total, 6 up, 6 in 2024-07-24T22:00:39.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:39 smithi047 ceph-mon[32551]: purged_snaps scrub starts 2024-07-24T22:00:39.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:39 smithi047 ceph-mon[32551]: purged_snaps scrub ok 2024-07-24T22:00:39.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:39 smithi047 ceph-mon[32551]: Detected new or changed devices on smithi188 2024-07-24T22:00:39.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:39 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi188 to 8544M 2024-07-24T22:00:39.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:39 smithi047 ceph-mon[32551]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:39.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:39 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:39.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:39 smithi047 ceph-mon[32551]: osd.5 [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083] boot 2024-07-24T22:00:39.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:39 smithi047 ceph-mon[32551]: osdmap e38: 6 total, 6 up, 6 in 2024-07-24T22:00:39.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:39 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:39.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:39 smithi047 ceph-mon[32551]: osdmap e39: 6 total, 6 up, 6 in 2024-07-24T22:00:39.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:39.974+0000 7fc89c5c8640 1 -- 172.21.15.47:0/842044878 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc894105760 con 0x7fc8800b3c20 2024-07-24T22:00:40.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:39 smithi188 ceph-mon[37380]: purged_snaps scrub starts 2024-07-24T22:00:40.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:39 smithi188 ceph-mon[37380]: purged_snaps scrub ok 2024-07-24T22:00:40.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:39 smithi188 ceph-mon[37380]: Detected new or changed devices on smithi188 2024-07-24T22:00:40.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:39 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi188 to 8544M 2024-07-24T22:00:40.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:39 smithi188 ceph-mon[37380]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-07-24T22:00:40.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:39 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:40.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:39 smithi188 ceph-mon[37380]: osd.5 [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083] boot 2024-07-24T22:00:40.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:39 smithi188 ceph-mon[37380]: osdmap e38: 6 total, 6 up, 6 in 2024-07-24T22:00:40.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:39 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-24T22:00:40.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:39 smithi188 ceph-mon[37380]: osdmap e39: 6 total, 6 up, 6 in 2024-07-24T22:00:41.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:40 smithi047 ceph-mon[32551]: osdmap e40: 6 total, 6 up, 6 in 2024-07-24T22:00:41.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:40 smithi047 ceph-mon[32551]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:00:41.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:40 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:00:41.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:40 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:00:41.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:40 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:41.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:40 smithi047 ceph-mon[32551]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:00:41.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:40 smithi188 ceph-mon[37380]: osdmap e40: 6 total, 6 up, 6 in 2024-07-24T22:00:41.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:40 smithi188 ceph-mon[37380]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:00:41.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:40 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:00:41.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:40 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:00:41.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:40 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:41.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:40 smithi188 ceph-mon[37380]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:00:41.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:40 smithi183 ceph-mon[37007]: osdmap e40: 6 total, 6 up, 6 in 2024-07-24T22:00:41.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:40 smithi183 ceph-mon[37007]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:00:41.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:40 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:00:41.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:40 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:00:41.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:40 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:41.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:40 smithi183 ceph-mon[37007]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:00:43.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:43 smithi047 ceph-mon[32551]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:00:43.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:43 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1460000499' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a38cf12-619f-4e82-a7a5-21ee2014038a"}]: dispatch 2024-07-24T22:00:43.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:43 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1460000499' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a38cf12-619f-4e82-a7a5-21ee2014038a"}]': finished 2024-07-24T22:00:43.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:43 smithi047 ceph-mon[32551]: osdmap e41: 7 total, 6 up, 7 in 2024-07-24T22:00:43.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:43 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:00:43.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:43 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1736794211' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:00:43.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:43 smithi183 ceph-mon[37007]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:00:43.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:43 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1460000499' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a38cf12-619f-4e82-a7a5-21ee2014038a"}]: dispatch 2024-07-24T22:00:43.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:43 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1460000499' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a38cf12-619f-4e82-a7a5-21ee2014038a"}]': finished 2024-07-24T22:00:43.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:43 smithi183 ceph-mon[37007]: osdmap e41: 7 total, 6 up, 7 in 2024-07-24T22:00:43.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:43 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:00:43.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:43 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1736794211' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:00:43.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:43 smithi188 ceph-mon[37380]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:00:43.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:43 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1460000499' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a38cf12-619f-4e82-a7a5-21ee2014038a"}]: dispatch 2024-07-24T22:00:43.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:43 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1460000499' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a38cf12-619f-4e82-a7a5-21ee2014038a"}]': finished 2024-07-24T22:00:43.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:43 smithi188 ceph-mon[37380]: osdmap e41: 7 total, 6 up, 7 in 2024-07-24T22:00:43.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:43 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:00:43.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:43 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1736794211' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:00:45.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:45 smithi183 ceph-mon[37007]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:00:45.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:45 smithi047 ceph-mon[32551]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:00:45.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:45 smithi188 ceph-mon[37380]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:00:47.373 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:47 smithi047 ceph-mon[32551]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-07-24T22:00:47.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:47 smithi183 ceph-mon[37007]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-07-24T22:00:47.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:47 smithi188 ceph-mon[37380]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-07-24T22:00:49.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:49 smithi183 ceph-mon[37007]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-07-24T22:00:49.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-07-24T22:00:49.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:49.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:49 smithi047 ceph-mon[32551]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-07-24T22:00:49.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-07-24T22:00:49.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:49.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:49 smithi188 ceph-mon[37380]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-07-24T22:00:49.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-07-24T22:00:49.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:50.390 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:50 smithi047 ceph-mon[32551]: Deploying daemon osd.6 on smithi047 2024-07-24T22:00:50.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:50 smithi183 ceph-mon[37007]: Deploying daemon osd.6 on smithi047 2024-07-24T22:00:50.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:50 smithi188 ceph-mon[37380]: Deploying daemon osd.6 on smithi047 2024-07-24T22:00:51.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:51 smithi047 ceph-mon[32551]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-24T22:00:51.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:51 smithi183 ceph-mon[37007]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-24T22:00:51.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:51 smithi188 ceph-mon[37380]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-24T22:00:53.289 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:53 smithi047 ceph-mon[32551]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-24T22:00:53.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:53 smithi183 ceph-mon[37007]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-24T22:00:53.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:53 smithi188 ceph-mon[37380]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-24T22:00:54.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:54 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:54.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:54 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:54.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:54 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:54.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:54 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:54.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:54 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:54.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:54 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:54.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:54 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:54.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:54 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:54.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:54 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:55.399 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:55 smithi047 ceph-mon[32551]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-07-24T22:00:55.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:55 smithi183 ceph-mon[37007]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-07-24T22:00:55.449 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:55 smithi188 ceph-mon[37380]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-07-24T22:00:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:57.389+0000 7fc88b7fe640 1 -- 172.21.15.47:0/842044878 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc894105760 con 0x7fc8800b3c20 2024-07-24T22:00:57.392 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 6 on host 'smithi047' 2024-07-24T22:00:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:57.392+0000 7fc89c5c8640 1 -- 172.21.15.47:0/842044878 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8800b3c20 msgr2=0x7fc8800b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:00:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:57.392+0000 7fc89c5c8640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8800b3c20 0x7fc8800b60e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc89000abe0 tx=0x7fc89000a2d0 comp rx=0 tx=0).stop 2024-07-24T22:00:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:57.392+0000 7fc89c5c8640 1 -- 172.21.15.47:0/842044878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc894108180 msgr2=0x7fc894199030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:00:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:57.392+0000 7fc89c5c8640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc894108180 0x7fc894199030 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc884006010 tx=0x7fc8840042f0 comp rx=0 tx=0).stop 2024-07-24T22:00:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:57.392+0000 7fc89c5c8640 1 -- 172.21.15.47:0/842044878 shutdown_connections 2024-07-24T22:00:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:57.392+0000 7fc89c5c8640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8800b3c20 0x7fc8800b60e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:57.392+0000 7fc89c5c8640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc894108b00 0x7fc89419e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:57.392+0000 7fc89c5c8640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc894108180 0x7fc894199030 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:57.392+0000 7fc89c5c8640 1 --2- 172.21.15.47:0/842044878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc894102770 0x7fc894198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:00:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:57.392+0000 7fc89c5c8640 1 -- 172.21.15.47:0/842044878 >> 172.21.15.47:0/842044878 conn(0x7fc8940fe1c0 msgr2=0x7fc8941005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:00:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:57.392+0000 7fc89c5c8640 1 -- 172.21.15.47:0/842044878 shutdown_connections 2024-07-24T22:00:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:00:57.392+0000 7fc89c5c8640 1 -- 172.21.15.47:0/842044878 wait complete. 2024-07-24T22:00:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:57 smithi047 ceph-mon[32551]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:00:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:57 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:57 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:57 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:57 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:57 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:57 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:57.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:57 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:57.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:57 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:57 smithi183 ceph-mon[37007]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:00:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:57 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:57 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:57 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:57 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:57 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:57 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:57 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:57 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:57.971 DEBUG:teuthology.orchestra.run.smithi047:osd.6> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.6.service 2024-07-24T22:00:57.974 INFO:tasks.cephadm:Deploying osd.7 on smithi183 with /dev/vg_nvme/lv_2... 2024-07-24T22:00:57.974 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-07-24T22:00:58.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:57 smithi188 ceph-mon[37380]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:00:58.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:57 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:58.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:57 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:58.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:57 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:00:58.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:57 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:00:58.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:57 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:58.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:57 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:00:58.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:57 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:58.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:57 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:00:58.231 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.b/config 2024-07-24T22:00:58.285 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:00:58 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:00:58.043+0000 7f794ef8c640 -1 osd.6 0 log_to_monitors true 2024-07-24T22:00:58.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:58 smithi183 ceph-mon[37007]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-07-24T22:00:58.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:58 smithi047 ceph-mon[32551]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-07-24T22:00:59.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:58 smithi188 ceph-mon[37380]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-07-24T22:00:59.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:59 smithi183 ceph-mon[37007]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:00:59.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:59 smithi183 ceph-mon[37007]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-07-24T22:00:59.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:59 smithi183 ceph-mon[37007]: osdmap e42: 7 total, 6 up, 7 in 2024-07-24T22:00:59.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:59 smithi183 ceph-mon[37007]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-07-24T22:00:59.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:00:59 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:00:59.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:59 smithi047 ceph-mon[32551]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:00:59.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:59 smithi047 ceph-mon[32551]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-07-24T22:00:59.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:59 smithi047 ceph-mon[32551]: osdmap e42: 7 total, 6 up, 7 in 2024-07-24T22:00:59.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:59 smithi047 ceph-mon[32551]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-07-24T22:00:59.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:00:59 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:00:59.941 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-07-24T22:01:00.020 INFO:teuthology.orchestra.run.smithi183.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-07-24T22:01:00.034 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10+0 records in 2024-07-24T22:01:00.034 INFO:teuthology.orchestra.run.smithi183.stderr:10+0 records out 2024-07-24T22:01:00.034 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132641 s, 791 MB/s 2024-07-24T22:01:00.034 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping successful for: 2024-07-24T22:01:00.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:59 smithi188 ceph-mon[37380]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:01:00.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:59 smithi188 ceph-mon[37380]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-07-24T22:01:00.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:59 smithi188 ceph-mon[37380]: osdmap e42: 7 total, 6 up, 7 in 2024-07-24T22:01:00.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:59 smithi188 ceph-mon[37380]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-07-24T22:01:00.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:00:59 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:01:00.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:01:00 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:01:00.356+0000 7f794af0f640 -1 osd.6 0 waiting for initial osdmap 2024-07-24T22:01:00.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:01:00 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:01:00.365+0000 7f7942d2e640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T22:01:00.655 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:00 smithi183 ceph-mon[37007]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-07-24T22:01:00.655 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:00 smithi183 ceph-mon[37007]: osdmap e43: 7 total, 6 up, 7 in 2024-07-24T22:01:00.655 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:00 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:01:00.655 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:00 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:01:00.655 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:00 smithi183 ceph-mon[37007]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' 2024-07-24T22:01:00.683 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_2 2024-07-24T22:01:00.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:00 smithi047 ceph-mon[32551]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-07-24T22:01:00.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:00 smithi047 ceph-mon[32551]: osdmap e43: 7 total, 6 up, 7 in 2024-07-24T22:01:00.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:00 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:01:00.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:00 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:01:00.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:00 smithi047 ceph-mon[32551]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' 2024-07-24T22:01:00.940 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.b/config 2024-07-24T22:01:01.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:00 smithi188 ceph-mon[37380]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-07-24T22:01:01.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:00 smithi188 ceph-mon[37380]: osdmap e43: 7 total, 6 up, 7 in 2024-07-24T22:01:01.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:00 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:01:01.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:00 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:01:01.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:00 smithi188 ceph-mon[37380]: from='osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980]' entity='osd.6' 2024-07-24T22:01:01.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: purged_snaps scrub starts 2024-07-24T22:01:01.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: purged_snaps scrub ok 2024-07-24T22:01:01.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:01:01.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:01:01.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:01.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:01.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:01.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:01.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:01.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:01.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:01.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:01.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:01.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980] boot 2024-07-24T22:01:01.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: osdmap e44: 7 total, 7 up, 7 in 2024-07-24T22:01:01.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:01 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:01:01.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: purged_snaps scrub starts 2024-07-24T22:01:01.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: purged_snaps scrub ok 2024-07-24T22:01:01.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:01:01.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:01:01.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:01.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:01.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:01.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:01.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:01.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:01.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:01.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:01.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:01.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980] boot 2024-07-24T22:01:01.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: osdmap e44: 7 total, 7 up, 7 in 2024-07-24T22:01:01.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:01 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:01:01.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: purged_snaps scrub starts 2024-07-24T22:01:01.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: purged_snaps scrub ok 2024-07-24T22:01:01.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-07-24T22:01:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:01:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: osd.6 [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980] boot 2024-07-24T22:01:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: osdmap e44: 7 total, 7 up, 7 in 2024-07-24T22:01:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:01 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-24T22:01:02.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.496+0000 7fc1c72a5640 1 -- 172.21.15.183:0/751301925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c0107a00 msgr2=0x7fc1c010e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:01:02.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.496+0000 7fc1c72a5640 1 --2- 172.21.15.183:0/751301925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c0107a00 0x7fc1c010e200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009ca0 tx=0x7fc1b802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:01:02.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.497+0000 7fc1c72a5640 1 -- 172.21.15.183:0/751301925 shutdown_connections 2024-07-24T22:01:02.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.497+0000 7fc1c72a5640 1 --2- 172.21.15.183:0/751301925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c0107a00 0x7fc1c010e200 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:02.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.497+0000 7fc1c72a5640 1 --2- 172.21.15.183:0/751301925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1c0107080 0x7fc1c01074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:02.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.497+0000 7fc1c72a5640 1 --2- 172.21.15.183:0/751301925 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1c0101670 0x7fc1c0101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:02.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.497+0000 7fc1c72a5640 1 -- 172.21.15.183:0/751301925 >> 172.21.15.183:0/751301925 conn(0x7fc1c00fd0e0 msgr2=0x7fc1c00ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:01:02.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.497+0000 7fc1c72a5640 1 -- 172.21.15.183:0/751301925 shutdown_connections 2024-07-24T22:01:02.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.497+0000 7fc1c72a5640 1 -- 172.21.15.183:0/751301925 wait complete. 2024-07-24T22:01:02.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.497+0000 7fc1c72a5640 1 Processor -- start 2024-07-24T22:01:02.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.497+0000 7fc1c72a5640 1 -- start start 2024-07-24T22:01:02.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c72a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1c0101670 0x7fc1c01999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:01:02.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c72a5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c0107080 0x7fc1c0199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:01:02.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c72a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1c0107a00 0x7fc1c019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:01:02.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c72a5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c0111630 con 0x7fc1c0107a00 2024-07-24T22:01:02.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c72a5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c01114b0 con 0x7fc1c0107080 2024-07-24T22:01:02.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c72a5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c01117b0 con 0x7fc1c0101670 2024-07-24T22:01:02.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c4840640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c0107080 0x7fc1c0199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:01:02.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c4840640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c0107080 0x7fc1c0199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:34786/0 (socket says 172.21.15.183:34786) 2024-07-24T22:01:02.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c4840640 1 -- 172.21.15.183:0/1539793840 learned_addr learned my addr 172.21.15.183:0/1539793840 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-07-24T22:01:02.502 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c5842640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1c0107a00 0x7fc1c019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:01:02.502 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c5041640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1c0101670 0x7fc1c01999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:01:02.502 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c4840640 1 -- 172.21.15.183:0/1539793840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1c0101670 msgr2=0x7fc1c01999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:01:02.502 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c4840640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1c0101670 0x7fc1c01999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:02.502 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c4840640 1 -- 172.21.15.183:0/1539793840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1c0107a00 msgr2=0x7fc1c019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:01:02.502 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c4840640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1c0107a00 0x7fc1c019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:02.502 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c4840640 1 -- 172.21.15.183:0/1539793840 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c01a4d80 con 0x7fc1c0107080 2024-07-24T22:01:02.502 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c5842640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1c0107a00 0x7fc1c019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:01:02.502 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c4840640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c0107080 0x7fc1c0199ee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000c890 tx=0x7fc1b000cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:01:02.502 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1b67fc640 1 -- 172.21.15.183:0/1539793840 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0004220 con 0x7fc1c0107080 2024-07-24T22:01:02.502 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c72a5640 1 -- 172.21.15.183:0/1539793840 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c01a5070 con 0x7fc1c0107080 2024-07-24T22:01:02.502 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1b67fc640 1 -- 172.21.15.183:0/1539793840 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1b00043c0 con 0x7fc1c0107080 2024-07-24T22:01:02.503 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1b67fc640 1 -- 172.21.15.183:0/1539793840 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0004a00 con 0x7fc1c0107080 2024-07-24T22:01:02.503 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.498+0000 7fc1c72a5640 1 -- 172.21.15.183:0/1539793840 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c01a55b0 con 0x7fc1c0107080 2024-07-24T22:01:02.504 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.500+0000 7fc1c72a5640 1 -- 172.21.15.183:0/1539793840 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c0101a50 con 0x7fc1c0107080 2024-07-24T22:01:02.504 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.501+0000 7fc1b67fc640 1 -- 172.21.15.183:0/1539793840 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fc1b00079b0 con 0x7fc1c0107080 2024-07-24T22:01:02.504 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.501+0000 7fc1b67fc640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1ac0b3c20 0x7fc1ac0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:01:02.504 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.502+0000 7fc1b67fc640 1 -- 172.21.15.183:0/1539793840 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5180+0+0 (secure 0 0 0) 0x7fc1b00e2e90 con 0x7fc1c0107080 2024-07-24T22:01:02.504 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.502+0000 7fc1c5041640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1ac0b3c20 0x7fc1ac0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:01:02.504 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.502+0000 7fc1c5041640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1ac0b3c20 0x7fc1ac0b60e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc005e10 tx=0x7fc1bc005da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:01:02.506 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.505+0000 7fc1b67fc640 1 -- 172.21.15.183:0/1539793840 <== mon.2 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fc1b0014030 con 0x7fc1c0107080 2024-07-24T22:01:02.701 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:02.699+0000 7fc1c72a5640 1 -- 172.21.15.183:0/1539793840 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc1c0062f80 con 0x7fc1ac0b3c20 2024-07-24T22:01:02.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:02 smithi183 ceph-mon[37007]: Detected new or changed devices on smithi047 2024-07-24T22:01:02.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:02 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi047 to 5697M 2024-07-24T22:01:02.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:02 smithi047 ceph-mon[32551]: Detected new or changed devices on smithi047 2024-07-24T22:01:02.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:02 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi047 to 5697M 2024-07-24T22:01:03.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:02 smithi188 ceph-mon[37380]: Detected new or changed devices on smithi047 2024-07-24T22:01:03.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:02 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi047 to 5697M 2024-07-24T22:01:03.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:03 smithi183 ceph-mon[37007]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:03.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:03 smithi183 ceph-mon[37007]: osdmap e45: 7 total, 7 up, 7 in 2024-07-24T22:01:03.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:03 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:01:03.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:03 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:01:03.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:03 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:03.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:03 smithi047 ceph-mon[32551]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:03.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:03 smithi047 ceph-mon[32551]: osdmap e45: 7 total, 7 up, 7 in 2024-07-24T22:01:03.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:03 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:01:03.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:03 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:01:03.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:03 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:04.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:03 smithi188 ceph-mon[37380]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:04.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:03 smithi188 ceph-mon[37380]: osdmap e45: 7 total, 7 up, 7 in 2024-07-24T22:01:04.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:03 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:01:04.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:03 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:01:04.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:03 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:04.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:04 smithi183 ceph-mon[37007]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:01:04.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:04 smithi047 ceph-mon[32551]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:01:05.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:04 smithi188 ceph-mon[37380]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:01:05.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:05 smithi183 ceph-mon[37007]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:05.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:05 smithi183 ceph-mon[37007]: from='client.? 172.21.15.183:0/1622371625' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309"}]: dispatch 2024-07-24T22:01:05.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:05 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309"}]: dispatch 2024-07-24T22:01:05.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:05 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309"}]': finished 2024-07-24T22:01:05.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:05 smithi183 ceph-mon[37007]: osdmap e46: 8 total, 7 up, 8 in 2024-07-24T22:01:05.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:05 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:05.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:05 smithi183 ceph-mon[37007]: from='client.? 172.21.15.183:0/4251933968' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:01:05.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:05 smithi047 ceph-mon[32551]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:05.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:05 smithi047 ceph-mon[32551]: from='client.? 172.21.15.183:0/1622371625' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309"}]: dispatch 2024-07-24T22:01:05.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:05 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309"}]: dispatch 2024-07-24T22:01:05.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:05 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309"}]': finished 2024-07-24T22:01:05.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:05 smithi047 ceph-mon[32551]: osdmap e46: 8 total, 7 up, 8 in 2024-07-24T22:01:05.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:05 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:05.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:05 smithi047 ceph-mon[32551]: from='client.? 172.21.15.183:0/4251933968' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:01:06.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:05 smithi188 ceph-mon[37380]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:06.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:05 smithi188 ceph-mon[37380]: from='client.? 172.21.15.183:0/1622371625' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309"}]: dispatch 2024-07-24T22:01:06.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:05 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309"}]: dispatch 2024-07-24T22:01:06.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:05 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309"}]': finished 2024-07-24T22:01:06.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:05 smithi188 ceph-mon[37380]: osdmap e46: 8 total, 7 up, 8 in 2024-07-24T22:01:06.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:05 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:06.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:05 smithi188 ceph-mon[37380]: from='client.? 172.21.15.183:0/4251933968' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:01:07.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:07 smithi183 ceph-mon[37007]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:07.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:07 smithi047 ceph-mon[32551]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:08.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:07 smithi188 ceph-mon[37380]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:09.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:09 smithi183 ceph-mon[37007]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:09.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:09 smithi047 ceph-mon[32551]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:10.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:09 smithi188 ceph-mon[37380]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:11.807 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:11 smithi183 ceph-mon[37007]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:11.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:11 smithi047 ceph-mon[32551]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:12.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:11 smithi188 ceph-mon[37380]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:12.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-07-24T22:01:12.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:12.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-07-24T22:01:12.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:13.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-07-24T22:01:13.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:13 smithi183 ceph-mon[37007]: Deploying daemon osd.7 on smithi183 2024-07-24T22:01:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:13 smithi183 ceph-mon[37007]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:13.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:13 smithi047 ceph-mon[32551]: Deploying daemon osd.7 on smithi183 2024-07-24T22:01:13.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:13 smithi047 ceph-mon[32551]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:14.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:13 smithi188 ceph-mon[37380]: Deploying daemon osd.7 on smithi183 2024-07-24T22:01:14.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:13 smithi188 ceph-mon[37380]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:15.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:15 smithi183 ceph-mon[37007]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:15.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:15 smithi047 ceph-mon[32551]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:16.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:15 smithi188 ceph-mon[37380]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:17.886 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:17 smithi183 ceph-mon[37007]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:17.886 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:01:17.886 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:17.886 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:17 smithi047 ceph-mon[32551]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:01:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:18.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:17 smithi188 ceph-mon[37380]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:18.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:01:18.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:18.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:19.854 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:19 smithi183 ceph-mon[37007]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:19.854 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:19.855 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:19.855 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:19.855 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:19.855 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:19.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:19 smithi047 ceph-mon[32551]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:19.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:19.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:19.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:19.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:19.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:20.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:19 smithi188 ceph-mon[37380]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:20.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:20.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:20.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:20.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:20.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:20.231 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:20.229+0000 7fc1b67fc640 1 -- 172.21.15.183:0/1539793840 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc1c0062f80 con 0x7fc1ac0b3c20 2024-07-24T22:01:20.232 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 7 on host 'smithi183' 2024-07-24T22:01:20.234 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:20.231+0000 7fc1c72a5640 1 -- 172.21.15.183:0/1539793840 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1ac0b3c20 msgr2=0x7fc1ac0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:01:20.234 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:20.231+0000 7fc1c72a5640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1ac0b3c20 0x7fc1ac0b60e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc005e10 tx=0x7fc1bc005da0 comp rx=0 tx=0).stop 2024-07-24T22:01:20.234 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:20.231+0000 7fc1c72a5640 1 -- 172.21.15.183:0/1539793840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c0107080 msgr2=0x7fc1c0199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:01:20.234 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:20.231+0000 7fc1c72a5640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c0107080 0x7fc1c0199ee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000c890 tx=0x7fc1b000cd50 comp rx=0 tx=0).stop 2024-07-24T22:01:20.234 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:20.231+0000 7fc1c72a5640 1 -- 172.21.15.183:0/1539793840 shutdown_connections 2024-07-24T22:01:20.234 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:20.231+0000 7fc1c72a5640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1ac0b3c20 0x7fc1ac0b60e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:20.234 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:20.231+0000 7fc1c72a5640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1c0107a00 0x7fc1c019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:20.234 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:20.231+0000 7fc1c72a5640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c0107080 0x7fc1c0199ee0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:20.235 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:20.231+0000 7fc1c72a5640 1 --2- 172.21.15.183:0/1539793840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1c0101670 0x7fc1c01999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:20.235 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:20.231+0000 7fc1c72a5640 1 -- 172.21.15.183:0/1539793840 >> 172.21.15.183:0/1539793840 conn(0x7fc1c00fd0e0 msgr2=0x7fc1c00ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:01:20.235 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:20.232+0000 7fc1c72a5640 1 -- 172.21.15.183:0/1539793840 shutdown_connections 2024-07-24T22:01:20.235 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:01:20.232+0000 7fc1c72a5640 1 -- 172.21.15.183:0/1539793840 wait complete. 2024-07-24T22:01:20.834 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:01:20.834 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:20.834 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:20.864 DEBUG:teuthology.orchestra.run.smithi183:osd.7> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.7.service 2024-07-24T22:01:20.866 INFO:tasks.cephadm:Deploying osd.8 on smithi188 with /dev/vg_nvme/lv_2... 2024-07-24T22:01:20.866 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-07-24T22:01:20.894 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:01:20.894 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:20.894 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:20.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:01:20.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:20.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:21.129 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T22:01:21.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:21 smithi183 ceph-mon[37007]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:21.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:21 smithi183 ceph-mon[37007]: from='osd.7 [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-24T22:01:21.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:21 smithi183 ceph-mon[37007]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-24T22:01:21.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:21 smithi047 ceph-mon[32551]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:21.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:21 smithi047 ceph-mon[32551]: from='osd.7 [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-24T22:01:21.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:21 smithi047 ceph-mon[32551]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-24T22:01:22.019 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:21 smithi188 ceph-mon[37380]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:22.019 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:21 smithi188 ceph-mon[37380]: from='osd.7 [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-24T22:01:22.020 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:21 smithi188 ceph-mon[37380]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-24T22:01:22.644 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-07-24T22:01:22.739 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-07-24T22:01:22.752 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-07-24T22:01:22.752 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-07-24T22:01:22.752 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113218 s, 926 MB/s 2024-07-24T22:01:22.752 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-07-24T22:01:22.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:22 smithi183 ceph-mon[37007]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-07-24T22:01:22.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:22 smithi183 ceph-mon[37007]: osdmap e47: 8 total, 7 up, 8 in 2024-07-24T22:01:22.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:22 smithi183 ceph-mon[37007]: from='osd.7 [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:01:22.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:22 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:22.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:22 smithi183 ceph-mon[37007]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:01:22.912 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:01:22 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:01:22.649+0000 7f4bb0039640 -1 osd.7 0 waiting for initial osdmap 2024-07-24T22:01:22.912 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:01:22 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:01:22.657+0000 7f4babe60640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T22:01:22.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:22 smithi047 ceph-mon[32551]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-07-24T22:01:22.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:22 smithi047 ceph-mon[32551]: osdmap e47: 8 total, 7 up, 8 in 2024-07-24T22:01:22.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:22 smithi047 ceph-mon[32551]: from='osd.7 [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:01:22.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:22 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:22.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:22 smithi047 ceph-mon[32551]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:01:23.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:22 smithi188 ceph-mon[37380]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-07-24T22:01:23.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:22 smithi188 ceph-mon[37380]: osdmap e47: 8 total, 7 up, 8 in 2024-07-24T22:01:23.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:22 smithi188 ceph-mon[37380]: from='osd.7 [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:01:23.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:22 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:23.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:22 smithi188 ceph-mon[37380]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:01:23.364 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch daemon add osd smithi188:vg_nvme/lv_2 2024-07-24T22:01:23.675 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T22:01:23.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:23 smithi183 ceph-mon[37007]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:23.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:23 smithi183 ceph-mon[37007]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-07-24T22:01:23.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:23 smithi183 ceph-mon[37007]: osdmap e48: 8 total, 7 up, 8 in 2024-07-24T22:01:23.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:23 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:23.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:23 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:23.917 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:23 smithi188 ceph-mon[37380]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:23.917 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:23 smithi188 ceph-mon[37380]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-07-24T22:01:23.918 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:23 smithi188 ceph-mon[37380]: osdmap e48: 8 total, 7 up, 8 in 2024-07-24T22:01:23.918 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:23 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:23.918 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:23 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:23.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:23 smithi047 ceph-mon[32551]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-07-24T22:01:23.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:23 smithi047 ceph-mon[32551]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-07-24T22:01:23.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:23 smithi047 ceph-mon[32551]: osdmap e48: 8 total, 7 up, 8 in 2024-07-24T22:01:23.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:23 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:23.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:23 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:24.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: purged_snaps scrub starts 2024-07-24T22:01:24.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: purged_snaps scrub ok 2024-07-24T22:01:24.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: osd.7 [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514] boot 2024-07-24T22:01:24.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: osdmap e49: 8 total, 8 up, 8 in 2024-07-24T22:01:24.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:24.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:24.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:24.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:24.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:24.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:24.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:24.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:24.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:24.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:24.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:24 smithi188 ceph-mon[37380]: osdmap e50: 8 total, 8 up, 8 in 2024-07-24T22:01:24.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: purged_snaps scrub starts 2024-07-24T22:01:24.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: purged_snaps scrub ok 2024-07-24T22:01:24.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: osd.7 [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514] boot 2024-07-24T22:01:24.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: osdmap e49: 8 total, 8 up, 8 in 2024-07-24T22:01:24.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:24.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:24.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:24.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:24.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:24.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:24.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:24.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:24.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:24.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:24.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:24 smithi183 ceph-mon[37007]: osdmap e50: 8 total, 8 up, 8 in 2024-07-24T22:01:24.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: purged_snaps scrub starts 2024-07-24T22:01:24.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: purged_snaps scrub ok 2024-07-24T22:01:24.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: osd.7 [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514] boot 2024-07-24T22:01:24.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: osdmap e49: 8 total, 8 up, 8 in 2024-07-24T22:01:24.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-24T22:01:24.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:24.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:24.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:24.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:24.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:24.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:24.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:24.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:24.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:24.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:24 smithi047 ceph-mon[32551]: osdmap e50: 8 total, 8 up, 8 in 2024-07-24T22:01:25.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 -- 172.21.15.188:0/1329790877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8478101690 msgr2=0x7f8478101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:01:25.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 --2- 172.21.15.188:0/1329790877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8478101690 0x7f8478101a70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8474009900 tx=0x7f847402a410 comp rx=0 tx=0).stop 2024-07-24T22:01:25.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 -- 172.21.15.188:0/1329790877 shutdown_connections 2024-07-24T22:01:25.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 --2- 172.21.15.188:0/1329790877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8478107a20 0x7f847810e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:25.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 --2- 172.21.15.188:0/1329790877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84781070a0 0x7f84781074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:25.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 --2- 172.21.15.188:0/1329790877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8478101690 0x7f8478101a70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:25.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 -- 172.21.15.188:0/1329790877 >> 172.21.15.188:0/1329790877 conn(0x7f84780fd100 msgr2=0x7f84780ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:01:25.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 -- 172.21.15.188:0/1329790877 shutdown_connections 2024-07-24T22:01:25.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 -- 172.21.15.188:0/1329790877 wait complete. 2024-07-24T22:01:25.196 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 Processor -- start 2024-07-24T22:01:25.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 -- start start 2024-07-24T22:01:25.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8478101690 0x7f8478198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:01:25.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84781070a0 0x7f84781992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:01:25.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8478107a20 0x7f847819e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:01:25.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8478111720 con 0x7f84781070a0 2024-07-24T22:01:25.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f84781115a0 con 0x7f8478107a20 2024-07-24T22:01:25.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.192+0000 7f847f74d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f84781118a0 con 0x7f8478101690 2024-07-24T22:01:25.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847d4e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8478101690 0x7f8478198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:01:25.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847d4e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8478101690 0x7f8478198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:54740/0 (socket says 172.21.15.188:54740) 2024-07-24T22:01:25.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847d4e9640 1 -- 172.21.15.188:0/1098540061 learned_addr learned my addr 172.21.15.188:0/1098540061 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-07-24T22:01:25.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847cce8640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84781070a0 0x7f84781992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:01:25.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847dcea640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8478107a20 0x7f847819e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:01:25.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847d4e9640 1 -- 172.21.15.188:0/1098540061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8478107a20 msgr2=0x7f847819e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:01:25.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847d4e9640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8478107a20 0x7f847819e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:25.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847d4e9640 1 -- 172.21.15.188:0/1098540061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84781070a0 msgr2=0x7f84781992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:01:25.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847d4e9640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84781070a0 0x7f84781992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:25.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847d4e9640 1 -- 172.21.15.188:0/1098540061 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847819ee40 con 0x7f8478101690 2024-07-24T22:01:25.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847cce8640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84781070a0 0x7f84781992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:01:25.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847d4e9640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8478101690 0x7f8478198d90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8474006010 tx=0x7f84740042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:01:25.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f846e7fc640 1 -- 172.21.15.188:0/1098540061 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847403f030 con 0x7f8478101690 2024-07-24T22:01:25.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847f74d640 1 -- 172.21.15.188:0/1098540061 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847819f0d0 con 0x7f8478101690 2024-07-24T22:01:25.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f846e7fc640 1 -- 172.21.15.188:0/1098540061 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8474003800 con 0x7f8478101690 2024-07-24T22:01:25.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f846e7fc640 1 -- 172.21.15.188:0/1098540061 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474035070 con 0x7f8478101690 2024-07-24T22:01:25.198 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.193+0000 7f847f74d640 1 -- 172.21.15.188:0/1098540061 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84781a57f0 con 0x7f8478101690 2024-07-24T22:01:25.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.194+0000 7f847f74d640 1 -- 172.21.15.188:0/1098540061 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8478101af0 con 0x7f8478101690 2024-07-24T22:01:25.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.196+0000 7f846e7fc640 1 -- 172.21.15.188:0/1098540061 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f8474003cb0 con 0x7f8478101690 2024-07-24T22:01:25.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.196+0000 7f846e7fc640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f84640b3c20 0x7f84640b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:01:25.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.197+0000 7f846e7fc640 1 -- 172.21.15.188:0/1098540061 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5612+0+0 (secure 0 0 0) 0x7f8474103ea0 con 0x7f8478101690 2024-07-24T22:01:25.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.197+0000 7f847cce8640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f84640b3c20 0x7f84640b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:01:25.200 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.197+0000 7f847cce8640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f84640b3c20 0x7f84640b60e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8468006fd0 tx=0x7f8468008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:01:25.201 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.199+0000 7f846e7fc640 1 -- 172.21.15.188:0/1098540061 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f84740cbf80 con 0x7f8478101690 2024-07-24T22:01:25.399 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:25.397+0000 7f847f74d640 1 -- 172.21.15.188:0/1098540061 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8478062f80 con 0x7f84640b3c20 2024-07-24T22:01:25.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:25 smithi183 ceph-mon[37007]: Detected new or changed devices on smithi183 2024-07-24T22:01:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:25 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi183 to 5696M 2024-07-24T22:01:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:25 smithi183 ceph-mon[37007]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:25 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:01:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:25 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:01:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:25 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:25.914 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:25 smithi188 ceph-mon[37380]: Detected new or changed devices on smithi183 2024-07-24T22:01:25.914 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:25 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi183 to 5696M 2024-07-24T22:01:25.914 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:25 smithi188 ceph-mon[37380]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:25.914 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:25 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:01:25.914 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:25 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:01:25.914 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:25 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:25.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:25 smithi047 ceph-mon[32551]: Detected new or changed devices on smithi183 2024-07-24T22:01:25.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:25 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi183 to 5696M 2024-07-24T22:01:25.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:25 smithi047 ceph-mon[32551]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:25.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:25 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:01:25.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:25 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:01:25.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:25 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:26.917 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:26 smithi188 ceph-mon[37380]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:01:26.918 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:26 smithi188 ceph-mon[37380]: osdmap e51: 8 total, 8 up, 8 in 2024-07-24T22:01:26.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:26 smithi047 ceph-mon[32551]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:01:26.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:26 smithi047 ceph-mon[32551]: osdmap e51: 8 total, 8 up, 8 in 2024-07-24T22:01:27.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:26 smithi183 ceph-mon[37007]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:01:27.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:26 smithi183 ceph-mon[37007]: osdmap e51: 8 total, 8 up, 8 in 2024-07-24T22:01:27.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:27 smithi047 ceph-mon[32551]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:27.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:27 smithi047 ceph-mon[32551]: from='client.? 172.21.15.188:0/4045303453' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6dfd7252-61a6-423d-8498-cbcfa41ae1e1"}]: dispatch 2024-07-24T22:01:27.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:27 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6dfd7252-61a6-423d-8498-cbcfa41ae1e1"}]: dispatch 2024-07-24T22:01:27.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:27 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6dfd7252-61a6-423d-8498-cbcfa41ae1e1"}]': finished 2024-07-24T22:01:27.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:27 smithi047 ceph-mon[32551]: osdmap e52: 9 total, 8 up, 9 in 2024-07-24T22:01:27.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:27.939 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:27 smithi188 ceph-mon[37380]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:27.939 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:27 smithi188 ceph-mon[37380]: from='client.? 172.21.15.188:0/4045303453' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6dfd7252-61a6-423d-8498-cbcfa41ae1e1"}]: dispatch 2024-07-24T22:01:27.939 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:27 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6dfd7252-61a6-423d-8498-cbcfa41ae1e1"}]: dispatch 2024-07-24T22:01:27.939 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:27 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6dfd7252-61a6-423d-8498-cbcfa41ae1e1"}]': finished 2024-07-24T22:01:27.939 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:27 smithi188 ceph-mon[37380]: osdmap e52: 9 total, 8 up, 9 in 2024-07-24T22:01:27.939 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:28.063 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:27 smithi183 ceph-mon[37007]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:28.063 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:27 smithi183 ceph-mon[37007]: from='client.? 172.21.15.188:0/4045303453' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6dfd7252-61a6-423d-8498-cbcfa41ae1e1"}]: dispatch 2024-07-24T22:01:28.063 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:27 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6dfd7252-61a6-423d-8498-cbcfa41ae1e1"}]: dispatch 2024-07-24T22:01:28.063 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:27 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6dfd7252-61a6-423d-8498-cbcfa41ae1e1"}]': finished 2024-07-24T22:01:28.063 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:27 smithi183 ceph-mon[37007]: osdmap e52: 9 total, 8 up, 9 in 2024-07-24T22:01:28.064 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:28.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:28 smithi047 ceph-mon[32551]: from='client.? 172.21.15.188:0/2775270411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:01:29.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:28 smithi188 ceph-mon[37380]: from='client.? 172.21.15.188:0/2775270411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:01:29.078 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:28 smithi183 ceph-mon[37007]: from='client.? 172.21.15.188:0/2775270411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:01:29.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:29 smithi047 ceph-mon[32551]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:30.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:29 smithi188 ceph-mon[37380]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:30.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:29 smithi183 ceph-mon[37007]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:31.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:31 smithi047 ceph-mon[32551]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-07-24T22:01:31.960 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:31 smithi188 ceph-mon[37380]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-07-24T22:01:32.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:31 smithi183 ceph-mon[37007]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-07-24T22:01:33.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:33 smithi047 ceph-mon[32551]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-24T22:01:34.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:33 smithi188 ceph-mon[37380]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-24T22:01:34.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:33 smithi183 ceph-mon[37007]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-24T22:01:34.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-07-24T22:01:34.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:34.967 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-07-24T22:01:34.968 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:35.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-07-24T22:01:35.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:35.864 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:35 smithi188 ceph-mon[37380]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-07-24T22:01:35.864 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:35 smithi188 ceph-mon[37380]: Deploying daemon osd.8 on smithi188 2024-07-24T22:01:35.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:35 smithi047 ceph-mon[32551]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-07-24T22:01:35.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:35 smithi047 ceph-mon[32551]: Deploying daemon osd.8 on smithi188 2024-07-24T22:01:36.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:35 smithi183 ceph-mon[37007]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-07-24T22:01:36.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:35 smithi183 ceph-mon[37007]: Deploying daemon osd.8 on smithi188 2024-07-24T22:01:37.758 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:37 smithi188 ceph-mon[37380]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-24T22:01:38.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:37 smithi183 ceph-mon[37007]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-24T22:01:38.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:37 smithi047 ceph-mon[32551]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-24T22:01:39.771 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:39 smithi188 ceph-mon[37380]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-07-24T22:01:39.771 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:39 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:01:39.771 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:39 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:39.771 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:39 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:40.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:39 smithi183 ceph-mon[37007]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-07-24T22:01:40.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:39 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:01:40.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:39 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:40.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:39 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:39 smithi047 ceph-mon[32551]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-07-24T22:01:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:39 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:01:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:39 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:39 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:41.856 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:41 smithi188 ceph-mon[37380]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:01:41.898 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:41.893+0000 7f846e7fc640 1 -- 172.21.15.188:0/1098540061 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8478062f80 con 0x7f84640b3c20 2024-07-24T22:01:41.899 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 8 on host 'smithi188' 2024-07-24T22:01:41.899 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:41.895+0000 7f847f74d640 1 -- 172.21.15.188:0/1098540061 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f84640b3c20 msgr2=0x7f84640b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:01:41.899 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:41.895+0000 7f847f74d640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f84640b3c20 0x7f84640b60e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8468006fd0 tx=0x7f8468008040 comp rx=0 tx=0).stop 2024-07-24T22:01:41.899 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:41.895+0000 7f847f74d640 1 -- 172.21.15.188:0/1098540061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8478101690 msgr2=0x7f8478198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:01:41.899 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:41.895+0000 7f847f74d640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8478101690 0x7f8478198d90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8474006010 tx=0x7f84740042f0 comp rx=0 tx=0).stop 2024-07-24T22:01:41.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:41.895+0000 7f847f74d640 1 -- 172.21.15.188:0/1098540061 shutdown_connections 2024-07-24T22:01:41.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:41.895+0000 7f847f74d640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f84640b3c20 0x7f84640b60e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:41.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:41.895+0000 7f847f74d640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8478107a20 0x7f847819e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:41.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:41.895+0000 7f847f74d640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84781070a0 0x7f84781992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:41.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:41.895+0000 7f847f74d640 1 --2- 172.21.15.188:0/1098540061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8478101690 0x7f8478198d90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:41.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:41.895+0000 7f847f74d640 1 -- 172.21.15.188:0/1098540061 >> 172.21.15.188:0/1098540061 conn(0x7f84780fd100 msgr2=0x7f847806b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:01:41.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:41.895+0000 7f847f74d640 1 -- 172.21.15.188:0/1098540061 shutdown_connections 2024-07-24T22:01:41.900 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:01:41.895+0000 7f847f74d640 1 -- 172.21.15.188:0/1098540061 wait complete. 2024-07-24T22:01:42.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:41 smithi183 ceph-mon[37007]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:01:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:41 smithi047 ceph-mon[32551]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:01:42.830 DEBUG:teuthology.orchestra.run.smithi188:osd.8> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.8.service 2024-07-24T22:01:42.833 INFO:tasks.cephadm:Deploying osd.9 on smithi047 with /dev/vg_nvme/lv_1... 2024-07-24T22:01:42.833 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-07-24T22:01:43.117 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:01:43.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:42 smithi183 ceph-mon[37007]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:43.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:43.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:43.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:42 smithi047 ceph-mon[32551]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:43.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:43.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:43.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:42 smithi188 ceph-mon[37380]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:43.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:01:42 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:01:42.984+0000 7f1175ac3640 -1 osd.8 0 log_to_monitors true 2024-07-24T22:01:43.975 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:43 smithi188 ceph-mon[37380]: from='osd.8 [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-24T22:01:43.975 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:43 smithi188 ceph-mon[37380]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-24T22:01:43.975 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:43 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:43.976 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:43 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:44.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:43 smithi183 ceph-mon[37007]: from='osd.8 [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-24T22:01:44.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:43 smithi183 ceph-mon[37007]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-24T22:01:44.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:43 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:44.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:43 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:44.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:43 smithi047 ceph-mon[32551]: from='osd.8 [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-24T22:01:44.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:43 smithi047 ceph-mon[32551]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-24T22:01:44.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:43 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:44.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:43 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:44.816 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-07-24T22:01:44.902 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-07-24T22:01:44.913 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-07-24T22:01:44.913 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-07-24T22:01:44.913 INFO:teuthology.orchestra.run.smithi047.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00877011 s, 1.2 GB/s 2024-07-24T22:01:44.913 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-07-24T22:01:45.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:44 smithi183 ceph-mon[37007]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-07-24T22:01:45.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:44 smithi183 ceph-mon[37007]: osdmap e53: 9 total, 8 up, 9 in 2024-07-24T22:01:45.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:44 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:45.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:44 smithi183 ceph-mon[37007]: from='osd.8 [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:01:45.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:44 smithi183 ceph-mon[37007]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:01:45.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:44 smithi183 ceph-mon[37007]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:45.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:44 smithi047 ceph-mon[32551]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-07-24T22:01:45.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:44 smithi047 ceph-mon[32551]: osdmap e53: 9 total, 8 up, 9 in 2024-07-24T22:01:45.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:44 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:45.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:44 smithi047 ceph-mon[32551]: from='osd.8 [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:01:45.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:44 smithi047 ceph-mon[32551]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:01:45.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:44 smithi047 ceph-mon[32551]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:44 smithi188 ceph-mon[37380]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-07-24T22:01:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:44 smithi188 ceph-mon[37380]: osdmap e53: 9 total, 8 up, 9 in 2024-07-24T22:01:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:44 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:44 smithi188 ceph-mon[37380]: from='osd.8 [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:01:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:44 smithi188 ceph-mon[37380]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:01:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:44 smithi188 ceph-mon[37380]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:45.471 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_1 2024-07-24T22:01:45.739 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:01:45.914 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:01:45.804+0000 7f1171a46640 -1 osd.8 0 waiting for initial osdmap 2024-07-24T22:01:46.054 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-07-24T22:01:46.054 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: osdmap e54: 9 total, 8 up, 9 in 2024-07-24T22:01:46.054 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:46.054 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:46.054 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='osd.8 ' entity='osd.8' 2024-07-24T22:01:46.054 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:46.054 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:46.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:46.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:46.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:46.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:46.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:46.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:46.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:46.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: osdmap e55: 9 total, 8 up, 9 in 2024-07-24T22:01:46.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:46.298 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:01:45.959+0000 7f1169865640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T22:01:46.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-07-24T22:01:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: osdmap e54: 9 total, 8 up, 9 in 2024-07-24T22:01:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='osd.8 ' entity='osd.8' 2024-07-24T22:01:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:46.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:46.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: osdmap e55: 9 total, 8 up, 9 in 2024-07-24T22:01:46.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:46.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-07-24T22:01:46.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: osdmap e54: 9 total, 8 up, 9 in 2024-07-24T22:01:46.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:46.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:46.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='osd.8 ' entity='osd.8' 2024-07-24T22:01:46.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:46.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:46.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:46.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:46.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:01:46.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:46.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:46.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:46.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:46.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: osdmap e55: 9 total, 8 up, 9 in 2024-07-24T22:01:46.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:47.083 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:46 smithi047 ceph-mon[32551]: purged_snaps scrub starts 2024-07-24T22:01:47.083 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:46 smithi047 ceph-mon[32551]: purged_snaps scrub ok 2024-07-24T22:01:47.083 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:46 smithi047 ceph-mon[32551]: Detected new or changed devices on smithi188 2024-07-24T22:01:47.083 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:46 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi188 to 5696M 2024-07-24T22:01:47.083 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:47.083 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:01:47.083 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:47.083 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:47.083 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:47.083 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:46 smithi047 ceph-mon[32551]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:47.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:47.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.262+0000 7f5466186640 1 -- 172.21.15.47:0/426470823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54601036a0 msgr2=0x7f5460103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:01:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.262+0000 7f5466186640 1 --2- 172.21.15.47:0/426470823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54601036a0 0x7f5460103a80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5450009900 tx=0x7f545002a410 comp rx=0 tx=0).stop 2024-07-24T22:01:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.262+0000 7f5466186640 1 -- 172.21.15.47:0/426470823 shutdown_connections 2024-07-24T22:01:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.262+0000 7f5466186640 1 --2- 172.21.15.47:0/426470823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f546010cb00 0x7f546010ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.262+0000 7f5466186640 1 --2- 172.21.15.47:0/426470823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5460103fc0 0x7f546010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.262+0000 7f5466186640 1 --2- 172.21.15.47:0/426470823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54601036a0 0x7f5460103a80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.262+0000 7f5466186640 1 -- 172.21.15.47:0/426470823 >> 172.21.15.47:0/426470823 conn(0x7f54600fd100 msgr2=0x7f54600ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:01:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.262+0000 7f5466186640 1 -- 172.21.15.47:0/426470823 shutdown_connections 2024-07-24T22:01:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.262+0000 7f5466186640 1 -- 172.21.15.47:0/426470823 wait complete. 2024-07-24T22:01:47.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.263+0000 7f5466186640 1 Processor -- start 2024-07-24T22:01:47.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.263+0000 7f5466186640 1 -- start start 2024-07-24T22:01:47.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.263+0000 7f5466186640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54601036a0 0x7f5460198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:01:47.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.263+0000 7f5466186640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5460103fc0 0x7f54601991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:01:47.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.263+0000 7f5466186640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f546010cb00 0x7f546019e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:01:47.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.263+0000 7f5466186640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5460112760 con 0x7f54601036a0 2024-07-24T22:01:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.263+0000 7f5466186640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f54601125e0 con 0x7f546010cb00 2024-07-24T22:01:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.263+0000 7f5466186640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f54601128e0 con 0x7f5460103fc0 2024-07-24T22:01:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54601036a0 0x7f5460198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:01:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54601036a0 0x7f5460198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49458/0 (socket says 172.21.15.47:49458) 2024-07-24T22:01:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545f7fe640 1 -- 172.21.15.47:0/2284155459 learned_addr learned my addr 172.21.15.47:0/2284155459 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:01:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545ffff640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f546010cb00 0x7f546019e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:01:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545effd640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5460103fc0 0x7f54601991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:01:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545f7fe640 1 -- 172.21.15.47:0/2284155459 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5460103fc0 msgr2=0x7f54601991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:01:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545f7fe640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5460103fc0 0x7f54601991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545f7fe640 1 -- 172.21.15.47:0/2284155459 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f546010cb00 msgr2=0x7f546019e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:01:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545f7fe640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f546010cb00 0x7f546019e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:01:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545f7fe640 1 -- 172.21.15.47:0/2284155459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546019ed20 con 0x7f54601036a0 2024-07-24T22:01:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545f7fe640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54601036a0 0x7f5460198c70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5450005940 tx=0x7f54500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:01:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545cff9640 1 -- 172.21.15.47:0/2284155459 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545003f030 con 0x7f54601036a0 2024-07-24T22:01:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545cff9640 1 -- 172.21.15.47:0/2284155459 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5450003cb0 con 0x7f54601036a0 2024-07-24T22:01:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f5466186640 1 -- 172.21.15.47:0/2284155459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f546019efb0 con 0x7f54601036a0 2024-07-24T22:01:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.264+0000 7f545cff9640 1 -- 172.21.15.47:0/2284155459 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5450035070 con 0x7f54601036a0 2024-07-24T22:01:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.265+0000 7f5466186640 1 -- 172.21.15.47:0/2284155459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54601a56d0 con 0x7f54601036a0 2024-07-24T22:01:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.266+0000 7f5466186640 1 -- 172.21.15.47:0/2284155459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5460103a80 con 0x7f54601036a0 2024-07-24T22:01:47.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.267+0000 7f545cff9640 1 -- 172.21.15.47:0/2284155459 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f5450042030 con 0x7f54601036a0 2024-07-24T22:01:47.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.268+0000 7f545cff9640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f54480b3c20 0x7f54480b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:01:47.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.268+0000 7f545effd640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f54480b3c20 0x7f54480b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:01:47.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.268+0000 7f545cff9640 1 -- 172.21.15.47:0/2284155459 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6077+0+0 (secure 0 0 0) 0x7f5450103bd0 con 0x7f54601036a0 2024-07-24T22:01:47.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.268+0000 7f545effd640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f54480b3c20 0x7f54480b60e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f54600ff910 tx=0x7f545400b2e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:01:47.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.272+0000 7f545cff9640 1 -- 172.21.15.47:0/2284155459 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f54500cb3f0 con 0x7f54601036a0 2024-07-24T22:01:47.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:46 smithi188 ceph-mon[37380]: purged_snaps scrub starts 2024-07-24T22:01:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:46 smithi188 ceph-mon[37380]: purged_snaps scrub ok 2024-07-24T22:01:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:46 smithi188 ceph-mon[37380]: Detected new or changed devices on smithi188 2024-07-24T22:01:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:46 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi188 to 5696M 2024-07-24T22:01:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:01:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:46 smithi188 ceph-mon[37380]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:46 smithi183 ceph-mon[37007]: purged_snaps scrub starts 2024-07-24T22:01:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:46 smithi183 ceph-mon[37007]: purged_snaps scrub ok 2024-07-24T22:01:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:46 smithi183 ceph-mon[37007]: Detected new or changed devices on smithi188 2024-07-24T22:01:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:46 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi188 to 5696M 2024-07-24T22:01:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:01:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:01:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:01:47.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:46 smithi183 ceph-mon[37007]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-07-24T22:01:47.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:47.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:01:47.477+0000 7f5466186640 1 -- 172.21.15.47:0/2284155459 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f54600fed10 con 0x7f54480b3c20 2024-07-24T22:01:48.130 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:47 smithi047 ceph-mon[32551]: osd.8 [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658] boot 2024-07-24T22:01:48.130 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:47 smithi047 ceph-mon[32551]: osdmap e56: 9 total, 9 up, 9 in 2024-07-24T22:01:48.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:47 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:48.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:47 smithi047 ceph-mon[32551]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:01:48.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:47 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:01:48.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:47 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:01:48.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:47 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:48.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:47 smithi188 ceph-mon[37380]: osd.8 [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658] boot 2024-07-24T22:01:48.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:47 smithi188 ceph-mon[37380]: osdmap e56: 9 total, 9 up, 9 in 2024-07-24T22:01:48.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:47 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:48.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:47 smithi188 ceph-mon[37380]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:01:48.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:47 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:01:48.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:47 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:01:48.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:47 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:48.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:47 smithi183 ceph-mon[37007]: osd.8 [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658] boot 2024-07-24T22:01:48.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:47 smithi183 ceph-mon[37007]: osdmap e56: 9 total, 9 up, 9 in 2024-07-24T22:01:48.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:47 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-24T22:01:48.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:47 smithi183 ceph-mon[37007]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:01:48.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:47 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:01:48.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:47 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:01:48.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:47 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:49.140 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:48 smithi047 ceph-mon[32551]: osdmap e57: 9 total, 9 up, 9 in 2024-07-24T22:01:49.140 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:48 smithi047 ceph-mon[32551]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:01:49.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:48 smithi188 ceph-mon[37380]: osdmap e57: 9 total, 9 up, 9 in 2024-07-24T22:01:49.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:48 smithi188 ceph-mon[37380]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:01:49.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:48 smithi183 ceph-mon[37007]: osdmap e57: 9 total, 9 up, 9 in 2024-07-24T22:01:49.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:48 smithi183 ceph-mon[37007]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:01:50.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:49 smithi047 ceph-mon[32551]: osdmap e58: 9 total, 9 up, 9 in 2024-07-24T22:01:50.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:49 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1273363808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abd93c5e-283e-4873-a241-1056f2894116"}]: dispatch 2024-07-24T22:01:50.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:49 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1273363808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abd93c5e-283e-4873-a241-1056f2894116"}]': finished 2024-07-24T22:01:50.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:49 smithi047 ceph-mon[32551]: osdmap e59: 10 total, 9 up, 10 in 2024-07-24T22:01:50.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:01:50.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:49 smithi188 ceph-mon[37380]: osdmap e58: 9 total, 9 up, 9 in 2024-07-24T22:01:50.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:49 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1273363808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abd93c5e-283e-4873-a241-1056f2894116"}]: dispatch 2024-07-24T22:01:50.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:49 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1273363808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abd93c5e-283e-4873-a241-1056f2894116"}]': finished 2024-07-24T22:01:50.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:49 smithi188 ceph-mon[37380]: osdmap e59: 10 total, 9 up, 10 in 2024-07-24T22:01:50.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:01:50.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:49 smithi183 ceph-mon[37007]: osdmap e58: 9 total, 9 up, 9 in 2024-07-24T22:01:50.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:49 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1273363808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abd93c5e-283e-4873-a241-1056f2894116"}]: dispatch 2024-07-24T22:01:50.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:49 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1273363808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abd93c5e-283e-4873-a241-1056f2894116"}]': finished 2024-07-24T22:01:50.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:49 smithi183 ceph-mon[37007]: osdmap e59: 10 total, 9 up, 10 in 2024-07-24T22:01:50.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:01:51.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:50 smithi188 ceph-mon[37380]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:01:51.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:50 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3820726363' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:01:51.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:50 smithi183 ceph-mon[37007]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:01:51.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:50 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3820726363' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:01:51.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:50 smithi047 ceph-mon[32551]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:01:51.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:50 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3820726363' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:01:53.364 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:53 smithi047 ceph-mon[32551]: pgmap v180: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:01:53.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:53 smithi183 ceph-mon[37007]: pgmap v180: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:01:53.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:53 smithi188 ceph-mon[37380]: pgmap v180: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:01:55.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:55 smithi047 ceph-mon[32551]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-07-24T22:01:55.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:55 smithi183 ceph-mon[37007]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-07-24T22:01:55.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:55 smithi188 ceph-mon[37380]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-07-24T22:01:57.358 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:57 smithi047 ceph-mon[32551]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-24T22:01:57.358 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:57 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-07-24T22:01:57.358 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:57 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:57.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:57 smithi183 ceph-mon[37007]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-24T22:01:57.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:57 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-07-24T22:01:57.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:57 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:57.540 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:57 smithi188 ceph-mon[37380]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-24T22:01:57.540 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:57 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-07-24T22:01:57.540 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:57 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:01:58.349 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:58 smithi047 ceph-mon[32551]: Deploying daemon osd.9 on smithi047 2024-07-24T22:01:58.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:58 smithi183 ceph-mon[37007]: Deploying daemon osd.9 on smithi047 2024-07-24T22:01:58.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:58 smithi188 ceph-mon[37380]: Deploying daemon osd.9 on smithi047 2024-07-24T22:01:59.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:01:59 smithi183 ceph-mon[37007]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-07-24T22:01:59.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:01:59 smithi047 ceph-mon[32551]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-07-24T22:01:59.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:01:59 smithi188 ceph-mon[37380]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-07-24T22:02:01.387 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:01 smithi047 ceph-mon[32551]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-07-24T22:02:01.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:01 smithi183 ceph-mon[37007]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-07-24T22:02:01.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:01 smithi188 ceph-mon[37380]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-07-24T22:02:02.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:02 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:02.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:02 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:02.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:02 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:02.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:02 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:02.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:02 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:02.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:02 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:02.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:02 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:02.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:02 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:02.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:02 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:03.784 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:03 smithi047 ceph-mon[32551]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:02:03.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:03 smithi188 ceph-mon[37380]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:02:03.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:03 smithi183 ceph-mon[37007]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:02:04.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:04.601+0000 7f545cff9640 1 -- 172.21.15.47:0/2284155459 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f54600fed10 con 0x7f54480b3c20 2024-07-24T22:02:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 9 on host 'smithi047' 2024-07-24T22:02:04.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:04.604+0000 7f5466186640 1 -- 172.21.15.47:0/2284155459 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f54480b3c20 msgr2=0x7f54480b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:04.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:04.604+0000 7f5466186640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f54480b3c20 0x7f54480b60e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f54600ff910 tx=0x7f545400b2e0 comp rx=0 tx=0).stop 2024-07-24T22:02:04.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:04.604+0000 7f5466186640 1 -- 172.21.15.47:0/2284155459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54601036a0 msgr2=0x7f5460198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:04.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:04.604+0000 7f5466186640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54601036a0 0x7f5460198c70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5450005940 tx=0x7f54500042f0 comp rx=0 tx=0).stop 2024-07-24T22:02:04.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:04.604+0000 7f5466186640 1 -- 172.21.15.47:0/2284155459 shutdown_connections 2024-07-24T22:02:04.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:04.604+0000 7f5466186640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f54480b3c20 0x7f54480b60e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:04.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:04.604+0000 7f5466186640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f546010cb00 0x7f546019e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:04.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:04.604+0000 7f5466186640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5460103fc0 0x7f54601991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:04.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:04.604+0000 7f5466186640 1 --2- 172.21.15.47:0/2284155459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54601036a0 0x7f5460198c70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:04.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:04.604+0000 7f5466186640 1 -- 172.21.15.47:0/2284155459 >> 172.21.15.47:0/2284155459 conn(0x7f54600fd100 msgr2=0x7f546010ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:02:04.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:04.604+0000 7f5466186640 1 -- 172.21.15.47:0/2284155459 shutdown_connections 2024-07-24T22:02:04.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:04.604+0000 7f5466186640 1 -- 172.21.15.47:0/2284155459 wait complete. 2024-07-24T22:02:05.178 DEBUG:teuthology.orchestra.run.smithi047:osd.9> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.9.service 2024-07-24T22:02:05.180 INFO:tasks.cephadm:Deploying osd.10 on smithi183 with /dev/vg_nvme/lv_1... 2024-07-24T22:02:05.180 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-07-24T22:02:05.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:04 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:04 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:04 smithi047 ceph-mon[32551]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:02:05.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:04 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:05.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:04 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:05.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:04 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:04 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:05.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:04 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.202 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:04 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:04 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:04 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:04 smithi188 ceph-mon[37380]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:02:05.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:04 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:05.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:04 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:05.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:04 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:04 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:05.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:04 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:04 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:04 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:04 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:04 smithi183 ceph-mon[37007]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-07-24T22:02:05.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:04 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:05.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:04 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:05.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:04 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:04 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:05.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:04 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:04 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:05.439 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.b/config 2024-07-24T22:02:05.468 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:02:05 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:02:05.445+0000 7f949fb78640 -1 osd.9 0 log_to_monitors true 2024-07-24T22:02:06.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:05 smithi183 ceph-mon[37007]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-07-24T22:02:06.281 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:05 smithi047 ceph-mon[32551]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-07-24T22:02:06.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:05 smithi188 ceph-mon[37380]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-07-24T22:02:07.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:06 smithi183 ceph-mon[37007]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-07-24T22:02:07.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:06 smithi183 ceph-mon[37007]: osdmap e60: 10 total, 9 up, 10 in 2024-07-24T22:02:07.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:06 smithi183 ceph-mon[37007]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-07-24T22:02:07.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:06 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:07.163 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:06 smithi183 ceph-mon[37007]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:02:07.219 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-07-24T22:02:07.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:06 smithi188 ceph-mon[37380]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-07-24T22:02:07.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:06 smithi188 ceph-mon[37380]: osdmap e60: 10 total, 9 up, 10 in 2024-07-24T22:02:07.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:06 smithi188 ceph-mon[37380]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-07-24T22:02:07.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:06 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:07.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:06 smithi188 ceph-mon[37380]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:02:07.312 INFO:teuthology.orchestra.run.smithi183.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-07-24T22:02:07.325 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10+0 records in 2024-07-24T22:02:07.326 INFO:teuthology.orchestra.run.smithi183.stderr:10+0 records out 2024-07-24T22:02:07.326 INFO:teuthology.orchestra.run.smithi183.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116295 s, 902 MB/s 2024-07-24T22:02:07.326 INFO:teuthology.orchestra.run.smithi183.stderr:--> Zapping successful for: 2024-07-24T22:02:07.405 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:06 smithi047 ceph-mon[32551]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-07-24T22:02:07.405 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:06 smithi047 ceph-mon[32551]: osdmap e60: 10 total, 9 up, 10 in 2024-07-24T22:02:07.405 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:06 smithi047 ceph-mon[32551]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-07-24T22:02:07.405 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:06 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:07.405 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:06 smithi047 ceph-mon[32551]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:02:07.923 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:02:07.826+0000 7f949bafb640 -1 osd.9 0 waiting for initial osdmap 2024-07-24T22:02:07.923 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:02:07.840+0000 7f949391a640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T22:02:08.055 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_1 2024-07-24T22:02:08.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-07-24T22:02:08.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: osdmap e61: 10 total, 9 up, 10 in 2024-07-24T22:02:08.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:08.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:08.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' 2024-07-24T22:02:08.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:08.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:08.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:08.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:08.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:08.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:08.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:08.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:08.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:08.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:08.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-07-24T22:02:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: osdmap e61: 10 total, 9 up, 10 in 2024-07-24T22:02:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' 2024-07-24T22:02:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:08.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:08.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:08.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:08.305 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.b/config 2024-07-24T22:02:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-07-24T22:02:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: osdmap e61: 10 total, 9 up, 10 in 2024-07-24T22:02:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884]' entity='osd.9' 2024-07-24T22:02:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:08.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:08.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:09.105 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:08 smithi183 ceph-mon[37007]: purged_snaps scrub starts 2024-07-24T22:02:09.105 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:08 smithi183 ceph-mon[37007]: purged_snaps scrub ok 2024-07-24T22:02:09.105 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:08 smithi183 ceph-mon[37007]: Detected new or changed devices on smithi047 2024-07-24T22:02:09.105 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:08 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi047 to 4273M 2024-07-24T22:02:09.106 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:09.106 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:08 smithi183 ceph-mon[37007]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:02:09.106 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:08 smithi183 ceph-mon[37007]: osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884] boot 2024-07-24T22:02:09.106 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:08 smithi183 ceph-mon[37007]: osdmap e62: 10 total, 10 up, 10 in 2024-07-24T22:02:09.106 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:09.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:08 smithi188 ceph-mon[37380]: purged_snaps scrub starts 2024-07-24T22:02:09.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:08 smithi188 ceph-mon[37380]: purged_snaps scrub ok 2024-07-24T22:02:09.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:08 smithi188 ceph-mon[37380]: Detected new or changed devices on smithi047 2024-07-24T22:02:09.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:08 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi047 to 4273M 2024-07-24T22:02:09.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:09.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:08 smithi188 ceph-mon[37380]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:02:09.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:08 smithi188 ceph-mon[37380]: osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884] boot 2024-07-24T22:02:09.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:08 smithi188 ceph-mon[37380]: osdmap e62: 10 total, 10 up, 10 in 2024-07-24T22:02:09.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:09.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:08 smithi047 ceph-mon[32551]: purged_snaps scrub starts 2024-07-24T22:02:09.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:08 smithi047 ceph-mon[32551]: purged_snaps scrub ok 2024-07-24T22:02:09.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:08 smithi047 ceph-mon[32551]: Detected new or changed devices on smithi047 2024-07-24T22:02:09.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:08 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi047 to 4273M 2024-07-24T22:02:09.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:09.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:08 smithi047 ceph-mon[32551]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-07-24T22:02:09.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:08 smithi047 ceph-mon[32551]: osd.9 [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884] boot 2024-07-24T22:02:09.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:08 smithi047 ceph-mon[32551]: osdmap e62: 10 total, 10 up, 10 in 2024-07-24T22:02:09.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-24T22:02:09.901 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.898+0000 7f138e3f1640 1 -- 172.21.15.183:0/3985141625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1388102790 msgr2=0x7f1388102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:09.901 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.898+0000 7f138e3f1640 1 --2- 172.21.15.183:0/3985141625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1388102790 0x7f1388102b70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1378009900 tx=0x7f137802a410 comp rx=0 tx=0).stop 2024-07-24T22:02:09.901 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.898+0000 7f138e3f1640 1 -- 172.21.15.183:0/3985141625 shutdown_connections 2024-07-24T22:02:09.901 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.898+0000 7f138e3f1640 1 --2- 172.21.15.183:0/3985141625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1388108b20 0x7f138810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:09.902 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.898+0000 7f138e3f1640 1 --2- 172.21.15.183:0/3985141625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13881081a0 0x7f13881085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:09.902 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.898+0000 7f138e3f1640 1 --2- 172.21.15.183:0/3985141625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1388102790 0x7f1388102b70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:09.902 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.898+0000 7f138e3f1640 1 -- 172.21.15.183:0/3985141625 >> 172.21.15.183:0/3985141625 conn(0x7f13880fe200 msgr2=0x7f1388100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:02:09.902 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.898+0000 7f138e3f1640 1 -- 172.21.15.183:0/3985141625 shutdown_connections 2024-07-24T22:02:09.902 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.898+0000 7f138e3f1640 1 -- 172.21.15.183:0/3985141625 wait complete. 2024-07-24T22:02:09.902 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.898+0000 7f138e3f1640 1 Processor -- start 2024-07-24T22:02:09.902 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.898+0000 7f138e3f1640 1 -- start start 2024-07-24T22:02:09.902 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f138e3f1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1388102790 0x7f1388198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:09.902 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f138e3f1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13881081a0 0x7f1388199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:09.902 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f138e3f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1388108b20 0x7f138819e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:09.902 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f138e3f1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f13881127c0 con 0x7f13881081a0 2024-07-24T22:02:09.902 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f138e3f1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1388112640 con 0x7f1388102790 2024-07-24T22:02:09.903 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f138e3f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1388112940 con 0x7f1388108b20 2024-07-24T22:02:09.903 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f1387fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1388102790 0x7f1388198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:09.903 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f1387fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1388102790 0x7f1388198cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:40290/0 (socket says 172.21.15.183:40290) 2024-07-24T22:02:09.903 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f1387fff640 1 -- 172.21.15.183:0/990587237 learned_addr learned my addr 172.21.15.183:0/990587237 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-07-24T22:02:09.903 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f138c98e640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1388108b20 0x7f138819e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:09.903 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f13877fe640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13881081a0 0x7f1388199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:09.903 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f1387fff640 1 -- 172.21.15.183:0/990587237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1388108b20 msgr2=0x7f138819e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:09.903 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f1387fff640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1388108b20 0x7f138819e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:09.903 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f1387fff640 1 -- 172.21.15.183:0/990587237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13881081a0 msgr2=0x7f1388199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:09.903 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f1387fff640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13881081a0 0x7f1388199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:09.903 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f1387fff640 1 -- 172.21.15.183:0/990587237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138819ed80 con 0x7f1388102790 2024-07-24T22:02:09.903 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f13877fe640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13881081a0 0x7f1388199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:02:09.903 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f1387fff640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1388102790 0x7f1388198cd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1378005940 tx=0x7f1378004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:02:09.904 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.899+0000 7f13857fa640 1 -- 172.21.15.183:0/990587237 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137803f030 con 0x7f1388102790 2024-07-24T22:02:09.904 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.900+0000 7f138e3f1640 1 -- 172.21.15.183:0/990587237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138819f010 con 0x7f1388102790 2024-07-24T22:02:09.904 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.900+0000 7f13857fa640 1 -- 172.21.15.183:0/990587237 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1378003aa0 con 0x7f1388102790 2024-07-24T22:02:09.904 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.900+0000 7f13857fa640 1 -- 172.21.15.183:0/990587237 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378035070 con 0x7f1388102790 2024-07-24T22:02:09.904 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.900+0000 7f138e3f1640 1 -- 172.21.15.183:0/990587237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13881a5730 con 0x7f1388102790 2024-07-24T22:02:09.905 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.900+0000 7f138e3f1640 1 -- 172.21.15.183:0/990587237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1388102b70 con 0x7f1388102790 2024-07-24T22:02:09.905 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.902+0000 7f13857fa640 1 -- 172.21.15.183:0/990587237 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f1378042030 con 0x7f1388102790 2024-07-24T22:02:09.905 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.903+0000 7f13857fa640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13700b3c20 0x7f13700b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:09.905 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.903+0000 7f13857fa640 1 -- 172.21.15.183:0/990587237 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6476+0+0 (secure 0 0 0) 0x7f1378103f20 con 0x7f1388102790 2024-07-24T22:02:09.905 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.903+0000 7f13877fe640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13700b3c20 0x7f13700b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:09.905 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.903+0000 7f13877fe640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13700b3c20 0x7f13700b60e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1388105090 tx=0x7f137c005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:02:09.907 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:09.906+0000 7f13857fa640 1 -- 172.21.15.183:0/990587237 <== mon.2 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f13780cbca0 con 0x7f1388102790 2024-07-24T22:02:10.100 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:10.098+0000 7f138e3f1640 1 -- 172.21.15.183:0/990587237 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f138810a960 con 0x7f13700b3c20 2024-07-24T22:02:11.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:11 smithi183 ceph-mon[37007]: osdmap e63: 10 total, 10 up, 10 in 2024-07-24T22:02:11.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:11 smithi183 ceph-mon[37007]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:11.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:11 smithi183 ceph-mon[37007]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:02:11.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:11 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:02:11.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:11 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:02:11.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:11 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:11.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:11 smithi188 ceph-mon[37380]: osdmap e63: 10 total, 10 up, 10 in 2024-07-24T22:02:11.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:11 smithi188 ceph-mon[37380]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:11.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:11 smithi188 ceph-mon[37380]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:02:11.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:11 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:02:11.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:11 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:02:11.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:11 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:11.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:11 smithi047 ceph-mon[32551]: osdmap e63: 10 total, 10 up, 10 in 2024-07-24T22:02:11.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:11 smithi047 ceph-mon[32551]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:11.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:11 smithi047 ceph-mon[32551]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:02:11.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:11 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:02:11.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:11 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:02:11.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:11 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:13.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:13 smithi183 ceph-mon[37007]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:13.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:13 smithi183 ceph-mon[37007]: from='client.? 172.21.15.183:0/3278511580' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc967f8f-ce27-4230-be70-e36927f89fe4"}]: dispatch 2024-07-24T22:02:13.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:13 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc967f8f-ce27-4230-be70-e36927f89fe4"}]: dispatch 2024-07-24T22:02:13.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:13 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc967f8f-ce27-4230-be70-e36927f89fe4"}]': finished 2024-07-24T22:02:13.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:13 smithi183 ceph-mon[37007]: osdmap e64: 11 total, 10 up, 11 in 2024-07-24T22:02:13.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:13 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:13.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:13 smithi047 ceph-mon[32551]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:13.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:13 smithi047 ceph-mon[32551]: from='client.? 172.21.15.183:0/3278511580' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc967f8f-ce27-4230-be70-e36927f89fe4"}]: dispatch 2024-07-24T22:02:13.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:13 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc967f8f-ce27-4230-be70-e36927f89fe4"}]: dispatch 2024-07-24T22:02:13.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:13 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc967f8f-ce27-4230-be70-e36927f89fe4"}]': finished 2024-07-24T22:02:13.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:13 smithi047 ceph-mon[32551]: osdmap e64: 11 total, 10 up, 11 in 2024-07-24T22:02:13.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:13 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:13.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:13 smithi188 ceph-mon[37380]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:13.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:13 smithi188 ceph-mon[37380]: from='client.? 172.21.15.183:0/3278511580' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc967f8f-ce27-4230-be70-e36927f89fe4"}]: dispatch 2024-07-24T22:02:13.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:13 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc967f8f-ce27-4230-be70-e36927f89fe4"}]: dispatch 2024-07-24T22:02:13.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:13 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc967f8f-ce27-4230-be70-e36927f89fe4"}]': finished 2024-07-24T22:02:13.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:13 smithi188 ceph-mon[37380]: osdmap e64: 11 total, 10 up, 11 in 2024-07-24T22:02:13.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:13 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:14.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:14 smithi183 ceph-mon[37007]: from='client.? 172.21.15.183:0/1748074129' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:02:14.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:14 smithi047 ceph-mon[32551]: from='client.? 172.21.15.183:0/1748074129' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:02:14.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:14 smithi188 ceph-mon[37380]: from='client.? 172.21.15.183:0/1748074129' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:02:15.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:15 smithi183 ceph-mon[37007]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:15 smithi047 ceph-mon[32551]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:15.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:15 smithi188 ceph-mon[37380]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:17.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:17 smithi183 ceph-mon[37007]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:17.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:17 smithi047 ceph-mon[32551]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:17.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:17 smithi188 ceph-mon[37380]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:19.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:19 smithi183 ceph-mon[37007]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:19.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:19 smithi047 ceph-mon[32551]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:19.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:19 smithi188 ceph-mon[37380]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:20.390 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-07-24T22:02:20.391 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:20.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-07-24T22:02:20.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:20.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-07-24T22:02:20.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:21.395 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:21 smithi183 ceph-mon[37007]: Deploying daemon osd.10 on smithi183 2024-07-24T22:02:21.395 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:21 smithi183 ceph-mon[37007]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:21.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:21 smithi047 ceph-mon[32551]: Deploying daemon osd.10 on smithi183 2024-07-24T22:02:21.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:21 smithi047 ceph-mon[32551]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:21.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:21 smithi188 ceph-mon[37380]: Deploying daemon osd.10 on smithi183 2024-07-24T22:02:21.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:21 smithi188 ceph-mon[37380]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:23.324 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:23 smithi183 ceph-mon[37007]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:23.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:23 smithi047 ceph-mon[32551]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:23.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:23 smithi188 ceph-mon[37380]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:25.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:25 smithi183 ceph-mon[37007]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:25.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:25 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:25.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:25 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:25.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:25 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:25.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:25 smithi047 ceph-mon[32551]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:25.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:25 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:25.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:25 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:25.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:25 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:25.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:25 smithi188 ceph-mon[37380]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:25.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:25 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:25.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:25 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:25.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:25 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:27.404 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:27 smithi183 ceph-mon[37007]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:27.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:27 smithi047 ceph-mon[32551]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:27.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:27 smithi188 ceph-mon[37380]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:28.150 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 10 on host 'smithi183' 2024-07-24T22:02:28.151 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:28.147+0000 7f13857fa640 1 -- 172.21.15.183:0/990587237 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f138810a960 con 0x7f13700b3c20 2024-07-24T22:02:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:28.150+0000 7f138e3f1640 1 -- 172.21.15.183:0/990587237 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13700b3c20 msgr2=0x7f13700b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:28.150+0000 7f138e3f1640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13700b3c20 0x7f13700b60e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1388105090 tx=0x7f137c005f90 comp rx=0 tx=0).stop 2024-07-24T22:02:28.152 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:28.150+0000 7f138e3f1640 1 -- 172.21.15.183:0/990587237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1388102790 msgr2=0x7f1388198cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:28.150+0000 7f138e3f1640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1388102790 0x7f1388198cd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1378005940 tx=0x7f1378004270 comp rx=0 tx=0).stop 2024-07-24T22:02:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:28.150+0000 7f138e3f1640 1 -- 172.21.15.183:0/990587237 shutdown_connections 2024-07-24T22:02:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:28.150+0000 7f138e3f1640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13700b3c20 0x7f13700b60e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:28.150+0000 7f138e3f1640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1388108b20 0x7f138819e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:28.150+0000 7f138e3f1640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13881081a0 0x7f1388199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:28.150+0000 7f138e3f1640 1 --2- 172.21.15.183:0/990587237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1388102790 0x7f1388198cd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:28.150+0000 7f138e3f1640 1 -- 172.21.15.183:0/990587237 >> 172.21.15.183:0/990587237 conn(0x7f13880fe200 msgr2=0x7f13881005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:02:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:28.150+0000 7f138e3f1640 1 -- 172.21.15.183:0/990587237 shutdown_connections 2024-07-24T22:02:28.153 INFO:teuthology.orchestra.run.smithi183.stderr:2024-07-24T22:02:28.150+0000 7f138e3f1640 1 -- 172.21.15.183:0/990587237 wait complete. 2024-07-24T22:02:28.811 DEBUG:teuthology.orchestra.run.smithi183:osd.10> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.10.service 2024-07-24T22:02:28.814 INFO:tasks.cephadm:Deploying osd.11 on smithi188 with /dev/vg_nvme/lv_1... 2024-07-24T22:02:28.814 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-07-24T22:02:29.075 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T22:02:29.398 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:29 smithi188 ceph-mon[37380]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:29.398 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:29 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:29.398 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:29 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:29.398 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:29 smithi188 ceph-mon[37380]: from='osd.10 [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-24T22:02:29.399 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:29 smithi188 ceph-mon[37380]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-24T22:02:29.399 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:29 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:29.399 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:29 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:29.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:29 smithi183 ceph-mon[37007]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:29.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:29 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:29.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:29 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:29.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:29 smithi183 ceph-mon[37007]: from='osd.10 [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-24T22:02:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:29 smithi183 ceph-mon[37007]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-24T22:02:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:29 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:29.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:29 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:29 smithi047 ceph-mon[32551]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:29 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:29 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:29 smithi047 ceph-mon[32551]: from='osd.10 [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-24T22:02:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:29 smithi047 ceph-mon[32551]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-24T22:02:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:29 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:29 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:30.387 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:30 smithi183 ceph-mon[37007]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-07-24T22:02:30.387 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:30 smithi183 ceph-mon[37007]: osdmap e65: 11 total, 10 up, 11 in 2024-07-24T22:02:30.388 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:30.388 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:30 smithi183 ceph-mon[37007]: from='osd.10 [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:02:30.388 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:30 smithi183 ceph-mon[37007]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:02:30.388 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:02:30 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:02:30.167+0000 7f37ac333640 -1 osd.10 0 waiting for initial osdmap 2024-07-24T22:02:30.388 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:02:30 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:02:30.178+0000 7f37a815a640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T22:02:30.417 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:30 smithi188 ceph-mon[37380]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-07-24T22:02:30.417 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:30 smithi188 ceph-mon[37380]: osdmap e65: 11 total, 10 up, 11 in 2024-07-24T22:02:30.417 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:30.417 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:30 smithi188 ceph-mon[37380]: from='osd.10 [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:02:30.417 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:30 smithi188 ceph-mon[37380]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:02:30.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:30 smithi047 ceph-mon[32551]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-07-24T22:02:30.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:30 smithi047 ceph-mon[32551]: osdmap e65: 11 total, 10 up, 11 in 2024-07-24T22:02:30.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:30.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:30 smithi047 ceph-mon[32551]: from='osd.10 [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:02:30.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:30 smithi047 ceph-mon[32551]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]: dispatch 2024-07-24T22:02:30.734 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-07-24T22:02:30.827 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-07-24T22:02:30.842 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-07-24T22:02:30.842 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-07-24T22:02:30.842 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0118779 s, 883 MB/s 2024-07-24T22:02:30.842 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-07-24T22:02:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:31 smithi183 ceph-mon[37007]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:31 smithi183 ceph-mon[37007]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-07-24T22:02:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:31 smithi183 ceph-mon[37007]: osdmap e66: 11 total, 10 up, 11 in 2024-07-24T22:02:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:31.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:31.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:31 smithi188 ceph-mon[37380]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:31.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:31 smithi188 ceph-mon[37380]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-07-24T22:02:31.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:31 smithi188 ceph-mon[37380]: osdmap e66: 11 total, 10 up, 11 in 2024-07-24T22:02:31.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:31.424 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:31.425 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch daemon add osd smithi188:vg_nvme/lv_1 2024-07-24T22:02:31.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:31 smithi047 ceph-mon[32551]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-07-24T22:02:31.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:31 smithi047 ceph-mon[32551]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-07-24T22:02:31.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:31 smithi047 ceph-mon[32551]: osdmap e66: 11 total, 10 up, 11 in 2024-07-24T22:02:31.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:31.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:31.689 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T22:02:32.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: purged_snaps scrub starts 2024-07-24T22:02:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: purged_snaps scrub ok 2024-07-24T22:02:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: osd.10 [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199] boot 2024-07-24T22:02:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: osdmap e67: 11 total, 11 up, 11 in 2024-07-24T22:02:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:32.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: purged_snaps scrub starts 2024-07-24T22:02:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: purged_snaps scrub ok 2024-07-24T22:02:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: osd.10 [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199] boot 2024-07-24T22:02:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: osdmap e67: 11 total, 11 up, 11 in 2024-07-24T22:02:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:32.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:32.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:32.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:32.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:32.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: purged_snaps scrub starts 2024-07-24T22:02:32.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: purged_snaps scrub ok 2024-07-24T22:02:32.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: osd.10 [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199] boot 2024-07-24T22:02:32.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: osdmap e67: 11 total, 11 up, 11 in 2024-07-24T22:02:32.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-24T22:02:32.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:32.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:32.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:32.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:32.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:32.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:32.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:32.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:32.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:32.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:33.219 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.217+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/4051840344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f481070a0 msgr2=0x7f9f481074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:33.220 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.217+0000 7f9f4dcf0640 1 --2- 172.21.15.188:0/4051840344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f481070a0 0x7f9f481074e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009900 tx=0x7f9f3c02a410 comp rx=0 tx=0).stop 2024-07-24T22:02:33.220 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.217+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/4051840344 shutdown_connections 2024-07-24T22:02:33.220 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.217+0000 7f9f4dcf0640 1 --2- 172.21.15.188:0/4051840344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f48107a20 0x7f9f4810e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:33.220 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.217+0000 7f9f4dcf0640 1 --2- 172.21.15.188:0/4051840344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f481070a0 0x7f9f481074e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:33.220 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.217+0000 7f9f4dcf0640 1 --2- 172.21.15.188:0/4051840344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f48101690 0x7f9f48101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:33.220 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.217+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/4051840344 >> 172.21.15.188:0/4051840344 conn(0x7f9f480fd100 msgr2=0x7f9f480ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:02:33.220 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.217+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/4051840344 shutdown_connections 2024-07-24T22:02:33.220 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.217+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/4051840344 wait complete. 2024-07-24T22:02:33.220 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.218+0000 7f9f4dcf0640 1 Processor -- start 2024-07-24T22:02:33.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.218+0000 7f9f4dcf0640 1 -- start start 2024-07-24T22:02:33.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.218+0000 7f9f4dcf0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f48101690 0x7f9f48197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:33.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.218+0000 7f9f4dcf0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f481070a0 0x7f9f48198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:33.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.218+0000 7f9f4dcf0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f48107a20 0x7f9f4819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:33.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.218+0000 7f9f4dcf0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9f48111620 con 0x7f9f48101690 2024-07-24T22:02:33.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.218+0000 7f9f4dcf0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9f481114a0 con 0x7f9f48107a20 2024-07-24T22:02:33.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.218+0000 7f9f4dcf0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9f481117a0 con 0x7f9f481070a0 2024-07-24T22:02:33.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.218+0000 7f9f46ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f481070a0 0x7f9f48198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:33.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.218+0000 7f9f46ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f481070a0 0x7f9f48198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:42632/0 (socket says 172.21.15.188:42632) 2024-07-24T22:02:33.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.218+0000 7f9f46ffd640 1 -- 172.21.15.188:0/3256755267 learned_addr learned my addr 172.21.15.188:0/3256755267 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-07-24T22:02:33.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.218+0000 7f9f477fe640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f48101690 0x7f9f48197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:33.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.219+0000 7f9f47fff640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f48107a20 0x7f9f4819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:33.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.219+0000 7f9f46ffd640 1 -- 172.21.15.188:0/3256755267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f48107a20 msgr2=0x7f9f4819d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:33.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.219+0000 7f9f46ffd640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f48107a20 0x7f9f4819d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:33.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.219+0000 7f9f46ffd640 1 -- 172.21.15.188:0/3256755267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f48101690 msgr2=0x7f9f48197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:33.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.219+0000 7f9f46ffd640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f48101690 0x7f9f48197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:33.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.219+0000 7f9f46ffd640 1 -- 172.21.15.188:0/3256755267 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4819dbe0 con 0x7f9f481070a0 2024-07-24T22:02:33.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.219+0000 7f9f46ffd640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f481070a0 0x7f9f48198070 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c005940 tx=0x7f9f3c0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:02:33.224 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.219+0000 7f9f44ff9640 1 -- 172.21.15.188:0/3256755267 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c03f030 con 0x7f9f481070a0 2024-07-24T22:02:33.224 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.219+0000 7f9f44ff9640 1 -- 172.21.15.188:0/3256755267 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f3c003cb0 con 0x7f9f481070a0 2024-07-24T22:02:33.224 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.219+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/3256755267 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4819de70 con 0x7f9f481070a0 2024-07-24T22:02:33.224 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.219+0000 7f9f44ff9640 1 -- 172.21.15.188:0/3256755267 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c035070 con 0x7f9f481070a0 2024-07-24T22:02:33.224 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.219+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/3256755267 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f481a4590 con 0x7f9f481070a0 2024-07-24T22:02:33.224 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.220+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/3256755267 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f48101a70 con 0x7f9f481070a0 2024-07-24T22:02:33.224 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.222+0000 7f9f44ff9640 1 -- 172.21.15.188:0/3256755267 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f9f3c042030 con 0x7f9f481070a0 2024-07-24T22:02:33.225 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.223+0000 7f9f44ff9640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9f300b3c20 0x7f9f300b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:33.225 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.223+0000 7f9f44ff9640 1 -- 172.21.15.188:0/3256755267 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6909+0+0 (secure 0 0 0) 0x7f9f3c1042f0 con 0x7f9f481070a0 2024-07-24T22:02:33.225 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.223+0000 7f9f477fe640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9f300b3c20 0x7f9f300b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:33.226 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.224+0000 7f9f477fe640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9f300b3c20 0x7f9f300b60e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f380058c0 tx=0x7f9f3800a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:02:33.228 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.226+0000 7f9f44ff9640 1 -- 172.21.15.188:0/3256755267 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f9f3c0cbe20 con 0x7f9f481070a0 2024-07-24T22:02:33.421 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:33.419+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/3256755267 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9f481092a0 con 0x7f9f300b3c20 2024-07-24T22:02:33.422 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:33 smithi188 ceph-mon[37380]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:33.422 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:33 smithi188 ceph-mon[37380]: Detected new or changed devices on smithi183 2024-07-24T22:02:33.422 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:33 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi183 to 4272M 2024-07-24T22:02:33.422 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:33 smithi188 ceph-mon[37380]: osdmap e68: 11 total, 11 up, 11 in 2024-07-24T22:02:33.422 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:33 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:33.422 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:33 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:33.422 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:33 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:33.422 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:33 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:33.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:33 smithi047 ceph-mon[32551]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:33.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:33 smithi047 ceph-mon[32551]: Detected new or changed devices on smithi183 2024-07-24T22:02:33.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:33 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi183 to 4272M 2024-07-24T22:02:33.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:33 smithi047 ceph-mon[32551]: osdmap e68: 11 total, 11 up, 11 in 2024-07-24T22:02:33.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:33 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:33.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:33 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:33.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:33 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:33.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:33 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:33.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:33 smithi183 ceph-mon[37007]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:33.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:33 smithi183 ceph-mon[37007]: Detected new or changed devices on smithi183 2024-07-24T22:02:33.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:33 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi183 to 4272M 2024-07-24T22:02:33.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:33 smithi183 ceph-mon[37007]: osdmap e68: 11 total, 11 up, 11 in 2024-07-24T22:02:33.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:33 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:33.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:33 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:33.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:33 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:33.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:33 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:34.497 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:34 smithi188 ceph-mon[37380]: osdmap e69: 11 total, 11 up, 11 in 2024-07-24T22:02:34.497 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:34 smithi188 ceph-mon[37380]: from='client.24514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:02:34.497 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:02:34.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:02:34.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:34 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:34.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:34 smithi183 ceph-mon[37007]: osdmap e69: 11 total, 11 up, 11 in 2024-07-24T22:02:34.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:34 smithi183 ceph-mon[37007]: from='client.24514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:02:34.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:02:34.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:02:34.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:34 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:34.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:34 smithi047 ceph-mon[32551]: osdmap e69: 11 total, 11 up, 11 in 2024-07-24T22:02:34.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:34 smithi047 ceph-mon[32551]: from='client.24514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:02:34.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-24T22:02:34.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-24T22:02:34.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:34 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:35.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:35 smithi188 ceph-mon[37380]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-07-24T22:02:35.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:35 smithi183 ceph-mon[37007]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-07-24T22:02:35.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:35 smithi047 ceph-mon[32551]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-07-24T22:02:36.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:36 smithi188 ceph-mon[37380]: from='client.? 172.21.15.188:0/1187538419' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b379865-3a5c-4a2d-aa74-a4f215027fa8"}]: dispatch 2024-07-24T22:02:36.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:36 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b379865-3a5c-4a2d-aa74-a4f215027fa8"}]: dispatch 2024-07-24T22:02:36.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:36 smithi188 ceph-mon[37380]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b379865-3a5c-4a2d-aa74-a4f215027fa8"}]': finished 2024-07-24T22:02:36.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:36 smithi188 ceph-mon[37380]: osdmap e70: 12 total, 11 up, 12 in 2024-07-24T22:02:36.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:36 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:36.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:36 smithi183 ceph-mon[37007]: from='client.? 172.21.15.188:0/1187538419' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b379865-3a5c-4a2d-aa74-a4f215027fa8"}]: dispatch 2024-07-24T22:02:36.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:36 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b379865-3a5c-4a2d-aa74-a4f215027fa8"}]: dispatch 2024-07-24T22:02:36.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:36 smithi183 ceph-mon[37007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b379865-3a5c-4a2d-aa74-a4f215027fa8"}]': finished 2024-07-24T22:02:36.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:36 smithi183 ceph-mon[37007]: osdmap e70: 12 total, 11 up, 12 in 2024-07-24T22:02:36.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:36 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:36.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:36 smithi047 ceph-mon[32551]: from='client.? 172.21.15.188:0/1187538419' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b379865-3a5c-4a2d-aa74-a4f215027fa8"}]: dispatch 2024-07-24T22:02:36.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:36 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b379865-3a5c-4a2d-aa74-a4f215027fa8"}]: dispatch 2024-07-24T22:02:36.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:36 smithi047 ceph-mon[32551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b379865-3a5c-4a2d-aa74-a4f215027fa8"}]': finished 2024-07-24T22:02:36.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:36 smithi047 ceph-mon[32551]: osdmap e70: 12 total, 11 up, 12 in 2024-07-24T22:02:36.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:36 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:37.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:37 smithi188 ceph-mon[37380]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-07-24T22:02:37.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:37 smithi188 ceph-mon[37380]: from='client.? 172.21.15.188:0/2668513485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:02:37.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:37 smithi183 ceph-mon[37007]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-07-24T22:02:37.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:37 smithi183 ceph-mon[37007]: from='client.? 172.21.15.188:0/2668513485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:02:37.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:37 smithi047 ceph-mon[32551]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-07-24T22:02:37.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:37 smithi047 ceph-mon[32551]: from='client.? 172.21.15.188:0/2668513485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-24T22:02:39.472 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:39 smithi188 ceph-mon[37380]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-24T22:02:39.485 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:39 smithi183 ceph-mon[37007]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-24T22:02:39.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:39 smithi047 ceph-mon[32551]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-24T22:02:41.366 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:41 smithi188 ceph-mon[37380]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-07-24T22:02:41.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:41 smithi183 ceph-mon[37007]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-07-24T22:02:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:41 smithi047 ceph-mon[32551]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-07-24T22:02:43.292 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:43 smithi188 ceph-mon[37380]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-07-24T22:02:43.292 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:43 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-07-24T22:02:43.292 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:43 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:43.293 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:43 smithi188 ceph-mon[37380]: Deploying daemon osd.11 on smithi188 2024-07-24T22:02:43.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:43 smithi183 ceph-mon[37007]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-07-24T22:02:43.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:43 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-07-24T22:02:43.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:43 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:43.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:43 smithi183 ceph-mon[37007]: Deploying daemon osd.11 on smithi188 2024-07-24T22:02:43.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:43 smithi047 ceph-mon[32551]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-07-24T22:02:43.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:43 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-07-24T22:02:43.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:43 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:43.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:43 smithi047 ceph-mon[32551]: Deploying daemon osd.11 on smithi188 2024-07-24T22:02:45.413 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:45 smithi188 ceph-mon[37380]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:45.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:45 smithi047 ceph-mon[32551]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:45 smithi183 ceph-mon[37007]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:47.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:47 smithi188 ceph-mon[37380]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:47.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:47 smithi183 ceph-mon[37007]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:47.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:47 smithi047 ceph-mon[32551]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:48.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:48 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:48.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:48 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:48.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:48 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:48.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:48 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:48.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:48 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:48.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:48 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:48.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:48 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:48.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:48 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:48.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:48 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:49.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:49 smithi188 ceph-mon[37380]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:49.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:49 smithi047 ceph-mon[32551]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:49.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:49 smithi183 ceph-mon[37007]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:50.687 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:50.685+0000 7f9f44ff9640 1 -- 172.21.15.188:0/3256755267 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9f481092a0 con 0x7f9f300b3c20 2024-07-24T22:02:50.687 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 11 on host 'smithi188' 2024-07-24T22:02:50.689 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:50.687+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/3256755267 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9f300b3c20 msgr2=0x7f9f300b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:50.689 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:50.687+0000 7f9f4dcf0640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9f300b3c20 0x7f9f300b60e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f380058c0 tx=0x7f9f3800a2d0 comp rx=0 tx=0).stop 2024-07-24T22:02:50.689 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:50.687+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/3256755267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f481070a0 msgr2=0x7f9f48198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:50.689 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:50.687+0000 7f9f4dcf0640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f481070a0 0x7f9f48198070 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c005940 tx=0x7f9f3c0042f0 comp rx=0 tx=0).stop 2024-07-24T22:02:50.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:50.687+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/3256755267 shutdown_connections 2024-07-24T22:02:50.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:50.687+0000 7f9f4dcf0640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9f300b3c20 0x7f9f300b60e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:50.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:50.687+0000 7f9f4dcf0640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f48107a20 0x7f9f4819d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:50.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:50.687+0000 7f9f4dcf0640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f481070a0 0x7f9f48198070 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:50.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:50.687+0000 7f9f4dcf0640 1 --2- 172.21.15.188:0/3256755267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f48101690 0x7f9f48197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:50.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:50.687+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/3256755267 >> 172.21.15.188:0/3256755267 conn(0x7f9f480fd100 msgr2=0x7f9f480ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:02:50.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:50.687+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/3256755267 shutdown_connections 2024-07-24T22:02:50.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:02:50.687+0000 7f9f4dcf0640 1 -- 172.21.15.188:0/3256755267 wait complete. 2024-07-24T22:02:51.266 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:50 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.266 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:50 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.266 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:50 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:51.266 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:50 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:51.267 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:50 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.267 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:50 smithi188 ceph-mon[37380]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:51.267 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:50 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:51.267 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:50 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.267 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:50 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.294 DEBUG:teuthology.orchestra.run.smithi188:osd.11> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.11.service 2024-07-24T22:02:51.297 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-07-24T22:02:51.298 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd stat -f json 2024-07-24T22:02:51.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:50 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:50 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:50 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:51.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:50 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:51.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:50 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:50 smithi047 ceph-mon[32551]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:51.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:50 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:51.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:50 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:50 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:50 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:50 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:50 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:50 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:50 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:50 smithi183 ceph-mon[37007]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:50 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:02:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:50 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:50 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:51.531 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:02:51 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:02:51.343+0000 7fa8d1af4640 -1 osd.11 0 log_to_monitors true 2024-07-24T22:02:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:02:52.114 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:52 smithi188 ceph-mon[37380]: from='osd.11 [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-24T22:02:52.114 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:52 smithi188 ceph-mon[37380]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-24T22:02:52.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:52 smithi047 ceph-mon[32551]: from='osd.11 [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-24T22:02:52.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:52 smithi047 ceph-mon[32551]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-24T22:02:52.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:52 smithi183 ceph-mon[37007]: from='osd.11 [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-24T22:02:52.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:52 smithi183 ceph-mon[37007]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-24T22:02:53.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.214+0000 7fb7eebf7640 1 -- 172.21.15.47:0/3961702216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7e8103fc0 msgr2=0x7fb7e810c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:53.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.214+0000 7fb7eebf7640 1 --2- 172.21.15.47:0/3961702216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7e8103fc0 0x7fb7e810c4b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8009900 tx=0x7fb7d802a410 comp rx=0 tx=0).stop 2024-07-24T22:02:53.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.214+0000 7fb7eebf7640 1 -- 172.21.15.47:0/3961702216 shutdown_connections 2024-07-24T22:02:53.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.214+0000 7fb7eebf7640 1 --2- 172.21.15.47:0/3961702216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7e810cb00 0x7fb7e810ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:53.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.214+0000 7fb7eebf7640 1 --2- 172.21.15.47:0/3961702216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7e8103fc0 0x7fb7e810c4b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:53.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.214+0000 7fb7eebf7640 1 --2- 172.21.15.47:0/3961702216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7e81036a0 0x7fb7e8103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:53.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.214+0000 7fb7eebf7640 1 -- 172.21.15.47:0/3961702216 >> 172.21.15.47:0/3961702216 conn(0x7fb7e80fd100 msgr2=0x7fb7e80ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:02:53.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.214+0000 7fb7eebf7640 1 -- 172.21.15.47:0/3961702216 shutdown_connections 2024-07-24T22:02:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.214+0000 7fb7eebf7640 1 -- 172.21.15.47:0/3961702216 wait complete. 2024-07-24T22:02:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.214+0000 7fb7eebf7640 1 Processor -- start 2024-07-24T22:02:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7eebf7640 1 -- start start 2024-07-24T22:02:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7eebf7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7e81036a0 0x7fb7e8198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7eebf7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7e8103fc0 0x7fb7e8199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7eebf7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7e810cb00 0x7fb7e819e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7eebf7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e8112760 con 0x7fb7e810cb00 2024-07-24T22:02:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7eebf7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e81125e0 con 0x7fb7e81036a0 2024-07-24T22:02:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7eebf7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e81128e0 con 0x7fb7e8103fc0 2024-07-24T22:02:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7ed194640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7e810cb00 0x7fb7e819e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7ed194640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7e810cb00 0x7fb7e819e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43628/0 (socket says 172.21.15.47:43628) 2024-07-24T22:02:53.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7ed194640 1 -- 172.21.15.47:0/2302574637 learned_addr learned my addr 172.21.15.47:0/2302574637 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:02:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7dffff640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7e8103fc0 0x7fb7e8199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7ec993640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7e81036a0 0x7fb7e8198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7ed194640 1 -- 172.21.15.47:0/2302574637 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7e8103fc0 msgr2=0x7fb7e8199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7ed194640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7e8103fc0 0x7fb7e8199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7ed194640 1 -- 172.21.15.47:0/2302574637 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7e81036a0 msgr2=0x7fb7e8198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7ed194640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7e81036a0 0x7fb7e8198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7ed194640 1 -- 172.21.15.47:0/2302574637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e819ec80 con 0x7fb7e810cb00 2024-07-24T22:02:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.215+0000 7fb7ed194640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7e810cb00 0x7fb7e819e4b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000eb10 tx=0x7fb7e000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:02:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.216+0000 7fb7ddffb640 1 -- 172.21.15.47:0/2302574637 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000ce20 con 0x7fb7e810cb00 2024-07-24T22:02:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.216+0000 7fb7ddffb640 1 -- 172.21.15.47:0/2302574637 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7e0005020 con 0x7fb7e810cb00 2024-07-24T22:02:53.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.216+0000 7fb7eebf7640 1 -- 172.21.15.47:0/2302574637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e819ef70 con 0x7fb7e810cb00 2024-07-24T22:02:53.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.216+0000 7fb7ddffb640 1 -- 172.21.15.47:0/2302574637 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0010690 con 0x7fb7e810cb00 2024-07-24T22:02:53.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.216+0000 7fb7eebf7640 1 -- 172.21.15.47:0/2302574637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e81a5800 con 0x7fb7e810cb00 2024-07-24T22:02:53.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.217+0000 7fb7eebf7640 1 -- 172.21.15.47:0/2302574637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e8103a80 con 0x7fb7e810cb00 2024-07-24T22:02:53.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.218+0000 7fb7ddffb640 1 -- 172.21.15.47:0/2302574637 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fb7e0005510 con 0x7fb7e810cb00 2024-07-24T22:02:53.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.219+0000 7fb7ddffb640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb7d00b3ca0 0x7fb7d00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:53.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.219+0000 7fb7ec993640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb7d00b3ca0 0x7fb7d00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:53.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.219+0000 7fb7ddffb640 1 -- 172.21.15.47:0/2302574637 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7062+0+0 (secure 0 0 0) 0x7fb7e00e3e00 con 0x7fb7e810cb00 2024-07-24T22:02:53.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.219+0000 7fb7ec993640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb7d00b3ca0 0x7fb7d00b6160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400abe0 tx=0x7fb7e400a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:02:53.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.223+0000 7fb7ddffb640 1 -- 172.21.15.47:0/2302574637 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fb7e00ab930 con 0x7fb7e810cb00 2024-07-24T22:02:53.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:53 smithi188 ceph-mon[37380]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-07-24T22:02:53.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:53 smithi188 ceph-mon[37380]: osdmap e71: 12 total, 11 up, 12 in 2024-07-24T22:02:53.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:53 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:53.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:53 smithi188 ceph-mon[37380]: from='osd.11 [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:02:53.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:53 smithi188 ceph-mon[37380]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:02:53.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:53 smithi188 ceph-mon[37380]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:53.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:53 smithi183 ceph-mon[37007]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-07-24T22:02:53.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:53 smithi183 ceph-mon[37007]: osdmap e71: 12 total, 11 up, 12 in 2024-07-24T22:02:53.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:53 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:53.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:53 smithi183 ceph-mon[37007]: from='osd.11 [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:02:53.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:53 smithi183 ceph-mon[37007]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:02:53.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:53 smithi183 ceph-mon[37007]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:53.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.418+0000 7fb7eebf7640 1 -- 172.21.15.47:0/2302574637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb7e8107ae0 con 0x7fb7e810cb00 2024-07-24T22:02:53.420 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:53 smithi047 ceph-mon[32551]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-07-24T22:02:53.421 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:53 smithi047 ceph-mon[32551]: osdmap e71: 12 total, 11 up, 12 in 2024-07-24T22:02:53.421 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:53 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:53.421 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:53 smithi047 ceph-mon[32551]: from='osd.11 [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:02:53.421 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:53 smithi047 ceph-mon[32551]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-07-24T22:02:53.421 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:53 smithi047 ceph-mon[32551]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:53.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.419+0000 7fb7ddffb640 1 -- 172.21.15.47:0/2302574637 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fb7e00ab230 con 0x7fb7e810cb00 2024-07-24T22:02:53.421 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:02:53.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.422+0000 7fb7eebf7640 1 -- 172.21.15.47:0/2302574637 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb7d00b3ca0 msgr2=0x7fb7d00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.422+0000 7fb7eebf7640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb7d00b3ca0 0x7fb7d00b6160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400abe0 tx=0x7fb7e400a2d0 comp rx=0 tx=0).stop 2024-07-24T22:02:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.422+0000 7fb7eebf7640 1 -- 172.21.15.47:0/2302574637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7e810cb00 msgr2=0x7fb7e819e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.422+0000 7fb7eebf7640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7e810cb00 0x7fb7e819e4b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000eb10 tx=0x7fb7e000ef10 comp rx=0 tx=0).stop 2024-07-24T22:02:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.422+0000 7fb7eebf7640 1 -- 172.21.15.47:0/2302574637 shutdown_connections 2024-07-24T22:02:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.422+0000 7fb7eebf7640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb7d00b3ca0 0x7fb7d00b6160 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.422+0000 7fb7eebf7640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7e810cb00 0x7fb7e819e4b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.422+0000 7fb7eebf7640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7e8103fc0 0x7fb7e8199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.422+0000 7fb7eebf7640 1 --2- 172.21.15.47:0/2302574637 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7e81036a0 0x7fb7e8198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.422+0000 7fb7eebf7640 1 -- 172.21.15.47:0/2302574637 >> 172.21.15.47:0/2302574637 conn(0x7fb7e80fd100 msgr2=0x7fb7e80fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:02:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.422+0000 7fb7eebf7640 1 -- 172.21.15.47:0/2302574637 shutdown_connections 2024-07-24T22:02:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:53.422+0000 7fb7eebf7640 1 -- 172.21.15.47:0/2302574637 wait complete. 2024-07-24T22:02:53.996 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:02:53 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:02:53.914+0000 7fa8ce28b640 -1 osd.11 0 waiting for initial osdmap 2024-07-24T22:02:54.012 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1721858551,"num_in_osds":12,"osd_in_since":1721858555,"num_remapped_pgs":0} 2024-07-24T22:02:54.298 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:02:54 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:02:54.099+0000 7fa8c5896640 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T22:02:54.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:54 smithi188 ceph-mon[37380]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-07-24T22:02:54.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:54 smithi188 ceph-mon[37380]: osdmap e72: 12 total, 11 up, 12 in 2024-07-24T22:02:54.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:54 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:54.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:54 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:54.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:54 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2302574637' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-07-24T22:02:54.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:54 smithi188 ceph-mon[37380]: from='osd.11 ' entity='osd.11' 2024-07-24T22:02:54.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:54 smithi183 ceph-mon[37007]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-07-24T22:02:54.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:54 smithi183 ceph-mon[37007]: osdmap e72: 12 total, 11 up, 12 in 2024-07-24T22:02:54.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:54 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:54.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:54 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:54.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:54 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2302574637' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-07-24T22:02:54.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:54 smithi183 ceph-mon[37007]: from='osd.11 ' entity='osd.11' 2024-07-24T22:02:54.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:54 smithi047 ceph-mon[32551]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-07-24T22:02:54.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:54 smithi047 ceph-mon[32551]: osdmap e72: 12 total, 11 up, 12 in 2024-07-24T22:02:54.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:54 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:54.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:54 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:54.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:54 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2302574637' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-07-24T22:02:54.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:54 smithi047 ceph-mon[32551]: from='osd.11 ' entity='osd.11' 2024-07-24T22:02:55.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd stat -f json 2024-07-24T22:02:55.282 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:02:55.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: purged_snaps scrub starts 2024-07-24T22:02:55.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: purged_snaps scrub ok 2024-07-24T22:02:55.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:55.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: Detected new or changed devices on smithi188 2024-07-24T22:02:55.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:55.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:55.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:55.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:55.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:55.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:55.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi188 to 4272M 2024-07-24T22:02:55.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:55.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:55.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:55.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:55.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:55 smithi188 ceph-mon[37380]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:55.392 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: purged_snaps scrub starts 2024-07-24T22:02:55.392 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: purged_snaps scrub ok 2024-07-24T22:02:55.392 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:55.392 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: Detected new or changed devices on smithi188 2024-07-24T22:02:55.392 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:55.392 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:55.392 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:55.393 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:55.393 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:55.393 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:55.393 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi188 to 4272M 2024-07-24T22:02:55.393 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:55.393 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:55.393 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:55.393 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:55.393 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:55 smithi047 ceph-mon[32551]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:55.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: purged_snaps scrub starts 2024-07-24T22:02:55.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: purged_snaps scrub ok 2024-07-24T22:02:55.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:55.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: Detected new or changed devices on smithi188 2024-07-24T22:02:55.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:55.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:55.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:55.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:55.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:55.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:02:55.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi188 to 4272M 2024-07-24T22:02:55.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:55.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:02:55.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:02:55.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:02:55.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:55 smithi183 ceph-mon[37007]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-24T22:02:56.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:56 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:56.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:56 smithi188 ceph-mon[37380]: osd.11 [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101] boot 2024-07-24T22:02:56.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:56 smithi188 ceph-mon[37380]: osdmap e73: 12 total, 12 up, 12 in 2024-07-24T22:02:56.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:56 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:56.331 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:56 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:56.331 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:56 smithi047 ceph-mon[32551]: osd.11 [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101] boot 2024-07-24T22:02:56.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:56 smithi047 ceph-mon[32551]: osdmap e73: 12 total, 12 up, 12 in 2024-07-24T22:02:56.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:56 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:56.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:56 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:56.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:56 smithi183 ceph-mon[37007]: osd.11 [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101] boot 2024-07-24T22:02:56.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:56 smithi183 ceph-mon[37007]: osdmap e73: 12 total, 12 up, 12 in 2024-07-24T22:02:56.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:56 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-24T22:02:56.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.802+0000 7fdad7826640 1 -- 172.21.15.47:0/2045007512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdad0103ed0 msgr2=0x7fdad010c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:56.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.802+0000 7fdad7826640 1 --2- 172.21.15.47:0/2045007512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdad0103ed0 0x7fdad010c4b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009900 tx=0x7fdac402a410 comp rx=0 tx=0).stop 2024-07-24T22:02:56.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.802+0000 7fdad7826640 1 -- 172.21.15.47:0/2045007512 shutdown_connections 2024-07-24T22:02:56.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.802+0000 7fdad7826640 1 --2- 172.21.15.47:0/2045007512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdad010ca80 0x7fdad010ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:56.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.802+0000 7fdad7826640 1 --2- 172.21.15.47:0/2045007512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdad0103ed0 0x7fdad010c4b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:56.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.802+0000 7fdad7826640 1 --2- 172.21.15.47:0/2045007512 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdad01034d0 0x7fdad01038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:56.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.802+0000 7fdad7826640 1 -- 172.21.15.47:0/2045007512 >> 172.21.15.47:0/2045007512 conn(0x7fdad00fd0c0 msgr2=0x7fdad00ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:02:56.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.802+0000 7fdad7826640 1 -- 172.21.15.47:0/2045007512 shutdown_connections 2024-07-24T22:02:56.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.802+0000 7fdad7826640 1 -- 172.21.15.47:0/2045007512 wait complete. 2024-07-24T22:02:56.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad7826640 1 Processor -- start 2024-07-24T22:02:56.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad7826640 1 -- start start 2024-07-24T22:02:56.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad7826640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdad01034d0 0x7fdad0101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:56.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad7826640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdad0103ed0 0x7fdad0101890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:56.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad7826640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdad010ca80 0x7fdad0101dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:56.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad7826640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdad0112730 con 0x7fdad010ca80 2024-07-24T22:02:56.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad7826640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdad01125b0 con 0x7fdad01034d0 2024-07-24T22:02:56.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad7826640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdad01128b0 con 0x7fdad0103ed0 2024-07-24T22:02:56.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad5dc3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdad010ca80 0x7fdad0101dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:56.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad5dc3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdad010ca80 0x7fdad0101dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57200/0 (socket says 172.21.15.47:57200) 2024-07-24T22:02:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad5dc3640 1 -- 172.21.15.47:0/3188610862 learned_addr learned my addr 172.21.15.47:0/3188610862 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:02:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad4dc1640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdad0103ed0 0x7fdad0101890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad55c2640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdad01034d0 0x7fdad0101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad5dc3640 1 -- 172.21.15.47:0/3188610862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdad0103ed0 msgr2=0x7fdad0101890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad5dc3640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdad0103ed0 0x7fdad0101890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad5dc3640 1 -- 172.21.15.47:0/3188610862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdad01034d0 msgr2=0x7fdad0101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad5dc3640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdad01034d0 0x7fdad0101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad5dc3640 1 -- 172.21.15.47:0/3188610862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad01a7030 con 0x7fdad010ca80 2024-07-24T22:02:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.803+0000 7fdad55c2640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdad01034d0 0x7fdad0101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:02:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.804+0000 7fdad5dc3640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdad010ca80 0x7fdad0101dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdac000eb10 tx=0x7fdac000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:02:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.804+0000 7fdace7fc640 1 -- 172.21.15.47:0/3188610862 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0004b20 con 0x7fdad010ca80 2024-07-24T22:02:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.804+0000 7fdace7fc640 1 -- 172.21.15.47:0/3188610862 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdac0004cc0 con 0x7fdad010ca80 2024-07-24T22:02:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.804+0000 7fdace7fc640 1 -- 172.21.15.47:0/3188610862 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0010670 con 0x7fdad010ca80 2024-07-24T22:02:56.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.804+0000 7fdad7826640 1 -- 172.21.15.47:0/3188610862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad01a7320 con 0x7fdad010ca80 2024-07-24T22:02:56.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.804+0000 7fdad7826640 1 -- 172.21.15.47:0/3188610862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad01a77e0 con 0x7fdad010ca80 2024-07-24T22:02:56.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.805+0000 7fdad7826640 1 -- 172.21.15.47:0/3188610862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdad01038b0 con 0x7fdad010ca80 2024-07-24T22:02:56.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.806+0000 7fdace7fc640 1 -- 172.21.15.47:0/3188610862 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fdac0005000 con 0x7fdad010ca80 2024-07-24T22:02:56.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.807+0000 7fdace7fc640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdab80b3c20 0x7fdab80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:56.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.807+0000 7fdad55c2640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdab80b3c20 0x7fdab80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:56.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.807+0000 7fdace7fc640 1 -- 172.21.15.47:0/3188610862 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7fdac00e4040 con 0x7fdad010ca80 2024-07-24T22:02:56.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.807+0000 7fdad55c2640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdab80b3c20 0x7fdab80b60e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdac8005d00 tx=0x7fdac8005c70 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:02:56.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:56.810+0000 7fdace7fc640 1 -- 172.21.15.47:0/3188610862 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fdac00555e0 con 0x7fdad010ca80 2024-07-24T22:02:57.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.004+0000 7fdad7826640 1 -- 172.21.15.47:0/3188610862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fdad0107560 con 0x7fdad010ca80 2024-07-24T22:02:57.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.005+0000 7fdace7fc640 1 -- 172.21.15.47:0/3188610862 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7fdac00aba60 con 0x7fdad010ca80 2024-07-24T22:02:57.007 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:02:57.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.007+0000 7fdad7826640 1 -- 172.21.15.47:0/3188610862 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdab80b3c20 msgr2=0x7fdab80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:57.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.007+0000 7fdad7826640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdab80b3c20 0x7fdab80b60e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdac8005d00 tx=0x7fdac8005c70 comp rx=0 tx=0).stop 2024-07-24T22:02:57.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.007+0000 7fdad7826640 1 -- 172.21.15.47:0/3188610862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdad010ca80 msgr2=0x7fdad0101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:57.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.007+0000 7fdad7826640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdad010ca80 0x7fdad0101dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdac000eb10 tx=0x7fdac000c2d0 comp rx=0 tx=0).stop 2024-07-24T22:02:57.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.007+0000 7fdad7826640 1 -- 172.21.15.47:0/3188610862 shutdown_connections 2024-07-24T22:02:57.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.007+0000 7fdad7826640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdab80b3c20 0x7fdab80b60e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:57.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.007+0000 7fdad7826640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdad010ca80 0x7fdad0101dd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:57.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.007+0000 7fdad7826640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdad0103ed0 0x7fdad0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:57.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.007+0000 7fdad7826640 1 --2- 172.21.15.47:0/3188610862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdad01034d0 0x7fdad0101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:57.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.007+0000 7fdad7826640 1 -- 172.21.15.47:0/3188610862 >> 172.21.15.47:0/3188610862 conn(0x7fdad00fd0c0 msgr2=0x7fdad00fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:02:57.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.007+0000 7fdad7826640 1 -- 172.21.15.47:0/3188610862 shutdown_connections 2024-07-24T22:02:57.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:57.007+0000 7fdad7826640 1 -- 172.21.15.47:0/3188610862 wait complete. 2024-07-24T22:02:57.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:57 smithi183 ceph-mon[37007]: osdmap e74: 12 total, 12 up, 12 in 2024-07-24T22:02:57.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:57 smithi183 ceph-mon[37007]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:02:57.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:57 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3188610862' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-07-24T22:02:57.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:57 smithi047 ceph-mon[32551]: osdmap e74: 12 total, 12 up, 12 in 2024-07-24T22:02:57.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:57 smithi047 ceph-mon[32551]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:02:57.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:57 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3188610862' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-07-24T22:02:57.509 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1721858575,"num_in_osds":12,"osd_in_since":1721858555,"num_remapped_pgs":0} 2024-07-24T22:02:57.510 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd dump --format=json 2024-07-24T22:02:57.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:57 smithi188 ceph-mon[37380]: osdmap e74: 12 total, 12 up, 12 in 2024-07-24T22:02:57.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:57 smithi188 ceph-mon[37380]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:02:57.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:57 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3188610862' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-07-24T22:02:57.772 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:02:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.305+0000 7f460ffa9640 1 -- 172.21.15.47:0/2331523143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4608101db0 msgr2=0x7f4608106280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.305+0000 7f460ffa9640 1 --2- 172.21.15.47:0/2331523143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4608101db0 0x7f4608106280 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009900 tx=0x7f45f802a410 comp rx=0 tx=0).stop 2024-07-24T22:02:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.305+0000 7f460ffa9640 1 -- 172.21.15.47:0/2331523143 shutdown_connections 2024-07-24T22:02:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.305+0000 7f460ffa9640 1 --2- 172.21.15.47:0/2331523143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46081068d0 0x7f4608106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.305+0000 7f460ffa9640 1 --2- 172.21.15.47:0/2331523143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4608101db0 0x7f4608106280 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.305+0000 7f460ffa9640 1 --2- 172.21.15.47:0/2331523143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4608101490 0x7f4608101870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.305+0000 7f460ffa9640 1 -- 172.21.15.47:0/2331523143 >> 172.21.15.47:0/2331523143 conn(0x7f46080fd100 msgr2=0x7f46080ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:02:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.305+0000 7f460ffa9640 1 -- 172.21.15.47:0/2331523143 shutdown_connections 2024-07-24T22:02:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.305+0000 7f460ffa9640 1 -- 172.21.15.47:0/2331523143 wait complete. 2024-07-24T22:02:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.306+0000 7f460ffa9640 1 Processor -- start 2024-07-24T22:02:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.306+0000 7f460ffa9640 1 -- start start 2024-07-24T22:02:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.306+0000 7f460ffa9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4608101490 0x7f460819f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.306+0000 7f460ffa9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4608101db0 0x7f460819f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.306+0000 7f460ffa9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46081068d0 0x7f46081a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.306+0000 7f460ffa9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4608118e00 con 0x7f46081068d0 2024-07-24T22:02:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.306+0000 7f460ffa9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4608118c80 con 0x7f4608101db0 2024-07-24T22:02:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.306+0000 7f460ffa9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4608118f80 con 0x7f4608101490 2024-07-24T22:02:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460e546640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46081068d0 0x7f46081a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460e546640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46081068d0 0x7f46081a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57232/0 (socket says 172.21.15.47:57232) 2024-07-24T22:02:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460e546640 1 -- 172.21.15.47:0/296480734 learned_addr learned my addr 172.21.15.47:0/296480734 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:02:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460d544640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4608101db0 0x7f460819f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460dd45640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4608101490 0x7f460819f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460e546640 1 -- 172.21.15.47:0/296480734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4608101490 msgr2=0x7f460819f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460e546640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4608101490 0x7f460819f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460e546640 1 -- 172.21.15.47:0/296480734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4608101db0 msgr2=0x7f460819f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460e546640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4608101db0 0x7f460819f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460e546640 1 -- 172.21.15.47:0/296480734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46081a5390 con 0x7f46081068d0 2024-07-24T22:02:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460dd45640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4608101490 0x7f460819f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:02:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460e546640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46081068d0 0x7f46081a4bc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f460000eaa0 tx=0x7f460000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:02:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f45feffd640 1 -- 172.21.15.47:0/296480734 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460000cdb0 con 0x7f46081068d0 2024-07-24T22:02:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460ffa9640 1 -- 172.21.15.47:0/296480734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46081a5680 con 0x7f46081068d0 2024-07-24T22:02:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f45feffd640 1 -- 172.21.15.47:0/296480734 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4600005020 con 0x7f46081068d0 2024-07-24T22:02:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f45feffd640 1 -- 172.21.15.47:0/296480734 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46000116d0 con 0x7f46081068d0 2024-07-24T22:02:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.307+0000 7f460ffa9640 1 -- 172.21.15.47:0/296480734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46081abdc0 con 0x7f46081068d0 2024-07-24T22:02:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.308+0000 7f460ffa9640 1 -- 172.21.15.47:0/296480734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4608106280 con 0x7f46081068d0 2024-07-24T22:02:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.310+0000 7f45feffd640 1 -- 172.21.15.47:0/296480734 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f46000051d0 con 0x7f46081068d0 2024-07-24T22:02:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.310+0000 7f45feffd640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f45f40b3c20 0x7f45f40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:02:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.311+0000 7f460dd45640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f45f40b3c20 0x7f45f40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:02:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.311+0000 7f45feffd640 1 -- 172.21.15.47:0/296480734 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7f46000e3e10 con 0x7f46081068d0 2024-07-24T22:02:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.311+0000 7f460dd45640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f45f40b3c20 0x7f45f40b60e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4604006fd0 tx=0x7f4604008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:02:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.313+0000 7f45feffd640 1 -- 172.21.15.47:0/296480734 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f4600016030 con 0x7f46081068d0 2024-07-24T22:02:59.351 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:02:59 smithi047 ceph-mon[32551]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:02:59.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:02:59 smithi183 ceph-mon[37007]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:02:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.509+0000 7f460ffa9640 1 -- 172.21.15.47:0/296480734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46081ac0e0 con 0x7f46081068d0 2024-07-24T22:02:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.510+0000 7f45feffd640 1 -- 172.21.15.47:0/296480734 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+18784 (secure 0 0 0) 0x7f46000ab830 con 0x7f46081068d0 2024-07-24T22:02:59.512 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:02:59.512 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":74,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","created":"2024-07-24T21:55:28.945912+0000","modified":"2024-07-24T22:02:56.048784+0000","last_up_change":"2024-07-24T22:02:55.044691+0000","last_in_change":"2024-07-24T22:02:35.671256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T21:59:32.066678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60de2c3d-e4b7-4878-bdbb-ce3257e3706c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6803","nonce":2665889913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6805","nonce":2665889913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6809","nonce":2665889913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6807","nonce":2665889913}]},"public_addr":"172.21.15.47:6803/2665889913","cluster_addr":"172.21.15.47:6805/2665889913","heartbeat_back_addr":"172.21.15.47:6809/2665889913","heartbeat_front_addr":"172.21.15.47:6807/2665889913","state":["exists","up"]},{"osd":1,"uuid":"7f086675-3bed-47ca-a93f-fab9580068b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6801","nonce":3486494228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6803","nonce":3486494228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6807","nonce":3486494228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6805","nonce":3486494228}]},"public_addr":"172.21.15.183:6801/3486494228","cluster_addr":"172.21.15.183:6803/3486494228","heartbeat_back_addr":"172.21.15.183:6807/3486494228","heartbeat_front_addr":"172.21.15.183:6805/3486494228","state":["exists","up"]},{"osd":2,"uuid":"040fff27-6fa6-48de-9365-fcced8f89e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6801","nonce":2245903281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6803","nonce":2245903281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6807","nonce":2245903281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6805","nonce":2245903281}]},"public_addr":"172.21.15.188:6801/2245903281","cluster_addr":"172.21.15.188:6803/2245903281","heartbeat_back_addr":"172.21.15.188:6807/2245903281","heartbeat_front_addr":"172.21.15.188:6805/2245903281","state":["exists","up"]},{"osd":3,"uuid":"e129321a-9566-4bea-b982-34f7ddd1ae1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6811","nonce":236749130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6813","nonce":236749130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6817","nonce":236749130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6815","nonce":236749130}]},"public_addr":"172.21.15.47:6811/236749130","cluster_addr":"172.21.15.47:6813/236749130","heartbeat_back_addr":"172.21.15.47:6817/236749130","heartbeat_front_addr":"172.21.15.47:6815/236749130","state":["exists","up"]},{"osd":4,"uuid":"f969fba7-b0ff-4ea6-83bd-38aba32b1be1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6809","nonce":3978122107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6811","nonce":3978122107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6815","nonce":3978122107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6813","nonce":3978122107}]},"public_addr":"172.21.15.183:6809/3978122107","cluster_addr":"172.21.15.183:6811/3978122107","heartbeat_back_addr":"172.21.15.183:6815/3978122107","heartbeat_front_addr":"172.21.15.183:6813/3978122107","state":["exists","up"]},{"osd":5,"uuid":"3799c912-3d9f-4efd-9b36-569c385e4c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6809","nonce":2097128083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6811","nonce":2097128083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6815","nonce":2097128083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6813","nonce":2097128083}]},"public_addr":"172.21.15.188:6809/2097128083","cluster_addr":"172.21.15.188:6811/2097128083","heartbeat_back_addr":"172.21.15.188:6815/2097128083","heartbeat_front_addr":"172.21.15.188:6813/2097128083","state":["exists","up"]},{"osd":6,"uuid":"1a38cf12-619f-4e82-a7a5-21ee2014038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6819","nonce":2288252980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6821","nonce":2288252980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6825","nonce":2288252980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6823","nonce":2288252980}]},"public_addr":"172.21.15.47:6819/2288252980","cluster_addr":"172.21.15.47:6821/2288252980","heartbeat_back_addr":"172.21.15.47:6825/2288252980","heartbeat_front_addr":"172.21.15.47:6823/2288252980","state":["exists","up"]},{"osd":7,"uuid":"6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6817","nonce":465426514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6819","nonce":465426514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6823","nonce":465426514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6821","nonce":465426514}]},"public_addr":"172.21.15.183:6817/465426514","cluster_addr":"172.21.15.183:6819/465426514","heartbeat_back_addr":"172.21.15.183:6823/465426514","heartbeat_front_addr":"172.21.15.183:6821/465426514","state":["exists","up"]},{"osd":8,"uuid":"6dfd7252-61a6-423d-8498-cbcfa41ae1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6817","nonce":2247055658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6819","nonce":2247055658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6823","nonce":2247055658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6821","nonce":2247055658}]},"public_addr":"172.21.15.188:6817/2247055658","cluster_addr":"172.21.15.188:6819/2247055658","heartbeat_back_addr":"172.21.15.188:6823/2247055658","heartbeat_front_addr":"172.21.15.188:6821/2247055658","state":["exists","up"]},{"osd":9,"uuid":"abd93c5e-283e-4873-a241-1056f2894116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6827","nonce":2628721884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6829","nonce":2628721884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6833","nonce":2628721884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6831","nonce":2628721884}]},"public_addr":"172.21.15.47:6827/2628721884","cluster_addr":"172.21.15.47:6829/2628721884","heartbeat_back_addr":"172.21.15.47:6833/2628721884","heartbeat_front_addr":"172.21.15.47:6831/2628721884","state":["exists","up"]},{"osd":10,"uuid":"bc967f8f-ce27-4230-be70-e36927f89fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6825","nonce":3509332199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6827","nonce":3509332199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6831","nonce":3509332199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6829","nonce":3509332199}]},"public_addr":"172.21.15.183:6825/3509332199","cluster_addr":"172.21.15.183:6827/3509332199","heartbeat_back_addr":"172.21.15.183:6831/3509332199","heartbeat_front_addr":"172.21.15.183:6829/3509332199","state":["exists","up"]},{"osd":11,"uuid":"8b379865-3a5c-4a2d-aa74-a4f215027fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6825","nonce":3725107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6827","nonce":3725107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6831","nonce":3725107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6829","nonce":3725107101}]},"public_addr":"172.21.15.188:6825/3725107101","cluster_addr":"172.21.15.188:6827/3725107101","heartbeat_back_addr":"172.21.15.188:6831/3725107101","heartbeat_front_addr":"172.21.15.188:6829/3725107101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:58:44.413660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:06.554842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:28.651418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:50.995466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:13.906535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:36.632662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:59.003224+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:21.701327+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:44.017943+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:06.400895+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:29.625920+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:52.323223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3499235566":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/2112533111":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/2714360830":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/507334607":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6800/2524786594":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/1004458106":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6800/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/1046677443":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/899235864":"2024-07-25T21:56:15.044564+0000","172.21.15.47:6800/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/3057769442":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/2596054312":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6801/2524786594":"2024-07-25T21:57:25.995502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T22:02:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.512+0000 7f460ffa9640 1 -- 172.21.15.47:0/296480734 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f45f40b3c20 msgr2=0x7f45f40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.512+0000 7f460ffa9640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f45f40b3c20 0x7f45f40b60e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4604006fd0 tx=0x7f4604008040 comp rx=0 tx=0).stop 2024-07-24T22:02:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.512+0000 7f460ffa9640 1 -- 172.21.15.47:0/296480734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46081068d0 msgr2=0x7f46081a4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:02:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.512+0000 7f460ffa9640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46081068d0 0x7f46081a4bc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f460000eaa0 tx=0x7f460000ef60 comp rx=0 tx=0).stop 2024-07-24T22:02:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.512+0000 7f460ffa9640 1 -- 172.21.15.47:0/296480734 shutdown_connections 2024-07-24T22:02:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.512+0000 7f460ffa9640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f45f40b3c20 0x7f45f40b60e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.512+0000 7f460ffa9640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46081068d0 0x7f46081a4bc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.512+0000 7f460ffa9640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4608101db0 0x7f460819f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.512+0000 7f460ffa9640 1 --2- 172.21.15.47:0/296480734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4608101490 0x7f460819f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:02:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.513+0000 7f460ffa9640 1 -- 172.21.15.47:0/296480734 >> 172.21.15.47:0/296480734 conn(0x7f46080fd100 msgr2=0x7f4608104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:02:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.513+0000 7f460ffa9640 1 -- 172.21.15.47:0/296480734 shutdown_connections 2024-07-24T22:02:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:02:59.513+0000 7f460ffa9640 1 -- 172.21.15.47:0/296480734 wait complete. 2024-07-24T22:02:59.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:02:59 smithi188 ceph-mon[37380]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:00.203 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-24T21:59:32.066678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-07-24T22:03:00.203 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-07-24T22:03:00.409 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:00 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/296480734' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:03:00.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:00 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/296480734' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:03:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:00.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:00 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/296480734' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:03:01.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:01 smithi183 ceph-mon[37007]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:01.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:01 smithi047 ceph-mon[32551]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:01.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:01 smithi188 ceph-mon[37380]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:01.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.962+0000 7f5959a25640 1 -- 172.21.15.47:0/1611756169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5954103570 msgr2=0x7f5954103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:01.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.962+0000 7f5959a25640 1 --2- 172.21.15.47:0/1611756169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5954103570 0x7f5954103950 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5944009900 tx=0x7f594402a410 comp rx=0 tx=0).stop 2024-07-24T22:03:01.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.962+0000 7f5959a25640 1 -- 172.21.15.47:0/1611756169 shutdown_connections 2024-07-24T22:03:01.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.962+0000 7f5959a25640 1 --2- 172.21.15.47:0/1611756169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f595410cb20 0x7f595410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:01.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.962+0000 7f5959a25640 1 --2- 172.21.15.47:0/1611756169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5954103f70 0x7f595410c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.962+0000 7f5959a25640 1 --2- 172.21.15.47:0/1611756169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5954103570 0x7f5954103950 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.962+0000 7f5959a25640 1 -- 172.21.15.47:0/1611756169 >> 172.21.15.47:0/1611756169 conn(0x7f59540fd100 msgr2=0x7f59540ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.962+0000 7f5959a25640 1 -- 172.21.15.47:0/1611756169 shutdown_connections 2024-07-24T22:03:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.962+0000 7f5959a25640 1 -- 172.21.15.47:0/1611756169 wait complete. 2024-07-24T22:03:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.963+0000 7f5959a25640 1 Processor -- start 2024-07-24T22:03:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.963+0000 7f5959a25640 1 -- start start 2024-07-24T22:03:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.963+0000 7f5959a25640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5954103570 0x7f5954198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.963+0000 7f5959a25640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5954103f70 0x7f5954199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.963+0000 7f5959a25640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f595410cb20 0x7f595419e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.963+0000 7f5959a25640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f59541127d0 con 0x7f5954103f70 2024-07-24T22:03:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.963+0000 7f5959a25640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5954112650 con 0x7f595410cb20 2024-07-24T22:03:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.963+0000 7f5959a25640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5954112950 con 0x7f5954103570 2024-07-24T22:03:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.963+0000 7f594bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5954103f70 0x7f5954199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.963+0000 7f594bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5954103f70 0x7f5954199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57258/0 (socket says 172.21.15.47:57258) 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.963+0000 7f594bfff640 1 -- 172.21.15.47:0/256984531 learned_addr learned my addr 172.21.15.47:0/256984531 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.963+0000 7f5952ffd640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5954103570 0x7f5954198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.964+0000 7f59537fe640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f595410cb20 0x7f595419e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.964+0000 7f594bfff640 1 -- 172.21.15.47:0/256984531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5954103570 msgr2=0x7f5954198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.964+0000 7f594bfff640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5954103570 0x7f5954198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.964+0000 7f594bfff640 1 -- 172.21.15.47:0/256984531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f595410cb20 msgr2=0x7f595419e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.964+0000 7f594bfff640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f595410cb20 0x7f595419e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.964+0000 7f594bfff640 1 -- 172.21.15.47:0/256984531 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595419edd0 con 0x7f5954103f70 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.964+0000 7f59537fe640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f595410cb20 0x7f595419e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.964+0000 7f594bfff640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5954103f70 0x7f5954199260 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f593c00b4a0 tx=0x7f593c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.964+0000 7f5958a23640 1 -- 172.21.15.47:0/256984531 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c014070 con 0x7f5954103f70 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.964+0000 7f5958a23640 1 -- 172.21.15.47:0/256984531 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f593c010ac0 con 0x7f5954103f70 2024-07-24T22:03:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.964+0000 7f5959a25640 1 -- 172.21.15.47:0/256984531 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595419f0c0 con 0x7f5954103f70 2024-07-24T22:03:01.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.964+0000 7f5958a23640 1 -- 172.21.15.47:0/256984531 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c017c30 con 0x7f5954103f70 2024-07-24T22:03:01.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.964+0000 7f5959a25640 1 -- 172.21.15.47:0/256984531 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59541a5800 con 0x7f5954103f70 2024-07-24T22:03:01.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.965+0000 7f5959a25640 1 -- 172.21.15.47:0/256984531 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5954103950 con 0x7f5954103f70 2024-07-24T22:03:01.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.967+0000 7f5958a23640 1 -- 172.21.15.47:0/256984531 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f593c017070 con 0x7f5954103f70 2024-07-24T22:03:01.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.967+0000 7f5958a23640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f59400b3c20 0x7f59400b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:01.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.968+0000 7f5952ffd640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f59400b3c20 0x7f59400b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:01.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.968+0000 7f5958a23640 1 -- 172.21.15.47:0/256984531 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7f593c0e2f70 con 0x7f5954103f70 2024-07-24T22:03:01.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.968+0000 7f5952ffd640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f59400b3c20 0x7f59400b60e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5944031440 tx=0x7f5944005b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:01.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:01.970+0000 7f5958a23640 1 -- 172.21.15.47:0/256984531 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f593c0aa990 con 0x7f5954103f70 2024-07-24T22:03:02.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.167+0000 7f5959a25640 1 -- 172.21.15.47:0/256984531 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f595402e000 con 0x7f5954103f70 2024-07-24T22:03:02.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.168+0000 7f5958a23640 1 -- 172.21.15.47:0/256984531 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f593c0aa290 con 0x7f5954103f70 2024-07-24T22:03:02.171 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-07-24T22:03:02.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.170+0000 7f5959a25640 1 -- 172.21.15.47:0/256984531 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f59400b3c20 msgr2=0x7f59400b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:02.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.170+0000 7f5959a25640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f59400b3c20 0x7f59400b60e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5944031440 tx=0x7f5944005b50 comp rx=0 tx=0).stop 2024-07-24T22:03:02.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.170+0000 7f5959a25640 1 -- 172.21.15.47:0/256984531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5954103f70 msgr2=0x7f5954199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:02.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.170+0000 7f5959a25640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5954103f70 0x7f5954199260 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f593c00b4a0 tx=0x7f593c00b960 comp rx=0 tx=0).stop 2024-07-24T22:03:02.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.170+0000 7f5959a25640 1 -- 172.21.15.47:0/256984531 shutdown_connections 2024-07-24T22:03:02.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.170+0000 7f5959a25640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f59400b3c20 0x7f59400b60e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:02.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.170+0000 7f5959a25640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f595410cb20 0x7f595419e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:02.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.170+0000 7f5959a25640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5954103f70 0x7f5954199260 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:02.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.170+0000 7f5959a25640 1 --2- 172.21.15.47:0/256984531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5954103570 0x7f5954198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:02.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.170+0000 7f5959a25640 1 -- 172.21.15.47:0/256984531 >> 172.21.15.47:0/256984531 conn(0x7f59540fd100 msgr2=0x7f59540fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:02.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.170+0000 7f5959a25640 1 -- 172.21.15.47:0/256984531 shutdown_connections 2024-07-24T22:03:02.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:02.170+0000 7f5959a25640 1 -- 172.21.15.47:0/256984531 wait complete. 2024-07-24T22:03:02.786 INFO:tasks.cephadm:Adding mds.a on smithi047 2024-07-24T22:03:02.786 INFO:tasks.cephadm:Adding mds.d on smithi047 2024-07-24T22:03:02.786 INFO:tasks.cephadm:Adding mds.g on smithi047 2024-07-24T22:03:02.786 INFO:tasks.cephadm:Adding mds.j on smithi047 2024-07-24T22:03:02.786 INFO:tasks.cephadm:Adding mds.b on smithi183 2024-07-24T22:03:02.787 INFO:tasks.cephadm:Adding mds.e on smithi183 2024-07-24T22:03:02.787 INFO:tasks.cephadm:Adding mds.h on smithi183 2024-07-24T22:03:02.787 INFO:tasks.cephadm:Adding mds.k on smithi183 2024-07-24T22:03:02.787 INFO:tasks.cephadm:Adding mds.c on smithi188 2024-07-24T22:03:02.787 INFO:tasks.cephadm:Adding mds.f on smithi188 2024-07-24T22:03:02.787 INFO:tasks.cephadm:Adding mds.i on smithi188 2024-07-24T22:03:02.787 INFO:tasks.cephadm:Adding mds.l on smithi188 2024-07-24T22:03:02.787 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph orch apply mds all '12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi183=b;smithi183=e;smithi183=h;smithi183=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l' 2024-07-24T22:03:03.051 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T22:03:03.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:03 smithi183 ceph-mon[37007]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:03.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:03 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/256984531' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-24T22:03:03.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:03 smithi047 ceph-mon[32551]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:03.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:03 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/256984531' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-24T22:03:03.448 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:03 smithi188 ceph-mon[37380]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:03.448 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:03 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/256984531' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-24T22:03:04.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.535+0000 7f088c0e9640 1 -- 172.21.15.188:0/405863967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0884101b40 msgr2=0x7f0884106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:04.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.535+0000 7f088c0e9640 1 --2- 172.21.15.188:0/405863967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0884101b40 0x7f0884106d30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f087c009ca0 tx=0x7f087c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:03:04.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.535+0000 7f088c0e9640 1 -- 172.21.15.188:0/405863967 shutdown_connections 2024-07-24T22:03:04.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.535+0000 7f088c0e9640 1 --2- 172.21.15.188:0/405863967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0884101b40 0x7f0884106d30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:04.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.535+0000 7f088c0e9640 1 --2- 172.21.15.188:0/405863967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0884101700 0x7f08841067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:04.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.535+0000 7f088c0e9640 1 --2- 172.21.15.188:0/405863967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f088406a640 0x7f08841011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:04.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.535+0000 7f088c0e9640 1 -- 172.21.15.188:0/405863967 >> 172.21.15.188:0/405863967 conn(0x7f0884076980 msgr2=0x7f0884076d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:04.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.535+0000 7f088c0e9640 1 -- 172.21.15.188:0/405863967 shutdown_connections 2024-07-24T22:03:04.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.535+0000 7f088c0e9640 1 -- 172.21.15.188:0/405863967 wait complete. 2024-07-24T22:03:04.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.536+0000 7f088c0e9640 1 Processor -- start 2024-07-24T22:03:04.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.536+0000 7f088c0e9640 1 -- start start 2024-07-24T22:03:04.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.536+0000 7f088c0e9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f088406a640 0x7f0884198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:04.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.536+0000 7f088c0e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0884101700 0x7f0884199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:04.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.536+0000 7f088c0e9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0884101b40 0x7f088419e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:04.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.536+0000 7f088c0e9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0884111630 con 0x7f0884101b40 2024-07-24T22:03:04.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.536+0000 7f088c0e9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f08841114b0 con 0x7f088406a640 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.536+0000 7f088c0e9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f08841117b0 con 0x7f0884101700 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.536+0000 7f0889684640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0884101700 0x7f0884199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.536+0000 7f0889684640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0884101700 0x7f0884199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:60448/0 (socket says 172.21.15.188:60448) 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.536+0000 7f0889684640 1 -- 172.21.15.188:0/3002610223 learned_addr learned my addr 172.21.15.188:0/3002610223 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.536+0000 7f0889e85640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f088406a640 0x7f0884198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.536+0000 7f088a686640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0884101b40 0x7f088419e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.537+0000 7f0889684640 1 -- 172.21.15.188:0/3002610223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f088406a640 msgr2=0x7f0884198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.537+0000 7f0889684640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f088406a640 0x7f0884198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.537+0000 7f0889684640 1 -- 172.21.15.188:0/3002610223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0884101b40 msgr2=0x7f088419e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.537+0000 7f0889684640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0884101b40 0x7f088419e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.537+0000 7f0889684640 1 -- 172.21.15.188:0/3002610223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088419ecd0 con 0x7f0884101700 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.537+0000 7f0889e85640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f088406a640 0x7f0884198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.537+0000 7f0889684640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0884101700 0x7f0884199160 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f087400d770 tx=0x7f087400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:04.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.537+0000 7f087affd640 1 -- 172.21.15.188:0/3002610223 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874017070 con 0x7f0884101700 2024-07-24T22:03:04.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.537+0000 7f087affd640 1 -- 172.21.15.188:0/3002610223 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08740054d0 con 0x7f0884101700 2024-07-24T22:03:04.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.537+0000 7f088c0e9640 1 -- 172.21.15.188:0/3002610223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088419efc0 con 0x7f0884101700 2024-07-24T22:03:04.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.537+0000 7f087affd640 1 -- 172.21.15.188:0/3002610223 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874004c30 con 0x7f0884101700 2024-07-24T22:03:04.542 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.537+0000 7f088c0e9640 1 -- 172.21.15.188:0/3002610223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08841a5680 con 0x7f0884101700 2024-07-24T22:03:04.543 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.538+0000 7f088c0e9640 1 -- 172.21.15.188:0/3002610223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08841011c0 con 0x7f0884101700 2024-07-24T22:03:04.543 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.539+0000 7f087affd640 1 -- 172.21.15.188:0/3002610223 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f0874004dd0 con 0x7f0884101700 2024-07-24T22:03:04.543 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.540+0000 7f087affd640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08700b3c20 0x7f08700b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:04.543 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.540+0000 7f087affd640 1 -- 172.21.15.188:0/3002610223 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7f08740e37f0 con 0x7f0884101700 2024-07-24T22:03:04.543 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.540+0000 7f0889e85640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08700b3c20 0x7f08700b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:04.543 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.541+0000 7f0889e85640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08700b3c20 0x7f08700b60e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f08800058c0 tx=0x7f0880005850 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:04.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.543+0000 7f087affd640 1 -- 172.21.15.188:0/3002610223 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f08740ab210 con 0x7f0884101700 2024-07-24T22:03:04.738 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.736+0000 7f088c0e9640 1 -- 172.21.15.188:0/3002610223 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi183=b;smithi183=e;smithi183=h;smithi183=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l", "target": ["mon-mgr", ""]}) -- 0x7f0884062f80 con 0x7f08700b3c20 2024-07-24T22:03:04.747 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.745+0000 7f087affd640 1 -- 172.21.15.188:0/3002610223 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f0884062f80 con 0x7f08700b3c20 2024-07-24T22:03:04.747 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled mds.all update... 2024-07-24T22:03:04.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.748+0000 7f088c0e9640 1 -- 172.21.15.188:0/3002610223 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08700b3c20 msgr2=0x7f08700b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:04.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.748+0000 7f088c0e9640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08700b3c20 0x7f08700b60e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f08800058c0 tx=0x7f0880005850 comp rx=0 tx=0).stop 2024-07-24T22:03:04.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.748+0000 7f088c0e9640 1 -- 172.21.15.188:0/3002610223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0884101700 msgr2=0x7f0884199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:04.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.748+0000 7f088c0e9640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0884101700 0x7f0884199160 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f087400d770 tx=0x7f087400dc30 comp rx=0 tx=0).stop 2024-07-24T22:03:04.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.748+0000 7f088c0e9640 1 -- 172.21.15.188:0/3002610223 shutdown_connections 2024-07-24T22:03:04.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.748+0000 7f088c0e9640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08700b3c20 0x7f08700b60e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:04.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.748+0000 7f088c0e9640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0884101b40 0x7f088419e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:04.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.748+0000 7f088c0e9640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0884101700 0x7f0884199160 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:04.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.748+0000 7f088c0e9640 1 --2- 172.21.15.188:0/3002610223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f088406a640 0x7f0884198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:04.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.748+0000 7f088c0e9640 1 -- 172.21.15.188:0/3002610223 >> 172.21.15.188:0/3002610223 conn(0x7f0884076980 msgr2=0x7f0884107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:04.751 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.748+0000 7f088c0e9640 1 -- 172.21.15.188:0/3002610223 shutdown_connections 2024-07-24T22:03:04.751 INFO:teuthology.orchestra.run.smithi188.stderr:2024-07-24T22:03:04.748+0000 7f088c0e9640 1 -- 172.21.15.188:0/3002610223 wait complete. 2024-07-24T22:03:05.311 DEBUG:teuthology.orchestra.run.smithi047:mds.a> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.a.service 2024-07-24T22:03:05.313 DEBUG:teuthology.orchestra.run.smithi047:mds.d> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.d.service 2024-07-24T22:03:05.356 DEBUG:teuthology.orchestra.run.smithi047:mds.g> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.g.service 2024-07-24T22:03:05.402 DEBUG:teuthology.orchestra.run.smithi047:mds.j> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.j.service 2024-07-24T22:03:05.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:05 smithi183 ceph-mon[37007]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:05.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:05 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:05.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:05 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:03:05.419 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:05 smithi047 ceph-mon[32551]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:05.419 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:05 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:05.419 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:05 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:03:05.420 DEBUG:teuthology.orchestra.run.smithi183:mds.b> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.b.service 2024-07-24T22:03:05.422 DEBUG:teuthology.orchestra.run.smithi183:mds.e> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.e.service 2024-07-24T22:03:05.465 DEBUG:teuthology.orchestra.run.smithi183:mds.h> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.h.service 2024-07-24T22:03:05.508 DEBUG:teuthology.orchestra.run.smithi183:mds.k> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.k.service 2024-07-24T22:03:05.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:05 smithi188 ceph-mon[37380]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:05.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:05 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:05.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:05 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:03:05.551 DEBUG:teuthology.orchestra.run.smithi188:mds.c> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.c.service 2024-07-24T22:03:05.553 DEBUG:teuthology.orchestra.run.smithi188:mds.f> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.f.service 2024-07-24T22:03:05.596 DEBUG:teuthology.orchestra.run.smithi188:mds.i> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.i.service 2024-07-24T22:03:05.639 DEBUG:teuthology.orchestra.run.smithi188:mds.l> sudo journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.l.service 2024-07-24T22:03:05.682 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-07-24T22:03:05.682 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:03:05.942 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:06.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:06 smithi047 ceph-mon[32551]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi183=b;smithi183=e;smithi183=h;smithi183=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:03:06.328 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:06 smithi047 ceph-mon[32551]: Saving service mds.all spec with placement smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi183=b;smithi183=e;smithi183=h;smithi183=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l;count:12 2024-07-24T22:03:06.328 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:06 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:06.328 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:06 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:03:06.328 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:06 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:06.328 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:06 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:06.328 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:06 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:06.328 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:06 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:06.328 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:06 smithi047 ceph-mon[32551]: Deploying daemon mds.l on smithi188 2024-07-24T22:03:06.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:06 smithi183 ceph-mon[37007]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi183=b;smithi183=e;smithi183=h;smithi183=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:03:06.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:06 smithi183 ceph-mon[37007]: Saving service mds.all spec with placement smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi183=b;smithi183=e;smithi183=h;smithi183=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l;count:12 2024-07-24T22:03:06.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:06 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:06.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:06 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:03:06.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:06 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:06.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:06 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:06.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:06 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:06.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:06 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:06.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:06 smithi183 ceph-mon[37007]: Deploying daemon mds.l on smithi188 2024-07-24T22:03:06.506 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:06 smithi188 ceph-mon[37380]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi183=b;smithi183=e;smithi183=h;smithi183=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:03:06.506 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:06 smithi188 ceph-mon[37380]: Saving service mds.all spec with placement smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi183=b;smithi183=e;smithi183=h;smithi183=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l;count:12 2024-07-24T22:03:06.506 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:06 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:06.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:06 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:03:06.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:06 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:06.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:06 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:06.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:06 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:06.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:06 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:06.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:06 smithi188 ceph-mon[37380]: Deploying daemon mds.l on smithi188 2024-07-24T22:03:07.416 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:03:07 smithi188 systemd[1]: Starting Ceph mds.l for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:03:07.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.485+0000 7fe0603d9640 1 -- 172.21.15.47:0/641650062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe058074f30 msgr2=0x7fe058075310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:07.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.485+0000 7fe0603d9640 1 --2- 172.21.15.47:0/641650062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe058074f30 0x7fe058075310 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe054009900 tx=0x7fe05402a410 comp rx=0 tx=0).stop 2024-07-24T22:03:07.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.485+0000 7fe0603d9640 1 -- 172.21.15.47:0/641650062 shutdown_connections 2024-07-24T22:03:07.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.485+0000 7fe0603d9640 1 --2- 172.21.15.47:0/641650062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe05810edb0 0x7fe0581111a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:07.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.485+0000 7fe0603d9640 1 --2- 172.21.15.47:0/641650062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe058075930 0x7fe05810e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:07.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.485+0000 7fe0603d9640 1 --2- 172.21.15.47:0/641650062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe058074f30 0x7fe058075310 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:07.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.485+0000 7fe0603d9640 1 -- 172.21.15.47:0/641650062 >> 172.21.15.47:0/641650062 conn(0x7fe0580fe200 msgr2=0x7fe058100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:07.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.485+0000 7fe0603d9640 1 -- 172.21.15.47:0/641650062 shutdown_connections 2024-07-24T22:03:07.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.485+0000 7fe0603d9640 1 -- 172.21.15.47:0/641650062 wait complete. 2024-07-24T22:03:07.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.485+0000 7fe0603d9640 1 Processor -- start 2024-07-24T22:03:07.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.485+0000 7fe0603d9640 1 -- start start 2024-07-24T22:03:07.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe0603d9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe058074f30 0x7fe05819af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:07.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe0603d9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe058075930 0x7fe05819b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe0603d9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe05810edb0 0x7fe0581a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe0603d9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe0581149c0 con 0x7fe05810edb0 2024-07-24T22:03:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe0603d9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe058114840 con 0x7fe058075930 2024-07-24T22:03:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe0603d9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe058114b40 con 0x7fe058074f30 2024-07-24T22:03:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe05e976640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe05810edb0 0x7fe0581a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe05e976640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe05810edb0 0x7fe0581a0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60238/0 (socket says 172.21.15.47:60238) 2024-07-24T22:03:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe05e976640 1 -- 172.21.15.47:0/2696162586 learned_addr learned my addr 172.21.15.47:0/2696162586 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe05e175640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe058074f30 0x7fe05819af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe05d974640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe058075930 0x7fe05819b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe05e976640 1 -- 172.21.15.47:0/2696162586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe058074f30 msgr2=0x7fe05819af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe05e976640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe058074f30 0x7fe05819af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe05e976640 1 -- 172.21.15.47:0/2696162586 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe058075930 msgr2=0x7fe05819b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:07.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe05e976640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe058075930 0x7fe05819b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:07.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe05e976640 1 -- 172.21.15.47:0/2696162586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0581a0fe0 con 0x7fe05810edb0 2024-07-24T22:03:07.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe05d974640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe058075930 0x7fe05819b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:03:07.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe05e976640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe05810edb0 0x7fe0581a0810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe05000e9d0 tx=0x7fe05000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:07.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.486+0000 7fe04f7fe640 1 -- 172.21.15.47:0/2696162586 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05000cd80 con 0x7fe05810edb0 2024-07-24T22:03:07.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.487+0000 7fe0603d9640 1 -- 172.21.15.47:0/2696162586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0581a12d0 con 0x7fe05810edb0 2024-07-24T22:03:07.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.487+0000 7fe04f7fe640 1 -- 172.21.15.47:0/2696162586 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe050005020 con 0x7fe05810edb0 2024-07-24T22:03:07.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.487+0000 7fe04f7fe640 1 -- 172.21.15.47:0/2696162586 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0500116d0 con 0x7fe05810edb0 2024-07-24T22:03:07.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.487+0000 7fe0603d9640 1 -- 172.21.15.47:0/2696162586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0581a7a10 con 0x7fe05810edb0 2024-07-24T22:03:07.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.488+0000 7fe0603d9640 1 -- 172.21.15.47:0/2696162586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe058075310 con 0x7fe05810edb0 2024-07-24T22:03:07.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.489+0000 7fe04f7fe640 1 -- 172.21.15.47:0/2696162586 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fe0500051d0 con 0x7fe05810edb0 2024-07-24T22:03:07.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.490+0000 7fe04f7fe640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe0440b3c20 0x7fe0440b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:07.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.490+0000 7fe05e175640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe0440b3c20 0x7fe0440b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:07.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.490+0000 7fe04f7fe640 1 -- 172.21.15.47:0/2696162586 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7fe0500e3f10 con 0x7fe05810edb0 2024-07-24T22:03:07.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.490+0000 7fe05e175640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe0440b3c20 0x7fe0440b60e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe054031440 tx=0x7fe0540095f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:07.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.493+0000 7fe04f7fe640 1 -- 172.21.15.47:0/2696162586 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fe050016030 con 0x7fe05810edb0 2024-07-24T22:03:07.686 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:07 smithi188 ceph-mon[37380]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:07.686 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:03:07 smithi188 podman[68603]: 2024-07-24 22:03:07.41524414 +0000 UTC m=+0.085856611 container create eb134e71fb4edff7d5a357e6c9850bfb812945afcd08ed08cf501d5ae9cdbfad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-l, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240716, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-07-24T22:03:07.686 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:03:07 smithi188 podman[68603]: 2024-07-24 22:03:07.34649105 +0000 UTC m=+0.017103531 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:03:07.686 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:03:07 smithi188 podman[68603]: 2024-07-24 22:03:07.659327727 +0000 UTC m=+0.329940214 container init eb134e71fb4edff7d5a357e6c9850bfb812945afcd08ed08cf501d5ae9cdbfad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-l, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-07-24T22:03:07.686 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:03:07 smithi188 podman[68603]: 2024-07-24 22:03:07.661887771 +0000 UTC m=+0.332500246 container start eb134e71fb4edff7d5a357e6c9850bfb812945afcd08ed08cf501d5ae9cdbfad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=main-86385b1, org.label-schema.build-date=20240716, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-07-24T22:03:07.686 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:03:07 smithi188 ceph-mds[68622]: -- 172.21.15.188:0/2469828522 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563353825860 con 0x563353803000 2024-07-24T22:03:07.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:07 smithi047 ceph-mon[32551]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.727+0000 7fe0603d9640 1 -- 172.21.15.47:0/2696162586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0581a7d30 con 0x7fe05810edb0 2024-07-24T22:03:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.727+0000 7fe04f7fe640 1 -- 172.21.15.47:0/2696162586 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fe0500ab930 con 0x7fe05810edb0 2024-07-24T22:03:07.730 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:03:07.730 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":2,"btime":"2024-07-24T22:03:07:689307+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-07-24T22:03:07.730 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 2 2024-07-24T22:03:07.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.730+0000 7fe0603d9640 1 -- 172.21.15.47:0/2696162586 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe0440b3c20 msgr2=0x7fe0440b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:07.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.730+0000 7fe0603d9640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe0440b3c20 0x7fe0440b60e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe054031440 tx=0x7fe0540095f0 comp rx=0 tx=0).stop 2024-07-24T22:03:07.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.730+0000 7fe0603d9640 1 -- 172.21.15.47:0/2696162586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe05810edb0 msgr2=0x7fe0581a0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:07.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.730+0000 7fe0603d9640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe05810edb0 0x7fe0581a0810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe05000e9d0 tx=0x7fe05000ee90 comp rx=0 tx=0).stop 2024-07-24T22:03:07.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.730+0000 7fe0603d9640 1 -- 172.21.15.47:0/2696162586 shutdown_connections 2024-07-24T22:03:07.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.730+0000 7fe0603d9640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe0440b3c20 0x7fe0440b60e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:07.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.730+0000 7fe0603d9640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe05810edb0 0x7fe0581a0810 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:07.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.730+0000 7fe0603d9640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe058075930 0x7fe05819b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:07.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.730+0000 7fe0603d9640 1 --2- 172.21.15.47:0/2696162586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe058074f30 0x7fe05819af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:07.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.730+0000 7fe0603d9640 1 -- 172.21.15.47:0/2696162586 >> 172.21.15.47:0/2696162586 conn(0x7fe0580fe200 msgr2=0x7fe0580fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:07.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.730+0000 7fe0603d9640 1 -- 172.21.15.47:0/2696162586 shutdown_connections 2024-07-24T22:03:07.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:07.730+0000 7fe0603d9640 1 -- 172.21.15.47:0/2696162586 wait complete. 2024-07-24T22:03:07.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:07 smithi183 ceph-mon[37007]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:08.049 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:03:07 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-l[68618]: starting mds.l at 2024-07-24T22:03:08.049 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:03:07 smithi188 bash[68603]: eb134e71fb4edff7d5a357e6c9850bfb812945afcd08ed08cf501d5ae9cdbfad 2024-07-24T22:03:08.049 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:03:07 smithi188 systemd[1]: Started Ceph mds.l for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:03:08.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:08 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.188:6832/3861632765,v1:172.21.15.188:6833/3861632765] up:boot 2024-07-24T22:03:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:08 smithi183 ceph-mon[37007]: fsmap 1 up:standby 2024-07-24T22:03:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-24T22:03:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:08 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2696162586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:09.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:08 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.188:6832/3861632765,v1:172.21.15.188:6833/3861632765] up:boot 2024-07-24T22:03:09.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:08 smithi188 ceph-mon[37380]: fsmap 1 up:standby 2024-07-24T22:03:09.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-24T22:03:09.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:08 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2696162586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:09.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:09.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:09.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:09.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:09.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:09.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:09.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:08 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.188:6832/3861632765,v1:172.21.15.188:6833/3861632765] up:boot 2024-07-24T22:03:09.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:08 smithi047 ceph-mon[32551]: fsmap 1 up:standby 2024-07-24T22:03:09.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-24T22:03:09.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:08 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2696162586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:09.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:09.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:09.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:09.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:09.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:09.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:09.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:09 smithi183 ceph-mon[37007]: Deploying daemon mds.k on smithi183 2024-07-24T22:03:09.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:09 smithi183 ceph-mon[37007]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:09.912 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:03:09 smithi183 systemd[1]: Starting Ceph mds.k for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:03:10.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:09 smithi188 ceph-mon[37380]: Deploying daemon mds.k on smithi183 2024-07-24T22:03:10.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:09 smithi188 ceph-mon[37380]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:10.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:09 smithi047 ceph-mon[32551]: Deploying daemon mds.k on smithi183 2024-07-24T22:03:10.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:09 smithi047 ceph-mon[32551]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:10.219 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:03:10 smithi183 podman[67109]: 2024-07-24 22:03:09.905169801 +0000 UTC m=+0.018236780 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:03:10.219 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:03:10 smithi183 podman[67109]: 2024-07-24 22:03:10.007432368 +0000 UTC m=+0.120499337 container create 5127c2528a071da2248bc717cf21d0b6f4431cab0fefacc563dacc3fb55472e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=main-86385b1, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716) 2024-07-24T22:03:10.219 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:03:10 smithi183 podman[67109]: 2024-07-24 22:03:10.218040357 +0000 UTC m=+0.331107326 container init 5127c2528a071da2248bc717cf21d0b6f4431cab0fefacc563dacc3fb55472e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716) 2024-07-24T22:03:10.393 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:03:10.475 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:03:10 smithi183 podman[67109]: 2024-07-24 22:03:10.220987471 +0000 UTC m=+0.334054441 container start 5127c2528a071da2248bc717cf21d0b6f4431cab0fefacc563dacc3fb55472e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, ceph=True, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-07-24T22:03:10.476 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:03:10 smithi183 ceph-mds[67129]: -- 172.21.15.183:0/697470064 <== mon.2 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5585f20f3860 con 0x5585f20d1000 2024-07-24T22:03:10.476 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:03:10 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-k[67125]: starting mds.k at 2024-07-24T22:03:10.476 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:03:10 smithi183 bash[67109]: 5127c2528a071da2248bc717cf21d0b6f4431cab0fefacc563dacc3fb55472e2 2024-07-24T22:03:10.476 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:03:10 smithi183 systemd[1]: Started Ceph mds.k for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:03:10.678 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:11.745 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:11 smithi183 ceph-mon[37007]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:11.745 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:11 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:11.745 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:11 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:11.745 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:11 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:11.746 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:11 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:11.746 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:11 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:11.746 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:11 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:11.746 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:11 smithi183 ceph-mon[37007]: Deploying daemon mds.j on smithi047 2024-07-24T22:03:11.746 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:11 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.183:6832/2401857175,v1:172.21.15.183:6833/2401857175] up:boot 2024-07-24T22:03:11.746 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:11 smithi183 ceph-mon[37007]: fsmap 2 up:standby 2024-07-24T22:03:11.746 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:11 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-24T22:03:11.746 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:11 smithi047 ceph-mon[32551]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:11.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:11 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:11.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:11 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:11.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:11 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:11.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:11 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:11.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:11 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:11.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:11 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:11.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:11 smithi047 ceph-mon[32551]: Deploying daemon mds.j on smithi047 2024-07-24T22:03:11.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:11 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.183:6832/2401857175,v1:172.21.15.183:6833/2401857175] up:boot 2024-07-24T22:03:11.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:11 smithi047 ceph-mon[32551]: fsmap 2 up:standby 2024-07-24T22:03:11.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:11 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-24T22:03:11.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:11 smithi188 ceph-mon[37380]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:11.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:11 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:11 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:11 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:11 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:11 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:11 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:11 smithi188 ceph-mon[37380]: Deploying daemon mds.j on smithi047 2024-07-24T22:03:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:11 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.183:6832/2401857175,v1:172.21.15.183:6833/2401857175] up:boot 2024-07-24T22:03:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:11 smithi188 ceph-mon[37380]: fsmap 2 up:standby 2024-07-24T22:03:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:11 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-24T22:03:12.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.088+0000 7fd908a18640 1 -- 172.21.15.47:0/2884822212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd904108b20 msgr2=0x7fd90410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:12.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.088+0000 7fd908a18640 1 --2- 172.21.15.47:0/2884822212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd904108b20 0x7fd90410f320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009ca0 tx=0x7fd8fc02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:03:12.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.088+0000 7fd908a18640 1 -- 172.21.15.47:0/2884822212 shutdown_connections 2024-07-24T22:03:12.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.088+0000 7fd908a18640 1 --2- 172.21.15.47:0/2884822212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd904108b20 0x7fd90410f320 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:12.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.088+0000 7fd908a18640 1 --2- 172.21.15.47:0/2884822212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9041081a0 0x7fd9041085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:12.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.088+0000 7fd908a18640 1 --2- 172.21.15.47:0/2884822212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd904102790 0x7fd904102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:12.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.088+0000 7fd908a18640 1 -- 172.21.15.47:0/2884822212 >> 172.21.15.47:0/2884822212 conn(0x7fd9040fe200 msgr2=0x7fd904100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:12.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.088+0000 7fd908a18640 1 -- 172.21.15.47:0/2884822212 shutdown_connections 2024-07-24T22:03:12.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.088+0000 7fd908a18640 1 -- 172.21.15.47:0/2884822212 wait complete. 2024-07-24T22:03:12.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.089+0000 7fd908a18640 1 Processor -- start 2024-07-24T22:03:12.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.089+0000 7fd908a18640 1 -- start start 2024-07-24T22:03:12.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.089+0000 7fd908a18640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd904102790 0x7fd90419ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:12.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.089+0000 7fd908a18640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9041081a0 0x7fd90419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:12.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.089+0000 7fd908a18640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd904108b20 0x7fd9041a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:12.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.089+0000 7fd908a18640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd904112740 con 0x7fd904108b20 2024-07-24T22:03:12.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.089+0000 7fd908a18640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd9041125c0 con 0x7fd904102790 2024-07-24T22:03:12.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.089+0000 7fd908a18640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9041128c0 con 0x7fd9041081a0 2024-07-24T22:03:12.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd902d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd904108b20 0x7fd9041a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:12.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd902d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd904108b20 0x7fd9041a0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60262/0 (socket says 172.21.15.47:60262) 2024-07-24T22:03:12.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd90259c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd904102790 0x7fd90419ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:12.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd902d9d640 1 -- 172.21.15.47:0/1421612502 learned_addr learned my addr 172.21.15.47:0/1421612502 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:12.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd8f9d9b640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9041081a0 0x7fd90419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:12.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd90259c640 1 -- 172.21.15.47:0/1421612502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9041081a0 msgr2=0x7fd90419b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:12.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd90259c640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9041081a0 0x7fd90419b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:12.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd90259c640 1 -- 172.21.15.47:0/1421612502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd904108b20 msgr2=0x7fd9041a0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:12.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd90259c640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd904108b20 0x7fd9041a0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:12.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd90259c640 1 -- 172.21.15.47:0/1421612502 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9041a0ef0 con 0x7fd904102790 2024-07-24T22:03:12.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd902d9d640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd904108b20 0x7fd9041a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:03:12.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd90259c640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd904102790 0x7fd90419ae40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400e9f0 tx=0x7fd8f400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:12.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd8fbfff640 1 -- 172.21.15.47:0/1421612502 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f400ccc0 con 0x7fd904102790 2024-07-24T22:03:12.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd8fbfff640 1 -- 172.21.15.47:0/1421612502 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8f40108e0 con 0x7fd904102790 2024-07-24T22:03:12.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd8fbfff640 1 -- 172.21.15.47:0/1421612502 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4018880 con 0x7fd904102790 2024-07-24T22:03:12.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.090+0000 7fd908a18640 1 -- 172.21.15.47:0/1421612502 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9041a11e0 con 0x7fd904102790 2024-07-24T22:03:12.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.091+0000 7fd908a18640 1 -- 172.21.15.47:0/1421612502 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9041a78a0 con 0x7fd904102790 2024-07-24T22:03:12.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.092+0000 7fd908a18640 1 -- 172.21.15.47:0/1421612502 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd904102b70 con 0x7fd904102790 2024-07-24T22:03:12.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.093+0000 7fd8fbfff640 1 -- 172.21.15.47:0/1421612502 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fd8f4010430 con 0x7fd904102790 2024-07-24T22:03:12.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.094+0000 7fd8fbfff640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8f00b3c20 0x7fd8f00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:12.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.094+0000 7fd8f9d9b640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8f00b3c20 0x7fd8f00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:12.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.094+0000 7fd8fbfff640 1 -- 172.21.15.47:0/1421612502 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7fd8f40e3ca0 con 0x7fd904102790 2024-07-24T22:03:12.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.094+0000 7fd8f9d9b640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8f00b3c20 0x7fd8f00b60e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd904104950 tx=0x7fd8ec00b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:12.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.098+0000 7fd8fbfff640 1 -- 172.21.15.47:0/1421612502 <== mon.2 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fd8f40aafd0 con 0x7fd904102790 2024-07-24T22:03:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.331+0000 7fd908a18640 1 -- 172.21.15.47:0/1421612502 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd90402e000 con 0x7fd904102790 2024-07-24T22:03:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.332+0000 7fd8fbfff640 1 -- 172.21.15.47:0/1421612502 <== mon.2 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7fd8f40af520 con 0x7fd904102790 2024-07-24T22:03:12.334 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:03:12.334 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":3,"btime":"2024-07-24T22:03:10:693339+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-07-24T22:03:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 3 2024-07-24T22:03:12.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.334+0000 7fd908a18640 1 -- 172.21.15.47:0/1421612502 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8f00b3c20 msgr2=0x7fd8f00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:12.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.334+0000 7fd908a18640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8f00b3c20 0x7fd8f00b60e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd904104950 tx=0x7fd8ec00b390 comp rx=0 tx=0).stop 2024-07-24T22:03:12.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.334+0000 7fd908a18640 1 -- 172.21.15.47:0/1421612502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd904102790 msgr2=0x7fd90419ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:12.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.334+0000 7fd908a18640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd904102790 0x7fd90419ae40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400e9f0 tx=0x7fd8f400eeb0 comp rx=0 tx=0).stop 2024-07-24T22:03:12.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.334+0000 7fd908a18640 1 -- 172.21.15.47:0/1421612502 shutdown_connections 2024-07-24T22:03:12.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.334+0000 7fd908a18640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8f00b3c20 0x7fd8f00b60e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:12.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.334+0000 7fd908a18640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd904108b20 0x7fd9041a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:12.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.334+0000 7fd908a18640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9041081a0 0x7fd90419b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:12.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.334+0000 7fd908a18640 1 --2- 172.21.15.47:0/1421612502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd904102790 0x7fd90419ae40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:12.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.334+0000 7fd908a18640 1 -- 172.21.15.47:0/1421612502 >> 172.21.15.47:0/1421612502 conn(0x7fd9040fe200 msgr2=0x7fd9041067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:12.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.335+0000 7fd908a18640 1 -- 172.21.15.47:0/1421612502 shutdown_connections 2024-07-24T22:03:12.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:12.335+0000 7fd908a18640 1 -- 172.21.15.47:0/1421612502 wait complete. 2024-07-24T22:03:12.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:12 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1421612502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:12.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:12 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1421612502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:12.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:12 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1421612502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:13.726 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:13 smithi047 ceph-mon[32551]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:13.727 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:03:13 smithi047 systemd[1]: Starting Ceph mds.j for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:03:13.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:13 smithi188 ceph-mon[37380]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:13.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:13 smithi183 ceph-mon[37007]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:14.021 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:03:13 smithi047 podman[78130]: 2024-07-24 22:03:13.934510279 +0000 UTC m=+0.097577091 container create b6d50e5740e36b7ea6df3688394cff799fa3118c10b1a8e3e33a2cdd5caabb62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-24T22:03:14.021 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:03:13 smithi047 podman[78130]: 2024-07-24 22:03:13.854901619 +0000 UTC m=+0.017968400 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:03:14.436 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:03:14 smithi047 podman[78130]: 2024-07-24 22:03:14.120188282 +0000 UTC m=+0.283255064 container init b6d50e5740e36b7ea6df3688394cff799fa3118c10b1a8e3e33a2cdd5caabb62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, RELEASE=main-86385b1, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-24T22:03:14.436 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:03:14 smithi047 podman[78130]: 2024-07-24 22:03:14.123066231 +0000 UTC m=+0.286132998 container start b6d50e5740e36b7ea6df3688394cff799fa3118c10b1a8e3e33a2cdd5caabb62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, RELEASE=main-86385b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-07-24T22:03:14.436 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:03:14 smithi047 ceph-mds[78149]: -- 172.21.15.47:0/2718787429 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557606e8bc20 con 0x557606e69400 2024-07-24T22:03:14.436 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:03:14 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-j[78145]: starting mds.j at 2024-07-24T22:03:14.436 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:03:14 smithi047 bash[78130]: b6d50e5740e36b7ea6df3688394cff799fa3118c10b1a8e3e33a2cdd5caabb62 2024-07-24T22:03:14.437 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:03:14 smithi047 systemd[1]: Started Ceph mds.j for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:03:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:15 smithi047 ceph-mon[32551]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:15 smithi047 ceph-mon[32551]: Deploying daemon mds.d on smithi047 2024-07-24T22:03:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:15 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.47:6834/2008479600,v1:172.21.15.47:6835/2008479600] up:boot 2024-07-24T22:03:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:15 smithi047 ceph-mon[32551]: fsmap 3 up:standby 2024-07-24T22:03:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-24T22:03:15.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:15 smithi188 ceph-mon[37380]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:15.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:15.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:15.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:15.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:15.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:15.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:15.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:15 smithi188 ceph-mon[37380]: Deploying daemon mds.d on smithi047 2024-07-24T22:03:15.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:15 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.47:6834/2008479600,v1:172.21.15.47:6835/2008479600] up:boot 2024-07-24T22:03:15.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:15 smithi188 ceph-mon[37380]: fsmap 3 up:standby 2024-07-24T22:03:15.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-24T22:03:15.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:15 smithi183 ceph-mon[37007]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:15.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:15.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:15.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:15.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:15.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:15.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:15.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:15 smithi183 ceph-mon[37007]: Deploying daemon mds.d on smithi047 2024-07-24T22:03:15.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:15 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.47:6834/2008479600,v1:172.21.15.47:6835/2008479600] up:boot 2024-07-24T22:03:15.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:15 smithi183 ceph-mon[37007]: fsmap 3 up:standby 2024-07-24T22:03:15.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-24T22:03:15.756 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:03:16.036 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:16.146 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:03:15 smithi047 systemd[1]: Starting Ceph mds.d for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:03:17.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:17 smithi047 ceph-mon[32551]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:17.347 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:03:17 smithi047 podman[78501]: 2024-07-24 22:03:17.135935403 +0000 UTC m=+0.858763265 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:03:17.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:17 smithi188 ceph-mon[37380]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:17.611 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:03:17 smithi047 podman[78501]: 2024-07-24 22:03:17.478761014 +0000 UTC m=+1.201588854 container create 6f824af4f09cbc64371a916dc235a77a98b6d86714f0168aeb528f6a65b1b277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, RELEASE=main-86385b1, GIT_CLEAN=True, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-07-24T22:03:17.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:17 smithi183 ceph-mon[37007]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:17.866 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:03:17 smithi047 podman[78501]: 2024-07-24 22:03:17.765241371 +0000 UTC m=+1.488069218 container init 6f824af4f09cbc64371a916dc235a77a98b6d86714f0168aeb528f6a65b1b277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-d, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=main-86385b1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240716) 2024-07-24T22:03:17.866 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:03:17 smithi047 podman[78501]: 2024-07-24 22:03:17.768746794 +0000 UTC m=+1.491574639 container start 6f824af4f09cbc64371a916dc235a77a98b6d86714f0168aeb528f6a65b1b277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=main-86385b1) 2024-07-24T22:03:17.866 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:03:17 smithi047 ceph-mds[78593]: -- 172.21.15.47:0/2930019608 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56122b96fc20 con 0x56122b94c800 2024-07-24T22:03:17.867 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:03:17 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-d[78570]: starting mds.d at 2024-07-24T22:03:18.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.766+0000 7f75466c8640 1 -- 172.21.15.47:0/2353927694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f754010ede0 msgr2=0x7f75401111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:18.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.766+0000 7f75466c8640 1 --2- 172.21.15.47:0/2353927694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f754010ede0 0x7f75401111d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7538009ca0 tx=0x7f753802a950 comp rx=0 tx=0).stop 2024-07-24T22:03:18.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.766+0000 7f75466c8640 1 -- 172.21.15.47:0/2353927694 shutdown_connections 2024-07-24T22:03:18.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.766+0000 7f75466c8640 1 --2- 172.21.15.47:0/2353927694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f754010ede0 0x7f75401111d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:18.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.766+0000 7f75466c8640 1 --2- 172.21.15.47:0/2353927694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7540101b50 0x7f754010e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:18.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.766+0000 7f75466c8640 1 --2- 172.21.15.47:0/2353927694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7540101230 0x7f7540101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:18.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.766+0000 7f75466c8640 1 -- 172.21.15.47:0/2353927694 >> 172.21.15.47:0/2353927694 conn(0x7f75400fd100 msgr2=0x7f75400ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:18.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.766+0000 7f75466c8640 1 -- 172.21.15.47:0/2353927694 shutdown_connections 2024-07-24T22:03:18.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.766+0000 7f75466c8640 1 -- 172.21.15.47:0/2353927694 wait complete. 2024-07-24T22:03:18.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.766+0000 7f75466c8640 1 Processor -- start 2024-07-24T22:03:18.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.766+0000 7f75466c8640 1 -- start start 2024-07-24T22:03:18.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.767+0000 7f75466c8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7540101230 0x7f754019ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:18.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.767+0000 7f75466c8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7540101b50 0x7f754019b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:18.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.767+0000 7f75466c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f754010ede0 0x7f75401a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:18.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.767+0000 7f75466c8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7540114960 con 0x7f7540101b50 2024-07-24T22:03:18.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.767+0000 7f75466c8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f75401147e0 con 0x7f7540101230 2024-07-24T22:03:18.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.767+0000 7f75466c8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7540114ae0 con 0x7f754010ede0 2024-07-24T22:03:18.018 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:03:18.018 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":4,"btime":"2024-07-24T22:03:14:453700+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-07-24T22:03:18.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.767+0000 7f753f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7540101b50 0x7f754019b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:18.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.767+0000 7f753f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7540101b50 0x7f754019b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39114/0 (socket says 172.21.15.47:39114) 2024-07-24T22:03:18.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.767+0000 7f753f7fe640 1 -- 172.21.15.47:0/150768541 learned_addr learned my addr 172.21.15.47:0/150768541 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:18.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.767+0000 7f7544c65640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f754010ede0 0x7f75401a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:18.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.767+0000 7f753ffff640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7540101230 0x7f754019ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:18.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.768+0000 7f753f7fe640 1 -- 172.21.15.47:0/150768541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f754010ede0 msgr2=0x7f75401a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:18.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.768+0000 7f753f7fe640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f754010ede0 0x7f75401a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:18.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.768+0000 7f753f7fe640 1 -- 172.21.15.47:0/150768541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7540101230 msgr2=0x7f754019ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:18.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.768+0000 7f753f7fe640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7540101230 0x7f754019ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:18.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.768+0000 7f753f7fe640 1 -- 172.21.15.47:0/150768541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75401a0e40 con 0x7f7540101b50 2024-07-24T22:03:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.768+0000 7f753f7fe640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7540101b50 0x7f754019b2d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f753400c920 tx=0x7f753400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.768+0000 7f753d7fa640 1 -- 172.21.15.47:0/150768541 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7534007c70 con 0x7f7540101b50 2024-07-24T22:03:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.768+0000 7f753d7fa640 1 -- 172.21.15.47:0/150768541 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7534007e10 con 0x7f7540101b50 2024-07-24T22:03:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.768+0000 7f75466c8640 1 -- 172.21.15.47:0/150768541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75401a1130 con 0x7f7540101b50 2024-07-24T22:03:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.768+0000 7f753d7fa640 1 -- 172.21.15.47:0/150768541 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7534018820 con 0x7f7540101b50 2024-07-24T22:03:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.768+0000 7f75466c8640 1 -- 172.21.15.47:0/150768541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75401a77f0 con 0x7f7540101b50 2024-07-24T22:03:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.769+0000 7f75466c8640 1 -- 172.21.15.47:0/150768541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7540101610 con 0x7f7540101b50 2024-07-24T22:03:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.770+0000 7f753d7fa640 1 -- 172.21.15.47:0/150768541 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f753400f450 con 0x7f7540101b50 2024-07-24T22:03:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.772+0000 7f753d7fa640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f75280b3c20 0x7f75280b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.772+0000 7f753ffff640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f75280b3c20 0x7f75280b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.772+0000 7f753d7fa640 1 -- 172.21.15.47:0/150768541 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7f75340e3c80 con 0x7f7540101b50 2024-07-24T22:03:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.772+0000 7f753ffff640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f75280b3c20 0x7f75280b60e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75300058c0 tx=0x7f753000a250 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:17.775+0000 7f753d7fa640 1 -- 172.21.15.47:0/150768541 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f7534014030 con 0x7f7540101b50 2024-07-24T22:03:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.013+0000 7f75466c8640 1 -- 172.21.15.47:0/150768541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f754019bec0 con 0x7f7540101b50 2024-07-24T22:03:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.014+0000 7f753d7fa640 1 -- 172.21.15.47:0/150768541 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f75340ab690 con 0x7f7540101b50 2024-07-24T22:03:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 4 2024-07-24T22:03:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.016+0000 7f75466c8640 1 -- 172.21.15.47:0/150768541 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f75280b3c20 msgr2=0x7f75280b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.016+0000 7f75466c8640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f75280b3c20 0x7f75280b60e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75300058c0 tx=0x7f753000a250 comp rx=0 tx=0).stop 2024-07-24T22:03:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.016+0000 7f75466c8640 1 -- 172.21.15.47:0/150768541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7540101b50 msgr2=0x7f754019b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.016+0000 7f75466c8640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7540101b50 0x7f754019b2d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f753400c920 tx=0x7f753400cde0 comp rx=0 tx=0).stop 2024-07-24T22:03:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.016+0000 7f75466c8640 1 -- 172.21.15.47:0/150768541 shutdown_connections 2024-07-24T22:03:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.016+0000 7f75466c8640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f75280b3c20 0x7f75280b60e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.016+0000 7f75466c8640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f754010ede0 0x7f75401a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.016+0000 7f75466c8640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7540101b50 0x7f754019b2d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.016+0000 7f75466c8640 1 --2- 172.21.15.47:0/150768541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7540101230 0x7f754019ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.016+0000 7f75466c8640 1 -- 172.21.15.47:0/150768541 >> 172.21.15.47:0/150768541 conn(0x7f75400fd100 msgr2=0x7f754010f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.016+0000 7f75466c8640 1 -- 172.21.15.47:0/150768541 shutdown_connections 2024-07-24T22:03:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:18.016+0000 7f75466c8640 1 -- 172.21.15.47:0/150768541 wait complete. 2024-07-24T22:03:18.186 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:03:17 smithi047 bash[78501]: 6f824af4f09cbc64371a916dc235a77a98b6d86714f0168aeb528f6a65b1b277 2024-07-24T22:03:18.186 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:03:17 smithi047 systemd[1]: Started Ceph mds.d for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:03:19.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:19.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:19.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:19.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:19.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:19.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:19.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:18 smithi047 ceph-mon[32551]: Deploying daemon mds.e on smithi183 2024-07-24T22:03:19.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:18 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/150768541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:19.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:18 smithi047 ceph-mon[32551]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:19.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:18 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.47:6836/3498135783,v1:172.21.15.47:6837/3498135783] up:boot 2024-07-24T22:03:19.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:18 smithi047 ceph-mon[32551]: fsmap 4 up:standby 2024-07-24T22:03:19.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-24T22:03:19.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:19.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:19.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:19.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:19.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:19.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:19.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:18 smithi188 ceph-mon[37380]: Deploying daemon mds.e on smithi183 2024-07-24T22:03:19.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:18 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/150768541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:19.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:18 smithi188 ceph-mon[37380]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:19.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:18 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.47:6836/3498135783,v1:172.21.15.47:6837/3498135783] up:boot 2024-07-24T22:03:19.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:18 smithi188 ceph-mon[37380]: fsmap 4 up:standby 2024-07-24T22:03:19.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-24T22:03:19.317 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:19.317 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:19.317 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:19.317 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:19.317 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:19.318 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:19.318 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:18 smithi183 ceph-mon[37007]: Deploying daemon mds.e on smithi183 2024-07-24T22:03:19.318 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:18 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/150768541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:19.318 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:18 smithi183 ceph-mon[37007]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:19.318 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:18 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.47:6836/3498135783,v1:172.21.15.47:6837/3498135783] up:boot 2024-07-24T22:03:19.318 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:18 smithi183 ceph-mon[37007]: fsmap 4 up:standby 2024-07-24T22:03:19.318 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-24T22:03:19.912 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:03:19 smithi183 systemd[1]: Starting Ceph mds.e for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:03:20.239 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:03:19 smithi183 podman[67423]: 2024-07-24 22:03:19.881196545 +0000 UTC m=+0.017082089 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:03:20.239 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:03:20 smithi183 podman[67423]: 2024-07-24 22:03:20.010054418 +0000 UTC m=+0.145940004 container create 39578ef40e61813865d05fa82008c1d1781c7419ec989a46159551e37262041a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-e, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T22:03:20.239 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:03:20 smithi183 podman[67423]: 2024-07-24 22:03:20.237251284 +0000 UTC m=+0.373136828 container init 39578ef40e61813865d05fa82008c1d1781c7419ec989a46159551e37262041a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240716, RELEASE=main-86385b1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-07-24T22:03:20.643 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:03:20.661 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:03:20 smithi183 podman[67423]: 2024-07-24 22:03:20.240395574 +0000 UTC m=+0.376281119 container start 39578ef40e61813865d05fa82008c1d1781c7419ec989a46159551e37262041a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-e, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-24T22:03:20.662 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:03:20 smithi183 ceph-mds[67442]: -- 172.21.15.183:0/222049925 <== mon.2 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5633c8b9f860 con 0x5633c8b7d400 2024-07-24T22:03:20.662 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:03:20 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-e[67438]: starting mds.e at 2024-07-24T22:03:20.662 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:03:20 smithi183 bash[67423]: 39578ef40e61813865d05fa82008c1d1781c7419ec989a46159551e37262041a 2024-07-24T22:03:20.662 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:03:20 smithi183 systemd[1]: Started Ceph mds.e for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:03:20.924 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:21.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:21 smithi188 ceph-mon[37380]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:21.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:21 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:21.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:21 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:21.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:21 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:21.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:21 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:21.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:21 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:21.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:21 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:21.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:21 smithi188 ceph-mon[37380]: Deploying daemon mds.f on smithi188 2024-07-24T22:03:21.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:21 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.183:6834/740841820,v1:172.21.15.183:6835/740841820] up:boot 2024-07-24T22:03:21.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:21 smithi188 ceph-mon[37380]: fsmap 5 up:standby 2024-07-24T22:03:21.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:21 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-24T22:03:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:21 smithi183 ceph-mon[37007]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:21 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:21 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:21 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:21 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:21 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:21 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:21 smithi183 ceph-mon[37007]: Deploying daemon mds.f on smithi188 2024-07-24T22:03:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:21 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.183:6834/740841820,v1:172.21.15.183:6835/740841820] up:boot 2024-07-24T22:03:21.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:21 smithi183 ceph-mon[37007]: fsmap 5 up:standby 2024-07-24T22:03:21.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:21 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-24T22:03:21.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:21 smithi047 ceph-mon[32551]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:21.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:21 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:21.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:21 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:21.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:21 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:21.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:21 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:21.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:21 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:21.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:21 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:21.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:21 smithi047 ceph-mon[32551]: Deploying daemon mds.f on smithi188 2024-07-24T22:03:21.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:21 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.183:6834/740841820,v1:172.21.15.183:6835/740841820] up:boot 2024-07-24T22:03:21.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:21 smithi047 ceph-mon[32551]: fsmap 5 up:standby 2024-07-24T22:03:21.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:21 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-24T22:03:22.263 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:03:22 smithi188 systemd[1]: Starting Ceph mds.f for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:03:22.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.428+0000 7f026e473640 1 -- 172.21.15.47:0/2788393446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681022d0 msgr2=0x7f02681026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.428+0000 7f026e473640 1 --2- 172.21.15.47:0/2788393446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681022d0 0x7f02681026b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0258009900 tx=0x7f025802a410 comp rx=0 tx=0).stop 2024-07-24T22:03:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.428+0000 7f026e473640 1 -- 172.21.15.47:0/2788393446 shutdown_connections 2024-07-24T22:03:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.428+0000 7f026e473640 1 --2- 172.21.15.47:0/2788393446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0268107ad0 0x7f026810e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.428+0000 7f026e473640 1 --2- 172.21.15.47:0/2788393446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0268107130 0x7f0268107590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.429+0000 7f026e473640 1 --2- 172.21.15.47:0/2788393446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681022d0 0x7f02681026b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.429+0000 7f026e473640 1 -- 172.21.15.47:0/2788393446 >> 172.21.15.47:0/2788393446 conn(0x7f0268076980 msgr2=0x7f0268076d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.429+0000 7f026e473640 1 -- 172.21.15.47:0/2788393446 shutdown_connections 2024-07-24T22:03:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.429+0000 7f026e473640 1 -- 172.21.15.47:0/2788393446 wait complete. 2024-07-24T22:03:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.429+0000 7f026e473640 1 Processor -- start 2024-07-24T22:03:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.429+0000 7f026e473640 1 -- start start 2024-07-24T22:03:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.429+0000 7f026e473640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681022d0 0x7f0268198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.429+0000 7f026e473640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0268107130 0x7f02681991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.429+0000 7f026e473640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0268107ad0 0x7f026819e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.429+0000 7f026e473640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0268111640 con 0x7f02681022d0 2024-07-24T22:03:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.429+0000 7f026e473640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f02681114c0 con 0x7f0268107130 2024-07-24T22:03:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.429+0000 7f026e473640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f02681117c0 con 0x7f0268107ad0 2024-07-24T22:03:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f0267fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681022d0 0x7f0268198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f0267fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681022d0 0x7f0268198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39150/0 (socket says 172.21.15.47:39150) 2024-07-24T22:03:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f0267fff640 1 -- 172.21.15.47:0/9808997 learned_addr learned my addr 172.21.15.47:0/9808997 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f026ca10640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0268107ad0 0x7f026819e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f025ffff640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0268107130 0x7f02681991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f0267fff640 1 -- 172.21.15.47:0/9808997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0268107ad0 msgr2=0x7f026819e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f0267fff640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0268107ad0 0x7f026819e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f0267fff640 1 -- 172.21.15.47:0/9808997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0268107130 msgr2=0x7f02681991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f0267fff640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0268107130 0x7f02681991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f0267fff640 1 -- 172.21.15.47:0/9808997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026819ed60 con 0x7f02681022d0 2024-07-24T22:03:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f0267fff640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681022d0 0x7f0268198cb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0258005ab0 tx=0x7f0258003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f0265ffb640 1 -- 172.21.15.47:0/9808997 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025803f070 con 0x7f02681022d0 2024-07-24T22:03:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f026e473640 1 -- 172.21.15.47:0/9808997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026819eff0 con 0x7f02681022d0 2024-07-24T22:03:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f0265ffb640 1 -- 172.21.15.47:0/9808997 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0258031d60 con 0x7f02681022d0 2024-07-24T22:03:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f0265ffb640 1 -- 172.21.15.47:0/9808997 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258035030 con 0x7f02681022d0 2024-07-24T22:03:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.430+0000 7f026e473640 1 -- 172.21.15.47:0/9808997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02681a5710 con 0x7f02681022d0 2024-07-24T22:03:22.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.432+0000 7f026e473640 1 -- 172.21.15.47:0/9808997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02681026b0 con 0x7f02681022d0 2024-07-24T22:03:22.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.433+0000 7f0265ffb640 1 -- 172.21.15.47:0/9808997 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f0258042070 con 0x7f02681022d0 2024-07-24T22:03:22.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.434+0000 7f0265ffb640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f02540b3c20 0x7f02540b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:22.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.434+0000 7f025ffff640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f02540b3c20 0x7f02540b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:22.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.434+0000 7f0265ffb640 1 -- 172.21.15.47:0/9808997 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7f0258104730 con 0x7f02681022d0 2024-07-24T22:03:22.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.434+0000 7f025ffff640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f02540b3c20 0x7f02540b60e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f02680771e0 tx=0x7f0250005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:22.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.437+0000 7f0265ffb640 1 -- 172.21.15.47:0/9808997 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f02580cc150 con 0x7f02681022d0 2024-07-24T22:03:22.513 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:03:22 smithi188 podman[68907]: 2024-07-24 22:03:22.163394099 +0000 UTC m=+0.017356231 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:03:22.513 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:03:22 smithi188 podman[68907]: 2024-07-24 22:03:22.292909721 +0000 UTC m=+0.146871838 container create a9844a4d3e413affe91dedbd168a3dbf208ceec2c00aa440158c911fc71624a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-f, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-07-24T22:03:22.513 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:03:22 smithi188 podman[68907]: 2024-07-24 22:03:22.512427142 +0000 UTC m=+0.366389261 container init a9844a4d3e413affe91dedbd168a3dbf208ceec2c00aa440158c911fc71624a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-24T22:03:22.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.678+0000 7f026e473640 1 -- 172.21.15.47:0/9808997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0268199de0 con 0x7f02681022d0 2024-07-24T22:03:22.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.679+0000 7f0265ffb640 1 -- 172.21.15.47:0/9808997 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7f02580cba50 con 0x7f02681022d0 2024-07-24T22:03:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:03:22.681 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":6,"btime":"2024-07-24T22:03:21:117640+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-07-24T22:03:22.681 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 6 2024-07-24T22:03:22.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.681+0000 7f026e473640 1 -- 172.21.15.47:0/9808997 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f02540b3c20 msgr2=0x7f02540b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:22.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.681+0000 7f026e473640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f02540b3c20 0x7f02540b60e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f02680771e0 tx=0x7f0250005f90 comp rx=0 tx=0).stop 2024-07-24T22:03:22.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.681+0000 7f026e473640 1 -- 172.21.15.47:0/9808997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681022d0 msgr2=0x7f0268198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:22.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.681+0000 7f026e473640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681022d0 0x7f0268198cb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0258005ab0 tx=0x7f0258003c80 comp rx=0 tx=0).stop 2024-07-24T22:03:22.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.681+0000 7f026e473640 1 -- 172.21.15.47:0/9808997 shutdown_connections 2024-07-24T22:03:22.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.681+0000 7f026e473640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f02540b3c20 0x7f02540b60e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:22.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.681+0000 7f026e473640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0268107ad0 0x7f026819e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:22.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.681+0000 7f026e473640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0268107130 0x7f02681991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:22.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.681+0000 7f026e473640 1 --2- 172.21.15.47:0/9808997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681022d0 0x7f0268198cb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:22.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.681+0000 7f026e473640 1 -- 172.21.15.47:0/9808997 >> 172.21.15.47:0/9808997 conn(0x7f0268076980 msgr2=0x7f0268105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:22.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.681+0000 7f026e473640 1 -- 172.21.15.47:0/9808997 shutdown_connections 2024-07-24T22:03:22.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:22.682+0000 7f026e473640 1 -- 172.21.15.47:0/9808997 wait complete. 2024-07-24T22:03:22.798 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:03:22 smithi188 podman[68907]: 2024-07-24 22:03:22.515143155 +0000 UTC m=+0.369105283 container start a9844a4d3e413affe91dedbd168a3dbf208ceec2c00aa440158c911fc71624a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716) 2024-07-24T22:03:22.799 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:03:22 smithi188 ceph-mds[68926]: -- 172.21.15.188:0/411036200 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5603ffd8d860 con 0x5603ffd6b000 2024-07-24T22:03:22.799 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:03:22 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-f[68922]: starting mds.f at 2024-07-24T22:03:22.799 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:03:22 smithi188 bash[68907]: a9844a4d3e413affe91dedbd168a3dbf208ceec2c00aa440158c911fc71624a4 2024-07-24T22:03:22.799 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:03:22 smithi188 systemd[1]: Started Ceph mds.f for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:03:23.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:23 smithi188 ceph-mon[37380]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:23 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:23 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:23 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:23 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:23 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:23 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:23 smithi188 ceph-mon[37380]: Deploying daemon mds.c on smithi188 2024-07-24T22:03:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:23 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/9808997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:23 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.188:6834/3246894203,v1:172.21.15.188:6835/3246894203] up:boot 2024-07-24T22:03:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:23 smithi188 ceph-mon[37380]: fsmap 6 up:standby 2024-07-24T22:03:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:23 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-24T22:03:23.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:23 smithi047 ceph-mon[32551]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:23.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:23 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:23.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:23 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:23.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:23 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:23.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:23 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:23.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:23 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:23.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:23 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:23.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:23 smithi047 ceph-mon[32551]: Deploying daemon mds.c on smithi188 2024-07-24T22:03:23.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:23 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/9808997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:23.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:23 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.188:6834/3246894203,v1:172.21.15.188:6835/3246894203] up:boot 2024-07-24T22:03:23.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:23 smithi047 ceph-mon[32551]: fsmap 6 up:standby 2024-07-24T22:03:23.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:23 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-24T22:03:24.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:23 smithi183 ceph-mon[37007]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:24.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:23 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:24.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:23 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:24.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:23 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:24.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:23 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:24.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:23 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:24.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:23 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:24.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:23 smithi183 ceph-mon[37007]: Deploying daemon mds.c on smithi188 2024-07-24T22:03:24.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:23 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/9808997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:24.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:23 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.188:6834/3246894203,v1:172.21.15.188:6835/3246894203] up:boot 2024-07-24T22:03:24.163 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:23 smithi183 ceph-mon[37007]: fsmap 6 up:standby 2024-07-24T22:03:24.163 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:23 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-24T22:03:24.799 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:03:24 smithi188 systemd[1]: Starting Ceph mds.c for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:03:25.108 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:03:24 smithi188 podman[69207]: 2024-07-24 22:03:24.729061693 +0000 UTC m=+0.016997833 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:03:25.108 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:03:24 smithi188 podman[69207]: 2024-07-24 22:03:24.857974772 +0000 UTC m=+0.145910901 container create 87e54b1f238b09b097525e5b6c2eec9306a89390967b01c58a53d57d2792a941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-c, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-07-24T22:03:25.109 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:03:25 smithi188 podman[69207]: 2024-07-24 22:03:25.107670249 +0000 UTC m=+0.395606379 container init 87e54b1f238b09b097525e5b6c2eec9306a89390967b01c58a53d57d2792a941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=main-86385b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-24T22:03:25.298 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:03:25.548 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:03:25 smithi188 podman[69207]: 2024-07-24 22:03:25.110754279 +0000 UTC m=+0.398690419 container start 87e54b1f238b09b097525e5b6c2eec9306a89390967b01c58a53d57d2792a941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=main-86385b1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-07-24T22:03:25.549 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:03:25 smithi188 ceph-mds[69227]: -- 172.21.15.188:0/2641996286 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce932d9860 con 0x55ce932b6800 2024-07-24T22:03:25.549 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:03:25 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-c[69223]: starting mds.c at 2024-07-24T22:03:25.549 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:03:25 smithi188 bash[69207]: 87e54b1f238b09b097525e5b6c2eec9306a89390967b01c58a53d57d2792a941 2024-07-24T22:03:25.549 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:03:25 smithi188 systemd[1]: Started Ceph mds.c for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:03:25.572 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:25.915 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:25 smithi183 ceph-mon[37007]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:25.915 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:25 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:25.916 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:25 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:25.916 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:25 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:25.916 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:25 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:25.916 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:25 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:25.916 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:25 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:25.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:25 smithi047 ceph-mon[32551]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:25.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:25 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:25.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:25 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:25.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:25 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:25.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:25 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:25.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:25 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:25.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:25 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:26.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:25 smithi188 ceph-mon[37380]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:26.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:25 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:26.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:25 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:26.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:25 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:26.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:25 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:26.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:25 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:26.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:25 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:26.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:26 smithi188 ceph-mon[37380]: Deploying daemon mds.h on smithi183 2024-07-24T22:03:26.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:26 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.188:6836/749102233,v1:172.21.15.188:6837/749102233] up:boot 2024-07-24T22:03:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:26 smithi188 ceph-mon[37380]: fsmap 7 up:standby 2024-07-24T22:03:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-24T22:03:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:26 smithi183 ceph-mon[37007]: Deploying daemon mds.h on smithi183 2024-07-24T22:03:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:26 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.188:6836/749102233,v1:172.21.15.188:6837/749102233] up:boot 2024-07-24T22:03:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:26 smithi183 ceph-mon[37007]: fsmap 7 up:standby 2024-07-24T22:03:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-24T22:03:26.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:26 smithi047 ceph-mon[32551]: Deploying daemon mds.h on smithi183 2024-07-24T22:03:26.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:26 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.188:6836/749102233,v1:172.21.15.188:6837/749102233] up:boot 2024-07-24T22:03:26.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:26 smithi047 ceph-mon[32551]: fsmap 7 up:standby 2024-07-24T22:03:26.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-24T22:03:27.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.125+0000 7f8c5249c640 1 -- 172.21.15.47:0/3392125465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4c102790 msgr2=0x7f8c4c102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:27.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.125+0000 7f8c5249c640 1 --2- 172.21.15.47:0/3392125465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4c102790 0x7f8c4c102b70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009900 tx=0x7f8c3c02a410 comp rx=0 tx=0).stop 2024-07-24T22:03:27.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.125+0000 7f8c5249c640 1 -- 172.21.15.47:0/3392125465 shutdown_connections 2024-07-24T22:03:27.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.125+0000 7f8c5249c640 1 --2- 172.21.15.47:0/3392125465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4c108b20 0x7f8c4c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:27.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.125+0000 7f8c5249c640 1 --2- 172.21.15.47:0/3392125465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c4c1081a0 0x7f8c4c1085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:27.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.125+0000 7f8c5249c640 1 --2- 172.21.15.47:0/3392125465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4c102790 0x7f8c4c102b70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:27.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.125+0000 7f8c5249c640 1 -- 172.21.15.47:0/3392125465 >> 172.21.15.47:0/3392125465 conn(0x7f8c4c0fe200 msgr2=0x7f8c4c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:27.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.125+0000 7f8c5249c640 1 -- 172.21.15.47:0/3392125465 shutdown_connections 2024-07-24T22:03:27.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.125+0000 7f8c5249c640 1 -- 172.21.15.47:0/3392125465 wait complete. 2024-07-24T22:03:27.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.126+0000 7f8c5249c640 1 Processor -- start 2024-07-24T22:03:27.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.126+0000 7f8c5249c640 1 -- start start 2024-07-24T22:03:27.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.126+0000 7f8c5249c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4c102790 0x7f8c4c198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:27.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.126+0000 7f8c5249c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4c1081a0 0x7f8c4c199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:27.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.126+0000 7f8c5249c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c4c108b20 0x7f8c4c19e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:27.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.126+0000 7f8c5249c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c112740 con 0x7f8c4c102790 2024-07-24T22:03:27.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.126+0000 7f8c5249c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c1125c0 con 0x7f8c4c108b20 2024-07-24T22:03:27.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.126+0000 7f8c5249c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c1128c0 con 0x7f8c4c1081a0 2024-07-24T22:03:27.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.126+0000 7f8c4bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4c102790 0x7f8c4c198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:27.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.126+0000 7f8c4bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4c102790 0x7f8c4c198c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56716/0 (socket says 172.21.15.47:56716) 2024-07-24T22:03:27.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.126+0000 7f8c4bfff640 1 -- 172.21.15.47:0/1852117316 learned_addr learned my addr 172.21.15.47:0/1852117316 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:27.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.126+0000 7f8c4b7fe640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4c1081a0 0x7f8c4c199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:27.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.127+0000 7f8c50a39640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c4c108b20 0x7f8c4c19e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:27.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.127+0000 7f8c4bfff640 1 -- 172.21.15.47:0/1852117316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4c1081a0 msgr2=0x7f8c4c199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:27.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.127+0000 7f8c4bfff640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4c1081a0 0x7f8c4c199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:27.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.127+0000 7f8c4bfff640 1 -- 172.21.15.47:0/1852117316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c4c108b20 msgr2=0x7f8c4c19e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:27.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.127+0000 7f8c4bfff640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c4c108b20 0x7f8c4c19e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:27.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.127+0000 7f8c4bfff640 1 -- 172.21.15.47:0/1852117316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4c19ece0 con 0x7f8c4c102790 2024-07-24T22:03:27.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.127+0000 7f8c4b7fe640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4c1081a0 0x7f8c4c199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:03:27.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.127+0000 7f8c4bfff640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4c102790 0x7f8c4c198c30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c005940 tx=0x7f8c3c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:27.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.127+0000 7f8c497fa640 1 -- 172.21.15.47:0/1852117316 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c03f030 con 0x7f8c4c102790 2024-07-24T22:03:27.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.127+0000 7f8c5249c640 1 -- 172.21.15.47:0/1852117316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4c19ef70 con 0x7f8c4c102790 2024-07-24T22:03:27.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.127+0000 7f8c497fa640 1 -- 172.21.15.47:0/1852117316 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c3c0044c0 con 0x7f8c4c102790 2024-07-24T22:03:27.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.127+0000 7f8c497fa640 1 -- 172.21.15.47:0/1852117316 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c035070 con 0x7f8c4c102790 2024-07-24T22:03:27.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.127+0000 7f8c5249c640 1 -- 172.21.15.47:0/1852117316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c4c1a5690 con 0x7f8c4c102790 2024-07-24T22:03:27.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.128+0000 7f8c5249c640 1 -- 172.21.15.47:0/1852117316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c4c102b70 con 0x7f8c4c102790 2024-07-24T22:03:27.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.130+0000 7f8c497fa640 1 -- 172.21.15.47:0/1852117316 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f8c3c042030 con 0x7f8c4c102790 2024-07-24T22:03:27.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.130+0000 7f8c497fa640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8c340b3c20 0x7f8c340b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:27.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.131+0000 7f8c4b7fe640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8c340b3c20 0x7f8c340b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:27.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.131+0000 7f8c497fa640 1 -- 172.21.15.47:0/1852117316 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7f8c3c103e90 con 0x7f8c4c102790 2024-07-24T22:03:27.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.131+0000 7f8c4b7fe640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8c340b3c20 0x7f8c340b60e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c1078e0 tx=0x7f8c40005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:27.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.133+0000 7f8c497fa640 1 -- 172.21.15.47:0/1852117316 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f8c3c0cb260 con 0x7f8c4c102790 2024-07-24T22:03:27.313 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:03:27 smithi183 systemd[1]: Starting Ceph mds.h for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:03:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.366+0000 7f8c5249c640 1 -- 172.21.15.47:0/1852117316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c4c199d60 con 0x7f8c4c102790 2024-07-24T22:03:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.367+0000 7f8c497fa640 1 -- 172.21.15.47:0/1852117316 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f8c3c0cf7b0 con 0x7f8c4c102790 2024-07-24T22:03:27.369 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:03:27.369 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"btime":"2024-07-24T22:03:25:662702+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-07-24T22:03:27.369 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-07-24T22:03:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.369+0000 7f8c5249c640 1 -- 172.21.15.47:0/1852117316 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8c340b3c20 msgr2=0x7f8c340b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.369+0000 7f8c5249c640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8c340b3c20 0x7f8c340b60e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c1078e0 tx=0x7f8c40005f90 comp rx=0 tx=0).stop 2024-07-24T22:03:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.369+0000 7f8c5249c640 1 -- 172.21.15.47:0/1852117316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4c102790 msgr2=0x7f8c4c198c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.369+0000 7f8c5249c640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4c102790 0x7f8c4c198c30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c005940 tx=0x7f8c3c0040c0 comp rx=0 tx=0).stop 2024-07-24T22:03:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.369+0000 7f8c5249c640 1 -- 172.21.15.47:0/1852117316 shutdown_connections 2024-07-24T22:03:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.369+0000 7f8c5249c640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8c340b3c20 0x7f8c340b60e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.369+0000 7f8c5249c640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c4c108b20 0x7f8c4c19e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.369+0000 7f8c5249c640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8c4c1081a0 0x7f8c4c199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.369+0000 7f8c5249c640 1 --2- 172.21.15.47:0/1852117316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4c102790 0x7f8c4c198c30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.369+0000 7f8c5249c640 1 -- 172.21.15.47:0/1852117316 >> 172.21.15.47:0/1852117316 conn(0x7f8c4c0fe200 msgr2=0x7f8c4c0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.369+0000 7f8c5249c640 1 -- 172.21.15.47:0/1852117316 shutdown_connections 2024-07-24T22:03:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:27.369+0000 7f8c5249c640 1 -- 172.21.15.47:0/1852117316 wait complete. 2024-07-24T22:03:27.573 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:03:27 smithi183 podman[67729]: 2024-07-24 22:03:27.214203975 +0000 UTC m=+0.017352516 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:03:27.573 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:03:27 smithi183 podman[67729]: 2024-07-24 22:03:27.336593228 +0000 UTC m=+0.139741758 container create 94f9561d55138f8f31d05f697797e412de92fe2f560871d0559b1d84bf01c3be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240716, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-24T22:03:27.574 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:03:27 smithi183 podman[67729]: 2024-07-24 22:03:27.54728043 +0000 UTC m=+0.350428978 container init 94f9561d55138f8f31d05f697797e412de92fe2f560871d0559b1d84bf01c3be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-h, GIT_CLEAN=True, RELEASE=main-86385b1, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240716) 2024-07-24T22:03:27.574 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:03:27 smithi183 podman[67729]: 2024-07-24 22:03:27.549744867 +0000 UTC m=+0.352893398 container start 94f9561d55138f8f31d05f697797e412de92fe2f560871d0559b1d84bf01c3be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240716, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-07-24T22:03:27.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:27 smithi188 ceph-mon[37380]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:27 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1852117316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:27.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:27 smithi183 ceph-mon[37007]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:27.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:27 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1852117316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:27.912 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:03:27 smithi183 ceph-mds[67749]: -- 172.21.15.183:0/3777843580 <== mon.2 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ddb93c1860 con 0x55ddb939e800 2024-07-24T22:03:27.912 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:03:27 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-h[67745]: starting mds.h at 2024-07-24T22:03:27.912 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:03:27 smithi183 bash[67729]: 94f9561d55138f8f31d05f697797e412de92fe2f560871d0559b1d84bf01c3be 2024-07-24T22:03:27.912 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:03:27 smithi183 systemd[1]: Started Ceph mds.h for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:03:27.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:27 smithi047 ceph-mon[32551]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:27.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:27 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1852117316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:28 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.183:6836/2532099121,v1:172.21.15.183:6837/2532099121] up:boot 2024-07-24T22:03:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:28 smithi188 ceph-mon[37380]: fsmap 8 up:standby 2024-07-24T22:03:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-24T22:03:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:28 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:28.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:28 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.183:6836/2532099121,v1:172.21.15.183:6837/2532099121] up:boot 2024-07-24T22:03:28.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:28 smithi047 ceph-mon[32551]: fsmap 8 up:standby 2024-07-24T22:03:28.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-24T22:03:28.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:28.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:28.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:28.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:28.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:28.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:28 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:29.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:28 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.183:6836/2532099121,v1:172.21.15.183:6837/2532099121] up:boot 2024-07-24T22:03:29.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:28 smithi183 ceph-mon[37007]: fsmap 8 up:standby 2024-07-24T22:03:29.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-24T22:03:29.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:29.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:29.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:29.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:29.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:29.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:28 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:29.682 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:03:29 smithi188 systemd[1]: Starting Ceph mds.i for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:03:29.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:29 smithi047 ceph-mon[32551]: Deploying daemon mds.i on smithi188 2024-07-24T22:03:29.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:29 smithi047 ceph-mon[32551]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:29.945 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:29 smithi188 ceph-mon[37380]: Deploying daemon mds.i on smithi188 2024-07-24T22:03:29.945 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:29 smithi188 ceph-mon[37380]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:29.945 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:03:29 smithi188 podman[69521]: 2024-07-24 22:03:29.8085777 +0000 UTC m=+0.111819354 container create 3a9a1b23bfb79e76b6dd2997403e0cf3c830b9fc5e09c9e6b57c8365a714b8a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-i, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240716) 2024-07-24T22:03:29.945 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:03:29 smithi188 podman[69521]: 2024-07-24 22:03:29.713873427 +0000 UTC m=+0.017115099 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:03:29.993 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:03:30.063 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:29 smithi183 ceph-mon[37007]: Deploying daemon mds.i on smithi188 2024-07-24T22:03:30.063 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:29 smithi183 ceph-mon[37007]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:30.278 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:30.549 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:03:30 smithi188 podman[69521]: 2024-07-24 22:03:30.052821485 +0000 UTC m=+0.356063143 container init 3a9a1b23bfb79e76b6dd2997403e0cf3c830b9fc5e09c9e6b57c8365a714b8a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-i, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240716, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=main-86385b1) 2024-07-24T22:03:30.549 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:03:30 smithi188 podman[69521]: 2024-07-24 22:03:30.055592004 +0000 UTC m=+0.358833659 container start 3a9a1b23bfb79e76b6dd2997403e0cf3c830b9fc5e09c9e6b57c8365a714b8a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-07-24T22:03:30.549 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:03:30 smithi188 ceph-mds[69540]: -- 172.21.15.188:0/1144769667 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e7ccf7b860 con 0x55e7ccf58800 2024-07-24T22:03:30.549 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:03:30 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-i[69536]: starting mds.i at 2024-07-24T22:03:30.549 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:03:30 smithi188 bash[69521]: 3a9a1b23bfb79e76b6dd2997403e0cf3c830b9fc5e09c9e6b57c8365a714b8a8 2024-07-24T22:03:30.549 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:03:30 smithi188 systemd[1]: Started Ceph mds.i for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:03:31.340 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:31 smithi183 ceph-mon[37007]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:31.341 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:31.341 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:31.341 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:31.341 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:31.341 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:31.341 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:31.341 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:31 smithi183 ceph-mon[37007]: Deploying daemon mds.g on smithi047 2024-07-24T22:03:31.341 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:31 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] up:boot 2024-07-24T22:03:31.341 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:31 smithi183 ceph-mon[37007]: fsmap 9 up:standby 2024-07-24T22:03:31.341 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-24T22:03:31.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:31 smithi047 ceph-mon[32551]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:31.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:31.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:31.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:31.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:31.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:31.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:31.545 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:31 smithi047 ceph-mon[32551]: Deploying daemon mds.g on smithi047 2024-07-24T22:03:31.546 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:31 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] up:boot 2024-07-24T22:03:31.546 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:31 smithi047 ceph-mon[32551]: fsmap 9 up:standby 2024-07-24T22:03:31.546 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-24T22:03:31.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:31 smithi188 ceph-mon[37380]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:31.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:31.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:31 smithi188 ceph-mon[37380]: Deploying daemon mds.g on smithi047 2024-07-24T22:03:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:31 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] up:boot 2024-07-24T22:03:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:31 smithi188 ceph-mon[37380]: fsmap 9 up:standby 2024-07-24T22:03:31.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-24T22:03:32.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.944+0000 7f952fdd6640 1 -- 172.21.15.47:0/3099719803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9528108b20 msgr2=0x7f952810f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:32.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.944+0000 7f952fdd6640 1 --2- 172.21.15.47:0/3099719803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9528108b20 0x7f952810f320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9520009ca0 tx=0x7f952002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:03:32.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.944+0000 7f952fdd6640 1 -- 172.21.15.47:0/3099719803 shutdown_connections 2024-07-24T22:03:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.944+0000 7f952fdd6640 1 --2- 172.21.15.47:0/3099719803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9528108b20 0x7f952810f320 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.944+0000 7f952fdd6640 1 --2- 172.21.15.47:0/3099719803 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95281081a0 0x7f95281085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.944+0000 7f952fdd6640 1 --2- 172.21.15.47:0/3099719803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9528102790 0x7f9528102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.944+0000 7f952fdd6640 1 -- 172.21.15.47:0/3099719803 >> 172.21.15.47:0/3099719803 conn(0x7f95280fe200 msgr2=0x7f9528100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.944+0000 7f952fdd6640 1 -- 172.21.15.47:0/3099719803 shutdown_connections 2024-07-24T22:03:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.945+0000 7f952fdd6640 1 -- 172.21.15.47:0/3099719803 wait complete. 2024-07-24T22:03:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.945+0000 7f952fdd6640 1 Processor -- start 2024-07-24T22:03:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.945+0000 7f952fdd6640 1 -- start start 2024-07-24T22:03:32.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.945+0000 7f952fdd6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9528102790 0x7f952819ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:32.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.945+0000 7f952fdd6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95281081a0 0x7f952819b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:32.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.945+0000 7f952fdd6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9528108b20 0x7f95281a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:32.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.945+0000 7f952fdd6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9528112740 con 0x7f9528108b20 2024-07-24T22:03:32.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.945+0000 7f952fdd6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f95281125c0 con 0x7f95281081a0 2024-07-24T22:03:32.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.945+0000 7f952fdd6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f95281128c0 con 0x7f9528102790 2024-07-24T22:03:32.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f952e373640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9528108b20 0x7f95281a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:32.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f952e373640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9528108b20 0x7f95281a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56722/0 (socket says 172.21.15.47:56722) 2024-07-24T22:03:32.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f952e373640 1 -- 172.21.15.47:0/2943029205 learned_addr learned my addr 172.21.15.47:0/2943029205 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:32.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f952d371640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95281081a0 0x7f952819b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:32.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f952db72640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9528102790 0x7f952819ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:32.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f952e373640 1 -- 172.21.15.47:0/2943029205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9528102790 msgr2=0x7f952819ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:32.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f952e373640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9528102790 0x7f952819ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:32.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f952e373640 1 -- 172.21.15.47:0/2943029205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95281081a0 msgr2=0x7f952819b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:32.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f952e373640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95281081a0 0x7f952819b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:32.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f952e373640 1 -- 172.21.15.47:0/2943029205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95281a0ec0 con 0x7f9528108b20 2024-07-24T22:03:32.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f952e373640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9528108b20 0x7f95281a06f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9520005cc0 tx=0x7f952002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:32.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f951affd640 1 -- 172.21.15.47:0/2943029205 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520003bf0 con 0x7f9528108b20 2024-07-24T22:03:32.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f952fdd6640 1 -- 172.21.15.47:0/2943029205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95281a1150 con 0x7f9528108b20 2024-07-24T22:03:32.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f951affd640 1 -- 172.21.15.47:0/2943029205 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9520003d90 con 0x7f9528108b20 2024-07-24T22:03:32.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f951affd640 1 -- 172.21.15.47:0/2943029205 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952002fbc0 con 0x7f9528108b20 2024-07-24T22:03:32.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.946+0000 7f952fdd6640 1 -- 172.21.15.47:0/2943029205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95281a7870 con 0x7f9528108b20 2024-07-24T22:03:32.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.948+0000 7f952fdd6640 1 -- 172.21.15.47:0/2943029205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9528102b70 con 0x7f9528108b20 2024-07-24T22:03:32.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.951+0000 7f951affd640 1 -- 172.21.15.47:0/2943029205 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f952002fd60 con 0x7f9528108b20 2024-07-24T22:03:32.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.952+0000 7f951affd640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95140b3c20 0x7f95140b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:32.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.952+0000 7f952db72640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95140b3c20 0x7f95140b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:32.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.952+0000 7f951affd640 1 -- 172.21.15.47:0/2943029205 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7f9520105090 con 0x7f9528108b20 2024-07-24T22:03:32.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.952+0000 7f952db72640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95140b3c20 0x7f95140b60e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f952400bbe0 tx=0x7f952400b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:32.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:32.956+0000 7f951affd640 1 -- 172.21.15.47:0/2943029205 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f95200cca10 con 0x7f9528108b20 2024-07-24T22:03:33.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.199+0000 7f952fdd6640 1 -- 172.21.15.47:0/2943029205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f952810ed70 con 0x7f9528108b20 2024-07-24T22:03:33.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.199+0000 7f951affd640 1 -- 172.21.15.47:0/2943029205 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7f95200098b0 con 0x7f9528108b20 2024-07-24T22:03:33.202 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:03:33.202 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":10,"btime":"2024-07-24T22:03:30:680483+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24628,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-07-24T22:03:33.202 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 10 2024-07-24T22:03:33.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.202+0000 7f952fdd6640 1 -- 172.21.15.47:0/2943029205 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95140b3c20 msgr2=0x7f95140b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.202+0000 7f952fdd6640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95140b3c20 0x7f95140b60e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f952400bbe0 tx=0x7f952400b390 comp rx=0 tx=0).stop 2024-07-24T22:03:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.202+0000 7f952fdd6640 1 -- 172.21.15.47:0/2943029205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9528108b20 msgr2=0x7f95281a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.202+0000 7f952fdd6640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9528108b20 0x7f95281a06f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9520005cc0 tx=0x7f952002f380 comp rx=0 tx=0).stop 2024-07-24T22:03:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.202+0000 7f952fdd6640 1 -- 172.21.15.47:0/2943029205 shutdown_connections 2024-07-24T22:03:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.202+0000 7f952fdd6640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95140b3c20 0x7f95140b60e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.202+0000 7f952fdd6640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9528108b20 0x7f95281a06f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.202+0000 7f952fdd6640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95281081a0 0x7f952819b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.202+0000 7f952fdd6640 1 --2- 172.21.15.47:0/2943029205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9528102790 0x7f952819ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.202+0000 7f952fdd6640 1 -- 172.21.15.47:0/2943029205 >> 172.21.15.47:0/2943029205 conn(0x7f95280fe200 msgr2=0x7f9528075590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.202+0000 7f952fdd6640 1 -- 172.21.15.47:0/2943029205 shutdown_connections 2024-07-24T22:03:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:33.202+0000 7f952fdd6640 1 -- 172.21.15.47:0/2943029205 wait complete. 2024-07-24T22:03:33.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:33 smithi047 ceph-mon[32551]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:33.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:33 smithi188 ceph-mon[37380]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:33.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:33 smithi183 ceph-mon[37007]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:34.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:34 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2943029205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:34.436 INFO:journalctl@ceph.mds.g.smithi047.stdout:Jul 24 22:03:34 smithi047 systemd[1]: Started Ceph mds.g for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:03:34.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:34 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2943029205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:34.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:34 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2943029205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:35.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:35 smithi047 ceph-mon[32551]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:35.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:35.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:35.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:35.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:35.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:35.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:35.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:35 smithi047 ceph-mon[32551]: Deploying daemon mds.a on smithi047 2024-07-24T22:03:35.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:35 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.47:6838/3216013409,v1:172.21.15.47:6839/3216013409] up:boot 2024-07-24T22:03:35.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:35 smithi047 ceph-mon[32551]: fsmap 10 up:standby 2024-07-24T22:03:35.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:35 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-24T22:03:35.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:35 smithi183 ceph-mon[37007]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:35.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:35.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:35.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:35.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:35.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:35.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:35.666 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:35 smithi183 ceph-mon[37007]: Deploying daemon mds.a on smithi047 2024-07-24T22:03:35.666 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:35 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.47:6838/3216013409,v1:172.21.15.47:6839/3216013409] up:boot 2024-07-24T22:03:35.666 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:35 smithi183 ceph-mon[37007]: fsmap 10 up:standby 2024-07-24T22:03:35.666 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:35 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-24T22:03:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:35 smithi188 ceph-mon[37380]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:35.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:35 smithi188 ceph-mon[37380]: Deploying daemon mds.a on smithi047 2024-07-24T22:03:35.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:35 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.47:6838/3216013409,v1:172.21.15.47:6839/3216013409] up:boot 2024-07-24T22:03:35.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:35 smithi188 ceph-mon[37380]: fsmap 10 up:standby 2024-07-24T22:03:35.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:35 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-24T22:03:35.811 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:03:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:37.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:37 smithi183 ceph-mon[37007]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:37.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:37 smithi047 ceph-mon[32551]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:37.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:37 smithi188 ceph-mon[37380]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:37.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.797+0000 7fc7b11cf640 1 -- 172.21.15.47:0/3667923795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7ac1034f0 msgr2=0x7fc7ac1038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:37.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.797+0000 7fc7b11cf640 1 --2- 172.21.15.47:0/3667923795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7ac1034f0 0x7fc7ac1038d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009900 tx=0x7fc79c02a410 comp rx=0 tx=0).stop 2024-07-24T22:03:37.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.797+0000 7fc7b11cf640 1 -- 172.21.15.47:0/3667923795 shutdown_connections 2024-07-24T22:03:37.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.797+0000 7fc7b11cf640 1 --2- 172.21.15.47:0/3667923795 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7ac10caa0 0x7fc7ac10ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:37.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.797+0000 7fc7b11cf640 1 --2- 172.21.15.47:0/3667923795 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7ac103ef0 0x7fc7ac10c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:37.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.797+0000 7fc7b11cf640 1 --2- 172.21.15.47:0/3667923795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7ac1034f0 0x7fc7ac1038d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:37.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.797+0000 7fc7b11cf640 1 -- 172.21.15.47:0/3667923795 >> 172.21.15.47:0/3667923795 conn(0x7fc7ac0fd0c0 msgr2=0x7fc7ac0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:37.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.797+0000 7fc7b11cf640 1 -- 172.21.15.47:0/3667923795 shutdown_connections 2024-07-24T22:03:37.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.797+0000 7fc7b11cf640 1 -- 172.21.15.47:0/3667923795 wait complete. 2024-07-24T22:03:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.797+0000 7fc7b11cf640 1 Processor -- start 2024-07-24T22:03:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7b11cf640 1 -- start start 2024-07-24T22:03:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7b11cf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7ac1034f0 0x7fc7ac198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7b11cf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7ac103ef0 0x7fc7ac199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7b11cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7ac10caa0 0x7fc7ac19e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7b11cf640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac112710 con 0x7fc7ac1034f0 2024-07-24T22:03:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7b11cf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac112590 con 0x7fc7ac103ef0 2024-07-24T22:03:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7b11cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac112890 con 0x7fc7ac10caa0 2024-07-24T22:03:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7aad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7ac1034f0 0x7fc7ac198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7aad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7ac1034f0 0x7fc7ac198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51730/0 (socket says 172.21.15.47:51730) 2024-07-24T22:03:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7aad9d640 1 -- 172.21.15.47:0/334957903 learned_addr learned my addr 172.21.15.47:0/334957903 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7ab59e640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7ac10caa0 0x7fc7ac19e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:37.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7aa59c640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7ac103ef0 0x7fc7ac199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:37.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7aad9d640 1 -- 172.21.15.47:0/334957903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7ac10caa0 msgr2=0x7fc7ac19e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:37.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7aad9d640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7ac10caa0 0x7fc7ac19e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:37.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7aad9d640 1 -- 172.21.15.47:0/334957903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7ac103ef0 msgr2=0x7fc7ac199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:37.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7aad9d640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7ac103ef0 0x7fc7ac199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:37.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7aad9d640 1 -- 172.21.15.47:0/334957903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ac19ecf0 con 0x7fc7ac1034f0 2024-07-24T22:03:37.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.798+0000 7fc7aad9d640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7ac1034f0 0x7fc7ac198c40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc79c005940 tx=0x7fc79c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:37.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.799+0000 7fc793fff640 1 -- 172.21.15.47:0/334957903 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c03f030 con 0x7fc7ac1034f0 2024-07-24T22:03:37.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.799+0000 7fc7b11cf640 1 -- 172.21.15.47:0/334957903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ac19ef80 con 0x7fc7ac1034f0 2024-07-24T22:03:37.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.799+0000 7fc793fff640 1 -- 172.21.15.47:0/334957903 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc79c003cb0 con 0x7fc7ac1034f0 2024-07-24T22:03:37.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.799+0000 7fc793fff640 1 -- 172.21.15.47:0/334957903 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c035070 con 0x7fc7ac1034f0 2024-07-24T22:03:37.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.799+0000 7fc7b11cf640 1 -- 172.21.15.47:0/334957903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ac1a56a0 con 0x7fc7ac1034f0 2024-07-24T22:03:37.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.800+0000 7fc7b11cf640 1 -- 172.21.15.47:0/334957903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ac1038d0 con 0x7fc7ac1034f0 2024-07-24T22:03:37.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.801+0000 7fc793fff640 1 -- 172.21.15.47:0/334957903 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fc79c042030 con 0x7fc7ac1034f0 2024-07-24T22:03:37.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.802+0000 7fc793fff640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7940b3c20 0x7fc7940b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:37.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.802+0000 7fc7aa59c640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7940b3c20 0x7fc7940b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:37.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.802+0000 7fc793fff640 1 -- 172.21.15.47:0/334957903 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7fc79c104370 con 0x7fc7ac1034f0 2024-07-24T22:03:37.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.802+0000 7fc7aa59c640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7940b3c20 0x7fc7940b60e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0005fd0 tx=0x7fc7a0005850 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:37.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:37.805+0000 7fc793fff640 1 -- 172.21.15.47:0/334957903 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fc79c0cbd90 con 0x7fc7ac1034f0 2024-07-24T22:03:37.991 INFO:journalctl@ceph.mds.a.smithi047.stdout:Jul 24 22:03:37 smithi047 systemd[1]: Started Ceph mds.a for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:03:38.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.063+0000 7fc7b11cf640 1 -- 172.21.15.47:0/334957903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7ac199d70 con 0x7fc7ac1034f0 2024-07-24T22:03:38.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.064+0000 7fc793fff640 1 -- 172.21.15.47:0/334957903 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8878 (secure 0 0 0) 0x7fc79c0cb690 con 0x7fc7ac1034f0 2024-07-24T22:03:38.066 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:03:38.066 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":11,"btime":"2024-07-24T22:03:35:202472+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24628,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-07-24T22:03:38.066 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 11 2024-07-24T22:03:38.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.066+0000 7fc7b11cf640 1 -- 172.21.15.47:0/334957903 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7940b3c20 msgr2=0x7fc7940b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:38.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.066+0000 7fc7b11cf640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7940b3c20 0x7fc7940b60e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0005fd0 tx=0x7fc7a0005850 comp rx=0 tx=0).stop 2024-07-24T22:03:38.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.066+0000 7fc7b11cf640 1 -- 172.21.15.47:0/334957903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7ac1034f0 msgr2=0x7fc7ac198c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:38.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.066+0000 7fc7b11cf640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7ac1034f0 0x7fc7ac198c40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc79c005940 tx=0x7fc79c0042f0 comp rx=0 tx=0).stop 2024-07-24T22:03:38.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.066+0000 7fc7b11cf640 1 -- 172.21.15.47:0/334957903 shutdown_connections 2024-07-24T22:03:38.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.066+0000 7fc7b11cf640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7940b3c20 0x7fc7940b60e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:38.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.066+0000 7fc7b11cf640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7ac10caa0 0x7fc7ac19e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:38.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.066+0000 7fc7b11cf640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7ac103ef0 0x7fc7ac199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:38.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.066+0000 7fc7b11cf640 1 --2- 172.21.15.47:0/334957903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7ac1034f0 0x7fc7ac198c40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:38.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.066+0000 7fc7b11cf640 1 -- 172.21.15.47:0/334957903 >> 172.21.15.47:0/334957903 conn(0x7fc7ac0fd0c0 msgr2=0x7fc7ac0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:38.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.066+0000 7fc7b11cf640 1 -- 172.21.15.47:0/334957903 shutdown_connections 2024-07-24T22:03:38.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:38.066+0000 7fc7b11cf640 1 -- 172.21.15.47:0/334957903 wait complete. 2024-07-24T22:03:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:39.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:39.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:39.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:39.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:39.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:39.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:38 smithi047 ceph-mon[32551]: Deploying daemon mds.b on smithi183 2024-07-24T22:03:39.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:38 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/334957903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:39.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:38 smithi047 ceph-mon[32551]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:39.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:38 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.47:6840/516348946,v1:172.21.15.47:6841/516348946] up:boot 2024-07-24T22:03:39.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:38 smithi047 ceph-mon[32551]: fsmap 11 up:standby 2024-07-24T22:03:39.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:38 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-24T22:03:39.196 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:39.196 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:39.197 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:39.197 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:39.197 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:39.197 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:39.197 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:38 smithi183 ceph-mon[37007]: Deploying daemon mds.b on smithi183 2024-07-24T22:03:39.197 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:38 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/334957903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:39.197 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:38 smithi183 ceph-mon[37007]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:39.197 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:38 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.47:6840/516348946,v1:172.21.15.47:6841/516348946] up:boot 2024-07-24T22:03:39.197 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:38 smithi183 ceph-mon[37007]: fsmap 11 up:standby 2024-07-24T22:03:39.197 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:38 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-24T22:03:39.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:39.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:39.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:39.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-24T22:03:39.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-24T22:03:39.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:39.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:38 smithi188 ceph-mon[37380]: Deploying daemon mds.b on smithi183 2024-07-24T22:03:39.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:38 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/334957903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:39.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:38 smithi188 ceph-mon[37380]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:39.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:38 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.47:6840/516348946,v1:172.21.15.47:6841/516348946] up:boot 2024-07-24T22:03:39.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:38 smithi188 ceph-mon[37380]: fsmap 11 up:standby 2024-07-24T22:03:39.300 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:38 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-24T22:03:39.863 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:03:39 smithi183 systemd[1]: Starting Ceph mds.b for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:03:39.863 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:03:39 smithi183 podman[68045]: 2024-07-24 22:03:39.763572648 +0000 UTC m=+0.016859254 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:03:40.134 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:03:39 smithi183 podman[68045]: 2024-07-24 22:03:39.863347242 +0000 UTC m=+0.116633888 container create 579e77367107a856498ef5f05c4524b07d0808d92a6af0838ddcd62aecd75e68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-b, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240716, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-24T22:03:40.411 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:03:40 smithi183 podman[68045]: 2024-07-24 22:03:40.133095509 +0000 UTC m=+0.386382111 container init 579e77367107a856498ef5f05c4524b07d0808d92a6af0838ddcd62aecd75e68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=main-86385b1, org.label-schema.license=GPLv2) 2024-07-24T22:03:40.412 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:03:40 smithi183 podman[68045]: 2024-07-24 22:03:40.135727349 +0000 UTC m=+0.389013941 container start 579e77367107a856498ef5f05c4524b07d0808d92a6af0838ddcd62aecd75e68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=main-86385b1, GIT_CLEAN=True) 2024-07-24T22:03:40.412 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:03:40 smithi183 ceph-mds[68065]: -- 172.21.15.183:0/1813791430 <== mon.2 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559086415860 con 0x5590863f3400 2024-07-24T22:03:40.412 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:03:40 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-b[68061]: starting mds.b at 2024-07-24T22:03:40.412 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:03:40 smithi183 bash[68045]: 579e77367107a856498ef5f05c4524b07d0808d92a6af0838ddcd62aecd75e68 2024-07-24T22:03:40.412 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:03:40 smithi183 systemd[1]: Started Ceph mds.b for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:03:40.689 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:03:41.431 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:41.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:41 smithi047 ceph-mon[32551]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:41.538 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:41 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.538 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:41 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.538 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:41 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.538 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:41 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.538 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:41 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.538 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:41 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:03:41.538 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:41 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.538 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:41 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.183:6838/2872116437,v1:172.21.15.183:6839/2872116437] up:boot 2024-07-24T22:03:41.538 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:41 smithi047 ceph-mon[32551]: fsmap 12 up:standby 2024-07-24T22:03:41.538 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:41 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-24T22:03:41.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:41 smithi188 ceph-mon[37380]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:41.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:41 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:41 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:41 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:41 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:41 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:41 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:03:41.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:41 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:41 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.183:6838/2872116437,v1:172.21.15.183:6839/2872116437] up:boot 2024-07-24T22:03:41.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:41 smithi188 ceph-mon[37380]: fsmap 12 up:standby 2024-07-24T22:03:41.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:41 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-24T22:03:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:41 smithi183 ceph-mon[37007]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:41 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:41 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:41 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:41 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:41 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:41 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:03:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:41 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:41 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.183:6838/2872116437,v1:172.21.15.183:6839/2872116437] up:boot 2024-07-24T22:03:41.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:41 smithi183 ceph-mon[37007]: fsmap 12 up:standby 2024-07-24T22:03:41.663 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:41 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-24T22:03:43.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.028+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/3064508142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9ec102790 msgr2=0x7fa9ec102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:43.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.028+0000 7fa9f2ee4640 1 --2- 172.21.15.47:0/3064508142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9ec102790 0x7fa9ec102b70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009900 tx=0x7fa9e002a410 comp rx=0 tx=0).stop 2024-07-24T22:03:43.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.028+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/3064508142 shutdown_connections 2024-07-24T22:03:43.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.028+0000 7fa9f2ee4640 1 --2- 172.21.15.47:0/3064508142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9ec108b20 0x7fa9ec10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:43.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.028+0000 7fa9f2ee4640 1 --2- 172.21.15.47:0/3064508142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9ec1081a0 0x7fa9ec1085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:43.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.028+0000 7fa9f2ee4640 1 --2- 172.21.15.47:0/3064508142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9ec102790 0x7fa9ec102b70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:43.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.028+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/3064508142 >> 172.21.15.47:0/3064508142 conn(0x7fa9ec0fe200 msgr2=0x7fa9ec100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:43.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.028+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/3064508142 shutdown_connections 2024-07-24T22:03:43.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.028+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/3064508142 wait complete. 2024-07-24T22:03:43.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.029+0000 7fa9f2ee4640 1 Processor -- start 2024-07-24T22:03:43.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.029+0000 7fa9f2ee4640 1 -- start start 2024-07-24T22:03:43.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.029+0000 7fa9f2ee4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9ec102790 0x7fa9ec198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:43.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.029+0000 7fa9f2ee4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9ec1081a0 0x7fa9ec199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:43.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.029+0000 7fa9f2ee4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9ec108b20 0x7fa9ec19e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:43.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.029+0000 7fa9f2ee4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec112740 con 0x7fa9ec102790 2024-07-24T22:03:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.029+0000 7fa9f2ee4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec1125c0 con 0x7fa9ec108b20 2024-07-24T22:03:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.029+0000 7fa9f2ee4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec1128c0 con 0x7fa9ec1081a0 2024-07-24T22:03:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.029+0000 7fa9f0c80640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9ec102790 0x7fa9ec198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.029+0000 7fa9f0c80640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9ec102790 0x7fa9ec198c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51764/0 (socket says 172.21.15.47:51764) 2024-07-24T22:03:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.029+0000 7fa9f0c80640 1 -- 172.21.15.47:0/4161713309 learned_addr learned my addr 172.21.15.47:0/4161713309 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9ebfff640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9ec1081a0 0x7fa9ec199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9f0c80640 1 -- 172.21.15.47:0/4161713309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9ec1081a0 msgr2=0x7fa9ec199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9f1481640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9ec108b20 0x7fa9ec19e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9f0c80640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9ec1081a0 0x7fa9ec199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9f0c80640 1 -- 172.21.15.47:0/4161713309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9ec108b20 msgr2=0x7fa9ec19e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9f0c80640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9ec108b20 0x7fa9ec19e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9f0c80640 1 -- 172.21.15.47:0/4161713309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec19ece0 con 0x7fa9ec102790 2024-07-24T22:03:43.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9ebfff640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9ec1081a0 0x7fa9ec199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:03:43.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9f1481640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9ec108b20 0x7fa9ec19e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:03:43.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9f0c80640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9ec102790 0x7fa9ec198c30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0005940 tx=0x7fa9e00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:43.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9e9ffb640 1 -- 172.21.15.47:0/4161713309 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e003f030 con 0x7fa9ec102790 2024-07-24T22:03:43.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/4161713309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9ec19ef70 con 0x7fa9ec102790 2024-07-24T22:03:43.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9e9ffb640 1 -- 172.21.15.47:0/4161713309 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9e0003cb0 con 0x7fa9ec102790 2024-07-24T22:03:43.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9e9ffb640 1 -- 172.21.15.47:0/4161713309 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0035070 con 0x7fa9ec102790 2024-07-24T22:03:43.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.030+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/4161713309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9ec1a5690 con 0x7fa9ec102790 2024-07-24T22:03:43.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.031+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/4161713309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9ec102b70 con 0x7fa9ec102790 2024-07-24T22:03:43.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.033+0000 7fa9e9ffb640 1 -- 172.21.15.47:0/4161713309 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fa9e0042030 con 0x7fa9ec102790 2024-07-24T22:03:43.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.033+0000 7fa9e9ffb640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa9dc0b3c20 0x7fa9dc0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:43.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.033+0000 7fa9e9ffb640 1 -- 172.21.15.47:0/4161713309 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7fa9e0104460 con 0x7fa9ec102790 2024-07-24T22:03:43.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.033+0000 7fa9ebfff640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa9dc0b3c20 0x7fa9dc0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:43.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.034+0000 7fa9ebfff640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa9dc0b3c20 0x7fa9dc0b60e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec1078e0 tx=0x7fa9d8005ec0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:43.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.036+0000 7fa9e9ffb640 1 -- 172.21.15.47:0/4161713309 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fa9e00cbe80 con 0x7fa9ec102790 2024-07-24T22:03:43.112 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:43.112 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:43.112 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:43.112 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:42 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:43.112 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:42 smithi047 ceph-mon[32551]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:42 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:43.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:42 smithi183 ceph-mon[37007]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:43.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.274+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/4161713309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9ec199d60 con 0x7fa9ec102790 2024-07-24T22:03:43.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.275+0000 7fa9e9ffb640 1 -- 172.21.15.47:0/4161713309 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10530 (secure 0 0 0) 0x7fa9e00e0e20 con 0x7fa9ec102790 2024-07-24T22:03:43.277 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:03:43.277 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":13,"btime":"2024-07-24T22:03:41:121407+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24628,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-07-24T22:03:43.277 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 13 2024-07-24T22:03:43.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.278+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/4161713309 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa9dc0b3c20 msgr2=0x7fa9dc0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:43.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.278+0000 7fa9f2ee4640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa9dc0b3c20 0x7fa9dc0b60e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec1078e0 tx=0x7fa9d8005ec0 comp rx=0 tx=0).stop 2024-07-24T22:03:43.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.278+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/4161713309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9ec102790 msgr2=0x7fa9ec198c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:43.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.278+0000 7fa9f2ee4640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9ec102790 0x7fa9ec198c30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0005940 tx=0x7fa9e00042f0 comp rx=0 tx=0).stop 2024-07-24T22:03:43.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.278+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/4161713309 shutdown_connections 2024-07-24T22:03:43.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.278+0000 7fa9f2ee4640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa9dc0b3c20 0x7fa9dc0b60e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:43.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.278+0000 7fa9f2ee4640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9ec108b20 0x7fa9ec19e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:43.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.278+0000 7fa9f2ee4640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9ec1081a0 0x7fa9ec199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:43.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.278+0000 7fa9f2ee4640 1 --2- 172.21.15.47:0/4161713309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9ec102790 0x7fa9ec198c30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:43.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.278+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/4161713309 >> 172.21.15.47:0/4161713309 conn(0x7fa9ec0fe200 msgr2=0x7fa9ec0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:43.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.278+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/4161713309 shutdown_connections 2024-07-24T22:03:43.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:43.278+0000 7fa9f2ee4640 1 -- 172.21.15.47:0/4161713309 wait complete. 2024-07-24T22:03:43.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:43.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:43.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:43.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:42 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:43.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:42 smithi188 ceph-mon[37380]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:44.098 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-07-24T22:03:44.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:43 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/4161713309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:44.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:43 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/4161713309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:44.404 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:44.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:43 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/4161713309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:03:45.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:45 smithi188 ceph-mon[37380]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:45.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:45.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:45.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:45.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:03:45.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:45.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:45 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:03:45.550 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:45 smithi047 ceph-mon[32551]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:45.550 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:45.550 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:45.550 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:45.550 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:03:45.550 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:45.550 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:45 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:03:45.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:45 smithi183 ceph-mon[37007]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:03:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:45 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:03:46.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.043+0000 7fa5f2f12640 1 -- 172.21.15.47:0/4198383055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec108b20 msgr2=0x7fa5ec10f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:46.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.043+0000 7fa5f2f12640 1 --2- 172.21.15.47:0/4198383055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec108b20 0x7fa5ec10f320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009ca0 tx=0x7fa5e402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:03:46.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.043+0000 7fa5f2f12640 1 -- 172.21.15.47:0/4198383055 shutdown_connections 2024-07-24T22:03:46.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.043+0000 7fa5f2f12640 1 --2- 172.21.15.47:0/4198383055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec108b20 0x7fa5ec10f320 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:46.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.043+0000 7fa5f2f12640 1 --2- 172.21.15.47:0/4198383055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5ec1081a0 0x7fa5ec1085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:46.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.043+0000 7fa5f2f12640 1 --2- 172.21.15.47:0/4198383055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5ec102790 0x7fa5ec102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:46.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.043+0000 7fa5f2f12640 1 -- 172.21.15.47:0/4198383055 >> 172.21.15.47:0/4198383055 conn(0x7fa5ec0fe200 msgr2=0x7fa5ec100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:46.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.043+0000 7fa5f2f12640 1 -- 172.21.15.47:0/4198383055 shutdown_connections 2024-07-24T22:03:46.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.043+0000 7fa5f2f12640 1 -- 172.21.15.47:0/4198383055 wait complete. 2024-07-24T22:03:46.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.044+0000 7fa5f2f12640 1 Processor -- start 2024-07-24T22:03:46.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.044+0000 7fa5f2f12640 1 -- start start 2024-07-24T22:03:46.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.044+0000 7fa5f2f12640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5ec102790 0x7fa5ec074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:46.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.044+0000 7fa5f2f12640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec1081a0 0x7fa5ec0753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:46.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.044+0000 7fa5f2f12640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5ec108b20 0x7fa5ec075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:46.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.044+0000 7fa5f2f12640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec1127a0 con 0x7fa5ec1081a0 2024-07-24T22:03:46.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.044+0000 7fa5f2f12640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec112620 con 0x7fa5ec102790 2024-07-24T22:03:46.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.044+0000 7fa5f2f12640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec112920 con 0x7fa5ec108b20 2024-07-24T22:03:46.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.044+0000 7fa5ebfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec1081a0 0x7fa5ec0753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:46.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.044+0000 7fa5ebfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec1081a0 0x7fa5ec0753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43026/0 (socket says 172.21.15.47:43026) 2024-07-24T22:03:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.044+0000 7fa5ebfff640 1 -- 172.21.15.47:0/3660658488 learned_addr learned my addr 172.21.15.47:0/3660658488 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.044+0000 7fa5f14af640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5ec108b20 0x7fa5ec075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.044+0000 7fa5f0cae640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5ec102790 0x7fa5ec074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.045+0000 7fa5ebfff640 1 -- 172.21.15.47:0/3660658488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5ec108b20 msgr2=0x7fa5ec075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.045+0000 7fa5ebfff640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5ec108b20 0x7fa5ec075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.045+0000 7fa5ebfff640 1 -- 172.21.15.47:0/3660658488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5ec102790 msgr2=0x7fa5ec074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.045+0000 7fa5ebfff640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5ec102790 0x7fa5ec074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.045+0000 7fa5ebfff640 1 -- 172.21.15.47:0/3660658488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ec1a70f0 con 0x7fa5ec1081a0 2024-07-24T22:03:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.045+0000 7fa5f0cae640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5ec102790 0x7fa5ec074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:03:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.045+0000 7fa5ebfff640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec1081a0 0x7fa5ec0753d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000b4a0 tx=0x7fa5e000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.045+0000 7fa5e9ffb640 1 -- 172.21.15.47:0/3660658488 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0014070 con 0x7fa5ec1081a0 2024-07-24T22:03:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.045+0000 7fa5f2f12640 1 -- 172.21.15.47:0/3660658488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5ec1a73e0 con 0x7fa5ec1081a0 2024-07-24T22:03:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.045+0000 7fa5e9ffb640 1 -- 172.21.15.47:0/3660658488 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5e0010ac0 con 0x7fa5ec1081a0 2024-07-24T22:03:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.045+0000 7fa5e9ffb640 1 -- 172.21.15.47:0/3660658488 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0017c30 con 0x7fa5ec1081a0 2024-07-24T22:03:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.045+0000 7fa5f2f12640 1 -- 172.21.15.47:0/3660658488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5ec1a79f0 con 0x7fa5ec1081a0 2024-07-24T22:03:46.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.046+0000 7fa5f2f12640 1 -- 172.21.15.47:0/3660658488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5ec102b70 con 0x7fa5ec1081a0 2024-07-24T22:03:46.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.047+0000 7fa5e9ffb640 1 -- 172.21.15.47:0/3660658488 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fa5e0017070 con 0x7fa5ec1081a0 2024-07-24T22:03:46.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.048+0000 7fa5e9ffb640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa5d40b3c20 0x7fa5d40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:46.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.048+0000 7fa5f0cae640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa5d40b3c20 0x7fa5d40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:46.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.048+0000 7fa5e9ffb640 1 -- 172.21.15.47:0/3660658488 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7fa5e00e3050 con 0x7fa5ec1081a0 2024-07-24T22:03:46.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.049+0000 7fa5f0cae640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa5d40b3c20 0x7fa5d40b60e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0058c0 tx=0x7fa5dc005850 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:46.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.052+0000 7fa5e9ffb640 1 -- 172.21.15.47:0/3660658488 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fa5e00aaa70 con 0x7fa5ec1081a0 2024-07-24T22:03:46.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.257+0000 7fa5f2f12640 1 -- 172.21.15.47:0/3660658488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa5ec10a370 con 0x7fa5ec1081a0 2024-07-24T22:03:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.258+0000 7fa5e9ffb640 1 -- 172.21.15.47:0/3660658488 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7fa5e00aa370 con 0x7fa5ec1081a0 2024-07-24T22:03:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:03:46.260 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-07-24T22:03:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:03:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-07-24T22:03:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-07-24T22:03:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:03:46.260 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-07-24T22:03:46.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.260+0000 7fa5f2f12640 1 -- 172.21.15.47:0/3660658488 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa5d40b3c20 msgr2=0x7fa5d40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:46.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.260+0000 7fa5f2f12640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa5d40b3c20 0x7fa5d40b60e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0058c0 tx=0x7fa5dc005850 comp rx=0 tx=0).stop 2024-07-24T22:03:46.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.260+0000 7fa5f2f12640 1 -- 172.21.15.47:0/3660658488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec1081a0 msgr2=0x7fa5ec0753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:46.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.260+0000 7fa5f2f12640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec1081a0 0x7fa5ec0753d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000b4a0 tx=0x7fa5e000b960 comp rx=0 tx=0).stop 2024-07-24T22:03:46.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.260+0000 7fa5f2f12640 1 -- 172.21.15.47:0/3660658488 shutdown_connections 2024-07-24T22:03:46.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.260+0000 7fa5f2f12640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa5d40b3c20 0x7fa5d40b60e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:46.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.260+0000 7fa5f2f12640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5ec108b20 0x7fa5ec075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.260+0000 7fa5f2f12640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec1081a0 0x7fa5ec0753d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.260+0000 7fa5f2f12640 1 --2- 172.21.15.47:0/3660658488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5ec102790 0x7fa5ec074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.260+0000 7fa5f2f12640 1 -- 172.21.15.47:0/3660658488 >> 172.21.15.47:0/3660658488 conn(0x7fa5ec0fe200 msgr2=0x7fa5ec1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.260+0000 7fa5f2f12640 1 -- 172.21.15.47:0/3660658488 shutdown_connections 2024-07-24T22:03:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:46.260+0000 7fa5f2f12640 1 -- 172.21.15.47:0/3660658488 wait complete. 2024-07-24T22:03:46.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:46.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:46.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:46.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:46 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:46.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:46 smithi047 ceph-mon[32551]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:46.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:46 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3660658488' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-07-24T22:03:47.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:47.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:47.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:47.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:46 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:47.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:46 smithi188 ceph-mon[37380]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:47.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:46 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3660658488' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-07-24T22:03:47.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:47.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:47.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:47.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:46 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:47.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:46 smithi183 ceph-mon[37007]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:47.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:46 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3660658488' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-07-24T22:03:47.289 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-07-24T22:03:47.289 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-07-24T22:03:47.595 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.123+0000 7f51a81db640 1 -- 172.21.15.47:0/3387526596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a0102790 msgr2=0x7f51a0102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.123+0000 7f51a81db640 1 --2- 172.21.15.47:0/3387526596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a0102790 0x7f51a0102b70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f519c009900 tx=0x7f519c02a410 comp rx=0 tx=0).stop 2024-07-24T22:03:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.123+0000 7f51a81db640 1 -- 172.21.15.47:0/3387526596 shutdown_connections 2024-07-24T22:03:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.123+0000 7f51a81db640 1 --2- 172.21.15.47:0/3387526596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a0108b20 0x7f51a010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.123+0000 7f51a81db640 1 --2- 172.21.15.47:0/3387526596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51a01081a0 0x7f51a01085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.123+0000 7f51a81db640 1 --2- 172.21.15.47:0/3387526596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a0102790 0x7f51a0102b70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.123+0000 7f51a81db640 1 -- 172.21.15.47:0/3387526596 >> 172.21.15.47:0/3387526596 conn(0x7f51a00fe200 msgr2=0x7f51a0100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.123+0000 7f51a81db640 1 -- 172.21.15.47:0/3387526596 shutdown_connections 2024-07-24T22:03:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.123+0000 7f51a81db640 1 -- 172.21.15.47:0/3387526596 wait complete. 2024-07-24T22:03:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.124+0000 7f51a81db640 1 Processor -- start 2024-07-24T22:03:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.124+0000 7f51a81db640 1 -- start start 2024-07-24T22:03:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.124+0000 7f51a81db640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51a0102790 0x7f51a0198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.124+0000 7f51a81db640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a01081a0 0x7f51a01991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.124+0000 7f51a81db640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a0108b20 0x7f51a019e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.124+0000 7f51a81db640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01127a0 con 0x7f51a01081a0 2024-07-24T22:03:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.124+0000 7f51a81db640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0112620 con 0x7f51a0108b20 2024-07-24T22:03:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.124+0000 7f51a81db640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0112920 con 0x7f51a0102790 2024-07-24T22:03:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.124+0000 7f51a5776640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a01081a0 0x7f51a01991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.124+0000 7f51a5776640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a01081a0 0x7f51a01991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43030/0 (socket says 172.21.15.47:43030) 2024-07-24T22:03:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f51a5776640 1 -- 172.21.15.47:0/3463607093 learned_addr learned my addr 172.21.15.47:0/3463607093 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f51a6778640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a0108b20 0x7f51a019e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f51a5f77640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51a0102790 0x7f51a0198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f51a5776640 1 -- 172.21.15.47:0/3463607093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51a0102790 msgr2=0x7f51a0198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f51a5776640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51a0102790 0x7f51a0198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f51a5776640 1 -- 172.21.15.47:0/3463607093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a0108b20 msgr2=0x7f51a019e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f51a5776640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a0108b20 0x7f51a019e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f51a5776640 1 -- 172.21.15.47:0/3463607093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a019ed60 con 0x7f51a01081a0 2024-07-24T22:03:49.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f51a5776640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a01081a0 0x7f51a01991f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f519000b4a0 tx=0x7f519000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:49.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f5196ffd640 1 -- 172.21.15.47:0/3463607093 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190014070 con 0x7f51a01081a0 2024-07-24T22:03:49.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f5196ffd640 1 -- 172.21.15.47:0/3463607093 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5190010ac0 con 0x7f51a01081a0 2024-07-24T22:03:49.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f51a81db640 1 -- 172.21.15.47:0/3463607093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a019f050 con 0x7f51a01081a0 2024-07-24T22:03:49.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f5196ffd640 1 -- 172.21.15.47:0/3463607093 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190017c30 con 0x7f51a01081a0 2024-07-24T22:03:49.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.125+0000 7f51a81db640 1 -- 172.21.15.47:0/3463607093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a01a58e0 con 0x7f51a01081a0 2024-07-24T22:03:49.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.126+0000 7f51a81db640 1 -- 172.21.15.47:0/3463607093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a0102b70 con 0x7f51a01081a0 2024-07-24T22:03:49.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.128+0000 7f5196ffd640 1 -- 172.21.15.47:0/3463607093 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f5190017070 con 0x7f51a01081a0 2024-07-24T22:03:49.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.128+0000 7f5196ffd640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f518c0b3ca0 0x7f518c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:49.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.129+0000 7f51a5f77640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f518c0b3ca0 0x7f518c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:49.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.129+0000 7f5196ffd640 1 -- 172.21.15.47:0/3463607093 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7342+0+0 (secure 0 0 0) 0x7f51900e3090 con 0x7f51a01081a0 2024-07-24T22:03:49.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.129+0000 7f51a5f77640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f518c0b3ca0 0x7f518c0b6160 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f519c031440 tx=0x7f519c0095f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:49.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.131+0000 7f5196ffd640 1 -- 172.21.15.47:0/3463607093 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f51900aaab0 con 0x7f51a01081a0 2024-07-24T22:03:49.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.325+0000 7f51a81db640 1 -- 172.21.15.47:0/3463607093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f51a0199de0 con 0x7f51a01081a0 2024-07-24T22:03:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.365+0000 7f5196ffd640 1 -- 172.21.15.47:0/3463607093 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7f51a0199de0 con 0x7f51a01081a0 2024-07-24T22:03:49.368 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-07-24T22:03:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.368+0000 7f51a81db640 1 -- 172.21.15.47:0/3463607093 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f518c0b3ca0 msgr2=0x7f518c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.368+0000 7f51a81db640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f518c0b3ca0 0x7f518c0b6160 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f519c031440 tx=0x7f519c0095f0 comp rx=0 tx=0).stop 2024-07-24T22:03:49.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.368+0000 7f51a81db640 1 -- 172.21.15.47:0/3463607093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a01081a0 msgr2=0x7f51a01991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:49.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.368+0000 7f51a81db640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a01081a0 0x7f51a01991f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f519000b4a0 tx=0x7f519000b960 comp rx=0 tx=0).stop 2024-07-24T22:03:49.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.368+0000 7f51a81db640 1 -- 172.21.15.47:0/3463607093 shutdown_connections 2024-07-24T22:03:49.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.368+0000 7f51a81db640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f518c0b3ca0 0x7f518c0b6160 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:49.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.368+0000 7f51a81db640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a0108b20 0x7f51a019e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:49.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.368+0000 7f51a81db640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a01081a0 0x7f51a01991f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:49.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.368+0000 7f51a81db640 1 --2- 172.21.15.47:0/3463607093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51a0102790 0x7f51a0198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:49.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.368+0000 7f51a81db640 1 -- 172.21.15.47:0/3463607093 >> 172.21.15.47:0/3463607093 conn(0x7f51a00fe200 msgr2=0x7f51a01005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:49.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.368+0000 7f51a81db640 1 -- 172.21.15.47:0/3463607093 shutdown_connections 2024-07-24T22:03:49.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:49.368+0000 7f51a81db640 1 -- 172.21.15.47:0/3463607093 wait complete. 2024-07-24T22:03:49.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:49 smithi183 ceph-mon[37007]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:49.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:49.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:49.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:49.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:03:49.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:49 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:49.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:49 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3463607093' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-07-24T22:03:49.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:49 smithi047 ceph-mon[32551]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:49.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:49.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:49.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:49.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:03:49.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:49 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:49.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:49 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3463607093' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-07-24T22:03:49.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:49 smithi188 ceph-mon[37380]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:03:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:03:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:49 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:03:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:49 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3463607093' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-07-24T22:03:50.020 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-07-24T22:03:50.286 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:50.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:50 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3463607093' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-07-24T22:03:50.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:50 smithi047 ceph-mon[32551]: osdmap e75: 12 total, 12 up, 12 in 2024-07-24T22:03:50.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:50 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3463607093' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-07-24T22:03:50.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:50 smithi183 ceph-mon[37007]: osdmap e75: 12 total, 12 up, 12 in 2024-07-24T22:03:50.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:50 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3463607093' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-07-24T22:03:50.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:50 smithi188 ceph-mon[37380]: osdmap e75: 12 total, 12 up, 12 in 2024-07-24T22:03:51.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:51 smithi047 ceph-mon[32551]: pgmap v255: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:51.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:51 smithi047 ceph-mon[32551]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-24T22:03:51.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:51 smithi047 ceph-mon[32551]: osdmap e76: 12 total, 12 up, 12 in 2024-07-24T22:03:51.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:51 smithi183 ceph-mon[37007]: pgmap v255: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:51.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:51 smithi183 ceph-mon[37007]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-24T22:03:51.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:51 smithi183 ceph-mon[37007]: osdmap e76: 12 total, 12 up, 12 in 2024-07-24T22:03:51.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:51 smithi188 ceph-mon[37380]: pgmap v255: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:51.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:51 smithi188 ceph-mon[37380]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-24T22:03:51.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:51 smithi188 ceph-mon[37380]: osdmap e76: 12 total, 12 up, 12 in 2024-07-24T22:03:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.823+0000 7f3700609640 1 -- 172.21.15.47:0/757842266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f8107a20 msgr2=0x7f36f810e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.823+0000 7f3700609640 1 --2- 172.21.15.47:0/757842266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f8107a20 0x7f36f810e220 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009ca0 tx=0x7f36f002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:03:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.823+0000 7f3700609640 1 -- 172.21.15.47:0/757842266 shutdown_connections 2024-07-24T22:03:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.823+0000 7f3700609640 1 --2- 172.21.15.47:0/757842266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f8107a20 0x7f36f810e220 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.823+0000 7f3700609640 1 --2- 172.21.15.47:0/757842266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f81070a0 0x7f36f81074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.823+0000 7f3700609640 1 --2- 172.21.15.47:0/757842266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f8101690 0x7f36f8101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.823+0000 7f3700609640 1 -- 172.21.15.47:0/757842266 >> 172.21.15.47:0/757842266 conn(0x7f36f80fd100 msgr2=0x7f36f80ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.823+0000 7f3700609640 1 -- 172.21.15.47:0/757842266 shutdown_connections 2024-07-24T22:03:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.823+0000 7f3700609640 1 -- 172.21.15.47:0/757842266 wait complete. 2024-07-24T22:03:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.824+0000 7f3700609640 1 Processor -- start 2024-07-24T22:03:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.824+0000 7f3700609640 1 -- start start 2024-07-24T22:03:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.824+0000 7f3700609640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f8101690 0x7f36f8198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.824+0000 7f3700609640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f81070a0 0x7f36f81991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.824+0000 7f3700609640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f8107a20 0x7f36f819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.824+0000 7f3700609640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36f81116b0 con 0x7f36f81070a0 2024-07-24T22:03:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.824+0000 7f3700609640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f36f8111530 con 0x7f36f8101690 2024-07-24T22:03:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.824+0000 7f3700609640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f36f8111830 con 0x7f36f8107a20 2024-07-24T22:03:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.824+0000 7f36fdba4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f81070a0 0x7f36f81991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f36fdba4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f81070a0 0x7f36f81991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43052/0 (socket says 172.21.15.47:43052) 2024-07-24T22:03:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f36fdba4640 1 -- 172.21.15.47:0/38420324 learned_addr learned my addr 172.21.15.47:0/38420324 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f36fe3a5640 1 --2- 172.21.15.47:0/38420324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f8101690 0x7f36f8198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f36fdba4640 1 -- 172.21.15.47:0/38420324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f8107a20 msgr2=0x7f36f819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f36fdba4640 1 --2- 172.21.15.47:0/38420324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f8107a20 0x7f36f819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f36fdba4640 1 -- 172.21.15.47:0/38420324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f8101690 msgr2=0x7f36f8198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f36fdba4640 1 --2- 172.21.15.47:0/38420324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f8101690 0x7f36f8198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f36fdba4640 1 -- 172.21.15.47:0/38420324 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f819ed20 con 0x7f36f81070a0 2024-07-24T22:03:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f36fdba4640 1 --2- 172.21.15.47:0/38420324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f81070a0 0x7f36f81991b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36e800c890 tx=0x7f36e800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f36ef7fe640 1 -- 172.21.15.47:0/38420324 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e8004220 con 0x7f36f81070a0 2024-07-24T22:03:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f3700609640 1 -- 172.21.15.47:0/38420324 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f819f010 con 0x7f36f81070a0 2024-07-24T22:03:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f36ef7fe640 1 -- 172.21.15.47:0/38420324 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36e80043c0 con 0x7f36f81070a0 2024-07-24T22:03:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f36ef7fe640 1 -- 172.21.15.47:0/38420324 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e8004a00 con 0x7f36f81070a0 2024-07-24T22:03:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.825+0000 7f3700609640 1 -- 172.21.15.47:0/38420324 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f81a5750 con 0x7f36f81070a0 2024-07-24T22:03:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.826+0000 7f3700609640 1 -- 172.21.15.47:0/38420324 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f8101a70 con 0x7f36f81070a0 2024-07-24T22:03:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.828+0000 7f36ef7fe640 1 -- 172.21.15.47:0/38420324 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f36e80079b0 con 0x7f36f81070a0 2024-07-24T22:03:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.829+0000 7f36ef7fe640 1 --2- 172.21.15.47:0/38420324 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f36e40b3c20 0x7f36e40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.829+0000 7f36fe3a5640 1 --2- 172.21.15.47:0/38420324 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f36e40b3c20 0x7f36e40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.829+0000 7f36ef7fe640 1 -- 172.21.15.47:0/38420324 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7712+0+0 (secure 0 0 0) 0x7f36e80e3cb0 con 0x7f36f81070a0 2024-07-24T22:03:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.830+0000 7f36fe3a5640 1 --2- 172.21.15.47:0/38420324 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f36e40b3c20 0x7f36e40b60e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009890 tx=0x7f36f4008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:51.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:51.832+0000 7f36ef7fe640 1 -- 172.21.15.47:0/38420324 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f36e8014030 con 0x7f36f81070a0 2024-07-24T22:03:52.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.030+0000 7f3700609640 1 -- 172.21.15.47:0/38420324 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f36f8199da0 con 0x7f36f81070a0 2024-07-24T22:03:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.383+0000 7f36ef7fe640 1 -- 172.21.15.47:0/38420324 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7f36e80ab4e0 con 0x7f36f81070a0 2024-07-24T22:03:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-07-24T22:03:52.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.386+0000 7f3700609640 1 -- 172.21.15.47:0/38420324 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f36e40b3c20 msgr2=0x7f36e40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:52.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.386+0000 7f3700609640 1 --2- 172.21.15.47:0/38420324 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f36e40b3c20 0x7f36e40b60e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009890 tx=0x7f36f4008040 comp rx=0 tx=0).stop 2024-07-24T22:03:52.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.386+0000 7f3700609640 1 -- 172.21.15.47:0/38420324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f81070a0 msgr2=0x7f36f81991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:52.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.386+0000 7f3700609640 1 --2- 172.21.15.47:0/38420324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f81070a0 0x7f36f81991b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36e800c890 tx=0x7f36e800cd50 comp rx=0 tx=0).stop 2024-07-24T22:03:52.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.386+0000 7f3700609640 1 -- 172.21.15.47:0/38420324 shutdown_connections 2024-07-24T22:03:52.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.386+0000 7f3700609640 1 --2- 172.21.15.47:0/38420324 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f36e40b3c20 0x7f36e40b60e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:52.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.386+0000 7f3700609640 1 --2- 172.21.15.47:0/38420324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36f8107a20 0x7f36f819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:52.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.386+0000 7f3700609640 1 --2- 172.21.15.47:0/38420324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f81070a0 0x7f36f81991b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:52.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.386+0000 7f3700609640 1 --2- 172.21.15.47:0/38420324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36f8101690 0x7f36f8198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:52.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.386+0000 7f3700609640 1 -- 172.21.15.47:0/38420324 >> 172.21.15.47:0/38420324 conn(0x7f36f80fd100 msgr2=0x7f36f806b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:52.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.387+0000 7f3700609640 1 -- 172.21.15.47:0/38420324 shutdown_connections 2024-07-24T22:03:52.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:52.387+0000 7f3700609640 1 -- 172.21.15.47:0/38420324 wait complete. 2024-07-24T22:03:52.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:52 smithi183 ceph-mon[37007]: osdmap e77: 12 total, 12 up, 12 in 2024-07-24T22:03:52.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:52 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/38420324' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-07-24T22:03:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:52 smithi047 ceph-mon[32551]: osdmap e77: 12 total, 12 up, 12 in 2024-07-24T22:03:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:52 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/38420324' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-07-24T22:03:52.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:52 smithi188 ceph-mon[37380]: osdmap e77: 12 total, 12 up, 12 in 2024-07-24T22:03:52.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:52 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/38420324' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-07-24T22:03:52.987 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-07-24T22:03:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:53.657 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:53 smithi047 ceph-mon[32551]: pgmap v258: 33 pgs: 5 creating+peering, 15 unknown, 13 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:53.657 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:53 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/38420324' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-07-24T22:03:53.657 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:53 smithi047 ceph-mon[32551]: osdmap e78: 12 total, 12 up, 12 in 2024-07-24T22:03:53.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:53 smithi183 ceph-mon[37007]: pgmap v258: 33 pgs: 5 creating+peering, 15 unknown, 13 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:53.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:53 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/38420324' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-07-24T22:03:53.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:53 smithi183 ceph-mon[37007]: osdmap e78: 12 total, 12 up, 12 in 2024-07-24T22:03:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:53 smithi188 ceph-mon[37380]: pgmap v258: 33 pgs: 5 creating+peering, 15 unknown, 13 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:53.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:53 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/38420324' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-07-24T22:03:53.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:53 smithi188 ceph-mon[37380]: osdmap e78: 12 total, 12 up, 12 in 2024-07-24T22:03:54.518 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:54 smithi047 ceph-mon[32551]: osdmap e79: 12 total, 12 up, 12 in 2024-07-24T22:03:54.519 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:54 smithi047 ceph-mon[32551]: osdmap e80: 12 total, 12 up, 12 in 2024-07-24T22:03:54.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:54 smithi183 ceph-mon[37007]: osdmap e79: 12 total, 12 up, 12 in 2024-07-24T22:03:54.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:54 smithi183 ceph-mon[37007]: osdmap e80: 12 total, 12 up, 12 in 2024-07-24T22:03:54.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.717+0000 7f2ca88ee640 1 -- 172.21.15.47:0/367356797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca4108b00 msgr2=0x7f2ca410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:54.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.717+0000 7f2ca88ee640 1 --2- 172.21.15.47:0/367356797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca4108b00 0x7f2ca410f300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009900 tx=0x7f2c9c02a410 comp rx=0 tx=0).stop 2024-07-24T22:03:54.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.717+0000 7f2ca88ee640 1 -- 172.21.15.47:0/367356797 shutdown_connections 2024-07-24T22:03:54.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.717+0000 7f2ca88ee640 1 --2- 172.21.15.47:0/367356797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca4108b00 0x7f2ca410f300 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:54.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.717+0000 7f2ca88ee640 1 --2- 172.21.15.47:0/367356797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ca4108180 0x7f2ca41085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:54.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.717+0000 7f2ca88ee640 1 --2- 172.21.15.47:0/367356797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ca4102770 0x7f2ca4102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:54.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.717+0000 7f2ca88ee640 1 -- 172.21.15.47:0/367356797 >> 172.21.15.47:0/367356797 conn(0x7f2ca40fe1c0 msgr2=0x7f2ca41005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:54.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.717+0000 7f2ca88ee640 1 -- 172.21.15.47:0/367356797 shutdown_connections 2024-07-24T22:03:54.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.717+0000 7f2ca88ee640 1 -- 172.21.15.47:0/367356797 wait complete. 2024-07-24T22:03:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.718+0000 7f2ca88ee640 1 Processor -- start 2024-07-24T22:03:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.718+0000 7f2ca88ee640 1 -- start start 2024-07-24T22:03:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.718+0000 7f2ca88ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca4102770 0x7f2ca4074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.718+0000 7f2ca88ee640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ca4108180 0x7f2ca40753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.718+0000 7f2ca88ee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ca4108b00 0x7f2ca4075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.718+0000 7f2ca88ee640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca4112730 con 0x7f2ca4102770 2024-07-24T22:03:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.718+0000 7f2ca88ee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca41125b0 con 0x7f2ca4108b00 2024-07-24T22:03:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.718+0000 7f2ca88ee640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca41128b0 con 0x7f2ca4108180 2024-07-24T22:03:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.718+0000 7f2ca259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca4102770 0x7f2ca4074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2ca259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca4102770 0x7f2ca4074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43068/0 (socket says 172.21.15.47:43068) 2024-07-24T22:03:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2ca259c640 1 -- 172.21.15.47:0/2533373166 learned_addr learned my addr 172.21.15.47:0/2533373166 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2ca2d9d640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ca4108b00 0x7f2ca4075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2ca1d9b640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ca4108180 0x7f2ca40753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2ca259c640 1 -- 172.21.15.47:0/2533373166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ca4108180 msgr2=0x7f2ca40753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2ca259c640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ca4108180 0x7f2ca40753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2ca259c640 1 -- 172.21.15.47:0/2533373166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ca4108b00 msgr2=0x7f2ca4075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2ca259c640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ca4108b00 0x7f2ca4075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2ca259c640 1 -- 172.21.15.47:0/2533373166 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca41a6f80 con 0x7f2ca4102770 2024-07-24T22:03:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2ca259c640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca4102770 0x7f2ca4074e90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400cce0 tx=0x7f2c9400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2c937fe640 1 -- 172.21.15.47:0/2533373166 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9400f650 con 0x7f2ca4102770 2024-07-24T22:03:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2c937fe640 1 -- 172.21.15.47:0/2533373166 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c9400fca0 con 0x7f2ca4102770 2024-07-24T22:03:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2ca88ee640 1 -- 172.21.15.47:0/2533373166 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca41a7270 con 0x7f2ca4102770 2024-07-24T22:03:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2c937fe640 1 -- 172.21.15.47:0/2533373166 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94018b40 con 0x7f2ca4102770 2024-07-24T22:03:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.719+0000 7f2ca88ee640 1 -- 172.21.15.47:0/2533373166 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca41a77b0 con 0x7f2ca4102770 2024-07-24T22:03:54.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.720+0000 7f2ca88ee640 1 -- 172.21.15.47:0/2533373166 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca4102b50 con 0x7f2ca4102770 2024-07-24T22:03:54.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.722+0000 7f2c937fe640 1 -- 172.21.15.47:0/2533373166 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f2c94018d00 con 0x7f2ca4102770 2024-07-24T22:03:54.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.723+0000 7f2c937fe640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2c8c0b3c20 0x7f2c8c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:54.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.723+0000 7f2ca1d9b640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2c8c0b3c20 0x7f2c8c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:54.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.723+0000 7f2c937fe640 1 -- 172.21.15.47:0/2533373166 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8094+0+0 (secure 0 0 0) 0x7f2c940e42c0 con 0x7f2ca4102770 2024-07-24T22:03:54.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.723+0000 7f2ca1d9b640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2c8c0b3c20 0x7f2c8c0b60e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4076980 tx=0x7f2c9800b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:54.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.726+0000 7f2c937fe640 1 -- 172.21.15.47:0/2533373166 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f2c94014030 con 0x7f2ca4102770 2024-07-24T22:03:54.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:54 smithi188 ceph-mon[37380]: osdmap e79: 12 total, 12 up, 12 in 2024-07-24T22:03:54.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:54 smithi188 ceph-mon[37380]: osdmap e80: 12 total, 12 up, 12 in 2024-07-24T22:03:54.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:54.958+0000 7f2ca88ee640 1 -- 172.21.15.47:0/2533373166 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2ca41a7ba0 con 0x7f2ca4102770 2024-07-24T22:03:55.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:55.400+0000 7f2c937fe640 1 -- 172.21.15.47:0/2533373166 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f2c940ab9e0 con 0x7f2ca4102770 2024-07-24T22:03:55.402 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 2 and data pool 3 2024-07-24T22:03:55.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:55.403+0000 7f2ca88ee640 1 -- 172.21.15.47:0/2533373166 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2c8c0b3c20 msgr2=0x7f2c8c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:55.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:55.403+0000 7f2ca88ee640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2c8c0b3c20 0x7f2c8c0b60e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4076980 tx=0x7f2c9800b390 comp rx=0 tx=0).stop 2024-07-24T22:03:55.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:55.403+0000 7f2ca88ee640 1 -- 172.21.15.47:0/2533373166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca4102770 msgr2=0x7f2ca4074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:55.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:55.403+0000 7f2ca88ee640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca4102770 0x7f2ca4074e90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400cce0 tx=0x7f2c9400a620 comp rx=0 tx=0).stop 2024-07-24T22:03:55.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:55.403+0000 7f2ca88ee640 1 -- 172.21.15.47:0/2533373166 shutdown_connections 2024-07-24T22:03:55.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:55.403+0000 7f2ca88ee640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2c8c0b3c20 0x7f2c8c0b60e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:55.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:55.403+0000 7f2ca88ee640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ca4108b00 0x7f2ca4075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:55.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:55.403+0000 7f2ca88ee640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ca4108180 0x7f2ca40753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:55.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:55.403+0000 7f2ca88ee640 1 --2- 172.21.15.47:0/2533373166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca4102770 0x7f2ca4074e90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:55.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:55.403+0000 7f2ca88ee640 1 -- 172.21.15.47:0/2533373166 >> 172.21.15.47:0/2533373166 conn(0x7f2ca40fe1c0 msgr2=0x7f2ca41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:55.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:55.404+0000 7f2ca88ee640 1 -- 172.21.15.47:0/2533373166 shutdown_connections 2024-07-24T22:03:55.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:55.404+0000 7f2ca88ee640 1 -- 172.21.15.47:0/2533373166 wait complete. 2024-07-24T22:03:55.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:55 smithi183 ceph-mon[37007]: pgmap v261: 97 pgs: 17 creating+peering, 43 unknown, 37 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:55.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:55 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2533373166' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-07-24T22:03:55.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:55 smithi183 ceph-mon[37007]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-07-24T22:03:55.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:55 smithi047 ceph-mon[32551]: pgmap v261: 97 pgs: 17 creating+peering, 43 unknown, 37 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:55.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:55 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2533373166' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-07-24T22:03:55.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:55 smithi047 ceph-mon[32551]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-07-24T22:03:55.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:55 smithi188 ceph-mon[37380]: pgmap v261: 97 pgs: 17 creating+peering, 43 unknown, 37 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:55.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:55 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2533373166' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-07-24T22:03:55.701 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:55 smithi188 ceph-mon[37380]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-07-24T22:03:56.045 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd dump --format=json 2024-07-24T22:03:56.316 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:56.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:56 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2533373166' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-07-24T22:03:56.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:56 smithi047 ceph-mon[32551]: osdmap e81: 12 total, 12 up, 12 in 2024-07-24T22:03:56.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:56 smithi047 ceph-mon[32551]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-07-24T22:03:56.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:56 smithi047 ceph-mon[32551]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-07-24T22:03:56.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:56 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2533373166' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-07-24T22:03:56.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:56 smithi188 ceph-mon[37380]: osdmap e81: 12 total, 12 up, 12 in 2024-07-24T22:03:56.712 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:56 smithi188 ceph-mon[37380]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-07-24T22:03:56.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:56 smithi188 ceph-mon[37380]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-07-24T22:03:56.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:56 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2533373166' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-07-24T22:03:56.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:56 smithi183 ceph-mon[37007]: osdmap e81: 12 total, 12 up, 12 in 2024-07-24T22:03:56.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:56 smithi183 ceph-mon[37007]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-07-24T22:03:56.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:56 smithi183 ceph-mon[37007]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-07-24T22:03:57.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:57 smithi047 ceph-mon[32551]: pgmap v264: 97 pgs: 12 creating+peering, 24 unknown, 61 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:57.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:57 smithi047 ceph-mon[32551]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-07-24T22:03:57.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:57 smithi047 ceph-mon[32551]: Cluster is now healthy 2024-07-24T22:03:57.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:57 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] up:active 2024-07-24T22:03:57.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:57 smithi047 ceph-mon[32551]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-07-24T22:03:57.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:57 smithi047 ceph-mon[32551]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-07-24T22:03:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:57 smithi188 ceph-mon[37380]: pgmap v264: 97 pgs: 12 creating+peering, 24 unknown, 61 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:57 smithi188 ceph-mon[37380]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-07-24T22:03:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:57 smithi188 ceph-mon[37380]: Cluster is now healthy 2024-07-24T22:03:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:57 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] up:active 2024-07-24T22:03:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:57 smithi188 ceph-mon[37380]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-07-24T22:03:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:57 smithi188 ceph-mon[37380]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-07-24T22:03:57.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.876+0000 7f699f7ab640 1 -- 172.21.15.47:0/4002214211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998102790 msgr2=0x7f6998102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:57.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.876+0000 7f699f7ab640 1 --2- 172.21.15.47:0/4002214211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998102790 0x7f6998102b70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6994009900 tx=0x7f699402a410 comp rx=0 tx=0).stop 2024-07-24T22:03:57.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.876+0000 7f699f7ab640 1 -- 172.21.15.47:0/4002214211 shutdown_connections 2024-07-24T22:03:57.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.876+0000 7f699f7ab640 1 --2- 172.21.15.47:0/4002214211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6998108b20 0x7f699810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:57.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.876+0000 7f699f7ab640 1 --2- 172.21.15.47:0/4002214211 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69981081a0 0x7f69981085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:57.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.876+0000 7f699f7ab640 1 --2- 172.21.15.47:0/4002214211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998102790 0x7f6998102b70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:57.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.876+0000 7f699f7ab640 1 -- 172.21.15.47:0/4002214211 >> 172.21.15.47:0/4002214211 conn(0x7f69980fe200 msgr2=0x7f6998100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:57.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.876+0000 7f699f7ab640 1 -- 172.21.15.47:0/4002214211 shutdown_connections 2024-07-24T22:03:57.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.876+0000 7f699f7ab640 1 -- 172.21.15.47:0/4002214211 wait complete. 2024-07-24T22:03:57.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699f7ab640 1 Processor -- start 2024-07-24T22:03:57.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699f7ab640 1 -- start start 2024-07-24T22:03:57.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699f7ab640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6998102790 0x7f6998198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:57.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699f7ab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69981081a0 0x7f6998199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:57.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699f7ab640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998108b20 0x7f699819e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:57.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699f7ab640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6998112720 con 0x7f6998108b20 2024-07-24T22:03:57.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699f7ab640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f69981125a0 con 0x7f6998102790 2024-07-24T22:03:57.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699f7ab640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f69981128a0 con 0x7f69981081a0 2024-07-24T22:03:57.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699dd48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998108b20 0x7f699819e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:57.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699cd46640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69981081a0 0x7f6998199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:57.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699dd48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998108b20 0x7f699819e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56326/0 (socket says 172.21.15.47:56326) 2024-07-24T22:03:57.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699dd48640 1 -- 172.21.15.47:0/2280876457 learned_addr learned my addr 172.21.15.47:0/2280876457 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:03:57.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699d547640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6998102790 0x7f6998198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:57.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699dd48640 1 -- 172.21.15.47:0/2280876457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69981081a0 msgr2=0x7f6998199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:57.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699dd48640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69981081a0 0x7f6998199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:57.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699dd48640 1 -- 172.21.15.47:0/2280876457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6998102790 msgr2=0x7f6998198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:57.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.877+0000 7f699dd48640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6998102790 0x7f6998198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:57.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.878+0000 7f699dd48640 1 -- 172.21.15.47:0/2280876457 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699819eca0 con 0x7f6998108b20 2024-07-24T22:03:57.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.878+0000 7f699cd46640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69981081a0 0x7f6998199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:03:57.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.878+0000 7f699d547640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6998102790 0x7f6998198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:03:57.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.878+0000 7f699dd48640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998108b20 0x7f699819e4d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f699000cce0 tx=0x7f699000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:57.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.878+0000 7f698a7fc640 1 -- 172.21.15.47:0/2280876457 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699000f450 con 0x7f6998108b20 2024-07-24T22:03:57.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.878+0000 7f698a7fc640 1 -- 172.21.15.47:0/2280876457 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f699000faa0 con 0x7f6998108b20 2024-07-24T22:03:57.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.878+0000 7f699f7ab640 1 -- 172.21.15.47:0/2280876457 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699819ef90 con 0x7f6998108b20 2024-07-24T22:03:57.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.878+0000 7f698a7fc640 1 -- 172.21.15.47:0/2280876457 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6990018b70 con 0x7f6998108b20 2024-07-24T22:03:57.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.878+0000 7f699f7ab640 1 -- 172.21.15.47:0/2280876457 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69981a5650 con 0x7f6998108b20 2024-07-24T22:03:57.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.879+0000 7f699f7ab640 1 -- 172.21.15.47:0/2280876457 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6998102b70 con 0x7f6998108b20 2024-07-24T22:03:57.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.881+0000 7f698a7fc640 1 -- 172.21.15.47:0/2280876457 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f6990018d10 con 0x7f6998108b20 2024-07-24T22:03:57.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.881+0000 7f698a7fc640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69840b3c20 0x7f69840b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:03:57.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.881+0000 7f699d547640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69840b3c20 0x7f69840b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:03:57.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.881+0000 7f698a7fc640 1 -- 172.21.15.47:0/2280876457 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8194+0+0 (secure 0 0 0) 0x7f69900e41d0 con 0x7f6998108b20 2024-07-24T22:03:57.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.882+0000 7f699d547640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69840b3c20 0x7f69840b60e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6994031440 tx=0x7f6994005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:03:57.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:57.884+0000 7f698a7fc640 1 -- 172.21.15.47:0/2280876457 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f6990014030 con 0x7f6998108b20 2024-07-24T22:03:57.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:57 smithi183 ceph-mon[37007]: pgmap v264: 97 pgs: 12 creating+peering, 24 unknown, 61 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:03:57.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:57 smithi183 ceph-mon[37007]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-07-24T22:03:57.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:57 smithi183 ceph-mon[37007]: Cluster is now healthy 2024-07-24T22:03:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:57 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] up:active 2024-07-24T22:03:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:57 smithi183 ceph-mon[37007]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-07-24T22:03:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:57 smithi183 ceph-mon[37007]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-07-24T22:03:58.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.081+0000 7f699f7ab640 1 -- 172.21.15.47:0/2280876457 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f699802e000 con 0x7f6998108b20 2024-07-24T22:03:58.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.082+0000 7f698a7fc640 1 -- 172.21.15.47:0/2280876457 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22547 (secure 0 0 0) 0x7f69900ab8d0 con 0x7f6998108b20 2024-07-24T22:03:58.084 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:03:58.085 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":81,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","created":"2024-07-24T21:55:28.945912+0000","modified":"2024-07-24T22:03:54.960206+0000","last_up_change":"2024-07-24T22:02:55.044691+0000","last_in_change":"2024-07-24T22:02:35.671256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T21:59:32.066678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T22:03:49.331120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T22:03:52.034826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60de2c3d-e4b7-4878-bdbb-ce3257e3706c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6803","nonce":2665889913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6805","nonce":2665889913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6809","nonce":2665889913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6807","nonce":2665889913}]},"public_addr":"172.21.15.47:6803/2665889913","cluster_addr":"172.21.15.47:6805/2665889913","heartbeat_back_addr":"172.21.15.47:6809/2665889913","heartbeat_front_addr":"172.21.15.47:6807/2665889913","state":["exists","up"]},{"osd":1,"uuid":"7f086675-3bed-47ca-a93f-fab9580068b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6801","nonce":3486494228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6803","nonce":3486494228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6807","nonce":3486494228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6805","nonce":3486494228}]},"public_addr":"172.21.15.183:6801/3486494228","cluster_addr":"172.21.15.183:6803/3486494228","heartbeat_back_addr":"172.21.15.183:6807/3486494228","heartbeat_front_addr":"172.21.15.183:6805/3486494228","state":["exists","up"]},{"osd":2,"uuid":"040fff27-6fa6-48de-9365-fcced8f89e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6801","nonce":2245903281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6803","nonce":2245903281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6807","nonce":2245903281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6805","nonce":2245903281}]},"public_addr":"172.21.15.188:6801/2245903281","cluster_addr":"172.21.15.188:6803/2245903281","heartbeat_back_addr":"172.21.15.188:6807/2245903281","heartbeat_front_addr":"172.21.15.188:6805/2245903281","state":["exists","up"]},{"osd":3,"uuid":"e129321a-9566-4bea-b982-34f7ddd1ae1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6811","nonce":236749130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6813","nonce":236749130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6817","nonce":236749130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6815","nonce":236749130}]},"public_addr":"172.21.15.47:6811/236749130","cluster_addr":"172.21.15.47:6813/236749130","heartbeat_back_addr":"172.21.15.47:6817/236749130","heartbeat_front_addr":"172.21.15.47:6815/236749130","state":["exists","up"]},{"osd":4,"uuid":"f969fba7-b0ff-4ea6-83bd-38aba32b1be1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6809","nonce":3978122107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6811","nonce":3978122107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6815","nonce":3978122107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6813","nonce":3978122107}]},"public_addr":"172.21.15.183:6809/3978122107","cluster_addr":"172.21.15.183:6811/3978122107","heartbeat_back_addr":"172.21.15.183:6815/3978122107","heartbeat_front_addr":"172.21.15.183:6813/3978122107","state":["exists","up"]},{"osd":5,"uuid":"3799c912-3d9f-4efd-9b36-569c385e4c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6809","nonce":2097128083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6811","nonce":2097128083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6815","nonce":2097128083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6813","nonce":2097128083}]},"public_addr":"172.21.15.188:6809/2097128083","cluster_addr":"172.21.15.188:6811/2097128083","heartbeat_back_addr":"172.21.15.188:6815/2097128083","heartbeat_front_addr":"172.21.15.188:6813/2097128083","state":["exists","up"]},{"osd":6,"uuid":"1a38cf12-619f-4e82-a7a5-21ee2014038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6819","nonce":2288252980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6821","nonce":2288252980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6825","nonce":2288252980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6823","nonce":2288252980}]},"public_addr":"172.21.15.47:6819/2288252980","cluster_addr":"172.21.15.47:6821/2288252980","heartbeat_back_addr":"172.21.15.47:6825/2288252980","heartbeat_front_addr":"172.21.15.47:6823/2288252980","state":["exists","up"]},{"osd":7,"uuid":"6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6817","nonce":465426514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6819","nonce":465426514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6823","nonce":465426514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6821","nonce":465426514}]},"public_addr":"172.21.15.183:6817/465426514","cluster_addr":"172.21.15.183:6819/465426514","heartbeat_back_addr":"172.21.15.183:6823/465426514","heartbeat_front_addr":"172.21.15.183:6821/465426514","state":["exists","up"]},{"osd":8,"uuid":"6dfd7252-61a6-423d-8498-cbcfa41ae1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6817","nonce":2247055658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6819","nonce":2247055658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6823","nonce":2247055658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6821","nonce":2247055658}]},"public_addr":"172.21.15.188:6817/2247055658","cluster_addr":"172.21.15.188:6819/2247055658","heartbeat_back_addr":"172.21.15.188:6823/2247055658","heartbeat_front_addr":"172.21.15.188:6821/2247055658","state":["exists","up"]},{"osd":9,"uuid":"abd93c5e-283e-4873-a241-1056f2894116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6827","nonce":2628721884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6829","nonce":2628721884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6833","nonce":2628721884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6831","nonce":2628721884}]},"public_addr":"172.21.15.47:6827/2628721884","cluster_addr":"172.21.15.47:6829/2628721884","heartbeat_back_addr":"172.21.15.47:6833/2628721884","heartbeat_front_addr":"172.21.15.47:6831/2628721884","state":["exists","up"]},{"osd":10,"uuid":"bc967f8f-ce27-4230-be70-e36927f89fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6825","nonce":3509332199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6827","nonce":3509332199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6831","nonce":3509332199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6829","nonce":3509332199}]},"public_addr":"172.21.15.183:6825/3509332199","cluster_addr":"172.21.15.183:6827/3509332199","heartbeat_back_addr":"172.21.15.183:6831/3509332199","heartbeat_front_addr":"172.21.15.183:6829/3509332199","state":["exists","up"]},{"osd":11,"uuid":"8b379865-3a5c-4a2d-aa74-a4f215027fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6825","nonce":3725107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6827","nonce":3725107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6831","nonce":3725107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6829","nonce":3725107101}]},"public_addr":"172.21.15.188:6825/3725107101","cluster_addr":"172.21.15.188:6827/3725107101","heartbeat_back_addr":"172.21.15.188:6831/3725107101","heartbeat_front_addr":"172.21.15.188:6829/3725107101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:58:44.413660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:06.554842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:28.651418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:50.995466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:13.906535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:36.632662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:59.003224+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:21.701327+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:44.017943+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:06.400895+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:29.625920+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:52.323223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3499235566":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/2112533111":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/2714360830":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/507334607":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6800/2524786594":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/1004458106":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6800/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/1046677443":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/899235864":"2024-07-25T21:56:15.044564+0000","172.21.15.47:6800/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/3057769442":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/2596054312":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6801/2524786594":"2024-07-25T21:57:25.995502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T22:03:58.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.084+0000 7f699f7ab640 1 -- 172.21.15.47:0/2280876457 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69840b3c20 msgr2=0x7f69840b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.085+0000 7f699f7ab640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69840b3c20 0x7f69840b60e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6994031440 tx=0x7f6994005a20 comp rx=0 tx=0).stop 2024-07-24T22:03:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.085+0000 7f699f7ab640 1 -- 172.21.15.47:0/2280876457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998108b20 msgr2=0x7f699819e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:03:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.085+0000 7f699f7ab640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998108b20 0x7f699819e4d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f699000cce0 tx=0x7f699000a620 comp rx=0 tx=0).stop 2024-07-24T22:03:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.085+0000 7f699f7ab640 1 -- 172.21.15.47:0/2280876457 shutdown_connections 2024-07-24T22:03:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.085+0000 7f699f7ab640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69840b3c20 0x7f69840b60e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.085+0000 7f699f7ab640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998108b20 0x7f699819e4d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.085+0000 7f699f7ab640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69981081a0 0x7f6998199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.085+0000 7f699f7ab640 1 --2- 172.21.15.47:0/2280876457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6998102790 0x7f6998198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:03:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.085+0000 7f699f7ab640 1 -- 172.21.15.47:0/2280876457 >> 172.21.15.47:0/2280876457 conn(0x7f69980fe200 msgr2=0x7f69980feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:03:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.085+0000 7f699f7ab640 1 -- 172.21.15.47:0/2280876457 shutdown_connections 2024-07-24T22:03:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:03:58.085+0000 7f699f7ab640 1 -- 172.21.15.47:0/2280876457 wait complete. 2024-07-24T22:03:58.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:58 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2280876457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:03:58.736 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd dump --format=json 2024-07-24T22:03:58.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:58 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2280876457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:03:58.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:58 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2280876457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:03:59.008 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:03:59.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:03:59 smithi047 ceph-mon[32551]: pgmap v265: 97 pgs: 97 active+clean; 578 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-07-24T22:03:59.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:03:59 smithi188 ceph-mon[37380]: pgmap v265: 97 pgs: 97 active+clean; 578 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-07-24T22:03:59.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:03:59 smithi183 ceph-mon[37007]: pgmap v265: 97 pgs: 97 active+clean; 578 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-07-24T22:04:00.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.549+0000 7ff46e1d6640 1 -- 172.21.15.47:0/3246947329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4681079f0 msgr2=0x7ff46810e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:00.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.549+0000 7ff46e1d6640 1 --2- 172.21.15.47:0/3246947329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4681079f0 0x7ff46810e1f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff460009ca0 tx=0x7ff46002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:04:00.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.549+0000 7ff46e1d6640 1 -- 172.21.15.47:0/3246947329 shutdown_connections 2024-07-24T22:04:00.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.549+0000 7ff46e1d6640 1 --2- 172.21.15.47:0/3246947329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4681079f0 0x7ff46810e1f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:00.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.549+0000 7ff46e1d6640 1 --2- 172.21.15.47:0/3246947329 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff468107070 0x7ff4681074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:00.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.549+0000 7ff46e1d6640 1 --2- 172.21.15.47:0/3246947329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff468101660 0x7ff468101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:00.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.549+0000 7ff46e1d6640 1 -- 172.21.15.47:0/3246947329 >> 172.21.15.47:0/3246947329 conn(0x7ff4680fd0f0 msgr2=0x7ff4680ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:00.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.549+0000 7ff46e1d6640 1 -- 172.21.15.47:0/3246947329 shutdown_connections 2024-07-24T22:04:00.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.549+0000 7ff46e1d6640 1 -- 172.21.15.47:0/3246947329 wait complete. 2024-07-24T22:04:00.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.550+0000 7ff46e1d6640 1 Processor -- start 2024-07-24T22:04:00.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.550+0000 7ff46e1d6640 1 -- start start 2024-07-24T22:04:00.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.550+0000 7ff46e1d6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff468101660 0x7ff4680fd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:00.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.550+0000 7ff46e1d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff468107070 0x7ff4680fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:00.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.550+0000 7ff46e1d6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4681079f0 0x7ff4680fe070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:00.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.550+0000 7ff46e1d6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff468111670 con 0x7ff4681079f0 2024-07-24T22:04:00.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.550+0000 7ff46e1d6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681114f0 con 0x7ff468101660 2024-07-24T22:04:00.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.550+0000 7ff46e1d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff4681117f0 con 0x7ff468107070 2024-07-24T22:04:00.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.550+0000 7ff467fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4681079f0 0x7ff4680fe070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:00.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.550+0000 7ff467fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4681079f0 0x7ff4680fe070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56344/0 (socket says 172.21.15.47:56344) 2024-07-24T22:04:00.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.550+0000 7ff467fff640 1 -- 172.21.15.47:0/1314439717 learned_addr learned my addr 172.21.15.47:0/1314439717 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:00.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.551+0000 7ff4677fe640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff468101660 0x7ff4680fd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:00.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.551+0000 7ff466ffd640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff468107070 0x7ff4680fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:00.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.551+0000 7ff467fff640 1 -- 172.21.15.47:0/1314439717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff468107070 msgr2=0x7ff4680fdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:00.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.551+0000 7ff467fff640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff468107070 0x7ff4680fdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:00.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.551+0000 7ff467fff640 1 -- 172.21.15.47:0/1314439717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff468101660 msgr2=0x7ff4680fd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:00.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.551+0000 7ff467fff640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff468101660 0x7ff4680fd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:00.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.551+0000 7ff467fff640 1 -- 172.21.15.47:0/1314439717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4681a7170 con 0x7ff4681079f0 2024-07-24T22:04:00.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.551+0000 7ff467fff640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4681079f0 0x7ff4680fe070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff460009430 tx=0x7ff4600317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:00.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.551+0000 7ff464ff9640 1 -- 172.21.15.47:0/1314439717 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460003b70 con 0x7ff4681079f0 2024-07-24T22:04:00.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.551+0000 7ff464ff9640 1 -- 172.21.15.47:0/1314439717 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff460003d10 con 0x7ff4681079f0 2024-07-24T22:04:00.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.551+0000 7ff46e1d6640 1 -- 172.21.15.47:0/1314439717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4681a7400 con 0x7ff4681079f0 2024-07-24T22:04:00.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.551+0000 7ff464ff9640 1 -- 172.21.15.47:0/1314439717 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46002fa30 con 0x7ff4681079f0 2024-07-24T22:04:00.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.551+0000 7ff46e1d6640 1 -- 172.21.15.47:0/1314439717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4681a7990 con 0x7ff4681079f0 2024-07-24T22:04:00.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.553+0000 7ff46e1d6640 1 -- 172.21.15.47:0/1314439717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff468102910 con 0x7ff4681079f0 2024-07-24T22:04:00.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.554+0000 7ff464ff9640 1 -- 172.21.15.47:0/1314439717 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7ff46002fbd0 con 0x7ff4681079f0 2024-07-24T22:04:00.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.555+0000 7ff464ff9640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff4500b3ca0 0x7ff4500b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:00.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.555+0000 7ff4677fe640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff4500b3ca0 0x7ff4500b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:00.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.555+0000 7ff464ff9640 1 -- 172.21.15.47:0/1314439717 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8194+0+0 (secure 0 0 0) 0x7ff460105270 con 0x7ff4681079f0 2024-07-24T22:04:00.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.555+0000 7ff4677fe640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff4500b3ca0 0x7ff4500b6160 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff458009bd0 tx=0x7ff458005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:00.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.558+0000 7ff464ff9640 1 -- 172.21.15.47:0/1314439717 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7ff4600cc880 con 0x7ff4681079f0 2024-07-24T22:04:00.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.751+0000 7ff46e1d6640 1 -- 172.21.15.47:0/1314439717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff46810a7e0 con 0x7ff4681079f0 2024-07-24T22:04:00.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.753+0000 7ff464ff9640 1 -- 172.21.15.47:0/1314439717 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22547 (secure 0 0 0) 0x7ff4600cc180 con 0x7ff4681079f0 2024-07-24T22:04:00.755 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:04:00.755 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":81,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","created":"2024-07-24T21:55:28.945912+0000","modified":"2024-07-24T22:03:54.960206+0000","last_up_change":"2024-07-24T22:02:55.044691+0000","last_in_change":"2024-07-24T22:02:35.671256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T21:59:32.066678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T22:03:49.331120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T22:03:52.034826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60de2c3d-e4b7-4878-bdbb-ce3257e3706c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6803","nonce":2665889913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6805","nonce":2665889913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6809","nonce":2665889913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6807","nonce":2665889913}]},"public_addr":"172.21.15.47:6803/2665889913","cluster_addr":"172.21.15.47:6805/2665889913","heartbeat_back_addr":"172.21.15.47:6809/2665889913","heartbeat_front_addr":"172.21.15.47:6807/2665889913","state":["exists","up"]},{"osd":1,"uuid":"7f086675-3bed-47ca-a93f-fab9580068b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6801","nonce":3486494228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6803","nonce":3486494228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6807","nonce":3486494228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6805","nonce":3486494228}]},"public_addr":"172.21.15.183:6801/3486494228","cluster_addr":"172.21.15.183:6803/3486494228","heartbeat_back_addr":"172.21.15.183:6807/3486494228","heartbeat_front_addr":"172.21.15.183:6805/3486494228","state":["exists","up"]},{"osd":2,"uuid":"040fff27-6fa6-48de-9365-fcced8f89e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6801","nonce":2245903281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6803","nonce":2245903281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6807","nonce":2245903281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6805","nonce":2245903281}]},"public_addr":"172.21.15.188:6801/2245903281","cluster_addr":"172.21.15.188:6803/2245903281","heartbeat_back_addr":"172.21.15.188:6807/2245903281","heartbeat_front_addr":"172.21.15.188:6805/2245903281","state":["exists","up"]},{"osd":3,"uuid":"e129321a-9566-4bea-b982-34f7ddd1ae1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6811","nonce":236749130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6813","nonce":236749130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6817","nonce":236749130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6815","nonce":236749130}]},"public_addr":"172.21.15.47:6811/236749130","cluster_addr":"172.21.15.47:6813/236749130","heartbeat_back_addr":"172.21.15.47:6817/236749130","heartbeat_front_addr":"172.21.15.47:6815/236749130","state":["exists","up"]},{"osd":4,"uuid":"f969fba7-b0ff-4ea6-83bd-38aba32b1be1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6809","nonce":3978122107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6811","nonce":3978122107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6815","nonce":3978122107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6813","nonce":3978122107}]},"public_addr":"172.21.15.183:6809/3978122107","cluster_addr":"172.21.15.183:6811/3978122107","heartbeat_back_addr":"172.21.15.183:6815/3978122107","heartbeat_front_addr":"172.21.15.183:6813/3978122107","state":["exists","up"]},{"osd":5,"uuid":"3799c912-3d9f-4efd-9b36-569c385e4c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6809","nonce":2097128083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6811","nonce":2097128083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6815","nonce":2097128083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6813","nonce":2097128083}]},"public_addr":"172.21.15.188:6809/2097128083","cluster_addr":"172.21.15.188:6811/2097128083","heartbeat_back_addr":"172.21.15.188:6815/2097128083","heartbeat_front_addr":"172.21.15.188:6813/2097128083","state":["exists","up"]},{"osd":6,"uuid":"1a38cf12-619f-4e82-a7a5-21ee2014038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6819","nonce":2288252980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6821","nonce":2288252980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6825","nonce":2288252980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6823","nonce":2288252980}]},"public_addr":"172.21.15.47:6819/2288252980","cluster_addr":"172.21.15.47:6821/2288252980","heartbeat_back_addr":"172.21.15.47:6825/2288252980","heartbeat_front_addr":"172.21.15.47:6823/2288252980","state":["exists","up"]},{"osd":7,"uuid":"6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6817","nonce":465426514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6819","nonce":465426514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6823","nonce":465426514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6821","nonce":465426514}]},"public_addr":"172.21.15.183:6817/465426514","cluster_addr":"172.21.15.183:6819/465426514","heartbeat_back_addr":"172.21.15.183:6823/465426514","heartbeat_front_addr":"172.21.15.183:6821/465426514","state":["exists","up"]},{"osd":8,"uuid":"6dfd7252-61a6-423d-8498-cbcfa41ae1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6817","nonce":2247055658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6819","nonce":2247055658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6823","nonce":2247055658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6821","nonce":2247055658}]},"public_addr":"172.21.15.188:6817/2247055658","cluster_addr":"172.21.15.188:6819/2247055658","heartbeat_back_addr":"172.21.15.188:6823/2247055658","heartbeat_front_addr":"172.21.15.188:6821/2247055658","state":["exists","up"]},{"osd":9,"uuid":"abd93c5e-283e-4873-a241-1056f2894116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6827","nonce":2628721884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6829","nonce":2628721884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6833","nonce":2628721884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6831","nonce":2628721884}]},"public_addr":"172.21.15.47:6827/2628721884","cluster_addr":"172.21.15.47:6829/2628721884","heartbeat_back_addr":"172.21.15.47:6833/2628721884","heartbeat_front_addr":"172.21.15.47:6831/2628721884","state":["exists","up"]},{"osd":10,"uuid":"bc967f8f-ce27-4230-be70-e36927f89fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6825","nonce":3509332199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6827","nonce":3509332199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6831","nonce":3509332199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6829","nonce":3509332199}]},"public_addr":"172.21.15.183:6825/3509332199","cluster_addr":"172.21.15.183:6827/3509332199","heartbeat_back_addr":"172.21.15.183:6831/3509332199","heartbeat_front_addr":"172.21.15.183:6829/3509332199","state":["exists","up"]},{"osd":11,"uuid":"8b379865-3a5c-4a2d-aa74-a4f215027fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6825","nonce":3725107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6827","nonce":3725107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6831","nonce":3725107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6829","nonce":3725107101}]},"public_addr":"172.21.15.188:6825/3725107101","cluster_addr":"172.21.15.188:6827/3725107101","heartbeat_back_addr":"172.21.15.188:6831/3725107101","heartbeat_front_addr":"172.21.15.188:6829/3725107101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:58:44.413660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:06.554842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:28.651418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:50.995466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:13.906535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:36.632662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:59.003224+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:21.701327+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:44.017943+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:06.400895+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:29.625920+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:52.323223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3499235566":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/2112533111":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/2714360830":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/507334607":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6800/2524786594":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/1004458106":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6800/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/1046677443":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/899235864":"2024-07-25T21:56:15.044564+0000","172.21.15.47:6800/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/3057769442":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/2596054312":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6801/2524786594":"2024-07-25T21:57:25.995502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T22:04:00.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.755+0000 7ff46e1d6640 1 -- 172.21.15.47:0/1314439717 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff4500b3ca0 msgr2=0x7ff4500b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:00.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.755+0000 7ff46e1d6640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff4500b3ca0 0x7ff4500b6160 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff458009bd0 tx=0x7ff458005f90 comp rx=0 tx=0).stop 2024-07-24T22:04:00.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.755+0000 7ff46e1d6640 1 -- 172.21.15.47:0/1314439717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4681079f0 msgr2=0x7ff4680fe070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:00.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.755+0000 7ff46e1d6640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4681079f0 0x7ff4680fe070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff460009430 tx=0x7ff4600317c0 comp rx=0 tx=0).stop 2024-07-24T22:04:00.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.755+0000 7ff46e1d6640 1 -- 172.21.15.47:0/1314439717 shutdown_connections 2024-07-24T22:04:00.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.755+0000 7ff46e1d6640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff4500b3ca0 0x7ff4500b6160 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:00.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.755+0000 7ff46e1d6640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4681079f0 0x7ff4680fe070 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:00.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.755+0000 7ff46e1d6640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff468107070 0x7ff4680fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:00.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.755+0000 7ff46e1d6640 1 --2- 172.21.15.47:0/1314439717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff468101660 0x7ff4680fd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:00.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.755+0000 7ff46e1d6640 1 -- 172.21.15.47:0/1314439717 >> 172.21.15.47:0/1314439717 conn(0x7ff4680fd0f0 msgr2=0x7ff46806ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:00.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.755+0000 7ff46e1d6640 1 -- 172.21.15.47:0/1314439717 shutdown_connections 2024-07-24T22:04:00.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:00.755+0000 7ff46e1d6640 1 -- 172.21.15.47:0/1314439717 wait complete. 2024-07-24T22:04:01.048 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:04:00 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-i[69536]: 2024-07-24T22:04:00.693+0000 7f4f9c7f9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-24T22:04:01.413 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-07-24T22:04:01.683 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:01.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:01 smithi047 ceph-mon[32551]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-07-24T22:04:01.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:01 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1314439717' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:04:01.714 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:01 smithi183 ceph-mon[37007]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-07-24T22:04:01.714 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:01 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1314439717' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:04:01.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:01 smithi188 ceph-mon[37380]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-07-24T22:04:01.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:01 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1314439717' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:04:03.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.316+0000 7f39a2f6c640 1 -- 172.21.15.47:0/3503023369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f399c101670 msgr2=0x7f399c101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:03.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.316+0000 7f39a2f6c640 1 --2- 172.21.15.47:0/3503023369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f399c101670 0x7f399c101a50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3990009900 tx=0x7f399002a410 comp rx=0 tx=0).stop 2024-07-24T22:04:03.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.316+0000 7f39a2f6c640 1 -- 172.21.15.47:0/3503023369 shutdown_connections 2024-07-24T22:04:03.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.316+0000 7f39a2f6c640 1 --2- 172.21.15.47:0/3503023369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f399c107a00 0x7f399c10e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:03.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.316+0000 7f39a2f6c640 1 --2- 172.21.15.47:0/3503023369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f399c107080 0x7f399c1074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.316+0000 7f39a2f6c640 1 --2- 172.21.15.47:0/3503023369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f399c101670 0x7f399c101a50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.316+0000 7f39a2f6c640 1 -- 172.21.15.47:0/3503023369 >> 172.21.15.47:0/3503023369 conn(0x7f399c0fd0e0 msgr2=0x7f399c0ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.316+0000 7f39a2f6c640 1 -- 172.21.15.47:0/3503023369 shutdown_connections 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.316+0000 7f39a2f6c640 1 -- 172.21.15.47:0/3503023369 wait complete. 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.317+0000 7f39a2f6c640 1 Processor -- start 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.317+0000 7f39a2f6c640 1 -- start start 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.317+0000 7f39a2f6c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f399c101670 0x7f399c19ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.317+0000 7f39a2f6c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f399c107080 0x7f399c19b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.317+0000 7f39a2f6c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f399c107a00 0x7f399c1a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.317+0000 7f39a2f6c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f399c111610 con 0x7f399c107a00 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.317+0000 7f39a2f6c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f399c111490 con 0x7f399c101670 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.317+0000 7f39a2f6c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f399c111790 con 0x7f399c107080 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.317+0000 7f39a1509640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f399c107a00 0x7f399c1a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:03.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.317+0000 7f39a0d08640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f399c101670 0x7f399c19ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:03.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.317+0000 7f39a1509640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f399c107a00 0x7f399c1a0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56358/0 (socket says 172.21.15.47:56358) 2024-07-24T22:04:03.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.317+0000 7f39a1509640 1 -- 172.21.15.47:0/789317245 learned_addr learned my addr 172.21.15.47:0/789317245 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:03.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.317+0000 7f399bfff640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f399c107080 0x7f399c19b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:03.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.318+0000 7f39a1509640 1 -- 172.21.15.47:0/789317245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f399c107080 msgr2=0x7f399c19b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:03.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.318+0000 7f39a1509640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f399c107080 0x7f399c19b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:03.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.318+0000 7f39a1509640 1 -- 172.21.15.47:0/789317245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f399c101670 msgr2=0x7f399c19ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:03.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.318+0000 7f39a1509640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f399c101670 0x7f399c19ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:03.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.318+0000 7f39a1509640 1 -- 172.21.15.47:0/789317245 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399c1a0f20 con 0x7f399c107a00 2024-07-24T22:04:03.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.318+0000 7f399bfff640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f399c107080 0x7f399c19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:04:03.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.318+0000 7f39a1509640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f399c107a00 0x7f399c1a0750 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3994009fd0 tx=0x7f399400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:03.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.318+0000 7f3999ffb640 1 -- 172.21.15.47:0/789317245 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994017070 con 0x7f399c107a00 2024-07-24T22:04:03.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.318+0000 7f3999ffb640 1 -- 172.21.15.47:0/789317245 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3994003e20 con 0x7f399c107a00 2024-07-24T22:04:03.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.318+0000 7f39a2f6c640 1 -- 172.21.15.47:0/789317245 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399c1a1210 con 0x7f399c107a00 2024-07-24T22:04:03.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.318+0000 7f3999ffb640 1 -- 172.21.15.47:0/789317245 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994010460 con 0x7f399c107a00 2024-07-24T22:04:03.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.318+0000 7f39a2f6c640 1 -- 172.21.15.47:0/789317245 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399c1a78d0 con 0x7f399c107a00 2024-07-24T22:04:03.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.319+0000 7f39a2f6c640 1 -- 172.21.15.47:0/789317245 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f399c101a50 con 0x7f399c107a00 2024-07-24T22:04:03.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.320+0000 7f3999ffb640 1 -- 172.21.15.47:0/789317245 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f3994003970 con 0x7f399c107a00 2024-07-24T22:04:03.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.321+0000 7f3999ffb640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f398c0b3c20 0x7f398c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:03.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.321+0000 7f39a0d08640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f398c0b3c20 0x7f398c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:03.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.321+0000 7f3999ffb640 1 -- 172.21.15.47:0/789317245 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8194+0+0 (secure 0 0 0) 0x7f39940e3a00 con 0x7f399c107a00 2024-07-24T22:04:03.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.322+0000 7f39a0d08640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f398c0b3c20 0x7f398c0b60e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3990031440 tx=0x7f3990005b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:03.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.325+0000 7f3999ffb640 1 -- 172.21.15.47:0/789317245 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f39940ab070 con 0x7f399c107a00 2024-07-24T22:04:03.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:03.562+0000 7f39a2f6c640 1 -- 172.21.15.47:0/789317245 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f399c1a7c10 con 0x7f399c107a00 2024-07-24T22:04:03.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:03 smithi047 ceph-mon[32551]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-24T22:04:03.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:03 smithi188 ceph-mon[37380]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-24T22:04:03.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:03 smithi183 ceph-mon[37007]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-24T22:04:04.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:04.430+0000 7f3999ffb640 1 -- 172.21.15.47:0/789317245 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f39940aa970 con 0x7f399c107a00 2024-07-24T22:04:04.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:04.434+0000 7f39a2f6c640 1 -- 172.21.15.47:0/789317245 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f398c0b3c20 msgr2=0x7f398c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:04.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:04.434+0000 7f39a2f6c640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f398c0b3c20 0x7f398c0b60e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3990031440 tx=0x7f3990005b50 comp rx=0 tx=0).stop 2024-07-24T22:04:04.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:04.434+0000 7f39a2f6c640 1 -- 172.21.15.47:0/789317245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f399c107a00 msgr2=0x7f399c1a0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:04.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:04.434+0000 7f39a2f6c640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f399c107a00 0x7f399c1a0750 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3994009fd0 tx=0x7f399400b260 comp rx=0 tx=0).stop 2024-07-24T22:04:04.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:04.434+0000 7f39a2f6c640 1 -- 172.21.15.47:0/789317245 shutdown_connections 2024-07-24T22:04:04.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:04.434+0000 7f39a2f6c640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f398c0b3c20 0x7f398c0b60e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:04.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:04.434+0000 7f39a2f6c640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f399c107a00 0x7f399c1a0750 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:04.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:04.434+0000 7f39a2f6c640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f399c107080 0x7f399c19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:04.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:04.434+0000 7f39a2f6c640 1 --2- 172.21.15.47:0/789317245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f399c101670 0x7f399c19ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:04.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:04.434+0000 7f39a2f6c640 1 -- 172.21.15.47:0/789317245 >> 172.21.15.47:0/789317245 conn(0x7f399c0fd0e0 msgr2=0x7f399c06ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:04.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:04.434+0000 7f39a2f6c640 1 -- 172.21.15.47:0/789317245 shutdown_connections 2024-07-24T22:04:04.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:04.434+0000 7f39a2f6c640 1 -- 172.21.15.47:0/789317245 wait complete. 2024-07-24T22:04:04.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:04 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/789317245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-07-24T22:04:04.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:04 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/789317245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-07-24T22:04:04.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:04 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/789317245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-07-24T22:04:05.037 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-07-24T22:04:05.037 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-07-24T22:04:05.312 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:05.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:05 smithi047 ceph-mon[32551]: pgmap v268: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-07-24T22:04:05.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:05 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/789317245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-07-24T22:04:05.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:05 smithi047 ceph-mon[32551]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-07-24T22:04:05.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:05 smithi188 ceph-mon[37380]: pgmap v268: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-07-24T22:04:05.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:05 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/789317245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-07-24T22:04:05.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:05 smithi188 ceph-mon[37380]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-07-24T22:04:05.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:05 smithi183 ceph-mon[37007]: pgmap v268: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-07-24T22:04:05.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:05 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/789317245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-07-24T22:04:05.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:05 smithi183 ceph-mon[37007]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-07-24T22:04:06.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.762+0000 7f7d2a666640 1 -- 172.21.15.47:0/544328182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d24101690 msgr2=0x7f7d24101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:06.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.762+0000 7f7d2a666640 1 --2- 172.21.15.47:0/544328182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d24101690 0x7f7d24101a70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7d14009900 tx=0x7f7d1402a410 comp rx=0 tx=0).stop 2024-07-24T22:04:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.762+0000 7f7d2a666640 1 -- 172.21.15.47:0/544328182 shutdown_connections 2024-07-24T22:04:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.762+0000 7f7d2a666640 1 --2- 172.21.15.47:0/544328182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d24107a20 0x7f7d2410e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.762+0000 7f7d2a666640 1 --2- 172.21.15.47:0/544328182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d241070a0 0x7f7d241074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.762+0000 7f7d2a666640 1 --2- 172.21.15.47:0/544328182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d24101690 0x7f7d24101a70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.762+0000 7f7d2a666640 1 -- 172.21.15.47:0/544328182 >> 172.21.15.47:0/544328182 conn(0x7f7d240fd100 msgr2=0x7f7d240ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.762+0000 7f7d2a666640 1 -- 172.21.15.47:0/544328182 shutdown_connections 2024-07-24T22:04:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.762+0000 7f7d2a666640 1 -- 172.21.15.47:0/544328182 wait complete. 2024-07-24T22:04:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.762+0000 7f7d2a666640 1 Processor -- start 2024-07-24T22:04:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.762+0000 7f7d2a666640 1 -- start start 2024-07-24T22:04:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d2a666640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d24101690 0x7f7d24199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d2a666640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d241070a0 0x7f7d2419a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d2a666640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d24107a20 0x7f7d241a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d2a666640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d24111650 con 0x7f7d241070a0 2024-07-24T22:04:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d2a666640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7d241114d0 con 0x7f7d24101690 2024-07-24T22:04:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d2a666640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7d241117d0 con 0x7f7d24107a20 2024-07-24T22:04:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d1bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d241070a0 0x7f7d2419a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d1bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d241070a0 0x7f7d2419a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56990/0 (socket says 172.21.15.47:56990) 2024-07-24T22:04:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d1bfff640 1 -- 172.21.15.47:0/157047034 learned_addr learned my addr 172.21.15.47:0/157047034 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d23fff640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d24101690 0x7f7d24199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d28c03640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d24107a20 0x7f7d241a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d1bfff640 1 -- 172.21.15.47:0/157047034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d24107a20 msgr2=0x7f7d241a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d1bfff640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d24107a20 0x7f7d241a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d1bfff640 1 -- 172.21.15.47:0/157047034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d24101690 msgr2=0x7f7d24199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d1bfff640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d24101690 0x7f7d24199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d1bfff640 1 -- 172.21.15.47:0/157047034 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d241a50a0 con 0x7f7d241070a0 2024-07-24T22:04:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d1bfff640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d241070a0 0x7f7d2419a020 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00d770 tx=0x7f7d0c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d21ffb640 1 -- 172.21.15.47:0/157047034 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c017070 con 0x7f7d241070a0 2024-07-24T22:04:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d21ffb640 1 -- 172.21.15.47:0/157047034 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d0c0054d0 con 0x7f7d241070a0 2024-07-24T22:04:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d2a666640 1 -- 172.21.15.47:0/157047034 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d241a5270 con 0x7f7d241070a0 2024-07-24T22:04:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.763+0000 7f7d21ffb640 1 -- 172.21.15.47:0/157047034 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c004c30 con 0x7f7d241070a0 2024-07-24T22:04:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.764+0000 7f7d2a666640 1 -- 172.21.15.47:0/157047034 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d241a56d0 con 0x7f7d241070a0 2024-07-24T22:04:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.765+0000 7f7d2a666640 1 -- 172.21.15.47:0/157047034 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d24101a70 con 0x7f7d241070a0 2024-07-24T22:04:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.766+0000 7f7d21ffb640 1 -- 172.21.15.47:0/157047034 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f7d0c004dd0 con 0x7f7d241070a0 2024-07-24T22:04:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.767+0000 7f7d21ffb640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7d100b3c20 0x7f7d100b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.767+0000 7f7d23fff640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7d100b3c20 0x7f7d100b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.767+0000 7f7d21ffb640 1 -- 172.21.15.47:0/157047034 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8194+0+0 (secure 0 0 0) 0x7f7d0c0e3af0 con 0x7f7d241070a0 2024-07-24T22:04:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.768+0000 7f7d23fff640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7d100b3c20 0x7f7d100b60e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7d14031440 tx=0x7f7d14005b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:06.770+0000 7f7d21ffb640 1 -- 172.21.15.47:0/157047034 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f7d0c0ab160 con 0x7f7d241070a0 2024-07-24T22:04:07.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.007+0000 7f7d2a666640 1 -- 172.21.15.47:0/157047034 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f7d2406b2a0 con 0x7f7d241070a0 2024-07-24T22:04:07.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.434+0000 7f7d21ffb640 1 -- 172.21.15.47:0/157047034 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f7d2406b2a0 con 0x7f7d241070a0 2024-07-24T22:04:07.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.438+0000 7f7d2a666640 1 -- 172.21.15.47:0/157047034 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7d100b3c20 msgr2=0x7f7d100b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:07.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.438+0000 7f7d2a666640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7d100b3c20 0x7f7d100b60e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7d14031440 tx=0x7f7d14005b50 comp rx=0 tx=0).stop 2024-07-24T22:04:07.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.438+0000 7f7d2a666640 1 -- 172.21.15.47:0/157047034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d241070a0 msgr2=0x7f7d2419a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:07.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.438+0000 7f7d2a666640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d241070a0 0x7f7d2419a020 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00d770 tx=0x7f7d0c00dc30 comp rx=0 tx=0).stop 2024-07-24T22:04:07.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.438+0000 7f7d2a666640 1 -- 172.21.15.47:0/157047034 shutdown_connections 2024-07-24T22:04:07.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.438+0000 7f7d2a666640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7d100b3c20 0x7f7d100b60e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:07.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.438+0000 7f7d2a666640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d24107a20 0x7f7d241a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:07.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.438+0000 7f7d2a666640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d241070a0 0x7f7d2419a020 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:07.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.438+0000 7f7d2a666640 1 --2- 172.21.15.47:0/157047034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d24101690 0x7f7d24199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:07.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.438+0000 7f7d2a666640 1 -- 172.21.15.47:0/157047034 >> 172.21.15.47:0/157047034 conn(0x7f7d240fd100 msgr2=0x7f7d240ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:07.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.438+0000 7f7d2a666640 1 -- 172.21.15.47:0/157047034 shutdown_connections 2024-07-24T22:04:07.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:07.438+0000 7f7d2a666640 1 -- 172.21.15.47:0/157047034 wait complete. 2024-07-24T22:04:07.730 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:07 smithi047 ceph-mon[32551]: pgmap v269: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-07-24T22:04:07.730 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:07 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/157047034' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-07-24T22:04:07.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:07 smithi188 ceph-mon[37380]: pgmap v269: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-07-24T22:04:07.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:07 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/157047034' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-07-24T22:04:07.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:07 smithi183 ceph-mon[37007]: pgmap v269: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-07-24T22:04:07.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:07 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/157047034' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-07-24T22:04:08.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-07-24T22:04:08.283 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:08.683 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:08 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/157047034' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-07-24T22:04:08.683 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:08 smithi047 ceph-mon[32551]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-07-24T22:04:08.683 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:08 smithi047 ceph-mon[32551]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-07-24T22:04:08.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:08 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/157047034' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-07-24T22:04:08.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:08 smithi188 ceph-mon[37380]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-07-24T22:04:08.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:08 smithi188 ceph-mon[37380]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-07-24T22:04:08.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:08 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/157047034' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-07-24T22:04:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:08 smithi183 ceph-mon[37007]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-07-24T22:04:08.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:08 smithi183 ceph-mon[37007]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-07-24T22:04:09.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:09 smithi047 ceph-mon[32551]: pgmap v270: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-07-24T22:04:09.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:09 smithi188 ceph-mon[37380]: pgmap v270: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-07-24T22:04:09.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:09 smithi183 ceph-mon[37007]: pgmap v270: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-07-24T22:04:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.951+0000 7f8577c6d640 1 -- 172.21.15.47:0/3672351644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8570108180 msgr2=0x7f85701085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:09.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.951+0000 7f8577c6d640 1 --2- 172.21.15.47:0/3672351644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8570108180 0x7f85701085c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8564009900 tx=0x7f856402a410 comp rx=0 tx=0).stop 2024-07-24T22:04:09.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.951+0000 7f8577c6d640 1 -- 172.21.15.47:0/3672351644 shutdown_connections 2024-07-24T22:04:09.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.952+0000 7f8577c6d640 1 --2- 172.21.15.47:0/3672351644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8570108b00 0x7f857010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:09.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.952+0000 7f8577c6d640 1 --2- 172.21.15.47:0/3672351644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8570108180 0x7f85701085c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:09.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.952+0000 7f8577c6d640 1 --2- 172.21.15.47:0/3672351644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8570102770 0x7f8570102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:09.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.952+0000 7f8577c6d640 1 -- 172.21.15.47:0/3672351644 >> 172.21.15.47:0/3672351644 conn(0x7f85700fe1c0 msgr2=0x7f85701005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:09.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.952+0000 7f8577c6d640 1 -- 172.21.15.47:0/3672351644 shutdown_connections 2024-07-24T22:04:09.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.952+0000 7f8577c6d640 1 -- 172.21.15.47:0/3672351644 wait complete. 2024-07-24T22:04:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.952+0000 7f8577c6d640 1 Processor -- start 2024-07-24T22:04:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.952+0000 7f8577c6d640 1 -- start start 2024-07-24T22:04:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.952+0000 7f8577c6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8570102770 0x7f8570074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.952+0000 7f8577c6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8570108180 0x7f85700753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.952+0000 7f8577c6d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8570108b00 0x7f8570075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f8577c6d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8570112750 con 0x7f8570108b00 2024-07-24T22:04:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f8577c6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f85701125d0 con 0x7f8570108180 2024-07-24T22:04:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f8577c6d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f85701128d0 con 0x7f8570102770 2024-07-24T22:04:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f857620a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8570108b00 0x7f8570075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f857620a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8570108b00 0x7f8570075910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57004/0 (socket says 172.21.15.47:57004) 2024-07-24T22:04:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f857620a640 1 -- 172.21.15.47:0/1432090953 learned_addr learned my addr 172.21.15.47:0/1432090953 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f8575a09640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8570102770 0x7f8570074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f8575208640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8570108180 0x7f85700753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f857620a640 1 -- 172.21.15.47:0/1432090953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8570102770 msgr2=0x7f8570074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f857620a640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8570102770 0x7f8570074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f857620a640 1 -- 172.21.15.47:0/1432090953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8570108180 msgr2=0x7f85700753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f857620a640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8570108180 0x7f85700753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f857620a640 1 -- 172.21.15.47:0/1432090953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85701a6fc0 con 0x7f8570108b00 2024-07-24T22:04:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f857620a640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8570108b00 0x7f8570075910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f856800c970 tx=0x7f856800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f856effd640 1 -- 172.21.15.47:0/1432090953 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568007bb0 con 0x7f8570108b00 2024-07-24T22:04:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f8577c6d640 1 -- 172.21.15.47:0/1432090953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85701a72b0 con 0x7f8570108b00 2024-07-24T22:04:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f856effd640 1 -- 172.21.15.47:0/1432090953 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8568007d50 con 0x7f8570108b00 2024-07-24T22:04:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f856effd640 1 -- 172.21.15.47:0/1432090953 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568018770 con 0x7f8570108b00 2024-07-24T22:04:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.953+0000 7f8577c6d640 1 -- 172.21.15.47:0/1432090953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85701a7770 con 0x7f8570108b00 2024-07-24T22:04:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.954+0000 7f8577c6d640 1 -- 172.21.15.47:0/1432090953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8570102b50 con 0x7f8570108b00 2024-07-24T22:04:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.956+0000 7f856effd640 1 -- 172.21.15.47:0/1432090953 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7f856800f990 con 0x7f8570108b00 2024-07-24T22:04:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.957+0000 7f856effd640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f85580b3c20 0x7f85580b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.957+0000 7f8575a09640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f85580b3c20 0x7f85580b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.957+0000 7f856effd640 1 -- 172.21.15.47:0/1432090953 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8194+0+0 (secure 0 0 0) 0x7f85680e3da0 con 0x7f8570108b00 2024-07-24T22:04:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.957+0000 7f8575a09640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f85580b3c20 0x7f85580b60e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8560007ec0 tx=0x7f85600075b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:09.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:09.959+0000 7f856effd640 1 -- 172.21.15.47:0/1432090953 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f8568014030 con 0x7f8570108b00 2024-07-24T22:04:10.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.196+0000 7f8577c6d640 1 -- 172.21.15.47:0/1432090953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f857002e000 con 0x7f8570108b00 2024-07-24T22:04:10.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.452+0000 7f856effd640 1 -- 172.21.15.47:0/1432090953 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f85680ab440 con 0x7f8570108b00 2024-07-24T22:04:10.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.455+0000 7f8577c6d640 1 -- 172.21.15.47:0/1432090953 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f85580b3c20 msgr2=0x7f85580b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:10.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.455+0000 7f8577c6d640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f85580b3c20 0x7f85580b60e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8560007ec0 tx=0x7f85600075b0 comp rx=0 tx=0).stop 2024-07-24T22:04:10.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.455+0000 7f8577c6d640 1 -- 172.21.15.47:0/1432090953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8570108b00 msgr2=0x7f8570075910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:10.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.455+0000 7f8577c6d640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8570108b00 0x7f8570075910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f856800c970 tx=0x7f856800ce30 comp rx=0 tx=0).stop 2024-07-24T22:04:10.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.455+0000 7f8577c6d640 1 -- 172.21.15.47:0/1432090953 shutdown_connections 2024-07-24T22:04:10.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.455+0000 7f8577c6d640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f85580b3c20 0x7f85580b60e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:10.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.455+0000 7f8577c6d640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8570108b00 0x7f8570075910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:10.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.455+0000 7f8577c6d640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8570108180 0x7f85700753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:10.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.455+0000 7f8577c6d640 1 --2- 172.21.15.47:0/1432090953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8570102770 0x7f8570074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:10.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.455+0000 7f8577c6d640 1 -- 172.21.15.47:0/1432090953 >> 172.21.15.47:0/1432090953 conn(0x7f85700fe1c0 msgr2=0x7f85701005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:10.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.455+0000 7f8577c6d640 1 -- 172.21.15.47:0/1432090953 shutdown_connections 2024-07-24T22:04:10.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:10.455+0000 7f8577c6d640 1 -- 172.21.15.47:0/1432090953 wait complete. 2024-07-24T22:04:10.744 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:10 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1432090953' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-07-24T22:04:10.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:10 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1432090953' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-07-24T22:04:10.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:10 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1432090953' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-07-24T22:04:11.027 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-07-24T22:04:11.027 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-07-24T22:04:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:11.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:11 smithi047 ceph-mon[32551]: pgmap v271: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:04:11.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:11 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1432090953' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-07-24T22:04:11.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:11 smithi047 ceph-mon[32551]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-07-24T22:04:11.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:11 smithi188 ceph-mon[37380]: pgmap v271: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:04:11.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:11 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1432090953' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-07-24T22:04:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:11 smithi188 ceph-mon[37380]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-07-24T22:04:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:11 smithi183 ceph-mon[37007]: pgmap v271: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:04:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:11 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1432090953' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-07-24T22:04:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:11 smithi183 ceph-mon[37007]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-07-24T22:04:12.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.732+0000 7fd785f4a640 1 -- 172.21.15.47:0/1543306108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7801081a0 msgr2=0x7fd7801085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:12.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.732+0000 7fd785f4a640 1 --2- 172.21.15.47:0/1543306108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7801081a0 0x7fd7801085e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd768009900 tx=0x7fd76802a3f0 comp rx=0 tx=0).stop 2024-07-24T22:04:12.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.732+0000 7fd785f4a640 1 -- 172.21.15.47:0/1543306108 shutdown_connections 2024-07-24T22:04:12.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.732+0000 7fd785f4a640 1 --2- 172.21.15.47:0/1543306108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd780108b20 0x7fd78010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:12.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.732+0000 7fd785f4a640 1 --2- 172.21.15.47:0/1543306108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7801081a0 0x7fd7801085e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:12.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.732+0000 7fd785f4a640 1 --2- 172.21.15.47:0/1543306108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd780102790 0x7fd780102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:12.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.732+0000 7fd785f4a640 1 -- 172.21.15.47:0/1543306108 >> 172.21.15.47:0/1543306108 conn(0x7fd7800fe200 msgr2=0x7fd780100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:12.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.732+0000 7fd785f4a640 1 -- 172.21.15.47:0/1543306108 shutdown_connections 2024-07-24T22:04:12.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.732+0000 7fd785f4a640 1 -- 172.21.15.47:0/1543306108 wait complete. 2024-07-24T22:04:12.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.732+0000 7fd785f4a640 1 Processor -- start 2024-07-24T22:04:12.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd785f4a640 1 -- start start 2024-07-24T22:04:12.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd785f4a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd780102790 0x7fd780074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:12.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd785f4a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7801081a0 0x7fd7800753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:12.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd785f4a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd780108b20 0x7fd780075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:12.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd785f4a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd780112730 con 0x7fd780102790 2024-07-24T22:04:12.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd785f4a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd7801125b0 con 0x7fd7801081a0 2024-07-24T22:04:12.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd785f4a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd7801128b0 con 0x7fd780108b20 2024-07-24T22:04:12.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd77f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd780102790 0x7fd780074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:12.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd77f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd780102790 0x7fd780074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57030/0 (socket says 172.21.15.47:57030) 2024-07-24T22:04:12.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd77f7fe640 1 -- 172.21.15.47:0/960506765 learned_addr learned my addr 172.21.15.47:0/960506765 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:12.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd777fff640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7801081a0 0x7fd7800753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:12.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd77ffff640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd780108b20 0x7fd780075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:12.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd77f7fe640 1 -- 172.21.15.47:0/960506765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd780108b20 msgr2=0x7fd780075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:12.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd77f7fe640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd780108b20 0x7fd780075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:12.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd77f7fe640 1 -- 172.21.15.47:0/960506765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7801081a0 msgr2=0x7fd7800753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:12.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd77f7fe640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7801081a0 0x7fd7800753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:12.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd77f7fe640 1 -- 172.21.15.47:0/960506765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7801a6f60 con 0x7fd780102790 2024-07-24T22:04:12.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd777fff640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7801081a0 0x7fd7800753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:04:12.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.733+0000 7fd77f7fe640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd780102790 0x7fd780074e90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c920 tx=0x7fd77000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:12.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.734+0000 7fd77d7fa640 1 -- 172.21.15.47:0/960506765 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770007c70 con 0x7fd780102790 2024-07-24T22:04:12.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.734+0000 7fd77d7fa640 1 -- 172.21.15.47:0/960506765 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd770007e10 con 0x7fd780102790 2024-07-24T22:04:12.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.734+0000 7fd785f4a640 1 -- 172.21.15.47:0/960506765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7801a7250 con 0x7fd780102790 2024-07-24T22:04:12.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.734+0000 7fd77d7fa640 1 -- 172.21.15.47:0/960506765 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770018820 con 0x7fd780102790 2024-07-24T22:04:12.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.734+0000 7fd785f4a640 1 -- 172.21.15.47:0/960506765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7801a7760 con 0x7fd780102790 2024-07-24T22:04:12.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.735+0000 7fd785f4a640 1 -- 172.21.15.47:0/960506765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd780103a40 con 0x7fd780102790 2024-07-24T22:04:12.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.736+0000 7fd77d7fa640 1 -- 172.21.15.47:0/960506765 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) ==== 151076+0+0 (secure 0 0 0) 0x7fd77000f450 con 0x7fd780102790 2024-07-24T22:04:12.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.737+0000 7fd77d7fa640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd76c0b3c20 0x7fd76c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:12.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.737+0000 7fd777fff640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd76c0b3c20 0x7fd76c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:12.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.737+0000 7fd77d7fa640 1 -- 172.21.15.47:0/960506765 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8194+0+0 (secure 0 0 0) 0x7fd7700e40a0 con 0x7fd780102790 2024-07-24T22:04:12.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.738+0000 7fd777fff640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd76c0b3c20 0x7fd76c0b60e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd768031440 tx=0x7fd7680095f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:12.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.740+0000 7fd77d7fa640 1 -- 172.21.15.47:0/960506765 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fd770014030 con 0x7fd780102790 2024-07-24T22:04:12.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.961+0000 7fd785f4a640 1 -- 172.21.15.47:0/960506765 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd780105780 con 0x7fd76c0b3c20 2024-07-24T22:04:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.980+0000 7fd77d7fa640 1 -- 172.21.15.47:0/960506765 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd780105780 con 0x7fd76c0b3c20 2024-07-24T22:04:12.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.982+0000 7fd785f4a640 1 -- 172.21.15.47:0/960506765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd76c0b3c20 msgr2=0x7fd76c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:12.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.982+0000 7fd785f4a640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd76c0b3c20 0x7fd76c0b60e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd768031440 tx=0x7fd7680095f0 comp rx=0 tx=0).stop 2024-07-24T22:04:12.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.982+0000 7fd785f4a640 1 -- 172.21.15.47:0/960506765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd780102790 msgr2=0x7fd780074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:12.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.982+0000 7fd785f4a640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd780102790 0x7fd780074e90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c920 tx=0x7fd77000cde0 comp rx=0 tx=0).stop 2024-07-24T22:04:12.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.982+0000 7fd785f4a640 1 -- 172.21.15.47:0/960506765 shutdown_connections 2024-07-24T22:04:12.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.982+0000 7fd785f4a640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd76c0b3c20 0x7fd76c0b60e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:12.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.982+0000 7fd785f4a640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd780108b20 0x7fd780075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:12.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.982+0000 7fd785f4a640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7801081a0 0x7fd7800753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:12.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.982+0000 7fd785f4a640 1 --2- 172.21.15.47:0/960506765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd780102790 0x7fd780074e90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:12.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:04:12 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T22:04:12.966+0000 7ff14993b640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T22:04:12.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:04:12 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T22:04:12.966+0000 7ff14993b640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T22:04:12.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:04:12 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T22:04:12.966+0000 7ff14993b640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T22:04:12.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:04:12 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T22:04:12.966+0000 7ff14993b640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T22:04:12.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:04:12 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T22:04:12.966+0000 7ff14993b640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T22:04:12.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.982+0000 7fd785f4a640 1 -- 172.21.15.47:0/960506765 >> 172.21.15.47:0/960506765 conn(0x7fd7800fe200 msgr2=0x7fd7801005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:12.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.982+0000 7fd785f4a640 1 -- 172.21.15.47:0/960506765 shutdown_connections 2024-07-24T22:04:12.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:12.982+0000 7fd785f4a640 1 -- 172.21.15.47:0/960506765 wait complete. 2024-07-24T22:04:13.674 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:13 smithi047 ceph-mon[32551]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-24T22:04:13.707 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-07-24T22:04:13.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:13 smithi188 ceph-mon[37380]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-24T22:04:13.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:13 smithi183 ceph-mon[37007]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-24T22:04:13.975 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:14.631 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:14 smithi047 ceph-mon[32551]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:14.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:14 smithi188 ceph-mon[37380]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:14.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:14 smithi183 ceph-mon[37007]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.354+0000 7f5726b6b640 1 -- 172.21.15.47:0/1457719882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f572010ed70 msgr2=0x7f5720111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:15.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.354+0000 7f5726b6b640 1 --2- 172.21.15.47:0/1457719882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f572010ed70 0x7f5720111160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5718009ca0 tx=0x7f571802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:04:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.354+0000 7f5726b6b640 1 -- 172.21.15.47:0/1457719882 shutdown_connections 2024-07-24T22:04:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.354+0000 7f5726b6b640 1 --2- 172.21.15.47:0/1457719882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f572010ed70 0x7f5720111160 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.354+0000 7f5726b6b640 1 --2- 172.21.15.47:0/1457719882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5720075930 0x7f572010e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.354+0000 7f5726b6b640 1 --2- 172.21.15.47:0/1457719882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5720074f30 0x7f5720075310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.354+0000 7f5726b6b640 1 -- 172.21.15.47:0/1457719882 >> 172.21.15.47:0/1457719882 conn(0x7f57200fe200 msgr2=0x7f5720100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.354+0000 7f5726b6b640 1 -- 172.21.15.47:0/1457719882 shutdown_connections 2024-07-24T22:04:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.354+0000 7f5726b6b640 1 -- 172.21.15.47:0/1457719882 wait complete. 2024-07-24T22:04:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.354+0000 7f5726b6b640 1 Processor -- start 2024-07-24T22:04:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.354+0000 7f5726b6b640 1 -- start start 2024-07-24T22:04:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5726b6b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5720074f30 0x7f572019ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5726b6b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5720075930 0x7f572019b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5726b6b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f572010ed70 0x7f57201a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:15.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5726b6b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5720114920 con 0x7f572010ed70 2024-07-24T22:04:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5726b6b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f57201147a0 con 0x7f5720074f30 2024-07-24T22:04:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5726b6b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5720114aa0 con 0x7f5720075930 2024-07-24T22:04:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5725108640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f572010ed70 0x7f57201a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5725108640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f572010ed70 0x7f57201a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52136/0 (socket says 172.21.15.47:52136) 2024-07-24T22:04:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5725108640 1 -- 172.21.15.47:0/2809483969 learned_addr learned my addr 172.21.15.47:0/2809483969 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5717fff640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5720075930 0x7f572019b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5724907640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5720074f30 0x7f572019ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5725108640 1 -- 172.21.15.47:0/2809483969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5720075930 msgr2=0x7f572019b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5725108640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5720075930 0x7f572019b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5725108640 1 -- 172.21.15.47:0/2809483969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5720074f30 msgr2=0x7f572019ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5725108640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5720074f30 0x7f572019ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5725108640 1 -- 172.21.15.47:0/2809483969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57201a0dc0 con 0x7f572010ed70 2024-07-24T22:04:15.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5725108640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f572010ed70 0x7f57201a05f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f57180319f0 tx=0x7f5718031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5715ffb640 1 -- 172.21.15.47:0/2809483969 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718003bf0 con 0x7f572010ed70 2024-07-24T22:04:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5715ffb640 1 -- 172.21.15.47:0/2809483969 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5718003d90 con 0x7f572010ed70 2024-07-24T22:04:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5726b6b640 1 -- 172.21.15.47:0/2809483969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57201a1050 con 0x7f572010ed70 2024-07-24T22:04:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.355+0000 7f5715ffb640 1 -- 172.21.15.47:0/2809483969 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571802fc00 con 0x7f572010ed70 2024-07-24T22:04:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.356+0000 7f5726b6b640 1 -- 172.21.15.47:0/2809483969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57201a7770 con 0x7f572010ed70 2024-07-24T22:04:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.357+0000 7f5726b6b640 1 -- 172.21.15.47:0/2809483969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5720075310 con 0x7f572010ed70 2024-07-24T22:04:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.358+0000 7f5715ffb640 1 -- 172.21.15.47:0/2809483969 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f5718004610 con 0x7f572010ed70 2024-07-24T22:04:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.359+0000 7f5715ffb640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f57080b3cb0 0x7f57080b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.359+0000 7f5724907640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f57080b3cb0 0x7f57080b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.359+0000 7f5715ffb640 1 -- 172.21.15.47:0/2809483969 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8194+0+0 (secure 0 0 0) 0x7f5718105310 con 0x7f572010ed70 2024-07-24T22:04:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.359+0000 7f5724907640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f57080b3cb0 0x7f57080b6170 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5710005fd0 tx=0x7f5710005850 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:15.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.362+0000 7f5715ffb640 1 -- 172.21.15.47:0/2809483969 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f57180cc930 con 0x7f572010ed70 2024-07-24T22:04:15.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.584+0000 7f5726b6b640 1 -- 172.21.15.47:0/2809483969 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f57200ffe10 con 0x7f57080b3cb0 2024-07-24T22:04:15.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.608+0000 7f5715ffb640 1 -- 172.21.15.47:0/2809483969 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f57200ffe10 con 0x7f57080b3cb0 2024-07-24T22:04:15.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.610+0000 7f5726b6b640 1 -- 172.21.15.47:0/2809483969 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f57080b3cb0 msgr2=0x7f57080b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:15.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.610+0000 7f5726b6b640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f57080b3cb0 0x7f57080b6170 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5710005fd0 tx=0x7f5710005850 comp rx=0 tx=0).stop 2024-07-24T22:04:15.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.610+0000 7f5726b6b640 1 -- 172.21.15.47:0/2809483969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f572010ed70 msgr2=0x7f57201a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:15.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.610+0000 7f5726b6b640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f572010ed70 0x7f57201a05f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f57180319f0 tx=0x7f5718031a20 comp rx=0 tx=0).stop 2024-07-24T22:04:15.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.610+0000 7f5726b6b640 1 -- 172.21.15.47:0/2809483969 shutdown_connections 2024-07-24T22:04:15.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.610+0000 7f5726b6b640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f57080b3cb0 0x7f57080b6170 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:15.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.610+0000 7f5726b6b640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f572010ed70 0x7f57201a05f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:15.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.610+0000 7f5726b6b640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5720075930 0x7f572019b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:15.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.610+0000 7f5726b6b640 1 --2- 172.21.15.47:0/2809483969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5720074f30 0x7f572019ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:15.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.610+0000 7f5726b6b640 1 -- 172.21.15.47:0/2809483969 >> 172.21.15.47:0/2809483969 conn(0x7f57200fe200 msgr2=0x7f5720110ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:15.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.611+0000 7f5726b6b640 1 -- 172.21.15.47:0/2809483969 shutdown_connections 2024-07-24T22:04:15.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:15.611+0000 7f5726b6b640 1 -- 172.21.15.47:0/2809483969 wait complete. 2024-07-24T22:04:15.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:15 smithi188 ceph-mon[37380]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2024-07-24T22:04:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:15 smithi188 ceph-mon[37380]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-07-24T22:04:15.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:15 smithi183 ceph-mon[37007]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2024-07-24T22:04:15.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:15 smithi183 ceph-mon[37007]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-07-24T22:04:15.928 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:15 smithi047 ceph-mon[32551]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2024-07-24T22:04:15.929 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:15 smithi047 ceph-mon[32551]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-07-24T22:04:16.276 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-07-24T22:04:16.549 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:16.568 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:16 smithi047 ceph-mon[32551]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:16.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:16 smithi188 ceph-mon[37380]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:16.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:16 smithi183 ceph-mon[37007]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:17.728 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:17 smithi047 ceph-mon[32551]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2024-07-24T22:04:17.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:17 smithi188 ceph-mon[37380]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2024-07-24T22:04:17.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:17 smithi183 ceph-mon[37007]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2024-07-24T22:04:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.018+0000 7f4eb742d640 1 -- 172.21.15.47:0/409319957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0101210 msgr2=0x7f4eb01015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:18.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.018+0000 7f4eb742d640 1 --2- 172.21.15.47:0/409319957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0101210 0x7f4eb01015f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009900 tx=0x7f4ea002a480 comp rx=0 tx=0).stop 2024-07-24T22:04:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.018+0000 7f4eb742d640 1 -- 172.21.15.47:0/409319957 shutdown_connections 2024-07-24T22:04:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.018+0000 7f4eb742d640 1 --2- 172.21.15.47:0/409319957 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4eb010edc0 0x7f4eb01111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.018+0000 7f4eb742d640 1 --2- 172.21.15.47:0/409319957 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4eb0101b30 0x7f4eb010e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.018+0000 7f4eb742d640 1 --2- 172.21.15.47:0/409319957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0101210 0x7f4eb01015f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.018+0000 7f4eb742d640 1 -- 172.21.15.47:0/409319957 >> 172.21.15.47:0/409319957 conn(0x7f4eb00fd0c0 msgr2=0x7f4eb00ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.018+0000 7f4eb742d640 1 -- 172.21.15.47:0/409319957 shutdown_connections 2024-07-24T22:04:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.018+0000 7f4eb742d640 1 -- 172.21.15.47:0/409319957 wait complete. 2024-07-24T22:04:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.018+0000 7f4eb742d640 1 Processor -- start 2024-07-24T22:04:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.018+0000 7f4eb742d640 1 -- start start 2024-07-24T22:04:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb742d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0101210 0x7f4eb019b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb742d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4eb0101b30 0x7f4eb019b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:18.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb742d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4eb010edc0 0x7f4eb01a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb742d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb01149d0 con 0x7f4eb0101210 2024-07-24T22:04:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb742d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb0114850 con 0x7f4eb0101b30 2024-07-24T22:04:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb742d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb0114b50 con 0x7f4eb010edc0 2024-07-24T22:04:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb51c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0101210 0x7f4eb019b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb51c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0101210 0x7f4eb019b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52148/0 (socket says 172.21.15.47:52148) 2024-07-24T22:04:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb51c9640 1 -- 172.21.15.47:0/3246897507 learned_addr learned my addr 172.21.15.47:0/3246897507 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb59ca640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4eb010edc0 0x7f4eb01a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb49c8640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4eb0101b30 0x7f4eb019b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb51c9640 1 -- 172.21.15.47:0/3246897507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4eb010edc0 msgr2=0x7f4eb01a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb51c9640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4eb010edc0 0x7f4eb01a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb51c9640 1 -- 172.21.15.47:0/3246897507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4eb0101b30 msgr2=0x7f4eb019b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb51c9640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4eb0101b30 0x7f4eb019b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:18.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb51c9640 1 -- 172.21.15.47:0/3246897507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb01a12f0 con 0x7f4eb0101210 2024-07-24T22:04:18.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eb51c9640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0101210 0x7f4eb019b240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0005ab0 tx=0x7f4ea0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:18.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.019+0000 7f4eae7fc640 1 -- 172.21.15.47:0/3246897507 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea003f070 con 0x7f4eb0101210 2024-07-24T22:04:18.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.020+0000 7f4eae7fc640 1 -- 172.21.15.47:0/3246897507 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ea0031d60 con 0x7f4eb0101210 2024-07-24T22:04:18.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.020+0000 7f4eb742d640 1 -- 172.21.15.47:0/3246897507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb01a1580 con 0x7f4eb0101210 2024-07-24T22:04:18.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.020+0000 7f4eae7fc640 1 -- 172.21.15.47:0/3246897507 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0035030 con 0x7f4eb0101210 2024-07-24T22:04:18.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.020+0000 7f4eb742d640 1 -- 172.21.15.47:0/3246897507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb01a7ca0 con 0x7f4eb0101210 2024-07-24T22:04:18.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.021+0000 7f4eb742d640 1 -- 172.21.15.47:0/3246897507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb01015f0 con 0x7f4eb0101210 2024-07-24T22:04:18.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.022+0000 7f4eae7fc640 1 -- 172.21.15.47:0/3246897507 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f4ea0042070 con 0x7f4eb0101210 2024-07-24T22:04:18.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.023+0000 7f4eae7fc640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4e980b3cb0 0x7f4e980b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:18.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.023+0000 7f4eb49c8640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4e980b3cb0 0x7f4e980b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:18.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.023+0000 7f4eae7fc640 1 -- 172.21.15.47:0/3246897507 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8194+0+0 (secure 0 0 0) 0x7f4ea0104750 con 0x7f4eb0101210 2024-07-24T22:04:18.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.023+0000 7f4eb49c8640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4e980b3cb0 0x7f4e980b6170 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4005fd0 tx=0x7f4ea4005850 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:18.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.027+0000 7f4eae7fc640 1 -- 172.21.15.47:0/3246897507 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f4ea00cbc60 con 0x7f4eb0101210 2024-07-24T22:04:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.252+0000 7f4eb742d640 1 -- 172.21.15.47:0/3246897507 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f4eb006ab70 con 0x7f4e980b3cb0 2024-07-24T22:04:18.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.256+0000 7f4eae7fc640 1 -- 172.21.15.47:0/3246897507 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f4eb006ab70 con 0x7f4e980b3cb0 2024-07-24T22:04:18.261 INFO:teuthology.orchestra.run.smithi047.stdout:/volumes/qa/sv_0/52daae86-e518-4950-b943-506168dbce35 2024-07-24T22:04:18.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.259+0000 7f4eb742d640 1 -- 172.21.15.47:0/3246897507 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4e980b3cb0 msgr2=0x7f4e980b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:18.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.259+0000 7f4eb742d640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4e980b3cb0 0x7f4e980b6170 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4005fd0 tx=0x7f4ea4005850 comp rx=0 tx=0).stop 2024-07-24T22:04:18.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.259+0000 7f4eb742d640 1 -- 172.21.15.47:0/3246897507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0101210 msgr2=0x7f4eb019b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:18.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.259+0000 7f4eb742d640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0101210 0x7f4eb019b240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0005ab0 tx=0x7f4ea0003cd0 comp rx=0 tx=0).stop 2024-07-24T22:04:18.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.259+0000 7f4eb742d640 1 -- 172.21.15.47:0/3246897507 shutdown_connections 2024-07-24T22:04:18.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.259+0000 7f4eb742d640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4e980b3cb0 0x7f4e980b6170 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:18.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.259+0000 7f4eb742d640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4eb010edc0 0x7f4eb01a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:18.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.259+0000 7f4eb742d640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4eb0101b30 0x7f4eb019b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:18.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.259+0000 7f4eb742d640 1 --2- 172.21.15.47:0/3246897507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eb0101210 0x7f4eb019b240 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:18.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.259+0000 7f4eb742d640 1 -- 172.21.15.47:0/3246897507 >> 172.21.15.47:0/3246897507 conn(0x7f4eb00fd0c0 msgr2=0x7f4eb01100c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:18.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.259+0000 7f4eb742d640 1 -- 172.21.15.47:0/3246897507 shutdown_connections 2024-07-24T22:04:18.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:18.259+0000 7f4eb742d640 1 -- 172.21.15.47:0/3246897507 wait complete. 2024-07-24T22:04:18.929 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-07-24T22:04:19.198 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:19.573 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:19 smithi047 ceph-mon[32551]: pgmap v275: 97 pgs: 97 active+clean; 599 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-07-24T22:04:19.574 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:19 smithi047 ceph-mon[32551]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:19.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:19 smithi188 ceph-mon[37380]: pgmap v275: 97 pgs: 97 active+clean; 599 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-07-24T22:04:19.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:19 smithi188 ceph-mon[37380]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:19.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:19 smithi183 ceph-mon[37007]: pgmap v275: 97 pgs: 97 active+clean; 599 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-07-24T22:04:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:19 smithi183 ceph-mon[37007]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:20.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.816+0000 7f6887c9a640 1 -- 172.21.15.47:0/3655630810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6880102790 msgr2=0x7f6880102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:20.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.816+0000 7f6887c9a640 1 --2- 172.21.15.47:0/3655630810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6880102790 0x7f6880102b70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f687c009900 tx=0x7f687c02a410 comp rx=0 tx=0).stop 2024-07-24T22:04:20.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.816+0000 7f6887c9a640 1 -- 172.21.15.47:0/3655630810 shutdown_connections 2024-07-24T22:04:20.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.816+0000 7f6887c9a640 1 --2- 172.21.15.47:0/3655630810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6880108b20 0x7f688010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:20.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.816+0000 7f6887c9a640 1 --2- 172.21.15.47:0/3655630810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68801081a0 0x7f68801085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:20.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.816+0000 7f6887c9a640 1 --2- 172.21.15.47:0/3655630810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6880102790 0x7f6880102b70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:20.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.816+0000 7f6887c9a640 1 -- 172.21.15.47:0/3655630810 >> 172.21.15.47:0/3655630810 conn(0x7f68800fe200 msgr2=0x7f6880100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:20.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.816+0000 7f6887c9a640 1 -- 172.21.15.47:0/3655630810 shutdown_connections 2024-07-24T22:04:20.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.816+0000 7f6887c9a640 1 -- 172.21.15.47:0/3655630810 wait complete. 2024-07-24T22:04:20.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6887c9a640 1 Processor -- start 2024-07-24T22:04:20.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6887c9a640 1 -- start start 2024-07-24T22:04:20.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6887c9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6880102790 0x7f6880074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:20.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6887c9a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68801081a0 0x7f68800753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:20.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6887c9a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6880108b20 0x7f6880075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:20.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6887c9a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6880112740 con 0x7f6880102790 2024-07-24T22:04:20.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6887c9a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f68801125c0 con 0x7f6880108b20 2024-07-24T22:04:20.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6887c9a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f68801128c0 con 0x7f68801081a0 2024-07-24T22:04:20.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6885a36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6880102790 0x7f6880074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:20.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6885a36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6880102790 0x7f6880074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52174/0 (socket says 172.21.15.47:52174) 2024-07-24T22:04:20.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6885a36640 1 -- 172.21.15.47:0/1561012400 learned_addr learned my addr 172.21.15.47:0/1561012400 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:20.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6886237640 1 --2- 172.21.15.47:0/1561012400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6880108b20 0x7f6880075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:20.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6885a36640 1 -- 172.21.15.47:0/1561012400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68801081a0 msgr2=0x7f68800753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:20.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6885a36640 1 --2- 172.21.15.47:0/1561012400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68801081a0 0x7f68800753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:20.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6885a36640 1 -- 172.21.15.47:0/1561012400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6880108b20 msgr2=0x7f6880075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:20.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6885a36640 1 --2- 172.21.15.47:0/1561012400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6880108b20 0x7f6880075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:20.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.817+0000 7f6885a36640 1 -- 172.21.15.47:0/1561012400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68801a6fd0 con 0x7f6880102790 2024-07-24T22:04:20.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.818+0000 7f6885a36640 1 --2- 172.21.15.47:0/1561012400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6880102790 0x7f6880074e90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f687c005940 tx=0x7f687c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:20.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.818+0000 7f6876ffd640 1 -- 172.21.15.47:0/1561012400 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c03f030 con 0x7f6880102790 2024-07-24T22:04:20.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.818+0000 7f6876ffd640 1 -- 172.21.15.47:0/1561012400 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f687c003cb0 con 0x7f6880102790 2024-07-24T22:04:20.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.818+0000 7f6887c9a640 1 -- 172.21.15.47:0/1561012400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68801a7260 con 0x7f6880102790 2024-07-24T22:04:20.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.818+0000 7f6876ffd640 1 -- 172.21.15.47:0/1561012400 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c035070 con 0x7f6880102790 2024-07-24T22:04:20.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.818+0000 7f6887c9a640 1 -- 172.21.15.47:0/1561012400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68801a7740 con 0x7f6880102790 2024-07-24T22:04:20.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.819+0000 7f6887c9a640 1 -- 172.21.15.47:0/1561012400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6880102b70 con 0x7f6880102790 2024-07-24T22:04:20.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.820+0000 7f6876ffd640 1 -- 172.21.15.47:0/1561012400 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f687c042030 con 0x7f6880102790 2024-07-24T22:04:20.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.821+0000 7f6876ffd640 1 --2- 172.21.15.47:0/1561012400 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f686c0b3cb0 0x7f686c0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:20.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.821+0000 7f6885235640 1 --2- 172.21.15.47:0/1561012400 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f686c0b3cb0 0x7f686c0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:20.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.821+0000 7f6876ffd640 1 -- 172.21.15.47:0/1561012400 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8194+0+0 (secure 0 0 0) 0x7f687c104740 con 0x7f6880102790 2024-07-24T22:04:20.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.821+0000 7f6885235640 1 --2- 172.21.15.47:0/1561012400 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f686c0b3cb0 0x7f686c0b6170 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6880076980 tx=0x7f6870005c70 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:20.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:20.825+0000 7f6876ffd640 1 -- 172.21.15.47:0/1561012400 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f687c0cbc50 con 0x7f6880102790 2024-07-24T22:04:21.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.048+0000 7f6887c9a640 1 -- 172.21.15.47:0/1561012400 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f68800ff170 con 0x7f686c0b3cb0 2024-07-24T22:04:21.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.071+0000 7f6876ffd640 1 -- 172.21.15.47:0/1561012400 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f68800ff170 con 0x7f686c0b3cb0 2024-07-24T22:04:21.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.073+0000 7f6887c9a640 1 -- 172.21.15.47:0/1561012400 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f686c0b3cb0 msgr2=0x7f686c0b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:21.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.073+0000 7f6887c9a640 1 --2- 172.21.15.47:0/1561012400 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f686c0b3cb0 0x7f686c0b6170 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6880076980 tx=0x7f6870005c70 comp rx=0 tx=0).stop 2024-07-24T22:04:21.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.073+0000 7f6887c9a640 1 -- 172.21.15.47:0/1561012400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6880102790 msgr2=0x7f6880074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:21.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.073+0000 7f6887c9a640 1 --2- 172.21.15.47:0/1561012400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6880102790 0x7f6880074e90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f687c005940 tx=0x7f687c0042f0 comp rx=0 tx=0).stop 2024-07-24T22:04:21.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.073+0000 7f6887c9a640 1 -- 172.21.15.47:0/1561012400 shutdown_connections 2024-07-24T22:04:21.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.073+0000 7f6887c9a640 1 --2- 172.21.15.47:0/1561012400 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f686c0b3cb0 0x7f686c0b6170 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:21.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.073+0000 7f6887c9a640 1 --2- 172.21.15.47:0/1561012400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6880108b20 0x7f6880075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:21.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.073+0000 7f6887c9a640 1 --2- 172.21.15.47:0/1561012400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68801081a0 0x7f68800753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:21.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.073+0000 7f6887c9a640 1 --2- 172.21.15.47:0/1561012400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6880102790 0x7f6880074e90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:21.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.073+0000 7f6887c9a640 1 -- 172.21.15.47:0/1561012400 >> 172.21.15.47:0/1561012400 conn(0x7f68800fe200 msgr2=0x7f68800fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:21.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.073+0000 7f6887c9a640 1 -- 172.21.15.47:0/1561012400 shutdown_connections 2024-07-24T22:04:21.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:21.073+0000 7f6887c9a640 1 -- 172.21.15.47:0/1561012400 wait complete. 2024-07-24T22:04:21.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:21 smithi047 ceph-mon[32551]: pgmap v276: 97 pgs: 97 active+clean; 599 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-07-24T22:04:21.720 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-07-24T22:04:21.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:21 smithi188 ceph-mon[37380]: pgmap v276: 97 pgs: 97 active+clean; 599 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-07-24T22:04:21.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:21 smithi183 ceph-mon[37007]: pgmap v276: 97 pgs: 97 active+clean; 599 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-07-24T22:04:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:22.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:22 smithi188 ceph-mon[37380]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:22.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:22 smithi183 ceph-mon[37007]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:22.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:22 smithi047 ceph-mon[32551]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.562+0000 7fef68aab640 1 -- 172.21.15.47:0/156312441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef64107a20 msgr2=0x7fef6410e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.562+0000 7fef68aab640 1 --2- 172.21.15.47:0/156312441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef64107a20 0x7fef6410e220 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009ca0 tx=0x7fef5c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:04:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.563+0000 7fef68aab640 1 -- 172.21.15.47:0/156312441 shutdown_connections 2024-07-24T22:04:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.563+0000 7fef68aab640 1 --2- 172.21.15.47:0/156312441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef64107a20 0x7fef6410e220 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.563+0000 7fef68aab640 1 --2- 172.21.15.47:0/156312441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef641070a0 0x7fef641074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.563+0000 7fef68aab640 1 --2- 172.21.15.47:0/156312441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef64101690 0x7fef64101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.563+0000 7fef68aab640 1 -- 172.21.15.47:0/156312441 >> 172.21.15.47:0/156312441 conn(0x7fef640fd100 msgr2=0x7fef640ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.563+0000 7fef68aab640 1 -- 172.21.15.47:0/156312441 shutdown_connections 2024-07-24T22:04:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.563+0000 7fef68aab640 1 -- 172.21.15.47:0/156312441 wait complete. 2024-07-24T22:04:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.563+0000 7fef68aab640 1 Processor -- start 2024-07-24T22:04:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.563+0000 7fef68aab640 1 -- start start 2024-07-24T22:04:23.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef68aab640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef64101690 0x7fef64199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:23.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef68aab640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef641070a0 0x7fef64199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:23.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef68aab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef64107a20 0x7fef6419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:23.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef68aab640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fef641116a0 con 0x7fef641070a0 2024-07-24T22:04:23.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef68aab640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fef64111520 con 0x7fef64101690 2024-07-24T22:04:23.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef68aab640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fef64111820 con 0x7fef64107a20 2024-07-24T22:04:23.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef61d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef641070a0 0x7fef64199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:23.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef61d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef641070a0 0x7fef64199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52190/0 (socket says 172.21.15.47:52190) 2024-07-24T22:04:23.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef61d9b640 1 -- 172.21.15.47:0/2508517036 learned_addr learned my addr 172.21.15.47:0/2508517036 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:23.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef62d9d640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef64107a20 0x7fef6419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:23.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef6259c640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef64101690 0x7fef64199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:23.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef61d9b640 1 -- 172.21.15.47:0/2508517036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef64107a20 msgr2=0x7fef6419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:23.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef61d9b640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef64107a20 0x7fef6419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef61d9b640 1 -- 172.21.15.47:0/2508517036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef64101690 msgr2=0x7fef64199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef61d9b640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef64101690 0x7fef64199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef61d9b640 1 -- 172.21.15.47:0/2508517036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef641a4e10 con 0x7fef641070a0 2024-07-24T22:04:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef6259c640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef64101690 0x7fef64199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:04:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef61d9b640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef641070a0 0x7fef64199f70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fef5800b4a0 tx=0x7fef5800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef537fe640 1 -- 172.21.15.47:0/2508517036 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58014070 con 0x7fef641070a0 2024-07-24T22:04:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.564+0000 7fef537fe640 1 -- 172.21.15.47:0/2508517036 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef58010ac0 con 0x7fef641070a0 2024-07-24T22:04:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.565+0000 7fef537fe640 1 -- 172.21.15.47:0/2508517036 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58017c30 con 0x7fef641070a0 2024-07-24T22:04:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.565+0000 7fef68aab640 1 -- 172.21.15.47:0/2508517036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef641a5100 con 0x7fef641070a0 2024-07-24T22:04:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.565+0000 7fef68aab640 1 -- 172.21.15.47:0/2508517036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef641a55f0 con 0x7fef641070a0 2024-07-24T22:04:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.566+0000 7fef68aab640 1 -- 172.21.15.47:0/2508517036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef64101a70 con 0x7fef641070a0 2024-07-24T22:04:23.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.567+0000 7fef537fe640 1 -- 172.21.15.47:0/2508517036 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fef58017070 con 0x7fef641070a0 2024-07-24T22:04:23.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.568+0000 7fef537fe640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fef4c0b3cb0 0x7fef4c0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:23.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.568+0000 7fef6259c640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fef4c0b3cb0 0x7fef4c0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:23.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.568+0000 7fef537fe640 1 -- 172.21.15.47:0/2508517036 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8194+0+0 (secure 0 0 0) 0x7fef580e3080 con 0x7fef641070a0 2024-07-24T22:04:23.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.568+0000 7fef6259c640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fef4c0b3cb0 0x7fef4c0b6170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef5400abe0 tx=0x7fef5400a5c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:23.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.572+0000 7fef537fe640 1 -- 172.21.15.47:0/2508517036 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fef580aa6a0 con 0x7fef641070a0 2024-07-24T22:04:23.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:23 smithi047 ceph-mon[32551]: pgmap v277: 97 pgs: 97 active+clean; 619 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-07-24T22:04:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:23 smithi188 ceph-mon[37380]: pgmap v277: 97 pgs: 97 active+clean; 619 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-07-24T22:04:23.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.798+0000 7fef68aab640 1 -- 172.21.15.47:0/2508517036 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fef64062f80 con 0x7fef4c0b3cb0 2024-07-24T22:04:23.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.802+0000 7fef537fe640 1 -- 172.21.15.47:0/2508517036 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fef64062f80 con 0x7fef4c0b3cb0 2024-07-24T22:04:23.804 INFO:teuthology.orchestra.run.smithi047.stdout:/volumes/qa/sv_1/6fea125c-eb4b-4d5a-a01c-8376212837a2 2024-07-24T22:04:23.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.804+0000 7fef68aab640 1 -- 172.21.15.47:0/2508517036 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fef4c0b3cb0 msgr2=0x7fef4c0b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:23.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.804+0000 7fef68aab640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fef4c0b3cb0 0x7fef4c0b6170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef5400abe0 tx=0x7fef5400a5c0 comp rx=0 tx=0).stop 2024-07-24T22:04:23.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.804+0000 7fef68aab640 1 -- 172.21.15.47:0/2508517036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef641070a0 msgr2=0x7fef64199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:23.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.804+0000 7fef68aab640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef641070a0 0x7fef64199f70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fef5800b4a0 tx=0x7fef5800b960 comp rx=0 tx=0).stop 2024-07-24T22:04:23.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.804+0000 7fef68aab640 1 -- 172.21.15.47:0/2508517036 shutdown_connections 2024-07-24T22:04:23.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.804+0000 7fef68aab640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fef4c0b3cb0 0x7fef4c0b6170 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:23.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.804+0000 7fef68aab640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef64107a20 0x7fef6419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:23.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.804+0000 7fef68aab640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef641070a0 0x7fef64199f70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:23.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.804+0000 7fef68aab640 1 --2- 172.21.15.47:0/2508517036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef64101690 0x7fef64199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:23.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.804+0000 7fef68aab640 1 -- 172.21.15.47:0/2508517036 >> 172.21.15.47:0/2508517036 conn(0x7fef640fd100 msgr2=0x7fef640ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:23.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.805+0000 7fef68aab640 1 -- 172.21.15.47:0/2508517036 shutdown_connections 2024-07-24T22:04:23.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:23.805+0000 7fef68aab640 1 -- 172.21.15.47:0/2508517036 wait complete. 2024-07-24T22:04:23.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:23 smithi183 ceph-mon[37007]: pgmap v277: 97 pgs: 97 active+clean; 619 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-07-24T22:04:24.614 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:04:24.884 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:25.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:25 smithi047 ceph-mon[32551]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:25.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:25 smithi047 ceph-mon[32551]: pgmap v278: 97 pgs: 97 active+clean; 619 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-07-24T22:04:25.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:25 smithi188 ceph-mon[37380]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:25.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:25 smithi188 ceph-mon[37380]: pgmap v278: 97 pgs: 97 active+clean; 619 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-07-24T22:04:25.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:25 smithi183 ceph-mon[37007]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:04:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:25 smithi183 ceph-mon[37007]: pgmap v278: 97 pgs: 97 active+clean; 619 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-07-24T22:04:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.339+0000 7f6ac39aa640 1 -- 172.21.15.47:0/1869461712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6abc1036a0 msgr2=0x7f6abc103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.339+0000 7f6ac39aa640 1 --2- 172.21.15.47:0/1869461712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6abc1036a0 0x7f6abc103a80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009ca0 tx=0x7f6ab802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:04:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.339+0000 7f6ac39aa640 1 -- 172.21.15.47:0/1869461712 shutdown_connections 2024-07-24T22:04:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.339+0000 7f6ac39aa640 1 --2- 172.21.15.47:0/1869461712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6abc10cb00 0x7f6abc10ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.339+0000 7f6ac39aa640 1 --2- 172.21.15.47:0/1869461712 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6abc103fc0 0x7f6abc10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:26.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.339+0000 7f6ac39aa640 1 --2- 172.21.15.47:0/1869461712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6abc1036a0 0x7f6abc103a80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.339+0000 7f6ac39aa640 1 -- 172.21.15.47:0/1869461712 >> 172.21.15.47:0/1869461712 conn(0x7f6abc0fd100 msgr2=0x7f6abc0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.339+0000 7f6ac39aa640 1 -- 172.21.15.47:0/1869461712 shutdown_connections 2024-07-24T22:04:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.339+0000 7f6ac39aa640 1 -- 172.21.15.47:0/1869461712 wait complete. 2024-07-24T22:04:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.339+0000 7f6ac39aa640 1 Processor -- start 2024-07-24T22:04:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac39aa640 1 -- start start 2024-07-24T22:04:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac39aa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6abc1036a0 0x7f6abc101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac39aa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6abc103fc0 0x7f6abc101890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac39aa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6abc10cb00 0x7f6abc101dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac39aa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc1127c0 con 0x7f6abc10cb00 2024-07-24T22:04:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac39aa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc112640 con 0x7f6abc103fc0 2024-07-24T22:04:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac39aa640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc112940 con 0x7f6abc1036a0 2024-07-24T22:04:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac1f47640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6abc10cb00 0x7f6abc101dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac1f47640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6abc10cb00 0x7f6abc101dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37514/0 (socket says 172.21.15.47:37514) 2024-07-24T22:04:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac1f47640 1 -- 172.21.15.47:0/3636562742 learned_addr learned my addr 172.21.15.47:0/3636562742 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac0f45640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6abc103fc0 0x7f6abc101890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac1746640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6abc1036a0 0x7f6abc101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac1f47640 1 -- 172.21.15.47:0/3636562742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6abc1036a0 msgr2=0x7f6abc101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac1f47640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6abc1036a0 0x7f6abc101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac1f47640 1 -- 172.21.15.47:0/3636562742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6abc103fc0 msgr2=0x7f6abc101890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac1f47640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6abc103fc0 0x7f6abc101890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac1f47640 1 -- 172.21.15.47:0/3636562742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc1a70f0 con 0x7f6abc10cb00 2024-07-24T22:04:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ac1f47640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6abc10cb00 0x7f6abc101dd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009fd0 tx=0x7f6ab400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:26.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.340+0000 7f6ab27fc640 1 -- 172.21.15.47:0/3636562742 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4011830 con 0x7f6abc10cb00 2024-07-24T22:04:26.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.341+0000 7f6ab27fc640 1 -- 172.21.15.47:0/3636562742 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ab4016070 con 0x7f6abc10cb00 2024-07-24T22:04:26.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.341+0000 7f6ab27fc640 1 -- 172.21.15.47:0/3636562742 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4010de0 con 0x7f6abc10cb00 2024-07-24T22:04:26.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.341+0000 7f6ac39aa640 1 -- 172.21.15.47:0/3636562742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6abc1a73e0 con 0x7f6abc10cb00 2024-07-24T22:04:26.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.341+0000 7f6ac39aa640 1 -- 172.21.15.47:0/3636562742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6abc1a7920 con 0x7f6abc10cb00 2024-07-24T22:04:26.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.342+0000 7f6ac39aa640 1 -- 172.21.15.47:0/3636562742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6abc103a80 con 0x7f6abc10cb00 2024-07-24T22:04:26.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.343+0000 7f6ab27fc640 1 -- 172.21.15.47:0/3636562742 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f6ab40119d0 con 0x7f6abc10cb00 2024-07-24T22:04:26.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.344+0000 7f6ab27fc640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aa80b3d30 0x7f6aa80b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:26.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.344+0000 7f6ac1746640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aa80b3d30 0x7f6aa80b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:26.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.344+0000 7f6ab27fc640 1 -- 172.21.15.47:0/3636562742 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8194+0+0 (secure 0 0 0) 0x7f6ab40e3ab0 con 0x7f6abc10cb00 2024-07-24T22:04:26.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.344+0000 7f6ac1746640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aa80b3d30 0x7f6aa80b61f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6ab802f500 tx=0x7f6ab802f310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:26.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.347+0000 7f6ab27fc640 1 -- 172.21.15.47:0/3636562742 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f6ab40ab0d0 con 0x7f6abc10cb00 2024-07-24T22:04:26.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.589+0000 7f6ac39aa640 1 -- 172.21.15.47:0/3636562742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6abc1a7c70 con 0x7f6abc10cb00 2024-07-24T22:04:26.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.589+0000 7f6ab27fc640 1 -- 172.21.15.47:0/3636562742 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f6ab40aa9d0 con 0x7f6abc10cb00 2024-07-24T22:04:26.591 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:04:26.592 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:04:26.592 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:04:26.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.591+0000 7f6ac39aa640 1 -- 172.21.15.47:0/3636562742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aa80b3d30 msgr2=0x7f6aa80b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:26.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.591+0000 7f6ac39aa640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aa80b3d30 0x7f6aa80b61f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6ab802f500 tx=0x7f6ab802f310 comp rx=0 tx=0).stop 2024-07-24T22:04:26.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.591+0000 7f6ac39aa640 1 -- 172.21.15.47:0/3636562742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6abc10cb00 msgr2=0x7f6abc101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:26.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.591+0000 7f6ac39aa640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6abc10cb00 0x7f6abc101dd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009fd0 tx=0x7f6ab400b8e0 comp rx=0 tx=0).stop 2024-07-24T22:04:26.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.591+0000 7f6ac39aa640 1 -- 172.21.15.47:0/3636562742 shutdown_connections 2024-07-24T22:04:26.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.591+0000 7f6ac39aa640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aa80b3d30 0x7f6aa80b61f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:26.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.591+0000 7f6ac39aa640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6abc10cb00 0x7f6abc101dd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:26.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.591+0000 7f6ac39aa640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6abc103fc0 0x7f6abc101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:26.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.591+0000 7f6ac39aa640 1 --2- 172.21.15.47:0/3636562742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6abc1036a0 0x7f6abc101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:26.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.591+0000 7f6ac39aa640 1 -- 172.21.15.47:0/3636562742 >> 172.21.15.47:0/3636562742 conn(0x7f6abc0fd100 msgr2=0x7f6abc10ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:26.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.591+0000 7f6ac39aa640 1 -- 172.21.15.47:0/3636562742 shutdown_connections 2024-07-24T22:04:26.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:26.591+0000 7f6ac39aa640 1 -- 172.21.15.47:0/3636562742 wait complete. 2024-07-24T22:04:26.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-07-24T22:04:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-07-24T22:04:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-07-24T22:04:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-07-24T22:04:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-07-24T22:04:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-07-24T22:04:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-07-24T22:04:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-07-24T22:04:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 7]}]: dispatch 2024-07-24T22:04:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-07-24T22:04:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-07-24T22:04:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-07-24T22:04:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-07-24T22:04:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-07-24T22:04:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-07-24T22:04:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-07-24T22:04:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-07-24T22:04:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-07-24T22:04:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 7]}]: dispatch 2024-07-24T22:04:26.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-07-24T22:04:26.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-07-24T22:04:26.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-07-24T22:04:26.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-07-24T22:04:26.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-07-24T22:04:26.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-07-24T22:04:26.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-07-24T22:04:26.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-07-24T22:04:26.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-07-24T22:04:26.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 7]}]: dispatch 2024-07-24T22:04:26.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-07-24T22:04:27.257 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd dump --format=json 2024-07-24T22:04:27.528 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:27.769 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:27 smithi047 ceph-mon[32551]: pgmap v279: 97 pgs: 97 active+clean; 619 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-07-24T22:04:27.769 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-07-24T22:04:27.769 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-07-24T22:04:27.769 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-07-24T22:04:27.769 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-07-24T22:04:27.769 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-07-24T22:04:27.769 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-07-24T22:04:27.769 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-07-24T22:04:27.770 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-07-24T22:04:27.770 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 7]}]': finished 2024-07-24T22:04:27.770 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-07-24T22:04:27.770 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:27 smithi047 ceph-mon[32551]: osdmap e82: 12 total, 12 up, 12 in 2024-07-24T22:04:27.770 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:27 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3636562742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:04:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:27 smithi188 ceph-mon[37380]: pgmap v279: 97 pgs: 97 active+clean; 619 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-07-24T22:04:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-07-24T22:04:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-07-24T22:04:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-07-24T22:04:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-07-24T22:04:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-07-24T22:04:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-07-24T22:04:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-07-24T22:04:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-07-24T22:04:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 7]}]': finished 2024-07-24T22:04:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-07-24T22:04:27.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:27 smithi188 ceph-mon[37380]: osdmap e82: 12 total, 12 up, 12 in 2024-07-24T22:04:27.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:27 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3636562742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:04:27.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:27 smithi183 ceph-mon[37007]: pgmap v279: 97 pgs: 97 active+clean; 619 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-07-24T22:04:27.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-07-24T22:04:27.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-07-24T22:04:27.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-07-24T22:04:27.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-07-24T22:04:27.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-07-24T22:04:27.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-07-24T22:04:27.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-07-24T22:04:27.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-07-24T22:04:27.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 7]}]': finished 2024-07-24T22:04:27.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-07-24T22:04:27.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:27 smithi183 ceph-mon[37007]: osdmap e82: 12 total, 12 up, 12 in 2024-07-24T22:04:27.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:27 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3636562742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:04:28.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:28 smithi188 ceph-mon[37380]: osdmap e83: 12 total, 12 up, 12 in 2024-07-24T22:04:28.860 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:28 smithi047 ceph-mon[32551]: osdmap e83: 12 total, 12 up, 12 in 2024-07-24T22:04:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:28 smithi183 ceph-mon[37007]: osdmap e83: 12 total, 12 up, 12 in 2024-07-24T22:04:29.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.180+0000 7fbdcdd98640 1 -- 172.21.15.47:0/1483542305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc8103590 msgr2=0x7fbdc8103970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:29.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.180+0000 7fbdcdd98640 1 --2- 172.21.15.47:0/1483542305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc8103590 0x7fbdc8103970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009860 tx=0x7fbdb802a340 comp rx=0 tx=0).stop 2024-07-24T22:04:29.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.180+0000 7fbdcdd98640 1 -- 172.21.15.47:0/1483542305 shutdown_connections 2024-07-24T22:04:29.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.180+0000 7fbdcdd98640 1 --2- 172.21.15.47:0/1483542305 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdc810cb40 0x7fbdc810ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:29.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.180+0000 7fbdcdd98640 1 --2- 172.21.15.47:0/1483542305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdc8103f90 0x7fbdc810c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:29.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.180+0000 7fbdcdd98640 1 --2- 172.21.15.47:0/1483542305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc8103590 0x7fbdc8103970 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:29.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.180+0000 7fbdcdd98640 1 -- 172.21.15.47:0/1483542305 >> 172.21.15.47:0/1483542305 conn(0x7fbdc80fd100 msgr2=0x7fbdc80ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:29.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.180+0000 7fbdcdd98640 1 -- 172.21.15.47:0/1483542305 shutdown_connections 2024-07-24T22:04:29.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.180+0000 7fbdcdd98640 1 -- 172.21.15.47:0/1483542305 wait complete. 2024-07-24T22:04:29.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.181+0000 7fbdcdd98640 1 Processor -- start 2024-07-24T22:04:29.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.181+0000 7fbdcdd98640 1 -- start start 2024-07-24T22:04:29.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdcdd98640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdc8103590 0x7fbdc8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:29.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdcdd98640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdc8103f90 0x7fbdc8101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:29.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdcdd98640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc810cb40 0x7fbdc8101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:29.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdcdd98640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc8112750 con 0x7fbdc8103590 2024-07-24T22:04:29.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdcdd98640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc81125d0 con 0x7fbdc810cb40 2024-07-24T22:04:29.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdcdd98640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc81128d0 con 0x7fbdc8103f90 2024-07-24T22:04:29.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdc77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdc8103590 0x7fbdc8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:29.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdc77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdc8103590 0x7fbdc8101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37536/0 (socket says 172.21.15.47:37536) 2024-07-24T22:04:29.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdc77fe640 1 -- 172.21.15.47:0/2298344384 learned_addr learned my addr 172.21.15.47:0/2298344384 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:29.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdc6ffd640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdc8103f90 0x7fbdc8101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:29.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdc7fff640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc810cb40 0x7fbdc8101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:29.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdc77fe640 1 -- 172.21.15.47:0/2298344384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdc8103f90 msgr2=0x7fbdc8101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:29.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdc77fe640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdc8103f90 0x7fbdc8101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:29.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdc77fe640 1 -- 172.21.15.47:0/2298344384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc810cb40 msgr2=0x7fbdc8101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:29.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdc77fe640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc810cb40 0x7fbdc8101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:29.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdc77fe640 1 -- 172.21.15.47:0/2298344384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc81a70e0 con 0x7fbdc8103590 2024-07-24T22:04:29.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdc77fe640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdc8103590 0x7fbdc8101410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80303f0 tx=0x7fbdb8032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:29.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.182+0000 7fbdc4ff9640 1 -- 172.21.15.47:0/2298344384 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8040020 con 0x7fbdc8103590 2024-07-24T22:04:29.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.183+0000 7fbdc4ff9640 1 -- 172.21.15.47:0/2298344384 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdb8030dd0 con 0x7fbdc8103590 2024-07-24T22:04:29.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.183+0000 7fbdcdd98640 1 -- 172.21.15.47:0/2298344384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc81a7370 con 0x7fbdc8103590 2024-07-24T22:04:29.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.183+0000 7fbdc4ff9640 1 -- 172.21.15.47:0/2298344384 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8037040 con 0x7fbdc8103590 2024-07-24T22:04:29.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.183+0000 7fbdcdd98640 1 -- 172.21.15.47:0/2298344384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc81a7850 con 0x7fbdc8103590 2024-07-24T22:04:29.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.184+0000 7fbdcdd98640 1 -- 172.21.15.47:0/2298344384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc8103970 con 0x7fbdc8103590 2024-07-24T22:04:29.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.185+0000 7fbdc4ff9640 1 -- 172.21.15.47:0/2298344384 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fbdb8043020 con 0x7fbdc8103590 2024-07-24T22:04:29.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.186+0000 7fbdc4ff9640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbdb00b3cb0 0x7fbdb00b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:29.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.186+0000 7fbdc6ffd640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbdb00b3cb0 0x7fbdb00b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:29.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.186+0000 7fbdc4ff9640 1 -- 172.21.15.47:0/2298344384 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7fbdb8104210 con 0x7fbdc8103590 2024-07-24T22:04:29.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.186+0000 7fbdc6ffd640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbdb00b3cb0 0x7fbdb00b6170 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8102f00 tx=0x7fbdbc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:29.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.188+0000 7fbdc4ff9640 1 -- 172.21.15.47:0/2298344384 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fbdb804a020 con 0x7fbdc8103590 2024-07-24T22:04:29.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.385+0000 7fbdcdd98640 1 -- 172.21.15.47:0/2298344384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbdc8102710 con 0x7fbdc8103590 2024-07-24T22:04:29.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.386+0000 7fbdc4ff9640 1 -- 172.21.15.47:0/2298344384 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+23016 (secure 0 0 0) 0x7fbdc8102710 con 0x7fbdc8103590 2024-07-24T22:04:29.388 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:04:29.388 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":83,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","created":"2024-07-24T21:55:28.945912+0000","modified":"2024-07-24T22:04:27.493014+0000","last_up_change":"2024-07-24T22:02:55.044691+0000","last_in_change":"2024-07-24T22:02:35.671256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T21:59:32.066678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T22:03:49.331120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T22:03:52.034826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60de2c3d-e4b7-4878-bdbb-ce3257e3706c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6803","nonce":2665889913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6805","nonce":2665889913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6809","nonce":2665889913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6807","nonce":2665889913}]},"public_addr":"172.21.15.47:6803/2665889913","cluster_addr":"172.21.15.47:6805/2665889913","heartbeat_back_addr":"172.21.15.47:6809/2665889913","heartbeat_front_addr":"172.21.15.47:6807/2665889913","state":["exists","up"]},{"osd":1,"uuid":"7f086675-3bed-47ca-a93f-fab9580068b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6801","nonce":3486494228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6803","nonce":3486494228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6807","nonce":3486494228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6805","nonce":3486494228}]},"public_addr":"172.21.15.183:6801/3486494228","cluster_addr":"172.21.15.183:6803/3486494228","heartbeat_back_addr":"172.21.15.183:6807/3486494228","heartbeat_front_addr":"172.21.15.183:6805/3486494228","state":["exists","up"]},{"osd":2,"uuid":"040fff27-6fa6-48de-9365-fcced8f89e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6801","nonce":2245903281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6803","nonce":2245903281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6807","nonce":2245903281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6805","nonce":2245903281}]},"public_addr":"172.21.15.188:6801/2245903281","cluster_addr":"172.21.15.188:6803/2245903281","heartbeat_back_addr":"172.21.15.188:6807/2245903281","heartbeat_front_addr":"172.21.15.188:6805/2245903281","state":["exists","up"]},{"osd":3,"uuid":"e129321a-9566-4bea-b982-34f7ddd1ae1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6811","nonce":236749130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6813","nonce":236749130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6817","nonce":236749130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6815","nonce":236749130}]},"public_addr":"172.21.15.47:6811/236749130","cluster_addr":"172.21.15.47:6813/236749130","heartbeat_back_addr":"172.21.15.47:6817/236749130","heartbeat_front_addr":"172.21.15.47:6815/236749130","state":["exists","up"]},{"osd":4,"uuid":"f969fba7-b0ff-4ea6-83bd-38aba32b1be1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6809","nonce":3978122107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6811","nonce":3978122107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6815","nonce":3978122107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6813","nonce":3978122107}]},"public_addr":"172.21.15.183:6809/3978122107","cluster_addr":"172.21.15.183:6811/3978122107","heartbeat_back_addr":"172.21.15.183:6815/3978122107","heartbeat_front_addr":"172.21.15.183:6813/3978122107","state":["exists","up"]},{"osd":5,"uuid":"3799c912-3d9f-4efd-9b36-569c385e4c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6809","nonce":2097128083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6811","nonce":2097128083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6815","nonce":2097128083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6813","nonce":2097128083}]},"public_addr":"172.21.15.188:6809/2097128083","cluster_addr":"172.21.15.188:6811/2097128083","heartbeat_back_addr":"172.21.15.188:6815/2097128083","heartbeat_front_addr":"172.21.15.188:6813/2097128083","state":["exists","up"]},{"osd":6,"uuid":"1a38cf12-619f-4e82-a7a5-21ee2014038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6819","nonce":2288252980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6821","nonce":2288252980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6825","nonce":2288252980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6823","nonce":2288252980}]},"public_addr":"172.21.15.47:6819/2288252980","cluster_addr":"172.21.15.47:6821/2288252980","heartbeat_back_addr":"172.21.15.47:6825/2288252980","heartbeat_front_addr":"172.21.15.47:6823/2288252980","state":["exists","up"]},{"osd":7,"uuid":"6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6817","nonce":465426514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6819","nonce":465426514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6823","nonce":465426514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6821","nonce":465426514}]},"public_addr":"172.21.15.183:6817/465426514","cluster_addr":"172.21.15.183:6819/465426514","heartbeat_back_addr":"172.21.15.183:6823/465426514","heartbeat_front_addr":"172.21.15.183:6821/465426514","state":["exists","up"]},{"osd":8,"uuid":"6dfd7252-61a6-423d-8498-cbcfa41ae1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6817","nonce":2247055658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6819","nonce":2247055658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6823","nonce":2247055658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6821","nonce":2247055658}]},"public_addr":"172.21.15.188:6817/2247055658","cluster_addr":"172.21.15.188:6819/2247055658","heartbeat_back_addr":"172.21.15.188:6823/2247055658","heartbeat_front_addr":"172.21.15.188:6821/2247055658","state":["exists","up"]},{"osd":9,"uuid":"abd93c5e-283e-4873-a241-1056f2894116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6827","nonce":2628721884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6829","nonce":2628721884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6833","nonce":2628721884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6831","nonce":2628721884}]},"public_addr":"172.21.15.47:6827/2628721884","cluster_addr":"172.21.15.47:6829/2628721884","heartbeat_back_addr":"172.21.15.47:6833/2628721884","heartbeat_front_addr":"172.21.15.47:6831/2628721884","state":["exists","up"]},{"osd":10,"uuid":"bc967f8f-ce27-4230-be70-e36927f89fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6825","nonce":3509332199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6827","nonce":3509332199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6831","nonce":3509332199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6829","nonce":3509332199}]},"public_addr":"172.21.15.183:6825/3509332199","cluster_addr":"172.21.15.183:6827/3509332199","heartbeat_back_addr":"172.21.15.183:6831/3509332199","heartbeat_front_addr":"172.21.15.183:6829/3509332199","state":["exists","up"]},{"osd":11,"uuid":"8b379865-3a5c-4a2d-aa74-a4f215027fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6825","nonce":3725107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6827","nonce":3725107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6831","nonce":3725107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6829","nonce":3725107101}]},"public_addr":"172.21.15.188:6825/3725107101","cluster_addr":"172.21.15.188:6827/3725107101","heartbeat_back_addr":"172.21.15.188:6831/3725107101","heartbeat_front_addr":"172.21.15.188:6829/3725107101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:58:44.413660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:06.554842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:28.651418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:50.995466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:13.906535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:36.632662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:59.003224+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:21.701327+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:44.017943+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:06.400895+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:29.625920+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:52.323223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3499235566":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/2112533111":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/2714360830":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/507334607":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6800/2524786594":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/1004458106":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6800/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/1046677443":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/899235864":"2024-07-25T21:56:15.044564+0000","172.21.15.47:6800/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/3057769442":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/2596054312":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6801/2524786594":"2024-07-25T21:57:25.995502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T22:04:29.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.388+0000 7fbdcdd98640 1 -- 172.21.15.47:0/2298344384 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbdb00b3cb0 msgr2=0x7fbdb00b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:29.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.388+0000 7fbdcdd98640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbdb00b3cb0 0x7fbdb00b6170 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8102f00 tx=0x7fbdbc009260 comp rx=0 tx=0).stop 2024-07-24T22:04:29.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.388+0000 7fbdcdd98640 1 -- 172.21.15.47:0/2298344384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdc8103590 msgr2=0x7fbdc8101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:29.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.388+0000 7fbdcdd98640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdc8103590 0x7fbdc8101410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80303f0 tx=0x7fbdb8032da0 comp rx=0 tx=0).stop 2024-07-24T22:04:29.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.388+0000 7fbdcdd98640 1 -- 172.21.15.47:0/2298344384 shutdown_connections 2024-07-24T22:04:29.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.388+0000 7fbdcdd98640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbdb00b3cb0 0x7fbdb00b6170 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:29.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.388+0000 7fbdcdd98640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdc810cb40 0x7fbdc8101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:29.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.388+0000 7fbdcdd98640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdc8103f90 0x7fbdc8101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:29.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.388+0000 7fbdcdd98640 1 --2- 172.21.15.47:0/2298344384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdc8103590 0x7fbdc8101410 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:29.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.388+0000 7fbdcdd98640 1 -- 172.21.15.47:0/2298344384 >> 172.21.15.47:0/2298344384 conn(0x7fbdc80fd100 msgr2=0x7fbdc80fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:29.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.388+0000 7fbdcdd98640 1 -- 172.21.15.47:0/2298344384 shutdown_connections 2024-07-24T22:04:29.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:29.388+0000 7fbdcdd98640 1 -- 172.21.15.47:0/2298344384 wait complete. 2024-07-24T22:04:29.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:29 smithi188 ceph-mon[37380]: pgmap v282: 97 pgs: 1 peering, 96 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-07-24T22:04:29.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:29 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2298344384' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:04:29.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:29 smithi183 ceph-mon[37007]: pgmap v282: 97 pgs: 1 peering, 96 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-07-24T22:04:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:29 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2298344384' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:04:29.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:29 smithi047 ceph-mon[32551]: pgmap v282: 97 pgs: 1 peering, 96 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-07-24T22:04:29.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:29 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2298344384' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:04:29.988 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-07-24T22:04:29.989 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph pg dump --format=json 2024-07-24T22:04:30.267 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:31.553 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:31 smithi047 ceph-mon[32551]: pgmap v283: 97 pgs: 1 peering, 96 active+clean; 633 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.5 KiB/s wr, 3 op/s; 87 B/s, 0 objects/s recovering 2024-07-24T22:04:31.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.758+0000 7f68303e1640 1 -- 172.21.15.47:0/433683684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6828102790 msgr2=0x7f6828102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:31.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.758+0000 7f68303e1640 1 --2- 172.21.15.47:0/433683684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6828102790 0x7f6828102b70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6824009900 tx=0x7f682402a410 comp rx=0 tx=0).stop 2024-07-24T22:04:31.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.759+0000 7f68303e1640 1 -- 172.21.15.47:0/433683684 shutdown_connections 2024-07-24T22:04:31.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.759+0000 7f68303e1640 1 --2- 172.21.15.47:0/433683684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6828108b20 0x7f682810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:31.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.759+0000 7f68303e1640 1 --2- 172.21.15.47:0/433683684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68281081a0 0x7f68281085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:31.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.759+0000 7f68303e1640 1 --2- 172.21.15.47:0/433683684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6828102790 0x7f6828102b70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:31.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.759+0000 7f68303e1640 1 -- 172.21.15.47:0/433683684 >> 172.21.15.47:0/433683684 conn(0x7f68280fe200 msgr2=0x7f6828100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:31.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.759+0000 7f68303e1640 1 -- 172.21.15.47:0/433683684 shutdown_connections 2024-07-24T22:04:31.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.759+0000 7f68303e1640 1 -- 172.21.15.47:0/433683684 wait complete. 2024-07-24T22:04:31.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.759+0000 7f68303e1640 1 Processor -- start 2024-07-24T22:04:31.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.759+0000 7f68303e1640 1 -- start start 2024-07-24T22:04:31.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.759+0000 7f68303e1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6828102790 0x7f682819aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:31.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.759+0000 7f68303e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68281081a0 0x7f682819b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:31.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f68303e1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6828108b20 0x7f68281a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:31.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f68303e1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68281127f0 con 0x7f6828102790 2024-07-24T22:04:31.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f68303e1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6828112670 con 0x7f6828108b20 2024-07-24T22:04:31.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f68303e1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6828112970 con 0x7f68281081a0 2024-07-24T22:04:31.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f682e17d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6828102790 0x7f682819aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:31.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f682e17d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6828102790 0x7f682819aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37554/0 (socket says 172.21.15.47:37554) 2024-07-24T22:04:31.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f682e17d640 1 -- 172.21.15.47:0/51418620 learned_addr learned my addr 172.21.15.47:0/51418620 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:31.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f682e97e640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6828108b20 0x7f68281a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:31.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f682d97c640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68281081a0 0x7f682819b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:31.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f682e17d640 1 -- 172.21.15.47:0/51418620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68281081a0 msgr2=0x7f682819b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:31.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f682e17d640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68281081a0 0x7f682819b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:31.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f682e17d640 1 -- 172.21.15.47:0/51418620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6828108b20 msgr2=0x7f68281a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:31.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f682e17d640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6828108b20 0x7f68281a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:31.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f682e17d640 1 -- 172.21.15.47:0/51418620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68281a0f90 con 0x7f6828102790 2024-07-24T22:04:31.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f682e97e640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6828108b20 0x7f68281a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:04:31.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f682e17d640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6828102790 0x7f682819aee0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6824005ab0 tx=0x7f6824003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:31.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f681f7fe640 1 -- 172.21.15.47:0/51418620 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682403f070 con 0x7f6828102790 2024-07-24T22:04:31.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f681f7fe640 1 -- 172.21.15.47:0/51418620 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6824031d60 con 0x7f6828102790 2024-07-24T22:04:31.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f68303e1640 1 -- 172.21.15.47:0/51418620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68281a1220 con 0x7f6828102790 2024-07-24T22:04:31.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f681f7fe640 1 -- 172.21.15.47:0/51418620 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824035030 con 0x7f6828102790 2024-07-24T22:04:31.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.760+0000 7f68303e1640 1 -- 172.21.15.47:0/51418620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68281a7940 con 0x7f6828102790 2024-07-24T22:04:31.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.761+0000 7f68303e1640 1 -- 172.21.15.47:0/51418620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6828102b70 con 0x7f6828102790 2024-07-24T22:04:31.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.763+0000 7f681f7fe640 1 -- 172.21.15.47:0/51418620 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f6824042070 con 0x7f6828102790 2024-07-24T22:04:31.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.763+0000 7f681f7fe640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f68140b3cb0 0x7f68140b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:31.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.764+0000 7f682d97c640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f68140b3cb0 0x7f68140b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:31.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.764+0000 7f681f7fe640 1 -- 172.21.15.47:0/51418620 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f6824104f10 con 0x7f6828102790 2024-07-24T22:04:31.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.764+0000 7f682d97c640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f68140b3cb0 0x7f68140b6170 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6828107a30 tx=0x7f6818008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:31.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.766+0000 7f681f7fe640 1 -- 172.21.15.47:0/51418620 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f68240cc2a0 con 0x7f6828102790 2024-07-24T22:04:31.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:31 smithi188 ceph-mon[37380]: pgmap v283: 97 pgs: 1 peering, 96 active+clean; 633 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.5 KiB/s wr, 3 op/s; 87 B/s, 0 objects/s recovering 2024-07-24T22:04:31.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:31 smithi183 ceph-mon[37007]: pgmap v283: 97 pgs: 1 peering, 96 active+clean; 633 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.5 KiB/s wr, 3 op/s; 87 B/s, 0 objects/s recovering 2024-07-24T22:04:31.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.960+0000 7f68303e1640 1 -- 172.21.15.47:0/51418620 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6828062f80 con 0x7f68140b3cb0 2024-07-24T22:04:31.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.964+0000 7f681f7fe640 1 -- 172.21.15.47:0/51418620 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258591 (secure 0 0 0) 0x7f6828062f80 con 0x7f68140b3cb0 2024-07-24T22:04:31.969 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:04:31.970 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-07-24T22:04:31.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.968+0000 7f68303e1640 1 -- 172.21.15.47:0/51418620 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f68140b3cb0 msgr2=0x7f68140b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:31.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.968+0000 7f68303e1640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f68140b3cb0 0x7f68140b6170 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6828107a30 tx=0x7f6818008040 comp rx=0 tx=0).stop 2024-07-24T22:04:31.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.968+0000 7f68303e1640 1 -- 172.21.15.47:0/51418620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6828102790 msgr2=0x7f682819aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:31.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.968+0000 7f68303e1640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6828102790 0x7f682819aee0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6824005ab0 tx=0x7f6824003cd0 comp rx=0 tx=0).stop 2024-07-24T22:04:31.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.968+0000 7f68303e1640 1 -- 172.21.15.47:0/51418620 shutdown_connections 2024-07-24T22:04:31.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.968+0000 7f68303e1640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f68140b3cb0 0x7f68140b6170 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:31.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.968+0000 7f68303e1640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6828108b20 0x7f68281a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:31.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.968+0000 7f68303e1640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68281081a0 0x7f682819b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:31.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.968+0000 7f68303e1640 1 --2- 172.21.15.47:0/51418620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6828102790 0x7f682819aee0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:31.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.968+0000 7f68303e1640 1 -- 172.21.15.47:0/51418620 >> 172.21.15.47:0/51418620 conn(0x7f68280fe200 msgr2=0x7f6828075590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:31.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.968+0000 7f68303e1640 1 -- 172.21.15.47:0/51418620 shutdown_connections 2024-07-24T22:04:31.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:31.968+0000 7f68303e1640 1 -- 172.21.15.47:0/51418620 wait complete. 2024-07-24T22:04:32.729 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-07-24T22:04:30.080717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648340,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":132,"num_read_kb":152,"num_write":203,"num_write_kb":2231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952539,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":294,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386600,"kb_used_data":12420,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555224,"statfs":{"total":1151940427776,"available":1151544549376,"internally_reserved":0,"allocated":12718080,"data_stored":7255625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14856,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":34,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":699,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002036"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.420267+0000","last_change":"2024-07-24T22:03:53.407929+0000","last_active":"2024-07-24T22:03:55.420267+0000","last_peered":"2024-07-24T22:03:55.420267+0000","last_clean":"2024-07-24T22:03:55.420267+0000","last_became_active":"2024-07-24T22:03:53.407508+0000","last_became_peered":"2024-07-24T22:03:53.407508+0000","last_unstale":"2024-07-24T22:03:55.420267+0000","last_undegraded":"2024-07-24T22:03:55.420267+0000","last_fullsized":"2024-07-24T22:03:55.420267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:00:35.699906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.501214+0000","last_change":"2024-07-24T22:03:53.404867+0000","last_active":"2024-07-24T22:04:26.501214+0000","last_peered":"2024-07-24T22:04:26.501214+0000","last_clean":"2024-07-24T22:04:26.501214+0000","last_became_active":"2024-07-24T22:03:53.404309+0000","last_became_peered":"2024-07-24T22:03:53.404309+0000","last_unstale":"2024-07-24T22:04:26.501214+0000","last_undegraded":"2024-07-24T22:04:26.501214+0000","last_fullsized":"2024-07-24T22:04:26.501214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:21:51.238815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.501022+0000","last_change":"2024-07-24T22:03:53.404368+0000","last_active":"2024-07-24T22:04:26.501022+0000","last_peered":"2024-07-24T22:04:26.501022+0000","last_clean":"2024-07-24T22:04:26.501022+0000","last_became_active":"2024-07-24T22:03:53.403941+0000","last_became_peered":"2024-07-24T22:03:53.403941+0000","last_unstale":"2024-07-24T22:04:26.501022+0000","last_undegraded":"2024-07-24T22:04:26.501022+0000","last_fullsized":"2024-07-24T22:04:26.501022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:10:09.884724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.498379+0000","last_change":"2024-07-24T22:03:53.407661+0000","last_active":"2024-07-24T22:04:26.498379+0000","last_peered":"2024-07-24T22:04:26.498379+0000","last_clean":"2024-07-24T22:04:26.498379+0000","last_became_active":"2024-07-24T22:03:53.407375+0000","last_became_peered":"2024-07-24T22:03:53.407375+0000","last_unstale":"2024-07-24T22:04:26.498379+0000","last_undegraded":"2024-07-24T22:04:26.498379+0000","last_fullsized":"2024-07-24T22:04:26.498379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:34.000666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500864+0000","last_change":"2024-07-24T22:03:53.406227+0000","last_active":"2024-07-24T22:04:27.500864+0000","last_peered":"2024-07-24T22:04:27.500864+0000","last_clean":"2024-07-24T22:04:27.500864+0000","last_became_active":"2024-07-24T22:03:53.405819+0000","last_became_peered":"2024-07-24T22:03:53.405819+0000","last_unstale":"2024-07-24T22:04:27.500864+0000","last_undegraded":"2024-07-24T22:04:27.500864+0000","last_fullsized":"2024-07-24T22:04:27.500864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:59.022972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.411952+0000","last_change":"2024-07-24T22:03:53.394231+0000","last_active":"2024-07-24T22:03:55.411952+0000","last_peered":"2024-07-24T22:03:55.411952+0000","last_clean":"2024-07-24T22:03:55.411952+0000","last_became_active":"2024-07-24T22:03:53.393880+0000","last_became_peered":"2024-07-24T22:03:53.393880+0000","last_unstale":"2024-07-24T22:03:55.411952+0000","last_undegraded":"2024-07-24T22:03:55.411952+0000","last_fullsized":"2024-07-24T22:03:55.411952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:14.019543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500652+0000","last_change":"2024-07-24T22:03:53.413012+0000","last_active":"2024-07-24T22:04:27.500652+0000","last_peered":"2024-07-24T22:04:27.500652+0000","last_clean":"2024-07-24T22:04:27.500652+0000","last_became_active":"2024-07-24T22:03:53.411791+0000","last_became_peered":"2024-07-24T22:03:53.411791+0000","last_unstale":"2024-07-24T22:04:27.500652+0000","last_undegraded":"2024-07-24T22:04:27.500652+0000","last_fullsized":"2024-07-24T22:04:27.500652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:15:02.939598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.502913+0000","last_change":"2024-07-24T22:04:27.502867+0000","last_active":"2024-07-24T22:04:27.502913+0000","last_peered":"2024-07-24T22:04:27.502913+0000","last_clean":"2024-07-24T22:04:27.502913+0000","last_became_active":"2024-07-24T22:04:27.502515+0000","last_became_peered":"2024-07-24T22:04:27.502515+0000","last_unstale":"2024-07-24T22:04:27.502913+0000","last_undegraded":"2024-07-24T22:04:27.502913+0000","last_fullsized":"2024-07-24T22:04:27.502913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:58:39.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,10],"acting":[3,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.566696+0000","last_change":"2024-07-24T22:03:53.413213+0000","last_active":"2024-07-24T22:04:27.566696+0000","last_peered":"2024-07-24T22:04:27.566696+0000","last_clean":"2024-07-24T22:04:27.566696+0000","last_became_active":"2024-07-24T22:03:53.412725+0000","last_became_peered":"2024-07-24T22:03:53.412725+0000","last_unstale":"2024-07-24T22:04:27.566696+0000","last_undegraded":"2024-07-24T22:04:27.566696+0000","last_fullsized":"2024-07-24T22:04:27.566696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:34:01.897965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.412457+0000","last_change":"2024-07-24T22:03:53.401129+0000","last_active":"2024-07-24T22:03:55.412457+0000","last_peered":"2024-07-24T22:03:55.412457+0000","last_clean":"2024-07-24T22:03:55.412457+0000","last_became_active":"2024-07-24T22:03:53.400780+0000","last_became_peered":"2024-07-24T22:03:53.400780+0000","last_unstale":"2024-07-24T22:03:55.412457+0000","last_undegraded":"2024-07-24T22:03:55.412457+0000","last_fullsized":"2024-07-24T22:03:55.412457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:28:37.825021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501073+0000","last_change":"2024-07-24T22:03:53.406490+0000","last_active":"2024-07-24T22:04:27.501073+0000","last_peered":"2024-07-24T22:04:27.501073+0000","last_clean":"2024-07-24T22:04:27.501073+0000","last_became_active":"2024-07-24T22:03:53.406108+0000","last_became_peered":"2024-07-24T22:03:53.406108+0000","last_unstale":"2024-07-24T22:04:27.501073+0000","last_undegraded":"2024-07-24T22:04:27.501073+0000","last_fullsized":"2024-07-24T22:04:27.501073+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:37.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.503630+0000","last_change":"2024-07-24T22:04:27.503165+0000","last_active":"2024-07-24T22:04:27.503630+0000","last_peered":"2024-07-24T22:04:27.503630+0000","last_clean":"2024-07-24T22:04:27.503630+0000","last_became_active":"2024-07-24T22:04:27.502861+0000","last_became_peered":"2024-07-24T22:04:27.502861+0000","last_unstale":"2024-07-24T22:04:27.503630+0000","last_undegraded":"2024-07-24T22:04:27.503630+0000","last_fullsized":"2024-07-24T22:04:27.503630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:36:41.353268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.495480+0000","last_change":"2024-07-24T22:03:53.392763+0000","last_active":"2024-07-24T22:04:26.495480+0000","last_peered":"2024-07-24T22:04:26.495480+0000","last_clean":"2024-07-24T22:04:26.495480+0000","last_became_active":"2024-07-24T22:03:53.392476+0000","last_became_peered":"2024-07-24T22:03:53.392476+0000","last_unstale":"2024-07-24T22:04:26.495480+0000","last_undegraded":"2024-07-24T22:04:26.495480+0000","last_fullsized":"2024-07-24T22:04:26.495480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:25:13.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.500468+0000","last_change":"2024-07-24T22:03:53.406937+0000","last_active":"2024-07-24T22:04:26.500468+0000","last_peered":"2024-07-24T22:04:26.500468+0000","last_clean":"2024-07-24T22:04:26.500468+0000","last_became_active":"2024-07-24T22:03:53.406495+0000","last_became_peered":"2024-07-24T22:03:53.406495+0000","last_unstale":"2024-07-24T22:04:26.500468+0000","last_undegraded":"2024-07-24T22:04:26.500468+0000","last_fullsized":"2024-07-24T22:04:26.500468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:06:50.434751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.500367+0000","last_change":"2024-07-24T22:03:53.401073+0000","last_active":"2024-07-24T22:04:26.500367+0000","last_peered":"2024-07-24T22:04:26.500367+0000","last_clean":"2024-07-24T22:04:26.500367+0000","last_became_active":"2024-07-24T22:03:53.399675+0000","last_became_peered":"2024-07-24T22:03:53.399675+0000","last_unstale":"2024-07-24T22:04:26.500367+0000","last_undegraded":"2024-07-24T22:04:26.500367+0000","last_fullsized":"2024-07-24T22:04:26.500367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:59:25.461178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.565549+0000","last_change":"2024-07-24T22:03:53.408289+0000","last_active":"2024-07-24T22:04:27.565549+0000","last_peered":"2024-07-24T22:04:27.565549+0000","last_clean":"2024-07-24T22:04:27.565549+0000","last_became_active":"2024-07-24T22:03:53.407950+0000","last_became_peered":"2024-07-24T22:03:53.407950+0000","last_unstale":"2024-07-24T22:04:27.565549+0000","last_undegraded":"2024-07-24T22:04:27.565549+0000","last_fullsized":"2024-07-24T22:04:27.565549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:10:30.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.420418+0000","last_change":"2024-07-24T22:03:53.409909+0000","last_active":"2024-07-24T22:03:55.420418+0000","last_peered":"2024-07-24T22:03:55.420418+0000","last_clean":"2024-07-24T22:03:55.420418+0000","last_became_active":"2024-07-24T22:03:53.409183+0000","last_became_peered":"2024-07-24T22:03:53.409183+0000","last_unstale":"2024-07-24T22:03:55.420418+0000","last_undegraded":"2024-07-24T22:03:55.420418+0000","last_fullsized":"2024-07-24T22:03:55.420418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:14:50.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499131+0000","last_change":"2024-07-24T22:03:53.401198+0000","last_active":"2024-07-24T22:04:27.499131+0000","last_peered":"2024-07-24T22:04:27.499131+0000","last_clean":"2024-07-24T22:04:27.499131+0000","last_became_active":"2024-07-24T22:03:53.400885+0000","last_became_peered":"2024-07-24T22:03:53.400885+0000","last_unstale":"2024-07-24T22:04:27.499131+0000","last_undegraded":"2024-07-24T22:04:27.499131+0000","last_fullsized":"2024-07-24T22:04:27.499131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:59:37.965714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.411743+0000","last_change":"2024-07-24T22:03:53.406590+0000","last_active":"2024-07-24T22:03:55.411743+0000","last_peered":"2024-07-24T22:03:55.411743+0000","last_clean":"2024-07-24T22:03:55.411743+0000","last_became_active":"2024-07-24T22:03:53.406283+0000","last_became_peered":"2024-07-24T22:03:53.406283+0000","last_unstale":"2024-07-24T22:03:55.411743+0000","last_undegraded":"2024-07-24T22:03:55.411743+0000","last_fullsized":"2024-07-24T22:03:55.411743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:30.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.419497+0000","last_change":"2024-07-24T22:03:53.408790+0000","last_active":"2024-07-24T22:03:55.419497+0000","last_peered":"2024-07-24T22:03:55.419497+0000","last_clean":"2024-07-24T22:03:55.419497+0000","last_became_active":"2024-07-24T22:03:53.408480+0000","last_became_peered":"2024-07-24T22:03:53.408480+0000","last_unstale":"2024-07-24T22:03:55.419497+0000","last_undegraded":"2024-07-24T22:03:55.419497+0000","last_fullsized":"2024-07-24T22:03:55.419497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:59.601606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.495513+0000","last_change":"2024-07-24T22:03:53.407400+0000","last_active":"2024-07-24T22:04:26.495513+0000","last_peered":"2024-07-24T22:04:26.495513+0000","last_clean":"2024-07-24T22:04:26.495513+0000","last_became_active":"2024-07-24T22:03:53.407084+0000","last_became_peered":"2024-07-24T22:03:53.407084+0000","last_unstale":"2024-07-24T22:04:26.495513+0000","last_undegraded":"2024-07-24T22:04:26.495513+0000","last_fullsized":"2024-07-24T22:04:26.495513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:51:04.942504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.565721+0000","last_change":"2024-07-24T22:03:53.407444+0000","last_active":"2024-07-24T22:04:27.565721+0000","last_peered":"2024-07-24T22:04:27.565721+0000","last_clean":"2024-07-24T22:04:27.565721+0000","last_became_active":"2024-07-24T22:03:53.407025+0000","last_became_peered":"2024-07-24T22:03:53.407025+0000","last_unstale":"2024-07-24T22:04:27.565721+0000","last_undegraded":"2024-07-24T22:04:27.565721+0000","last_fullsized":"2024-07-24T22:04:27.565721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:47:49.620354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498204+0000","last_change":"2024-07-24T22:03:53.406748+0000","last_active":"2024-07-24T22:04:27.498204+0000","last_peered":"2024-07-24T22:04:27.498204+0000","last_clean":"2024-07-24T22:04:27.498204+0000","last_became_active":"2024-07-24T22:03:53.406398+0000","last_became_peered":"2024-07-24T22:03:53.406398+0000","last_unstale":"2024-07-24T22:04:27.498204+0000","last_undegraded":"2024-07-24T22:04:27.498204+0000","last_fullsized":"2024-07-24T22:04:27.498204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:35:40.117375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499636+0000","last_change":"2024-07-24T22:03:53.402203+0000","last_active":"2024-07-24T22:04:27.499636+0000","last_peered":"2024-07-24T22:04:27.499636+0000","last_clean":"2024-07-24T22:04:27.499636+0000","last_became_active":"2024-07-24T22:03:53.401826+0000","last_became_peered":"2024-07-24T22:03:53.401826+0000","last_unstale":"2024-07-24T22:04:27.499636+0000","last_undegraded":"2024-07-24T22:04:27.499636+0000","last_fullsized":"2024-07-24T22:04:27.499636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:45.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498918+0000","last_change":"2024-07-24T22:03:53.408179+0000","last_active":"2024-07-24T22:04:27.498918+0000","last_peered":"2024-07-24T22:04:27.498918+0000","last_clean":"2024-07-24T22:04:27.498918+0000","last_became_active":"2024-07-24T22:03:53.407547+0000","last_became_peered":"2024-07-24T22:03:53.407547+0000","last_unstale":"2024-07-24T22:04:27.498918+0000","last_undegraded":"2024-07-24T22:04:27.498918+0000","last_fullsized":"2024-07-24T22:04:27.498918+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:03:52.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.412146+0000","last_change":"2024-07-24T22:03:53.408550+0000","last_active":"2024-07-24T22:03:55.412146+0000","last_peered":"2024-07-24T22:03:55.412146+0000","last_clean":"2024-07-24T22:03:55.412146+0000","last_became_active":"2024-07-24T22:03:53.408119+0000","last_became_peered":"2024-07-24T22:03:53.408119+0000","last_unstale":"2024-07-24T22:03:55.412146+0000","last_undegraded":"2024-07-24T22:03:55.412146+0000","last_fullsized":"2024-07-24T22:03:55.412146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:33:54.154606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.419773+0000","last_change":"2024-07-24T22:03:53.412562+0000","last_active":"2024-07-24T22:03:55.419773+0000","last_peered":"2024-07-24T22:03:55.419773+0000","last_clean":"2024-07-24T22:03:55.419773+0000","last_became_active":"2024-07-24T22:03:53.412231+0000","last_became_peered":"2024-07-24T22:03:53.412231+0000","last_unstale":"2024-07-24T22:03:55.419773+0000","last_undegraded":"2024-07-24T22:03:55.419773+0000","last_fullsized":"2024-07-24T22:03:55.419773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:53:48.403662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.495525+0000","last_change":"2024-07-24T22:03:53.398212+0000","last_active":"2024-07-24T22:04:26.495525+0000","last_peered":"2024-07-24T22:04:26.495525+0000","last_clean":"2024-07-24T22:04:26.495525+0000","last_became_active":"2024-07-24T22:03:53.397853+0000","last_became_peered":"2024-07-24T22:03:53.397853+0000","last_unstale":"2024-07-24T22:04:26.495525+0000","last_undegraded":"2024-07-24T22:04:26.495525+0000","last_fullsized":"2024-07-24T22:04:26.495525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:39:47.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.501129+0000","last_change":"2024-07-24T22:03:53.397188+0000","last_active":"2024-07-24T22:04:26.501129+0000","last_peered":"2024-07-24T22:04:26.501129+0000","last_clean":"2024-07-24T22:04:26.501129+0000","last_became_active":"2024-07-24T22:03:53.396865+0000","last_became_peered":"2024-07-24T22:03:53.396865+0000","last_unstale":"2024-07-24T22:04:26.501129+0000","last_undegraded":"2024-07-24T22:04:26.501129+0000","last_fullsized":"2024-07-24T22:04:26.501129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:20:49.074330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.411524+0000","last_change":"2024-07-24T22:03:53.406605+0000","last_active":"2024-07-24T22:03:55.411524+0000","last_peered":"2024-07-24T22:03:55.411524+0000","last_clean":"2024-07-24T22:03:55.411524+0000","last_became_active":"2024-07-24T22:03:53.406264+0000","last_became_peered":"2024-07-24T22:03:53.406264+0000","last_unstale":"2024-07-24T22:03:55.411524+0000","last_undegraded":"2024-07-24T22:03:55.411524+0000","last_fullsized":"2024-07-24T22:03:55.411524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:13:46.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.411714+0000","last_change":"2024-07-24T22:03:53.400422+0000","last_active":"2024-07-24T22:03:55.411714+0000","last_peered":"2024-07-24T22:03:55.411714+0000","last_clean":"2024-07-24T22:03:55.411714+0000","last_became_active":"2024-07-24T22:03:53.400096+0000","last_became_peered":"2024-07-24T22:03:53.400096+0000","last_unstale":"2024-07-24T22:03:55.411714+0000","last_undegraded":"2024-07-24T22:03:55.411714+0000","last_fullsized":"2024-07-24T22:03:55.411714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:04:07.882659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.420007+0000","last_change":"2024-07-24T22:03:53.413231+0000","last_active":"2024-07-24T22:03:55.420007+0000","last_peered":"2024-07-24T22:03:55.420007+0000","last_clean":"2024-07-24T22:03:55.420007+0000","last_became_active":"2024-07-24T22:03:53.412825+0000","last_became_peered":"2024-07-24T22:03:53.412825+0000","last_unstale":"2024-07-24T22:03:55.420007+0000","last_undegraded":"2024-07-24T22:03:55.420007+0000","last_fullsized":"2024-07-24T22:03:55.420007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:59:30.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501034+0000","last_change":"2024-07-24T22:03:53.409007+0000","last_active":"2024-07-24T22:04:27.501034+0000","last_peered":"2024-07-24T22:04:27.501034+0000","last_clean":"2024-07-24T22:04:27.501034+0000","last_became_active":"2024-07-24T22:03:53.408624+0000","last_became_peered":"2024-07-24T22:03:53.408624+0000","last_unstale":"2024-07-24T22:04:27.501034+0000","last_undegraded":"2024-07-24T22:04:27.501034+0000","last_fullsized":"2024-07-24T22:04:27.501034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:31:22.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500041+0000","last_change":"2024-07-24T22:03:50.388894+0000","last_active":"2024-07-24T22:04:27.500041+0000","last_peered":"2024-07-24T22:04:27.500041+0000","last_clean":"2024-07-24T22:04:27.500041+0000","last_became_active":"2024-07-24T22:03:50.388608+0000","last_became_peered":"2024-07-24T22:03:50.388608+0000","last_unstale":"2024-07-24T22:04:27.500041+0000","last_undegraded":"2024-07-24T22:04:27.500041+0000","last_fullsized":"2024-07-24T22:04:27.500041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:36:43.571415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500386+0000","last_change":"2024-07-24T22:03:53.397509+0000","last_active":"2024-07-24T22:04:27.500386+0000","last_peered":"2024-07-24T22:04:27.500386+0000","last_clean":"2024-07-24T22:04:27.500386+0000","last_became_active":"2024-07-24T22:03:53.397186+0000","last_became_peered":"2024-07-24T22:03:53.397186+0000","last_unstale":"2024-07-24T22:04:27.500386+0000","last_undegraded":"2024-07-24T22:04:27.500386+0000","last_fullsized":"2024-07-24T22:04:27.500386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:15:14.081853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.412140+0000","last_change":"2024-07-24T22:03:50.383523+0000","last_active":"2024-07-24T22:03:55.412140+0000","last_peered":"2024-07-24T22:03:55.412140+0000","last_clean":"2024-07-24T22:03:55.412140+0000","last_became_active":"2024-07-24T22:03:50.383088+0000","last_became_peered":"2024-07-24T22:03:50.383088+0000","last_unstale":"2024-07-24T22:03:55.412140+0000","last_undegraded":"2024-07-24T22:03:55.412140+0000","last_fullsized":"2024-07-24T22:03:55.412140+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:57:07.824581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.495218+0000","last_change":"2024-07-24T22:03:50.383726+0000","last_active":"2024-07-24T22:04:26.495218+0000","last_peered":"2024-07-24T22:04:26.495218+0000","last_clean":"2024-07-24T22:04:26.495218+0000","last_became_active":"2024-07-24T22:03:50.383480+0000","last_became_peered":"2024-07-24T22:03:50.383480+0000","last_unstale":"2024-07-24T22:04:26.495218+0000","last_undegraded":"2024-07-24T22:04:26.495218+0000","last_fullsized":"2024-07-24T22:04:26.495218+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:05:05.093272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498792+0000","last_change":"2024-07-24T22:03:53.406223+0000","last_active":"2024-07-24T22:04:27.498792+0000","last_peered":"2024-07-24T22:04:27.498792+0000","last_clean":"2024-07-24T22:04:27.498792+0000","last_became_active":"2024-07-24T22:03:53.404642+0000","last_became_peered":"2024-07-24T22:03:53.404642+0000","last_unstale":"2024-07-24T22:04:27.498792+0000","last_undegraded":"2024-07-24T22:04:27.498792+0000","last_fullsized":"2024-07-24T22:04:27.498792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:00:51.849538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499934+0000","last_change":"2024-07-24T22:03:50.385780+0000","last_active":"2024-07-24T22:04:27.499934+0000","last_peered":"2024-07-24T22:04:27.499934+0000","last_clean":"2024-07-24T22:04:27.499934+0000","last_became_active":"2024-07-24T22:03:50.385488+0000","last_became_peered":"2024-07-24T22:03:50.385488+0000","last_unstale":"2024-07-24T22:04:27.499934+0000","last_undegraded":"2024-07-24T22:04:27.499934+0000","last_fullsized":"2024-07-24T22:04:27.499934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:47:35.908303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498786+0000","last_change":"2024-07-24T22:03:53.403103+0000","last_active":"2024-07-24T22:04:27.498786+0000","last_peered":"2024-07-24T22:04:27.498786+0000","last_clean":"2024-07-24T22:04:27.498786+0000","last_became_active":"2024-07-24T22:03:53.402810+0000","last_became_peered":"2024-07-24T22:03:53.402810+0000","last_unstale":"2024-07-24T22:04:27.498786+0000","last_undegraded":"2024-07-24T22:04:27.498786+0000","last_fullsized":"2024-07-24T22:04:27.498786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:15.798983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.411552+0000","last_change":"2024-07-24T22:03:50.382383+0000","last_active":"2024-07-24T22:03:55.411552+0000","last_peered":"2024-07-24T22:03:55.411552+0000","last_clean":"2024-07-24T22:03:55.411552+0000","last_became_active":"2024-07-24T22:03:50.381629+0000","last_became_peered":"2024-07-24T22:03:50.381629+0000","last_unstale":"2024-07-24T22:03:55.411552+0000","last_undegraded":"2024-07-24T22:03:55.411552+0000","last_fullsized":"2024-07-24T22:03:55.411552+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:17.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.565568+0000","last_change":"2024-07-24T22:03:53.409587+0000","last_active":"2024-07-24T22:04:27.565568+0000","last_peered":"2024-07-24T22:04:27.565568+0000","last_clean":"2024-07-24T22:04:27.565568+0000","last_became_active":"2024-07-24T22:03:53.409240+0000","last_became_peered":"2024-07-24T22:03:53.409240+0000","last_unstale":"2024-07-24T22:04:27.565568+0000","last_undegraded":"2024-07-24T22:04:27.565568+0000","last_fullsized":"2024-07-24T22:04:27.565568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:37:18.654244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500731+0000","last_change":"2024-07-24T22:03:50.387933+0000","last_active":"2024-07-24T22:04:27.500731+0000","last_peered":"2024-07-24T22:04:27.500731+0000","last_clean":"2024-07-24T22:04:27.500731+0000","last_became_active":"2024-07-24T22:03:50.386985+0000","last_became_peered":"2024-07-24T22:03:50.386985+0000","last_unstale":"2024-07-24T22:04:27.500731+0000","last_undegraded":"2024-07-24T22:04:27.500731+0000","last_fullsized":"2024-07-24T22:04:27.500731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:35:29.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.501360+0000","last_change":"2024-07-24T22:03:53.404419+0000","last_active":"2024-07-24T22:04:26.501360+0000","last_peered":"2024-07-24T22:04:26.501360+0000","last_clean":"2024-07-24T22:04:26.501360+0000","last_became_active":"2024-07-24T22:03:53.402713+0000","last_became_peered":"2024-07-24T22:03:53.402713+0000","last_unstale":"2024-07-24T22:04:26.501360+0000","last_undegraded":"2024-07-24T22:04:26.501360+0000","last_fullsized":"2024-07-24T22:04:26.501360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:41.262686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500076+0000","last_change":"2024-07-24T22:03:50.511126+0000","last_active":"2024-07-24T22:04:27.500076+0000","last_peered":"2024-07-24T22:04:27.500076+0000","last_clean":"2024-07-24T22:04:27.500076+0000","last_became_active":"2024-07-24T22:03:50.510801+0000","last_became_peered":"2024-07-24T22:03:50.510801+0000","last_unstale":"2024-07-24T22:04:27.500076+0000","last_undegraded":"2024-07-24T22:04:27.500076+0000","last_fullsized":"2024-07-24T22:04:27.500076+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:59:37.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.566143+0000","last_change":"2024-07-24T22:03:53.410202+0000","last_active":"2024-07-24T22:04:27.566143+0000","last_peered":"2024-07-24T22:04:27.566143+0000","last_clean":"2024-07-24T22:04:27.566143+0000","last_became_active":"2024-07-24T22:03:53.409884+0000","last_became_peered":"2024-07-24T22:03:53.409884+0000","last_unstale":"2024-07-24T22:04:27.566143+0000","last_undegraded":"2024-07-24T22:04:27.566143+0000","last_fullsized":"2024-07-24T22:04:27.566143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:54:02.603267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'24","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:04:25.480888+0000","last_change":"2024-07-24T22:03:50.386993+0000","last_active":"2024-07-24T22:04:25.480888+0000","last_peered":"2024-07-24T22:04:25.480888+0000","last_clean":"2024-07-24T22:04:25.480888+0000","last_became_active":"2024-07-24T22:03:50.386675+0000","last_became_peered":"2024-07-24T22:03:50.386675+0000","last_unstale":"2024-07-24T22:04:25.480888+0000","last_undegraded":"2024-07-24T22:04:25.480888+0000","last_fullsized":"2024-07-24T22:04:25.480888+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:20:58.384179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56940,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":45,"num_read_kb":77,"num_write":24,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501339+0000","last_change":"2024-07-24T22:03:53.413293+0000","last_active":"2024-07-24T22:04:27.501339+0000","last_peered":"2024-07-24T22:04:27.501339+0000","last_clean":"2024-07-24T22:04:27.501339+0000","last_became_active":"2024-07-24T22:03:53.412900+0000","last_became_peered":"2024-07-24T22:03:53.412900+0000","last_unstale":"2024-07-24T22:04:27.501339+0000","last_undegraded":"2024-07-24T22:04:27.501339+0000","last_fullsized":"2024-07-24T22:04:27.501339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:11:32.553108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.415711+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:03:55.415711+0000","last_peered":"2024-07-24T22:03:55.415711+0000","last_clean":"2024-07-24T22:03:55.415711+0000","last_became_active":"2024-07-24T22:03:50.387059+0000","last_became_peered":"2024-07-24T22:03:50.387059+0000","last_unstale":"2024-07-24T22:03:55.415711+0000","last_undegraded":"2024-07-24T22:03:55.415711+0000","last_fullsized":"2024-07-24T22:03:55.415711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:40:06.887090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.495327+0000","last_change":"2024-07-24T22:03:53.406808+0000","last_active":"2024-07-24T22:04:26.495327+0000","last_peered":"2024-07-24T22:04:26.495327+0000","last_clean":"2024-07-24T22:04:26.495327+0000","last_became_active":"2024-07-24T22:03:53.406487+0000","last_became_peered":"2024-07-24T22:03:53.406487+0000","last_unstale":"2024-07-24T22:04:26.495327+0000","last_undegraded":"2024-07-24T22:04:26.495327+0000","last_fullsized":"2024-07-24T22:04:26.495327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:44:57.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499836+0000","last_change":"2024-07-24T22:03:50.386881+0000","last_active":"2024-07-24T22:04:27.499836+0000","last_peered":"2024-07-24T22:04:27.499836+0000","last_clean":"2024-07-24T22:04:27.499836+0000","last_became_active":"2024-07-24T22:03:50.386564+0000","last_became_peered":"2024-07-24T22:03:50.386564+0000","last_unstale":"2024-07-24T22:04:27.499836+0000","last_undegraded":"2024-07-24T22:04:27.499836+0000","last_fullsized":"2024-07-24T22:04:27.499836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:22:22.339854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500832+0000","last_change":"2024-07-24T22:03:53.403207+0000","last_active":"2024-07-24T22:04:27.500832+0000","last_peered":"2024-07-24T22:04:27.500832+0000","last_clean":"2024-07-24T22:04:27.500832+0000","last_became_active":"2024-07-24T22:03:53.402875+0000","last_became_peered":"2024-07-24T22:03:53.402875+0000","last_unstale":"2024-07-24T22:04:27.500832+0000","last_undegraded":"2024-07-24T22:04:27.500832+0000","last_fullsized":"2024-07-24T22:04:27.500832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:25:28.866228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.497844+0000","last_change":"2024-07-24T22:03:50.386721+0000","last_active":"2024-07-24T22:04:26.497844+0000","last_peered":"2024-07-24T22:04:26.497844+0000","last_clean":"2024-07-24T22:04:26.497844+0000","last_became_active":"2024-07-24T22:03:50.385654+0000","last_became_peered":"2024-07-24T22:03:50.385654+0000","last_unstale":"2024-07-24T22:04:26.497844+0000","last_undegraded":"2024-07-24T22:04:26.497844+0000","last_fullsized":"2024-07-24T22:04:26.497844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:16:15.802744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500850+0000","last_change":"2024-07-24T22:03:53.405367+0000","last_active":"2024-07-24T22:04:27.500850+0000","last_peered":"2024-07-24T22:04:27.500850+0000","last_clean":"2024-07-24T22:04:27.500850+0000","last_became_active":"2024-07-24T22:03:53.404875+0000","last_became_peered":"2024-07-24T22:03:53.404875+0000","last_unstale":"2024-07-24T22:04:27.500850+0000","last_undegraded":"2024-07-24T22:04:27.500850+0000","last_fullsized":"2024-07-24T22:04:27.500850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:42.247052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.574489+0000","last_change":"2024-07-24T22:04:27.574426+0000","last_active":"2024-07-24T22:04:27.574489+0000","last_peered":"2024-07-24T22:04:27.574489+0000","last_clean":"2024-07-24T22:04:27.574489+0000","last_became_active":"2024-07-24T22:04:27.568176+0000","last_became_peered":"2024-07-24T22:04:27.568176+0000","last_unstale":"2024-07-24T22:04:27.574489+0000","last_undegraded":"2024-07-24T22:04:27.574489+0000","last_fullsized":"2024-07-24T22:04:27.574489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:20:37.620669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499882+0000","last_change":"2024-07-24T22:03:53.405136+0000","last_active":"2024-07-24T22:04:27.499882+0000","last_peered":"2024-07-24T22:04:27.499882+0000","last_clean":"2024-07-24T22:04:27.499882+0000","last_became_active":"2024-07-24T22:03:53.404043+0000","last_became_peered":"2024-07-24T22:03:53.404043+0000","last_unstale":"2024-07-24T22:04:27.499882+0000","last_undegraded":"2024-07-24T22:04:27.499882+0000","last_fullsized":"2024-07-24T22:04:27.499882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:03:21.912335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501621+0000","last_change":"2024-07-24T22:03:50.382364+0000","last_active":"2024-07-24T22:04:27.501621+0000","last_peered":"2024-07-24T22:04:27.501621+0000","last_clean":"2024-07-24T22:04:27.501621+0000","last_became_active":"2024-07-24T22:03:50.382029+0000","last_became_peered":"2024-07-24T22:03:50.382029+0000","last_unstale":"2024-07-24T22:04:27.501621+0000","last_undegraded":"2024-07-24T22:04:27.501621+0000","last_fullsized":"2024-07-24T22:04:27.501621+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:48:10.004826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.419851+0000","last_change":"2024-07-24T22:03:53.413053+0000","last_active":"2024-07-24T22:03:55.419851+0000","last_peered":"2024-07-24T22:03:55.419851+0000","last_clean":"2024-07-24T22:03:55.419851+0000","last_became_active":"2024-07-24T22:03:53.412733+0000","last_became_peered":"2024-07-24T22:03:53.412733+0000","last_unstale":"2024-07-24T22:03:55.419851+0000","last_undegraded":"2024-07-24T22:03:55.419851+0000","last_fullsized":"2024-07-24T22:03:55.419851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:16.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.495695+0000","last_change":"2024-07-24T22:03:50.387314+0000","last_active":"2024-07-24T22:04:26.495695+0000","last_peered":"2024-07-24T22:04:26.495695+0000","last_clean":"2024-07-24T22:04:26.495695+0000","last_became_active":"2024-07-24T22:03:50.386919+0000","last_became_peered":"2024-07-24T22:03:50.386919+0000","last_unstale":"2024-07-24T22:04:26.495695+0000","last_undegraded":"2024-07-24T22:04:26.495695+0000","last_fullsized":"2024-07-24T22:04:26.495695+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:51:03.203285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500927+0000","last_change":"2024-07-24T22:03:53.411938+0000","last_active":"2024-07-24T22:04:27.500927+0000","last_peered":"2024-07-24T22:04:27.500927+0000","last_clean":"2024-07-24T22:04:27.500927+0000","last_became_active":"2024-07-24T22:03:53.411545+0000","last_became_peered":"2024-07-24T22:03:53.411545+0000","last_unstale":"2024-07-24T22:04:27.500927+0000","last_undegraded":"2024-07-24T22:04:27.500927+0000","last_fullsized":"2024-07-24T22:04:27.500927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:41:19.370886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500252+0000","last_change":"2024-07-24T22:03:50.384400+0000","last_active":"2024-07-24T22:04:27.500252+0000","last_peered":"2024-07-24T22:04:27.500252+0000","last_clean":"2024-07-24T22:04:27.500252+0000","last_became_active":"2024-07-24T22:03:50.383945+0000","last_became_peered":"2024-07-24T22:03:50.383945+0000","last_unstale":"2024-07-24T22:04:27.500252+0000","last_undegraded":"2024-07-24T22:04:27.500252+0000","last_fullsized":"2024-07-24T22:04:27.500252+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:16.035171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.507442+0000","last_change":"2024-07-24T22:04:27.507390+0000","last_active":"2024-07-24T22:04:27.507442+0000","last_peered":"2024-07-24T22:04:27.507442+0000","last_clean":"2024-07-24T22:04:27.507442+0000","last_became_active":"2024-07-24T22:04:27.504206+0000","last_became_peered":"2024-07-24T22:04:27.504206+0000","last_unstale":"2024-07-24T22:04:27.507442+0000","last_undegraded":"2024-07-24T22:04:27.507442+0000","last_fullsized":"2024-07-24T22:04:27.507442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:55:21.559702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.411848+0000","last_change":"2024-07-24T22:03:50.511075+0000","last_active":"2024-07-24T22:03:55.411848+0000","last_peered":"2024-07-24T22:03:55.411848+0000","last_clean":"2024-07-24T22:03:55.411848+0000","last_became_active":"2024-07-24T22:03:50.510244+0000","last_became_peered":"2024-07-24T22:03:50.510244+0000","last_unstale":"2024-07-24T22:03:55.411848+0000","last_undegraded":"2024-07-24T22:03:55.411848+0000","last_fullsized":"2024-07-24T22:03:55.411848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:54:03.068211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501174+0000","last_change":"2024-07-24T22:03:53.410865+0000","last_active":"2024-07-24T22:04:27.501174+0000","last_peered":"2024-07-24T22:04:27.501174+0000","last_clean":"2024-07-24T22:04:27.501174+0000","last_became_active":"2024-07-24T22:03:53.410255+0000","last_became_peered":"2024-07-24T22:03:53.410255+0000","last_unstale":"2024-07-24T22:04:27.501174+0000","last_undegraded":"2024-07-24T22:04:27.501174+0000","last_fullsized":"2024-07-24T22:04:27.501174+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:15.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501157+0000","last_change":"2024-07-24T22:02:33.494929+0000","last_active":"2024-07-24T22:04:27.501157+0000","last_peered":"2024-07-24T22:04:27.501157+0000","last_clean":"2024-07-24T22:04:27.501157+0000","last_became_active":"2024-07-24T22:02:33.489241+0000","last_became_peered":"2024-07-24T22:02:33.489241+0000","last_unstale":"2024-07-24T22:04:27.501157+0000","last_undegraded":"2024-07-24T22:04:27.501157+0000","last_fullsized":"2024-07-24T22:04:27.501157+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_clean_scrub_stamp":"2024-07-24T21:59:32.406119+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:46.421413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.497812+0000","last_change":"2024-07-24T22:03:50.385093+0000","last_active":"2024-07-24T22:04:26.497812+0000","last_peered":"2024-07-24T22:04:26.497812+0000","last_clean":"2024-07-24T22:04:26.497812+0000","last_became_active":"2024-07-24T22:03:50.384639+0000","last_became_peered":"2024-07-24T22:03:50.384639+0000","last_unstale":"2024-07-24T22:04:26.497812+0000","last_undegraded":"2024-07-24T22:04:26.497812+0000","last_fullsized":"2024-07-24T22:04:26.497812+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:06:10.402336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498368+0000","last_change":"2024-07-24T22:03:53.409627+0000","last_active":"2024-07-24T22:04:27.498368+0000","last_peered":"2024-07-24T22:04:27.498368+0000","last_clean":"2024-07-24T22:04:27.498368+0000","last_became_active":"2024-07-24T22:03:53.409295+0000","last_became_peered":"2024-07-24T22:03:53.409295+0000","last_unstale":"2024-07-24T22:04:27.498368+0000","last_undegraded":"2024-07-24T22:04:27.498368+0000","last_fullsized":"2024-07-24T22:04:27.498368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:23:39.670020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501059+0000","last_change":"2024-07-24T22:03:50.385772+0000","last_active":"2024-07-24T22:04:27.501059+0000","last_peered":"2024-07-24T22:04:27.501059+0000","last_clean":"2024-07-24T22:04:27.501059+0000","last_became_active":"2024-07-24T22:03:50.385421+0000","last_became_peered":"2024-07-24T22:03:50.385421+0000","last_unstale":"2024-07-24T22:04:27.501059+0000","last_undegraded":"2024-07-24T22:04:27.501059+0000","last_fullsized":"2024-07-24T22:04:27.501059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:58:57.227697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.495225+0000","last_change":"2024-07-24T22:03:53.400558+0000","last_active":"2024-07-24T22:04:26.495225+0000","last_peered":"2024-07-24T22:04:26.495225+0000","last_clean":"2024-07-24T22:04:26.495225+0000","last_became_active":"2024-07-24T22:03:53.400131+0000","last_became_peered":"2024-07-24T22:03:53.400131+0000","last_unstale":"2024-07-24T22:04:26.495225+0000","last_undegraded":"2024-07-24T22:04:26.495225+0000","last_fullsized":"2024-07-24T22:04:26.495225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:57:57.586742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.495338+0000","last_change":"2024-07-24T22:03:50.510189+0000","last_active":"2024-07-24T22:04:26.495338+0000","last_peered":"2024-07-24T22:04:26.495338+0000","last_clean":"2024-07-24T22:04:26.495338+0000","last_became_active":"2024-07-24T22:03:50.509857+0000","last_became_peered":"2024-07-24T22:03:50.509857+0000","last_unstale":"2024-07-24T22:04:26.495338+0000","last_undegraded":"2024-07-24T22:04:26.495338+0000","last_fullsized":"2024-07-24T22:04:26.495338+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:05:59.240650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.505356+0000","last_change":"2024-07-24T22:04:27.505187+0000","last_active":"2024-07-24T22:04:27.505356+0000","last_peered":"2024-07-24T22:04:27.505356+0000","last_clean":"2024-07-24T22:04:27.505356+0000","last_became_active":"2024-07-24T22:04:27.504785+0000","last_became_peered":"2024-07-24T22:04:27.504785+0000","last_unstale":"2024-07-24T22:04:27.505356+0000","last_undegraded":"2024-07-24T22:04:27.505356+0000","last_fullsized":"2024-07-24T22:04:27.505356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:47:33.516835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501118+0000","last_change":"2024-07-24T22:03:50.387913+0000","last_active":"2024-07-24T22:04:27.501118+0000","last_peered":"2024-07-24T22:04:27.501118+0000","last_clean":"2024-07-24T22:04:27.501118+0000","last_became_active":"2024-07-24T22:03:50.386700+0000","last_became_peered":"2024-07-24T22:03:50.386700+0000","last_unstale":"2024-07-24T22:04:27.501118+0000","last_undegraded":"2024-07-24T22:04:27.501118+0000","last_fullsized":"2024-07-24T22:04:27.501118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:03:56.295684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.412553+0000","last_change":"2024-07-24T22:03:53.399369+0000","last_active":"2024-07-24T22:03:55.412553+0000","last_peered":"2024-07-24T22:03:55.412553+0000","last_clean":"2024-07-24T22:03:55.412553+0000","last_became_active":"2024-07-24T22:03:53.399001+0000","last_became_peered":"2024-07-24T22:03:53.399001+0000","last_unstale":"2024-07-24T22:03:55.412553+0000","last_undegraded":"2024-07-24T22:03:55.412553+0000","last_fullsized":"2024-07-24T22:03:55.412553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:26:46.531080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500369+0000","last_change":"2024-07-24T22:03:50.510889+0000","last_active":"2024-07-24T22:04:27.500369+0000","last_peered":"2024-07-24T22:04:27.500369+0000","last_clean":"2024-07-24T22:04:27.500369+0000","last_became_active":"2024-07-24T22:03:50.510366+0000","last_became_peered":"2024-07-24T22:03:50.510366+0000","last_unstale":"2024-07-24T22:04:27.500369+0000","last_undegraded":"2024-07-24T22:04:27.500369+0000","last_fullsized":"2024-07-24T22:04:27.500369+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:47:54.838304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:56.182305+0000","last_change":"2024-07-24T22:03:53.398987+0000","last_active":"2024-07-24T22:03:56.182305+0000","last_peered":"2024-07-24T22:03:56.182305+0000","last_clean":"2024-07-24T22:03:56.182305+0000","last_became_active":"2024-07-24T22:03:53.398604+0000","last_became_peered":"2024-07-24T22:03:53.398604+0000","last_unstale":"2024-07-24T22:03:56.182305+0000","last_undegraded":"2024-07-24T22:03:56.182305+0000","last_fullsized":"2024-07-24T22:03:56.182305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:28:41.684174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501463+0000","last_change":"2024-07-24T22:03:50.510623+0000","last_active":"2024-07-24T22:04:27.501463+0000","last_peered":"2024-07-24T22:04:27.501463+0000","last_clean":"2024-07-24T22:04:27.501463+0000","last_became_active":"2024-07-24T22:03:50.510204+0000","last_became_peered":"2024-07-24T22:03:50.510204+0000","last_unstale":"2024-07-24T22:04:27.501463+0000","last_undegraded":"2024-07-24T22:04:27.501463+0000","last_fullsized":"2024-07-24T22:04:27.501463+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:06:40.838840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.495633+0000","last_change":"2024-07-24T22:03:53.400289+0000","last_active":"2024-07-24T22:04:26.495633+0000","last_peered":"2024-07-24T22:04:26.495633+0000","last_clean":"2024-07-24T22:04:26.495633+0000","last_became_active":"2024-07-24T22:03:53.399939+0000","last_became_peered":"2024-07-24T22:03:53.399939+0000","last_unstale":"2024-07-24T22:04:26.495633+0000","last_undegraded":"2024-07-24T22:04:26.495633+0000","last_fullsized":"2024-07-24T22:04:26.495633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:29:26.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'8","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499232+0000","last_change":"2024-07-24T22:03:50.382776+0000","last_active":"2024-07-24T22:04:27.499232+0000","last_peered":"2024-07-24T22:04:27.499232+0000","last_clean":"2024-07-24T22:04:27.499232+0000","last_became_active":"2024-07-24T22:03:50.382474+0000","last_became_peered":"2024-07-24T22:03:50.382474+0000","last_unstale":"2024-07-24T22:04:27.499232+0000","last_undegraded":"2024-07-24T22:04:27.499232+0000","last_fullsized":"2024-07-24T22:04:27.499232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:59:34.688895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498616+0000","last_change":"2024-07-24T22:03:53.407883+0000","last_active":"2024-07-24T22:04:27.498616+0000","last_peered":"2024-07-24T22:04:27.498616+0000","last_clean":"2024-07-24T22:04:27.498616+0000","last_became_active":"2024-07-24T22:03:53.407524+0000","last_became_peered":"2024-07-24T22:03:53.407524+0000","last_unstale":"2024-07-24T22:04:27.498616+0000","last_undegraded":"2024-07-24T22:04:27.498616+0000","last_fullsized":"2024-07-24T22:04:27.498616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:52:25.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.498507+0000","last_change":"2024-07-24T22:03:50.388789+0000","last_active":"2024-07-24T22:04:26.498507+0000","last_peered":"2024-07-24T22:04:26.498507+0000","last_clean":"2024-07-24T22:04:26.498507+0000","last_became_active":"2024-07-24T22:03:50.385439+0000","last_became_peered":"2024-07-24T22:03:50.385439+0000","last_unstale":"2024-07-24T22:04:26.498507+0000","last_undegraded":"2024-07-24T22:04:26.498507+0000","last_fullsized":"2024-07-24T22:04:26.498507+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:14:25.009588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"peering","last_fresh":"2024-07-24T22:03:56.924407+0000","last_change":"2024-07-24T22:04:26.500843+0000","last_active":"2024-07-24T22:04:26.500843+0000","last_peered":"2024-07-24T22:03:56.924407+0000","last_clean":"2024-07-24T22:03:56.924407+0000","last_became_active":"2024-07-24T22:03:53.402566+0000","last_became_peered":"2024-07-24T22:03:53.402566+0000","last_unstale":"2024-07-24T22:03:56.924407+0000","last_undegraded":"2024-07-24T22:03:56.924407+0000","last_fullsized":"2024-07-24T22:03:56.924407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.565723+0000","last_change":"2024-07-24T22:03:50.510687+0000","last_active":"2024-07-24T22:04:27.565723+0000","last_peered":"2024-07-24T22:04:27.565723+0000","last_clean":"2024-07-24T22:04:27.565723+0000","last_became_active":"2024-07-24T22:03:50.510310+0000","last_became_peered":"2024-07-24T22:03:50.510310+0000","last_unstale":"2024-07-24T22:04:27.565723+0000","last_undegraded":"2024-07-24T22:04:27.565723+0000","last_fullsized":"2024-07-24T22:04:27.565723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:14:29.957324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500830+0000","last_change":"2024-07-24T22:03:53.412711+0000","last_active":"2024-07-24T22:04:27.500830+0000","last_peered":"2024-07-24T22:04:27.500830+0000","last_clean":"2024-07-24T22:04:27.500830+0000","last_became_active":"2024-07-24T22:03:53.412375+0000","last_became_peered":"2024-07-24T22:03:53.412375+0000","last_unstale":"2024-07-24T22:04:27.500830+0000","last_undegraded":"2024-07-24T22:04:27.500830+0000","last_fullsized":"2024-07-24T22:04:27.500830+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:55:29.441385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499186+0000","last_change":"2024-07-24T22:03:50.383094+0000","last_active":"2024-07-24T22:04:27.499186+0000","last_peered":"2024-07-24T22:04:27.499186+0000","last_clean":"2024-07-24T22:04:27.499186+0000","last_became_active":"2024-07-24T22:03:50.382687+0000","last_became_peered":"2024-07-24T22:03:50.382687+0000","last_unstale":"2024-07-24T22:04:27.499186+0000","last_undegraded":"2024-07-24T22:04:27.499186+0000","last_fullsized":"2024-07-24T22:04:27.499186+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:32:02.727855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.420108+0000","last_change":"2024-07-24T22:03:53.403709+0000","last_active":"2024-07-24T22:03:55.420108+0000","last_peered":"2024-07-24T22:03:55.420108+0000","last_clean":"2024-07-24T22:03:55.420108+0000","last_became_active":"2024-07-24T22:03:53.403334+0000","last_became_peered":"2024-07-24T22:03:53.403334+0000","last_unstale":"2024-07-24T22:03:55.420108+0000","last_undegraded":"2024-07-24T22:03:55.420108+0000","last_fullsized":"2024-07-24T22:03:55.420108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:27:50.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-07-24T22:03:55.411808+0000","last_change":"2024-07-24T22:03:50.385547+0000","last_active":"2024-07-24T22:03:55.411808+0000","last_peered":"2024-07-24T22:03:55.411808+0000","last_clean":"2024-07-24T22:03:55.411808+0000","last_became_active":"2024-07-24T22:03:50.385233+0000","last_became_peered":"2024-07-24T22:03:50.385233+0000","last_unstale":"2024-07-24T22:03:55.411808+0000","last_undegraded":"2024-07-24T22:03:55.411808+0000","last_fullsized":"2024-07-24T22:03:55.411808+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:40:04.647242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498549+0000","last_change":"2024-07-24T22:03:53.402386+0000","last_active":"2024-07-24T22:04:27.498549+0000","last_peered":"2024-07-24T22:04:27.498549+0000","last_clean":"2024-07-24T22:04:27.498549+0000","last_became_active":"2024-07-24T22:03:53.399363+0000","last_became_peered":"2024-07-24T22:03:53.399363+0000","last_unstale":"2024-07-24T22:04:27.498549+0000","last_undegraded":"2024-07-24T22:04:27.498549+0000","last_fullsized":"2024-07-24T22:04:27.498549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:19:05.835280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500988+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:04:27.500988+0000","last_peered":"2024-07-24T22:04:27.500988+0000","last_clean":"2024-07-24T22:04:27.500988+0000","last_became_active":"2024-07-24T22:03:50.387097+0000","last_became_peered":"2024-07-24T22:03:50.387097+0000","last_unstale":"2024-07-24T22:04:27.500988+0000","last_undegraded":"2024-07-24T22:04:27.500988+0000","last_fullsized":"2024-07-24T22:04:27.500988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:11:23.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500948+0000","last_change":"2024-07-24T22:03:53.407386+0000","last_active":"2024-07-24T22:04:27.500948+0000","last_peered":"2024-07-24T22:04:27.500948+0000","last_clean":"2024-07-24T22:04:27.500948+0000","last_became_active":"2024-07-24T22:03:53.407059+0000","last_became_peered":"2024-07-24T22:03:53.407059+0000","last_unstale":"2024-07-24T22:04:27.500948+0000","last_undegraded":"2024-07-24T22:04:27.500948+0000","last_fullsized":"2024-07-24T22:04:27.500948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:12:38.508170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.568167+0000","last_change":"2024-07-24T22:04:27.567714+0000","last_active":"2024-07-24T22:04:27.568167+0000","last_peered":"2024-07-24T22:04:27.568167+0000","last_clean":"2024-07-24T22:04:27.568167+0000","last_became_active":"2024-07-24T22:04:27.567492+0000","last_became_peered":"2024-07-24T22:04:27.567492+0000","last_unstale":"2024-07-24T22:04:27.568167+0000","last_undegraded":"2024-07-24T22:04:27.568167+0000","last_fullsized":"2024-07-24T22:04:27.568167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:00:13.705346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.502127+0000","last_change":"2024-07-24T22:03:50.385538+0000","last_active":"2024-07-24T22:04:27.502127+0000","last_peered":"2024-07-24T22:04:27.502127+0000","last_clean":"2024-07-24T22:04:27.502127+0000","last_became_active":"2024-07-24T22:03:50.385191+0000","last_became_peered":"2024-07-24T22:03:50.385191+0000","last_unstale":"2024-07-24T22:04:27.502127+0000","last_undegraded":"2024-07-24T22:04:27.502127+0000","last_fullsized":"2024-07-24T22:04:27.502127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:33:37.674903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.566043+0000","last_change":"2024-07-24T22:03:53.411751+0000","last_active":"2024-07-24T22:04:27.566043+0000","last_peered":"2024-07-24T22:04:27.566043+0000","last_clean":"2024-07-24T22:04:27.566043+0000","last_became_active":"2024-07-24T22:03:53.410827+0000","last_became_peered":"2024-07-24T22:03:53.410827+0000","last_unstale":"2024-07-24T22:04:27.566043+0000","last_undegraded":"2024-07-24T22:04:27.566043+0000","last_fullsized":"2024-07-24T22:04:27.566043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:07:26.439047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.576697+0000","last_change":"2024-07-24T22:04:27.576631+0000","last_active":"2024-07-24T22:04:27.576697+0000","last_peered":"2024-07-24T22:04:27.576697+0000","last_clean":"2024-07-24T22:04:27.576697+0000","last_became_active":"2024-07-24T22:04:27.568320+0000","last_became_peered":"2024-07-24T22:04:27.568320+0000","last_unstale":"2024-07-24T22:04:27.576697+0000","last_undegraded":"2024-07-24T22:04:27.576697+0000","last_fullsized":"2024-07-24T22:04:27.576697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:36:15.767170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-24T22:04:26.500886+0000","last_change":"2024-07-24T22:03:53.406029+0000","last_active":"2024-07-24T22:04:26.500886+0000","last_peered":"2024-07-24T22:04:26.500886+0000","last_clean":"2024-07-24T22:04:26.500886+0000","last_became_active":"2024-07-24T22:03:53.405529+0000","last_became_peered":"2024-07-24T22:03:53.405529+0000","last_unstale":"2024-07-24T22:04:26.500886+0000","last_undegraded":"2024-07-24T22:04:26.500886+0000","last_fullsized":"2024-07-24T22:04:26.500886+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:57:02.290836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498886+0000","last_change":"2024-07-24T22:03:50.510884+0000","last_active":"2024-07-24T22:04:27.498886+0000","last_peered":"2024-07-24T22:04:27.498886+0000","last_clean":"2024-07-24T22:04:27.498886+0000","last_became_active":"2024-07-24T22:03:50.509851+0000","last_became_peered":"2024-07-24T22:03:50.509851+0000","last_unstale":"2024-07-24T22:04:27.498886+0000","last_undegraded":"2024-07-24T22:04:27.498886+0000","last_fullsized":"2024-07-24T22:04:27.498886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:37:55.735488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498633+0000","last_change":"2024-07-24T22:03:53.409966+0000","last_active":"2024-07-24T22:04:27.498633+0000","last_peered":"2024-07-24T22:04:27.498633+0000","last_clean":"2024-07-24T22:04:27.498633+0000","last_became_active":"2024-07-24T22:03:53.409652+0000","last_became_peered":"2024-07-24T22:03:53.409652+0000","last_unstale":"2024-07-24T22:04:27.498633+0000","last_undegraded":"2024-07-24T22:04:27.498633+0000","last_fullsized":"2024-07-24T22:04:27.498633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:10:53.262459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.571203+0000","last_change":"2024-07-24T22:04:27.571166+0000","last_active":"2024-07-24T22:04:27.571203+0000","last_peered":"2024-07-24T22:04:27.571203+0000","last_clean":"2024-07-24T22:04:27.571203+0000","last_became_active":"2024-07-24T22:04:27.567419+0000","last_became_peered":"2024-07-24T22:04:27.567419+0000","last_unstale":"2024-07-24T22:04:27.571203+0000","last_undegraded":"2024-07-24T22:04:27.571203+0000","last_fullsized":"2024-07-24T22:04:27.571203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:37:11.513631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57738,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":51,"num_read_kb":83,"num_write":78,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":173214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612630,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":872448,"data_stored":434412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28528,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716624,"statfs":{"total":95995035648,"available":95965822976,"internally_reserved":0,"allocated":1548288,"data_stored":1082031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972383,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40396,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704756,"statfs":{"total":95995035648,"available":95953670144,"internally_reserved":0,"allocated":913408,"data_stored":452825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168612,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":452148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397543,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1507328,"data_stored":1043193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561068,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40352,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704800,"statfs":{"total":95995035648,"available":95953715200,"internally_reserved":0,"allocated":876544,"data_stored":434529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757297,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1515520,"data_stored":1042793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920820,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":434434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117049,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":905216,"data_stored":443724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378686,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":491386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":509648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":434502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":57522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":56974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T22:04:32.734 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph pg dump --format=json 2024-07-24T22:04:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:33.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:33 smithi047 ceph-mon[32551]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:04:33.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:33 smithi047 ceph-mon[32551]: pgmap v284: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.1 KiB/s wr, 4 op/s; 87 B/s, 0 objects/s recovering 2024-07-24T22:04:33.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:33 smithi188 ceph-mon[37380]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:04:33.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:33 smithi188 ceph-mon[37380]: pgmap v284: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.1 KiB/s wr, 4 op/s; 87 B/s, 0 objects/s recovering 2024-07-24T22:04:33.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:33 smithi183 ceph-mon[37007]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:04:33.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:33 smithi183 ceph-mon[37007]: pgmap v284: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.1 KiB/s wr, 4 op/s; 87 B/s, 0 objects/s recovering 2024-07-24T22:04:34.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.565+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2784028535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f41070a0 msgr2=0x7fc2f41074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:34.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.565+0000 7fc2f99dd640 1 --2- 172.21.15.47:0/2784028535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f41070a0 0x7fc2f41074e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009900 tx=0x7fc2dc02a410 comp rx=0 tx=0).stop 2024-07-24T22:04:34.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.565+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2784028535 shutdown_connections 2024-07-24T22:04:34.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.565+0000 7fc2f99dd640 1 --2- 172.21.15.47:0/2784028535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2f4107a20 0x7fc2f410e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:34.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.565+0000 7fc2f99dd640 1 --2- 172.21.15.47:0/2784028535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f41070a0 0x7fc2f41074e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:34.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.565+0000 7fc2f99dd640 1 --2- 172.21.15.47:0/2784028535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2f4101690 0x7fc2f4101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:34.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.565+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2784028535 >> 172.21.15.47:0/2784028535 conn(0x7fc2f40fd100 msgr2=0x7fc2f40ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:34.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.565+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2784028535 shutdown_connections 2024-07-24T22:04:34.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.565+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2784028535 wait complete. 2024-07-24T22:04:34.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.566+0000 7fc2f99dd640 1 Processor -- start 2024-07-24T22:04:34.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.566+0000 7fc2f99dd640 1 -- start start 2024-07-24T22:04:34.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.566+0000 7fc2f99dd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2f4101690 0x7fc2f4197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:34.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.566+0000 7fc2f99dd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f41070a0 0x7fc2f4198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:34.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.566+0000 7fc2f99dd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2f4107a20 0x7fc2f419d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:34.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.566+0000 7fc2f99dd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4111620 con 0x7fc2f41070a0 2024-07-24T22:04:34.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.566+0000 7fc2f99dd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f41114a0 con 0x7fc2f4107a20 2024-07-24T22:04:34.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.566+0000 7fc2f99dd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f41117a0 con 0x7fc2f4101690 2024-07-24T22:04:34.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.566+0000 7fc2ea7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f41070a0 0x7fc2f4198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:34.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2ea7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f41070a0 0x7fc2f4198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37570/0 (socket says 172.21.15.47:37570) 2024-07-24T22:04:34.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2ea7fc640 1 -- 172.21.15.47:0/2692050743 learned_addr learned my addr 172.21.15.47:0/2692050743 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:34.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2f2ffd640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2f4101690 0x7fc2f4197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:34.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2f37fe640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2f4107a20 0x7fc2f419d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:34.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2ea7fc640 1 -- 172.21.15.47:0/2692050743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2f4101690 msgr2=0x7fc2f4197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:34.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2ea7fc640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2f4101690 0x7fc2f4197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:34.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2ea7fc640 1 -- 172.21.15.47:0/2692050743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2f4107a20 msgr2=0x7fc2f419d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:34.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2ea7fc640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2f4107a20 0x7fc2f419d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2ea7fc640 1 -- 172.21.15.47:0/2692050743 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f419db80 con 0x7fc2f41070a0 2024-07-24T22:04:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2f37fe640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2f4107a20 0x7fc2f419d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:04:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2ea7fc640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f41070a0 0x7fc2f4198010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc005940 tx=0x7fc2dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2f89db640 1 -- 172.21.15.47:0/2692050743 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc03f030 con 0x7fc2f41070a0 2024-07-24T22:04:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2692050743 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f419de10 con 0x7fc2f41070a0 2024-07-24T22:04:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2f89db640 1 -- 172.21.15.47:0/2692050743 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2dc003cb0 con 0x7fc2f41070a0 2024-07-24T22:04:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2f89db640 1 -- 172.21.15.47:0/2692050743 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc035070 con 0x7fc2f41070a0 2024-07-24T22:04:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.567+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2692050743 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f41a4530 con 0x7fc2f41070a0 2024-07-24T22:04:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.568+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2692050743 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f4101a70 con 0x7fc2f41070a0 2024-07-24T22:04:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.570+0000 7fc2f89db640 1 -- 172.21.15.47:0/2692050743 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fc2dc042030 con 0x7fc2f41070a0 2024-07-24T22:04:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.570+0000 7fc2f89db640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc2e00b3cb0 0x7fc2e00b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.571+0000 7fc2f2ffd640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc2e00b3cb0 0x7fc2e00b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.571+0000 7fc2f89db640 1 -- 172.21.15.47:0/2692050743 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7fc2dc104a60 con 0x7fc2f41070a0 2024-07-24T22:04:34.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.571+0000 7fc2f2ffd640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc2e00b3cb0 0x7fc2e00b6170 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400bbe0 tx=0x7fc2e400b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:34.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.574+0000 7fc2f89db640 1 -- 172.21.15.47:0/2692050743 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fc2dc0cbe50 con 0x7fc2f41070a0 2024-07-24T22:04:34.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.764+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2692050743 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2f4062f80 con 0x7fc2e00b3cb0 2024-07-24T22:04:34.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.768+0000 7fc2f89db640 1 -- 172.21.15.47:0/2692050743 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258629 (secure 0 0 0) 0x7fc2f4062f80 con 0x7fc2e00b3cb0 2024-07-24T22:04:34.772 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:04:34.773 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-07-24T22:04:34.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.772+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2692050743 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc2e00b3cb0 msgr2=0x7fc2e00b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.772+0000 7fc2f99dd640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc2e00b3cb0 0x7fc2e00b6170 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400bbe0 tx=0x7fc2e400b390 comp rx=0 tx=0).stop 2024-07-24T22:04:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.772+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2692050743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f41070a0 msgr2=0x7fc2f4198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.772+0000 7fc2f99dd640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f41070a0 0x7fc2f4198010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc005940 tx=0x7fc2dc0042f0 comp rx=0 tx=0).stop 2024-07-24T22:04:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.772+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2692050743 shutdown_connections 2024-07-24T22:04:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.772+0000 7fc2f99dd640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc2e00b3cb0 0x7fc2e00b6170 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.772+0000 7fc2f99dd640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2f4107a20 0x7fc2f419d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.772+0000 7fc2f99dd640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2f41070a0 0x7fc2f4198010 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.772+0000 7fc2f99dd640 1 --2- 172.21.15.47:0/2692050743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2f4101690 0x7fc2f4197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.772+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2692050743 >> 172.21.15.47:0/2692050743 conn(0x7fc2f40fd100 msgr2=0x7fc2f40ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.772+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2692050743 shutdown_connections 2024-07-24T22:04:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:34.772+0000 7fc2f99dd640 1 -- 172.21.15.47:0/2692050743 wait complete. 2024-07-24T22:04:35.391 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-07-24T22:04:34.081758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653735,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":143,"num_read_kb":163,"num_write":208,"num_write_kb":2239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952539,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":294,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386820,"kb_used_data":12640,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555004,"statfs":{"total":1151940427776,"available":1151544324096,"internally_reserved":0,"allocated":12943360,"data_stored":7381322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20134,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":45,"num_write":15,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":699,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001848"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496725+0000","last_change":"2024-07-24T22:03:53.407929+0000","last_active":"2024-07-24T22:04:27.496725+0000","last_peered":"2024-07-24T22:04:27.496725+0000","last_clean":"2024-07-24T22:04:27.496725+0000","last_became_active":"2024-07-24T22:03:53.407508+0000","last_became_peered":"2024-07-24T22:03:53.407508+0000","last_unstale":"2024-07-24T22:04:27.496725+0000","last_undegraded":"2024-07-24T22:04:27.496725+0000","last_fullsized":"2024-07-24T22:04:27.496725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:00:35.699906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500061+0000","last_change":"2024-07-24T22:03:53.404867+0000","last_active":"2024-07-24T22:04:27.500061+0000","last_peered":"2024-07-24T22:04:27.500061+0000","last_clean":"2024-07-24T22:04:27.500061+0000","last_became_active":"2024-07-24T22:03:53.404309+0000","last_became_peered":"2024-07-24T22:03:53.404309+0000","last_unstale":"2024-07-24T22:04:27.500061+0000","last_undegraded":"2024-07-24T22:04:27.500061+0000","last_fullsized":"2024-07-24T22:04:27.500061+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:21:51.238815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500443+0000","last_change":"2024-07-24T22:03:53.404368+0000","last_active":"2024-07-24T22:04:27.500443+0000","last_peered":"2024-07-24T22:04:27.500443+0000","last_clean":"2024-07-24T22:04:27.500443+0000","last_became_active":"2024-07-24T22:03:53.403941+0000","last_became_peered":"2024-07-24T22:03:53.403941+0000","last_unstale":"2024-07-24T22:04:27.500443+0000","last_undegraded":"2024-07-24T22:04:27.500443+0000","last_fullsized":"2024-07-24T22:04:27.500443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:10:09.884724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.567217+0000","last_change":"2024-07-24T22:03:53.407661+0000","last_active":"2024-07-24T22:04:27.567217+0000","last_peered":"2024-07-24T22:04:27.567217+0000","last_clean":"2024-07-24T22:04:27.567217+0000","last_became_active":"2024-07-24T22:03:53.407375+0000","last_became_peered":"2024-07-24T22:03:53.407375+0000","last_unstale":"2024-07-24T22:04:27.567217+0000","last_undegraded":"2024-07-24T22:04:27.567217+0000","last_fullsized":"2024-07-24T22:04:27.567217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:34.000666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500864+0000","last_change":"2024-07-24T22:03:53.406227+0000","last_active":"2024-07-24T22:04:27.500864+0000","last_peered":"2024-07-24T22:04:27.500864+0000","last_clean":"2024-07-24T22:04:27.500864+0000","last_became_active":"2024-07-24T22:03:53.405819+0000","last_became_peered":"2024-07-24T22:03:53.405819+0000","last_unstale":"2024-07-24T22:04:27.500864+0000","last_undegraded":"2024-07-24T22:04:27.500864+0000","last_fullsized":"2024-07-24T22:04:27.500864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:59.022972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501831+0000","last_change":"2024-07-24T22:04:27.501754+0000","last_active":"2024-07-24T22:04:27.501831+0000","last_peered":"2024-07-24T22:04:27.501831+0000","last_clean":"2024-07-24T22:04:27.501831+0000","last_became_active":"2024-07-24T22:04:27.501340+0000","last_became_peered":"2024-07-24T22:04:27.501340+0000","last_unstale":"2024-07-24T22:04:27.501831+0000","last_undegraded":"2024-07-24T22:04:27.501831+0000","last_fullsized":"2024-07-24T22:04:27.501831+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:38:04.880980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500652+0000","last_change":"2024-07-24T22:03:53.413012+0000","last_active":"2024-07-24T22:04:27.500652+0000","last_peered":"2024-07-24T22:04:27.500652+0000","last_clean":"2024-07-24T22:04:27.500652+0000","last_became_active":"2024-07-24T22:03:53.411791+0000","last_became_peered":"2024-07-24T22:03:53.411791+0000","last_unstale":"2024-07-24T22:04:27.500652+0000","last_undegraded":"2024-07-24T22:04:27.500652+0000","last_fullsized":"2024-07-24T22:04:27.500652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:15:02.939598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.502913+0000","last_change":"2024-07-24T22:04:27.502867+0000","last_active":"2024-07-24T22:04:27.502913+0000","last_peered":"2024-07-24T22:04:27.502913+0000","last_clean":"2024-07-24T22:04:27.502913+0000","last_became_active":"2024-07-24T22:04:27.502515+0000","last_became_peered":"2024-07-24T22:04:27.502515+0000","last_unstale":"2024-07-24T22:04:27.502913+0000","last_undegraded":"2024-07-24T22:04:27.502913+0000","last_fullsized":"2024-07-24T22:04:27.502913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:58:39.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,10],"acting":[3,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.566696+0000","last_change":"2024-07-24T22:03:53.413213+0000","last_active":"2024-07-24T22:04:27.566696+0000","last_peered":"2024-07-24T22:04:27.566696+0000","last_clean":"2024-07-24T22:04:27.566696+0000","last_became_active":"2024-07-24T22:03:53.412725+0000","last_became_peered":"2024-07-24T22:03:53.412725+0000","last_unstale":"2024-07-24T22:04:27.566696+0000","last_undegraded":"2024-07-24T22:04:27.566696+0000","last_fullsized":"2024-07-24T22:04:27.566696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:34:01.897965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.497261+0000","last_change":"2024-07-24T22:03:53.401129+0000","last_active":"2024-07-24T22:04:27.497261+0000","last_peered":"2024-07-24T22:04:27.497261+0000","last_clean":"2024-07-24T22:04:27.497261+0000","last_became_active":"2024-07-24T22:03:53.400780+0000","last_became_peered":"2024-07-24T22:03:53.400780+0000","last_unstale":"2024-07-24T22:04:27.497261+0000","last_undegraded":"2024-07-24T22:04:27.497261+0000","last_fullsized":"2024-07-24T22:04:27.497261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:28:37.825021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501073+0000","last_change":"2024-07-24T22:03:53.406490+0000","last_active":"2024-07-24T22:04:27.501073+0000","last_peered":"2024-07-24T22:04:27.501073+0000","last_clean":"2024-07-24T22:04:27.501073+0000","last_became_active":"2024-07-24T22:03:53.406108+0000","last_became_peered":"2024-07-24T22:03:53.406108+0000","last_unstale":"2024-07-24T22:04:27.501073+0000","last_undegraded":"2024-07-24T22:04:27.501073+0000","last_fullsized":"2024-07-24T22:04:27.501073+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:37.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.503630+0000","last_change":"2024-07-24T22:04:27.503165+0000","last_active":"2024-07-24T22:04:27.503630+0000","last_peered":"2024-07-24T22:04:27.503630+0000","last_clean":"2024-07-24T22:04:27.503630+0000","last_became_active":"2024-07-24T22:04:27.502861+0000","last_became_peered":"2024-07-24T22:04:27.502861+0000","last_unstale":"2024-07-24T22:04:27.503630+0000","last_undegraded":"2024-07-24T22:04:27.503630+0000","last_fullsized":"2024-07-24T22:04:27.503630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:36:41.353268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496066+0000","last_change":"2024-07-24T22:03:53.392763+0000","last_active":"2024-07-24T22:04:27.496066+0000","last_peered":"2024-07-24T22:04:27.496066+0000","last_clean":"2024-07-24T22:04:27.496066+0000","last_became_active":"2024-07-24T22:03:53.392476+0000","last_became_peered":"2024-07-24T22:03:53.392476+0000","last_unstale":"2024-07-24T22:04:27.496066+0000","last_undegraded":"2024-07-24T22:04:27.496066+0000","last_fullsized":"2024-07-24T22:04:27.496066+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:25:13.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500088+0000","last_change":"2024-07-24T22:03:53.406937+0000","last_active":"2024-07-24T22:04:27.500088+0000","last_peered":"2024-07-24T22:04:27.500088+0000","last_clean":"2024-07-24T22:04:27.500088+0000","last_became_active":"2024-07-24T22:03:53.406495+0000","last_became_peered":"2024-07-24T22:03:53.406495+0000","last_unstale":"2024-07-24T22:04:27.500088+0000","last_undegraded":"2024-07-24T22:04:27.500088+0000","last_fullsized":"2024-07-24T22:04:27.500088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:06:50.434751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499820+0000","last_change":"2024-07-24T22:03:53.401073+0000","last_active":"2024-07-24T22:04:27.499820+0000","last_peered":"2024-07-24T22:04:27.499820+0000","last_clean":"2024-07-24T22:04:27.499820+0000","last_became_active":"2024-07-24T22:03:53.399675+0000","last_became_peered":"2024-07-24T22:03:53.399675+0000","last_unstale":"2024-07-24T22:04:27.499820+0000","last_undegraded":"2024-07-24T22:04:27.499820+0000","last_fullsized":"2024-07-24T22:04:27.499820+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:59:25.461178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.565549+0000","last_change":"2024-07-24T22:03:53.408289+0000","last_active":"2024-07-24T22:04:27.565549+0000","last_peered":"2024-07-24T22:04:27.565549+0000","last_clean":"2024-07-24T22:04:27.565549+0000","last_became_active":"2024-07-24T22:03:53.407950+0000","last_became_peered":"2024-07-24T22:03:53.407950+0000","last_unstale":"2024-07-24T22:04:27.565549+0000","last_undegraded":"2024-07-24T22:04:27.565549+0000","last_fullsized":"2024-07-24T22:04:27.565549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:10:30.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496787+0000","last_change":"2024-07-24T22:03:53.409909+0000","last_active":"2024-07-24T22:04:27.496787+0000","last_peered":"2024-07-24T22:04:27.496787+0000","last_clean":"2024-07-24T22:04:27.496787+0000","last_became_active":"2024-07-24T22:03:53.409183+0000","last_became_peered":"2024-07-24T22:03:53.409183+0000","last_unstale":"2024-07-24T22:04:27.496787+0000","last_undegraded":"2024-07-24T22:04:27.496787+0000","last_fullsized":"2024-07-24T22:04:27.496787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:14:50.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499131+0000","last_change":"2024-07-24T22:03:53.401198+0000","last_active":"2024-07-24T22:04:27.499131+0000","last_peered":"2024-07-24T22:04:27.499131+0000","last_clean":"2024-07-24T22:04:27.499131+0000","last_became_active":"2024-07-24T22:03:53.400885+0000","last_became_peered":"2024-07-24T22:03:53.400885+0000","last_unstale":"2024-07-24T22:04:27.499131+0000","last_undegraded":"2024-07-24T22:04:27.499131+0000","last_fullsized":"2024-07-24T22:04:27.499131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:59:37.965714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.503643+0000","last_change":"2024-07-24T22:03:53.406590+0000","last_active":"2024-07-24T22:04:27.503643+0000","last_peered":"2024-07-24T22:04:27.503643+0000","last_clean":"2024-07-24T22:04:27.503643+0000","last_became_active":"2024-07-24T22:03:53.406283+0000","last_became_peered":"2024-07-24T22:03:53.406283+0000","last_unstale":"2024-07-24T22:04:27.503643+0000","last_undegraded":"2024-07-24T22:04:27.503643+0000","last_fullsized":"2024-07-24T22:04:27.503643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:30.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496579+0000","last_change":"2024-07-24T22:03:53.408790+0000","last_active":"2024-07-24T22:04:27.496579+0000","last_peered":"2024-07-24T22:04:27.496579+0000","last_clean":"2024-07-24T22:04:27.496579+0000","last_became_active":"2024-07-24T22:03:53.408480+0000","last_became_peered":"2024-07-24T22:03:53.408480+0000","last_unstale":"2024-07-24T22:04:27.496579+0000","last_undegraded":"2024-07-24T22:04:27.496579+0000","last_fullsized":"2024-07-24T22:04:27.496579+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:59.601606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496124+0000","last_change":"2024-07-24T22:03:53.407400+0000","last_active":"2024-07-24T22:04:27.496124+0000","last_peered":"2024-07-24T22:04:27.496124+0000","last_clean":"2024-07-24T22:04:27.496124+0000","last_became_active":"2024-07-24T22:03:53.407084+0000","last_became_peered":"2024-07-24T22:03:53.407084+0000","last_unstale":"2024-07-24T22:04:27.496124+0000","last_undegraded":"2024-07-24T22:04:27.496124+0000","last_fullsized":"2024-07-24T22:04:27.496124+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:51:04.942504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.565721+0000","last_change":"2024-07-24T22:03:53.407444+0000","last_active":"2024-07-24T22:04:27.565721+0000","last_peered":"2024-07-24T22:04:27.565721+0000","last_clean":"2024-07-24T22:04:27.565721+0000","last_became_active":"2024-07-24T22:03:53.407025+0000","last_became_peered":"2024-07-24T22:03:53.407025+0000","last_unstale":"2024-07-24T22:04:27.565721+0000","last_undegraded":"2024-07-24T22:04:27.565721+0000","last_fullsized":"2024-07-24T22:04:27.565721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:47:49.620354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498204+0000","last_change":"2024-07-24T22:03:53.406748+0000","last_active":"2024-07-24T22:04:27.498204+0000","last_peered":"2024-07-24T22:04:27.498204+0000","last_clean":"2024-07-24T22:04:27.498204+0000","last_became_active":"2024-07-24T22:03:53.406398+0000","last_became_peered":"2024-07-24T22:03:53.406398+0000","last_unstale":"2024-07-24T22:04:27.498204+0000","last_undegraded":"2024-07-24T22:04:27.498204+0000","last_fullsized":"2024-07-24T22:04:27.498204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:35:40.117375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499636+0000","last_change":"2024-07-24T22:03:53.402203+0000","last_active":"2024-07-24T22:04:27.499636+0000","last_peered":"2024-07-24T22:04:27.499636+0000","last_clean":"2024-07-24T22:04:27.499636+0000","last_became_active":"2024-07-24T22:03:53.401826+0000","last_became_peered":"2024-07-24T22:03:53.401826+0000","last_unstale":"2024-07-24T22:04:27.499636+0000","last_undegraded":"2024-07-24T22:04:27.499636+0000","last_fullsized":"2024-07-24T22:04:27.499636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:45.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498918+0000","last_change":"2024-07-24T22:03:53.408179+0000","last_active":"2024-07-24T22:04:27.498918+0000","last_peered":"2024-07-24T22:04:27.498918+0000","last_clean":"2024-07-24T22:04:27.498918+0000","last_became_active":"2024-07-24T22:03:53.407547+0000","last_became_peered":"2024-07-24T22:03:53.407547+0000","last_unstale":"2024-07-24T22:04:27.498918+0000","last_undegraded":"2024-07-24T22:04:27.498918+0000","last_fullsized":"2024-07-24T22:04:27.498918+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:03:52.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.503829+0000","last_change":"2024-07-24T22:03:53.408550+0000","last_active":"2024-07-24T22:04:27.503829+0000","last_peered":"2024-07-24T22:04:27.503829+0000","last_clean":"2024-07-24T22:04:27.503829+0000","last_became_active":"2024-07-24T22:03:53.408119+0000","last_became_peered":"2024-07-24T22:03:53.408119+0000","last_unstale":"2024-07-24T22:04:27.503829+0000","last_undegraded":"2024-07-24T22:04:27.503829+0000","last_fullsized":"2024-07-24T22:04:27.503829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:33:54.154606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496627+0000","last_change":"2024-07-24T22:03:53.412562+0000","last_active":"2024-07-24T22:04:27.496627+0000","last_peered":"2024-07-24T22:04:27.496627+0000","last_clean":"2024-07-24T22:04:27.496627+0000","last_became_active":"2024-07-24T22:03:53.412231+0000","last_became_peered":"2024-07-24T22:03:53.412231+0000","last_unstale":"2024-07-24T22:04:27.496627+0000","last_undegraded":"2024-07-24T22:04:27.496627+0000","last_fullsized":"2024-07-24T22:04:27.496627+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:53:48.403662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496127+0000","last_change":"2024-07-24T22:03:53.398212+0000","last_active":"2024-07-24T22:04:27.496127+0000","last_peered":"2024-07-24T22:04:27.496127+0000","last_clean":"2024-07-24T22:04:27.496127+0000","last_became_active":"2024-07-24T22:03:53.397853+0000","last_became_peered":"2024-07-24T22:03:53.397853+0000","last_unstale":"2024-07-24T22:04:27.496127+0000","last_undegraded":"2024-07-24T22:04:27.496127+0000","last_fullsized":"2024-07-24T22:04:27.496127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:39:47.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500319+0000","last_change":"2024-07-24T22:03:53.397188+0000","last_active":"2024-07-24T22:04:27.500319+0000","last_peered":"2024-07-24T22:04:27.500319+0000","last_clean":"2024-07-24T22:04:27.500319+0000","last_became_active":"2024-07-24T22:03:53.396865+0000","last_became_peered":"2024-07-24T22:03:53.396865+0000","last_unstale":"2024-07-24T22:04:27.500319+0000","last_undegraded":"2024-07-24T22:04:27.500319+0000","last_fullsized":"2024-07-24T22:04:27.500319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:20:49.074330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.503161+0000","last_change":"2024-07-24T22:03:53.406605+0000","last_active":"2024-07-24T22:04:27.503161+0000","last_peered":"2024-07-24T22:04:27.503161+0000","last_clean":"2024-07-24T22:04:27.503161+0000","last_became_active":"2024-07-24T22:03:53.406264+0000","last_became_peered":"2024-07-24T22:03:53.406264+0000","last_unstale":"2024-07-24T22:04:27.503161+0000","last_undegraded":"2024-07-24T22:04:27.503161+0000","last_fullsized":"2024-07-24T22:04:27.503161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:13:46.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.503236+0000","last_change":"2024-07-24T22:03:53.400422+0000","last_active":"2024-07-24T22:04:27.503236+0000","last_peered":"2024-07-24T22:04:27.503236+0000","last_clean":"2024-07-24T22:04:27.503236+0000","last_became_active":"2024-07-24T22:03:53.400096+0000","last_became_peered":"2024-07-24T22:03:53.400096+0000","last_unstale":"2024-07-24T22:04:27.503236+0000","last_undegraded":"2024-07-24T22:04:27.503236+0000","last_fullsized":"2024-07-24T22:04:27.503236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:04:07.882659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496413+0000","last_change":"2024-07-24T22:03:53.413231+0000","last_active":"2024-07-24T22:04:27.496413+0000","last_peered":"2024-07-24T22:04:27.496413+0000","last_clean":"2024-07-24T22:04:27.496413+0000","last_became_active":"2024-07-24T22:03:53.412825+0000","last_became_peered":"2024-07-24T22:03:53.412825+0000","last_unstale":"2024-07-24T22:04:27.496413+0000","last_undegraded":"2024-07-24T22:04:27.496413+0000","last_fullsized":"2024-07-24T22:04:27.496413+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:59:30.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501034+0000","last_change":"2024-07-24T22:03:53.409007+0000","last_active":"2024-07-24T22:04:27.501034+0000","last_peered":"2024-07-24T22:04:27.501034+0000","last_clean":"2024-07-24T22:04:27.501034+0000","last_became_active":"2024-07-24T22:03:53.408624+0000","last_became_peered":"2024-07-24T22:03:53.408624+0000","last_unstale":"2024-07-24T22:04:27.501034+0000","last_undegraded":"2024-07-24T22:04:27.501034+0000","last_fullsized":"2024-07-24T22:04:27.501034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:31:22.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500041+0000","last_change":"2024-07-24T22:03:50.388894+0000","last_active":"2024-07-24T22:04:27.500041+0000","last_peered":"2024-07-24T22:04:27.500041+0000","last_clean":"2024-07-24T22:04:27.500041+0000","last_became_active":"2024-07-24T22:03:50.388608+0000","last_became_peered":"2024-07-24T22:03:50.388608+0000","last_unstale":"2024-07-24T22:04:27.500041+0000","last_undegraded":"2024-07-24T22:04:27.500041+0000","last_fullsized":"2024-07-24T22:04:27.500041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:36:43.571415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500386+0000","last_change":"2024-07-24T22:03:53.397509+0000","last_active":"2024-07-24T22:04:27.500386+0000","last_peered":"2024-07-24T22:04:27.500386+0000","last_clean":"2024-07-24T22:04:27.500386+0000","last_became_active":"2024-07-24T22:03:53.397186+0000","last_became_peered":"2024-07-24T22:03:53.397186+0000","last_unstale":"2024-07-24T22:04:27.500386+0000","last_undegraded":"2024-07-24T22:04:27.500386+0000","last_fullsized":"2024-07-24T22:04:27.500386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:15:14.081853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496768+0000","last_change":"2024-07-24T22:03:50.383523+0000","last_active":"2024-07-24T22:04:27.496768+0000","last_peered":"2024-07-24T22:04:27.496768+0000","last_clean":"2024-07-24T22:04:27.496768+0000","last_became_active":"2024-07-24T22:03:50.383088+0000","last_became_peered":"2024-07-24T22:03:50.383088+0000","last_unstale":"2024-07-24T22:04:27.496768+0000","last_undegraded":"2024-07-24T22:04:27.496768+0000","last_fullsized":"2024-07-24T22:04:27.496768+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:57:07.824581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.495799+0000","last_change":"2024-07-24T22:03:50.383726+0000","last_active":"2024-07-24T22:04:27.495799+0000","last_peered":"2024-07-24T22:04:27.495799+0000","last_clean":"2024-07-24T22:04:27.495799+0000","last_became_active":"2024-07-24T22:03:50.383480+0000","last_became_peered":"2024-07-24T22:03:50.383480+0000","last_unstale":"2024-07-24T22:04:27.495799+0000","last_undegraded":"2024-07-24T22:04:27.495799+0000","last_fullsized":"2024-07-24T22:04:27.495799+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:05:05.093272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498792+0000","last_change":"2024-07-24T22:03:53.406223+0000","last_active":"2024-07-24T22:04:27.498792+0000","last_peered":"2024-07-24T22:04:27.498792+0000","last_clean":"2024-07-24T22:04:27.498792+0000","last_became_active":"2024-07-24T22:03:53.404642+0000","last_became_peered":"2024-07-24T22:03:53.404642+0000","last_unstale":"2024-07-24T22:04:27.498792+0000","last_undegraded":"2024-07-24T22:04:27.498792+0000","last_fullsized":"2024-07-24T22:04:27.498792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:00:51.849538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499934+0000","last_change":"2024-07-24T22:03:50.385780+0000","last_active":"2024-07-24T22:04:27.499934+0000","last_peered":"2024-07-24T22:04:27.499934+0000","last_clean":"2024-07-24T22:04:27.499934+0000","last_became_active":"2024-07-24T22:03:50.385488+0000","last_became_peered":"2024-07-24T22:03:50.385488+0000","last_unstale":"2024-07-24T22:04:27.499934+0000","last_undegraded":"2024-07-24T22:04:27.499934+0000","last_fullsized":"2024-07-24T22:04:27.499934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:47:35.908303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498786+0000","last_change":"2024-07-24T22:03:53.403103+0000","last_active":"2024-07-24T22:04:27.498786+0000","last_peered":"2024-07-24T22:04:27.498786+0000","last_clean":"2024-07-24T22:04:27.498786+0000","last_became_active":"2024-07-24T22:03:53.402810+0000","last_became_peered":"2024-07-24T22:03:53.402810+0000","last_unstale":"2024-07-24T22:04:27.498786+0000","last_undegraded":"2024-07-24T22:04:27.498786+0000","last_fullsized":"2024-07-24T22:04:27.498786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:15.798983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.497262+0000","last_change":"2024-07-24T22:03:50.382383+0000","last_active":"2024-07-24T22:04:27.497262+0000","last_peered":"2024-07-24T22:04:27.497262+0000","last_clean":"2024-07-24T22:04:27.497262+0000","last_became_active":"2024-07-24T22:03:50.381629+0000","last_became_peered":"2024-07-24T22:03:50.381629+0000","last_unstale":"2024-07-24T22:04:27.497262+0000","last_undegraded":"2024-07-24T22:04:27.497262+0000","last_fullsized":"2024-07-24T22:04:27.497262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:17.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.565568+0000","last_change":"2024-07-24T22:03:53.409587+0000","last_active":"2024-07-24T22:04:27.565568+0000","last_peered":"2024-07-24T22:04:27.565568+0000","last_clean":"2024-07-24T22:04:27.565568+0000","last_became_active":"2024-07-24T22:03:53.409240+0000","last_became_peered":"2024-07-24T22:03:53.409240+0000","last_unstale":"2024-07-24T22:04:27.565568+0000","last_undegraded":"2024-07-24T22:04:27.565568+0000","last_fullsized":"2024-07-24T22:04:27.565568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:37:18.654244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500731+0000","last_change":"2024-07-24T22:03:50.387933+0000","last_active":"2024-07-24T22:04:27.500731+0000","last_peered":"2024-07-24T22:04:27.500731+0000","last_clean":"2024-07-24T22:04:27.500731+0000","last_became_active":"2024-07-24T22:03:50.386985+0000","last_became_peered":"2024-07-24T22:03:50.386985+0000","last_unstale":"2024-07-24T22:04:27.500731+0000","last_undegraded":"2024-07-24T22:04:27.500731+0000","last_fullsized":"2024-07-24T22:04:27.500731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:35:29.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500849+0000","last_change":"2024-07-24T22:03:53.404419+0000","last_active":"2024-07-24T22:04:27.500849+0000","last_peered":"2024-07-24T22:04:27.500849+0000","last_clean":"2024-07-24T22:04:27.500849+0000","last_became_active":"2024-07-24T22:03:53.402713+0000","last_became_peered":"2024-07-24T22:03:53.402713+0000","last_unstale":"2024-07-24T22:04:27.500849+0000","last_undegraded":"2024-07-24T22:04:27.500849+0000","last_fullsized":"2024-07-24T22:04:27.500849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:41.262686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500076+0000","last_change":"2024-07-24T22:03:50.511126+0000","last_active":"2024-07-24T22:04:27.500076+0000","last_peered":"2024-07-24T22:04:27.500076+0000","last_clean":"2024-07-24T22:04:27.500076+0000","last_became_active":"2024-07-24T22:03:50.510801+0000","last_became_peered":"2024-07-24T22:03:50.510801+0000","last_unstale":"2024-07-24T22:04:27.500076+0000","last_undegraded":"2024-07-24T22:04:27.500076+0000","last_fullsized":"2024-07-24T22:04:27.500076+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:59:37.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.566143+0000","last_change":"2024-07-24T22:03:53.410202+0000","last_active":"2024-07-24T22:04:27.566143+0000","last_peered":"2024-07-24T22:04:27.566143+0000","last_clean":"2024-07-24T22:04:27.566143+0000","last_became_active":"2024-07-24T22:03:53.409884+0000","last_became_peered":"2024-07-24T22:03:53.409884+0000","last_unstale":"2024-07-24T22:04:27.566143+0000","last_undegraded":"2024-07-24T22:04:27.566143+0000","last_fullsized":"2024-07-24T22:04:27.566143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:54:02.603267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'27","reported_seq":110,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:30.490234+0000","last_change":"2024-07-24T22:03:50.386993+0000","last_active":"2024-07-24T22:04:30.490234+0000","last_peered":"2024-07-24T22:04:30.490234+0000","last_clean":"2024-07-24T22:04:30.490234+0000","last_became_active":"2024-07-24T22:03:50.386675+0000","last_became_peered":"2024-07-24T22:03:50.386675+0000","last_unstale":"2024-07-24T22:04:30.490234+0000","last_undegraded":"2024-07-24T22:04:30.490234+0000","last_fullsized":"2024-07-24T22:04:30.490234+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:20:58.384179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62335,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":88,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501339+0000","last_change":"2024-07-24T22:03:53.413293+0000","last_active":"2024-07-24T22:04:27.501339+0000","last_peered":"2024-07-24T22:04:27.501339+0000","last_clean":"2024-07-24T22:04:27.501339+0000","last_became_active":"2024-07-24T22:03:53.412900+0000","last_became_peered":"2024-07-24T22:03:53.412900+0000","last_unstale":"2024-07-24T22:04:27.501339+0000","last_undegraded":"2024-07-24T22:04:27.501339+0000","last_fullsized":"2024-07-24T22:04:27.501339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:11:32.553108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.503434+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:04:27.503434+0000","last_peered":"2024-07-24T22:04:27.503434+0000","last_clean":"2024-07-24T22:04:27.503434+0000","last_became_active":"2024-07-24T22:03:50.387059+0000","last_became_peered":"2024-07-24T22:03:50.387059+0000","last_unstale":"2024-07-24T22:04:27.503434+0000","last_undegraded":"2024-07-24T22:04:27.503434+0000","last_fullsized":"2024-07-24T22:04:27.503434+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:40:06.887090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.495899+0000","last_change":"2024-07-24T22:03:53.406808+0000","last_active":"2024-07-24T22:04:27.495899+0000","last_peered":"2024-07-24T22:04:27.495899+0000","last_clean":"2024-07-24T22:04:27.495899+0000","last_became_active":"2024-07-24T22:03:53.406487+0000","last_became_peered":"2024-07-24T22:03:53.406487+0000","last_unstale":"2024-07-24T22:04:27.495899+0000","last_undegraded":"2024-07-24T22:04:27.495899+0000","last_fullsized":"2024-07-24T22:04:27.495899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:44:57.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499836+0000","last_change":"2024-07-24T22:03:50.386881+0000","last_active":"2024-07-24T22:04:27.499836+0000","last_peered":"2024-07-24T22:04:27.499836+0000","last_clean":"2024-07-24T22:04:27.499836+0000","last_became_active":"2024-07-24T22:03:50.386564+0000","last_became_peered":"2024-07-24T22:03:50.386564+0000","last_unstale":"2024-07-24T22:04:27.499836+0000","last_undegraded":"2024-07-24T22:04:27.499836+0000","last_fullsized":"2024-07-24T22:04:27.499836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:22:22.339854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500832+0000","last_change":"2024-07-24T22:03:53.403207+0000","last_active":"2024-07-24T22:04:27.500832+0000","last_peered":"2024-07-24T22:04:27.500832+0000","last_clean":"2024-07-24T22:04:27.500832+0000","last_became_active":"2024-07-24T22:03:53.402875+0000","last_became_peered":"2024-07-24T22:03:53.402875+0000","last_unstale":"2024-07-24T22:04:27.500832+0000","last_undegraded":"2024-07-24T22:04:27.500832+0000","last_fullsized":"2024-07-24T22:04:27.500832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:25:28.866228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.566944+0000","last_change":"2024-07-24T22:03:50.386721+0000","last_active":"2024-07-24T22:04:27.566944+0000","last_peered":"2024-07-24T22:04:27.566944+0000","last_clean":"2024-07-24T22:04:27.566944+0000","last_became_active":"2024-07-24T22:03:50.385654+0000","last_became_peered":"2024-07-24T22:03:50.385654+0000","last_unstale":"2024-07-24T22:04:27.566944+0000","last_undegraded":"2024-07-24T22:04:27.566944+0000","last_fullsized":"2024-07-24T22:04:27.566944+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:16:15.802744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500850+0000","last_change":"2024-07-24T22:03:53.405367+0000","last_active":"2024-07-24T22:04:27.500850+0000","last_peered":"2024-07-24T22:04:27.500850+0000","last_clean":"2024-07-24T22:04:27.500850+0000","last_became_active":"2024-07-24T22:03:53.404875+0000","last_became_peered":"2024-07-24T22:03:53.404875+0000","last_unstale":"2024-07-24T22:04:27.500850+0000","last_undegraded":"2024-07-24T22:04:27.500850+0000","last_fullsized":"2024-07-24T22:04:27.500850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:42.247052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.574489+0000","last_change":"2024-07-24T22:04:27.574426+0000","last_active":"2024-07-24T22:04:27.574489+0000","last_peered":"2024-07-24T22:04:27.574489+0000","last_clean":"2024-07-24T22:04:27.574489+0000","last_became_active":"2024-07-24T22:04:27.568176+0000","last_became_peered":"2024-07-24T22:04:27.568176+0000","last_unstale":"2024-07-24T22:04:27.574489+0000","last_undegraded":"2024-07-24T22:04:27.574489+0000","last_fullsized":"2024-07-24T22:04:27.574489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:20:37.620669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499882+0000","last_change":"2024-07-24T22:03:53.405136+0000","last_active":"2024-07-24T22:04:27.499882+0000","last_peered":"2024-07-24T22:04:27.499882+0000","last_clean":"2024-07-24T22:04:27.499882+0000","last_became_active":"2024-07-24T22:03:53.404043+0000","last_became_peered":"2024-07-24T22:03:53.404043+0000","last_unstale":"2024-07-24T22:04:27.499882+0000","last_undegraded":"2024-07-24T22:04:27.499882+0000","last_fullsized":"2024-07-24T22:04:27.499882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:03:21.912335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501621+0000","last_change":"2024-07-24T22:03:50.382364+0000","last_active":"2024-07-24T22:04:27.501621+0000","last_peered":"2024-07-24T22:04:27.501621+0000","last_clean":"2024-07-24T22:04:27.501621+0000","last_became_active":"2024-07-24T22:03:50.382029+0000","last_became_peered":"2024-07-24T22:03:50.382029+0000","last_unstale":"2024-07-24T22:04:27.501621+0000","last_undegraded":"2024-07-24T22:04:27.501621+0000","last_fullsized":"2024-07-24T22:04:27.501621+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:48:10.004826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496619+0000","last_change":"2024-07-24T22:03:53.413053+0000","last_active":"2024-07-24T22:04:27.496619+0000","last_peered":"2024-07-24T22:04:27.496619+0000","last_clean":"2024-07-24T22:04:27.496619+0000","last_became_active":"2024-07-24T22:03:53.412733+0000","last_became_peered":"2024-07-24T22:03:53.412733+0000","last_unstale":"2024-07-24T22:04:27.496619+0000","last_undegraded":"2024-07-24T22:04:27.496619+0000","last_fullsized":"2024-07-24T22:04:27.496619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:16.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496182+0000","last_change":"2024-07-24T22:03:50.387314+0000","last_active":"2024-07-24T22:04:27.496182+0000","last_peered":"2024-07-24T22:04:27.496182+0000","last_clean":"2024-07-24T22:04:27.496182+0000","last_became_active":"2024-07-24T22:03:50.386919+0000","last_became_peered":"2024-07-24T22:03:50.386919+0000","last_unstale":"2024-07-24T22:04:27.496182+0000","last_undegraded":"2024-07-24T22:04:27.496182+0000","last_fullsized":"2024-07-24T22:04:27.496182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:51:03.203285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500927+0000","last_change":"2024-07-24T22:03:53.411938+0000","last_active":"2024-07-24T22:04:27.500927+0000","last_peered":"2024-07-24T22:04:27.500927+0000","last_clean":"2024-07-24T22:04:27.500927+0000","last_became_active":"2024-07-24T22:03:53.411545+0000","last_became_peered":"2024-07-24T22:03:53.411545+0000","last_unstale":"2024-07-24T22:04:27.500927+0000","last_undegraded":"2024-07-24T22:04:27.500927+0000","last_fullsized":"2024-07-24T22:04:27.500927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:41:19.370886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500252+0000","last_change":"2024-07-24T22:03:50.384400+0000","last_active":"2024-07-24T22:04:27.500252+0000","last_peered":"2024-07-24T22:04:27.500252+0000","last_clean":"2024-07-24T22:04:27.500252+0000","last_became_active":"2024-07-24T22:03:50.383945+0000","last_became_peered":"2024-07-24T22:03:50.383945+0000","last_unstale":"2024-07-24T22:04:27.500252+0000","last_undegraded":"2024-07-24T22:04:27.500252+0000","last_fullsized":"2024-07-24T22:04:27.500252+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:16.035171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.507442+0000","last_change":"2024-07-24T22:04:27.507390+0000","last_active":"2024-07-24T22:04:27.507442+0000","last_peered":"2024-07-24T22:04:27.507442+0000","last_clean":"2024-07-24T22:04:27.507442+0000","last_became_active":"2024-07-24T22:04:27.504206+0000","last_became_peered":"2024-07-24T22:04:27.504206+0000","last_unstale":"2024-07-24T22:04:27.507442+0000","last_undegraded":"2024-07-24T22:04:27.507442+0000","last_fullsized":"2024-07-24T22:04:27.507442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:55:21.559702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.503794+0000","last_change":"2024-07-24T22:03:50.511075+0000","last_active":"2024-07-24T22:04:27.503794+0000","last_peered":"2024-07-24T22:04:27.503794+0000","last_clean":"2024-07-24T22:04:27.503794+0000","last_became_active":"2024-07-24T22:03:50.510244+0000","last_became_peered":"2024-07-24T22:03:50.510244+0000","last_unstale":"2024-07-24T22:04:27.503794+0000","last_undegraded":"2024-07-24T22:04:27.503794+0000","last_fullsized":"2024-07-24T22:04:27.503794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:54:03.068211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501174+0000","last_change":"2024-07-24T22:03:53.410865+0000","last_active":"2024-07-24T22:04:27.501174+0000","last_peered":"2024-07-24T22:04:27.501174+0000","last_clean":"2024-07-24T22:04:27.501174+0000","last_became_active":"2024-07-24T22:03:53.410255+0000","last_became_peered":"2024-07-24T22:03:53.410255+0000","last_unstale":"2024-07-24T22:04:27.501174+0000","last_undegraded":"2024-07-24T22:04:27.501174+0000","last_fullsized":"2024-07-24T22:04:27.501174+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:15.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501157+0000","last_change":"2024-07-24T22:02:33.494929+0000","last_active":"2024-07-24T22:04:27.501157+0000","last_peered":"2024-07-24T22:04:27.501157+0000","last_clean":"2024-07-24T22:04:27.501157+0000","last_became_active":"2024-07-24T22:02:33.489241+0000","last_became_peered":"2024-07-24T22:02:33.489241+0000","last_unstale":"2024-07-24T22:04:27.501157+0000","last_undegraded":"2024-07-24T22:04:27.501157+0000","last_fullsized":"2024-07-24T22:04:27.501157+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_clean_scrub_stamp":"2024-07-24T21:59:32.406119+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:46.421413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.567053+0000","last_change":"2024-07-24T22:03:50.385093+0000","last_active":"2024-07-24T22:04:27.567053+0000","last_peered":"2024-07-24T22:04:27.567053+0000","last_clean":"2024-07-24T22:04:27.567053+0000","last_became_active":"2024-07-24T22:03:50.384639+0000","last_became_peered":"2024-07-24T22:03:50.384639+0000","last_unstale":"2024-07-24T22:04:27.567053+0000","last_undegraded":"2024-07-24T22:04:27.567053+0000","last_fullsized":"2024-07-24T22:04:27.567053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:06:10.402336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498368+0000","last_change":"2024-07-24T22:03:53.409627+0000","last_active":"2024-07-24T22:04:27.498368+0000","last_peered":"2024-07-24T22:04:27.498368+0000","last_clean":"2024-07-24T22:04:27.498368+0000","last_became_active":"2024-07-24T22:03:53.409295+0000","last_became_peered":"2024-07-24T22:03:53.409295+0000","last_unstale":"2024-07-24T22:04:27.498368+0000","last_undegraded":"2024-07-24T22:04:27.498368+0000","last_fullsized":"2024-07-24T22:04:27.498368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:23:39.670020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501059+0000","last_change":"2024-07-24T22:03:50.385772+0000","last_active":"2024-07-24T22:04:27.501059+0000","last_peered":"2024-07-24T22:04:27.501059+0000","last_clean":"2024-07-24T22:04:27.501059+0000","last_became_active":"2024-07-24T22:03:50.385421+0000","last_became_peered":"2024-07-24T22:03:50.385421+0000","last_unstale":"2024-07-24T22:04:27.501059+0000","last_undegraded":"2024-07-24T22:04:27.501059+0000","last_fullsized":"2024-07-24T22:04:27.501059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:58:57.227697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.495786+0000","last_change":"2024-07-24T22:03:53.400558+0000","last_active":"2024-07-24T22:04:27.495786+0000","last_peered":"2024-07-24T22:04:27.495786+0000","last_clean":"2024-07-24T22:04:27.495786+0000","last_became_active":"2024-07-24T22:03:53.400131+0000","last_became_peered":"2024-07-24T22:03:53.400131+0000","last_unstale":"2024-07-24T22:04:27.495786+0000","last_undegraded":"2024-07-24T22:04:27.495786+0000","last_fullsized":"2024-07-24T22:04:27.495786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:57:57.586742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.495881+0000","last_change":"2024-07-24T22:03:50.510189+0000","last_active":"2024-07-24T22:04:27.495881+0000","last_peered":"2024-07-24T22:04:27.495881+0000","last_clean":"2024-07-24T22:04:27.495881+0000","last_became_active":"2024-07-24T22:03:50.509857+0000","last_became_peered":"2024-07-24T22:03:50.509857+0000","last_unstale":"2024-07-24T22:04:27.495881+0000","last_undegraded":"2024-07-24T22:04:27.495881+0000","last_fullsized":"2024-07-24T22:04:27.495881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:05:59.240650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.505356+0000","last_change":"2024-07-24T22:04:27.505187+0000","last_active":"2024-07-24T22:04:27.505356+0000","last_peered":"2024-07-24T22:04:27.505356+0000","last_clean":"2024-07-24T22:04:27.505356+0000","last_became_active":"2024-07-24T22:04:27.504785+0000","last_became_peered":"2024-07-24T22:04:27.504785+0000","last_unstale":"2024-07-24T22:04:27.505356+0000","last_undegraded":"2024-07-24T22:04:27.505356+0000","last_fullsized":"2024-07-24T22:04:27.505356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:47:33.516835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501118+0000","last_change":"2024-07-24T22:03:50.387913+0000","last_active":"2024-07-24T22:04:27.501118+0000","last_peered":"2024-07-24T22:04:27.501118+0000","last_clean":"2024-07-24T22:04:27.501118+0000","last_became_active":"2024-07-24T22:03:50.386700+0000","last_became_peered":"2024-07-24T22:03:50.386700+0000","last_unstale":"2024-07-24T22:04:27.501118+0000","last_undegraded":"2024-07-24T22:04:27.501118+0000","last_fullsized":"2024-07-24T22:04:27.501118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:03:56.295684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496908+0000","last_change":"2024-07-24T22:03:53.399369+0000","last_active":"2024-07-24T22:04:27.496908+0000","last_peered":"2024-07-24T22:04:27.496908+0000","last_clean":"2024-07-24T22:04:27.496908+0000","last_became_active":"2024-07-24T22:03:53.399001+0000","last_became_peered":"2024-07-24T22:03:53.399001+0000","last_unstale":"2024-07-24T22:04:27.496908+0000","last_undegraded":"2024-07-24T22:04:27.496908+0000","last_fullsized":"2024-07-24T22:04:27.496908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:26:46.531080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500369+0000","last_change":"2024-07-24T22:03:50.510889+0000","last_active":"2024-07-24T22:04:27.500369+0000","last_peered":"2024-07-24T22:04:27.500369+0000","last_clean":"2024-07-24T22:04:27.500369+0000","last_became_active":"2024-07-24T22:03:50.510366+0000","last_became_peered":"2024-07-24T22:03:50.510366+0000","last_unstale":"2024-07-24T22:04:27.500369+0000","last_undegraded":"2024-07-24T22:04:27.500369+0000","last_fullsized":"2024-07-24T22:04:27.500369+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:47:54.838304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496936+0000","last_change":"2024-07-24T22:03:53.398987+0000","last_active":"2024-07-24T22:04:27.496936+0000","last_peered":"2024-07-24T22:04:27.496936+0000","last_clean":"2024-07-24T22:04:27.496936+0000","last_became_active":"2024-07-24T22:03:53.398604+0000","last_became_peered":"2024-07-24T22:03:53.398604+0000","last_unstale":"2024-07-24T22:04:27.496936+0000","last_undegraded":"2024-07-24T22:04:27.496936+0000","last_fullsized":"2024-07-24T22:04:27.496936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:28:41.684174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.501463+0000","last_change":"2024-07-24T22:03:50.510623+0000","last_active":"2024-07-24T22:04:27.501463+0000","last_peered":"2024-07-24T22:04:27.501463+0000","last_clean":"2024-07-24T22:04:27.501463+0000","last_became_active":"2024-07-24T22:03:50.510204+0000","last_became_peered":"2024-07-24T22:03:50.510204+0000","last_unstale":"2024-07-24T22:04:27.501463+0000","last_undegraded":"2024-07-24T22:04:27.501463+0000","last_fullsized":"2024-07-24T22:04:27.501463+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:06:40.838840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496236+0000","last_change":"2024-07-24T22:03:53.400289+0000","last_active":"2024-07-24T22:04:27.496236+0000","last_peered":"2024-07-24T22:04:27.496236+0000","last_clean":"2024-07-24T22:04:27.496236+0000","last_became_active":"2024-07-24T22:03:53.399939+0000","last_became_peered":"2024-07-24T22:03:53.399939+0000","last_unstale":"2024-07-24T22:04:27.496236+0000","last_undegraded":"2024-07-24T22:04:27.496236+0000","last_fullsized":"2024-07-24T22:04:27.496236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:29:26.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499285+0000","last_change":"2024-07-24T22:03:50.382776+0000","last_active":"2024-07-24T22:04:27.499285+0000","last_peered":"2024-07-24T22:04:27.499285+0000","last_clean":"2024-07-24T22:04:27.499285+0000","last_became_active":"2024-07-24T22:03:50.382474+0000","last_became_peered":"2024-07-24T22:03:50.382474+0000","last_unstale":"2024-07-24T22:04:27.499285+0000","last_undegraded":"2024-07-24T22:04:27.499285+0000","last_fullsized":"2024-07-24T22:04:27.499285+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:59:34.688895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498616+0000","last_change":"2024-07-24T22:03:53.407883+0000","last_active":"2024-07-24T22:04:27.498616+0000","last_peered":"2024-07-24T22:04:27.498616+0000","last_clean":"2024-07-24T22:04:27.498616+0000","last_became_active":"2024-07-24T22:03:53.407524+0000","last_became_peered":"2024-07-24T22:03:53.407524+0000","last_unstale":"2024-07-24T22:04:27.498616+0000","last_undegraded":"2024-07-24T22:04:27.498616+0000","last_fullsized":"2024-07-24T22:04:27.498616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:52:25.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.567574+0000","last_change":"2024-07-24T22:03:50.388789+0000","last_active":"2024-07-24T22:04:27.567574+0000","last_peered":"2024-07-24T22:04:27.567574+0000","last_clean":"2024-07-24T22:04:27.567574+0000","last_became_active":"2024-07-24T22:03:50.385439+0000","last_became_peered":"2024-07-24T22:03:50.385439+0000","last_unstale":"2024-07-24T22:04:27.567574+0000","last_undegraded":"2024-07-24T22:04:27.567574+0000","last_fullsized":"2024-07-24T22:04:27.567574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:14:25.009588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.504019+0000","last_change":"2024-07-24T22:04:27.503956+0000","last_active":"2024-07-24T22:04:27.504019+0000","last_peered":"2024-07-24T22:04:27.504019+0000","last_clean":"2024-07-24T22:04:27.504019+0000","last_became_active":"2024-07-24T22:04:27.503498+0000","last_became_peered":"2024-07-24T22:04:27.503498+0000","last_unstale":"2024-07-24T22:04:27.504019+0000","last_undegraded":"2024-07-24T22:04:27.504019+0000","last_fullsized":"2024-07-24T22:04:27.504019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:23:20.294458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.565723+0000","last_change":"2024-07-24T22:03:50.510687+0000","last_active":"2024-07-24T22:04:27.565723+0000","last_peered":"2024-07-24T22:04:27.565723+0000","last_clean":"2024-07-24T22:04:27.565723+0000","last_became_active":"2024-07-24T22:03:50.510310+0000","last_became_peered":"2024-07-24T22:03:50.510310+0000","last_unstale":"2024-07-24T22:04:27.565723+0000","last_undegraded":"2024-07-24T22:04:27.565723+0000","last_fullsized":"2024-07-24T22:04:27.565723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:14:29.957324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500830+0000","last_change":"2024-07-24T22:03:53.412711+0000","last_active":"2024-07-24T22:04:27.500830+0000","last_peered":"2024-07-24T22:04:27.500830+0000","last_clean":"2024-07-24T22:04:27.500830+0000","last_became_active":"2024-07-24T22:03:53.412375+0000","last_became_peered":"2024-07-24T22:03:53.412375+0000","last_unstale":"2024-07-24T22:04:27.500830+0000","last_undegraded":"2024-07-24T22:04:27.500830+0000","last_fullsized":"2024-07-24T22:04:27.500830+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:55:29.441385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.499186+0000","last_change":"2024-07-24T22:03:50.383094+0000","last_active":"2024-07-24T22:04:27.499186+0000","last_peered":"2024-07-24T22:04:27.499186+0000","last_clean":"2024-07-24T22:04:27.499186+0000","last_became_active":"2024-07-24T22:03:50.382687+0000","last_became_peered":"2024-07-24T22:03:50.382687+0000","last_unstale":"2024-07-24T22:04:27.499186+0000","last_undegraded":"2024-07-24T22:04:27.499186+0000","last_fullsized":"2024-07-24T22:04:27.499186+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:32:02.727855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.496477+0000","last_change":"2024-07-24T22:03:53.403709+0000","last_active":"2024-07-24T22:04:27.496477+0000","last_peered":"2024-07-24T22:04:27.496477+0000","last_clean":"2024-07-24T22:04:27.496477+0000","last_became_active":"2024-07-24T22:03:53.403334+0000","last_became_peered":"2024-07-24T22:03:53.403334+0000","last_unstale":"2024-07-24T22:04:27.496477+0000","last_undegraded":"2024-07-24T22:04:27.496477+0000","last_fullsized":"2024-07-24T22:04:27.496477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:27:50.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.503311+0000","last_change":"2024-07-24T22:03:50.385547+0000","last_active":"2024-07-24T22:04:27.503311+0000","last_peered":"2024-07-24T22:04:27.503311+0000","last_clean":"2024-07-24T22:04:27.503311+0000","last_became_active":"2024-07-24T22:03:50.385233+0000","last_became_peered":"2024-07-24T22:03:50.385233+0000","last_unstale":"2024-07-24T22:04:27.503311+0000","last_undegraded":"2024-07-24T22:04:27.503311+0000","last_fullsized":"2024-07-24T22:04:27.503311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:40:04.647242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498549+0000","last_change":"2024-07-24T22:03:53.402386+0000","last_active":"2024-07-24T22:04:27.498549+0000","last_peered":"2024-07-24T22:04:27.498549+0000","last_clean":"2024-07-24T22:04:27.498549+0000","last_became_active":"2024-07-24T22:03:53.399363+0000","last_became_peered":"2024-07-24T22:03:53.399363+0000","last_unstale":"2024-07-24T22:04:27.498549+0000","last_undegraded":"2024-07-24T22:04:27.498549+0000","last_fullsized":"2024-07-24T22:04:27.498549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:19:05.835280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500988+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:04:27.500988+0000","last_peered":"2024-07-24T22:04:27.500988+0000","last_clean":"2024-07-24T22:04:27.500988+0000","last_became_active":"2024-07-24T22:03:50.387097+0000","last_became_peered":"2024-07-24T22:03:50.387097+0000","last_unstale":"2024-07-24T22:04:27.500988+0000","last_undegraded":"2024-07-24T22:04:27.500988+0000","last_fullsized":"2024-07-24T22:04:27.500988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:11:23.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500948+0000","last_change":"2024-07-24T22:03:53.407386+0000","last_active":"2024-07-24T22:04:27.500948+0000","last_peered":"2024-07-24T22:04:27.500948+0000","last_clean":"2024-07-24T22:04:27.500948+0000","last_became_active":"2024-07-24T22:03:53.407059+0000","last_became_peered":"2024-07-24T22:03:53.407059+0000","last_unstale":"2024-07-24T22:04:27.500948+0000","last_undegraded":"2024-07-24T22:04:27.500948+0000","last_fullsized":"2024-07-24T22:04:27.500948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:12:38.508170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.568167+0000","last_change":"2024-07-24T22:04:27.567714+0000","last_active":"2024-07-24T22:04:27.568167+0000","last_peered":"2024-07-24T22:04:27.568167+0000","last_clean":"2024-07-24T22:04:27.568167+0000","last_became_active":"2024-07-24T22:04:27.567492+0000","last_became_peered":"2024-07-24T22:04:27.567492+0000","last_unstale":"2024-07-24T22:04:27.568167+0000","last_undegraded":"2024-07-24T22:04:27.568167+0000","last_fullsized":"2024-07-24T22:04:27.568167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:00:13.705346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.502127+0000","last_change":"2024-07-24T22:03:50.385538+0000","last_active":"2024-07-24T22:04:27.502127+0000","last_peered":"2024-07-24T22:04:27.502127+0000","last_clean":"2024-07-24T22:04:27.502127+0000","last_became_active":"2024-07-24T22:03:50.385191+0000","last_became_peered":"2024-07-24T22:03:50.385191+0000","last_unstale":"2024-07-24T22:04:27.502127+0000","last_undegraded":"2024-07-24T22:04:27.502127+0000","last_fullsized":"2024-07-24T22:04:27.502127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:33:37.674903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.566043+0000","last_change":"2024-07-24T22:03:53.411751+0000","last_active":"2024-07-24T22:04:27.566043+0000","last_peered":"2024-07-24T22:04:27.566043+0000","last_clean":"2024-07-24T22:04:27.566043+0000","last_became_active":"2024-07-24T22:03:53.410827+0000","last_became_peered":"2024-07-24T22:03:53.410827+0000","last_unstale":"2024-07-24T22:04:27.566043+0000","last_undegraded":"2024-07-24T22:04:27.566043+0000","last_fullsized":"2024-07-24T22:04:27.566043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:07:26.439047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.576697+0000","last_change":"2024-07-24T22:04:27.576631+0000","last_active":"2024-07-24T22:04:27.576697+0000","last_peered":"2024-07-24T22:04:27.576697+0000","last_clean":"2024-07-24T22:04:27.576697+0000","last_became_active":"2024-07-24T22:04:27.568320+0000","last_became_peered":"2024-07-24T22:04:27.568320+0000","last_unstale":"2024-07-24T22:04:27.576697+0000","last_undegraded":"2024-07-24T22:04:27.576697+0000","last_fullsized":"2024-07-24T22:04:27.576697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:36:15.767170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.500788+0000","last_change":"2024-07-24T22:03:53.406029+0000","last_active":"2024-07-24T22:04:27.500788+0000","last_peered":"2024-07-24T22:04:27.500788+0000","last_clean":"2024-07-24T22:04:27.500788+0000","last_became_active":"2024-07-24T22:03:53.405529+0000","last_became_peered":"2024-07-24T22:03:53.405529+0000","last_unstale":"2024-07-24T22:04:27.500788+0000","last_undegraded":"2024-07-24T22:04:27.500788+0000","last_fullsized":"2024-07-24T22:04:27.500788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:57:02.290836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498886+0000","last_change":"2024-07-24T22:03:50.510884+0000","last_active":"2024-07-24T22:04:27.498886+0000","last_peered":"2024-07-24T22:04:27.498886+0000","last_clean":"2024-07-24T22:04:27.498886+0000","last_became_active":"2024-07-24T22:03:50.509851+0000","last_became_peered":"2024-07-24T22:03:50.509851+0000","last_unstale":"2024-07-24T22:04:27.498886+0000","last_undegraded":"2024-07-24T22:04:27.498886+0000","last_fullsized":"2024-07-24T22:04:27.498886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:37:55.735488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.498633+0000","last_change":"2024-07-24T22:03:53.409966+0000","last_active":"2024-07-24T22:04:27.498633+0000","last_peered":"2024-07-24T22:04:27.498633+0000","last_clean":"2024-07-24T22:04:27.498633+0000","last_became_active":"2024-07-24T22:03:53.409652+0000","last_became_peered":"2024-07-24T22:03:53.409652+0000","last_unstale":"2024-07-24T22:04:27.498633+0000","last_undegraded":"2024-07-24T22:04:27.498633+0000","last_fullsized":"2024-07-24T22:04:27.498633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:10:53.262459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-07-24T22:04:27.571203+0000","last_change":"2024-07-24T22:04:27.571166+0000","last_active":"2024-07-24T22:04:27.571203+0000","last_peered":"2024-07-24T22:04:27.571203+0000","last_clean":"2024-07-24T22:04:27.571203+0000","last_became_active":"2024-07-24T22:04:27.567419+0000","last_became_peered":"2024-07-24T22:04:27.567419+0000","last_unstale":"2024-07-24T22:04:27.571203+0000","last_undegraded":"2024-07-24T22:04:27.571203+0000","last_fullsized":"2024-07-24T22:04:27.571203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:37:11.513631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63133,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":62,"num_read_kb":94,"num_write":83,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":184004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612631,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":905216,"data_stored":452126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808857,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1589248,"data_stored":1105140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972384,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40396,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704756,"statfs":{"total":95995035648,"available":95953670144,"internally_reserved":0,"allocated":913408,"data_stored":452825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168613,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":452148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397544,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1507328,"data_stored":1043193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561069,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40392,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704760,"statfs":{"total":95995035648,"available":95953674240,"internally_reserved":0,"allocated":909312,"data_stored":452243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757297,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1515520,"data_stored":1042793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920821,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":452148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117050,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40400,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704752,"statfs":{"total":95995035648,"available":95953666048,"internally_reserved":0,"allocated":917504,"data_stored":452347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378687,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":514495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":509648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705734,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":452216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":57522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":62529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T22:04:35.397 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-07-24T22:04:35.398 INFO:tasks.cephadm:Setting up client nodes... 2024-07-24T22:04:35.399 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-07-24T22:04:35.668 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:35.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:35 smithi047 ceph-mon[32551]: pgmap v285: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.1 KiB/s wr, 4 op/s; 87 B/s, 0 objects/s recovering 2024-07-24T22:04:35.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:35 smithi188 ceph-mon[37380]: pgmap v285: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.1 KiB/s wr, 4 op/s; 87 B/s, 0 objects/s recovering 2024-07-24T22:04:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:35 smithi183 ceph-mon[37007]: pgmap v285: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.1 KiB/s wr, 4 op/s; 87 B/s, 0 objects/s recovering 2024-07-24T22:04:36.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:36 smithi047 ceph-mon[32551]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:04:36.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:36 smithi188 ceph-mon[37380]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:04:36.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:36 smithi183 ceph-mon[37007]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:04:37.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.266+0000 7f77b7eb5640 1 -- 172.21.15.47:0/391527542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b0102750 msgr2=0x7f77b0102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:37.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.266+0000 7f77b7eb5640 1 --2- 172.21.15.47:0/391527542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b0102750 0x7f77b0102b30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009900 tx=0x7f77a802a410 comp rx=0 tx=0).stop 2024-07-24T22:04:37.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.266+0000 7f77b7eb5640 1 -- 172.21.15.47:0/391527542 shutdown_connections 2024-07-24T22:04:37.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.266+0000 7f77b7eb5640 1 --2- 172.21.15.47:0/391527542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77b0108ae0 0x7f77b010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:37.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.266+0000 7f77b7eb5640 1 --2- 172.21.15.47:0/391527542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77b0108160 0x7f77b01085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:37.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.266+0000 7f77b7eb5640 1 --2- 172.21.15.47:0/391527542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b0102750 0x7f77b0102b30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:37.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.266+0000 7f77b7eb5640 1 -- 172.21.15.47:0/391527542 >> 172.21.15.47:0/391527542 conn(0x7f77b00fe200 msgr2=0x7f77b0100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.266+0000 7f77b7eb5640 1 -- 172.21.15.47:0/391527542 shutdown_connections 2024-07-24T22:04:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.266+0000 7f77b7eb5640 1 -- 172.21.15.47:0/391527542 wait complete. 2024-07-24T22:04:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.266+0000 7f77b7eb5640 1 Processor -- start 2024-07-24T22:04:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b7eb5640 1 -- start start 2024-07-24T22:04:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b7eb5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b0102750 0x7f77b0074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b7eb5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77b0108160 0x7f77b00753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b7eb5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77b0108ae0 0x7f77b0075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b7eb5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77b0112710 con 0x7f77b0102750 2024-07-24T22:04:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b7eb5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f77b0112590 con 0x7f77b0108ae0 2024-07-24T22:04:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b7eb5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f77b0112890 con 0x7f77b0108160 2024-07-24T22:04:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b5c51640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b0102750 0x7f77b0074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b5c51640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b0102750 0x7f77b0074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51048/0 (socket says 172.21.15.47:51048) 2024-07-24T22:04:37.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b5c51640 1 -- 172.21.15.47:0/3791455584 learned_addr learned my addr 172.21.15.47:0/3791455584 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:37.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b5450640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77b0108160 0x7f77b00753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:37.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b6452640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77b0108ae0 0x7f77b0075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:37.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b5c51640 1 -- 172.21.15.47:0/3791455584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77b0108160 msgr2=0x7f77b00753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:37.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b5c51640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77b0108160 0x7f77b00753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:37.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b5c51640 1 -- 172.21.15.47:0/3791455584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77b0108ae0 msgr2=0x7f77b0075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:37.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b5c51640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77b0108ae0 0x7f77b0075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:37.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b5c51640 1 -- 172.21.15.47:0/3791455584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b01a6fc0 con 0x7f77b0102750 2024-07-24T22:04:37.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.267+0000 7f77b5c51640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b0102750 0x7f77b0074e90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f77a8005940 tx=0x7f77a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:37.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.268+0000 7f77aeffd640 1 -- 172.21.15.47:0/3791455584 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a803f030 con 0x7f77b0102750 2024-07-24T22:04:37.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.268+0000 7f77aeffd640 1 -- 172.21.15.47:0/3791455584 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77a8003cb0 con 0x7f77b0102750 2024-07-24T22:04:37.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.268+0000 7f77b7eb5640 1 -- 172.21.15.47:0/3791455584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b01a7250 con 0x7f77b0102750 2024-07-24T22:04:37.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.268+0000 7f77aeffd640 1 -- 172.21.15.47:0/3791455584 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a8035070 con 0x7f77b0102750 2024-07-24T22:04:37.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.268+0000 7f77b7eb5640 1 -- 172.21.15.47:0/3791455584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b01a7780 con 0x7f77b0102750 2024-07-24T22:04:37.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.269+0000 7f77b7eb5640 1 -- 172.21.15.47:0/3791455584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b0102b30 con 0x7f77b0102750 2024-07-24T22:04:37.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.271+0000 7f77aeffd640 1 -- 172.21.15.47:0/3791455584 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f77a8042030 con 0x7f77b0102750 2024-07-24T22:04:37.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.271+0000 7f77aeffd640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77980b3d30 0x7f77980b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:37.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.272+0000 7f77b5450640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77980b3d30 0x7f77980b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:37.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.272+0000 7f77aeffd640 1 -- 172.21.15.47:0/3791455584 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f77a8104a70 con 0x7f77b0102750 2024-07-24T22:04:37.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.272+0000 7f77b5450640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77980b3d30 0x7f77980b61f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f77a4005e10 tx=0x7f77a4005da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:37.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.274+0000 7f77aeffd640 1 -- 172.21.15.47:0/3791455584 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f77a80cbe60 con 0x7f77b0102750 2024-07-24T22:04:37.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.544+0000 7f77b7eb5640 1 -- 172.21.15.47:0/3791455584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f77b0076190 con 0x7f77b0102750 2024-07-24T22:04:37.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.546+0000 7f77aeffd640 1 -- 172.21.15.47:0/3791455584 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f77a80cb760 con 0x7f77b0102750 2024-07-24T22:04:37.549 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-07-24T22:04:37.550 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB1eqFmD6maIBAA+9RijRRP9cQUIY4jY0pe7g== 2024-07-24T22:04:37.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.549+0000 7f77b7eb5640 1 -- 172.21.15.47:0/3791455584 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77980b3d30 msgr2=0x7f77980b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:37.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.549+0000 7f77b7eb5640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77980b3d30 0x7f77980b61f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f77a4005e10 tx=0x7f77a4005da0 comp rx=0 tx=0).stop 2024-07-24T22:04:37.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.549+0000 7f77b7eb5640 1 -- 172.21.15.47:0/3791455584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b0102750 msgr2=0x7f77b0074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:37.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.549+0000 7f77b7eb5640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b0102750 0x7f77b0074e90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f77a8005940 tx=0x7f77a80042f0 comp rx=0 tx=0).stop 2024-07-24T22:04:37.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.549+0000 7f77b7eb5640 1 -- 172.21.15.47:0/3791455584 shutdown_connections 2024-07-24T22:04:37.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.549+0000 7f77b7eb5640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77980b3d30 0x7f77980b61f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:37.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.549+0000 7f77b7eb5640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77b0108ae0 0x7f77b0075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:37.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.549+0000 7f77b7eb5640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77b0108160 0x7f77b00753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:37.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.549+0000 7f77b7eb5640 1 --2- 172.21.15.47:0/3791455584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b0102750 0x7f77b0074e90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:37.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.549+0000 7f77b7eb5640 1 -- 172.21.15.47:0/3791455584 >> 172.21.15.47:0/3791455584 conn(0x7f77b00fe200 msgr2=0x7f77b00fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:37.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.549+0000 7f77b7eb5640 1 -- 172.21.15.47:0/3791455584 shutdown_connections 2024-07-24T22:04:37.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:37.549+0000 7f77b7eb5640 1 -- 172.21.15.47:0/3791455584 wait complete. 2024-07-24T22:04:37.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:37 smithi188 ceph-mon[37380]: pgmap v286: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 961 B/s wr, 2 op/s; 72 B/s, 0 objects/s recovering 2024-07-24T22:04:37.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:37 smithi047 ceph-mon[32551]: pgmap v286: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 961 B/s wr, 2 op/s; 72 B/s, 0 objects/s recovering 2024-07-24T22:04:37.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:37 smithi183 ceph-mon[37007]: pgmap v286: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 961 B/s wr, 2 op/s; 72 B/s, 0 objects/s recovering 2024-07-24T22:04:38.312 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T22:04:38.312 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-07-24T22:04:38.312 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-07-24T22:04:38.355 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph config log 1 --format=json 2024-07-24T22:04:38.525 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:38 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3791455584' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-07-24T22:04:38.526 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:38 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3791455584' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-07-24T22:04:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:38.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:38 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3791455584' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-07-24T22:04:38.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:38 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3791455584' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-07-24T22:04:38.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:38 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3791455584' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-07-24T22:04:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:38 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3791455584' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-07-24T22:04:39.876 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:39 smithi047 ceph-mon[32551]: pgmap v287: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 870 B/s wr, 3 op/s; 66 B/s, 0 objects/s recovering 2024-07-24T22:04:39.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:39 smithi183 ceph-mon[37007]: pgmap v287: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 870 B/s wr, 3 op/s; 66 B/s, 0 objects/s recovering 2024-07-24T22:04:40.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:39 smithi188 ceph-mon[37380]: pgmap v287: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 870 B/s wr, 3 op/s; 66 B/s, 0 objects/s recovering 2024-07-24T22:04:40.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.395+0000 7fc88ca5a640 1 -- 172.21.15.47:0/544050657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc888103f30 msgr2=0x7fc88810c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:40.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.395+0000 7fc88ca5a640 1 --2- 172.21.15.47:0/544050657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc888103f30 0x7fc88810c510 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009900 tx=0x7fc87c02a410 comp rx=0 tx=0).stop 2024-07-24T22:04:40.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.396+0000 7fc88ca5a640 1 -- 172.21.15.47:0/544050657 shutdown_connections 2024-07-24T22:04:40.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.396+0000 7fc88ca5a640 1 --2- 172.21.15.47:0/544050657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc88810cae0 0x7fc88810ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:40.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.396+0000 7fc88ca5a640 1 --2- 172.21.15.47:0/544050657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc888103f30 0x7fc88810c510 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:40.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.396+0000 7fc88ca5a640 1 --2- 172.21.15.47:0/544050657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc888103530 0x7fc888103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:40.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.396+0000 7fc88ca5a640 1 -- 172.21.15.47:0/544050657 >> 172.21.15.47:0/544050657 conn(0x7fc8880fd0c0 msgr2=0x7fc8880ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:40.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.396+0000 7fc88ca5a640 1 -- 172.21.15.47:0/544050657 shutdown_connections 2024-07-24T22:04:40.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.396+0000 7fc88ca5a640 1 -- 172.21.15.47:0/544050657 wait complete. 2024-07-24T22:04:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.396+0000 7fc88ca5a640 1 Processor -- start 2024-07-24T22:04:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.396+0000 7fc88ca5a640 1 -- start start 2024-07-24T22:04:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88ca5a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc888103530 0x7fc8881013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88ca5a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc888103f30 0x7fc8881018f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88ca5a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc88810cae0 0x7fc888101e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88ca5a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc888112830 con 0x7fc888103530 2024-07-24T22:04:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88ca5a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc8881126b0 con 0x7fc888103f30 2024-07-24T22:04:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88ca5a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc8881129b0 con 0x7fc88810cae0 2024-07-24T22:04:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc888103530 0x7fc8881013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc888103530 0x7fc8881013b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51070/0 (socket says 172.21.15.47:51070) 2024-07-24T22:04:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88659c640 1 -- 172.21.15.47:0/2517831410 learned_addr learned my addr 172.21.15.47:0/2517831410 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc886d9d640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc88810cae0 0x7fc888101e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc885d9b640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc888103f30 0x7fc8881018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88659c640 1 -- 172.21.15.47:0/2517831410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc88810cae0 msgr2=0x7fc888101e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88659c640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc88810cae0 0x7fc888101e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88659c640 1 -- 172.21.15.47:0/2517831410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc888103f30 msgr2=0x7fc8881018f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88659c640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc888103f30 0x7fc8881018f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88659c640 1 -- 172.21.15.47:0/2517831410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8881a7220 con 0x7fc888103530 2024-07-24T22:04:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc885d9b640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc888103f30 0x7fc8881018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:04:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88659c640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc888103530 0x7fc8881013b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc87800b4a0 tx=0x7fc87800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc8777fe640 1 -- 172.21.15.47:0/2517831410 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878014070 con 0x7fc888103530 2024-07-24T22:04:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc8777fe640 1 -- 172.21.15.47:0/2517831410 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc878010ac0 con 0x7fc888103530 2024-07-24T22:04:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.397+0000 7fc88ca5a640 1 -- 172.21.15.47:0/2517831410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8881a7510 con 0x7fc888103530 2024-07-24T22:04:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.398+0000 7fc8777fe640 1 -- 172.21.15.47:0/2517831410 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878017c30 con 0x7fc888103530 2024-07-24T22:04:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.398+0000 7fc88ca5a640 1 -- 172.21.15.47:0/2517831410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8881a7a50 con 0x7fc888103530 2024-07-24T22:04:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.398+0000 7fc88ca5a640 1 -- 172.21.15.47:0/2517831410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc888103990 con 0x7fc888103530 2024-07-24T22:04:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.400+0000 7fc8777fe640 1 -- 172.21.15.47:0/2517831410 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fc878017070 con 0x7fc888103530 2024-07-24T22:04:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.401+0000 7fc8777fe640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8700b3d30 0x7fc8700b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.401+0000 7fc885d9b640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8700b3d30 0x7fc8700b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.401+0000 7fc8777fe640 1 -- 172.21.15.47:0/2517831410 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7fc8780e3650 con 0x7fc888103530 2024-07-24T22:04:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.401+0000 7fc885d9b640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8700b3d30 0x7fc8700b61f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc87c005ab0 tx=0x7fc87c000bc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.404+0000 7fc8777fe640 1 -- 172.21.15.47:0/2517831410 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fc8780aaaf0 con 0x7fc888103530 2024-07-24T22:04:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.600+0000 7fc88ca5a640 1 -- 172.21.15.47:0/2517831410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fc888107bb0 con 0x7fc888103530 2024-07-24T22:04:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.601+0000 7fc8777fe640 1 -- 172.21.15.47:0/2517831410 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v53) ==== 86+0+133 (secure 0 0 0) 0x7fc8780aa3f0 con 0x7fc888103530 2024-07-24T22:04:40.603 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:04:40.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.603+0000 7fc88ca5a640 1 -- 172.21.15.47:0/2517831410 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8700b3d30 msgr2=0x7fc8700b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:40.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.603+0000 7fc88ca5a640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8700b3d30 0x7fc8700b61f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc87c005ab0 tx=0x7fc87c000bc0 comp rx=0 tx=0).stop 2024-07-24T22:04:40.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.603+0000 7fc88ca5a640 1 -- 172.21.15.47:0/2517831410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc888103530 msgr2=0x7fc8881013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:40.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.603+0000 7fc88ca5a640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc888103530 0x7fc8881013b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc87800b4a0 tx=0x7fc87800b960 comp rx=0 tx=0).stop 2024-07-24T22:04:40.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.603+0000 7fc88ca5a640 1 -- 172.21.15.47:0/2517831410 shutdown_connections 2024-07-24T22:04:40.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.603+0000 7fc88ca5a640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8700b3d30 0x7fc8700b61f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:40.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.603+0000 7fc88ca5a640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc88810cae0 0x7fc888101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:40.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.603+0000 7fc88ca5a640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc888103f30 0x7fc8881018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:40.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.603+0000 7fc88ca5a640 1 --2- 172.21.15.47:0/2517831410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc888103530 0x7fc8881013b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:40.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.603+0000 7fc88ca5a640 1 -- 172.21.15.47:0/2517831410 >> 172.21.15.47:0/2517831410 conn(0x7fc8880fd0c0 msgr2=0x7fc8880fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:40.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.603+0000 7fc88ca5a640 1 -- 172.21.15.47:0/2517831410 shutdown_connections 2024-07-24T22:04:40.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:40.603+0000 7fc88ca5a640 1 -- 172.21.15.47:0/2517831410 wait complete. 2024-07-24T22:04:41.284 INFO:teuthology.orchestra.run.smithi047.stdout:[{"version":53,"timestamp":"2024-07-24T22:03:40.293646+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-07-24T22:04:41.285 INFO:tasks.ceph_manager:config epoch is 53 2024-07-24T22:04:41.285 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-07-24T22:04:41.285 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-07-24T22:04:41.285 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph mgr dump --format=json 2024-07-24T22:04:41.562 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:41.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:41 smithi047 ceph-mon[32551]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 767 B/s wr, 2 op/s; 58 B/s, 0 objects/s recovering 2024-07-24T22:04:41.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:41 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2517831410' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-07-24T22:04:41.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:41 smithi183 ceph-mon[37007]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 767 B/s wr, 2 op/s; 58 B/s, 0 objects/s recovering 2024-07-24T22:04:41.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:41 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2517831410' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-07-24T22:04:42.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:41 smithi188 ceph-mon[37380]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 767 B/s wr, 2 op/s; 58 B/s, 0 objects/s recovering 2024-07-24T22:04:42.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:41 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2517831410' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-07-24T22:04:43.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.175+0000 7f5c23103640 1 -- 172.21.15.47:0/2768020488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c102790 msgr2=0x7f5c1c102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:43.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.175+0000 7f5c23103640 1 --2- 172.21.15.47:0/2768020488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c102790 0x7f5c1c102b70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009900 tx=0x7f5c1402a410 comp rx=0 tx=0).stop 2024-07-24T22:04:43.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.175+0000 7f5c23103640 1 -- 172.21.15.47:0/2768020488 shutdown_connections 2024-07-24T22:04:43.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.175+0000 7f5c23103640 1 --2- 172.21.15.47:0/2768020488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c1c108b20 0x7f5c1c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:43.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.175+0000 7f5c23103640 1 --2- 172.21.15.47:0/2768020488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c1c1081a0 0x7f5c1c1085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:43.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.175+0000 7f5c23103640 1 --2- 172.21.15.47:0/2768020488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c102790 0x7f5c1c102b70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:43.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.175+0000 7f5c23103640 1 -- 172.21.15.47:0/2768020488 >> 172.21.15.47:0/2768020488 conn(0x7f5c1c0fe200 msgr2=0x7f5c1c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:43.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.175+0000 7f5c23103640 1 -- 172.21.15.47:0/2768020488 shutdown_connections 2024-07-24T22:04:43.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.175+0000 7f5c23103640 1 -- 172.21.15.47:0/2768020488 wait complete. 2024-07-24T22:04:43.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.175+0000 7f5c23103640 1 Processor -- start 2024-07-24T22:04:43.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c23103640 1 -- start start 2024-07-24T22:04:43.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c23103640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c1c102790 0x7f5c1c074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:43.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c23103640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c1c1081a0 0x7f5c1c0753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:43.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c23103640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c108b20 0x7f5c1c075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:43.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c23103640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c1127a0 con 0x7f5c1c108b20 2024-07-24T22:04:43.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c23103640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c112620 con 0x7f5c1c102790 2024-07-24T22:04:43.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c23103640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c112920 con 0x7f5c1c1081a0 2024-07-24T22:04:43.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c216a0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c108b20 0x7f5c1c075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:43.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c216a0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c108b20 0x7f5c1c075910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51098/0 (socket says 172.21.15.47:51098) 2024-07-24T22:04:43.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c216a0640 1 -- 172.21.15.47:0/2933536888 learned_addr learned my addr 172.21.15.47:0/2933536888 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:43.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c0bfff640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c1c1081a0 0x7f5c1c0753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:43.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c20e9f640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c1c102790 0x7f5c1c074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:43.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c216a0640 1 -- 172.21.15.47:0/2933536888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c1c1081a0 msgr2=0x7f5c1c0753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:43.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c216a0640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c1c1081a0 0x7f5c1c0753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:43.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c216a0640 1 -- 172.21.15.47:0/2933536888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c1c102790 msgr2=0x7f5c1c074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:43.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c216a0640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c1c102790 0x7f5c1c074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:43.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.176+0000 7f5c216a0640 1 -- 172.21.15.47:0/2933536888 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c1a7070 con 0x7f5c1c108b20 2024-07-24T22:04:43.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.177+0000 7f5c216a0640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c108b20 0x7f5c1c075910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00b970 tx=0x7f5c0c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:43.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.177+0000 7f5c1a7fc640 1 -- 172.21.15.47:0/2933536888 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c019070 con 0x7f5c1c108b20 2024-07-24T22:04:43.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.177+0000 7f5c1a7fc640 1 -- 172.21.15.47:0/2933536888 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c0c014440 con 0x7f5c1c108b20 2024-07-24T22:04:43.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.177+0000 7f5c1a7fc640 1 -- 172.21.15.47:0/2933536888 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c0075d0 con 0x7f5c1c108b20 2024-07-24T22:04:43.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.177+0000 7f5c23103640 1 -- 172.21.15.47:0/2933536888 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1c1a7360 con 0x7f5c1c108b20 2024-07-24T22:04:43.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.177+0000 7f5c23103640 1 -- 172.21.15.47:0/2933536888 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c1c1a78d0 con 0x7f5c1c108b20 2024-07-24T22:04:43.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.178+0000 7f5c23103640 1 -- 172.21.15.47:0/2933536888 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1c102b70 con 0x7f5c1c108b20 2024-07-24T22:04:43.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.179+0000 7f5c1a7fc640 1 -- 172.21.15.47:0/2933536888 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f5c0c01c070 con 0x7f5c1c108b20 2024-07-24T22:04:43.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.180+0000 7f5c1a7fc640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5c040b3cb0 0x7f5c040b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:43.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.180+0000 7f5c20e9f640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5c040b3cb0 0x7f5c040b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:43.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.180+0000 7f5c1a7fc640 1 -- 172.21.15.47:0/2933536888 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f5c0c0e3800 con 0x7f5c1c108b20 2024-07-24T22:04:43.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.181+0000 7f5c20e9f640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5c040b3cb0 0x7f5c040b6170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5c14031440 tx=0x7f5c14005e80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:43.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.183+0000 7f5c1a7fc640 1 -- 172.21.15.47:0/2933536888 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f5c0c0aa650 con 0x7f5c1c108b20 2024-07-24T22:04:43.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.429+0000 7f5c23103640 1 -- 172.21.15.47:0/2933536888 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5c1c076190 con 0x7f5c1c108b20 2024-07-24T22:04:43.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.434+0000 7f5c1a7fc640 1 -- 172.21.15.47:0/2933536888 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+291036 (secure 0 0 0) 0x7f5c0c0aeba0 con 0x7f5c1c108b20 2024-07-24T22:04:43.439 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:04:43.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.437+0000 7f5c23103640 1 -- 172.21.15.47:0/2933536888 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5c040b3cb0 msgr2=0x7f5c040b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:43.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.437+0000 7f5c23103640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5c040b3cb0 0x7f5c040b6170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5c14031440 tx=0x7f5c14005e80 comp rx=0 tx=0).stop 2024-07-24T22:04:43.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.437+0000 7f5c23103640 1 -- 172.21.15.47:0/2933536888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c108b20 msgr2=0x7f5c1c075910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:43.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.437+0000 7f5c23103640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c108b20 0x7f5c1c075910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00b970 tx=0x7f5c0c00bd70 comp rx=0 tx=0).stop 2024-07-24T22:04:43.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.437+0000 7f5c23103640 1 -- 172.21.15.47:0/2933536888 shutdown_connections 2024-07-24T22:04:43.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.437+0000 7f5c23103640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5c040b3cb0 0x7f5c040b6170 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:43.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.437+0000 7f5c23103640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c108b20 0x7f5c1c075910 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:43.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.437+0000 7f5c23103640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c1c1081a0 0x7f5c1c0753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:43.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.437+0000 7f5c23103640 1 --2- 172.21.15.47:0/2933536888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c1c102790 0x7f5c1c074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:43.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.437+0000 7f5c23103640 1 -- 172.21.15.47:0/2933536888 >> 172.21.15.47:0/2933536888 conn(0x7f5c1c0fe200 msgr2=0x7f5c1c1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:43.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.437+0000 7f5c23103640 1 -- 172.21.15.47:0/2933536888 shutdown_connections 2024-07-24T22:04:43.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:43.437+0000 7f5c23103640 1 -- 172.21.15.47:0/2933536888 wait complete. 2024-07-24T22:04:43.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:43 smithi047 ceph-mon[32551]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-07-24T22:04:43.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:43 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2933536888' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-07-24T22:04:43.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:43 smithi183 ceph-mon[37007]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-07-24T22:04:43.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:43 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2933536888' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-07-24T22:04:44.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:43 smithi188 ceph-mon[37380]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-07-24T22:04:44.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:43 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2933536888' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-07-24T22:04:44.177 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":21,"flags":0,"active_gid":14214,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4198530936},{"type":"v1","addr":"172.21.15.47:6801","nonce":4198530936}]},"active_addr":"172.21.15.47:6801/4198530936","active_change":"2024-07-24T21:57:25.995614+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24139,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24146,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.47:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3923541960}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3530546501}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3079641273}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":1687428340}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":1157113575}]}]} 2024-07-24T22:04:44.184 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-07-24T22:04:44.184 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-07-24T22:04:44.184 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd dump --format=json 2024-07-24T22:04:44.453 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:45.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:45 smithi047 ceph-mon[32551]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:04:45.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:45 smithi183 ceph-mon[37007]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:04:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.022+0000 7f256dc41640 1 -- 172.21.15.47:0/3438041079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25681036a0 msgr2=0x7f2568103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.022+0000 7f256dc41640 1 --2- 172.21.15.47:0/3438041079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25681036a0 0x7f2568103a80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2558009ca0 tx=0x7f255802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:04:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.022+0000 7f256dc41640 1 -- 172.21.15.47:0/3438041079 shutdown_connections 2024-07-24T22:04:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.022+0000 7f256dc41640 1 --2- 172.21.15.47:0/3438041079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f256810cb00 0x7f256810ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.022+0000 7f256dc41640 1 --2- 172.21.15.47:0/3438041079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2568103fc0 0x7f256810c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.022+0000 7f256dc41640 1 --2- 172.21.15.47:0/3438041079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25681036a0 0x7f2568103a80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.022+0000 7f256dc41640 1 -- 172.21.15.47:0/3438041079 >> 172.21.15.47:0/3438041079 conn(0x7f25680fd100 msgr2=0x7f25680ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.022+0000 7f256dc41640 1 -- 172.21.15.47:0/3438041079 shutdown_connections 2024-07-24T22:04:46.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.022+0000 7f256dc41640 1 -- 172.21.15.47:0/3438041079 wait complete. 2024-07-24T22:04:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.023+0000 7f256dc41640 1 Processor -- start 2024-07-24T22:04:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.023+0000 7f256dc41640 1 -- start start 2024-07-24T22:04:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.023+0000 7f256dc41640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25681036a0 0x7f2568198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.023+0000 7f256dc41640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2568103fc0 0x7f2568199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.023+0000 7f256dc41640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f256810cb00 0x7f256819e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:46.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.023+0000 7f256dc41640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2568112740 con 0x7f25681036a0 2024-07-24T22:04:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.023+0000 7f256dc41640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f25681125c0 con 0x7f256810cb00 2024-07-24T22:04:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.023+0000 7f256dc41640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f25681128c0 con 0x7f2568103fc0 2024-07-24T22:04:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.023+0000 7f25677fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25681036a0 0x7f2568198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.023+0000 7f25677fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25681036a0 0x7f2568198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39094/0 (socket says 172.21.15.47:39094) 2024-07-24T22:04:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.023+0000 7f25677fe640 1 -- 172.21.15.47:0/274597737 learned_addr learned my addr 172.21.15.47:0/274597737 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.023+0000 7f2567fff640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f256810cb00 0x7f256819e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.023+0000 7f2566ffd640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2568103fc0 0x7f2568199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.024+0000 7f25677fe640 1 -- 172.21.15.47:0/274597737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2568103fc0 msgr2=0x7f2568199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:46.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.024+0000 7f25677fe640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2568103fc0 0x7f2568199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.024+0000 7f25677fe640 1 -- 172.21.15.47:0/274597737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f256810cb00 msgr2=0x7f256819e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.024+0000 7f25677fe640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f256810cb00 0x7f256819e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.024+0000 7f25677fe640 1 -- 172.21.15.47:0/274597737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256819ed00 con 0x7f25681036a0 2024-07-24T22:04:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.024+0000 7f25677fe640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25681036a0 0x7f2568198c50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2558006010 tx=0x7f25580319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.024+0000 7f2564ff9640 1 -- 172.21.15.47:0/274597737 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558003bf0 con 0x7f25681036a0 2024-07-24T22:04:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.024+0000 7f2564ff9640 1 -- 172.21.15.47:0/274597737 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2558003d90 con 0x7f25681036a0 2024-07-24T22:04:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.024+0000 7f256dc41640 1 -- 172.21.15.47:0/274597737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256819ef90 con 0x7f25681036a0 2024-07-24T22:04:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.024+0000 7f2564ff9640 1 -- 172.21.15.47:0/274597737 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255802fc20 con 0x7f25681036a0 2024-07-24T22:04:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.024+0000 7f256dc41640 1 -- 172.21.15.47:0/274597737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25681a56b0 con 0x7f25681036a0 2024-07-24T22:04:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.025+0000 7f256dc41640 1 -- 172.21.15.47:0/274597737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2568103a80 con 0x7f25681036a0 2024-07-24T22:04:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.027+0000 7f2564ff9640 1 -- 172.21.15.47:0/274597737 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f25580046a0 con 0x7f25681036a0 2024-07-24T22:04:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.027+0000 7f2564ff9640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f25500b3cb0 0x7f25500b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.027+0000 7f2566ffd640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f25500b3cb0 0x7f25500b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:46.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.027+0000 7f2564ff9640 1 -- 172.21.15.47:0/274597737 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f2558105490 con 0x7f25681036a0 2024-07-24T22:04:46.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.028+0000 7f2566ffd640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f25500b3cb0 0x7f25500b6170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f255c0058c0 tx=0x7f255c005850 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:46.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.030+0000 7f2564ff9640 1 -- 172.21.15.47:0/274597737 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f25580cc990 con 0x7f25681036a0 2024-07-24T22:04:46.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:45 smithi188 ceph-mon[37380]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:04:46.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.228+0000 7f256dc41640 1 -- 172.21.15.47:0/274597737 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2568107b70 con 0x7f25681036a0 2024-07-24T22:04:46.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.229+0000 7f2564ff9640 1 -- 172.21.15.47:0/274597737 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+23016 (secure 0 0 0) 0x7f25580cc290 con 0x7f25681036a0 2024-07-24T22:04:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:04:46.231 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":83,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","created":"2024-07-24T21:55:28.945912+0000","modified":"2024-07-24T22:04:27.493014+0000","last_up_change":"2024-07-24T22:02:55.044691+0000","last_in_change":"2024-07-24T22:02:35.671256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T21:59:32.066678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T22:03:49.331120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T22:03:52.034826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60de2c3d-e4b7-4878-bdbb-ce3257e3706c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6803","nonce":2665889913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6805","nonce":2665889913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6809","nonce":2665889913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6807","nonce":2665889913}]},"public_addr":"172.21.15.47:6803/2665889913","cluster_addr":"172.21.15.47:6805/2665889913","heartbeat_back_addr":"172.21.15.47:6809/2665889913","heartbeat_front_addr":"172.21.15.47:6807/2665889913","state":["exists","up"]},{"osd":1,"uuid":"7f086675-3bed-47ca-a93f-fab9580068b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6801","nonce":3486494228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6803","nonce":3486494228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6807","nonce":3486494228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6805","nonce":3486494228}]},"public_addr":"172.21.15.183:6801/3486494228","cluster_addr":"172.21.15.183:6803/3486494228","heartbeat_back_addr":"172.21.15.183:6807/3486494228","heartbeat_front_addr":"172.21.15.183:6805/3486494228","state":["exists","up"]},{"osd":2,"uuid":"040fff27-6fa6-48de-9365-fcced8f89e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6801","nonce":2245903281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6803","nonce":2245903281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6807","nonce":2245903281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6805","nonce":2245903281}]},"public_addr":"172.21.15.188:6801/2245903281","cluster_addr":"172.21.15.188:6803/2245903281","heartbeat_back_addr":"172.21.15.188:6807/2245903281","heartbeat_front_addr":"172.21.15.188:6805/2245903281","state":["exists","up"]},{"osd":3,"uuid":"e129321a-9566-4bea-b982-34f7ddd1ae1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6811","nonce":236749130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6813","nonce":236749130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6817","nonce":236749130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6815","nonce":236749130}]},"public_addr":"172.21.15.47:6811/236749130","cluster_addr":"172.21.15.47:6813/236749130","heartbeat_back_addr":"172.21.15.47:6817/236749130","heartbeat_front_addr":"172.21.15.47:6815/236749130","state":["exists","up"]},{"osd":4,"uuid":"f969fba7-b0ff-4ea6-83bd-38aba32b1be1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6809","nonce":3978122107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6811","nonce":3978122107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6815","nonce":3978122107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6813","nonce":3978122107}]},"public_addr":"172.21.15.183:6809/3978122107","cluster_addr":"172.21.15.183:6811/3978122107","heartbeat_back_addr":"172.21.15.183:6815/3978122107","heartbeat_front_addr":"172.21.15.183:6813/3978122107","state":["exists","up"]},{"osd":5,"uuid":"3799c912-3d9f-4efd-9b36-569c385e4c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6809","nonce":2097128083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6811","nonce":2097128083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6815","nonce":2097128083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6813","nonce":2097128083}]},"public_addr":"172.21.15.188:6809/2097128083","cluster_addr":"172.21.15.188:6811/2097128083","heartbeat_back_addr":"172.21.15.188:6815/2097128083","heartbeat_front_addr":"172.21.15.188:6813/2097128083","state":["exists","up"]},{"osd":6,"uuid":"1a38cf12-619f-4e82-a7a5-21ee2014038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6819","nonce":2288252980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6821","nonce":2288252980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6825","nonce":2288252980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6823","nonce":2288252980}]},"public_addr":"172.21.15.47:6819/2288252980","cluster_addr":"172.21.15.47:6821/2288252980","heartbeat_back_addr":"172.21.15.47:6825/2288252980","heartbeat_front_addr":"172.21.15.47:6823/2288252980","state":["exists","up"]},{"osd":7,"uuid":"6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6817","nonce":465426514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6819","nonce":465426514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6823","nonce":465426514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6821","nonce":465426514}]},"public_addr":"172.21.15.183:6817/465426514","cluster_addr":"172.21.15.183:6819/465426514","heartbeat_back_addr":"172.21.15.183:6823/465426514","heartbeat_front_addr":"172.21.15.183:6821/465426514","state":["exists","up"]},{"osd":8,"uuid":"6dfd7252-61a6-423d-8498-cbcfa41ae1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6817","nonce":2247055658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6819","nonce":2247055658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6823","nonce":2247055658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6821","nonce":2247055658}]},"public_addr":"172.21.15.188:6817/2247055658","cluster_addr":"172.21.15.188:6819/2247055658","heartbeat_back_addr":"172.21.15.188:6823/2247055658","heartbeat_front_addr":"172.21.15.188:6821/2247055658","state":["exists","up"]},{"osd":9,"uuid":"abd93c5e-283e-4873-a241-1056f2894116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6827","nonce":2628721884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6829","nonce":2628721884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6833","nonce":2628721884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6831","nonce":2628721884}]},"public_addr":"172.21.15.47:6827/2628721884","cluster_addr":"172.21.15.47:6829/2628721884","heartbeat_back_addr":"172.21.15.47:6833/2628721884","heartbeat_front_addr":"172.21.15.47:6831/2628721884","state":["exists","up"]},{"osd":10,"uuid":"bc967f8f-ce27-4230-be70-e36927f89fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6825","nonce":3509332199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6827","nonce":3509332199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6831","nonce":3509332199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6829","nonce":3509332199}]},"public_addr":"172.21.15.183:6825/3509332199","cluster_addr":"172.21.15.183:6827/3509332199","heartbeat_back_addr":"172.21.15.183:6831/3509332199","heartbeat_front_addr":"172.21.15.183:6829/3509332199","state":["exists","up"]},{"osd":11,"uuid":"8b379865-3a5c-4a2d-aa74-a4f215027fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6825","nonce":3725107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6827","nonce":3725107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6831","nonce":3725107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6829","nonce":3725107101}]},"public_addr":"172.21.15.188:6825/3725107101","cluster_addr":"172.21.15.188:6827/3725107101","heartbeat_back_addr":"172.21.15.188:6831/3725107101","heartbeat_front_addr":"172.21.15.188:6829/3725107101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:58:44.413660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:06.554842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:28.651418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:50.995466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:13.906535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:36.632662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:59.003224+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:21.701327+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:44.017943+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:06.400895+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:29.625920+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:52.323223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3499235566":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/2112533111":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/2714360830":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/507334607":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6800/2524786594":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/1004458106":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6800/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/1046677443":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/899235864":"2024-07-25T21:56:15.044564+0000","172.21.15.47:6800/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/3057769442":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/2596054312":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6801/2524786594":"2024-07-25T21:57:25.995502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T22:04:46.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.231+0000 7f256dc41640 1 -- 172.21.15.47:0/274597737 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f25500b3cb0 msgr2=0x7f25500b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:46.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.231+0000 7f256dc41640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f25500b3cb0 0x7f25500b6170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f255c0058c0 tx=0x7f255c005850 comp rx=0 tx=0).stop 2024-07-24T22:04:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.232+0000 7f256dc41640 1 -- 172.21.15.47:0/274597737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25681036a0 msgr2=0x7f2568198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.232+0000 7f256dc41640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25681036a0 0x7f2568198c50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2558006010 tx=0x7f25580319f0 comp rx=0 tx=0).stop 2024-07-24T22:04:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.232+0000 7f256dc41640 1 -- 172.21.15.47:0/274597737 shutdown_connections 2024-07-24T22:04:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.232+0000 7f256dc41640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f25500b3cb0 0x7f25500b6170 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.232+0000 7f256dc41640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f256810cb00 0x7f256819e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.232+0000 7f256dc41640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2568103fc0 0x7f2568199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.232+0000 7f256dc41640 1 --2- 172.21.15.47:0/274597737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25681036a0 0x7f2568198c50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.232+0000 7f256dc41640 1 -- 172.21.15.47:0/274597737 >> 172.21.15.47:0/274597737 conn(0x7f25680fd100 msgr2=0x7f25680fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.232+0000 7f256dc41640 1 -- 172.21.15.47:0/274597737 shutdown_connections 2024-07-24T22:04:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:46.232+0000 7f256dc41640 1 -- 172.21.15.47:0/274597737 wait complete. 2024-07-24T22:04:46.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:46 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/274597737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:04:46.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:46 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/274597737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:04:47.000 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-07-24T22:04:47.000 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd dump --format=json 2024-07-24T22:04:47.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:46 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/274597737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:04:47.271 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:47.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:47 smithi047 ceph-mon[32551]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:04:47.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:47 smithi183 ceph-mon[37007]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:04:48.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:47 smithi188 ceph-mon[37380]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:04:48.818 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:48 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:04:48.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:48 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:04:49.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.017+0000 7f358ac4a640 1 -- 172.21.15.47:0/2299758521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3584103660 msgr2=0x7f3584103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:49.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.017+0000 7f358ac4a640 1 --2- 172.21.15.47:0/2299758521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3584103660 0x7f3584103a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3578009900 tx=0x7f357802a410 comp rx=0 tx=0).stop 2024-07-24T22:04:49.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.017+0000 7f358ac4a640 1 -- 172.21.15.47:0/2299758521 shutdown_connections 2024-07-24T22:04:49.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.017+0000 7f358ac4a640 1 --2- 172.21.15.47:0/2299758521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f358410cac0 0x7f358410ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:49.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.017+0000 7f358ac4a640 1 --2- 172.21.15.47:0/2299758521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3584103f80 0x7f358410c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:49.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.017+0000 7f358ac4a640 1 --2- 172.21.15.47:0/2299758521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3584103660 0x7f3584103a40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:49.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.017+0000 7f358ac4a640 1 -- 172.21.15.47:0/2299758521 >> 172.21.15.47:0/2299758521 conn(0x7f35840fd0c0 msgr2=0x7f35840ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:49.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.017+0000 7f358ac4a640 1 -- 172.21.15.47:0/2299758521 shutdown_connections 2024-07-24T22:04:49.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.017+0000 7f358ac4a640 1 -- 172.21.15.47:0/2299758521 wait complete. 2024-07-24T22:04:49.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.018+0000 7f358ac4a640 1 Processor -- start 2024-07-24T22:04:49.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.018+0000 7f358ac4a640 1 -- start start 2024-07-24T22:04:49.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.018+0000 7f358ac4a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3584103660 0x7f3584198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:49.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.018+0000 7f358ac4a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3584103f80 0x7f3584199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:49.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.018+0000 7f358ac4a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f358410cac0 0x7f358419e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:49.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f358ac4a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3584112700 con 0x7f3584103f80 2024-07-24T22:04:49.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f358ac4a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3584112580 con 0x7f3584103660 2024-07-24T22:04:49.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f358ac4a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3584112880 con 0x7f358410cac0 2024-07-24T22:04:49.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f3583fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3584103f80 0x7f3584199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:49.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f3583fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3584103f80 0x7f3584199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39108/0 (socket says 172.21.15.47:39108) 2024-07-24T22:04:49.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f3583fff640 1 -- 172.21.15.47:0/4073557986 learned_addr learned my addr 172.21.15.47:0/4073557986 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:49.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f35889e6640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3584103660 0x7f3584198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:49.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f35891e7640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f358410cac0 0x7f358419e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:49.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f3583fff640 1 -- 172.21.15.47:0/4073557986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f358410cac0 msgr2=0x7f358419e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:49.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f3583fff640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f358410cac0 0x7f358419e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:49.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f3583fff640 1 -- 172.21.15.47:0/4073557986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3584103660 msgr2=0x7f3584198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:49.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f3583fff640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3584103660 0x7f3584198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:49.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f3583fff640 1 -- 172.21.15.47:0/4073557986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358419ed00 con 0x7f3584103f80 2024-07-24T22:04:49.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f3583fff640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3584103f80 0x7f3584199190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f357000d750 tx=0x7f357000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:49.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f3581ffb640 1 -- 172.21.15.47:0/4073557986 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3570017070 con 0x7f3584103f80 2024-07-24T22:04:49.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f358ac4a640 1 -- 172.21.15.47:0/4073557986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f358419eff0 con 0x7f3584103f80 2024-07-24T22:04:49.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f3581ffb640 1 -- 172.21.15.47:0/4073557986 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3570004020 con 0x7f3584103f80 2024-07-24T22:04:49.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.019+0000 7f3581ffb640 1 -- 172.21.15.47:0/4073557986 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3570003c00 con 0x7f3584103f80 2024-07-24T22:04:49.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.020+0000 7f358ac4a640 1 -- 172.21.15.47:0/4073557986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35841a5880 con 0x7f3584103f80 2024-07-24T22:04:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.021+0000 7f358ac4a640 1 -- 172.21.15.47:0/4073557986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f358406ab70 con 0x7f3584103f80 2024-07-24T22:04:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.022+0000 7f3581ffb640 1 -- 172.21.15.47:0/4073557986 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f3570009a30 con 0x7f3584103f80 2024-07-24T22:04:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.023+0000 7f3581ffb640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f35740b3cb0 0x7f35740b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.023+0000 7f35889e6640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f35740b3cb0 0x7f35740b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.023+0000 7f3581ffb640 1 -- 172.21.15.47:0/4073557986 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f35700e37b0 con 0x7f3584103f80 2024-07-24T22:04:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.024+0000 7f35889e6640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f35740b3cb0 0x7f35740b6170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3578031440 tx=0x7f3578005b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:49.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.028+0000 7f3581ffb640 1 -- 172.21.15.47:0/4073557986 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f35700aa4f0 con 0x7f3584103f80 2024-07-24T22:04:49.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:48 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:04:49.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.236+0000 7f358ac4a640 1 -- 172.21.15.47:0/4073557986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35841a5a50 con 0x7f3584103f80 2024-07-24T22:04:49.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.237+0000 7f3581ffb640 1 -- 172.21.15.47:0/4073557986 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+23016 (secure 0 0 0) 0x7f35700aea40 con 0x7f3584103f80 2024-07-24T22:04:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:04:49.240 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":83,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","created":"2024-07-24T21:55:28.945912+0000","modified":"2024-07-24T22:04:27.493014+0000","last_up_change":"2024-07-24T22:02:55.044691+0000","last_in_change":"2024-07-24T22:02:35.671256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T21:59:32.066678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T22:03:49.331120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T22:03:52.034826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60de2c3d-e4b7-4878-bdbb-ce3257e3706c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6803","nonce":2665889913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6805","nonce":2665889913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6809","nonce":2665889913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6807","nonce":2665889913}]},"public_addr":"172.21.15.47:6803/2665889913","cluster_addr":"172.21.15.47:6805/2665889913","heartbeat_back_addr":"172.21.15.47:6809/2665889913","heartbeat_front_addr":"172.21.15.47:6807/2665889913","state":["exists","up"]},{"osd":1,"uuid":"7f086675-3bed-47ca-a93f-fab9580068b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6801","nonce":3486494228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6803","nonce":3486494228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6807","nonce":3486494228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6805","nonce":3486494228}]},"public_addr":"172.21.15.183:6801/3486494228","cluster_addr":"172.21.15.183:6803/3486494228","heartbeat_back_addr":"172.21.15.183:6807/3486494228","heartbeat_front_addr":"172.21.15.183:6805/3486494228","state":["exists","up"]},{"osd":2,"uuid":"040fff27-6fa6-48de-9365-fcced8f89e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6801","nonce":2245903281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6803","nonce":2245903281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6807","nonce":2245903281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6805","nonce":2245903281}]},"public_addr":"172.21.15.188:6801/2245903281","cluster_addr":"172.21.15.188:6803/2245903281","heartbeat_back_addr":"172.21.15.188:6807/2245903281","heartbeat_front_addr":"172.21.15.188:6805/2245903281","state":["exists","up"]},{"osd":3,"uuid":"e129321a-9566-4bea-b982-34f7ddd1ae1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6811","nonce":236749130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6813","nonce":236749130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6817","nonce":236749130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6815","nonce":236749130}]},"public_addr":"172.21.15.47:6811/236749130","cluster_addr":"172.21.15.47:6813/236749130","heartbeat_back_addr":"172.21.15.47:6817/236749130","heartbeat_front_addr":"172.21.15.47:6815/236749130","state":["exists","up"]},{"osd":4,"uuid":"f969fba7-b0ff-4ea6-83bd-38aba32b1be1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6809","nonce":3978122107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6811","nonce":3978122107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6815","nonce":3978122107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6813","nonce":3978122107}]},"public_addr":"172.21.15.183:6809/3978122107","cluster_addr":"172.21.15.183:6811/3978122107","heartbeat_back_addr":"172.21.15.183:6815/3978122107","heartbeat_front_addr":"172.21.15.183:6813/3978122107","state":["exists","up"]},{"osd":5,"uuid":"3799c912-3d9f-4efd-9b36-569c385e4c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6809","nonce":2097128083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6811","nonce":2097128083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6815","nonce":2097128083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6813","nonce":2097128083}]},"public_addr":"172.21.15.188:6809/2097128083","cluster_addr":"172.21.15.188:6811/2097128083","heartbeat_back_addr":"172.21.15.188:6815/2097128083","heartbeat_front_addr":"172.21.15.188:6813/2097128083","state":["exists","up"]},{"osd":6,"uuid":"1a38cf12-619f-4e82-a7a5-21ee2014038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6819","nonce":2288252980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6821","nonce":2288252980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6825","nonce":2288252980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6823","nonce":2288252980}]},"public_addr":"172.21.15.47:6819/2288252980","cluster_addr":"172.21.15.47:6821/2288252980","heartbeat_back_addr":"172.21.15.47:6825/2288252980","heartbeat_front_addr":"172.21.15.47:6823/2288252980","state":["exists","up"]},{"osd":7,"uuid":"6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6817","nonce":465426514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6819","nonce":465426514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6823","nonce":465426514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6821","nonce":465426514}]},"public_addr":"172.21.15.183:6817/465426514","cluster_addr":"172.21.15.183:6819/465426514","heartbeat_back_addr":"172.21.15.183:6823/465426514","heartbeat_front_addr":"172.21.15.183:6821/465426514","state":["exists","up"]},{"osd":8,"uuid":"6dfd7252-61a6-423d-8498-cbcfa41ae1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6817","nonce":2247055658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6819","nonce":2247055658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6823","nonce":2247055658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6821","nonce":2247055658}]},"public_addr":"172.21.15.188:6817/2247055658","cluster_addr":"172.21.15.188:6819/2247055658","heartbeat_back_addr":"172.21.15.188:6823/2247055658","heartbeat_front_addr":"172.21.15.188:6821/2247055658","state":["exists","up"]},{"osd":9,"uuid":"abd93c5e-283e-4873-a241-1056f2894116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6827","nonce":2628721884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6829","nonce":2628721884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6833","nonce":2628721884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6831","nonce":2628721884}]},"public_addr":"172.21.15.47:6827/2628721884","cluster_addr":"172.21.15.47:6829/2628721884","heartbeat_back_addr":"172.21.15.47:6833/2628721884","heartbeat_front_addr":"172.21.15.47:6831/2628721884","state":["exists","up"]},{"osd":10,"uuid":"bc967f8f-ce27-4230-be70-e36927f89fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6825","nonce":3509332199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6827","nonce":3509332199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6831","nonce":3509332199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6829","nonce":3509332199}]},"public_addr":"172.21.15.183:6825/3509332199","cluster_addr":"172.21.15.183:6827/3509332199","heartbeat_back_addr":"172.21.15.183:6831/3509332199","heartbeat_front_addr":"172.21.15.183:6829/3509332199","state":["exists","up"]},{"osd":11,"uuid":"8b379865-3a5c-4a2d-aa74-a4f215027fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6825","nonce":3725107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6827","nonce":3725107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6831","nonce":3725107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6829","nonce":3725107101}]},"public_addr":"172.21.15.188:6825/3725107101","cluster_addr":"172.21.15.188:6827/3725107101","heartbeat_back_addr":"172.21.15.188:6831/3725107101","heartbeat_front_addr":"172.21.15.188:6829/3725107101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:58:44.413660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:06.554842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:28.651418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:50.995466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:13.906535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:36.632662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:59.003224+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:21.701327+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:44.017943+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:06.400895+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:29.625920+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:52.323223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3499235566":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/2112533111":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/2714360830":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/507334607":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6800/2524786594":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/1004458106":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6800/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/1046677443":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/899235864":"2024-07-25T21:56:15.044564+0000","172.21.15.47:6800/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/3057769442":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/2596054312":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6801/2524786594":"2024-07-25T21:57:25.995502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T22:04:49.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.239+0000 7f358ac4a640 1 -- 172.21.15.47:0/4073557986 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f35740b3cb0 msgr2=0x7f35740b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:49.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.239+0000 7f358ac4a640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f35740b3cb0 0x7f35740b6170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3578031440 tx=0x7f3578005b50 comp rx=0 tx=0).stop 2024-07-24T22:04:49.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.239+0000 7f358ac4a640 1 -- 172.21.15.47:0/4073557986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3584103f80 msgr2=0x7f3584199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:49.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.239+0000 7f358ac4a640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3584103f80 0x7f3584199190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f357000d750 tx=0x7f357000dc10 comp rx=0 tx=0).stop 2024-07-24T22:04:49.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.239+0000 7f358ac4a640 1 -- 172.21.15.47:0/4073557986 shutdown_connections 2024-07-24T22:04:49.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.239+0000 7f358ac4a640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f35740b3cb0 0x7f35740b6170 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:49.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.239+0000 7f358ac4a640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f358410cac0 0x7f358419e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:49.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.239+0000 7f358ac4a640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3584103f80 0x7f3584199190 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:49.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.239+0000 7f358ac4a640 1 --2- 172.21.15.47:0/4073557986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3584103660 0x7f3584198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:49.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.239+0000 7f358ac4a640 1 -- 172.21.15.47:0/4073557986 >> 172.21.15.47:0/4073557986 conn(0x7f35840fd0c0 msgr2=0x7f35840fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:49.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.240+0000 7f358ac4a640 1 -- 172.21.15.47:0/4073557986 shutdown_connections 2024-07-24T22:04:49.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:49.240+0000 7f358ac4a640 1 -- 172.21.15.47:0/4073557986 wait complete. 2024-07-24T22:04:49.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:49 smithi183 ceph-mon[37007]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:04:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:49 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/4073557986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:04:49.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:49 smithi047 ceph-mon[32551]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:04:49.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:49 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/4073557986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:04:50.011 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-07-24T22:04:50.011 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-07-24T22:04:50.012 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-07-24T22:04:50.012 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-07-24T22:04:50.013 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-07-24T22:04:50.013 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-07-24T22:04:50.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-07-24T22:04:50.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-07-24T22:04:50.015 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-07-24T22:04:50.015 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-07-24T22:04:50.016 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-07-24T22:04:50.016 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-07-24T22:04:50.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:49 smithi188 ceph-mon[37380]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:04:50.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:49 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/4073557986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:04:50.808 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:50.820 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:50.841 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:50.897 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:51.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:50 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:04:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:50 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:04:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:50 smithi047 ceph-mon[32551]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:04:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:50 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:04:51.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:50 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:04:51.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:50 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:04:51.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:50 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:04:51.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:50 smithi188 ceph-mon[37380]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:04:51.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:50 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:04:51.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:50 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:04:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:50 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:04:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:50 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:04:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:50 smithi183 ceph-mon[37007]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:04:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:50 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:04:51.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:50 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:04:52.270 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:52.270 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:52.273 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:52.273 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:52.274 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:52.294 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:52.294 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:52.294 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:04:53.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:53 smithi183 ceph-mon[37007]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:04:53.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:53 smithi047 ceph-mon[32551]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:04:53.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:53 smithi188 ceph-mon[37380]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:04:55.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:55 smithi047 ceph-mon[32551]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:04:55.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:55 smithi183 ceph-mon[37007]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:04:55.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:55 smithi188 ceph-mon[37380]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:04:57.180 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:57 smithi047 ceph-mon[32551]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:04:57.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:57 smithi183 ceph-mon[37007]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:04:57.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:57 smithi188 ceph-mon[37380]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:04:59.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.116+0000 7f2e562c4640 1 -- 172.21.15.47:0/2116824161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e501079e0 msgr2=0x7f2e5010e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:59.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.116+0000 7f2e562c4640 1 --2- 172.21.15.47:0/2116824161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e501079e0 0x7f2e5010e1e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009ca0 tx=0x7f2e4802a8b0 comp rx=0 tx=0).stop 2024-07-24T22:04:59.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.116+0000 7f2e562c4640 1 -- 172.21.15.47:0/2116824161 shutdown_connections 2024-07-24T22:04:59.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.116+0000 7f2e562c4640 1 --2- 172.21.15.47:0/2116824161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e501079e0 0x7f2e5010e1e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:59.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.116+0000 7f2e562c4640 1 --2- 172.21.15.47:0/2116824161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e50107060 0x7f2e501074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:59.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.116+0000 7f2e562c4640 1 --2- 172.21.15.47:0/2116824161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e50101650 0x7f2e50101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:59.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.116+0000 7f2e562c4640 1 -- 172.21.15.47:0/2116824161 >> 172.21.15.47:0/2116824161 conn(0x7f2e500fd0c0 msgr2=0x7f2e500ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:59.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.116+0000 7f2e562c4640 1 -- 172.21.15.47:0/2116824161 shutdown_connections 2024-07-24T22:04:59.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.116+0000 7f2e562c4640 1 -- 172.21.15.47:0/2116824161 wait complete. 2024-07-24T22:04:59.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.117+0000 7f2e562c4640 1 Processor -- start 2024-07-24T22:04:59.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.117+0000 7f2e562c4640 1 -- start start 2024-07-24T22:04:59.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e562c4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e50101650 0x7f2e500fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:59.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e562c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e50107060 0x7f2e500fdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:59.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e562c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e501079e0 0x7f2e500fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:59.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e562c4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2e50111660 con 0x7f2e50107060 2024-07-24T22:04:59.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e562c4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501114e0 con 0x7f2e50101650 2024-07-24T22:04:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e562c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501117e0 con 0x7f2e501079e0 2024-07-24T22:04:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e4f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e50107060 0x7f2e500fdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e4f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e50107060 0x7f2e500fdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41806/0 (socket says 172.21.15.47:41806) 2024-07-24T22:04:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e4f7fe640 1 -- 172.21.15.47:0/3487860004 learned_addr learned my addr 172.21.15.47:0/3487860004 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:04:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e4ffff640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e50101650 0x7f2e500fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e54861640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e501079e0 0x7f2e500fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e4f7fe640 1 -- 172.21.15.47:0/3487860004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e501079e0 msgr2=0x7f2e500fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e4f7fe640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e501079e0 0x7f2e500fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e4f7fe640 1 -- 172.21.15.47:0/3487860004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e50101650 msgr2=0x7f2e500fd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e4f7fe640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e50101650 0x7f2e500fd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.118+0000 7f2e4f7fe640 1 -- 172.21.15.47:0/3487860004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e501a70d0 con 0x7f2e50107060 2024-07-24T22:04:59.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.119+0000 7f2e4f7fe640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e50107060 0x7f2e500fdb00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400b4a0 tx=0x7f2e4400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:59.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.119+0000 7f2e4d7fa640 1 -- 172.21.15.47:0/3487860004 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e44014070 con 0x7f2e50107060 2024-07-24T22:04:59.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.119+0000 7f2e4d7fa640 1 -- 172.21.15.47:0/3487860004 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e44010ac0 con 0x7f2e50107060 2024-07-24T22:04:59.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.119+0000 7f2e4d7fa640 1 -- 172.21.15.47:0/3487860004 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e44017c30 con 0x7f2e50107060 2024-07-24T22:04:59.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.119+0000 7f2e562c4640 1 -- 172.21.15.47:0/3487860004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e501a73c0 con 0x7f2e50107060 2024-07-24T22:04:59.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.119+0000 7f2e562c4640 1 -- 172.21.15.47:0/3487860004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e501a7930 con 0x7f2e50107060 2024-07-24T22:04:59.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.120+0000 7f2e562c4640 1 -- 172.21.15.47:0/3487860004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2e50104170 con 0x7f2e50107060 2024-07-24T22:04:59.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.122+0000 7f2e4d7fa640 1 -- 172.21.15.47:0/3487860004 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f2e44017070 con 0x7f2e50107060 2024-07-24T22:04:59.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.122+0000 7f2e4d7fa640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2e380b3d30 0x7f2e380b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:59.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.123+0000 7f2e4ffff640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2e380b3d30 0x7f2e380b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:59.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.123+0000 7f2e4d7fa640 1 -- 172.21.15.47:0/3487860004 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f2e440e3480 con 0x7f2e50107060 2024-07-24T22:04:59.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.123+0000 7f2e4d7fa640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913] conn(0x7f2e380bdc60 0x7f2e380c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:04:59.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.123+0000 7f2e4d7fa640 1 -- 172.21.15.47:0/3487860004 --> [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e44018ec0 con 0x7f2e380bdc60 2024-07-24T22:04:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.123+0000 7f2e4d7fa640 1 -- 172.21.15.47:0/3487860004 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f2e440e38d0 con 0x7f2e50107060 2024-07-24T22:04:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.123+0000 7f2e54861640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913] conn(0x7f2e380bdc60 0x7f2e380c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:04:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.123+0000 7f2e4ffff640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2e380b3d30 0x7f2e380b61f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009bd0 tx=0x7f2e40005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.123+0000 7f2e54861640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913] conn(0x7f2e380bdc60 0x7f2e380c0100 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:04:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.124+0000 7f2e4d7fa640 1 -- 172.21.15.47:0/3487860004 <== osd.0 v2:172.21.15.47:6802/2665889913 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2e44018ec0 con 0x7f2e380bdc60 2024-07-24T22:04:59.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.139+0000 7f2e562c4640 1 -- 172.21.15.47:0/3487860004 --> [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2e50102900 con 0x7f2e380bdc60 2024-07-24T22:04:59.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.139+0000 7f2e4d7fa640 1 -- 172.21.15.47:0/3487860004 <== osd.0 v2:172.21.15.47:6802/2665889913 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2e50102900 con 0x7f2e380bdc60 2024-07-24T22:04:59.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.139+0000 7f2e562c4640 1 -- 172.21.15.47:0/3487860004 >> [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913] conn(0x7f2e380bdc60 msgr2=0x7f2e380c0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:59.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.139+0000 7f2e562c4640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913] conn(0x7f2e380bdc60 0x7f2e380c0100 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:04:59.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.140+0000 7f2e562c4640 1 -- 172.21.15.47:0/3487860004 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2e380b3d30 msgr2=0x7f2e380b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:59.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.140+0000 7f2e562c4640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2e380b3d30 0x7f2e380b61f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009bd0 tx=0x7f2e40005f90 comp rx=0 tx=0).stop 2024-07-24T22:04:59.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.140+0000 7f2e562c4640 1 -- 172.21.15.47:0/3487860004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e50107060 msgr2=0x7f2e500fdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:04:59.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.140+0000 7f2e562c4640 1 --2- 172.21.15.47:0/3487860004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e50107060 0x7f2e500fdb00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400b4a0 tx=0x7f2e4400b960 comp rx=0 tx=0).stop 2024-07-24T22:04:59.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.140+0000 7f2e54861640 1 -- 172.21.15.47:0/3487860004 reap_dead start 2024-07-24T22:04:59.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.140+0000 7f2e562c4640 1 -- 172.21.15.47:0/3487860004 shutdown_connections 2024-07-24T22:04:59.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.140+0000 7f2e562c4640 1 -- 172.21.15.47:0/3487860004 >> 172.21.15.47:0/3487860004 conn(0x7f2e500fd0c0 msgr2=0x7f2e5006a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:04:59.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.140+0000 7f2e562c4640 1 -- 172.21.15.47:0/3487860004 shutdown_connections 2024-07-24T22:04:59.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:04:59.140+0000 7f2e562c4640 1 -- 172.21.15.47:0/3487860004 wait complete. 2024-07-24T22:04:59.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:04:59 smithi183 ceph-mon[37007]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:04:59.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:04:59 smithi047 ceph-mon[32551]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:04:59.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:04:59 smithi188 ceph-mon[37380]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:00.239 INFO:teuthology.orchestra.run.smithi047.stdout:38654705740 2024-07-24T22:05:00.239 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-07-24T22:05:01.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:01 smithi183 ceph-mon[37007]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:01.425 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:01 smithi047 ceph-mon[32551]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:01.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:01 smithi188 ceph-mon[37380]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:02.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.873+0000 7f7ca3c95640 1 -- 172.21.15.47:0/194814827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c9c101d70 msgr2=0x7f7c9c106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:02.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.873+0000 7f7ca3c95640 1 --2- 172.21.15.47:0/194814827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c9c101d70 0x7f7c9c106240 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009900 tx=0x7f7c8c02a410 comp rx=0 tx=0).stop 2024-07-24T22:05:02.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.873+0000 7f7ca3c95640 1 -- 172.21.15.47:0/194814827 shutdown_connections 2024-07-24T22:05:02.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.873+0000 7f7ca3c95640 1 --2- 172.21.15.47:0/194814827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9c106890 0x7f7c9c106ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:02.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.873+0000 7f7ca3c95640 1 --2- 172.21.15.47:0/194814827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c9c101d70 0x7f7c9c106240 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:02.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.873+0000 7f7ca3c95640 1 --2- 172.21.15.47:0/194814827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c9c101450 0x7f7c9c101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:02.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.873+0000 7f7ca3c95640 1 -- 172.21.15.47:0/194814827 >> 172.21.15.47:0/194814827 conn(0x7f7c9c0fd0c0 msgr2=0x7f7c9c0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:02.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.873+0000 7f7ca3c95640 1 -- 172.21.15.47:0/194814827 shutdown_connections 2024-07-24T22:05:02.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.873+0000 7f7ca3c95640 1 -- 172.21.15.47:0/194814827 wait complete. 2024-07-24T22:05:02.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.874+0000 7f7ca3c95640 1 Processor -- start 2024-07-24T22:05:02.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.874+0000 7f7ca3c95640 1 -- start start 2024-07-24T22:05:02.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.874+0000 7f7ca3c95640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c9c101450 0x7f7c9c19f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:02.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.874+0000 7f7ca3c95640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9c101d70 0x7f7c9c19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:02.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.874+0000 7f7ca3c95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c9c106890 0x7f7c9c1a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:02.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.874+0000 7f7ca3c95640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c118d90 con 0x7f7c9c106890 2024-07-24T22:05:02.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.874+0000 7f7ca3c95640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c118c10 con 0x7f7c9c101d70 2024-07-24T22:05:02.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.874+0000 7f7ca3c95640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c118f10 con 0x7f7c9c101450 2024-07-24T22:05:02.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.874+0000 7f7ca2232640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c9c106890 0x7f7c9c1a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:02.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.874+0000 7f7ca2232640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c9c106890 0x7f7c9c1a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41826/0 (socket says 172.21.15.47:41826) 2024-07-24T22:05:02.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.874+0000 7f7ca2232640 1 -- 172.21.15.47:0/1565469100 learned_addr learned my addr 172.21.15.47:0/1565469100 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:02.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.874+0000 7f7ca1a31640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c9c101450 0x7f7c9c19f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:02.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.875+0000 7f7ca1230640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9c101d70 0x7f7c9c19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:02.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.875+0000 7f7ca2232640 1 -- 172.21.15.47:0/1565469100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c9c101450 msgr2=0x7f7c9c19f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:02.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.875+0000 7f7ca2232640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c9c101450 0x7f7c9c19f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:02.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.875+0000 7f7ca2232640 1 -- 172.21.15.47:0/1565469100 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9c101d70 msgr2=0x7f7c9c19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:02.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.875+0000 7f7ca2232640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9c101d70 0x7f7c9c19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:02.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.875+0000 7f7ca2232640 1 -- 172.21.15.47:0/1565469100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c1a5390 con 0x7f7c9c106890 2024-07-24T22:05:02.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.875+0000 7f7ca2232640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c9c106890 0x7f7c9c1a4bc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400b970 tx=0x7f7c9400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:02.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.875+0000 7f7c92ffd640 1 -- 172.21.15.47:0/1565469100 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94019070 con 0x7f7c9c106890 2024-07-24T22:05:02.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.875+0000 7f7c92ffd640 1 -- 172.21.15.47:0/1565469100 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c94014440 con 0x7f7c9c106890 2024-07-24T22:05:02.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.875+0000 7f7ca3c95640 1 -- 172.21.15.47:0/1565469100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9c1a5680 con 0x7f7c9c106890 2024-07-24T22:05:02.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.875+0000 7f7c92ffd640 1 -- 172.21.15.47:0/1565469100 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c940075d0 con 0x7f7c9c106890 2024-07-24T22:05:02.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.875+0000 7f7ca3c95640 1 -- 172.21.15.47:0/1565469100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9c1abdc0 con 0x7f7c9c106890 2024-07-24T22:05:02.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.876+0000 7f7ca3c95640 1 -- 172.21.15.47:0/1565469100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c9c105c80 con 0x7f7c9c106890 2024-07-24T22:05:02.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.877+0000 7f7c92ffd640 1 -- 172.21.15.47:0/1565469100 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f7c9401c070 con 0x7f7c9c106890 2024-07-24T22:05:02.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.878+0000 7f7c92ffd640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7c880b3d30 0x7f7c880b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:02.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.878+0000 7f7ca1a31640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7c880b3d30 0x7f7c880b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:02.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.878+0000 7f7c92ffd640 1 -- 172.21.15.47:0/1565469100 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f7c940e3b90 con 0x7f7c9c106890 2024-07-24T22:05:02.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.878+0000 7f7c92ffd640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130] conn(0x7f7c880bdc60 0x7f7c880c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:02.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.878+0000 7f7c92ffd640 1 -- 172.21.15.47:0/1565469100 --> [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c9401be50 con 0x7f7c880bdc60 2024-07-24T22:05:02.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.878+0000 7f7c92ffd640 1 -- 172.21.15.47:0/1565469100 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f7c940e3f40 con 0x7f7c9c106890 2024-07-24T22:05:02.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.879+0000 7f7ca1230640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130] conn(0x7f7c880bdc60 0x7f7c880c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:02.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.879+0000 7f7ca1a31640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7c880b3d30 0x7f7c880b61f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7c98005fd0 tx=0x7f7c9800b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:02.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.879+0000 7f7ca1230640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130] conn(0x7f7c880bdc60 0x7f7c880c0100 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:02.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.880+0000 7f7c92ffd640 1 -- 172.21.15.47:0/1565469100 <== osd.3 v2:172.21.15.47:6810/236749130 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c9401be50 con 0x7f7c880bdc60 2024-07-24T22:05:02.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.894+0000 7f7ca3c95640 1 -- 172.21.15.47:0/1565469100 --> [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c9c06ab70 con 0x7f7c880bdc60 2024-07-24T22:05:02.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.894+0000 7f7c92ffd640 1 -- 172.21.15.47:0/1565469100 <== osd.3 v2:172.21.15.47:6810/236749130 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7c9c06ab70 con 0x7f7c880bdc60 2024-07-24T22:05:02.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.895+0000 7f7ca3c95640 1 -- 172.21.15.47:0/1565469100 >> [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130] conn(0x7f7c880bdc60 msgr2=0x7f7c880c0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:02.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.895+0000 7f7ca3c95640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130] conn(0x7f7c880bdc60 0x7f7c880c0100 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:02.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.895+0000 7f7ca3c95640 1 -- 172.21.15.47:0/1565469100 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7c880b3d30 msgr2=0x7f7c880b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:02.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.895+0000 7f7ca3c95640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7c880b3d30 0x7f7c880b61f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7c98005fd0 tx=0x7f7c9800b390 comp rx=0 tx=0).stop 2024-07-24T22:05:02.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.895+0000 7f7ca3c95640 1 -- 172.21.15.47:0/1565469100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c9c106890 msgr2=0x7f7c9c1a4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:02.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.895+0000 7f7ca3c95640 1 --2- 172.21.15.47:0/1565469100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c9c106890 0x7f7c9c1a4bc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400b970 tx=0x7f7c9400be30 comp rx=0 tx=0).stop 2024-07-24T22:05:02.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.895+0000 7f7ca2232640 1 -- 172.21.15.47:0/1565469100 reap_dead start 2024-07-24T22:05:02.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.895+0000 7f7ca3c95640 1 -- 172.21.15.47:0/1565469100 shutdown_connections 2024-07-24T22:05:02.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.895+0000 7f7ca3c95640 1 -- 172.21.15.47:0/1565469100 >> 172.21.15.47:0/1565469100 conn(0x7f7c9c0fd0c0 msgr2=0x7f7c9c104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:02.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.895+0000 7f7ca3c95640 1 -- 172.21.15.47:0/1565469100 shutdown_connections 2024-07-24T22:05:02.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:01.895+0000 7f7ca3c95640 1 -- 172.21.15.47:0/1565469100 wait complete. 2024-07-24T22:05:03.067 INFO:teuthology.orchestra.run.smithi047.stdout:115964117056 2024-07-24T22:05:03.068 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-07-24T22:05:03.330 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:03 smithi047 ceph-mon[32551]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:03.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:03 smithi183 ceph-mon[37007]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:03.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:03 smithi188 ceph-mon[37380]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.163+0000 7fc900889640 1 -- 172.21.15.47:0/4068058364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8fc102770 msgr2=0x7fc8fc102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.163+0000 7fc900889640 1 --2- 172.21.15.47:0/4068058364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8fc102770 0x7fc8fc102b50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009900 tx=0x7fc8ec02a410 comp rx=0 tx=0).stop 2024-07-24T22:05:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.163+0000 7fc900889640 1 -- 172.21.15.47:0/4068058364 shutdown_connections 2024-07-24T22:05:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.163+0000 7fc900889640 1 --2- 172.21.15.47:0/4068058364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8fc108b00 0x7fc8fc10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.163+0000 7fc900889640 1 --2- 172.21.15.47:0/4068058364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8fc108180 0x7fc8fc1085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.163+0000 7fc900889640 1 --2- 172.21.15.47:0/4068058364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8fc102770 0x7fc8fc102b50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.163+0000 7fc900889640 1 -- 172.21.15.47:0/4068058364 >> 172.21.15.47:0/4068058364 conn(0x7fc8fc0fe1c0 msgr2=0x7fc8fc1005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.163+0000 7fc900889640 1 -- 172.21.15.47:0/4068058364 shutdown_connections 2024-07-24T22:05:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.163+0000 7fc900889640 1 -- 172.21.15.47:0/4068058364 wait complete. 2024-07-24T22:05:05.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.164+0000 7fc900889640 1 Processor -- start 2024-07-24T22:05:05.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.164+0000 7fc900889640 1 -- start start 2024-07-24T22:05:05.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.164+0000 7fc900889640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8fc102770 0x7fc8fc198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:05.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.164+0000 7fc900889640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8fc108180 0x7fc8fc1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:05.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.164+0000 7fc900889640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8fc108b00 0x7fc8fc19e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:05.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.164+0000 7fc900889640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc8fc112760 con 0x7fc8fc102770 2024-07-24T22:05:05.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.164+0000 7fc900889640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc8fc1125e0 con 0x7fc8fc108b00 2024-07-24T22:05:05.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.164+0000 7fc900889640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc8fc1128e0 con 0x7fc8fc108180 2024-07-24T22:05:05.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8fa59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8fc102770 0x7fc8fc198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:05.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8fa59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8fc102770 0x7fc8fc198c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47504/0 (socket says 172.21.15.47:47504) 2024-07-24T22:05:05.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8fa59c640 1 -- 172.21.15.47:0/3278694749 learned_addr learned my addr 172.21.15.47:0/3278694749 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:05.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8fad9d640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8fc108b00 0x7fc8fc19e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:05.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8f1d9b640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8fc108180 0x7fc8fc1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:05.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8fa59c640 1 -- 172.21.15.47:0/3278694749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8fc108180 msgr2=0x7fc8fc1991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:05.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8fa59c640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8fc108180 0x7fc8fc1991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8fa59c640 1 -- 172.21.15.47:0/3278694749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8fc108b00 msgr2=0x7fc8fc19e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:05.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8fa59c640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8fc108b00 0x7fc8fc19e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8fa59c640 1 -- 172.21.15.47:0/3278694749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8fc19ed40 con 0x7fc8fc102770 2024-07-24T22:05:05.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8fad9d640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8fc108b00 0x7fc8fc19e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:05:05.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8fa59c640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8fc102770 0x7fc8fc198c90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec005ab0 tx=0x7fc8ec003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:05.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8f3fff640 1 -- 172.21.15.47:0/3278694749 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec03f070 con 0x7fc8fc102770 2024-07-24T22:05:05.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8f3fff640 1 -- 172.21.15.47:0/3278694749 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8ec031d60 con 0x7fc8fc102770 2024-07-24T22:05:05.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc900889640 1 -- 172.21.15.47:0/3278694749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8fc19efd0 con 0x7fc8fc102770 2024-07-24T22:05:05.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.165+0000 7fc8f3fff640 1 -- 172.21.15.47:0/3278694749 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec035030 con 0x7fc8fc102770 2024-07-24T22:05:05.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.166+0000 7fc900889640 1 -- 172.21.15.47:0/3278694749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8fc1a56f0 con 0x7fc8fc102770 2024-07-24T22:05:05.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.166+0000 7fc900889640 1 -- 172.21.15.47:0/3278694749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8fc063290 con 0x7fc8fc102770 2024-07-24T22:05:05.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.168+0000 7fc8f3fff640 1 -- 172.21.15.47:0/3278694749 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fc8ec042070 con 0x7fc8fc102770 2024-07-24T22:05:05.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.169+0000 7fc8f3fff640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8e80b3cb0 0x7fc8e80b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:05.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.169+0000 7fc8f1d9b640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8e80b3cb0 0x7fc8e80b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:05.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.169+0000 7fc8f3fff640 1 -- 172.21.15.47:0/3278694749 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7fc8ec104860 con 0x7fc8fc102770 2024-07-24T22:05:05.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.169+0000 7fc8f3fff640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101] conn(0x7fc8e80bdbe0 0x7fc8e80c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:05.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.169+0000 7fc8f3fff640 1 -- 172.21.15.47:0/3278694749 --> [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8ec04be50 con 0x7fc8e80bdbe0 2024-07-24T22:05:05.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.169+0000 7fc8f3fff640 1 -- 172.21.15.47:0/3278694749 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fc8ec104cb0 con 0x7fc8fc102770 2024-07-24T22:05:05.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.170+0000 7fc8f1d9b640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8e80b3cb0 0x7fc8e80b6170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc1078c0 tx=0x7fc8e400b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:05.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.170+0000 7fc8fad9d640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101] conn(0x7fc8e80bdbe0 0x7fc8e80c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:05.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.170+0000 7fc8fad9d640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101] conn(0x7fc8e80bdbe0 0x7fc8e80c0080 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:05.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.171+0000 7fc8f3fff640 1 -- 172.21.15.47:0/3278694749 <== osd.11 v2:172.21.15.188:6824/3725107101 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8ec04be50 con 0x7fc8e80bdbe0 2024-07-24T22:05:05.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.191+0000 7fc900889640 1 -- 172.21.15.47:0/3278694749 --> [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc8fc063690 con 0x7fc8e80bdbe0 2024-07-24T22:05:05.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.192+0000 7fc8f3fff640 1 -- 172.21.15.47:0/3278694749 <== osd.11 v2:172.21.15.188:6824/3725107101 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc8fc063690 con 0x7fc8e80bdbe0 2024-07-24T22:05:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.193+0000 7fc900889640 1 -- 172.21.15.47:0/3278694749 >> [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101] conn(0x7fc8e80bdbe0 msgr2=0x7fc8e80c0080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.193+0000 7fc900889640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101] conn(0x7fc8e80bdbe0 0x7fc8e80c0080 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.193+0000 7fc900889640 1 -- 172.21.15.47:0/3278694749 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8e80b3cb0 msgr2=0x7fc8e80b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.193+0000 7fc900889640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc8e80b3cb0 0x7fc8e80b6170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc1078c0 tx=0x7fc8e400b390 comp rx=0 tx=0).stop 2024-07-24T22:05:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.193+0000 7fc900889640 1 -- 172.21.15.47:0/3278694749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8fc102770 msgr2=0x7fc8fc198c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.193+0000 7fc900889640 1 --2- 172.21.15.47:0/3278694749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8fc102770 0x7fc8fc198c90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec005ab0 tx=0x7fc8ec003c80 comp rx=0 tx=0).stop 2024-07-24T22:05:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.193+0000 7fc8fad9d640 1 -- 172.21.15.47:0/3278694749 reap_dead start 2024-07-24T22:05:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.193+0000 7fc900889640 1 -- 172.21.15.47:0/3278694749 shutdown_connections 2024-07-24T22:05:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.193+0000 7fc900889640 1 -- 172.21.15.47:0/3278694749 >> 172.21.15.47:0/3278694749 conn(0x7fc8fc0fe1c0 msgr2=0x7fc8fc0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.193+0000 7fc900889640 1 -- 172.21.15.47:0/3278694749 shutdown_connections 2024-07-24T22:05:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.193+0000 7fc900889640 1 -- 172.21.15.47:0/3278694749 wait complete. 2024-07-24T22:05:05.383 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:05 smithi047 ceph-mon[32551]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:05.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:05 smithi183 ceph-mon[37007]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:05.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:05 smithi188 ceph-mon[37380]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:05.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.766+0000 7f51ae65d640 1 -- 172.21.15.47:0/3889712805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a8108180 msgr2=0x7f51a81085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:05.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.766+0000 7f51ae65d640 1 --2- 172.21.15.47:0/3889712805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a8108180 0x7f51a81085c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f519c009900 tx=0x7f519c02a410 comp rx=0 tx=0).stop 2024-07-24T22:05:05.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.766+0000 7f51ae65d640 1 -- 172.21.15.47:0/3889712805 shutdown_connections 2024-07-24T22:05:05.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.766+0000 7f51ae65d640 1 --2- 172.21.15.47:0/3889712805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51a8108b00 0x7f51a810f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.766+0000 7f51ae65d640 1 --2- 172.21.15.47:0/3889712805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a8108180 0x7f51a81085c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.766+0000 7f51ae65d640 1 --2- 172.21.15.47:0/3889712805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a8102770 0x7f51a8102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.766+0000 7f51ae65d640 1 -- 172.21.15.47:0/3889712805 >> 172.21.15.47:0/3889712805 conn(0x7f51a80fe1c0 msgr2=0x7f51a81005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:05.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.767+0000 7f51ae65d640 1 -- 172.21.15.47:0/3889712805 shutdown_connections 2024-07-24T22:05:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.767+0000 7f51ae65d640 1 -- 172.21.15.47:0/3889712805 wait complete. 2024-07-24T22:05:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.767+0000 7f51ae65d640 1 Processor -- start 2024-07-24T22:05:05.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.767+0000 7f51ae65d640 1 -- start start 2024-07-24T22:05:05.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51ae65d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a8102770 0x7f51a8198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:05.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51ae65d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51a8108180 0x7f51a81991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:05.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51ae65d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a8108b00 0x7f51a819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:05.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51ae65d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51a8112700 con 0x7f51a8102770 2024-07-24T22:05:05.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51ae65d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51a8112580 con 0x7f51a8108b00 2024-07-24T22:05:05.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51ae65d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f51a8112880 con 0x7f51a8108180 2024-07-24T22:05:05.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a8102770 0x7f51a8198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:05.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a8102770 0x7f51a8198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47516/0 (socket says 172.21.15.47:47516) 2024-07-24T22:05:05.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51a7fff640 1 -- 172.21.15.47:0/2054095836 learned_addr learned my addr 172.21.15.47:0/2054095836 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:05.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51a77fe640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51a8108180 0x7f51a81991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51acbfa640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a8108b00 0x7f51a819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51a7fff640 1 -- 172.21.15.47:0/2054095836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51a8108180 msgr2=0x7f51a81991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51a7fff640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51a8108180 0x7f51a81991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51a7fff640 1 -- 172.21.15.47:0/2054095836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a8108b00 msgr2=0x7f51a819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51a7fff640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a8108b00 0x7f51a819e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51a7fff640 1 -- 172.21.15.47:0/2054095836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a819ed20 con 0x7f51a8102770 2024-07-24T22:05:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51a7fff640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a8102770 0x7f51a8198c70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f519800e9f0 tx=0x7f519800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:05.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51a57fa640 1 -- 172.21.15.47:0/2054095836 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519800cd80 con 0x7f51a8102770 2024-07-24T22:05:05.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51ae65d640 1 -- 172.21.15.47:0/2054095836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a819f010 con 0x7f51a8102770 2024-07-24T22:05:05.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51a57fa640 1 -- 172.21.15.47:0/2054095836 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51980108e0 con 0x7f51a8102770 2024-07-24T22:05:05.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.768+0000 7f51a57fa640 1 -- 172.21.15.47:0/2054095836 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198018980 con 0x7f51a8102770 2024-07-24T22:05:05.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.769+0000 7f51ae65d640 1 -- 172.21.15.47:0/2054095836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a81a56d0 con 0x7f51a8102770 2024-07-24T22:05:05.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.769+0000 7f51ae65d640 1 -- 172.21.15.47:0/2054095836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f51a80632d0 con 0x7f51a8102770 2024-07-24T22:05:05.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.771+0000 7f51a57fa640 1 -- 172.21.15.47:0/2054095836 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f5198010430 con 0x7f51a8102770 2024-07-24T22:05:05.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.772+0000 7f51a57fa640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f51900b3cb0 0x7f51900b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:05.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.772+0000 7f51a77fe640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f51900b3cb0 0x7f51900b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:05.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.772+0000 7f51a57fa640 1 -- 172.21.15.47:0/2054095836 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f51980e4a90 con 0x7f51a8102770 2024-07-24T22:05:05.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.772+0000 7f51a57fa640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107] conn(0x7f51900bdbe0 0x7f51900c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:05.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.772+0000 7f51a57fa640 1 -- 172.21.15.47:0/2054095836 --> [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51900c0750 con 0x7f51900bdbe0 2024-07-24T22:05:05.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.772+0000 7f51a57fa640 1 -- 172.21.15.47:0/2054095836 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f51980e4ee0 con 0x7f51a8102770 2024-07-24T22:05:05.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.772+0000 7f51a77fe640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f51900b3cb0 0x7f51900b6170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f519c031440 tx=0x7f519c0095f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:05.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.772+0000 7f51acbfa640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107] conn(0x7f51900bdbe0 0x7f51900c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:05.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.773+0000 7f51acbfa640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107] conn(0x7f51900bdbe0 0x7f51900c0080 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:05.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.774+0000 7f51a57fa640 1 -- 172.21.15.47:0/2054095836 <== osd.4 v2:172.21.15.183:6808/3978122107 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f51900c0750 con 0x7f51900bdbe0 2024-07-24T22:05:05.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.788+0000 7f51ae65d640 1 -- 172.21.15.47:0/2054095836 --> [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f51a8063780 con 0x7f51900bdbe0 2024-07-24T22:05:05.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.788+0000 7f51a57fa640 1 -- 172.21.15.47:0/2054095836 <== osd.4 v2:172.21.15.183:6808/3978122107 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f51a8063780 con 0x7f51900bdbe0 2024-07-24T22:05:05.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.789+0000 7f51ae65d640 1 -- 172.21.15.47:0/2054095836 >> [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107] conn(0x7f51900bdbe0 msgr2=0x7f51900c0080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:05.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.789+0000 7f51ae65d640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107] conn(0x7f51900bdbe0 0x7f51900c0080 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.789+0000 7f51ae65d640 1 -- 172.21.15.47:0/2054095836 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f51900b3cb0 msgr2=0x7f51900b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:05.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.789+0000 7f51ae65d640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f51900b3cb0 0x7f51900b6170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f519c031440 tx=0x7f519c0095f0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.789+0000 7f51ae65d640 1 -- 172.21.15.47:0/2054095836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a8102770 msgr2=0x7f51a8198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:05.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.789+0000 7f51ae65d640 1 --2- 172.21.15.47:0/2054095836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51a8102770 0x7f51a8198c70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f519800e9f0 tx=0x7f519800eeb0 comp rx=0 tx=0).stop 2024-07-24T22:05:05.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.789+0000 7f51acbfa640 1 -- 172.21.15.47:0/2054095836 reap_dead start 2024-07-24T22:05:05.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.789+0000 7f51ae65d640 1 -- 172.21.15.47:0/2054095836 shutdown_connections 2024-07-24T22:05:05.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.789+0000 7f51ae65d640 1 -- 172.21.15.47:0/2054095836 >> 172.21.15.47:0/2054095836 conn(0x7f51a80fe1c0 msgr2=0x7f51a81005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:05.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.789+0000 7f51ae65d640 1 -- 172.21.15.47:0/2054095836 shutdown_connections 2024-07-24T22:05:05.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:05.789+0000 7f51ae65d640 1 -- 172.21.15.47:0/2054095836 wait complete. 2024-07-24T22:05:06.367 INFO:teuthology.orchestra.run.smithi047.stdout:141733920828 2024-07-24T22:05:06.367 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-07-24T22:05:07.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.059+0000 7f18079bd640 1 -- 172.21.15.47:0/1673580233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800103f80 msgr2=0x7f180010c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:07.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.059+0000 7f18079bd640 1 --2- 172.21.15.47:0/1673580233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800103f80 0x7f180010c470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009900 tx=0x7f17f002a410 comp rx=0 tx=0).stop 2024-07-24T22:05:07.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.059+0000 7f18079bd640 1 -- 172.21.15.47:0/1673580233 shutdown_connections 2024-07-24T22:05:07.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.060+0000 7f18079bd640 1 --2- 172.21.15.47:0/1673580233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f180010cac0 0x7f180010ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:07.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.060+0000 7f18079bd640 1 --2- 172.21.15.47:0/1673580233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800103f80 0x7f180010c470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:07.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.060+0000 7f18079bd640 1 --2- 172.21.15.47:0/1673580233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1800103660 0x7f1800103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:07.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.060+0000 7f18079bd640 1 -- 172.21.15.47:0/1673580233 >> 172.21.15.47:0/1673580233 conn(0x7f18000fd0c0 msgr2=0x7f18000ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:07.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.060+0000 7f18079bd640 1 -- 172.21.15.47:0/1673580233 shutdown_connections 2024-07-24T22:05:07.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.060+0000 7f18079bd640 1 -- 172.21.15.47:0/1673580233 wait complete. 2024-07-24T22:05:07.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.060+0000 7f18079bd640 1 Processor -- start 2024-07-24T22:05:07.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.060+0000 7f18079bd640 1 -- start start 2024-07-24T22:05:07.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f18079bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800103660 0x7f1800198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:07.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f18079bd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1800103f80 0x7f1800199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:07.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f18079bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f180010cac0 0x7f180019e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:07.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f18079bd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1800112770 con 0x7f1800103660 2024-07-24T22:05:07.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f18079bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f18001125f0 con 0x7f180010cac0 2024-07-24T22:05:07.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f18079bd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f18001128f0 con 0x7f1800103f80 2024-07-24T22:05:07.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f1805759640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800103660 0x7f1800198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:07.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f1805759640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800103660 0x7f1800198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47540/0 (socket says 172.21.15.47:47540) 2024-07-24T22:05:07.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f1805759640 1 -- 172.21.15.47:0/3525248707 learned_addr learned my addr 172.21.15.47:0/3525248707 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:07.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f1805f5a640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f180010cac0 0x7f180019e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:07.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f1805759640 1 -- 172.21.15.47:0/3525248707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1800103f80 msgr2=0x7f1800199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:07.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f1805759640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1800103f80 0x7f1800199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:07.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f1805759640 1 -- 172.21.15.47:0/3525248707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f180010cac0 msgr2=0x7f180019e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:07.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f1805759640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f180010cac0 0x7f180019e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:07.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f1805759640 1 -- 172.21.15.47:0/3525248707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180019ed70 con 0x7f1800103660 2024-07-24T22:05:07.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f1805f5a640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f180010cac0 0x7f180019e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:07.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.061+0000 7f1805759640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800103660 0x7f1800198cc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00b4a0 tx=0x7f17fc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:07.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.062+0000 7f17f67fc640 1 -- 172.21.15.47:0/3525248707 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc014070 con 0x7f1800103660 2024-07-24T22:05:07.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.062+0000 7f18079bd640 1 -- 172.21.15.47:0/3525248707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180019f060 con 0x7f1800103660 2024-07-24T22:05:07.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.062+0000 7f17f67fc640 1 -- 172.21.15.47:0/3525248707 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17fc010ac0 con 0x7f1800103660 2024-07-24T22:05:07.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.062+0000 7f17f67fc640 1 -- 172.21.15.47:0/3525248707 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc017c30 con 0x7f1800103660 2024-07-24T22:05:07.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.062+0000 7f18079bd640 1 -- 172.21.15.47:0/3525248707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18001a57a0 con 0x7f1800103660 2024-07-24T22:05:07.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.062+0000 7f18079bd640 1 -- 172.21.15.47:0/3525248707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f18000ff730 con 0x7f1800103660 2024-07-24T22:05:07.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.064+0000 7f17f67fc640 1 -- 172.21.15.47:0/3525248707 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f17fc017070 con 0x7f1800103660 2024-07-24T22:05:07.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.065+0000 7f17f67fc640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17ec0b3cb0 0x7f17ec0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:07.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.065+0000 7f1804f58640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17ec0b3cb0 0x7f17ec0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:07.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.065+0000 7f17f67fc640 1 -- 172.21.15.47:0/3525248707 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f17fc0e3670 con 0x7f1800103660 2024-07-24T22:05:07.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.065+0000 7f17f67fc640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228] conn(0x7f17ec0bdbe0 0x7f17ec0c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:07.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.065+0000 7f17f67fc640 1 -- 172.21.15.47:0/3525248707 --> [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17fc01be50 con 0x7f17ec0bdbe0 2024-07-24T22:05:07.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.065+0000 7f17f67fc640 1 -- 172.21.15.47:0/3525248707 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f17fc0e3ac0 con 0x7f1800103660 2024-07-24T22:05:07.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.065+0000 7f1804f58640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17ec0b3cb0 0x7f17ec0b6170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f17f002a930 tx=0x7f17f0031400 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:07.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.066+0000 7f1805f5a640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228] conn(0x7f17ec0bdbe0 0x7f17ec0c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:07.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.066+0000 7f1805f5a640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228] conn(0x7f17ec0bdbe0 0x7f17ec0c0080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:07.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.067+0000 7f17f67fc640 1 -- 172.21.15.47:0/3525248707 <== osd.1 v2:172.21.15.183:6800/3486494228 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f17fc01be50 con 0x7f17ec0bdbe0 2024-07-24T22:05:07.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.083+0000 7f18079bd640 1 -- 172.21.15.47:0/3525248707 --> [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f180006ab70 con 0x7f17ec0bdbe0 2024-07-24T22:05:07.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.084+0000 7f17f67fc640 1 -- 172.21.15.47:0/3525248707 <== osd.1 v2:172.21.15.183:6800/3486494228 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f180006ab70 con 0x7f17ec0bdbe0 2024-07-24T22:05:07.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.084+0000 7f18079bd640 1 -- 172.21.15.47:0/3525248707 >> [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228] conn(0x7f17ec0bdbe0 msgr2=0x7f17ec0c0080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:07.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.084+0000 7f18079bd640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228] conn(0x7f17ec0bdbe0 0x7f17ec0c0080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:07.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.084+0000 7f18079bd640 1 -- 172.21.15.47:0/3525248707 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17ec0b3cb0 msgr2=0x7f17ec0b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:07.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.084+0000 7f18079bd640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17ec0b3cb0 0x7f17ec0b6170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f17f002a930 tx=0x7f17f0031400 comp rx=0 tx=0).stop 2024-07-24T22:05:07.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.084+0000 7f18079bd640 1 -- 172.21.15.47:0/3525248707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800103660 msgr2=0x7f1800198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:07.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.084+0000 7f18079bd640 1 --2- 172.21.15.47:0/3525248707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800103660 0x7f1800198cc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00b4a0 tx=0x7f17fc00b960 comp rx=0 tx=0).stop 2024-07-24T22:05:07.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.085+0000 7f1805f5a640 1 -- 172.21.15.47:0/3525248707 reap_dead start 2024-07-24T22:05:07.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.085+0000 7f18079bd640 1 -- 172.21.15.47:0/3525248707 shutdown_connections 2024-07-24T22:05:07.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.085+0000 7f18079bd640 1 -- 172.21.15.47:0/3525248707 >> 172.21.15.47:0/3525248707 conn(0x7f18000fd0c0 msgr2=0x7f18000fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:07.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.085+0000 7f18079bd640 1 -- 172.21.15.47:0/3525248707 shutdown_connections 2024-07-24T22:05:07.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:07.085+0000 7f18079bd640 1 -- 172.21.15.47:0/3525248707 wait complete. 2024-07-24T22:05:07.369 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:07 smithi047 ceph-mon[32551]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:07.369 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:05:07.369 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:05:07.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:07 smithi183 ceph-mon[37007]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:07.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:05:07.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:05:07.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:07 smithi188 ceph-mon[37380]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:07.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:05:07.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:05:08.317 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:05:08.318 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:05:08.318 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:05:08.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:05:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:05:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:05:08.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:05:08.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:05:08.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:05:08.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.529+0000 7f94e2eea640 1 -- 172.21.15.47:0/2116795264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94dc1036a0 msgr2=0x7f94dc103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:08.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.529+0000 7f94e2eea640 1 --2- 172.21.15.47:0/2116795264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94dc1036a0 0x7f94dc103a80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009900 tx=0x7f94cc02a410 comp rx=0 tx=0).stop 2024-07-24T22:05:08.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.529+0000 7f94e2eea640 1 -- 172.21.15.47:0/2116795264 shutdown_connections 2024-07-24T22:05:08.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.529+0000 7f94e2eea640 1 --2- 172.21.15.47:0/2116795264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94dc10cb00 0x7f94dc10ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:08.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.529+0000 7f94e2eea640 1 --2- 172.21.15.47:0/2116795264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94dc103fc0 0x7f94dc10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:08.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.529+0000 7f94e2eea640 1 --2- 172.21.15.47:0/2116795264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94dc1036a0 0x7f94dc103a80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:08.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.529+0000 7f94e2eea640 1 -- 172.21.15.47:0/2116795264 >> 172.21.15.47:0/2116795264 conn(0x7f94dc0fd100 msgr2=0x7f94dc0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:08.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.529+0000 7f94e2eea640 1 -- 172.21.15.47:0/2116795264 shutdown_connections 2024-07-24T22:05:08.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.529+0000 7f94e2eea640 1 -- 172.21.15.47:0/2116795264 wait complete. 2024-07-24T22:05:08.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e2eea640 1 Processor -- start 2024-07-24T22:05:08.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e2eea640 1 -- start start 2024-07-24T22:05:08.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e2eea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94dc1036a0 0x7f94dc198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:08.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e2eea640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94dc103fc0 0x7f94dc199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:08.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e2eea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94dc10cb00 0x7f94dc19e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:08.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e2eea640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc1127d0 con 0x7f94dc10cb00 2024-07-24T22:05:08.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e2eea640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc112650 con 0x7f94dc103fc0 2024-07-24T22:05:08.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e2eea640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc112950 con 0x7f94dc1036a0 2024-07-24T22:05:08.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e1487640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94dc10cb00 0x7f94dc19e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:08.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e1487640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94dc10cb00 0x7f94dc19e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47550/0 (socket says 172.21.15.47:47550) 2024-07-24T22:05:08.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e1487640 1 -- 172.21.15.47:0/2753140741 learned_addr learned my addr 172.21.15.47:0/2753140741 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:08.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94dbfff640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94dc103fc0 0x7f94dc199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:08.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e0c86640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94dc1036a0 0x7f94dc198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:08.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e1487640 1 -- 172.21.15.47:0/2753140741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94dc1036a0 msgr2=0x7f94dc198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:08.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e1487640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94dc1036a0 0x7f94dc198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:08.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e1487640 1 -- 172.21.15.47:0/2753140741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94dc103fc0 msgr2=0x7f94dc199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:08.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e1487640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94dc103fc0 0x7f94dc199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:08.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e1487640 1 -- 172.21.15.47:0/2753140741 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94dc19edd0 con 0x7f94dc10cb00 2024-07-24T22:05:08.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.530+0000 7f94e0c86640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94dc1036a0 0x7f94dc198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:05:08.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.531+0000 7f94e1487640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94dc10cb00 0x7f94dc19e600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009fd0 tx=0x7f94d400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:08.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.531+0000 7f94d9ffb640 1 -- 172.21.15.47:0/2753140741 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4017070 con 0x7f94dc10cb00 2024-07-24T22:05:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.531+0000 7f94d9ffb640 1 -- 172.21.15.47:0/2753140741 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94d4003e20 con 0x7f94dc10cb00 2024-07-24T22:05:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.531+0000 7f94e2eea640 1 -- 172.21.15.47:0/2753140741 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94dc19f0c0 con 0x7f94dc10cb00 2024-07-24T22:05:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.531+0000 7f94d9ffb640 1 -- 172.21.15.47:0/2753140741 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4010460 con 0x7f94dc10cb00 2024-07-24T22:05:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.531+0000 7f94e2eea640 1 -- 172.21.15.47:0/2753140741 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94dc1a5780 con 0x7f94dc10cb00 2024-07-24T22:05:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.532+0000 7f94e2eea640 1 -- 172.21.15.47:0/2753140741 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f94dc0632d0 con 0x7f94dc10cb00 2024-07-24T22:05:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.534+0000 7f94d9ffb640 1 -- 172.21.15.47:0/2753140741 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f94d4003970 con 0x7f94dc10cb00 2024-07-24T22:05:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.535+0000 7f94d9ffb640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94c80b3cb0 0x7f94c80b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.535+0000 7f94e0c86640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94c80b3cb0 0x7f94c80b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.535+0000 7f94d9ffb640 1 -- 172.21.15.47:0/2753140741 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f94d40e4230 con 0x7f94dc10cb00 2024-07-24T22:05:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.535+0000 7f94d9ffb640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884] conn(0x7f94c80bdbe0 0x7f94c80c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.535+0000 7f94d9ffb640 1 -- 172.21.15.47:0/2753140741 --> [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94c80c0750 con 0x7f94c80bdbe0 2024-07-24T22:05:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.535+0000 7f94d9ffb640 1 -- 172.21.15.47:0/2753140741 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f94d40a6d80 con 0x7f94dc10cb00 2024-07-24T22:05:08.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.535+0000 7f94dbfff640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884] conn(0x7f94c80bdbe0 0x7f94c80c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:08.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.535+0000 7f94e0c86640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94c80b3cb0 0x7f94c80b6170 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f94cc000c00 tx=0x7f94cc031400 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:08.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.535+0000 7f94dbfff640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884] conn(0x7f94c80bdbe0 0x7f94c80c0080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:08.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.536+0000 7f94d9ffb640 1 -- 172.21.15.47:0/2753140741 <== osd.9 v2:172.21.15.47:6826/2628721884 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f94c80c0750 con 0x7f94c80bdbe0 2024-07-24T22:05:08.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.551+0000 7f94e2eea640 1 -- 172.21.15.47:0/2753140741 --> [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f94dc063750 con 0x7f94c80bdbe0 2024-07-24T22:05:08.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.551+0000 7f94d9ffb640 1 -- 172.21.15.47:0/2753140741 <== osd.9 v2:172.21.15.47:6826/2628721884 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f94dc063750 con 0x7f94c80bdbe0 2024-07-24T22:05:08.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.551+0000 7f94e2eea640 1 -- 172.21.15.47:0/2753140741 >> [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884] conn(0x7f94c80bdbe0 msgr2=0x7f94c80c0080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:08.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.551+0000 7f94e2eea640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884] conn(0x7f94c80bdbe0 0x7f94c80c0080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:08.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.551+0000 7f94e2eea640 1 -- 172.21.15.47:0/2753140741 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94c80b3cb0 msgr2=0x7f94c80b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:08.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.551+0000 7f94e2eea640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94c80b3cb0 0x7f94c80b6170 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f94cc000c00 tx=0x7f94cc031400 comp rx=0 tx=0).stop 2024-07-24T22:05:08.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.551+0000 7f94e2eea640 1 -- 172.21.15.47:0/2753140741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94dc10cb00 msgr2=0x7f94dc19e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:08.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.551+0000 7f94e2eea640 1 --2- 172.21.15.47:0/2753140741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94dc10cb00 0x7f94dc19e600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009fd0 tx=0x7f94d400b260 comp rx=0 tx=0).stop 2024-07-24T22:05:08.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.551+0000 7f94e1487640 1 -- 172.21.15.47:0/2753140741 reap_dead start 2024-07-24T22:05:08.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.551+0000 7f94e2eea640 1 -- 172.21.15.47:0/2753140741 shutdown_connections 2024-07-24T22:05:08.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.551+0000 7f94e2eea640 1 -- 172.21.15.47:0/2753140741 >> 172.21.15.47:0/2753140741 conn(0x7f94dc0fd100 msgr2=0x7f94dc0fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:08.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.552+0000 7f94e2eea640 1 -- 172.21.15.47:0/2753140741 shutdown_connections 2024-07-24T22:05:08.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:08.552+0000 7f94e2eea640 1 -- 172.21.15.47:0/2753140741 wait complete. 2024-07-24T22:05:09.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:09 smithi047 ceph-mon[32551]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:09.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:09 smithi188 ceph-mon[37380]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:09.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:09 smithi183 ceph-mon[37007]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:10.232 INFO:teuthology.orchestra.run.smithi047.stdout:60129542219 2024-07-24T22:05:10.233 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-07-24T22:05:10.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.426+0000 7fd0cc727640 1 -- 172.21.15.47:0/1634093634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0c4101650 msgr2=0x7fd0c4101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:10.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.426+0000 7fd0cc727640 1 --2- 172.21.15.47:0/1634093634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0c4101650 0x7fd0c4101a30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009ca0 tx=0x7fd0c002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.426+0000 7fd0cc727640 1 -- 172.21.15.47:0/1634093634 shutdown_connections 2024-07-24T22:05:10.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.426+0000 7fd0cc727640 1 --2- 172.21.15.47:0/1634093634 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0c41079e0 0x7fd0c410e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.426+0000 7fd0cc727640 1 --2- 172.21.15.47:0/1634093634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0c4107060 0x7fd0c41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.426+0000 7fd0cc727640 1 --2- 172.21.15.47:0/1634093634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0c4101650 0x7fd0c4101a30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.427+0000 7fd0cc727640 1 -- 172.21.15.47:0/1634093634 >> 172.21.15.47:0/1634093634 conn(0x7fd0c40fd0c0 msgr2=0x7fd0c40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:10.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.427+0000 7fd0cc727640 1 -- 172.21.15.47:0/1634093634 shutdown_connections 2024-07-24T22:05:10.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.427+0000 7fd0cc727640 1 -- 172.21.15.47:0/1634093634 wait complete. 2024-07-24T22:05:10.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.427+0000 7fd0cc727640 1 Processor -- start 2024-07-24T22:05:10.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0cc727640 1 -- start start 2024-07-24T22:05:10.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0cc727640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0c4101650 0x7fd0c4199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:10.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0cc727640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0c4107060 0x7fd0c4199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:10.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0cc727640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0c41079e0 0x7fd0c419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:10.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0cc727640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c4111610 con 0x7fd0c4107060 2024-07-24T22:05:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0cc727640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c4111490 con 0x7fd0c4101650 2024-07-24T22:05:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0cc727640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c4111790 con 0x7fd0c41079e0 2024-07-24T22:05:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0c9cc2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0c4107060 0x7fd0c4199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0c9cc2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0c4107060 0x7fd0c4199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47594/0 (socket says 172.21.15.47:47594) 2024-07-24T22:05:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0c9cc2640 1 -- 172.21.15.47:0/2800774080 learned_addr learned my addr 172.21.15.47:0/2800774080 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0ca4c3640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0c4101650 0x7fd0c4199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0cacc4640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0c41079e0 0x7fd0c419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0c9cc2640 1 -- 172.21.15.47:0/2800774080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0c41079e0 msgr2=0x7fd0c419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0c9cc2640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0c41079e0 0x7fd0c419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0c9cc2640 1 -- 172.21.15.47:0/2800774080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0c4101650 msgr2=0x7fd0c4199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0c9cc2640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0c4101650 0x7fd0c4199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0c9cc2640 1 -- 172.21.15.47:0/2800774080 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c41a4e40 con 0x7fd0c4107060 2024-07-24T22:05:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.428+0000 7fd0ca4c3640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0c4101650 0x7fd0c4199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:05:10.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.429+0000 7fd0c9cc2640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0c4107060 0x7fd0c4199fa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd0b400e9f0 tx=0x7fd0b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:10.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.429+0000 7fd0bb7fe640 1 -- 172.21.15.47:0/2800774080 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b400cd80 con 0x7fd0c4107060 2024-07-24T22:05:10.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.429+0000 7fd0bb7fe640 1 -- 172.21.15.47:0/2800774080 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0b40054d0 con 0x7fd0c4107060 2024-07-24T22:05:10.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.429+0000 7fd0cc727640 1 -- 172.21.15.47:0/2800774080 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c41a5130 con 0x7fd0c4107060 2024-07-24T22:05:10.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.429+0000 7fd0bb7fe640 1 -- 172.21.15.47:0/2800774080 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4010690 con 0x7fd0c4107060 2024-07-24T22:05:10.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.429+0000 7fd0cc727640 1 -- 172.21.15.47:0/2800774080 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c41a5620 con 0x7fd0c4107060 2024-07-24T22:05:10.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.430+0000 7fd0cc727640 1 -- 172.21.15.47:0/2800774080 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0c40632d0 con 0x7fd0c4107060 2024-07-24T22:05:10.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.432+0000 7fd0bb7fe640 1 -- 172.21.15.47:0/2800774080 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fd0b4004e30 con 0x7fd0c4107060 2024-07-24T22:05:10.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.433+0000 7fd0bb7fe640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd0b00b3cb0 0x7fd0b00b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:10.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.433+0000 7fd0bb7fe640 1 -- 172.21.15.47:0/2800774080 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7fd0b40e4780 con 0x7fd0c4107060 2024-07-24T22:05:10.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.433+0000 7fd0ca4c3640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd0b00b3cb0 0x7fd0b00b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:10.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.433+0000 7fd0bb7fe640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083] conn(0x7fd0b00bdbe0 0x7fd0b00c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:10.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.433+0000 7fd0bb7fe640 1 -- 172.21.15.47:0/2800774080 --> [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0b4015e80 con 0x7fd0b00bdbe0 2024-07-24T22:05:10.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.433+0000 7fd0bb7fe640 1 -- 172.21.15.47:0/2800774080 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fd0b40e4b30 con 0x7fd0c4107060 2024-07-24T22:05:10.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.433+0000 7fd0cacc4640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083] conn(0x7fd0b00bdbe0 0x7fd0b00c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:10.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.434+0000 7fd0ca4c3640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd0b00b3cb0 0x7fd0b00b6170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009430 tx=0x7fd0c0009360 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:10.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.434+0000 7fd0cacc4640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083] conn(0x7fd0b00bdbe0 0x7fd0b00c0080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:10.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.435+0000 7fd0bb7fe640 1 -- 172.21.15.47:0/2800774080 <== osd.5 v2:172.21.15.188:6808/2097128083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd0b4015e80 con 0x7fd0b00bdbe0 2024-07-24T22:05:10.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.449+0000 7fd0cc727640 1 -- 172.21.15.47:0/2800774080 --> [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd0c40636d0 con 0x7fd0b00bdbe0 2024-07-24T22:05:10.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.450+0000 7fd0bb7fe640 1 -- 172.21.15.47:0/2800774080 <== osd.5 v2:172.21.15.188:6808/2097128083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd0c40636d0 con 0x7fd0b00bdbe0 2024-07-24T22:05:10.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.450+0000 7fd0cc727640 1 -- 172.21.15.47:0/2800774080 >> [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083] conn(0x7fd0b00bdbe0 msgr2=0x7fd0b00c0080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:10.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.450+0000 7fd0cc727640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083] conn(0x7fd0b00bdbe0 0x7fd0b00c0080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.450+0000 7fd0cc727640 1 -- 172.21.15.47:0/2800774080 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd0b00b3cb0 msgr2=0x7fd0b00b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:10.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.450+0000 7fd0cc727640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd0b00b3cb0 0x7fd0b00b6170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009430 tx=0x7fd0c0009360 comp rx=0 tx=0).stop 2024-07-24T22:05:10.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.450+0000 7fd0cc727640 1 -- 172.21.15.47:0/2800774080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0c4107060 msgr2=0x7fd0c4199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:10.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.450+0000 7fd0cc727640 1 --2- 172.21.15.47:0/2800774080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0c4107060 0x7fd0c4199fa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd0b400e9f0 tx=0x7fd0b400edf0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.450+0000 7fd0cacc4640 1 -- 172.21.15.47:0/2800774080 reap_dead start 2024-07-24T22:05:10.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.450+0000 7fd0cc727640 1 -- 172.21.15.47:0/2800774080 shutdown_connections 2024-07-24T22:05:10.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.450+0000 7fd0cc727640 1 -- 172.21.15.47:0/2800774080 >> 172.21.15.47:0/2800774080 conn(0x7fd0c40fd0c0 msgr2=0x7fd0c40ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:10.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.450+0000 7fd0cc727640 1 -- 172.21.15.47:0/2800774080 shutdown_connections 2024-07-24T22:05:10.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:10.450+0000 7fd0cc727640 1 -- 172.21.15.47:0/2800774080 wait complete. 2024-07-24T22:05:10.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.878+0000 7f2c2eb74640 1 -- 172.21.15.47:0/2719244249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c28107070 msgr2=0x7f2c281074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:10.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.878+0000 7f2c2eb74640 1 --2- 172.21.15.47:0/2719244249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c28107070 0x7f2c281074b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009900 tx=0x7f2c1802a410 comp rx=0 tx=0).stop 2024-07-24T22:05:10.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.878+0000 7f2c2eb74640 1 -- 172.21.15.47:0/2719244249 shutdown_connections 2024-07-24T22:05:10.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.878+0000 7f2c2eb74640 1 --2- 172.21.15.47:0/2719244249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c281079f0 0x7f2c2810e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.878+0000 7f2c2eb74640 1 --2- 172.21.15.47:0/2719244249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c28107070 0x7f2c281074b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.878+0000 7f2c2eb74640 1 --2- 172.21.15.47:0/2719244249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c28101660 0x7f2c28101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.878+0000 7f2c2eb74640 1 -- 172.21.15.47:0/2719244249 >> 172.21.15.47:0/2719244249 conn(0x7f2c280fd0f0 msgr2=0x7f2c280ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:10.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.878+0000 7f2c2eb74640 1 -- 172.21.15.47:0/2719244249 shutdown_connections 2024-07-24T22:05:10.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.878+0000 7f2c2eb74640 1 -- 172.21.15.47:0/2719244249 wait complete. 2024-07-24T22:05:10.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.878+0000 7f2c2eb74640 1 Processor -- start 2024-07-24T22:05:10.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.878+0000 7f2c2eb74640 1 -- start start 2024-07-24T22:05:10.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2eb74640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c28101660 0x7f2c2810ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:10.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2eb74640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c28107070 0x7f2c2810f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:10.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2eb74640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c281079f0 0x7f2c2810f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:10.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2eb74640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2c28112760 con 0x7f2c28101660 2024-07-24T22:05:10.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2eb74640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2c281125e0 con 0x7f2c281079f0 2024-07-24T22:05:10.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2eb74640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2c281128e0 con 0x7f2c28107070 2024-07-24T22:05:10.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2c910640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c28101660 0x7f2c2810ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:10.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2c910640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c28101660 0x7f2c2810ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47570/0 (socket says 172.21.15.47:47570) 2024-07-24T22:05:10.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2c910640 1 -- 172.21.15.47:0/1247639933 learned_addr learned my addr 172.21.15.47:0/1247639933 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:10.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2d111640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c281079f0 0x7f2c2810f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:10.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c1ffff640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c28107070 0x7f2c2810f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:10.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2c910640 1 -- 172.21.15.47:0/1247639933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c28107070 msgr2=0x7f2c2810f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:10.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2c910640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c28107070 0x7f2c2810f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2c910640 1 -- 172.21.15.47:0/1247639933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c281079f0 msgr2=0x7f2c2810f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:10.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2c910640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c281079f0 0x7f2c2810f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2c910640 1 -- 172.21.15.47:0/1247639933 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c281a7070 con 0x7f2c28101660 2024-07-24T22:05:10.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2c910640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c28101660 0x7f2c2810ed00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400c890 tx=0x7f2c2400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:10.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c1dffb640 1 -- 172.21.15.47:0/1247639933 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24004220 con 0x7f2c28101660 2024-07-24T22:05:10.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c1dffb640 1 -- 172.21.15.47:0/1247639933 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c240043c0 con 0x7f2c28101660 2024-07-24T22:05:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c2eb74640 1 -- 172.21.15.47:0/1247639933 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c281a7360 con 0x7f2c28101660 2024-07-24T22:05:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.879+0000 7f2c1dffb640 1 -- 172.21.15.47:0/1247639933 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24004a00 con 0x7f2c28101660 2024-07-24T22:05:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.880+0000 7f2c2eb74640 1 -- 172.21.15.47:0/1247639933 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c281a7870 con 0x7f2c28101660 2024-07-24T22:05:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.880+0000 7f2c2eb74640 1 -- 172.21.15.47:0/1247639933 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2c280632d0 con 0x7f2c28101660 2024-07-24T22:05:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.882+0000 7f2c1dffb640 1 -- 172.21.15.47:0/1247639933 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f2c240079b0 con 0x7f2c28101660 2024-07-24T22:05:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.882+0000 7f2c1dffb640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2c100b3cb0 0x7f2c100b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.883+0000 7f2c1ffff640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2c100b3cb0 0x7f2c100b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.883+0000 7f2c1dffb640 1 -- 172.21.15.47:0/1247639933 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f2c240e3bb0 con 0x7f2c28101660 2024-07-24T22:05:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.883+0000 7f2c1dffb640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199] conn(0x7f2c100bdbe0 0x7f2c100c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.883+0000 7f2c1dffb640 1 -- 172.21.15.47:0/1247639933 --> [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c100c0750 con 0x7f2c100bdbe0 2024-07-24T22:05:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.883+0000 7f2c1dffb640 1 -- 172.21.15.47:0/1247639933 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f2c240e82c0 con 0x7f2c28101660 2024-07-24T22:05:10.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.883+0000 7f2c1ffff640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2c100b3cb0 0x7f2c100b6170 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2c18031440 tx=0x7f2c18005b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:10.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.883+0000 7f2c2d111640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199] conn(0x7f2c100bdbe0 0x7f2c100c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:10.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.883+0000 7f2c2d111640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199] conn(0x7f2c100bdbe0 0x7f2c100c0080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:10.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.884+0000 7f2c1dffb640 1 -- 172.21.15.47:0/1247639933 <== osd.10 v2:172.21.15.183:6824/3509332199 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2c100c0750 con 0x7f2c100bdbe0 2024-07-24T22:05:10.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.899+0000 7f2c2eb74640 1 -- 172.21.15.47:0/1247639933 --> [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2c28063750 con 0x7f2c100bdbe0 2024-07-24T22:05:10.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.900+0000 7f2c1dffb640 1 -- 172.21.15.47:0/1247639933 <== osd.10 v2:172.21.15.183:6824/3509332199 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2c28063750 con 0x7f2c100bdbe0 2024-07-24T22:05:10.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.900+0000 7f2c2eb74640 1 -- 172.21.15.47:0/1247639933 >> [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199] conn(0x7f2c100bdbe0 msgr2=0x7f2c100c0080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:10.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.900+0000 7f2c2eb74640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199] conn(0x7f2c100bdbe0 0x7f2c100c0080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:10.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.900+0000 7f2c2eb74640 1 -- 172.21.15.47:0/1247639933 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2c100b3cb0 msgr2=0x7f2c100b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:10.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.900+0000 7f2c2eb74640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2c100b3cb0 0x7f2c100b6170 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2c18031440 tx=0x7f2c18005b50 comp rx=0 tx=0).stop 2024-07-24T22:05:10.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.900+0000 7f2c2eb74640 1 -- 172.21.15.47:0/1247639933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c28101660 msgr2=0x7f2c2810ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:10.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.900+0000 7f2c2eb74640 1 --2- 172.21.15.47:0/1247639933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c28101660 0x7f2c2810ed00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400c890 tx=0x7f2c2400cd50 comp rx=0 tx=0).stop 2024-07-24T22:05:10.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.900+0000 7f2c2d111640 1 -- 172.21.15.47:0/1247639933 reap_dead start 2024-07-24T22:05:10.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.900+0000 7f2c2eb74640 1 -- 172.21.15.47:0/1247639933 shutdown_connections 2024-07-24T22:05:10.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.900+0000 7f2c2eb74640 1 -- 172.21.15.47:0/1247639933 >> 172.21.15.47:0/1247639933 conn(0x7f2c280fd0f0 msgr2=0x7f2c280ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:10.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.900+0000 7f2c2eb74640 1 -- 172.21.15.47:0/1247639933 shutdown_connections 2024-07-24T22:05:10.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:09.900+0000 7f2c2eb74640 1 -- 172.21.15.47:0/1247639933 wait complete. 2024-07-24T22:05:10.998 INFO:teuthology.orchestra.run.smithi047.stdout:266287972391 2024-07-24T22:05:10.998 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-07-24T22:05:11.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.177+0000 7f9f2a107640 1 -- 172.21.15.47:0/2414891901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f24103f50 msgr2=0x7f9f2410c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:11.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.177+0000 7f9f2a107640 1 --2- 172.21.15.47:0/2414891901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f24103f50 0x7f9f2410c530 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009900 tx=0x7f9f1802a410 comp rx=0 tx=0).stop 2024-07-24T22:05:11.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.177+0000 7f9f2a107640 1 -- 172.21.15.47:0/2414891901 shutdown_connections 2024-07-24T22:05:11.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.177+0000 7f9f2a107640 1 --2- 172.21.15.47:0/2414891901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f2410cb00 0x7f9f2410ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:11.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.177+0000 7f9f2a107640 1 --2- 172.21.15.47:0/2414891901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f24103f50 0x7f9f2410c530 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:11.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.177+0000 7f9f2a107640 1 --2- 172.21.15.47:0/2414891901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f24103550 0x7f9f24103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:11.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.177+0000 7f9f2a107640 1 -- 172.21.15.47:0/2414891901 >> 172.21.15.47:0/2414891901 conn(0x7f9f240fd0c0 msgr2=0x7f9f240ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.178+0000 7f9f2a107640 1 -- 172.21.15.47:0/2414891901 shutdown_connections 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.178+0000 7f9f2a107640 1 -- 172.21.15.47:0/2414891901 wait complete. 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.178+0000 7f9f2a107640 1 Processor -- start 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.178+0000 7f9f2a107640 1 -- start start 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f2a107640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f24103550 0x7f9f241013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f2a107640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f24103f50 0x7f9f24101910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f2a107640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2410cb00 0x7f9f24101e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f2a107640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9f24112700 con 0x7f9f24103550 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f2a107640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9f24112580 con 0x7f9f2410cb00 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f2a107640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9f24112880 con 0x7f9f24103f50 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f24103550 0x7f9f241013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f24103550 0x7f9f241013d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47620/0 (socket says 172.21.15.47:47620) 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f237fe640 1 -- 172.21.15.47:0/880619999 learned_addr learned my addr 172.21.15.47:0/880619999 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f23fff640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2410cb00 0x7f9f24101e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:11.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f22ffd640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f24103f50 0x7f9f24101910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f237fe640 1 -- 172.21.15.47:0/880619999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f24103f50 msgr2=0x7f9f24101910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f237fe640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f24103f50 0x7f9f24101910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f237fe640 1 -- 172.21.15.47:0/880619999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2410cb00 msgr2=0x7f9f24101e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f237fe640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2410cb00 0x7f9f24101e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f237fe640 1 -- 172.21.15.47:0/880619999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f241a7030 con 0x7f9f24103550 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f237fe640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f24103550 0x7f9f241013d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400e9f0 tx=0x7f9f1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f20ff9640 1 -- 172.21.15.47:0/880619999 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1400cd80 con 0x7f9f24103550 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.179+0000 7f9f2a107640 1 -- 172.21.15.47:0/880619999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f241a7320 con 0x7f9f24103550 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.180+0000 7f9f20ff9640 1 -- 172.21.15.47:0/880619999 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f140108e0 con 0x7f9f24103550 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.180+0000 7f9f20ff9640 1 -- 172.21.15.47:0/880619999 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14018980 con 0x7f9f24103550 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.180+0000 7f9f2a107640 1 -- 172.21.15.47:0/880619999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f241a7880 con 0x7f9f24103550 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.180+0000 7f9f2a107640 1 -- 172.21.15.47:0/880619999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9f240ff730 con 0x7f9f24103550 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.182+0000 7f9f20ff9640 1 -- 172.21.15.47:0/880619999 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f9f14010430 con 0x7f9f24103550 2024-07-24T22:05:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.183+0000 7f9f20ff9640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9f0c0b3d30 0x7f9f0c0b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.183+0000 7f9f22ffd640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9f0c0b3d30 0x7f9f0c0b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.183+0000 7f9f20ff9640 1 -- 172.21.15.47:0/880619999 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f9f140e4a30 con 0x7f9f24103550 2024-07-24T22:05:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.183+0000 7f9f20ff9640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514] conn(0x7f9f0c0bdc60 0x7f9f0c0c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.183+0000 7f9f20ff9640 1 -- 172.21.15.47:0/880619999 --> [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f0c0c07d0 con 0x7f9f0c0bdc60 2024-07-24T22:05:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.183+0000 7f9f20ff9640 1 -- 172.21.15.47:0/880619999 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f9f140e4e80 con 0x7f9f24103550 2024-07-24T22:05:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.183+0000 7f9f22ffd640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9f0c0b3d30 0x7f9f0c0b61f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9f18031440 tx=0x7f9f180095f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.184+0000 7f9f23fff640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514] conn(0x7f9f0c0bdc60 0x7f9f0c0c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.184+0000 7f9f23fff640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514] conn(0x7f9f0c0bdc60 0x7f9f0c0c0100 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.185+0000 7f9f20ff9640 1 -- 172.21.15.47:0/880619999 <== osd.7 v2:172.21.15.183:6816/465426514 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9f0c0c07d0 con 0x7f9f0c0bdc60 2024-07-24T22:05:11.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.201+0000 7f9f2a107640 1 -- 172.21.15.47:0/880619999 --> [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9f2406aab0 con 0x7f9f0c0bdc60 2024-07-24T22:05:11.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.202+0000 7f9f20ff9640 1 -- 172.21.15.47:0/880619999 <== osd.7 v2:172.21.15.183:6816/465426514 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9f2406aab0 con 0x7f9f0c0bdc60 2024-07-24T22:05:11.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.202+0000 7f9f2a107640 1 -- 172.21.15.47:0/880619999 >> [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514] conn(0x7f9f0c0bdc60 msgr2=0x7f9f0c0c0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:11.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.202+0000 7f9f2a107640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514] conn(0x7f9f0c0bdc60 0x7f9f0c0c0100 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:11.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.202+0000 7f9f2a107640 1 -- 172.21.15.47:0/880619999 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9f0c0b3d30 msgr2=0x7f9f0c0b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:11.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.202+0000 7f9f2a107640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9f0c0b3d30 0x7f9f0c0b61f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9f18031440 tx=0x7f9f180095f0 comp rx=0 tx=0).stop 2024-07-24T22:05:11.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.202+0000 7f9f2a107640 1 -- 172.21.15.47:0/880619999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f24103550 msgr2=0x7f9f241013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:11.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.202+0000 7f9f2a107640 1 --2- 172.21.15.47:0/880619999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f24103550 0x7f9f241013d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400e9f0 tx=0x7f9f1400eeb0 comp rx=0 tx=0).stop 2024-07-24T22:05:11.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.202+0000 7f9f23fff640 1 -- 172.21.15.47:0/880619999 reap_dead start 2024-07-24T22:05:11.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.202+0000 7f9f2a107640 1 -- 172.21.15.47:0/880619999 shutdown_connections 2024-07-24T22:05:11.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.202+0000 7f9f2a107640 1 -- 172.21.15.47:0/880619999 >> 172.21.15.47:0/880619999 conn(0x7f9f240fd0c0 msgr2=0x7f9f240fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:11.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.202+0000 7f9f2a107640 1 -- 172.21.15.47:0/880619999 shutdown_connections 2024-07-24T22:05:11.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:11.202+0000 7f9f2a107640 1 -- 172.21.15.47:0/880619999 wait complete. 2024-07-24T22:05:11.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:11 smithi047 ceph-mon[32551]: pgmap v303: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:11.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:11 smithi188 ceph-mon[37380]: pgmap v303: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:11.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:11 smithi183 ceph-mon[37007]: pgmap v303: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:12.066 INFO:teuthology.orchestra.run.smithi047.stdout:313532612638 2024-07-24T22:05:12.066 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-07-24T22:05:12.540 INFO:teuthology.orchestra.run.smithi047.stdout:210453397552 2024-07-24T22:05:12.541 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-07-24T22:05:12.925 INFO:teuthology.orchestra.run.smithi047.stdout:163208757306 2024-07-24T22:05:12.925 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-07-24T22:05:13.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.642+0000 7ff0b2050640 1 -- 172.21.15.47:0/450542071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac10cb00 msgr2=0x7ff0ac10ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.642+0000 7ff0b2050640 1 --2- 172.21.15.47:0/450542071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac10cb00 0x7ff0ac10ef60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009ca0 tx=0x7ff0a402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:05:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.642+0000 7ff0b2050640 1 -- 172.21.15.47:0/450542071 shutdown_connections 2024-07-24T22:05:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.642+0000 7ff0b2050640 1 --2- 172.21.15.47:0/450542071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac10cb00 0x7ff0ac10ef60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.642+0000 7ff0b2050640 1 --2- 172.21.15.47:0/450542071 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0ac103fc0 0x7ff0ac10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.642+0000 7ff0b2050640 1 --2- 172.21.15.47:0/450542071 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0ac1036a0 0x7ff0ac103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.642+0000 7ff0b2050640 1 -- 172.21.15.47:0/450542071 >> 172.21.15.47:0/450542071 conn(0x7ff0ac0fd100 msgr2=0x7ff0ac0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.642+0000 7ff0b2050640 1 -- 172.21.15.47:0/450542071 shutdown_connections 2024-07-24T22:05:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.642+0000 7ff0b2050640 1 -- 172.21.15.47:0/450542071 wait complete. 2024-07-24T22:05:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.642+0000 7ff0b2050640 1 Processor -- start 2024-07-24T22:05:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0b2050640 1 -- start start 2024-07-24T22:05:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0b2050640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac1036a0 0x7ff0ac198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0b2050640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0ac103fc0 0x7ff0ac1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0b2050640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0ac10cb00 0x7ff0ac19e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0b2050640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac112760 con 0x7ff0ac1036a0 2024-07-24T22:05:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0b2050640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac1125e0 con 0x7ff0ac103fc0 2024-07-24T22:05:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0b2050640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac1128e0 con 0x7ff0ac10cb00 2024-07-24T22:05:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0ab7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac1036a0 0x7ff0ac198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0ab7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac1036a0 0x7ff0ac198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47648/0 (socket says 172.21.15.47:47648) 2024-07-24T22:05:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0ab7fe640 1 -- 172.21.15.47:0/449171744 learned_addr learned my addr 172.21.15.47:0/449171744 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:13.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0a3fff640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0ac103fc0 0x7ff0ac1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:13.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0abfff640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0ac10cb00 0x7ff0ac19e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:13.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0ab7fe640 1 -- 172.21.15.47:0/449171744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0ac10cb00 msgr2=0x7ff0ac19e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:13.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0ab7fe640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0ac10cb00 0x7ff0ac19e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:13.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0ab7fe640 1 -- 172.21.15.47:0/449171744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0ac103fc0 msgr2=0x7ff0ac1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:13.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0ab7fe640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0ac103fc0 0x7ff0ac1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:13.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0ab7fe640 1 -- 172.21.15.47:0/449171744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ac19ed60 con 0x7ff0ac1036a0 2024-07-24T22:05:13.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.643+0000 7ff0abfff640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0ac10cb00 0x7ff0ac19e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.644+0000 7ff0ab7fe640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac1036a0 0x7ff0ac198cb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff09c00c970 tx=0x7ff09c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.644+0000 7ff0a97fa640 1 -- 172.21.15.47:0/449171744 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c007bb0 con 0x7ff0ac1036a0 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.644+0000 7ff0a97fa640 1 -- 172.21.15.47:0/449171744 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff09c007d50 con 0x7ff0ac1036a0 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.644+0000 7ff0a97fa640 1 -- 172.21.15.47:0/449171744 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c00f450 con 0x7ff0ac1036a0 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.644+0000 7ff0b2050640 1 -- 172.21.15.47:0/449171744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0ac19f050 con 0x7ff0ac1036a0 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.644+0000 7ff0b2050640 1 -- 172.21.15.47:0/449171744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0ac1a5710 con 0x7ff0ac1036a0 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.645+0000 7ff0b2050640 1 -- 172.21.15.47:0/449171744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0ac0ff060 con 0x7ff0ac1036a0 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.646+0000 7ff0a97fa640 1 -- 172.21.15.47:0/449171744 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7ff09c004f00 con 0x7ff0ac1036a0 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.647+0000 7ff0a97fa640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff0980b3d30 0x7ff0980b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.647+0000 7ff0a3fff640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff0980b3d30 0x7ff0980b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.647+0000 7ff0a97fa640 1 -- 172.21.15.47:0/449171744 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7ff09c0e3ff0 con 0x7ff0ac1036a0 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.647+0000 7ff0a97fa640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980] conn(0x7ff0980bdc60 0x7ff0980c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.647+0000 7ff0a97fa640 1 -- 172.21.15.47:0/449171744 --> [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff09c012ec0 con 0x7ff0980bdc60 2024-07-24T22:05:13.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.647+0000 7ff0a97fa640 1 -- 172.21.15.47:0/449171744 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7ff09c0e4440 con 0x7ff0ac1036a0 2024-07-24T22:05:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.647+0000 7ff0abfff640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980] conn(0x7ff0980bdc60 0x7ff0980c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.647+0000 7ff0a3fff640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff0980b3d30 0x7ff0980b61f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0ff8a0 tx=0x7ff094005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.648+0000 7ff0abfff640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980] conn(0x7ff0980bdc60 0x7ff0980c0100 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.648+0000 7ff0a97fa640 1 -- 172.21.15.47:0/449171744 <== osd.6 v2:172.21.15.47:6818/2288252980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff09c012ec0 con 0x7ff0980bdc60 2024-07-24T22:05:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.663+0000 7ff0b2050640 1 -- 172.21.15.47:0/449171744 --> [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0ac06b550 con 0x7ff0980bdc60 2024-07-24T22:05:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.663+0000 7ff0a97fa640 1 -- 172.21.15.47:0/449171744 <== osd.6 v2:172.21.15.47:6818/2288252980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff0ac06b550 con 0x7ff0980bdc60 2024-07-24T22:05:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.663+0000 7ff0b2050640 1 -- 172.21.15.47:0/449171744 >> [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980] conn(0x7ff0980bdc60 msgr2=0x7ff0980c0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.663+0000 7ff0b2050640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980] conn(0x7ff0980bdc60 0x7ff0980c0100 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.663+0000 7ff0b2050640 1 -- 172.21.15.47:0/449171744 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff0980b3d30 msgr2=0x7ff0980b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.663+0000 7ff0b2050640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff0980b3d30 0x7ff0980b61f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0ff8a0 tx=0x7ff094005f90 comp rx=0 tx=0).stop 2024-07-24T22:05:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.663+0000 7ff0b2050640 1 -- 172.21.15.47:0/449171744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac1036a0 msgr2=0x7ff0ac198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.663+0000 7ff0b2050640 1 --2- 172.21.15.47:0/449171744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac1036a0 0x7ff0ac198cb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff09c00c970 tx=0x7ff09c00ce30 comp rx=0 tx=0).stop 2024-07-24T22:05:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.663+0000 7ff0abfff640 1 -- 172.21.15.47:0/449171744 reap_dead start 2024-07-24T22:05:13.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.664+0000 7ff0b2050640 1 -- 172.21.15.47:0/449171744 shutdown_connections 2024-07-24T22:05:13.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.664+0000 7ff0b2050640 1 -- 172.21.15.47:0/449171744 >> 172.21.15.47:0/449171744 conn(0x7ff0ac0fd100 msgr2=0x7ff0ac10ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:13.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.664+0000 7ff0b2050640 1 -- 172.21.15.47:0/449171744 shutdown_connections 2024-07-24T22:05:13.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:13.664+0000 7ff0b2050640 1 -- 172.21.15.47:0/449171744 wait complete. 2024-07-24T22:05:13.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:13 smithi047 ceph-mon[32551]: pgmap v304: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:13.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:13 smithi188 ceph-mon[37380]: pgmap v304: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:13.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:13 smithi183 ceph-mon[37007]: pgmap v304: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:14.427 INFO:teuthology.orchestra.run.smithi047.stdout:287762808865 2024-07-24T22:05:14.427 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-07-24T22:05:15.417 INFO:teuthology.orchestra.run.smithi047.stdout:188978561078 2024-07-24T22:05:15.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-07-24T22:05:15.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:15 smithi047 ceph-mon[32551]: pgmap v305: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:15.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.759+0000 7fc08b70c640 1 -- 172.21.15.47:0/1381281451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0841011f0 msgr2=0x7fc0841015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:15.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.759+0000 7fc08b70c640 1 --2- 172.21.15.47:0/1381281451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0841011f0 0x7fc0841015d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc080009900 tx=0x7fc08002a480 comp rx=0 tx=0).stop 2024-07-24T22:05:15.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.759+0000 7fc08b70c640 1 -- 172.21.15.47:0/1381281451 shutdown_connections 2024-07-24T22:05:15.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.759+0000 7fc08b70c640 1 --2- 172.21.15.47:0/1381281451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc08410eda0 0x7fc084111190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:15.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.759+0000 7fc08b70c640 1 --2- 172.21.15.47:0/1381281451 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc084101b10 0x7fc08410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:15.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.759+0000 7fc08b70c640 1 --2- 172.21.15.47:0/1381281451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0841011f0 0x7fc0841015d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:15.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.759+0000 7fc08b70c640 1 -- 172.21.15.47:0/1381281451 >> 172.21.15.47:0/1381281451 conn(0x7fc0840fd0c0 msgr2=0x7fc0840ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:15.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.759+0000 7fc08b70c640 1 -- 172.21.15.47:0/1381281451 shutdown_connections 2024-07-24T22:05:15.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.759+0000 7fc08b70c640 1 -- 172.21.15.47:0/1381281451 wait complete. 2024-07-24T22:05:15.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.760+0000 7fc08b70c640 1 Processor -- start 2024-07-24T22:05:15.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.760+0000 7fc08b70c640 1 -- start start 2024-07-24T22:05:15.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.760+0000 7fc08b70c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0841011f0 0x7fc08419adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:15.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.760+0000 7fc08b70c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc084101b10 0x7fc08419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:15.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.760+0000 7fc08b70c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc08410eda0 0x7fc0841a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:15.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.760+0000 7fc08b70c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841148e0 con 0x7fc08410eda0 2024-07-24T22:05:15.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.760+0000 7fc08b70c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc084114760 con 0x7fc084101b10 2024-07-24T22:05:15.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.760+0000 7fc08b70c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc084114a60 con 0x7fc0841011f0 2024-07-24T22:05:15.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.760+0000 7fc089ca9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc08410eda0 0x7fc0841a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:15.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.760+0000 7fc089ca9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc08410eda0 0x7fc0841a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59190/0 (socket says 172.21.15.47:59190) 2024-07-24T22:05:15.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.760+0000 7fc089ca9640 1 -- 172.21.15.47:0/2724780472 learned_addr learned my addr 172.21.15.47:0/2724780472 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:15.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc088ca7640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc084101b10 0x7fc08419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:15.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc0894a8640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0841011f0 0x7fc08419adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:15.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc089ca9640 1 -- 172.21.15.47:0/2724780472 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0841011f0 msgr2=0x7fc08419adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:15.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc089ca9640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0841011f0 0x7fc08419adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:15.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc089ca9640 1 -- 172.21.15.47:0/2724780472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc084101b10 msgr2=0x7fc08419b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:15.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc089ca9640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc084101b10 0x7fc08419b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:15.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc089ca9640 1 -- 172.21.15.47:0/2724780472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0841a0ea0 con 0x7fc08410eda0 2024-07-24T22:05:15.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc0894a8640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0841011f0 0x7fc08419adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:05:15.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc088ca7640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc084101b10 0x7fc08419b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:15.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc089ca9640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc08410eda0 0x7fc0841a06d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00eaa0 tx=0x7fc07c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:15.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc07a7fc640 1 -- 172.21.15.47:0/2724780472 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c00cdb0 con 0x7fc08410eda0 2024-07-24T22:05:15.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc07a7fc640 1 -- 172.21.15.47:0/2724780472 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc07c005020 con 0x7fc08410eda0 2024-07-24T22:05:15.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc08b70c640 1 -- 172.21.15.47:0/2724780472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0841a1190 con 0x7fc08410eda0 2024-07-24T22:05:15.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc07a7fc640 1 -- 172.21.15.47:0/2724780472 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0116d0 con 0x7fc08410eda0 2024-07-24T22:05:15.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.761+0000 7fc08b70c640 1 -- 172.21.15.47:0/2724780472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0841a7850 con 0x7fc08410eda0 2024-07-24T22:05:15.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.762+0000 7fc08b70c640 1 -- 172.21.15.47:0/2724780472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc084110410 con 0x7fc08410eda0 2024-07-24T22:05:15.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.764+0000 7fc07a7fc640 1 -- 172.21.15.47:0/2724780472 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fc07c0051d0 con 0x7fc08410eda0 2024-07-24T22:05:15.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.764+0000 7fc07a7fc640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc0700b3d30 0x7fc0700b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:15.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.764+0000 7fc0894a8640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc0700b3d30 0x7fc0700b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:15.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.764+0000 7fc07a7fc640 1 -- 172.21.15.47:0/2724780472 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7fc07c0e4120 con 0x7fc08410eda0 2024-07-24T22:05:15.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.765+0000 7fc07a7fc640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658] conn(0x7fc0700bdc60 0x7fc0700c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:15.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.765+0000 7fc07a7fc640 1 -- 172.21.15.47:0/2724780472 --> [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0700c07d0 con 0x7fc0700bdc60 2024-07-24T22:05:15.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.765+0000 7fc07a7fc640 1 -- 172.21.15.47:0/2724780472 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fc07c0eb050 con 0x7fc08410eda0 2024-07-24T22:05:15.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.765+0000 7fc0894a8640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc0700b3d30 0x7fc0700b61f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc080000c00 tx=0x7fc080031400 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:15.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.765+0000 7fc088ca7640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658] conn(0x7fc0700bdc60 0x7fc0700c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:15.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.765+0000 7fc088ca7640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658] conn(0x7fc0700bdc60 0x7fc0700c0100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:15.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.766+0000 7fc07a7fc640 1 -- 172.21.15.47:0/2724780472 <== osd.8 v2:172.21.15.188:6816/2247055658 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc0700c07d0 con 0x7fc0700bdc60 2024-07-24T22:05:15.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.791+0000 7fc08b70c640 1 -- 172.21.15.47:0/2724780472 --> [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc08406ab70 con 0x7fc0700bdc60 2024-07-24T22:05:15.793 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:15.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.792+0000 7fc07a7fc640 1 -- 172.21.15.47:0/2724780472 <== osd.8 v2:172.21.15.188:6816/2247055658 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc08406ab70 con 0x7fc0700bdc60 2024-07-24T22:05:15.794 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:15.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.792+0000 7fc08b70c640 1 -- 172.21.15.47:0/2724780472 >> [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658] conn(0x7fc0700bdc60 msgr2=0x7fc0700c0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:15.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.792+0000 7fc08b70c640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658] conn(0x7fc0700bdc60 0x7fc0700c0100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:15.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.792+0000 7fc08b70c640 1 -- 172.21.15.47:0/2724780472 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc0700b3d30 msgr2=0x7fc0700b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:15.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.792+0000 7fc08b70c640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc0700b3d30 0x7fc0700b61f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc080000c00 tx=0x7fc080031400 comp rx=0 tx=0).stop 2024-07-24T22:05:15.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.792+0000 7fc08b70c640 1 -- 172.21.15.47:0/2724780472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc08410eda0 msgr2=0x7fc0841a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:15.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.792+0000 7fc08b70c640 1 --2- 172.21.15.47:0/2724780472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc08410eda0 0x7fc0841a06d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00eaa0 tx=0x7fc07c00ef60 comp rx=0 tx=0).stop 2024-07-24T22:05:15.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.792+0000 7fc089ca9640 1 -- 172.21.15.47:0/2724780472 reap_dead start 2024-07-24T22:05:15.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.793+0000 7fc08b70c640 1 -- 172.21.15.47:0/2724780472 shutdown_connections 2024-07-24T22:05:15.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.793+0000 7fc08b70c640 1 -- 172.21.15.47:0/2724780472 >> 172.21.15.47:0/2724780472 conn(0x7fc0840fd0c0 msgr2=0x7fc084110fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:15.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.793+0000 7fc08b70c640 1 -- 172.21.15.47:0/2724780472 shutdown_connections 2024-07-24T22:05:15.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:15.793+0000 7fc08b70c640 1 -- 172.21.15.47:0/2724780472 wait complete. 2024-07-24T22:05:15.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:15 smithi188 ceph-mon[37380]: pgmap v305: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:15.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:15 smithi183 ceph-mon[37007]: pgmap v305: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:16.838 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.840+0000 7f544bd35640 1 -- 172.21.15.47:0/3275093120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5444075930 msgr2=0x7f544410e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.840+0000 7f544bd35640 1 --2- 172.21.15.47:0/3275093120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5444075930 0x7f544410e7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5434009900 tx=0x7f543402a3f0 comp rx=0 tx=0).stop 2024-07-24T22:05:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.840+0000 7f544bd35640 1 -- 172.21.15.47:0/3275093120 shutdown_connections 2024-07-24T22:05:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.840+0000 7f544bd35640 1 --2- 172.21.15.47:0/3275093120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f544410ed70 0x7f5444111160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.840+0000 7f544bd35640 1 --2- 172.21.15.47:0/3275093120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5444075930 0x7f544410e7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.840+0000 7f544bd35640 1 --2- 172.21.15.47:0/3275093120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5444074f30 0x7f5444075310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.840+0000 7f544bd35640 1 -- 172.21.15.47:0/3275093120 >> 172.21.15.47:0/3275093120 conn(0x7f54440fe200 msgr2=0x7f5444100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.840+0000 7f544bd35640 1 -- 172.21.15.47:0/3275093120 shutdown_connections 2024-07-24T22:05:16.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.840+0000 7f544bd35640 1 -- 172.21.15.47:0/3275093120 wait complete. 2024-07-24T22:05:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.841+0000 7f544bd35640 1 Processor -- start 2024-07-24T22:05:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.841+0000 7f544bd35640 1 -- start start 2024-07-24T22:05:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.841+0000 7f544bd35640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5444074f30 0x7f544419ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.841+0000 7f544bd35640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5444075930 0x7f544419b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.841+0000 7f544bd35640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f544410ed70 0x7f54441a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.841+0000 7f544bd35640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5444114970 con 0x7f5444075930 2024-07-24T22:05:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.841+0000 7f544bd35640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f54441147f0 con 0x7f544410ed70 2024-07-24T22:05:16.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.841+0000 7f544bd35640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5444114af0 con 0x7f5444074f30 2024-07-24T22:05:16.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.841+0000 7f54492d0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5444075930 0x7f544419b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.841+0000 7f5449ad1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5444074f30 0x7f544419ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.841+0000 7f544a2d2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f544410ed70 0x7f54441a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.842+0000 7f5449ad1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5444074f30 0x7f544419ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:48792/0 (socket says 172.21.15.47:48792) 2024-07-24T22:05:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.842+0000 7f544a2d2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f544410ed70 0x7f54441a0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:57564/0 (socket says 172.21.15.47:57564) 2024-07-24T22:05:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.842+0000 7f5449ad1640 1 -- 172.21.15.47:0/4057714721 learned_addr learned my addr 172.21.15.47:0/4057714721 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.841+0000 7f54492d0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5444075930 0x7f544419b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59208/0 (socket says 172.21.15.47:59208) 2024-07-24T22:05:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.842+0000 7f544a2d2640 1 -- 172.21.15.47:0/4057714721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5444074f30 msgr2=0x7f544419ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.842+0000 7f544a2d2640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5444074f30 0x7f544419ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.842+0000 7f544a2d2640 1 -- 172.21.15.47:0/4057714721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5444075930 msgr2=0x7f544419b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.842+0000 7f544a2d2640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5444075930 0x7f544419b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:16.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.842+0000 7f544a2d2640 1 -- 172.21.15.47:0/4057714721 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54441a0f30 con 0x7f544410ed70 2024-07-24T22:05:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.842+0000 7f5449ad1640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5444074f30 0x7f544419ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.842+0000 7f54492d0640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5444075930 0x7f544419b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:05:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.842+0000 7f544a2d2640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f544410ed70 0x7f54441a0760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f543c005fd0 tx=0x7f543c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.843+0000 7f543affd640 1 -- 172.21.15.47:0/4057714721 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c00cdf0 con 0x7f544410ed70 2024-07-24T22:05:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.843+0000 7f543affd640 1 -- 172.21.15.47:0/4057714721 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f543c005020 con 0x7f544410ed70 2024-07-24T22:05:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.843+0000 7f544bd35640 1 -- 172.21.15.47:0/4057714721 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54441a1220 con 0x7f544410ed70 2024-07-24T22:05:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.843+0000 7f544bd35640 1 -- 172.21.15.47:0/4057714721 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54441a78e0 con 0x7f544410ed70 2024-07-24T22:05:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.843+0000 7f543affd640 1 -- 172.21.15.47:0/4057714721 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c010690 con 0x7f544410ed70 2024-07-24T22:05:16.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.844+0000 7f544bd35640 1 -- 172.21.15.47:0/4057714721 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5444100870 con 0x7f544410ed70 2024-07-24T22:05:16.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.849+0000 7f543affd640 1 -- 172.21.15.47:0/4057714721 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f543c005460 con 0x7f544410ed70 2024-07-24T22:05:16.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.850+0000 7f543affd640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f54300b3db0 0x7f54300b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:16.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.850+0000 7f543affd640 1 -- 172.21.15.47:0/4057714721 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f543c0e47e0 con 0x7f544410ed70 2024-07-24T22:05:16.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.851+0000 7f543affd640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281] conn(0x7f54300bdce0 0x7f54300c0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:16.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.851+0000 7f543affd640 1 -- 172.21.15.47:0/4057714721 --> [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f543c022e50 con 0x7f54300bdce0 2024-07-24T22:05:16.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.851+0000 7f543affd640 1 -- 172.21.15.47:0/4057714721 <== mon.2 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f543c0e4bd0 con 0x7f544410ed70 2024-07-24T22:05:16.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.851+0000 7f5449ad1640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f54300b3db0 0x7f54300b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:16.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.852+0000 7f54492d0640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281] conn(0x7f54300bdce0 0x7f54300c0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:16.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.852+0000 7f54492d0640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281] conn(0x7f54300bdce0 0x7f54300c0180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:16.859 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:16.859 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:16.859 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:16.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.853+0000 7f543affd640 1 -- 172.21.15.47:0/4057714721 <== osd.2 v2:172.21.15.188:6800/2245903281 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f543c022e50 con 0x7f54300bdce0 2024-07-24T22:05:16.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.854+0000 7f5449ad1640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f54300b3db0 0x7f54300b6270 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5440009ce0 tx=0x7f5440005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:16.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.879+0000 7f544bd35640 1 -- 172.21.15.47:0/4057714721 --> [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5444100b00 con 0x7f54300bdce0 2024-07-24T22:05:16.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.880+0000 7f543affd640 1 -- 172.21.15.47:0/4057714721 <== osd.2 v2:172.21.15.188:6800/2245903281 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5444100b00 con 0x7f54300bdce0 2024-07-24T22:05:16.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.880+0000 7f544bd35640 1 -- 172.21.15.47:0/4057714721 >> [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281] conn(0x7f54300bdce0 msgr2=0x7f54300c0180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:16.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.880+0000 7f544bd35640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281] conn(0x7f54300bdce0 0x7f54300c0180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:16.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.880+0000 7f544bd35640 1 -- 172.21.15.47:0/4057714721 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f54300b3db0 msgr2=0x7f54300b6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:16.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.880+0000 7f544bd35640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f54300b3db0 0x7f54300b6270 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5440009ce0 tx=0x7f5440005f90 comp rx=0 tx=0).stop 2024-07-24T22:05:16.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.881+0000 7f544bd35640 1 -- 172.21.15.47:0/4057714721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f544410ed70 msgr2=0x7f54441a0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:16.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.881+0000 7f544bd35640 1 --2- 172.21.15.47:0/4057714721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f544410ed70 0x7f54441a0760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f543c005fd0 tx=0x7f543c00ef10 comp rx=0 tx=0).stop 2024-07-24T22:05:16.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.881+0000 7f544a2d2640 1 -- 172.21.15.47:0/4057714721 reap_dead start 2024-07-24T22:05:16.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.881+0000 7f544bd35640 1 -- 172.21.15.47:0/4057714721 shutdown_connections 2024-07-24T22:05:16.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.881+0000 7f544bd35640 1 -- 172.21.15.47:0/4057714721 >> 172.21.15.47:0/4057714721 conn(0x7f54440fe200 msgr2=0x7f54440fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:16.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.881+0000 7f544bd35640 1 -- 172.21.15.47:0/4057714721 shutdown_connections 2024-07-24T22:05:16.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:16.881+0000 7f544bd35640 1 -- 172.21.15.47:0/4057714721 wait complete. 2024-07-24T22:05:17.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:17 smithi047 ceph-mon[32551]: pgmap v306: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:17.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:17 smithi188 ceph-mon[37380]: pgmap v306: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:17.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:17 smithi183 ceph-mon[37007]: pgmap v306: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:17.921 INFO:teuthology.orchestra.run.smithi047.stdout:240518168622 2024-07-24T22:05:17.922 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-07-24T22:05:19.727 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:19 smithi047 ceph-mon[32551]: pgmap v307: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:19.907 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:19.908 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:19.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:19 smithi183 ceph-mon[37007]: pgmap v307: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:19.912 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:20.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:19 smithi188 ceph-mon[37380]: pgmap v307: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:20.284 INFO:teuthology.orchestra.run.smithi047.stdout:81604378697 2024-07-24T22:05:20.285 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-07-24T22:05:21.816 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:21 smithi047 ceph-mon[32551]: pgmap v308: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:21.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:21 smithi183 ceph-mon[37007]: pgmap v308: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:22.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:21 smithi188 ceph-mon[37380]: pgmap v308: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:23.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.041+0000 7f4e98a18640 1 -- 172.21.15.47:0/403333624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e94107150 msgr2=0x7f4e94107590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:23.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.041+0000 7f4e98a18640 1 --2- 172.21.15.47:0/403333624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e94107150 0x7f4e94107590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009930 tx=0x7f4e8802a420 comp rx=0 tx=0).stop 2024-07-24T22:05:23.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.041+0000 7f4e98a18640 1 -- 172.21.15.47:0/403333624 shutdown_connections 2024-07-24T22:05:23.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.041+0000 7f4e98a18640 1 --2- 172.21.15.47:0/403333624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94107ad0 0x7f4e9410e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.041+0000 7f4e98a18640 1 --2- 172.21.15.47:0/403333624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e94107150 0x7f4e94107590 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.041+0000 7f4e98a18640 1 --2- 172.21.15.47:0/403333624 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e94102360 0x7f4e94102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.041+0000 7f4e98a18640 1 -- 172.21.15.47:0/403333624 >> 172.21.15.47:0/403333624 conn(0x7f4e94076890 msgr2=0x7f4e94076ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:23.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.041+0000 7f4e98a18640 1 -- 172.21.15.47:0/403333624 shutdown_connections 2024-07-24T22:05:23.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.041+0000 7f4e98a18640 1 -- 172.21.15.47:0/403333624 wait complete. 2024-07-24T22:05:23.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.041+0000 7f4e98a18640 1 Processor -- start 2024-07-24T22:05:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e98a18640 1 -- start start 2024-07-24T22:05:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e98a18640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e94102360 0x7f4e94198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e98a18640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94107150 0x7f4e941991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e98a18640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e94107ad0 0x7f4e9419e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e98a18640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4e94111600 con 0x7f4e94102360 2024-07-24T22:05:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e98a18640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4e94111480 con 0x7f4e94107150 2024-07-24T22:05:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e98a18640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4e94111780 con 0x7f4e94107ad0 2024-07-24T22:05:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e9259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e94102360 0x7f4e94198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e9259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e94102360 0x7f4e94198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59236/0 (socket says 172.21.15.47:59236) 2024-07-24T22:05:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e9259c640 1 -- 172.21.15.47:0/333240662 learned_addr learned my addr 172.21.15.47:0/333240662 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e91d9b640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94107150 0x7f4e941991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e92d9d640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e94107ad0 0x7f4e9419e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e9259c640 1 -- 172.21.15.47:0/333240662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e94107ad0 msgr2=0x7f4e9419e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e9259c640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e94107ad0 0x7f4e9419e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e9259c640 1 -- 172.21.15.47:0/333240662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94107150 msgr2=0x7f4e941991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e9259c640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94107150 0x7f4e941991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e9259c640 1 -- 172.21.15.47:0/333240662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9419ed50 con 0x7f4e94102360 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.042+0000 7f4e92d9d640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e94107ad0 0x7f4e9419e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.043+0000 7f4e9259c640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e94102360 0x7f4e94198ca0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400d770 tx=0x7f4e8400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.043+0000 7f4e837fe640 1 -- 172.21.15.47:0/333240662 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84017070 con 0x7f4e94102360 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.043+0000 7f4e98a18640 1 -- 172.21.15.47:0/333240662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e9419f040 con 0x7f4e94102360 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.043+0000 7f4e837fe640 1 -- 172.21.15.47:0/333240662 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e840054d0 con 0x7f4e94102360 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.043+0000 7f4e837fe640 1 -- 172.21.15.47:0/333240662 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84004c30 con 0x7f4e94102360 2024-07-24T22:05:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.043+0000 7f4e98a18640 1 -- 172.21.15.47:0/333240662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e941a5700 con 0x7f4e94102360 2024-07-24T22:05:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.044+0000 7f4e98a18640 1 -- 172.21.15.47:0/333240662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e94102740 con 0x7f4e94102360 2024-07-24T22:05:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.045+0000 7f4e837fe640 1 -- 172.21.15.47:0/333240662 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7f4e84004e10 con 0x7f4e94102360 2024-07-24T22:05:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.046+0000 7f4e837fe640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4e7c0b3cb0 0x7f4e7c0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.046+0000 7f4e91d9b640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4e7c0b3cb0 0x7f4e7c0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.046+0000 7f4e837fe640 1 -- 172.21.15.47:0/333240662 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7f4e840e3a00 con 0x7f4e94102360 2024-07-24T22:05:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.047+0000 7f4e91d9b640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4e7c0b3cb0 0x7f4e7c0b6170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009900 tx=0x7f4e88000bc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:23.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.050+0000 7f4e837fe640 1 -- 172.21.15.47:0/333240662 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f4e840e5e20 con 0x7f4e94102360 2024-07-24T22:05:23.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.249+0000 7f4e98a18640 1 -- 172.21.15.47:0/333240662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4e9410a8e0 con 0x7f4e94102360 2024-07-24T22:05:23.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.249+0000 7f4e837fe640 1 -- 172.21.15.47:0/333240662 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e840aadf0 con 0x7f4e94102360 2024-07-24T22:05:23.251 INFO:teuthology.orchestra.run.smithi047.stdout:38654705745 2024-07-24T22:05:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.251+0000 7f4e98a18640 1 -- 172.21.15.47:0/333240662 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4e7c0b3cb0 msgr2=0x7f4e7c0b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.251+0000 7f4e98a18640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4e7c0b3cb0 0x7f4e7c0b6170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009900 tx=0x7f4e88000bc0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.251+0000 7f4e98a18640 1 -- 172.21.15.47:0/333240662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e94102360 msgr2=0x7f4e94198ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.251+0000 7f4e98a18640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e94102360 0x7f4e94198ca0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400d770 tx=0x7f4e8400dc30 comp rx=0 tx=0).stop 2024-07-24T22:05:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.251+0000 7f4e98a18640 1 -- 172.21.15.47:0/333240662 shutdown_connections 2024-07-24T22:05:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.251+0000 7f4e98a18640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4e7c0b3cb0 0x7f4e7c0b6170 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.251+0000 7f4e98a18640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e94107ad0 0x7f4e9419e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.251+0000 7f4e98a18640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e94107150 0x7f4e941991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.251+0000 7f4e98a18640 1 --2- 172.21.15.47:0/333240662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e94102360 0x7f4e94198ca0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.251+0000 7f4e98a18640 1 -- 172.21.15.47:0/333240662 >> 172.21.15.47:0/333240662 conn(0x7f4e94076890 msgr2=0x7f4e94106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:23.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.251+0000 7f4e98a18640 1 -- 172.21.15.47:0/333240662 shutdown_connections 2024-07-24T22:05:23.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.251+0000 7f4e98a18640 1 -- 172.21.15.47:0/333240662 wait complete. 2024-07-24T22:05:23.383 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:23.888 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:23 smithi047 ceph-mon[32551]: pgmap v309: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-07-24T22:05:23.888 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:23 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/333240662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-07-24T22:05:23.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:23 smithi183 ceph-mon[37007]: pgmap v309: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-07-24T22:05:23.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:23 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/333240662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-07-24T22:05:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.972+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3695703507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf18107060 msgr2=0x7fcf181074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.972+0000 7fcf1e68d640 1 --2- 172.21.15.47:0/3695703507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf18107060 0x7fcf181074a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009900 tx=0x7fcf0002a3f0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.972+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3695703507 shutdown_connections 2024-07-24T22:05:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.972+0000 7fcf1e68d640 1 --2- 172.21.15.47:0/3695703507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf181079e0 0x7fcf1810e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.972+0000 7fcf1e68d640 1 --2- 172.21.15.47:0/3695703507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf18107060 0x7fcf181074a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.972+0000 7fcf1e68d640 1 --2- 172.21.15.47:0/3695703507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf18101650 0x7fcf18101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.972+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3695703507 >> 172.21.15.47:0/3695703507 conn(0x7fcf180fd0c0 msgr2=0x7fcf180ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.972+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3695703507 shutdown_connections 2024-07-24T22:05:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.972+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3695703507 wait complete. 2024-07-24T22:05:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.973+0000 7fcf1e68d640 1 Processor -- start 2024-07-24T22:05:23.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.973+0000 7fcf1e68d640 1 -- start start 2024-07-24T22:05:23.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.973+0000 7fcf1e68d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf18101650 0x7fcf18198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:23.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.973+0000 7fcf1e68d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf18107060 0x7fcf18199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:23.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.973+0000 7fcf1e68d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf181079e0 0x7fcf1819e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:23.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.973+0000 7fcf1e68d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181115e0 con 0x7fcf181079e0 2024-07-24T22:05:23.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.973+0000 7fcf1e68d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcf18111460 con 0x7fcf18107060 2024-07-24T22:05:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.973+0000 7fcf1e68d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcf18111760 con 0x7fcf18101650 2024-07-24T22:05:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf1cc2a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf181079e0 0x7fcf1819e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf1cc2a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf181079e0 0x7fcf1819e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59244/0 (socket says 172.21.15.47:59244) 2024-07-24T22:05:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf1cc2a640 1 -- 172.21.15.47:0/3886879704 learned_addr learned my addr 172.21.15.47:0/3886879704 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf17fff640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf18101650 0x7fcf18198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf0ffff640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf18107060 0x7fcf18199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf1cc2a640 1 -- 172.21.15.47:0/3886879704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf18101650 msgr2=0x7fcf18198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf1cc2a640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf18101650 0x7fcf18198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf1cc2a640 1 -- 172.21.15.47:0/3886879704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf18107060 msgr2=0x7fcf18199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf1cc2a640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf18107060 0x7fcf18199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf1cc2a640 1 -- 172.21.15.47:0/3886879704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1819eca0 con 0x7fcf181079e0 2024-07-24T22:05:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf0ffff640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf18107060 0x7fcf18199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf1cc2a640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf181079e0 0x7fcf1819e4d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000cce0 tx=0x7fcf1000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf15ffb640 1 -- 172.21.15.47:0/3886879704 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000f450 con 0x7fcf181079e0 2024-07-24T22:05:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3886879704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf1819ef90 con 0x7fcf181079e0 2024-07-24T22:05:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf15ffb640 1 -- 172.21.15.47:0/3886879704 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf1000faa0 con 0x7fcf181079e0 2024-07-24T22:05:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf15ffb640 1 -- 172.21.15.47:0/3886879704 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf10018a80 con 0x7fcf181079e0 2024-07-24T22:05:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.974+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3886879704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf181a5650 con 0x7fcf181079e0 2024-07-24T22:05:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.975+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3886879704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf18101a30 con 0x7fcf181079e0 2024-07-24T22:05:23.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.977+0000 7fcf15ffb640 1 -- 172.21.15.47:0/3886879704 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 21) ==== 151127+0+0 (secure 0 0 0) 0x7fcf1000fc50 con 0x7fcf181079e0 2024-07-24T22:05:23.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.977+0000 7fcf15ffb640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcf040b3cb0 0x7fcf040b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:23.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.978+0000 7fcf17fff640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcf040b3cb0 0x7fcf040b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:23.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.978+0000 7fcf15ffb640 1 -- 172.21.15.47:0/3886879704 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8484+0+0 (secure 0 0 0) 0x7fcf100e4330 con 0x7fcf181079e0 2024-07-24T22:05:23.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.978+0000 7fcf17fff640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcf040b3cb0 0x7fcf040b6170 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800abe0 tx=0x7fcf0800a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:23.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:23.982+0000 7fcf15ffb640 1 -- 172.21.15.47:0/3886879704 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fcf10014030 con 0x7fcf181079e0 2024-07-24T22:05:24.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:23 smithi188 ceph-mon[37380]: pgmap v309: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-07-24T22:05:24.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:23 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/333240662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-07-24T22:05:24.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.179+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3886879704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcf181a5950 con 0x7fcf181079e0 2024-07-24T22:05:24.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.179+0000 7fcf15ffb640 1 -- 172.21.15.47:0/3886879704 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcf100ab720 con 0x7fcf181079e0 2024-07-24T22:05:24.183 INFO:teuthology.orchestra.run.smithi047.stdout:115964117060 2024-07-24T22:05:24.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.182+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3886879704 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcf040b3cb0 msgr2=0x7fcf040b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:24.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.182+0000 7fcf1e68d640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcf040b3cb0 0x7fcf040b6170 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800abe0 tx=0x7fcf0800a2d0 comp rx=0 tx=0).stop 2024-07-24T22:05:24.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.182+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3886879704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf181079e0 msgr2=0x7fcf1819e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:24.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.182+0000 7fcf1e68d640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf181079e0 0x7fcf1819e4d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000cce0 tx=0x7fcf1000a620 comp rx=0 tx=0).stop 2024-07-24T22:05:24.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.182+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3886879704 shutdown_connections 2024-07-24T22:05:24.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.182+0000 7fcf1e68d640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcf040b3cb0 0x7fcf040b6170 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:24.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.182+0000 7fcf1e68d640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf181079e0 0x7fcf1819e4d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:24.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.182+0000 7fcf1e68d640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf18107060 0x7fcf18199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:24.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.182+0000 7fcf1e68d640 1 --2- 172.21.15.47:0/3886879704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf18101650 0x7fcf18198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:24.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.182+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3886879704 >> 172.21.15.47:0/3886879704 conn(0x7fcf180fd0c0 msgr2=0x7fcf1806a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:24.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.183+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3886879704 shutdown_connections 2024-07-24T22:05:24.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:24.183+0000 7fcf1e68d640 1 -- 172.21.15.47:0/3886879704 wait complete. 2024-07-24T22:05:24.613 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705740 got 38654705745 for osd.0 2024-07-24T22:05:24.613 DEBUG:teuthology.parallel:result is None 2024-07-24T22:05:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:24 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3886879704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-07-24T22:05:24.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:24 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3886879704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-07-24T22:05:25.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:24 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3886879704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-07-24T22:05:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:25 smithi183 ceph-mon[37007]: pgmap v310: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:25.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:25 smithi047 ceph-mon[32551]: pgmap v310: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:25.949 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:25 smithi188 ceph-mon[37380]: pgmap v310: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:26.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]: dispatch 2024-07-24T22:05:26.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:26 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2024-07-24T22:05:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]: dispatch 2024-07-24T22:05:26.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:26 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2024-07-24T22:05:27.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]: dispatch 2024-07-24T22:05:27.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:26 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2024-07-24T22:05:27.760 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:27 smithi047 ceph-mon[32551]: pgmap v311: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:27.760 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2024-07-24T22:05:27.760 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:27 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2024-07-24T22:05:27.760 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:27 smithi047 ceph-mon[32551]: osdmap e84: 12 total, 12 up, 12 in 2024-07-24T22:05:27.760 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:27 smithi047 ceph-mon[32551]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-07-24T22:05:27.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:27 smithi183 ceph-mon[37007]: pgmap v311: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:27.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2024-07-24T22:05:27.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:27 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2024-07-24T22:05:27.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:27 smithi183 ceph-mon[37007]: osdmap e84: 12 total, 12 up, 12 in 2024-07-24T22:05:27.915 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:27 smithi183 ceph-mon[37007]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-07-24T22:05:28.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:27 smithi188 ceph-mon[37380]: pgmap v311: 97 pgs: 97 active+clean; 638 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:28.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2024-07-24T22:05:28.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:27 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2024-07-24T22:05:28.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:27 smithi188 ceph-mon[37380]: osdmap e84: 12 total, 12 up, 12 in 2024-07-24T22:05:28.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:27 smithi188 ceph-mon[37380]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-07-24T22:05:28.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.583+0000 7f52ab866640 1 -- 172.21.15.47:0/3147500198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52a41079e0 msgr2=0x7f52a410e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:28.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.583+0000 7f52ab866640 1 --2- 172.21.15.47:0/3147500198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52a41079e0 0x7f52a410e1e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f529c009be0 tx=0x7f529c02a6c0 comp rx=0 tx=0).stop 2024-07-24T22:05:28.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.583+0000 7f52ab866640 1 -- 172.21.15.47:0/3147500198 shutdown_connections 2024-07-24T22:05:28.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.583+0000 7f52ab866640 1 --2- 172.21.15.47:0/3147500198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52a41079e0 0x7f52a410e1e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:28.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.583+0000 7f52ab866640 1 --2- 172.21.15.47:0/3147500198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52a4107060 0x7f52a41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:28.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.583+0000 7f52ab866640 1 --2- 172.21.15.47:0/3147500198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52a4101650 0x7f52a4101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:28.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.583+0000 7f52ab866640 1 -- 172.21.15.47:0/3147500198 >> 172.21.15.47:0/3147500198 conn(0x7f52a40fd0c0 msgr2=0x7f52a40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:28.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.583+0000 7f52ab866640 1 -- 172.21.15.47:0/3147500198 shutdown_connections 2024-07-24T22:05:28.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.583+0000 7f52ab866640 1 -- 172.21.15.47:0/3147500198 wait complete. 2024-07-24T22:05:28.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.584+0000 7f52ab866640 1 Processor -- start 2024-07-24T22:05:28.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.584+0000 7f52ab866640 1 -- start start 2024-07-24T22:05:28.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.584+0000 7f52ab866640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52a4101650 0x7f52a40fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:28.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.584+0000 7f52ab866640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52a4107060 0x7f52a40fdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:28.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.584+0000 7f52ab866640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52a41079e0 0x7f52a40fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:28.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.584+0000 7f52ab866640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f52a4111610 con 0x7f52a41079e0 2024-07-24T22:05:28.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.584+0000 7f52ab866640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f52a4111490 con 0x7f52a4101650 2024-07-24T22:05:28.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.584+0000 7f52ab866640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f52a4111790 con 0x7f52a4107060 2024-07-24T22:05:28.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.584+0000 7f52a9602640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52a4101650 0x7f52a40fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:28.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.584+0000 7f52a9e03640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52a41079e0 0x7f52a40fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:28.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.584+0000 7f52a9602640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52a4101650 0x7f52a40fd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:51996/0 (socket says 172.21.15.47:51996) 2024-07-24T22:05:28.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.584+0000 7f52a9602640 1 -- 172.21.15.47:0/3531352012 learned_addr learned my addr 172.21.15.47:0/3531352012 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:28.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.584+0000 7f52a8e01640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52a4107060 0x7f52a40fdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:28.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.585+0000 7f52a9e03640 1 -- 172.21.15.47:0/3531352012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52a4107060 msgr2=0x7f52a40fdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.585+0000 7f52a9e03640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52a4107060 0x7f52a40fdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.585+0000 7f52a9e03640 1 -- 172.21.15.47:0/3531352012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52a4101650 msgr2=0x7f52a40fd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.585+0000 7f52a9e03640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52a4101650 0x7f52a40fd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.585+0000 7f52a9e03640 1 -- 172.21.15.47:0/3531352012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a41a70b0 con 0x7f52a41079e0 2024-07-24T22:05:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.585+0000 7f52a8e01640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52a4107060 0x7f52a40fdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:05:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.585+0000 7f52a9e03640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52a41079e0 0x7f52a40fe040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f529c009b30 tx=0x7f529c003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.587+0000 7f529a7fc640 1 -- 172.21.15.47:0/3531352012 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c041020 con 0x7f52a41079e0 2024-07-24T22:05:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.587+0000 7f529a7fc640 1 -- 172.21.15.47:0/3531352012 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f529c0318f0 con 0x7f52a41079e0 2024-07-24T22:05:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.587+0000 7f52ab866640 1 -- 172.21.15.47:0/3531352012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a41a7340 con 0x7f52a41079e0 2024-07-24T22:05:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.587+0000 7f529a7fc640 1 -- 172.21.15.47:0/3531352012 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c036040 con 0x7f52a41079e0 2024-07-24T22:05:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.587+0000 7f52ab866640 1 -- 172.21.15.47:0/3531352012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a41a77f0 con 0x7f52a41079e0 2024-07-24T22:05:28.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.588+0000 7f52ab866640 1 -- 172.21.15.47:0/3531352012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52a4101a30 con 0x7f52a41079e0 2024-07-24T22:05:28.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.591+0000 7f529a7fc640 1 -- 172.21.15.47:0/3531352012 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f529c044020 con 0x7f52a41079e0 2024-07-24T22:05:28.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.591+0000 7f529a7fc640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f52900b3c20 0x7f52900b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:28.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.592+0000 7f52a9602640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f52900b3c20 0x7f52900b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:28.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.592+0000 7f529a7fc640 1 -- 172.21.15.47:0/3531352012 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f529c104c10 con 0x7f52a41079e0 2024-07-24T22:05:28.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.592+0000 7f52a9602640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f52900b3c20 0x7f52900b60e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52a00058c0 tx=0x7f52a0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:28.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.594+0000 7f529a7fc640 1 -- 172.21.15.47:0/3531352012 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f529c04b020 con 0x7f52a41079e0 2024-07-24T22:05:28.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:28 smithi047 ceph-mon[32551]: osdmap e85: 12 total, 12 up, 12 in 2024-07-24T22:05:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.792+0000 7f52ab866640 1 -- 172.21.15.47:0/3531352012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f52a402e000 con 0x7f52a41079e0 2024-07-24T22:05:28.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.792+0000 7f529a7fc640 1 -- 172.21.15.47:0/3531352012 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f529c0cc140 con 0x7f52a41079e0 2024-07-24T22:05:28.795 INFO:teuthology.orchestra.run.smithi047.stdout:210453397555 2024-07-24T22:05:28.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.794+0000 7f52ab866640 1 -- 172.21.15.47:0/3531352012 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f52900b3c20 msgr2=0x7f52900b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:28.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.794+0000 7f52ab866640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f52900b3c20 0x7f52900b60e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52a00058c0 tx=0x7f52a0009260 comp rx=0 tx=0).stop 2024-07-24T22:05:28.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.794+0000 7f52ab866640 1 -- 172.21.15.47:0/3531352012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52a41079e0 msgr2=0x7f52a40fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:28.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.794+0000 7f52ab866640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52a41079e0 0x7f52a40fe040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f529c009b30 tx=0x7f529c003b80 comp rx=0 tx=0).stop 2024-07-24T22:05:28.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.795+0000 7f52ab866640 1 -- 172.21.15.47:0/3531352012 shutdown_connections 2024-07-24T22:05:28.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.795+0000 7f52ab866640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f52900b3c20 0x7f52900b60e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:28.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.795+0000 7f52ab866640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52a41079e0 0x7f52a40fe040 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:28.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.795+0000 7f52ab866640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52a4107060 0x7f52a40fdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:28.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.795+0000 7f52ab866640 1 --2- 172.21.15.47:0/3531352012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52a4101650 0x7f52a40fd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:28.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.795+0000 7f52ab866640 1 -- 172.21.15.47:0/3531352012 >> 172.21.15.47:0/3531352012 conn(0x7f52a40fd0c0 msgr2=0x7f52a406a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:28.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.795+0000 7f52ab866640 1 -- 172.21.15.47:0/3531352012 shutdown_connections 2024-07-24T22:05:28.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.795+0000 7f52ab866640 1 -- 172.21.15.47:0/3531352012 wait complete. 2024-07-24T22:05:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:28 smithi183 ceph-mon[37007]: osdmap e85: 12 total, 12 up, 12 in 2024-07-24T22:05:29.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:28 smithi188 ceph-mon[37380]: osdmap e85: 12 total, 12 up, 12 in 2024-07-24T22:05:29.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.192+0000 7fcca90fb640 1 -- 172.21.15.47:0/2579709316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4103f50 msgr2=0x7fcca410c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:29.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.192+0000 7fcca90fb640 1 --2- 172.21.15.47:0/2579709316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4103f50 0x7fcca410c530 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009900 tx=0x7fcc8c02a410 comp rx=0 tx=0).stop 2024-07-24T22:05:29.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.192+0000 7fcca90fb640 1 -- 172.21.15.47:0/2579709316 shutdown_connections 2024-07-24T22:05:29.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.192+0000 7fcca90fb640 1 --2- 172.21.15.47:0/2579709316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcca410cb00 0x7fcca410ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.192+0000 7fcca90fb640 1 --2- 172.21.15.47:0/2579709316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4103f50 0x7fcca410c530 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.192+0000 7fcca90fb640 1 --2- 172.21.15.47:0/2579709316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcca4103550 0x7fcca4103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.192+0000 7fcca90fb640 1 -- 172.21.15.47:0/2579709316 >> 172.21.15.47:0/2579709316 conn(0x7fcca40fd0c0 msgr2=0x7fcca40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:29.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.192+0000 7fcca90fb640 1 -- 172.21.15.47:0/2579709316 shutdown_connections 2024-07-24T22:05:29.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.192+0000 7fcca90fb640 1 -- 172.21.15.47:0/2579709316 wait complete. 2024-07-24T22:05:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.193+0000 7fcca90fb640 1 Processor -- start 2024-07-24T22:05:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.193+0000 7fcca90fb640 1 -- start start 2024-07-24T22:05:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.193+0000 7fcca90fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4103550 0x7fcca41013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca90fb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcca4103f50 0x7fcca4101910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca90fb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcca410cb00 0x7fcca4101e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca90fb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcca4112700 con 0x7fcca4103550 2024-07-24T22:05:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca90fb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcca4112580 con 0x7fcca410cb00 2024-07-24T22:05:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca90fb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcca4112880 con 0x7fcca4103f50 2024-07-24T22:05:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4103550 0x7fcca41013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4103550 0x7fcca41013d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45250/0 (socket says 172.21.15.47:45250) 2024-07-24T22:05:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca2d9d640 1 -- 172.21.15.47:0/2855413590 learned_addr learned my addr 172.21.15.47:0/2855413590 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca259c640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcca4103f50 0x7fcca4101910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca359e640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcca410cb00 0x7fcca4101e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca2d9d640 1 -- 172.21.15.47:0/2855413590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcca4103f50 msgr2=0x7fcca4101910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca2d9d640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcca4103f50 0x7fcca4101910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca2d9d640 1 -- 172.21.15.47:0/2855413590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcca410cb00 msgr2=0x7fcca4101e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca2d9d640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcca410cb00 0x7fcca4101e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca2d9d640 1 -- 172.21.15.47:0/2855413590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca41a7010 con 0x7fcca4103550 2024-07-24T22:05:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca259c640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcca4103f50 0x7fcca4101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca2d9d640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4103550 0x7fcca41013d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400cce0 tx=0x7fcc9400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcc9bfff640 1 -- 172.21.15.47:0/2855413590 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400f650 con 0x7fcca4103550 2024-07-24T22:05:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcca90fb640 1 -- 172.21.15.47:0/2855413590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca41a7300 con 0x7fcca4103550 2024-07-24T22:05:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcc9bfff640 1 -- 172.21.15.47:0/2855413590 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc9400fca0 con 0x7fcca4103550 2024-07-24T22:05:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.194+0000 7fcc9bfff640 1 -- 172.21.15.47:0/2855413590 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94018b40 con 0x7fcca4103550 2024-07-24T22:05:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.195+0000 7fcca90fb640 1 -- 172.21.15.47:0/2855413590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca41a7810 con 0x7fcca4103550 2024-07-24T22:05:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.196+0000 7fcca90fb640 1 -- 172.21.15.47:0/2855413590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca4103930 con 0x7fcca4103550 2024-07-24T22:05:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.197+0000 7fcc9bfff640 1 -- 172.21.15.47:0/2855413590 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fcc9400f7f0 con 0x7fcca4103550 2024-07-24T22:05:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.198+0000 7fcc9bfff640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcc900b3c20 0x7fcc900b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.198+0000 7fcca259c640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcc900b3c20 0x7fcc900b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.198+0000 7fcc9bfff640 1 -- 172.21.15.47:0/2855413590 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fcc940e42e0 con 0x7fcca4103550 2024-07-24T22:05:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.198+0000 7fcca259c640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcc900b3c20 0x7fcc900b60e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c031440 tx=0x7fcc8c0095f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.202+0000 7fcc9bfff640 1 -- 172.21.15.47:0/2855413590 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fcc94014030 con 0x7fcca4103550 2024-07-24T22:05:29.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.399+0000 7fcca90fb640 1 -- 172.21.15.47:0/2855413590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fcca41a7ad0 con 0x7fcca4103550 2024-07-24T22:05:29.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.399+0000 7fcc9bfff640 1 -- 172.21.15.47:0/2855413590 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcc940ab810 con 0x7fcca4103550 2024-07-24T22:05:29.402 INFO:teuthology.orchestra.run.smithi047.stdout:60129542223 2024-07-24T22:05:29.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.402+0000 7fcca90fb640 1 -- 172.21.15.47:0/2855413590 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcc900b3c20 msgr2=0x7fcc900b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:29.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.402+0000 7fcca90fb640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcc900b3c20 0x7fcc900b60e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c031440 tx=0x7fcc8c0095f0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.402+0000 7fcca90fb640 1 -- 172.21.15.47:0/2855413590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4103550 msgr2=0x7fcca41013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:29.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.402+0000 7fcca90fb640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4103550 0x7fcca41013d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400cce0 tx=0x7fcc9400a620 comp rx=0 tx=0).stop 2024-07-24T22:05:29.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.402+0000 7fcca90fb640 1 -- 172.21.15.47:0/2855413590 shutdown_connections 2024-07-24T22:05:29.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.402+0000 7fcca90fb640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcc900b3c20 0x7fcc900b60e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.402+0000 7fcca90fb640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcca410cb00 0x7fcca4101e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.402+0000 7fcca90fb640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcca4103f50 0x7fcca4101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.402+0000 7fcca90fb640 1 --2- 172.21.15.47:0/2855413590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca4103550 0x7fcca41013d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.402+0000 7fcca90fb640 1 -- 172.21.15.47:0/2855413590 >> 172.21.15.47:0/2855413590 conn(0x7fcca40fd0c0 msgr2=0x7fcca410ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:29.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.402+0000 7fcca90fb640 1 -- 172.21.15.47:0/2855413590 shutdown_connections 2024-07-24T22:05:29.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.402+0000 7fcca90fb640 1 -- 172.21.15.47:0/2855413590 wait complete. 2024-07-24T22:05:29.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.462+0000 7ff34aad6640 1 -- 172.21.15.47:0/2951523597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff344108b20 msgr2=0x7ff34410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:29.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.462+0000 7ff34aad6640 1 --2- 172.21.15.47:0/2951523597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff344108b20 0x7ff34410f320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009ca0 tx=0x7ff33c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 -- 172.21.15.47:0/2951523597 shutdown_connections 2024-07-24T22:05:29.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 --2- 172.21.15.47:0/2951523597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff344108b20 0x7ff34410f320 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 --2- 172.21.15.47:0/2951523597 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3441081a0 0x7ff3441085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 --2- 172.21.15.47:0/2951523597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff344102790 0x7ff344102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 -- 172.21.15.47:0/2951523597 >> 172.21.15.47:0/2951523597 conn(0x7ff3440fe200 msgr2=0x7ff344100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:29.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 -- 172.21.15.47:0/2951523597 shutdown_connections 2024-07-24T22:05:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 -- 172.21.15.47:0/2951523597 wait complete. 2024-07-24T22:05:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 Processor -- start 2024-07-24T22:05:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 -- start start 2024-07-24T22:05:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff344102790 0x7ff344198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3441081a0 0x7ff3441990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff344108b20 0x7ff34419e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff344112740 con 0x7ff344102790 2024-07-24T22:05:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff3441125c0 con 0x7ff3441081a0 2024-07-24T22:05:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.463+0000 7ff34aad6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff3441128c0 con 0x7ff344108b20 2024-07-24T22:05:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff348872640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff344102790 0x7ff344198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff348872640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff344102790 0x7ff344198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45212/0 (socket says 172.21.15.47:45212) 2024-07-24T22:05:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff348872640 1 -- 172.21.15.47:0/2026787498 learned_addr learned my addr 172.21.15.47:0/2026787498 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff343fff640 1 --2- 172.21.15.47:0/2026787498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3441081a0 0x7ff3441990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:29.599 INFO:teuthology.orchestra.run.smithi047.stdout:163208757309 2024-07-24T22:05:29.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff348872640 1 -- 172.21.15.47:0/2026787498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff344108b20 msgr2=0x7ff34419e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:29.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff348872640 1 --2- 172.21.15.47:0/2026787498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff344108b20 0x7ff34419e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff348872640 1 -- 172.21.15.47:0/2026787498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3441081a0 msgr2=0x7ff3441990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:29.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff348872640 1 --2- 172.21.15.47:0/2026787498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3441081a0 0x7ff3441990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff348872640 1 -- 172.21.15.47:0/2026787498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34419ec40 con 0x7ff344102790 2024-07-24T22:05:29.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff348872640 1 --2- 172.21.15.47:0/2026787498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff344102790 0x7ff344198b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff33800d950 tx=0x7ff33800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:29.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff341ffb640 1 -- 172.21.15.47:0/2026787498 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338017070 con 0x7ff344102790 2024-07-24T22:05:29.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff341ffb640 1 -- 172.21.15.47:0/2026787498 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff338009c30 con 0x7ff344102790 2024-07-24T22:05:29.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff34aad6640 1 -- 172.21.15.47:0/2026787498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff34419ef30 con 0x7ff344102790 2024-07-24T22:05:29.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff341ffb640 1 -- 172.21.15.47:0/2026787498 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33800f620 con 0x7ff344102790 2024-07-24T22:05:29.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.464+0000 7ff34aad6640 1 -- 172.21.15.47:0/2026787498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3441a57c0 con 0x7ff344102790 2024-07-24T22:05:29.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.465+0000 7ff34aad6640 1 -- 172.21.15.47:0/2026787498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff344102b70 con 0x7ff344102790 2024-07-24T22:05:29.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.467+0000 7ff341ffb640 1 -- 172.21.15.47:0/2026787498 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7ff338010460 con 0x7ff344102790 2024-07-24T22:05:29.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.467+0000 7ff341ffb640 1 --2- 172.21.15.47:0/2026787498 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff3340b3ca0 0x7ff3340b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:29.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.468+0000 7ff343fff640 1 --2- 172.21.15.47:0/2026787498 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff3340b3ca0 0x7ff3340b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:29.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.468+0000 7ff341ffb640 1 -- 172.21.15.47:0/2026787498 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ff3380e39f0 con 0x7ff344102790 2024-07-24T22:05:29.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.468+0000 7ff343fff640 1 --2- 172.21.15.47:0/2026787498 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff3340b3ca0 0x7ff3340b6160 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff330005e10 tx=0x7ff330005da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.471+0000 7ff341ffb640 1 -- 172.21.15.47:0/2026787498 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7ff3380aaf20 con 0x7ff344102790 2024-07-24T22:05:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.677+0000 7ff34aad6640 1 -- 172.21.15.47:0/2026787498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff34402e000 con 0x7ff344102790 2024-07-24T22:05:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.677+0000 7ff341ffb640 1 -- 172.21.15.47:0/2026787498 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff338009de0 con 0x7ff344102790 2024-07-24T22:05:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.680+0000 7ff34aad6640 1 -- 172.21.15.47:0/2026787498 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff3340b3ca0 msgr2=0x7ff3340b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.680+0000 7ff34aad6640 1 --2- 172.21.15.47:0/2026787498 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff3340b3ca0 0x7ff3340b6160 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff330005e10 tx=0x7ff330005da0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.680+0000 7ff34aad6640 1 -- 172.21.15.47:0/2026787498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff344102790 msgr2=0x7ff344198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.680+0000 7ff34aad6640 1 --2- 172.21.15.47:0/2026787498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff344102790 0x7ff344198b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff33800d950 tx=0x7ff33800de10 comp rx=0 tx=0).stop 2024-07-24T22:05:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.681+0000 7ff34aad6640 1 -- 172.21.15.47:0/2026787498 shutdown_connections 2024-07-24T22:05:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.681+0000 7ff34aad6640 1 --2- 172.21.15.47:0/2026787498 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff3340b3ca0 0x7ff3340b6160 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.681+0000 7ff34aad6640 1 --2- 172.21.15.47:0/2026787498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff344108b20 0x7ff34419e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.681+0000 7ff34aad6640 1 --2- 172.21.15.47:0/2026787498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3441081a0 0x7ff3441990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.681+0000 7ff34aad6640 1 --2- 172.21.15.47:0/2026787498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff344102790 0x7ff344198b90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.681+0000 7ff34aad6640 1 -- 172.21.15.47:0/2026787498 >> 172.21.15.47:0/2026787498 conn(0x7ff3440fe200 msgr2=0x7ff3441005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.681+0000 7ff34aad6640 1 -- 172.21.15.47:0/2026787498 shutdown_connections 2024-07-24T22:05:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:28.681+0000 7ff34aad6640 1 -- 172.21.15.47:0/2026787498 wait complete. 2024-07-24T22:05:29.899 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:29 smithi047 ceph-mon[32551]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 383 B/s wr, 2 op/s 2024-07-24T22:05:29.899 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:29 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2026787498' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-07-24T22:05:29.899 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:29 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3531352012' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-07-24T22:05:29.899 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:29 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2855413590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-07-24T22:05:29.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:29 smithi183 ceph-mon[37007]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 383 B/s wr, 2 op/s 2024-07-24T22:05:29.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:29 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2026787498' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-07-24T22:05:29.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:29 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3531352012' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-07-24T22:05:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:29 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2855413590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-07-24T22:05:29.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.981+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3941915546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee01036a0 msgr2=0x7f5ee0103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:29.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.981+0000 7f5ee87bb640 1 --2- 172.21.15.47:0/3941915546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee01036a0 0x7f5ee0103a80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009900 tx=0x7f5edc02a410 comp rx=0 tx=0).stop 2024-07-24T22:05:29.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.981+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3941915546 shutdown_connections 2024-07-24T22:05:29.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.981+0000 7f5ee87bb640 1 --2- 172.21.15.47:0/3941915546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ee010cb00 0x7f5ee010ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.981+0000 7f5ee87bb640 1 --2- 172.21.15.47:0/3941915546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee0103fc0 0x7f5ee010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.981+0000 7f5ee87bb640 1 --2- 172.21.15.47:0/3941915546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee01036a0 0x7f5ee0103a80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.981+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3941915546 >> 172.21.15.47:0/3941915546 conn(0x7f5ee00fd100 msgr2=0x7f5ee00ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:29.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.981+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3941915546 shutdown_connections 2024-07-24T22:05:29.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.981+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3941915546 wait complete. 2024-07-24T22:05:29.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.982+0000 7f5ee87bb640 1 Processor -- start 2024-07-24T22:05:29.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.982+0000 7f5ee87bb640 1 -- start start 2024-07-24T22:05:29.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.982+0000 7f5ee87bb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ee01036a0 0x7f5ee0198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:29.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.982+0000 7f5ee87bb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee0103fc0 0x7f5ee01991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:29.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.982+0000 7f5ee87bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee010cb00 0x7f5ee019e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:29.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.982+0000 7f5ee87bb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee0112760 con 0x7f5ee010cb00 2024-07-24T22:05:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.982+0000 7f5ee87bb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee01125e0 con 0x7f5ee01036a0 2024-07-24T22:05:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.982+0000 7f5ee87bb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee01128e0 con 0x7f5ee0103fc0 2024-07-24T22:05:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.983+0000 7f5ee6d58640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee010cb00 0x7f5ee019e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.983+0000 7f5ee6d58640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee010cb00 0x7f5ee019e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45262/0 (socket says 172.21.15.47:45262) 2024-07-24T22:05:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.983+0000 7f5ee6d58640 1 -- 172.21.15.47:0/3532368163 learned_addr learned my addr 172.21.15.47:0/3532368163 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.983+0000 7f5ee6557640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ee01036a0 0x7f5ee0198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.983+0000 7f5ee5d56640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee0103fc0 0x7f5ee01991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.983+0000 7f5ee6d58640 1 -- 172.21.15.47:0/3532368163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee0103fc0 msgr2=0x7f5ee01991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.983+0000 7f5ee6d58640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee0103fc0 0x7f5ee01991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.983+0000 7f5ee6d58640 1 -- 172.21.15.47:0/3532368163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ee01036a0 msgr2=0x7f5ee0198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.983+0000 7f5ee6d58640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ee01036a0 0x7f5ee0198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.983+0000 7f5ee6d58640 1 -- 172.21.15.47:0/3532368163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee019ed40 con 0x7f5ee010cb00 2024-07-24T22:05:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.983+0000 7f5ee6557640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ee01036a0 0x7f5ee0198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:29.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.983+0000 7f5ee6d58640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee010cb00 0x7f5ee019e570 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800eaa0 tx=0x7f5ed800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:29.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.983+0000 7f5ed77fe640 1 -- 172.21.15.47:0/3532368163 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800cdb0 con 0x7f5ee010cb00 2024-07-24T22:05:29.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.984+0000 7f5ed77fe640 1 -- 172.21.15.47:0/3532368163 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ed8005020 con 0x7f5ee010cb00 2024-07-24T22:05:29.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.984+0000 7f5ed77fe640 1 -- 172.21.15.47:0/3532368163 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed80116d0 con 0x7f5ee010cb00 2024-07-24T22:05:29.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.984+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3532368163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee019f030 con 0x7f5ee010cb00 2024-07-24T22:05:29.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.984+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3532368163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee01a56f0 con 0x7f5ee010cb00 2024-07-24T22:05:29.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.985+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3532368163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee0103a80 con 0x7f5ee010cb00 2024-07-24T22:05:29.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.986+0000 7f5ed77fe640 1 -- 172.21.15.47:0/3532368163 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f5ed80051d0 con 0x7f5ee010cb00 2024-07-24T22:05:29.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.987+0000 7f5ed77fe640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5ecc0b3ca0 0x7f5ecc0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:29.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.987+0000 7f5ee6557640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5ecc0b3ca0 0x7f5ecc0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:29.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.987+0000 7f5ed77fe640 1 -- 172.21.15.47:0/3532368163 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f5ed80e3ff0 con 0x7f5ee010cb00 2024-07-24T22:05:29.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.987+0000 7f5ee6557640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5ecc0b3ca0 0x7f5ecc0b6160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5edc031440 tx=0x7f5edc005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:29.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:29.991+0000 7f5ed77fe640 1 -- 172.21.15.47:0/3532368163 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f5ed8016030 con 0x7f5ee010cb00 2024-07-24T22:05:30.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:29 smithi188 ceph-mon[37380]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 383 B/s wr, 2 op/s 2024-07-24T22:05:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:29 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2026787498' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-07-24T22:05:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:29 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3531352012' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-07-24T22:05:30.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:29 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2855413590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-07-24T22:05:30.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.188+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3532368163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f5ee002e000 con 0x7f5ee010cb00 2024-07-24T22:05:30.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.188+0000 7f5ed77fe640 1 -- 172.21.15.47:0/3532368163 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5ed80ab4e0 con 0x7f5ee010cb00 2024-07-24T22:05:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:141733920833 2024-07-24T22:05:30.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.190+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3532368163 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5ecc0b3ca0 msgr2=0x7f5ecc0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.191+0000 7f5ee87bb640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5ecc0b3ca0 0x7f5ecc0b6160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5edc031440 tx=0x7f5edc005a20 comp rx=0 tx=0).stop 2024-07-24T22:05:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.191+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3532368163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee010cb00 msgr2=0x7f5ee019e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.191+0000 7f5ee87bb640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee010cb00 0x7f5ee019e570 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800eaa0 tx=0x7f5ed800ef60 comp rx=0 tx=0).stop 2024-07-24T22:05:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.191+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3532368163 shutdown_connections 2024-07-24T22:05:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.191+0000 7f5ee87bb640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5ecc0b3ca0 0x7f5ecc0b6160 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.191+0000 7f5ee87bb640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee010cb00 0x7f5ee019e570 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.191+0000 7f5ee87bb640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee0103fc0 0x7f5ee01991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.191+0000 7f5ee87bb640 1 --2- 172.21.15.47:0/3532368163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ee01036a0 0x7f5ee0198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.191+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3532368163 >> 172.21.15.47:0/3532368163 conn(0x7f5ee00fd100 msgr2=0x7f5ee00fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.191+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3532368163 shutdown_connections 2024-07-24T22:05:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:30.191+0000 7f5ee87bb640 1 -- 172.21.15.47:0/3532368163 wait complete. 2024-07-24T22:05:30.898 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:30 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3532368163' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-07-24T22:05:30.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:30 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3532368163' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-07-24T22:05:30.931 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920828 got 141733920833 for osd.4 2024-07-24T22:05:30.931 DEBUG:teuthology.parallel:result is None 2024-07-24T22:05:31.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:30 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3532368163' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-07-24T22:05:31.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.520+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/3502001079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64107a00 msgr2=0x7f8b6410e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:31.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.520+0000 7f8b6b1c5640 1 --2- 172.21.15.47:0/3502001079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64107a00 0x7f8b6410e200 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009ca0 tx=0x7f8b5c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:05:31.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.520+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/3502001079 shutdown_connections 2024-07-24T22:05:31.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.520+0000 7f8b6b1c5640 1 --2- 172.21.15.47:0/3502001079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64107a00 0x7f8b6410e200 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.520+0000 7f8b6b1c5640 1 --2- 172.21.15.47:0/3502001079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b64107080 0x7f8b641074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.520+0000 7f8b6b1c5640 1 --2- 172.21.15.47:0/3502001079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b64101670 0x7f8b64101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.520+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/3502001079 >> 172.21.15.47:0/3502001079 conn(0x7f8b640fd120 msgr2=0x7f8b640ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.520+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/3502001079 shutdown_connections 2024-07-24T22:05:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.520+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/3502001079 wait complete. 2024-07-24T22:05:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.521+0000 7f8b6b1c5640 1 Processor -- start 2024-07-24T22:05:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.521+0000 7f8b6b1c5640 1 -- start start 2024-07-24T22:05:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.521+0000 7f8b6b1c5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64101670 0x7f8b64199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.521+0000 7f8b6b1c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b64107080 0x7f8b64199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.521+0000 7f8b6b1c5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b64107a00 0x7f8b6419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.521+0000 7f8b6b1c5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64111630 con 0x7f8b64101670 2024-07-24T22:05:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.521+0000 7f8b6b1c5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641114b0 con 0x7f8b64107a00 2024-07-24T22:05:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.521+0000 7f8b6b1c5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641117b0 con 0x7f8b64107080 2024-07-24T22:05:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.521+0000 7f8b68f61640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64101670 0x7f8b64199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.521+0000 7f8b68f61640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64101670 0x7f8b64199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45286/0 (socket says 172.21.15.47:45286) 2024-07-24T22:05:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.521+0000 7f8b68f61640 1 -- 172.21.15.47:0/1294347940 learned_addr learned my addr 172.21.15.47:0/1294347940 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.522+0000 7f8b69762640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b64107a00 0x7f8b6419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.522+0000 7f8b63fff640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b64107080 0x7f8b64199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.522+0000 7f8b68f61640 1 -- 172.21.15.47:0/1294347940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b64107080 msgr2=0x7f8b64199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.522+0000 7f8b68f61640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b64107080 0x7f8b64199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.522+0000 7f8b68f61640 1 -- 172.21.15.47:0/1294347940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b64107a00 msgr2=0x7f8b6419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.522+0000 7f8b68f61640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b64107a00 0x7f8b6419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.522+0000 7f8b68f61640 1 -- 172.21.15.47:0/1294347940 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b641a4de0 con 0x7f8b64101670 2024-07-24T22:05:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.522+0000 7f8b63fff640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b64107080 0x7f8b64199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.522+0000 7f8b68f61640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64101670 0x7f8b64199a00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800e9f0 tx=0x7f8b5800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:31.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.522+0000 7f8b61ffb640 1 -- 172.21.15.47:0/1294347940 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800cd80 con 0x7f8b64101670 2024-07-24T22:05:31.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.522+0000 7f8b61ffb640 1 -- 172.21.15.47:0/1294347940 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b580108e0 con 0x7f8b64101670 2024-07-24T22:05:31.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.522+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/1294347940 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b641a50d0 con 0x7f8b64101670 2024-07-24T22:05:31.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.522+0000 7f8b61ffb640 1 -- 172.21.15.47:0/1294347940 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58018980 con 0x7f8b64101670 2024-07-24T22:05:31.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.523+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/1294347940 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b641a5610 con 0x7f8b64101670 2024-07-24T22:05:31.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.524+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/1294347940 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b64101a50 con 0x7f8b64101670 2024-07-24T22:05:31.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.525+0000 7f8b61ffb640 1 -- 172.21.15.47:0/1294347940 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f8b58010430 con 0x7f8b64101670 2024-07-24T22:05:31.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.526+0000 7f8b61ffb640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b540b3c20 0x7f8b540b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:31.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.526+0000 7f8b63fff640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b540b3c20 0x7f8b540b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:31.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.526+0000 7f8b61ffb640 1 -- 172.21.15.47:0/1294347940 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8b580e4660 con 0x7f8b64101670 2024-07-24T22:05:31.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.527+0000 7f8b63fff640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b540b3c20 0x7f8b540b60e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b500058c0 tx=0x7f8b50005850 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:31.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.529+0000 7f8b61ffb640 1 -- 172.21.15.47:0/1294347940 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f8b580abb30 con 0x7f8b64101670 2024-07-24T22:05:31.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:31 smithi047 ceph-mon[32551]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 383 B/s wr, 1 op/s 2024-07-24T22:05:31.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.730+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/1294347940 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f8b6406b0a0 con 0x7f8b64101670 2024-07-24T22:05:31.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.730+0000 7f8b61ffb640 1 -- 172.21.15.47:0/1294347940 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f8b6406b0a0 con 0x7f8b64101670 2024-07-24T22:05:31.732 INFO:teuthology.orchestra.run.smithi047.stdout:287762808869 2024-07-24T22:05:31.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.732+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/1294347940 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b540b3c20 msgr2=0x7f8b540b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.732+0000 7f8b6b1c5640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b540b3c20 0x7f8b540b60e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b500058c0 tx=0x7f8b50005850 comp rx=0 tx=0).stop 2024-07-24T22:05:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.732+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/1294347940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64101670 msgr2=0x7f8b64199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.732+0000 7f8b6b1c5640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64101670 0x7f8b64199a00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800e9f0 tx=0x7f8b5800eeb0 comp rx=0 tx=0).stop 2024-07-24T22:05:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.733+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/1294347940 shutdown_connections 2024-07-24T22:05:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.733+0000 7f8b6b1c5640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b540b3c20 0x7f8b540b60e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.733+0000 7f8b6b1c5640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b64107a00 0x7f8b6419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.733+0000 7f8b6b1c5640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b64107080 0x7f8b64199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.733+0000 7f8b6b1c5640 1 --2- 172.21.15.47:0/1294347940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64101670 0x7f8b64199a00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.733+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/1294347940 >> 172.21.15.47:0/1294347940 conn(0x7f8b640fd120 msgr2=0x7f8b640ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.733+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/1294347940 shutdown_connections 2024-07-24T22:05:31.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:31.733+0000 7f8b6b1c5640 1 -- 172.21.15.47:0/1294347940 wait complete. 2024-07-24T22:05:31.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:31 smithi183 ceph-mon[37007]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 383 B/s wr, 1 op/s 2024-07-24T22:05:32.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:31 smithi188 ceph-mon[37380]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 383 B/s wr, 1 op/s 2024-07-24T22:05:32.672 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757306 got 163208757309 for osd.5 2024-07-24T22:05:32.672 DEBUG:teuthology.parallel:result is None 2024-07-24T22:05:32.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:32 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1294347940' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-07-24T22:05:32.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:32 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1294347940' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-07-24T22:05:33.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:32 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1294347940' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-07-24T22:05:33.390 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542219 got 60129542223 for osd.1 2024-07-24T22:05:33.391 DEBUG:teuthology.parallel:result is None 2024-07-24T22:05:33.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:33 smithi047 ceph-mon[32551]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-07-24T22:05:33.777 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117056 got 115964117060 for osd.3 2024-07-24T22:05:33.777 DEBUG:teuthology.parallel:result is None 2024-07-24T22:05:33.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:33 smithi183 ceph-mon[37007]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-07-24T22:05:34.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:33 smithi188 ceph-mon[37380]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-07-24T22:05:34.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.358+0000 7fe841ea3640 1 -- 172.21.15.47:0/48168411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe83c074f30 msgr2=0x7fe83c075310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:34.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.358+0000 7fe841ea3640 1 --2- 172.21.15.47:0/48168411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe83c074f30 0x7fe83c075310 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009900 tx=0x7fe82c02a3f0 comp rx=0 tx=0).stop 2024-07-24T22:05:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.358+0000 7fe841ea3640 1 -- 172.21.15.47:0/48168411 shutdown_connections 2024-07-24T22:05:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.358+0000 7fe841ea3640 1 --2- 172.21.15.47:0/48168411 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe83c1134d0 0x7fe83c1158c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.358+0000 7fe841ea3640 1 --2- 172.21.15.47:0/48168411 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe83c075850 0x7fe83c112f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.358+0000 7fe841ea3640 1 --2- 172.21.15.47:0/48168411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe83c074f30 0x7fe83c075310 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.358+0000 7fe841ea3640 1 -- 172.21.15.47:0/48168411 >> 172.21.15.47:0/48168411 conn(0x7fe83c0fe1c0 msgr2=0x7fe83c1005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.358+0000 7fe841ea3640 1 -- 172.21.15.47:0/48168411 shutdown_connections 2024-07-24T22:05:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.358+0000 7fe841ea3640 1 -- 172.21.15.47:0/48168411 wait complete. 2024-07-24T22:05:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.358+0000 7fe841ea3640 1 Processor -- start 2024-07-24T22:05:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe841ea3640 1 -- start start 2024-07-24T22:05:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe841ea3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe83c074f30 0x7fe83c19f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe841ea3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe83c075850 0x7fe83c19f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe841ea3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe83c1134d0 0x7fe83c1a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe841ea3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe83c118d50 con 0x7fe83c074f30 2024-07-24T22:05:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe841ea3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe83c118bd0 con 0x7fe83c075850 2024-07-24T22:05:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe841ea3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe83c118ed0 con 0x7fe83c1134d0 2024-07-24T22:05:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe83b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe83c074f30 0x7fe83c19f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe83b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe83c074f30 0x7fe83c19f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45300/0 (socket says 172.21.15.47:45300) 2024-07-24T22:05:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe83b7fe640 1 -- 172.21.15.47:0/1912137910 learned_addr learned my addr 172.21.15.47:0/1912137910 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:34.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe83affd640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe83c075850 0x7fe83c19f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:34.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe83bfff640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe83c1134d0 0x7fe83c1a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:34.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe83b7fe640 1 -- 172.21.15.47:0/1912137910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe83c1134d0 msgr2=0x7fe83c1a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:34.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe83b7fe640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe83c1134d0 0x7fe83c1a4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:34.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe83b7fe640 1 -- 172.21.15.47:0/1912137910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe83c075850 msgr2=0x7fe83c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:34.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe83b7fe640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe83c075850 0x7fe83c19f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:34.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe83b7fe640 1 -- 172.21.15.47:0/1912137910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe83c1a5310 con 0x7fe83c074f30 2024-07-24T22:05:34.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe83bfff640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe83c1134d0 0x7fe83c1a4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:05:34.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe83affd640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe83c075850 0x7fe83c19f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:34.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.359+0000 7fe83b7fe640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe83c074f30 0x7fe83c19f260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe82c005940 tx=0x7fe82c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:34.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.360+0000 7fe838ff9640 1 -- 172.21.15.47:0/1912137910 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82c03f030 con 0x7fe83c074f30 2024-07-24T22:05:34.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.360+0000 7fe838ff9640 1 -- 172.21.15.47:0/1912137910 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe82c003cb0 con 0x7fe83c074f30 2024-07-24T22:05:34.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.360+0000 7fe841ea3640 1 -- 172.21.15.47:0/1912137910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe83c1a55a0 con 0x7fe83c074f30 2024-07-24T22:05:34.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.360+0000 7fe838ff9640 1 -- 172.21.15.47:0/1912137910 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82c035070 con 0x7fe83c074f30 2024-07-24T22:05:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.360+0000 7fe841ea3640 1 -- 172.21.15.47:0/1912137910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe83c1abcc0 con 0x7fe83c074f30 2024-07-24T22:05:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.361+0000 7fe841ea3640 1 -- 172.21.15.47:0/1912137910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe83c075310 con 0x7fe83c074f30 2024-07-24T22:05:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.362+0000 7fe838ff9640 1 -- 172.21.15.47:0/1912137910 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fe82c042030 con 0x7fe83c074f30 2024-07-24T22:05:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.363+0000 7fe838ff9640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe8240b3ca0 0x7fe8240b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.363+0000 7fe83affd640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe8240b3ca0 0x7fe8240b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.363+0000 7fe838ff9640 1 -- 172.21.15.47:0/1912137910 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fe82c1046f0 con 0x7fe83c074f30 2024-07-24T22:05:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.363+0000 7fe83affd640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe8240b3ca0 0x7fe8240b6160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe830005d00 tx=0x7fe830005c70 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.367+0000 7fe838ff9640 1 -- 172.21.15.47:0/1912137910 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fe82c0cbbc0 con 0x7fe83c074f30 2024-07-24T22:05:34.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.568+0000 7fe841ea3640 1 -- 172.21.15.47:0/1912137910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fe83c1abfc0 con 0x7fe83c074f30 2024-07-24T22:05:34.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.568+0000 7fe838ff9640 1 -- 172.21.15.47:0/1912137910 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe82c0cb4c0 con 0x7fe83c074f30 2024-07-24T22:05:34.570 INFO:teuthology.orchestra.run.smithi047.stdout:266287972396 2024-07-24T22:05:34.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.570+0000 7fe841ea3640 1 -- 172.21.15.47:0/1912137910 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe8240b3ca0 msgr2=0x7fe8240b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:34.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.570+0000 7fe841ea3640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe8240b3ca0 0x7fe8240b6160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe830005d00 tx=0x7fe830005c70 comp rx=0 tx=0).stop 2024-07-24T22:05:34.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.570+0000 7fe841ea3640 1 -- 172.21.15.47:0/1912137910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe83c074f30 msgr2=0x7fe83c19f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:34.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.570+0000 7fe841ea3640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe83c074f30 0x7fe83c19f260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe82c005940 tx=0x7fe82c0042f0 comp rx=0 tx=0).stop 2024-07-24T22:05:34.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.570+0000 7fe841ea3640 1 -- 172.21.15.47:0/1912137910 shutdown_connections 2024-07-24T22:05:34.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.570+0000 7fe841ea3640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe8240b3ca0 0x7fe8240b6160 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:34.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.570+0000 7fe841ea3640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe83c1134d0 0x7fe83c1a4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:34.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.570+0000 7fe841ea3640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe83c075850 0x7fe83c19f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:34.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.570+0000 7fe841ea3640 1 --2- 172.21.15.47:0/1912137910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe83c074f30 0x7fe83c19f260 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:34.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.570+0000 7fe841ea3640 1 -- 172.21.15.47:0/1912137910 >> 172.21.15.47:0/1912137910 conn(0x7fe83c0fe1c0 msgr2=0x7fe83c0fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:34.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.570+0000 7fe841ea3640 1 -- 172.21.15.47:0/1912137910 shutdown_connections 2024-07-24T22:05:34.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:34.570+0000 7fe841ea3640 1 -- 172.21.15.47:0/1912137910 wait complete. 2024-07-24T22:05:34.711 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:34 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1912137910' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-07-24T22:05:34.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:34 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1912137910' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-07-24T22:05:35.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:34 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1912137910' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-07-24T22:05:35.346 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972391 got 266287972396 for osd.9 2024-07-24T22:05:35.347 DEBUG:teuthology.parallel:result is None 2024-07-24T22:05:35.771 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397552 got 210453397555 for osd.7 2024-07-24T22:05:35.772 DEBUG:teuthology.parallel:result is None 2024-07-24T22:05:35.905 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:35 smithi047 ceph-mon[32551]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-07-24T22:05:35.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:35 smithi183 ceph-mon[37007]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-07-24T22:05:35.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.987+0000 7fcdae79a640 1 -- 172.21.15.47:0/2446951773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcda8107060 msgr2=0x7fcda81074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:35.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.987+0000 7fcdae79a640 1 --2- 172.21.15.47:0/2446951773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcda8107060 0x7fcda81074a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009900 tx=0x7fcd9c02a410 comp rx=0 tx=0).stop 2024-07-24T22:05:35.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.987+0000 7fcdae79a640 1 -- 172.21.15.47:0/2446951773 shutdown_connections 2024-07-24T22:05:35.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.987+0000 7fcdae79a640 1 --2- 172.21.15.47:0/2446951773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcda81079e0 0x7fcda810e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:35.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.987+0000 7fcdae79a640 1 --2- 172.21.15.47:0/2446951773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcda8107060 0x7fcda81074a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:35.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.987+0000 7fcdae79a640 1 --2- 172.21.15.47:0/2446951773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcda8101650 0x7fcda8101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:35.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.987+0000 7fcdae79a640 1 -- 172.21.15.47:0/2446951773 >> 172.21.15.47:0/2446951773 conn(0x7fcda80fd0c0 msgr2=0x7fcda80ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:35.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.987+0000 7fcdae79a640 1 -- 172.21.15.47:0/2446951773 shutdown_connections 2024-07-24T22:05:35.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.987+0000 7fcdae79a640 1 -- 172.21.15.47:0/2446951773 wait complete. 2024-07-24T22:05:35.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.988+0000 7fcdae79a640 1 Processor -- start 2024-07-24T22:05:35.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.988+0000 7fcdae79a640 1 -- start start 2024-07-24T22:05:35.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.988+0000 7fcdae79a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcda8101650 0x7fcda8198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:35.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.988+0000 7fcdae79a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcda8107060 0x7fcda81991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:35.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.988+0000 7fcdae79a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcda81079e0 0x7fcda819e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:35.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.988+0000 7fcdae79a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcda81115e0 con 0x7fcda8107060 2024-07-24T22:05:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.988+0000 7fcdae79a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcda8111460 con 0x7fcda8101650 2024-07-24T22:05:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.988+0000 7fcdae79a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcda8111760 con 0x7fcda81079e0 2024-07-24T22:05:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcda77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcda8107060 0x7fcda81991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcda77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcda8107060 0x7fcda81991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35246/0 (socket says 172.21.15.47:35246) 2024-07-24T22:05:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcda77fe640 1 -- 172.21.15.47:0/3316005853 learned_addr learned my addr 172.21.15.47:0/3316005853 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcdacd37640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcda81079e0 0x7fcda819e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcda7fff640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcda8101650 0x7fcda8198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcda77fe640 1 -- 172.21.15.47:0/3316005853 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcda81079e0 msgr2=0x7fcda819e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcda77fe640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcda81079e0 0x7fcda819e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcda77fe640 1 -- 172.21.15.47:0/3316005853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcda8101650 msgr2=0x7fcda8198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcda77fe640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcda8101650 0x7fcda8198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:35.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcda77fe640 1 -- 172.21.15.47:0/3316005853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda819ed30 con 0x7fcda8107060 2024-07-24T22:05:35.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcda77fe640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcda8107060 0x7fcda81991c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c005940 tx=0x7fcd9c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:35.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcda57fa640 1 -- 172.21.15.47:0/3316005853 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c03f030 con 0x7fcda8107060 2024-07-24T22:05:35.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcda57fa640 1 -- 172.21.15.47:0/3316005853 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd9c003cb0 con 0x7fcda8107060 2024-07-24T22:05:35.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcdae79a640 1 -- 172.21.15.47:0/3316005853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda819efc0 con 0x7fcda8107060 2024-07-24T22:05:35.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcda57fa640 1 -- 172.21.15.47:0/3316005853 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c035070 con 0x7fcda8107060 2024-07-24T22:05:35.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.989+0000 7fcdae79a640 1 -- 172.21.15.47:0/3316005853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda81a56e0 con 0x7fcda8107060 2024-07-24T22:05:35.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.990+0000 7fcdae79a640 1 -- 172.21.15.47:0/3316005853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda8101a30 con 0x7fcda8107060 2024-07-24T22:05:35.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.992+0000 7fcda57fa640 1 -- 172.21.15.47:0/3316005853 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fcd9c042030 con 0x7fcda8107060 2024-07-24T22:05:35.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.993+0000 7fcda57fa640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcd900b3c20 0x7fcd900b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:35.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.993+0000 7fcda7fff640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcd900b3c20 0x7fcd900b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:35.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.993+0000 7fcda57fa640 1 -- 172.21.15.47:0/3316005853 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fcd9c104900 con 0x7fcda8107060 2024-07-24T22:05:35.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.993+0000 7fcda7fff640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcd900b3c20 0x7fcd900b60e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800bbe0 tx=0x7fcd9800b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:35.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:35.996+0000 7fcda57fa640 1 -- 172.21.15.47:0/3316005853 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fcd9c0cb780 con 0x7fcda8107060 2024-07-24T22:05:36.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:35 smithi188 ceph-mon[37380]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-07-24T22:05:36.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcdae79a640 1 -- 172.21.15.47:0/3316005853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcda81a5910 con 0x7fcda8107060 2024-07-24T22:05:36.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcda57fa640 1 -- 172.21.15.47:0/3316005853 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcd9c0d40a0 con 0x7fcda8107060 2024-07-24T22:05:36.198 INFO:teuthology.orchestra.run.smithi047.stdout:188978561082 2024-07-24T22:05:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcdae79a640 1 -- 172.21.15.47:0/3316005853 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcd900b3c20 msgr2=0x7fcd900b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcdae79a640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcd900b3c20 0x7fcd900b60e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800bbe0 tx=0x7fcd9800b390 comp rx=0 tx=0).stop 2024-07-24T22:05:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcdae79a640 1 -- 172.21.15.47:0/3316005853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcda8107060 msgr2=0x7fcda81991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcdae79a640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcda8107060 0x7fcda81991c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c005940 tx=0x7fcd9c0042f0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcdae79a640 1 -- 172.21.15.47:0/3316005853 shutdown_connections 2024-07-24T22:05:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcdae79a640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcd900b3c20 0x7fcd900b60e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcdae79a640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcda81079e0 0x7fcda819e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcdae79a640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcda8107060 0x7fcda81991c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcdae79a640 1 --2- 172.21.15.47:0/3316005853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcda8101650 0x7fcda8198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcdae79a640 1 -- 172.21.15.47:0/3316005853 >> 172.21.15.47:0/3316005853 conn(0x7fcda80fd0c0 msgr2=0x7fcda806a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:36.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcdae79a640 1 -- 172.21.15.47:0/3316005853 shutdown_connections 2024-07-24T22:05:36.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.196+0000 7fcdae79a640 1 -- 172.21.15.47:0/3316005853 wait complete. 2024-07-24T22:05:36.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.365+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3156180973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a5c102790 msgr2=0x7f5a5c102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.365+0000 7f5a60f3b640 1 --2- 172.21.15.47:0/3156180973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a5c102790 0x7f5a5c102b70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009900 tx=0x7f5a5402a410 comp rx=0 tx=0).stop 2024-07-24T22:05:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.366+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3156180973 shutdown_connections 2024-07-24T22:05:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.366+0000 7f5a60f3b640 1 --2- 172.21.15.47:0/3156180973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a5c108b20 0x7f5a5c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.366+0000 7f5a60f3b640 1 --2- 172.21.15.47:0/3156180973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a5c1081a0 0x7f5a5c1085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.366+0000 7f5a60f3b640 1 --2- 172.21.15.47:0/3156180973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a5c102790 0x7f5a5c102b70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.366+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3156180973 >> 172.21.15.47:0/3156180973 conn(0x7f5a5c0fe200 msgr2=0x7f5a5c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.366+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3156180973 shutdown_connections 2024-07-24T22:05:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.366+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3156180973 wait complete. 2024-07-24T22:05:36.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.367+0000 7f5a60f3b640 1 Processor -- start 2024-07-24T22:05:36.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.367+0000 7f5a60f3b640 1 -- start start 2024-07-24T22:05:36.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.367+0000 7f5a60f3b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a5c102790 0x7f5a5c198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:36.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.367+0000 7f5a60f3b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a5c1081a0 0x7f5a5c1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:36.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.367+0000 7f5a60f3b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a5c108b20 0x7f5a5c19e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.367+0000 7f5a60f3b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c112740 con 0x7f5a5c108b20 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.367+0000 7f5a60f3b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c1125c0 con 0x7f5a5c1081a0 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.367+0000 7f5a60f3b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c1128c0 con 0x7f5a5c102790 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.367+0000 7f5a5ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a5c108b20 0x7f5a5c19e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.367+0000 7f5a5ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a5c108b20 0x7f5a5c19e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35268/0 (socket says 172.21.15.47:35268) 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.367+0000 7f5a5ad9d640 1 -- 172.21.15.47:0/3169399254 learned_addr learned my addr 172.21.15.47:0/3169399254 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.367+0000 7f5a59d9b640 1 --2- 172.21.15.47:0/3169399254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a5c1081a0 0x7f5a5c1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.368+0000 7f5a5ad9d640 1 -- 172.21.15.47:0/3169399254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a5c102790 msgr2=0x7f5a5c198c70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.368+0000 7f5a5ad9d640 1 --2- 172.21.15.47:0/3169399254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a5c102790 0x7f5a5c198c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.368+0000 7f5a5ad9d640 1 -- 172.21.15.47:0/3169399254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a5c1081a0 msgr2=0x7f5a5c1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.368+0000 7f5a5ad9d640 1 --2- 172.21.15.47:0/3169399254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a5c1081a0 0x7f5a5c1991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.368+0000 7f5a5ad9d640 1 -- 172.21.15.47:0/3169399254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5c19ed20 con 0x7f5a5c108b20 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.368+0000 7f5a5ad9d640 1 --2- 172.21.15.47:0/3169399254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a5c108b20 0x7f5a5c19e550 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009fd0 tx=0x7f5a4c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.368+0000 7f5a537fe640 1 -- 172.21.15.47:0/3169399254 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c017070 con 0x7f5a5c108b20 2024-07-24T22:05:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.368+0000 7f5a537fe640 1 -- 172.21.15.47:0/3169399254 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a4c003e20 con 0x7f5a5c108b20 2024-07-24T22:05:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.368+0000 7f5a537fe640 1 -- 172.21.15.47:0/3169399254 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c010460 con 0x7f5a5c108b20 2024-07-24T22:05:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.368+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3169399254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5c19f010 con 0x7f5a5c108b20 2024-07-24T22:05:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.368+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3169399254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a5c1a56d0 con 0x7f5a5c108b20 2024-07-24T22:05:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.370+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3169399254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a5c102b70 con 0x7f5a5c108b20 2024-07-24T22:05:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.371+0000 7f5a537fe640 1 -- 172.21.15.47:0/3169399254 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f5a4c003970 con 0x7f5a5c108b20 2024-07-24T22:05:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.373+0000 7f5a537fe640 1 --2- 172.21.15.47:0/3169399254 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5a480b3c20 0x7f5a480b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.373+0000 7f5a5a59c640 1 --2- 172.21.15.47:0/3169399254 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5a480b3c20 0x7f5a480b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.373+0000 7f5a537fe640 1 -- 172.21.15.47:0/3169399254 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f5a4c0e3bf0 con 0x7f5a5c108b20 2024-07-24T22:05:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.373+0000 7f5a5a59c640 1 --2- 172.21.15.47:0/3169399254 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5a480b3c20 0x7f5a480b60e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5a5402a930 tx=0x7f5a54000bc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.379+0000 7f5a537fe640 1 -- 172.21.15.47:0/3169399254 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f5a4c0ab120 con 0x7f5a5c108b20 2024-07-24T22:05:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.580+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3169399254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f5a5c02e000 con 0x7f5a5c108b20 2024-07-24T22:05:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.581+0000 7f5a537fe640 1 -- 172.21.15.47:0/3169399254 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5a4c0aaa20 con 0x7f5a5c108b20 2024-07-24T22:05:36.583 INFO:teuthology.orchestra.run.smithi047.stdout:313532612644 2024-07-24T22:05:36.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.583+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3169399254 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5a480b3c20 msgr2=0x7f5a480b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:36.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.583+0000 7f5a60f3b640 1 --2- 172.21.15.47:0/3169399254 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5a480b3c20 0x7f5a480b60e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5a5402a930 tx=0x7f5a54000bc0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.583+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3169399254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a5c108b20 msgr2=0x7f5a5c19e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:36.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.583+0000 7f5a60f3b640 1 --2- 172.21.15.47:0/3169399254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a5c108b20 0x7f5a5c19e550 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009fd0 tx=0x7f5a4c00b260 comp rx=0 tx=0).stop 2024-07-24T22:05:36.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.583+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3169399254 shutdown_connections 2024-07-24T22:05:36.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.583+0000 7f5a60f3b640 1 --2- 172.21.15.47:0/3169399254 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5a480b3c20 0x7f5a480b60e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.583+0000 7f5a60f3b640 1 --2- 172.21.15.47:0/3169399254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a5c108b20 0x7f5a5c19e550 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.583+0000 7f5a60f3b640 1 --2- 172.21.15.47:0/3169399254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a5c1081a0 0x7f5a5c1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.583+0000 7f5a60f3b640 1 --2- 172.21.15.47:0/3169399254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a5c102790 0x7f5a5c198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:36.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.583+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3169399254 >> 172.21.15.47:0/3169399254 conn(0x7f5a5c0fe200 msgr2=0x7f5a5c1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:36.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.583+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3169399254 shutdown_connections 2024-07-24T22:05:36.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:36.583+0000 7f5a60f3b640 1 -- 172.21.15.47:0/3169399254 wait complete. 2024-07-24T22:05:36.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:36 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3316005853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-07-24T22:05:36.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:36 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3169399254' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-07-24T22:05:36.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:36 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3316005853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-07-24T22:05:36.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:36 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3169399254' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-07-24T22:05:37.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:36 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3316005853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-07-24T22:05:37.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:36 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3169399254' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-07-24T22:05:37.091 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561078 got 188978561082 for osd.6 2024-07-24T22:05:37.092 DEBUG:teuthology.parallel:result is None 2024-07-24T22:05:37.749 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:37 smithi047 ceph-mon[32551]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 644 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:05:37.785 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612638 got 313532612644 for osd.11 2024-07-24T22:05:37.785 DEBUG:teuthology.parallel:result is None 2024-07-24T22:05:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:37 smithi183 ceph-mon[37007]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 644 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:05:38.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:37 smithi188 ceph-mon[37380]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 644 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:05:38.330 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808865 got 287762808869 for osd.10 2024-07-24T22:05:38.330 DEBUG:teuthology.parallel:result is None 2024-07-24T22:05:39.616 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:39 smithi047 ceph-mon[32551]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:05:39.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:39 smithi183 ceph-mon[37007]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:05:40.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:39 smithi188 ceph-mon[37380]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:05:41.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.363+0000 7f63fd4fb640 1 -- 172.21.15.47:0/2566547080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63f81070a0 msgr2=0x7f63f81074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:41.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.363+0000 7f63fd4fb640 1 --2- 172.21.15.47:0/2566547080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63f81070a0 0x7f63f81074e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009900 tx=0x7f63ec02a410 comp rx=0 tx=0).stop 2024-07-24T22:05:41.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.363+0000 7f63fd4fb640 1 -- 172.21.15.47:0/2566547080 shutdown_connections 2024-07-24T22:05:41.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.363+0000 7f63fd4fb640 1 --2- 172.21.15.47:0/2566547080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63f8107a20 0x7f63f810e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.363+0000 7f63fd4fb640 1 --2- 172.21.15.47:0/2566547080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63f81070a0 0x7f63f81074e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.363+0000 7f63fd4fb640 1 --2- 172.21.15.47:0/2566547080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63f8101690 0x7f63f8101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.363+0000 7f63fd4fb640 1 -- 172.21.15.47:0/2566547080 >> 172.21.15.47:0/2566547080 conn(0x7f63f80fd100 msgr2=0x7f63f80ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:41.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.363+0000 7f63fd4fb640 1 -- 172.21.15.47:0/2566547080 shutdown_connections 2024-07-24T22:05:41.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.363+0000 7f63fd4fb640 1 -- 172.21.15.47:0/2566547080 wait complete. 2024-07-24T22:05:41.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.364+0000 7f63fd4fb640 1 Processor -- start 2024-07-24T22:05:41.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.364+0000 7f63fd4fb640 1 -- start start 2024-07-24T22:05:41.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.364+0000 7f63fd4fb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63f8101690 0x7f63f8197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:41.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.364+0000 7f63fd4fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63f81070a0 0x7f63f8197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:41.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.364+0000 7f63fd4fb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63f8107a20 0x7f63f81982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:41.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.364+0000 7f63fd4fb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8111670 con 0x7f63f81070a0 2024-07-24T22:05:41.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.364+0000 7f63fd4fb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f63f81114f0 con 0x7f63f8101690 2024-07-24T22:05:41.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.364+0000 7f63fd4fb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f63f81117f0 con 0x7f63f8107a20 2024-07-24T22:05:41.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.364+0000 7f63f67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63f81070a0 0x7f63f8197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:41.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.364+0000 7f63f67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63f81070a0 0x7f63f8197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35314/0 (socket says 172.21.15.47:35314) 2024-07-24T22:05:41.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.364+0000 7f63f67fc640 1 -- 172.21.15.47:0/1719943439 learned_addr learned my addr 172.21.15.47:0/1719943439 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:41.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.365+0000 7f63f6ffd640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63f8101690 0x7f63f8197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:41.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.365+0000 7f63f77fe640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63f8107a20 0x7f63f81982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.365+0000 7f63f67fc640 1 -- 172.21.15.47:0/1719943439 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63f8107a20 msgr2=0x7f63f81982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.365+0000 7f63f67fc640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63f8107a20 0x7f63f81982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.365+0000 7f63f67fc640 1 -- 172.21.15.47:0/1719943439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63f8101690 msgr2=0x7f63f8197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.365+0000 7f63f67fc640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63f8101690 0x7f63f8197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.365+0000 7f63f67fc640 1 -- 172.21.15.47:0/1719943439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f81a7010 con 0x7f63f81070a0 2024-07-24T22:05:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.365+0000 7f63f67fc640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63f81070a0 0x7f63f8197d70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f63ec005ab0 tx=0x7f63ec003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.365+0000 7f63dffff640 1 -- 172.21.15.47:0/1719943439 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec03f070 con 0x7f63f81070a0 2024-07-24T22:05:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.365+0000 7f63fd4fb640 1 -- 172.21.15.47:0/1719943439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f81a72a0 con 0x7f63f81070a0 2024-07-24T22:05:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.365+0000 7f63dffff640 1 -- 172.21.15.47:0/1719943439 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63ec031d60 con 0x7f63f81070a0 2024-07-24T22:05:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.365+0000 7f63fd4fb640 1 -- 172.21.15.47:0/1719943439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f81a77d0 con 0x7f63f81070a0 2024-07-24T22:05:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.365+0000 7f63dffff640 1 -- 172.21.15.47:0/1719943439 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec035030 con 0x7f63f81070a0 2024-07-24T22:05:41.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.366+0000 7f63fd4fb640 1 -- 172.21.15.47:0/1719943439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f8101a70 con 0x7f63f81070a0 2024-07-24T22:05:41.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.368+0000 7f63dffff640 1 -- 172.21.15.47:0/1719943439 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f63ec042070 con 0x7f63f81070a0 2024-07-24T22:05:41.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.368+0000 7f63dffff640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63e00b3c20 0x7f63e00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:41.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.369+0000 7f63dffff640 1 -- 172.21.15.47:0/1719943439 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f63ec104230 con 0x7f63f81070a0 2024-07-24T22:05:41.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.369+0000 7f63f6ffd640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63e00b3c20 0x7f63e00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:41.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.369+0000 7f63f6ffd640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63e00b3c20 0x7f63e00b60e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f63e800bbe0 tx=0x7f63e800b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:41.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.372+0000 7f63dffff640 1 -- 172.21.15.47:0/1719943439 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f63ec0cb760 con 0x7f63f81070a0 2024-07-24T22:05:41.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.253+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2816034208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf141070a0 msgr2=0x7fdf141074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.253+0000 7fdf18e1b640 1 --2- 172.21.15.47:0/2816034208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf141070a0 0x7fdf141074e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009900 tx=0x7fdf0802a410 comp rx=0 tx=0).stop 2024-07-24T22:05:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.253+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2816034208 shutdown_connections 2024-07-24T22:05:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.253+0000 7fdf18e1b640 1 --2- 172.21.15.47:0/2816034208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf14107a20 0x7fdf1410e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.253+0000 7fdf18e1b640 1 --2- 172.21.15.47:0/2816034208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf141070a0 0x7fdf141074e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.253+0000 7fdf18e1b640 1 --2- 172.21.15.47:0/2816034208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf14101690 0x7fdf14101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.253+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2816034208 >> 172.21.15.47:0/2816034208 conn(0x7fdf140fd100 msgr2=0x7fdf140ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.253+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2816034208 shutdown_connections 2024-07-24T22:05:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.253+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2816034208 wait complete. 2024-07-24T22:05:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.254+0000 7fdf18e1b640 1 Processor -- start 2024-07-24T22:05:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.254+0000 7fdf18e1b640 1 -- start start 2024-07-24T22:05:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.254+0000 7fdf18e1b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf14101690 0x7fdf14198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.254+0000 7fdf18e1b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf141070a0 0x7fdf14199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.254+0000 7fdf18e1b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf14107a20 0x7fdf1419e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.254+0000 7fdf18e1b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdf141127c0 con 0x7fdf14101690 2024-07-24T22:05:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.254+0000 7fdf18e1b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdf14112640 con 0x7fdf141070a0 2024-07-24T22:05:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.254+0000 7fdf18e1b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdf14112940 con 0x7fdf14107a20 2024-07-24T22:05:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.254+0000 7fdf1259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf14101690 0x7fdf14198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.254+0000 7fdf1259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf14101690 0x7fdf14198c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35286/0 (socket says 172.21.15.47:35286) 2024-07-24T22:05:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.254+0000 7fdf1259c640 1 -- 172.21.15.47:0/2138001656 learned_addr learned my addr 172.21.15.47:0/2138001656 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf11d9b640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf141070a0 0x7fdf14199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf12d9d640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf14107a20 0x7fdf1419e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf1259c640 1 -- 172.21.15.47:0/2138001656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf14107a20 msgr2=0x7fdf1419e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf1259c640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf14107a20 0x7fdf1419e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf1259c640 1 -- 172.21.15.47:0/2138001656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf141070a0 msgr2=0x7fdf14199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf1259c640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf141070a0 0x7fdf14199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf1259c640 1 -- 172.21.15.47:0/2138001656 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1419ece0 con 0x7fdf14101690 2024-07-24T22:05:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf11d9b640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf141070a0 0x7fdf14199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf12d9d640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf14107a20 0x7fdf1419e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf1259c640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf14101690 0x7fdf14198c30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400d950 tx=0x7fdf0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf037fe640 1 -- 172.21.15.47:0/2138001656 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04017030 con 0x7fdf14101690 2024-07-24T22:05:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2138001656 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1419efd0 con 0x7fdf14101690 2024-07-24T22:05:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf037fe640 1 -- 172.21.15.47:0/2138001656 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf04004020 con 0x7fdf14101690 2024-07-24T22:05:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf037fe640 1 -- 172.21.15.47:0/2138001656 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf040047a0 con 0x7fdf14101690 2024-07-24T22:05:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.255+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2138001656 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf141a5860 con 0x7fdf14101690 2024-07-24T22:05:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.256+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2138001656 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf14101a70 con 0x7fdf14101690 2024-07-24T22:05:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.258+0000 7fdf037fe640 1 -- 172.21.15.47:0/2138001656 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fdf04009a30 con 0x7fdf14101690 2024-07-24T22:05:41.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.259+0000 7fdf037fe640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdefc0b3ca0 0x7fdefc0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:41.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.259+0000 7fdf11d9b640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdefc0b3ca0 0x7fdefc0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:41.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.259+0000 7fdf037fe640 1 -- 172.21.15.47:0/2138001656 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fdf040e38d0 con 0x7fdf14101690 2024-07-24T22:05:41.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.259+0000 7fdf11d9b640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdefc0b3ca0 0x7fdefc0b6160 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdf08031440 tx=0x7fdf08005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:41.532 INFO:teuthology.orchestra.run.smithi047.stdout:81604378701 2024-07-24T22:05:41.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.263+0000 7fdf037fe640 1 -- 172.21.15.47:0/2138001656 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fdf040aae00 con 0x7fdf14101690 2024-07-24T22:05:41.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.462+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2138001656 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fdf14109860 con 0x7fdf14101690 2024-07-24T22:05:41.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.463+0000 7fdf037fe640 1 -- 172.21.15.47:0/2138001656 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf040a4e20 con 0x7fdf14101690 2024-07-24T22:05:41.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.465+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2138001656 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdefc0b3ca0 msgr2=0x7fdefc0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:41.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.465+0000 7fdf18e1b640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdefc0b3ca0 0x7fdefc0b6160 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdf08031440 tx=0x7fdf08005a20 comp rx=0 tx=0).stop 2024-07-24T22:05:41.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.465+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2138001656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf14101690 msgr2=0x7fdf14198c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:41.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.465+0000 7fdf18e1b640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf14101690 0x7fdf14198c30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400d950 tx=0x7fdf0400de10 comp rx=0 tx=0).stop 2024-07-24T22:05:41.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.465+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2138001656 shutdown_connections 2024-07-24T22:05:41.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.465+0000 7fdf18e1b640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdefc0b3ca0 0x7fdefc0b6160 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.465+0000 7fdf18e1b640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf14107a20 0x7fdf1419e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.465+0000 7fdf18e1b640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf141070a0 0x7fdf14199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.465+0000 7fdf18e1b640 1 --2- 172.21.15.47:0/2138001656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf14101690 0x7fdf14198c30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.465+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2138001656 >> 172.21.15.47:0/2138001656 conn(0x7fdf140fd100 msgr2=0x7fdf140ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:41.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.465+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2138001656 shutdown_connections 2024-07-24T22:05:41.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.465+0000 7fdf18e1b640 1 -- 172.21.15.47:0/2138001656 wait complete. 2024-07-24T22:05:41.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.580+0000 7f63fd4fb640 1 -- 172.21.15.47:0/1719943439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f63f806b260 con 0x7f63f81070a0 2024-07-24T22:05:41.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.580+0000 7f63dffff640 1 -- 172.21.15.47:0/1719943439 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f63f806b260 con 0x7f63f81070a0 2024-07-24T22:05:41.583 INFO:teuthology.orchestra.run.smithi047.stdout:240518168627 2024-07-24T22:05:41.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.582+0000 7f63fd4fb640 1 -- 172.21.15.47:0/1719943439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63e00b3c20 msgr2=0x7f63e00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:41.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.582+0000 7f63fd4fb640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63e00b3c20 0x7f63e00b60e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f63e800bbe0 tx=0x7f63e800b390 comp rx=0 tx=0).stop 2024-07-24T22:05:41.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.582+0000 7f63fd4fb640 1 -- 172.21.15.47:0/1719943439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63f81070a0 msgr2=0x7f63f8197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:41.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.582+0000 7f63fd4fb640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63f81070a0 0x7f63f8197d70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f63ec005ab0 tx=0x7f63ec003c80 comp rx=0 tx=0).stop 2024-07-24T22:05:41.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.582+0000 7f63fd4fb640 1 -- 172.21.15.47:0/1719943439 shutdown_connections 2024-07-24T22:05:41.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.582+0000 7f63fd4fb640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63e00b3c20 0x7f63e00b60e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.582+0000 7f63fd4fb640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63f8107a20 0x7f63f81982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.582+0000 7f63fd4fb640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63f81070a0 0x7f63f8197d70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.582+0000 7f63fd4fb640 1 --2- 172.21.15.47:0/1719943439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63f8101690 0x7f63f8197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:41.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.582+0000 7f63fd4fb640 1 -- 172.21.15.47:0/1719943439 >> 172.21.15.47:0/1719943439 conn(0x7f63f80fd100 msgr2=0x7f63f80ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:41.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.583+0000 7f63fd4fb640 1 -- 172.21.15.47:0/1719943439 shutdown_connections 2024-07-24T22:05:41.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:41.583+0000 7f63fd4fb640 1 -- 172.21.15.47:0/1719943439 wait complete. 2024-07-24T22:05:41.724 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:41 smithi047 ceph-mon[32551]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:05:41.724 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:41 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2138001656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-07-24T22:05:41.724 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:41 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1719943439' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-07-24T22:05:41.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:41 smithi183 ceph-mon[37007]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:05:41.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:41 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2138001656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-07-24T22:05:41.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:41 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1719943439' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-07-24T22:05:42.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:41 smithi188 ceph-mon[37380]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:05:42.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:41 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2138001656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-07-24T22:05:42.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:41 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1719943439' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-07-24T22:05:42.390 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168622 got 240518168627 for osd.8 2024-07-24T22:05:42.390 DEBUG:teuthology.parallel:result is None 2024-07-24T22:05:42.841 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378697 got 81604378701 for osd.2 2024-07-24T22:05:42.841 DEBUG:teuthology.parallel:result is None 2024-07-24T22:05:42.842 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-07-24T22:05:42.842 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph pg dump --format=json 2024-07-24T22:05:43.113 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:43.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:43 smithi183 ceph-mon[37007]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-07-24T22:05:43.930 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:43 smithi047 ceph-mon[32551]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-07-24T22:05:44.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:43 smithi188 ceph-mon[37380]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-07-24T22:05:44.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.769+0000 7f004bfd7640 1 -- 172.21.15.47:0/560675656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f004410cb00 msgr2=0x7f004410ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:44.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.769+0000 7f004bfd7640 1 --2- 172.21.15.47:0/560675656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f004410cb00 0x7f004410ef60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f003c009ca0 tx=0x7f003c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:05:44.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.769+0000 7f004bfd7640 1 -- 172.21.15.47:0/560675656 shutdown_connections 2024-07-24T22:05:44.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.769+0000 7f004bfd7640 1 --2- 172.21.15.47:0/560675656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f004410cb00 0x7f004410ef60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:44.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.769+0000 7f004bfd7640 1 --2- 172.21.15.47:0/560675656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0044103fc0 0x7f004410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:44.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.769+0000 7f004bfd7640 1 --2- 172.21.15.47:0/560675656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00441036a0 0x7f0044103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:44.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.769+0000 7f004bfd7640 1 -- 172.21.15.47:0/560675656 >> 172.21.15.47:0/560675656 conn(0x7f00440fd100 msgr2=0x7f00440ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.769+0000 7f004bfd7640 1 -- 172.21.15.47:0/560675656 shutdown_connections 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.769+0000 7f004bfd7640 1 -- 172.21.15.47:0/560675656 wait complete. 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004bfd7640 1 Processor -- start 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004bfd7640 1 -- start start 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004bfd7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00441036a0 0x7f0044101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004bfd7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0044103fc0 0x7f0044101890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004bfd7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f004410cb00 0x7f0044101dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004bfd7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00441127b0 con 0x7f004410cb00 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004bfd7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0044112630 con 0x7f00441036a0 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004bfd7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0044112930 con 0x7f0044103fc0 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004a574640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f004410cb00 0x7f0044101dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004a574640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f004410cb00 0x7f0044101dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35328/0 (socket says 172.21.15.47:35328) 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004a574640 1 -- 172.21.15.47:0/354677720 learned_addr learned my addr 172.21.15.47:0/354677720 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f0049d73640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00441036a0 0x7f0044101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f0049572640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0044103fc0 0x7f0044101890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004a574640 1 -- 172.21.15.47:0/354677720 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0044103fc0 msgr2=0x7f0044101890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004a574640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0044103fc0 0x7f0044101890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004a574640 1 -- 172.21.15.47:0/354677720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00441036a0 msgr2=0x7f0044101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.770+0000 7f004a574640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00441036a0 0x7f0044101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.771+0000 7f004a574640 1 -- 172.21.15.47:0/354677720 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00441a7060 con 0x7f004410cb00 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.771+0000 7f0049572640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0044103fc0 0x7f0044101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.771+0000 7f0049d73640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00441036a0 0x7f0044101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.771+0000 7f004a574640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f004410cb00 0x7f0044101dd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f003c009430 tx=0x7f003c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.771+0000 7f003affd640 1 -- 172.21.15.47:0/354677720 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003c003c30 con 0x7f004410cb00 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.771+0000 7f003affd640 1 -- 172.21.15.47:0/354677720 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f003c003dd0 con 0x7f004410cb00 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.771+0000 7f004bfd7640 1 -- 172.21.15.47:0/354677720 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00441a72f0 con 0x7f004410cb00 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.771+0000 7f003affd640 1 -- 172.21.15.47:0/354677720 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003c02faa0 con 0x7f004410cb00 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.771+0000 7f004bfd7640 1 -- 172.21.15.47:0/354677720 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00441a7830 con 0x7f004410cb00 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.772+0000 7f004bfd7640 1 -- 172.21.15.47:0/354677720 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0044103a80 con 0x7f004410cb00 2024-07-24T22:05:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.774+0000 7f003affd640 1 -- 172.21.15.47:0/354677720 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f003c02fc40 con 0x7f004410cb00 2024-07-24T22:05:44.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.774+0000 7f003affd640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00300b3c20 0x7f00300b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:44.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.774+0000 7f0049d73640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00300b3c20 0x7f00300b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:44.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.774+0000 7f003affd640 1 -- 172.21.15.47:0/354677720 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f003c1054f0 con 0x7f004410cb00 2024-07-24T22:05:44.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.775+0000 7f0049d73640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00300b3c20 0x7f00300b60e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f00400058c0 tx=0x7f004000a250 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:44.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.778+0000 7f003affd640 1 -- 172.21.15.47:0/354677720 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f003c0ccab0 con 0x7f004410cb00 2024-07-24T22:05:44.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.969+0000 7f004bfd7640 1 -- 172.21.15.47:0/354677720 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00440fed10 con 0x7f00300b3c20 2024-07-24T22:05:44.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.973+0000 7f003affd640 1 -- 172.21.15.47:0/354677720 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258744 (secure 0 0 0) 0x7f00440fed10 con 0x7f00300b3c20 2024-07-24T22:05:44.977 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:05:44.978 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-07-24T22:05:44.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.977+0000 7f004bfd7640 1 -- 172.21.15.47:0/354677720 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00300b3c20 msgr2=0x7f00300b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:44.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.977+0000 7f004bfd7640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00300b3c20 0x7f00300b60e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f00400058c0 tx=0x7f004000a250 comp rx=0 tx=0).stop 2024-07-24T22:05:44.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.977+0000 7f004bfd7640 1 -- 172.21.15.47:0/354677720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f004410cb00 msgr2=0x7f0044101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:44.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.977+0000 7f004bfd7640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f004410cb00 0x7f0044101dd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f003c009430 tx=0x7f003c0319f0 comp rx=0 tx=0).stop 2024-07-24T22:05:44.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.977+0000 7f004bfd7640 1 -- 172.21.15.47:0/354677720 shutdown_connections 2024-07-24T22:05:44.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.977+0000 7f004bfd7640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00300b3c20 0x7f00300b60e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:44.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.977+0000 7f004bfd7640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f004410cb00 0x7f0044101dd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:44.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.977+0000 7f004bfd7640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0044103fc0 0x7f0044101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.977+0000 7f004bfd7640 1 --2- 172.21.15.47:0/354677720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00441036a0 0x7f0044101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.977+0000 7f004bfd7640 1 -- 172.21.15.47:0/354677720 >> 172.21.15.47:0/354677720 conn(0x7f00440fd100 msgr2=0x7f004410ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.977+0000 7f004bfd7640 1 -- 172.21.15.47:0/354677720 shutdown_connections 2024-07-24T22:05:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:44.977+0000 7f004bfd7640 1 -- 172.21.15.47:0/354677720 wait complete. 2024-07-24T22:05:45.787 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-07-24T22:05:44.100725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653984,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":284,"num_read_kb":234,"num_write":213,"num_write_kb":2242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952539,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":666,"ondisk_log_size":666,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387224,"kb_used_data":13032,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554600,"statfs":{"total":1151940427776,"available":1151543910400,"internally_reserved":0,"allocated":13344768,"data_stored":7597656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003663"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573950+0000","last_change":"2024-07-24T22:03:53.407929+0000","last_active":"2024-07-24T22:05:27.573950+0000","last_peered":"2024-07-24T22:05:27.573950+0000","last_clean":"2024-07-24T22:05:27.573950+0000","last_became_active":"2024-07-24T22:03:53.407508+0000","last_became_peered":"2024-07-24T22:03:53.407508+0000","last_unstale":"2024-07-24T22:05:27.573950+0000","last_undegraded":"2024-07-24T22:05:27.573950+0000","last_fullsized":"2024-07-24T22:05:27.573950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:00:35.699906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696483+0000","last_change":"2024-07-24T22:03:53.404867+0000","last_active":"2024-07-24T22:05:27.696483+0000","last_peered":"2024-07-24T22:05:27.696483+0000","last_clean":"2024-07-24T22:05:27.696483+0000","last_became_active":"2024-07-24T22:03:53.404309+0000","last_became_peered":"2024-07-24T22:03:53.404309+0000","last_unstale":"2024-07-24T22:05:27.696483+0000","last_undegraded":"2024-07-24T22:05:27.696483+0000","last_fullsized":"2024-07-24T22:05:27.696483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:21:51.238815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696354+0000","last_change":"2024-07-24T22:03:53.404368+0000","last_active":"2024-07-24T22:05:27.696354+0000","last_peered":"2024-07-24T22:05:27.696354+0000","last_clean":"2024-07-24T22:05:27.696354+0000","last_became_active":"2024-07-24T22:03:53.403941+0000","last_became_peered":"2024-07-24T22:03:53.403941+0000","last_unstale":"2024-07-24T22:05:27.696354+0000","last_undegraded":"2024-07-24T22:05:27.696354+0000","last_fullsized":"2024-07-24T22:05:27.696354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:10:09.884724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576486+0000","last_change":"2024-07-24T22:03:53.407661+0000","last_active":"2024-07-24T22:05:27.576486+0000","last_peered":"2024-07-24T22:05:27.576486+0000","last_clean":"2024-07-24T22:05:27.576486+0000","last_became_active":"2024-07-24T22:03:53.407375+0000","last_became_peered":"2024-07-24T22:03:53.407375+0000","last_unstale":"2024-07-24T22:05:27.576486+0000","last_undegraded":"2024-07-24T22:05:27.576486+0000","last_fullsized":"2024-07-24T22:05:27.576486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:34.000666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575915+0000","last_change":"2024-07-24T22:03:53.406227+0000","last_active":"2024-07-24T22:05:27.575915+0000","last_peered":"2024-07-24T22:05:27.575915+0000","last_clean":"2024-07-24T22:05:27.575915+0000","last_became_active":"2024-07-24T22:03:53.405819+0000","last_became_peered":"2024-07-24T22:03:53.405819+0000","last_unstale":"2024-07-24T22:05:27.575915+0000","last_undegraded":"2024-07-24T22:05:27.575915+0000","last_fullsized":"2024-07-24T22:05:27.575915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:59.022972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588760+0000","last_change":"2024-07-24T22:04:27.501754+0000","last_active":"2024-07-24T22:05:27.588760+0000","last_peered":"2024-07-24T22:05:27.588760+0000","last_clean":"2024-07-24T22:05:27.588760+0000","last_became_active":"2024-07-24T22:04:27.501340+0000","last_became_peered":"2024-07-24T22:04:27.501340+0000","last_unstale":"2024-07-24T22:05:27.588760+0000","last_undegraded":"2024-07-24T22:05:27.588760+0000","last_fullsized":"2024-07-24T22:05:27.588760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:38:04.880980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575905+0000","last_change":"2024-07-24T22:03:53.413012+0000","last_active":"2024-07-24T22:05:27.575905+0000","last_peered":"2024-07-24T22:05:27.575905+0000","last_clean":"2024-07-24T22:05:27.575905+0000","last_became_active":"2024-07-24T22:03:53.411791+0000","last_became_peered":"2024-07-24T22:03:53.411791+0000","last_unstale":"2024-07-24T22:05:27.575905+0000","last_undegraded":"2024-07-24T22:05:27.575905+0000","last_fullsized":"2024-07-24T22:05:27.575905+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:15:02.939598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695709+0000","last_change":"2024-07-24T22:04:27.502867+0000","last_active":"2024-07-24T22:05:27.695709+0000","last_peered":"2024-07-24T22:05:27.695709+0000","last_clean":"2024-07-24T22:05:27.695709+0000","last_became_active":"2024-07-24T22:04:27.502515+0000","last_became_peered":"2024-07-24T22:04:27.502515+0000","last_unstale":"2024-07-24T22:05:27.695709+0000","last_undegraded":"2024-07-24T22:05:27.695709+0000","last_fullsized":"2024-07-24T22:05:27.695709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:58:39.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,10],"acting":[3,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572125+0000","last_change":"2024-07-24T22:03:53.413213+0000","last_active":"2024-07-24T22:05:27.572125+0000","last_peered":"2024-07-24T22:05:27.572125+0000","last_clean":"2024-07-24T22:05:27.572125+0000","last_became_active":"2024-07-24T22:03:53.412725+0000","last_became_peered":"2024-07-24T22:03:53.412725+0000","last_unstale":"2024-07-24T22:05:27.572125+0000","last_undegraded":"2024-07-24T22:05:27.572125+0000","last_fullsized":"2024-07-24T22:05:27.572125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:34:01.897965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589168+0000","last_change":"2024-07-24T22:03:53.401129+0000","last_active":"2024-07-24T22:05:27.589168+0000","last_peered":"2024-07-24T22:05:27.589168+0000","last_clean":"2024-07-24T22:05:27.589168+0000","last_became_active":"2024-07-24T22:03:53.400780+0000","last_became_peered":"2024-07-24T22:03:53.400780+0000","last_unstale":"2024-07-24T22:05:27.589168+0000","last_undegraded":"2024-07-24T22:05:27.589168+0000","last_fullsized":"2024-07-24T22:05:27.589168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:28:37.825021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576181+0000","last_change":"2024-07-24T22:03:53.406490+0000","last_active":"2024-07-24T22:05:27.576181+0000","last_peered":"2024-07-24T22:05:27.576181+0000","last_clean":"2024-07-24T22:05:27.576181+0000","last_became_active":"2024-07-24T22:03:53.406108+0000","last_became_peered":"2024-07-24T22:03:53.406108+0000","last_unstale":"2024-07-24T22:05:27.576181+0000","last_undegraded":"2024-07-24T22:05:27.576181+0000","last_fullsized":"2024-07-24T22:05:27.576181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:37.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695913+0000","last_change":"2024-07-24T22:04:27.503165+0000","last_active":"2024-07-24T22:05:27.695913+0000","last_peered":"2024-07-24T22:05:27.695913+0000","last_clean":"2024-07-24T22:05:27.695913+0000","last_became_active":"2024-07-24T22:04:27.502861+0000","last_became_peered":"2024-07-24T22:04:27.502861+0000","last_unstale":"2024-07-24T22:05:27.695913+0000","last_undegraded":"2024-07-24T22:05:27.695913+0000","last_fullsized":"2024-07-24T22:05:27.695913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:36:41.353268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571191+0000","last_change":"2024-07-24T22:03:53.392763+0000","last_active":"2024-07-24T22:05:27.571191+0000","last_peered":"2024-07-24T22:05:27.571191+0000","last_clean":"2024-07-24T22:05:27.571191+0000","last_became_active":"2024-07-24T22:03:53.392476+0000","last_became_peered":"2024-07-24T22:03:53.392476+0000","last_unstale":"2024-07-24T22:05:27.571191+0000","last_undegraded":"2024-07-24T22:05:27.571191+0000","last_fullsized":"2024-07-24T22:05:27.571191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:25:13.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696312+0000","last_change":"2024-07-24T22:03:53.406937+0000","last_active":"2024-07-24T22:05:27.696312+0000","last_peered":"2024-07-24T22:05:27.696312+0000","last_clean":"2024-07-24T22:05:27.696312+0000","last_became_active":"2024-07-24T22:03:53.406495+0000","last_became_peered":"2024-07-24T22:03:53.406495+0000","last_unstale":"2024-07-24T22:05:27.696312+0000","last_undegraded":"2024-07-24T22:05:27.696312+0000","last_fullsized":"2024-07-24T22:05:27.696312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:06:50.434751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695657+0000","last_change":"2024-07-24T22:03:53.401073+0000","last_active":"2024-07-24T22:05:27.695657+0000","last_peered":"2024-07-24T22:05:27.695657+0000","last_clean":"2024-07-24T22:05:27.695657+0000","last_became_active":"2024-07-24T22:03:53.399675+0000","last_became_peered":"2024-07-24T22:03:53.399675+0000","last_unstale":"2024-07-24T22:05:27.695657+0000","last_undegraded":"2024-07-24T22:05:27.695657+0000","last_fullsized":"2024-07-24T22:05:27.695657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:59:25.461178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571598+0000","last_change":"2024-07-24T22:03:53.408289+0000","last_active":"2024-07-24T22:05:27.571598+0000","last_peered":"2024-07-24T22:05:27.571598+0000","last_clean":"2024-07-24T22:05:27.571598+0000","last_became_active":"2024-07-24T22:03:53.407950+0000","last_became_peered":"2024-07-24T22:03:53.407950+0000","last_unstale":"2024-07-24T22:05:27.571598+0000","last_undegraded":"2024-07-24T22:05:27.571598+0000","last_fullsized":"2024-07-24T22:05:27.571598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:10:30.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573965+0000","last_change":"2024-07-24T22:03:53.409909+0000","last_active":"2024-07-24T22:05:27.573965+0000","last_peered":"2024-07-24T22:05:27.573965+0000","last_clean":"2024-07-24T22:05:27.573965+0000","last_became_active":"2024-07-24T22:03:53.409183+0000","last_became_peered":"2024-07-24T22:03:53.409183+0000","last_unstale":"2024-07-24T22:05:27.573965+0000","last_undegraded":"2024-07-24T22:05:27.573965+0000","last_fullsized":"2024-07-24T22:05:27.573965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:14:50.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695644+0000","last_change":"2024-07-24T22:03:53.401198+0000","last_active":"2024-07-24T22:05:27.695644+0000","last_peered":"2024-07-24T22:05:27.695644+0000","last_clean":"2024-07-24T22:05:27.695644+0000","last_became_active":"2024-07-24T22:03:53.400885+0000","last_became_peered":"2024-07-24T22:03:53.400885+0000","last_unstale":"2024-07-24T22:05:27.695644+0000","last_undegraded":"2024-07-24T22:05:27.695644+0000","last_fullsized":"2024-07-24T22:05:27.695644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:59:37.965714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695930+0000","last_change":"2024-07-24T22:03:53.406590+0000","last_active":"2024-07-24T22:05:27.695930+0000","last_peered":"2024-07-24T22:05:27.695930+0000","last_clean":"2024-07-24T22:05:27.695930+0000","last_became_active":"2024-07-24T22:03:53.406283+0000","last_became_peered":"2024-07-24T22:03:53.406283+0000","last_unstale":"2024-07-24T22:05:27.695930+0000","last_undegraded":"2024-07-24T22:05:27.695930+0000","last_fullsized":"2024-07-24T22:05:27.695930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:30.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573313+0000","last_change":"2024-07-24T22:03:53.408790+0000","last_active":"2024-07-24T22:05:27.573313+0000","last_peered":"2024-07-24T22:05:27.573313+0000","last_clean":"2024-07-24T22:05:27.573313+0000","last_became_active":"2024-07-24T22:03:53.408480+0000","last_became_peered":"2024-07-24T22:03:53.408480+0000","last_unstale":"2024-07-24T22:05:27.573313+0000","last_undegraded":"2024-07-24T22:05:27.573313+0000","last_fullsized":"2024-07-24T22:05:27.573313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:59.601606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571122+0000","last_change":"2024-07-24T22:03:53.407400+0000","last_active":"2024-07-24T22:05:27.571122+0000","last_peered":"2024-07-24T22:05:27.571122+0000","last_clean":"2024-07-24T22:05:27.571122+0000","last_became_active":"2024-07-24T22:03:53.407084+0000","last_became_peered":"2024-07-24T22:03:53.407084+0000","last_unstale":"2024-07-24T22:05:27.571122+0000","last_undegraded":"2024-07-24T22:05:27.571122+0000","last_fullsized":"2024-07-24T22:05:27.571122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:51:04.942504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571727+0000","last_change":"2024-07-24T22:03:53.407444+0000","last_active":"2024-07-24T22:05:27.571727+0000","last_peered":"2024-07-24T22:05:27.571727+0000","last_clean":"2024-07-24T22:05:27.571727+0000","last_became_active":"2024-07-24T22:03:53.407025+0000","last_became_peered":"2024-07-24T22:03:53.407025+0000","last_unstale":"2024-07-24T22:05:27.571727+0000","last_undegraded":"2024-07-24T22:05:27.571727+0000","last_fullsized":"2024-07-24T22:05:27.571727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:47:49.620354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696121+0000","last_change":"2024-07-24T22:03:53.406748+0000","last_active":"2024-07-24T22:05:27.696121+0000","last_peered":"2024-07-24T22:05:27.696121+0000","last_clean":"2024-07-24T22:05:27.696121+0000","last_became_active":"2024-07-24T22:03:53.406398+0000","last_became_peered":"2024-07-24T22:03:53.406398+0000","last_unstale":"2024-07-24T22:05:27.696121+0000","last_undegraded":"2024-07-24T22:05:27.696121+0000","last_fullsized":"2024-07-24T22:05:27.696121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:35:40.117375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574638+0000","last_change":"2024-07-24T22:03:53.402203+0000","last_active":"2024-07-24T22:05:27.574638+0000","last_peered":"2024-07-24T22:05:27.574638+0000","last_clean":"2024-07-24T22:05:27.574638+0000","last_became_active":"2024-07-24T22:03:53.401826+0000","last_became_peered":"2024-07-24T22:03:53.401826+0000","last_unstale":"2024-07-24T22:05:27.574638+0000","last_undegraded":"2024-07-24T22:05:27.574638+0000","last_fullsized":"2024-07-24T22:05:27.574638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:45.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696615+0000","last_change":"2024-07-24T22:03:53.408179+0000","last_active":"2024-07-24T22:05:27.696615+0000","last_peered":"2024-07-24T22:05:27.696615+0000","last_clean":"2024-07-24T22:05:27.696615+0000","last_became_active":"2024-07-24T22:03:53.407547+0000","last_became_peered":"2024-07-24T22:03:53.407547+0000","last_unstale":"2024-07-24T22:05:27.696615+0000","last_undegraded":"2024-07-24T22:05:27.696615+0000","last_fullsized":"2024-07-24T22:05:27.696615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:03:52.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696021+0000","last_change":"2024-07-24T22:03:53.408550+0000","last_active":"2024-07-24T22:05:27.696021+0000","last_peered":"2024-07-24T22:05:27.696021+0000","last_clean":"2024-07-24T22:05:27.696021+0000","last_became_active":"2024-07-24T22:03:53.408119+0000","last_became_peered":"2024-07-24T22:03:53.408119+0000","last_unstale":"2024-07-24T22:05:27.696021+0000","last_undegraded":"2024-07-24T22:05:27.696021+0000","last_fullsized":"2024-07-24T22:05:27.696021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:33:54.154606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573794+0000","last_change":"2024-07-24T22:03:53.412562+0000","last_active":"2024-07-24T22:05:27.573794+0000","last_peered":"2024-07-24T22:05:27.573794+0000","last_clean":"2024-07-24T22:05:27.573794+0000","last_became_active":"2024-07-24T22:03:53.412231+0000","last_became_peered":"2024-07-24T22:03:53.412231+0000","last_unstale":"2024-07-24T22:05:27.573794+0000","last_undegraded":"2024-07-24T22:05:27.573794+0000","last_fullsized":"2024-07-24T22:05:27.573794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:53:48.403662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571125+0000","last_change":"2024-07-24T22:03:53.398212+0000","last_active":"2024-07-24T22:05:27.571125+0000","last_peered":"2024-07-24T22:05:27.571125+0000","last_clean":"2024-07-24T22:05:27.571125+0000","last_became_active":"2024-07-24T22:03:53.397853+0000","last_became_peered":"2024-07-24T22:03:53.397853+0000","last_unstale":"2024-07-24T22:05:27.571125+0000","last_undegraded":"2024-07-24T22:05:27.571125+0000","last_fullsized":"2024-07-24T22:05:27.571125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:39:47.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696235+0000","last_change":"2024-07-24T22:03:53.397188+0000","last_active":"2024-07-24T22:05:27.696235+0000","last_peered":"2024-07-24T22:05:27.696235+0000","last_clean":"2024-07-24T22:05:27.696235+0000","last_became_active":"2024-07-24T22:03:53.396865+0000","last_became_peered":"2024-07-24T22:03:53.396865+0000","last_unstale":"2024-07-24T22:05:27.696235+0000","last_undegraded":"2024-07-24T22:05:27.696235+0000","last_fullsized":"2024-07-24T22:05:27.696235+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:20:49.074330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695747+0000","last_change":"2024-07-24T22:03:53.406605+0000","last_active":"2024-07-24T22:05:27.695747+0000","last_peered":"2024-07-24T22:05:27.695747+0000","last_clean":"2024-07-24T22:05:27.695747+0000","last_became_active":"2024-07-24T22:03:53.406264+0000","last_became_peered":"2024-07-24T22:03:53.406264+0000","last_unstale":"2024-07-24T22:05:27.695747+0000","last_undegraded":"2024-07-24T22:05:27.695747+0000","last_fullsized":"2024-07-24T22:05:27.695747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:13:46.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695952+0000","last_change":"2024-07-24T22:03:53.400422+0000","last_active":"2024-07-24T22:05:27.695952+0000","last_peered":"2024-07-24T22:05:27.695952+0000","last_clean":"2024-07-24T22:05:27.695952+0000","last_became_active":"2024-07-24T22:03:53.400096+0000","last_became_peered":"2024-07-24T22:03:53.400096+0000","last_unstale":"2024-07-24T22:05:27.695952+0000","last_undegraded":"2024-07-24T22:05:27.695952+0000","last_fullsized":"2024-07-24T22:05:27.695952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:04:07.882659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573300+0000","last_change":"2024-07-24T22:03:53.413231+0000","last_active":"2024-07-24T22:05:27.573300+0000","last_peered":"2024-07-24T22:05:27.573300+0000","last_clean":"2024-07-24T22:05:27.573300+0000","last_became_active":"2024-07-24T22:03:53.412825+0000","last_became_peered":"2024-07-24T22:03:53.412825+0000","last_unstale":"2024-07-24T22:05:27.573300+0000","last_undegraded":"2024-07-24T22:05:27.573300+0000","last_fullsized":"2024-07-24T22:05:27.573300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:59:30.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575892+0000","last_change":"2024-07-24T22:03:53.409007+0000","last_active":"2024-07-24T22:05:27.575892+0000","last_peered":"2024-07-24T22:05:27.575892+0000","last_clean":"2024-07-24T22:05:27.575892+0000","last_became_active":"2024-07-24T22:03:53.408624+0000","last_became_peered":"2024-07-24T22:03:53.408624+0000","last_unstale":"2024-07-24T22:05:27.575892+0000","last_undegraded":"2024-07-24T22:05:27.575892+0000","last_fullsized":"2024-07-24T22:05:27.575892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:31:22.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575265+0000","last_change":"2024-07-24T22:03:50.388894+0000","last_active":"2024-07-24T22:05:27.575265+0000","last_peered":"2024-07-24T22:05:27.575265+0000","last_clean":"2024-07-24T22:05:27.575265+0000","last_became_active":"2024-07-24T22:03:50.388608+0000","last_became_peered":"2024-07-24T22:03:50.388608+0000","last_unstale":"2024-07-24T22:05:27.575265+0000","last_undegraded":"2024-07-24T22:05:27.575265+0000","last_fullsized":"2024-07-24T22:05:27.575265+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:36:43.571415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575180+0000","last_change":"2024-07-24T22:03:53.397509+0000","last_active":"2024-07-24T22:05:27.575180+0000","last_peered":"2024-07-24T22:05:27.575180+0000","last_clean":"2024-07-24T22:05:27.575180+0000","last_became_active":"2024-07-24T22:03:53.397186+0000","last_became_peered":"2024-07-24T22:03:53.397186+0000","last_unstale":"2024-07-24T22:05:27.575180+0000","last_undegraded":"2024-07-24T22:05:27.575180+0000","last_fullsized":"2024-07-24T22:05:27.575180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:15:14.081853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588873+0000","last_change":"2024-07-24T22:03:50.383523+0000","last_active":"2024-07-24T22:05:27.588873+0000","last_peered":"2024-07-24T22:05:27.588873+0000","last_clean":"2024-07-24T22:05:27.588873+0000","last_became_active":"2024-07-24T22:03:50.383088+0000","last_became_peered":"2024-07-24T22:03:50.383088+0000","last_unstale":"2024-07-24T22:05:27.588873+0000","last_undegraded":"2024-07-24T22:05:27.588873+0000","last_fullsized":"2024-07-24T22:05:27.588873+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:57:07.824581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570907+0000","last_change":"2024-07-24T22:03:50.383726+0000","last_active":"2024-07-24T22:05:27.570907+0000","last_peered":"2024-07-24T22:05:27.570907+0000","last_clean":"2024-07-24T22:05:27.570907+0000","last_became_active":"2024-07-24T22:03:50.383480+0000","last_became_peered":"2024-07-24T22:03:50.383480+0000","last_unstale":"2024-07-24T22:05:27.570907+0000","last_undegraded":"2024-07-24T22:05:27.570907+0000","last_fullsized":"2024-07-24T22:05:27.570907+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:05:05.093272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695769+0000","last_change":"2024-07-24T22:03:53.406223+0000","last_active":"2024-07-24T22:05:27.695769+0000","last_peered":"2024-07-24T22:05:27.695769+0000","last_clean":"2024-07-24T22:05:27.695769+0000","last_became_active":"2024-07-24T22:03:53.404642+0000","last_became_peered":"2024-07-24T22:03:53.404642+0000","last_unstale":"2024-07-24T22:05:27.695769+0000","last_undegraded":"2024-07-24T22:05:27.695769+0000","last_fullsized":"2024-07-24T22:05:27.695769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:00:51.849538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574845+0000","last_change":"2024-07-24T22:03:50.385780+0000","last_active":"2024-07-24T22:05:27.574845+0000","last_peered":"2024-07-24T22:05:27.574845+0000","last_clean":"2024-07-24T22:05:27.574845+0000","last_became_active":"2024-07-24T22:03:50.385488+0000","last_became_peered":"2024-07-24T22:03:50.385488+0000","last_unstale":"2024-07-24T22:05:27.574845+0000","last_undegraded":"2024-07-24T22:05:27.574845+0000","last_fullsized":"2024-07-24T22:05:27.574845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:47:35.908303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695709+0000","last_change":"2024-07-24T22:03:53.403103+0000","last_active":"2024-07-24T22:05:27.695709+0000","last_peered":"2024-07-24T22:05:27.695709+0000","last_clean":"2024-07-24T22:05:27.695709+0000","last_became_active":"2024-07-24T22:03:53.402810+0000","last_became_peered":"2024-07-24T22:03:53.402810+0000","last_unstale":"2024-07-24T22:05:27.695709+0000","last_undegraded":"2024-07-24T22:05:27.695709+0000","last_fullsized":"2024-07-24T22:05:27.695709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:15.798983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589036+0000","last_change":"2024-07-24T22:03:50.382383+0000","last_active":"2024-07-24T22:05:27.589036+0000","last_peered":"2024-07-24T22:05:27.589036+0000","last_clean":"2024-07-24T22:05:27.589036+0000","last_became_active":"2024-07-24T22:03:50.381629+0000","last_became_peered":"2024-07-24T22:03:50.381629+0000","last_unstale":"2024-07-24T22:05:27.589036+0000","last_undegraded":"2024-07-24T22:05:27.589036+0000","last_fullsized":"2024-07-24T22:05:27.589036+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:17.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572104+0000","last_change":"2024-07-24T22:03:53.409587+0000","last_active":"2024-07-24T22:05:27.572104+0000","last_peered":"2024-07-24T22:05:27.572104+0000","last_clean":"2024-07-24T22:05:27.572104+0000","last_became_active":"2024-07-24T22:03:53.409240+0000","last_became_peered":"2024-07-24T22:03:53.409240+0000","last_unstale":"2024-07-24T22:05:27.572104+0000","last_undegraded":"2024-07-24T22:05:27.572104+0000","last_fullsized":"2024-07-24T22:05:27.572104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:37:18.654244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576399+0000","last_change":"2024-07-24T22:03:50.387933+0000","last_active":"2024-07-24T22:05:27.576399+0000","last_peered":"2024-07-24T22:05:27.576399+0000","last_clean":"2024-07-24T22:05:27.576399+0000","last_became_active":"2024-07-24T22:03:50.386985+0000","last_became_peered":"2024-07-24T22:03:50.386985+0000","last_unstale":"2024-07-24T22:05:27.576399+0000","last_undegraded":"2024-07-24T22:05:27.576399+0000","last_fullsized":"2024-07-24T22:05:27.576399+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:35:29.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696634+0000","last_change":"2024-07-24T22:03:53.404419+0000","last_active":"2024-07-24T22:05:27.696634+0000","last_peered":"2024-07-24T22:05:27.696634+0000","last_clean":"2024-07-24T22:05:27.696634+0000","last_became_active":"2024-07-24T22:03:53.402713+0000","last_became_peered":"2024-07-24T22:03:53.402713+0000","last_unstale":"2024-07-24T22:05:27.696634+0000","last_undegraded":"2024-07-24T22:05:27.696634+0000","last_fullsized":"2024-07-24T22:05:27.696634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:41.262686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575058+0000","last_change":"2024-07-24T22:03:50.511126+0000","last_active":"2024-07-24T22:05:27.575058+0000","last_peered":"2024-07-24T22:05:27.575058+0000","last_clean":"2024-07-24T22:05:27.575058+0000","last_became_active":"2024-07-24T22:03:50.510801+0000","last_became_peered":"2024-07-24T22:03:50.510801+0000","last_unstale":"2024-07-24T22:05:27.575058+0000","last_undegraded":"2024-07-24T22:05:27.575058+0000","last_fullsized":"2024-07-24T22:05:27.575058+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:59:37.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571709+0000","last_change":"2024-07-24T22:03:53.410202+0000","last_active":"2024-07-24T22:05:27.571709+0000","last_peered":"2024-07-24T22:05:27.571709+0000","last_clean":"2024-07-24T22:05:27.571709+0000","last_became_active":"2024-07-24T22:03:53.409884+0000","last_became_peered":"2024-07-24T22:03:53.409884+0000","last_unstale":"2024-07-24T22:05:27.571709+0000","last_undegraded":"2024-07-24T22:05:27.571709+0000","last_fullsized":"2024-07-24T22:05:27.571709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:54:02.603267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'30","reported_seq":258,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:40.608651+0000","last_change":"2024-07-24T22:03:50.386993+0000","last_active":"2024-07-24T22:05:40.608651+0000","last_peered":"2024-07-24T22:05:40.608651+0000","last_clean":"2024-07-24T22:05:40.608651+0000","last_became_active":"2024-07-24T22:03:50.386675+0000","last_became_peered":"2024-07-24T22:03:50.386675+0000","last_unstale":"2024-07-24T22:05:40.608651+0000","last_undegraded":"2024-07-24T22:05:40.608651+0000","last_fullsized":"2024-07-24T22:05:40.608651+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:20:58.384179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62584,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":197,"num_read_kb":159,"num_write":30,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576518+0000","last_change":"2024-07-24T22:03:53.413293+0000","last_active":"2024-07-24T22:05:27.576518+0000","last_peered":"2024-07-24T22:05:27.576518+0000","last_clean":"2024-07-24T22:05:27.576518+0000","last_became_active":"2024-07-24T22:03:53.412900+0000","last_became_peered":"2024-07-24T22:03:53.412900+0000","last_unstale":"2024-07-24T22:05:27.576518+0000","last_undegraded":"2024-07-24T22:05:27.576518+0000","last_fullsized":"2024-07-24T22:05:27.576518+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:11:32.553108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696059+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.696059+0000","last_peered":"2024-07-24T22:05:27.696059+0000","last_clean":"2024-07-24T22:05:27.696059+0000","last_became_active":"2024-07-24T22:03:50.387059+0000","last_became_peered":"2024-07-24T22:03:50.387059+0000","last_unstale":"2024-07-24T22:05:27.696059+0000","last_undegraded":"2024-07-24T22:05:27.696059+0000","last_fullsized":"2024-07-24T22:05:27.696059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:40:06.887090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570856+0000","last_change":"2024-07-24T22:03:53.406808+0000","last_active":"2024-07-24T22:05:27.570856+0000","last_peered":"2024-07-24T22:05:27.570856+0000","last_clean":"2024-07-24T22:05:27.570856+0000","last_became_active":"2024-07-24T22:03:53.406487+0000","last_became_peered":"2024-07-24T22:03:53.406487+0000","last_unstale":"2024-07-24T22:05:27.570856+0000","last_undegraded":"2024-07-24T22:05:27.570856+0000","last_fullsized":"2024-07-24T22:05:27.570856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:44:57.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574876+0000","last_change":"2024-07-24T22:03:50.386881+0000","last_active":"2024-07-24T22:05:27.574876+0000","last_peered":"2024-07-24T22:05:27.574876+0000","last_clean":"2024-07-24T22:05:27.574876+0000","last_became_active":"2024-07-24T22:03:50.386564+0000","last_became_peered":"2024-07-24T22:03:50.386564+0000","last_unstale":"2024-07-24T22:05:27.574876+0000","last_undegraded":"2024-07-24T22:05:27.574876+0000","last_fullsized":"2024-07-24T22:05:27.574876+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:22:22.339854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576223+0000","last_change":"2024-07-24T22:03:53.403207+0000","last_active":"2024-07-24T22:05:27.576223+0000","last_peered":"2024-07-24T22:05:27.576223+0000","last_clean":"2024-07-24T22:05:27.576223+0000","last_became_active":"2024-07-24T22:03:53.402875+0000","last_became_peered":"2024-07-24T22:03:53.402875+0000","last_unstale":"2024-07-24T22:05:27.576223+0000","last_undegraded":"2024-07-24T22:05:27.576223+0000","last_fullsized":"2024-07-24T22:05:27.576223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:25:28.866228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575905+0000","last_change":"2024-07-24T22:03:50.386721+0000","last_active":"2024-07-24T22:05:27.575905+0000","last_peered":"2024-07-24T22:05:27.575905+0000","last_clean":"2024-07-24T22:05:27.575905+0000","last_became_active":"2024-07-24T22:03:50.385654+0000","last_became_peered":"2024-07-24T22:03:50.385654+0000","last_unstale":"2024-07-24T22:05:27.575905+0000","last_undegraded":"2024-07-24T22:05:27.575905+0000","last_fullsized":"2024-07-24T22:05:27.575905+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:16:15.802744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575839+0000","last_change":"2024-07-24T22:03:53.405367+0000","last_active":"2024-07-24T22:05:27.575839+0000","last_peered":"2024-07-24T22:05:27.575839+0000","last_clean":"2024-07-24T22:05:27.575839+0000","last_became_active":"2024-07-24T22:03:53.404875+0000","last_became_peered":"2024-07-24T22:03:53.404875+0000","last_unstale":"2024-07-24T22:05:27.575839+0000","last_undegraded":"2024-07-24T22:05:27.575839+0000","last_fullsized":"2024-07-24T22:05:27.575839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:42.247052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575827+0000","last_change":"2024-07-24T22:04:27.574426+0000","last_active":"2024-07-24T22:05:27.575827+0000","last_peered":"2024-07-24T22:05:27.575827+0000","last_clean":"2024-07-24T22:05:27.575827+0000","last_became_active":"2024-07-24T22:04:27.568176+0000","last_became_peered":"2024-07-24T22:04:27.568176+0000","last_unstale":"2024-07-24T22:05:27.575827+0000","last_undegraded":"2024-07-24T22:05:27.575827+0000","last_fullsized":"2024-07-24T22:05:27.575827+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:20:37.620669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574848+0000","last_change":"2024-07-24T22:03:53.405136+0000","last_active":"2024-07-24T22:05:27.574848+0000","last_peered":"2024-07-24T22:05:27.574848+0000","last_clean":"2024-07-24T22:05:27.574848+0000","last_became_active":"2024-07-24T22:03:53.404043+0000","last_became_peered":"2024-07-24T22:03:53.404043+0000","last_unstale":"2024-07-24T22:05:27.574848+0000","last_undegraded":"2024-07-24T22:05:27.574848+0000","last_fullsized":"2024-07-24T22:05:27.574848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:03:21.912335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576686+0000","last_change":"2024-07-24T22:03:50.382364+0000","last_active":"2024-07-24T22:05:27.576686+0000","last_peered":"2024-07-24T22:05:27.576686+0000","last_clean":"2024-07-24T22:05:27.576686+0000","last_became_active":"2024-07-24T22:03:50.382029+0000","last_became_peered":"2024-07-24T22:03:50.382029+0000","last_unstale":"2024-07-24T22:05:27.576686+0000","last_undegraded":"2024-07-24T22:05:27.576686+0000","last_fullsized":"2024-07-24T22:05:27.576686+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:48:10.004826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573726+0000","last_change":"2024-07-24T22:03:53.413053+0000","last_active":"2024-07-24T22:05:27.573726+0000","last_peered":"2024-07-24T22:05:27.573726+0000","last_clean":"2024-07-24T22:05:27.573726+0000","last_became_active":"2024-07-24T22:03:53.412733+0000","last_became_peered":"2024-07-24T22:03:53.412733+0000","last_unstale":"2024-07-24T22:05:27.573726+0000","last_undegraded":"2024-07-24T22:05:27.573726+0000","last_fullsized":"2024-07-24T22:05:27.573726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:16.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571295+0000","last_change":"2024-07-24T22:03:50.387314+0000","last_active":"2024-07-24T22:05:27.571295+0000","last_peered":"2024-07-24T22:05:27.571295+0000","last_clean":"2024-07-24T22:05:27.571295+0000","last_became_active":"2024-07-24T22:03:50.386919+0000","last_became_peered":"2024-07-24T22:03:50.386919+0000","last_unstale":"2024-07-24T22:05:27.571295+0000","last_undegraded":"2024-07-24T22:05:27.571295+0000","last_fullsized":"2024-07-24T22:05:27.571295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:51:03.203285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576666+0000","last_change":"2024-07-24T22:03:53.411938+0000","last_active":"2024-07-24T22:05:27.576666+0000","last_peered":"2024-07-24T22:05:27.576666+0000","last_clean":"2024-07-24T22:05:27.576666+0000","last_became_active":"2024-07-24T22:03:53.411545+0000","last_became_peered":"2024-07-24T22:03:53.411545+0000","last_unstale":"2024-07-24T22:05:27.576666+0000","last_undegraded":"2024-07-24T22:05:27.576666+0000","last_fullsized":"2024-07-24T22:05:27.576666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:41:19.370886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575121+0000","last_change":"2024-07-24T22:03:50.384400+0000","last_active":"2024-07-24T22:05:27.575121+0000","last_peered":"2024-07-24T22:05:27.575121+0000","last_clean":"2024-07-24T22:05:27.575121+0000","last_became_active":"2024-07-24T22:03:50.383945+0000","last_became_peered":"2024-07-24T22:03:50.383945+0000","last_unstale":"2024-07-24T22:05:27.575121+0000","last_undegraded":"2024-07-24T22:05:27.575121+0000","last_fullsized":"2024-07-24T22:05:27.575121+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:16.035171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576355+0000","last_change":"2024-07-24T22:04:27.507390+0000","last_active":"2024-07-24T22:05:27.576355+0000","last_peered":"2024-07-24T22:05:27.576355+0000","last_clean":"2024-07-24T22:05:27.576355+0000","last_became_active":"2024-07-24T22:04:27.504206+0000","last_became_peered":"2024-07-24T22:04:27.504206+0000","last_unstale":"2024-07-24T22:05:27.576355+0000","last_undegraded":"2024-07-24T22:05:27.576355+0000","last_fullsized":"2024-07-24T22:05:27.576355+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:55:21.559702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696155+0000","last_change":"2024-07-24T22:03:50.511075+0000","last_active":"2024-07-24T22:05:27.696155+0000","last_peered":"2024-07-24T22:05:27.696155+0000","last_clean":"2024-07-24T22:05:27.696155+0000","last_became_active":"2024-07-24T22:03:50.510244+0000","last_became_peered":"2024-07-24T22:03:50.510244+0000","last_unstale":"2024-07-24T22:05:27.696155+0000","last_undegraded":"2024-07-24T22:05:27.696155+0000","last_fullsized":"2024-07-24T22:05:27.696155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:54:03.068211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576290+0000","last_change":"2024-07-24T22:03:53.410865+0000","last_active":"2024-07-24T22:05:27.576290+0000","last_peered":"2024-07-24T22:05:27.576290+0000","last_clean":"2024-07-24T22:05:27.576290+0000","last_became_active":"2024-07-24T22:03:53.410255+0000","last_became_peered":"2024-07-24T22:03:53.410255+0000","last_unstale":"2024-07-24T22:05:27.576290+0000","last_undegraded":"2024-07-24T22:05:27.576290+0000","last_fullsized":"2024-07-24T22:05:27.576290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:15.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576134+0000","last_change":"2024-07-24T22:02:33.494929+0000","last_active":"2024-07-24T22:05:27.576134+0000","last_peered":"2024-07-24T22:05:27.576134+0000","last_clean":"2024-07-24T22:05:27.576134+0000","last_became_active":"2024-07-24T22:02:33.489241+0000","last_became_peered":"2024-07-24T22:02:33.489241+0000","last_unstale":"2024-07-24T22:05:27.576134+0000","last_undegraded":"2024-07-24T22:05:27.576134+0000","last_fullsized":"2024-07-24T22:05:27.576134+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_clean_scrub_stamp":"2024-07-24T21:59:32.406119+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:46.421413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576215+0000","last_change":"2024-07-24T22:03:50.385093+0000","last_active":"2024-07-24T22:05:27.576215+0000","last_peered":"2024-07-24T22:05:27.576215+0000","last_clean":"2024-07-24T22:05:27.576215+0000","last_became_active":"2024-07-24T22:03:50.384639+0000","last_became_peered":"2024-07-24T22:03:50.384639+0000","last_unstale":"2024-07-24T22:05:27.576215+0000","last_undegraded":"2024-07-24T22:05:27.576215+0000","last_fullsized":"2024-07-24T22:05:27.576215+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:06:10.402336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695985+0000","last_change":"2024-07-24T22:03:53.409627+0000","last_active":"2024-07-24T22:05:27.695985+0000","last_peered":"2024-07-24T22:05:27.695985+0000","last_clean":"2024-07-24T22:05:27.695985+0000","last_became_active":"2024-07-24T22:03:53.409295+0000","last_became_peered":"2024-07-24T22:03:53.409295+0000","last_unstale":"2024-07-24T22:05:27.695985+0000","last_undegraded":"2024-07-24T22:05:27.695985+0000","last_fullsized":"2024-07-24T22:05:27.695985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:23:39.670020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575968+0000","last_change":"2024-07-24T22:03:50.385772+0000","last_active":"2024-07-24T22:05:27.575968+0000","last_peered":"2024-07-24T22:05:27.575968+0000","last_clean":"2024-07-24T22:05:27.575968+0000","last_became_active":"2024-07-24T22:03:50.385421+0000","last_became_peered":"2024-07-24T22:03:50.385421+0000","last_unstale":"2024-07-24T22:05:27.575968+0000","last_undegraded":"2024-07-24T22:05:27.575968+0000","last_fullsized":"2024-07-24T22:05:27.575968+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:58:57.227697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570831+0000","last_change":"2024-07-24T22:03:53.400558+0000","last_active":"2024-07-24T22:05:27.570831+0000","last_peered":"2024-07-24T22:05:27.570831+0000","last_clean":"2024-07-24T22:05:27.570831+0000","last_became_active":"2024-07-24T22:03:53.400131+0000","last_became_peered":"2024-07-24T22:03:53.400131+0000","last_unstale":"2024-07-24T22:05:27.570831+0000","last_undegraded":"2024-07-24T22:05:27.570831+0000","last_fullsized":"2024-07-24T22:05:27.570831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:57:57.586742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570948+0000","last_change":"2024-07-24T22:03:50.510189+0000","last_active":"2024-07-24T22:05:27.570948+0000","last_peered":"2024-07-24T22:05:27.570948+0000","last_clean":"2024-07-24T22:05:27.570948+0000","last_became_active":"2024-07-24T22:03:50.509857+0000","last_became_peered":"2024-07-24T22:03:50.509857+0000","last_unstale":"2024-07-24T22:05:27.570948+0000","last_undegraded":"2024-07-24T22:05:27.570948+0000","last_fullsized":"2024-07-24T22:05:27.570948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:05:59.240650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574648+0000","last_change":"2024-07-24T22:04:27.505187+0000","last_active":"2024-07-24T22:05:27.574648+0000","last_peered":"2024-07-24T22:05:27.574648+0000","last_clean":"2024-07-24T22:05:27.574648+0000","last_became_active":"2024-07-24T22:04:27.504785+0000","last_became_peered":"2024-07-24T22:04:27.504785+0000","last_unstale":"2024-07-24T22:05:27.574648+0000","last_undegraded":"2024-07-24T22:05:27.574648+0000","last_fullsized":"2024-07-24T22:05:27.574648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:47:33.516835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576182+0000","last_change":"2024-07-24T22:05:27.575016+0000","last_active":"2024-07-24T22:05:27.576182+0000","last_peered":"2024-07-24T22:05:27.576182+0000","last_clean":"2024-07-24T22:05:27.576182+0000","last_became_active":"2024-07-24T22:05:27.574644+0000","last_became_peered":"2024-07-24T22:05:27.574644+0000","last_unstale":"2024-07-24T22:05:27.576182+0000","last_undegraded":"2024-07-24T22:05:27.576182+0000","last_fullsized":"2024-07-24T22:05:27.576182+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:11:37.759190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588862+0000","last_change":"2024-07-24T22:03:53.399369+0000","last_active":"2024-07-24T22:05:27.588862+0000","last_peered":"2024-07-24T22:05:27.588862+0000","last_clean":"2024-07-24T22:05:27.588862+0000","last_became_active":"2024-07-24T22:03:53.399001+0000","last_became_peered":"2024-07-24T22:03:53.399001+0000","last_unstale":"2024-07-24T22:05:27.588862+0000","last_undegraded":"2024-07-24T22:05:27.588862+0000","last_fullsized":"2024-07-24T22:05:27.588862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:26:46.531080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695821+0000","last_change":"2024-07-24T22:03:50.510889+0000","last_active":"2024-07-24T22:05:27.695821+0000","last_peered":"2024-07-24T22:05:27.695821+0000","last_clean":"2024-07-24T22:05:27.695821+0000","last_became_active":"2024-07-24T22:03:50.510366+0000","last_became_peered":"2024-07-24T22:03:50.510366+0000","last_unstale":"2024-07-24T22:05:27.695821+0000","last_undegraded":"2024-07-24T22:05:27.695821+0000","last_fullsized":"2024-07-24T22:05:27.695821+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:47:54.838304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588953+0000","last_change":"2024-07-24T22:03:53.398987+0000","last_active":"2024-07-24T22:05:27.588953+0000","last_peered":"2024-07-24T22:05:27.588953+0000","last_clean":"2024-07-24T22:05:27.588953+0000","last_became_active":"2024-07-24T22:03:53.398604+0000","last_became_peered":"2024-07-24T22:03:53.398604+0000","last_unstale":"2024-07-24T22:05:27.588953+0000","last_undegraded":"2024-07-24T22:05:27.588953+0000","last_fullsized":"2024-07-24T22:05:27.588953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:28:41.684174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576638+0000","last_change":"2024-07-24T22:03:50.510623+0000","last_active":"2024-07-24T22:05:27.576638+0000","last_peered":"2024-07-24T22:05:27.576638+0000","last_clean":"2024-07-24T22:05:27.576638+0000","last_became_active":"2024-07-24T22:03:50.510204+0000","last_became_peered":"2024-07-24T22:03:50.510204+0000","last_unstale":"2024-07-24T22:05:27.576638+0000","last_undegraded":"2024-07-24T22:05:27.576638+0000","last_fullsized":"2024-07-24T22:05:27.576638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:06:40.838840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571131+0000","last_change":"2024-07-24T22:03:53.400289+0000","last_active":"2024-07-24T22:05:27.571131+0000","last_peered":"2024-07-24T22:05:27.571131+0000","last_clean":"2024-07-24T22:05:27.571131+0000","last_became_active":"2024-07-24T22:03:53.399939+0000","last_became_peered":"2024-07-24T22:03:53.399939+0000","last_unstale":"2024-07-24T22:05:27.571131+0000","last_undegraded":"2024-07-24T22:05:27.571131+0000","last_fullsized":"2024-07-24T22:05:27.571131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:29:26.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'10","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695669+0000","last_change":"2024-07-24T22:03:50.382776+0000","last_active":"2024-07-24T22:05:27.695669+0000","last_peered":"2024-07-24T22:05:27.695669+0000","last_clean":"2024-07-24T22:05:27.695669+0000","last_became_active":"2024-07-24T22:03:50.382474+0000","last_became_peered":"2024-07-24T22:03:50.382474+0000","last_unstale":"2024-07-24T22:05:27.695669+0000","last_undegraded":"2024-07-24T22:05:27.695669+0000","last_fullsized":"2024-07-24T22:05:27.695669+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:59:34.688895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696647+0000","last_change":"2024-07-24T22:03:53.407883+0000","last_active":"2024-07-24T22:05:27.696647+0000","last_peered":"2024-07-24T22:05:27.696647+0000","last_clean":"2024-07-24T22:05:27.696647+0000","last_became_active":"2024-07-24T22:03:53.407524+0000","last_became_peered":"2024-07-24T22:03:53.407524+0000","last_unstale":"2024-07-24T22:05:27.696647+0000","last_undegraded":"2024-07-24T22:05:27.696647+0000","last_fullsized":"2024-07-24T22:05:27.696647+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:52:25.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576716+0000","last_change":"2024-07-24T22:03:50.388789+0000","last_active":"2024-07-24T22:05:27.576716+0000","last_peered":"2024-07-24T22:05:27.576716+0000","last_clean":"2024-07-24T22:05:27.576716+0000","last_became_active":"2024-07-24T22:03:50.385439+0000","last_became_peered":"2024-07-24T22:03:50.385439+0000","last_unstale":"2024-07-24T22:05:27.576716+0000","last_undegraded":"2024-07-24T22:05:27.576716+0000","last_fullsized":"2024-07-24T22:05:27.576716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:14:25.009588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696530+0000","last_change":"2024-07-24T22:04:27.503956+0000","last_active":"2024-07-24T22:05:27.696530+0000","last_peered":"2024-07-24T22:05:27.696530+0000","last_clean":"2024-07-24T22:05:27.696530+0000","last_became_active":"2024-07-24T22:04:27.503498+0000","last_became_peered":"2024-07-24T22:04:27.503498+0000","last_unstale":"2024-07-24T22:05:27.696530+0000","last_undegraded":"2024-07-24T22:05:27.696530+0000","last_fullsized":"2024-07-24T22:05:27.696530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:23:20.294458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571675+0000","last_change":"2024-07-24T22:03:50.510687+0000","last_active":"2024-07-24T22:05:27.571675+0000","last_peered":"2024-07-24T22:05:27.571675+0000","last_clean":"2024-07-24T22:05:27.571675+0000","last_became_active":"2024-07-24T22:03:50.510310+0000","last_became_peered":"2024-07-24T22:03:50.510310+0000","last_unstale":"2024-07-24T22:05:27.571675+0000","last_undegraded":"2024-07-24T22:05:27.571675+0000","last_fullsized":"2024-07-24T22:05:27.571675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:14:29.957324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575940+0000","last_change":"2024-07-24T22:03:53.412711+0000","last_active":"2024-07-24T22:05:27.575940+0000","last_peered":"2024-07-24T22:05:27.575940+0000","last_clean":"2024-07-24T22:05:27.575940+0000","last_became_active":"2024-07-24T22:03:53.412375+0000","last_became_peered":"2024-07-24T22:03:53.412375+0000","last_unstale":"2024-07-24T22:05:27.575940+0000","last_undegraded":"2024-07-24T22:05:27.575940+0000","last_fullsized":"2024-07-24T22:05:27.575940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:55:29.441385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696289+0000","last_change":"2024-07-24T22:03:50.383094+0000","last_active":"2024-07-24T22:05:27.696289+0000","last_peered":"2024-07-24T22:05:27.696289+0000","last_clean":"2024-07-24T22:05:27.696289+0000","last_became_active":"2024-07-24T22:03:50.382687+0000","last_became_peered":"2024-07-24T22:03:50.382687+0000","last_unstale":"2024-07-24T22:05:27.696289+0000","last_undegraded":"2024-07-24T22:05:27.696289+0000","last_fullsized":"2024-07-24T22:05:27.696289+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:32:02.727855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573300+0000","last_change":"2024-07-24T22:03:53.403709+0000","last_active":"2024-07-24T22:05:27.573300+0000","last_peered":"2024-07-24T22:05:27.573300+0000","last_clean":"2024-07-24T22:05:27.573300+0000","last_became_active":"2024-07-24T22:03:53.403334+0000","last_became_peered":"2024-07-24T22:03:53.403334+0000","last_unstale":"2024-07-24T22:05:27.573300+0000","last_undegraded":"2024-07-24T22:05:27.573300+0000","last_fullsized":"2024-07-24T22:05:27.573300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:27:50.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695761+0000","last_change":"2024-07-24T22:03:50.385547+0000","last_active":"2024-07-24T22:05:27.695761+0000","last_peered":"2024-07-24T22:05:27.695761+0000","last_clean":"2024-07-24T22:05:27.695761+0000","last_became_active":"2024-07-24T22:03:50.385233+0000","last_became_peered":"2024-07-24T22:03:50.385233+0000","last_unstale":"2024-07-24T22:05:27.695761+0000","last_undegraded":"2024-07-24T22:05:27.695761+0000","last_fullsized":"2024-07-24T22:05:27.695761+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:40:04.647242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695985+0000","last_change":"2024-07-24T22:03:53.402386+0000","last_active":"2024-07-24T22:05:27.695985+0000","last_peered":"2024-07-24T22:05:27.695985+0000","last_clean":"2024-07-24T22:05:27.695985+0000","last_became_active":"2024-07-24T22:03:53.399363+0000","last_became_peered":"2024-07-24T22:03:53.399363+0000","last_unstale":"2024-07-24T22:05:27.695985+0000","last_undegraded":"2024-07-24T22:05:27.695985+0000","last_fullsized":"2024-07-24T22:05:27.695985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:19:05.835280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576039+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.576039+0000","last_peered":"2024-07-24T22:05:27.576039+0000","last_clean":"2024-07-24T22:05:27.576039+0000","last_became_active":"2024-07-24T22:03:50.387097+0000","last_became_peered":"2024-07-24T22:03:50.387097+0000","last_unstale":"2024-07-24T22:05:27.576039+0000","last_undegraded":"2024-07-24T22:05:27.576039+0000","last_fullsized":"2024-07-24T22:05:27.576039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:11:23.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576452+0000","last_change":"2024-07-24T22:03:53.407386+0000","last_active":"2024-07-24T22:05:27.576452+0000","last_peered":"2024-07-24T22:05:27.576452+0000","last_clean":"2024-07-24T22:05:27.576452+0000","last_became_active":"2024-07-24T22:03:53.407059+0000","last_became_peered":"2024-07-24T22:03:53.407059+0000","last_unstale":"2024-07-24T22:05:27.576452+0000","last_undegraded":"2024-07-24T22:05:27.576452+0000","last_fullsized":"2024-07-24T22:05:27.576452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:12:38.508170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695772+0000","last_change":"2024-07-24T22:04:27.567714+0000","last_active":"2024-07-24T22:05:27.695772+0000","last_peered":"2024-07-24T22:05:27.695772+0000","last_clean":"2024-07-24T22:05:27.695772+0000","last_became_active":"2024-07-24T22:04:27.567492+0000","last_became_peered":"2024-07-24T22:04:27.567492+0000","last_unstale":"2024-07-24T22:05:27.695772+0000","last_undegraded":"2024-07-24T22:05:27.695772+0000","last_fullsized":"2024-07-24T22:05:27.695772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:00:13.705346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576226+0000","last_change":"2024-07-24T22:03:50.385538+0000","last_active":"2024-07-24T22:05:27.576226+0000","last_peered":"2024-07-24T22:05:27.576226+0000","last_clean":"2024-07-24T22:05:27.576226+0000","last_became_active":"2024-07-24T22:03:50.385191+0000","last_became_peered":"2024-07-24T22:03:50.385191+0000","last_unstale":"2024-07-24T22:05:27.576226+0000","last_undegraded":"2024-07-24T22:05:27.576226+0000","last_fullsized":"2024-07-24T22:05:27.576226+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:33:37.674903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571728+0000","last_change":"2024-07-24T22:03:53.411751+0000","last_active":"2024-07-24T22:05:27.571728+0000","last_peered":"2024-07-24T22:05:27.571728+0000","last_clean":"2024-07-24T22:05:27.571728+0000","last_became_active":"2024-07-24T22:03:53.410827+0000","last_became_peered":"2024-07-24T22:03:53.410827+0000","last_unstale":"2024-07-24T22:05:27.571728+0000","last_undegraded":"2024-07-24T22:05:27.571728+0000","last_fullsized":"2024-07-24T22:05:27.571728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:07:26.439047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.584159+0000","last_change":"2024-07-24T22:05:27.581982+0000","last_active":"2024-07-24T22:05:27.584159+0000","last_peered":"2024-07-24T22:05:27.584159+0000","last_clean":"2024-07-24T22:05:27.584159+0000","last_became_active":"2024-07-24T22:05:27.577413+0000","last_became_peered":"2024-07-24T22:05:27.577413+0000","last_unstale":"2024-07-24T22:05:27.584159+0000","last_undegraded":"2024-07-24T22:05:27.584159+0000","last_fullsized":"2024-07-24T22:05:27.584159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:40:27.424379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696571+0000","last_change":"2024-07-24T22:03:53.406029+0000","last_active":"2024-07-24T22:05:27.696571+0000","last_peered":"2024-07-24T22:05:27.696571+0000","last_clean":"2024-07-24T22:05:27.696571+0000","last_became_active":"2024-07-24T22:03:53.405529+0000","last_became_peered":"2024-07-24T22:03:53.405529+0000","last_unstale":"2024-07-24T22:05:27.696571+0000","last_undegraded":"2024-07-24T22:05:27.696571+0000","last_fullsized":"2024-07-24T22:05:27.696571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:57:02.290836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696534+0000","last_change":"2024-07-24T22:03:50.510884+0000","last_active":"2024-07-24T22:05:27.696534+0000","last_peered":"2024-07-24T22:05:27.696534+0000","last_clean":"2024-07-24T22:05:27.696534+0000","last_became_active":"2024-07-24T22:03:50.509851+0000","last_became_peered":"2024-07-24T22:03:50.509851+0000","last_unstale":"2024-07-24T22:05:27.696534+0000","last_undegraded":"2024-07-24T22:05:27.696534+0000","last_fullsized":"2024-07-24T22:05:27.696534+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:37:55.735488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696318+0000","last_change":"2024-07-24T22:03:53.409966+0000","last_active":"2024-07-24T22:05:27.696318+0000","last_peered":"2024-07-24T22:05:27.696318+0000","last_clean":"2024-07-24T22:05:27.696318+0000","last_became_active":"2024-07-24T22:03:53.409652+0000","last_became_peered":"2024-07-24T22:03:53.409652+0000","last_unstale":"2024-07-24T22:05:27.696318+0000","last_undegraded":"2024-07-24T22:05:27.696318+0000","last_fullsized":"2024-07-24T22:05:27.696318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:10:53.262459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696471+0000","last_change":"2024-07-24T22:04:27.571166+0000","last_active":"2024-07-24T22:05:27.696471+0000","last_peered":"2024-07-24T22:05:27.696471+0000","last_clean":"2024-07-24T22:05:27.696471+0000","last_became_active":"2024-07-24T22:04:27.567419+0000","last_became_peered":"2024-07-24T22:04:27.567419+0000","last_unstale":"2024-07-24T22:05:27.696471+0000","last_undegraded":"2024-07-24T22:05:27.696471+0000","last_fullsized":"2024-07-24T22:05:27.696471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:37:11.513631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63382,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":203,"num_read_kb":165,"num_write":88,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612646,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":937984,"data_stored":469642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1122905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972399,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40428,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704724,"statfs":{"total":95995035648,"available":95953637376,"internally_reserved":0,"allocated":946176,"data_stored":470341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168628,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":469664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1540096,"data_stored":1060709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561084,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":469759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757312,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1548288,"data_stored":1060309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920836,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117065,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40432,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704720,"statfs":{"total":95995035648,"available":95953633280,"internally_reserved":0,"allocated":950272,"data_stored":469863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378702,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":532260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542226,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":532808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705749,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":62778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T22:05:45.792 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph pg dump --format=json 2024-07-24T22:05:45.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:45 smithi183 ceph-mon[37007]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:45.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:45 smithi047 ceph-mon[32551]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:46.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:45 smithi188 ceph-mon[37380]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:46.060 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:46.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:46 smithi047 ceph-mon[32551]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:05:46.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:46 smithi183 ceph-mon[37007]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:05:47.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:46 smithi188 ceph-mon[37380]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:05:47.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.593+0000 7fb327b30640 1 -- 172.21.15.47:0/503566436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb320103ef0 msgr2=0x7fb32010c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:47.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.593+0000 7fb327b30640 1 --2- 172.21.15.47:0/503566436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb320103ef0 0x7fb32010c4d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb310009900 tx=0x7fb31002a410 comp rx=0 tx=0).stop 2024-07-24T22:05:47.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.593+0000 7fb327b30640 1 -- 172.21.15.47:0/503566436 shutdown_connections 2024-07-24T22:05:47.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.593+0000 7fb327b30640 1 --2- 172.21.15.47:0/503566436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb32010caa0 0x7fb32010ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:47.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.593+0000 7fb327b30640 1 --2- 172.21.15.47:0/503566436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb320103ef0 0x7fb32010c4d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:47.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.593+0000 7fb327b30640 1 --2- 172.21.15.47:0/503566436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3201034f0 0x7fb3201038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:47.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.593+0000 7fb327b30640 1 -- 172.21.15.47:0/503566436 >> 172.21.15.47:0/503566436 conn(0x7fb3200fd0c0 msgr2=0x7fb3200ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:47.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.593+0000 7fb327b30640 1 -- 172.21.15.47:0/503566436 shutdown_connections 2024-07-24T22:05:47.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.593+0000 7fb327b30640 1 -- 172.21.15.47:0/503566436 wait complete. 2024-07-24T22:05:47.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.594+0000 7fb327b30640 1 Processor -- start 2024-07-24T22:05:47.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.594+0000 7fb327b30640 1 -- start start 2024-07-24T22:05:47.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.594+0000 7fb327b30640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3201034f0 0x7fb320198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:47.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.594+0000 7fb327b30640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb320103ef0 0x7fb3201991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.594+0000 7fb327b30640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb32010caa0 0x7fb32019e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.594+0000 7fb327b30640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb3201126f0 con 0x7fb3201034f0 2024-07-24T22:05:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.594+0000 7fb327b30640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb320112570 con 0x7fb320103ef0 2024-07-24T22:05:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.594+0000 7fb327b30640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb320112870 con 0x7fb32010caa0 2024-07-24T22:05:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.594+0000 7fb3258cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3201034f0 0x7fb320198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.594+0000 7fb3258cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3201034f0 0x7fb320198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34104/0 (socket says 172.21.15.47:34104) 2024-07-24T22:05:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.594+0000 7fb3258cc640 1 -- 172.21.15.47:0/2930841151 learned_addr learned my addr 172.21.15.47:0/2930841151 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.594+0000 7fb3260cd640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb32010caa0 0x7fb32019e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.594+0000 7fb3250cb640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb320103ef0 0x7fb3201991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.595+0000 7fb3258cc640 1 -- 172.21.15.47:0/2930841151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb32010caa0 msgr2=0x7fb32019e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.595+0000 7fb3258cc640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb32010caa0 0x7fb32019e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.595+0000 7fb3258cc640 1 -- 172.21.15.47:0/2930841151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb320103ef0 msgr2=0x7fb3201991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:47.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.595+0000 7fb3258cc640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb320103ef0 0x7fb3201991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.595+0000 7fb3258cc640 1 -- 172.21.15.47:0/2930841151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32019ed10 con 0x7fb3201034f0 2024-07-24T22:05:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.595+0000 7fb3258cc640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3201034f0 0x7fb320198c60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00c890 tx=0x7fb31c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.595+0000 7fb316ffd640 1 -- 172.21.15.47:0/2930841151 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c004220 con 0x7fb3201034f0 2024-07-24T22:05:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.595+0000 7fb327b30640 1 -- 172.21.15.47:0/2930841151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32019f000 con 0x7fb3201034f0 2024-07-24T22:05:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.595+0000 7fb316ffd640 1 -- 172.21.15.47:0/2930841151 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb31c0043c0 con 0x7fb3201034f0 2024-07-24T22:05:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.595+0000 7fb316ffd640 1 -- 172.21.15.47:0/2930841151 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c004a00 con 0x7fb3201034f0 2024-07-24T22:05:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.595+0000 7fb327b30640 1 -- 172.21.15.47:0/2930841151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3201a56c0 con 0x7fb3201034f0 2024-07-24T22:05:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.597+0000 7fb327b30640 1 -- 172.21.15.47:0/2930841151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3201038d0 con 0x7fb3201034f0 2024-07-24T22:05:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.597+0000 7fb316ffd640 1 -- 172.21.15.47:0/2930841151 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fb31c0079b0 con 0x7fb3201034f0 2024-07-24T22:05:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.598+0000 7fb316ffd640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb30c0b3c20 0x7fb30c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.598+0000 7fb3250cb640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb30c0b3c20 0x7fb30c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.598+0000 7fb316ffd640 1 -- 172.21.15.47:0/2930841151 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb31c0e3a40 con 0x7fb3201034f0 2024-07-24T22:05:47.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.599+0000 7fb3250cb640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb30c0b3c20 0x7fb30c0b60e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb310031440 tx=0x7fb310005b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:47.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.603+0000 7fb316ffd640 1 -- 172.21.15.47:0/2930841151 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fb31c014030 con 0x7fb3201034f0 2024-07-24T22:05:47.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.793+0000 7fb327b30640 1 -- 172.21.15.47:0/2930841151 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb320062f80 con 0x7fb30c0b3c20 2024-07-24T22:05:47.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.797+0000 7fb316ffd640 1 -- 172.21.15.47:0/2930841151 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258744 (secure 0 0 0) 0x7fb320062f80 con 0x7fb30c0b3c20 2024-07-24T22:05:47.802 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:05:47.803 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-07-24T22:05:47.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.800+0000 7fb327b30640 1 -- 172.21.15.47:0/2930841151 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb30c0b3c20 msgr2=0x7fb30c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:47.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.800+0000 7fb327b30640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb30c0b3c20 0x7fb30c0b60e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb310031440 tx=0x7fb310005b50 comp rx=0 tx=0).stop 2024-07-24T22:05:47.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.800+0000 7fb327b30640 1 -- 172.21.15.47:0/2930841151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3201034f0 msgr2=0x7fb320198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:47.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.800+0000 7fb327b30640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3201034f0 0x7fb320198c60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00c890 tx=0x7fb31c00cd50 comp rx=0 tx=0).stop 2024-07-24T22:05:47.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.800+0000 7fb327b30640 1 -- 172.21.15.47:0/2930841151 shutdown_connections 2024-07-24T22:05:47.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.800+0000 7fb327b30640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb30c0b3c20 0x7fb30c0b60e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:47.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.800+0000 7fb327b30640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb32010caa0 0x7fb32019e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:47.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.800+0000 7fb327b30640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb320103ef0 0x7fb3201991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.800+0000 7fb327b30640 1 --2- 172.21.15.47:0/2930841151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3201034f0 0x7fb320198c60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.800+0000 7fb327b30640 1 -- 172.21.15.47:0/2930841151 >> 172.21.15.47:0/2930841151 conn(0x7fb3200fd0c0 msgr2=0x7fb3200fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.800+0000 7fb327b30640 1 -- 172.21.15.47:0/2930841151 shutdown_connections 2024-07-24T22:05:47.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:47.800+0000 7fb327b30640 1 -- 172.21.15.47:0/2930841151 wait complete. 2024-07-24T22:05:47.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:47 smithi183 ceph-mon[37007]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:47.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:47 smithi047 ceph-mon[32551]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:48.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:47 smithi188 ceph-mon[37380]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:48.598 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-07-24T22:05:46.101362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653984,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":284,"num_read_kb":234,"num_write":213,"num_write_kb":2242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952539,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":666,"ondisk_log_size":666,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387224,"kb_used_data":13032,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554600,"statfs":{"total":1151940427776,"available":1151543910400,"internally_reserved":0,"allocated":13344768,"data_stored":7597656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003572"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573950+0000","last_change":"2024-07-24T22:03:53.407929+0000","last_active":"2024-07-24T22:05:27.573950+0000","last_peered":"2024-07-24T22:05:27.573950+0000","last_clean":"2024-07-24T22:05:27.573950+0000","last_became_active":"2024-07-24T22:03:53.407508+0000","last_became_peered":"2024-07-24T22:03:53.407508+0000","last_unstale":"2024-07-24T22:05:27.573950+0000","last_undegraded":"2024-07-24T22:05:27.573950+0000","last_fullsized":"2024-07-24T22:05:27.573950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:00:35.699906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696483+0000","last_change":"2024-07-24T22:03:53.404867+0000","last_active":"2024-07-24T22:05:27.696483+0000","last_peered":"2024-07-24T22:05:27.696483+0000","last_clean":"2024-07-24T22:05:27.696483+0000","last_became_active":"2024-07-24T22:03:53.404309+0000","last_became_peered":"2024-07-24T22:03:53.404309+0000","last_unstale":"2024-07-24T22:05:27.696483+0000","last_undegraded":"2024-07-24T22:05:27.696483+0000","last_fullsized":"2024-07-24T22:05:27.696483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:21:51.238815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696354+0000","last_change":"2024-07-24T22:03:53.404368+0000","last_active":"2024-07-24T22:05:27.696354+0000","last_peered":"2024-07-24T22:05:27.696354+0000","last_clean":"2024-07-24T22:05:27.696354+0000","last_became_active":"2024-07-24T22:03:53.403941+0000","last_became_peered":"2024-07-24T22:03:53.403941+0000","last_unstale":"2024-07-24T22:05:27.696354+0000","last_undegraded":"2024-07-24T22:05:27.696354+0000","last_fullsized":"2024-07-24T22:05:27.696354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:10:09.884724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576486+0000","last_change":"2024-07-24T22:03:53.407661+0000","last_active":"2024-07-24T22:05:27.576486+0000","last_peered":"2024-07-24T22:05:27.576486+0000","last_clean":"2024-07-24T22:05:27.576486+0000","last_became_active":"2024-07-24T22:03:53.407375+0000","last_became_peered":"2024-07-24T22:03:53.407375+0000","last_unstale":"2024-07-24T22:05:27.576486+0000","last_undegraded":"2024-07-24T22:05:27.576486+0000","last_fullsized":"2024-07-24T22:05:27.576486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:34.000666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575915+0000","last_change":"2024-07-24T22:03:53.406227+0000","last_active":"2024-07-24T22:05:27.575915+0000","last_peered":"2024-07-24T22:05:27.575915+0000","last_clean":"2024-07-24T22:05:27.575915+0000","last_became_active":"2024-07-24T22:03:53.405819+0000","last_became_peered":"2024-07-24T22:03:53.405819+0000","last_unstale":"2024-07-24T22:05:27.575915+0000","last_undegraded":"2024-07-24T22:05:27.575915+0000","last_fullsized":"2024-07-24T22:05:27.575915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:59.022972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588760+0000","last_change":"2024-07-24T22:04:27.501754+0000","last_active":"2024-07-24T22:05:27.588760+0000","last_peered":"2024-07-24T22:05:27.588760+0000","last_clean":"2024-07-24T22:05:27.588760+0000","last_became_active":"2024-07-24T22:04:27.501340+0000","last_became_peered":"2024-07-24T22:04:27.501340+0000","last_unstale":"2024-07-24T22:05:27.588760+0000","last_undegraded":"2024-07-24T22:05:27.588760+0000","last_fullsized":"2024-07-24T22:05:27.588760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:38:04.880980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575905+0000","last_change":"2024-07-24T22:03:53.413012+0000","last_active":"2024-07-24T22:05:27.575905+0000","last_peered":"2024-07-24T22:05:27.575905+0000","last_clean":"2024-07-24T22:05:27.575905+0000","last_became_active":"2024-07-24T22:03:53.411791+0000","last_became_peered":"2024-07-24T22:03:53.411791+0000","last_unstale":"2024-07-24T22:05:27.575905+0000","last_undegraded":"2024-07-24T22:05:27.575905+0000","last_fullsized":"2024-07-24T22:05:27.575905+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:15:02.939598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695709+0000","last_change":"2024-07-24T22:04:27.502867+0000","last_active":"2024-07-24T22:05:27.695709+0000","last_peered":"2024-07-24T22:05:27.695709+0000","last_clean":"2024-07-24T22:05:27.695709+0000","last_became_active":"2024-07-24T22:04:27.502515+0000","last_became_peered":"2024-07-24T22:04:27.502515+0000","last_unstale":"2024-07-24T22:05:27.695709+0000","last_undegraded":"2024-07-24T22:05:27.695709+0000","last_fullsized":"2024-07-24T22:05:27.695709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:58:39.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,10],"acting":[3,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572125+0000","last_change":"2024-07-24T22:03:53.413213+0000","last_active":"2024-07-24T22:05:27.572125+0000","last_peered":"2024-07-24T22:05:27.572125+0000","last_clean":"2024-07-24T22:05:27.572125+0000","last_became_active":"2024-07-24T22:03:53.412725+0000","last_became_peered":"2024-07-24T22:03:53.412725+0000","last_unstale":"2024-07-24T22:05:27.572125+0000","last_undegraded":"2024-07-24T22:05:27.572125+0000","last_fullsized":"2024-07-24T22:05:27.572125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:34:01.897965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589168+0000","last_change":"2024-07-24T22:03:53.401129+0000","last_active":"2024-07-24T22:05:27.589168+0000","last_peered":"2024-07-24T22:05:27.589168+0000","last_clean":"2024-07-24T22:05:27.589168+0000","last_became_active":"2024-07-24T22:03:53.400780+0000","last_became_peered":"2024-07-24T22:03:53.400780+0000","last_unstale":"2024-07-24T22:05:27.589168+0000","last_undegraded":"2024-07-24T22:05:27.589168+0000","last_fullsized":"2024-07-24T22:05:27.589168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:28:37.825021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576181+0000","last_change":"2024-07-24T22:03:53.406490+0000","last_active":"2024-07-24T22:05:27.576181+0000","last_peered":"2024-07-24T22:05:27.576181+0000","last_clean":"2024-07-24T22:05:27.576181+0000","last_became_active":"2024-07-24T22:03:53.406108+0000","last_became_peered":"2024-07-24T22:03:53.406108+0000","last_unstale":"2024-07-24T22:05:27.576181+0000","last_undegraded":"2024-07-24T22:05:27.576181+0000","last_fullsized":"2024-07-24T22:05:27.576181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:37.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695913+0000","last_change":"2024-07-24T22:04:27.503165+0000","last_active":"2024-07-24T22:05:27.695913+0000","last_peered":"2024-07-24T22:05:27.695913+0000","last_clean":"2024-07-24T22:05:27.695913+0000","last_became_active":"2024-07-24T22:04:27.502861+0000","last_became_peered":"2024-07-24T22:04:27.502861+0000","last_unstale":"2024-07-24T22:05:27.695913+0000","last_undegraded":"2024-07-24T22:05:27.695913+0000","last_fullsized":"2024-07-24T22:05:27.695913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:36:41.353268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571191+0000","last_change":"2024-07-24T22:03:53.392763+0000","last_active":"2024-07-24T22:05:27.571191+0000","last_peered":"2024-07-24T22:05:27.571191+0000","last_clean":"2024-07-24T22:05:27.571191+0000","last_became_active":"2024-07-24T22:03:53.392476+0000","last_became_peered":"2024-07-24T22:03:53.392476+0000","last_unstale":"2024-07-24T22:05:27.571191+0000","last_undegraded":"2024-07-24T22:05:27.571191+0000","last_fullsized":"2024-07-24T22:05:27.571191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:25:13.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696312+0000","last_change":"2024-07-24T22:03:53.406937+0000","last_active":"2024-07-24T22:05:27.696312+0000","last_peered":"2024-07-24T22:05:27.696312+0000","last_clean":"2024-07-24T22:05:27.696312+0000","last_became_active":"2024-07-24T22:03:53.406495+0000","last_became_peered":"2024-07-24T22:03:53.406495+0000","last_unstale":"2024-07-24T22:05:27.696312+0000","last_undegraded":"2024-07-24T22:05:27.696312+0000","last_fullsized":"2024-07-24T22:05:27.696312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:06:50.434751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695657+0000","last_change":"2024-07-24T22:03:53.401073+0000","last_active":"2024-07-24T22:05:27.695657+0000","last_peered":"2024-07-24T22:05:27.695657+0000","last_clean":"2024-07-24T22:05:27.695657+0000","last_became_active":"2024-07-24T22:03:53.399675+0000","last_became_peered":"2024-07-24T22:03:53.399675+0000","last_unstale":"2024-07-24T22:05:27.695657+0000","last_undegraded":"2024-07-24T22:05:27.695657+0000","last_fullsized":"2024-07-24T22:05:27.695657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:59:25.461178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571598+0000","last_change":"2024-07-24T22:03:53.408289+0000","last_active":"2024-07-24T22:05:27.571598+0000","last_peered":"2024-07-24T22:05:27.571598+0000","last_clean":"2024-07-24T22:05:27.571598+0000","last_became_active":"2024-07-24T22:03:53.407950+0000","last_became_peered":"2024-07-24T22:03:53.407950+0000","last_unstale":"2024-07-24T22:05:27.571598+0000","last_undegraded":"2024-07-24T22:05:27.571598+0000","last_fullsized":"2024-07-24T22:05:27.571598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:10:30.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573965+0000","last_change":"2024-07-24T22:03:53.409909+0000","last_active":"2024-07-24T22:05:27.573965+0000","last_peered":"2024-07-24T22:05:27.573965+0000","last_clean":"2024-07-24T22:05:27.573965+0000","last_became_active":"2024-07-24T22:03:53.409183+0000","last_became_peered":"2024-07-24T22:03:53.409183+0000","last_unstale":"2024-07-24T22:05:27.573965+0000","last_undegraded":"2024-07-24T22:05:27.573965+0000","last_fullsized":"2024-07-24T22:05:27.573965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:14:50.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695644+0000","last_change":"2024-07-24T22:03:53.401198+0000","last_active":"2024-07-24T22:05:27.695644+0000","last_peered":"2024-07-24T22:05:27.695644+0000","last_clean":"2024-07-24T22:05:27.695644+0000","last_became_active":"2024-07-24T22:03:53.400885+0000","last_became_peered":"2024-07-24T22:03:53.400885+0000","last_unstale":"2024-07-24T22:05:27.695644+0000","last_undegraded":"2024-07-24T22:05:27.695644+0000","last_fullsized":"2024-07-24T22:05:27.695644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:59:37.965714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695930+0000","last_change":"2024-07-24T22:03:53.406590+0000","last_active":"2024-07-24T22:05:27.695930+0000","last_peered":"2024-07-24T22:05:27.695930+0000","last_clean":"2024-07-24T22:05:27.695930+0000","last_became_active":"2024-07-24T22:03:53.406283+0000","last_became_peered":"2024-07-24T22:03:53.406283+0000","last_unstale":"2024-07-24T22:05:27.695930+0000","last_undegraded":"2024-07-24T22:05:27.695930+0000","last_fullsized":"2024-07-24T22:05:27.695930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:30.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573313+0000","last_change":"2024-07-24T22:03:53.408790+0000","last_active":"2024-07-24T22:05:27.573313+0000","last_peered":"2024-07-24T22:05:27.573313+0000","last_clean":"2024-07-24T22:05:27.573313+0000","last_became_active":"2024-07-24T22:03:53.408480+0000","last_became_peered":"2024-07-24T22:03:53.408480+0000","last_unstale":"2024-07-24T22:05:27.573313+0000","last_undegraded":"2024-07-24T22:05:27.573313+0000","last_fullsized":"2024-07-24T22:05:27.573313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:59.601606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571122+0000","last_change":"2024-07-24T22:03:53.407400+0000","last_active":"2024-07-24T22:05:27.571122+0000","last_peered":"2024-07-24T22:05:27.571122+0000","last_clean":"2024-07-24T22:05:27.571122+0000","last_became_active":"2024-07-24T22:03:53.407084+0000","last_became_peered":"2024-07-24T22:03:53.407084+0000","last_unstale":"2024-07-24T22:05:27.571122+0000","last_undegraded":"2024-07-24T22:05:27.571122+0000","last_fullsized":"2024-07-24T22:05:27.571122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:51:04.942504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571727+0000","last_change":"2024-07-24T22:03:53.407444+0000","last_active":"2024-07-24T22:05:27.571727+0000","last_peered":"2024-07-24T22:05:27.571727+0000","last_clean":"2024-07-24T22:05:27.571727+0000","last_became_active":"2024-07-24T22:03:53.407025+0000","last_became_peered":"2024-07-24T22:03:53.407025+0000","last_unstale":"2024-07-24T22:05:27.571727+0000","last_undegraded":"2024-07-24T22:05:27.571727+0000","last_fullsized":"2024-07-24T22:05:27.571727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:47:49.620354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696121+0000","last_change":"2024-07-24T22:03:53.406748+0000","last_active":"2024-07-24T22:05:27.696121+0000","last_peered":"2024-07-24T22:05:27.696121+0000","last_clean":"2024-07-24T22:05:27.696121+0000","last_became_active":"2024-07-24T22:03:53.406398+0000","last_became_peered":"2024-07-24T22:03:53.406398+0000","last_unstale":"2024-07-24T22:05:27.696121+0000","last_undegraded":"2024-07-24T22:05:27.696121+0000","last_fullsized":"2024-07-24T22:05:27.696121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:35:40.117375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574638+0000","last_change":"2024-07-24T22:03:53.402203+0000","last_active":"2024-07-24T22:05:27.574638+0000","last_peered":"2024-07-24T22:05:27.574638+0000","last_clean":"2024-07-24T22:05:27.574638+0000","last_became_active":"2024-07-24T22:03:53.401826+0000","last_became_peered":"2024-07-24T22:03:53.401826+0000","last_unstale":"2024-07-24T22:05:27.574638+0000","last_undegraded":"2024-07-24T22:05:27.574638+0000","last_fullsized":"2024-07-24T22:05:27.574638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:45.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696615+0000","last_change":"2024-07-24T22:03:53.408179+0000","last_active":"2024-07-24T22:05:27.696615+0000","last_peered":"2024-07-24T22:05:27.696615+0000","last_clean":"2024-07-24T22:05:27.696615+0000","last_became_active":"2024-07-24T22:03:53.407547+0000","last_became_peered":"2024-07-24T22:03:53.407547+0000","last_unstale":"2024-07-24T22:05:27.696615+0000","last_undegraded":"2024-07-24T22:05:27.696615+0000","last_fullsized":"2024-07-24T22:05:27.696615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:03:52.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696021+0000","last_change":"2024-07-24T22:03:53.408550+0000","last_active":"2024-07-24T22:05:27.696021+0000","last_peered":"2024-07-24T22:05:27.696021+0000","last_clean":"2024-07-24T22:05:27.696021+0000","last_became_active":"2024-07-24T22:03:53.408119+0000","last_became_peered":"2024-07-24T22:03:53.408119+0000","last_unstale":"2024-07-24T22:05:27.696021+0000","last_undegraded":"2024-07-24T22:05:27.696021+0000","last_fullsized":"2024-07-24T22:05:27.696021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:33:54.154606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573794+0000","last_change":"2024-07-24T22:03:53.412562+0000","last_active":"2024-07-24T22:05:27.573794+0000","last_peered":"2024-07-24T22:05:27.573794+0000","last_clean":"2024-07-24T22:05:27.573794+0000","last_became_active":"2024-07-24T22:03:53.412231+0000","last_became_peered":"2024-07-24T22:03:53.412231+0000","last_unstale":"2024-07-24T22:05:27.573794+0000","last_undegraded":"2024-07-24T22:05:27.573794+0000","last_fullsized":"2024-07-24T22:05:27.573794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:53:48.403662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571125+0000","last_change":"2024-07-24T22:03:53.398212+0000","last_active":"2024-07-24T22:05:27.571125+0000","last_peered":"2024-07-24T22:05:27.571125+0000","last_clean":"2024-07-24T22:05:27.571125+0000","last_became_active":"2024-07-24T22:03:53.397853+0000","last_became_peered":"2024-07-24T22:03:53.397853+0000","last_unstale":"2024-07-24T22:05:27.571125+0000","last_undegraded":"2024-07-24T22:05:27.571125+0000","last_fullsized":"2024-07-24T22:05:27.571125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:39:47.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696235+0000","last_change":"2024-07-24T22:03:53.397188+0000","last_active":"2024-07-24T22:05:27.696235+0000","last_peered":"2024-07-24T22:05:27.696235+0000","last_clean":"2024-07-24T22:05:27.696235+0000","last_became_active":"2024-07-24T22:03:53.396865+0000","last_became_peered":"2024-07-24T22:03:53.396865+0000","last_unstale":"2024-07-24T22:05:27.696235+0000","last_undegraded":"2024-07-24T22:05:27.696235+0000","last_fullsized":"2024-07-24T22:05:27.696235+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:20:49.074330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695747+0000","last_change":"2024-07-24T22:03:53.406605+0000","last_active":"2024-07-24T22:05:27.695747+0000","last_peered":"2024-07-24T22:05:27.695747+0000","last_clean":"2024-07-24T22:05:27.695747+0000","last_became_active":"2024-07-24T22:03:53.406264+0000","last_became_peered":"2024-07-24T22:03:53.406264+0000","last_unstale":"2024-07-24T22:05:27.695747+0000","last_undegraded":"2024-07-24T22:05:27.695747+0000","last_fullsized":"2024-07-24T22:05:27.695747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:13:46.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695952+0000","last_change":"2024-07-24T22:03:53.400422+0000","last_active":"2024-07-24T22:05:27.695952+0000","last_peered":"2024-07-24T22:05:27.695952+0000","last_clean":"2024-07-24T22:05:27.695952+0000","last_became_active":"2024-07-24T22:03:53.400096+0000","last_became_peered":"2024-07-24T22:03:53.400096+0000","last_unstale":"2024-07-24T22:05:27.695952+0000","last_undegraded":"2024-07-24T22:05:27.695952+0000","last_fullsized":"2024-07-24T22:05:27.695952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:04:07.882659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573300+0000","last_change":"2024-07-24T22:03:53.413231+0000","last_active":"2024-07-24T22:05:27.573300+0000","last_peered":"2024-07-24T22:05:27.573300+0000","last_clean":"2024-07-24T22:05:27.573300+0000","last_became_active":"2024-07-24T22:03:53.412825+0000","last_became_peered":"2024-07-24T22:03:53.412825+0000","last_unstale":"2024-07-24T22:05:27.573300+0000","last_undegraded":"2024-07-24T22:05:27.573300+0000","last_fullsized":"2024-07-24T22:05:27.573300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:59:30.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575892+0000","last_change":"2024-07-24T22:03:53.409007+0000","last_active":"2024-07-24T22:05:27.575892+0000","last_peered":"2024-07-24T22:05:27.575892+0000","last_clean":"2024-07-24T22:05:27.575892+0000","last_became_active":"2024-07-24T22:03:53.408624+0000","last_became_peered":"2024-07-24T22:03:53.408624+0000","last_unstale":"2024-07-24T22:05:27.575892+0000","last_undegraded":"2024-07-24T22:05:27.575892+0000","last_fullsized":"2024-07-24T22:05:27.575892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:31:22.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575265+0000","last_change":"2024-07-24T22:03:50.388894+0000","last_active":"2024-07-24T22:05:27.575265+0000","last_peered":"2024-07-24T22:05:27.575265+0000","last_clean":"2024-07-24T22:05:27.575265+0000","last_became_active":"2024-07-24T22:03:50.388608+0000","last_became_peered":"2024-07-24T22:03:50.388608+0000","last_unstale":"2024-07-24T22:05:27.575265+0000","last_undegraded":"2024-07-24T22:05:27.575265+0000","last_fullsized":"2024-07-24T22:05:27.575265+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:36:43.571415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575180+0000","last_change":"2024-07-24T22:03:53.397509+0000","last_active":"2024-07-24T22:05:27.575180+0000","last_peered":"2024-07-24T22:05:27.575180+0000","last_clean":"2024-07-24T22:05:27.575180+0000","last_became_active":"2024-07-24T22:03:53.397186+0000","last_became_peered":"2024-07-24T22:03:53.397186+0000","last_unstale":"2024-07-24T22:05:27.575180+0000","last_undegraded":"2024-07-24T22:05:27.575180+0000","last_fullsized":"2024-07-24T22:05:27.575180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:15:14.081853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588873+0000","last_change":"2024-07-24T22:03:50.383523+0000","last_active":"2024-07-24T22:05:27.588873+0000","last_peered":"2024-07-24T22:05:27.588873+0000","last_clean":"2024-07-24T22:05:27.588873+0000","last_became_active":"2024-07-24T22:03:50.383088+0000","last_became_peered":"2024-07-24T22:03:50.383088+0000","last_unstale":"2024-07-24T22:05:27.588873+0000","last_undegraded":"2024-07-24T22:05:27.588873+0000","last_fullsized":"2024-07-24T22:05:27.588873+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:57:07.824581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570907+0000","last_change":"2024-07-24T22:03:50.383726+0000","last_active":"2024-07-24T22:05:27.570907+0000","last_peered":"2024-07-24T22:05:27.570907+0000","last_clean":"2024-07-24T22:05:27.570907+0000","last_became_active":"2024-07-24T22:03:50.383480+0000","last_became_peered":"2024-07-24T22:03:50.383480+0000","last_unstale":"2024-07-24T22:05:27.570907+0000","last_undegraded":"2024-07-24T22:05:27.570907+0000","last_fullsized":"2024-07-24T22:05:27.570907+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:05:05.093272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695769+0000","last_change":"2024-07-24T22:03:53.406223+0000","last_active":"2024-07-24T22:05:27.695769+0000","last_peered":"2024-07-24T22:05:27.695769+0000","last_clean":"2024-07-24T22:05:27.695769+0000","last_became_active":"2024-07-24T22:03:53.404642+0000","last_became_peered":"2024-07-24T22:03:53.404642+0000","last_unstale":"2024-07-24T22:05:27.695769+0000","last_undegraded":"2024-07-24T22:05:27.695769+0000","last_fullsized":"2024-07-24T22:05:27.695769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:00:51.849538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574845+0000","last_change":"2024-07-24T22:03:50.385780+0000","last_active":"2024-07-24T22:05:27.574845+0000","last_peered":"2024-07-24T22:05:27.574845+0000","last_clean":"2024-07-24T22:05:27.574845+0000","last_became_active":"2024-07-24T22:03:50.385488+0000","last_became_peered":"2024-07-24T22:03:50.385488+0000","last_unstale":"2024-07-24T22:05:27.574845+0000","last_undegraded":"2024-07-24T22:05:27.574845+0000","last_fullsized":"2024-07-24T22:05:27.574845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:47:35.908303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695709+0000","last_change":"2024-07-24T22:03:53.403103+0000","last_active":"2024-07-24T22:05:27.695709+0000","last_peered":"2024-07-24T22:05:27.695709+0000","last_clean":"2024-07-24T22:05:27.695709+0000","last_became_active":"2024-07-24T22:03:53.402810+0000","last_became_peered":"2024-07-24T22:03:53.402810+0000","last_unstale":"2024-07-24T22:05:27.695709+0000","last_undegraded":"2024-07-24T22:05:27.695709+0000","last_fullsized":"2024-07-24T22:05:27.695709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:15.798983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589036+0000","last_change":"2024-07-24T22:03:50.382383+0000","last_active":"2024-07-24T22:05:27.589036+0000","last_peered":"2024-07-24T22:05:27.589036+0000","last_clean":"2024-07-24T22:05:27.589036+0000","last_became_active":"2024-07-24T22:03:50.381629+0000","last_became_peered":"2024-07-24T22:03:50.381629+0000","last_unstale":"2024-07-24T22:05:27.589036+0000","last_undegraded":"2024-07-24T22:05:27.589036+0000","last_fullsized":"2024-07-24T22:05:27.589036+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:17.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572104+0000","last_change":"2024-07-24T22:03:53.409587+0000","last_active":"2024-07-24T22:05:27.572104+0000","last_peered":"2024-07-24T22:05:27.572104+0000","last_clean":"2024-07-24T22:05:27.572104+0000","last_became_active":"2024-07-24T22:03:53.409240+0000","last_became_peered":"2024-07-24T22:03:53.409240+0000","last_unstale":"2024-07-24T22:05:27.572104+0000","last_undegraded":"2024-07-24T22:05:27.572104+0000","last_fullsized":"2024-07-24T22:05:27.572104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:37:18.654244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576399+0000","last_change":"2024-07-24T22:03:50.387933+0000","last_active":"2024-07-24T22:05:27.576399+0000","last_peered":"2024-07-24T22:05:27.576399+0000","last_clean":"2024-07-24T22:05:27.576399+0000","last_became_active":"2024-07-24T22:03:50.386985+0000","last_became_peered":"2024-07-24T22:03:50.386985+0000","last_unstale":"2024-07-24T22:05:27.576399+0000","last_undegraded":"2024-07-24T22:05:27.576399+0000","last_fullsized":"2024-07-24T22:05:27.576399+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:35:29.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696634+0000","last_change":"2024-07-24T22:03:53.404419+0000","last_active":"2024-07-24T22:05:27.696634+0000","last_peered":"2024-07-24T22:05:27.696634+0000","last_clean":"2024-07-24T22:05:27.696634+0000","last_became_active":"2024-07-24T22:03:53.402713+0000","last_became_peered":"2024-07-24T22:03:53.402713+0000","last_unstale":"2024-07-24T22:05:27.696634+0000","last_undegraded":"2024-07-24T22:05:27.696634+0000","last_fullsized":"2024-07-24T22:05:27.696634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:41.262686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575058+0000","last_change":"2024-07-24T22:03:50.511126+0000","last_active":"2024-07-24T22:05:27.575058+0000","last_peered":"2024-07-24T22:05:27.575058+0000","last_clean":"2024-07-24T22:05:27.575058+0000","last_became_active":"2024-07-24T22:03:50.510801+0000","last_became_peered":"2024-07-24T22:03:50.510801+0000","last_unstale":"2024-07-24T22:05:27.575058+0000","last_undegraded":"2024-07-24T22:05:27.575058+0000","last_fullsized":"2024-07-24T22:05:27.575058+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:59:37.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571709+0000","last_change":"2024-07-24T22:03:53.410202+0000","last_active":"2024-07-24T22:05:27.571709+0000","last_peered":"2024-07-24T22:05:27.571709+0000","last_clean":"2024-07-24T22:05:27.571709+0000","last_became_active":"2024-07-24T22:03:53.409884+0000","last_became_peered":"2024-07-24T22:03:53.409884+0000","last_unstale":"2024-07-24T22:05:27.571709+0000","last_undegraded":"2024-07-24T22:05:27.571709+0000","last_fullsized":"2024-07-24T22:05:27.571709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:54:02.603267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'30","reported_seq":258,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:40.608651+0000","last_change":"2024-07-24T22:03:50.386993+0000","last_active":"2024-07-24T22:05:40.608651+0000","last_peered":"2024-07-24T22:05:40.608651+0000","last_clean":"2024-07-24T22:05:40.608651+0000","last_became_active":"2024-07-24T22:03:50.386675+0000","last_became_peered":"2024-07-24T22:03:50.386675+0000","last_unstale":"2024-07-24T22:05:40.608651+0000","last_undegraded":"2024-07-24T22:05:40.608651+0000","last_fullsized":"2024-07-24T22:05:40.608651+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:20:58.384179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62584,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":197,"num_read_kb":159,"num_write":30,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576518+0000","last_change":"2024-07-24T22:03:53.413293+0000","last_active":"2024-07-24T22:05:27.576518+0000","last_peered":"2024-07-24T22:05:27.576518+0000","last_clean":"2024-07-24T22:05:27.576518+0000","last_became_active":"2024-07-24T22:03:53.412900+0000","last_became_peered":"2024-07-24T22:03:53.412900+0000","last_unstale":"2024-07-24T22:05:27.576518+0000","last_undegraded":"2024-07-24T22:05:27.576518+0000","last_fullsized":"2024-07-24T22:05:27.576518+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:11:32.553108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696059+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.696059+0000","last_peered":"2024-07-24T22:05:27.696059+0000","last_clean":"2024-07-24T22:05:27.696059+0000","last_became_active":"2024-07-24T22:03:50.387059+0000","last_became_peered":"2024-07-24T22:03:50.387059+0000","last_unstale":"2024-07-24T22:05:27.696059+0000","last_undegraded":"2024-07-24T22:05:27.696059+0000","last_fullsized":"2024-07-24T22:05:27.696059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:40:06.887090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570856+0000","last_change":"2024-07-24T22:03:53.406808+0000","last_active":"2024-07-24T22:05:27.570856+0000","last_peered":"2024-07-24T22:05:27.570856+0000","last_clean":"2024-07-24T22:05:27.570856+0000","last_became_active":"2024-07-24T22:03:53.406487+0000","last_became_peered":"2024-07-24T22:03:53.406487+0000","last_unstale":"2024-07-24T22:05:27.570856+0000","last_undegraded":"2024-07-24T22:05:27.570856+0000","last_fullsized":"2024-07-24T22:05:27.570856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:44:57.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574876+0000","last_change":"2024-07-24T22:03:50.386881+0000","last_active":"2024-07-24T22:05:27.574876+0000","last_peered":"2024-07-24T22:05:27.574876+0000","last_clean":"2024-07-24T22:05:27.574876+0000","last_became_active":"2024-07-24T22:03:50.386564+0000","last_became_peered":"2024-07-24T22:03:50.386564+0000","last_unstale":"2024-07-24T22:05:27.574876+0000","last_undegraded":"2024-07-24T22:05:27.574876+0000","last_fullsized":"2024-07-24T22:05:27.574876+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:22:22.339854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576223+0000","last_change":"2024-07-24T22:03:53.403207+0000","last_active":"2024-07-24T22:05:27.576223+0000","last_peered":"2024-07-24T22:05:27.576223+0000","last_clean":"2024-07-24T22:05:27.576223+0000","last_became_active":"2024-07-24T22:03:53.402875+0000","last_became_peered":"2024-07-24T22:03:53.402875+0000","last_unstale":"2024-07-24T22:05:27.576223+0000","last_undegraded":"2024-07-24T22:05:27.576223+0000","last_fullsized":"2024-07-24T22:05:27.576223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:25:28.866228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575905+0000","last_change":"2024-07-24T22:03:50.386721+0000","last_active":"2024-07-24T22:05:27.575905+0000","last_peered":"2024-07-24T22:05:27.575905+0000","last_clean":"2024-07-24T22:05:27.575905+0000","last_became_active":"2024-07-24T22:03:50.385654+0000","last_became_peered":"2024-07-24T22:03:50.385654+0000","last_unstale":"2024-07-24T22:05:27.575905+0000","last_undegraded":"2024-07-24T22:05:27.575905+0000","last_fullsized":"2024-07-24T22:05:27.575905+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:16:15.802744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575839+0000","last_change":"2024-07-24T22:03:53.405367+0000","last_active":"2024-07-24T22:05:27.575839+0000","last_peered":"2024-07-24T22:05:27.575839+0000","last_clean":"2024-07-24T22:05:27.575839+0000","last_became_active":"2024-07-24T22:03:53.404875+0000","last_became_peered":"2024-07-24T22:03:53.404875+0000","last_unstale":"2024-07-24T22:05:27.575839+0000","last_undegraded":"2024-07-24T22:05:27.575839+0000","last_fullsized":"2024-07-24T22:05:27.575839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:42.247052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575827+0000","last_change":"2024-07-24T22:04:27.574426+0000","last_active":"2024-07-24T22:05:27.575827+0000","last_peered":"2024-07-24T22:05:27.575827+0000","last_clean":"2024-07-24T22:05:27.575827+0000","last_became_active":"2024-07-24T22:04:27.568176+0000","last_became_peered":"2024-07-24T22:04:27.568176+0000","last_unstale":"2024-07-24T22:05:27.575827+0000","last_undegraded":"2024-07-24T22:05:27.575827+0000","last_fullsized":"2024-07-24T22:05:27.575827+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:20:37.620669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574848+0000","last_change":"2024-07-24T22:03:53.405136+0000","last_active":"2024-07-24T22:05:27.574848+0000","last_peered":"2024-07-24T22:05:27.574848+0000","last_clean":"2024-07-24T22:05:27.574848+0000","last_became_active":"2024-07-24T22:03:53.404043+0000","last_became_peered":"2024-07-24T22:03:53.404043+0000","last_unstale":"2024-07-24T22:05:27.574848+0000","last_undegraded":"2024-07-24T22:05:27.574848+0000","last_fullsized":"2024-07-24T22:05:27.574848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:03:21.912335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576686+0000","last_change":"2024-07-24T22:03:50.382364+0000","last_active":"2024-07-24T22:05:27.576686+0000","last_peered":"2024-07-24T22:05:27.576686+0000","last_clean":"2024-07-24T22:05:27.576686+0000","last_became_active":"2024-07-24T22:03:50.382029+0000","last_became_peered":"2024-07-24T22:03:50.382029+0000","last_unstale":"2024-07-24T22:05:27.576686+0000","last_undegraded":"2024-07-24T22:05:27.576686+0000","last_fullsized":"2024-07-24T22:05:27.576686+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:48:10.004826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573726+0000","last_change":"2024-07-24T22:03:53.413053+0000","last_active":"2024-07-24T22:05:27.573726+0000","last_peered":"2024-07-24T22:05:27.573726+0000","last_clean":"2024-07-24T22:05:27.573726+0000","last_became_active":"2024-07-24T22:03:53.412733+0000","last_became_peered":"2024-07-24T22:03:53.412733+0000","last_unstale":"2024-07-24T22:05:27.573726+0000","last_undegraded":"2024-07-24T22:05:27.573726+0000","last_fullsized":"2024-07-24T22:05:27.573726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:16.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571295+0000","last_change":"2024-07-24T22:03:50.387314+0000","last_active":"2024-07-24T22:05:27.571295+0000","last_peered":"2024-07-24T22:05:27.571295+0000","last_clean":"2024-07-24T22:05:27.571295+0000","last_became_active":"2024-07-24T22:03:50.386919+0000","last_became_peered":"2024-07-24T22:03:50.386919+0000","last_unstale":"2024-07-24T22:05:27.571295+0000","last_undegraded":"2024-07-24T22:05:27.571295+0000","last_fullsized":"2024-07-24T22:05:27.571295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:51:03.203285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576666+0000","last_change":"2024-07-24T22:03:53.411938+0000","last_active":"2024-07-24T22:05:27.576666+0000","last_peered":"2024-07-24T22:05:27.576666+0000","last_clean":"2024-07-24T22:05:27.576666+0000","last_became_active":"2024-07-24T22:03:53.411545+0000","last_became_peered":"2024-07-24T22:03:53.411545+0000","last_unstale":"2024-07-24T22:05:27.576666+0000","last_undegraded":"2024-07-24T22:05:27.576666+0000","last_fullsized":"2024-07-24T22:05:27.576666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:41:19.370886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575121+0000","last_change":"2024-07-24T22:03:50.384400+0000","last_active":"2024-07-24T22:05:27.575121+0000","last_peered":"2024-07-24T22:05:27.575121+0000","last_clean":"2024-07-24T22:05:27.575121+0000","last_became_active":"2024-07-24T22:03:50.383945+0000","last_became_peered":"2024-07-24T22:03:50.383945+0000","last_unstale":"2024-07-24T22:05:27.575121+0000","last_undegraded":"2024-07-24T22:05:27.575121+0000","last_fullsized":"2024-07-24T22:05:27.575121+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:16.035171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576355+0000","last_change":"2024-07-24T22:04:27.507390+0000","last_active":"2024-07-24T22:05:27.576355+0000","last_peered":"2024-07-24T22:05:27.576355+0000","last_clean":"2024-07-24T22:05:27.576355+0000","last_became_active":"2024-07-24T22:04:27.504206+0000","last_became_peered":"2024-07-24T22:04:27.504206+0000","last_unstale":"2024-07-24T22:05:27.576355+0000","last_undegraded":"2024-07-24T22:05:27.576355+0000","last_fullsized":"2024-07-24T22:05:27.576355+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:55:21.559702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696155+0000","last_change":"2024-07-24T22:03:50.511075+0000","last_active":"2024-07-24T22:05:27.696155+0000","last_peered":"2024-07-24T22:05:27.696155+0000","last_clean":"2024-07-24T22:05:27.696155+0000","last_became_active":"2024-07-24T22:03:50.510244+0000","last_became_peered":"2024-07-24T22:03:50.510244+0000","last_unstale":"2024-07-24T22:05:27.696155+0000","last_undegraded":"2024-07-24T22:05:27.696155+0000","last_fullsized":"2024-07-24T22:05:27.696155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:54:03.068211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576290+0000","last_change":"2024-07-24T22:03:53.410865+0000","last_active":"2024-07-24T22:05:27.576290+0000","last_peered":"2024-07-24T22:05:27.576290+0000","last_clean":"2024-07-24T22:05:27.576290+0000","last_became_active":"2024-07-24T22:03:53.410255+0000","last_became_peered":"2024-07-24T22:03:53.410255+0000","last_unstale":"2024-07-24T22:05:27.576290+0000","last_undegraded":"2024-07-24T22:05:27.576290+0000","last_fullsized":"2024-07-24T22:05:27.576290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:15.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576134+0000","last_change":"2024-07-24T22:02:33.494929+0000","last_active":"2024-07-24T22:05:27.576134+0000","last_peered":"2024-07-24T22:05:27.576134+0000","last_clean":"2024-07-24T22:05:27.576134+0000","last_became_active":"2024-07-24T22:02:33.489241+0000","last_became_peered":"2024-07-24T22:02:33.489241+0000","last_unstale":"2024-07-24T22:05:27.576134+0000","last_undegraded":"2024-07-24T22:05:27.576134+0000","last_fullsized":"2024-07-24T22:05:27.576134+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_clean_scrub_stamp":"2024-07-24T21:59:32.406119+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:46.421413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576215+0000","last_change":"2024-07-24T22:03:50.385093+0000","last_active":"2024-07-24T22:05:27.576215+0000","last_peered":"2024-07-24T22:05:27.576215+0000","last_clean":"2024-07-24T22:05:27.576215+0000","last_became_active":"2024-07-24T22:03:50.384639+0000","last_became_peered":"2024-07-24T22:03:50.384639+0000","last_unstale":"2024-07-24T22:05:27.576215+0000","last_undegraded":"2024-07-24T22:05:27.576215+0000","last_fullsized":"2024-07-24T22:05:27.576215+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:06:10.402336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695985+0000","last_change":"2024-07-24T22:03:53.409627+0000","last_active":"2024-07-24T22:05:27.695985+0000","last_peered":"2024-07-24T22:05:27.695985+0000","last_clean":"2024-07-24T22:05:27.695985+0000","last_became_active":"2024-07-24T22:03:53.409295+0000","last_became_peered":"2024-07-24T22:03:53.409295+0000","last_unstale":"2024-07-24T22:05:27.695985+0000","last_undegraded":"2024-07-24T22:05:27.695985+0000","last_fullsized":"2024-07-24T22:05:27.695985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:23:39.670020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575968+0000","last_change":"2024-07-24T22:03:50.385772+0000","last_active":"2024-07-24T22:05:27.575968+0000","last_peered":"2024-07-24T22:05:27.575968+0000","last_clean":"2024-07-24T22:05:27.575968+0000","last_became_active":"2024-07-24T22:03:50.385421+0000","last_became_peered":"2024-07-24T22:03:50.385421+0000","last_unstale":"2024-07-24T22:05:27.575968+0000","last_undegraded":"2024-07-24T22:05:27.575968+0000","last_fullsized":"2024-07-24T22:05:27.575968+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:58:57.227697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570831+0000","last_change":"2024-07-24T22:03:53.400558+0000","last_active":"2024-07-24T22:05:27.570831+0000","last_peered":"2024-07-24T22:05:27.570831+0000","last_clean":"2024-07-24T22:05:27.570831+0000","last_became_active":"2024-07-24T22:03:53.400131+0000","last_became_peered":"2024-07-24T22:03:53.400131+0000","last_unstale":"2024-07-24T22:05:27.570831+0000","last_undegraded":"2024-07-24T22:05:27.570831+0000","last_fullsized":"2024-07-24T22:05:27.570831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:57:57.586742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570948+0000","last_change":"2024-07-24T22:03:50.510189+0000","last_active":"2024-07-24T22:05:27.570948+0000","last_peered":"2024-07-24T22:05:27.570948+0000","last_clean":"2024-07-24T22:05:27.570948+0000","last_became_active":"2024-07-24T22:03:50.509857+0000","last_became_peered":"2024-07-24T22:03:50.509857+0000","last_unstale":"2024-07-24T22:05:27.570948+0000","last_undegraded":"2024-07-24T22:05:27.570948+0000","last_fullsized":"2024-07-24T22:05:27.570948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:05:59.240650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574648+0000","last_change":"2024-07-24T22:04:27.505187+0000","last_active":"2024-07-24T22:05:27.574648+0000","last_peered":"2024-07-24T22:05:27.574648+0000","last_clean":"2024-07-24T22:05:27.574648+0000","last_became_active":"2024-07-24T22:04:27.504785+0000","last_became_peered":"2024-07-24T22:04:27.504785+0000","last_unstale":"2024-07-24T22:05:27.574648+0000","last_undegraded":"2024-07-24T22:05:27.574648+0000","last_fullsized":"2024-07-24T22:05:27.574648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:47:33.516835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576182+0000","last_change":"2024-07-24T22:05:27.575016+0000","last_active":"2024-07-24T22:05:27.576182+0000","last_peered":"2024-07-24T22:05:27.576182+0000","last_clean":"2024-07-24T22:05:27.576182+0000","last_became_active":"2024-07-24T22:05:27.574644+0000","last_became_peered":"2024-07-24T22:05:27.574644+0000","last_unstale":"2024-07-24T22:05:27.576182+0000","last_undegraded":"2024-07-24T22:05:27.576182+0000","last_fullsized":"2024-07-24T22:05:27.576182+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:11:37.759190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588862+0000","last_change":"2024-07-24T22:03:53.399369+0000","last_active":"2024-07-24T22:05:27.588862+0000","last_peered":"2024-07-24T22:05:27.588862+0000","last_clean":"2024-07-24T22:05:27.588862+0000","last_became_active":"2024-07-24T22:03:53.399001+0000","last_became_peered":"2024-07-24T22:03:53.399001+0000","last_unstale":"2024-07-24T22:05:27.588862+0000","last_undegraded":"2024-07-24T22:05:27.588862+0000","last_fullsized":"2024-07-24T22:05:27.588862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:26:46.531080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695821+0000","last_change":"2024-07-24T22:03:50.510889+0000","last_active":"2024-07-24T22:05:27.695821+0000","last_peered":"2024-07-24T22:05:27.695821+0000","last_clean":"2024-07-24T22:05:27.695821+0000","last_became_active":"2024-07-24T22:03:50.510366+0000","last_became_peered":"2024-07-24T22:03:50.510366+0000","last_unstale":"2024-07-24T22:05:27.695821+0000","last_undegraded":"2024-07-24T22:05:27.695821+0000","last_fullsized":"2024-07-24T22:05:27.695821+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:47:54.838304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588953+0000","last_change":"2024-07-24T22:03:53.398987+0000","last_active":"2024-07-24T22:05:27.588953+0000","last_peered":"2024-07-24T22:05:27.588953+0000","last_clean":"2024-07-24T22:05:27.588953+0000","last_became_active":"2024-07-24T22:03:53.398604+0000","last_became_peered":"2024-07-24T22:03:53.398604+0000","last_unstale":"2024-07-24T22:05:27.588953+0000","last_undegraded":"2024-07-24T22:05:27.588953+0000","last_fullsized":"2024-07-24T22:05:27.588953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:28:41.684174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576638+0000","last_change":"2024-07-24T22:03:50.510623+0000","last_active":"2024-07-24T22:05:27.576638+0000","last_peered":"2024-07-24T22:05:27.576638+0000","last_clean":"2024-07-24T22:05:27.576638+0000","last_became_active":"2024-07-24T22:03:50.510204+0000","last_became_peered":"2024-07-24T22:03:50.510204+0000","last_unstale":"2024-07-24T22:05:27.576638+0000","last_undegraded":"2024-07-24T22:05:27.576638+0000","last_fullsized":"2024-07-24T22:05:27.576638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:06:40.838840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571131+0000","last_change":"2024-07-24T22:03:53.400289+0000","last_active":"2024-07-24T22:05:27.571131+0000","last_peered":"2024-07-24T22:05:27.571131+0000","last_clean":"2024-07-24T22:05:27.571131+0000","last_became_active":"2024-07-24T22:03:53.399939+0000","last_became_peered":"2024-07-24T22:03:53.399939+0000","last_unstale":"2024-07-24T22:05:27.571131+0000","last_undegraded":"2024-07-24T22:05:27.571131+0000","last_fullsized":"2024-07-24T22:05:27.571131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:29:26.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'10","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695669+0000","last_change":"2024-07-24T22:03:50.382776+0000","last_active":"2024-07-24T22:05:27.695669+0000","last_peered":"2024-07-24T22:05:27.695669+0000","last_clean":"2024-07-24T22:05:27.695669+0000","last_became_active":"2024-07-24T22:03:50.382474+0000","last_became_peered":"2024-07-24T22:03:50.382474+0000","last_unstale":"2024-07-24T22:05:27.695669+0000","last_undegraded":"2024-07-24T22:05:27.695669+0000","last_fullsized":"2024-07-24T22:05:27.695669+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:59:34.688895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696647+0000","last_change":"2024-07-24T22:03:53.407883+0000","last_active":"2024-07-24T22:05:27.696647+0000","last_peered":"2024-07-24T22:05:27.696647+0000","last_clean":"2024-07-24T22:05:27.696647+0000","last_became_active":"2024-07-24T22:03:53.407524+0000","last_became_peered":"2024-07-24T22:03:53.407524+0000","last_unstale":"2024-07-24T22:05:27.696647+0000","last_undegraded":"2024-07-24T22:05:27.696647+0000","last_fullsized":"2024-07-24T22:05:27.696647+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:52:25.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576716+0000","last_change":"2024-07-24T22:03:50.388789+0000","last_active":"2024-07-24T22:05:27.576716+0000","last_peered":"2024-07-24T22:05:27.576716+0000","last_clean":"2024-07-24T22:05:27.576716+0000","last_became_active":"2024-07-24T22:03:50.385439+0000","last_became_peered":"2024-07-24T22:03:50.385439+0000","last_unstale":"2024-07-24T22:05:27.576716+0000","last_undegraded":"2024-07-24T22:05:27.576716+0000","last_fullsized":"2024-07-24T22:05:27.576716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:14:25.009588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696530+0000","last_change":"2024-07-24T22:04:27.503956+0000","last_active":"2024-07-24T22:05:27.696530+0000","last_peered":"2024-07-24T22:05:27.696530+0000","last_clean":"2024-07-24T22:05:27.696530+0000","last_became_active":"2024-07-24T22:04:27.503498+0000","last_became_peered":"2024-07-24T22:04:27.503498+0000","last_unstale":"2024-07-24T22:05:27.696530+0000","last_undegraded":"2024-07-24T22:05:27.696530+0000","last_fullsized":"2024-07-24T22:05:27.696530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:23:20.294458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571675+0000","last_change":"2024-07-24T22:03:50.510687+0000","last_active":"2024-07-24T22:05:27.571675+0000","last_peered":"2024-07-24T22:05:27.571675+0000","last_clean":"2024-07-24T22:05:27.571675+0000","last_became_active":"2024-07-24T22:03:50.510310+0000","last_became_peered":"2024-07-24T22:03:50.510310+0000","last_unstale":"2024-07-24T22:05:27.571675+0000","last_undegraded":"2024-07-24T22:05:27.571675+0000","last_fullsized":"2024-07-24T22:05:27.571675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:14:29.957324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575940+0000","last_change":"2024-07-24T22:03:53.412711+0000","last_active":"2024-07-24T22:05:27.575940+0000","last_peered":"2024-07-24T22:05:27.575940+0000","last_clean":"2024-07-24T22:05:27.575940+0000","last_became_active":"2024-07-24T22:03:53.412375+0000","last_became_peered":"2024-07-24T22:03:53.412375+0000","last_unstale":"2024-07-24T22:05:27.575940+0000","last_undegraded":"2024-07-24T22:05:27.575940+0000","last_fullsized":"2024-07-24T22:05:27.575940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:55:29.441385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696289+0000","last_change":"2024-07-24T22:03:50.383094+0000","last_active":"2024-07-24T22:05:27.696289+0000","last_peered":"2024-07-24T22:05:27.696289+0000","last_clean":"2024-07-24T22:05:27.696289+0000","last_became_active":"2024-07-24T22:03:50.382687+0000","last_became_peered":"2024-07-24T22:03:50.382687+0000","last_unstale":"2024-07-24T22:05:27.696289+0000","last_undegraded":"2024-07-24T22:05:27.696289+0000","last_fullsized":"2024-07-24T22:05:27.696289+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:32:02.727855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573300+0000","last_change":"2024-07-24T22:03:53.403709+0000","last_active":"2024-07-24T22:05:27.573300+0000","last_peered":"2024-07-24T22:05:27.573300+0000","last_clean":"2024-07-24T22:05:27.573300+0000","last_became_active":"2024-07-24T22:03:53.403334+0000","last_became_peered":"2024-07-24T22:03:53.403334+0000","last_unstale":"2024-07-24T22:05:27.573300+0000","last_undegraded":"2024-07-24T22:05:27.573300+0000","last_fullsized":"2024-07-24T22:05:27.573300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:27:50.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695761+0000","last_change":"2024-07-24T22:03:50.385547+0000","last_active":"2024-07-24T22:05:27.695761+0000","last_peered":"2024-07-24T22:05:27.695761+0000","last_clean":"2024-07-24T22:05:27.695761+0000","last_became_active":"2024-07-24T22:03:50.385233+0000","last_became_peered":"2024-07-24T22:03:50.385233+0000","last_unstale":"2024-07-24T22:05:27.695761+0000","last_undegraded":"2024-07-24T22:05:27.695761+0000","last_fullsized":"2024-07-24T22:05:27.695761+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:40:04.647242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695985+0000","last_change":"2024-07-24T22:03:53.402386+0000","last_active":"2024-07-24T22:05:27.695985+0000","last_peered":"2024-07-24T22:05:27.695985+0000","last_clean":"2024-07-24T22:05:27.695985+0000","last_became_active":"2024-07-24T22:03:53.399363+0000","last_became_peered":"2024-07-24T22:03:53.399363+0000","last_unstale":"2024-07-24T22:05:27.695985+0000","last_undegraded":"2024-07-24T22:05:27.695985+0000","last_fullsized":"2024-07-24T22:05:27.695985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:19:05.835280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576039+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.576039+0000","last_peered":"2024-07-24T22:05:27.576039+0000","last_clean":"2024-07-24T22:05:27.576039+0000","last_became_active":"2024-07-24T22:03:50.387097+0000","last_became_peered":"2024-07-24T22:03:50.387097+0000","last_unstale":"2024-07-24T22:05:27.576039+0000","last_undegraded":"2024-07-24T22:05:27.576039+0000","last_fullsized":"2024-07-24T22:05:27.576039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:11:23.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576452+0000","last_change":"2024-07-24T22:03:53.407386+0000","last_active":"2024-07-24T22:05:27.576452+0000","last_peered":"2024-07-24T22:05:27.576452+0000","last_clean":"2024-07-24T22:05:27.576452+0000","last_became_active":"2024-07-24T22:03:53.407059+0000","last_became_peered":"2024-07-24T22:03:53.407059+0000","last_unstale":"2024-07-24T22:05:27.576452+0000","last_undegraded":"2024-07-24T22:05:27.576452+0000","last_fullsized":"2024-07-24T22:05:27.576452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:12:38.508170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695772+0000","last_change":"2024-07-24T22:04:27.567714+0000","last_active":"2024-07-24T22:05:27.695772+0000","last_peered":"2024-07-24T22:05:27.695772+0000","last_clean":"2024-07-24T22:05:27.695772+0000","last_became_active":"2024-07-24T22:04:27.567492+0000","last_became_peered":"2024-07-24T22:04:27.567492+0000","last_unstale":"2024-07-24T22:05:27.695772+0000","last_undegraded":"2024-07-24T22:05:27.695772+0000","last_fullsized":"2024-07-24T22:05:27.695772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:00:13.705346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576226+0000","last_change":"2024-07-24T22:03:50.385538+0000","last_active":"2024-07-24T22:05:27.576226+0000","last_peered":"2024-07-24T22:05:27.576226+0000","last_clean":"2024-07-24T22:05:27.576226+0000","last_became_active":"2024-07-24T22:03:50.385191+0000","last_became_peered":"2024-07-24T22:03:50.385191+0000","last_unstale":"2024-07-24T22:05:27.576226+0000","last_undegraded":"2024-07-24T22:05:27.576226+0000","last_fullsized":"2024-07-24T22:05:27.576226+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:33:37.674903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571728+0000","last_change":"2024-07-24T22:03:53.411751+0000","last_active":"2024-07-24T22:05:27.571728+0000","last_peered":"2024-07-24T22:05:27.571728+0000","last_clean":"2024-07-24T22:05:27.571728+0000","last_became_active":"2024-07-24T22:03:53.410827+0000","last_became_peered":"2024-07-24T22:03:53.410827+0000","last_unstale":"2024-07-24T22:05:27.571728+0000","last_undegraded":"2024-07-24T22:05:27.571728+0000","last_fullsized":"2024-07-24T22:05:27.571728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:07:26.439047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.584159+0000","last_change":"2024-07-24T22:05:27.581982+0000","last_active":"2024-07-24T22:05:27.584159+0000","last_peered":"2024-07-24T22:05:27.584159+0000","last_clean":"2024-07-24T22:05:27.584159+0000","last_became_active":"2024-07-24T22:05:27.577413+0000","last_became_peered":"2024-07-24T22:05:27.577413+0000","last_unstale":"2024-07-24T22:05:27.584159+0000","last_undegraded":"2024-07-24T22:05:27.584159+0000","last_fullsized":"2024-07-24T22:05:27.584159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:40:27.424379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696571+0000","last_change":"2024-07-24T22:03:53.406029+0000","last_active":"2024-07-24T22:05:27.696571+0000","last_peered":"2024-07-24T22:05:27.696571+0000","last_clean":"2024-07-24T22:05:27.696571+0000","last_became_active":"2024-07-24T22:03:53.405529+0000","last_became_peered":"2024-07-24T22:03:53.405529+0000","last_unstale":"2024-07-24T22:05:27.696571+0000","last_undegraded":"2024-07-24T22:05:27.696571+0000","last_fullsized":"2024-07-24T22:05:27.696571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:57:02.290836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696534+0000","last_change":"2024-07-24T22:03:50.510884+0000","last_active":"2024-07-24T22:05:27.696534+0000","last_peered":"2024-07-24T22:05:27.696534+0000","last_clean":"2024-07-24T22:05:27.696534+0000","last_became_active":"2024-07-24T22:03:50.509851+0000","last_became_peered":"2024-07-24T22:03:50.509851+0000","last_unstale":"2024-07-24T22:05:27.696534+0000","last_undegraded":"2024-07-24T22:05:27.696534+0000","last_fullsized":"2024-07-24T22:05:27.696534+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:37:55.735488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696318+0000","last_change":"2024-07-24T22:03:53.409966+0000","last_active":"2024-07-24T22:05:27.696318+0000","last_peered":"2024-07-24T22:05:27.696318+0000","last_clean":"2024-07-24T22:05:27.696318+0000","last_became_active":"2024-07-24T22:03:53.409652+0000","last_became_peered":"2024-07-24T22:03:53.409652+0000","last_unstale":"2024-07-24T22:05:27.696318+0000","last_undegraded":"2024-07-24T22:05:27.696318+0000","last_fullsized":"2024-07-24T22:05:27.696318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:10:53.262459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696471+0000","last_change":"2024-07-24T22:04:27.571166+0000","last_active":"2024-07-24T22:05:27.696471+0000","last_peered":"2024-07-24T22:05:27.696471+0000","last_clean":"2024-07-24T22:05:27.696471+0000","last_became_active":"2024-07-24T22:04:27.567419+0000","last_became_peered":"2024-07-24T22:04:27.567419+0000","last_unstale":"2024-07-24T22:05:27.696471+0000","last_undegraded":"2024-07-24T22:05:27.696471+0000","last_fullsized":"2024-07-24T22:05:27.696471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:37:11.513631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63382,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":203,"num_read_kb":165,"num_write":88,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612647,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":937984,"data_stored":469642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1122905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972399,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40428,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704724,"statfs":{"total":95995035648,"available":95953637376,"internally_reserved":0,"allocated":946176,"data_stored":470341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168628,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":469664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1540096,"data_stored":1060709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561084,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":469759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757313,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1548288,"data_stored":1060309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920836,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117065,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40432,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704720,"statfs":{"total":95995035648,"available":95953633280,"internally_reserved":0,"allocated":950272,"data_stored":469863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378702,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":532260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":532808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705749,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":62778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T22:05:48.602 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-07-24T22:05:48.602 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-07-24T22:05:48.602 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-07-24T22:05:48.602 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph health --format=json 2024-07-24T22:05:48.876 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:49 smithi183 ceph-mon[37007]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:05:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:49 smithi183 ceph-mon[37007]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:49.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:49 smithi047 ceph-mon[32551]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:05:49.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:49 smithi047 ceph-mon[32551]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:50.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:49 smithi188 ceph-mon[37380]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:05:50.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:49 smithi188 ceph-mon[37380]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:50.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.582+0000 7f8e22caa640 1 -- 172.21.15.47:0/3769518111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e1c1081a0 msgr2=0x7f8e1c1085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:50.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.582+0000 7f8e22caa640 1 --2- 172.21.15.47:0/3769518111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e1c1081a0 0x7f8e1c1085e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009900 tx=0x7f8e0802a410 comp rx=0 tx=0).stop 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.582+0000 7f8e22caa640 1 -- 172.21.15.47:0/3769518111 shutdown_connections 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.582+0000 7f8e22caa640 1 --2- 172.21.15.47:0/3769518111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e1c108b20 0x7f8e1c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.582+0000 7f8e22caa640 1 --2- 172.21.15.47:0/3769518111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e1c1081a0 0x7f8e1c1085e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.582+0000 7f8e22caa640 1 --2- 172.21.15.47:0/3769518111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e1c102790 0x7f8e1c102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.582+0000 7f8e22caa640 1 -- 172.21.15.47:0/3769518111 >> 172.21.15.47:0/3769518111 conn(0x7f8e1c0fe200 msgr2=0x7f8e1c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.582+0000 7f8e22caa640 1 -- 172.21.15.47:0/3769518111 shutdown_connections 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.582+0000 7f8e22caa640 1 -- 172.21.15.47:0/3769518111 wait complete. 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.583+0000 7f8e22caa640 1 Processor -- start 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.583+0000 7f8e22caa640 1 -- start start 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.583+0000 7f8e22caa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e1c102790 0x7f8e1c198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.583+0000 7f8e22caa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e1c1081a0 0x7f8e1c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.583+0000 7f8e22caa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e1c108b20 0x7f8e1c19e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.583+0000 7f8e22caa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c112820 con 0x7f8e1c1081a0 2024-07-24T22:05:50.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.583+0000 7f8e22caa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c1126a0 con 0x7f8e1c108b20 2024-07-24T22:05:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.583+0000 7f8e22caa640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c1129a0 con 0x7f8e1c102790 2024-07-24T22:05:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.583+0000 7f8e1bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e1c1081a0 0x7f8e1c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.583+0000 7f8e1bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e1c1081a0 0x7f8e1c1992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34118/0 (socket says 172.21.15.47:34118) 2024-07-24T22:05:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.583+0000 7f8e1bfff640 1 -- 172.21.15.47:0/1108611386 learned_addr learned my addr 172.21.15.47:0/1108611386 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.583+0000 7f8e20a46640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e1c102790 0x7f8e1c198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.583+0000 7f8e21247640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e1c108b20 0x7f8e1c19e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.584+0000 7f8e1bfff640 1 -- 172.21.15.47:0/1108611386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e1c102790 msgr2=0x7f8e1c198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.584+0000 7f8e1bfff640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e1c102790 0x7f8e1c198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.584+0000 7f8e1bfff640 1 -- 172.21.15.47:0/1108611386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e1c108b20 msgr2=0x7f8e1c19e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.584+0000 7f8e1bfff640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e1c108b20 0x7f8e1c19e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.584+0000 7f8e1bfff640 1 -- 172.21.15.47:0/1108611386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1c19ee40 con 0x7f8e1c1081a0 2024-07-24T22:05:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.584+0000 7f8e20a46640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e1c102790 0x7f8e1c198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.584+0000 7f8e1bfff640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e1c1081a0 0x7f8e1c1992d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8e08006010 tx=0x7f8e080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.584+0000 7f8e19ffb640 1 -- 172.21.15.47:0/1108611386 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0803f030 con 0x7f8e1c1081a0 2024-07-24T22:05:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.584+0000 7f8e19ffb640 1 -- 172.21.15.47:0/1108611386 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e08003800 con 0x7f8e1c1081a0 2024-07-24T22:05:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.584+0000 7f8e22caa640 1 -- 172.21.15.47:0/1108611386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1c19f0d0 con 0x7f8e1c1081a0 2024-07-24T22:05:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.584+0000 7f8e19ffb640 1 -- 172.21.15.47:0/1108611386 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08035070 con 0x7f8e1c1081a0 2024-07-24T22:05:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.584+0000 7f8e22caa640 1 -- 172.21.15.47:0/1108611386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e1c1a57f0 con 0x7f8e1c1081a0 2024-07-24T22:05:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.585+0000 7f8e22caa640 1 -- 172.21.15.47:0/1108611386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e1c102bf0 con 0x7f8e1c1081a0 2024-07-24T22:05:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.586+0000 7f8e19ffb640 1 -- 172.21.15.47:0/1108611386 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f8e08003cb0 con 0x7f8e1c1081a0 2024-07-24T22:05:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.587+0000 7f8e19ffb640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8e0c0b3c20 0x7f8e0c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.588+0000 7f8e20a46640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8e0c0b3c20 0x7f8e0c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.588+0000 7f8e19ffb640 1 -- 172.21.15.47:0/1108611386 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8e08104890 con 0x7f8e1c1081a0 2024-07-24T22:05:50.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.588+0000 7f8e20a46640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8e0c0b3c20 0x7f8e0c0b60e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009930 tx=0x7f8e10008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:50.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.591+0000 7f8e19ffb640 1 -- 172.21.15.47:0/1108611386 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f8e080cbd60 con 0x7f8e1c1081a0 2024-07-24T22:05:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.827+0000 7f8e22caa640 1 -- 172.21.15.47:0/1108611386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8e1c10a370 con 0x7f8e1c1081a0 2024-07-24T22:05:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.827+0000 7f8e19ffb640 1 -- 172.21.15.47:0/1108611386 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8e080cb660 con 0x7f8e1c1081a0 2024-07-24T22:05:50.829 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:05:50.829 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-07-24T22:05:50.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.829+0000 7f8e22caa640 1 -- 172.21.15.47:0/1108611386 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8e0c0b3c20 msgr2=0x7f8e0c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:50.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.829+0000 7f8e22caa640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8e0c0b3c20 0x7f8e0c0b60e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009930 tx=0x7f8e10008040 comp rx=0 tx=0).stop 2024-07-24T22:05:50.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.829+0000 7f8e22caa640 1 -- 172.21.15.47:0/1108611386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e1c1081a0 msgr2=0x7f8e1c1992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:50.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.829+0000 7f8e22caa640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e1c1081a0 0x7f8e1c1992d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8e08006010 tx=0x7f8e080042f0 comp rx=0 tx=0).stop 2024-07-24T22:05:50.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.829+0000 7f8e22caa640 1 -- 172.21.15.47:0/1108611386 shutdown_connections 2024-07-24T22:05:50.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.829+0000 7f8e22caa640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8e0c0b3c20 0x7f8e0c0b60e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:50.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.829+0000 7f8e22caa640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e1c108b20 0x7f8e1c19e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:50.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.829+0000 7f8e22caa640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e1c1081a0 0x7f8e1c1992d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:50.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.829+0000 7f8e22caa640 1 --2- 172.21.15.47:0/1108611386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e1c102790 0x7f8e1c198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:50.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.829+0000 7f8e22caa640 1 -- 172.21.15.47:0/1108611386 >> 172.21.15.47:0/1108611386 conn(0x7f8e1c0fe200 msgr2=0x7f8e1c1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:50.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.829+0000 7f8e22caa640 1 -- 172.21.15.47:0/1108611386 shutdown_connections 2024-07-24T22:05:50.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:50.829+0000 7f8e22caa640 1 -- 172.21.15.47:0/1108611386 wait complete. 2024-07-24T22:05:51.602 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-07-24T22:05:51.602 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:05:51.874 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:51.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:51 smithi183 ceph-mon[37007]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:51.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:51 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1108611386' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-07-24T22:05:51.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:51 smithi047 ceph-mon[32551]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:51.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:51 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1108611386' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-07-24T22:05:52.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:51 smithi188 ceph-mon[37380]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:52.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:51 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1108611386' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-07-24T22:05:53.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.522+0000 7f715b598640 1 -- 172.21.15.47:0/974307990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7154103fb0 msgr2=0x7f715410c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:53.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.522+0000 7f715b598640 1 --2- 172.21.15.47:0/974307990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7154103fb0 0x7f715410c4a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7148009900 tx=0x7f714802a410 comp rx=0 tx=0).stop 2024-07-24T22:05:53.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.522+0000 7f715b598640 1 -- 172.21.15.47:0/974307990 shutdown_connections 2024-07-24T22:05:53.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.522+0000 7f715b598640 1 --2- 172.21.15.47:0/974307990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f715410caf0 0x7f715410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:53.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.522+0000 7f715b598640 1 --2- 172.21.15.47:0/974307990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7154103fb0 0x7f715410c4a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:53.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.522+0000 7f715b598640 1 --2- 172.21.15.47:0/974307990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7154103690 0x7f7154103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:53.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.522+0000 7f715b598640 1 -- 172.21.15.47:0/974307990 >> 172.21.15.47:0/974307990 conn(0x7f71540fd0b0 msgr2=0x7f71540ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:53.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.522+0000 7f715b598640 1 -- 172.21.15.47:0/974307990 shutdown_connections 2024-07-24T22:05:53.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.522+0000 7f715b598640 1 -- 172.21.15.47:0/974307990 wait complete. 2024-07-24T22:05:53.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.522+0000 7f715b598640 1 Processor -- start 2024-07-24T22:05:53.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.522+0000 7f715b598640 1 -- start start 2024-07-24T22:05:53.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f715b598640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7154103690 0x7f7154198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:53.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f715b598640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7154103fb0 0x7f7154199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:53.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f715b598640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715410caf0 0x7f715419e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:53.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f715b598640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7154112820 con 0x7f715410caf0 2024-07-24T22:05:53.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f715b598640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f71541126a0 con 0x7f7154103690 2024-07-24T22:05:53.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f715b598640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f71541129a0 con 0x7f7154103fb0 2024-07-24T22:05:53.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f7159b35640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715410caf0 0x7f715419e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:53.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f7159b35640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715410caf0 0x7f715419e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34136/0 (socket says 172.21.15.47:34136) 2024-07-24T22:05:53.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f7159b35640 1 -- 172.21.15.47:0/311582680 learned_addr learned my addr 172.21.15.47:0/311582680 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:53.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f7159334640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7154103690 0x7f7154198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:53.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f7159b35640 1 -- 172.21.15.47:0/311582680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7154103fb0 msgr2=0x7f7154199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:53.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f7158b33640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7154103fb0 0x7f7154199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:53.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f7159b35640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7154103fb0 0x7f7154199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:53.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f7159b35640 1 -- 172.21.15.47:0/311582680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7154103690 msgr2=0x7f7154198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:53.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f7159b35640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7154103690 0x7f7154198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:53.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f7159b35640 1 -- 172.21.15.47:0/311582680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715419eee0 con 0x7f715410caf0 2024-07-24T22:05:53.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f7159334640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7154103690 0x7f7154198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:05:53.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f7159b35640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715410caf0 0x7f715419e710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f714c009fd0 tx=0x7f714c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:53.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f71467fc640 1 -- 172.21.15.47:0/311582680 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c011830 con 0x7f715410caf0 2024-07-24T22:05:53.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f71467fc640 1 -- 172.21.15.47:0/311582680 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f714c016070 con 0x7f715410caf0 2024-07-24T22:05:53.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f715b598640 1 -- 172.21.15.47:0/311582680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715419f1d0 con 0x7f715410caf0 2024-07-24T22:05:53.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f71467fc640 1 -- 172.21.15.47:0/311582680 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c010de0 con 0x7f715410caf0 2024-07-24T22:05:53.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.523+0000 7f715b598640 1 -- 172.21.15.47:0/311582680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71541a5890 con 0x7f715410caf0 2024-07-24T22:05:53.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.524+0000 7f715b598640 1 -- 172.21.15.47:0/311582680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7154103af0 con 0x7f715410caf0 2024-07-24T22:05:53.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.526+0000 7f71467fc640 1 -- 172.21.15.47:0/311582680 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f714c0119d0 con 0x7f715410caf0 2024-07-24T22:05:53.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.527+0000 7f71467fc640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f71400b3c20 0x7f71400b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:53.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.527+0000 7f7159334640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f71400b3c20 0x7f71400b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:53.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.527+0000 7f71467fc640 1 -- 172.21.15.47:0/311582680 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f714c0e3540 con 0x7f715410caf0 2024-07-24T22:05:53.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.527+0000 7f7159334640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f71400b3c20 0x7f71400b60e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7150007eb0 tx=0x7f71500073c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:53.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.531+0000 7f71467fc640 1 -- 172.21.15.47:0/311582680 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f714c0aaa70 con 0x7f715410caf0 2024-07-24T22:05:53.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.767+0000 7f715b598640 1 -- 172.21.15.47:0/311582680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f715402e000 con 0x7f715410caf0 2024-07-24T22:05:53.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.767+0000 7f71467fc640 1 -- 172.21.15.47:0/311582680 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f714c0aa370 con 0x7f715410caf0 2024-07-24T22:05:53.770 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:05:53.770 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:05:53.770 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:05:53.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.769+0000 7f715b598640 1 -- 172.21.15.47:0/311582680 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f71400b3c20 msgr2=0x7f71400b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:53.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.769+0000 7f715b598640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f71400b3c20 0x7f71400b60e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7150007eb0 tx=0x7f71500073c0 comp rx=0 tx=0).stop 2024-07-24T22:05:53.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.769+0000 7f715b598640 1 -- 172.21.15.47:0/311582680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715410caf0 msgr2=0x7f715419e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:53.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.769+0000 7f715b598640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715410caf0 0x7f715419e710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f714c009fd0 tx=0x7f714c00b8e0 comp rx=0 tx=0).stop 2024-07-24T22:05:53.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.769+0000 7f715b598640 1 -- 172.21.15.47:0/311582680 shutdown_connections 2024-07-24T22:05:53.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.769+0000 7f715b598640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f71400b3c20 0x7f71400b60e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:53.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.769+0000 7f715b598640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f715410caf0 0x7f715419e710 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:53.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.769+0000 7f715b598640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7154103fb0 0x7f7154199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:53.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.769+0000 7f715b598640 1 --2- 172.21.15.47:0/311582680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7154103690 0x7f7154198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:53.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.769+0000 7f715b598640 1 -- 172.21.15.47:0/311582680 >> 172.21.15.47:0/311582680 conn(0x7f71540fd0b0 msgr2=0x7f71540fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:53.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.770+0000 7f715b598640 1 -- 172.21.15.47:0/311582680 shutdown_connections 2024-07-24T22:05:53.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:53.770+0000 7f715b598640 1 -- 172.21.15.47:0/311582680 wait complete. 2024-07-24T22:05:53.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:53 smithi183 ceph-mon[37007]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:53.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:53 smithi047 ceph-mon[32551]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:54.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:53 smithi188 ceph-mon[37380]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:54.577 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:05:54.847 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:54.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:54 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/311582680' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:05:54.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:54 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/311582680' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:05:55.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:54 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/311582680' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:05:55.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:55 smithi183 ceph-mon[37007]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:55.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:55 smithi047 ceph-mon[32551]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:55.950 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:55 smithi188 ceph-mon[37380]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.641+0000 7fd320a16640 1 -- 172.21.15.47:0/1587036622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd31c10cac0 msgr2=0x7fd31c10ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.641+0000 7fd320a16640 1 --2- 172.21.15.47:0/1587036622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd31c10cac0 0x7fd31c10ef20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd314009ca0 tx=0x7fd31402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:05:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.641+0000 7fd320a16640 1 -- 172.21.15.47:0/1587036622 shutdown_connections 2024-07-24T22:05:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.641+0000 7fd320a16640 1 --2- 172.21.15.47:0/1587036622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd31c10cac0 0x7fd31c10ef20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.641+0000 7fd320a16640 1 --2- 172.21.15.47:0/1587036622 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd31c103f80 0x7fd31c10c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.641+0000 7fd320a16640 1 --2- 172.21.15.47:0/1587036622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd31c103660 0x7fd31c103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.641+0000 7fd320a16640 1 -- 172.21.15.47:0/1587036622 >> 172.21.15.47:0/1587036622 conn(0x7fd31c0fd0c0 msgr2=0x7fd31c0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.641+0000 7fd320a16640 1 -- 172.21.15.47:0/1587036622 shutdown_connections 2024-07-24T22:05:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.641+0000 7fd320a16640 1 -- 172.21.15.47:0/1587036622 wait complete. 2024-07-24T22:05:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.642+0000 7fd320a16640 1 Processor -- start 2024-07-24T22:05:56.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.642+0000 7fd320a16640 1 -- start start 2024-07-24T22:05:56.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.642+0000 7fd320a16640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd31c103660 0x7fd31c101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:56.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.642+0000 7fd320a16640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd31c103f80 0x7fd31c101850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:56.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.642+0000 7fd320a16640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd31c10cac0 0x7fd31c101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:56.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.642+0000 7fd320a16640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c112720 con 0x7fd31c103f80 2024-07-24T22:05:56.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.642+0000 7fd320a16640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c1125a0 con 0x7fd31c103660 2024-07-24T22:05:56.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.642+0000 7fd320a16640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c1128a0 con 0x7fd31c10cac0 2024-07-24T22:05:56.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.642+0000 7fd313fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd31c103f80 0x7fd31c101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:56.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.643+0000 7fd313fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd31c103f80 0x7fd31c101850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48802/0 (socket says 172.21.15.47:48802) 2024-07-24T22:05:56.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.643+0000 7fd313fff640 1 -- 172.21.15.47:0/3415393469 learned_addr learned my addr 172.21.15.47:0/3415393469 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:56.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.643+0000 7fd31a59c640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd31c103660 0x7fd31c101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:56.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.643+0000 7fd31ad9d640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd31c10cac0 0x7fd31c101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:56.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.643+0000 7fd313fff640 1 -- 172.21.15.47:0/3415393469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd31c10cac0 msgr2=0x7fd31c101d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:56.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.643+0000 7fd313fff640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd31c10cac0 0x7fd31c101d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:56.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.643+0000 7fd313fff640 1 -- 172.21.15.47:0/3415393469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd31c103660 msgr2=0x7fd31c101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:56.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.643+0000 7fd313fff640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd31c103660 0x7fd31c101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:56.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.643+0000 7fd313fff640 1 -- 172.21.15.47:0/3415393469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c1a7030 con 0x7fd31c103f80 2024-07-24T22:05:56.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.643+0000 7fd313fff640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd31c103f80 0x7fd31c101850 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd30400d750 tx=0x7fd30400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:56.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.646+0000 7fd3137fe640 1 -- 172.21.15.47:0/3415393469 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd304017070 con 0x7fd31c103f80 2024-07-24T22:05:56.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.646+0000 7fd3137fe640 1 -- 172.21.15.47:0/3415393469 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd304004020 con 0x7fd31c103f80 2024-07-24T22:05:56.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.646+0000 7fd3137fe640 1 -- 172.21.15.47:0/3415393469 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd304003c00 con 0x7fd31c103f80 2024-07-24T22:05:56.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.646+0000 7fd320a16640 1 -- 172.21.15.47:0/3415393469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c1a7320 con 0x7fd31c103f80 2024-07-24T22:05:56.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.646+0000 7fd320a16640 1 -- 172.21.15.47:0/3415393469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31c1a78b0 con 0x7fd31c103f80 2024-07-24T22:05:56.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.647+0000 7fd320a16640 1 -- 172.21.15.47:0/3415393469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31c103a40 con 0x7fd31c103f80 2024-07-24T22:05:56.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.648+0000 7fd3137fe640 1 -- 172.21.15.47:0/3415393469 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fd304009a30 con 0x7fd31c103f80 2024-07-24T22:05:56.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.649+0000 7fd3137fe640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd3080b3ca0 0x7fd3080b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:56.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.649+0000 7fd3137fe640 1 -- 172.21.15.47:0/3415393469 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fd3040e35b0 con 0x7fd31c103f80 2024-07-24T22:05:56.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.649+0000 7fd31a59c640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd3080b3ca0 0x7fd3080b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:56.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.650+0000 7fd31a59c640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd3080b3ca0 0x7fd3080b6160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd30c005fd0 tx=0x7fd30c00b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:56.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.653+0000 7fd3137fe640 1 -- 172.21.15.47:0/3415393469 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fd3040aa430 con 0x7fd31c103f80 2024-07-24T22:05:56.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.886+0000 7fd320a16640 1 -- 172.21.15.47:0/3415393469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd31c102610 con 0x7fd31c103f80 2024-07-24T22:05:56.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.887+0000 7fd3137fe640 1 -- 172.21.15.47:0/3415393469 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7fd3040ae980 con 0x7fd31c103f80 2024-07-24T22:05:56.889 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:05:56.889 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:05:56.889 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:05:56.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.889+0000 7fd320a16640 1 -- 172.21.15.47:0/3415393469 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd3080b3ca0 msgr2=0x7fd3080b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:56.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.889+0000 7fd320a16640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd3080b3ca0 0x7fd3080b6160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd30c005fd0 tx=0x7fd30c00b390 comp rx=0 tx=0).stop 2024-07-24T22:05:56.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.889+0000 7fd320a16640 1 -- 172.21.15.47:0/3415393469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd31c103f80 msgr2=0x7fd31c101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:56.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.889+0000 7fd320a16640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd31c103f80 0x7fd31c101850 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd30400d750 tx=0x7fd30400dc10 comp rx=0 tx=0).stop 2024-07-24T22:05:56.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.889+0000 7fd320a16640 1 -- 172.21.15.47:0/3415393469 shutdown_connections 2024-07-24T22:05:56.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.889+0000 7fd320a16640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd3080b3ca0 0x7fd3080b6160 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:56.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.889+0000 7fd320a16640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd31c10cac0 0x7fd31c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:56.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.889+0000 7fd320a16640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd31c103f80 0x7fd31c101850 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:56.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.889+0000 7fd320a16640 1 --2- 172.21.15.47:0/3415393469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd31c103660 0x7fd31c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:56.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.889+0000 7fd320a16640 1 -- 172.21.15.47:0/3415393469 >> 172.21.15.47:0/3415393469 conn(0x7fd31c0fd0c0 msgr2=0x7fd31c0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:56.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.889+0000 7fd320a16640 1 -- 172.21.15.47:0/3415393469 shutdown_connections 2024-07-24T22:05:56.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:56.889+0000 7fd320a16640 1 -- 172.21.15.47:0/3415393469 wait complete. 2024-07-24T22:05:57.664 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd dump --format=json 2024-07-24T22:05:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:57 smithi183 ceph-mon[37007]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:57 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3415393469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:05:57.930 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:05:57.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:57 smithi047 ceph-mon[32551]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:57.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:57 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3415393469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:05:58.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:57 smithi188 ceph-mon[37380]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:05:58.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:57 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3415393469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:05:59.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.590+0000 7f69a0168640 1 -- 172.21.15.47:0/1543698886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69981079e0 msgr2=0x7f699810e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:59.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.590+0000 7f69a0168640 1 --2- 172.21.15.47:0/1543698886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69981079e0 0x7f699810e1e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6990009900 tx=0x7f699002a410 comp rx=0 tx=0).stop 2024-07-24T22:05:59.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.590+0000 7f69a0168640 1 -- 172.21.15.47:0/1543698886 shutdown_connections 2024-07-24T22:05:59.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.590+0000 7f69a0168640 1 --2- 172.21.15.47:0/1543698886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69981079e0 0x7f699810e1e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.590+0000 7f69a0168640 1 --2- 172.21.15.47:0/1543698886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6998107060 0x7f69981074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.590+0000 7f69a0168640 1 --2- 172.21.15.47:0/1543698886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6998101650 0x7f6998101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.590+0000 7f69a0168640 1 -- 172.21.15.47:0/1543698886 >> 172.21.15.47:0/1543698886 conn(0x7f69980fd0c0 msgr2=0x7f69980ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.590+0000 7f69a0168640 1 -- 172.21.15.47:0/1543698886 shutdown_connections 2024-07-24T22:05:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.590+0000 7f69a0168640 1 -- 172.21.15.47:0/1543698886 wait complete. 2024-07-24T22:05:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.590+0000 7f69a0168640 1 Processor -- start 2024-07-24T22:05:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.590+0000 7f69a0168640 1 -- start start 2024-07-24T22:05:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f69a0168640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998101650 0x7f6998198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f69a0168640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6998107060 0x7f69981991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f69a0168640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69981079e0 0x7f699819e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f69a0168640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69981116b0 con 0x7f6998101650 2024-07-24T22:05:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f69a0168640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6998111530 con 0x7f69981079e0 2024-07-24T22:05:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f69a0168640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6998111830 con 0x7f6998107060 2024-07-24T22:05:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f699df04640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998101650 0x7f6998198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f699df04640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998101650 0x7f6998198c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48828/0 (socket says 172.21.15.47:48828) 2024-07-24T22:05:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f699df04640 1 -- 172.21.15.47:0/470724607 learned_addr learned my addr 172.21.15.47:0/470724607 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:05:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f699e705640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69981079e0 0x7f699819e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f699d703640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6998107060 0x7f69981991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f699df04640 1 -- 172.21.15.47:0/470724607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6998107060 msgr2=0x7f69981991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f699df04640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6998107060 0x7f69981991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f699df04640 1 -- 172.21.15.47:0/470724607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69981079e0 msgr2=0x7f699819e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f699df04640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69981079e0 0x7f699819e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f699df04640 1 -- 172.21.15.47:0/470724607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699819ed40 con 0x7f6998101650 2024-07-24T22:05:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f699e705640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69981079e0 0x7f699819e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:05:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f699d703640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6998107060 0x7f69981991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:05:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f699df04640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998101650 0x7f6998198c90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f698800d950 tx=0x7f698800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f6996ffd640 1 -- 172.21.15.47:0/470724607 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6988017070 con 0x7f6998101650 2024-07-24T22:05:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f6996ffd640 1 -- 172.21.15.47:0/470724607 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6988009c30 con 0x7f6998101650 2024-07-24T22:05:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.591+0000 7f69a0168640 1 -- 172.21.15.47:0/470724607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699819f030 con 0x7f6998101650 2024-07-24T22:05:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.592+0000 7f6996ffd640 1 -- 172.21.15.47:0/470724607 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698800f620 con 0x7f6998101650 2024-07-24T22:05:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.592+0000 7f69a0168640 1 -- 172.21.15.47:0/470724607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69981a5770 con 0x7f6998101650 2024-07-24T22:05:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.593+0000 7f69a0168640 1 -- 172.21.15.47:0/470724607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6998101a30 con 0x7f6998101650 2024-07-24T22:05:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.594+0000 7f6996ffd640 1 -- 172.21.15.47:0/470724607 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f6988010460 con 0x7f6998101650 2024-07-24T22:05:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.595+0000 7f6996ffd640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69800b3c20 0x7f69800b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:05:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.595+0000 7f699d703640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69800b3c20 0x7f69800b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:05:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.596+0000 7f6996ffd640 1 -- 172.21.15.47:0/470724607 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f69880e3a50 con 0x7f6998101650 2024-07-24T22:05:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.596+0000 7f699d703640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69800b3c20 0x7f69800b60e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f69981037a0 tx=0x7f698c0073c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:05:59.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.598+0000 7f6996ffd640 1 -- 172.21.15.47:0/470724607 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f69880aaf80 con 0x7f6998101650 2024-07-24T22:05:59.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.796+0000 7f69a0168640 1 -- 172.21.15.47:0/470724607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69981a5af0 con 0x7f6998101650 2024-07-24T22:05:59.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.797+0000 7f6996ffd640 1 -- 172.21.15.47:0/470724607 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23138 (secure 0 0 0) 0x7f6988009de0 con 0x7f6998101650 2024-07-24T22:05:59.799 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:05:59.799 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":85,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","created":"2024-07-24T21:55:28.945912+0000","modified":"2024-07-24T22:05:27.567637+0000","last_up_change":"2024-07-24T22:02:55.044691+0000","last_in_change":"2024-07-24T22:02:35.671256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T21:59:32.066678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T22:03:49.331120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T22:03:52.034826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60de2c3d-e4b7-4878-bdbb-ce3257e3706c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6803","nonce":2665889913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6805","nonce":2665889913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6809","nonce":2665889913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6807","nonce":2665889913}]},"public_addr":"172.21.15.47:6803/2665889913","cluster_addr":"172.21.15.47:6805/2665889913","heartbeat_back_addr":"172.21.15.47:6809/2665889913","heartbeat_front_addr":"172.21.15.47:6807/2665889913","state":["exists","up"]},{"osd":1,"uuid":"7f086675-3bed-47ca-a93f-fab9580068b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6801","nonce":3486494228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6803","nonce":3486494228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6807","nonce":3486494228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6805","nonce":3486494228}]},"public_addr":"172.21.15.183:6801/3486494228","cluster_addr":"172.21.15.183:6803/3486494228","heartbeat_back_addr":"172.21.15.183:6807/3486494228","heartbeat_front_addr":"172.21.15.183:6805/3486494228","state":["exists","up"]},{"osd":2,"uuid":"040fff27-6fa6-48de-9365-fcced8f89e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6801","nonce":2245903281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6803","nonce":2245903281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6807","nonce":2245903281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6805","nonce":2245903281}]},"public_addr":"172.21.15.188:6801/2245903281","cluster_addr":"172.21.15.188:6803/2245903281","heartbeat_back_addr":"172.21.15.188:6807/2245903281","heartbeat_front_addr":"172.21.15.188:6805/2245903281","state":["exists","up"]},{"osd":3,"uuid":"e129321a-9566-4bea-b982-34f7ddd1ae1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6811","nonce":236749130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6813","nonce":236749130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6817","nonce":236749130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6815","nonce":236749130}]},"public_addr":"172.21.15.47:6811/236749130","cluster_addr":"172.21.15.47:6813/236749130","heartbeat_back_addr":"172.21.15.47:6817/236749130","heartbeat_front_addr":"172.21.15.47:6815/236749130","state":["exists","up"]},{"osd":4,"uuid":"f969fba7-b0ff-4ea6-83bd-38aba32b1be1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6809","nonce":3978122107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6811","nonce":3978122107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6815","nonce":3978122107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6813","nonce":3978122107}]},"public_addr":"172.21.15.183:6809/3978122107","cluster_addr":"172.21.15.183:6811/3978122107","heartbeat_back_addr":"172.21.15.183:6815/3978122107","heartbeat_front_addr":"172.21.15.183:6813/3978122107","state":["exists","up"]},{"osd":5,"uuid":"3799c912-3d9f-4efd-9b36-569c385e4c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6809","nonce":2097128083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6811","nonce":2097128083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6815","nonce":2097128083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6813","nonce":2097128083}]},"public_addr":"172.21.15.188:6809/2097128083","cluster_addr":"172.21.15.188:6811/2097128083","heartbeat_back_addr":"172.21.15.188:6815/2097128083","heartbeat_front_addr":"172.21.15.188:6813/2097128083","state":["exists","up"]},{"osd":6,"uuid":"1a38cf12-619f-4e82-a7a5-21ee2014038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6819","nonce":2288252980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6821","nonce":2288252980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6825","nonce":2288252980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6823","nonce":2288252980}]},"public_addr":"172.21.15.47:6819/2288252980","cluster_addr":"172.21.15.47:6821/2288252980","heartbeat_back_addr":"172.21.15.47:6825/2288252980","heartbeat_front_addr":"172.21.15.47:6823/2288252980","state":["exists","up"]},{"osd":7,"uuid":"6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6817","nonce":465426514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6819","nonce":465426514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6823","nonce":465426514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6821","nonce":465426514}]},"public_addr":"172.21.15.183:6817/465426514","cluster_addr":"172.21.15.183:6819/465426514","heartbeat_back_addr":"172.21.15.183:6823/465426514","heartbeat_front_addr":"172.21.15.183:6821/465426514","state":["exists","up"]},{"osd":8,"uuid":"6dfd7252-61a6-423d-8498-cbcfa41ae1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6817","nonce":2247055658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6819","nonce":2247055658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6823","nonce":2247055658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6821","nonce":2247055658}]},"public_addr":"172.21.15.188:6817/2247055658","cluster_addr":"172.21.15.188:6819/2247055658","heartbeat_back_addr":"172.21.15.188:6823/2247055658","heartbeat_front_addr":"172.21.15.188:6821/2247055658","state":["exists","up"]},{"osd":9,"uuid":"abd93c5e-283e-4873-a241-1056f2894116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6827","nonce":2628721884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6829","nonce":2628721884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6833","nonce":2628721884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6831","nonce":2628721884}]},"public_addr":"172.21.15.47:6827/2628721884","cluster_addr":"172.21.15.47:6829/2628721884","heartbeat_back_addr":"172.21.15.47:6833/2628721884","heartbeat_front_addr":"172.21.15.47:6831/2628721884","state":["exists","up"]},{"osd":10,"uuid":"bc967f8f-ce27-4230-be70-e36927f89fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6825","nonce":3509332199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6827","nonce":3509332199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6831","nonce":3509332199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6829","nonce":3509332199}]},"public_addr":"172.21.15.183:6825/3509332199","cluster_addr":"172.21.15.183:6827/3509332199","heartbeat_back_addr":"172.21.15.183:6831/3509332199","heartbeat_front_addr":"172.21.15.183:6829/3509332199","state":["exists","up"]},{"osd":11,"uuid":"8b379865-3a5c-4a2d-aa74-a4f215027fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6825","nonce":3725107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6827","nonce":3725107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6831","nonce":3725107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6829","nonce":3725107101}]},"public_addr":"172.21.15.188:6825/3725107101","cluster_addr":"172.21.15.188:6827/3725107101","heartbeat_back_addr":"172.21.15.188:6831/3725107101","heartbeat_front_addr":"172.21.15.188:6829/3725107101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:58:44.413660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:06.554842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:28.651418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:50.995466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:13.906535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:36.632662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:59.003224+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:21.701327+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:44.017943+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:06.400895+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:29.625920+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:52.323223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3499235566":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/2112533111":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/2714360830":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/507334607":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6800/2524786594":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/1004458106":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6800/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/1046677443":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/899235864":"2024-07-25T21:56:15.044564+0000","172.21.15.47:6800/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/3057769442":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/2596054312":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6801/2524786594":"2024-07-25T21:57:25.995502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T22:05:59.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.799+0000 7f69a0168640 1 -- 172.21.15.47:0/470724607 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69800b3c20 msgr2=0x7f69800b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:59.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.799+0000 7f69a0168640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69800b3c20 0x7f69800b60e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f69981037a0 tx=0x7f698c0073c0 comp rx=0 tx=0).stop 2024-07-24T22:05:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.799+0000 7f69a0168640 1 -- 172.21.15.47:0/470724607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998101650 msgr2=0x7f6998198c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:05:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.799+0000 7f69a0168640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998101650 0x7f6998198c90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f698800d950 tx=0x7f698800de10 comp rx=0 tx=0).stop 2024-07-24T22:05:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.799+0000 7f69a0168640 1 -- 172.21.15.47:0/470724607 shutdown_connections 2024-07-24T22:05:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.799+0000 7f69a0168640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69800b3c20 0x7f69800b60e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.799+0000 7f69a0168640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69981079e0 0x7f699819e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.799+0000 7f69a0168640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6998107060 0x7f69981991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.799+0000 7f69a0168640 1 --2- 172.21.15.47:0/470724607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6998101650 0x7f6998198c90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:05:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.799+0000 7f69a0168640 1 -- 172.21.15.47:0/470724607 >> 172.21.15.47:0/470724607 conn(0x7f69980fd0c0 msgr2=0x7f699806a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:05:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.799+0000 7f69a0168640 1 -- 172.21.15.47:0/470724607 shutdown_connections 2024-07-24T22:05:59.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:05:59.799+0000 7f69a0168640 1 -- 172.21.15.47:0/470724607 wait complete. 2024-07-24T22:05:59.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:05:59 smithi183 ceph-mon[37007]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:05:59.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:05:59 smithi047 ceph-mon[32551]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:00.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:05:59 smithi188 ceph-mon[37380]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:00.568 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:06:00.842 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:00.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:00 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/470724607' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:06:00.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:00 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/470724607' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:06:01.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:00 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/470724607' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:06:01.857 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:01 smithi047 ceph-mon[32551]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:01.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:01 smithi183 ceph-mon[37007]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:02.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:01 smithi188 ceph-mon[37380]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:02.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.395+0000 7f1fcfa78640 1 -- 172.21.15.47:0/2572283520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fc8102790 msgr2=0x7f1fc8102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:02.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.395+0000 7f1fcfa78640 1 --2- 172.21.15.47:0/2572283520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fc8102790 0x7f1fc8102b70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009900 tx=0x7f1fc402a410 comp rx=0 tx=0).stop 2024-07-24T22:06:02.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.395+0000 7f1fcfa78640 1 -- 172.21.15.47:0/2572283520 shutdown_connections 2024-07-24T22:06:02.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.395+0000 7f1fcfa78640 1 --2- 172.21.15.47:0/2572283520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fc8108b20 0x7f1fc810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:02.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.395+0000 7f1fcfa78640 1 --2- 172.21.15.47:0/2572283520 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1fc81081a0 0x7f1fc81085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:02.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.395+0000 7f1fcfa78640 1 --2- 172.21.15.47:0/2572283520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fc8102790 0x7f1fc8102b70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:02.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.395+0000 7f1fcfa78640 1 -- 172.21.15.47:0/2572283520 >> 172.21.15.47:0/2572283520 conn(0x7f1fc80fe200 msgr2=0x7f1fc8100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.395+0000 7f1fcfa78640 1 -- 172.21.15.47:0/2572283520 shutdown_connections 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.395+0000 7f1fcfa78640 1 -- 172.21.15.47:0/2572283520 wait complete. 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fcfa78640 1 Processor -- start 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fcfa78640 1 -- start start 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fcfa78640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1fc8102790 0x7f1fc8074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fcfa78640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fc81081a0 0x7f1fc80753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fcfa78640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fc8108b20 0x7f1fc8075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fcfa78640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc8112720 con 0x7f1fc8108b20 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fcfa78640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc81125a0 con 0x7f1fc81081a0 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fcfa78640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc81128a0 con 0x7f1fc8102790 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fce015640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fc8108b20 0x7f1fc8075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fce015640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fc8108b20 0x7f1fc8075910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48842/0 (socket says 172.21.15.47:48842) 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fce015640 1 -- 172.21.15.47:0/3521353986 learned_addr learned my addr 172.21.15.47:0/3521353986 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fcd013640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fc81081a0 0x7f1fc80753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fcd814640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1fc8102790 0x7f1fc8074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fce015640 1 -- 172.21.15.47:0/3521353986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1fc8102790 msgr2=0x7f1fc8074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fce015640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1fc8102790 0x7f1fc8074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.396+0000 7f1fce015640 1 -- 172.21.15.47:0/3521353986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fc81081a0 msgr2=0x7f1fc80753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.397+0000 7f1fce015640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fc81081a0 0x7f1fc80753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.397+0000 7f1fce015640 1 -- 172.21.15.47:0/3521353986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc81a6fd0 con 0x7f1fc8108b20 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.397+0000 7f1fce015640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fc8108b20 0x7f1fc8075910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1fc000eaa0 tx=0x7f1fc000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.397+0000 7f1fbeffd640 1 -- 172.21.15.47:0/3521353986 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc000cdb0 con 0x7f1fc8108b20 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.397+0000 7f1fbeffd640 1 -- 172.21.15.47:0/3521353986 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fc0005020 con 0x7f1fc8108b20 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.397+0000 7f1fcfa78640 1 -- 172.21.15.47:0/3521353986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc81a72c0 con 0x7f1fc8108b20 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.397+0000 7f1fbeffd640 1 -- 172.21.15.47:0/3521353986 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00116d0 con 0x7f1fc8108b20 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.397+0000 7f1fcfa78640 1 -- 172.21.15.47:0/3521353986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc81a7800 con 0x7f1fc8108b20 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.398+0000 7f1fcfa78640 1 -- 172.21.15.47:0/3521353986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc8102b70 con 0x7f1fc8108b20 2024-07-24T22:06:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.399+0000 7f1fbeffd640 1 -- 172.21.15.47:0/3521353986 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f1fc00051d0 con 0x7f1fc8108b20 2024-07-24T22:06:02.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.401+0000 7f1fbeffd640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1fb40b3ca0 0x7f1fb40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:02.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.401+0000 7f1fcd814640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1fb40b3ca0 0x7f1fb40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:02.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.401+0000 7f1fbeffd640 1 -- 172.21.15.47:0/3521353986 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f1fc00e43f0 con 0x7f1fc8108b20 2024-07-24T22:06:02.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.401+0000 7f1fcd814640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1fb40b3ca0 0x7f1fb40b6160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4031440 tx=0x7f1fc40095f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:02.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.404+0000 7f1fbeffd640 1 -- 172.21.15.47:0/3521353986 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f1fc0016030 con 0x7f1fc8108b20 2024-07-24T22:06:02.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.637+0000 7f1fcfa78640 1 -- 172.21.15.47:0/3521353986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fc8076190 con 0x7f1fc8108b20 2024-07-24T22:06:02.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.638+0000 7f1fbeffd640 1 -- 172.21.15.47:0/3521353986 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f1fc8076190 con 0x7f1fc8108b20 2024-07-24T22:06:02.640 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:02.640 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:06:02.641 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:06:02.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.640+0000 7f1fcfa78640 1 -- 172.21.15.47:0/3521353986 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1fb40b3ca0 msgr2=0x7f1fb40b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:02.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.640+0000 7f1fcfa78640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1fb40b3ca0 0x7f1fb40b6160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4031440 tx=0x7f1fc40095f0 comp rx=0 tx=0).stop 2024-07-24T22:06:02.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.640+0000 7f1fcfa78640 1 -- 172.21.15.47:0/3521353986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fc8108b20 msgr2=0x7f1fc8075910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:02.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.640+0000 7f1fcfa78640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fc8108b20 0x7f1fc8075910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1fc000eaa0 tx=0x7f1fc000ef60 comp rx=0 tx=0).stop 2024-07-24T22:06:02.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.640+0000 7f1fcfa78640 1 -- 172.21.15.47:0/3521353986 shutdown_connections 2024-07-24T22:06:02.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.640+0000 7f1fcfa78640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1fb40b3ca0 0x7f1fb40b6160 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:02.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.640+0000 7f1fcfa78640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fc8108b20 0x7f1fc8075910 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:02.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.640+0000 7f1fcfa78640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fc81081a0 0x7f1fc80753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:02.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.640+0000 7f1fcfa78640 1 --2- 172.21.15.47:0/3521353986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1fc8102790 0x7f1fc8074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:02.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.640+0000 7f1fcfa78640 1 -- 172.21.15.47:0/3521353986 >> 172.21.15.47:0/3521353986 conn(0x7f1fc80fe200 msgr2=0x7f1fc80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:02.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.640+0000 7f1fcfa78640 1 -- 172.21.15.47:0/3521353986 shutdown_connections 2024-07-24T22:06:02.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:02.640+0000 7f1fcfa78640 1 -- 172.21.15.47:0/3521353986 wait complete. 2024-07-24T22:06:02.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:02 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3521353986' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:02.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:02 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3521353986' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:03.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:02 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3521353986' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:03.253 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-07-24T22:03:54.960171+0000', 'modified': '2024-07-24T22:04:10.197477+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24628}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24610': {'gid': 24610, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.188:6837/749102233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6836', 'nonce': 749102233}, {'type': 'v1', 'addr': '172.21.15.188:6837', 'nonce': 749102233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24628': {'gid': 24628, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.188:6839/3781670075', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6838', 'nonce': 3781670075}, {'type': 'v1', 'addr': '172.21.15.188:6839', 'nonce': 3781670075}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24628, 'qdb_cluster': [24628]} 2024-07-24T22:06:03.253 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-07-24T22:06:03.254 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.i status 2024-07-24T22:06:03.524 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:03.898 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:03 smithi047 ceph-mon[32551]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:04.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:03 smithi188 ceph-mon[37380]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:04.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:03 smithi183 ceph-mon[37007]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:05.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.148+0000 7fb329cf5640 1 -- 172.21.15.47:0/2112216556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb324101210 msgr2=0x7fb3241015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:05.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.148+0000 7fb329cf5640 1 --2- 172.21.15.47:0/2112216556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb324101210 0x7fb3241015f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb314009900 tx=0x7fb31402a410 comp rx=0 tx=0).stop 2024-07-24T22:06:05.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.148+0000 7fb329cf5640 1 -- 172.21.15.47:0/2112216556 shutdown_connections 2024-07-24T22:06:05.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.148+0000 7fb329cf5640 1 --2- 172.21.15.47:0/2112216556 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb32410edc0 0x7fb3241111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.148+0000 7fb329cf5640 1 --2- 172.21.15.47:0/2112216556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb324101b30 0x7fb32410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.148+0000 7fb329cf5640 1 --2- 172.21.15.47:0/2112216556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb324101210 0x7fb3241015f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.148+0000 7fb329cf5640 1 -- 172.21.15.47:0/2112216556 >> 172.21.15.47:0/2112216556 conn(0x7fb3240fd0c0 msgr2=0x7fb3240ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.148+0000 7fb329cf5640 1 -- 172.21.15.47:0/2112216556 shutdown_connections 2024-07-24T22:06:05.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.148+0000 7fb329cf5640 1 -- 172.21.15.47:0/2112216556 wait complete. 2024-07-24T22:06:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.149+0000 7fb329cf5640 1 Processor -- start 2024-07-24T22:06:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.149+0000 7fb329cf5640 1 -- start start 2024-07-24T22:06:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.149+0000 7fb329cf5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb324101210 0x7fb32419aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.149+0000 7fb329cf5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb324101b30 0x7fb32419b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.149+0000 7fb329cf5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb32410edc0 0x7fb3241a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.149+0000 7fb329cf5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb324114940 con 0x7fb324101210 2024-07-24T22:06:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.149+0000 7fb329cf5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb3241147c0 con 0x7fb32410edc0 2024-07-24T22:06:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.149+0000 7fb329cf5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb324114ac0 con 0x7fb324101b30 2024-07-24T22:06:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.149+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb324101210 0x7fb32419aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.149+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb324101210 0x7fb32419aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35690/0 (socket says 172.21.15.47:35690) 2024-07-24T22:06:05.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.149+0000 7fb3237fe640 1 -- 172.21.15.47:0/343088442 learned_addr learned my addr 172.21.15.47:0/343088442 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.150+0000 7fb323fff640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb32410edc0 0x7fb3241a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.150+0000 7fb31affd640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb324101b30 0x7fb32419b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.150+0000 7fb3237fe640 1 -- 172.21.15.47:0/343088442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb324101b30 msgr2=0x7fb32419b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.150+0000 7fb3237fe640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb324101b30 0x7fb32419b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.150+0000 7fb3237fe640 1 -- 172.21.15.47:0/343088442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb32410edc0 msgr2=0x7fb3241a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.150+0000 7fb3237fe640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb32410edc0 0x7fb3241a07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.150+0000 7fb3237fe640 1 -- 172.21.15.47:0/343088442 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3241a0fa0 con 0x7fb324101210 2024-07-24T22:06:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.150+0000 7fb31affd640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb324101b30 0x7fb32419b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:06:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.150+0000 7fb323fff640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb32410edc0 0x7fb3241a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:06:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.150+0000 7fb3237fe640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb324101210 0x7fb32419aef0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb314005940 tx=0x7fb314004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.150+0000 7fb3217fa640 1 -- 172.21.15.47:0/343088442 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31403f030 con 0x7fb324101210 2024-07-24T22:06:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.151+0000 7fb329cf5640 1 -- 172.21.15.47:0/343088442 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3241a1230 con 0x7fb324101210 2024-07-24T22:06:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.151+0000 7fb3217fa640 1 -- 172.21.15.47:0/343088442 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb314003aa0 con 0x7fb324101210 2024-07-24T22:06:05.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.151+0000 7fb329cf5640 1 -- 172.21.15.47:0/343088442 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3241a7950 con 0x7fb324101210 2024-07-24T22:06:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.151+0000 7fb3217fa640 1 -- 172.21.15.47:0/343088442 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314035070 con 0x7fb324101210 2024-07-24T22:06:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.153+0000 7fb3217fa640 1 -- 172.21.15.47:0/343088442 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fb314042030 con 0x7fb324101210 2024-07-24T22:06:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.153+0000 7fb32c0a6740 1 Processor -- start 2024-07-24T22:06:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb32c0a6740 1 -- start start 2024-07-24T22:06:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb32c0a6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d22b80 0x562568d210e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb32c0a6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 0x562568d21a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb32c0a6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 0x562568d2f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb32c0a6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562568c97740 con 0x562568d21620 2024-07-24T22:06:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb32c0a6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562568c86c40 con 0x562568d2d450 2024-07-24T22:06:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb32c0a6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562568c8ac80 con 0x562568d22b80 2024-07-24T22:06:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 0x562568d21a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 0x562568d21a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35704/0 (socket says 172.21.15.47:35704) 2024-07-24T22:06:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb3237fe640 1 -- 172.21.15.47:0/2040546050 learned_addr learned my addr 172.21.15.47:0/2040546050 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:05.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb31affd640 1 --2- 172.21.15.47:0/2040546050 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 0x562568d2f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb323fff640 1 --2- 172.21.15.47:0/2040546050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d22b80 0x562568d210e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb3237fe640 1 -- 172.21.15.47:0/2040546050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d22b80 msgr2=0x562568d210e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:05.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb3237fe640 1 --2- 172.21.15.47:0/2040546050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d22b80 0x562568d210e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb3217fa640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb3100b3c20 0x7fb3100b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb3237fe640 1 -- 172.21.15.47:0/2040546050 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 msgr2=0x562568d2f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb3237fe640 1 --2- 172.21.15.47:0/2040546050 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 0x562568d2f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb3237fe640 1 -- 172.21.15.47:0/2040546050 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562568c101f0 con 0x562568d21620 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.154+0000 7fb323fff640 1 --2- 172.21.15.47:0/2040546050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d22b80 0x562568d210e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.155+0000 7fb323fff640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb3100b3c20 0x7fb3100b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.155+0000 7fb3217fa640 1 -- 172.21.15.47:0/343088442 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb3141041c0 con 0x7fb324101210 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.155+0000 7fb3237fe640 1 --2- 172.21.15.47:0/2040546050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 0x562568d21a40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb31407e4d0 tx=0x7fb31404b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa5d173ce1f30f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.155+0000 7fb319ffb640 1 -- 172.21.15.47:0/2040546050 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140cae70 con 0x562568d21620 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.155+0000 7fb319ffb640 1 -- 172.21.15.47:0/2040546050 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3140cabb0 con 0x562568d21620 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.155+0000 7fb323fff640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb3100b3c20 0x7fb3100b60e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0092f0 tx=0x7fb31c009600 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.155+0000 7fb319ffb640 1 -- 172.21.15.47:0/2040546050 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140ca810 con 0x562568d21620 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.156+0000 7fb32c0a6740 1 -- 172.21.15.47:0/2040546050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 msgr2=0x562568d21a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.156+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/2040546050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 0x562568d21a40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb31407e4d0 tx=0x7fb31404b000 comp rx=0 tx=0).stop 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.156+0000 7fb32c0a6740 1 -- 172.21.15.47:0/2040546050 shutdown_connections 2024-07-24T22:06:05.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.156+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/2040546050 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 0x562568d2f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.156+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/2040546050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 0x562568d21a40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.156+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/2040546050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d22b80 0x562568d210e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.156+0000 7fb32c0a6740 1 -- 172.21.15.47:0/2040546050 >> 172.21.15.47:0/2040546050 conn(0x562568cbf6c0 msgr2=0x562568d1ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:05.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.156+0000 7fb32c0a6740 1 -- 172.21.15.47:0/2040546050 shutdown_connections 2024-07-24T22:06:05.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.156+0000 7fb32c0a6740 1 -- 172.21.15.47:0/2040546050 wait complete. 2024-07-24T22:06:05.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.156+0000 7fb32c0a6740 1 -- start start 2024-07-24T22:06:05.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.157+0000 7fb32c0a6740 1 Processor -- start 2024-07-24T22:06:05.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.157+0000 7fb32c0a6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d21620 0x562568d2cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.157+0000 7fb32c0a6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d22b80 0x562568d2a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.157+0000 7fb32c0a6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 0x562568d2a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.157+0000 7fb32c0a6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562568aea5f0 con 0x562568d22b80 2024-07-24T22:06:05.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.157+0000 7fb31affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d22b80 0x562568d2a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.157+0000 7fb31affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d22b80 0x562568d2a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35708/0 (socket says 172.21.15.47:35708) 2024-07-24T22:06:05.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.157+0000 7fb32c0a6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562568c294c0 con 0x562568d2d450 2024-07-24T22:06:05.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.157+0000 7fb31affd640 1 -- 172.21.15.47:0/493862288 learned_addr learned my addr 172.21.15.47:0/493862288 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:05.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.157+0000 7fb32c0a6740 1 -- 172.21.15.47:0/493862288 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562568d30030 con 0x562568d21620 2024-07-24T22:06:05.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.157+0000 7fb32c0a6740 10 client.0 _ll_register_callbacks cb 0x562568c7f0c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:06:05.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.157+0000 7fb3237fe640 1 --2- 172.21.15.47:0/493862288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d21620 0x562568d2cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.157+0000 7fb323fff640 1 --2- 172.21.15.47:0/493862288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 0x562568d2a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb31affd640 1 -- 172.21.15.47:0/493862288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d21620 msgr2=0x562568d2cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:05.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb31affd640 1 --2- 172.21.15.47:0/493862288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d21620 0x562568d2cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb31affd640 1 -- 172.21.15.47:0/493862288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 msgr2=0x562568d2a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:05.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb31affd640 1 --2- 172.21.15.47:0/493862288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 0x562568d2a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb31affd640 1 -- 172.21.15.47:0/493862288 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562568c1c550 con 0x562568d22b80 2024-07-24T22:06:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb31affd640 1 --2- 172.21.15.47:0/493862288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d22b80 0x562568d2a060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb30c012d20 tx=0x7fb30c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22995a73799de6ad server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb302ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:06:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb302ffd640 1 -- 172.21.15.47:0/493862288 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c012110 con 0x562568d22b80 2024-07-24T22:06:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb302ffd640 1 -- 172.21.15.47:0/493862288 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb30c004050 con 0x562568d22b80 2024-07-24T22:06:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb32c0a6740 1 -- 172.21.15.47:0/493862288 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3140cabb0 con 0x562568d22b80 2024-07-24T22:06:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb302ffd640 1 -- 172.21.15.47:0/493862288 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb30c0122b0 con 0x562568d22b80 2024-07-24T22:06:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb32c0a6740 10 client.15129 fetch_fsmap learned FSMap version 20 2024-07-24T22:06:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb32c0a6740 1 -- 172.21.15.47:0/493862288 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5625689e7540 con 0x562568d22b80 2024-07-24T22:06:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.158+0000 7fb302ffd640 1 -- 172.21.15.47:0/493862288 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3140cabb0 con 0x562568d22b80 2024-07-24T22:06:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.159+0000 7fb302ffd640 1 -- 172.21.15.47:0/493862288 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb30c010430 con 0x562568d22b80 2024-07-24T22:06:05.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.159+0000 7fb32c0a6740 10 client.15129 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:06:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.159+0000 7fb32c0a6740 10 client.15129 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-24T22:06:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.159+0000 7fb32c0a6740 20 client.15129 populate_metadata read hostname 'smithi047' 2024-07-24T22:06:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.159+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/493862288 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562568d3dbd0 0x562568d3f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.159+0000 7fb32c0a6740 4 client.15129 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:06:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.159+0000 7fb32c0a6740 1 -- 172.21.15.47:0/493862288 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562568c99690 con 0x562568d3dbd0 2024-07-24T22:06:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.159+0000 7fb3237fe640 1 --2- 172.21.15.47:0/493862288 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562568d3dbd0 0x562568d3f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.160+0000 7fb3237fe640 1 --2- 172.21.15.47:0/493862288 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562568d3dbd0 0x562568d3f040 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16ad73034ffe626d server_cookie=11b1a56504fcd1ff in_seq=0 out_seq=0 2024-07-24T22:06:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.160+0000 7fb302ffd640 10 client.15129 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:06:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.160+0000 7fb302ffd640 1 -- 172.21.15.47:0/493862288 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562568c99690 con 0x562568d3dbd0 2024-07-24T22:06:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.160+0000 7fb302ffd640 10 client.15129 handle_command_reply: tid=0 2024-07-24T22:06:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.160+0000 7fb32c0a6740 1 client.15129 shutdown 2024-07-24T22:06:05.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.161+0000 7fb32c0a6740 1 -- 172.21.15.47:0/493862288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d22b80 msgr2=0x562568d2a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:05.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.161+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/493862288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d22b80 0x562568d2a060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb30c012d20 tx=0x7fb30c00f790 comp rx=0 tx=0).stop 2024-07-24T22:06:05.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.161+0000 7fb32c0a6740 1 -- 172.21.15.47:0/493862288 shutdown_connections 2024-07-24T22:06:05.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.161+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/493862288 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562568d3dbd0 0x562568d3f040 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.161+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/493862288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 0x562568d2a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.161+0000 7fb302ffd640 0 client.15129 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:06:05.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.161+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/493862288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d22b80 0x562568d2a060 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.161+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/493862288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d21620 0x562568d2cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.161+0000 7fb32c0a6740 1 -- 172.21.15.47:0/493862288 >> 172.21.15.47:0/493862288 conn(0x562568cbf6c0 msgr2=0x562568d24ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:05.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.161+0000 7fb32c0a6740 1 -- 172.21.15.47:0/493862288 shutdown_connections 2024-07-24T22:06:05.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.161+0000 7fb32c0a6740 1 -- 172.21.15.47:0/493862288 wait complete. 2024-07-24T22:06:05.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.161+0000 7fb32c0a6740 20 client.15129 trim_cache size 0 max 16384 2024-07-24T22:06:05.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.180+0000 7fb32c0a6740 1 Processor -- start 2024-07-24T22:06:05.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.180+0000 7fb32c0a6740 1 -- start start 2024-07-24T22:06:05.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.180+0000 7fb32c0a6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 0x562568d25400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.180+0000 7fb32c0a6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d22b80 0x562568d20d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.180+0000 7fb32c0a6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 0x562568d2a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.180+0000 7fb32c0a6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562568d3d380 con 0x562568d21620 2024-07-24T22:06:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.180+0000 7fb32c0a6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562568d3da50 con 0x562568d2d450 2024-07-24T22:06:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.180+0000 7fb32c0a6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562568d3e120 con 0x562568d22b80 2024-07-24T22:06:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 0x562568d25400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 0x562568d25400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35710/0 (socket says 172.21.15.47:35710) 2024-07-24T22:06:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb3237fe640 1 -- 172.21.15.47:0/3196767716 learned_addr learned my addr 172.21.15.47:0/3196767716 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb31affd640 1 --2- 172.21.15.47:0/3196767716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d22b80 0x562568d20d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb323fff640 1 --2- 172.21.15.47:0/3196767716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 0x562568d2a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb3237fe640 1 -- 172.21.15.47:0/3196767716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d22b80 msgr2=0x562568d20d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb3237fe640 1 --2- 172.21.15.47:0/3196767716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d22b80 0x562568d20d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb3237fe640 1 -- 172.21.15.47:0/3196767716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 msgr2=0x562568d2a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb3237fe640 1 --2- 172.21.15.47:0/3196767716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 0x562568d2a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb3237fe640 1 -- 172.21.15.47:0/3196767716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562568d2fbb0 con 0x562568d21620 2024-07-24T22:06:05.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb323fff640 1 --2- 172.21.15.47:0/3196767716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 0x562568d2a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:06:05.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb3237fe640 1 --2- 172.21.15.47:0/3196767716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 0x562568d25400 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb314006010 tx=0x7fb314005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92826b28968b1508 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:05.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb3197fa640 1 -- 172.21.15.47:0/3196767716 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314049040 con 0x562568d21620 2024-07-24T22:06:05.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb3197fa640 1 -- 172.21.15.47:0/3196767716 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb314107c80 con 0x562568d21620 2024-07-24T22:06:05.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.181+0000 7fb3197fa640 1 -- 172.21.15.47:0/3196767716 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140ca9f0 con 0x562568d21620 2024-07-24T22:06:05.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.182+0000 7fb32c0a6740 1 -- 172.21.15.47:0/3196767716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 msgr2=0x562568d25400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:05.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.182+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/3196767716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 0x562568d25400 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb314006010 tx=0x7fb314005c90 comp rx=0 tx=0).stop 2024-07-24T22:06:05.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.182+0000 7fb32c0a6740 1 -- 172.21.15.47:0/3196767716 shutdown_connections 2024-07-24T22:06:05.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.182+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/3196767716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d2d450 0x562568d2a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.182+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/3196767716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d22b80 0x562568d20d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.182+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/3196767716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d21620 0x562568d25400 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.182+0000 7fb32c0a6740 1 -- 172.21.15.47:0/3196767716 >> 172.21.15.47:0/3196767716 conn(0x562568cbf6c0 msgr2=0x562568d2bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.182+0000 7fb32c0a6740 1 -- 172.21.15.47:0/3196767716 shutdown_connections 2024-07-24T22:06:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.182+0000 7fb32c0a6740 1 -- 172.21.15.47:0/3196767716 wait complete. 2024-07-24T22:06:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.183+0000 7fb32c0a6740 1 -- start start 2024-07-24T22:06:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.183+0000 7fb32c0a6740 1 Processor -- start 2024-07-24T22:06:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.183+0000 7fb32c0a6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d21620 0x562568d47aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.183+0000 7fb32c0a6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d22b80 0x562568d27380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.183+0000 7fb32c0a6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d2d450 0x562568d279b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.183+0000 7fb32c0a6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562568d3eec0 con 0x562568d2d450 2024-07-24T22:06:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.183+0000 7fb32c0a6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562568d3e7f0 con 0x562568d22b80 2024-07-24T22:06:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.183+0000 7fb32c0a6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562568d3f590 con 0x562568d21620 2024-07-24T22:06:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.183+0000 7fb32c0a6740 10 client.0 _ll_register_callbacks cb 0x7fb30c009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:06:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.183+0000 7fb323fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d2d450 0x562568d279b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb323fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d2d450 0x562568d279b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35718/0 (socket says 172.21.15.47:35718) 2024-07-24T22:06:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb3237fe640 1 --2- 172.21.15.47:0/3263423174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d21620 0x562568d47aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb323fff640 1 -- 172.21.15.47:0/3263423174 learned_addr learned my addr 172.21.15.47:0/3263423174 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb31affd640 1 --2- 172.21.15.47:0/3263423174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d22b80 0x562568d27380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb3237fe640 1 -- 172.21.15.47:0/3263423174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d22b80 msgr2=0x562568d27380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb3237fe640 1 --2- 172.21.15.47:0/3263423174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d22b80 0x562568d27380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb3237fe640 1 -- 172.21.15.47:0/3263423174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d2d450 msgr2=0x562568d279b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb3237fe640 1 --2- 172.21.15.47:0/3263423174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d2d450 0x562568d279b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb3237fe640 1 -- 172.21.15.47:0/3263423174 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562568d44950 con 0x562568d21620 2024-07-24T22:06:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb3237fe640 1 --2- 172.21.15.47:0/3263423174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d21620 0x562568d47aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb314101f10 tx=0x7fb3140cf490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8439254576c5420 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb302ffd640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:06:05.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb302ffd640 1 -- 172.21.15.47:0/3263423174 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140e5060 con 0x562568d21620 2024-07-24T22:06:05.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb302ffd640 1 -- 172.21.15.47:0/3263423174 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb3140cb300 con 0x562568d21620 2024-07-24T22:06:05.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.184+0000 7fb32c0a6740 1 -- 172.21.15.47:0/3263423174 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb314107c80 con 0x562568d21620 2024-07-24T22:06:05.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.185+0000 7fb302ffd640 1 -- 172.21.15.47:0/3263423174 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb314049050 con 0x562568d21620 2024-07-24T22:06:05.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.185+0000 7fb32c0a6740 10 client.24874 fetch_fsmap learned FSMap version 20 2024-07-24T22:06:05.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.185+0000 7fb32c0a6740 1 -- 172.21.15.47:0/3263423174 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562568da8570 con 0x562568d21620 2024-07-24T22:06:05.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.185+0000 7fb302ffd640 1 -- 172.21.15.47:0/3263423174 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb314107c80 con 0x562568d21620 2024-07-24T22:06:05.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.185+0000 7fb302ffd640 1 -- 172.21.15.47:0/3263423174 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb3140d3c10 con 0x562568d21620 2024-07-24T22:06:05.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.185+0000 7fb32c0a6740 10 client.24874 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:06:05.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.185+0000 7fb32c0a6740 10 client.24874 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-24T22:06:05.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.185+0000 7fb32c0a6740 20 client.24874 populate_metadata read hostname 'smithi047' 2024-07-24T22:06:05.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.185+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/3263423174 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562568d3dbd0 0x562568dab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:05.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.185+0000 7fb32c0a6740 4 client.24874 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-24T22:06:05.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.185+0000 7fb32c0a6740 1 -- 172.21.15.47:0/3263423174 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "status"}) -- 0x562568c95130 con 0x562568d3dbd0 2024-07-24T22:06:05.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.185+0000 7fb31affd640 1 --2- 172.21.15.47:0/3263423174 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562568d3dbd0 0x562568dab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:05.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb31affd640 1 --2- 172.21.15.47:0/3263423174 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562568d3dbd0 0x562568dab8f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d0949eba58381a8 server_cookie=33a284f39703c126 in_seq=0 out_seq=0 2024-07-24T22:06:05.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb302ffd640 10 client.24874 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:06:05.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb302ffd640 1 -- 172.21.15.47:0/3263423174 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562568c95130 con 0x562568d3dbd0 2024-07-24T22:06:05.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb302ffd640 10 client.24874 handle_command_reply: tid=0 2024-07-24T22:06:05.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb32c0a6740 1 client.24874 shutdown 2024-07-24T22:06:05.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb32c0a6740 1 -- 172.21.15.47:0/3263423174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d21620 msgr2=0x562568d47aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:05.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/3263423174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d21620 0x562568d47aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb314101f10 tx=0x7fb3140cf490 comp rx=0 tx=0).stop 2024-07-24T22:06:05.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb32c0a6740 1 -- 172.21.15.47:0/3263423174 shutdown_connections 2024-07-24T22:06:05.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/3263423174 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562568d3dbd0 0x562568dab8f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/3263423174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562568d2d450 0x562568d279b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/3263423174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562568d22b80 0x562568d27380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb32c0a6740 1 --2- 172.21.15.47:0/3263423174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562568d21620 0x562568d47aa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb302ffd640 0 client.24874 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:06:05.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb32c0a6740 1 -- 172.21.15.47:0/3263423174 >> 172.21.15.47:0/3263423174 conn(0x562568cbf6c0 msgr2=0x562568d2b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:05.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb32c0a6740 1 -- 172.21.15.47:0/3263423174 shutdown_connections 2024-07-24T22:06:05.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb32c0a6740 1 -- 172.21.15.47:0/3263423174 wait complete. 2024-07-24T22:06:05.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.186+0000 7fb32c0a6740 20 client.24874 trim_cache size 0 max 16384 2024-07-24T22:06:05.193 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:06:05.193 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "46bf760a-4a07-11ef-bcad-c7b262605968", 2024-07-24T22:06:05.193 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-07-24T22:06:05.194 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24628, 2024-07-24T22:06:05.194 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-07-24T22:06:05.194 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-07-24T22:06:05.194 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-07-24T22:06:05.194 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 129.784575816, 2024-07-24T22:06:05.194 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 20, 2024-07-24T22:06:05.194 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 85, 2024-07-24T22:06:05.194 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 81, 2024-07-24T22:06:05.194 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 155.10609346300001 2024-07-24T22:06:05.194 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:06:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.187+0000 7fb329cf5640 1 -- 172.21.15.47:0/343088442 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb3100b3c20 msgr2=0x7fb3100b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.187+0000 7fb329cf5640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb3100b3c20 0x7fb3100b60e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0092f0 tx=0x7fb31c009600 comp rx=0 tx=0).stop 2024-07-24T22:06:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.187+0000 7fb329cf5640 1 -- 172.21.15.47:0/343088442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb324101210 msgr2=0x7fb32419aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.187+0000 7fb329cf5640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb324101210 0x7fb32419aef0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb314005940 tx=0x7fb314004270 comp rx=0 tx=0).stop 2024-07-24T22:06:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.187+0000 7fb329cf5640 1 -- 172.21.15.47:0/343088442 shutdown_connections 2024-07-24T22:06:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.187+0000 7fb329cf5640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb3100b3c20 0x7fb3100b60e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.187+0000 7fb329cf5640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb32410edc0 0x7fb3241a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.187+0000 7fb329cf5640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb324101b30 0x7fb32419b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.187+0000 7fb329cf5640 1 --2- 172.21.15.47:0/343088442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb324101210 0x7fb32419aef0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:05.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.187+0000 7fb329cf5640 1 -- 172.21.15.47:0/343088442 >> 172.21.15.47:0/343088442 conn(0x7fb3240fd0c0 msgr2=0x7fb3240ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:05.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.187+0000 7fb329cf5640 1 -- 172.21.15.47:0/343088442 shutdown_connections 2024-07-24T22:06:05.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:05.187+0000 7fb329cf5640 1 -- 172.21.15.47:0/343088442 wait complete. 2024-07-24T22:06:05.892 INFO:tasks.cephadm:Setup complete, yielding 2024-07-24T22:06:05.892 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-07-24T22:06:05.902 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-07-24T22:06:05.902 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- bash -c 'ceph orch status' 2024-07-24T22:06:05.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:05 smithi047 ceph-mon[32551]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:06.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:05 smithi188 ceph-mon[37380]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:06.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:05 smithi183 ceph-mon[37007]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:06.173 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:07.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.875+0000 7fa0c156c640 1 -- 172.21.15.47:0/1406422739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0bc107090 msgr2=0x7fa0bc1074d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:07.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.875+0000 7fa0c156c640 1 --2- 172.21.15.47:0/1406422739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0bc107090 0x7fa0bc1074d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009900 tx=0x7fa0a402a410 comp rx=0 tx=0).stop 2024-07-24T22:06:07.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.875+0000 7fa0c156c640 1 -- 172.21.15.47:0/1406422739 shutdown_connections 2024-07-24T22:06:07.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.875+0000 7fa0c156c640 1 --2- 172.21.15.47:0/1406422739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0bc107a10 0x7fa0bc10e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.875+0000 7fa0c156c640 1 --2- 172.21.15.47:0/1406422739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0bc107090 0x7fa0bc1074d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.875+0000 7fa0c156c640 1 --2- 172.21.15.47:0/1406422739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0bc101680 0x7fa0bc101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.875+0000 7fa0c156c640 1 -- 172.21.15.47:0/1406422739 >> 172.21.15.47:0/1406422739 conn(0x7fa0bc0fd0d0 msgr2=0x7fa0bc0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.875+0000 7fa0c156c640 1 -- 172.21.15.47:0/1406422739 shutdown_connections 2024-07-24T22:06:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0c156c640 1 -- 172.21.15.47:0/1406422739 wait complete. 2024-07-24T22:06:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0c156c640 1 Processor -- start 2024-07-24T22:06:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0c156c640 1 -- start start 2024-07-24T22:06:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0c156c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0bc101680 0x7fa0bc198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0c156c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0bc107090 0x7fa0bc1994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0c156c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0bc107a10 0x7fa0bc19e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0c156c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc111610 con 0x7fa0bc107090 2024-07-24T22:06:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0c156c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc111490 con 0x7fa0bc101680 2024-07-24T22:06:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0c156c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc111790 con 0x7fa0bc107a10 2024-07-24T22:06:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0bc107090 0x7fa0bc1994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0baffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0bc101680 0x7fa0bc198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0bc107090 0x7fa0bc1994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35740/0 (socket says 172.21.15.47:35740) 2024-07-24T22:06:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0baffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0bc101680 0x7fa0bc198f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:49218/0 (socket says 172.21.15.47:49218) 2024-07-24T22:06:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.876+0000 7fa0b3fff640 1 -- 172.21.15.47:0/1192452299 learned_addr learned my addr 172.21.15.47:0/1192452299 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.877+0000 7fa0bb7fe640 1 --2- 172.21.15.47:0/1192452299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0bc107a10 0x7fa0bc19e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.877+0000 7fa0baffd640 1 -- 172.21.15.47:0/1192452299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0bc107a10 msgr2=0x7fa0bc19e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.877+0000 7fa0baffd640 1 --2- 172.21.15.47:0/1192452299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0bc107a10 0x7fa0bc19e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.877+0000 7fa0baffd640 1 -- 172.21.15.47:0/1192452299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0bc107090 msgr2=0x7fa0bc1994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.877+0000 7fa0baffd640 1 --2- 172.21.15.47:0/1192452299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0bc107090 0x7fa0bc1994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:07.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.877+0000 7fa0baffd640 1 -- 172.21.15.47:0/1192452299 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0bc19f040 con 0x7fa0bc101680 2024-07-24T22:06:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.877+0000 7fa0baffd640 1 --2- 172.21.15.47:0/1192452299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0bc101680 0x7fa0bc198f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00e9f0 tx=0x7fa0ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.877+0000 7fa0b8ff9640 1 -- 172.21.15.47:0/1192452299 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac00ccc0 con 0x7fa0bc101680 2024-07-24T22:06:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.877+0000 7fa0b8ff9640 1 -- 172.21.15.47:0/1192452299 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0ac0108e0 con 0x7fa0bc101680 2024-07-24T22:06:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.877+0000 7fa0c156c640 1 -- 172.21.15.47:0/1192452299 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0bc19f330 con 0x7fa0bc101680 2024-07-24T22:06:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.877+0000 7fa0b8ff9640 1 -- 172.21.15.47:0/1192452299 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac018880 con 0x7fa0bc101680 2024-07-24T22:06:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.877+0000 7fa0c156c640 1 -- 172.21.15.47:0/1192452299 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0bc1a59f0 con 0x7fa0bc101680 2024-07-24T22:06:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.878+0000 7fa0c156c640 1 -- 172.21.15.47:0/1192452299 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0bc101a60 con 0x7fa0bc101680 2024-07-24T22:06:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.880+0000 7fa0b8ff9640 1 -- 172.21.15.47:0/1192452299 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fa0ac010430 con 0x7fa0bc101680 2024-07-24T22:06:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.880+0000 7fa0b8ff9640 1 --2- 172.21.15.47:0/1192452299 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0a80b3c20 0x7fa0a80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.881+0000 7fa0b3fff640 1 --2- 172.21.15.47:0/1192452299 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0a80b3c20 0x7fa0a80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.881+0000 7fa0b8ff9640 1 -- 172.21.15.47:0/1192452299 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa0ac0e4560 con 0x7fa0bc101680 2024-07-24T22:06:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.881+0000 7fa0b3fff640 1 --2- 172.21.15.47:0/1192452299 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0a80b3c20 0x7fa0a80b60e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4031440 tx=0x7fa0a40058d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:07.883+0000 7fa0b8ff9640 1 -- 172.21.15.47:0/1192452299 <== mon.2 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fa0ac0ab440 con 0x7fa0bc101680 2024-07-24T22:06:07.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:07 smithi047 ceph-mon[32551]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:07.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:07 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:06:08.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:07 smithi188 ceph-mon[37380]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:08.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:07 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:06:08.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.110+0000 7fa0c156c640 1 -- 172.21.15.47:0/1192452299 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fa0bc0008d0 con 0x7fa0a80b3c20 2024-07-24T22:06:08.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.111+0000 7fa0b8ff9640 1 -- 172.21.15.47:0/1192452299 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fa0bc0008d0 con 0x7fa0a80b3c20 2024-07-24T22:06:08.113 INFO:teuthology.orchestra.run.smithi047.stdout:Backend: cephadm 2024-07-24T22:06:08.113 INFO:teuthology.orchestra.run.smithi047.stdout:Available: Yes 2024-07-24T22:06:08.113 INFO:teuthology.orchestra.run.smithi047.stdout:Paused: No 2024-07-24T22:06:08.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.113+0000 7fa0c156c640 1 -- 172.21.15.47:0/1192452299 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0a80b3c20 msgr2=0x7fa0a80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:08.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.113+0000 7fa0c156c640 1 --2- 172.21.15.47:0/1192452299 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0a80b3c20 0x7fa0a80b60e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4031440 tx=0x7fa0a40058d0 comp rx=0 tx=0).stop 2024-07-24T22:06:08.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.113+0000 7fa0c156c640 1 -- 172.21.15.47:0/1192452299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0bc101680 msgr2=0x7fa0bc198f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:08.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.113+0000 7fa0c156c640 1 --2- 172.21.15.47:0/1192452299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0bc101680 0x7fa0bc198f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00e9f0 tx=0x7fa0ac00eeb0 comp rx=0 tx=0).stop 2024-07-24T22:06:08.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.113+0000 7fa0c156c640 1 -- 172.21.15.47:0/1192452299 shutdown_connections 2024-07-24T22:06:08.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.113+0000 7fa0c156c640 1 --2- 172.21.15.47:0/1192452299 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0a80b3c20 0x7fa0a80b60e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:08.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.114+0000 7fa0c156c640 1 --2- 172.21.15.47:0/1192452299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0bc107a10 0x7fa0bc19e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:08.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.114+0000 7fa0c156c640 1 --2- 172.21.15.47:0/1192452299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0bc107090 0x7fa0bc1994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:08.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.114+0000 7fa0c156c640 1 --2- 172.21.15.47:0/1192452299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0bc101680 0x7fa0bc198f90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:08.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.114+0000 7fa0c156c640 1 -- 172.21.15.47:0/1192452299 >> 172.21.15.47:0/1192452299 conn(0x7fa0bc0fd0d0 msgr2=0x7fa0bc06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:08.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.114+0000 7fa0c156c640 1 -- 172.21.15.47:0/1192452299 shutdown_connections 2024-07-24T22:06:08.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:08.114+0000 7fa0c156c640 1 -- 172.21.15.47:0/1192452299 wait complete. 2024-07-24T22:06:08.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:07 smithi183 ceph-mon[37007]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:08.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:07 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:06:08.730 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- bash -c 'ceph orch ps' 2024-07-24T22:06:09.296 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:09.296 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:09.296 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:08 smithi047 ceph-mon[32551]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:09.296 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:08 smithi047 ceph-mon[32551]: from='client.24857 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:09.296 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:09.297 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:08 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:09.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:09.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:09.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:08 smithi188 ceph-mon[37380]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:09.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:08 smithi188 ceph-mon[37380]: from='client.24857 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:09.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:09.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:08 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:09.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:09.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:09.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:08 smithi183 ceph-mon[37007]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:09.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:08 smithi183 ceph-mon[37007]: from='client.24857 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:09.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:09.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:08 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:09.704 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:10 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:10.126 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:10 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:10.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:10 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:10.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:10 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:10.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:10 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:10.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:10 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:11.330 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:11 smithi047 ceph-mon[32551]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:11.330 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:11 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:11.330 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:11 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:11.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.327+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3381232806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dbc108b20 msgr2=0x7f1dbc10f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:11.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.327+0000 7f1dc13a0640 1 --2- 172.21.15.47:0/3381232806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dbc108b20 0x7f1dbc10f320 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009900 tx=0x7f1db402a410 comp rx=0 tx=0).stop 2024-07-24T22:06:11.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.327+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3381232806 shutdown_connections 2024-07-24T22:06:11.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.327+0000 7f1dc13a0640 1 --2- 172.21.15.47:0/3381232806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dbc108b20 0x7f1dbc10f320 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:11.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.327+0000 7f1dc13a0640 1 --2- 172.21.15.47:0/3381232806 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dbc1081a0 0x7f1dbc1085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:11.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.327+0000 7f1dc13a0640 1 --2- 172.21.15.47:0/3381232806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dbc102790 0x7f1dbc102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:11.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.327+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3381232806 >> 172.21.15.47:0/3381232806 conn(0x7f1dbc0fe200 msgr2=0x7f1dbc100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.327+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3381232806 shutdown_connections 2024-07-24T22:06:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.327+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3381232806 wait complete. 2024-07-24T22:06:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.328+0000 7f1dc13a0640 1 Processor -- start 2024-07-24T22:06:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.328+0000 7f1dc13a0640 1 -- start start 2024-07-24T22:06:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dc13a0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dbc102790 0x7f1dbc198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dc13a0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dbc1081a0 0x7f1dbc199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dc13a0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dbc108b20 0x7f1dbc19e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dc13a0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc1127a0 con 0x7f1dbc108b20 2024-07-24T22:06:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dc13a0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc112620 con 0x7f1dbc102790 2024-07-24T22:06:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dc13a0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc112920 con 0x7f1dbc1081a0 2024-07-24T22:06:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dbb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dbc108b20 0x7f1dbc19e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dbaffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dbc102790 0x7f1dbc198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dbb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dbc108b20 0x7f1dbc19e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35752/0 (socket says 172.21.15.47:35752) 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dbb7fe640 1 -- 172.21.15.47:0/3135254072 learned_addr learned my addr 172.21.15.47:0/3135254072 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dba7fc640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dbc1081a0 0x7f1dbc199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dbb7fe640 1 -- 172.21.15.47:0/3135254072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dbc1081a0 msgr2=0x7f1dbc199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dbb7fe640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dbc1081a0 0x7f1dbc199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dbb7fe640 1 -- 172.21.15.47:0/3135254072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dbc102790 msgr2=0x7f1dbc198cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dbb7fe640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dbc102790 0x7f1dbc198cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dbb7fe640 1 -- 172.21.15.47:0/3135254072 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dbc19ed80 con 0x7f1dbc108b20 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.329+0000 7f1dbaffd640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dbc102790 0x7f1dbc198cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.330+0000 7f1dbb7fe640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dbc108b20 0x7f1dbc19e5b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1db4004770 tx=0x7f1db4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.330+0000 7f1da3fff640 1 -- 172.21.15.47:0/3135254072 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db403f030 con 0x7f1dbc108b20 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.330+0000 7f1da3fff640 1 -- 172.21.15.47:0/3135254072 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1db4003aa0 con 0x7f1dbc108b20 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.330+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3135254072 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dbc19f010 con 0x7f1dbc108b20 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.330+0000 7f1da3fff640 1 -- 172.21.15.47:0/3135254072 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4035070 con 0x7f1dbc108b20 2024-07-24T22:06:11.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.330+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3135254072 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dbc1a5730 con 0x7f1dbc108b20 2024-07-24T22:06:11.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.331+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3135254072 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dbc102b70 con 0x7f1dbc108b20 2024-07-24T22:06:11.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.332+0000 7f1da3fff640 1 -- 172.21.15.47:0/3135254072 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f1db4042030 con 0x7f1dbc108b20 2024-07-24T22:06:11.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.333+0000 7f1da3fff640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1da40b3c20 0x7f1da40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:11.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.333+0000 7f1dbaffd640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1da40b3c20 0x7f1da40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:11.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.334+0000 7f1da3fff640 1 -- 172.21.15.47:0/3135254072 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f1db41046c0 con 0x7f1dbc108b20 2024-07-24T22:06:11.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.334+0000 7f1dbaffd640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1da40b3c20 0x7f1da40b60e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1dac005fd0 tx=0x7f1dac009760 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:11.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.337+0000 7f1da3fff640 1 -- 172.21.15.47:0/3135254072 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f1db40cbbf0 con 0x7f1dbc108b20 2024-07-24T22:06:11.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:11 smithi183 ceph-mon[37007]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:11.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:11 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:11.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:11 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:11.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.545+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3135254072 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1dbc062f80 con 0x7f1da40b3c20 2024-07-24T22:06:11.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:11 smithi188 ceph-mon[37380]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:11.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:11 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:11.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:11 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:11.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.558+0000 7f1da3fff640 1 -- 172.21.15.47:0/3135254072 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f1dbc062f80 con 0x7f1da40b3c20 2024-07-24T22:06:11.560 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-07-24T22:06:11.560 INFO:teuthology.orchestra.run.smithi047.stdout:mds.a smithi047 running (2m) 0s ago 2m 15.1M - 19.0.0-5197-g86385b1d 2e906353c5e5 58ebd81e3185 2024-07-24T22:06:11.561 INFO:teuthology.orchestra.run.smithi047.stdout:mds.b smithi183 running (2m) 2s ago 2m 17.3M - 19.0.0-5197-g86385b1d 2e906353c5e5 579e77367107 2024-07-24T22:06:11.561 INFO:teuthology.orchestra.run.smithi047.stdout:mds.c smithi188 running (2m) 2s ago 2m 21.1M - 19.0.0-5197-g86385b1d 2e906353c5e5 87e54b1f238b 2024-07-24T22:06:11.561 INFO:teuthology.orchestra.run.smithi047.stdout:mds.d smithi047 running (2m) 0s ago 2m 15.2M - 19.0.0-5197-g86385b1d 2e906353c5e5 6f824af4f09c 2024-07-24T22:06:11.561 INFO:teuthology.orchestra.run.smithi047.stdout:mds.e smithi183 running (2m) 2s ago 2m 15.2M - 19.0.0-5197-g86385b1d 2e906353c5e5 39578ef40e61 2024-07-24T22:06:11.561 INFO:teuthology.orchestra.run.smithi047.stdout:mds.f smithi188 running (2m) 2s ago 2m 17.3M - 19.0.0-5197-g86385b1d 2e906353c5e5 a9844a4d3e41 2024-07-24T22:06:11.561 INFO:teuthology.orchestra.run.smithi047.stdout:mds.g smithi047 running (2m) 0s ago 2m 14.9M - 19.0.0-5197-g86385b1d 2e906353c5e5 c40b95a1e501 2024-07-24T22:06:11.561 INFO:teuthology.orchestra.run.smithi047.stdout:mds.h smithi183 running (2m) 2s ago 2m 15.2M - 19.0.0-5197-g86385b1d 2e906353c5e5 94f9561d5513 2024-07-24T22:06:11.561 INFO:teuthology.orchestra.run.smithi047.stdout:mds.i smithi188 running (2m) 2s ago 2m 27.8M - 19.0.0-5197-g86385b1d 2e906353c5e5 3a9a1b23bfb7 2024-07-24T22:06:11.561 INFO:teuthology.orchestra.run.smithi047.stdout:mds.j smithi047 running (2m) 0s ago 2m 16.6M - 19.0.0-5197-g86385b1d 2e906353c5e5 b6d50e5740e3 2024-07-24T22:06:11.561 INFO:teuthology.orchestra.run.smithi047.stdout:mds.k smithi183 running (3m) 2s ago 3m 14.3M - 19.0.0-5197-g86385b1d 2e906353c5e5 5127c2528a07 2024-07-24T22:06:11.561 INFO:teuthology.orchestra.run.smithi047.stdout:mds.l smithi188 running (3m) 2s ago 3m 17.6M - 19.0.0-5197-g86385b1d 2e906353c5e5 eb134e71fb4e 2024-07-24T22:06:11.561 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.x smithi047 *:9283,8765 running (10m) 0s ago 10m 516M - 19.0.0-5197-g86385b1d 2e906353c5e5 f03081798de4 2024-07-24T22:06:11.561 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.y smithi183 *:8443,8765 running (8m) 2s ago 8m 458M - 19.0.0-5197-g86385b1d 2e906353c5e5 6f53b628aace 2024-07-24T22:06:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.z smithi188 *:8443,8765 running (8m) 2s ago 8m 455M - 19.0.0-5197-g86385b1d 2e906353c5e5 1ea1a7fc455f 2024-07-24T22:06:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:mon.a smithi047 running (10m) 0s ago 10m 52.2M 2048M 19.0.0-5197-g86385b1d 2e906353c5e5 12081d7d2866 2024-07-24T22:06:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:mon.b smithi183 running (9m) 2s ago 9m 42.8M 2048M 19.0.0-5197-g86385b1d 2e906353c5e5 c19ff3c84519 2024-07-24T22:06:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:mon.c smithi188 running (9m) 2s ago 9m 42.9M 2048M 19.0.0-5197-g86385b1d 2e906353c5e5 6e0df7c9206f 2024-07-24T22:06:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (7m) 0s ago 7m 49.8M 4273M 19.0.0-5197-g86385b1d 2e906353c5e5 87cbeeacd017 2024-07-24T22:06:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi183 running (7m) 2s ago 7m 50.4M 4272M 19.0.0-5197-g86385b1d 2e906353c5e5 51e8422f804a 2024-07-24T22:06:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi188 running (6m) 2s ago 6m 51.0M 4272M 19.0.0-5197-g86385b1d 2e906353c5e5 cd7ebcd6f1e0 2024-07-24T22:06:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi047 running (6m) 0s ago 6m 53.6M 4273M 19.0.0-5197-g86385b1d 2e906353c5e5 5136eecd53f1 2024-07-24T22:06:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi183 running (6m) 2s ago 6m 46.5M 4272M 19.0.0-5197-g86385b1d 2e906353c5e5 17d8fb0b0b75 2024-07-24T22:06:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi188 running (5m) 2s ago 5m 47.5M 4272M 19.0.0-5197-g86385b1d 2e906353c5e5 92b469681a59 2024-07-24T22:06:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:osd.6 smithi047 running (5m) 0s ago 5m 54.2M 4273M 19.0.0-5197-g86385b1d 2e906353c5e5 a0b03b7fa6b6 2024-07-24T22:06:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:osd.7 smithi183 running (4m) 2s ago 4m 48.2M 4272M 19.0.0-5197-g86385b1d 2e906353c5e5 b159ce3d4da9 2024-07-24T22:06:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:osd.8 smithi188 running (4m) 2s ago 4m 55.7M 4272M 19.0.0-5197-g86385b1d 2e906353c5e5 d710a231dd21 2024-07-24T22:06:11.563 INFO:teuthology.orchestra.run.smithi047.stdout:osd.9 smithi047 running (4m) 0s ago 4m 53.0M 4273M 19.0.0-5197-g86385b1d 2e906353c5e5 b337cc136848 2024-07-24T22:06:11.563 INFO:teuthology.orchestra.run.smithi047.stdout:osd.10 smithi183 running (3m) 2s ago 3m 47.9M 4272M 19.0.0-5197-g86385b1d 2e906353c5e5 9cb06d2fdf78 2024-07-24T22:06:11.563 INFO:teuthology.orchestra.run.smithi047.stdout:osd.11 smithi188 running (3m) 2s ago 3m 54.9M 4272M 19.0.0-5197-g86385b1d 2e906353c5e5 7a4e2a9d83c2 2024-07-24T22:06:11.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.561+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3135254072 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1da40b3c20 msgr2=0x7f1da40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:11.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.561+0000 7f1dc13a0640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1da40b3c20 0x7f1da40b60e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1dac005fd0 tx=0x7f1dac009760 comp rx=0 tx=0).stop 2024-07-24T22:06:11.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.561+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3135254072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dbc108b20 msgr2=0x7f1dbc19e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:11.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.561+0000 7f1dc13a0640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dbc108b20 0x7f1dbc19e5b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1db4004770 tx=0x7f1db4004270 comp rx=0 tx=0).stop 2024-07-24T22:06:11.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.561+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3135254072 shutdown_connections 2024-07-24T22:06:11.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.561+0000 7f1dc13a0640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1da40b3c20 0x7f1da40b60e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:11.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.561+0000 7f1dc13a0640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dbc108b20 0x7f1dbc19e5b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:11.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.561+0000 7f1dc13a0640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dbc1081a0 0x7f1dbc199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:11.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.561+0000 7f1dc13a0640 1 --2- 172.21.15.47:0/3135254072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dbc102790 0x7f1dbc198cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:11.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.561+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3135254072 >> 172.21.15.47:0/3135254072 conn(0x7f1dbc0fe200 msgr2=0x7f1dbc1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:11.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.561+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3135254072 shutdown_connections 2024-07-24T22:06:11.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:11.561+0000 7f1dc13a0640 1 -- 172.21.15.47:0/3135254072 wait complete. 2024-07-24T22:06:12.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:06:12.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:06:12.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:12.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:12 smithi047 ceph-mon[32551]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:12.269 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- bash -c 'ceph orch ls' 2024-07-24T22:06:12.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:06:12.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:06:12.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:12.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:12 smithi183 ceph-mon[37007]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:12.537 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:12.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:06:12.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:06:12.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:06:12.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:12 smithi188 ceph-mon[37380]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:13.386 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:13 smithi047 ceph-mon[32551]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:13.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:13 smithi183 ceph-mon[37007]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:13.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:13 smithi188 ceph-mon[37380]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:14.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.218+0000 7fa6faf05640 1 -- 172.21.15.47:0/2442357492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f4101650 msgr2=0x7fa6f4101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:14.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.218+0000 7fa6faf05640 1 --2- 172.21.15.47:0/2442357492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f4101650 0x7fa6f4101a30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009900 tx=0x7fa6e802a410 comp rx=0 tx=0).stop 2024-07-24T22:06:14.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.218+0000 7fa6faf05640 1 -- 172.21.15.47:0/2442357492 shutdown_connections 2024-07-24T22:06:14.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.218+0000 7fa6faf05640 1 --2- 172.21.15.47:0/2442357492 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f41079e0 0x7fa6f410e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:14.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.218+0000 7fa6faf05640 1 --2- 172.21.15.47:0/2442357492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6f4107060 0x7fa6f41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:14.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.218+0000 7fa6faf05640 1 --2- 172.21.15.47:0/2442357492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f4101650 0x7fa6f4101a30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:14.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.218+0000 7fa6faf05640 1 -- 172.21.15.47:0/2442357492 >> 172.21.15.47:0/2442357492 conn(0x7fa6f40fd0c0 msgr2=0x7fa6f40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:14.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.218+0000 7fa6faf05640 1 -- 172.21.15.47:0/2442357492 shutdown_connections 2024-07-24T22:06:14.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.218+0000 7fa6faf05640 1 -- 172.21.15.47:0/2442357492 wait complete. 2024-07-24T22:06:14.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.218+0000 7fa6faf05640 1 Processor -- start 2024-07-24T22:06:14.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.218+0000 7fa6faf05640 1 -- start start 2024-07-24T22:06:14.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6faf05640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6f4101650 0x7fa6f410ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:14.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6faf05640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f4107060 0x7fa6f410f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:14.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6faf05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f41079e0 0x7fa6f410f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:14.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6faf05640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f41127f0 con 0x7fa6f41079e0 2024-07-24T22:06:14.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6faf05640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4112670 con 0x7fa6f4107060 2024-07-24T22:06:14.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6faf05640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4112970 con 0x7fa6f4101650 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6f94a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f41079e0 0x7fa6f410f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6f94a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f41079e0 0x7fa6f410f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35770/0 (socket says 172.21.15.47:35770) 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6f94a2640 1 -- 172.21.15.47:0/315471033 learned_addr learned my addr 172.21.15.47:0/315471033 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6f8ca1640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6f4101650 0x7fa6f410ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6f3fff640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f4107060 0x7fa6f410f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6f94a2640 1 -- 172.21.15.47:0/315471033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6f4101650 msgr2=0x7fa6f410ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6f94a2640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6f4101650 0x7fa6f410ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6f94a2640 1 -- 172.21.15.47:0/315471033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f4107060 msgr2=0x7fa6f410f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6f94a2640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f4107060 0x7fa6f410f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6f94a2640 1 -- 172.21.15.47:0/315471033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f41a70a0 con 0x7fa6f41079e0 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6f8ca1640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6f4101650 0x7fa6f410ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6f94a2640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f41079e0 0x7fa6f410f770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00b970 tx=0x7fa6ec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.219+0000 7fa6f1ffb640 1 -- 172.21.15.47:0/315471033 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec019070 con 0x7fa6f41079e0 2024-07-24T22:06:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.220+0000 7fa6faf05640 1 -- 172.21.15.47:0/315471033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f41a7390 con 0x7fa6f41079e0 2024-07-24T22:06:14.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.220+0000 7fa6f1ffb640 1 -- 172.21.15.47:0/315471033 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6ec014440 con 0x7fa6f41079e0 2024-07-24T22:06:14.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.220+0000 7fa6f1ffb640 1 -- 172.21.15.47:0/315471033 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec0075d0 con 0x7fa6f41079e0 2024-07-24T22:06:14.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.220+0000 7fa6faf05640 1 -- 172.21.15.47:0/315471033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f41a7900 con 0x7fa6f41079e0 2024-07-24T22:06:14.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.221+0000 7fa6faf05640 1 -- 172.21.15.47:0/315471033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f4101a30 con 0x7fa6f41079e0 2024-07-24T22:06:14.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.222+0000 7fa6f1ffb640 1 -- 172.21.15.47:0/315471033 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fa6ec01c070 con 0x7fa6f41079e0 2024-07-24T22:06:14.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.223+0000 7fa6f1ffb640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa6e40b3c20 0x7fa6e40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:14.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.223+0000 7fa6f8ca1640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa6e40b3c20 0x7fa6e40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:14.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.223+0000 7fa6f1ffb640 1 -- 172.21.15.47:0/315471033 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa6ec0e3430 con 0x7fa6f41079e0 2024-07-24T22:06:14.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.224+0000 7fa6f8ca1640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa6e40b3c20 0x7fa6e40b60e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8000c00 tx=0x7fa6e8031400 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:14.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.227+0000 7fa6f1ffb640 1 -- 172.21.15.47:0/315471033 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fa6ec0aa960 con 0x7fa6f41079e0 2024-07-24T22:06:14.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.433+0000 7fa6faf05640 1 -- 172.21.15.47:0/315471033 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fa6f4062f80 con 0x7fa6e40b3c20 2024-07-24T22:06:14.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.439+0000 7fa6f1ffb640 1 -- 172.21.15.47:0/315471033 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fa6f4062f80 con 0x7fa6e40b3c20 2024-07-24T22:06:14.441 INFO:teuthology.orchestra.run.smithi047.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-07-24T22:06:14.441 INFO:teuthology.orchestra.run.smithi047.stdout:mds.all 12/12 5s ago 3m smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi183=b;smithi183=e;smithi183=h;smithi183=k;smithi188=c;smithi188=f;smithi188=i;smithi188=l;count:12 2024-07-24T22:06:14.441 INFO:teuthology.orchestra.run.smithi047.stdout:mgr 3/3 5s ago 8m smithi047=x;smithi183=y;smithi188=z;count:3 2024-07-24T22:06:14.442 INFO:teuthology.orchestra.run.smithi047.stdout:mon 3/3 5s ago 9m smithi047:172.21.15.47=a;smithi183:172.21.15.183=b;smithi188:172.21.15.188=c;count:3 2024-07-24T22:06:14.442 INFO:teuthology.orchestra.run.smithi047.stdout:osd 12 5s ago - 2024-07-24T22:06:14.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.441+0000 7fa6faf05640 1 -- 172.21.15.47:0/315471033 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa6e40b3c20 msgr2=0x7fa6e40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:14.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.441+0000 7fa6faf05640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa6e40b3c20 0x7fa6e40b60e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8000c00 tx=0x7fa6e8031400 comp rx=0 tx=0).stop 2024-07-24T22:06:14.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.441+0000 7fa6faf05640 1 -- 172.21.15.47:0/315471033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f41079e0 msgr2=0x7fa6f410f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:14.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.441+0000 7fa6faf05640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f41079e0 0x7fa6f410f770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00b970 tx=0x7fa6ec00be30 comp rx=0 tx=0).stop 2024-07-24T22:06:14.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.441+0000 7fa6faf05640 1 -- 172.21.15.47:0/315471033 shutdown_connections 2024-07-24T22:06:14.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.441+0000 7fa6faf05640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa6e40b3c20 0x7fa6e40b60e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:14.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.441+0000 7fa6faf05640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f41079e0 0x7fa6f410f770 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:14.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.441+0000 7fa6faf05640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f4107060 0x7fa6f410f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:14.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.441+0000 7fa6faf05640 1 --2- 172.21.15.47:0/315471033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6f4101650 0x7fa6f410ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:14.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.442+0000 7fa6faf05640 1 -- 172.21.15.47:0/315471033 >> 172.21.15.47:0/315471033 conn(0x7fa6f40fd0c0 msgr2=0x7fa6f40ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:14.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.442+0000 7fa6faf05640 1 -- 172.21.15.47:0/315471033 shutdown_connections 2024-07-24T22:06:14.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:14.442+0000 7fa6faf05640 1 -- 172.21.15.47:0/315471033 wait complete. 2024-07-24T22:06:15.123 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- bash -c 'ceph orch host ls' 2024-07-24T22:06:15.396 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:15 smithi047 ceph-mon[32551]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:15 smithi047 ceph-mon[32551]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:15.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:15 smithi188 ceph-mon[37380]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:15.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:15 smithi188 ceph-mon[37380]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:15.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:15 smithi183 ceph-mon[37007]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:15.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:15 smithi183 ceph-mon[37007]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:17.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.048+0000 7f6266a96640 1 -- 172.21.15.47:0/2262664097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260108b20 msgr2=0x7f626010f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:17.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.048+0000 7f6266a96640 1 --2- 172.21.15.47:0/2262664097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260108b20 0x7f626010f320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6258009ca0 tx=0x7f625802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:06:17.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.048+0000 7f6266a96640 1 -- 172.21.15.47:0/2262664097 shutdown_connections 2024-07-24T22:06:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.048+0000 7f6266a96640 1 --2- 172.21.15.47:0/2262664097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260108b20 0x7f626010f320 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.048+0000 7f6266a96640 1 --2- 172.21.15.47:0/2262664097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62601081a0 0x7f62601085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.048+0000 7f6266a96640 1 --2- 172.21.15.47:0/2262664097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6260102790 0x7f6260102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.048+0000 7f6266a96640 1 -- 172.21.15.47:0/2262664097 >> 172.21.15.47:0/2262664097 conn(0x7f62600fe200 msgr2=0x7f6260100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.048+0000 7f6266a96640 1 -- 172.21.15.47:0/2262664097 shutdown_connections 2024-07-24T22:06:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.048+0000 7f6266a96640 1 -- 172.21.15.47:0/2262664097 wait complete. 2024-07-24T22:06:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.048+0000 7f6266a96640 1 Processor -- start 2024-07-24T22:06:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.048+0000 7f6266a96640 1 -- start start 2024-07-24T22:06:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f6266a96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6260102790 0x7f6260074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f6266a96640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62601081a0 0x7f62600753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f6266a96640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6260108b20 0x7f6260075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f6266a96640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f62601127a0 con 0x7f62601081a0 2024-07-24T22:06:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f6266a96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6260112620 con 0x7f6260102790 2024-07-24T22:06:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f6266a96640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6260112920 con 0x7f6260108b20 2024-07-24T22:06:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f625ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62601081a0 0x7f62600753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f625ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62601081a0 0x7f62600753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53798/0 (socket says 172.21.15.47:53798) 2024-07-24T22:06:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f625ffff640 1 -- 172.21.15.47:0/3696163753 learned_addr learned my addr 172.21.15.47:0/3696163753 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f6265033640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6260108b20 0x7f6260075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f6264832640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6260102790 0x7f6260074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f625ffff640 1 -- 172.21.15.47:0/3696163753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6260108b20 msgr2=0x7f6260075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f625ffff640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6260108b20 0x7f6260075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f625ffff640 1 -- 172.21.15.47:0/3696163753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6260102790 msgr2=0x7f6260074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f625ffff640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6260102790 0x7f6260074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f625ffff640 1 -- 172.21.15.47:0/3696163753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62601a6fd0 con 0x7f62601081a0 2024-07-24T22:06:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f6265033640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6260108b20 0x7f6260075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:06:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.049+0000 7f625ffff640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62601081a0 0x7f62600753d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c920 tx=0x7f624c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.050+0000 7f625dffb640 1 -- 172.21.15.47:0/3696163753 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c007c70 con 0x7f62601081a0 2024-07-24T22:06:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.050+0000 7f6266a96640 1 -- 172.21.15.47:0/3696163753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62601a72c0 con 0x7f62601081a0 2024-07-24T22:06:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.050+0000 7f625dffb640 1 -- 172.21.15.47:0/3696163753 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f624c007e10 con 0x7f62601081a0 2024-07-24T22:06:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.050+0000 7f625dffb640 1 -- 172.21.15.47:0/3696163753 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c018820 con 0x7f62601081a0 2024-07-24T22:06:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.050+0000 7f6266a96640 1 -- 172.21.15.47:0/3696163753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62601a7880 con 0x7f62601081a0 2024-07-24T22:06:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.051+0000 7f6266a96640 1 -- 172.21.15.47:0/3696163753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6260102b70 con 0x7f62601081a0 2024-07-24T22:06:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.052+0000 7f625dffb640 1 -- 172.21.15.47:0/3696163753 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f624c00f450 con 0x7f62601081a0 2024-07-24T22:06:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.053+0000 7f625dffb640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f62500b3c20 0x7f62500b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.053+0000 7f6264832640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f62500b3c20 0x7f62500b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.053+0000 7f625dffb640 1 -- 172.21.15.47:0/3696163753 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f624c0e3fa0 con 0x7f62601081a0 2024-07-24T22:06:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.054+0000 7f6264832640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f62500b3c20 0x7f62500b60e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6254009890 tx=0x7f6254008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.057+0000 7f625dffb640 1 -- 172.21.15.47:0/3696163753 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f624c014030 con 0x7f62601081a0 2024-07-24T22:06:17.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.260+0000 7f6266a96640 1 -- 172.21.15.47:0/3696163753 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f6260106790 con 0x7f62500b3c20 2024-07-24T22:06:17.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.261+0000 7f625dffb640 1 -- 172.21.15.47:0/3696163753 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f6260106790 con 0x7f62500b3c20 2024-07-24T22:06:17.263 INFO:teuthology.orchestra.run.smithi047.stdout:HOST ADDR LABELS STATUS 2024-07-24T22:06:17.263 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047 172.21.15.47 2024-07-24T22:06:17.263 INFO:teuthology.orchestra.run.smithi047.stdout:smithi183 172.21.15.183 2024-07-24T22:06:17.263 INFO:teuthology.orchestra.run.smithi047.stdout:smithi188 172.21.15.188 2024-07-24T22:06:17.263 INFO:teuthology.orchestra.run.smithi047.stdout:3 hosts in cluster 2024-07-24T22:06:17.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.263+0000 7f6266a96640 1 -- 172.21.15.47:0/3696163753 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f62500b3c20 msgr2=0x7f62500b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:17.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.263+0000 7f6266a96640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f62500b3c20 0x7f62500b60e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6254009890 tx=0x7f6254008040 comp rx=0 tx=0).stop 2024-07-24T22:06:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.263+0000 7f6266a96640 1 -- 172.21.15.47:0/3696163753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62601081a0 msgr2=0x7f62600753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.263+0000 7f6266a96640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62601081a0 0x7f62600753d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c920 tx=0x7f624c00cde0 comp rx=0 tx=0).stop 2024-07-24T22:06:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.263+0000 7f6266a96640 1 -- 172.21.15.47:0/3696163753 shutdown_connections 2024-07-24T22:06:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.263+0000 7f6266a96640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f62500b3c20 0x7f62500b60e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.263+0000 7f6266a96640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6260108b20 0x7f6260075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.263+0000 7f6266a96640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62601081a0 0x7f62600753d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.263+0000 7f6266a96640 1 --2- 172.21.15.47:0/3696163753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6260102790 0x7f6260074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.263+0000 7f6266a96640 1 -- 172.21.15.47:0/3696163753 >> 172.21.15.47:0/3696163753 conn(0x7f62600fe200 msgr2=0x7f62601005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.264+0000 7f6266a96640 1 -- 172.21.15.47:0/3696163753 shutdown_connections 2024-07-24T22:06:17.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:17.264+0000 7f6266a96640 1 -- 172.21.15.47:0/3696163753 wait complete. 2024-07-24T22:06:17.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:17 smithi047 ceph-mon[32551]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:17.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:17 smithi188 ceph-mon[37380]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:17.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:17 smithi183 ceph-mon[37007]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:17.955 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- bash -c 'ceph orch device ls' 2024-07-24T22:06:18.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:18 smithi047 ceph-mon[32551]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:18.224 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:18.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:18 smithi188 ceph-mon[37380]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:18.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:18 smithi183 ceph-mon[37007]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:19.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:19 smithi047 ceph-mon[32551]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:19.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:19 smithi188 ceph-mon[37380]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:19.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:19 smithi183 ceph-mon[37007]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.883+0000 7fc929892640 1 -- 172.21.15.47:0/1800072376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc924103660 msgr2=0x7fc924103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.883+0000 7fc929892640 1 --2- 172.21.15.47:0/1800072376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc924103660 0x7fc924103a40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc914009ca0 tx=0x7fc91402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:06:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.883+0000 7fc929892640 1 -- 172.21.15.47:0/1800072376 shutdown_connections 2024-07-24T22:06:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.883+0000 7fc929892640 1 --2- 172.21.15.47:0/1800072376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc92410cac0 0x7fc92410ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.883+0000 7fc929892640 1 --2- 172.21.15.47:0/1800072376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc924103f80 0x7fc92410c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.883+0000 7fc929892640 1 --2- 172.21.15.47:0/1800072376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc924103660 0x7fc924103a40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.883+0000 7fc929892640 1 -- 172.21.15.47:0/1800072376 >> 172.21.15.47:0/1800072376 conn(0x7fc9240fd0c0 msgr2=0x7fc9240ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.883+0000 7fc929892640 1 -- 172.21.15.47:0/1800072376 shutdown_connections 2024-07-24T22:06:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.883+0000 7fc929892640 1 -- 172.21.15.47:0/1800072376 wait complete. 2024-07-24T22:06:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.883+0000 7fc929892640 1 Processor -- start 2024-07-24T22:06:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc929892640 1 -- start start 2024-07-24T22:06:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc929892640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc924103660 0x7fc92419ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc929892640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc924103f80 0x7fc92419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc929892640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc92410cac0 0x7fc9241a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc929892640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc924112700 con 0x7fc924103f80 2024-07-24T22:06:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc929892640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc924112580 con 0x7fc924103660 2024-07-24T22:06:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc929892640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc924112880 con 0x7fc92410cac0 2024-07-24T22:06:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc9227fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc924103f80 0x7fc92419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc9227fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc924103f80 0x7fc92419b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53816/0 (socket says 172.21.15.47:53816) 2024-07-24T22:06:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc9227fc640 1 -- 172.21.15.47:0/136117148 learned_addr learned my addr 172.21.15.47:0/136117148 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:19.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc922ffd640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc924103660 0x7fc92419ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:19.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc9237fe640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc92410cac0 0x7fc9241a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:19.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc9227fc640 1 -- 172.21.15.47:0/136117148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc92410cac0 msgr2=0x7fc9241a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:19.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc9227fc640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc92410cac0 0x7fc9241a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:19.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc9227fc640 1 -- 172.21.15.47:0/136117148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc924103660 msgr2=0x7fc92419ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:19.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc9227fc640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc924103660 0x7fc92419ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:19.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc9227fc640 1 -- 172.21.15.47:0/136117148 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9241a0f00 con 0x7fc924103f80 2024-07-24T22:06:19.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.884+0000 7fc922ffd640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc924103660 0x7fc92419ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:06:19.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.885+0000 7fc9227fc640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc924103f80 0x7fc92419b390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc91800d750 tx=0x7fc91800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:19.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.885+0000 7fc928890640 1 -- 172.21.15.47:0/136117148 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918017070 con 0x7fc924103f80 2024-07-24T22:06:19.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.885+0000 7fc928890640 1 -- 172.21.15.47:0/136117148 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc918004020 con 0x7fc924103f80 2024-07-24T22:06:19.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.885+0000 7fc929892640 1 -- 172.21.15.47:0/136117148 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9241a11f0 con 0x7fc924103f80 2024-07-24T22:06:19.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.885+0000 7fc928890640 1 -- 172.21.15.47:0/136117148 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918003c00 con 0x7fc924103f80 2024-07-24T22:06:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.885+0000 7fc929892640 1 -- 172.21.15.47:0/136117148 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9241a78b0 con 0x7fc924103f80 2024-07-24T22:06:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.886+0000 7fc929892640 1 -- 172.21.15.47:0/136117148 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc924103a40 con 0x7fc924103f80 2024-07-24T22:06:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.887+0000 7fc928890640 1 -- 172.21.15.47:0/136117148 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fc918009a30 con 0x7fc924103f80 2024-07-24T22:06:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.888+0000 7fc928890640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc90c0b3c20 0x7fc90c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.888+0000 7fc922ffd640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc90c0b3c20 0x7fc90c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.888+0000 7fc928890640 1 -- 172.21.15.47:0/136117148 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fc9180e3b80 con 0x7fc924103f80 2024-07-24T22:06:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.889+0000 7fc922ffd640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc90c0b3c20 0x7fc90c0b60e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc914000f80 tx=0x7fc914009360 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:19.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:19.891+0000 7fc928890640 1 -- 172.21.15.47:0/136117148 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fc9180ab0b0 con 0x7fc924103f80 2024-07-24T22:06:20.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.092+0000 7fc929892640 1 -- 172.21.15.47:0/136117148 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fc924102a20 con 0x7fc90c0b3c20 2024-07-24T22:06:20.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.094+0000 7fc928890640 1 -- 172.21.15.47:0/136117148 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fc924102a20 con 0x7fc90c0b3c20 2024-07-24T22:06:20.096 INFO:teuthology.orchestra.run.smithi047.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-07-24T22:06:20.097 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130022480DGN 447G No 4m ago Has a FileSystem, LVM detected 2024-07-24T22:06:20.097 INFO:teuthology.orchestra.run.smithi047.stdout:smithi183 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500QJ400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-07-24T22:06:20.097 INFO:teuthology.orchestra.run.smithi047.stdout:smithi188 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500MP400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-07-24T22:06:20.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.096+0000 7fc929892640 1 -- 172.21.15.47:0/136117148 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc90c0b3c20 msgr2=0x7fc90c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:20.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.096+0000 7fc929892640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc90c0b3c20 0x7fc90c0b60e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc914000f80 tx=0x7fc914009360 comp rx=0 tx=0).stop 2024-07-24T22:06:20.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.097+0000 7fc929892640 1 -- 172.21.15.47:0/136117148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc924103f80 msgr2=0x7fc92419b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:20.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.097+0000 7fc929892640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc924103f80 0x7fc92419b390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc91800d750 tx=0x7fc91800dc10 comp rx=0 tx=0).stop 2024-07-24T22:06:20.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.097+0000 7fc929892640 1 -- 172.21.15.47:0/136117148 shutdown_connections 2024-07-24T22:06:20.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.097+0000 7fc929892640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc90c0b3c20 0x7fc90c0b60e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:20.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.097+0000 7fc929892640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc92410cac0 0x7fc9241a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:20.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.097+0000 7fc929892640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc924103f80 0x7fc92419b390 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:20.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.097+0000 7fc929892640 1 --2- 172.21.15.47:0/136117148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc924103660 0x7fc92419ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:20.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.097+0000 7fc929892640 1 -- 172.21.15.47:0/136117148 >> 172.21.15.47:0/136117148 conn(0x7fc9240fd0c0 msgr2=0x7fc92410ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:20.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.097+0000 7fc929892640 1 -- 172.21.15.47:0/136117148 shutdown_connections 2024-07-24T22:06:20.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:20.097+0000 7fc929892640 1 -- 172.21.15.47:0/136117148 wait complete. 2024-07-24T22:06:20.724 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-07-24T22:06:20.739 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-07-24T22:06:20.739 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- bash -c 'ceph fs dump' 2024-07-24T22:06:21.010 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:21.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:21 smithi047 ceph-mon[32551]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:21.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:21 smithi047 ceph-mon[32551]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:21.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:21 smithi188 ceph-mon[37380]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:21.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:21 smithi188 ceph-mon[37380]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:21 smithi183 ceph-mon[37007]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:21 smithi183 ceph-mon[37007]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.620+0000 7f0388655640 1 -- 172.21.15.47:0/1473198489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0380107080 msgr2=0x7f03801074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.620+0000 7f0388655640 1 --2- 172.21.15.47:0/1473198489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0380107080 0x7f03801074c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0370009900 tx=0x7f037002a410 comp rx=0 tx=0).stop 2024-07-24T22:06:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.620+0000 7f0388655640 1 -- 172.21.15.47:0/1473198489 shutdown_connections 2024-07-24T22:06:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.620+0000 7f0388655640 1 --2- 172.21.15.47:0/1473198489 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0380107a00 0x7f038010e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.620+0000 7f0388655640 1 --2- 172.21.15.47:0/1473198489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0380107080 0x7f03801074c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.620+0000 7f0388655640 1 --2- 172.21.15.47:0/1473198489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0380101670 0x7f0380101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.620+0000 7f0388655640 1 -- 172.21.15.47:0/1473198489 >> 172.21.15.47:0/1473198489 conn(0x7f03800fd0e0 msgr2=0x7f03800ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.620+0000 7f0388655640 1 -- 172.21.15.47:0/1473198489 shutdown_connections 2024-07-24T22:06:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.620+0000 7f0388655640 1 -- 172.21.15.47:0/1473198489 wait complete. 2024-07-24T22:06:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.621+0000 7f0388655640 1 Processor -- start 2024-07-24T22:06:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.621+0000 7f0388655640 1 -- start start 2024-07-24T22:06:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.621+0000 7f0388655640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0380101670 0x7f03801999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.621+0000 7f0388655640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0380107080 0x7f0380199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.621+0000 7f0388655640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0380107a00 0x7f038019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.621+0000 7f0388655640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0380111600 con 0x7f0380107a00 2024-07-24T22:06:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.621+0000 7f0388655640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0380111480 con 0x7f0380107080 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.621+0000 7f0388655640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0380111780 con 0x7f0380101670 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.621+0000 7f0386bf2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0380107a00 0x7f038019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.621+0000 7f0386bf2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0380107a00 0x7f038019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53826/0 (socket says 172.21.15.47:53826) 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.621+0000 7f0386bf2640 1 -- 172.21.15.47:0/1441530928 learned_addr learned my addr 172.21.15.47:0/1441530928 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.621+0000 7f0385bf0640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0380107080 0x7f0380199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.622+0000 7f03863f1640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0380101670 0x7f03801999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.622+0000 7f0386bf2640 1 -- 172.21.15.47:0/1441530928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0380101670 msgr2=0x7f03801999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.622+0000 7f0386bf2640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0380101670 0x7f03801999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.622+0000 7f0386bf2640 1 -- 172.21.15.47:0/1441530928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0380107080 msgr2=0x7f0380199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.622+0000 7f0386bf2640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0380107080 0x7f0380199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.622+0000 7f0386bf2640 1 -- 172.21.15.47:0/1441530928 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03801a4db0 con 0x7f0380107a00 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.622+0000 7f03863f1640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0380101670 0x7f03801999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.622+0000 7f0386bf2640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0380107a00 0x7f038019a470 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f037800cad0 tx=0x7f037800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.622+0000 7f03777fe640 1 -- 172.21.15.47:0/1441530928 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037800ae20 con 0x7f0380107a00 2024-07-24T22:06:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.622+0000 7f03777fe640 1 -- 172.21.15.47:0/1441530928 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0378005020 con 0x7f0380107a00 2024-07-24T22:06:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.622+0000 7f0388655640 1 -- 172.21.15.47:0/1441530928 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03801a50a0 con 0x7f0380107a00 2024-07-24T22:06:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.622+0000 7f03777fe640 1 -- 172.21.15.47:0/1441530928 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037800f6b0 con 0x7f0380107a00 2024-07-24T22:06:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.622+0000 7f0388655640 1 -- 172.21.15.47:0/1441530928 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03801a5560 con 0x7f0380107a00 2024-07-24T22:06:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.623+0000 7f0388655640 1 -- 172.21.15.47:0/1441530928 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0380101a50 con 0x7f0380107a00 2024-07-24T22:06:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.624+0000 7f03777fe640 1 -- 172.21.15.47:0/1441530928 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f03780051d0 con 0x7f0380107a00 2024-07-24T22:06:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.625+0000 7f03777fe640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f036c0b3c20 0x7f036c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.625+0000 7f03863f1640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f036c0b3c20 0x7f036c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.625+0000 7f03777fe640 1 -- 172.21.15.47:0/1441530928 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f03780e4220 con 0x7f0380107a00 2024-07-24T22:06:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.626+0000 7f03863f1640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f036c0b3c20 0x7f036c0b60e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f037c00baa0 tx=0x7f037c005d90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.628+0000 7f03777fe640 1 -- 172.21.15.47:0/1441530928 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f0378014030 con 0x7f0380107a00 2024-07-24T22:06:22.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.863+0000 7f0388655640 1 -- 172.21.15.47:0/1441530928 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f038006b260 con 0x7f0380107a00 2024-07-24T22:06:22.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.864+0000 7f03777fe640 1 -- 172.21.15.47:0/1441530928 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+3050 (secure 0 0 0) 0x7f038006b260 con 0x7f0380107a00 2024-07-24T22:06:22.866 INFO:teuthology.orchestra.run.smithi047.stdout:e20 2024-07-24T22:06:22.866 INFO:teuthology.orchestra.run.smithi047.stdout:btime 2024-07-24T22:04:10:448158+0000 2024-07-24T22:06:22.866 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-07-24T22:06:22.866 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-07-24T22:06:22.866 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-07-24T22:06:22.866 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:22.866 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-07-24T22:06:22.866 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-07-24T22:06:22.867 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 20 2024-07-24T22:06:22.867 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-07-24T22:06:22.867 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-07-24T22:03:54.960171+0000 2024-07-24T22:06:22.867 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-07-24T22:04:10.197477+0000 2024-07-24T22:06:22.867 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-07-24T22:06:22.867 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-07-24T22:06:22.867 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 300 2024-07-24T22:06:22.867 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-07-24T22:06:22.867 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-07-24T22:06:22.867 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-07-24T22:06:22.867 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-07-24T22:06:22.867 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-07-24T22:06:22.867 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 0 2024-07-24T22:06:22.868 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-07-24T22:06:22.868 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 1 2024-07-24T22:06:22.868 INFO:teuthology.orchestra.run.smithi047.stdout:in 0 2024-07-24T22:06:22.868 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=24628} 2024-07-24T22:06:22.868 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-07-24T22:06:22.868 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-07-24T22:06:22.868 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-07-24T22:06:22.868 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-07-24T22:06:22.868 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-07-24T22:06:22.868 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-07-24T22:06:22.868 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-07-24T22:06:22.868 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-07-24T22:06:22.868 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 0 2024-07-24T22:06:22.869 INFO:teuthology.orchestra.run.smithi047.stdout:qdb_cluster leader: 24628 members: 24628 2024-07-24T22:06:22.869 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.i{0:24628} state up:active seq 8 addr [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] compat {c=[1],r=[1],i=[1fff]}] 2024-07-24T22:06:22.869 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c{0:24610} state up:standby-replay seq 1 addr [v2:172.21.15.188:6836/749102233,v1:172.21.15.188:6837/749102233] compat {c=[1],r=[1],i=[1fff]}] 2024-07-24T22:06:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:22.869 INFO:teuthology.orchestra.run.smithi047.stdout:Standby daemons: 2024-07-24T22:06:22.869 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:22.869 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.j{-1:14706} state up:standby seq 1 addr [v2:172.21.15.47:6834/2008479600,v1:172.21.15.47:6835/2008479600] compat {c=[1],r=[1],i=[1fff]}] 2024-07-24T22:06:22.869 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d{-1:14718} state up:standby seq 1 addr [v2:172.21.15.47:6836/3498135783,v1:172.21.15.47:6837/3498135783] compat {c=[1],r=[1],i=[1fff]}] 2024-07-24T22:06:22.869 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.g{-1:14766} state up:standby seq 1 addr [v2:172.21.15.47:6838/3216013409,v1:172.21.15.47:6839/3216013409] compat {c=[1],r=[1],i=[1fff]}] 2024-07-24T22:06:22.869 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a{-1:14778} state up:standby seq 1 addr [v2:172.21.15.47:6840/516348946,v1:172.21.15.47:6841/516348946] compat {c=[1],r=[1],i=[1fff]}] 2024-07-24T22:06:22.869 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.k{-1:24512} state up:standby seq 1 addr [v2:172.21.15.183:6832/2401857175,v1:172.21.15.183:6833/2401857175] compat {c=[1],r=[1],i=[1fff]}] 2024-07-24T22:06:22.869 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.e{-1:24536} state up:standby seq 1 addr [v2:172.21.15.183:6834/740841820,v1:172.21.15.183:6835/740841820] compat {c=[1],r=[1],i=[1fff]}] 2024-07-24T22:06:22.870 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.h{-1:24557} state up:standby seq 1 addr [v2:172.21.15.183:6836/2532099121,v1:172.21.15.183:6837/2532099121] compat {c=[1],r=[1],i=[1fff]}] 2024-07-24T22:06:22.870 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.l{-1:24571} state up:standby seq 1 addr [v2:172.21.15.188:6832/3861632765,v1:172.21.15.188:6833/3861632765] compat {c=[1],r=[1],i=[1fff]}] 2024-07-24T22:06:22.870 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b{-1:24581} state up:standby seq 1 addr [v2:172.21.15.183:6838/2872116437,v1:172.21.15.183:6839/2872116437] compat {c=[1],r=[1],i=[1fff]}] 2024-07-24T22:06:22.870 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.f{-1:24604} state up:standby seq 1 addr [v2:172.21.15.188:6834/3246894203,v1:172.21.15.188:6835/3246894203] compat {c=[1],r=[1],i=[1fff]}] 2024-07-24T22:06:22.870 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:06:22.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.866+0000 7f0388655640 1 -- 172.21.15.47:0/1441530928 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f036c0b3c20 msgr2=0x7f036c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.866+0000 7f0388655640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f036c0b3c20 0x7f036c0b60e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f037c00baa0 tx=0x7f037c005d90 comp rx=0 tx=0).stop 2024-07-24T22:06:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.866+0000 7f0388655640 1 -- 172.21.15.47:0/1441530928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0380107a00 msgr2=0x7f038019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.866+0000 7f0388655640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0380107a00 0x7f038019a470 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f037800cad0 tx=0x7f037800cf90 comp rx=0 tx=0).stop 2024-07-24T22:06:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.866+0000 7f0388655640 1 -- 172.21.15.47:0/1441530928 shutdown_connections 2024-07-24T22:06:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.866+0000 7f0388655640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f036c0b3c20 0x7f036c0b60e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.866+0000 7f0388655640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0380107a00 0x7f038019a470 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.866+0000 7f0388655640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0380107080 0x7f0380199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.866+0000 7f0388655640 1 --2- 172.21.15.47:0/1441530928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0380101670 0x7f03801999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.866+0000 7f0388655640 1 -- 172.21.15.47:0/1441530928 >> 172.21.15.47:0/1441530928 conn(0x7f03800fd0e0 msgr2=0x7f03800ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.866+0000 7f0388655640 1 -- 172.21.15.47:0/1441530928 shutdown_connections 2024-07-24T22:06:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:22.866+0000 7f0388655640 1 -- 172.21.15.47:0/1441530928 wait complete. 2024-07-24T22:06:23.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:23 smithi047 ceph-mon[32551]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:23.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:23 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1441530928' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-07-24T22:06:23.534 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- bash -c 'ceph osd dump' 2024-07-24T22:06:23.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:23 smithi188 ceph-mon[37380]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:23.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:23 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1441530928' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-07-24T22:06:23.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:23 smithi183 ceph-mon[37007]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:23.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:23 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1441530928' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-07-24T22:06:23.802 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.396+0000 7f80e2017640 1 -- 172.21.15.47:0/2039437632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80dc1036a0 msgr2=0x7f80dc103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.396+0000 7f80e2017640 1 --2- 172.21.15.47:0/2039437632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80dc1036a0 0x7f80dc103a80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009900 tx=0x7f80cc02a410 comp rx=0 tx=0).stop 2024-07-24T22:06:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.396+0000 7f80e2017640 1 -- 172.21.15.47:0/2039437632 shutdown_connections 2024-07-24T22:06:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.396+0000 7f80e2017640 1 --2- 172.21.15.47:0/2039437632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80dc10cb00 0x7f80dc10ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.396+0000 7f80e2017640 1 --2- 172.21.15.47:0/2039437632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80dc103fc0 0x7f80dc10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.396+0000 7f80e2017640 1 --2- 172.21.15.47:0/2039437632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80dc1036a0 0x7f80dc103a80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.396+0000 7f80e2017640 1 -- 172.21.15.47:0/2039437632 >> 172.21.15.47:0/2039437632 conn(0x7f80dc0fd100 msgr2=0x7f80dc0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.397+0000 7f80e2017640 1 -- 172.21.15.47:0/2039437632 shutdown_connections 2024-07-24T22:06:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.397+0000 7f80e2017640 1 -- 172.21.15.47:0/2039437632 wait complete. 2024-07-24T22:06:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.397+0000 7f80e2017640 1 Processor -- start 2024-07-24T22:06:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80e2017640 1 -- start start 2024-07-24T22:06:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80e2017640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80dc1036a0 0x7f80dc198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80e2017640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80dc103fc0 0x7f80dc199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80e2017640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80dc10cb00 0x7f80dc19e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80e2017640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc112740 con 0x7f80dc103fc0 2024-07-24T22:06:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80e2017640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc1125c0 con 0x7f80dc1036a0 2024-07-24T22:06:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80e2017640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc1128c0 con 0x7f80dc10cb00 2024-07-24T22:06:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80dc103fc0 0x7f80dc199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80dc103fc0 0x7f80dc199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41066/0 (socket says 172.21.15.47:41066) 2024-07-24T22:06:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80daffd640 1 -- 172.21.15.47:0/3248766875 learned_addr learned my addr 172.21.15.47:0/3248766875 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80dbfff640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80dc10cb00 0x7f80dc19e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80db7fe640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80dc1036a0 0x7f80dc198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80daffd640 1 -- 172.21.15.47:0/3248766875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80dc10cb00 msgr2=0x7f80dc19e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80daffd640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80dc10cb00 0x7f80dc19e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80daffd640 1 -- 172.21.15.47:0/3248766875 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80dc1036a0 msgr2=0x7f80dc198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80daffd640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80dc1036a0 0x7f80dc198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.398+0000 7f80daffd640 1 -- 172.21.15.47:0/3248766875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80dc19ece0 con 0x7f80dc103fc0 2024-07-24T22:06:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.399+0000 7f80daffd640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80dc103fc0 0x7f80dc199170 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f80d000c970 tx=0x7f80d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.399+0000 7f80d8ff9640 1 -- 172.21.15.47:0/3248766875 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0007bb0 con 0x7f80dc103fc0 2024-07-24T22:06:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.399+0000 7f80d8ff9640 1 -- 172.21.15.47:0/3248766875 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80d0007d50 con 0x7f80dc103fc0 2024-07-24T22:06:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.399+0000 7f80e2017640 1 -- 172.21.15.47:0/3248766875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80dc19efd0 con 0x7f80dc103fc0 2024-07-24T22:06:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.399+0000 7f80d8ff9640 1 -- 172.21.15.47:0/3248766875 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d000f7b0 con 0x7f80dc103fc0 2024-07-24T22:06:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.399+0000 7f80e2017640 1 -- 172.21.15.47:0/3248766875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80dc1a5690 con 0x7f80dc103fc0 2024-07-24T22:06:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.400+0000 7f80e2017640 1 -- 172.21.15.47:0/3248766875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80dc103a80 con 0x7f80dc103fc0 2024-07-24T22:06:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.402+0000 7f80d8ff9640 1 -- 172.21.15.47:0/3248766875 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f80d0018480 con 0x7f80dc103fc0 2024-07-24T22:06:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.403+0000 7f80d8ff9640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f80c40b3c20 0x7f80c40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.403+0000 7f80db7fe640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f80c40b3c20 0x7f80c40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.403+0000 7f80d8ff9640 1 -- 172.21.15.47:0/3248766875 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f80d00e43a0 con 0x7f80dc103fc0 2024-07-24T22:06:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.404+0000 7f80db7fe640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f80c40b3c20 0x7f80c40b60e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f80cc031440 tx=0x7f80cc0095f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.407+0000 7f80d8ff9640 1 -- 172.21.15.47:0/3248766875 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f80d00ab990 con 0x7f80dc103fc0 2024-07-24T22:06:25.427 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:25 smithi047 ceph-mon[32551]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:25.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:25 smithi188 ceph-mon[37380]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:25.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.605+0000 7f80e2017640 1 -- 172.21.15.47:0/3248766875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f80dc199d60 con 0x7f80dc103fc0 2024-07-24T22:06:25.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.606+0000 7f80d8ff9640 1 -- 172.21.15.47:0/3248766875 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) ==== 56+0+5754 (secure 0 0 0) 0x7f80dc199d60 con 0x7f80dc103fc0 2024-07-24T22:06:25.608 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 85 2024-07-24T22:06:25.608 INFO:teuthology.orchestra.run.smithi047.stdout:fsid 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T22:06:25.608 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-07-24T21:55:28.945912+0000 2024-07-24T22:06:25.608 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-07-24T22:05:27.567637+0000 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:crush_version 26 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:full_ratio 0.95 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:backfillfull_ratio 0.9 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:nearfull_ratio 0.85 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:require_min_compat_client luminous 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:min_compat_client luminous 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:require_osd_release squid 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:stretch_mode_enabled false 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:max_osd 12 2024-07-24T22:06:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 up in weight 1 up_from 9 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6802/2665889913,v1:172.21.15.47:6803/2665889913] [v2:172.21.15.47:6804/2665889913,v1:172.21.15.47:6805/2665889913] exists,up 60de2c3d-e4b7-4878-bdbb-ce3257e3706c 2024-07-24T22:06:25.610 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 up in weight 1 up_from 14 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6800/3486494228,v1:172.21.15.183:6801/3486494228] [v2:172.21.15.183:6802/3486494228,v1:172.21.15.183:6803/3486494228] exists,up 7f086675-3bed-47ca-a93f-fab9580068b4 2024-07-24T22:06:25.610 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 up in weight 1 up_from 19 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.188:6800/2245903281,v1:172.21.15.188:6801/2245903281] [v2:172.21.15.188:6802/2245903281,v1:172.21.15.188:6803/2245903281] exists,up 040fff27-6fa6-48de-9365-fcced8f89e98 2024-07-24T22:06:25.610 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 up in weight 1 up_from 27 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6810/236749130,v1:172.21.15.47:6811/236749130] [v2:172.21.15.47:6812/236749130,v1:172.21.15.47:6813/236749130] exists,up e129321a-9566-4bea-b982-34f7ddd1ae1d 2024-07-24T22:06:25.610 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 up in weight 1 up_from 33 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6808/3978122107,v1:172.21.15.183:6809/3978122107] [v2:172.21.15.183:6810/3978122107,v1:172.21.15.183:6811/3978122107] exists,up f969fba7-b0ff-4ea6-83bd-38aba32b1be1 2024-07-24T22:06:25.610 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 up in weight 1 up_from 38 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.188:6808/2097128083,v1:172.21.15.188:6809/2097128083] [v2:172.21.15.188:6810/2097128083,v1:172.21.15.188:6811/2097128083] exists,up 3799c912-3d9f-4efd-9b36-569c385e4c33 2024-07-24T22:06:25.610 INFO:teuthology.orchestra.run.smithi047.stdout:osd.6 up in weight 1 up_from 44 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6818/2288252980,v1:172.21.15.47:6819/2288252980] [v2:172.21.15.47:6820/2288252980,v1:172.21.15.47:6821/2288252980] exists,up 1a38cf12-619f-4e82-a7a5-21ee2014038a 2024-07-24T22:06:25.610 INFO:teuthology.orchestra.run.smithi047.stdout:osd.7 up in weight 1 up_from 49 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6816/465426514,v1:172.21.15.183:6817/465426514] [v2:172.21.15.183:6818/465426514,v1:172.21.15.183:6819/465426514] exists,up 6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309 2024-07-24T22:06:25.610 INFO:teuthology.orchestra.run.smithi047.stdout:osd.8 up in weight 1 up_from 56 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.188:6816/2247055658,v1:172.21.15.188:6817/2247055658] [v2:172.21.15.188:6818/2247055658,v1:172.21.15.188:6819/2247055658] exists,up 6dfd7252-61a6-423d-8498-cbcfa41ae1e1 2024-07-24T22:06:25.610 INFO:teuthology.orchestra.run.smithi047.stdout:osd.9 up in weight 1 up_from 62 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6826/2628721884,v1:172.21.15.47:6827/2628721884] [v2:172.21.15.47:6828/2628721884,v1:172.21.15.47:6829/2628721884] exists,up abd93c5e-283e-4873-a241-1056f2894116 2024-07-24T22:06:25.610 INFO:teuthology.orchestra.run.smithi047.stdout:osd.10 up in weight 1 up_from 67 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6824/3509332199,v1:172.21.15.183:6825/3509332199] [v2:172.21.15.183:6826/3509332199,v1:172.21.15.183:6827/3509332199] exists,up bc967f8f-ce27-4230-be70-e36927f89fe4 2024-07-24T22:06:25.610 INFO:teuthology.orchestra.run.smithi047.stdout:osd.11 up in weight 1 up_from 73 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.188:6824/3725107101,v1:172.21.15.188:6825/3725107101] [v2:172.21.15.188:6826/3725107101,v1:172.21.15.188:6827/3725107101] exists,up 8b379865-3a5c-4a2d-aa74-a4f215027fa8 2024-07-24T22:06:25.610 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.2 [7,11] 2024-07-24T22:06:25.611 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.10 [2,4] 2024-07-24T22:06:25.611 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.1d [2,4,8,11] 2024-07-24T22:06:25.611 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.1f [8,1] 2024-07-24T22:06:25.611 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.0 [4,8] 2024-07-24T22:06:25.611 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.6 [4,6] 2024-07-24T22:06:25.611 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.c [3,9] 2024-07-24T22:06:25.611 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.1d [5,9] 2024-07-24T22:06:25.611 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.34 [4,9] 2024-07-24T22:06:25.611 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.38 [5,7] 2024-07-24T22:06:25.611 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.3a [4,8] 2024-07-24T22:06:25.611 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/3499235566 expires 2024-07-25T21:57:25.995502+0000 2024-07-24T22:06:25.611 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/2112533111 expires 2024-07-25T21:55:50.643046+0000 2024-07-24T22:06:25.611 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/2714360830 expires 2024-07-25T21:56:15.044564+0000 2024-07-24T22:06:25.612 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/507334607 expires 2024-07-25T21:57:25.995502+0000 2024-07-24T22:06:25.612 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6800/2524786594 expires 2024-07-25T21:57:25.995502+0000 2024-07-24T22:06:25.612 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/1004458106 expires 2024-07-25T21:55:50.643046+0000 2024-07-24T22:06:25.612 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6800/1185381011 expires 2024-07-25T21:55:50.643046+0000 2024-07-24T22:06:25.612 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6801/1185381011 expires 2024-07-25T21:55:50.643046+0000 2024-07-24T22:06:25.612 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/1046677443 expires 2024-07-25T21:55:50.643046+0000 2024-07-24T22:06:25.612 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6801/4239008956 expires 2024-07-25T21:56:15.044564+0000 2024-07-24T22:06:25.612 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/899235864 expires 2024-07-25T21:56:15.044564+0000 2024-07-24T22:06:25.612 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6800/4239008956 expires 2024-07-25T21:56:15.044564+0000 2024-07-24T22:06:25.612 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/3057769442 expires 2024-07-25T21:56:15.044564+0000 2024-07-24T22:06:25.612 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/2596054312 expires 2024-07-25T21:57:25.995502+0000 2024-07-24T22:06:25.612 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6801/2524786594 expires 2024-07-25T21:57:25.995502+0000 2024-07-24T22:06:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.608+0000 7f80e2017640 1 -- 172.21.15.47:0/3248766875 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f80c40b3c20 msgr2=0x7f80c40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.608+0000 7f80e2017640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f80c40b3c20 0x7f80c40b60e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f80cc031440 tx=0x7f80cc0095f0 comp rx=0 tx=0).stop 2024-07-24T22:06:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.608+0000 7f80e2017640 1 -- 172.21.15.47:0/3248766875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80dc103fc0 msgr2=0x7f80dc199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.608+0000 7f80e2017640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80dc103fc0 0x7f80dc199170 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f80d000c970 tx=0x7f80d000ce30 comp rx=0 tx=0).stop 2024-07-24T22:06:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.609+0000 7f80e2017640 1 -- 172.21.15.47:0/3248766875 shutdown_connections 2024-07-24T22:06:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.609+0000 7f80e2017640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f80c40b3c20 0x7f80c40b60e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.609+0000 7f80e2017640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80dc10cb00 0x7f80dc19e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.609+0000 7f80e2017640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80dc103fc0 0x7f80dc199170 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:25.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.609+0000 7f80e2017640 1 --2- 172.21.15.47:0/3248766875 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80dc1036a0 0x7f80dc198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:25.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.609+0000 7f80e2017640 1 -- 172.21.15.47:0/3248766875 >> 172.21.15.47:0/3248766875 conn(0x7f80dc0fd100 msgr2=0x7f80dc0fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:25.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.609+0000 7f80e2017640 1 -- 172.21.15.47:0/3248766875 shutdown_connections 2024-07-24T22:06:25.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:25.609+0000 7f80e2017640 1 -- 172.21.15.47:0/3248766875 wait complete. 2024-07-24T22:06:25.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:25 smithi183 ceph-mon[37007]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:26.227 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:26 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3248766875' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-07-24T22:06:26.257 INFO:teuthology.run_tasks:Running task fs.ready... 2024-07-24T22:06:26.269 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:06:26.535 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:26.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:26 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3248766875' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-07-24T22:06:26.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:26 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3248766875' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-07-24T22:06:27.409 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:27 smithi047 ceph-mon[32551]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:27.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:27 smithi188 ceph-mon[37380]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:27.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:27 smithi183 ceph-mon[37007]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:28.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.219+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/1435313873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a78102790 msgr2=0x7f8a78102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:28.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.219+0000 7f8a7cb8a640 1 --2- 172.21.15.47:0/1435313873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a78102790 0x7f8a78102b70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009900 tx=0x7f8a6802a410 comp rx=0 tx=0).stop 2024-07-24T22:06:28.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.219+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/1435313873 shutdown_connections 2024-07-24T22:06:28.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.219+0000 7f8a7cb8a640 1 --2- 172.21.15.47:0/1435313873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a78108b20 0x7f8a7810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:28.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.219+0000 7f8a7cb8a640 1 --2- 172.21.15.47:0/1435313873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a781081a0 0x7f8a781085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:28.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.219+0000 7f8a7cb8a640 1 --2- 172.21.15.47:0/1435313873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a78102790 0x7f8a78102b70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:28.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.219+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/1435313873 >> 172.21.15.47:0/1435313873 conn(0x7f8a780fe200 msgr2=0x7f8a78100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:28.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.219+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/1435313873 shutdown_connections 2024-07-24T22:06:28.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.219+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/1435313873 wait complete. 2024-07-24T22:06:28.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.220+0000 7f8a7cb8a640 1 Processor -- start 2024-07-24T22:06:28.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.220+0000 7f8a7cb8a640 1 -- start start 2024-07-24T22:06:28.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.220+0000 7f8a7cb8a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a78102790 0x7f8a78198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:28.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.220+0000 7f8a7cb8a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a781081a0 0x7f8a78199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:28.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.220+0000 7f8a7cb8a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a78108b20 0x7f8a7819e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:28.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.220+0000 7f8a7cb8a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78112720 con 0x7f8a78108b20 2024-07-24T22:06:28.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.220+0000 7f8a7cb8a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781125a0 con 0x7f8a78102790 2024-07-24T22:06:28.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.220+0000 7f8a7cb8a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781128a0 con 0x7f8a781081a0 2024-07-24T22:06:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a76d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a78108b20 0x7f8a7819e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a76d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a78108b20 0x7f8a7819e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41092/0 (socket says 172.21.15.47:41092) 2024-07-24T22:06:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a76d9d640 1 -- 172.21.15.47:0/4135052930 learned_addr learned my addr 172.21.15.47:0/4135052930 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a75d9b640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a781081a0 0x7f8a78199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a7659c640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a78102790 0x7f8a78198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a76d9d640 1 -- 172.21.15.47:0/4135052930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a781081a0 msgr2=0x7f8a78199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a76d9d640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a781081a0 0x7f8a78199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a76d9d640 1 -- 172.21.15.47:0/4135052930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a78102790 msgr2=0x7f8a78198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a76d9d640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a78102790 0x7f8a78198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a76d9d640 1 -- 172.21.15.47:0/4135052930 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7819ece0 con 0x7f8a78108b20 2024-07-24T22:06:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a76d9d640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a78108b20 0x7f8a7819e510 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000eaa0 tx=0x7f8a7000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a677fe640 1 -- 172.21.15.47:0/4135052930 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000cdb0 con 0x7f8a78108b20 2024-07-24T22:06:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/4135052930 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7819efd0 con 0x7f8a78108b20 2024-07-24T22:06:28.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a677fe640 1 -- 172.21.15.47:0/4135052930 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a70005020 con 0x7f8a78108b20 2024-07-24T22:06:28.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a677fe640 1 -- 172.21.15.47:0/4135052930 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a700116d0 con 0x7f8a78108b20 2024-07-24T22:06:28.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.221+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/4135052930 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a781a5690 con 0x7f8a78108b20 2024-07-24T22:06:28.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.222+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/4135052930 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a78102b70 con 0x7f8a78108b20 2024-07-24T22:06:28.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.224+0000 7f8a677fe640 1 -- 172.21.15.47:0/4135052930 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f8a700051d0 con 0x7f8a78108b20 2024-07-24T22:06:28.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.224+0000 7f8a677fe640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8a600b3c20 0x7f8a600b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:28.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.225+0000 7f8a7659c640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8a600b3c20 0x7f8a600b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:28.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.225+0000 7f8a677fe640 1 -- 172.21.15.47:0/4135052930 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8a700e4280 con 0x7f8a78108b20 2024-07-24T22:06:28.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.225+0000 7f8a7659c640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8a600b3c20 0x7f8a600b60e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8a68031440 tx=0x7f8a68005b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:28.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.227+0000 7f8a677fe640 1 -- 172.21.15.47:0/4135052930 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f8a70016030 con 0x7f8a78108b20 2024-07-24T22:06:28.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.460+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/4135052930 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a78199d60 con 0x7f8a78108b20 2024-07-24T22:06:28.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.460+0000 7f8a677fe640 1 -- 172.21.15.47:0/4135052930 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f8a78199d60 con 0x7f8a78108b20 2024-07-24T22:06:28.463 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:28.463 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:06:28.463 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:06:28.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.462+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/4135052930 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8a600b3c20 msgr2=0x7f8a600b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:28.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.462+0000 7f8a7cb8a640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8a600b3c20 0x7f8a600b60e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8a68031440 tx=0x7f8a68005b50 comp rx=0 tx=0).stop 2024-07-24T22:06:28.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.462+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/4135052930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a78108b20 msgr2=0x7f8a7819e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:28.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.462+0000 7f8a7cb8a640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a78108b20 0x7f8a7819e510 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000eaa0 tx=0x7f8a7000ef60 comp rx=0 tx=0).stop 2024-07-24T22:06:28.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.462+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/4135052930 shutdown_connections 2024-07-24T22:06:28.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.462+0000 7f8a7cb8a640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8a600b3c20 0x7f8a600b60e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:28.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.462+0000 7f8a7cb8a640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a78108b20 0x7f8a7819e510 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:28.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.462+0000 7f8a7cb8a640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a781081a0 0x7f8a78199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:28.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.462+0000 7f8a7cb8a640 1 --2- 172.21.15.47:0/4135052930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a78102790 0x7f8a78198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:28.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.462+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/4135052930 >> 172.21.15.47:0/4135052930 conn(0x7f8a780fe200 msgr2=0x7f8a780feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:28.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.463+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/4135052930 shutdown_connections 2024-07-24T22:06:28.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:28.463+0000 7f8a7cb8a640 1 -- 172.21.15.47:0/4135052930 wait complete. 2024-07-24T22:06:29.144 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:06:29.416 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:29 smithi047 ceph-mon[32551]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:29 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/4135052930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:29.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:29 smithi188 ceph-mon[37380]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:29.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:29 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/4135052930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:29.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:29 smithi183 ceph-mon[37007]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:29.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:29 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/4135052930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.018+0000 7fef266c4640 1 -- 172.21.15.47:0/2428270645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef20103f30 msgr2=0x7fef2010c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.018+0000 7fef266c4640 1 --2- 172.21.15.47:0/2428270645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef20103f30 0x7fef2010c510 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fef14009900 tx=0x7fef1402a410 comp rx=0 tx=0).stop 2024-07-24T22:06:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.019+0000 7fef266c4640 1 -- 172.21.15.47:0/2428270645 shutdown_connections 2024-07-24T22:06:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.019+0000 7fef266c4640 1 --2- 172.21.15.47:0/2428270645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef2010cae0 0x7fef2010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.019+0000 7fef266c4640 1 --2- 172.21.15.47:0/2428270645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef20103f30 0x7fef2010c510 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.019+0000 7fef266c4640 1 --2- 172.21.15.47:0/2428270645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef20103530 0x7fef20103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.019+0000 7fef266c4640 1 -- 172.21.15.47:0/2428270645 >> 172.21.15.47:0/2428270645 conn(0x7fef200fd100 msgr2=0x7fef200ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.019+0000 7fef266c4640 1 -- 172.21.15.47:0/2428270645 shutdown_connections 2024-07-24T22:06:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.019+0000 7fef266c4640 1 -- 172.21.15.47:0/2428270645 wait complete. 2024-07-24T22:06:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.020+0000 7fef266c4640 1 Processor -- start 2024-07-24T22:06:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.020+0000 7fef266c4640 1 -- start start 2024-07-24T22:06:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.020+0000 7fef266c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef20103530 0x7fef2019afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.020+0000 7fef266c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef20103f30 0x7fef2019b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.020+0000 7fef266c4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef2010cae0 0x7fef201a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.020+0000 7fef266c4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fef20112820 con 0x7fef20103f30 2024-07-24T22:06:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.020+0000 7fef266c4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fef201126a0 con 0x7fef2010cae0 2024-07-24T22:06:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.020+0000 7fef266c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fef201129a0 con 0x7fef20103530 2024-07-24T22:06:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.020+0000 7fef1f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef20103f30 0x7fef2019b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.020+0000 7fef1f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef20103f30 0x7fef2019b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41108/0 (socket says 172.21.15.47:41108) 2024-07-24T22:06:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.020+0000 7fef1f7fe640 1 -- 172.21.15.47:0/3394646603 learned_addr learned my addr 172.21.15.47:0/3394646603 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.020+0000 7fef24c61640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef2010cae0 0x7fef201a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.021+0000 7fef1ffff640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef20103530 0x7fef2019afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.021+0000 7fef1f7fe640 1 -- 172.21.15.47:0/3394646603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef20103530 msgr2=0x7fef2019afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.021+0000 7fef1f7fe640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef20103530 0x7fef2019afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.021+0000 7fef1f7fe640 1 -- 172.21.15.47:0/3394646603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef2010cae0 msgr2=0x7fef201a0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.021+0000 7fef1f7fe640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef2010cae0 0x7fef201a0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.021+0000 7fef1f7fe640 1 -- 172.21.15.47:0/3394646603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef201a1050 con 0x7fef20103f30 2024-07-24T22:06:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.021+0000 7fef1f7fe640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef20103f30 0x7fef2019b4e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fef14006010 tx=0x7fef140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.021+0000 7fef1d7fa640 1 -- 172.21.15.47:0/3394646603 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1403f030 con 0x7fef20103f30 2024-07-24T22:06:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.021+0000 7fef266c4640 1 -- 172.21.15.47:0/3394646603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef201a12e0 con 0x7fef20103f30 2024-07-24T22:06:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.021+0000 7fef1d7fa640 1 -- 172.21.15.47:0/3394646603 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef14003800 con 0x7fef20103f30 2024-07-24T22:06:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.021+0000 7fef1d7fa640 1 -- 172.21.15.47:0/3394646603 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14035070 con 0x7fef20103f30 2024-07-24T22:06:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.021+0000 7fef266c4640 1 -- 172.21.15.47:0/3394646603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef201a7a00 con 0x7fef20103f30 2024-07-24T22:06:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.022+0000 7fef266c4640 1 -- 172.21.15.47:0/3394646603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef20103990 con 0x7fef20103f30 2024-07-24T22:06:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.024+0000 7fef1d7fa640 1 -- 172.21.15.47:0/3394646603 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fef14003cb0 con 0x7fef20103f30 2024-07-24T22:06:31.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.025+0000 7fef1d7fa640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fef080b3c20 0x7fef080b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:31.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.025+0000 7fef1ffff640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fef080b3c20 0x7fef080b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:31.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.025+0000 7fef1d7fa640 1 -- 172.21.15.47:0/3394646603 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fef14104970 con 0x7fef20103f30 2024-07-24T22:06:31.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.026+0000 7fef1ffff640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fef080b3c20 0x7fef080b60e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fef10009890 tx=0x7fef10008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:31.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.028+0000 7fef1d7fa640 1 -- 172.21.15.47:0/3394646603 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fef140cbe40 con 0x7fef20103f30 2024-07-24T22:06:31.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.265+0000 7fef266c4640 1 -- 172.21.15.47:0/3394646603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef2019c0d0 con 0x7fef20103f30 2024-07-24T22:06:31.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.265+0000 7fef1d7fa640 1 -- 172.21.15.47:0/3394646603 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7fef140cb740 con 0x7fef20103f30 2024-07-24T22:06:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:31.268 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:06:31.268 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:06:31.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.267+0000 7fef266c4640 1 -- 172.21.15.47:0/3394646603 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fef080b3c20 msgr2=0x7fef080b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:31.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.267+0000 7fef266c4640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fef080b3c20 0x7fef080b60e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fef10009890 tx=0x7fef10008040 comp rx=0 tx=0).stop 2024-07-24T22:06:31.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.267+0000 7fef266c4640 1 -- 172.21.15.47:0/3394646603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef20103f30 msgr2=0x7fef2019b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:31.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.267+0000 7fef266c4640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef20103f30 0x7fef2019b4e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fef14006010 tx=0x7fef140042f0 comp rx=0 tx=0).stop 2024-07-24T22:06:31.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.268+0000 7fef266c4640 1 -- 172.21.15.47:0/3394646603 shutdown_connections 2024-07-24T22:06:31.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.268+0000 7fef266c4640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fef080b3c20 0x7fef080b60e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:31.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.268+0000 7fef266c4640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef2010cae0 0x7fef201a0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:31.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.268+0000 7fef266c4640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef20103f30 0x7fef2019b4e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:31.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.268+0000 7fef266c4640 1 --2- 172.21.15.47:0/3394646603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef20103530 0x7fef2019afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:31.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.268+0000 7fef266c4640 1 -- 172.21.15.47:0/3394646603 >> 172.21.15.47:0/3394646603 conn(0x7fef200fd100 msgr2=0x7fef200ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:31.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.268+0000 7fef266c4640 1 -- 172.21.15.47:0/3394646603 shutdown_connections 2024-07-24T22:06:31.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:31.268+0000 7fef266c4640 1 -- 172.21.15.47:0/3394646603 wait complete. 2024-07-24T22:06:31.464 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:31 smithi183 ceph-mon[37007]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:31.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:31 smithi188 ceph-mon[37380]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:31.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:31 smithi047 ceph-mon[32551]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:31.913 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd dump --format=json 2024-07-24T22:06:32.179 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:32.544 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:32 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3394646603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:32.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:32 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3394646603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:32.660 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:32 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3394646603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:33.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:33 smithi047 ceph-mon[32551]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:33.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:33 smithi188 ceph-mon[37380]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:33.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:33 smithi183 ceph-mon[37007]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:33.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.728+0000 7fa88ffff640 1 -- 172.21.15.47:0/1869572357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa890108950 msgr2=0x7fa89010f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:33.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.728+0000 7fa88ffff640 1 --2- 172.21.15.47:0/1869572357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa890108950 0x7fa89010f150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa888009ca0 tx=0x7fa88802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:06:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.728+0000 7fa88ffff640 1 -- 172.21.15.47:0/1869572357 shutdown_connections 2024-07-24T22:06:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.728+0000 7fa88ffff640 1 --2- 172.21.15.47:0/1869572357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa890108950 0x7fa89010f150 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.728+0000 7fa88ffff640 1 --2- 172.21.15.47:0/1869572357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa890107fd0 0x7fa890108410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.728+0000 7fa88ffff640 1 --2- 172.21.15.47:0/1869572357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8901025c0 0x7fa8901029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.728+0000 7fa88ffff640 1 -- 172.21.15.47:0/1869572357 >> 172.21.15.47:0/1869572357 conn(0x7fa8900fe050 msgr2=0x7fa890100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.728+0000 7fa88ffff640 1 -- 172.21.15.47:0/1869572357 shutdown_connections 2024-07-24T22:06:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.728+0000 7fa88ffff640 1 -- 172.21.15.47:0/1869572357 wait complete. 2024-07-24T22:06:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.729+0000 7fa88ffff640 1 Processor -- start 2024-07-24T22:06:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.729+0000 7fa88ffff640 1 -- start start 2024-07-24T22:06:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.729+0000 7fa88ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8901025c0 0x7fa890074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.729+0000 7fa88ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa890107fd0 0x7fa8900753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.729+0000 7fa88ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa890108950 0x7fa890075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.729+0000 7fa88ffff640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8901125e0 con 0x7fa890108950 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.729+0000 7fa88ffff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa890112460 con 0x7fa890107fd0 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.729+0000 7fa88ffff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa890112760 con 0x7fa8901025c0 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.729+0000 7fa88f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa890108950 0x7fa890075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.729+0000 7fa88f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa890108950 0x7fa890075910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41116/0 (socket says 172.21.15.47:41116) 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.729+0000 7fa88f7fe640 1 -- 172.21.15.47:0/3531066028 learned_addr learned my addr 172.21.15.47:0/3531066028 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.729+0000 7fa88effd640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8901025c0 0x7fa890074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.729+0000 7fa88e7fc640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa890107fd0 0x7fa8900753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.730+0000 7fa88f7fe640 1 -- 172.21.15.47:0/3531066028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8901025c0 msgr2=0x7fa890074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.730+0000 7fa88f7fe640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8901025c0 0x7fa890074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.730+0000 7fa88f7fe640 1 -- 172.21.15.47:0/3531066028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa890107fd0 msgr2=0x7fa8900753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.730+0000 7fa88f7fe640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa890107fd0 0x7fa8900753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.730+0000 7fa88f7fe640 1 -- 172.21.15.47:0/3531066028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8901a6dd0 con 0x7fa890108950 2024-07-24T22:06:33.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.730+0000 7fa88f7fe640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa890108950 0x7fa890075910 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa888005cc0 tx=0x7fa88802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:33.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.730+0000 7fa877fff640 1 -- 172.21.15.47:0/3531066028 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888003cf0 con 0x7fa890108950 2024-07-24T22:06:33.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.730+0000 7fa877fff640 1 -- 172.21.15.47:0/3531066028 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8880044f0 con 0x7fa890108950 2024-07-24T22:06:33.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.730+0000 7fa877fff640 1 -- 172.21.15.47:0/3531066028 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88802fc30 con 0x7fa890108950 2024-07-24T22:06:33.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.730+0000 7fa88ffff640 1 -- 172.21.15.47:0/3531066028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8901a7060 con 0x7fa890108950 2024-07-24T22:06:33.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.730+0000 7fa88ffff640 1 -- 172.21.15.47:0/3531066028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8901a7670 con 0x7fa890108950 2024-07-24T22:06:33.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.731+0000 7fa88ffff640 1 -- 172.21.15.47:0/3531066028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8901029a0 con 0x7fa890108950 2024-07-24T22:06:33.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.733+0000 7fa877fff640 1 -- 172.21.15.47:0/3531066028 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fa8880046a0 con 0x7fa890108950 2024-07-24T22:06:33.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.733+0000 7fa877fff640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa8780b3d40 0x7fa8780b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:33.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.733+0000 7fa88effd640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa8780b3d40 0x7fa8780b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:33.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.733+0000 7fa877fff640 1 -- 172.21.15.47:0/3531066028 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa8881054c0 con 0x7fa890108950 2024-07-24T22:06:33.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.734+0000 7fa88effd640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa8780b3d40 0x7fa8780b6200 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa880009990 tx=0x7fa880009110 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:33.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.736+0000 7fa877fff640 1 -- 172.21.15.47:0/3531066028 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fa8880cc9f0 con 0x7fa890108950 2024-07-24T22:06:33.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.931+0000 7fa88ffff640 1 -- 172.21.15.47:0/3531066028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa890076190 con 0x7fa890108950 2024-07-24T22:06:33.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.933+0000 7fa877fff640 1 -- 172.21.15.47:0/3531066028 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23138 (secure 0 0 0) 0x7fa890076190 con 0x7fa890108950 2024-07-24T22:06:33.935 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:33.935 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":85,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","created":"2024-07-24T21:55:28.945912+0000","modified":"2024-07-24T22:05:27.567637+0000","last_up_change":"2024-07-24T22:02:55.044691+0000","last_in_change":"2024-07-24T22:02:35.671256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T21:59:32.066678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T22:03:49.331120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T22:03:52.034826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60de2c3d-e4b7-4878-bdbb-ce3257e3706c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6803","nonce":2665889913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6805","nonce":2665889913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6809","nonce":2665889913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6807","nonce":2665889913}]},"public_addr":"172.21.15.47:6803/2665889913","cluster_addr":"172.21.15.47:6805/2665889913","heartbeat_back_addr":"172.21.15.47:6809/2665889913","heartbeat_front_addr":"172.21.15.47:6807/2665889913","state":["exists","up"]},{"osd":1,"uuid":"7f086675-3bed-47ca-a93f-fab9580068b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6801","nonce":3486494228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6803","nonce":3486494228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6807","nonce":3486494228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6805","nonce":3486494228}]},"public_addr":"172.21.15.183:6801/3486494228","cluster_addr":"172.21.15.183:6803/3486494228","heartbeat_back_addr":"172.21.15.183:6807/3486494228","heartbeat_front_addr":"172.21.15.183:6805/3486494228","state":["exists","up"]},{"osd":2,"uuid":"040fff27-6fa6-48de-9365-fcced8f89e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6801","nonce":2245903281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6803","nonce":2245903281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6807","nonce":2245903281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6805","nonce":2245903281}]},"public_addr":"172.21.15.188:6801/2245903281","cluster_addr":"172.21.15.188:6803/2245903281","heartbeat_back_addr":"172.21.15.188:6807/2245903281","heartbeat_front_addr":"172.21.15.188:6805/2245903281","state":["exists","up"]},{"osd":3,"uuid":"e129321a-9566-4bea-b982-34f7ddd1ae1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6811","nonce":236749130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6813","nonce":236749130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6817","nonce":236749130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6815","nonce":236749130}]},"public_addr":"172.21.15.47:6811/236749130","cluster_addr":"172.21.15.47:6813/236749130","heartbeat_back_addr":"172.21.15.47:6817/236749130","heartbeat_front_addr":"172.21.15.47:6815/236749130","state":["exists","up"]},{"osd":4,"uuid":"f969fba7-b0ff-4ea6-83bd-38aba32b1be1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6809","nonce":3978122107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6811","nonce":3978122107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6815","nonce":3978122107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6813","nonce":3978122107}]},"public_addr":"172.21.15.183:6809/3978122107","cluster_addr":"172.21.15.183:6811/3978122107","heartbeat_back_addr":"172.21.15.183:6815/3978122107","heartbeat_front_addr":"172.21.15.183:6813/3978122107","state":["exists","up"]},{"osd":5,"uuid":"3799c912-3d9f-4efd-9b36-569c385e4c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6809","nonce":2097128083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6811","nonce":2097128083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6815","nonce":2097128083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6813","nonce":2097128083}]},"public_addr":"172.21.15.188:6809/2097128083","cluster_addr":"172.21.15.188:6811/2097128083","heartbeat_back_addr":"172.21.15.188:6815/2097128083","heartbeat_front_addr":"172.21.15.188:6813/2097128083","state":["exists","up"]},{"osd":6,"uuid":"1a38cf12-619f-4e82-a7a5-21ee2014038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6819","nonce":2288252980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6821","nonce":2288252980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6825","nonce":2288252980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6823","nonce":2288252980}]},"public_addr":"172.21.15.47:6819/2288252980","cluster_addr":"172.21.15.47:6821/2288252980","heartbeat_back_addr":"172.21.15.47:6825/2288252980","heartbeat_front_addr":"172.21.15.47:6823/2288252980","state":["exists","up"]},{"osd":7,"uuid":"6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6817","nonce":465426514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6819","nonce":465426514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6823","nonce":465426514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6821","nonce":465426514}]},"public_addr":"172.21.15.183:6817/465426514","cluster_addr":"172.21.15.183:6819/465426514","heartbeat_back_addr":"172.21.15.183:6823/465426514","heartbeat_front_addr":"172.21.15.183:6821/465426514","state":["exists","up"]},{"osd":8,"uuid":"6dfd7252-61a6-423d-8498-cbcfa41ae1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6817","nonce":2247055658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6819","nonce":2247055658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6823","nonce":2247055658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6821","nonce":2247055658}]},"public_addr":"172.21.15.188:6817/2247055658","cluster_addr":"172.21.15.188:6819/2247055658","heartbeat_back_addr":"172.21.15.188:6823/2247055658","heartbeat_front_addr":"172.21.15.188:6821/2247055658","state":["exists","up"]},{"osd":9,"uuid":"abd93c5e-283e-4873-a241-1056f2894116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6827","nonce":2628721884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6829","nonce":2628721884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6833","nonce":2628721884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6831","nonce":2628721884}]},"public_addr":"172.21.15.47:6827/2628721884","cluster_addr":"172.21.15.47:6829/2628721884","heartbeat_back_addr":"172.21.15.47:6833/2628721884","heartbeat_front_addr":"172.21.15.47:6831/2628721884","state":["exists","up"]},{"osd":10,"uuid":"bc967f8f-ce27-4230-be70-e36927f89fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6825","nonce":3509332199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6827","nonce":3509332199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6831","nonce":3509332199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6829","nonce":3509332199}]},"public_addr":"172.21.15.183:6825/3509332199","cluster_addr":"172.21.15.183:6827/3509332199","heartbeat_back_addr":"172.21.15.183:6831/3509332199","heartbeat_front_addr":"172.21.15.183:6829/3509332199","state":["exists","up"]},{"osd":11,"uuid":"8b379865-3a5c-4a2d-aa74-a4f215027fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6825","nonce":3725107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6827","nonce":3725107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6831","nonce":3725107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6829","nonce":3725107101}]},"public_addr":"172.21.15.188:6825/3725107101","cluster_addr":"172.21.15.188:6827/3725107101","heartbeat_back_addr":"172.21.15.188:6831/3725107101","heartbeat_front_addr":"172.21.15.188:6829/3725107101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:58:44.413660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:06.554842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:28.651418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:50.995466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:13.906535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:36.632662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:59.003224+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:21.701327+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:44.017943+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:06.400895+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:29.625920+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:52.323223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3499235566":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/2112533111":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/2714360830":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/507334607":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6800/2524786594":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/1004458106":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6800/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/1046677443":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/899235864":"2024-07-25T21:56:15.044564+0000","172.21.15.47:6800/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/3057769442":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/2596054312":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6801/2524786594":"2024-07-25T21:57:25.995502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T22:06:33.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.935+0000 7fa88ffff640 1 -- 172.21.15.47:0/3531066028 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa8780b3d40 msgr2=0x7fa8780b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:33.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.935+0000 7fa88ffff640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa8780b3d40 0x7fa8780b6200 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa880009990 tx=0x7fa880009110 comp rx=0 tx=0).stop 2024-07-24T22:06:33.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.935+0000 7fa88ffff640 1 -- 172.21.15.47:0/3531066028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa890108950 msgr2=0x7fa890075910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:33.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.935+0000 7fa88ffff640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa890108950 0x7fa890075910 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa888005cc0 tx=0x7fa88802f470 comp rx=0 tx=0).stop 2024-07-24T22:06:33.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.935+0000 7fa88ffff640 1 -- 172.21.15.47:0/3531066028 shutdown_connections 2024-07-24T22:06:33.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.935+0000 7fa88ffff640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa8780b3d40 0x7fa8780b6200 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:33.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.935+0000 7fa88ffff640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa890108950 0x7fa890075910 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:33.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.935+0000 7fa88ffff640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa890107fd0 0x7fa8900753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:33.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.935+0000 7fa88ffff640 1 --2- 172.21.15.47:0/3531066028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8901025c0 0x7fa890074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:33.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.935+0000 7fa88ffff640 1 -- 172.21.15.47:0/3531066028 >> 172.21.15.47:0/3531066028 conn(0x7fa8900fe050 msgr2=0x7fa890100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:33.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.935+0000 7fa88ffff640 1 -- 172.21.15.47:0/3531066028 shutdown_connections 2024-07-24T22:06:33.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:33.935+0000 7fa88ffff640 1 -- 172.21.15.47:0/3531066028 wait complete. 2024-07-24T22:06:34.547 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:34 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3531066028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:06:34.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:34 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3531066028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:06:34.579 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-07-24T22:03:54.960171+0000', 'modified': '2024-07-24T22:04:10.197477+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24628}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24610': {'gid': 24610, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.188:6837/749102233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6836', 'nonce': 749102233}, {'type': 'v1', 'addr': '172.21.15.188:6837', 'nonce': 749102233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24628': {'gid': 24628, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.188:6839/3781670075', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6838', 'nonce': 3781670075}, {'type': 'v1', 'addr': '172.21.15.188:6839', 'nonce': 3781670075}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24628, 'qdb_cluster': [24628]} 2024-07-24T22:06:34.579 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-07-24T22:06:34.579 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.i status 2024-07-24T22:06:34.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:34 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3531066028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:06:34.848 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:35.300 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:35 smithi047 ceph-mon[32551]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:35.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:35 smithi188 ceph-mon[37380]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:35.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:35 smithi183 ceph-mon[37007]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.459+0000 7f947dbdf640 1 -- 172.21.15.47:0/3751204059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9478103fc0 msgr2=0x7f947810c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.459+0000 7f947dbdf640 1 --2- 172.21.15.47:0/3751204059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9478103fc0 0x7f947810c4b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f946c009900 tx=0x7f946c02a410 comp rx=0 tx=0).stop 2024-07-24T22:06:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.459+0000 7f947dbdf640 1 -- 172.21.15.47:0/3751204059 shutdown_connections 2024-07-24T22:06:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.459+0000 7f947dbdf640 1 --2- 172.21.15.47:0/3751204059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f947810cb00 0x7f947810ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.459+0000 7f947dbdf640 1 --2- 172.21.15.47:0/3751204059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9478103fc0 0x7f947810c4b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.459+0000 7f947dbdf640 1 --2- 172.21.15.47:0/3751204059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94781036a0 0x7f9478103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.459+0000 7f947dbdf640 1 -- 172.21.15.47:0/3751204059 >> 172.21.15.47:0/3751204059 conn(0x7f94780fd100 msgr2=0x7f94780ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.459+0000 7f947dbdf640 1 -- 172.21.15.47:0/3751204059 shutdown_connections 2024-07-24T22:06:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.459+0000 7f947dbdf640 1 -- 172.21.15.47:0/3751204059 wait complete. 2024-07-24T22:06:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.459+0000 7f947dbdf640 1 Processor -- start 2024-07-24T22:06:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f947dbdf640 1 -- start start 2024-07-24T22:06:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f947dbdf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94781036a0 0x7f9478101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f947dbdf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9478103fc0 0x7f9478101890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f947dbdf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f947810cb00 0x7f9478101dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f947dbdf640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f94781127b0 con 0x7f94781036a0 2024-07-24T22:06:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f947dbdf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9478112630 con 0x7f947810cb00 2024-07-24T22:06:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f947dbdf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9478112930 con 0x7f9478103fc0 2024-07-24T22:06:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f94777fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94781036a0 0x7f9478101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f94777fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94781036a0 0x7f9478101350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44142/0 (socket says 172.21.15.47:44142) 2024-07-24T22:06:36.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f94777fe640 1 -- 172.21.15.47:0/3382649359 learned_addr learned my addr 172.21.15.47:0/3382649359 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f9476ffd640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9478103fc0 0x7f9478101890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f9477fff640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f947810cb00 0x7f9478101dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f94777fe640 1 -- 172.21.15.47:0/3382649359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9478103fc0 msgr2=0x7f9478101890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f94777fe640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9478103fc0 0x7f9478101890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f94777fe640 1 -- 172.21.15.47:0/3382649359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f947810cb00 msgr2=0x7f9478101dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f94777fe640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f947810cb00 0x7f9478101dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.460+0000 7f94777fe640 1 -- 172.21.15.47:0/3382649359 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94781a70f0 con 0x7f94781036a0 2024-07-24T22:06:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.461+0000 7f94777fe640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94781036a0 0x7f9478101350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f946800c890 tx=0x7f946800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.461+0000 7f9474ff9640 1 -- 172.21.15.47:0/3382649359 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9468004220 con 0x7f94781036a0 2024-07-24T22:06:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.461+0000 7f9474ff9640 1 -- 172.21.15.47:0/3382649359 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94680043c0 con 0x7f94781036a0 2024-07-24T22:06:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.461+0000 7f947dbdf640 1 -- 172.21.15.47:0/3382649359 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94781a73e0 con 0x7f94781036a0 2024-07-24T22:06:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.461+0000 7f9474ff9640 1 -- 172.21.15.47:0/3382649359 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9468004a00 con 0x7f94781036a0 2024-07-24T22:06:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.461+0000 7f947dbdf640 1 -- 172.21.15.47:0/3382649359 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94781a7970 con 0x7f94781036a0 2024-07-24T22:06:36.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.463+0000 7f9474ff9640 1 -- 172.21.15.47:0/3382649359 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7f94680079b0 con 0x7f94781036a0 2024-07-24T22:06:36.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.463+0000 7f947ff90740 1 Processor -- start 2024-07-24T22:06:36.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.463+0000 7f947ff90740 1 -- start start 2024-07-24T22:06:36.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f947ff90740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab3b60 0x564358ab20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f947ff90740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab2600 0x564358ab2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f947ff90740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358abe430 0x564358ac0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f947ff90740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564358a28720 con 0x564358ab3b60 2024-07-24T22:06:36.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f947ff90740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564358a17c20 con 0x564358abe430 2024-07-24T22:06:36.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f947ff90740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564358a1bc60 con 0x564358ab2600 2024-07-24T22:06:36.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f9477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab3b60 0x564358ab20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f9477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab3b60 0x564358ab20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44148/0 (socket says 172.21.15.47:44148) 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f9477fff640 1 -- 172.21.15.47:0/2417007717 learned_addr learned my addr 172.21.15.47:0/2417007717 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f9476ffd640 1 --2- 172.21.15.47:0/2417007717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358abe430 0x564358ac0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f94777fe640 1 --2- 172.21.15.47:0/2417007717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab2600 0x564358ab2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f9477fff640 1 -- 172.21.15.47:0/2417007717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab2600 msgr2=0x564358ab2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f9477fff640 1 --2- 172.21.15.47:0/2417007717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab2600 0x564358ab2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f9477fff640 1 -- 172.21.15.47:0/2417007717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358abe430 msgr2=0x564358ac0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f9477fff640 1 --2- 172.21.15.47:0/2417007717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358abe430 0x564358ac0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f9477fff640 1 -- 172.21.15.47:0/2417007717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643589a11d0 con 0x564358ab3b60 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f9474ff9640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94600b3c20 0x7f94600b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f94777fe640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94600b3c20 0x7f94600b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f9477fff640 1 --2- 172.21.15.47:0/2417007717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab3b60 0x564358ab20c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9470009ef0 tx=0x7f947000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e7c26f5b7f50da server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.464+0000 7f9474ff9640 1 -- 172.21.15.47:0/3382649359 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f94680e3af0 con 0x7f94781036a0 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.465+0000 7f945dffb640 1 -- 172.21.15.47:0/2417007717 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947001a070 con 0x564358ab3b60 2024-07-24T22:06:36.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.465+0000 7f945dffb640 1 -- 172.21.15.47:0/2417007717 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94700158c0 con 0x564358ab3b60 2024-07-24T22:06:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.465+0000 7f945dffb640 1 -- 172.21.15.47:0/2417007717 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947000a820 con 0x564358ab3b60 2024-07-24T22:06:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.465+0000 7f947ff90740 1 -- 172.21.15.47:0/2417007717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab3b60 msgr2=0x564358ab20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.465+0000 7f947ff90740 1 --2- 172.21.15.47:0/2417007717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab3b60 0x564358ab20c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9470009ef0 tx=0x7f947000c7f0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.465+0000 7f94777fe640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94600b3c20 0x7f94600b60e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f94680e1840 tx=0x7f9468000bc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.465+0000 7f947ff90740 1 -- 172.21.15.47:0/2417007717 shutdown_connections 2024-07-24T22:06:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.465+0000 7f947ff90740 1 --2- 172.21.15.47:0/2417007717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358abe430 0x564358ac0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.465+0000 7f947ff90740 1 --2- 172.21.15.47:0/2417007717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab2600 0x564358ab2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.465+0000 7f947ff90740 1 --2- 172.21.15.47:0/2417007717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab3b60 0x564358ab20c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.466+0000 7f947ff90740 1 -- 172.21.15.47:0/2417007717 >> 172.21.15.47:0/2417007717 conn(0x564358a506a0 msgr2=0x564358aafef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.466+0000 7f947ff90740 1 -- 172.21.15.47:0/2417007717 shutdown_connections 2024-07-24T22:06:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.466+0000 7f947ff90740 1 -- 172.21.15.47:0/2417007717 wait complete. 2024-07-24T22:06:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.466+0000 7f947ff90740 1 -- start start 2024-07-24T22:06:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.466+0000 7f947ff90740 1 Processor -- start 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.466+0000 7f947ff90740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 0x564358abdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.466+0000 7f947ff90740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358ab3b60 0x564358abb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.466+0000 7f947ff90740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358abe430 0x564358abb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.466+0000 7f947ff90740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56435887b5f0 con 0x564358ab2600 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.466+0000 7f947ff90740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5643589ba4a0 con 0x564358ab3b60 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.466+0000 7f947ff90740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564358ac1250 con 0x564358abe430 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.466+0000 7f947ff90740 10 client.0 _ll_register_callbacks cb 0x564358a100a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 0x564358abdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 0x564358abdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44160/0 (socket says 172.21.15.47:44160) 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9477fff640 1 -- 172.21.15.47:0/3092393949 learned_addr learned my addr 172.21.15.47:0/3092393949 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9476ffd640 1 --2- 172.21.15.47:0/3092393949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358ab3b60 0x564358abb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9477fff640 1 --2- 172.21.15.47:0/3092393949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358abe430 0x564358abb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9477fff640 1 -- 172.21.15.47:0/3092393949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358abe430 msgr2=0x564358abb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9477fff640 1 --2- 172.21.15.47:0/3092393949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358abe430 0x564358abb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9477fff640 1 -- 172.21.15.47:0/3092393949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358ab3b60 msgr2=0x564358abb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9477fff640 1 --2- 172.21.15.47:0/3092393949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358ab3b60 0x564358abb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9477fff640 1 -- 172.21.15.47:0/3092393949 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643589ad530 con 0x564358ab2600 2024-07-24T22:06:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9477fff640 1 --2- 172.21.15.47:0/3092393949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 0x564358abdb80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f947000cfa0 tx=0x7f947000a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e042e1f31028b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:06:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9456ffd640 1 -- 172.21.15.47:0/3092393949 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470028060 con 0x564358ab2600 2024-07-24T22:06:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9456ffd640 1 -- 172.21.15.47:0/3092393949 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f947000a5a0 con 0x564358ab2600 2024-07-24T22:06:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f947ff90740 1 -- 172.21.15.47:0/3092393949 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94700158c0 con 0x564358ab2600 2024-07-24T22:06:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f9456ffd640 1 -- 172.21.15.47:0/3092393949 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f947001a050 con 0x564358ab2600 2024-07-24T22:06:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f947ff90740 10 client.15207 fetch_fsmap learned FSMap version 20 2024-07-24T22:06:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.467+0000 7f947ff90740 1 -- 172.21.15.47:0/3092393949 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564358778540 con 0x564358ab2600 2024-07-24T22:06:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.468+0000 7f9456ffd640 1 -- 172.21.15.47:0/3092393949 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94700158c0 con 0x564358ab2600 2024-07-24T22:06:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.468+0000 7f9456ffd640 1 -- 172.21.15.47:0/3092393949 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9470020720 con 0x564358ab2600 2024-07-24T22:06:36.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.468+0000 7f947ff90740 10 client.15207 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:06:36.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.468+0000 7f947ff90740 10 client.15207 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-24T22:06:36.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.468+0000 7f947ff90740 20 client.15207 populate_metadata read hostname 'smithi047' 2024-07-24T22:06:36.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.468+0000 7f947ff90740 1 --2- 172.21.15.47:0/3092393949 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564358aceb20 0x564358acfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.468+0000 7f947ff90740 4 client.15207 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:06:36.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.468+0000 7f947ff90740 1 -- 172.21.15.47:0/3092393949 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564358a2a670 con 0x564358aceb20 2024-07-24T22:06:36.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.468+0000 7f9476ffd640 1 --2- 172.21.15.47:0/3092393949 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564358aceb20 0x564358acfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.469+0000 7f9476ffd640 1 --2- 172.21.15.47:0/3092393949 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564358aceb20 0x564358acfef0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=626e342b588ec2a3 server_cookie=97e27507495b1202 in_seq=0 out_seq=0 2024-07-24T22:06:36.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.469+0000 7f9456ffd640 10 client.15207 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:06:36.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.469+0000 7f9456ffd640 1 -- 172.21.15.47:0/3092393949 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564358a2a670 con 0x564358aceb20 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.469+0000 7f9456ffd640 10 client.15207 handle_command_reply: tid=0 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.469+0000 7f947ff90740 1 client.15207 shutdown 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.470+0000 7f947ff90740 1 -- 172.21.15.47:0/3092393949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 msgr2=0x564358abdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.470+0000 7f947ff90740 1 --2- 172.21.15.47:0/3092393949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 0x564358abdb80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f947000cfa0 tx=0x7f947000a400 comp rx=0 tx=0).stop 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.470+0000 7f947ff90740 1 -- 172.21.15.47:0/3092393949 shutdown_connections 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.470+0000 7f947ff90740 1 --2- 172.21.15.47:0/3092393949 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564358aceb20 0x564358acfef0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.470+0000 7f947ff90740 1 --2- 172.21.15.47:0/3092393949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358abe430 0x564358abb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.470+0000 7f947ff90740 1 --2- 172.21.15.47:0/3092393949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358ab3b60 0x564358abb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.470+0000 7f947ff90740 1 --2- 172.21.15.47:0/3092393949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 0x564358abdb80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.470+0000 7f947ff90740 1 -- 172.21.15.47:0/3092393949 >> 172.21.15.47:0/3092393949 conn(0x564358a506a0 msgr2=0x564358ab5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.470+0000 7f9456ffd640 0 client.15207 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.470+0000 7f947ff90740 1 -- 172.21.15.47:0/3092393949 shutdown_connections 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.470+0000 7f947ff90740 1 -- 172.21.15.47:0/3092393949 wait complete. 2024-07-24T22:06:36.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.470+0000 7f947ff90740 20 client.15207 trim_cache size 0 max 16384 2024-07-24T22:06:36.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f947ff90740 1 Processor -- start 2024-07-24T22:06:36.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f947ff90740 1 -- start start 2024-07-24T22:06:36.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f947ff90740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358ab2600 0x564358aaaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f947ff90740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab3b60 0x564358aafe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f947ff90740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358abe430 0x564358ab1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f947ff90740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564358ace520 con 0x564358abe430 2024-07-24T22:06:36.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f947ff90740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564358ace9a0 con 0x564358ab2600 2024-07-24T22:06:36.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f947ff90740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564358acefd0 con 0x564358ab3b60 2024-07-24T22:06:36.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f9477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358abe430 0x564358ab1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f9477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358abe430 0x564358ab1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44168/0 (socket says 172.21.15.47:44168) 2024-07-24T22:06:36.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f9477fff640 1 -- 172.21.15.47:0/1405494167 learned_addr learned my addr 172.21.15.47:0/1405494167 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:36.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f9477fff640 1 --2- 172.21.15.47:0/1405494167 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358ab2600 0x564358aaaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f9476ffd640 1 --2- 172.21.15.47:0/1405494167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab3b60 0x564358aafe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f9477fff640 1 -- 172.21.15.47:0/1405494167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab3b60 msgr2=0x564358aafe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f9477fff640 1 --2- 172.21.15.47:0/1405494167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab3b60 0x564358aafe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f9477fff640 1 -- 172.21.15.47:0/1405494167 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358ab2600 msgr2=0x564358aaaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f9477fff640 1 --2- 172.21.15.47:0/1405494167 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358ab2600 0x564358aaaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f9477fff640 1 -- 172.21.15.47:0/1405494167 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564358ab37a0 con 0x564358abe430 2024-07-24T22:06:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.489+0000 7f9476ffd640 1 --2- 172.21.15.47:0/1405494167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab3b60 0x564358aafe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:06:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.490+0000 7f9477fff640 1 --2- 172.21.15.47:0/1405494167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358abe430 0x564358ab1be0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9470004b90 tx=0x7f9470009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b47ba38b7112c3 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.490+0000 7f945d7fa640 1 -- 172.21.15.47:0/1405494167 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470028020 con 0x564358abe430 2024-07-24T22:06:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.490+0000 7f945d7fa640 1 -- 172.21.15.47:0/1405494167 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94700157f0 con 0x564358abe430 2024-07-24T22:06:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.490+0000 7f945d7fa640 1 -- 172.21.15.47:0/1405494167 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947002b910 con 0x564358abe430 2024-07-24T22:06:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.490+0000 7f947ff90740 1 -- 172.21.15.47:0/1405494167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358abe430 msgr2=0x564358ab1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.490+0000 7f947ff90740 1 --2- 172.21.15.47:0/1405494167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358abe430 0x564358ab1be0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9470004b90 tx=0x7f9470009390 comp rx=0 tx=0).stop 2024-07-24T22:06:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.490+0000 7f947ff90740 1 -- 172.21.15.47:0/1405494167 shutdown_connections 2024-07-24T22:06:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.490+0000 7f947ff90740 1 --2- 172.21.15.47:0/1405494167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358abe430 0x564358ab1be0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.490+0000 7f947ff90740 1 --2- 172.21.15.47:0/1405494167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab3b60 0x564358aafe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.490+0000 7f947ff90740 1 --2- 172.21.15.47:0/1405494167 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358ab2600 0x564358aaaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.490+0000 7f947ff90740 1 -- 172.21.15.47:0/1405494167 >> 172.21.15.47:0/1405494167 conn(0x564358a506a0 msgr2=0x564358abc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.490+0000 7f947ff90740 1 -- 172.21.15.47:0/1405494167 shutdown_connections 2024-07-24T22:06:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.490+0000 7f947ff90740 1 -- 172.21.15.47:0/1405494167 wait complete. 2024-07-24T22:06:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.491+0000 7f947ff90740 1 -- start start 2024-07-24T22:06:36.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.491+0000 7f947ff90740 1 Processor -- start 2024-07-24T22:06:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.491+0000 7f947ff90740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 0x564358ad7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.491+0000 7f947ff90740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab3b60 0x564358ad7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.491+0000 7f947ff90740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358abe430 0x564358ad7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.491+0000 7f947ff90740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564358acfd70 con 0x564358ab2600 2024-07-24T22:06:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.491+0000 7f947ff90740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564358acf6a0 con 0x564358abe430 2024-07-24T22:06:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.491+0000 7f947ff90740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564358ad0440 con 0x564358ab3b60 2024-07-24T22:06:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.491+0000 7f947ff90740 10 client.0 _ll_register_callbacks cb 0x7f9470018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:06:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.491+0000 7f9477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 0x564358ad7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.491+0000 7f9477fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 0x564358ad7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44174/0 (socket says 172.21.15.47:44174) 2024-07-24T22:06:36.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.491+0000 7f9477fff640 1 -- 172.21.15.47:0/3361230688 learned_addr learned my addr 172.21.15.47:0/3361230688 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f9477fff640 1 --2- 172.21.15.47:0/3361230688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358abe430 0x564358ad7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f9476ffd640 1 --2- 172.21.15.47:0/3361230688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab3b60 0x564358ad7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f9477fff640 1 -- 172.21.15.47:0/3361230688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab3b60 msgr2=0x564358ad7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f9477fff640 1 --2- 172.21.15.47:0/3361230688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab3b60 0x564358ad7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f9477fff640 1 -- 172.21.15.47:0/3361230688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358abe430 msgr2=0x564358ad7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f9477fff640 1 --2- 172.21.15.47:0/3361230688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358abe430 0x564358ad7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f9477fff640 1 -- 172.21.15.47:0/3361230688 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564358ad81e0 con 0x564358ab2600 2024-07-24T22:06:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f9477fff640 1 --2- 172.21.15.47:0/3361230688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 0x564358ad7050 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9470002230 tx=0x7f947002b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d87ab3215dcc4c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f9456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:06:36.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f9456ffd640 1 -- 172.21.15.47:0/3361230688 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470028040 con 0x564358ab2600 2024-07-24T22:06:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f9456ffd640 1 -- 172.21.15.47:0/3361230688 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f947002b8a0 con 0x564358ab2600 2024-07-24T22:06:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f947ff90740 1 -- 172.21.15.47:0/3361230688 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94700157f0 con 0x564358ab2600 2024-07-24T22:06:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f9456ffd640 1 -- 172.21.15.47:0/3361230688 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f947000ccf0 con 0x564358ab2600 2024-07-24T22:06:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f947ff90740 10 client.15213 fetch_fsmap learned FSMap version 20 2024-07-24T22:06:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f947ff90740 1 -- 172.21.15.47:0/3361230688 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564358ab76c0 con 0x564358ab2600 2024-07-24T22:06:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.492+0000 7f9456ffd640 1 -- 172.21.15.47:0/3361230688 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94700157f0 con 0x564358ab2600 2024-07-24T22:06:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.493+0000 7f9456ffd640 1 -- 172.21.15.47:0/3361230688 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9470036960 con 0x564358ab2600 2024-07-24T22:06:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.493+0000 7f947ff90740 10 client.15213 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:06:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.493+0000 7f947ff90740 10 client.15213 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-24T22:06:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.493+0000 7f947ff90740 20 client.15213 populate_metadata read hostname 'smithi047' 2024-07-24T22:06:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.493+0000 7f947ff90740 1 --2- 172.21.15.47:0/3361230688 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564358b3ddf0 0x564358b3cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.493+0000 7f947ff90740 4 client.15213 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-24T22:06:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.493+0000 7f947ff90740 1 -- 172.21.15.47:0/3361230688 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "status"}) -- 0x564358a26110 con 0x564358b3ddf0 2024-07-24T22:06:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.493+0000 7f9476ffd640 1 --2- 172.21.15.47:0/3361230688 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564358b3ddf0 0x564358b3cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.493+0000 7f9476ffd640 1 --2- 172.21.15.47:0/3361230688 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564358b3ddf0 0x564358b3cb00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a15f3228dc31ebec server_cookie=a33964f40d42bf26 in_seq=0 out_seq=0 2024-07-24T22:06:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.493+0000 7f9456ffd640 10 client.15213 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:06:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f9456ffd640 1 -- 172.21.15.47:0/3361230688 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564358a26110 con 0x564358b3ddf0 2024-07-24T22:06:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f9456ffd640 10 client.15213 handle_command_reply: tid=0 2024-07-24T22:06:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947ff90740 1 client.15213 shutdown 2024-07-24T22:06:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947ff90740 1 -- 172.21.15.47:0/3361230688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 msgr2=0x564358ad7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947ff90740 1 --2- 172.21.15.47:0/3361230688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 0x564358ad7050 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9470002230 tx=0x7f947002b590 comp rx=0 tx=0).stop 2024-07-24T22:06:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947ff90740 1 -- 172.21.15.47:0/3361230688 shutdown_connections 2024-07-24T22:06:36.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947ff90740 1 --2- 172.21.15.47:0/3361230688 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564358b3ddf0 0x564358b3cb00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947ff90740 1 --2- 172.21.15.47:0/3361230688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564358abe430 0x564358ad7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947ff90740 1 --2- 172.21.15.47:0/3361230688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564358ab3b60 0x564358ad7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947ff90740 1 --2- 172.21.15.47:0/3361230688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564358ab2600 0x564358ad7050 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947ff90740 1 -- 172.21.15.47:0/3361230688 >> 172.21.15.47:0/3361230688 conn(0x564358a506a0 msgr2=0x564358abcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:36.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f9456ffd640 0 client.15213 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:06:36.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947ff90740 1 -- 172.21.15.47:0/3361230688 shutdown_connections 2024-07-24T22:06:36.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947ff90740 1 -- 172.21.15.47:0/3361230688 wait complete. 2024-07-24T22:06:36.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947ff90740 20 client.15213 trim_cache size 0 max 16384 2024-07-24T22:06:36.503 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:06:36.504 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "46bf760a-4a07-11ef-bcad-c7b262605968", 2024-07-24T22:06:36.504 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-07-24T22:06:36.504 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24628, 2024-07-24T22:06:36.504 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-07-24T22:06:36.504 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-07-24T22:06:36.504 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-07-24T22:06:36.504 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 161.09223839399999, 2024-07-24T22:06:36.504 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 20, 2024-07-24T22:06:36.504 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 85, 2024-07-24T22:06:36.504 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 81, 2024-07-24T22:06:36.504 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 186.41375616900001 2024-07-24T22:06:36.504 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:06:36.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947dbdf640 1 -- 172.21.15.47:0/3382649359 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94600b3c20 msgr2=0x7f94600b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:36.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947dbdf640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94600b3c20 0x7f94600b60e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f94680e1840 tx=0x7f9468000bc0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947dbdf640 1 -- 172.21.15.47:0/3382649359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94781036a0 msgr2=0x7f9478101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:36.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.494+0000 7f947dbdf640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94781036a0 0x7f9478101350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f946800c890 tx=0x7f946800cd50 comp rx=0 tx=0).stop 2024-07-24T22:06:36.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.495+0000 7f947dbdf640 1 -- 172.21.15.47:0/3382649359 shutdown_connections 2024-07-24T22:06:36.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.495+0000 7f947dbdf640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94600b3c20 0x7f94600b60e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.495+0000 7f947dbdf640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f947810cb00 0x7f9478101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.495+0000 7f947dbdf640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9478103fc0 0x7f9478101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.495+0000 7f947dbdf640 1 --2- 172.21.15.47:0/3382649359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94781036a0 0x7f9478101350 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:36.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.495+0000 7f947dbdf640 1 -- 172.21.15.47:0/3382649359 >> 172.21.15.47:0/3382649359 conn(0x7f94780fd100 msgr2=0x7f94780fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:36.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.495+0000 7f947dbdf640 1 -- 172.21.15.47:0/3382649359 shutdown_connections 2024-07-24T22:06:36.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:36.495+0000 7f947dbdf640 1 -- 172.21.15.47:0/3382649359 wait complete. 2024-07-24T22:06:37.298 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:37 smithi047 ceph-mon[32551]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:37.332 INFO:teuthology.run_tasks:Running task sequential... 2024-07-24T22:06:37.342 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-07-24T22:06:37.342 INFO:teuthology.task.sequential:In sequential, running task print... 2024-07-24T22:06:37.343 INFO:teuthology.task.print:Enabling mgr modules 2024-07-24T22:06:37.343 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-07-24T22:06:37.344 INFO:teuthology.task.exec:Executing custom commands... 2024-07-24T22:06:37.344 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-07-24T22:06:37.344 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-07-24T22:06:37.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.456+0000 7fa5025e3640 1 -- 172.21.15.47:0/3055382647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4fc1015e0 msgr2=0x7fa4fc1019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:37.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.456+0000 7fa5025e3640 1 --2- 172.21.15.47:0/3055382647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4fc1015e0 0x7fa4fc1019c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec009900 tx=0x7fa4ec02a410 comp rx=0 tx=0).stop 2024-07-24T22:06:37.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.456+0000 7fa5025e3640 1 -- 172.21.15.47:0/3055382647 shutdown_connections 2024-07-24T22:06:37.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.456+0000 7fa5025e3640 1 --2- 172.21.15.47:0/3055382647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4fc107910 0x7fa4fc10e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:37.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.456+0000 7fa5025e3640 1 --2- 172.21.15.47:0/3055382647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4fc106f90 0x7fa4fc1073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:37.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.456+0000 7fa5025e3640 1 --2- 172.21.15.47:0/3055382647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4fc1015e0 0x7fa4fc1019c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:37.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.456+0000 7fa5025e3640 1 -- 172.21.15.47:0/3055382647 >> 172.21.15.47:0/3055382647 conn(0x7fa4fc0782e0 msgr2=0x7fa4fc0ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:37.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.456+0000 7fa5025e3640 1 -- 172.21.15.47:0/3055382647 shutdown_connections 2024-07-24T22:06:37.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.456+0000 7fa5025e3640 1 -- 172.21.15.47:0/3055382647 wait complete. 2024-07-24T22:06:37.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.457+0000 7fa5025e3640 1 Processor -- start 2024-07-24T22:06:37.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.457+0000 7fa5025e3640 1 -- start start 2024-07-24T22:06:37.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.457+0000 7fa5025e3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4fc1015e0 0x7fa4fc0fd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:37.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.457+0000 7fa5025e3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4fc106f90 0x7fa4fc0fdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:37.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.457+0000 7fa5025e3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4fc107910 0x7fa4fc0fe200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:37.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.457+0000 7fa5025e3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc111560 con 0x7fa4fc106f90 2024-07-24T22:06:37.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.457+0000 7fa5025e3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc1113e0 con 0x7fa4fc1015e0 2024-07-24T22:06:37.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.457+0000 7fa5025e3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc1116e0 con 0x7fa4fc107910 2024-07-24T22:06:37.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.457+0000 7fa4fb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4fc106f90 0x7fa4fc0fdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:37.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.457+0000 7fa4fb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4fc106f90 0x7fa4fc0fdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44204/0 (socket says 172.21.15.47:44204) 2024-07-24T22:06:37.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.457+0000 7fa4fb7fe640 1 -- 172.21.15.47:0/2898888961 learned_addr learned my addr 172.21.15.47:0/2898888961 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:37.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa4fbfff640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4fc1015e0 0x7fa4fc0fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:37.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa500b80640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4fc107910 0x7fa4fc0fe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:37.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa4fb7fe640 1 -- 172.21.15.47:0/2898888961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4fc107910 msgr2=0x7fa4fc0fe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:37.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa4fb7fe640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4fc107910 0x7fa4fc0fe200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:37.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa4fb7fe640 1 -- 172.21.15.47:0/2898888961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4fc1015e0 msgr2=0x7fa4fc0fd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:37.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa4fb7fe640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4fc1015e0 0x7fa4fc0fd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:37.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa4fb7fe640 1 -- 172.21.15.47:0/2898888961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc1a6f60 con 0x7fa4fc106f90 2024-07-24T22:06:37.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa500b80640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4fc107910 0x7fa4fc0fe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:06:37.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa4fb7fe640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4fc106f90 0x7fa4fc0fdcc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000c920 tx=0x7fa4f000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:37.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa4f97fa640 1 -- 172.21.15.47:0/2898888961 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0007c70 con 0x7fa4fc106f90 2024-07-24T22:06:37.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa4f97fa640 1 -- 172.21.15.47:0/2898888961 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4f0007e10 con 0x7fa4fc106f90 2024-07-24T22:06:37.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa5025e3640 1 -- 172.21.15.47:0/2898888961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4fc1a7250 con 0x7fa4fc106f90 2024-07-24T22:06:37.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa4f97fa640 1 -- 172.21.15.47:0/2898888961 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0018820 con 0x7fa4fc106f90 2024-07-24T22:06:37.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.458+0000 7fa5025e3640 1 -- 172.21.15.47:0/2898888961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4fc1a77a0 con 0x7fa4fc106f90 2024-07-24T22:06:37.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.459+0000 7fa5025e3640 1 -- 172.21.15.47:0/2898888961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4fc1019c0 con 0x7fa4fc106f90 2024-07-24T22:06:37.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.460+0000 7fa4f97fa640 1 -- 172.21.15.47:0/2898888961 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 22) ==== 151076+0+0 (secure 0 0 0) 0x7fa4f000f450 con 0x7fa4fc106f90 2024-07-24T22:06:37.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.462+0000 7fa4f97fa640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa4e40b3c20 0x7fa4e40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:37.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.462+0000 7fa4fbfff640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa4e40b3c20 0x7fa4e40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:37.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.462+0000 7fa4f97fa640 1 -- 172.21.15.47:0/2898888961 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa4f00e41b0 con 0x7fa4fc106f90 2024-07-24T22:06:37.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.462+0000 7fa4fbfff640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa4e40b3c20 0x7fa4e40b60e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec031440 tx=0x7fa4ec005b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:37.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.465+0000 7fa4f97fa640 1 -- 172.21.15.47:0/2898888961 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fa4f0014030 con 0x7fa4fc106f90 2024-07-24T22:06:37.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:37 smithi188 ceph-mon[37380]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:37.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:37 smithi183 ceph-mon[37007]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:37.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:37.711+0000 7fa5025e3640 1 -- 172.21.15.47:0/2898888961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fa4fc1a7bc0 con 0x7fa4fc106f90 2024-07-24T22:06:38.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:38.215+0000 7fa4f97fa640 1 -- 172.21.15.47:0/2898888961 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 module 'snap_schedule' is already enabled v23) ==== 133+0+0 (secure 0 0 0) 0x7fa4f00ab710 con 0x7fa4fc106f90 2024-07-24T22:06:38.217 INFO:teuthology.orchestra.run.smithi047.stderr:module 'snap_schedule' is already enabled 2024-07-24T22:06:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:38.217+0000 7fa5025e3640 1 -- 172.21.15.47:0/2898888961 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa4e40b3c20 msgr2=0x7fa4e40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:38.217+0000 7fa5025e3640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa4e40b3c20 0x7fa4e40b60e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec031440 tx=0x7fa4ec005b50 comp rx=0 tx=0).stop 2024-07-24T22:06:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:38.217+0000 7fa5025e3640 1 -- 172.21.15.47:0/2898888961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4fc106f90 msgr2=0x7fa4fc0fdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:38.217+0000 7fa5025e3640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4fc106f90 0x7fa4fc0fdcc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000c920 tx=0x7fa4f000cde0 comp rx=0 tx=0).stop 2024-07-24T22:06:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:38.217+0000 7fa5025e3640 1 -- 172.21.15.47:0/2898888961 shutdown_connections 2024-07-24T22:06:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:38.217+0000 7fa5025e3640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa4e40b3c20 0x7fa4e40b60e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:38.217+0000 7fa5025e3640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4fc107910 0x7fa4fc0fe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:38.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:38.217+0000 7fa5025e3640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4fc106f90 0x7fa4fc0fdcc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:38.217+0000 7fa5025e3640 1 --2- 172.21.15.47:0/2898888961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4fc1015e0 0x7fa4fc0fd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:38.217+0000 7fa5025e3640 1 -- 172.21.15.47:0/2898888961 >> 172.21.15.47:0/2898888961 conn(0x7fa4fc0782e0 msgr2=0x7fa4fc0fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:38.217+0000 7fa5025e3640 1 -- 172.21.15.47:0/2898888961 shutdown_connections 2024-07-24T22:06:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:38.217+0000 7fa5025e3640 1 -- 172.21.15.47:0/2898888961 wait complete. 2024-07-24T22:06:38.239 INFO:teuthology.run_tasks:Running task kclient... 2024-07-24T22:06:38.265 INFO:tasks.kclient:Mounting kernel clients... 2024-07-24T22:06:38.265 INFO:tasks.kclient:config is {'client.0': {}} 2024-07-24T22:06:38.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:06:38.266 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-07-24T22:06:38.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:06:38.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-07-24T22:06:38.351 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-07-24T22:06:38.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T22:06:38.353 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-07-24T22:06:38.353 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-07-24T22:06:38.353 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-24T22:06:38.353 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs ls 2024-07-24T22:06:38.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:38 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2898888961' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-24T22:06:38.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:38 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2898888961' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-24T22:06:38.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:38 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2898888961' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-07-24T22:06:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:39.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:39 smithi188 ceph-mon[37380]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:39.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:39 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2898888961' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-07-24T22:06:39.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:39 smithi188 ceph-mon[37380]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-07-24T22:06:39.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:39 smithi183 ceph-mon[37007]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:39.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:39 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2898888961' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-07-24T22:06:39.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:39 smithi183 ceph-mon[37007]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-07-24T22:06:39.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:39 smithi047 ceph-mon[32551]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:39.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:39 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2898888961' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-07-24T22:06:39.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:39 smithi047 ceph-mon[32551]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-07-24T22:06:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.349+0000 7f66c6def640 1 -- 172.21.15.47:0/3656165907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c0102790 msgr2=0x7f66c0102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.349+0000 7f66c6def640 1 --2- 172.21.15.47:0/3656165907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c0102790 0x7f66c0102b70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009900 tx=0x7f66b002a400 comp rx=0 tx=0).stop 2024-07-24T22:06:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.349+0000 7f66c6def640 1 -- 172.21.15.47:0/3656165907 shutdown_connections 2024-07-24T22:06:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.349+0000 7f66c6def640 1 --2- 172.21.15.47:0/3656165907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c0108b20 0x7f66c010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.349+0000 7f66c6def640 1 --2- 172.21.15.47:0/3656165907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66c01081a0 0x7f66c01085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.349+0000 7f66c6def640 1 --2- 172.21.15.47:0/3656165907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c0102790 0x7f66c0102b70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.349+0000 7f66c6def640 1 -- 172.21.15.47:0/3656165907 >> 172.21.15.47:0/3656165907 conn(0x7f66c00fe200 msgr2=0x7f66c0100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.349+0000 7f66c6def640 1 -- 172.21.15.47:0/3656165907 shutdown_connections 2024-07-24T22:06:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.349+0000 7f66c6def640 1 -- 172.21.15.47:0/3656165907 wait complete. 2024-07-24T22:06:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.350+0000 7f66c6def640 1 Processor -- start 2024-07-24T22:06:40.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.350+0000 7f66c6def640 1 -- start start 2024-07-24T22:06:40.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.350+0000 7f66c6def640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c0102790 0x7f66c0198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:40.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.350+0000 7f66c6def640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c01081a0 0x7f66c01992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:40.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.350+0000 7f66c6def640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66c0108b20 0x7f66c019e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:40.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.350+0000 7f66c6def640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0112820 con 0x7f66c0102790 2024-07-24T22:06:40.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.350+0000 7f66c6def640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f66c01126a0 con 0x7f66c01081a0 2024-07-24T22:06:40.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.350+0000 7f66c6def640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f66c01129a0 con 0x7f66c0108b20 2024-07-24T22:06:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.350+0000 7f66c4b8b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c0102790 0x7f66c0198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.350+0000 7f66c4b8b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c0102790 0x7f66c0198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44218/0 (socket says 172.21.15.47:44218) 2024-07-24T22:06:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.350+0000 7f66c4b8b640 1 -- 172.21.15.47:0/3963336439 learned_addr learned my addr 172.21.15.47:0/3963336439 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.350+0000 7f66bffff640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c01081a0 0x7f66c01992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.351+0000 7f66c538c640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66c0108b20 0x7f66c019e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.351+0000 7f66c4b8b640 1 -- 172.21.15.47:0/3963336439 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66c0108b20 msgr2=0x7f66c019e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.351+0000 7f66c4b8b640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66c0108b20 0x7f66c019e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.351+0000 7f66c4b8b640 1 -- 172.21.15.47:0/3963336439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c01081a0 msgr2=0x7f66c01992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.351+0000 7f66c4b8b640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c01081a0 0x7f66c01992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.351+0000 7f66c4b8b640 1 -- 172.21.15.47:0/3963336439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c019ee60 con 0x7f66c0102790 2024-07-24T22:06:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.351+0000 7f66c4b8b640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c0102790 0x7f66c0198db0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f66b0006010 tx=0x7f66b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.351+0000 7f66bdffb640 1 -- 172.21.15.47:0/3963336439 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b003f030 con 0x7f66c0102790 2024-07-24T22:06:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.351+0000 7f66c6def640 1 -- 172.21.15.47:0/3963336439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c019f0f0 con 0x7f66c0102790 2024-07-24T22:06:40.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.351+0000 7f66bdffb640 1 -- 172.21.15.47:0/3963336439 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66b0003800 con 0x7f66c0102790 2024-07-24T22:06:40.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.351+0000 7f66bdffb640 1 -- 172.21.15.47:0/3963336439 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0035070 con 0x7f66c0102790 2024-07-24T22:06:40.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.351+0000 7f66c6def640 1 -- 172.21.15.47:0/3963336439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c01a5810 con 0x7f66c0102790 2024-07-24T22:06:40.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.353+0000 7f66c6def640 1 -- 172.21.15.47:0/3963336439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c0102bf0 con 0x7f66c0102790 2024-07-24T22:06:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.354+0000 7f66bdffb640 1 -- 172.21.15.47:0/3963336439 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f66b0003cb0 con 0x7f66c0102790 2024-07-24T22:06:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.355+0000 7f66bdffb640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f66a80b3c20 0x7f66a80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.355+0000 7f66bffff640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f66a80b3c20 0x7f66a80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.355+0000 7f66bdffb640 1 -- 172.21.15.47:0/3963336439 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f66b0104860 con 0x7f66c0102790 2024-07-24T22:06:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.355+0000 7f66bffff640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f66a80b3c20 0x7f66a80b60e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f66c0107cd0 tx=0x7f66b4009110 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:40.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.358+0000 7f66bdffb640 1 -- 172.21.15.47:0/3963336439 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f66b00cbd90 con 0x7f66c0102790 2024-07-24T22:06:40.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.594+0000 7f66c6def640 1 -- 172.21.15.47:0/3963336439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f66c0199ee0 con 0x7f66c0102790 2024-07-24T22:06:40.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.594+0000 7f66bdffb640 1 -- 172.21.15.47:0/3963336439 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7f66c0199ee0 con 0x7f66c0102790 2024-07-24T22:06:40.596 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-07-24T22:06:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.596+0000 7f66c6def640 1 -- 172.21.15.47:0/3963336439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f66a80b3c20 msgr2=0x7f66a80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.596+0000 7f66c6def640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f66a80b3c20 0x7f66a80b60e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f66c0107cd0 tx=0x7f66b4009110 comp rx=0 tx=0).stop 2024-07-24T22:06:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.596+0000 7f66c6def640 1 -- 172.21.15.47:0/3963336439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c0102790 msgr2=0x7f66c0198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:40.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.596+0000 7f66c6def640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c0102790 0x7f66c0198db0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f66b0006010 tx=0x7f66b00042f0 comp rx=0 tx=0).stop 2024-07-24T22:06:40.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.596+0000 7f66c6def640 1 -- 172.21.15.47:0/3963336439 shutdown_connections 2024-07-24T22:06:40.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.596+0000 7f66c6def640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f66a80b3c20 0x7f66a80b60e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:40.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.596+0000 7f66c6def640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66c0108b20 0x7f66c019e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:40.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.596+0000 7f66c6def640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66c01081a0 0x7f66c01992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:40.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.596+0000 7f66c6def640 1 --2- 172.21.15.47:0/3963336439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c0102790 0x7f66c0198db0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:40.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.596+0000 7f66c6def640 1 -- 172.21.15.47:0/3963336439 >> 172.21.15.47:0/3963336439 conn(0x7f66c00fe200 msgr2=0x7f66c01005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:40.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.596+0000 7f66c6def640 1 -- 172.21.15.47:0/3963336439 shutdown_connections 2024-07-24T22:06:40.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:40.596+0000 7f66c6def640 1 -- 172.21.15.47:0/3963336439 wait complete. 2024-07-24T22:06:41.250 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-07-24T22:06:41.250 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-24T22:06:41.250 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-07-24T22:06:41.250 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-07-24T22:06:41.250 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-24T22:06:41.250 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-07-24T22:06:41.250 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-07-24T22:06:41.250 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-24T22:06:41.250 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-24T22:06:41.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:06:41.251 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-07-24T22:06:41.268 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-24T22:06:41.269 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-24T22:06:41.269 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-07-24T22:06:41.269 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-07-24T22:06:41.269 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-07-24T22:06:41.269 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-07-24T22:06:41.269 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T22:06:41.269 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-07-24T22:06:41.269 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-07-24T22:06:41.269 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T22:06:41.269 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-07-24T22:06:41.270 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-07-24T22:06:41.270 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-24T22:06:41.270 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-07-24T22:06:41.270 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-07-24T22:06:41.270 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-07-24T22:06:41.270 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42038sec preferred_lft 42038sec 2024-07-24T22:06:41.270 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-07-24T22:06:41.270 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-07-24T22:06:41.270 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T22:06:41.270 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-07-24T22:06:41.270 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-07-24T22:06:41.271 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-07-24T22:06:41.271 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T22:06:41.271 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-07-24T22:06:41.271 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-07-24T22:06:41.271 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-07-24T22:06:41.271 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-07-24T22:06:41.271 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-07-24T22:06:41.272 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-07-24T22:06:41.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T22:06:41.475 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:41 smithi047 ceph-mon[32551]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:41.475 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:41 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3963336439' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-07-24T22:06:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T22:06:41.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:06:41.496 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-24T22:06:41.522 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-07-24T22:06:41.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:06:41.524 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-07-24T22:06:41.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:41 smithi188 ceph-mon[37380]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:41.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:41 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3963336439' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-07-24T22:06:41.593 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-07-24T22:06:41.593 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-24T22:06:41.593 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-07-24T22:06:41.593 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-07-24T22:06:41.593 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-24T22:06:41.594 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T22:06:41.594 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-07-24T22:06:41.594 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-07-24T22:06:41.594 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-07-24T22:06:41.594 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-07-24T22:06:41.594 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-07-24T22:06:41.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:41 smithi183 ceph-mon[37007]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:06:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:41 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3963336439' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-07-24T22:06:41.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T22:06:41.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T22:06:41.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:06:41.905 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-07-24T22:06:41.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:06:41.922 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-07-24T22:06:41.977 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T22:06:41.978 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-07-24T22:06:41.978 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-24T22:06:41.978 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-07-24T22:06:41.978 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-07-24T22:06:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T22:06:42.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T22:06:42.098 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-07-24T22:06:42.099 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T22:06:42.099 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-07-24T22:06:42.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-07-24T22:06:42.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-07-24T22:06:42.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-07-24T22:06:42.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-07-24T22:06:42.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-07-24T22:06:42.099 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-07-24T22:06:42.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T22:06:42.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T22:06:42.229 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T22:06:42.229 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-07-24T22:06:42.229 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-07-24T22:06:42.229 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-07-24T22:06:42.229 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-07-24T22:06:42.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T22:06:42.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T22:06:42.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T22:06:42.309 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-07-24T22:06:42.325 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-07-24T22:06:42.325 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T22:06:42.325 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-07-24T22:06:42.381 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-07-24T22:06:42.381 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-07-24T22:06:42.381 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/6fea125c-eb4b-4d5a-a01c-8376212837a2 2024-07-24T22:06:42.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:06:42.381 DEBUG:teuthology.orchestra.run.smithi047:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/6fea125c-eb4b-4d5a-a01c-8376212837a2 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-07-24T22:06:42.482 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-07-24T22:06:42.482 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-07-24T22:06:42.597 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-07-24T22:06:42.597 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-07-24T22:06:42.597 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:6789,172.21.15.183:6789,172.21.15.188:6789" 2024-07-24T22:06:42.597 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: trying mount with new device syntax: 0@46bf760a-4a07-11ef-bcad-c7b262605968.cephfs=/volumes/qa/sv_1/6fea125c-eb4b-4d5a-a01c-8376212837a2 2024-07-24T22:06:42.597 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync,name=0,key=0,mon_addr=172.21.15.47:6789/172.21.15.183:6789/172.21.15.188:6789" will pass to kernel 2024-07-24T22:06:42.598 INFO:teuthology.orchestra.run.smithi047.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-07-24T22:06:42.598 INFO:teuthology.orchestra.run.smithi047.stdout: You just mounted a file system that supports labels which does not 2024-07-24T22:06:42.598 INFO:teuthology.orchestra.run.smithi047.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-24T22:06:42.598 INFO:teuthology.orchestra.run.smithi047.stdout: applications will generate AVC messages and not be allowed access to 2024-07-24T22:06:42.598 INFO:teuthology.orchestra.run.smithi047.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-24T22:06:42.600 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-24T22:06:42.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:06:42.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-07-24T22:06:42.627 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T22:06:42.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T22:06:42.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T22:06:42.726 INFO:teuthology.orchestra.run.smithi047.stdout:client24917 2024-07-24T22:06:42.726 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T22:06:42.726 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T22:06:42.743 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T22:06:42.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T22:06:42.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T22:06:42.842 INFO:teuthology.orchestra.run.smithi047.stdout:client24917 2024-07-24T22:06:42.842 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T22:06:42.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T22:06:42.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T22:06:42.900 INFO:teuthology.orchestra.run.smithi047.stdout:client24917 2024-07-24T22:06:42.900 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/46bf760a-4a07-11ef-bcad-c7b262605968.client24917/status') 2024-07-24T22:06:42.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T22:06:42.961 INFO:teuthology.orchestra.run.smithi047.stdout:instance: client.24917 (3)172.21.15.47:0/652631585 2024-07-24T22:06:42.961 INFO:teuthology.orchestra.run.smithi047.stdout:blocklisted: false 2024-07-24T22:06:42.961 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records in 2024-07-24T22:06:42.962 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records out 2024-07-24T22:06:42.962 INFO:teuthology.orchestra.run.smithi047.stderr:70 bytes copied, 2.5949e-05 s, 2.7 MB/s 2024-07-24T22:06:42.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T22:06:42.969 INFO:teuthology.run_tasks:Running task check-counter... 2024-07-24T22:06:42.979 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-07-24T22:06:43.011 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T22:06:43.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.116+0000 7f6d41a8b640 1 -- 172.21.15.47:0/1577779793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d3c108a30 msgr2=0x7f6d3c10f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.116+0000 7f6d41a8b640 1 --2- 172.21.15.47:0/1577779793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d3c108a30 0x7f6d3c10f230 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009900 tx=0x7f6d3402a410 comp rx=0 tx=0).stop 2024-07-24T22:06:43.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.116+0000 7f6d41a8b640 1 -- 172.21.15.47:0/1577779793 shutdown_connections 2024-07-24T22:06:43.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.116+0000 7f6d41a8b640 1 --2- 172.21.15.47:0/1577779793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d3c108a30 0x7f6d3c10f230 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.116+0000 7f6d41a8b640 1 --2- 172.21.15.47:0/1577779793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d3c1080b0 0x7f6d3c1084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.116+0000 7f6d41a8b640 1 --2- 172.21.15.47:0/1577779793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d3c069fb0 0x7f6d3c06a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.116+0000 7f6d41a8b640 1 -- 172.21.15.47:0/1577779793 >> 172.21.15.47:0/1577779793 conn(0x7f6d3c077080 msgr2=0x7f6d3c077490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:43.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.116+0000 7f6d41a8b640 1 -- 172.21.15.47:0/1577779793 shutdown_connections 2024-07-24T22:06:43.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.116+0000 7f6d41a8b640 1 -- 172.21.15.47:0/1577779793 wait complete. 2024-07-24T22:06:43.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d41a8b640 1 Processor -- start 2024-07-24T22:06:43.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d41a8b640 1 -- start start 2024-07-24T22:06:43.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d41a8b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d3c069fb0 0x7f6d3c101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:43.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d41a8b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d3c1080b0 0x7f6d3c101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:43.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d41a8b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d3c108a30 0x7f6d3c1022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d41a8b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c112660 con 0x7f6d3c069fb0 2024-07-24T22:06:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d41a8b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1124e0 con 0x7f6d3c108a30 2024-07-24T22:06:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d41a8b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1127e0 con 0x7f6d3c1080b0 2024-07-24T22:06:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d3b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d3c069fb0 0x7f6d3c101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d3b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d3c069fb0 0x7f6d3c101820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44234/0 (socket says 172.21.15.47:44234) 2024-07-24T22:06:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d3b7fe640 1 -- 172.21.15.47:0/2286106343 learned_addr learned my addr 172.21.15.47:0/2286106343 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d3affd640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d3c1080b0 0x7f6d3c101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d3bfff640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d3c108a30 0x7f6d3c1022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d3b7fe640 1 -- 172.21.15.47:0/2286106343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d3c1080b0 msgr2=0x7f6d3c101d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d3b7fe640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d3c1080b0 0x7f6d3c101d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d3b7fe640 1 -- 172.21.15.47:0/2286106343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d3c108a30 msgr2=0x7f6d3c1022a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d3b7fe640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d3c108a30 0x7f6d3c1022a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.117+0000 7f6d3b7fe640 1 -- 172.21.15.47:0/2286106343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3c1a6f90 con 0x7f6d3c069fb0 2024-07-24T22:06:43.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.118+0000 7f6d3b7fe640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d3c069fb0 0x7f6d3c101820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00eab0 tx=0x7f6d2c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:43.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.118+0000 7f6d38ff9640 1 -- 172.21.15.47:0/2286106343 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00ce40 con 0x7f6d3c069fb0 2024-07-24T22:06:43.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.118+0000 7f6d38ff9640 1 -- 172.21.15.47:0/2286106343 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d2c011920 con 0x7f6d3c069fb0 2024-07-24T22:06:43.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.118+0000 7f6d41a8b640 1 -- 172.21.15.47:0/2286106343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3c1a7280 con 0x7f6d3c069fb0 2024-07-24T22:06:43.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.118+0000 7f6d38ff9640 1 -- 172.21.15.47:0/2286106343 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c010a30 con 0x7f6d3c069fb0 2024-07-24T22:06:43.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.118+0000 7f6d41a8b640 1 -- 172.21.15.47:0/2286106343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3c1a77d0 con 0x7f6d3c069fb0 2024-07-24T22:06:43.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.119+0000 7f6d41a8b640 1 -- 172.21.15.47:0/2286106343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3c06a390 con 0x7f6d3c069fb0 2024-07-24T22:06:43.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.120+0000 7f6d38ff9640 1 -- 172.21.15.47:0/2286106343 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f6d2c010bd0 con 0x7f6d3c069fb0 2024-07-24T22:06:43.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.121+0000 7f6d38ff9640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6d240b3c20 0x7f6d240b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:43.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.121+0000 7f6d3affd640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6d240b3c20 0x7f6d240b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:43.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.121+0000 7f6d38ff9640 1 -- 172.21.15.47:0/2286106343 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f6d2c0e44a0 con 0x7f6d3c069fb0 2024-07-24T22:06:43.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.122+0000 7f6d3affd640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6d240b3c20 0x7f6d240b60e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d30005fd0 tx=0x7f6d30005850 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:43.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.124+0000 7f6d38ff9640 1 -- 172.21.15.47:0/2286106343 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f6d2c016030 con 0x7f6d3c069fb0 2024-07-24T22:06:43.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.320+0000 7f6d41a8b640 1 -- 172.21.15.47:0/2286106343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d3c02e000 con 0x7f6d3c069fb0 2024-07-24T22:06:43.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.321+0000 7f6d38ff9640 1 -- 172.21.15.47:0/2286106343 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23138 (secure 0 0 0) 0x7f6d2c0ab970 con 0x7f6d3c069fb0 2024-07-24T22:06:43.324 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:43.324 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":85,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","created":"2024-07-24T21:55:28.945912+0000","modified":"2024-07-24T22:05:27.567637+0000","last_up_change":"2024-07-24T22:02:55.044691+0000","last_in_change":"2024-07-24T22:02:35.671256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T21:59:32.066678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T22:03:49.331120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T22:03:52.034826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60de2c3d-e4b7-4878-bdbb-ce3257e3706c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6803","nonce":2665889913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6805","nonce":2665889913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6809","nonce":2665889913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6807","nonce":2665889913}]},"public_addr":"172.21.15.47:6803/2665889913","cluster_addr":"172.21.15.47:6805/2665889913","heartbeat_back_addr":"172.21.15.47:6809/2665889913","heartbeat_front_addr":"172.21.15.47:6807/2665889913","state":["exists","up"]},{"osd":1,"uuid":"7f086675-3bed-47ca-a93f-fab9580068b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6801","nonce":3486494228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6803","nonce":3486494228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6807","nonce":3486494228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6805","nonce":3486494228}]},"public_addr":"172.21.15.183:6801/3486494228","cluster_addr":"172.21.15.183:6803/3486494228","heartbeat_back_addr":"172.21.15.183:6807/3486494228","heartbeat_front_addr":"172.21.15.183:6805/3486494228","state":["exists","up"]},{"osd":2,"uuid":"040fff27-6fa6-48de-9365-fcced8f89e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6801","nonce":2245903281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6803","nonce":2245903281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6807","nonce":2245903281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6805","nonce":2245903281}]},"public_addr":"172.21.15.188:6801/2245903281","cluster_addr":"172.21.15.188:6803/2245903281","heartbeat_back_addr":"172.21.15.188:6807/2245903281","heartbeat_front_addr":"172.21.15.188:6805/2245903281","state":["exists","up"]},{"osd":3,"uuid":"e129321a-9566-4bea-b982-34f7ddd1ae1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6811","nonce":236749130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6813","nonce":236749130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6817","nonce":236749130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6815","nonce":236749130}]},"public_addr":"172.21.15.47:6811/236749130","cluster_addr":"172.21.15.47:6813/236749130","heartbeat_back_addr":"172.21.15.47:6817/236749130","heartbeat_front_addr":"172.21.15.47:6815/236749130","state":["exists","up"]},{"osd":4,"uuid":"f969fba7-b0ff-4ea6-83bd-38aba32b1be1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6809","nonce":3978122107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6811","nonce":3978122107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6815","nonce":3978122107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6813","nonce":3978122107}]},"public_addr":"172.21.15.183:6809/3978122107","cluster_addr":"172.21.15.183:6811/3978122107","heartbeat_back_addr":"172.21.15.183:6815/3978122107","heartbeat_front_addr":"172.21.15.183:6813/3978122107","state":["exists","up"]},{"osd":5,"uuid":"3799c912-3d9f-4efd-9b36-569c385e4c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6809","nonce":2097128083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6811","nonce":2097128083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6815","nonce":2097128083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6813","nonce":2097128083}]},"public_addr":"172.21.15.188:6809/2097128083","cluster_addr":"172.21.15.188:6811/2097128083","heartbeat_back_addr":"172.21.15.188:6815/2097128083","heartbeat_front_addr":"172.21.15.188:6813/2097128083","state":["exists","up"]},{"osd":6,"uuid":"1a38cf12-619f-4e82-a7a5-21ee2014038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6819","nonce":2288252980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6821","nonce":2288252980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6825","nonce":2288252980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6823","nonce":2288252980}]},"public_addr":"172.21.15.47:6819/2288252980","cluster_addr":"172.21.15.47:6821/2288252980","heartbeat_back_addr":"172.21.15.47:6825/2288252980","heartbeat_front_addr":"172.21.15.47:6823/2288252980","state":["exists","up"]},{"osd":7,"uuid":"6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6817","nonce":465426514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6819","nonce":465426514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6823","nonce":465426514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6821","nonce":465426514}]},"public_addr":"172.21.15.183:6817/465426514","cluster_addr":"172.21.15.183:6819/465426514","heartbeat_back_addr":"172.21.15.183:6823/465426514","heartbeat_front_addr":"172.21.15.183:6821/465426514","state":["exists","up"]},{"osd":8,"uuid":"6dfd7252-61a6-423d-8498-cbcfa41ae1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6817","nonce":2247055658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6819","nonce":2247055658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6823","nonce":2247055658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6821","nonce":2247055658}]},"public_addr":"172.21.15.188:6817/2247055658","cluster_addr":"172.21.15.188:6819/2247055658","heartbeat_back_addr":"172.21.15.188:6823/2247055658","heartbeat_front_addr":"172.21.15.188:6821/2247055658","state":["exists","up"]},{"osd":9,"uuid":"abd93c5e-283e-4873-a241-1056f2894116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6827","nonce":2628721884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6829","nonce":2628721884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6833","nonce":2628721884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6831","nonce":2628721884}]},"public_addr":"172.21.15.47:6827/2628721884","cluster_addr":"172.21.15.47:6829/2628721884","heartbeat_back_addr":"172.21.15.47:6833/2628721884","heartbeat_front_addr":"172.21.15.47:6831/2628721884","state":["exists","up"]},{"osd":10,"uuid":"bc967f8f-ce27-4230-be70-e36927f89fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6825","nonce":3509332199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6827","nonce":3509332199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6831","nonce":3509332199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6829","nonce":3509332199}]},"public_addr":"172.21.15.183:6825/3509332199","cluster_addr":"172.21.15.183:6827/3509332199","heartbeat_back_addr":"172.21.15.183:6831/3509332199","heartbeat_front_addr":"172.21.15.183:6829/3509332199","state":["exists","up"]},{"osd":11,"uuid":"8b379865-3a5c-4a2d-aa74-a4f215027fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6825","nonce":3725107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6827","nonce":3725107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6831","nonce":3725107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6829","nonce":3725107101}]},"public_addr":"172.21.15.188:6825/3725107101","cluster_addr":"172.21.15.188:6827/3725107101","heartbeat_back_addr":"172.21.15.188:6831/3725107101","heartbeat_front_addr":"172.21.15.188:6829/3725107101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:58:44.413660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:06.554842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:28.651418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:50.995466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:13.906535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:36.632662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:59.003224+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:21.701327+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:44.017943+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:06.400895+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:29.625920+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:52.323223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3499235566":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/2112533111":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/2714360830":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/507334607":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6800/2524786594":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/1004458106":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6800/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/1046677443":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/899235864":"2024-07-25T21:56:15.044564+0000","172.21.15.47:6800/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/3057769442":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/2596054312":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6801/2524786594":"2024-07-25T21:57:25.995502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T22:06:43.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.323+0000 7f6d41a8b640 1 -- 172.21.15.47:0/2286106343 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6d240b3c20 msgr2=0x7f6d240b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.323+0000 7f6d41a8b640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6d240b3c20 0x7f6d240b60e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d30005fd0 tx=0x7f6d30005850 comp rx=0 tx=0).stop 2024-07-24T22:06:43.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.323+0000 7f6d41a8b640 1 -- 172.21.15.47:0/2286106343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d3c069fb0 msgr2=0x7f6d3c101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.323+0000 7f6d41a8b640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d3c069fb0 0x7f6d3c101820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00eab0 tx=0x7f6d2c00ef70 comp rx=0 tx=0).stop 2024-07-24T22:06:43.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.324+0000 7f6d41a8b640 1 -- 172.21.15.47:0/2286106343 shutdown_connections 2024-07-24T22:06:43.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.324+0000 7f6d41a8b640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6d240b3c20 0x7f6d240b60e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.324+0000 7f6d41a8b640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d3c108a30 0x7f6d3c1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.324+0000 7f6d41a8b640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d3c1080b0 0x7f6d3c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.324+0000 7f6d41a8b640 1 --2- 172.21.15.47:0/2286106343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d3c069fb0 0x7f6d3c101820 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.324+0000 7f6d41a8b640 1 -- 172.21.15.47:0/2286106343 >> 172.21.15.47:0/2286106343 conn(0x7f6d3c077080 msgr2=0x7f6d3c106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:43.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.324+0000 7f6d41a8b640 1 -- 172.21.15.47:0/2286106343 shutdown_connections 2024-07-24T22:06:43.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.324+0000 7f6d41a8b640 1 -- 172.21.15.47:0/2286106343 wait complete. 2024-07-24T22:06:43.337 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-24T21:59:32.066678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-07-24T22:03:49.331120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-07-24T22:03:52.034826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-07-24T22:06:43.337 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-07-24T22:06:43.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.444+0000 7f44fa54b640 1 -- 172.21.15.47:0/766723749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f4107940 msgr2=0x7f44f410e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.444+0000 7f44fa54b640 1 --2- 172.21.15.47:0/766723749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f4107940 0x7f44f410e140 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009ca0 tx=0x7f44ec02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.444+0000 7f44fa54b640 1 -- 172.21.15.47:0/766723749 shutdown_connections 2024-07-24T22:06:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.444+0000 7f44fa54b640 1 --2- 172.21.15.47:0/766723749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f4107940 0x7f44f410e140 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.444+0000 7f44fa54b640 1 --2- 172.21.15.47:0/766723749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f4106fc0 0x7f44f4107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.444+0000 7f44fa54b640 1 --2- 172.21.15.47:0/766723749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44f41015c0 0x7f44f41019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.444+0000 7f44fa54b640 1 -- 172.21.15.47:0/766723749 >> 172.21.15.47:0/766723749 conn(0x7f44f40fd020 msgr2=0x7f44f40ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.444+0000 7f44fa54b640 1 -- 172.21.15.47:0/766723749 shutdown_connections 2024-07-24T22:06:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.444+0000 7f44fa54b640 1 -- 172.21.15.47:0/766723749 wait complete. 2024-07-24T22:06:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.445+0000 7f44fa54b640 1 Processor -- start 2024-07-24T22:06:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.445+0000 7f44fa54b640 1 -- start start 2024-07-24T22:06:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.445+0000 7f44fa54b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f41015c0 0x7f44f4199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.445+0000 7f44fa54b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f4106fc0 0x7f44f4199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.445+0000 7f44fa54b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44f4107940 0x7f44f419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.445+0000 7f44fa54b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44f4111570 con 0x7f44f41015c0 2024-07-24T22:06:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.445+0000 7f44fa54b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41113f0 con 0x7f44f4107940 2024-07-24T22:06:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.445+0000 7f44fa54b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41116f0 con 0x7f44f4106fc0 2024-07-24T22:06:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.445+0000 7f44f3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f41015c0 0x7f44f4199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f41015c0 0x7f44f4199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44254/0 (socket says 172.21.15.47:44254) 2024-07-24T22:06:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f3fff640 1 -- 172.21.15.47:0/612803947 learned_addr learned my addr 172.21.15.47:0/612803947 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f8ae8640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44f4107940 0x7f44f419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f37fe640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f4106fc0 0x7f44f4199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f3fff640 1 -- 172.21.15.47:0/612803947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f4106fc0 msgr2=0x7f44f4199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f3fff640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f4106fc0 0x7f44f4199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f3fff640 1 -- 172.21.15.47:0/612803947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44f4107940 msgr2=0x7f44f419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f3fff640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44f4107940 0x7f44f419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f3fff640 1 -- 172.21.15.47:0/612803947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f41a4e00 con 0x7f44f41015c0 2024-07-24T22:06:43.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f37fe640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f4106fc0 0x7f44f4199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:06:43.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f8ae8640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44f4107940 0x7f44f419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:06:43.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f3fff640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f41015c0 0x7f44f4199a00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f44e400d950 tx=0x7f44e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:43.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f17fa640 1 -- 172.21.15.47:0/612803947 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e4017030 con 0x7f44f41015c0 2024-07-24T22:06:43.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f17fa640 1 -- 172.21.15.47:0/612803947 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44e4004020 con 0x7f44f41015c0 2024-07-24T22:06:43.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44fa54b640 1 -- 172.21.15.47:0/612803947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f41a50f0 con 0x7f44f41015c0 2024-07-24T22:06:43.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44f17fa640 1 -- 172.21.15.47:0/612803947 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e40047a0 con 0x7f44f41015c0 2024-07-24T22:06:43.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.446+0000 7f44fa54b640 1 -- 172.21.15.47:0/612803947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f41a5640 con 0x7f44f41015c0 2024-07-24T22:06:43.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.447+0000 7f44fa54b640 1 -- 172.21.15.47:0/612803947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f41019a0 con 0x7f44f41015c0 2024-07-24T22:06:43.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.449+0000 7f44f17fa640 1 -- 172.21.15.47:0/612803947 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f44e4009a30 con 0x7f44f41015c0 2024-07-24T22:06:43.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.450+0000 7f44f17fa640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44dc0b3c20 0x7f44dc0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:43.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.450+0000 7f44f37fe640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44dc0b3c20 0x7f44dc0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:43.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.450+0000 7f44f17fa640 1 -- 172.21.15.47:0/612803947 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f44e40e3f30 con 0x7f44f41015c0 2024-07-24T22:06:43.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.451+0000 7f44f37fe640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44dc0b3c20 0x7f44dc0b60e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f44f406b820 tx=0x7f44e80094b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:43.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.453+0000 7f44f17fa640 1 -- 172.21.15.47:0/612803947 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f44e40ab400 con 0x7f44f41015c0 2024-07-24T22:06:43.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:43 smithi188 ceph-mon[37380]: pgmap v351: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:43.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.646+0000 7f44fa54b640 1 -- 172.21.15.47:0/612803947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f44f402e000 con 0x7f44f41015c0 2024-07-24T22:06:43.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.646+0000 7f44f17fa640 1 -- 172.21.15.47:0/612803947 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7f44e40aad00 con 0x7f44f41015c0 2024-07-24T22:06:43.648 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-07-24T22:06:43.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.648+0000 7f44fa54b640 1 -- 172.21.15.47:0/612803947 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44dc0b3c20 msgr2=0x7f44dc0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.648+0000 7f44fa54b640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44dc0b3c20 0x7f44dc0b60e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f44f406b820 tx=0x7f44e80094b0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.648+0000 7f44fa54b640 1 -- 172.21.15.47:0/612803947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f41015c0 msgr2=0x7f44f4199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.648+0000 7f44fa54b640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f41015c0 0x7f44f4199a00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f44e400d950 tx=0x7f44e400de10 comp rx=0 tx=0).stop 2024-07-24T22:06:43.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.648+0000 7f44fa54b640 1 -- 172.21.15.47:0/612803947 shutdown_connections 2024-07-24T22:06:43.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.648+0000 7f44fa54b640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44dc0b3c20 0x7f44dc0b60e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.648+0000 7f44fa54b640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44f4107940 0x7f44f419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.648+0000 7f44fa54b640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f4106fc0 0x7f44f4199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.648+0000 7f44fa54b640 1 --2- 172.21.15.47:0/612803947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f41015c0 0x7f44f4199a00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.648+0000 7f44fa54b640 1 -- 172.21.15.47:0/612803947 >> 172.21.15.47:0/612803947 conn(0x7f44f40fd020 msgr2=0x7f44f40fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:43.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.648+0000 7f44fa54b640 1 -- 172.21.15.47:0/612803947 shutdown_connections 2024-07-24T22:06:43.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.648+0000 7f44fa54b640 1 -- 172.21.15.47:0/612803947 wait complete. 2024-07-24T22:06:43.660 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:43 smithi047 ceph-mon[32551]: pgmap v351: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:43.661 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-07-24T22:06:43.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:43 smithi183 ceph-mon[37007]: pgmap v351: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:06:43.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.768+0000 7f48d9c9a640 1 -- 172.21.15.47:0/737734601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48d4102200 msgr2=0x7f48d41025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.768+0000 7f48d9c9a640 1 --2- 172.21.15.47:0/737734601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48d4102200 0x7f48d41025e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009900 tx=0x7f48c402a410 comp rx=0 tx=0).stop 2024-07-24T22:06:43.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.768+0000 7f48d9c9a640 1 -- 172.21.15.47:0/737734601 shutdown_connections 2024-07-24T22:06:43.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.768+0000 7f48d9c9a640 1 --2- 172.21.15.47:0/737734601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f48d4107980 0x7f48d410e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.768+0000 7f48d9c9a640 1 --2- 172.21.15.47:0/737734601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d4106fe0 0x7f48d4107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.768+0000 7f48d9c9a640 1 --2- 172.21.15.47:0/737734601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48d4102200 0x7f48d41025e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.768+0000 7f48d9c9a640 1 -- 172.21.15.47:0/737734601 >> 172.21.15.47:0/737734601 conn(0x7f48d40756f0 msgr2=0x7f48d4075b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:43.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.768+0000 7f48d9c9a640 1 -- 172.21.15.47:0/737734601 shutdown_connections 2024-07-24T22:06:43.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.768+0000 7f48d9c9a640 1 -- 172.21.15.47:0/737734601 wait complete. 2024-07-24T22:06:43.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.768+0000 7f48d9c9a640 1 Processor -- start 2024-07-24T22:06:43.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d9c9a640 1 -- start start 2024-07-24T22:06:43.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d9c9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48d4102200 0x7f48d4198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:43.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d9c9a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f48d4106fe0 0x7f48d4199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:43.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d9c9a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d4107980 0x7f48d419e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:43.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d9c9a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f48d41126d0 con 0x7f48d4102200 2024-07-24T22:06:43.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d9c9a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f48d4112550 con 0x7f48d4107980 2024-07-24T22:06:43.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d9c9a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f48d4112850 con 0x7f48d4106fe0 2024-07-24T22:06:43.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48d4102200 0x7f48d4198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:43.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48d4102200 0x7f48d4198c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44274/0 (socket says 172.21.15.47:44274) 2024-07-24T22:06:43.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d37fe640 1 -- 172.21.15.47:0/750325099 learned_addr learned my addr 172.21.15.47:0/750325099 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:43.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d2ffd640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f48d4106fe0 0x7f48d4199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:43.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d3fff640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d4107980 0x7f48d419e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:43.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d37fe640 1 -- 172.21.15.47:0/750325099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f48d4106fe0 msgr2=0x7f48d4199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d37fe640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f48d4106fe0 0x7f48d4199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d37fe640 1 -- 172.21.15.47:0/750325099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d4107980 msgr2=0x7f48d419e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d37fe640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d4107980 0x7f48d419e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d37fe640 1 -- 172.21.15.47:0/750325099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d419ecd0 con 0x7f48d4102200 2024-07-24T22:06:43.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.769+0000 7f48d3fff640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d4107980 0x7f48d419e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:06:43.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.770+0000 7f48d37fe640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48d4102200 0x7f48d4198c30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f48c4005940 tx=0x7f48c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:43.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.770+0000 7f48d0ff9640 1 -- 172.21.15.47:0/750325099 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c403f030 con 0x7f48d4102200 2024-07-24T22:06:43.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.770+0000 7f48d0ff9640 1 -- 172.21.15.47:0/750325099 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48c4003cb0 con 0x7f48d4102200 2024-07-24T22:06:43.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.770+0000 7f48d9c9a640 1 -- 172.21.15.47:0/750325099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d419ef60 con 0x7f48d4102200 2024-07-24T22:06:43.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.770+0000 7f48d0ff9640 1 -- 172.21.15.47:0/750325099 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4035070 con 0x7f48d4102200 2024-07-24T22:06:43.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.770+0000 7f48d9c9a640 1 -- 172.21.15.47:0/750325099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d41a5680 con 0x7f48d4102200 2024-07-24T22:06:43.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.771+0000 7f48d9c9a640 1 -- 172.21.15.47:0/750325099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d41025e0 con 0x7f48d4102200 2024-07-24T22:06:43.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.772+0000 7f48d0ff9640 1 -- 172.21.15.47:0/750325099 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f48c4042030 con 0x7f48d4102200 2024-07-24T22:06:43.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.773+0000 7f48d0ff9640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f48c00b3c20 0x7f48c00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:43.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.773+0000 7f48d2ffd640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f48c00b3c20 0x7f48c00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:43.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.773+0000 7f48d0ff9640 1 -- 172.21.15.47:0/750325099 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f48c41046e0 con 0x7f48d4102200 2024-07-24T22:06:43.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.774+0000 7f48d2ffd640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f48c00b3c20 0x7f48c00b60e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f48d40ff1d0 tx=0x7f48bc008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:43.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.777+0000 7f48d0ff9640 1 -- 172.21.15.47:0/750325099 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f48c40cbc10 con 0x7f48d4102200 2024-07-24T22:06:43.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.972+0000 7f48d9c9a640 1 -- 172.21.15.47:0/750325099 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f48d402e000 con 0x7f48d4102200 2024-07-24T22:06:43.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.973+0000 7f48d0ff9640 1 -- 172.21.15.47:0/750325099 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) ==== 104+0+11 (secure 0 0 0) 0x7f48c40cb510 con 0x7f48d4102200 2024-07-24T22:06:43.975 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-07-24T22:06:43.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.975+0000 7f48d9c9a640 1 -- 172.21.15.47:0/750325099 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f48c00b3c20 msgr2=0x7f48c00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.975+0000 7f48d9c9a640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f48c00b3c20 0x7f48c00b60e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f48d40ff1d0 tx=0x7f48bc008040 comp rx=0 tx=0).stop 2024-07-24T22:06:43.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.975+0000 7f48d9c9a640 1 -- 172.21.15.47:0/750325099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48d4102200 msgr2=0x7f48d4198c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:43.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.975+0000 7f48d9c9a640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48d4102200 0x7f48d4198c30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f48c4005940 tx=0x7f48c40042f0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.975+0000 7f48d9c9a640 1 -- 172.21.15.47:0/750325099 shutdown_connections 2024-07-24T22:06:43.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.975+0000 7f48d9c9a640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f48c00b3c20 0x7f48c00b60e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.975+0000 7f48d9c9a640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d4107980 0x7f48d419e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.975+0000 7f48d9c9a640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f48d4106fe0 0x7f48d4199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.975+0000 7f48d9c9a640 1 --2- 172.21.15.47:0/750325099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48d4102200 0x7f48d4198c30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:43.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.975+0000 7f48d9c9a640 1 -- 172.21.15.47:0/750325099 >> 172.21.15.47:0/750325099 conn(0x7f48d40756f0 msgr2=0x7f48d40ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:43.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.975+0000 7f48d9c9a640 1 -- 172.21.15.47:0/750325099 shutdown_connections 2024-07-24T22:06:43.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:43.975+0000 7f48d9c9a640 1 -- 172.21.15.47:0/750325099 wait complete. 2024-07-24T22:06:43.988 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-07-24T22:06:44.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.095+0000 7fbf59f59640 1 -- 172.21.15.47:0/2973278922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf54103ef0 msgr2=0x7fbf5410c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.095+0000 7fbf59f59640 1 --2- 172.21.15.47:0/2973278922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf54103ef0 0x7fbf5410c3d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009900 tx=0x7fbf4802a410 comp rx=0 tx=0).stop 2024-07-24T22:06:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.095+0000 7fbf59f59640 1 -- 172.21.15.47:0/2973278922 shutdown_connections 2024-07-24T22:06:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.095+0000 7fbf59f59640 1 --2- 172.21.15.47:0/2973278922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf5410ca20 0x7fbf5410eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.095+0000 7fbf59f59640 1 --2- 172.21.15.47:0/2973278922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf54103ef0 0x7fbf5410c3d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.095+0000 7fbf59f59640 1 --2- 172.21.15.47:0/2973278922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf541035d0 0x7fbf541039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.095+0000 7fbf59f59640 1 -- 172.21.15.47:0/2973278922 >> 172.21.15.47:0/2973278922 conn(0x7fbf540fd020 msgr2=0x7fbf540ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.095+0000 7fbf59f59640 1 -- 172.21.15.47:0/2973278922 shutdown_connections 2024-07-24T22:06:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.095+0000 7fbf59f59640 1 -- 172.21.15.47:0/2973278922 wait complete. 2024-07-24T22:06:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.095+0000 7fbf59f59640 1 Processor -- start 2024-07-24T22:06:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.095+0000 7fbf59f59640 1 -- start start 2024-07-24T22:06:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf59f59640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf541035d0 0x7fbf54198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf59f59640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf54103ef0 0x7fbf54199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf59f59640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf5410ca20 0x7fbf5419e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf59f59640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbf541126a0 con 0x7fbf541035d0 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf59f59640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbf54112520 con 0x7fbf54103ef0 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf59f59640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbf54112820 con 0x7fbf5410ca20 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf541035d0 0x7fbf54198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf541035d0 0x7fbf54198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44298/0 (socket says 172.21.15.47:44298) 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf537fe640 1 -- 172.21.15.47:0/1120669775 learned_addr learned my addr 172.21.15.47:0/1120669775 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf53fff640 1 --2- 172.21.15.47:0/1120669775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf5410ca20 0x7fbf5419e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf537fe640 1 -- 172.21.15.47:0/1120669775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf5410ca20 msgr2=0x7fbf5419e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf537fe640 1 --2- 172.21.15.47:0/1120669775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf5410ca20 0x7fbf5419e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf537fe640 1 -- 172.21.15.47:0/1120669775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf54103ef0 msgr2=0x7fbf54199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf537fe640 1 --2- 172.21.15.47:0/1120669775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf54103ef0 0x7fbf54199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf537fe640 1 -- 172.21.15.47:0/1120669775 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5419ec60 con 0x7fbf541035d0 2024-07-24T22:06:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf537fe640 1 --2- 172.21.15.47:0/1120669775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf541035d0 0x7fbf54198bc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400c920 tx=0x7fbf4400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:44.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf50ff9640 1 -- 172.21.15.47:0/1120669775 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44007c70 con 0x7fbf541035d0 2024-07-24T22:06:44.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf50ff9640 1 -- 172.21.15.47:0/1120669775 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf44007e10 con 0x7fbf541035d0 2024-07-24T22:06:44.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf50ff9640 1 -- 172.21.15.47:0/1120669775 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44018820 con 0x7fbf541035d0 2024-07-24T22:06:44.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf59f59640 1 -- 172.21.15.47:0/1120669775 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5419ef50 con 0x7fbf541035d0 2024-07-24T22:06:44.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.096+0000 7fbf59f59640 1 -- 172.21.15.47:0/1120669775 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf541a57f0 con 0x7fbf541035d0 2024-07-24T22:06:44.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.097+0000 7fbf59f59640 1 -- 172.21.15.47:0/1120669775 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf541039b0 con 0x7fbf541035d0 2024-07-24T22:06:44.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.100+0000 7fbf50ff9640 1 -- 172.21.15.47:0/1120669775 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7fbf4400f450 con 0x7fbf541035d0 2024-07-24T22:06:44.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.100+0000 7fbf50ff9640 1 --2- 172.21.15.47:0/1120669775 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf3c0b3ca0 0x7fbf3c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:44.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.100+0000 7fbf52ffd640 1 --2- 172.21.15.47:0/1120669775 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf3c0b3ca0 0x7fbf3c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:44.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.100+0000 7fbf50ff9640 1 -- 172.21.15.47:0/1120669775 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fbf440e41e0 con 0x7fbf541035d0 2024-07-24T22:06:44.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.101+0000 7fbf52ffd640 1 --2- 172.21.15.47:0/1120669775 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf3c0b3ca0 0x7fbf3c0b6160 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbf4802a930 tx=0x7fbf48031400 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:44.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.103+0000 7fbf50ff9640 1 -- 172.21.15.47:0/1120669775 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fbf44014030 con 0x7fbf541035d0 2024-07-24T22:06:44.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.298+0000 7fbf59f59640 1 -- 172.21.15.47:0/1120669775 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbf541a5b60 con 0x7fbf541035d0 2024-07-24T22:06:44.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.298+0000 7fbf50ff9640 1 -- 172.21.15.47:0/1120669775 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) ==== 100+0+11 (secure 0 0 0) 0x7fbf440ab820 con 0x7fbf541035d0 2024-07-24T22:06:44.300 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-07-24T22:06:44.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.300+0000 7fbf59f59640 1 -- 172.21.15.47:0/1120669775 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf3c0b3ca0 msgr2=0x7fbf3c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:44.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.300+0000 7fbf59f59640 1 --2- 172.21.15.47:0/1120669775 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf3c0b3ca0 0x7fbf3c0b6160 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbf4802a930 tx=0x7fbf48031400 comp rx=0 tx=0).stop 2024-07-24T22:06:44.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.300+0000 7fbf59f59640 1 -- 172.21.15.47:0/1120669775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf541035d0 msgr2=0x7fbf54198bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:44.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.301+0000 7fbf59f59640 1 --2- 172.21.15.47:0/1120669775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf541035d0 0x7fbf54198bc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400c920 tx=0x7fbf4400cde0 comp rx=0 tx=0).stop 2024-07-24T22:06:44.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.301+0000 7fbf59f59640 1 -- 172.21.15.47:0/1120669775 shutdown_connections 2024-07-24T22:06:44.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.301+0000 7fbf59f59640 1 --2- 172.21.15.47:0/1120669775 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbf3c0b3ca0 0x7fbf3c0b6160 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:44.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.301+0000 7fbf59f59640 1 --2- 172.21.15.47:0/1120669775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf5410ca20 0x7fbf5419e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:44.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.301+0000 7fbf59f59640 1 --2- 172.21.15.47:0/1120669775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf54103ef0 0x7fbf54199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:44.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.301+0000 7fbf59f59640 1 --2- 172.21.15.47:0/1120669775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf541035d0 0x7fbf54198bc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:44.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.301+0000 7fbf59f59640 1 -- 172.21.15.47:0/1120669775 >> 172.21.15.47:0/1120669775 conn(0x7fbf540fd020 msgr2=0x7fbf540fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:44.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.301+0000 7fbf59f59640 1 -- 172.21.15.47:0/1120669775 shutdown_connections 2024-07-24T22:06:44.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:44.301+0000 7fbf59f59640 1 -- 172.21.15.47:0/1120669775 wait complete. 2024-07-24T22:06:44.313 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:44 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2286106343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:06:44.313 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:44 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/612803947' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-24T22:06:44.313 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:44 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/750325099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-24T22:06:44.314 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-07-24T22:06:44.314 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:06:44.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:44 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2286106343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:06:44.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:44 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/612803947' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-24T22:06:44.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:44 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/750325099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-24T22:06:44.582 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:44.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:44 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2286106343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:06:44.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:44 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/612803947' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-24T22:06:44.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:44 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/750325099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-24T22:06:45.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:45 smithi047 ceph-mon[32551]: pgmap v352: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-07-24T22:06:45.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:45 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1120669775' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-24T22:06:45.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:45 smithi188 ceph-mon[37380]: pgmap v352: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-07-24T22:06:45.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:45 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1120669775' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-24T22:06:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:45 smithi183 ceph-mon[37007]: pgmap v352: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-07-24T22:06:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:45 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1120669775' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-24T22:06:46.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.260+0000 7efcbaf17640 1 -- 172.21.15.47:0/2853889842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcb4103f30 msgr2=0x7efcb410c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:46.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.260+0000 7efcbaf17640 1 --2- 172.21.15.47:0/2853889842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcb4103f30 0x7efcb410c510 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efca0009900 tx=0x7efca002a410 comp rx=0 tx=0).stop 2024-07-24T22:06:46.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.260+0000 7efcbaf17640 1 -- 172.21.15.47:0/2853889842 shutdown_connections 2024-07-24T22:06:46.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.260+0000 7efcbaf17640 1 --2- 172.21.15.47:0/2853889842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efcb410cae0 0x7efcb410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:46.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.260+0000 7efcbaf17640 1 --2- 172.21.15.47:0/2853889842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcb4103f30 0x7efcb410c510 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:46.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.260+0000 7efcbaf17640 1 --2- 172.21.15.47:0/2853889842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efcb4103530 0x7efcb4103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:46.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.260+0000 7efcbaf17640 1 -- 172.21.15.47:0/2853889842 >> 172.21.15.47:0/2853889842 conn(0x7efcb40fd100 msgr2=0x7efcb40ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:46.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.260+0000 7efcbaf17640 1 -- 172.21.15.47:0/2853889842 shutdown_connections 2024-07-24T22:06:46.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.260+0000 7efcbaf17640 1 -- 172.21.15.47:0/2853889842 wait complete. 2024-07-24T22:06:46.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.261+0000 7efcbaf17640 1 Processor -- start 2024-07-24T22:06:46.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.261+0000 7efcbaf17640 1 -- start start 2024-07-24T22:06:46.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.261+0000 7efcbaf17640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efcb4103530 0x7efcb4198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:46.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.261+0000 7efcbaf17640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcb4103f30 0x7efcb41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.261+0000 7efcbaf17640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efcb410cae0 0x7efcb419e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.261+0000 7efcbaf17640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efcb4112820 con 0x7efcb4103f30 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.261+0000 7efcbaf17640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efcb41126a0 con 0x7efcb410cae0 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.261+0000 7efcbaf17640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efcb41129a0 con 0x7efcb4103530 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.261+0000 7efcb3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcb4103f30 0x7efcb41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.261+0000 7efcb3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcb4103f30 0x7efcb41992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56316/0 (socket says 172.21.15.47:56316) 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.261+0000 7efcb3fff640 1 -- 172.21.15.47:0/3186559321 learned_addr learned my addr 172.21.15.47:0/3186559321 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.262+0000 7efcb94b4640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efcb410cae0 0x7efcb419e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.262+0000 7efcb8cb3640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efcb4103530 0x7efcb4198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.262+0000 7efcb3fff640 1 -- 172.21.15.47:0/3186559321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efcb4103530 msgr2=0x7efcb4198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.262+0000 7efcb3fff640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efcb4103530 0x7efcb4198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.262+0000 7efcb3fff640 1 -- 172.21.15.47:0/3186559321 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efcb410cae0 msgr2=0x7efcb419e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.262+0000 7efcb3fff640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efcb410cae0 0x7efcb419e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:46.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.262+0000 7efcb3fff640 1 -- 172.21.15.47:0/3186559321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb419ee60 con 0x7efcb4103f30 2024-07-24T22:06:46.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.262+0000 7efcb3fff640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcb4103f30 0x7efcb41992f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efca0006010 tx=0x7efca00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:46.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.262+0000 7efcb1ffb640 1 -- 172.21.15.47:0/3186559321 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca003f030 con 0x7efcb4103f30 2024-07-24T22:06:46.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.262+0000 7efcbaf17640 1 -- 172.21.15.47:0/3186559321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb419f0f0 con 0x7efcb4103f30 2024-07-24T22:06:46.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.262+0000 7efcb1ffb640 1 -- 172.21.15.47:0/3186559321 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efca0003800 con 0x7efcb4103f30 2024-07-24T22:06:46.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.262+0000 7efcb1ffb640 1 -- 172.21.15.47:0/3186559321 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0035070 con 0x7efcb4103f30 2024-07-24T22:06:46.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.262+0000 7efcbaf17640 1 -- 172.21.15.47:0/3186559321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb41a5810 con 0x7efcb4103f30 2024-07-24T22:06:46.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.263+0000 7efcbaf17640 1 -- 172.21.15.47:0/3186559321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb4103990 con 0x7efcb4103f30 2024-07-24T22:06:46.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.265+0000 7efcb1ffb640 1 -- 172.21.15.47:0/3186559321 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7efca0003cb0 con 0x7efcb4103f30 2024-07-24T22:06:46.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.266+0000 7efcb1ffb640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efca40b3c20 0x7efca40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:46.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.266+0000 7efcb8cb3640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efca40b3c20 0x7efca40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:46.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.266+0000 7efcb1ffb640 1 -- 172.21.15.47:0/3186559321 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7efca01049c0 con 0x7efcb4103f30 2024-07-24T22:06:46.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.266+0000 7efcb8cb3640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efca40b3c20 0x7efca40b60e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efca8009890 tx=0x7efca8008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:46.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.269+0000 7efcb1ffb640 1 -- 172.21.15.47:0/3186559321 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7efca00cbef0 con 0x7efcb4103f30 2024-07-24T22:06:46.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.503+0000 7efcbaf17640 1 -- 172.21.15.47:0/3186559321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcb4199ee0 con 0x7efcb4103f30 2024-07-24T22:06:46.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.504+0000 7efcb1ffb640 1 -- 172.21.15.47:0/3186559321 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7efca00cb7f0 con 0x7efcb4103f30 2024-07-24T22:06:46.506 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:46.507 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:06:46.507 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:06:46.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.506+0000 7efcbaf17640 1 -- 172.21.15.47:0/3186559321 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efca40b3c20 msgr2=0x7efca40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:46.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.506+0000 7efcbaf17640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efca40b3c20 0x7efca40b60e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efca8009890 tx=0x7efca8008040 comp rx=0 tx=0).stop 2024-07-24T22:06:46.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.506+0000 7efcbaf17640 1 -- 172.21.15.47:0/3186559321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcb4103f30 msgr2=0x7efcb41992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:46.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.506+0000 7efcbaf17640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcb4103f30 0x7efcb41992f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efca0006010 tx=0x7efca00042f0 comp rx=0 tx=0).stop 2024-07-24T22:06:46.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.506+0000 7efcbaf17640 1 -- 172.21.15.47:0/3186559321 shutdown_connections 2024-07-24T22:06:46.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.506+0000 7efcbaf17640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efca40b3c20 0x7efca40b60e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:46.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.506+0000 7efcbaf17640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efcb410cae0 0x7efcb419e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:46.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.506+0000 7efcbaf17640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcb4103f30 0x7efcb41992f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:46.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.506+0000 7efcbaf17640 1 --2- 172.21.15.47:0/3186559321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efcb4103530 0x7efcb4198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:46.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.506+0000 7efcbaf17640 1 -- 172.21.15.47:0/3186559321 >> 172.21.15.47:0/3186559321 conn(0x7efcb40fd100 msgr2=0x7efcb40fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:46.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.506+0000 7efcbaf17640 1 -- 172.21.15.47:0/3186559321 shutdown_connections 2024-07-24T22:06:46.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:46.506+0000 7efcbaf17640 1 -- 172.21.15.47:0/3186559321 wait complete. 2024-07-24T22:06:47.247 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-07-24T22:06:47.247 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-07-24T22:06:47.247 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T22:06:47.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.356+0000 7f26413e3640 1 -- 172.21.15.47:0/3577147778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f263c074eb0 msgr2=0x7f263c075290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:47.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.356+0000 7f26413e3640 1 --2- 172.21.15.47:0/3577147778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f263c074eb0 0x7f263c075290 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f262c009ca0 tx=0x7f262c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.356+0000 7f26413e3640 1 -- 172.21.15.47:0/3577147778 shutdown_connections 2024-07-24T22:06:47.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.356+0000 7f26413e3640 1 --2- 172.21.15.47:0/3577147778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f263c10ecd0 0x7f263c1110c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.356+0000 7f26413e3640 1 --2- 172.21.15.47:0/3577147778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f263c0757d0 0x7f263c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.356+0000 7f26413e3640 1 --2- 172.21.15.47:0/3577147778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f263c074eb0 0x7f263c075290 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.356+0000 7f26413e3640 1 -- 172.21.15.47:0/3577147778 >> 172.21.15.47:0/3577147778 conn(0x7f263c0fe0f0 msgr2=0x7f263c100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:47.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.356+0000 7f26413e3640 1 -- 172.21.15.47:0/3577147778 shutdown_connections 2024-07-24T22:06:47.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.356+0000 7f26413e3640 1 -- 172.21.15.47:0/3577147778 wait complete. 2024-07-24T22:06:47.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f26413e3640 1 Processor -- start 2024-07-24T22:06:47.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f26413e3640 1 -- start start 2024-07-24T22:06:47.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f26413e3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f263c074eb0 0x7f263c19ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:47.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f26413e3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f263c0757d0 0x7f263c19b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:47.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f26413e3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f263c10ecd0 0x7f263c1a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:47.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f26413e3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f263c1148f0 con 0x7f263c10ecd0 2024-07-24T22:06:47.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f26413e3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f263c114770 con 0x7f263c074eb0 2024-07-24T22:06:47.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f26413e3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f263c114a70 con 0x7f263c0757d0 2024-07-24T22:06:47.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f263b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f263c10ecd0 0x7f263c1a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:47.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f263b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f263c10ecd0 0x7f263c1a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56334/0 (socket says 172.21.15.47:56334) 2024-07-24T22:06:47.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f263b7fe640 1 -- 172.21.15.47:0/526674739 learned_addr learned my addr 172.21.15.47:0/526674739 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:47.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f263affd640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f263c074eb0 0x7f263c19ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:47.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f263a7fc640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f263c0757d0 0x7f263c19b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:47.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f263b7fe640 1 -- 172.21.15.47:0/526674739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f263c0757d0 msgr2=0x7f263c19b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:47.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f263b7fe640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f263c0757d0 0x7f263c19b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f263b7fe640 1 -- 172.21.15.47:0/526674739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f263c074eb0 msgr2=0x7f263c19ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:47.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.357+0000 7f263b7fe640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f263c074eb0 0x7f263c19ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.358+0000 7f263b7fe640 1 -- 172.21.15.47:0/526674739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263c1a0f10 con 0x7f263c10ecd0 2024-07-24T22:06:47.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.358+0000 7f263b7fe640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f263c10ecd0 0x7f263c1a0740 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f263400c970 tx=0x7f263400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:47.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.358+0000 7f2623fff640 1 -- 172.21.15.47:0/526674739 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634004230 con 0x7f263c10ecd0 2024-07-24T22:06:47.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.358+0000 7f2623fff640 1 -- 172.21.15.47:0/526674739 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f263400ae50 con 0x7f263c10ecd0 2024-07-24T22:06:47.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.358+0000 7f26413e3640 1 -- 172.21.15.47:0/526674739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263c1a1200 con 0x7f263c10ecd0 2024-07-24T22:06:47.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.358+0000 7f2623fff640 1 -- 172.21.15.47:0/526674739 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634003d90 con 0x7f263c10ecd0 2024-07-24T22:06:47.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.358+0000 7f26413e3640 1 -- 172.21.15.47:0/526674739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263c1a7940 con 0x7f263c10ecd0 2024-07-24T22:06:47.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.359+0000 7f26413e3640 1 -- 172.21.15.47:0/526674739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f263c075290 con 0x7f263c10ecd0 2024-07-24T22:06:47.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.360+0000 7f2623fff640 1 -- 172.21.15.47:0/526674739 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f26340079b0 con 0x7f263c10ecd0 2024-07-24T22:06:47.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.361+0000 7f2623fff640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f26240b3c20 0x7f26240b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:47.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.361+0000 7f263affd640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f26240b3c20 0x7f26240b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:47.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.361+0000 7f2623fff640 1 -- 172.21.15.47:0/526674739 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f26340e3990 con 0x7f263c10ecd0 2024-07-24T22:06:47.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.362+0000 7f263affd640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f26240b3c20 0x7f26240b60e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f262c0098d0 tx=0x7f262c009900 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:47.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.365+0000 7f2623fff640 1 -- 172.21.15.47:0/526674739 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f2634014070 con 0x7f263c10ecd0 2024-07-24T22:06:47.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:47 smithi188 ceph-mon[37380]: pgmap v353: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-07-24T22:06:47.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:47 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3186559321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:47.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.556+0000 7f26413e3640 1 -- 172.21.15.47:0/526674739 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f263c100410 con 0x7f26240b3c20 2024-07-24T22:06:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.560+0000 7f2623fff640 1 -- 172.21.15.47:0/526674739 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258744 (secure 0 0 0) 0x7f263c100410 con 0x7f26240b3c20 2024-07-24T22:06:47.565 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:47.566 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-07-24T22:06:47.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.563+0000 7f26413e3640 1 -- 172.21.15.47:0/526674739 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f26240b3c20 msgr2=0x7f26240b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:47.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.563+0000 7f26413e3640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f26240b3c20 0x7f26240b60e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f262c0098d0 tx=0x7f262c009900 comp rx=0 tx=0).stop 2024-07-24T22:06:47.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.563+0000 7f26413e3640 1 -- 172.21.15.47:0/526674739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f263c10ecd0 msgr2=0x7f263c1a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:47.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.563+0000 7f26413e3640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f263c10ecd0 0x7f263c1a0740 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f263400c970 tx=0x7f263400cd70 comp rx=0 tx=0).stop 2024-07-24T22:06:47.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.563+0000 7f26413e3640 1 -- 172.21.15.47:0/526674739 shutdown_connections 2024-07-24T22:06:47.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.563+0000 7f26413e3640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f26240b3c20 0x7f26240b60e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.563+0000 7f26413e3640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f263c10ecd0 0x7f263c1a0740 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.563+0000 7f26413e3640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f263c0757d0 0x7f263c19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.563+0000 7f26413e3640 1 --2- 172.21.15.47:0/526674739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f263c074eb0 0x7f263c19ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.563+0000 7f26413e3640 1 -- 172.21.15.47:0/526674739 >> 172.21.15.47:0/526674739 conn(0x7f263c0fe0f0 msgr2=0x7f263c0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:47.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.564+0000 7f26413e3640 1 -- 172.21.15.47:0/526674739 shutdown_connections 2024-07-24T22:06:47.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.564+0000 7f26413e3640 1 -- 172.21.15.47:0/526674739 wait complete. 2024-07-24T22:06:47.575 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:47 smithi047 ceph-mon[32551]: pgmap v353: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-07-24T22:06:47.575 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:47 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3186559321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:47.577 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":353,"stamp":"2024-07-24T22:06:46.117152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653984,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":404,"num_read_kb":294,"num_write":215,"num_write_kb":2243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952539,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":667,"ondisk_log_size":667,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387216,"kb_used_data":13032,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554608,"statfs":{"total":1151940427776,"available":1151543918592,"internally_reserved":0,"allocated":13344768,"data_stored":7597964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002809"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574007+0000","last_change":"2024-07-24T22:03:53.407929+0000","last_active":"2024-07-24T22:05:27.574007+0000","last_peered":"2024-07-24T22:05:27.574007+0000","last_clean":"2024-07-24T22:05:27.574007+0000","last_became_active":"2024-07-24T22:03:53.407508+0000","last_became_peered":"2024-07-24T22:03:53.407508+0000","last_unstale":"2024-07-24T22:05:27.574007+0000","last_undegraded":"2024-07-24T22:05:27.574007+0000","last_fullsized":"2024-07-24T22:05:27.574007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:00:35.699906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696531+0000","last_change":"2024-07-24T22:03:53.404867+0000","last_active":"2024-07-24T22:05:27.696531+0000","last_peered":"2024-07-24T22:05:27.696531+0000","last_clean":"2024-07-24T22:05:27.696531+0000","last_became_active":"2024-07-24T22:03:53.404309+0000","last_became_peered":"2024-07-24T22:03:53.404309+0000","last_unstale":"2024-07-24T22:05:27.696531+0000","last_undegraded":"2024-07-24T22:05:27.696531+0000","last_fullsized":"2024-07-24T22:05:27.696531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:21:51.238815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696402+0000","last_change":"2024-07-24T22:03:53.404368+0000","last_active":"2024-07-24T22:05:27.696402+0000","last_peered":"2024-07-24T22:05:27.696402+0000","last_clean":"2024-07-24T22:05:27.696402+0000","last_became_active":"2024-07-24T22:03:53.403941+0000","last_became_peered":"2024-07-24T22:03:53.403941+0000","last_unstale":"2024-07-24T22:05:27.696402+0000","last_undegraded":"2024-07-24T22:05:27.696402+0000","last_fullsized":"2024-07-24T22:05:27.696402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:10:09.884724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576551+0000","last_change":"2024-07-24T22:03:53.407661+0000","last_active":"2024-07-24T22:05:27.576551+0000","last_peered":"2024-07-24T22:05:27.576551+0000","last_clean":"2024-07-24T22:05:27.576551+0000","last_became_active":"2024-07-24T22:03:53.407375+0000","last_became_peered":"2024-07-24T22:03:53.407375+0000","last_unstale":"2024-07-24T22:05:27.576551+0000","last_undegraded":"2024-07-24T22:05:27.576551+0000","last_fullsized":"2024-07-24T22:05:27.576551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:34.000666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575974+0000","last_change":"2024-07-24T22:03:53.406227+0000","last_active":"2024-07-24T22:05:27.575974+0000","last_peered":"2024-07-24T22:05:27.575974+0000","last_clean":"2024-07-24T22:05:27.575974+0000","last_became_active":"2024-07-24T22:03:53.405819+0000","last_became_peered":"2024-07-24T22:03:53.405819+0000","last_unstale":"2024-07-24T22:05:27.575974+0000","last_undegraded":"2024-07-24T22:05:27.575974+0000","last_fullsized":"2024-07-24T22:05:27.575974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:59.022972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588837+0000","last_change":"2024-07-24T22:04:27.501754+0000","last_active":"2024-07-24T22:05:27.588837+0000","last_peered":"2024-07-24T22:05:27.588837+0000","last_clean":"2024-07-24T22:05:27.588837+0000","last_became_active":"2024-07-24T22:04:27.501340+0000","last_became_peered":"2024-07-24T22:04:27.501340+0000","last_unstale":"2024-07-24T22:05:27.588837+0000","last_undegraded":"2024-07-24T22:05:27.588837+0000","last_fullsized":"2024-07-24T22:05:27.588837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:38:04.880980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575969+0000","last_change":"2024-07-24T22:03:53.413012+0000","last_active":"2024-07-24T22:05:27.575969+0000","last_peered":"2024-07-24T22:05:27.575969+0000","last_clean":"2024-07-24T22:05:27.575969+0000","last_became_active":"2024-07-24T22:03:53.411791+0000","last_became_peered":"2024-07-24T22:03:53.411791+0000","last_unstale":"2024-07-24T22:05:27.575969+0000","last_undegraded":"2024-07-24T22:05:27.575969+0000","last_fullsized":"2024-07-24T22:05:27.575969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:15:02.939598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695762+0000","last_change":"2024-07-24T22:04:27.502867+0000","last_active":"2024-07-24T22:05:27.695762+0000","last_peered":"2024-07-24T22:05:27.695762+0000","last_clean":"2024-07-24T22:05:27.695762+0000","last_became_active":"2024-07-24T22:04:27.502515+0000","last_became_peered":"2024-07-24T22:04:27.502515+0000","last_unstale":"2024-07-24T22:05:27.695762+0000","last_undegraded":"2024-07-24T22:05:27.695762+0000","last_fullsized":"2024-07-24T22:05:27.695762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:58:39.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,10],"acting":[3,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572158+0000","last_change":"2024-07-24T22:03:53.413213+0000","last_active":"2024-07-24T22:05:27.572158+0000","last_peered":"2024-07-24T22:05:27.572158+0000","last_clean":"2024-07-24T22:05:27.572158+0000","last_became_active":"2024-07-24T22:03:53.412725+0000","last_became_peered":"2024-07-24T22:03:53.412725+0000","last_unstale":"2024-07-24T22:05:27.572158+0000","last_undegraded":"2024-07-24T22:05:27.572158+0000","last_fullsized":"2024-07-24T22:05:27.572158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:34:01.897965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589224+0000","last_change":"2024-07-24T22:03:53.401129+0000","last_active":"2024-07-24T22:05:27.589224+0000","last_peered":"2024-07-24T22:05:27.589224+0000","last_clean":"2024-07-24T22:05:27.589224+0000","last_became_active":"2024-07-24T22:03:53.400780+0000","last_became_peered":"2024-07-24T22:03:53.400780+0000","last_unstale":"2024-07-24T22:05:27.589224+0000","last_undegraded":"2024-07-24T22:05:27.589224+0000","last_fullsized":"2024-07-24T22:05:27.589224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:28:37.825021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576231+0000","last_change":"2024-07-24T22:03:53.406490+0000","last_active":"2024-07-24T22:05:27.576231+0000","last_peered":"2024-07-24T22:05:27.576231+0000","last_clean":"2024-07-24T22:05:27.576231+0000","last_became_active":"2024-07-24T22:03:53.406108+0000","last_became_peered":"2024-07-24T22:03:53.406108+0000","last_unstale":"2024-07-24T22:05:27.576231+0000","last_undegraded":"2024-07-24T22:05:27.576231+0000","last_fullsized":"2024-07-24T22:05:27.576231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:37.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695913+0000","last_change":"2024-07-24T22:04:27.503165+0000","last_active":"2024-07-24T22:05:27.695913+0000","last_peered":"2024-07-24T22:05:27.695913+0000","last_clean":"2024-07-24T22:05:27.695913+0000","last_became_active":"2024-07-24T22:04:27.502861+0000","last_became_peered":"2024-07-24T22:04:27.502861+0000","last_unstale":"2024-07-24T22:05:27.695913+0000","last_undegraded":"2024-07-24T22:05:27.695913+0000","last_fullsized":"2024-07-24T22:05:27.695913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:36:41.353268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571263+0000","last_change":"2024-07-24T22:03:53.392763+0000","last_active":"2024-07-24T22:05:27.571263+0000","last_peered":"2024-07-24T22:05:27.571263+0000","last_clean":"2024-07-24T22:05:27.571263+0000","last_became_active":"2024-07-24T22:03:53.392476+0000","last_became_peered":"2024-07-24T22:03:53.392476+0000","last_unstale":"2024-07-24T22:05:27.571263+0000","last_undegraded":"2024-07-24T22:05:27.571263+0000","last_fullsized":"2024-07-24T22:05:27.571263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:25:13.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696340+0000","last_change":"2024-07-24T22:03:53.406937+0000","last_active":"2024-07-24T22:05:27.696340+0000","last_peered":"2024-07-24T22:05:27.696340+0000","last_clean":"2024-07-24T22:05:27.696340+0000","last_became_active":"2024-07-24T22:03:53.406495+0000","last_became_peered":"2024-07-24T22:03:53.406495+0000","last_unstale":"2024-07-24T22:05:27.696340+0000","last_undegraded":"2024-07-24T22:05:27.696340+0000","last_fullsized":"2024-07-24T22:05:27.696340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:06:50.434751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695723+0000","last_change":"2024-07-24T22:03:53.401073+0000","last_active":"2024-07-24T22:05:27.695723+0000","last_peered":"2024-07-24T22:05:27.695723+0000","last_clean":"2024-07-24T22:05:27.695723+0000","last_became_active":"2024-07-24T22:03:53.399675+0000","last_became_peered":"2024-07-24T22:03:53.399675+0000","last_unstale":"2024-07-24T22:05:27.695723+0000","last_undegraded":"2024-07-24T22:05:27.695723+0000","last_fullsized":"2024-07-24T22:05:27.695723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:59:25.461178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571670+0000","last_change":"2024-07-24T22:03:53.408289+0000","last_active":"2024-07-24T22:05:27.571670+0000","last_peered":"2024-07-24T22:05:27.571670+0000","last_clean":"2024-07-24T22:05:27.571670+0000","last_became_active":"2024-07-24T22:03:53.407950+0000","last_became_peered":"2024-07-24T22:03:53.407950+0000","last_unstale":"2024-07-24T22:05:27.571670+0000","last_undegraded":"2024-07-24T22:05:27.571670+0000","last_fullsized":"2024-07-24T22:05:27.571670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:10:30.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574008+0000","last_change":"2024-07-24T22:03:53.409909+0000","last_active":"2024-07-24T22:05:27.574008+0000","last_peered":"2024-07-24T22:05:27.574008+0000","last_clean":"2024-07-24T22:05:27.574008+0000","last_became_active":"2024-07-24T22:03:53.409183+0000","last_became_peered":"2024-07-24T22:03:53.409183+0000","last_unstale":"2024-07-24T22:05:27.574008+0000","last_undegraded":"2024-07-24T22:05:27.574008+0000","last_fullsized":"2024-07-24T22:05:27.574008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:14:50.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695710+0000","last_change":"2024-07-24T22:03:53.401198+0000","last_active":"2024-07-24T22:05:27.695710+0000","last_peered":"2024-07-24T22:05:27.695710+0000","last_clean":"2024-07-24T22:05:27.695710+0000","last_became_active":"2024-07-24T22:03:53.400885+0000","last_became_peered":"2024-07-24T22:03:53.400885+0000","last_unstale":"2024-07-24T22:05:27.695710+0000","last_undegraded":"2024-07-24T22:05:27.695710+0000","last_fullsized":"2024-07-24T22:05:27.695710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:59:37.965714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696048+0000","last_change":"2024-07-24T22:03:53.406590+0000","last_active":"2024-07-24T22:05:27.696048+0000","last_peered":"2024-07-24T22:05:27.696048+0000","last_clean":"2024-07-24T22:05:27.696048+0000","last_became_active":"2024-07-24T22:03:53.406283+0000","last_became_peered":"2024-07-24T22:03:53.406283+0000","last_unstale":"2024-07-24T22:05:27.696048+0000","last_undegraded":"2024-07-24T22:05:27.696048+0000","last_fullsized":"2024-07-24T22:05:27.696048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:30.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573401+0000","last_change":"2024-07-24T22:03:53.408790+0000","last_active":"2024-07-24T22:05:27.573401+0000","last_peered":"2024-07-24T22:05:27.573401+0000","last_clean":"2024-07-24T22:05:27.573401+0000","last_became_active":"2024-07-24T22:03:53.408480+0000","last_became_peered":"2024-07-24T22:03:53.408480+0000","last_unstale":"2024-07-24T22:05:27.573401+0000","last_undegraded":"2024-07-24T22:05:27.573401+0000","last_fullsized":"2024-07-24T22:05:27.573401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:59.601606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571171+0000","last_change":"2024-07-24T22:03:53.407400+0000","last_active":"2024-07-24T22:05:27.571171+0000","last_peered":"2024-07-24T22:05:27.571171+0000","last_clean":"2024-07-24T22:05:27.571171+0000","last_became_active":"2024-07-24T22:03:53.407084+0000","last_became_peered":"2024-07-24T22:03:53.407084+0000","last_unstale":"2024-07-24T22:05:27.571171+0000","last_undegraded":"2024-07-24T22:05:27.571171+0000","last_fullsized":"2024-07-24T22:05:27.571171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:51:04.942504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571785+0000","last_change":"2024-07-24T22:03:53.407444+0000","last_active":"2024-07-24T22:05:27.571785+0000","last_peered":"2024-07-24T22:05:27.571785+0000","last_clean":"2024-07-24T22:05:27.571785+0000","last_became_active":"2024-07-24T22:03:53.407025+0000","last_became_peered":"2024-07-24T22:03:53.407025+0000","last_unstale":"2024-07-24T22:05:27.571785+0000","last_undegraded":"2024-07-24T22:05:27.571785+0000","last_fullsized":"2024-07-24T22:05:27.571785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:47:49.620354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696170+0000","last_change":"2024-07-24T22:03:53.406748+0000","last_active":"2024-07-24T22:05:27.696170+0000","last_peered":"2024-07-24T22:05:27.696170+0000","last_clean":"2024-07-24T22:05:27.696170+0000","last_became_active":"2024-07-24T22:03:53.406398+0000","last_became_peered":"2024-07-24T22:03:53.406398+0000","last_unstale":"2024-07-24T22:05:27.696170+0000","last_undegraded":"2024-07-24T22:05:27.696170+0000","last_fullsized":"2024-07-24T22:05:27.696170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:35:40.117375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574701+0000","last_change":"2024-07-24T22:03:53.402203+0000","last_active":"2024-07-24T22:05:27.574701+0000","last_peered":"2024-07-24T22:05:27.574701+0000","last_clean":"2024-07-24T22:05:27.574701+0000","last_became_active":"2024-07-24T22:03:53.401826+0000","last_became_peered":"2024-07-24T22:03:53.401826+0000","last_unstale":"2024-07-24T22:05:27.574701+0000","last_undegraded":"2024-07-24T22:05:27.574701+0000","last_fullsized":"2024-07-24T22:05:27.574701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:45.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696666+0000","last_change":"2024-07-24T22:03:53.408179+0000","last_active":"2024-07-24T22:05:27.696666+0000","last_peered":"2024-07-24T22:05:27.696666+0000","last_clean":"2024-07-24T22:05:27.696666+0000","last_became_active":"2024-07-24T22:03:53.407547+0000","last_became_peered":"2024-07-24T22:03:53.407547+0000","last_unstale":"2024-07-24T22:05:27.696666+0000","last_undegraded":"2024-07-24T22:05:27.696666+0000","last_fullsized":"2024-07-24T22:05:27.696666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:03:52.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696074+0000","last_change":"2024-07-24T22:03:53.408550+0000","last_active":"2024-07-24T22:05:27.696074+0000","last_peered":"2024-07-24T22:05:27.696074+0000","last_clean":"2024-07-24T22:05:27.696074+0000","last_became_active":"2024-07-24T22:03:53.408119+0000","last_became_peered":"2024-07-24T22:03:53.408119+0000","last_unstale":"2024-07-24T22:05:27.696074+0000","last_undegraded":"2024-07-24T22:05:27.696074+0000","last_fullsized":"2024-07-24T22:05:27.696074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:33:54.154606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573853+0000","last_change":"2024-07-24T22:03:53.412562+0000","last_active":"2024-07-24T22:05:27.573853+0000","last_peered":"2024-07-24T22:05:27.573853+0000","last_clean":"2024-07-24T22:05:27.573853+0000","last_became_active":"2024-07-24T22:03:53.412231+0000","last_became_peered":"2024-07-24T22:03:53.412231+0000","last_unstale":"2024-07-24T22:05:27.573853+0000","last_undegraded":"2024-07-24T22:05:27.573853+0000","last_fullsized":"2024-07-24T22:05:27.573853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:53:48.403662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571173+0000","last_change":"2024-07-24T22:03:53.398212+0000","last_active":"2024-07-24T22:05:27.571173+0000","last_peered":"2024-07-24T22:05:27.571173+0000","last_clean":"2024-07-24T22:05:27.571173+0000","last_became_active":"2024-07-24T22:03:53.397853+0000","last_became_peered":"2024-07-24T22:03:53.397853+0000","last_unstale":"2024-07-24T22:05:27.571173+0000","last_undegraded":"2024-07-24T22:05:27.571173+0000","last_fullsized":"2024-07-24T22:05:27.571173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:39:47.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696283+0000","last_change":"2024-07-24T22:03:53.397188+0000","last_active":"2024-07-24T22:05:27.696283+0000","last_peered":"2024-07-24T22:05:27.696283+0000","last_clean":"2024-07-24T22:05:27.696283+0000","last_became_active":"2024-07-24T22:03:53.396865+0000","last_became_peered":"2024-07-24T22:03:53.396865+0000","last_unstale":"2024-07-24T22:05:27.696283+0000","last_undegraded":"2024-07-24T22:05:27.696283+0000","last_fullsized":"2024-07-24T22:05:27.696283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:20:49.074330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695823+0000","last_change":"2024-07-24T22:03:53.406605+0000","last_active":"2024-07-24T22:05:27.695823+0000","last_peered":"2024-07-24T22:05:27.695823+0000","last_clean":"2024-07-24T22:05:27.695823+0000","last_became_active":"2024-07-24T22:03:53.406264+0000","last_became_peered":"2024-07-24T22:03:53.406264+0000","last_unstale":"2024-07-24T22:05:27.695823+0000","last_undegraded":"2024-07-24T22:05:27.695823+0000","last_fullsized":"2024-07-24T22:05:27.695823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:13:46.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696013+0000","last_change":"2024-07-24T22:03:53.400422+0000","last_active":"2024-07-24T22:05:27.696013+0000","last_peered":"2024-07-24T22:05:27.696013+0000","last_clean":"2024-07-24T22:05:27.696013+0000","last_became_active":"2024-07-24T22:03:53.400096+0000","last_became_peered":"2024-07-24T22:03:53.400096+0000","last_unstale":"2024-07-24T22:05:27.696013+0000","last_undegraded":"2024-07-24T22:05:27.696013+0000","last_fullsized":"2024-07-24T22:05:27.696013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:04:07.882659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573363+0000","last_change":"2024-07-24T22:03:53.413231+0000","last_active":"2024-07-24T22:05:27.573363+0000","last_peered":"2024-07-24T22:05:27.573363+0000","last_clean":"2024-07-24T22:05:27.573363+0000","last_became_active":"2024-07-24T22:03:53.412825+0000","last_became_peered":"2024-07-24T22:03:53.412825+0000","last_unstale":"2024-07-24T22:05:27.573363+0000","last_undegraded":"2024-07-24T22:05:27.573363+0000","last_fullsized":"2024-07-24T22:05:27.573363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:59:30.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575993+0000","last_change":"2024-07-24T22:03:53.409007+0000","last_active":"2024-07-24T22:05:27.575993+0000","last_peered":"2024-07-24T22:05:27.575993+0000","last_clean":"2024-07-24T22:05:27.575993+0000","last_became_active":"2024-07-24T22:03:53.408624+0000","last_became_peered":"2024-07-24T22:03:53.408624+0000","last_unstale":"2024-07-24T22:05:27.575993+0000","last_undegraded":"2024-07-24T22:05:27.575993+0000","last_fullsized":"2024-07-24T22:05:27.575993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:31:22.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575311+0000","last_change":"2024-07-24T22:03:50.388894+0000","last_active":"2024-07-24T22:05:27.575311+0000","last_peered":"2024-07-24T22:05:27.575311+0000","last_clean":"2024-07-24T22:05:27.575311+0000","last_became_active":"2024-07-24T22:03:50.388608+0000","last_became_peered":"2024-07-24T22:03:50.388608+0000","last_unstale":"2024-07-24T22:05:27.575311+0000","last_undegraded":"2024-07-24T22:05:27.575311+0000","last_fullsized":"2024-07-24T22:05:27.575311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:36:43.571415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575239+0000","last_change":"2024-07-24T22:03:53.397509+0000","last_active":"2024-07-24T22:05:27.575239+0000","last_peered":"2024-07-24T22:05:27.575239+0000","last_clean":"2024-07-24T22:05:27.575239+0000","last_became_active":"2024-07-24T22:03:53.397186+0000","last_became_peered":"2024-07-24T22:03:53.397186+0000","last_unstale":"2024-07-24T22:05:27.575239+0000","last_undegraded":"2024-07-24T22:05:27.575239+0000","last_fullsized":"2024-07-24T22:05:27.575239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:15:14.081853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588955+0000","last_change":"2024-07-24T22:03:50.383523+0000","last_active":"2024-07-24T22:05:27.588955+0000","last_peered":"2024-07-24T22:05:27.588955+0000","last_clean":"2024-07-24T22:05:27.588955+0000","last_became_active":"2024-07-24T22:03:50.383088+0000","last_became_peered":"2024-07-24T22:03:50.383088+0000","last_unstale":"2024-07-24T22:05:27.588955+0000","last_undegraded":"2024-07-24T22:05:27.588955+0000","last_fullsized":"2024-07-24T22:05:27.588955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:57:07.824581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570963+0000","last_change":"2024-07-24T22:03:50.383726+0000","last_active":"2024-07-24T22:05:27.570963+0000","last_peered":"2024-07-24T22:05:27.570963+0000","last_clean":"2024-07-24T22:05:27.570963+0000","last_became_active":"2024-07-24T22:03:50.383480+0000","last_became_peered":"2024-07-24T22:03:50.383480+0000","last_unstale":"2024-07-24T22:05:27.570963+0000","last_undegraded":"2024-07-24T22:05:27.570963+0000","last_fullsized":"2024-07-24T22:05:27.570963+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:05:05.093272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695819+0000","last_change":"2024-07-24T22:03:53.406223+0000","last_active":"2024-07-24T22:05:27.695819+0000","last_peered":"2024-07-24T22:05:27.695819+0000","last_clean":"2024-07-24T22:05:27.695819+0000","last_became_active":"2024-07-24T22:03:53.404642+0000","last_became_peered":"2024-07-24T22:03:53.404642+0000","last_unstale":"2024-07-24T22:05:27.695819+0000","last_undegraded":"2024-07-24T22:05:27.695819+0000","last_fullsized":"2024-07-24T22:05:27.695819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:00:51.849538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574889+0000","last_change":"2024-07-24T22:03:50.385780+0000","last_active":"2024-07-24T22:05:27.574889+0000","last_peered":"2024-07-24T22:05:27.574889+0000","last_clean":"2024-07-24T22:05:27.574889+0000","last_became_active":"2024-07-24T22:03:50.385488+0000","last_became_peered":"2024-07-24T22:03:50.385488+0000","last_unstale":"2024-07-24T22:05:27.574889+0000","last_undegraded":"2024-07-24T22:05:27.574889+0000","last_fullsized":"2024-07-24T22:05:27.574889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:47:35.908303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695950+0000","last_change":"2024-07-24T22:03:53.403103+0000","last_active":"2024-07-24T22:05:27.695950+0000","last_peered":"2024-07-24T22:05:27.695950+0000","last_clean":"2024-07-24T22:05:27.695950+0000","last_became_active":"2024-07-24T22:03:53.402810+0000","last_became_peered":"2024-07-24T22:03:53.402810+0000","last_unstale":"2024-07-24T22:05:27.695950+0000","last_undegraded":"2024-07-24T22:05:27.695950+0000","last_fullsized":"2024-07-24T22:05:27.695950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:15.798983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589069+0000","last_change":"2024-07-24T22:03:50.382383+0000","last_active":"2024-07-24T22:05:27.589069+0000","last_peered":"2024-07-24T22:05:27.589069+0000","last_clean":"2024-07-24T22:05:27.589069+0000","last_became_active":"2024-07-24T22:03:50.381629+0000","last_became_peered":"2024-07-24T22:03:50.381629+0000","last_unstale":"2024-07-24T22:05:27.589069+0000","last_undegraded":"2024-07-24T22:05:27.589069+0000","last_fullsized":"2024-07-24T22:05:27.589069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:17.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572154+0000","last_change":"2024-07-24T22:03:53.409587+0000","last_active":"2024-07-24T22:05:27.572154+0000","last_peered":"2024-07-24T22:05:27.572154+0000","last_clean":"2024-07-24T22:05:27.572154+0000","last_became_active":"2024-07-24T22:03:53.409240+0000","last_became_peered":"2024-07-24T22:03:53.409240+0000","last_unstale":"2024-07-24T22:05:27.572154+0000","last_undegraded":"2024-07-24T22:05:27.572154+0000","last_fullsized":"2024-07-24T22:05:27.572154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:37:18.654244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576466+0000","last_change":"2024-07-24T22:03:50.387933+0000","last_active":"2024-07-24T22:05:27.576466+0000","last_peered":"2024-07-24T22:05:27.576466+0000","last_clean":"2024-07-24T22:05:27.576466+0000","last_became_active":"2024-07-24T22:03:50.386985+0000","last_became_peered":"2024-07-24T22:03:50.386985+0000","last_unstale":"2024-07-24T22:05:27.576466+0000","last_undegraded":"2024-07-24T22:05:27.576466+0000","last_fullsized":"2024-07-24T22:05:27.576466+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:35:29.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696682+0000","last_change":"2024-07-24T22:03:53.404419+0000","last_active":"2024-07-24T22:05:27.696682+0000","last_peered":"2024-07-24T22:05:27.696682+0000","last_clean":"2024-07-24T22:05:27.696682+0000","last_became_active":"2024-07-24T22:03:53.402713+0000","last_became_peered":"2024-07-24T22:03:53.402713+0000","last_unstale":"2024-07-24T22:05:27.696682+0000","last_undegraded":"2024-07-24T22:05:27.696682+0000","last_fullsized":"2024-07-24T22:05:27.696682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:41.262686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575104+0000","last_change":"2024-07-24T22:03:50.511126+0000","last_active":"2024-07-24T22:05:27.575104+0000","last_peered":"2024-07-24T22:05:27.575104+0000","last_clean":"2024-07-24T22:05:27.575104+0000","last_became_active":"2024-07-24T22:03:50.510801+0000","last_became_peered":"2024-07-24T22:03:50.510801+0000","last_unstale":"2024-07-24T22:05:27.575104+0000","last_undegraded":"2024-07-24T22:05:27.575104+0000","last_fullsized":"2024-07-24T22:05:27.575104+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:59:37.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571928+0000","last_change":"2024-07-24T22:03:53.410202+0000","last_active":"2024-07-24T22:05:27.571928+0000","last_peered":"2024-07-24T22:05:27.571928+0000","last_clean":"2024-07-24T22:05:27.571928+0000","last_became_active":"2024-07-24T22:03:53.409884+0000","last_became_peered":"2024-07-24T22:03:53.409884+0000","last_unstale":"2024-07-24T22:05:27.571928+0000","last_undegraded":"2024-07-24T22:05:27.571928+0000","last_fullsized":"2024-07-24T22:05:27.571928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:54:02.603267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'30","reported_seq":379,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:06:40.702509+0000","last_change":"2024-07-24T22:03:50.386993+0000","last_active":"2024-07-24T22:06:40.702509+0000","last_peered":"2024-07-24T22:06:40.702509+0000","last_clean":"2024-07-24T22:06:40.702509+0000","last_became_active":"2024-07-24T22:03:50.386675+0000","last_became_peered":"2024-07-24T22:03:50.386675+0000","last_unstale":"2024-07-24T22:06:40.702509+0000","last_undegraded":"2024-07-24T22:06:40.702509+0000","last_fullsized":"2024-07-24T22:06:40.702509+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:20:58.384179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62584,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":317,"num_read_kb":219,"num_write":30,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576569+0000","last_change":"2024-07-24T22:03:53.413293+0000","last_active":"2024-07-24T22:05:27.576569+0000","last_peered":"2024-07-24T22:05:27.576569+0000","last_clean":"2024-07-24T22:05:27.576569+0000","last_became_active":"2024-07-24T22:03:53.412900+0000","last_became_peered":"2024-07-24T22:03:53.412900+0000","last_unstale":"2024-07-24T22:05:27.576569+0000","last_undegraded":"2024-07-24T22:05:27.576569+0000","last_fullsized":"2024-07-24T22:05:27.576569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:11:32.553108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696109+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.696109+0000","last_peered":"2024-07-24T22:05:27.696109+0000","last_clean":"2024-07-24T22:05:27.696109+0000","last_became_active":"2024-07-24T22:03:50.387059+0000","last_became_peered":"2024-07-24T22:03:50.387059+0000","last_unstale":"2024-07-24T22:05:27.696109+0000","last_undegraded":"2024-07-24T22:05:27.696109+0000","last_fullsized":"2024-07-24T22:05:27.696109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:40:06.887090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570910+0000","last_change":"2024-07-24T22:03:53.406808+0000","last_active":"2024-07-24T22:05:27.570910+0000","last_peered":"2024-07-24T22:05:27.570910+0000","last_clean":"2024-07-24T22:05:27.570910+0000","last_became_active":"2024-07-24T22:03:53.406487+0000","last_became_peered":"2024-07-24T22:03:53.406487+0000","last_unstale":"2024-07-24T22:05:27.570910+0000","last_undegraded":"2024-07-24T22:05:27.570910+0000","last_fullsized":"2024-07-24T22:05:27.570910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:44:57.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574923+0000","last_change":"2024-07-24T22:03:50.386881+0000","last_active":"2024-07-24T22:05:27.574923+0000","last_peered":"2024-07-24T22:05:27.574923+0000","last_clean":"2024-07-24T22:05:27.574923+0000","last_became_active":"2024-07-24T22:03:50.386564+0000","last_became_peered":"2024-07-24T22:03:50.386564+0000","last_unstale":"2024-07-24T22:05:27.574923+0000","last_undegraded":"2024-07-24T22:05:27.574923+0000","last_fullsized":"2024-07-24T22:05:27.574923+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:22:22.339854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576277+0000","last_change":"2024-07-24T22:03:53.403207+0000","last_active":"2024-07-24T22:05:27.576277+0000","last_peered":"2024-07-24T22:05:27.576277+0000","last_clean":"2024-07-24T22:05:27.576277+0000","last_became_active":"2024-07-24T22:03:53.402875+0000","last_became_peered":"2024-07-24T22:03:53.402875+0000","last_unstale":"2024-07-24T22:05:27.576277+0000","last_undegraded":"2024-07-24T22:05:27.576277+0000","last_fullsized":"2024-07-24T22:05:27.576277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:25:28.866228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575960+0000","last_change":"2024-07-24T22:03:50.386721+0000","last_active":"2024-07-24T22:05:27.575960+0000","last_peered":"2024-07-24T22:05:27.575960+0000","last_clean":"2024-07-24T22:05:27.575960+0000","last_became_active":"2024-07-24T22:03:50.385654+0000","last_became_peered":"2024-07-24T22:03:50.385654+0000","last_unstale":"2024-07-24T22:05:27.575960+0000","last_undegraded":"2024-07-24T22:05:27.575960+0000","last_fullsized":"2024-07-24T22:05:27.575960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:16:15.802744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575896+0000","last_change":"2024-07-24T22:03:53.405367+0000","last_active":"2024-07-24T22:05:27.575896+0000","last_peered":"2024-07-24T22:05:27.575896+0000","last_clean":"2024-07-24T22:05:27.575896+0000","last_became_active":"2024-07-24T22:03:53.404875+0000","last_became_peered":"2024-07-24T22:03:53.404875+0000","last_unstale":"2024-07-24T22:05:27.575896+0000","last_undegraded":"2024-07-24T22:05:27.575896+0000","last_fullsized":"2024-07-24T22:05:27.575896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:42.247052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575893+0000","last_change":"2024-07-24T22:04:27.574426+0000","last_active":"2024-07-24T22:05:27.575893+0000","last_peered":"2024-07-24T22:05:27.575893+0000","last_clean":"2024-07-24T22:05:27.575893+0000","last_became_active":"2024-07-24T22:04:27.568176+0000","last_became_peered":"2024-07-24T22:04:27.568176+0000","last_unstale":"2024-07-24T22:05:27.575893+0000","last_undegraded":"2024-07-24T22:05:27.575893+0000","last_fullsized":"2024-07-24T22:05:27.575893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:20:37.620669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574893+0000","last_change":"2024-07-24T22:03:53.405136+0000","last_active":"2024-07-24T22:05:27.574893+0000","last_peered":"2024-07-24T22:05:27.574893+0000","last_clean":"2024-07-24T22:05:27.574893+0000","last_became_active":"2024-07-24T22:03:53.404043+0000","last_became_peered":"2024-07-24T22:03:53.404043+0000","last_unstale":"2024-07-24T22:05:27.574893+0000","last_undegraded":"2024-07-24T22:05:27.574893+0000","last_fullsized":"2024-07-24T22:05:27.574893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:03:21.912335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576738+0000","last_change":"2024-07-24T22:03:50.382364+0000","last_active":"2024-07-24T22:05:27.576738+0000","last_peered":"2024-07-24T22:05:27.576738+0000","last_clean":"2024-07-24T22:05:27.576738+0000","last_became_active":"2024-07-24T22:03:50.382029+0000","last_became_peered":"2024-07-24T22:03:50.382029+0000","last_unstale":"2024-07-24T22:05:27.576738+0000","last_undegraded":"2024-07-24T22:05:27.576738+0000","last_fullsized":"2024-07-24T22:05:27.576738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:48:10.004826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573801+0000","last_change":"2024-07-24T22:03:53.413053+0000","last_active":"2024-07-24T22:05:27.573801+0000","last_peered":"2024-07-24T22:05:27.573801+0000","last_clean":"2024-07-24T22:05:27.573801+0000","last_became_active":"2024-07-24T22:03:53.412733+0000","last_became_peered":"2024-07-24T22:03:53.412733+0000","last_unstale":"2024-07-24T22:05:27.573801+0000","last_undegraded":"2024-07-24T22:05:27.573801+0000","last_fullsized":"2024-07-24T22:05:27.573801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:16.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571346+0000","last_change":"2024-07-24T22:03:50.387314+0000","last_active":"2024-07-24T22:05:27.571346+0000","last_peered":"2024-07-24T22:05:27.571346+0000","last_clean":"2024-07-24T22:05:27.571346+0000","last_became_active":"2024-07-24T22:03:50.386919+0000","last_became_peered":"2024-07-24T22:03:50.386919+0000","last_unstale":"2024-07-24T22:05:27.571346+0000","last_undegraded":"2024-07-24T22:05:27.571346+0000","last_fullsized":"2024-07-24T22:05:27.571346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:51:03.203285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576716+0000","last_change":"2024-07-24T22:03:53.411938+0000","last_active":"2024-07-24T22:05:27.576716+0000","last_peered":"2024-07-24T22:05:27.576716+0000","last_clean":"2024-07-24T22:05:27.576716+0000","last_became_active":"2024-07-24T22:03:53.411545+0000","last_became_peered":"2024-07-24T22:03:53.411545+0000","last_unstale":"2024-07-24T22:05:27.576716+0000","last_undegraded":"2024-07-24T22:05:27.576716+0000","last_fullsized":"2024-07-24T22:05:27.576716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:41:19.370886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575188+0000","last_change":"2024-07-24T22:03:50.384400+0000","last_active":"2024-07-24T22:05:27.575188+0000","last_peered":"2024-07-24T22:05:27.575188+0000","last_clean":"2024-07-24T22:05:27.575188+0000","last_became_active":"2024-07-24T22:03:50.383945+0000","last_became_peered":"2024-07-24T22:03:50.383945+0000","last_unstale":"2024-07-24T22:05:27.575188+0000","last_undegraded":"2024-07-24T22:05:27.575188+0000","last_fullsized":"2024-07-24T22:05:27.575188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:16.035171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576430+0000","last_change":"2024-07-24T22:04:27.507390+0000","last_active":"2024-07-24T22:05:27.576430+0000","last_peered":"2024-07-24T22:05:27.576430+0000","last_clean":"2024-07-24T22:05:27.576430+0000","last_became_active":"2024-07-24T22:04:27.504206+0000","last_became_peered":"2024-07-24T22:04:27.504206+0000","last_unstale":"2024-07-24T22:05:27.576430+0000","last_undegraded":"2024-07-24T22:05:27.576430+0000","last_fullsized":"2024-07-24T22:05:27.576430+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:55:21.559702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696182+0000","last_change":"2024-07-24T22:03:50.511075+0000","last_active":"2024-07-24T22:05:27.696182+0000","last_peered":"2024-07-24T22:05:27.696182+0000","last_clean":"2024-07-24T22:05:27.696182+0000","last_became_active":"2024-07-24T22:03:50.510244+0000","last_became_peered":"2024-07-24T22:03:50.510244+0000","last_unstale":"2024-07-24T22:05:27.696182+0000","last_undegraded":"2024-07-24T22:05:27.696182+0000","last_fullsized":"2024-07-24T22:05:27.696182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:54:03.068211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576340+0000","last_change":"2024-07-24T22:03:53.410865+0000","last_active":"2024-07-24T22:05:27.576340+0000","last_peered":"2024-07-24T22:05:27.576340+0000","last_clean":"2024-07-24T22:05:27.576340+0000","last_became_active":"2024-07-24T22:03:53.410255+0000","last_became_peered":"2024-07-24T22:03:53.410255+0000","last_unstale":"2024-07-24T22:05:27.576340+0000","last_undegraded":"2024-07-24T22:05:27.576340+0000","last_fullsized":"2024-07-24T22:05:27.576340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:15.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576134+0000","last_change":"2024-07-24T22:02:33.494929+0000","last_active":"2024-07-24T22:05:27.576134+0000","last_peered":"2024-07-24T22:05:27.576134+0000","last_clean":"2024-07-24T22:05:27.576134+0000","last_became_active":"2024-07-24T22:02:33.489241+0000","last_became_peered":"2024-07-24T22:02:33.489241+0000","last_unstale":"2024-07-24T22:05:27.576134+0000","last_undegraded":"2024-07-24T22:05:27.576134+0000","last_fullsized":"2024-07-24T22:05:27.576134+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_clean_scrub_stamp":"2024-07-24T21:59:32.406119+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:46.421413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576268+0000","last_change":"2024-07-24T22:03:50.385093+0000","last_active":"2024-07-24T22:05:27.576268+0000","last_peered":"2024-07-24T22:05:27.576268+0000","last_clean":"2024-07-24T22:05:27.576268+0000","last_became_active":"2024-07-24T22:03:50.384639+0000","last_became_peered":"2024-07-24T22:03:50.384639+0000","last_unstale":"2024-07-24T22:05:27.576268+0000","last_undegraded":"2024-07-24T22:05:27.576268+0000","last_fullsized":"2024-07-24T22:05:27.576268+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:06:10.402336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696068+0000","last_change":"2024-07-24T22:03:53.409627+0000","last_active":"2024-07-24T22:05:27.696068+0000","last_peered":"2024-07-24T22:05:27.696068+0000","last_clean":"2024-07-24T22:05:27.696068+0000","last_became_active":"2024-07-24T22:03:53.409295+0000","last_became_peered":"2024-07-24T22:03:53.409295+0000","last_unstale":"2024-07-24T22:05:27.696068+0000","last_undegraded":"2024-07-24T22:05:27.696068+0000","last_fullsized":"2024-07-24T22:05:27.696068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:23:39.670020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576402+0000","last_change":"2024-07-24T22:03:50.385772+0000","last_active":"2024-07-24T22:05:27.576402+0000","last_peered":"2024-07-24T22:05:27.576402+0000","last_clean":"2024-07-24T22:05:27.576402+0000","last_became_active":"2024-07-24T22:03:50.385421+0000","last_became_peered":"2024-07-24T22:03:50.385421+0000","last_unstale":"2024-07-24T22:05:27.576402+0000","last_undegraded":"2024-07-24T22:05:27.576402+0000","last_fullsized":"2024-07-24T22:05:27.576402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:58:57.227697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570892+0000","last_change":"2024-07-24T22:03:53.400558+0000","last_active":"2024-07-24T22:05:27.570892+0000","last_peered":"2024-07-24T22:05:27.570892+0000","last_clean":"2024-07-24T22:05:27.570892+0000","last_became_active":"2024-07-24T22:03:53.400131+0000","last_became_peered":"2024-07-24T22:03:53.400131+0000","last_unstale":"2024-07-24T22:05:27.570892+0000","last_undegraded":"2024-07-24T22:05:27.570892+0000","last_fullsized":"2024-07-24T22:05:27.570892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:57:57.586742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571018+0000","last_change":"2024-07-24T22:03:50.510189+0000","last_active":"2024-07-24T22:05:27.571018+0000","last_peered":"2024-07-24T22:05:27.571018+0000","last_clean":"2024-07-24T22:05:27.571018+0000","last_became_active":"2024-07-24T22:03:50.509857+0000","last_became_peered":"2024-07-24T22:03:50.509857+0000","last_unstale":"2024-07-24T22:05:27.571018+0000","last_undegraded":"2024-07-24T22:05:27.571018+0000","last_fullsized":"2024-07-24T22:05:27.571018+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:05:59.240650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574703+0000","last_change":"2024-07-24T22:04:27.505187+0000","last_active":"2024-07-24T22:05:27.574703+0000","last_peered":"2024-07-24T22:05:27.574703+0000","last_clean":"2024-07-24T22:05:27.574703+0000","last_became_active":"2024-07-24T22:04:27.504785+0000","last_became_peered":"2024-07-24T22:04:27.504785+0000","last_unstale":"2024-07-24T22:05:27.574703+0000","last_undegraded":"2024-07-24T22:05:27.574703+0000","last_fullsized":"2024-07-24T22:05:27.574703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:47:33.516835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576182+0000","last_change":"2024-07-24T22:05:27.575016+0000","last_active":"2024-07-24T22:05:27.576182+0000","last_peered":"2024-07-24T22:05:27.576182+0000","last_clean":"2024-07-24T22:05:27.576182+0000","last_became_active":"2024-07-24T22:05:27.574644+0000","last_became_peered":"2024-07-24T22:05:27.574644+0000","last_unstale":"2024-07-24T22:05:27.576182+0000","last_undegraded":"2024-07-24T22:05:27.576182+0000","last_fullsized":"2024-07-24T22:05:27.576182+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:11:37.759190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588938+0000","last_change":"2024-07-24T22:03:53.399369+0000","last_active":"2024-07-24T22:05:27.588938+0000","last_peered":"2024-07-24T22:05:27.588938+0000","last_clean":"2024-07-24T22:05:27.588938+0000","last_became_active":"2024-07-24T22:03:53.399001+0000","last_became_peered":"2024-07-24T22:03:53.399001+0000","last_unstale":"2024-07-24T22:05:27.588938+0000","last_undegraded":"2024-07-24T22:05:27.588938+0000","last_fullsized":"2024-07-24T22:05:27.588938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:26:46.531080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695870+0000","last_change":"2024-07-24T22:03:50.510889+0000","last_active":"2024-07-24T22:05:27.695870+0000","last_peered":"2024-07-24T22:05:27.695870+0000","last_clean":"2024-07-24T22:05:27.695870+0000","last_became_active":"2024-07-24T22:03:50.510366+0000","last_became_peered":"2024-07-24T22:03:50.510366+0000","last_unstale":"2024-07-24T22:05:27.695870+0000","last_undegraded":"2024-07-24T22:05:27.695870+0000","last_fullsized":"2024-07-24T22:05:27.695870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:47:54.838304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589019+0000","last_change":"2024-07-24T22:03:53.398987+0000","last_active":"2024-07-24T22:05:27.589019+0000","last_peered":"2024-07-24T22:05:27.589019+0000","last_clean":"2024-07-24T22:05:27.589019+0000","last_became_active":"2024-07-24T22:03:53.398604+0000","last_became_peered":"2024-07-24T22:03:53.398604+0000","last_unstale":"2024-07-24T22:05:27.589019+0000","last_undegraded":"2024-07-24T22:05:27.589019+0000","last_fullsized":"2024-07-24T22:05:27.589019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:28:41.684174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576685+0000","last_change":"2024-07-24T22:03:50.510623+0000","last_active":"2024-07-24T22:05:27.576685+0000","last_peered":"2024-07-24T22:05:27.576685+0000","last_clean":"2024-07-24T22:05:27.576685+0000","last_became_active":"2024-07-24T22:03:50.510204+0000","last_became_peered":"2024-07-24T22:03:50.510204+0000","last_unstale":"2024-07-24T22:05:27.576685+0000","last_undegraded":"2024-07-24T22:05:27.576685+0000","last_fullsized":"2024-07-24T22:05:27.576685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:06:40.838840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571179+0000","last_change":"2024-07-24T22:03:53.400289+0000","last_active":"2024-07-24T22:05:27.571179+0000","last_peered":"2024-07-24T22:05:27.571179+0000","last_clean":"2024-07-24T22:05:27.571179+0000","last_became_active":"2024-07-24T22:03:53.399939+0000","last_became_peered":"2024-07-24T22:03:53.399939+0000","last_unstale":"2024-07-24T22:05:27.571179+0000","last_undegraded":"2024-07-24T22:05:27.571179+0000","last_fullsized":"2024-07-24T22:05:27.571179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:29:26.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:06:04.017159+0000","last_change":"2024-07-24T22:03:50.382776+0000","last_active":"2024-07-24T22:06:04.017159+0000","last_peered":"2024-07-24T22:06:04.017159+0000","last_clean":"2024-07-24T22:06:04.017159+0000","last_became_active":"2024-07-24T22:03:50.382474+0000","last_became_peered":"2024-07-24T22:03:50.382474+0000","last_unstale":"2024-07-24T22:06:04.017159+0000","last_undegraded":"2024-07-24T22:06:04.017159+0000","last_fullsized":"2024-07-24T22:06:04.017159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:59:34.688895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696694+0000","last_change":"2024-07-24T22:03:53.407883+0000","last_active":"2024-07-24T22:05:27.696694+0000","last_peered":"2024-07-24T22:05:27.696694+0000","last_clean":"2024-07-24T22:05:27.696694+0000","last_became_active":"2024-07-24T22:03:53.407524+0000","last_became_peered":"2024-07-24T22:03:53.407524+0000","last_unstale":"2024-07-24T22:05:27.696694+0000","last_undegraded":"2024-07-24T22:05:27.696694+0000","last_fullsized":"2024-07-24T22:05:27.696694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:52:25.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576771+0000","last_change":"2024-07-24T22:03:50.388789+0000","last_active":"2024-07-24T22:05:27.576771+0000","last_peered":"2024-07-24T22:05:27.576771+0000","last_clean":"2024-07-24T22:05:27.576771+0000","last_became_active":"2024-07-24T22:03:50.385439+0000","last_became_peered":"2024-07-24T22:03:50.385439+0000","last_unstale":"2024-07-24T22:05:27.576771+0000","last_undegraded":"2024-07-24T22:05:27.576771+0000","last_fullsized":"2024-07-24T22:05:27.576771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:14:25.009588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696603+0000","last_change":"2024-07-24T22:04:27.503956+0000","last_active":"2024-07-24T22:05:27.696603+0000","last_peered":"2024-07-24T22:05:27.696603+0000","last_clean":"2024-07-24T22:05:27.696603+0000","last_became_active":"2024-07-24T22:04:27.503498+0000","last_became_peered":"2024-07-24T22:04:27.503498+0000","last_unstale":"2024-07-24T22:05:27.696603+0000","last_undegraded":"2024-07-24T22:05:27.696603+0000","last_fullsized":"2024-07-24T22:05:27.696603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:23:20.294458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571757+0000","last_change":"2024-07-24T22:03:50.510687+0000","last_active":"2024-07-24T22:05:27.571757+0000","last_peered":"2024-07-24T22:05:27.571757+0000","last_clean":"2024-07-24T22:05:27.571757+0000","last_became_active":"2024-07-24T22:03:50.510310+0000","last_became_peered":"2024-07-24T22:03:50.510310+0000","last_unstale":"2024-07-24T22:05:27.571757+0000","last_undegraded":"2024-07-24T22:05:27.571757+0000","last_fullsized":"2024-07-24T22:05:27.571757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:14:29.957324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576327+0000","last_change":"2024-07-24T22:03:53.412711+0000","last_active":"2024-07-24T22:05:27.576327+0000","last_peered":"2024-07-24T22:05:27.576327+0000","last_clean":"2024-07-24T22:05:27.576327+0000","last_became_active":"2024-07-24T22:03:53.412375+0000","last_became_peered":"2024-07-24T22:03:53.412375+0000","last_unstale":"2024-07-24T22:05:27.576327+0000","last_undegraded":"2024-07-24T22:05:27.576327+0000","last_fullsized":"2024-07-24T22:05:27.576327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:55:29.441385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696331+0000","last_change":"2024-07-24T22:03:50.383094+0000","last_active":"2024-07-24T22:05:27.696331+0000","last_peered":"2024-07-24T22:05:27.696331+0000","last_clean":"2024-07-24T22:05:27.696331+0000","last_became_active":"2024-07-24T22:03:50.382687+0000","last_became_peered":"2024-07-24T22:03:50.382687+0000","last_unstale":"2024-07-24T22:05:27.696331+0000","last_undegraded":"2024-07-24T22:05:27.696331+0000","last_fullsized":"2024-07-24T22:05:27.696331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:32:02.727855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573366+0000","last_change":"2024-07-24T22:03:53.403709+0000","last_active":"2024-07-24T22:05:27.573366+0000","last_peered":"2024-07-24T22:05:27.573366+0000","last_clean":"2024-07-24T22:05:27.573366+0000","last_became_active":"2024-07-24T22:03:53.403334+0000","last_became_peered":"2024-07-24T22:03:53.403334+0000","last_unstale":"2024-07-24T22:05:27.573366+0000","last_undegraded":"2024-07-24T22:05:27.573366+0000","last_fullsized":"2024-07-24T22:05:27.573366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:27:50.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695814+0000","last_change":"2024-07-24T22:03:50.385547+0000","last_active":"2024-07-24T22:05:27.695814+0000","last_peered":"2024-07-24T22:05:27.695814+0000","last_clean":"2024-07-24T22:05:27.695814+0000","last_became_active":"2024-07-24T22:03:50.385233+0000","last_became_peered":"2024-07-24T22:03:50.385233+0000","last_unstale":"2024-07-24T22:05:27.695814+0000","last_undegraded":"2024-07-24T22:05:27.695814+0000","last_fullsized":"2024-07-24T22:05:27.695814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:40:04.647242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696043+0000","last_change":"2024-07-24T22:03:53.402386+0000","last_active":"2024-07-24T22:05:27.696043+0000","last_peered":"2024-07-24T22:05:27.696043+0000","last_clean":"2024-07-24T22:05:27.696043+0000","last_became_active":"2024-07-24T22:03:53.399363+0000","last_became_peered":"2024-07-24T22:03:53.399363+0000","last_unstale":"2024-07-24T22:05:27.696043+0000","last_undegraded":"2024-07-24T22:05:27.696043+0000","last_fullsized":"2024-07-24T22:05:27.696043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:19:05.835280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576088+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.576088+0000","last_peered":"2024-07-24T22:05:27.576088+0000","last_clean":"2024-07-24T22:05:27.576088+0000","last_became_active":"2024-07-24T22:03:50.387097+0000","last_became_peered":"2024-07-24T22:03:50.387097+0000","last_unstale":"2024-07-24T22:05:27.576088+0000","last_undegraded":"2024-07-24T22:05:27.576088+0000","last_fullsized":"2024-07-24T22:05:27.576088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:11:23.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576510+0000","last_change":"2024-07-24T22:03:53.407386+0000","last_active":"2024-07-24T22:05:27.576510+0000","last_peered":"2024-07-24T22:05:27.576510+0000","last_clean":"2024-07-24T22:05:27.576510+0000","last_became_active":"2024-07-24T22:03:53.407059+0000","last_became_peered":"2024-07-24T22:03:53.407059+0000","last_unstale":"2024-07-24T22:05:27.576510+0000","last_undegraded":"2024-07-24T22:05:27.576510+0000","last_fullsized":"2024-07-24T22:05:27.576510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:12:38.508170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695772+0000","last_change":"2024-07-24T22:04:27.567714+0000","last_active":"2024-07-24T22:05:27.695772+0000","last_peered":"2024-07-24T22:05:27.695772+0000","last_clean":"2024-07-24T22:05:27.695772+0000","last_became_active":"2024-07-24T22:04:27.567492+0000","last_became_peered":"2024-07-24T22:04:27.567492+0000","last_unstale":"2024-07-24T22:05:27.695772+0000","last_undegraded":"2024-07-24T22:05:27.695772+0000","last_fullsized":"2024-07-24T22:05:27.695772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:00:13.705346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576278+0000","last_change":"2024-07-24T22:03:50.385538+0000","last_active":"2024-07-24T22:05:27.576278+0000","last_peered":"2024-07-24T22:05:27.576278+0000","last_clean":"2024-07-24T22:05:27.576278+0000","last_became_active":"2024-07-24T22:03:50.385191+0000","last_became_peered":"2024-07-24T22:03:50.385191+0000","last_unstale":"2024-07-24T22:05:27.576278+0000","last_undegraded":"2024-07-24T22:05:27.576278+0000","last_fullsized":"2024-07-24T22:05:27.576278+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:33:37.674903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571800+0000","last_change":"2024-07-24T22:03:53.411751+0000","last_active":"2024-07-24T22:05:27.571800+0000","last_peered":"2024-07-24T22:05:27.571800+0000","last_clean":"2024-07-24T22:05:27.571800+0000","last_became_active":"2024-07-24T22:03:53.410827+0000","last_became_peered":"2024-07-24T22:03:53.410827+0000","last_unstale":"2024-07-24T22:05:27.571800+0000","last_undegraded":"2024-07-24T22:05:27.571800+0000","last_fullsized":"2024-07-24T22:05:27.571800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:07:26.439047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.584159+0000","last_change":"2024-07-24T22:05:27.581982+0000","last_active":"2024-07-24T22:05:27.584159+0000","last_peered":"2024-07-24T22:05:27.584159+0000","last_clean":"2024-07-24T22:05:27.584159+0000","last_became_active":"2024-07-24T22:05:27.577413+0000","last_became_peered":"2024-07-24T22:05:27.577413+0000","last_unstale":"2024-07-24T22:05:27.584159+0000","last_undegraded":"2024-07-24T22:05:27.584159+0000","last_fullsized":"2024-07-24T22:05:27.584159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:40:27.424379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696604+0000","last_change":"2024-07-24T22:03:53.406029+0000","last_active":"2024-07-24T22:05:27.696604+0000","last_peered":"2024-07-24T22:05:27.696604+0000","last_clean":"2024-07-24T22:05:27.696604+0000","last_became_active":"2024-07-24T22:03:53.405529+0000","last_became_peered":"2024-07-24T22:03:53.405529+0000","last_unstale":"2024-07-24T22:05:27.696604+0000","last_undegraded":"2024-07-24T22:05:27.696604+0000","last_fullsized":"2024-07-24T22:05:27.696604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:57:02.290836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696580+0000","last_change":"2024-07-24T22:03:50.510884+0000","last_active":"2024-07-24T22:05:27.696580+0000","last_peered":"2024-07-24T22:05:27.696580+0000","last_clean":"2024-07-24T22:05:27.696580+0000","last_became_active":"2024-07-24T22:03:50.509851+0000","last_became_peered":"2024-07-24T22:03:50.509851+0000","last_unstale":"2024-07-24T22:05:27.696580+0000","last_undegraded":"2024-07-24T22:05:27.696580+0000","last_fullsized":"2024-07-24T22:05:27.696580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:37:55.735488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696364+0000","last_change":"2024-07-24T22:03:53.409966+0000","last_active":"2024-07-24T22:05:27.696364+0000","last_peered":"2024-07-24T22:05:27.696364+0000","last_clean":"2024-07-24T22:05:27.696364+0000","last_became_active":"2024-07-24T22:03:53.409652+0000","last_became_peered":"2024-07-24T22:03:53.409652+0000","last_unstale":"2024-07-24T22:05:27.696364+0000","last_undegraded":"2024-07-24T22:05:27.696364+0000","last_fullsized":"2024-07-24T22:05:27.696364+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:10:53.262459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696523+0000","last_change":"2024-07-24T22:04:27.571166+0000","last_active":"2024-07-24T22:05:27.696523+0000","last_peered":"2024-07-24T22:05:27.696523+0000","last_clean":"2024-07-24T22:05:27.696523+0000","last_became_active":"2024-07-24T22:04:27.567419+0000","last_became_peered":"2024-07-24T22:04:27.567419+0000","last_unstale":"2024-07-24T22:05:27.696523+0000","last_undegraded":"2024-07-24T22:05:27.696523+0000","last_fullsized":"2024-07-24T22:05:27.696523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:37:11.513631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63382,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":323,"num_read_kb":225,"num_write":90,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612659,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":937984,"data_stored":469642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1122905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972411,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40428,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704724,"statfs":{"total":95995035648,"available":95953637376,"internally_reserved":0,"allocated":946176,"data_stored":470341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168640,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":469664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397571,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1540096,"data_stored":1060709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561096,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":469759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757325,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1548288,"data_stored":1060309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920848,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117077,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40432,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704720,"statfs":{"total":95995035648,"available":95953633280,"internally_reserved":0,"allocated":950272,"data_stored":469863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378714,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":532260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542239,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":533116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705761,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":62778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T22:06:47.581 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T22:06:47.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:47 smithi183 ceph-mon[37007]: pgmap v353: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-07-24T22:06:47.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:47 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3186559321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.719+0000 7fd86de65640 1 -- 172.21.15.47:0/185177616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8681082c0 msgr2=0x7fd868108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.719+0000 7fd86de65640 1 --2- 172.21.15.47:0/185177616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8681082c0 0x7fd868108720 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009900 tx=0x7fd85c02a410 comp rx=0 tx=0).stop 2024-07-24T22:06:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.719+0000 7fd86de65640 1 -- 172.21.15.47:0/185177616 shutdown_connections 2024-07-24T22:06:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.720+0000 7fd86de65640 1 --2- 172.21.15.47:0/185177616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd868108c60 0x7fd86810f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.720+0000 7fd86de65640 1 --2- 172.21.15.47:0/185177616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8681082c0 0x7fd868108720 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.720+0000 7fd86de65640 1 --2- 172.21.15.47:0/185177616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8681010f0 0x7fd8681014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.720+0000 7fd86de65640 1 -- 172.21.15.47:0/185177616 >> 172.21.15.47:0/185177616 conn(0x7fd868075690 msgr2=0x7fd868075aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.720+0000 7fd86de65640 1 -- 172.21.15.47:0/185177616 shutdown_connections 2024-07-24T22:06:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.720+0000 7fd86de65640 1 -- 172.21.15.47:0/185177616 wait complete. 2024-07-24T22:06:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.720+0000 7fd86de65640 1 Processor -- start 2024-07-24T22:06:47.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.720+0000 7fd86de65640 1 -- start start 2024-07-24T22:06:47.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.720+0000 7fd86de65640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8681010f0 0x7fd8681020b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:47.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.720+0000 7fd86de65640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8681082c0 0x7fd8681025f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:47.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.720+0000 7fd86de65640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd868108c60 0x7fd868102b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:47.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd86de65640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd868112790 con 0x7fd868108c60 2024-07-24T22:06:47.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd86de65640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd868112610 con 0x7fd8681082c0 2024-07-24T22:06:47.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd86de65640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd868112910 con 0x7fd8681010f0 2024-07-24T22:06:47.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd867fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd868108c60 0x7fd868102b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:47.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd867fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd868108c60 0x7fd868102b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56352/0 (socket says 172.21.15.47:56352) 2024-07-24T22:06:47.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd867fff640 1 -- 172.21.15.47:0/3672815696 learned_addr learned my addr 172.21.15.47:0/3672815696 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:47.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd8677fe640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8681010f0 0x7fd8681020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:47.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd867fff640 1 -- 172.21.15.47:0/3672815696 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8681010f0 msgr2=0x7fd8681020b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:47.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd866ffd640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8681082c0 0x7fd8681025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:47.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd867fff640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8681010f0 0x7fd8681020b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd867fff640 1 -- 172.21.15.47:0/3672815696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8681082c0 msgr2=0x7fd8681025f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:47.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd867fff640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8681082c0 0x7fd8681025f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd867fff640 1 -- 172.21.15.47:0/3672815696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8681a7120 con 0x7fd868108c60 2024-07-24T22:06:47.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd8677fe640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8681010f0 0x7fd8681020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:06:47.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd867fff640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd868108c60 0x7fd868102b30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd86000eb10 tx=0x7fd86000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:47.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd864ff9640 1 -- 172.21.15.47:0/3672815696 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd860004b20 con 0x7fd868108c60 2024-07-24T22:06:47.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd86de65640 1 -- 172.21.15.47:0/3672815696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8681a7410 con 0x7fd868108c60 2024-07-24T22:06:47.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd864ff9640 1 -- 172.21.15.47:0/3672815696 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd860004cc0 con 0x7fd868108c60 2024-07-24T22:06:47.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd864ff9640 1 -- 172.21.15.47:0/3672815696 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd860010670 con 0x7fd868108c60 2024-07-24T22:06:47.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.721+0000 7fd86de65640 1 -- 172.21.15.47:0/3672815696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8681a7910 con 0x7fd868108c60 2024-07-24T22:06:47.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.722+0000 7fd86de65640 1 -- 172.21.15.47:0/3672815696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8681014d0 con 0x7fd868108c60 2024-07-24T22:06:47.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.724+0000 7fd864ff9640 1 -- 172.21.15.47:0/3672815696 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7fd860005020 con 0x7fd868108c60 2024-07-24T22:06:47.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.725+0000 7fd864ff9640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8500b3c20 0x7fd8500b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:47.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.725+0000 7fd8677fe640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8500b3c20 0x7fd8500b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:47.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.725+0000 7fd864ff9640 1 -- 172.21.15.47:0/3672815696 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fd8600e44b0 con 0x7fd868108c60 2024-07-24T22:06:47.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.725+0000 7fd8677fe640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8500b3c20 0x7fd8500b60e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd858009b50 tx=0x7fd858005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:47.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.729+0000 7fd864ff9640 1 -- 172.21.15.47:0/3672815696 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fd8600ab9e0 con 0x7fd868108c60 2024-07-24T22:06:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.922+0000 7fd86de65640 1 -- 172.21.15.47:0/3672815696 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd86810a9e0 con 0x7fd8500b3c20 2024-07-24T22:06:47.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.926+0000 7fd864ff9640 1 -- 172.21.15.47:0/3672815696 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258744 (secure 0 0 0) 0x7fd86810a9e0 con 0x7fd8500b3c20 2024-07-24T22:06:47.931 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:47.932 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-07-24T22:06:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.929+0000 7fd86de65640 1 -- 172.21.15.47:0/3672815696 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8500b3c20 msgr2=0x7fd8500b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.929+0000 7fd86de65640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8500b3c20 0x7fd8500b60e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd858009b50 tx=0x7fd858005f90 comp rx=0 tx=0).stop 2024-07-24T22:06:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.929+0000 7fd86de65640 1 -- 172.21.15.47:0/3672815696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd868108c60 msgr2=0x7fd868102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.929+0000 7fd86de65640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd868108c60 0x7fd868102b30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd86000eb10 tx=0x7fd86000c2d0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.929+0000 7fd86de65640 1 -- 172.21.15.47:0/3672815696 shutdown_connections 2024-07-24T22:06:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.929+0000 7fd86de65640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8500b3c20 0x7fd8500b60e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.929+0000 7fd86de65640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd868108c60 0x7fd868102b30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.929+0000 7fd86de65640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8681082c0 0x7fd8681025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.929+0000 7fd86de65640 1 --2- 172.21.15.47:0/3672815696 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8681010f0 0x7fd8681020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.929+0000 7fd86de65640 1 -- 172.21.15.47:0/3672815696 >> 172.21.15.47:0/3672815696 conn(0x7fd868075690 msgr2=0x7fd8680ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.929+0000 7fd86de65640 1 -- 172.21.15.47:0/3672815696 shutdown_connections 2024-07-24T22:06:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:47.929+0000 7fd86de65640 1 -- 172.21.15.47:0/3672815696 wait complete. 2024-07-24T22:06:47.942 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":353,"stamp":"2024-07-24T22:06:46.117152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653984,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":404,"num_read_kb":294,"num_write":215,"num_write_kb":2243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952539,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":667,"ondisk_log_size":667,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387216,"kb_used_data":13032,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554608,"statfs":{"total":1151940427776,"available":1151543918592,"internally_reserved":0,"allocated":13344768,"data_stored":7597964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002809"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574007+0000","last_change":"2024-07-24T22:03:53.407929+0000","last_active":"2024-07-24T22:05:27.574007+0000","last_peered":"2024-07-24T22:05:27.574007+0000","last_clean":"2024-07-24T22:05:27.574007+0000","last_became_active":"2024-07-24T22:03:53.407508+0000","last_became_peered":"2024-07-24T22:03:53.407508+0000","last_unstale":"2024-07-24T22:05:27.574007+0000","last_undegraded":"2024-07-24T22:05:27.574007+0000","last_fullsized":"2024-07-24T22:05:27.574007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:00:35.699906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696531+0000","last_change":"2024-07-24T22:03:53.404867+0000","last_active":"2024-07-24T22:05:27.696531+0000","last_peered":"2024-07-24T22:05:27.696531+0000","last_clean":"2024-07-24T22:05:27.696531+0000","last_became_active":"2024-07-24T22:03:53.404309+0000","last_became_peered":"2024-07-24T22:03:53.404309+0000","last_unstale":"2024-07-24T22:05:27.696531+0000","last_undegraded":"2024-07-24T22:05:27.696531+0000","last_fullsized":"2024-07-24T22:05:27.696531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:21:51.238815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696402+0000","last_change":"2024-07-24T22:03:53.404368+0000","last_active":"2024-07-24T22:05:27.696402+0000","last_peered":"2024-07-24T22:05:27.696402+0000","last_clean":"2024-07-24T22:05:27.696402+0000","last_became_active":"2024-07-24T22:03:53.403941+0000","last_became_peered":"2024-07-24T22:03:53.403941+0000","last_unstale":"2024-07-24T22:05:27.696402+0000","last_undegraded":"2024-07-24T22:05:27.696402+0000","last_fullsized":"2024-07-24T22:05:27.696402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:10:09.884724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576551+0000","last_change":"2024-07-24T22:03:53.407661+0000","last_active":"2024-07-24T22:05:27.576551+0000","last_peered":"2024-07-24T22:05:27.576551+0000","last_clean":"2024-07-24T22:05:27.576551+0000","last_became_active":"2024-07-24T22:03:53.407375+0000","last_became_peered":"2024-07-24T22:03:53.407375+0000","last_unstale":"2024-07-24T22:05:27.576551+0000","last_undegraded":"2024-07-24T22:05:27.576551+0000","last_fullsized":"2024-07-24T22:05:27.576551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:34.000666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575974+0000","last_change":"2024-07-24T22:03:53.406227+0000","last_active":"2024-07-24T22:05:27.575974+0000","last_peered":"2024-07-24T22:05:27.575974+0000","last_clean":"2024-07-24T22:05:27.575974+0000","last_became_active":"2024-07-24T22:03:53.405819+0000","last_became_peered":"2024-07-24T22:03:53.405819+0000","last_unstale":"2024-07-24T22:05:27.575974+0000","last_undegraded":"2024-07-24T22:05:27.575974+0000","last_fullsized":"2024-07-24T22:05:27.575974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:59.022972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588837+0000","last_change":"2024-07-24T22:04:27.501754+0000","last_active":"2024-07-24T22:05:27.588837+0000","last_peered":"2024-07-24T22:05:27.588837+0000","last_clean":"2024-07-24T22:05:27.588837+0000","last_became_active":"2024-07-24T22:04:27.501340+0000","last_became_peered":"2024-07-24T22:04:27.501340+0000","last_unstale":"2024-07-24T22:05:27.588837+0000","last_undegraded":"2024-07-24T22:05:27.588837+0000","last_fullsized":"2024-07-24T22:05:27.588837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:38:04.880980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575969+0000","last_change":"2024-07-24T22:03:53.413012+0000","last_active":"2024-07-24T22:05:27.575969+0000","last_peered":"2024-07-24T22:05:27.575969+0000","last_clean":"2024-07-24T22:05:27.575969+0000","last_became_active":"2024-07-24T22:03:53.411791+0000","last_became_peered":"2024-07-24T22:03:53.411791+0000","last_unstale":"2024-07-24T22:05:27.575969+0000","last_undegraded":"2024-07-24T22:05:27.575969+0000","last_fullsized":"2024-07-24T22:05:27.575969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:15:02.939598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695762+0000","last_change":"2024-07-24T22:04:27.502867+0000","last_active":"2024-07-24T22:05:27.695762+0000","last_peered":"2024-07-24T22:05:27.695762+0000","last_clean":"2024-07-24T22:05:27.695762+0000","last_became_active":"2024-07-24T22:04:27.502515+0000","last_became_peered":"2024-07-24T22:04:27.502515+0000","last_unstale":"2024-07-24T22:05:27.695762+0000","last_undegraded":"2024-07-24T22:05:27.695762+0000","last_fullsized":"2024-07-24T22:05:27.695762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:58:39.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,10],"acting":[3,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572158+0000","last_change":"2024-07-24T22:03:53.413213+0000","last_active":"2024-07-24T22:05:27.572158+0000","last_peered":"2024-07-24T22:05:27.572158+0000","last_clean":"2024-07-24T22:05:27.572158+0000","last_became_active":"2024-07-24T22:03:53.412725+0000","last_became_peered":"2024-07-24T22:03:53.412725+0000","last_unstale":"2024-07-24T22:05:27.572158+0000","last_undegraded":"2024-07-24T22:05:27.572158+0000","last_fullsized":"2024-07-24T22:05:27.572158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:34:01.897965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589224+0000","last_change":"2024-07-24T22:03:53.401129+0000","last_active":"2024-07-24T22:05:27.589224+0000","last_peered":"2024-07-24T22:05:27.589224+0000","last_clean":"2024-07-24T22:05:27.589224+0000","last_became_active":"2024-07-24T22:03:53.400780+0000","last_became_peered":"2024-07-24T22:03:53.400780+0000","last_unstale":"2024-07-24T22:05:27.589224+0000","last_undegraded":"2024-07-24T22:05:27.589224+0000","last_fullsized":"2024-07-24T22:05:27.589224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:28:37.825021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576231+0000","last_change":"2024-07-24T22:03:53.406490+0000","last_active":"2024-07-24T22:05:27.576231+0000","last_peered":"2024-07-24T22:05:27.576231+0000","last_clean":"2024-07-24T22:05:27.576231+0000","last_became_active":"2024-07-24T22:03:53.406108+0000","last_became_peered":"2024-07-24T22:03:53.406108+0000","last_unstale":"2024-07-24T22:05:27.576231+0000","last_undegraded":"2024-07-24T22:05:27.576231+0000","last_fullsized":"2024-07-24T22:05:27.576231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:37.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695913+0000","last_change":"2024-07-24T22:04:27.503165+0000","last_active":"2024-07-24T22:05:27.695913+0000","last_peered":"2024-07-24T22:05:27.695913+0000","last_clean":"2024-07-24T22:05:27.695913+0000","last_became_active":"2024-07-24T22:04:27.502861+0000","last_became_peered":"2024-07-24T22:04:27.502861+0000","last_unstale":"2024-07-24T22:05:27.695913+0000","last_undegraded":"2024-07-24T22:05:27.695913+0000","last_fullsized":"2024-07-24T22:05:27.695913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:36:41.353268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571263+0000","last_change":"2024-07-24T22:03:53.392763+0000","last_active":"2024-07-24T22:05:27.571263+0000","last_peered":"2024-07-24T22:05:27.571263+0000","last_clean":"2024-07-24T22:05:27.571263+0000","last_became_active":"2024-07-24T22:03:53.392476+0000","last_became_peered":"2024-07-24T22:03:53.392476+0000","last_unstale":"2024-07-24T22:05:27.571263+0000","last_undegraded":"2024-07-24T22:05:27.571263+0000","last_fullsized":"2024-07-24T22:05:27.571263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:25:13.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696340+0000","last_change":"2024-07-24T22:03:53.406937+0000","last_active":"2024-07-24T22:05:27.696340+0000","last_peered":"2024-07-24T22:05:27.696340+0000","last_clean":"2024-07-24T22:05:27.696340+0000","last_became_active":"2024-07-24T22:03:53.406495+0000","last_became_peered":"2024-07-24T22:03:53.406495+0000","last_unstale":"2024-07-24T22:05:27.696340+0000","last_undegraded":"2024-07-24T22:05:27.696340+0000","last_fullsized":"2024-07-24T22:05:27.696340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:06:50.434751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695723+0000","last_change":"2024-07-24T22:03:53.401073+0000","last_active":"2024-07-24T22:05:27.695723+0000","last_peered":"2024-07-24T22:05:27.695723+0000","last_clean":"2024-07-24T22:05:27.695723+0000","last_became_active":"2024-07-24T22:03:53.399675+0000","last_became_peered":"2024-07-24T22:03:53.399675+0000","last_unstale":"2024-07-24T22:05:27.695723+0000","last_undegraded":"2024-07-24T22:05:27.695723+0000","last_fullsized":"2024-07-24T22:05:27.695723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:59:25.461178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571670+0000","last_change":"2024-07-24T22:03:53.408289+0000","last_active":"2024-07-24T22:05:27.571670+0000","last_peered":"2024-07-24T22:05:27.571670+0000","last_clean":"2024-07-24T22:05:27.571670+0000","last_became_active":"2024-07-24T22:03:53.407950+0000","last_became_peered":"2024-07-24T22:03:53.407950+0000","last_unstale":"2024-07-24T22:05:27.571670+0000","last_undegraded":"2024-07-24T22:05:27.571670+0000","last_fullsized":"2024-07-24T22:05:27.571670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:10:30.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574008+0000","last_change":"2024-07-24T22:03:53.409909+0000","last_active":"2024-07-24T22:05:27.574008+0000","last_peered":"2024-07-24T22:05:27.574008+0000","last_clean":"2024-07-24T22:05:27.574008+0000","last_became_active":"2024-07-24T22:03:53.409183+0000","last_became_peered":"2024-07-24T22:03:53.409183+0000","last_unstale":"2024-07-24T22:05:27.574008+0000","last_undegraded":"2024-07-24T22:05:27.574008+0000","last_fullsized":"2024-07-24T22:05:27.574008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:14:50.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695710+0000","last_change":"2024-07-24T22:03:53.401198+0000","last_active":"2024-07-24T22:05:27.695710+0000","last_peered":"2024-07-24T22:05:27.695710+0000","last_clean":"2024-07-24T22:05:27.695710+0000","last_became_active":"2024-07-24T22:03:53.400885+0000","last_became_peered":"2024-07-24T22:03:53.400885+0000","last_unstale":"2024-07-24T22:05:27.695710+0000","last_undegraded":"2024-07-24T22:05:27.695710+0000","last_fullsized":"2024-07-24T22:05:27.695710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:59:37.965714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696048+0000","last_change":"2024-07-24T22:03:53.406590+0000","last_active":"2024-07-24T22:05:27.696048+0000","last_peered":"2024-07-24T22:05:27.696048+0000","last_clean":"2024-07-24T22:05:27.696048+0000","last_became_active":"2024-07-24T22:03:53.406283+0000","last_became_peered":"2024-07-24T22:03:53.406283+0000","last_unstale":"2024-07-24T22:05:27.696048+0000","last_undegraded":"2024-07-24T22:05:27.696048+0000","last_fullsized":"2024-07-24T22:05:27.696048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:30.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573401+0000","last_change":"2024-07-24T22:03:53.408790+0000","last_active":"2024-07-24T22:05:27.573401+0000","last_peered":"2024-07-24T22:05:27.573401+0000","last_clean":"2024-07-24T22:05:27.573401+0000","last_became_active":"2024-07-24T22:03:53.408480+0000","last_became_peered":"2024-07-24T22:03:53.408480+0000","last_unstale":"2024-07-24T22:05:27.573401+0000","last_undegraded":"2024-07-24T22:05:27.573401+0000","last_fullsized":"2024-07-24T22:05:27.573401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:59.601606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571171+0000","last_change":"2024-07-24T22:03:53.407400+0000","last_active":"2024-07-24T22:05:27.571171+0000","last_peered":"2024-07-24T22:05:27.571171+0000","last_clean":"2024-07-24T22:05:27.571171+0000","last_became_active":"2024-07-24T22:03:53.407084+0000","last_became_peered":"2024-07-24T22:03:53.407084+0000","last_unstale":"2024-07-24T22:05:27.571171+0000","last_undegraded":"2024-07-24T22:05:27.571171+0000","last_fullsized":"2024-07-24T22:05:27.571171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:51:04.942504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571785+0000","last_change":"2024-07-24T22:03:53.407444+0000","last_active":"2024-07-24T22:05:27.571785+0000","last_peered":"2024-07-24T22:05:27.571785+0000","last_clean":"2024-07-24T22:05:27.571785+0000","last_became_active":"2024-07-24T22:03:53.407025+0000","last_became_peered":"2024-07-24T22:03:53.407025+0000","last_unstale":"2024-07-24T22:05:27.571785+0000","last_undegraded":"2024-07-24T22:05:27.571785+0000","last_fullsized":"2024-07-24T22:05:27.571785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:47:49.620354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696170+0000","last_change":"2024-07-24T22:03:53.406748+0000","last_active":"2024-07-24T22:05:27.696170+0000","last_peered":"2024-07-24T22:05:27.696170+0000","last_clean":"2024-07-24T22:05:27.696170+0000","last_became_active":"2024-07-24T22:03:53.406398+0000","last_became_peered":"2024-07-24T22:03:53.406398+0000","last_unstale":"2024-07-24T22:05:27.696170+0000","last_undegraded":"2024-07-24T22:05:27.696170+0000","last_fullsized":"2024-07-24T22:05:27.696170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:35:40.117375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574701+0000","last_change":"2024-07-24T22:03:53.402203+0000","last_active":"2024-07-24T22:05:27.574701+0000","last_peered":"2024-07-24T22:05:27.574701+0000","last_clean":"2024-07-24T22:05:27.574701+0000","last_became_active":"2024-07-24T22:03:53.401826+0000","last_became_peered":"2024-07-24T22:03:53.401826+0000","last_unstale":"2024-07-24T22:05:27.574701+0000","last_undegraded":"2024-07-24T22:05:27.574701+0000","last_fullsized":"2024-07-24T22:05:27.574701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:45.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696666+0000","last_change":"2024-07-24T22:03:53.408179+0000","last_active":"2024-07-24T22:05:27.696666+0000","last_peered":"2024-07-24T22:05:27.696666+0000","last_clean":"2024-07-24T22:05:27.696666+0000","last_became_active":"2024-07-24T22:03:53.407547+0000","last_became_peered":"2024-07-24T22:03:53.407547+0000","last_unstale":"2024-07-24T22:05:27.696666+0000","last_undegraded":"2024-07-24T22:05:27.696666+0000","last_fullsized":"2024-07-24T22:05:27.696666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:03:52.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696074+0000","last_change":"2024-07-24T22:03:53.408550+0000","last_active":"2024-07-24T22:05:27.696074+0000","last_peered":"2024-07-24T22:05:27.696074+0000","last_clean":"2024-07-24T22:05:27.696074+0000","last_became_active":"2024-07-24T22:03:53.408119+0000","last_became_peered":"2024-07-24T22:03:53.408119+0000","last_unstale":"2024-07-24T22:05:27.696074+0000","last_undegraded":"2024-07-24T22:05:27.696074+0000","last_fullsized":"2024-07-24T22:05:27.696074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:33:54.154606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573853+0000","last_change":"2024-07-24T22:03:53.412562+0000","last_active":"2024-07-24T22:05:27.573853+0000","last_peered":"2024-07-24T22:05:27.573853+0000","last_clean":"2024-07-24T22:05:27.573853+0000","last_became_active":"2024-07-24T22:03:53.412231+0000","last_became_peered":"2024-07-24T22:03:53.412231+0000","last_unstale":"2024-07-24T22:05:27.573853+0000","last_undegraded":"2024-07-24T22:05:27.573853+0000","last_fullsized":"2024-07-24T22:05:27.573853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:53:48.403662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571173+0000","last_change":"2024-07-24T22:03:53.398212+0000","last_active":"2024-07-24T22:05:27.571173+0000","last_peered":"2024-07-24T22:05:27.571173+0000","last_clean":"2024-07-24T22:05:27.571173+0000","last_became_active":"2024-07-24T22:03:53.397853+0000","last_became_peered":"2024-07-24T22:03:53.397853+0000","last_unstale":"2024-07-24T22:05:27.571173+0000","last_undegraded":"2024-07-24T22:05:27.571173+0000","last_fullsized":"2024-07-24T22:05:27.571173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:39:47.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696283+0000","last_change":"2024-07-24T22:03:53.397188+0000","last_active":"2024-07-24T22:05:27.696283+0000","last_peered":"2024-07-24T22:05:27.696283+0000","last_clean":"2024-07-24T22:05:27.696283+0000","last_became_active":"2024-07-24T22:03:53.396865+0000","last_became_peered":"2024-07-24T22:03:53.396865+0000","last_unstale":"2024-07-24T22:05:27.696283+0000","last_undegraded":"2024-07-24T22:05:27.696283+0000","last_fullsized":"2024-07-24T22:05:27.696283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:20:49.074330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695823+0000","last_change":"2024-07-24T22:03:53.406605+0000","last_active":"2024-07-24T22:05:27.695823+0000","last_peered":"2024-07-24T22:05:27.695823+0000","last_clean":"2024-07-24T22:05:27.695823+0000","last_became_active":"2024-07-24T22:03:53.406264+0000","last_became_peered":"2024-07-24T22:03:53.406264+0000","last_unstale":"2024-07-24T22:05:27.695823+0000","last_undegraded":"2024-07-24T22:05:27.695823+0000","last_fullsized":"2024-07-24T22:05:27.695823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:13:46.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696013+0000","last_change":"2024-07-24T22:03:53.400422+0000","last_active":"2024-07-24T22:05:27.696013+0000","last_peered":"2024-07-24T22:05:27.696013+0000","last_clean":"2024-07-24T22:05:27.696013+0000","last_became_active":"2024-07-24T22:03:53.400096+0000","last_became_peered":"2024-07-24T22:03:53.400096+0000","last_unstale":"2024-07-24T22:05:27.696013+0000","last_undegraded":"2024-07-24T22:05:27.696013+0000","last_fullsized":"2024-07-24T22:05:27.696013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:04:07.882659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573363+0000","last_change":"2024-07-24T22:03:53.413231+0000","last_active":"2024-07-24T22:05:27.573363+0000","last_peered":"2024-07-24T22:05:27.573363+0000","last_clean":"2024-07-24T22:05:27.573363+0000","last_became_active":"2024-07-24T22:03:53.412825+0000","last_became_peered":"2024-07-24T22:03:53.412825+0000","last_unstale":"2024-07-24T22:05:27.573363+0000","last_undegraded":"2024-07-24T22:05:27.573363+0000","last_fullsized":"2024-07-24T22:05:27.573363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:59:30.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575993+0000","last_change":"2024-07-24T22:03:53.409007+0000","last_active":"2024-07-24T22:05:27.575993+0000","last_peered":"2024-07-24T22:05:27.575993+0000","last_clean":"2024-07-24T22:05:27.575993+0000","last_became_active":"2024-07-24T22:03:53.408624+0000","last_became_peered":"2024-07-24T22:03:53.408624+0000","last_unstale":"2024-07-24T22:05:27.575993+0000","last_undegraded":"2024-07-24T22:05:27.575993+0000","last_fullsized":"2024-07-24T22:05:27.575993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:31:22.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575311+0000","last_change":"2024-07-24T22:03:50.388894+0000","last_active":"2024-07-24T22:05:27.575311+0000","last_peered":"2024-07-24T22:05:27.575311+0000","last_clean":"2024-07-24T22:05:27.575311+0000","last_became_active":"2024-07-24T22:03:50.388608+0000","last_became_peered":"2024-07-24T22:03:50.388608+0000","last_unstale":"2024-07-24T22:05:27.575311+0000","last_undegraded":"2024-07-24T22:05:27.575311+0000","last_fullsized":"2024-07-24T22:05:27.575311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:36:43.571415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575239+0000","last_change":"2024-07-24T22:03:53.397509+0000","last_active":"2024-07-24T22:05:27.575239+0000","last_peered":"2024-07-24T22:05:27.575239+0000","last_clean":"2024-07-24T22:05:27.575239+0000","last_became_active":"2024-07-24T22:03:53.397186+0000","last_became_peered":"2024-07-24T22:03:53.397186+0000","last_unstale":"2024-07-24T22:05:27.575239+0000","last_undegraded":"2024-07-24T22:05:27.575239+0000","last_fullsized":"2024-07-24T22:05:27.575239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:15:14.081853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588955+0000","last_change":"2024-07-24T22:03:50.383523+0000","last_active":"2024-07-24T22:05:27.588955+0000","last_peered":"2024-07-24T22:05:27.588955+0000","last_clean":"2024-07-24T22:05:27.588955+0000","last_became_active":"2024-07-24T22:03:50.383088+0000","last_became_peered":"2024-07-24T22:03:50.383088+0000","last_unstale":"2024-07-24T22:05:27.588955+0000","last_undegraded":"2024-07-24T22:05:27.588955+0000","last_fullsized":"2024-07-24T22:05:27.588955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:57:07.824581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570963+0000","last_change":"2024-07-24T22:03:50.383726+0000","last_active":"2024-07-24T22:05:27.570963+0000","last_peered":"2024-07-24T22:05:27.570963+0000","last_clean":"2024-07-24T22:05:27.570963+0000","last_became_active":"2024-07-24T22:03:50.383480+0000","last_became_peered":"2024-07-24T22:03:50.383480+0000","last_unstale":"2024-07-24T22:05:27.570963+0000","last_undegraded":"2024-07-24T22:05:27.570963+0000","last_fullsized":"2024-07-24T22:05:27.570963+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:05:05.093272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695819+0000","last_change":"2024-07-24T22:03:53.406223+0000","last_active":"2024-07-24T22:05:27.695819+0000","last_peered":"2024-07-24T22:05:27.695819+0000","last_clean":"2024-07-24T22:05:27.695819+0000","last_became_active":"2024-07-24T22:03:53.404642+0000","last_became_peered":"2024-07-24T22:03:53.404642+0000","last_unstale":"2024-07-24T22:05:27.695819+0000","last_undegraded":"2024-07-24T22:05:27.695819+0000","last_fullsized":"2024-07-24T22:05:27.695819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:00:51.849538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574889+0000","last_change":"2024-07-24T22:03:50.385780+0000","last_active":"2024-07-24T22:05:27.574889+0000","last_peered":"2024-07-24T22:05:27.574889+0000","last_clean":"2024-07-24T22:05:27.574889+0000","last_became_active":"2024-07-24T22:03:50.385488+0000","last_became_peered":"2024-07-24T22:03:50.385488+0000","last_unstale":"2024-07-24T22:05:27.574889+0000","last_undegraded":"2024-07-24T22:05:27.574889+0000","last_fullsized":"2024-07-24T22:05:27.574889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:47:35.908303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695950+0000","last_change":"2024-07-24T22:03:53.403103+0000","last_active":"2024-07-24T22:05:27.695950+0000","last_peered":"2024-07-24T22:05:27.695950+0000","last_clean":"2024-07-24T22:05:27.695950+0000","last_became_active":"2024-07-24T22:03:53.402810+0000","last_became_peered":"2024-07-24T22:03:53.402810+0000","last_unstale":"2024-07-24T22:05:27.695950+0000","last_undegraded":"2024-07-24T22:05:27.695950+0000","last_fullsized":"2024-07-24T22:05:27.695950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:15.798983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589069+0000","last_change":"2024-07-24T22:03:50.382383+0000","last_active":"2024-07-24T22:05:27.589069+0000","last_peered":"2024-07-24T22:05:27.589069+0000","last_clean":"2024-07-24T22:05:27.589069+0000","last_became_active":"2024-07-24T22:03:50.381629+0000","last_became_peered":"2024-07-24T22:03:50.381629+0000","last_unstale":"2024-07-24T22:05:27.589069+0000","last_undegraded":"2024-07-24T22:05:27.589069+0000","last_fullsized":"2024-07-24T22:05:27.589069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:17.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572154+0000","last_change":"2024-07-24T22:03:53.409587+0000","last_active":"2024-07-24T22:05:27.572154+0000","last_peered":"2024-07-24T22:05:27.572154+0000","last_clean":"2024-07-24T22:05:27.572154+0000","last_became_active":"2024-07-24T22:03:53.409240+0000","last_became_peered":"2024-07-24T22:03:53.409240+0000","last_unstale":"2024-07-24T22:05:27.572154+0000","last_undegraded":"2024-07-24T22:05:27.572154+0000","last_fullsized":"2024-07-24T22:05:27.572154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:37:18.654244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576466+0000","last_change":"2024-07-24T22:03:50.387933+0000","last_active":"2024-07-24T22:05:27.576466+0000","last_peered":"2024-07-24T22:05:27.576466+0000","last_clean":"2024-07-24T22:05:27.576466+0000","last_became_active":"2024-07-24T22:03:50.386985+0000","last_became_peered":"2024-07-24T22:03:50.386985+0000","last_unstale":"2024-07-24T22:05:27.576466+0000","last_undegraded":"2024-07-24T22:05:27.576466+0000","last_fullsized":"2024-07-24T22:05:27.576466+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:35:29.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696682+0000","last_change":"2024-07-24T22:03:53.404419+0000","last_active":"2024-07-24T22:05:27.696682+0000","last_peered":"2024-07-24T22:05:27.696682+0000","last_clean":"2024-07-24T22:05:27.696682+0000","last_became_active":"2024-07-24T22:03:53.402713+0000","last_became_peered":"2024-07-24T22:03:53.402713+0000","last_unstale":"2024-07-24T22:05:27.696682+0000","last_undegraded":"2024-07-24T22:05:27.696682+0000","last_fullsized":"2024-07-24T22:05:27.696682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:41.262686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575104+0000","last_change":"2024-07-24T22:03:50.511126+0000","last_active":"2024-07-24T22:05:27.575104+0000","last_peered":"2024-07-24T22:05:27.575104+0000","last_clean":"2024-07-24T22:05:27.575104+0000","last_became_active":"2024-07-24T22:03:50.510801+0000","last_became_peered":"2024-07-24T22:03:50.510801+0000","last_unstale":"2024-07-24T22:05:27.575104+0000","last_undegraded":"2024-07-24T22:05:27.575104+0000","last_fullsized":"2024-07-24T22:05:27.575104+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:59:37.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571928+0000","last_change":"2024-07-24T22:03:53.410202+0000","last_active":"2024-07-24T22:05:27.571928+0000","last_peered":"2024-07-24T22:05:27.571928+0000","last_clean":"2024-07-24T22:05:27.571928+0000","last_became_active":"2024-07-24T22:03:53.409884+0000","last_became_peered":"2024-07-24T22:03:53.409884+0000","last_unstale":"2024-07-24T22:05:27.571928+0000","last_undegraded":"2024-07-24T22:05:27.571928+0000","last_fullsized":"2024-07-24T22:05:27.571928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:54:02.603267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'30","reported_seq":379,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:06:40.702509+0000","last_change":"2024-07-24T22:03:50.386993+0000","last_active":"2024-07-24T22:06:40.702509+0000","last_peered":"2024-07-24T22:06:40.702509+0000","last_clean":"2024-07-24T22:06:40.702509+0000","last_became_active":"2024-07-24T22:03:50.386675+0000","last_became_peered":"2024-07-24T22:03:50.386675+0000","last_unstale":"2024-07-24T22:06:40.702509+0000","last_undegraded":"2024-07-24T22:06:40.702509+0000","last_fullsized":"2024-07-24T22:06:40.702509+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:20:58.384179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62584,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":317,"num_read_kb":219,"num_write":30,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576569+0000","last_change":"2024-07-24T22:03:53.413293+0000","last_active":"2024-07-24T22:05:27.576569+0000","last_peered":"2024-07-24T22:05:27.576569+0000","last_clean":"2024-07-24T22:05:27.576569+0000","last_became_active":"2024-07-24T22:03:53.412900+0000","last_became_peered":"2024-07-24T22:03:53.412900+0000","last_unstale":"2024-07-24T22:05:27.576569+0000","last_undegraded":"2024-07-24T22:05:27.576569+0000","last_fullsized":"2024-07-24T22:05:27.576569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:11:32.553108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696109+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.696109+0000","last_peered":"2024-07-24T22:05:27.696109+0000","last_clean":"2024-07-24T22:05:27.696109+0000","last_became_active":"2024-07-24T22:03:50.387059+0000","last_became_peered":"2024-07-24T22:03:50.387059+0000","last_unstale":"2024-07-24T22:05:27.696109+0000","last_undegraded":"2024-07-24T22:05:27.696109+0000","last_fullsized":"2024-07-24T22:05:27.696109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:40:06.887090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570910+0000","last_change":"2024-07-24T22:03:53.406808+0000","last_active":"2024-07-24T22:05:27.570910+0000","last_peered":"2024-07-24T22:05:27.570910+0000","last_clean":"2024-07-24T22:05:27.570910+0000","last_became_active":"2024-07-24T22:03:53.406487+0000","last_became_peered":"2024-07-24T22:03:53.406487+0000","last_unstale":"2024-07-24T22:05:27.570910+0000","last_undegraded":"2024-07-24T22:05:27.570910+0000","last_fullsized":"2024-07-24T22:05:27.570910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:44:57.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574923+0000","last_change":"2024-07-24T22:03:50.386881+0000","last_active":"2024-07-24T22:05:27.574923+0000","last_peered":"2024-07-24T22:05:27.574923+0000","last_clean":"2024-07-24T22:05:27.574923+0000","last_became_active":"2024-07-24T22:03:50.386564+0000","last_became_peered":"2024-07-24T22:03:50.386564+0000","last_unstale":"2024-07-24T22:05:27.574923+0000","last_undegraded":"2024-07-24T22:05:27.574923+0000","last_fullsized":"2024-07-24T22:05:27.574923+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:22:22.339854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576277+0000","last_change":"2024-07-24T22:03:53.403207+0000","last_active":"2024-07-24T22:05:27.576277+0000","last_peered":"2024-07-24T22:05:27.576277+0000","last_clean":"2024-07-24T22:05:27.576277+0000","last_became_active":"2024-07-24T22:03:53.402875+0000","last_became_peered":"2024-07-24T22:03:53.402875+0000","last_unstale":"2024-07-24T22:05:27.576277+0000","last_undegraded":"2024-07-24T22:05:27.576277+0000","last_fullsized":"2024-07-24T22:05:27.576277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:25:28.866228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575960+0000","last_change":"2024-07-24T22:03:50.386721+0000","last_active":"2024-07-24T22:05:27.575960+0000","last_peered":"2024-07-24T22:05:27.575960+0000","last_clean":"2024-07-24T22:05:27.575960+0000","last_became_active":"2024-07-24T22:03:50.385654+0000","last_became_peered":"2024-07-24T22:03:50.385654+0000","last_unstale":"2024-07-24T22:05:27.575960+0000","last_undegraded":"2024-07-24T22:05:27.575960+0000","last_fullsized":"2024-07-24T22:05:27.575960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:16:15.802744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575896+0000","last_change":"2024-07-24T22:03:53.405367+0000","last_active":"2024-07-24T22:05:27.575896+0000","last_peered":"2024-07-24T22:05:27.575896+0000","last_clean":"2024-07-24T22:05:27.575896+0000","last_became_active":"2024-07-24T22:03:53.404875+0000","last_became_peered":"2024-07-24T22:03:53.404875+0000","last_unstale":"2024-07-24T22:05:27.575896+0000","last_undegraded":"2024-07-24T22:05:27.575896+0000","last_fullsized":"2024-07-24T22:05:27.575896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:42.247052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575893+0000","last_change":"2024-07-24T22:04:27.574426+0000","last_active":"2024-07-24T22:05:27.575893+0000","last_peered":"2024-07-24T22:05:27.575893+0000","last_clean":"2024-07-24T22:05:27.575893+0000","last_became_active":"2024-07-24T22:04:27.568176+0000","last_became_peered":"2024-07-24T22:04:27.568176+0000","last_unstale":"2024-07-24T22:05:27.575893+0000","last_undegraded":"2024-07-24T22:05:27.575893+0000","last_fullsized":"2024-07-24T22:05:27.575893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:20:37.620669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574893+0000","last_change":"2024-07-24T22:03:53.405136+0000","last_active":"2024-07-24T22:05:27.574893+0000","last_peered":"2024-07-24T22:05:27.574893+0000","last_clean":"2024-07-24T22:05:27.574893+0000","last_became_active":"2024-07-24T22:03:53.404043+0000","last_became_peered":"2024-07-24T22:03:53.404043+0000","last_unstale":"2024-07-24T22:05:27.574893+0000","last_undegraded":"2024-07-24T22:05:27.574893+0000","last_fullsized":"2024-07-24T22:05:27.574893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:03:21.912335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576738+0000","last_change":"2024-07-24T22:03:50.382364+0000","last_active":"2024-07-24T22:05:27.576738+0000","last_peered":"2024-07-24T22:05:27.576738+0000","last_clean":"2024-07-24T22:05:27.576738+0000","last_became_active":"2024-07-24T22:03:50.382029+0000","last_became_peered":"2024-07-24T22:03:50.382029+0000","last_unstale":"2024-07-24T22:05:27.576738+0000","last_undegraded":"2024-07-24T22:05:27.576738+0000","last_fullsized":"2024-07-24T22:05:27.576738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:48:10.004826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573801+0000","last_change":"2024-07-24T22:03:53.413053+0000","last_active":"2024-07-24T22:05:27.573801+0000","last_peered":"2024-07-24T22:05:27.573801+0000","last_clean":"2024-07-24T22:05:27.573801+0000","last_became_active":"2024-07-24T22:03:53.412733+0000","last_became_peered":"2024-07-24T22:03:53.412733+0000","last_unstale":"2024-07-24T22:05:27.573801+0000","last_undegraded":"2024-07-24T22:05:27.573801+0000","last_fullsized":"2024-07-24T22:05:27.573801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:16.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571346+0000","last_change":"2024-07-24T22:03:50.387314+0000","last_active":"2024-07-24T22:05:27.571346+0000","last_peered":"2024-07-24T22:05:27.571346+0000","last_clean":"2024-07-24T22:05:27.571346+0000","last_became_active":"2024-07-24T22:03:50.386919+0000","last_became_peered":"2024-07-24T22:03:50.386919+0000","last_unstale":"2024-07-24T22:05:27.571346+0000","last_undegraded":"2024-07-24T22:05:27.571346+0000","last_fullsized":"2024-07-24T22:05:27.571346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:51:03.203285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576716+0000","last_change":"2024-07-24T22:03:53.411938+0000","last_active":"2024-07-24T22:05:27.576716+0000","last_peered":"2024-07-24T22:05:27.576716+0000","last_clean":"2024-07-24T22:05:27.576716+0000","last_became_active":"2024-07-24T22:03:53.411545+0000","last_became_peered":"2024-07-24T22:03:53.411545+0000","last_unstale":"2024-07-24T22:05:27.576716+0000","last_undegraded":"2024-07-24T22:05:27.576716+0000","last_fullsized":"2024-07-24T22:05:27.576716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:41:19.370886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575188+0000","last_change":"2024-07-24T22:03:50.384400+0000","last_active":"2024-07-24T22:05:27.575188+0000","last_peered":"2024-07-24T22:05:27.575188+0000","last_clean":"2024-07-24T22:05:27.575188+0000","last_became_active":"2024-07-24T22:03:50.383945+0000","last_became_peered":"2024-07-24T22:03:50.383945+0000","last_unstale":"2024-07-24T22:05:27.575188+0000","last_undegraded":"2024-07-24T22:05:27.575188+0000","last_fullsized":"2024-07-24T22:05:27.575188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:16.035171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576430+0000","last_change":"2024-07-24T22:04:27.507390+0000","last_active":"2024-07-24T22:05:27.576430+0000","last_peered":"2024-07-24T22:05:27.576430+0000","last_clean":"2024-07-24T22:05:27.576430+0000","last_became_active":"2024-07-24T22:04:27.504206+0000","last_became_peered":"2024-07-24T22:04:27.504206+0000","last_unstale":"2024-07-24T22:05:27.576430+0000","last_undegraded":"2024-07-24T22:05:27.576430+0000","last_fullsized":"2024-07-24T22:05:27.576430+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:55:21.559702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696182+0000","last_change":"2024-07-24T22:03:50.511075+0000","last_active":"2024-07-24T22:05:27.696182+0000","last_peered":"2024-07-24T22:05:27.696182+0000","last_clean":"2024-07-24T22:05:27.696182+0000","last_became_active":"2024-07-24T22:03:50.510244+0000","last_became_peered":"2024-07-24T22:03:50.510244+0000","last_unstale":"2024-07-24T22:05:27.696182+0000","last_undegraded":"2024-07-24T22:05:27.696182+0000","last_fullsized":"2024-07-24T22:05:27.696182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:54:03.068211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576340+0000","last_change":"2024-07-24T22:03:53.410865+0000","last_active":"2024-07-24T22:05:27.576340+0000","last_peered":"2024-07-24T22:05:27.576340+0000","last_clean":"2024-07-24T22:05:27.576340+0000","last_became_active":"2024-07-24T22:03:53.410255+0000","last_became_peered":"2024-07-24T22:03:53.410255+0000","last_unstale":"2024-07-24T22:05:27.576340+0000","last_undegraded":"2024-07-24T22:05:27.576340+0000","last_fullsized":"2024-07-24T22:05:27.576340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:15.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576134+0000","last_change":"2024-07-24T22:02:33.494929+0000","last_active":"2024-07-24T22:05:27.576134+0000","last_peered":"2024-07-24T22:05:27.576134+0000","last_clean":"2024-07-24T22:05:27.576134+0000","last_became_active":"2024-07-24T22:02:33.489241+0000","last_became_peered":"2024-07-24T22:02:33.489241+0000","last_unstale":"2024-07-24T22:05:27.576134+0000","last_undegraded":"2024-07-24T22:05:27.576134+0000","last_fullsized":"2024-07-24T22:05:27.576134+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_clean_scrub_stamp":"2024-07-24T21:59:32.406119+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:46.421413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576268+0000","last_change":"2024-07-24T22:03:50.385093+0000","last_active":"2024-07-24T22:05:27.576268+0000","last_peered":"2024-07-24T22:05:27.576268+0000","last_clean":"2024-07-24T22:05:27.576268+0000","last_became_active":"2024-07-24T22:03:50.384639+0000","last_became_peered":"2024-07-24T22:03:50.384639+0000","last_unstale":"2024-07-24T22:05:27.576268+0000","last_undegraded":"2024-07-24T22:05:27.576268+0000","last_fullsized":"2024-07-24T22:05:27.576268+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:06:10.402336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696068+0000","last_change":"2024-07-24T22:03:53.409627+0000","last_active":"2024-07-24T22:05:27.696068+0000","last_peered":"2024-07-24T22:05:27.696068+0000","last_clean":"2024-07-24T22:05:27.696068+0000","last_became_active":"2024-07-24T22:03:53.409295+0000","last_became_peered":"2024-07-24T22:03:53.409295+0000","last_unstale":"2024-07-24T22:05:27.696068+0000","last_undegraded":"2024-07-24T22:05:27.696068+0000","last_fullsized":"2024-07-24T22:05:27.696068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:23:39.670020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576402+0000","last_change":"2024-07-24T22:03:50.385772+0000","last_active":"2024-07-24T22:05:27.576402+0000","last_peered":"2024-07-24T22:05:27.576402+0000","last_clean":"2024-07-24T22:05:27.576402+0000","last_became_active":"2024-07-24T22:03:50.385421+0000","last_became_peered":"2024-07-24T22:03:50.385421+0000","last_unstale":"2024-07-24T22:05:27.576402+0000","last_undegraded":"2024-07-24T22:05:27.576402+0000","last_fullsized":"2024-07-24T22:05:27.576402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:58:57.227697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570892+0000","last_change":"2024-07-24T22:03:53.400558+0000","last_active":"2024-07-24T22:05:27.570892+0000","last_peered":"2024-07-24T22:05:27.570892+0000","last_clean":"2024-07-24T22:05:27.570892+0000","last_became_active":"2024-07-24T22:03:53.400131+0000","last_became_peered":"2024-07-24T22:03:53.400131+0000","last_unstale":"2024-07-24T22:05:27.570892+0000","last_undegraded":"2024-07-24T22:05:27.570892+0000","last_fullsized":"2024-07-24T22:05:27.570892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:57:57.586742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571018+0000","last_change":"2024-07-24T22:03:50.510189+0000","last_active":"2024-07-24T22:05:27.571018+0000","last_peered":"2024-07-24T22:05:27.571018+0000","last_clean":"2024-07-24T22:05:27.571018+0000","last_became_active":"2024-07-24T22:03:50.509857+0000","last_became_peered":"2024-07-24T22:03:50.509857+0000","last_unstale":"2024-07-24T22:05:27.571018+0000","last_undegraded":"2024-07-24T22:05:27.571018+0000","last_fullsized":"2024-07-24T22:05:27.571018+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:05:59.240650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574703+0000","last_change":"2024-07-24T22:04:27.505187+0000","last_active":"2024-07-24T22:05:27.574703+0000","last_peered":"2024-07-24T22:05:27.574703+0000","last_clean":"2024-07-24T22:05:27.574703+0000","last_became_active":"2024-07-24T22:04:27.504785+0000","last_became_peered":"2024-07-24T22:04:27.504785+0000","last_unstale":"2024-07-24T22:05:27.574703+0000","last_undegraded":"2024-07-24T22:05:27.574703+0000","last_fullsized":"2024-07-24T22:05:27.574703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:47:33.516835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576182+0000","last_change":"2024-07-24T22:05:27.575016+0000","last_active":"2024-07-24T22:05:27.576182+0000","last_peered":"2024-07-24T22:05:27.576182+0000","last_clean":"2024-07-24T22:05:27.576182+0000","last_became_active":"2024-07-24T22:05:27.574644+0000","last_became_peered":"2024-07-24T22:05:27.574644+0000","last_unstale":"2024-07-24T22:05:27.576182+0000","last_undegraded":"2024-07-24T22:05:27.576182+0000","last_fullsized":"2024-07-24T22:05:27.576182+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:11:37.759190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588938+0000","last_change":"2024-07-24T22:03:53.399369+0000","last_active":"2024-07-24T22:05:27.588938+0000","last_peered":"2024-07-24T22:05:27.588938+0000","last_clean":"2024-07-24T22:05:27.588938+0000","last_became_active":"2024-07-24T22:03:53.399001+0000","last_became_peered":"2024-07-24T22:03:53.399001+0000","last_unstale":"2024-07-24T22:05:27.588938+0000","last_undegraded":"2024-07-24T22:05:27.588938+0000","last_fullsized":"2024-07-24T22:05:27.588938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:26:46.531080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695870+0000","last_change":"2024-07-24T22:03:50.510889+0000","last_active":"2024-07-24T22:05:27.695870+0000","last_peered":"2024-07-24T22:05:27.695870+0000","last_clean":"2024-07-24T22:05:27.695870+0000","last_became_active":"2024-07-24T22:03:50.510366+0000","last_became_peered":"2024-07-24T22:03:50.510366+0000","last_unstale":"2024-07-24T22:05:27.695870+0000","last_undegraded":"2024-07-24T22:05:27.695870+0000","last_fullsized":"2024-07-24T22:05:27.695870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:47:54.838304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589019+0000","last_change":"2024-07-24T22:03:53.398987+0000","last_active":"2024-07-24T22:05:27.589019+0000","last_peered":"2024-07-24T22:05:27.589019+0000","last_clean":"2024-07-24T22:05:27.589019+0000","last_became_active":"2024-07-24T22:03:53.398604+0000","last_became_peered":"2024-07-24T22:03:53.398604+0000","last_unstale":"2024-07-24T22:05:27.589019+0000","last_undegraded":"2024-07-24T22:05:27.589019+0000","last_fullsized":"2024-07-24T22:05:27.589019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:28:41.684174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576685+0000","last_change":"2024-07-24T22:03:50.510623+0000","last_active":"2024-07-24T22:05:27.576685+0000","last_peered":"2024-07-24T22:05:27.576685+0000","last_clean":"2024-07-24T22:05:27.576685+0000","last_became_active":"2024-07-24T22:03:50.510204+0000","last_became_peered":"2024-07-24T22:03:50.510204+0000","last_unstale":"2024-07-24T22:05:27.576685+0000","last_undegraded":"2024-07-24T22:05:27.576685+0000","last_fullsized":"2024-07-24T22:05:27.576685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:06:40.838840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571179+0000","last_change":"2024-07-24T22:03:53.400289+0000","last_active":"2024-07-24T22:05:27.571179+0000","last_peered":"2024-07-24T22:05:27.571179+0000","last_clean":"2024-07-24T22:05:27.571179+0000","last_became_active":"2024-07-24T22:03:53.399939+0000","last_became_peered":"2024-07-24T22:03:53.399939+0000","last_unstale":"2024-07-24T22:05:27.571179+0000","last_undegraded":"2024-07-24T22:05:27.571179+0000","last_fullsized":"2024-07-24T22:05:27.571179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:29:26.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:06:04.017159+0000","last_change":"2024-07-24T22:03:50.382776+0000","last_active":"2024-07-24T22:06:04.017159+0000","last_peered":"2024-07-24T22:06:04.017159+0000","last_clean":"2024-07-24T22:06:04.017159+0000","last_became_active":"2024-07-24T22:03:50.382474+0000","last_became_peered":"2024-07-24T22:03:50.382474+0000","last_unstale":"2024-07-24T22:06:04.017159+0000","last_undegraded":"2024-07-24T22:06:04.017159+0000","last_fullsized":"2024-07-24T22:06:04.017159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:59:34.688895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696694+0000","last_change":"2024-07-24T22:03:53.407883+0000","last_active":"2024-07-24T22:05:27.696694+0000","last_peered":"2024-07-24T22:05:27.696694+0000","last_clean":"2024-07-24T22:05:27.696694+0000","last_became_active":"2024-07-24T22:03:53.407524+0000","last_became_peered":"2024-07-24T22:03:53.407524+0000","last_unstale":"2024-07-24T22:05:27.696694+0000","last_undegraded":"2024-07-24T22:05:27.696694+0000","last_fullsized":"2024-07-24T22:05:27.696694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:52:25.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576771+0000","last_change":"2024-07-24T22:03:50.388789+0000","last_active":"2024-07-24T22:05:27.576771+0000","last_peered":"2024-07-24T22:05:27.576771+0000","last_clean":"2024-07-24T22:05:27.576771+0000","last_became_active":"2024-07-24T22:03:50.385439+0000","last_became_peered":"2024-07-24T22:03:50.385439+0000","last_unstale":"2024-07-24T22:05:27.576771+0000","last_undegraded":"2024-07-24T22:05:27.576771+0000","last_fullsized":"2024-07-24T22:05:27.576771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:14:25.009588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696603+0000","last_change":"2024-07-24T22:04:27.503956+0000","last_active":"2024-07-24T22:05:27.696603+0000","last_peered":"2024-07-24T22:05:27.696603+0000","last_clean":"2024-07-24T22:05:27.696603+0000","last_became_active":"2024-07-24T22:04:27.503498+0000","last_became_peered":"2024-07-24T22:04:27.503498+0000","last_unstale":"2024-07-24T22:05:27.696603+0000","last_undegraded":"2024-07-24T22:05:27.696603+0000","last_fullsized":"2024-07-24T22:05:27.696603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:23:20.294458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571757+0000","last_change":"2024-07-24T22:03:50.510687+0000","last_active":"2024-07-24T22:05:27.571757+0000","last_peered":"2024-07-24T22:05:27.571757+0000","last_clean":"2024-07-24T22:05:27.571757+0000","last_became_active":"2024-07-24T22:03:50.510310+0000","last_became_peered":"2024-07-24T22:03:50.510310+0000","last_unstale":"2024-07-24T22:05:27.571757+0000","last_undegraded":"2024-07-24T22:05:27.571757+0000","last_fullsized":"2024-07-24T22:05:27.571757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:14:29.957324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576327+0000","last_change":"2024-07-24T22:03:53.412711+0000","last_active":"2024-07-24T22:05:27.576327+0000","last_peered":"2024-07-24T22:05:27.576327+0000","last_clean":"2024-07-24T22:05:27.576327+0000","last_became_active":"2024-07-24T22:03:53.412375+0000","last_became_peered":"2024-07-24T22:03:53.412375+0000","last_unstale":"2024-07-24T22:05:27.576327+0000","last_undegraded":"2024-07-24T22:05:27.576327+0000","last_fullsized":"2024-07-24T22:05:27.576327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:55:29.441385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696331+0000","last_change":"2024-07-24T22:03:50.383094+0000","last_active":"2024-07-24T22:05:27.696331+0000","last_peered":"2024-07-24T22:05:27.696331+0000","last_clean":"2024-07-24T22:05:27.696331+0000","last_became_active":"2024-07-24T22:03:50.382687+0000","last_became_peered":"2024-07-24T22:03:50.382687+0000","last_unstale":"2024-07-24T22:05:27.696331+0000","last_undegraded":"2024-07-24T22:05:27.696331+0000","last_fullsized":"2024-07-24T22:05:27.696331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:32:02.727855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573366+0000","last_change":"2024-07-24T22:03:53.403709+0000","last_active":"2024-07-24T22:05:27.573366+0000","last_peered":"2024-07-24T22:05:27.573366+0000","last_clean":"2024-07-24T22:05:27.573366+0000","last_became_active":"2024-07-24T22:03:53.403334+0000","last_became_peered":"2024-07-24T22:03:53.403334+0000","last_unstale":"2024-07-24T22:05:27.573366+0000","last_undegraded":"2024-07-24T22:05:27.573366+0000","last_fullsized":"2024-07-24T22:05:27.573366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:27:50.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695814+0000","last_change":"2024-07-24T22:03:50.385547+0000","last_active":"2024-07-24T22:05:27.695814+0000","last_peered":"2024-07-24T22:05:27.695814+0000","last_clean":"2024-07-24T22:05:27.695814+0000","last_became_active":"2024-07-24T22:03:50.385233+0000","last_became_peered":"2024-07-24T22:03:50.385233+0000","last_unstale":"2024-07-24T22:05:27.695814+0000","last_undegraded":"2024-07-24T22:05:27.695814+0000","last_fullsized":"2024-07-24T22:05:27.695814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:40:04.647242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696043+0000","last_change":"2024-07-24T22:03:53.402386+0000","last_active":"2024-07-24T22:05:27.696043+0000","last_peered":"2024-07-24T22:05:27.696043+0000","last_clean":"2024-07-24T22:05:27.696043+0000","last_became_active":"2024-07-24T22:03:53.399363+0000","last_became_peered":"2024-07-24T22:03:53.399363+0000","last_unstale":"2024-07-24T22:05:27.696043+0000","last_undegraded":"2024-07-24T22:05:27.696043+0000","last_fullsized":"2024-07-24T22:05:27.696043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:19:05.835280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576088+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.576088+0000","last_peered":"2024-07-24T22:05:27.576088+0000","last_clean":"2024-07-24T22:05:27.576088+0000","last_became_active":"2024-07-24T22:03:50.387097+0000","last_became_peered":"2024-07-24T22:03:50.387097+0000","last_unstale":"2024-07-24T22:05:27.576088+0000","last_undegraded":"2024-07-24T22:05:27.576088+0000","last_fullsized":"2024-07-24T22:05:27.576088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:11:23.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576510+0000","last_change":"2024-07-24T22:03:53.407386+0000","last_active":"2024-07-24T22:05:27.576510+0000","last_peered":"2024-07-24T22:05:27.576510+0000","last_clean":"2024-07-24T22:05:27.576510+0000","last_became_active":"2024-07-24T22:03:53.407059+0000","last_became_peered":"2024-07-24T22:03:53.407059+0000","last_unstale":"2024-07-24T22:05:27.576510+0000","last_undegraded":"2024-07-24T22:05:27.576510+0000","last_fullsized":"2024-07-24T22:05:27.576510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:12:38.508170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695772+0000","last_change":"2024-07-24T22:04:27.567714+0000","last_active":"2024-07-24T22:05:27.695772+0000","last_peered":"2024-07-24T22:05:27.695772+0000","last_clean":"2024-07-24T22:05:27.695772+0000","last_became_active":"2024-07-24T22:04:27.567492+0000","last_became_peered":"2024-07-24T22:04:27.567492+0000","last_unstale":"2024-07-24T22:05:27.695772+0000","last_undegraded":"2024-07-24T22:05:27.695772+0000","last_fullsized":"2024-07-24T22:05:27.695772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:00:13.705346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576278+0000","last_change":"2024-07-24T22:03:50.385538+0000","last_active":"2024-07-24T22:05:27.576278+0000","last_peered":"2024-07-24T22:05:27.576278+0000","last_clean":"2024-07-24T22:05:27.576278+0000","last_became_active":"2024-07-24T22:03:50.385191+0000","last_became_peered":"2024-07-24T22:03:50.385191+0000","last_unstale":"2024-07-24T22:05:27.576278+0000","last_undegraded":"2024-07-24T22:05:27.576278+0000","last_fullsized":"2024-07-24T22:05:27.576278+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:33:37.674903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571800+0000","last_change":"2024-07-24T22:03:53.411751+0000","last_active":"2024-07-24T22:05:27.571800+0000","last_peered":"2024-07-24T22:05:27.571800+0000","last_clean":"2024-07-24T22:05:27.571800+0000","last_became_active":"2024-07-24T22:03:53.410827+0000","last_became_peered":"2024-07-24T22:03:53.410827+0000","last_unstale":"2024-07-24T22:05:27.571800+0000","last_undegraded":"2024-07-24T22:05:27.571800+0000","last_fullsized":"2024-07-24T22:05:27.571800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:07:26.439047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.584159+0000","last_change":"2024-07-24T22:05:27.581982+0000","last_active":"2024-07-24T22:05:27.584159+0000","last_peered":"2024-07-24T22:05:27.584159+0000","last_clean":"2024-07-24T22:05:27.584159+0000","last_became_active":"2024-07-24T22:05:27.577413+0000","last_became_peered":"2024-07-24T22:05:27.577413+0000","last_unstale":"2024-07-24T22:05:27.584159+0000","last_undegraded":"2024-07-24T22:05:27.584159+0000","last_fullsized":"2024-07-24T22:05:27.584159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:40:27.424379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696604+0000","last_change":"2024-07-24T22:03:53.406029+0000","last_active":"2024-07-24T22:05:27.696604+0000","last_peered":"2024-07-24T22:05:27.696604+0000","last_clean":"2024-07-24T22:05:27.696604+0000","last_became_active":"2024-07-24T22:03:53.405529+0000","last_became_peered":"2024-07-24T22:03:53.405529+0000","last_unstale":"2024-07-24T22:05:27.696604+0000","last_undegraded":"2024-07-24T22:05:27.696604+0000","last_fullsized":"2024-07-24T22:05:27.696604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:57:02.290836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696580+0000","last_change":"2024-07-24T22:03:50.510884+0000","last_active":"2024-07-24T22:05:27.696580+0000","last_peered":"2024-07-24T22:05:27.696580+0000","last_clean":"2024-07-24T22:05:27.696580+0000","last_became_active":"2024-07-24T22:03:50.509851+0000","last_became_peered":"2024-07-24T22:03:50.509851+0000","last_unstale":"2024-07-24T22:05:27.696580+0000","last_undegraded":"2024-07-24T22:05:27.696580+0000","last_fullsized":"2024-07-24T22:05:27.696580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:37:55.735488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696364+0000","last_change":"2024-07-24T22:03:53.409966+0000","last_active":"2024-07-24T22:05:27.696364+0000","last_peered":"2024-07-24T22:05:27.696364+0000","last_clean":"2024-07-24T22:05:27.696364+0000","last_became_active":"2024-07-24T22:03:53.409652+0000","last_became_peered":"2024-07-24T22:03:53.409652+0000","last_unstale":"2024-07-24T22:05:27.696364+0000","last_undegraded":"2024-07-24T22:05:27.696364+0000","last_fullsized":"2024-07-24T22:05:27.696364+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:10:53.262459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696523+0000","last_change":"2024-07-24T22:04:27.571166+0000","last_active":"2024-07-24T22:05:27.696523+0000","last_peered":"2024-07-24T22:05:27.696523+0000","last_clean":"2024-07-24T22:05:27.696523+0000","last_became_active":"2024-07-24T22:04:27.567419+0000","last_became_peered":"2024-07-24T22:04:27.567419+0000","last_unstale":"2024-07-24T22:05:27.696523+0000","last_undegraded":"2024-07-24T22:05:27.696523+0000","last_fullsized":"2024-07-24T22:05:27.696523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:37:11.513631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63382,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":323,"num_read_kb":225,"num_write":90,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612659,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":937984,"data_stored":469642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1122905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972411,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40428,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704724,"statfs":{"total":95995035648,"available":95953637376,"internally_reserved":0,"allocated":946176,"data_stored":470341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168640,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":469664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397571,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1540096,"data_stored":1060709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561096,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":469759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757325,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1548288,"data_stored":1060309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920848,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117077,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40432,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704720,"statfs":{"total":95995035648,"available":95953633280,"internally_reserved":0,"allocated":950272,"data_stored":469863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378714,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":532260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542239,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":533116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705761,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":62778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T22:06:47.946 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-07-24T22:06:47.946 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T22:06:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.086+0000 7f43b9be8640 1 -- 172.21.15.47:0/3073318458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b410ca40 msgr2=0x7f43b410eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.086+0000 7f43b9be8640 1 --2- 172.21.15.47:0/3073318458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b410ca40 0x7f43b410eec0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009ca0 tx=0x7f43ac02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:06:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.086+0000 7f43b9be8640 1 -- 172.21.15.47:0/3073318458 shutdown_connections 2024-07-24T22:06:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.086+0000 7f43b9be8640 1 --2- 172.21.15.47:0/3073318458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b410ca40 0x7f43b410eec0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.086+0000 7f43b9be8640 1 --2- 172.21.15.47:0/3073318458 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43b4103f10 0x7f43b410c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.086+0000 7f43b9be8640 1 --2- 172.21.15.47:0/3073318458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43b41035f0 0x7f43b41039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.086+0000 7f43b9be8640 1 -- 172.21.15.47:0/3073318458 >> 172.21.15.47:0/3073318458 conn(0x7f43b40fd020 msgr2=0x7f43b40ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.086+0000 7f43b9be8640 1 -- 172.21.15.47:0/3073318458 shutdown_connections 2024-07-24T22:06:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.086+0000 7f43b9be8640 1 -- 172.21.15.47:0/3073318458 wait complete. 2024-07-24T22:06:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.087+0000 7f43b9be8640 1 Processor -- start 2024-07-24T22:06:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.087+0000 7f43b9be8640 1 -- start start 2024-07-24T22:06:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.087+0000 7f43b9be8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b41035f0 0x7f43b419ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.087+0000 7f43b9be8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43b4103f10 0x7f43b419b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.087+0000 7f43b9be8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43b410ca40 0x7f43b41a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.087+0000 7f43b9be8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43b41126c0 con 0x7f43b41035f0 2024-07-24T22:06:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.087+0000 7f43b9be8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f43b4112540 con 0x7f43b4103f10 2024-07-24T22:06:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.087+0000 7f43b9be8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f43b4112840 con 0x7f43b410ca40 2024-07-24T22:06:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.087+0000 7f43b37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b41035f0 0x7f43b419ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.087+0000 7f43b37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b41035f0 0x7f43b419ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56380/0 (socket says 172.21.15.47:56380) 2024-07-24T22:06:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.087+0000 7f43b37fe640 1 -- 172.21.15.47:0/1235549431 learned_addr learned my addr 172.21.15.47:0/1235549431 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.088+0000 7f43b3fff640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43b410ca40 0x7f43b41a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.088+0000 7f43b2ffd640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43b4103f10 0x7f43b419b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.088+0000 7f43b37fe640 1 -- 172.21.15.47:0/1235549431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43b410ca40 msgr2=0x7f43b41a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.088+0000 7f43b37fe640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43b410ca40 0x7f43b41a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.088+0000 7f43b37fe640 1 -- 172.21.15.47:0/1235549431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43b4103f10 msgr2=0x7f43b419b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.088+0000 7f43b37fe640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43b4103f10 0x7f43b419b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.088+0000 7f43b37fe640 1 -- 172.21.15.47:0/1235549431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b41a0e80 con 0x7f43b41035f0 2024-07-24T22:06:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.088+0000 7f43b37fe640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b41035f0 0x7f43b419ade0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f43a400d950 tx=0x7f43a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.088+0000 7f43b0ff9640 1 -- 172.21.15.47:0/1235549431 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4017070 con 0x7f43b41035f0 2024-07-24T22:06:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.088+0000 7f43b9be8640 1 -- 172.21.15.47:0/1235549431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b41a1170 con 0x7f43b41035f0 2024-07-24T22:06:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.088+0000 7f43b0ff9640 1 -- 172.21.15.47:0/1235549431 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43a4009c30 con 0x7f43b41035f0 2024-07-24T22:06:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.088+0000 7f43b9be8640 1 -- 172.21.15.47:0/1235549431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b41a7a10 con 0x7f43b41035f0 2024-07-24T22:06:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.088+0000 7f43b0ff9640 1 -- 172.21.15.47:0/1235549431 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4020060 con 0x7f43b41035f0 2024-07-24T22:06:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.089+0000 7f43b9be8640 1 -- 172.21.15.47:0/1235549431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b41039d0 con 0x7f43b41035f0 2024-07-24T22:06:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.090+0000 7f43b0ff9640 1 -- 172.21.15.47:0/1235549431 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f43a4010460 con 0x7f43b41035f0 2024-07-24T22:06:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.091+0000 7f43b0ff9640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f43a00b3c20 0x7f43a00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.091+0000 7f43b2ffd640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f43a00b3c20 0x7f43a00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.091+0000 7f43b0ff9640 1 -- 172.21.15.47:0/1235549431 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f43a40e3eb0 con 0x7f43b41035f0 2024-07-24T22:06:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.092+0000 7f43b2ffd640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f43a00b3c20 0x7f43a00b60e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f43b410df80 tx=0x7f439c005ed0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:48.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.094+0000 7f43b0ff9640 1 -- 172.21.15.47:0/1235549431 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f43a40ab380 con 0x7f43b41035f0 2024-07-24T22:06:48.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.292+0000 7f43b9be8640 1 -- 172.21.15.47:0/1235549431 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43b4102980 con 0x7f43a00b3c20 2024-07-24T22:06:48.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.297+0000 7f43b0ff9640 1 -- 172.21.15.47:0/1235549431 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258747 (secure 0 0 0) 0x7f43b4102980 con 0x7f43a00b3c20 2024-07-24T22:06:48.301 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:48.302 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-07-24T22:06:48.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.300+0000 7f43b9be8640 1 -- 172.21.15.47:0/1235549431 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f43a00b3c20 msgr2=0x7f43a00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:48.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.300+0000 7f43b9be8640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f43a00b3c20 0x7f43a00b60e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f43b410df80 tx=0x7f439c005ed0 comp rx=0 tx=0).stop 2024-07-24T22:06:48.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.300+0000 7f43b9be8640 1 -- 172.21.15.47:0/1235549431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b41035f0 msgr2=0x7f43b419ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:48.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.300+0000 7f43b9be8640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b41035f0 0x7f43b419ade0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f43a400d950 tx=0x7f43a400de10 comp rx=0 tx=0).stop 2024-07-24T22:06:48.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.300+0000 7f43b9be8640 1 -- 172.21.15.47:0/1235549431 shutdown_connections 2024-07-24T22:06:48.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.300+0000 7f43b9be8640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f43a00b3c20 0x7f43a00b60e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:48.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.300+0000 7f43b9be8640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43b410ca40 0x7f43b41a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:48.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.300+0000 7f43b9be8640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43b4103f10 0x7f43b419b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:48.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.300+0000 7f43b9be8640 1 --2- 172.21.15.47:0/1235549431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b41035f0 0x7f43b419ade0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:48.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.300+0000 7f43b9be8640 1 -- 172.21.15.47:0/1235549431 >> 172.21.15.47:0/1235549431 conn(0x7f43b40fd020 msgr2=0x7f43b410ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:48.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.300+0000 7f43b9be8640 1 -- 172.21.15.47:0/1235549431 shutdown_connections 2024-07-24T22:06:48.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:48.300+0000 7f43b9be8640 1 -- 172.21.15.47:0/1235549431 wait complete. 2024-07-24T22:06:48.313 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2024-07-24T22:06:48.117717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659665,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":416,"num_read_kb":306,"num_write":218,"num_write_kb":2251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952539,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":670,"ondisk_log_size":670,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387212,"kb_used_data":13040,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554612,"statfs":{"total":1151940427776,"available":1151543922688,"internally_reserved":0,"allocated":13352960,"data_stored":7609326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":22,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002796"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574007+0000","last_change":"2024-07-24T22:03:53.407929+0000","last_active":"2024-07-24T22:05:27.574007+0000","last_peered":"2024-07-24T22:05:27.574007+0000","last_clean":"2024-07-24T22:05:27.574007+0000","last_became_active":"2024-07-24T22:03:53.407508+0000","last_became_peered":"2024-07-24T22:03:53.407508+0000","last_unstale":"2024-07-24T22:05:27.574007+0000","last_undegraded":"2024-07-24T22:05:27.574007+0000","last_fullsized":"2024-07-24T22:05:27.574007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:00:35.699906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696531+0000","last_change":"2024-07-24T22:03:53.404867+0000","last_active":"2024-07-24T22:05:27.696531+0000","last_peered":"2024-07-24T22:05:27.696531+0000","last_clean":"2024-07-24T22:05:27.696531+0000","last_became_active":"2024-07-24T22:03:53.404309+0000","last_became_peered":"2024-07-24T22:03:53.404309+0000","last_unstale":"2024-07-24T22:05:27.696531+0000","last_undegraded":"2024-07-24T22:05:27.696531+0000","last_fullsized":"2024-07-24T22:05:27.696531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:21:51.238815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696402+0000","last_change":"2024-07-24T22:03:53.404368+0000","last_active":"2024-07-24T22:05:27.696402+0000","last_peered":"2024-07-24T22:05:27.696402+0000","last_clean":"2024-07-24T22:05:27.696402+0000","last_became_active":"2024-07-24T22:03:53.403941+0000","last_became_peered":"2024-07-24T22:03:53.403941+0000","last_unstale":"2024-07-24T22:05:27.696402+0000","last_undegraded":"2024-07-24T22:05:27.696402+0000","last_fullsized":"2024-07-24T22:05:27.696402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:10:09.884724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576551+0000","last_change":"2024-07-24T22:03:53.407661+0000","last_active":"2024-07-24T22:05:27.576551+0000","last_peered":"2024-07-24T22:05:27.576551+0000","last_clean":"2024-07-24T22:05:27.576551+0000","last_became_active":"2024-07-24T22:03:53.407375+0000","last_became_peered":"2024-07-24T22:03:53.407375+0000","last_unstale":"2024-07-24T22:05:27.576551+0000","last_undegraded":"2024-07-24T22:05:27.576551+0000","last_fullsized":"2024-07-24T22:05:27.576551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:34.000666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575974+0000","last_change":"2024-07-24T22:03:53.406227+0000","last_active":"2024-07-24T22:05:27.575974+0000","last_peered":"2024-07-24T22:05:27.575974+0000","last_clean":"2024-07-24T22:05:27.575974+0000","last_became_active":"2024-07-24T22:03:53.405819+0000","last_became_peered":"2024-07-24T22:03:53.405819+0000","last_unstale":"2024-07-24T22:05:27.575974+0000","last_undegraded":"2024-07-24T22:05:27.575974+0000","last_fullsized":"2024-07-24T22:05:27.575974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:59.022972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588837+0000","last_change":"2024-07-24T22:04:27.501754+0000","last_active":"2024-07-24T22:05:27.588837+0000","last_peered":"2024-07-24T22:05:27.588837+0000","last_clean":"2024-07-24T22:05:27.588837+0000","last_became_active":"2024-07-24T22:04:27.501340+0000","last_became_peered":"2024-07-24T22:04:27.501340+0000","last_unstale":"2024-07-24T22:05:27.588837+0000","last_undegraded":"2024-07-24T22:05:27.588837+0000","last_fullsized":"2024-07-24T22:05:27.588837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:38:04.880980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575969+0000","last_change":"2024-07-24T22:03:53.413012+0000","last_active":"2024-07-24T22:05:27.575969+0000","last_peered":"2024-07-24T22:05:27.575969+0000","last_clean":"2024-07-24T22:05:27.575969+0000","last_became_active":"2024-07-24T22:03:53.411791+0000","last_became_peered":"2024-07-24T22:03:53.411791+0000","last_unstale":"2024-07-24T22:05:27.575969+0000","last_undegraded":"2024-07-24T22:05:27.575969+0000","last_fullsized":"2024-07-24T22:05:27.575969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:15:02.939598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695762+0000","last_change":"2024-07-24T22:04:27.502867+0000","last_active":"2024-07-24T22:05:27.695762+0000","last_peered":"2024-07-24T22:05:27.695762+0000","last_clean":"2024-07-24T22:05:27.695762+0000","last_became_active":"2024-07-24T22:04:27.502515+0000","last_became_peered":"2024-07-24T22:04:27.502515+0000","last_unstale":"2024-07-24T22:05:27.695762+0000","last_undegraded":"2024-07-24T22:05:27.695762+0000","last_fullsized":"2024-07-24T22:05:27.695762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:58:39.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,10],"acting":[3,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572158+0000","last_change":"2024-07-24T22:03:53.413213+0000","last_active":"2024-07-24T22:05:27.572158+0000","last_peered":"2024-07-24T22:05:27.572158+0000","last_clean":"2024-07-24T22:05:27.572158+0000","last_became_active":"2024-07-24T22:03:53.412725+0000","last_became_peered":"2024-07-24T22:03:53.412725+0000","last_unstale":"2024-07-24T22:05:27.572158+0000","last_undegraded":"2024-07-24T22:05:27.572158+0000","last_fullsized":"2024-07-24T22:05:27.572158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:34:01.897965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589224+0000","last_change":"2024-07-24T22:03:53.401129+0000","last_active":"2024-07-24T22:05:27.589224+0000","last_peered":"2024-07-24T22:05:27.589224+0000","last_clean":"2024-07-24T22:05:27.589224+0000","last_became_active":"2024-07-24T22:03:53.400780+0000","last_became_peered":"2024-07-24T22:03:53.400780+0000","last_unstale":"2024-07-24T22:05:27.589224+0000","last_undegraded":"2024-07-24T22:05:27.589224+0000","last_fullsized":"2024-07-24T22:05:27.589224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:28:37.825021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576231+0000","last_change":"2024-07-24T22:03:53.406490+0000","last_active":"2024-07-24T22:05:27.576231+0000","last_peered":"2024-07-24T22:05:27.576231+0000","last_clean":"2024-07-24T22:05:27.576231+0000","last_became_active":"2024-07-24T22:03:53.406108+0000","last_became_peered":"2024-07-24T22:03:53.406108+0000","last_unstale":"2024-07-24T22:05:27.576231+0000","last_undegraded":"2024-07-24T22:05:27.576231+0000","last_fullsized":"2024-07-24T22:05:27.576231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:37.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695913+0000","last_change":"2024-07-24T22:04:27.503165+0000","last_active":"2024-07-24T22:05:27.695913+0000","last_peered":"2024-07-24T22:05:27.695913+0000","last_clean":"2024-07-24T22:05:27.695913+0000","last_became_active":"2024-07-24T22:04:27.502861+0000","last_became_peered":"2024-07-24T22:04:27.502861+0000","last_unstale":"2024-07-24T22:05:27.695913+0000","last_undegraded":"2024-07-24T22:05:27.695913+0000","last_fullsized":"2024-07-24T22:05:27.695913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:36:41.353268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571263+0000","last_change":"2024-07-24T22:03:53.392763+0000","last_active":"2024-07-24T22:05:27.571263+0000","last_peered":"2024-07-24T22:05:27.571263+0000","last_clean":"2024-07-24T22:05:27.571263+0000","last_became_active":"2024-07-24T22:03:53.392476+0000","last_became_peered":"2024-07-24T22:03:53.392476+0000","last_unstale":"2024-07-24T22:05:27.571263+0000","last_undegraded":"2024-07-24T22:05:27.571263+0000","last_fullsized":"2024-07-24T22:05:27.571263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:25:13.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696340+0000","last_change":"2024-07-24T22:03:53.406937+0000","last_active":"2024-07-24T22:05:27.696340+0000","last_peered":"2024-07-24T22:05:27.696340+0000","last_clean":"2024-07-24T22:05:27.696340+0000","last_became_active":"2024-07-24T22:03:53.406495+0000","last_became_peered":"2024-07-24T22:03:53.406495+0000","last_unstale":"2024-07-24T22:05:27.696340+0000","last_undegraded":"2024-07-24T22:05:27.696340+0000","last_fullsized":"2024-07-24T22:05:27.696340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:06:50.434751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695723+0000","last_change":"2024-07-24T22:03:53.401073+0000","last_active":"2024-07-24T22:05:27.695723+0000","last_peered":"2024-07-24T22:05:27.695723+0000","last_clean":"2024-07-24T22:05:27.695723+0000","last_became_active":"2024-07-24T22:03:53.399675+0000","last_became_peered":"2024-07-24T22:03:53.399675+0000","last_unstale":"2024-07-24T22:05:27.695723+0000","last_undegraded":"2024-07-24T22:05:27.695723+0000","last_fullsized":"2024-07-24T22:05:27.695723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:59:25.461178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571670+0000","last_change":"2024-07-24T22:03:53.408289+0000","last_active":"2024-07-24T22:05:27.571670+0000","last_peered":"2024-07-24T22:05:27.571670+0000","last_clean":"2024-07-24T22:05:27.571670+0000","last_became_active":"2024-07-24T22:03:53.407950+0000","last_became_peered":"2024-07-24T22:03:53.407950+0000","last_unstale":"2024-07-24T22:05:27.571670+0000","last_undegraded":"2024-07-24T22:05:27.571670+0000","last_fullsized":"2024-07-24T22:05:27.571670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:10:30.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574008+0000","last_change":"2024-07-24T22:03:53.409909+0000","last_active":"2024-07-24T22:05:27.574008+0000","last_peered":"2024-07-24T22:05:27.574008+0000","last_clean":"2024-07-24T22:05:27.574008+0000","last_became_active":"2024-07-24T22:03:53.409183+0000","last_became_peered":"2024-07-24T22:03:53.409183+0000","last_unstale":"2024-07-24T22:05:27.574008+0000","last_undegraded":"2024-07-24T22:05:27.574008+0000","last_fullsized":"2024-07-24T22:05:27.574008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:14:50.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695710+0000","last_change":"2024-07-24T22:03:53.401198+0000","last_active":"2024-07-24T22:05:27.695710+0000","last_peered":"2024-07-24T22:05:27.695710+0000","last_clean":"2024-07-24T22:05:27.695710+0000","last_became_active":"2024-07-24T22:03:53.400885+0000","last_became_peered":"2024-07-24T22:03:53.400885+0000","last_unstale":"2024-07-24T22:05:27.695710+0000","last_undegraded":"2024-07-24T22:05:27.695710+0000","last_fullsized":"2024-07-24T22:05:27.695710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:59:37.965714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696048+0000","last_change":"2024-07-24T22:03:53.406590+0000","last_active":"2024-07-24T22:05:27.696048+0000","last_peered":"2024-07-24T22:05:27.696048+0000","last_clean":"2024-07-24T22:05:27.696048+0000","last_became_active":"2024-07-24T22:03:53.406283+0000","last_became_peered":"2024-07-24T22:03:53.406283+0000","last_unstale":"2024-07-24T22:05:27.696048+0000","last_undegraded":"2024-07-24T22:05:27.696048+0000","last_fullsized":"2024-07-24T22:05:27.696048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:30.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573401+0000","last_change":"2024-07-24T22:03:53.408790+0000","last_active":"2024-07-24T22:05:27.573401+0000","last_peered":"2024-07-24T22:05:27.573401+0000","last_clean":"2024-07-24T22:05:27.573401+0000","last_became_active":"2024-07-24T22:03:53.408480+0000","last_became_peered":"2024-07-24T22:03:53.408480+0000","last_unstale":"2024-07-24T22:05:27.573401+0000","last_undegraded":"2024-07-24T22:05:27.573401+0000","last_fullsized":"2024-07-24T22:05:27.573401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:59.601606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571171+0000","last_change":"2024-07-24T22:03:53.407400+0000","last_active":"2024-07-24T22:05:27.571171+0000","last_peered":"2024-07-24T22:05:27.571171+0000","last_clean":"2024-07-24T22:05:27.571171+0000","last_became_active":"2024-07-24T22:03:53.407084+0000","last_became_peered":"2024-07-24T22:03:53.407084+0000","last_unstale":"2024-07-24T22:05:27.571171+0000","last_undegraded":"2024-07-24T22:05:27.571171+0000","last_fullsized":"2024-07-24T22:05:27.571171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:51:04.942504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571785+0000","last_change":"2024-07-24T22:03:53.407444+0000","last_active":"2024-07-24T22:05:27.571785+0000","last_peered":"2024-07-24T22:05:27.571785+0000","last_clean":"2024-07-24T22:05:27.571785+0000","last_became_active":"2024-07-24T22:03:53.407025+0000","last_became_peered":"2024-07-24T22:03:53.407025+0000","last_unstale":"2024-07-24T22:05:27.571785+0000","last_undegraded":"2024-07-24T22:05:27.571785+0000","last_fullsized":"2024-07-24T22:05:27.571785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:47:49.620354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696170+0000","last_change":"2024-07-24T22:03:53.406748+0000","last_active":"2024-07-24T22:05:27.696170+0000","last_peered":"2024-07-24T22:05:27.696170+0000","last_clean":"2024-07-24T22:05:27.696170+0000","last_became_active":"2024-07-24T22:03:53.406398+0000","last_became_peered":"2024-07-24T22:03:53.406398+0000","last_unstale":"2024-07-24T22:05:27.696170+0000","last_undegraded":"2024-07-24T22:05:27.696170+0000","last_fullsized":"2024-07-24T22:05:27.696170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:35:40.117375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574701+0000","last_change":"2024-07-24T22:03:53.402203+0000","last_active":"2024-07-24T22:05:27.574701+0000","last_peered":"2024-07-24T22:05:27.574701+0000","last_clean":"2024-07-24T22:05:27.574701+0000","last_became_active":"2024-07-24T22:03:53.401826+0000","last_became_peered":"2024-07-24T22:03:53.401826+0000","last_unstale":"2024-07-24T22:05:27.574701+0000","last_undegraded":"2024-07-24T22:05:27.574701+0000","last_fullsized":"2024-07-24T22:05:27.574701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:45.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696666+0000","last_change":"2024-07-24T22:03:53.408179+0000","last_active":"2024-07-24T22:05:27.696666+0000","last_peered":"2024-07-24T22:05:27.696666+0000","last_clean":"2024-07-24T22:05:27.696666+0000","last_became_active":"2024-07-24T22:03:53.407547+0000","last_became_peered":"2024-07-24T22:03:53.407547+0000","last_unstale":"2024-07-24T22:05:27.696666+0000","last_undegraded":"2024-07-24T22:05:27.696666+0000","last_fullsized":"2024-07-24T22:05:27.696666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:03:52.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696074+0000","last_change":"2024-07-24T22:03:53.408550+0000","last_active":"2024-07-24T22:05:27.696074+0000","last_peered":"2024-07-24T22:05:27.696074+0000","last_clean":"2024-07-24T22:05:27.696074+0000","last_became_active":"2024-07-24T22:03:53.408119+0000","last_became_peered":"2024-07-24T22:03:53.408119+0000","last_unstale":"2024-07-24T22:05:27.696074+0000","last_undegraded":"2024-07-24T22:05:27.696074+0000","last_fullsized":"2024-07-24T22:05:27.696074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:33:54.154606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573853+0000","last_change":"2024-07-24T22:03:53.412562+0000","last_active":"2024-07-24T22:05:27.573853+0000","last_peered":"2024-07-24T22:05:27.573853+0000","last_clean":"2024-07-24T22:05:27.573853+0000","last_became_active":"2024-07-24T22:03:53.412231+0000","last_became_peered":"2024-07-24T22:03:53.412231+0000","last_unstale":"2024-07-24T22:05:27.573853+0000","last_undegraded":"2024-07-24T22:05:27.573853+0000","last_fullsized":"2024-07-24T22:05:27.573853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:53:48.403662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571173+0000","last_change":"2024-07-24T22:03:53.398212+0000","last_active":"2024-07-24T22:05:27.571173+0000","last_peered":"2024-07-24T22:05:27.571173+0000","last_clean":"2024-07-24T22:05:27.571173+0000","last_became_active":"2024-07-24T22:03:53.397853+0000","last_became_peered":"2024-07-24T22:03:53.397853+0000","last_unstale":"2024-07-24T22:05:27.571173+0000","last_undegraded":"2024-07-24T22:05:27.571173+0000","last_fullsized":"2024-07-24T22:05:27.571173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:39:47.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696283+0000","last_change":"2024-07-24T22:03:53.397188+0000","last_active":"2024-07-24T22:05:27.696283+0000","last_peered":"2024-07-24T22:05:27.696283+0000","last_clean":"2024-07-24T22:05:27.696283+0000","last_became_active":"2024-07-24T22:03:53.396865+0000","last_became_peered":"2024-07-24T22:03:53.396865+0000","last_unstale":"2024-07-24T22:05:27.696283+0000","last_undegraded":"2024-07-24T22:05:27.696283+0000","last_fullsized":"2024-07-24T22:05:27.696283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:20:49.074330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695823+0000","last_change":"2024-07-24T22:03:53.406605+0000","last_active":"2024-07-24T22:05:27.695823+0000","last_peered":"2024-07-24T22:05:27.695823+0000","last_clean":"2024-07-24T22:05:27.695823+0000","last_became_active":"2024-07-24T22:03:53.406264+0000","last_became_peered":"2024-07-24T22:03:53.406264+0000","last_unstale":"2024-07-24T22:05:27.695823+0000","last_undegraded":"2024-07-24T22:05:27.695823+0000","last_fullsized":"2024-07-24T22:05:27.695823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:13:46.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696013+0000","last_change":"2024-07-24T22:03:53.400422+0000","last_active":"2024-07-24T22:05:27.696013+0000","last_peered":"2024-07-24T22:05:27.696013+0000","last_clean":"2024-07-24T22:05:27.696013+0000","last_became_active":"2024-07-24T22:03:53.400096+0000","last_became_peered":"2024-07-24T22:03:53.400096+0000","last_unstale":"2024-07-24T22:05:27.696013+0000","last_undegraded":"2024-07-24T22:05:27.696013+0000","last_fullsized":"2024-07-24T22:05:27.696013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:04:07.882659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573363+0000","last_change":"2024-07-24T22:03:53.413231+0000","last_active":"2024-07-24T22:05:27.573363+0000","last_peered":"2024-07-24T22:05:27.573363+0000","last_clean":"2024-07-24T22:05:27.573363+0000","last_became_active":"2024-07-24T22:03:53.412825+0000","last_became_peered":"2024-07-24T22:03:53.412825+0000","last_unstale":"2024-07-24T22:05:27.573363+0000","last_undegraded":"2024-07-24T22:05:27.573363+0000","last_fullsized":"2024-07-24T22:05:27.573363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:59:30.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575993+0000","last_change":"2024-07-24T22:03:53.409007+0000","last_active":"2024-07-24T22:05:27.575993+0000","last_peered":"2024-07-24T22:05:27.575993+0000","last_clean":"2024-07-24T22:05:27.575993+0000","last_became_active":"2024-07-24T22:03:53.408624+0000","last_became_peered":"2024-07-24T22:03:53.408624+0000","last_unstale":"2024-07-24T22:05:27.575993+0000","last_undegraded":"2024-07-24T22:05:27.575993+0000","last_fullsized":"2024-07-24T22:05:27.575993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:31:22.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575311+0000","last_change":"2024-07-24T22:03:50.388894+0000","last_active":"2024-07-24T22:05:27.575311+0000","last_peered":"2024-07-24T22:05:27.575311+0000","last_clean":"2024-07-24T22:05:27.575311+0000","last_became_active":"2024-07-24T22:03:50.388608+0000","last_became_peered":"2024-07-24T22:03:50.388608+0000","last_unstale":"2024-07-24T22:05:27.575311+0000","last_undegraded":"2024-07-24T22:05:27.575311+0000","last_fullsized":"2024-07-24T22:05:27.575311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:36:43.571415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575239+0000","last_change":"2024-07-24T22:03:53.397509+0000","last_active":"2024-07-24T22:05:27.575239+0000","last_peered":"2024-07-24T22:05:27.575239+0000","last_clean":"2024-07-24T22:05:27.575239+0000","last_became_active":"2024-07-24T22:03:53.397186+0000","last_became_peered":"2024-07-24T22:03:53.397186+0000","last_unstale":"2024-07-24T22:05:27.575239+0000","last_undegraded":"2024-07-24T22:05:27.575239+0000","last_fullsized":"2024-07-24T22:05:27.575239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:15:14.081853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588955+0000","last_change":"2024-07-24T22:03:50.383523+0000","last_active":"2024-07-24T22:05:27.588955+0000","last_peered":"2024-07-24T22:05:27.588955+0000","last_clean":"2024-07-24T22:05:27.588955+0000","last_became_active":"2024-07-24T22:03:50.383088+0000","last_became_peered":"2024-07-24T22:03:50.383088+0000","last_unstale":"2024-07-24T22:05:27.588955+0000","last_undegraded":"2024-07-24T22:05:27.588955+0000","last_fullsized":"2024-07-24T22:05:27.588955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:57:07.824581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570963+0000","last_change":"2024-07-24T22:03:50.383726+0000","last_active":"2024-07-24T22:05:27.570963+0000","last_peered":"2024-07-24T22:05:27.570963+0000","last_clean":"2024-07-24T22:05:27.570963+0000","last_became_active":"2024-07-24T22:03:50.383480+0000","last_became_peered":"2024-07-24T22:03:50.383480+0000","last_unstale":"2024-07-24T22:05:27.570963+0000","last_undegraded":"2024-07-24T22:05:27.570963+0000","last_fullsized":"2024-07-24T22:05:27.570963+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:05:05.093272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695819+0000","last_change":"2024-07-24T22:03:53.406223+0000","last_active":"2024-07-24T22:05:27.695819+0000","last_peered":"2024-07-24T22:05:27.695819+0000","last_clean":"2024-07-24T22:05:27.695819+0000","last_became_active":"2024-07-24T22:03:53.404642+0000","last_became_peered":"2024-07-24T22:03:53.404642+0000","last_unstale":"2024-07-24T22:05:27.695819+0000","last_undegraded":"2024-07-24T22:05:27.695819+0000","last_fullsized":"2024-07-24T22:05:27.695819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:00:51.849538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574889+0000","last_change":"2024-07-24T22:03:50.385780+0000","last_active":"2024-07-24T22:05:27.574889+0000","last_peered":"2024-07-24T22:05:27.574889+0000","last_clean":"2024-07-24T22:05:27.574889+0000","last_became_active":"2024-07-24T22:03:50.385488+0000","last_became_peered":"2024-07-24T22:03:50.385488+0000","last_unstale":"2024-07-24T22:05:27.574889+0000","last_undegraded":"2024-07-24T22:05:27.574889+0000","last_fullsized":"2024-07-24T22:05:27.574889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:47:35.908303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695950+0000","last_change":"2024-07-24T22:03:53.403103+0000","last_active":"2024-07-24T22:05:27.695950+0000","last_peered":"2024-07-24T22:05:27.695950+0000","last_clean":"2024-07-24T22:05:27.695950+0000","last_became_active":"2024-07-24T22:03:53.402810+0000","last_became_peered":"2024-07-24T22:03:53.402810+0000","last_unstale":"2024-07-24T22:05:27.695950+0000","last_undegraded":"2024-07-24T22:05:27.695950+0000","last_fullsized":"2024-07-24T22:05:27.695950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:15.798983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589069+0000","last_change":"2024-07-24T22:03:50.382383+0000","last_active":"2024-07-24T22:05:27.589069+0000","last_peered":"2024-07-24T22:05:27.589069+0000","last_clean":"2024-07-24T22:05:27.589069+0000","last_became_active":"2024-07-24T22:03:50.381629+0000","last_became_peered":"2024-07-24T22:03:50.381629+0000","last_unstale":"2024-07-24T22:05:27.589069+0000","last_undegraded":"2024-07-24T22:05:27.589069+0000","last_fullsized":"2024-07-24T22:05:27.589069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:17.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572154+0000","last_change":"2024-07-24T22:03:53.409587+0000","last_active":"2024-07-24T22:05:27.572154+0000","last_peered":"2024-07-24T22:05:27.572154+0000","last_clean":"2024-07-24T22:05:27.572154+0000","last_became_active":"2024-07-24T22:03:53.409240+0000","last_became_peered":"2024-07-24T22:03:53.409240+0000","last_unstale":"2024-07-24T22:05:27.572154+0000","last_undegraded":"2024-07-24T22:05:27.572154+0000","last_fullsized":"2024-07-24T22:05:27.572154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:37:18.654244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576466+0000","last_change":"2024-07-24T22:03:50.387933+0000","last_active":"2024-07-24T22:05:27.576466+0000","last_peered":"2024-07-24T22:05:27.576466+0000","last_clean":"2024-07-24T22:05:27.576466+0000","last_became_active":"2024-07-24T22:03:50.386985+0000","last_became_peered":"2024-07-24T22:03:50.386985+0000","last_unstale":"2024-07-24T22:05:27.576466+0000","last_undegraded":"2024-07-24T22:05:27.576466+0000","last_fullsized":"2024-07-24T22:05:27.576466+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:35:29.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696682+0000","last_change":"2024-07-24T22:03:53.404419+0000","last_active":"2024-07-24T22:05:27.696682+0000","last_peered":"2024-07-24T22:05:27.696682+0000","last_clean":"2024-07-24T22:05:27.696682+0000","last_became_active":"2024-07-24T22:03:53.402713+0000","last_became_peered":"2024-07-24T22:03:53.402713+0000","last_unstale":"2024-07-24T22:05:27.696682+0000","last_undegraded":"2024-07-24T22:05:27.696682+0000","last_fullsized":"2024-07-24T22:05:27.696682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:41.262686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575104+0000","last_change":"2024-07-24T22:03:50.511126+0000","last_active":"2024-07-24T22:05:27.575104+0000","last_peered":"2024-07-24T22:05:27.575104+0000","last_clean":"2024-07-24T22:05:27.575104+0000","last_became_active":"2024-07-24T22:03:50.510801+0000","last_became_peered":"2024-07-24T22:03:50.510801+0000","last_unstale":"2024-07-24T22:05:27.575104+0000","last_undegraded":"2024-07-24T22:05:27.575104+0000","last_fullsized":"2024-07-24T22:05:27.575104+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:59:37.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571928+0000","last_change":"2024-07-24T22:03:53.410202+0000","last_active":"2024-07-24T22:05:27.571928+0000","last_peered":"2024-07-24T22:05:27.571928+0000","last_clean":"2024-07-24T22:05:27.571928+0000","last_became_active":"2024-07-24T22:03:53.409884+0000","last_became_peered":"2024-07-24T22:03:53.409884+0000","last_unstale":"2024-07-24T22:05:27.571928+0000","last_undegraded":"2024-07-24T22:05:27.571928+0000","last_fullsized":"2024-07-24T22:05:27.571928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:54:02.603267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'33","reported_seq":394,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:06:45.712266+0000","last_change":"2024-07-24T22:03:50.386993+0000","last_active":"2024-07-24T22:06:45.712266+0000","last_peered":"2024-07-24T22:06:45.712266+0000","last_clean":"2024-07-24T22:06:45.712266+0000","last_became_active":"2024-07-24T22:03:50.386675+0000","last_became_peered":"2024-07-24T22:03:50.386675+0000","last_unstale":"2024-07-24T22:06:45.712266+0000","last_undegraded":"2024-07-24T22:06:45.712266+0000","last_fullsized":"2024-07-24T22:06:45.712266+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:20:58.384179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68265,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":329,"num_read_kb":231,"num_write":33,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576569+0000","last_change":"2024-07-24T22:03:53.413293+0000","last_active":"2024-07-24T22:05:27.576569+0000","last_peered":"2024-07-24T22:05:27.576569+0000","last_clean":"2024-07-24T22:05:27.576569+0000","last_became_active":"2024-07-24T22:03:53.412900+0000","last_became_peered":"2024-07-24T22:03:53.412900+0000","last_unstale":"2024-07-24T22:05:27.576569+0000","last_undegraded":"2024-07-24T22:05:27.576569+0000","last_fullsized":"2024-07-24T22:05:27.576569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:11:32.553108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696109+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.696109+0000","last_peered":"2024-07-24T22:05:27.696109+0000","last_clean":"2024-07-24T22:05:27.696109+0000","last_became_active":"2024-07-24T22:03:50.387059+0000","last_became_peered":"2024-07-24T22:03:50.387059+0000","last_unstale":"2024-07-24T22:05:27.696109+0000","last_undegraded":"2024-07-24T22:05:27.696109+0000","last_fullsized":"2024-07-24T22:05:27.696109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:40:06.887090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570910+0000","last_change":"2024-07-24T22:03:53.406808+0000","last_active":"2024-07-24T22:05:27.570910+0000","last_peered":"2024-07-24T22:05:27.570910+0000","last_clean":"2024-07-24T22:05:27.570910+0000","last_became_active":"2024-07-24T22:03:53.406487+0000","last_became_peered":"2024-07-24T22:03:53.406487+0000","last_unstale":"2024-07-24T22:05:27.570910+0000","last_undegraded":"2024-07-24T22:05:27.570910+0000","last_fullsized":"2024-07-24T22:05:27.570910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:44:57.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574923+0000","last_change":"2024-07-24T22:03:50.386881+0000","last_active":"2024-07-24T22:05:27.574923+0000","last_peered":"2024-07-24T22:05:27.574923+0000","last_clean":"2024-07-24T22:05:27.574923+0000","last_became_active":"2024-07-24T22:03:50.386564+0000","last_became_peered":"2024-07-24T22:03:50.386564+0000","last_unstale":"2024-07-24T22:05:27.574923+0000","last_undegraded":"2024-07-24T22:05:27.574923+0000","last_fullsized":"2024-07-24T22:05:27.574923+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:22:22.339854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576277+0000","last_change":"2024-07-24T22:03:53.403207+0000","last_active":"2024-07-24T22:05:27.576277+0000","last_peered":"2024-07-24T22:05:27.576277+0000","last_clean":"2024-07-24T22:05:27.576277+0000","last_became_active":"2024-07-24T22:03:53.402875+0000","last_became_peered":"2024-07-24T22:03:53.402875+0000","last_unstale":"2024-07-24T22:05:27.576277+0000","last_undegraded":"2024-07-24T22:05:27.576277+0000","last_fullsized":"2024-07-24T22:05:27.576277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:25:28.866228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575960+0000","last_change":"2024-07-24T22:03:50.386721+0000","last_active":"2024-07-24T22:05:27.575960+0000","last_peered":"2024-07-24T22:05:27.575960+0000","last_clean":"2024-07-24T22:05:27.575960+0000","last_became_active":"2024-07-24T22:03:50.385654+0000","last_became_peered":"2024-07-24T22:03:50.385654+0000","last_unstale":"2024-07-24T22:05:27.575960+0000","last_undegraded":"2024-07-24T22:05:27.575960+0000","last_fullsized":"2024-07-24T22:05:27.575960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:16:15.802744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575896+0000","last_change":"2024-07-24T22:03:53.405367+0000","last_active":"2024-07-24T22:05:27.575896+0000","last_peered":"2024-07-24T22:05:27.575896+0000","last_clean":"2024-07-24T22:05:27.575896+0000","last_became_active":"2024-07-24T22:03:53.404875+0000","last_became_peered":"2024-07-24T22:03:53.404875+0000","last_unstale":"2024-07-24T22:05:27.575896+0000","last_undegraded":"2024-07-24T22:05:27.575896+0000","last_fullsized":"2024-07-24T22:05:27.575896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:42.247052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575893+0000","last_change":"2024-07-24T22:04:27.574426+0000","last_active":"2024-07-24T22:05:27.575893+0000","last_peered":"2024-07-24T22:05:27.575893+0000","last_clean":"2024-07-24T22:05:27.575893+0000","last_became_active":"2024-07-24T22:04:27.568176+0000","last_became_peered":"2024-07-24T22:04:27.568176+0000","last_unstale":"2024-07-24T22:05:27.575893+0000","last_undegraded":"2024-07-24T22:05:27.575893+0000","last_fullsized":"2024-07-24T22:05:27.575893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:20:37.620669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574893+0000","last_change":"2024-07-24T22:03:53.405136+0000","last_active":"2024-07-24T22:05:27.574893+0000","last_peered":"2024-07-24T22:05:27.574893+0000","last_clean":"2024-07-24T22:05:27.574893+0000","last_became_active":"2024-07-24T22:03:53.404043+0000","last_became_peered":"2024-07-24T22:03:53.404043+0000","last_unstale":"2024-07-24T22:05:27.574893+0000","last_undegraded":"2024-07-24T22:05:27.574893+0000","last_fullsized":"2024-07-24T22:05:27.574893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:03:21.912335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576738+0000","last_change":"2024-07-24T22:03:50.382364+0000","last_active":"2024-07-24T22:05:27.576738+0000","last_peered":"2024-07-24T22:05:27.576738+0000","last_clean":"2024-07-24T22:05:27.576738+0000","last_became_active":"2024-07-24T22:03:50.382029+0000","last_became_peered":"2024-07-24T22:03:50.382029+0000","last_unstale":"2024-07-24T22:05:27.576738+0000","last_undegraded":"2024-07-24T22:05:27.576738+0000","last_fullsized":"2024-07-24T22:05:27.576738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:48:10.004826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573801+0000","last_change":"2024-07-24T22:03:53.413053+0000","last_active":"2024-07-24T22:05:27.573801+0000","last_peered":"2024-07-24T22:05:27.573801+0000","last_clean":"2024-07-24T22:05:27.573801+0000","last_became_active":"2024-07-24T22:03:53.412733+0000","last_became_peered":"2024-07-24T22:03:53.412733+0000","last_unstale":"2024-07-24T22:05:27.573801+0000","last_undegraded":"2024-07-24T22:05:27.573801+0000","last_fullsized":"2024-07-24T22:05:27.573801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:16.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571346+0000","last_change":"2024-07-24T22:03:50.387314+0000","last_active":"2024-07-24T22:05:27.571346+0000","last_peered":"2024-07-24T22:05:27.571346+0000","last_clean":"2024-07-24T22:05:27.571346+0000","last_became_active":"2024-07-24T22:03:50.386919+0000","last_became_peered":"2024-07-24T22:03:50.386919+0000","last_unstale":"2024-07-24T22:05:27.571346+0000","last_undegraded":"2024-07-24T22:05:27.571346+0000","last_fullsized":"2024-07-24T22:05:27.571346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:51:03.203285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576716+0000","last_change":"2024-07-24T22:03:53.411938+0000","last_active":"2024-07-24T22:05:27.576716+0000","last_peered":"2024-07-24T22:05:27.576716+0000","last_clean":"2024-07-24T22:05:27.576716+0000","last_became_active":"2024-07-24T22:03:53.411545+0000","last_became_peered":"2024-07-24T22:03:53.411545+0000","last_unstale":"2024-07-24T22:05:27.576716+0000","last_undegraded":"2024-07-24T22:05:27.576716+0000","last_fullsized":"2024-07-24T22:05:27.576716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:41:19.370886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575188+0000","last_change":"2024-07-24T22:03:50.384400+0000","last_active":"2024-07-24T22:05:27.575188+0000","last_peered":"2024-07-24T22:05:27.575188+0000","last_clean":"2024-07-24T22:05:27.575188+0000","last_became_active":"2024-07-24T22:03:50.383945+0000","last_became_peered":"2024-07-24T22:03:50.383945+0000","last_unstale":"2024-07-24T22:05:27.575188+0000","last_undegraded":"2024-07-24T22:05:27.575188+0000","last_fullsized":"2024-07-24T22:05:27.575188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:16.035171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576430+0000","last_change":"2024-07-24T22:04:27.507390+0000","last_active":"2024-07-24T22:05:27.576430+0000","last_peered":"2024-07-24T22:05:27.576430+0000","last_clean":"2024-07-24T22:05:27.576430+0000","last_became_active":"2024-07-24T22:04:27.504206+0000","last_became_peered":"2024-07-24T22:04:27.504206+0000","last_unstale":"2024-07-24T22:05:27.576430+0000","last_undegraded":"2024-07-24T22:05:27.576430+0000","last_fullsized":"2024-07-24T22:05:27.576430+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:55:21.559702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696182+0000","last_change":"2024-07-24T22:03:50.511075+0000","last_active":"2024-07-24T22:05:27.696182+0000","last_peered":"2024-07-24T22:05:27.696182+0000","last_clean":"2024-07-24T22:05:27.696182+0000","last_became_active":"2024-07-24T22:03:50.510244+0000","last_became_peered":"2024-07-24T22:03:50.510244+0000","last_unstale":"2024-07-24T22:05:27.696182+0000","last_undegraded":"2024-07-24T22:05:27.696182+0000","last_fullsized":"2024-07-24T22:05:27.696182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:54:03.068211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576340+0000","last_change":"2024-07-24T22:03:53.410865+0000","last_active":"2024-07-24T22:05:27.576340+0000","last_peered":"2024-07-24T22:05:27.576340+0000","last_clean":"2024-07-24T22:05:27.576340+0000","last_became_active":"2024-07-24T22:03:53.410255+0000","last_became_peered":"2024-07-24T22:03:53.410255+0000","last_unstale":"2024-07-24T22:05:27.576340+0000","last_undegraded":"2024-07-24T22:05:27.576340+0000","last_fullsized":"2024-07-24T22:05:27.576340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:15.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576134+0000","last_change":"2024-07-24T22:02:33.494929+0000","last_active":"2024-07-24T22:05:27.576134+0000","last_peered":"2024-07-24T22:05:27.576134+0000","last_clean":"2024-07-24T22:05:27.576134+0000","last_became_active":"2024-07-24T22:02:33.489241+0000","last_became_peered":"2024-07-24T22:02:33.489241+0000","last_unstale":"2024-07-24T22:05:27.576134+0000","last_undegraded":"2024-07-24T22:05:27.576134+0000","last_fullsized":"2024-07-24T22:05:27.576134+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_clean_scrub_stamp":"2024-07-24T21:59:32.406119+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:46.421413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576268+0000","last_change":"2024-07-24T22:03:50.385093+0000","last_active":"2024-07-24T22:05:27.576268+0000","last_peered":"2024-07-24T22:05:27.576268+0000","last_clean":"2024-07-24T22:05:27.576268+0000","last_became_active":"2024-07-24T22:03:50.384639+0000","last_became_peered":"2024-07-24T22:03:50.384639+0000","last_unstale":"2024-07-24T22:05:27.576268+0000","last_undegraded":"2024-07-24T22:05:27.576268+0000","last_fullsized":"2024-07-24T22:05:27.576268+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:06:10.402336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696068+0000","last_change":"2024-07-24T22:03:53.409627+0000","last_active":"2024-07-24T22:05:27.696068+0000","last_peered":"2024-07-24T22:05:27.696068+0000","last_clean":"2024-07-24T22:05:27.696068+0000","last_became_active":"2024-07-24T22:03:53.409295+0000","last_became_peered":"2024-07-24T22:03:53.409295+0000","last_unstale":"2024-07-24T22:05:27.696068+0000","last_undegraded":"2024-07-24T22:05:27.696068+0000","last_fullsized":"2024-07-24T22:05:27.696068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:23:39.670020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576402+0000","last_change":"2024-07-24T22:03:50.385772+0000","last_active":"2024-07-24T22:05:27.576402+0000","last_peered":"2024-07-24T22:05:27.576402+0000","last_clean":"2024-07-24T22:05:27.576402+0000","last_became_active":"2024-07-24T22:03:50.385421+0000","last_became_peered":"2024-07-24T22:03:50.385421+0000","last_unstale":"2024-07-24T22:05:27.576402+0000","last_undegraded":"2024-07-24T22:05:27.576402+0000","last_fullsized":"2024-07-24T22:05:27.576402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:58:57.227697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570892+0000","last_change":"2024-07-24T22:03:53.400558+0000","last_active":"2024-07-24T22:05:27.570892+0000","last_peered":"2024-07-24T22:05:27.570892+0000","last_clean":"2024-07-24T22:05:27.570892+0000","last_became_active":"2024-07-24T22:03:53.400131+0000","last_became_peered":"2024-07-24T22:03:53.400131+0000","last_unstale":"2024-07-24T22:05:27.570892+0000","last_undegraded":"2024-07-24T22:05:27.570892+0000","last_fullsized":"2024-07-24T22:05:27.570892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:57:57.586742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571018+0000","last_change":"2024-07-24T22:03:50.510189+0000","last_active":"2024-07-24T22:05:27.571018+0000","last_peered":"2024-07-24T22:05:27.571018+0000","last_clean":"2024-07-24T22:05:27.571018+0000","last_became_active":"2024-07-24T22:03:50.509857+0000","last_became_peered":"2024-07-24T22:03:50.509857+0000","last_unstale":"2024-07-24T22:05:27.571018+0000","last_undegraded":"2024-07-24T22:05:27.571018+0000","last_fullsized":"2024-07-24T22:05:27.571018+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:05:59.240650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574703+0000","last_change":"2024-07-24T22:04:27.505187+0000","last_active":"2024-07-24T22:05:27.574703+0000","last_peered":"2024-07-24T22:05:27.574703+0000","last_clean":"2024-07-24T22:05:27.574703+0000","last_became_active":"2024-07-24T22:04:27.504785+0000","last_became_peered":"2024-07-24T22:04:27.504785+0000","last_unstale":"2024-07-24T22:05:27.574703+0000","last_undegraded":"2024-07-24T22:05:27.574703+0000","last_fullsized":"2024-07-24T22:05:27.574703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:47:33.516835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576182+0000","last_change":"2024-07-24T22:05:27.575016+0000","last_active":"2024-07-24T22:05:27.576182+0000","last_peered":"2024-07-24T22:05:27.576182+0000","last_clean":"2024-07-24T22:05:27.576182+0000","last_became_active":"2024-07-24T22:05:27.574644+0000","last_became_peered":"2024-07-24T22:05:27.574644+0000","last_unstale":"2024-07-24T22:05:27.576182+0000","last_undegraded":"2024-07-24T22:05:27.576182+0000","last_fullsized":"2024-07-24T22:05:27.576182+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:11:37.759190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588938+0000","last_change":"2024-07-24T22:03:53.399369+0000","last_active":"2024-07-24T22:05:27.588938+0000","last_peered":"2024-07-24T22:05:27.588938+0000","last_clean":"2024-07-24T22:05:27.588938+0000","last_became_active":"2024-07-24T22:03:53.399001+0000","last_became_peered":"2024-07-24T22:03:53.399001+0000","last_unstale":"2024-07-24T22:05:27.588938+0000","last_undegraded":"2024-07-24T22:05:27.588938+0000","last_fullsized":"2024-07-24T22:05:27.588938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:26:46.531080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695870+0000","last_change":"2024-07-24T22:03:50.510889+0000","last_active":"2024-07-24T22:05:27.695870+0000","last_peered":"2024-07-24T22:05:27.695870+0000","last_clean":"2024-07-24T22:05:27.695870+0000","last_became_active":"2024-07-24T22:03:50.510366+0000","last_became_peered":"2024-07-24T22:03:50.510366+0000","last_unstale":"2024-07-24T22:05:27.695870+0000","last_undegraded":"2024-07-24T22:05:27.695870+0000","last_fullsized":"2024-07-24T22:05:27.695870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:47:54.838304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589019+0000","last_change":"2024-07-24T22:03:53.398987+0000","last_active":"2024-07-24T22:05:27.589019+0000","last_peered":"2024-07-24T22:05:27.589019+0000","last_clean":"2024-07-24T22:05:27.589019+0000","last_became_active":"2024-07-24T22:03:53.398604+0000","last_became_peered":"2024-07-24T22:03:53.398604+0000","last_unstale":"2024-07-24T22:05:27.589019+0000","last_undegraded":"2024-07-24T22:05:27.589019+0000","last_fullsized":"2024-07-24T22:05:27.589019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:28:41.684174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576685+0000","last_change":"2024-07-24T22:03:50.510623+0000","last_active":"2024-07-24T22:05:27.576685+0000","last_peered":"2024-07-24T22:05:27.576685+0000","last_clean":"2024-07-24T22:05:27.576685+0000","last_became_active":"2024-07-24T22:03:50.510204+0000","last_became_peered":"2024-07-24T22:03:50.510204+0000","last_unstale":"2024-07-24T22:05:27.576685+0000","last_undegraded":"2024-07-24T22:05:27.576685+0000","last_fullsized":"2024-07-24T22:05:27.576685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:06:40.838840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571179+0000","last_change":"2024-07-24T22:03:53.400289+0000","last_active":"2024-07-24T22:05:27.571179+0000","last_peered":"2024-07-24T22:05:27.571179+0000","last_clean":"2024-07-24T22:05:27.571179+0000","last_became_active":"2024-07-24T22:03:53.399939+0000","last_became_peered":"2024-07-24T22:03:53.399939+0000","last_unstale":"2024-07-24T22:05:27.571179+0000","last_undegraded":"2024-07-24T22:05:27.571179+0000","last_fullsized":"2024-07-24T22:05:27.571179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:29:26.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:06:04.017159+0000","last_change":"2024-07-24T22:03:50.382776+0000","last_active":"2024-07-24T22:06:04.017159+0000","last_peered":"2024-07-24T22:06:04.017159+0000","last_clean":"2024-07-24T22:06:04.017159+0000","last_became_active":"2024-07-24T22:03:50.382474+0000","last_became_peered":"2024-07-24T22:03:50.382474+0000","last_unstale":"2024-07-24T22:06:04.017159+0000","last_undegraded":"2024-07-24T22:06:04.017159+0000","last_fullsized":"2024-07-24T22:06:04.017159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:59:34.688895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696694+0000","last_change":"2024-07-24T22:03:53.407883+0000","last_active":"2024-07-24T22:05:27.696694+0000","last_peered":"2024-07-24T22:05:27.696694+0000","last_clean":"2024-07-24T22:05:27.696694+0000","last_became_active":"2024-07-24T22:03:53.407524+0000","last_became_peered":"2024-07-24T22:03:53.407524+0000","last_unstale":"2024-07-24T22:05:27.696694+0000","last_undegraded":"2024-07-24T22:05:27.696694+0000","last_fullsized":"2024-07-24T22:05:27.696694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:52:25.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576771+0000","last_change":"2024-07-24T22:03:50.388789+0000","last_active":"2024-07-24T22:05:27.576771+0000","last_peered":"2024-07-24T22:05:27.576771+0000","last_clean":"2024-07-24T22:05:27.576771+0000","last_became_active":"2024-07-24T22:03:50.385439+0000","last_became_peered":"2024-07-24T22:03:50.385439+0000","last_unstale":"2024-07-24T22:05:27.576771+0000","last_undegraded":"2024-07-24T22:05:27.576771+0000","last_fullsized":"2024-07-24T22:05:27.576771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:14:25.009588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696603+0000","last_change":"2024-07-24T22:04:27.503956+0000","last_active":"2024-07-24T22:05:27.696603+0000","last_peered":"2024-07-24T22:05:27.696603+0000","last_clean":"2024-07-24T22:05:27.696603+0000","last_became_active":"2024-07-24T22:04:27.503498+0000","last_became_peered":"2024-07-24T22:04:27.503498+0000","last_unstale":"2024-07-24T22:05:27.696603+0000","last_undegraded":"2024-07-24T22:05:27.696603+0000","last_fullsized":"2024-07-24T22:05:27.696603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:23:20.294458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571757+0000","last_change":"2024-07-24T22:03:50.510687+0000","last_active":"2024-07-24T22:05:27.571757+0000","last_peered":"2024-07-24T22:05:27.571757+0000","last_clean":"2024-07-24T22:05:27.571757+0000","last_became_active":"2024-07-24T22:03:50.510310+0000","last_became_peered":"2024-07-24T22:03:50.510310+0000","last_unstale":"2024-07-24T22:05:27.571757+0000","last_undegraded":"2024-07-24T22:05:27.571757+0000","last_fullsized":"2024-07-24T22:05:27.571757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:14:29.957324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576327+0000","last_change":"2024-07-24T22:03:53.412711+0000","last_active":"2024-07-24T22:05:27.576327+0000","last_peered":"2024-07-24T22:05:27.576327+0000","last_clean":"2024-07-24T22:05:27.576327+0000","last_became_active":"2024-07-24T22:03:53.412375+0000","last_became_peered":"2024-07-24T22:03:53.412375+0000","last_unstale":"2024-07-24T22:05:27.576327+0000","last_undegraded":"2024-07-24T22:05:27.576327+0000","last_fullsized":"2024-07-24T22:05:27.576327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:55:29.441385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696331+0000","last_change":"2024-07-24T22:03:50.383094+0000","last_active":"2024-07-24T22:05:27.696331+0000","last_peered":"2024-07-24T22:05:27.696331+0000","last_clean":"2024-07-24T22:05:27.696331+0000","last_became_active":"2024-07-24T22:03:50.382687+0000","last_became_peered":"2024-07-24T22:03:50.382687+0000","last_unstale":"2024-07-24T22:05:27.696331+0000","last_undegraded":"2024-07-24T22:05:27.696331+0000","last_fullsized":"2024-07-24T22:05:27.696331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:32:02.727855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573366+0000","last_change":"2024-07-24T22:03:53.403709+0000","last_active":"2024-07-24T22:05:27.573366+0000","last_peered":"2024-07-24T22:05:27.573366+0000","last_clean":"2024-07-24T22:05:27.573366+0000","last_became_active":"2024-07-24T22:03:53.403334+0000","last_became_peered":"2024-07-24T22:03:53.403334+0000","last_unstale":"2024-07-24T22:05:27.573366+0000","last_undegraded":"2024-07-24T22:05:27.573366+0000","last_fullsized":"2024-07-24T22:05:27.573366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:27:50.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695814+0000","last_change":"2024-07-24T22:03:50.385547+0000","last_active":"2024-07-24T22:05:27.695814+0000","last_peered":"2024-07-24T22:05:27.695814+0000","last_clean":"2024-07-24T22:05:27.695814+0000","last_became_active":"2024-07-24T22:03:50.385233+0000","last_became_peered":"2024-07-24T22:03:50.385233+0000","last_unstale":"2024-07-24T22:05:27.695814+0000","last_undegraded":"2024-07-24T22:05:27.695814+0000","last_fullsized":"2024-07-24T22:05:27.695814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:40:04.647242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696043+0000","last_change":"2024-07-24T22:03:53.402386+0000","last_active":"2024-07-24T22:05:27.696043+0000","last_peered":"2024-07-24T22:05:27.696043+0000","last_clean":"2024-07-24T22:05:27.696043+0000","last_became_active":"2024-07-24T22:03:53.399363+0000","last_became_peered":"2024-07-24T22:03:53.399363+0000","last_unstale":"2024-07-24T22:05:27.696043+0000","last_undegraded":"2024-07-24T22:05:27.696043+0000","last_fullsized":"2024-07-24T22:05:27.696043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:19:05.835280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576088+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.576088+0000","last_peered":"2024-07-24T22:05:27.576088+0000","last_clean":"2024-07-24T22:05:27.576088+0000","last_became_active":"2024-07-24T22:03:50.387097+0000","last_became_peered":"2024-07-24T22:03:50.387097+0000","last_unstale":"2024-07-24T22:05:27.576088+0000","last_undegraded":"2024-07-24T22:05:27.576088+0000","last_fullsized":"2024-07-24T22:05:27.576088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:11:23.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576510+0000","last_change":"2024-07-24T22:03:53.407386+0000","last_active":"2024-07-24T22:05:27.576510+0000","last_peered":"2024-07-24T22:05:27.576510+0000","last_clean":"2024-07-24T22:05:27.576510+0000","last_became_active":"2024-07-24T22:03:53.407059+0000","last_became_peered":"2024-07-24T22:03:53.407059+0000","last_unstale":"2024-07-24T22:05:27.576510+0000","last_undegraded":"2024-07-24T22:05:27.576510+0000","last_fullsized":"2024-07-24T22:05:27.576510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:12:38.508170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695772+0000","last_change":"2024-07-24T22:04:27.567714+0000","last_active":"2024-07-24T22:05:27.695772+0000","last_peered":"2024-07-24T22:05:27.695772+0000","last_clean":"2024-07-24T22:05:27.695772+0000","last_became_active":"2024-07-24T22:04:27.567492+0000","last_became_peered":"2024-07-24T22:04:27.567492+0000","last_unstale":"2024-07-24T22:05:27.695772+0000","last_undegraded":"2024-07-24T22:05:27.695772+0000","last_fullsized":"2024-07-24T22:05:27.695772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:00:13.705346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576278+0000","last_change":"2024-07-24T22:03:50.385538+0000","last_active":"2024-07-24T22:05:27.576278+0000","last_peered":"2024-07-24T22:05:27.576278+0000","last_clean":"2024-07-24T22:05:27.576278+0000","last_became_active":"2024-07-24T22:03:50.385191+0000","last_became_peered":"2024-07-24T22:03:50.385191+0000","last_unstale":"2024-07-24T22:05:27.576278+0000","last_undegraded":"2024-07-24T22:05:27.576278+0000","last_fullsized":"2024-07-24T22:05:27.576278+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:33:37.674903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571800+0000","last_change":"2024-07-24T22:03:53.411751+0000","last_active":"2024-07-24T22:05:27.571800+0000","last_peered":"2024-07-24T22:05:27.571800+0000","last_clean":"2024-07-24T22:05:27.571800+0000","last_became_active":"2024-07-24T22:03:53.410827+0000","last_became_peered":"2024-07-24T22:03:53.410827+0000","last_unstale":"2024-07-24T22:05:27.571800+0000","last_undegraded":"2024-07-24T22:05:27.571800+0000","last_fullsized":"2024-07-24T22:05:27.571800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:07:26.439047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.584159+0000","last_change":"2024-07-24T22:05:27.581982+0000","last_active":"2024-07-24T22:05:27.584159+0000","last_peered":"2024-07-24T22:05:27.584159+0000","last_clean":"2024-07-24T22:05:27.584159+0000","last_became_active":"2024-07-24T22:05:27.577413+0000","last_became_peered":"2024-07-24T22:05:27.577413+0000","last_unstale":"2024-07-24T22:05:27.584159+0000","last_undegraded":"2024-07-24T22:05:27.584159+0000","last_fullsized":"2024-07-24T22:05:27.584159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:40:27.424379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696604+0000","last_change":"2024-07-24T22:03:53.406029+0000","last_active":"2024-07-24T22:05:27.696604+0000","last_peered":"2024-07-24T22:05:27.696604+0000","last_clean":"2024-07-24T22:05:27.696604+0000","last_became_active":"2024-07-24T22:03:53.405529+0000","last_became_peered":"2024-07-24T22:03:53.405529+0000","last_unstale":"2024-07-24T22:05:27.696604+0000","last_undegraded":"2024-07-24T22:05:27.696604+0000","last_fullsized":"2024-07-24T22:05:27.696604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:57:02.290836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696580+0000","last_change":"2024-07-24T22:03:50.510884+0000","last_active":"2024-07-24T22:05:27.696580+0000","last_peered":"2024-07-24T22:05:27.696580+0000","last_clean":"2024-07-24T22:05:27.696580+0000","last_became_active":"2024-07-24T22:03:50.509851+0000","last_became_peered":"2024-07-24T22:03:50.509851+0000","last_unstale":"2024-07-24T22:05:27.696580+0000","last_undegraded":"2024-07-24T22:05:27.696580+0000","last_fullsized":"2024-07-24T22:05:27.696580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:37:55.735488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696364+0000","last_change":"2024-07-24T22:03:53.409966+0000","last_active":"2024-07-24T22:05:27.696364+0000","last_peered":"2024-07-24T22:05:27.696364+0000","last_clean":"2024-07-24T22:05:27.696364+0000","last_became_active":"2024-07-24T22:03:53.409652+0000","last_became_peered":"2024-07-24T22:03:53.409652+0000","last_unstale":"2024-07-24T22:05:27.696364+0000","last_undegraded":"2024-07-24T22:05:27.696364+0000","last_fullsized":"2024-07-24T22:05:27.696364+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:10:53.262459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696523+0000","last_change":"2024-07-24T22:04:27.571166+0000","last_active":"2024-07-24T22:05:27.696523+0000","last_peered":"2024-07-24T22:05:27.696523+0000","last_clean":"2024-07-24T22:05:27.696523+0000","last_became_active":"2024-07-24T22:04:27.567419+0000","last_became_peered":"2024-07-24T22:04:27.567419+0000","last_unstale":"2024-07-24T22:05:27.696523+0000","last_undegraded":"2024-07-24T22:05:27.696523+0000","last_fullsized":"2024-07-24T22:05:27.696523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:37:11.513631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69063,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":335,"num_read_kb":237,"num_write":93,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":201816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612659,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":937984,"data_stored":469642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808885,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1626112,"data_stored":1128586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972411,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40428,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704724,"statfs":{"total":95995035648,"available":95953637376,"internally_reserved":0,"allocated":946176,"data_stored":470341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168641,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":469664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397571,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1540096,"data_stored":1060709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561097,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":469759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757325,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1548288,"data_stored":1060309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920849,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117078,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40432,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704720,"statfs":{"total":95995035648,"available":95953633280,"internally_reserved":0,"allocated":950272,"data_stored":469863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378715,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":537941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542239,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":533116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705762,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":68299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T22:06:48.319 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:06:48.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:48 smithi188 ceph-mon[37380]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:06:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:48.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:48 smithi183 ceph-mon[37007]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:06:48.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:48 smithi047 ceph-mon[32551]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:06:49.410 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:49 smithi047 ceph-mon[32551]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:06:49.410 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:49 smithi047 ceph-mon[32551]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-07-24T22:06:49.410 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:49 smithi047 ceph-mon[32551]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:06:49.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:49 smithi188 ceph-mon[37380]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:06:49.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:49 smithi188 ceph-mon[37380]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-07-24T22:06:49.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:49 smithi188 ceph-mon[37380]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:06:49.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:49 smithi183 ceph-mon[37007]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:06:49.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:49 smithi183 ceph-mon[37007]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-07-24T22:06:49.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:49 smithi183 ceph-mon[37007]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:06:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.323+0000 7f9798257640 1 -- 172.21.15.47:0/78172550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9790102790 msgr2=0x7f9790102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.323+0000 7f9798257640 1 --2- 172.21.15.47:0/78172550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9790102790 0x7f9790102b70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f978c009900 tx=0x7f978c02a410 comp rx=0 tx=0).stop 2024-07-24T22:06:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.323+0000 7f9798257640 1 -- 172.21.15.47:0/78172550 shutdown_connections 2024-07-24T22:06:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.323+0000 7f9798257640 1 --2- 172.21.15.47:0/78172550 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9790108b20 0x7f979010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.323+0000 7f9798257640 1 --2- 172.21.15.47:0/78172550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97901081a0 0x7f97901085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.323+0000 7f9798257640 1 --2- 172.21.15.47:0/78172550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9790102790 0x7f9790102b70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.323+0000 7f9798257640 1 -- 172.21.15.47:0/78172550 >> 172.21.15.47:0/78172550 conn(0x7f97900fe200 msgr2=0x7f9790100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.323+0000 7f9798257640 1 -- 172.21.15.47:0/78172550 shutdown_connections 2024-07-24T22:06:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.323+0000 7f9798257640 1 -- 172.21.15.47:0/78172550 wait complete. 2024-07-24T22:06:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.323+0000 7f9798257640 1 Processor -- start 2024-07-24T22:06:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.323+0000 7f9798257640 1 -- start start 2024-07-24T22:06:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f9798257640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9790102790 0x7f9790074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f9798257640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97901081a0 0x7f97900753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f9798257640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9790108b20 0x7f9790075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f9798257640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9790112740 con 0x7f9790108b20 2024-07-24T22:06:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f9798257640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f97901125c0 con 0x7f9790102790 2024-07-24T22:06:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f9798257640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f97901128c0 con 0x7f97901081a0 2024-07-24T22:06:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f97967f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9790108b20 0x7f9790075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f97967f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9790108b20 0x7f9790075910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56398/0 (socket says 172.21.15.47:56398) 2024-07-24T22:06:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f97967f4640 1 -- 172.21.15.47:0/2734829289 learned_addr learned my addr 172.21.15.47:0/2734829289 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f9795ff3640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9790102790 0x7f9790074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f97957f2640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97901081a0 0x7f97900753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f97967f4640 1 -- 172.21.15.47:0/2734829289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97901081a0 msgr2=0x7f97900753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f97967f4640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97901081a0 0x7f97900753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f97967f4640 1 -- 172.21.15.47:0/2734829289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9790102790 msgr2=0x7f9790074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f97967f4640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9790102790 0x7f9790074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f97967f4640 1 -- 172.21.15.47:0/2734829289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97901a7050 con 0x7f9790108b20 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f9795ff3640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9790102790 0x7f9790074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f97967f4640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9790108b20 0x7f9790075910 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f978800eaa0 tx=0x7f978800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f9786ffd640 1 -- 172.21.15.47:0/2734829289 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978800cdb0 con 0x7f9790108b20 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.324+0000 7f9786ffd640 1 -- 172.21.15.47:0/2734829289 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9788005020 con 0x7f9790108b20 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.325+0000 7f9798257640 1 -- 172.21.15.47:0/2734829289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97901a7340 con 0x7f9790108b20 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.325+0000 7f9786ffd640 1 -- 172.21.15.47:0/2734829289 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97880116d0 con 0x7f9790108b20 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.325+0000 7f9798257640 1 -- 172.21.15.47:0/2734829289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97901a78d0 con 0x7f9790108b20 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.326+0000 7f9798257640 1 -- 172.21.15.47:0/2734829289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9790102b70 con 0x7f9790108b20 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.327+0000 7f9786ffd640 1 -- 172.21.15.47:0/2734829289 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f97880051d0 con 0x7f9790108b20 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.328+0000 7f9786ffd640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f977c0b3ca0 0x7f977c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.328+0000 7f9795ff3640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f977c0b3ca0 0x7f977c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.328+0000 7f9786ffd640 1 -- 172.21.15.47:0/2734829289 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f97880e4310 con 0x7f9790108b20 2024-07-24T22:06:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.329+0000 7f9795ff3640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f977c0b3ca0 0x7f977c0b6160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f978c031440 tx=0x7f978c005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.331+0000 7f9786ffd640 1 -- 172.21.15.47:0/2734829289 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f9788016030 con 0x7f9790108b20 2024-07-24T22:06:50.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.566+0000 7f9798257640 1 -- 172.21.15.47:0/2734829289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9790076190 con 0x7f9790108b20 2024-07-24T22:06:50.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.567+0000 7f9786ffd640 1 -- 172.21.15.47:0/2734829289 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f9790076190 con 0x7f9790108b20 2024-07-24T22:06:50.569 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:50.569 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:06:50.569 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:06:50.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.569+0000 7f9798257640 1 -- 172.21.15.47:0/2734829289 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f977c0b3ca0 msgr2=0x7f977c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:50.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.569+0000 7f9798257640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f977c0b3ca0 0x7f977c0b6160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f978c031440 tx=0x7f978c005a20 comp rx=0 tx=0).stop 2024-07-24T22:06:50.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.569+0000 7f9798257640 1 -- 172.21.15.47:0/2734829289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9790108b20 msgr2=0x7f9790075910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:50.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.569+0000 7f9798257640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9790108b20 0x7f9790075910 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f978800eaa0 tx=0x7f978800ef60 comp rx=0 tx=0).stop 2024-07-24T22:06:50.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.569+0000 7f9798257640 1 -- 172.21.15.47:0/2734829289 shutdown_connections 2024-07-24T22:06:50.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.569+0000 7f9798257640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f977c0b3ca0 0x7f977c0b6160 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:50.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.569+0000 7f9798257640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9790108b20 0x7f9790075910 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:50.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.569+0000 7f9798257640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97901081a0 0x7f97900753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:50.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.569+0000 7f9798257640 1 --2- 172.21.15.47:0/2734829289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9790102790 0x7f9790074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:50.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.569+0000 7f9798257640 1 -- 172.21.15.47:0/2734829289 >> 172.21.15.47:0/2734829289 conn(0x7f97900fe200 msgr2=0x7f97900feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:50.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.569+0000 7f9798257640 1 -- 172.21.15.47:0/2734829289 shutdown_connections 2024-07-24T22:06:50.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:50.569+0000 7f9798257640 1 -- 172.21.15.47:0/2734829289 wait complete. 2024-07-24T22:06:51.261 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd dump --format=json 2024-07-24T22:06:51.530 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:51.540 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:51 smithi047 ceph-mon[32551]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-07-24T22:06:51.541 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:51 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2734829289' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:51.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:51 smithi188 ceph-mon[37380]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-07-24T22:06:51.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:51 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2734829289' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:51.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:51 smithi183 ceph-mon[37007]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-07-24T22:06:51.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:51 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2734829289' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:06:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.143+0000 7f62ae62c640 1 -- 172.21.15.47:0/1570960069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62a8101690 msgr2=0x7f62a8101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.143+0000 7f62ae62c640 1 --2- 172.21.15.47:0/1570960069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62a8101690 0x7f62a8101a70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6298009900 tx=0x7f629802a410 comp rx=0 tx=0).stop 2024-07-24T22:06:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.143+0000 7f62ae62c640 1 -- 172.21.15.47:0/1570960069 shutdown_connections 2024-07-24T22:06:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.143+0000 7f62ae62c640 1 --2- 172.21.15.47:0/1570960069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62a8107a20 0x7f62a810e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.143+0000 7f62ae62c640 1 --2- 172.21.15.47:0/1570960069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62a81070a0 0x7f62a81074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.143+0000 7f62ae62c640 1 --2- 172.21.15.47:0/1570960069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62a8101690 0x7f62a8101a70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.143+0000 7f62ae62c640 1 -- 172.21.15.47:0/1570960069 >> 172.21.15.47:0/1570960069 conn(0x7f62a80fd100 msgr2=0x7f62a80ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.143+0000 7f62ae62c640 1 -- 172.21.15.47:0/1570960069 shutdown_connections 2024-07-24T22:06:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.143+0000 7f62ae62c640 1 -- 172.21.15.47:0/1570960069 wait complete. 2024-07-24T22:06:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.144+0000 7f62ae62c640 1 Processor -- start 2024-07-24T22:06:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.144+0000 7f62ae62c640 1 -- start start 2024-07-24T22:06:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.144+0000 7f62ae62c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62a8101690 0x7f62a8199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.144+0000 7f62ae62c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62a81070a0 0x7f62a819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.144+0000 7f62ae62c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62a8107a20 0x7f62a81a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.144+0000 7f62ae62c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f62a8111650 con 0x7f62a8107a20 2024-07-24T22:06:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.144+0000 7f62ae62c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f62a81114d0 con 0x7f62a8101690 2024-07-24T22:06:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.144+0000 7f62ae62c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f62a81117d0 con 0x7f62a81070a0 2024-07-24T22:06:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.144+0000 7f62acbc9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62a8107a20 0x7f62a81a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.144+0000 7f62acbc9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62a8107a20 0x7f62a81a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56424/0 (socket says 172.21.15.47:56424) 2024-07-24T22:06:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.144+0000 7f62acbc9640 1 -- 172.21.15.47:0/116935173 learned_addr learned my addr 172.21.15.47:0/116935173 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62a7fff640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62a8101690 0x7f62a8199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62a77fe640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62a81070a0 0x7f62a819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62acbc9640 1 -- 172.21.15.47:0/116935173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62a81070a0 msgr2=0x7f62a819a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62acbc9640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62a81070a0 0x7f62a819a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62acbc9640 1 -- 172.21.15.47:0/116935173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62a8101690 msgr2=0x7f62a8199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62acbc9640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62a8101690 0x7f62a8199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62acbc9640 1 -- 172.21.15.47:0/116935173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a81a50a0 con 0x7f62a8107a20 2024-07-24T22:06:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62a7fff640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62a8101690 0x7f62a8199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:06:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62acbc9640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62a8107a20 0x7f62a81a4b60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f62a000cad0 tx=0x7f62a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62a57fa640 1 -- 172.21.15.47:0/116935173 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a000ae20 con 0x7f62a8107a20 2024-07-24T22:06:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62ae62c640 1 -- 172.21.15.47:0/116935173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a81a5270 con 0x7f62a8107a20 2024-07-24T22:06:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62a57fa640 1 -- 172.21.15.47:0/116935173 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62a0005020 con 0x7f62a8107a20 2024-07-24T22:06:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62a57fa640 1 -- 172.21.15.47:0/116935173 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a000f6b0 con 0x7f62a8107a20 2024-07-24T22:06:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.145+0000 7f62ae62c640 1 -- 172.21.15.47:0/116935173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a81a5720 con 0x7f62a8107a20 2024-07-24T22:06:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.146+0000 7f62ae62c640 1 -- 172.21.15.47:0/116935173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a8101a70 con 0x7f62a8107a20 2024-07-24T22:06:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.147+0000 7f62a57fa640 1 -- 172.21.15.47:0/116935173 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f62a00051d0 con 0x7f62a8107a20 2024-07-24T22:06:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.148+0000 7f62a57fa640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f62900b3c20 0x7f62900b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.148+0000 7f62a7fff640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f62900b3c20 0x7f62900b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.148+0000 7f62a57fa640 1 -- 172.21.15.47:0/116935173 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f62a00e3dc0 con 0x7f62a8107a20 2024-07-24T22:06:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.149+0000 7f62a7fff640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f62900b3c20 0x7f62900b60e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6298031440 tx=0x7f6298005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.152+0000 7f62a57fa640 1 -- 172.21.15.47:0/116935173 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f62a0014030 con 0x7f62a8107a20 2024-07-24T22:06:53.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:53 smithi047 ceph-mon[32551]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-07-24T22:06:53.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.347+0000 7f62ae62c640 1 -- 172.21.15.47:0/116935173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62a802e000 con 0x7f62a8107a20 2024-07-24T22:06:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.348+0000 7f62a57fa640 1 -- 172.21.15.47:0/116935173 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23138 (secure 0 0 0) 0x7f62a00ab2f0 con 0x7f62a8107a20 2024-07-24T22:06:53.351 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:53.351 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":85,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","created":"2024-07-24T21:55:28.945912+0000","modified":"2024-07-24T22:05:27.567637+0000","last_up_change":"2024-07-24T22:02:55.044691+0000","last_in_change":"2024-07-24T22:02:35.671256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T21:59:32.066678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T22:03:49.331120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T22:03:52.034826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60de2c3d-e4b7-4878-bdbb-ce3257e3706c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6803","nonce":2665889913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6805","nonce":2665889913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6809","nonce":2665889913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6807","nonce":2665889913}]},"public_addr":"172.21.15.47:6803/2665889913","cluster_addr":"172.21.15.47:6805/2665889913","heartbeat_back_addr":"172.21.15.47:6809/2665889913","heartbeat_front_addr":"172.21.15.47:6807/2665889913","state":["exists","up"]},{"osd":1,"uuid":"7f086675-3bed-47ca-a93f-fab9580068b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6801","nonce":3486494228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6803","nonce":3486494228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6807","nonce":3486494228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6805","nonce":3486494228}]},"public_addr":"172.21.15.183:6801/3486494228","cluster_addr":"172.21.15.183:6803/3486494228","heartbeat_back_addr":"172.21.15.183:6807/3486494228","heartbeat_front_addr":"172.21.15.183:6805/3486494228","state":["exists","up"]},{"osd":2,"uuid":"040fff27-6fa6-48de-9365-fcced8f89e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6801","nonce":2245903281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6803","nonce":2245903281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6807","nonce":2245903281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6805","nonce":2245903281}]},"public_addr":"172.21.15.188:6801/2245903281","cluster_addr":"172.21.15.188:6803/2245903281","heartbeat_back_addr":"172.21.15.188:6807/2245903281","heartbeat_front_addr":"172.21.15.188:6805/2245903281","state":["exists","up"]},{"osd":3,"uuid":"e129321a-9566-4bea-b982-34f7ddd1ae1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6811","nonce":236749130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6813","nonce":236749130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6817","nonce":236749130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6815","nonce":236749130}]},"public_addr":"172.21.15.47:6811/236749130","cluster_addr":"172.21.15.47:6813/236749130","heartbeat_back_addr":"172.21.15.47:6817/236749130","heartbeat_front_addr":"172.21.15.47:6815/236749130","state":["exists","up"]},{"osd":4,"uuid":"f969fba7-b0ff-4ea6-83bd-38aba32b1be1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6809","nonce":3978122107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6811","nonce":3978122107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6815","nonce":3978122107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6813","nonce":3978122107}]},"public_addr":"172.21.15.183:6809/3978122107","cluster_addr":"172.21.15.183:6811/3978122107","heartbeat_back_addr":"172.21.15.183:6815/3978122107","heartbeat_front_addr":"172.21.15.183:6813/3978122107","state":["exists","up"]},{"osd":5,"uuid":"3799c912-3d9f-4efd-9b36-569c385e4c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6809","nonce":2097128083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6811","nonce":2097128083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6815","nonce":2097128083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6813","nonce":2097128083}]},"public_addr":"172.21.15.188:6809/2097128083","cluster_addr":"172.21.15.188:6811/2097128083","heartbeat_back_addr":"172.21.15.188:6815/2097128083","heartbeat_front_addr":"172.21.15.188:6813/2097128083","state":["exists","up"]},{"osd":6,"uuid":"1a38cf12-619f-4e82-a7a5-21ee2014038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6819","nonce":2288252980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6821","nonce":2288252980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6825","nonce":2288252980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6823","nonce":2288252980}]},"public_addr":"172.21.15.47:6819/2288252980","cluster_addr":"172.21.15.47:6821/2288252980","heartbeat_back_addr":"172.21.15.47:6825/2288252980","heartbeat_front_addr":"172.21.15.47:6823/2288252980","state":["exists","up"]},{"osd":7,"uuid":"6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6817","nonce":465426514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6819","nonce":465426514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6823","nonce":465426514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6821","nonce":465426514}]},"public_addr":"172.21.15.183:6817/465426514","cluster_addr":"172.21.15.183:6819/465426514","heartbeat_back_addr":"172.21.15.183:6823/465426514","heartbeat_front_addr":"172.21.15.183:6821/465426514","state":["exists","up"]},{"osd":8,"uuid":"6dfd7252-61a6-423d-8498-cbcfa41ae1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6817","nonce":2247055658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6819","nonce":2247055658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6823","nonce":2247055658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6821","nonce":2247055658}]},"public_addr":"172.21.15.188:6817/2247055658","cluster_addr":"172.21.15.188:6819/2247055658","heartbeat_back_addr":"172.21.15.188:6823/2247055658","heartbeat_front_addr":"172.21.15.188:6821/2247055658","state":["exists","up"]},{"osd":9,"uuid":"abd93c5e-283e-4873-a241-1056f2894116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6827","nonce":2628721884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6829","nonce":2628721884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6833","nonce":2628721884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6831","nonce":2628721884}]},"public_addr":"172.21.15.47:6827/2628721884","cluster_addr":"172.21.15.47:6829/2628721884","heartbeat_back_addr":"172.21.15.47:6833/2628721884","heartbeat_front_addr":"172.21.15.47:6831/2628721884","state":["exists","up"]},{"osd":10,"uuid":"bc967f8f-ce27-4230-be70-e36927f89fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6825","nonce":3509332199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6827","nonce":3509332199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6831","nonce":3509332199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6829","nonce":3509332199}]},"public_addr":"172.21.15.183:6825/3509332199","cluster_addr":"172.21.15.183:6827/3509332199","heartbeat_back_addr":"172.21.15.183:6831/3509332199","heartbeat_front_addr":"172.21.15.183:6829/3509332199","state":["exists","up"]},{"osd":11,"uuid":"8b379865-3a5c-4a2d-aa74-a4f215027fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6825","nonce":3725107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6827","nonce":3725107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6831","nonce":3725107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6829","nonce":3725107101}]},"public_addr":"172.21.15.188:6825/3725107101","cluster_addr":"172.21.15.188:6827/3725107101","heartbeat_back_addr":"172.21.15.188:6831/3725107101","heartbeat_front_addr":"172.21.15.188:6829/3725107101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:58:44.413660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:06.554842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:28.651418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:50.995466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:13.906535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:36.632662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:59.003224+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:21.701327+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:44.017943+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:06.400895+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:29.625920+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:52.323223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3499235566":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/2112533111":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/2714360830":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/507334607":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6800/2524786594":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/1004458106":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6800/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/1046677443":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/899235864":"2024-07-25T21:56:15.044564+0000","172.21.15.47:6800/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/3057769442":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/2596054312":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6801/2524786594":"2024-07-25T21:57:25.995502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T22:06:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.351+0000 7f62ae62c640 1 -- 172.21.15.47:0/116935173 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f62900b3c20 msgr2=0x7f62900b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.351+0000 7f62ae62c640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f62900b3c20 0x7f62900b60e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6298031440 tx=0x7f6298005a20 comp rx=0 tx=0).stop 2024-07-24T22:06:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.351+0000 7f62ae62c640 1 -- 172.21.15.47:0/116935173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62a8107a20 msgr2=0x7f62a81a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.351+0000 7f62ae62c640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62a8107a20 0x7f62a81a4b60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f62a000cad0 tx=0x7f62a000cf90 comp rx=0 tx=0).stop 2024-07-24T22:06:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.351+0000 7f62ae62c640 1 -- 172.21.15.47:0/116935173 shutdown_connections 2024-07-24T22:06:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.351+0000 7f62ae62c640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f62900b3c20 0x7f62900b60e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.351+0000 7f62ae62c640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62a8107a20 0x7f62a81a4b60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.351+0000 7f62ae62c640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62a81070a0 0x7f62a819a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.351+0000 7f62ae62c640 1 --2- 172.21.15.47:0/116935173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62a8101690 0x7f62a8199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.351+0000 7f62ae62c640 1 -- 172.21.15.47:0/116935173 >> 172.21.15.47:0/116935173 conn(0x7f62a80fd100 msgr2=0x7f62a80ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.351+0000 7f62ae62c640 1 -- 172.21.15.47:0/116935173 shutdown_connections 2024-07-24T22:06:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:53.351+0000 7f62ae62c640 1 -- 172.21.15.47:0/116935173 wait complete. 2024-07-24T22:06:53.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:53 smithi188 ceph-mon[37380]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-07-24T22:06:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:53 smithi183 ceph-mon[37007]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-07-24T22:06:54.109 DEBUG:tasks.fwd_scrub:Yielding 2024-07-24T22:06:54.109 INFO:teuthology.run_tasks:Running task exec... 2024-07-24T22:06:54.118 INFO:teuthology.task.exec:Executing custom commands... 2024-07-24T22:06:54.118 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-07-24T22:06:54.118 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-07-24T22:06:54.119 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-07-24T22:06:54.119 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:06:54.119 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:06:54.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.234+0000 7ffa4004e640 1 -- 172.21.15.47:0/4078793713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38107910 msgr2=0x7ffa3810e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:54.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.234+0000 7ffa4004e640 1 --2- 172.21.15.47:0/4078793713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38107910 0x7ffa3810e110 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009ca0 tx=0x7ffa3002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.234+0000 7ffa4004e640 1 -- 172.21.15.47:0/4078793713 shutdown_connections 2024-07-24T22:06:54.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.234+0000 7ffa4004e640 1 --2- 172.21.15.47:0/4078793713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38107910 0x7ffa3810e110 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.234+0000 7ffa4004e640 1 --2- 172.21.15.47:0/4078793713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa38106f90 0x7ffa381073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.234+0000 7ffa4004e640 1 --2- 172.21.15.47:0/4078793713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa381015e0 0x7ffa381019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.234+0000 7ffa4004e640 1 -- 172.21.15.47:0/4078793713 >> 172.21.15.47:0/4078793713 conn(0x7ffa380782e0 msgr2=0x7ffa380ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:54.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.234+0000 7ffa4004e640 1 -- 172.21.15.47:0/4078793713 shutdown_connections 2024-07-24T22:06:54.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.234+0000 7ffa4004e640 1 -- 172.21.15.47:0/4078793713 wait complete. 2024-07-24T22:06:54.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.235+0000 7ffa4004e640 1 Processor -- start 2024-07-24T22:06:54.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.235+0000 7ffa4004e640 1 -- start start 2024-07-24T22:06:54.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.235+0000 7ffa4004e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa381015e0 0x7ffa380fd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:54.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.235+0000 7ffa4004e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa38106f90 0x7ffa380fdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:54.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.235+0000 7ffa4004e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa38107910 0x7ffa380fe200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:54.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.235+0000 7ffa4004e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffa38111590 con 0x7ffa381015e0 2024-07-24T22:06:54.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.235+0000 7ffa4004e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffa38111410 con 0x7ffa38107910 2024-07-24T22:06:54.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.235+0000 7ffa4004e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffa38111710 con 0x7ffa38106f90 2024-07-24T22:06:54.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.235+0000 7ffa3ddea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa381015e0 0x7ffa380fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:54.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.235+0000 7ffa3ddea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa381015e0 0x7ffa380fd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56450/0 (socket says 172.21.15.47:56450) 2024-07-24T22:06:54.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.235+0000 7ffa3ddea640 1 -- 172.21.15.47:0/739509742 learned_addr learned my addr 172.21.15.47:0/739509742 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:54.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.235+0000 7ffa3e5eb640 1 --2- 172.21.15.47:0/739509742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa38107910 0x7ffa380fe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:54.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.236+0000 7ffa3ddea640 1 -- 172.21.15.47:0/739509742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa38106f90 msgr2=0x7ffa380fdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:54.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.236+0000 7ffa3ddea640 1 --2- 172.21.15.47:0/739509742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa38106f90 0x7ffa380fdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.236+0000 7ffa3ddea640 1 -- 172.21.15.47:0/739509742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa38107910 msgr2=0x7ffa380fe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:54.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.236+0000 7ffa3ddea640 1 --2- 172.21.15.47:0/739509742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa38107910 0x7ffa380fe200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.236+0000 7ffa3ddea640 1 -- 172.21.15.47:0/739509742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa381a6f20 con 0x7ffa381015e0 2024-07-24T22:06:54.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.236+0000 7ffa3ddea640 1 --2- 172.21.15.47:0/739509742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa381015e0 0x7ffa380fd780 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00d950 tx=0x7ffa2c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:54.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.236+0000 7ffa2affd640 1 -- 172.21.15.47:0/739509742 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c017070 con 0x7ffa381015e0 2024-07-24T22:06:54.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.236+0000 7ffa4004e640 1 -- 172.21.15.47:0/739509742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa381a7210 con 0x7ffa381015e0 2024-07-24T22:06:54.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.236+0000 7ffa2affd640 1 -- 172.21.15.47:0/739509742 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa2c009c30 con 0x7ffa381015e0 2024-07-24T22:06:54.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.236+0000 7ffa2affd640 1 -- 172.21.15.47:0/739509742 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c00f620 con 0x7ffa381015e0 2024-07-24T22:06:54.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.236+0000 7ffa4004e640 1 -- 172.21.15.47:0/739509742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa381a7760 con 0x7ffa381015e0 2024-07-24T22:06:54.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.237+0000 7ffa4004e640 1 -- 172.21.15.47:0/739509742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa381019c0 con 0x7ffa381015e0 2024-07-24T22:06:54.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.238+0000 7ffa2affd640 1 -- 172.21.15.47:0/739509742 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7ffa2c010460 con 0x7ffa381015e0 2024-07-24T22:06:54.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.239+0000 7ffa2affd640 1 --2- 172.21.15.47:0/739509742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffa240b3c20 0x7ffa240b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:54.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.239+0000 7ffa3d5e9640 1 --2- 172.21.15.47:0/739509742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffa240b3c20 0x7ffa240b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:54.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.239+0000 7ffa2affd640 1 -- 172.21.15.47:0/739509742 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ffa2c0e3ac0 con 0x7ffa381015e0 2024-07-24T22:06:54.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.240+0000 7ffa3d5e9640 1 --2- 172.21.15.47:0/739509742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffa240b3c20 0x7ffa240b60e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffa380ff270 tx=0x7ffa34005c70 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:54.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.243+0000 7ffa2affd640 1 -- 172.21.15.47:0/739509742 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7ffa2c0aaf90 con 0x7ffa381015e0 2024-07-24T22:06:54.401 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:54.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:54 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/116935173' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:06:54.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.472+0000 7ffa4004e640 1 -- 172.21.15.47:0/739509742 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7ffa38069090 con 0x7ffa240b3c20 2024-07-24T22:06:54.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:54 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/116935173' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:06:54.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.628+0000 7ffa2affd640 1 -- 172.21.15.47:0/739509742 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ffa38069090 con 0x7ffa240b3c20 2024-07-24T22:06:54.630 INFO:teuthology.orchestra.run.smithi047.stdout:Schedule set for path / 2024-07-24T22:06:54.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.631+0000 7ffa4004e640 1 -- 172.21.15.47:0/739509742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffa240b3c20 msgr2=0x7ffa240b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:54.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.631+0000 7ffa4004e640 1 --2- 172.21.15.47:0/739509742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffa240b3c20 0x7ffa240b60e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffa380ff270 tx=0x7ffa34005c70 comp rx=0 tx=0).stop 2024-07-24T22:06:54.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.631+0000 7ffa4004e640 1 -- 172.21.15.47:0/739509742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa381015e0 msgr2=0x7ffa380fd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:54.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.631+0000 7ffa4004e640 1 --2- 172.21.15.47:0/739509742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa381015e0 0x7ffa380fd780 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00d950 tx=0x7ffa2c00de10 comp rx=0 tx=0).stop 2024-07-24T22:06:54.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.631+0000 7ffa4004e640 1 -- 172.21.15.47:0/739509742 shutdown_connections 2024-07-24T22:06:54.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.631+0000 7ffa4004e640 1 --2- 172.21.15.47:0/739509742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffa240b3c20 0x7ffa240b60e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.631+0000 7ffa4004e640 1 --2- 172.21.15.47:0/739509742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa38107910 0x7ffa380fe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.631+0000 7ffa4004e640 1 --2- 172.21.15.47:0/739509742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa38106f90 0x7ffa380fdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.631+0000 7ffa4004e640 1 --2- 172.21.15.47:0/739509742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa381015e0 0x7ffa380fd780 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.631+0000 7ffa4004e640 1 -- 172.21.15.47:0/739509742 >> 172.21.15.47:0/739509742 conn(0x7ffa380782e0 msgr2=0x7ffa3806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:54.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.631+0000 7ffa4004e640 1 -- 172.21.15.47:0/739509742 shutdown_connections 2024-07-24T22:06:54.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.631+0000 7ffa4004e640 1 -- 172.21.15.47:0/739509742 wait complete. 2024-07-24T22:06:54.645 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-07-24T22:06:54.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:54 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/116935173' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:06:54.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.753+0000 7fa4c508d640 1 -- 172.21.15.47:0/3994914338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4c010c9f0 msgr2=0x7fa4c010ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:54.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.753+0000 7fa4c508d640 1 --2- 172.21.15.47:0/3994914338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4c010c9f0 0x7fa4c010ee70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009ca0 tx=0x7fa4b802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.753+0000 7fa4c508d640 1 -- 172.21.15.47:0/3994914338 shutdown_connections 2024-07-24T22:06:54.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.753+0000 7fa4c508d640 1 --2- 172.21.15.47:0/3994914338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4c010c9f0 0x7fa4c010ee70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.753+0000 7fa4c508d640 1 --2- 172.21.15.47:0/3994914338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4c0103ef0 0x7fa4c010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.753+0000 7fa4c508d640 1 --2- 172.21.15.47:0/3994914338 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4c01035d0 0x7fa4c01039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.753+0000 7fa4c508d640 1 -- 172.21.15.47:0/3994914338 >> 172.21.15.47:0/3994914338 conn(0x7fa4c00782e0 msgr2=0x7fa4c00ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:54.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.753+0000 7fa4c508d640 1 -- 172.21.15.47:0/3994914338 shutdown_connections 2024-07-24T22:06:54.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.753+0000 7fa4c508d640 1 -- 172.21.15.47:0/3994914338 wait complete. 2024-07-24T22:06:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4c508d640 1 Processor -- start 2024-07-24T22:06:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4c508d640 1 -- start start 2024-07-24T22:06:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4c508d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4c01035d0 0x7fa4c0198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4c508d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4c0103ef0 0x7fa4c0199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4c508d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4c010c9f0 0x7fa4c019e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4c508d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c0112670 con 0x7fa4c01035d0 2024-07-24T22:06:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4c508d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c01124f0 con 0x7fa4c0103ef0 2024-07-24T22:06:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4c508d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c01127f0 con 0x7fa4c010c9f0 2024-07-24T22:06:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4bed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4c01035d0 0x7fa4c0198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4bed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4c01035d0 0x7fa4c0198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56480/0 (socket says 172.21.15.47:56480) 2024-07-24T22:06:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4bed9d640 1 -- 172.21.15.47:0/369298562 learned_addr learned my addr 172.21.15.47:0/369298562 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4bf59e640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4c010c9f0 0x7fa4c019e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4be59c640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4c0103ef0 0x7fa4c0199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4bed9d640 1 -- 172.21.15.47:0/369298562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4c010c9f0 msgr2=0x7fa4c019e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4bed9d640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4c010c9f0 0x7fa4c019e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4bed9d640 1 -- 172.21.15.47:0/369298562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4c0103ef0 msgr2=0x7fa4c0199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4bed9d640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4c0103ef0 0x7fa4c0199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.754+0000 7fa4bed9d640 1 -- 172.21.15.47:0/369298562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c019ecb0 con 0x7fa4c01035d0 2024-07-24T22:06:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.755+0000 7fa4bed9d640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4c01035d0 0x7fa4c0198c10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000e9f0 tx=0x7fa4b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.755+0000 7fa4a7fff640 1 -- 172.21.15.47:0/369298562 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b000cd80 con 0x7fa4c01035d0 2024-07-24T22:06:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.755+0000 7fa4a7fff640 1 -- 172.21.15.47:0/369298562 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4b00054d0 con 0x7fa4c01035d0 2024-07-24T22:06:54.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.755+0000 7fa4c508d640 1 -- 172.21.15.47:0/369298562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c019efa0 con 0x7fa4c01035d0 2024-07-24T22:06:54.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.755+0000 7fa4a7fff640 1 -- 172.21.15.47:0/369298562 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0010690 con 0x7fa4c01035d0 2024-07-24T22:06:54.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.755+0000 7fa4c508d640 1 -- 172.21.15.47:0/369298562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c01a5660 con 0x7fa4c01035d0 2024-07-24T22:06:54.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.756+0000 7fa4c508d640 1 -- 172.21.15.47:0/369298562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c01039b0 con 0x7fa4c01035d0 2024-07-24T22:06:54.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.757+0000 7fa4a7fff640 1 -- 172.21.15.47:0/369298562 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7fa4b0004e90 con 0x7fa4c01035d0 2024-07-24T22:06:54.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.758+0000 7fa4a7fff640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa4a80b3c20 0x7fa4a80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:54.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.758+0000 7fa4be59c640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa4a80b3c20 0x7fa4a80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:54.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.758+0000 7fa4a7fff640 1 -- 172.21.15.47:0/369298562 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa4b00e4260 con 0x7fa4c01035d0 2024-07-24T22:06:54.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.758+0000 7fa4be59c640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa4a80b3c20 0x7fa4a80b60e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4005db0 tx=0x7fa4b4005d40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:54.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.762+0000 7fa4a7fff640 1 -- 172.21.15.47:0/369298562 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fa4b00ab730 con 0x7fa4c01035d0 2024-07-24T22:06:54.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:54.995+0000 7fa4c508d640 1 -- 172.21.15.47:0/369298562 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fa4c00ff800 con 0x7fa4a80b3c20 2024-07-24T22:06:55.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.055+0000 7fa4a7fff640 1 -- 172.21.15.47:0/369298562 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fa4c00ff800 con 0x7fa4a80b3c20 2024-07-24T22:06:55.057 INFO:teuthology.orchestra.run.smithi047.stdout:Retention added to path / 2024-07-24T22:06:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.057+0000 7fa4c508d640 1 -- 172.21.15.47:0/369298562 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa4a80b3c20 msgr2=0x7fa4a80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.057+0000 7fa4c508d640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa4a80b3c20 0x7fa4a80b60e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4005db0 tx=0x7fa4b4005d40 comp rx=0 tx=0).stop 2024-07-24T22:06:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.057+0000 7fa4c508d640 1 -- 172.21.15.47:0/369298562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4c01035d0 msgr2=0x7fa4c0198c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.057+0000 7fa4c508d640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4c01035d0 0x7fa4c0198c10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000e9f0 tx=0x7fa4b000edf0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.057+0000 7fa4c508d640 1 -- 172.21.15.47:0/369298562 shutdown_connections 2024-07-24T22:06:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.057+0000 7fa4c508d640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa4a80b3c20 0x7fa4a80b60e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.057+0000 7fa4c508d640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4c010c9f0 0x7fa4c019e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.057+0000 7fa4c508d640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4c0103ef0 0x7fa4c0199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.057+0000 7fa4c508d640 1 --2- 172.21.15.47:0/369298562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4c01035d0 0x7fa4c0198c10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.057+0000 7fa4c508d640 1 -- 172.21.15.47:0/369298562 >> 172.21.15.47:0/369298562 conn(0x7fa4c00782e0 msgr2=0x7fa4c00ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.057+0000 7fa4c508d640 1 -- 172.21.15.47:0/369298562 shutdown_connections 2024-07-24T22:06:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.057+0000 7fa4c508d640 1 -- 172.21.15.47:0/369298562 wait complete. 2024-07-24T22:06:55.071 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-07-24T22:06:55.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.175+0000 7fd75e65e640 1 -- 172.21.15.47:0/1898269854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7581080b0 msgr2=0x7fd7581084f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:55.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.175+0000 7fd75e65e640 1 --2- 172.21.15.47:0/1898269854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7581080b0 0x7fd7581084f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd740009900 tx=0x7fd74002a410 comp rx=0 tx=0).stop 2024-07-24T22:06:55.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.175+0000 7fd75e65e640 1 -- 172.21.15.47:0/1898269854 shutdown_connections 2024-07-24T22:06:55.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.175+0000 7fd75e65e640 1 --2- 172.21.15.47:0/1898269854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd758108a30 0x7fd75810f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.175+0000 7fd75e65e640 1 --2- 172.21.15.47:0/1898269854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7581080b0 0x7fd7581084f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.175+0000 7fd75e65e640 1 --2- 172.21.15.47:0/1898269854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7581026b0 0x7fd758102a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.175+0000 7fd75e65e640 1 -- 172.21.15.47:0/1898269854 >> 172.21.15.47:0/1898269854 conn(0x7fd7580fe0f0 msgr2=0x7fd758100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:55.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.175+0000 7fd75e65e640 1 -- 172.21.15.47:0/1898269854 shutdown_connections 2024-07-24T22:06:55.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.175+0000 7fd75e65e640 1 -- 172.21.15.47:0/1898269854 wait complete. 2024-07-24T22:06:55.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.176+0000 7fd75e65e640 1 Processor -- start 2024-07-24T22:06:55.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.176+0000 7fd75e65e640 1 -- start start 2024-07-24T22:06:55.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.176+0000 7fd75e65e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7581026b0 0x7fd758198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:55.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.176+0000 7fd75e65e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7581080b0 0x7fd758199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:55.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.176+0000 7fd75e65e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd758108a30 0x7fd75819e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:55.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.176+0000 7fd75e65e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7581126d0 con 0x7fd7581026b0 2024-07-24T22:06:55.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.176+0000 7fd75e65e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd758112550 con 0x7fd758108a30 2024-07-24T22:06:55.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.176+0000 7fd75e65e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd758112850 con 0x7fd7581080b0 2024-07-24T22:06:55.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd757fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7581026b0 0x7fd758198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:55.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd757fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7581026b0 0x7fd758198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32880/0 (socket says 172.21.15.47:32880) 2024-07-24T22:06:55.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd757fff640 1 -- 172.21.15.47:0/667242177 learned_addr learned my addr 172.21.15.47:0/667242177 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd75cbfb640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd758108a30 0x7fd75819e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd74ffff640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7581080b0 0x7fd758199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd757fff640 1 -- 172.21.15.47:0/667242177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7581080b0 msgr2=0x7fd758199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd757fff640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7581080b0 0x7fd758199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd757fff640 1 -- 172.21.15.47:0/667242177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd758108a30 msgr2=0x7fd75819e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd757fff640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd758108a30 0x7fd75819e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd757fff640 1 -- 172.21.15.47:0/667242177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75819ecb0 con 0x7fd7581026b0 2024-07-24T22:06:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd75cbfb640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd758108a30 0x7fd75819e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:06:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd757fff640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7581026b0 0x7fd758198c10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd74800e9f0 tx=0x7fd74800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd755ffb640 1 -- 172.21.15.47:0/667242177 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74800cd80 con 0x7fd7581026b0 2024-07-24T22:06:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd755ffb640 1 -- 172.21.15.47:0/667242177 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7480108e0 con 0x7fd7581026b0 2024-07-24T22:06:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd75e65e640 1 -- 172.21.15.47:0/667242177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75819efa0 con 0x7fd7581026b0 2024-07-24T22:06:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd755ffb640 1 -- 172.21.15.47:0/667242177 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd748018980 con 0x7fd7581026b0 2024-07-24T22:06:55.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.177+0000 7fd75e65e640 1 -- 172.21.15.47:0/667242177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7581a56e0 con 0x7fd7581026b0 2024-07-24T22:06:55.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.178+0000 7fd75e65e640 1 -- 172.21.15.47:0/667242177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd758102a90 con 0x7fd7581026b0 2024-07-24T22:06:55.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.179+0000 7fd755ffb640 1 -- 172.21.15.47:0/667242177 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7fd748010430 con 0x7fd7581026b0 2024-07-24T22:06:55.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.181+0000 7fd755ffb640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd7440b3c20 0x7fd7440b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:55.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.181+0000 7fd74ffff640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd7440b3c20 0x7fd7440b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:55.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.181+0000 7fd755ffb640 1 -- 172.21.15.47:0/667242177 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fd7480e4240 con 0x7fd7581026b0 2024-07-24T22:06:55.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.181+0000 7fd74ffff640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd7440b3c20 0x7fd7440b60e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd740031440 tx=0x7fd7400095f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:55.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.185+0000 7fd755ffb640 1 -- 172.21.15.47:0/667242177 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fd7480ab710 con 0x7fd7581026b0 2024-07-24T22:06:55.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.401+0000 7fd75e65e640 1 -- 172.21.15.47:0/667242177 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fd758062f80 con 0x7fd7440b3c20 2024-07-24T22:06:55.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.408+0000 7fd755ffb640 1 -- 172.21.15.47:0/667242177 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fd758062f80 con 0x7fd7440b3c20 2024-07-24T22:06:55.410 INFO:teuthology.orchestra.run.smithi047.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T22:06:54", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-07-24T22:06:55.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.410+0000 7fd75e65e640 1 -- 172.21.15.47:0/667242177 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd7440b3c20 msgr2=0x7fd7440b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:55.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.410+0000 7fd75e65e640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd7440b3c20 0x7fd7440b60e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd740031440 tx=0x7fd7400095f0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.410+0000 7fd75e65e640 1 -- 172.21.15.47:0/667242177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7581026b0 msgr2=0x7fd758198c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:55.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.410+0000 7fd75e65e640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7581026b0 0x7fd758198c10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd74800e9f0 tx=0x7fd74800eeb0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.410+0000 7fd75e65e640 1 -- 172.21.15.47:0/667242177 shutdown_connections 2024-07-24T22:06:55.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.410+0000 7fd75e65e640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd7440b3c20 0x7fd7440b60e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.410+0000 7fd75e65e640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd758108a30 0x7fd75819e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.410+0000 7fd75e65e640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7581080b0 0x7fd758199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.410+0000 7fd75e65e640 1 --2- 172.21.15.47:0/667242177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7581026b0 0x7fd758198c10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.410+0000 7fd75e65e640 1 -- 172.21.15.47:0/667242177 >> 172.21.15.47:0/667242177 conn(0x7fd7580fe0f0 msgr2=0x7fd7581004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:55.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.410+0000 7fd75e65e640 1 -- 172.21.15.47:0/667242177 shutdown_connections 2024-07-24T22:06:55.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.410+0000 7fd75e65e640 1 -- 172.21.15.47:0/667242177 wait complete. 2024-07-24T22:06:55.421 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:55 smithi047 ceph-mon[32551]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-07-24T22:06:55.421 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:55 smithi047 ceph-mon[32551]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:55.423 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-07-24T22:06:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.528+0000 7f38c4308640 1 -- 172.21.15.47:0/1398220060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38bc103ef0 msgr2=0x7f38bc10c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.528+0000 7f38c4308640 1 --2- 172.21.15.47:0/1398220060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38bc103ef0 0x7f38bc10c3d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009900 tx=0x7f38b002a410 comp rx=0 tx=0).stop 2024-07-24T22:06:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.528+0000 7f38c4308640 1 -- 172.21.15.47:0/1398220060 shutdown_connections 2024-07-24T22:06:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.528+0000 7f38c4308640 1 --2- 172.21.15.47:0/1398220060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38bc10c9f0 0x7f38bc10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.528+0000 7f38c4308640 1 --2- 172.21.15.47:0/1398220060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38bc103ef0 0x7f38bc10c3d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.528+0000 7f38c4308640 1 --2- 172.21.15.47:0/1398220060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38bc1035d0 0x7f38bc1039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.528+0000 7f38c4308640 1 -- 172.21.15.47:0/1398220060 >> 172.21.15.47:0/1398220060 conn(0x7f38bc0782e0 msgr2=0x7f38bc0ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.528+0000 7f38c4308640 1 -- 172.21.15.47:0/1398220060 shutdown_connections 2024-07-24T22:06:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.528+0000 7f38c4308640 1 -- 172.21.15.47:0/1398220060 wait complete. 2024-07-24T22:06:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.528+0000 7f38c4308640 1 Processor -- start 2024-07-24T22:06:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.528+0000 7f38c4308640 1 -- start start 2024-07-24T22:06:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c4308640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38bc1035d0 0x7f38bc198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c4308640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38bc103ef0 0x7f38bc199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c4308640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38bc10c9f0 0x7f38bc19e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c4308640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc112670 con 0x7f38bc1035d0 2024-07-24T22:06:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c4308640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc1124f0 con 0x7f38bc103ef0 2024-07-24T22:06:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c4308640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc1127f0 con 0x7f38bc10c9f0 2024-07-24T22:06:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c20a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38bc1035d0 0x7f38bc198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c20a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38bc1035d0 0x7f38bc198c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32902/0 (socket says 172.21.15.47:32902) 2024-07-24T22:06:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c20a4640 1 -- 172.21.15.47:0/767476684 learned_addr learned my addr 172.21.15.47:0/767476684 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c18a3640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38bc103ef0 0x7f38bc199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c28a5640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38bc10c9f0 0x7f38bc19e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c20a4640 1 -- 172.21.15.47:0/767476684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38bc10c9f0 msgr2=0x7f38bc19e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c20a4640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38bc10c9f0 0x7f38bc19e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c20a4640 1 -- 172.21.15.47:0/767476684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38bc103ef0 msgr2=0x7f38bc199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c20a4640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38bc103ef0 0x7f38bc199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c20a4640 1 -- 172.21.15.47:0/767476684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38bc19ecd0 con 0x7f38bc1035d0 2024-07-24T22:06:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c20a4640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38bc1035d0 0x7f38bc198c30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00cce0 tx=0x7f38ac00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38bb7fe640 1 -- 172.21.15.47:0/767476684 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00f450 con 0x7f38bc1035d0 2024-07-24T22:06:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38bb7fe640 1 -- 172.21.15.47:0/767476684 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38ac00faa0 con 0x7f38bc1035d0 2024-07-24T22:06:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c4308640 1 -- 172.21.15.47:0/767476684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38bc19efc0 con 0x7f38bc1035d0 2024-07-24T22:06:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38bb7fe640 1 -- 172.21.15.47:0/767476684 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac018c00 con 0x7f38bc1035d0 2024-07-24T22:06:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.529+0000 7f38c4308640 1 -- 172.21.15.47:0/767476684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38bc1a5680 con 0x7f38bc1035d0 2024-07-24T22:06:55.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.531+0000 7f38c4308640 1 -- 172.21.15.47:0/767476684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38bc1039b0 con 0x7f38bc1035d0 2024-07-24T22:06:55.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.533+0000 7f38bb7fe640 1 -- 172.21.15.47:0/767476684 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 23) ==== 151076+0+0 (secure 0 0 0) 0x7f38ac00f5f0 con 0x7f38bc1035d0 2024-07-24T22:06:55.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.533+0000 7f38bb7fe640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f38a40b3c20 0x7f38a40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:55.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.534+0000 7f38c18a3640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f38a40b3c20 0x7f38a40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:55.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.534+0000 7f38bb7fe640 1 -- 172.21.15.47:0/767476684 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f38ac0e4500 con 0x7f38bc1035d0 2024-07-24T22:06:55.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.534+0000 7f38c18a3640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f38a40b3c20 0x7f38a40b60e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f38b0000c00 tx=0x7f38b0032c60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.536+0000 7f38bb7fe640 1 -- 172.21.15.47:0/767476684 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f38ac014030 con 0x7f38bc1035d0 2024-07-24T22:06:55.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:55 smithi188 ceph-mon[37380]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-07-24T22:06:55.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:55 smithi188 ceph-mon[37380]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:55.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:55 smithi183 ceph-mon[37007]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-07-24T22:06:55.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:55 smithi183 ceph-mon[37007]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:55.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.757+0000 7f38c4308640 1 -- 172.21.15.47:0/767476684 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f38bc062f80 con 0x7f38a40b3c20 2024-07-24T22:06:55.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.765+0000 7f38bb7fe640 1 -- 172.21.15.47:0/767476684 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f38bc062f80 con 0x7f38a40b3c20 2024-07-24T22:06:55.767 INFO:teuthology.orchestra.run.smithi047.stdout:/ 1m 6m3h 2024-07-24T22:06:55.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.767+0000 7f38c4308640 1 -- 172.21.15.47:0/767476684 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f38a40b3c20 msgr2=0x7f38a40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:55.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.767+0000 7f38c4308640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f38a40b3c20 0x7f38a40b60e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f38b0000c00 tx=0x7f38b0032c60 comp rx=0 tx=0).stop 2024-07-24T22:06:55.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.767+0000 7f38c4308640 1 -- 172.21.15.47:0/767476684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38bc1035d0 msgr2=0x7f38bc198c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:55.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.767+0000 7f38c4308640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38bc1035d0 0x7f38bc198c30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00cce0 tx=0x7f38ac00a620 comp rx=0 tx=0).stop 2024-07-24T22:06:55.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.767+0000 7f38c4308640 1 -- 172.21.15.47:0/767476684 shutdown_connections 2024-07-24T22:06:55.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.767+0000 7f38c4308640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f38a40b3c20 0x7f38a40b60e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.767+0000 7f38c4308640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38bc10c9f0 0x7f38bc19e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.767+0000 7f38c4308640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38bc103ef0 0x7f38bc199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.767+0000 7f38c4308640 1 --2- 172.21.15.47:0/767476684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38bc1035d0 0x7f38bc198c30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:55.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.767+0000 7f38c4308640 1 -- 172.21.15.47:0/767476684 >> 172.21.15.47:0/767476684 conn(0x7f38bc0782e0 msgr2=0x7f38bc0fdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:55.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.767+0000 7f38c4308640 1 -- 172.21.15.47:0/767476684 shutdown_connections 2024-07-24T22:06:55.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:55.767+0000 7f38c4308640 1 -- 172.21.15.47:0/767476684 wait complete. 2024-07-24T22:06:55.780 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-07-24T22:06:55.807 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-07-24T22:06:55.818 INFO:teuthology.run_tasks:Running task background_exec... 2024-07-24T22:06:55.862 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-07-24T22:06:55.862 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-07-24T22:06:55.864 INFO:teuthology.run_tasks:Running task quiescer... 2024-07-24T22:06:55.915 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-07-24T22:06:55.915 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph pg dump --format=json 2024-07-24T22:06:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.272+0000 7f30c2aba640 1 -- 172.21.15.47:0/1146512143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30bc103660 msgr2=0x7f30bc103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.272+0000 7f30c2aba640 1 --2- 172.21.15.47:0/1146512143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30bc103660 0x7f30bc103a40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009ca0 tx=0x7f30ac02a8f0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.272+0000 7f30c2aba640 1 -- 172.21.15.47:0/1146512143 shutdown_connections 2024-07-24T22:06:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.272+0000 7f30c2aba640 1 --2- 172.21.15.47:0/1146512143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30bc10cac0 0x7f30bc10ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.272+0000 7f30c2aba640 1 --2- 172.21.15.47:0/1146512143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30bc103f80 0x7f30bc10c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.272+0000 7f30c2aba640 1 --2- 172.21.15.47:0/1146512143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30bc103660 0x7f30bc103a40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.272+0000 7f30c2aba640 1 -- 172.21.15.47:0/1146512143 >> 172.21.15.47:0/1146512143 conn(0x7f30bc0fd0c0 msgr2=0x7f30bc0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.272+0000 7f30c2aba640 1 -- 172.21.15.47:0/1146512143 shutdown_connections 2024-07-24T22:06:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.272+0000 7f30c2aba640 1 -- 172.21.15.47:0/1146512143 wait complete. 2024-07-24T22:06:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.273+0000 7f30c2aba640 1 Processor -- start 2024-07-24T22:06:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.273+0000 7f30c2aba640 1 -- start start 2024-07-24T22:06:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.273+0000 7f30c2aba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30bc103660 0x7f30bc19b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.273+0000 7f30c2aba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30bc103f80 0x7f30bc19b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.273+0000 7f30c2aba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30bc10cac0 0x7f30bc1a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.273+0000 7f30c2aba640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc114a30 con 0x7f30bc103f80 2024-07-24T22:06:56.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.273+0000 7f30c2aba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc1148b0 con 0x7f30bc103660 2024-07-24T22:06:56.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.273+0000 7f30c2aba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc114bb0 con 0x7f30bc10cac0 2024-07-24T22:06:56.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.273+0000 7f30bbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30bc103f80 0x7f30bc19b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.273+0000 7f30bbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30bc103f80 0x7f30bc19b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32930/0 (socket says 172.21.15.47:32930) 2024-07-24T22:06:56.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.273+0000 7f30bbfff640 1 -- 172.21.15.47:0/3508040169 learned_addr learned my addr 172.21.15.47:0/3508040169 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:56.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.273+0000 7f30c0856640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30bc103660 0x7f30bc19b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.273+0000 7f30c1057640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30bc10cac0 0x7f30bc1a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.274+0000 7f30bbfff640 1 -- 172.21.15.47:0/3508040169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30bc10cac0 msgr2=0x7f30bc1a0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:56.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.274+0000 7f30bbfff640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30bc10cac0 0x7f30bc1a0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.274+0000 7f30bbfff640 1 -- 172.21.15.47:0/3508040169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30bc103660 msgr2=0x7f30bc19b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:56.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.274+0000 7f30bbfff640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30bc103660 0x7f30bc19b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.274+0000 7f30bbfff640 1 -- 172.21.15.47:0/3508040169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc1a10d0 con 0x7f30bc103f80 2024-07-24T22:06:56.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.274+0000 7f30c0856640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30bc103660 0x7f30bc19b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:06:56.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.274+0000 7f30bbfff640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30bc103f80 0x7f30bc19b560 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009fd0 tx=0x7f30b400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:56.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.274+0000 7f30b9ffb640 1 -- 172.21.15.47:0/3508040169 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b4015020 con 0x7f30bc103f80 2024-07-24T22:06:56.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.274+0000 7f30b9ffb640 1 -- 172.21.15.47:0/3508040169 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30b4011ce0 con 0x7f30bc103f80 2024-07-24T22:06:56.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.274+0000 7f30c2aba640 1 -- 172.21.15.47:0/3508040169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30bc1a13c0 con 0x7f30bc103f80 2024-07-24T22:06:56.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.274+0000 7f30b9ffb640 1 -- 172.21.15.47:0/3508040169 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b4010de0 con 0x7f30bc103f80 2024-07-24T22:06:56.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.274+0000 7f30c2aba640 1 -- 172.21.15.47:0/3508040169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30bc1a7c50 con 0x7f30bc103f80 2024-07-24T22:06:56.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.277+0000 7f30b9ffb640 1 -- 172.21.15.47:0/3508040169 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 24) ==== 151133+0+0 (secure 0 0 0) 0x7f30b4018020 con 0x7f30bc103f80 2024-07-24T22:06:56.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.277+0000 7f30c4e6b740 1 Processor -- start 2024-07-24T22:06:56.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.277+0000 7f30c4e6b740 1 -- start start 2024-07-24T22:06:56.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.277+0000 7f30c4e6b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c88093d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.277+0000 7f30c4e6b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093d850 0x55c8809492a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.277+0000 7f30c4e6b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8809497e0 0x55c88094bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.277+0000 7f30c4e6b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8808b49f0 con 0x55c88093cf30 2024-07-24T22:06:56.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.277+0000 7f30c4e6b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c8808a3ef0 con 0x55c8809497e0 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.277+0000 7f30c4e6b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c8808a7f30 con 0x55c88093d850 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.277+0000 7f30c1057640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c88093d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.277+0000 7f30c1057640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c88093d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32936/0 (socket says 172.21.15.47:32936) 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.277+0000 7f30c1057640 1 -- 172.21.15.47:0/1738422002 learned_addr learned my addr 172.21.15.47:0/1738422002 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30bbfff640 1 --2- 172.21.15.47:0/1738422002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8809497e0 0x55c88094bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30c0856640 1 --2- 172.21.15.47:0/1738422002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093d850 0x55c8809492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30b9ffb640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f30a80b3d30 0x7f30a80b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30c1057640 1 -- 172.21.15.47:0/1738422002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093d850 msgr2=0x55c8809492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30c1057640 1 --2- 172.21.15.47:0/1738422002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093d850 0x55c8809492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30c1057640 1 -- 172.21.15.47:0/1738422002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8809497e0 msgr2=0x55c88094bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30c1057640 1 --2- 172.21.15.47:0/1738422002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8809497e0 0x55c88094bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30c1057640 1 -- 172.21.15.47:0/1738422002 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c880604930 con 0x55c88093cf30 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30c0856640 1 --2- 172.21.15.47:0/1738422002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093d850 0x55c8809492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:06:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30bbfff640 1 --2- 172.21.15.47:0/1738422002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8809497e0 0x55c88094bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30b9ffb640 1 -- 172.21.15.47:0/3508040169 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f30b40e3610 con 0x7f30bc103f80 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30c1057640 1 --2- 172.21.15.47:0/1738422002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c88093d310 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f30a40099c0 tx=0x7f30a4009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c50f7ecde636b5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30c1057640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f30a80b3d30 0x7f30a80b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30b2ffd640 1 -- 172.21.15.47:0/1738422002 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4017070 con 0x55c88093cf30 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30b2ffd640 1 -- 172.21.15.47:0/1738422002 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30a400ec60 con 0x55c88093cf30 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.278+0000 7f30b2ffd640 1 -- 172.21.15.47:0/1738422002 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a401c860 con 0x55c88093cf30 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.279+0000 7f30c1057640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f30a80b3d30 0x7f30a80b61f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f30a4019000 tx=0x7f30a401cae0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.279+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1738422002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 msgr2=0x55c88093d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.279+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/1738422002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c88093d310 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f30a40099c0 tx=0x7f30a4009e80 comp rx=0 tx=0).stop 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.279+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1738422002 shutdown_connections 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.279+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/1738422002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8809497e0 0x55c88094bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.279+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/1738422002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093d850 0x55c8809492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.279+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/1738422002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c88093d310 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.279+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1738422002 >> 172.21.15.47:0/1738422002 conn(0x55c88093ad60 msgr2=0x55c88093bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.279+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1738422002 shutdown_connections 2024-07-24T22:06:56.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.279+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1738422002 wait complete. 2024-07-24T22:06:56.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.280+0000 7f30c4e6b740 1 -- start start 2024-07-24T22:06:56.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.280+0000 7f30c4e6b740 1 Processor -- start 2024-07-24T22:06:56.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.280+0000 7f30c4e6b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c8809467c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.280+0000 7f30c4e6b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880946d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.280+0000 7f30c4e6b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8809497e0 0x55c880947240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.280+0000 7f30c4e6b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c880707890 con 0x55c88093cf30 2024-07-24T22:06:56.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.280+0000 7f30c0856640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c8809467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.280+0000 7f30c0856640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c8809467c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32940/0 (socket says 172.21.15.47:32940) 2024-07-24T22:06:56.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.280+0000 7f30c0856640 1 -- 172.21.15.47:0/3720948902 learned_addr learned my addr 172.21.15.47:0/3720948902 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:56.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3720948902 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c880846390 con 0x55c88093d850 2024-07-24T22:06:56.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3720948902 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c88094c460 con 0x55c8809497e0 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f30c4e6b740 10 client.0 _ll_register_callbacks cb 0x55c880850500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f30c1057640 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8809497e0 0x55c880947240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f30bbfff640 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880946d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f30c1057640 1 -- 172.21.15.47:0/3720948902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 msgr2=0x55c880946d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f30c1057640 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880946d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f30c1057640 1 -- 172.21.15.47:0/3720948902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 msgr2=0x55c8809467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f30c1057640 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c8809467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f30c1057640 1 -- 172.21.15.47:0/3720948902 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c880840d60 con 0x55c8809497e0 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f30c0856640 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c8809467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f30c1057640 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8809497e0 0x55c880947240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f30a4006fd0 tx=0x7f30a4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=342f3cbcc1bcfe76 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f309bfff640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f309bfff640 1 -- 172.21.15.47:0/3720948902 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4009540 con 0x55c8809497e0 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.281+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3720948902 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30a400ec60 con 0x55c8809497e0 2024-07-24T22:06:56.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.282+0000 7f309bfff640 1 -- 172.21.15.47:0/3720948902 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f30a4013470 con 0x55c8809497e0 2024-07-24T22:06:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.282+0000 7f309bfff640 1 -- 172.21.15.47:0/3720948902 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f30a4013670 con 0x55c8809497e0 2024-07-24T22:06:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.282+0000 7f30c4e6b740 10 client.25000 fetch_fsmap learned FSMap version 20 2024-07-24T22:06:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.282+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3720948902 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c880960be0 con 0x55c8809497e0 2024-07-24T22:06:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.282+0000 7f309bfff640 1 -- 172.21.15.47:0/3720948902 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30a400ec60 con 0x55c8809497e0 2024-07-24T22:06:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.282+0000 7f309bfff640 1 -- 172.21.15.47:0/3720948902 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f30a403aac0 con 0x55c8809497e0 2024-07-24T22:06:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.282+0000 7f30c4e6b740 10 client.25000 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:06:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.282+0000 7f30c4e6b740 10 client.25000 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:06:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.282+0000 7f30c4e6b740 20 client.25000 populate_metadata read hostname 'smithi047' 2024-07-24T22:06:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.282+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c880961f90 0x55c880964380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.282+0000 7f30c4e6b740 4 client.25000 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:06:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.282+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3720948902 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8808b6940 con 0x55c880961f90 2024-07-24T22:06:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.282+0000 7f30c0856640 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c880961f90 0x55c880964380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.283+0000 7f30c0856640 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c880961f90 0x55c880964380 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d133c78ff8227ec server_cookie=b61b2f7d8d2bbac3 in_seq=0 out_seq=0 2024-07-24T22:06:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.283+0000 7f309bfff640 10 client.25000 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:06:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.283+0000 7f309bfff640 1 -- 172.21.15.47:0/3720948902 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8808b6940 con 0x55c880961f90 2024-07-24T22:06:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.283+0000 7f309bfff640 10 client.25000 handle_command_reply: tid=0 2024-07-24T22:06:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.284+0000 7f30c4e6b740 1 client.25000 shutdown 2024-07-24T22:06:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.284+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3720948902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8809497e0 msgr2=0x55c880947240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.284+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8809497e0 0x55c880947240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f30a4006fd0 tx=0x7f30a4017000 comp rx=0 tx=0).stop 2024-07-24T22:06:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.284+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3720948902 shutdown_connections 2024-07-24T22:06:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.284+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c880961f90 0x55c880964380 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.284+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8809497e0 0x55c880947240 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.284+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880946d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.284+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/3720948902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c8809467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.284+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3720948902 >> 172.21.15.47:0/3720948902 conn(0x55c88093ad60 msgr2=0x55c880940900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.284+0000 7f309bfff640 0 client.25000 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:06:56.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.284+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3720948902 shutdown_connections 2024-07-24T22:06:56.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.284+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3720948902 wait complete. 2024-07-24T22:06:56.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.284+0000 7f30c4e6b740 20 client.25000 trim_cache size 0 max 16384 2024-07-24T22:06:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.303+0000 7f30c4e6b740 1 Processor -- start 2024-07-24T22:06:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.303+0000 7f30c4e6b740 1 -- start start 2024-07-24T22:06:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.303+0000 7f30c4e6b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093ad60 0x55c880945cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.303+0000 7f30c4e6b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c8809699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.303+0000 7f30c4e6b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880969ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.303+0000 7f30c4e6b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc1aa090 con 0x55c88093cf30 2024-07-24T22:06:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.303+0000 7f30c4e6b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc1ac910 con 0x55c88093d850 2024-07-24T22:06:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.303+0000 7f30c4e6b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc1aa700 con 0x55c88093ad60 2024-07-24T22:06:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.304+0000 7f30bbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c8809699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.304+0000 7f30bbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c8809699b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32944/0 (socket says 172.21.15.47:32944) 2024-07-24T22:06:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.304+0000 7f30bbfff640 1 -- 172.21.15.47:0/3078059578 learned_addr learned my addr 172.21.15.47:0/3078059578 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.304+0000 7f30c1057640 1 --2- 172.21.15.47:0/3078059578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880969ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.304+0000 7f30c0856640 1 --2- 172.21.15.47:0/3078059578 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093ad60 0x55c880945cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.304+0000 7f30c1057640 1 -- 172.21.15.47:0/3078059578 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093ad60 msgr2=0x55c880945cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.304+0000 7f30c1057640 1 --2- 172.21.15.47:0/3078059578 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093ad60 0x55c880945cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.304+0000 7f30c1057640 1 -- 172.21.15.47:0/3078059578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 msgr2=0x55c8809699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.304+0000 7f30c1057640 1 --2- 172.21.15.47:0/3078059578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c8809699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.304+0000 7f30c1057640 1 -- 172.21.15.47:0/3078059578 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8809352a0 con 0x55c88093d850 2024-07-24T22:06:56.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.304+0000 7f30c0856640 1 --2- 172.21.15.47:0/3078059578 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093ad60 0x55c880945cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:06:56.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.304+0000 7f30bbfff640 1 --2- 172.21.15.47:0/3078059578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c8809699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:06:56.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.304+0000 7f30c1057640 1 --2- 172.21.15.47:0/3078059578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880969ef0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009910 tx=0x7f30a4009e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd640fe3f311135d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:56.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.305+0000 7f30b27fc640 1 -- 172.21.15.47:0/3078059578 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4009540 con 0x55c88093d850 2024-07-24T22:06:56.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.305+0000 7f30b27fc640 1 -- 172.21.15.47:0/3078059578 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30a403f070 con 0x55c88093d850 2024-07-24T22:06:56.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.305+0000 7f30b27fc640 1 -- 172.21.15.47:0/3078059578 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4031a90 con 0x55c88093d850 2024-07-24T22:06:56.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.306+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3078059578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 msgr2=0x55c880969ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:56.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.306+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/3078059578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880969ef0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009910 tx=0x7f30a4009e80 comp rx=0 tx=0).stop 2024-07-24T22:06:56.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.306+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3078059578 shutdown_connections 2024-07-24T22:06:56.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.306+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/3078059578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880969ef0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.306+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/3078059578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093cf30 0x55c8809699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.306+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/3078059578 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093ad60 0x55c880945cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.306+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3078059578 >> 172.21.15.47:0/3078059578 conn(0x55c880948a20 msgr2=0x55c880946fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:56.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.306+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3078059578 shutdown_connections 2024-07-24T22:06:56.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.306+0000 7f30c4e6b740 1 -- 172.21.15.47:0/3078059578 wait complete. 2024-07-24T22:06:56.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.306+0000 7f30c4e6b740 1 -- start start 2024-07-24T22:06:56.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.306+0000 7f30c4e6b740 1 Processor -- start 2024-07-24T22:06:56.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c4e6b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093ad60 0x55c88095a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c4e6b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093cf30 0x55c880955d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c0856640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093ad60 0x55c88095a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c0856640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093ad60 0x55c88095a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32952/0 (socket says 172.21.15.47:32952) 2024-07-24T22:06:56.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c0856640 1 -- 172.21.15.47:0/1367015244 learned_addr learned my addr 172.21.15.47:0/1367015244 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:56.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880956490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1367015244 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc1aadd0 con 0x55c88093ad60 2024-07-24T22:06:56.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1367015244 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc1ac240 con 0x55c88093d850 2024-07-24T22:06:56.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1367015244 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc1ab4a0 con 0x55c88093cf30 2024-07-24T22:06:56.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c4e6b740 10 client.0 _ll_register_callbacks cb 0x7f30a40046a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:06:56.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30bbfff640 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093cf30 0x55c880955d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c1057640 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880956490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c0856640 1 -- 172.21.15.47:0/1367015244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093cf30 msgr2=0x55c880955d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:56.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c0856640 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093cf30 0x55c880955d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c0856640 1 -- 172.21.15.47:0/1367015244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 msgr2=0x55c880956490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:06:56.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c0856640 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880956490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.307+0000 7f30c0856640 1 -- 172.21.15.47:0/1367015244 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8809cb980 con 0x55c88093ad60 2024-07-24T22:06:56.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.308+0000 7f30bbfff640 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093cf30 0x55c880955d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:06:56.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.308+0000 7f30c1057640 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880956490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:06:56.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.308+0000 7f30c0856640 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093ad60 0x55c88095a830 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f30ac033040 tx=0x7f30ac031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c29dd05f060a11 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:56.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.308+0000 7f309bfff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:06:56.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.308+0000 7f309bfff640 1 -- 172.21.15.47:0/1367015244 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac003970 con 0x55c88093ad60 2024-07-24T22:06:56.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.308+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1367015244 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30a403f070 con 0x55c88093ad60 2024-07-24T22:06:56.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.308+0000 7f309bfff640 1 -- 172.21.15.47:0/1367015244 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f30ac003b10 con 0x55c88093ad60 2024-07-24T22:06:56.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.308+0000 7f309bfff640 1 -- 172.21.15.47:0/1367015244 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f30ac003d10 con 0x55c88093ad60 2024-07-24T22:06:56.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.308+0000 7f30c4e6b740 10 client.15333 fetch_fsmap learned FSMap version 20 2024-07-24T22:06:56.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.308+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1367015244 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c8809ccc60 con 0x55c88093ad60 2024-07-24T22:06:56.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.308+0000 7f309bfff640 1 -- 172.21.15.47:0/1367015244 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30a403f070 con 0x55c88093ad60 2024-07-24T22:06:56.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.309+0000 7f309bfff640 1 -- 172.21.15.47:0/1367015244 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f30ac02f870 con 0x55c88093ad60 2024-07-24T22:06:56.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.309+0000 7f30c4e6b740 10 client.15333 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:06:56.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.309+0000 7f30c4e6b740 10 client.15333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:06:56.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.309+0000 7f30c4e6b740 20 client.15333 populate_metadata read hostname 'smithi047' 2024-07-24T22:06:56.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.309+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c8809497e0 0x55c8809cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:56.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.309+0000 7f30c4e6b740 4 client.15333 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:06:56.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.309+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1367015244 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c8808b23e0 con 0x55c8809497e0 2024-07-24T22:06:56.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.309+0000 7f30bbfff640 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c8809497e0 0x55c8809cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:56.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.310+0000 7f309bfff640 10 client.15333 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:06:56.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.310+0000 7f30bbfff640 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c8809497e0 0x55c8809cf450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f9b4570176c0cb0 server_cookie=c7925ef616eab24f in_seq=0 out_seq=0 2024-07-24T22:06:56.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.311+0000 7f309bfff640 1 -- 172.21.15.47:0/1367015244 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c8808b23e0 con 0x55c8809497e0 2024-07-24T22:06:56.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.311+0000 7f309bfff640 10 client.15333 handle_command_reply: tid=0 2024-07-24T22:06:56.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.311+0000 7f30c4e6b740 1 client.15333 shutdown 2024-07-24T22:06:56.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.311+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1367015244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093ad60 msgr2=0x55c88095a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:56.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.311+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093ad60 0x55c88095a830 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f30ac033040 tx=0x7f30ac031dc0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.311+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1367015244 shutdown_connections 2024-07-24T22:06:56.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.311+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c8809497e0 0x55c8809cf450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.311+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c88093d850 0x55c880956490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.311+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c88093cf30 0x55c880955d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.311+0000 7f30c4e6b740 1 --2- 172.21.15.47:0/1367015244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c88093ad60 0x55c88095a830 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.311+0000 7f309bfff640 0 client.15333 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:06:56.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.311+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1367015244 >> 172.21.15.47:0/1367015244 conn(0x55c880948a20 msgr2=0x55c88095ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:56.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.312+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1367015244 shutdown_connections 2024-07-24T22:06:56.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.312+0000 7f30c4e6b740 1 -- 172.21.15.47:0/1367015244 wait complete. 2024-07-24T22:06:56.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.312+0000 7f30c4e6b740 20 client.15333 trim_cache size 0 max 16384 2024-07-24T22:06:56.320 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:06:56.320 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:06:56.320 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "bc102dd6-17d4-46dd-95f9-bbea2067a549", 2024-07-24T22:06:56.320 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:06:56.320 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:06:56.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.313+0000 7f30c2aba640 1 -- 172.21.15.47:0/3508040169 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f30a80b3d30 msgr2=0x7f30a80b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:56.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.313+0000 7f30c2aba640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f30a80b3d30 0x7f30a80b61f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f30a4019000 tx=0x7f30a401cae0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.313+0000 7f30c2aba640 1 -- 172.21.15.47:0/3508040169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30bc103f80 msgr2=0x7f30bc19b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:56.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.313+0000 7f30c2aba640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30bc103f80 0x7f30bc19b560 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009fd0 tx=0x7f30b400b870 comp rx=0 tx=0).stop 2024-07-24T22:06:56.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.313+0000 7f30c2aba640 1 -- 172.21.15.47:0/3508040169 shutdown_connections 2024-07-24T22:06:56.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.313+0000 7f30c2aba640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f30a80b3d30 0x7f30a80b61f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.313+0000 7f30c2aba640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30bc10cac0 0x7f30bc1a0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.313+0000 7f30c2aba640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30bc103f80 0x7f30bc19b560 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.313+0000 7f30c2aba640 1 --2- 172.21.15.47:0/3508040169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30bc103660 0x7f30bc19b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:56.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.313+0000 7f30c2aba640 1 -- 172.21.15.47:0/3508040169 >> 172.21.15.47:0/3508040169 conn(0x7f30bc0fd0c0 msgr2=0x7f30bc0fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:56.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.313+0000 7f30c2aba640 1 -- 172.21.15.47:0/3508040169 shutdown_connections 2024-07-24T22:06:56.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:56.313+0000 7f30c2aba640 1 -- 172.21.15.47:0/3508040169 wait complete. 2024-07-24T22:06:56.534 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:56.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:56 smithi188 ceph-mon[37380]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:56.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:56 smithi188 ceph-mon[37380]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:56.657 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:56 smithi047 ceph-mon[32551]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:56.657 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:56 smithi047 ceph-mon[32551]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:56.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:56 smithi183 ceph-mon[37007]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:56.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:56 smithi183 ceph-mon[37007]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:57.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:57 smithi188 ceph-mon[37380]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:57.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:57 smithi188 ceph-mon[37380]: pgmap v358: 97 pgs: 97 active+clean; 1.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-07-24T22:06:57.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:57 smithi188 ceph-mon[37380]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-07-24T22:06:57.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:57 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:06:57.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:57 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:06:57.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:57 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:06:57.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:57 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:06:57.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:57 smithi183 ceph-mon[37007]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:57.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:57 smithi183 ceph-mon[37007]: pgmap v358: 97 pgs: 97 active+clean; 1.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-07-24T22:06:57.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:57 smithi183 ceph-mon[37007]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-07-24T22:06:57.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:57 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:06:57.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:57 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:06:57.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:57 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:06:57.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:57 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:06:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:57 smithi047 ceph-mon[32551]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:06:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:57 smithi047 ceph-mon[32551]: pgmap v358: 97 pgs: 97 active+clean; 1.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-07-24T22:06:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:57 smithi047 ceph-mon[32551]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-07-24T22:06:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:57 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:06:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:57 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:06:57.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:57 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:06:57.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:57 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:06:57.989 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:06:59.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.065+0000 7f158082f640 1 -- 172.21.15.47:0/780142053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157c103fc0 msgr2=0x7f157c10c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:59.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.065+0000 7f158082f640 1 --2- 172.21.15.47:0/780142053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157c103fc0 0x7f157c10c4b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1570009900 tx=0x7f157002a410 comp rx=0 tx=0).stop 2024-07-24T22:06:59.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.065+0000 7f158082f640 1 -- 172.21.15.47:0/780142053 shutdown_connections 2024-07-24T22:06:59.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.065+0000 7f158082f640 1 --2- 172.21.15.47:0/780142053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f157c10cb00 0x7f157c10ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:59.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.065+0000 7f158082f640 1 --2- 172.21.15.47:0/780142053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157c103fc0 0x7f157c10c4b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:59.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.065+0000 7f158082f640 1 --2- 172.21.15.47:0/780142053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f157c1036a0 0x7f157c103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:59.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.065+0000 7f158082f640 1 -- 172.21.15.47:0/780142053 >> 172.21.15.47:0/780142053 conn(0x7f157c0fd100 msgr2=0x7f157c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:59.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.065+0000 7f158082f640 1 -- 172.21.15.47:0/780142053 shutdown_connections 2024-07-24T22:06:59.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.065+0000 7f158082f640 1 -- 172.21.15.47:0/780142053 wait complete. 2024-07-24T22:06:59.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.066+0000 7f158082f640 1 Processor -- start 2024-07-24T22:06:59.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.066+0000 7f158082f640 1 -- start start 2024-07-24T22:06:59.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f158082f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f157c1036a0 0x7f157c198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f158082f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157c103fc0 0x7f157c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f158082f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f157c10cb00 0x7f157c19e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f158082f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f157c112830 con 0x7f157c103fc0 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f158082f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f157c1126b0 con 0x7f157c10cb00 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f158082f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f157c1129b0 con 0x7f157c1036a0 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f1579d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157c103fc0 0x7f157c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f1579d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157c103fc0 0x7f157c199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32984/0 (socket says 172.21.15.47:32984) 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f1579d9b640 1 -- 172.21.15.47:0/3936554135 learned_addr learned my addr 172.21.15.47:0/3936554135 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f157a59c640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f157c1036a0 0x7f157c198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f157ad9d640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f157c10cb00 0x7f157c19e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f1579d9b640 1 -- 172.21.15.47:0/3936554135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f157c1036a0 msgr2=0x7f157c198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f1579d9b640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f157c1036a0 0x7f157c198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f1579d9b640 1 -- 172.21.15.47:0/3936554135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f157c10cb00 msgr2=0x7f157c19e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f1579d9b640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f157c10cb00 0x7f157c19e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:59.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.067+0000 7f1579d9b640 1 -- 172.21.15.47:0/3936554135 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157c19ee90 con 0x7f157c103fc0 2024-07-24T22:06:59.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.068+0000 7f1579d9b640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157c103fc0 0x7f157c199320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1570004270 tx=0x7f15700042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:59.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.068+0000 7f156b7fe640 1 -- 172.21.15.47:0/3936554135 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157003f030 con 0x7f157c103fc0 2024-07-24T22:06:59.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.068+0000 7f156b7fe640 1 -- 172.21.15.47:0/3936554135 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15700044c0 con 0x7f157c103fc0 2024-07-24T22:06:59.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.068+0000 7f158082f640 1 -- 172.21.15.47:0/3936554135 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157c19f120 con 0x7f157c103fc0 2024-07-24T22:06:59.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.068+0000 7f156b7fe640 1 -- 172.21.15.47:0/3936554135 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570035070 con 0x7f157c103fc0 2024-07-24T22:06:59.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.068+0000 7f158082f640 1 -- 172.21.15.47:0/3936554135 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f157c1a5840 con 0x7f157c103fc0 2024-07-24T22:06:59.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.069+0000 7f158082f640 1 -- 172.21.15.47:0/3936554135 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f157c103b00 con 0x7f157c103fc0 2024-07-24T22:06:59.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.070+0000 7f156b7fe640 1 -- 172.21.15.47:0/3936554135 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 24) ==== 151133+0+0 (secure 0 0 0) 0x7f1570042030 con 0x7f157c103fc0 2024-07-24T22:06:59.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.071+0000 7f156b7fe640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15640b3cb0 0x7f15640b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:06:59.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.071+0000 7f157a59c640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15640b3cb0 0x7f15640b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:06:59.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.071+0000 7f156b7fe640 1 -- 172.21.15.47:0/3936554135 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f15701048f0 con 0x7f157c103fc0 2024-07-24T22:06:59.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.071+0000 7f157a59c640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15640b3cb0 0x7f15640b6170 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f156c00a400 tx=0x7f156c00d040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:06:59.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.074+0000 7f156b7fe640 1 -- 172.21.15.47:0/3936554135 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f15700cbc60 con 0x7f157c103fc0 2024-07-24T22:06:59.146 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:06:59.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.281+0000 7f158082f640 1 -- 172.21.15.47:0/3936554135 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f157c0ff420 con 0x7f15640b3cb0 2024-07-24T22:06:59.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.285+0000 7f156b7fe640 1 -- 172.21.15.47:0/3936554135 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258795 (secure 0 0 0) 0x7f157c0ff420 con 0x7f15640b3cb0 2024-07-24T22:06:59.290 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:06:59.291 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-07-24T22:06:59.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.288+0000 7f158082f640 1 -- 172.21.15.47:0/3936554135 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15640b3cb0 msgr2=0x7f15640b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:59.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.288+0000 7f158082f640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15640b3cb0 0x7f15640b6170 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f156c00a400 tx=0x7f156c00d040 comp rx=0 tx=0).stop 2024-07-24T22:06:59.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.288+0000 7f158082f640 1 -- 172.21.15.47:0/3936554135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157c103fc0 msgr2=0x7f157c199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:06:59.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.288+0000 7f158082f640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157c103fc0 0x7f157c199320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1570004270 tx=0x7f15700042a0 comp rx=0 tx=0).stop 2024-07-24T22:06:59.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.288+0000 7f158082f640 1 -- 172.21.15.47:0/3936554135 shutdown_connections 2024-07-24T22:06:59.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.288+0000 7f158082f640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15640b3cb0 0x7f15640b6170 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:59.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.288+0000 7f158082f640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f157c10cb00 0x7f157c19e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:59.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.288+0000 7f158082f640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157c103fc0 0x7f157c199320 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:59.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.288+0000 7f158082f640 1 --2- 172.21.15.47:0/3936554135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f157c1036a0 0x7f157c198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:06:59.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.288+0000 7f158082f640 1 -- 172.21.15.47:0/3936554135 >> 172.21.15.47:0/3936554135 conn(0x7f157c0fd100 msgr2=0x7f157c0fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:06:59.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.288+0000 7f158082f640 1 -- 172.21.15.47:0/3936554135 shutdown_connections 2024-07-24T22:06:59.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:06:59.288+0000 7f158082f640 1 -- 172.21.15.47:0/3936554135 wait complete. 2024-07-24T22:06:59.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:06:59 smithi047 ceph-mon[32551]: pgmap v359: 97 pgs: 97 active+clean; 1.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 62 KiB/s wr, 9 op/s 2024-07-24T22:06:59.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:06:59 smithi188 ceph-mon[37380]: pgmap v359: 97 pgs: 97 active+clean; 1.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 62 KiB/s wr, 9 op/s 2024-07-24T22:06:59.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:06:59 smithi183 ceph-mon[37007]: pgmap v359: 97 pgs: 97 active+clean; 1.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 62 KiB/s wr, 9 op/s 2024-07-24T22:07:00.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:00 smithi047 ceph-mon[32551]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:07:00.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:00 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:07:00.437 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:07:00 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T22:07:00.064+0000 7ff12ed11640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T22:07:00.437 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:07:00 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T22:07:00.064+0000 7ff12ed11640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T22:07:00.437 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:07:00 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T22:07:00.064+0000 7ff12ed11640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T22:07:00.437 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:07:00 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T22:07:00.064+0000 7ff12ed11640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T22:07:00.437 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:07:00 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T22:07:00.064+0000 7ff12ed11640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T22:07:00.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:00 smithi188 ceph-mon[37380]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:07:00.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:00 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:07:00.609 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2024-07-24T22:06:58.120154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1053441,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":455,"num_read_kb":334,"num_write":280,"num_write_kb":2989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952539,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388864,"kb_used_data":14588,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124552960,"statfs":{"total":1151940427776,"available":1151542231040,"internally_reserved":0,"allocated":14938112,"data_stored":9188683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":399457,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":40,"num_write":65,"num_write_kb":746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003002"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574007+0000","last_change":"2024-07-24T22:03:53.407929+0000","last_active":"2024-07-24T22:05:27.574007+0000","last_peered":"2024-07-24T22:05:27.574007+0000","last_clean":"2024-07-24T22:05:27.574007+0000","last_became_active":"2024-07-24T22:03:53.407508+0000","last_became_peered":"2024-07-24T22:03:53.407508+0000","last_unstale":"2024-07-24T22:05:27.574007+0000","last_undegraded":"2024-07-24T22:05:27.574007+0000","last_fullsized":"2024-07-24T22:05:27.574007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:00:35.699906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696531+0000","last_change":"2024-07-24T22:03:53.404867+0000","last_active":"2024-07-24T22:05:27.696531+0000","last_peered":"2024-07-24T22:05:27.696531+0000","last_clean":"2024-07-24T22:05:27.696531+0000","last_became_active":"2024-07-24T22:03:53.404309+0000","last_became_peered":"2024-07-24T22:03:53.404309+0000","last_unstale":"2024-07-24T22:05:27.696531+0000","last_undegraded":"2024-07-24T22:05:27.696531+0000","last_fullsized":"2024-07-24T22:05:27.696531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:21:51.238815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696402+0000","last_change":"2024-07-24T22:03:53.404368+0000","last_active":"2024-07-24T22:05:27.696402+0000","last_peered":"2024-07-24T22:05:27.696402+0000","last_clean":"2024-07-24T22:05:27.696402+0000","last_became_active":"2024-07-24T22:03:53.403941+0000","last_became_peered":"2024-07-24T22:03:53.403941+0000","last_unstale":"2024-07-24T22:05:27.696402+0000","last_undegraded":"2024-07-24T22:05:27.696402+0000","last_fullsized":"2024-07-24T22:05:27.696402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:10:09.884724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576551+0000","last_change":"2024-07-24T22:03:53.407661+0000","last_active":"2024-07-24T22:05:27.576551+0000","last_peered":"2024-07-24T22:05:27.576551+0000","last_clean":"2024-07-24T22:05:27.576551+0000","last_became_active":"2024-07-24T22:03:53.407375+0000","last_became_peered":"2024-07-24T22:03:53.407375+0000","last_unstale":"2024-07-24T22:05:27.576551+0000","last_undegraded":"2024-07-24T22:05:27.576551+0000","last_fullsized":"2024-07-24T22:05:27.576551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:34.000666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575974+0000","last_change":"2024-07-24T22:03:53.406227+0000","last_active":"2024-07-24T22:05:27.575974+0000","last_peered":"2024-07-24T22:05:27.575974+0000","last_clean":"2024-07-24T22:05:27.575974+0000","last_became_active":"2024-07-24T22:03:53.405819+0000","last_became_peered":"2024-07-24T22:03:53.405819+0000","last_unstale":"2024-07-24T22:05:27.575974+0000","last_undegraded":"2024-07-24T22:05:27.575974+0000","last_fullsized":"2024-07-24T22:05:27.575974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:59.022972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588837+0000","last_change":"2024-07-24T22:04:27.501754+0000","last_active":"2024-07-24T22:05:27.588837+0000","last_peered":"2024-07-24T22:05:27.588837+0000","last_clean":"2024-07-24T22:05:27.588837+0000","last_became_active":"2024-07-24T22:04:27.501340+0000","last_became_peered":"2024-07-24T22:04:27.501340+0000","last_unstale":"2024-07-24T22:05:27.588837+0000","last_undegraded":"2024-07-24T22:05:27.588837+0000","last_fullsized":"2024-07-24T22:05:27.588837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:38:04.880980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575969+0000","last_change":"2024-07-24T22:03:53.413012+0000","last_active":"2024-07-24T22:05:27.575969+0000","last_peered":"2024-07-24T22:05:27.575969+0000","last_clean":"2024-07-24T22:05:27.575969+0000","last_became_active":"2024-07-24T22:03:53.411791+0000","last_became_peered":"2024-07-24T22:03:53.411791+0000","last_unstale":"2024-07-24T22:05:27.575969+0000","last_undegraded":"2024-07-24T22:05:27.575969+0000","last_fullsized":"2024-07-24T22:05:27.575969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:15:02.939598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695762+0000","last_change":"2024-07-24T22:04:27.502867+0000","last_active":"2024-07-24T22:05:27.695762+0000","last_peered":"2024-07-24T22:05:27.695762+0000","last_clean":"2024-07-24T22:05:27.695762+0000","last_became_active":"2024-07-24T22:04:27.502515+0000","last_became_peered":"2024-07-24T22:04:27.502515+0000","last_unstale":"2024-07-24T22:05:27.695762+0000","last_undegraded":"2024-07-24T22:05:27.695762+0000","last_fullsized":"2024-07-24T22:05:27.695762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:58:39.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,10],"acting":[3,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572158+0000","last_change":"2024-07-24T22:03:53.413213+0000","last_active":"2024-07-24T22:05:27.572158+0000","last_peered":"2024-07-24T22:05:27.572158+0000","last_clean":"2024-07-24T22:05:27.572158+0000","last_became_active":"2024-07-24T22:03:53.412725+0000","last_became_peered":"2024-07-24T22:03:53.412725+0000","last_unstale":"2024-07-24T22:05:27.572158+0000","last_undegraded":"2024-07-24T22:05:27.572158+0000","last_fullsized":"2024-07-24T22:05:27.572158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:34:01.897965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589224+0000","last_change":"2024-07-24T22:03:53.401129+0000","last_active":"2024-07-24T22:05:27.589224+0000","last_peered":"2024-07-24T22:05:27.589224+0000","last_clean":"2024-07-24T22:05:27.589224+0000","last_became_active":"2024-07-24T22:03:53.400780+0000","last_became_peered":"2024-07-24T22:03:53.400780+0000","last_unstale":"2024-07-24T22:05:27.589224+0000","last_undegraded":"2024-07-24T22:05:27.589224+0000","last_fullsized":"2024-07-24T22:05:27.589224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:28:37.825021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576231+0000","last_change":"2024-07-24T22:03:53.406490+0000","last_active":"2024-07-24T22:05:27.576231+0000","last_peered":"2024-07-24T22:05:27.576231+0000","last_clean":"2024-07-24T22:05:27.576231+0000","last_became_active":"2024-07-24T22:03:53.406108+0000","last_became_peered":"2024-07-24T22:03:53.406108+0000","last_unstale":"2024-07-24T22:05:27.576231+0000","last_undegraded":"2024-07-24T22:05:27.576231+0000","last_fullsized":"2024-07-24T22:05:27.576231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:37.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695960+0000","last_change":"2024-07-24T22:04:27.503165+0000","last_active":"2024-07-24T22:05:27.695960+0000","last_peered":"2024-07-24T22:05:27.695960+0000","last_clean":"2024-07-24T22:05:27.695960+0000","last_became_active":"2024-07-24T22:04:27.502861+0000","last_became_peered":"2024-07-24T22:04:27.502861+0000","last_unstale":"2024-07-24T22:05:27.695960+0000","last_undegraded":"2024-07-24T22:05:27.695960+0000","last_fullsized":"2024-07-24T22:05:27.695960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:36:41.353268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571263+0000","last_change":"2024-07-24T22:03:53.392763+0000","last_active":"2024-07-24T22:05:27.571263+0000","last_peered":"2024-07-24T22:05:27.571263+0000","last_clean":"2024-07-24T22:05:27.571263+0000","last_became_active":"2024-07-24T22:03:53.392476+0000","last_became_peered":"2024-07-24T22:03:53.392476+0000","last_unstale":"2024-07-24T22:05:27.571263+0000","last_undegraded":"2024-07-24T22:05:27.571263+0000","last_fullsized":"2024-07-24T22:05:27.571263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:25:13.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696340+0000","last_change":"2024-07-24T22:03:53.406937+0000","last_active":"2024-07-24T22:05:27.696340+0000","last_peered":"2024-07-24T22:05:27.696340+0000","last_clean":"2024-07-24T22:05:27.696340+0000","last_became_active":"2024-07-24T22:03:53.406495+0000","last_became_peered":"2024-07-24T22:03:53.406495+0000","last_unstale":"2024-07-24T22:05:27.696340+0000","last_undegraded":"2024-07-24T22:05:27.696340+0000","last_fullsized":"2024-07-24T22:05:27.696340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:06:50.434751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695723+0000","last_change":"2024-07-24T22:03:53.401073+0000","last_active":"2024-07-24T22:05:27.695723+0000","last_peered":"2024-07-24T22:05:27.695723+0000","last_clean":"2024-07-24T22:05:27.695723+0000","last_became_active":"2024-07-24T22:03:53.399675+0000","last_became_peered":"2024-07-24T22:03:53.399675+0000","last_unstale":"2024-07-24T22:05:27.695723+0000","last_undegraded":"2024-07-24T22:05:27.695723+0000","last_fullsized":"2024-07-24T22:05:27.695723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:59:25.461178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571670+0000","last_change":"2024-07-24T22:03:53.408289+0000","last_active":"2024-07-24T22:05:27.571670+0000","last_peered":"2024-07-24T22:05:27.571670+0000","last_clean":"2024-07-24T22:05:27.571670+0000","last_became_active":"2024-07-24T22:03:53.407950+0000","last_became_peered":"2024-07-24T22:03:53.407950+0000","last_unstale":"2024-07-24T22:05:27.571670+0000","last_undegraded":"2024-07-24T22:05:27.571670+0000","last_fullsized":"2024-07-24T22:05:27.571670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:10:30.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574008+0000","last_change":"2024-07-24T22:03:53.409909+0000","last_active":"2024-07-24T22:05:27.574008+0000","last_peered":"2024-07-24T22:05:27.574008+0000","last_clean":"2024-07-24T22:05:27.574008+0000","last_became_active":"2024-07-24T22:03:53.409183+0000","last_became_peered":"2024-07-24T22:03:53.409183+0000","last_unstale":"2024-07-24T22:05:27.574008+0000","last_undegraded":"2024-07-24T22:05:27.574008+0000","last_fullsized":"2024-07-24T22:05:27.574008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:14:50.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695710+0000","last_change":"2024-07-24T22:03:53.401198+0000","last_active":"2024-07-24T22:05:27.695710+0000","last_peered":"2024-07-24T22:05:27.695710+0000","last_clean":"2024-07-24T22:05:27.695710+0000","last_became_active":"2024-07-24T22:03:53.400885+0000","last_became_peered":"2024-07-24T22:03:53.400885+0000","last_unstale":"2024-07-24T22:05:27.695710+0000","last_undegraded":"2024-07-24T22:05:27.695710+0000","last_fullsized":"2024-07-24T22:05:27.695710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:59:37.965714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696048+0000","last_change":"2024-07-24T22:03:53.406590+0000","last_active":"2024-07-24T22:05:27.696048+0000","last_peered":"2024-07-24T22:05:27.696048+0000","last_clean":"2024-07-24T22:05:27.696048+0000","last_became_active":"2024-07-24T22:03:53.406283+0000","last_became_peered":"2024-07-24T22:03:53.406283+0000","last_unstale":"2024-07-24T22:05:27.696048+0000","last_undegraded":"2024-07-24T22:05:27.696048+0000","last_fullsized":"2024-07-24T22:05:27.696048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:30.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573401+0000","last_change":"2024-07-24T22:03:53.408790+0000","last_active":"2024-07-24T22:05:27.573401+0000","last_peered":"2024-07-24T22:05:27.573401+0000","last_clean":"2024-07-24T22:05:27.573401+0000","last_became_active":"2024-07-24T22:03:53.408480+0000","last_became_peered":"2024-07-24T22:03:53.408480+0000","last_unstale":"2024-07-24T22:05:27.573401+0000","last_undegraded":"2024-07-24T22:05:27.573401+0000","last_fullsized":"2024-07-24T22:05:27.573401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:59.601606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571171+0000","last_change":"2024-07-24T22:03:53.407400+0000","last_active":"2024-07-24T22:05:27.571171+0000","last_peered":"2024-07-24T22:05:27.571171+0000","last_clean":"2024-07-24T22:05:27.571171+0000","last_became_active":"2024-07-24T22:03:53.407084+0000","last_became_peered":"2024-07-24T22:03:53.407084+0000","last_unstale":"2024-07-24T22:05:27.571171+0000","last_undegraded":"2024-07-24T22:05:27.571171+0000","last_fullsized":"2024-07-24T22:05:27.571171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:51:04.942504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571785+0000","last_change":"2024-07-24T22:03:53.407444+0000","last_active":"2024-07-24T22:05:27.571785+0000","last_peered":"2024-07-24T22:05:27.571785+0000","last_clean":"2024-07-24T22:05:27.571785+0000","last_became_active":"2024-07-24T22:03:53.407025+0000","last_became_peered":"2024-07-24T22:03:53.407025+0000","last_unstale":"2024-07-24T22:05:27.571785+0000","last_undegraded":"2024-07-24T22:05:27.571785+0000","last_fullsized":"2024-07-24T22:05:27.571785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:47:49.620354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696170+0000","last_change":"2024-07-24T22:03:53.406748+0000","last_active":"2024-07-24T22:05:27.696170+0000","last_peered":"2024-07-24T22:05:27.696170+0000","last_clean":"2024-07-24T22:05:27.696170+0000","last_became_active":"2024-07-24T22:03:53.406398+0000","last_became_peered":"2024-07-24T22:03:53.406398+0000","last_unstale":"2024-07-24T22:05:27.696170+0000","last_undegraded":"2024-07-24T22:05:27.696170+0000","last_fullsized":"2024-07-24T22:05:27.696170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:35:40.117375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574701+0000","last_change":"2024-07-24T22:03:53.402203+0000","last_active":"2024-07-24T22:05:27.574701+0000","last_peered":"2024-07-24T22:05:27.574701+0000","last_clean":"2024-07-24T22:05:27.574701+0000","last_became_active":"2024-07-24T22:03:53.401826+0000","last_became_peered":"2024-07-24T22:03:53.401826+0000","last_unstale":"2024-07-24T22:05:27.574701+0000","last_undegraded":"2024-07-24T22:05:27.574701+0000","last_fullsized":"2024-07-24T22:05:27.574701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:45.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696666+0000","last_change":"2024-07-24T22:03:53.408179+0000","last_active":"2024-07-24T22:05:27.696666+0000","last_peered":"2024-07-24T22:05:27.696666+0000","last_clean":"2024-07-24T22:05:27.696666+0000","last_became_active":"2024-07-24T22:03:53.407547+0000","last_became_peered":"2024-07-24T22:03:53.407547+0000","last_unstale":"2024-07-24T22:05:27.696666+0000","last_undegraded":"2024-07-24T22:05:27.696666+0000","last_fullsized":"2024-07-24T22:05:27.696666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:03:52.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696074+0000","last_change":"2024-07-24T22:03:53.408550+0000","last_active":"2024-07-24T22:05:27.696074+0000","last_peered":"2024-07-24T22:05:27.696074+0000","last_clean":"2024-07-24T22:05:27.696074+0000","last_became_active":"2024-07-24T22:03:53.408119+0000","last_became_peered":"2024-07-24T22:03:53.408119+0000","last_unstale":"2024-07-24T22:05:27.696074+0000","last_undegraded":"2024-07-24T22:05:27.696074+0000","last_fullsized":"2024-07-24T22:05:27.696074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:33:54.154606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573853+0000","last_change":"2024-07-24T22:03:53.412562+0000","last_active":"2024-07-24T22:05:27.573853+0000","last_peered":"2024-07-24T22:05:27.573853+0000","last_clean":"2024-07-24T22:05:27.573853+0000","last_became_active":"2024-07-24T22:03:53.412231+0000","last_became_peered":"2024-07-24T22:03:53.412231+0000","last_unstale":"2024-07-24T22:05:27.573853+0000","last_undegraded":"2024-07-24T22:05:27.573853+0000","last_fullsized":"2024-07-24T22:05:27.573853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:53:48.403662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571173+0000","last_change":"2024-07-24T22:03:53.398212+0000","last_active":"2024-07-24T22:05:27.571173+0000","last_peered":"2024-07-24T22:05:27.571173+0000","last_clean":"2024-07-24T22:05:27.571173+0000","last_became_active":"2024-07-24T22:03:53.397853+0000","last_became_peered":"2024-07-24T22:03:53.397853+0000","last_unstale":"2024-07-24T22:05:27.571173+0000","last_undegraded":"2024-07-24T22:05:27.571173+0000","last_fullsized":"2024-07-24T22:05:27.571173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:39:47.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696283+0000","last_change":"2024-07-24T22:03:53.397188+0000","last_active":"2024-07-24T22:05:27.696283+0000","last_peered":"2024-07-24T22:05:27.696283+0000","last_clean":"2024-07-24T22:05:27.696283+0000","last_became_active":"2024-07-24T22:03:53.396865+0000","last_became_peered":"2024-07-24T22:03:53.396865+0000","last_unstale":"2024-07-24T22:05:27.696283+0000","last_undegraded":"2024-07-24T22:05:27.696283+0000","last_fullsized":"2024-07-24T22:05:27.696283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:20:49.074330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695823+0000","last_change":"2024-07-24T22:03:53.406605+0000","last_active":"2024-07-24T22:05:27.695823+0000","last_peered":"2024-07-24T22:05:27.695823+0000","last_clean":"2024-07-24T22:05:27.695823+0000","last_became_active":"2024-07-24T22:03:53.406264+0000","last_became_peered":"2024-07-24T22:03:53.406264+0000","last_unstale":"2024-07-24T22:05:27.695823+0000","last_undegraded":"2024-07-24T22:05:27.695823+0000","last_fullsized":"2024-07-24T22:05:27.695823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:13:46.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696013+0000","last_change":"2024-07-24T22:03:53.400422+0000","last_active":"2024-07-24T22:05:27.696013+0000","last_peered":"2024-07-24T22:05:27.696013+0000","last_clean":"2024-07-24T22:05:27.696013+0000","last_became_active":"2024-07-24T22:03:53.400096+0000","last_became_peered":"2024-07-24T22:03:53.400096+0000","last_unstale":"2024-07-24T22:05:27.696013+0000","last_undegraded":"2024-07-24T22:05:27.696013+0000","last_fullsized":"2024-07-24T22:05:27.696013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:04:07.882659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573363+0000","last_change":"2024-07-24T22:03:53.413231+0000","last_active":"2024-07-24T22:05:27.573363+0000","last_peered":"2024-07-24T22:05:27.573363+0000","last_clean":"2024-07-24T22:05:27.573363+0000","last_became_active":"2024-07-24T22:03:53.412825+0000","last_became_peered":"2024-07-24T22:03:53.412825+0000","last_unstale":"2024-07-24T22:05:27.573363+0000","last_undegraded":"2024-07-24T22:05:27.573363+0000","last_fullsized":"2024-07-24T22:05:27.573363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:59:30.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575993+0000","last_change":"2024-07-24T22:03:53.409007+0000","last_active":"2024-07-24T22:05:27.575993+0000","last_peered":"2024-07-24T22:05:27.575993+0000","last_clean":"2024-07-24T22:05:27.575993+0000","last_became_active":"2024-07-24T22:03:53.408624+0000","last_became_peered":"2024-07-24T22:03:53.408624+0000","last_unstale":"2024-07-24T22:05:27.575993+0000","last_undegraded":"2024-07-24T22:05:27.575993+0000","last_fullsized":"2024-07-24T22:05:27.575993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:31:22.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575311+0000","last_change":"2024-07-24T22:03:50.388894+0000","last_active":"2024-07-24T22:05:27.575311+0000","last_peered":"2024-07-24T22:05:27.575311+0000","last_clean":"2024-07-24T22:05:27.575311+0000","last_became_active":"2024-07-24T22:03:50.388608+0000","last_became_peered":"2024-07-24T22:03:50.388608+0000","last_unstale":"2024-07-24T22:05:27.575311+0000","last_undegraded":"2024-07-24T22:05:27.575311+0000","last_fullsized":"2024-07-24T22:05:27.575311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:36:43.571415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575239+0000","last_change":"2024-07-24T22:03:53.397509+0000","last_active":"2024-07-24T22:05:27.575239+0000","last_peered":"2024-07-24T22:05:27.575239+0000","last_clean":"2024-07-24T22:05:27.575239+0000","last_became_active":"2024-07-24T22:03:53.397186+0000","last_became_peered":"2024-07-24T22:03:53.397186+0000","last_unstale":"2024-07-24T22:05:27.575239+0000","last_undegraded":"2024-07-24T22:05:27.575239+0000","last_fullsized":"2024-07-24T22:05:27.575239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:15:14.081853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588955+0000","last_change":"2024-07-24T22:03:50.383523+0000","last_active":"2024-07-24T22:05:27.588955+0000","last_peered":"2024-07-24T22:05:27.588955+0000","last_clean":"2024-07-24T22:05:27.588955+0000","last_became_active":"2024-07-24T22:03:50.383088+0000","last_became_peered":"2024-07-24T22:03:50.383088+0000","last_unstale":"2024-07-24T22:05:27.588955+0000","last_undegraded":"2024-07-24T22:05:27.588955+0000","last_fullsized":"2024-07-24T22:05:27.588955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:57:07.824581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570963+0000","last_change":"2024-07-24T22:03:50.383726+0000","last_active":"2024-07-24T22:05:27.570963+0000","last_peered":"2024-07-24T22:05:27.570963+0000","last_clean":"2024-07-24T22:05:27.570963+0000","last_became_active":"2024-07-24T22:03:50.383480+0000","last_became_peered":"2024-07-24T22:03:50.383480+0000","last_unstale":"2024-07-24T22:05:27.570963+0000","last_undegraded":"2024-07-24T22:05:27.570963+0000","last_fullsized":"2024-07-24T22:05:27.570963+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:05:05.093272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695819+0000","last_change":"2024-07-24T22:03:53.406223+0000","last_active":"2024-07-24T22:05:27.695819+0000","last_peered":"2024-07-24T22:05:27.695819+0000","last_clean":"2024-07-24T22:05:27.695819+0000","last_became_active":"2024-07-24T22:03:53.404642+0000","last_became_peered":"2024-07-24T22:03:53.404642+0000","last_unstale":"2024-07-24T22:05:27.695819+0000","last_undegraded":"2024-07-24T22:05:27.695819+0000","last_fullsized":"2024-07-24T22:05:27.695819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:00:51.849538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574889+0000","last_change":"2024-07-24T22:03:50.385780+0000","last_active":"2024-07-24T22:05:27.574889+0000","last_peered":"2024-07-24T22:05:27.574889+0000","last_clean":"2024-07-24T22:05:27.574889+0000","last_became_active":"2024-07-24T22:03:50.385488+0000","last_became_peered":"2024-07-24T22:03:50.385488+0000","last_unstale":"2024-07-24T22:05:27.574889+0000","last_undegraded":"2024-07-24T22:05:27.574889+0000","last_fullsized":"2024-07-24T22:05:27.574889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:47:35.908303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695950+0000","last_change":"2024-07-24T22:03:53.403103+0000","last_active":"2024-07-24T22:05:27.695950+0000","last_peered":"2024-07-24T22:05:27.695950+0000","last_clean":"2024-07-24T22:05:27.695950+0000","last_became_active":"2024-07-24T22:03:53.402810+0000","last_became_peered":"2024-07-24T22:03:53.402810+0000","last_unstale":"2024-07-24T22:05:27.695950+0000","last_undegraded":"2024-07-24T22:05:27.695950+0000","last_fullsized":"2024-07-24T22:05:27.695950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:15.798983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589069+0000","last_change":"2024-07-24T22:03:50.382383+0000","last_active":"2024-07-24T22:05:27.589069+0000","last_peered":"2024-07-24T22:05:27.589069+0000","last_clean":"2024-07-24T22:05:27.589069+0000","last_became_active":"2024-07-24T22:03:50.381629+0000","last_became_peered":"2024-07-24T22:03:50.381629+0000","last_unstale":"2024-07-24T22:05:27.589069+0000","last_undegraded":"2024-07-24T22:05:27.589069+0000","last_fullsized":"2024-07-24T22:05:27.589069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:17.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572154+0000","last_change":"2024-07-24T22:03:53.409587+0000","last_active":"2024-07-24T22:05:27.572154+0000","last_peered":"2024-07-24T22:05:27.572154+0000","last_clean":"2024-07-24T22:05:27.572154+0000","last_became_active":"2024-07-24T22:03:53.409240+0000","last_became_peered":"2024-07-24T22:03:53.409240+0000","last_unstale":"2024-07-24T22:05:27.572154+0000","last_undegraded":"2024-07-24T22:05:27.572154+0000","last_fullsized":"2024-07-24T22:05:27.572154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:37:18.654244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576466+0000","last_change":"2024-07-24T22:03:50.387933+0000","last_active":"2024-07-24T22:05:27.576466+0000","last_peered":"2024-07-24T22:05:27.576466+0000","last_clean":"2024-07-24T22:05:27.576466+0000","last_became_active":"2024-07-24T22:03:50.386985+0000","last_became_peered":"2024-07-24T22:03:50.386985+0000","last_unstale":"2024-07-24T22:05:27.576466+0000","last_undegraded":"2024-07-24T22:05:27.576466+0000","last_fullsized":"2024-07-24T22:05:27.576466+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:35:29.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696682+0000","last_change":"2024-07-24T22:03:53.404419+0000","last_active":"2024-07-24T22:05:27.696682+0000","last_peered":"2024-07-24T22:05:27.696682+0000","last_clean":"2024-07-24T22:05:27.696682+0000","last_became_active":"2024-07-24T22:03:53.402713+0000","last_became_peered":"2024-07-24T22:03:53.402713+0000","last_unstale":"2024-07-24T22:05:27.696682+0000","last_undegraded":"2024-07-24T22:05:27.696682+0000","last_fullsized":"2024-07-24T22:05:27.696682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:41.262686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575104+0000","last_change":"2024-07-24T22:03:50.511126+0000","last_active":"2024-07-24T22:05:27.575104+0000","last_peered":"2024-07-24T22:05:27.575104+0000","last_clean":"2024-07-24T22:05:27.575104+0000","last_became_active":"2024-07-24T22:03:50.510801+0000","last_became_peered":"2024-07-24T22:03:50.510801+0000","last_unstale":"2024-07-24T22:05:27.575104+0000","last_undegraded":"2024-07-24T22:05:27.575104+0000","last_fullsized":"2024-07-24T22:05:27.575104+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:59:37.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571928+0000","last_change":"2024-07-24T22:03:53.410202+0000","last_active":"2024-07-24T22:05:27.571928+0000","last_peered":"2024-07-24T22:05:27.571928+0000","last_clean":"2024-07-24T22:05:27.571928+0000","last_became_active":"2024-07-24T22:03:53.409884+0000","last_became_peered":"2024-07-24T22:03:53.409884+0000","last_unstale":"2024-07-24T22:05:27.571928+0000","last_undegraded":"2024-07-24T22:05:27.571928+0000","last_fullsized":"2024-07-24T22:05:27.571928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:54:02.603267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'33","reported_seq":414,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:06:55.727925+0000","last_change":"2024-07-24T22:03:50.386993+0000","last_active":"2024-07-24T22:06:55.727925+0000","last_peered":"2024-07-24T22:06:55.727925+0000","last_clean":"2024-07-24T22:06:55.727925+0000","last_became_active":"2024-07-24T22:03:50.386675+0000","last_became_peered":"2024-07-24T22:03:50.386675+0000","last_unstale":"2024-07-24T22:06:55.727925+0000","last_undegraded":"2024-07-24T22:06:55.727925+0000","last_fullsized":"2024-07-24T22:06:55.727925+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:20:58.384179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68265,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":349,"num_read_kb":241,"num_write":33,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576569+0000","last_change":"2024-07-24T22:03:53.413293+0000","last_active":"2024-07-24T22:05:27.576569+0000","last_peered":"2024-07-24T22:05:27.576569+0000","last_clean":"2024-07-24T22:05:27.576569+0000","last_became_active":"2024-07-24T22:03:53.412900+0000","last_became_peered":"2024-07-24T22:03:53.412900+0000","last_unstale":"2024-07-24T22:05:27.576569+0000","last_undegraded":"2024-07-24T22:05:27.576569+0000","last_fullsized":"2024-07-24T22:05:27.576569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:11:32.553108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696109+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.696109+0000","last_peered":"2024-07-24T22:05:27.696109+0000","last_clean":"2024-07-24T22:05:27.696109+0000","last_became_active":"2024-07-24T22:03:50.387059+0000","last_became_peered":"2024-07-24T22:03:50.387059+0000","last_unstale":"2024-07-24T22:05:27.696109+0000","last_undegraded":"2024-07-24T22:05:27.696109+0000","last_fullsized":"2024-07-24T22:05:27.696109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:40:06.887090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570910+0000","last_change":"2024-07-24T22:03:53.406808+0000","last_active":"2024-07-24T22:05:27.570910+0000","last_peered":"2024-07-24T22:05:27.570910+0000","last_clean":"2024-07-24T22:05:27.570910+0000","last_became_active":"2024-07-24T22:03:53.406487+0000","last_became_peered":"2024-07-24T22:03:53.406487+0000","last_unstale":"2024-07-24T22:05:27.570910+0000","last_undegraded":"2024-07-24T22:05:27.570910+0000","last_fullsized":"2024-07-24T22:05:27.570910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:44:57.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574923+0000","last_change":"2024-07-24T22:03:50.386881+0000","last_active":"2024-07-24T22:05:27.574923+0000","last_peered":"2024-07-24T22:05:27.574923+0000","last_clean":"2024-07-24T22:05:27.574923+0000","last_became_active":"2024-07-24T22:03:50.386564+0000","last_became_peered":"2024-07-24T22:03:50.386564+0000","last_unstale":"2024-07-24T22:05:27.574923+0000","last_undegraded":"2024-07-24T22:05:27.574923+0000","last_fullsized":"2024-07-24T22:05:27.574923+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:22:22.339854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576277+0000","last_change":"2024-07-24T22:03:53.403207+0000","last_active":"2024-07-24T22:05:27.576277+0000","last_peered":"2024-07-24T22:05:27.576277+0000","last_clean":"2024-07-24T22:05:27.576277+0000","last_became_active":"2024-07-24T22:03:53.402875+0000","last_became_peered":"2024-07-24T22:03:53.402875+0000","last_unstale":"2024-07-24T22:05:27.576277+0000","last_undegraded":"2024-07-24T22:05:27.576277+0000","last_fullsized":"2024-07-24T22:05:27.576277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:25:28.866228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575960+0000","last_change":"2024-07-24T22:03:50.386721+0000","last_active":"2024-07-24T22:05:27.575960+0000","last_peered":"2024-07-24T22:05:27.575960+0000","last_clean":"2024-07-24T22:05:27.575960+0000","last_became_active":"2024-07-24T22:03:50.385654+0000","last_became_peered":"2024-07-24T22:03:50.385654+0000","last_unstale":"2024-07-24T22:05:27.575960+0000","last_undegraded":"2024-07-24T22:05:27.575960+0000","last_fullsized":"2024-07-24T22:05:27.575960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:16:15.802744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575896+0000","last_change":"2024-07-24T22:03:53.405367+0000","last_active":"2024-07-24T22:05:27.575896+0000","last_peered":"2024-07-24T22:05:27.575896+0000","last_clean":"2024-07-24T22:05:27.575896+0000","last_became_active":"2024-07-24T22:03:53.404875+0000","last_became_peered":"2024-07-24T22:03:53.404875+0000","last_unstale":"2024-07-24T22:05:27.575896+0000","last_undegraded":"2024-07-24T22:05:27.575896+0000","last_fullsized":"2024-07-24T22:05:27.575896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:42.247052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575893+0000","last_change":"2024-07-24T22:04:27.574426+0000","last_active":"2024-07-24T22:05:27.575893+0000","last_peered":"2024-07-24T22:05:27.575893+0000","last_clean":"2024-07-24T22:05:27.575893+0000","last_became_active":"2024-07-24T22:04:27.568176+0000","last_became_peered":"2024-07-24T22:04:27.568176+0000","last_unstale":"2024-07-24T22:05:27.575893+0000","last_undegraded":"2024-07-24T22:05:27.575893+0000","last_fullsized":"2024-07-24T22:05:27.575893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:20:37.620669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574893+0000","last_change":"2024-07-24T22:03:53.405136+0000","last_active":"2024-07-24T22:05:27.574893+0000","last_peered":"2024-07-24T22:05:27.574893+0000","last_clean":"2024-07-24T22:05:27.574893+0000","last_became_active":"2024-07-24T22:03:53.404043+0000","last_became_peered":"2024-07-24T22:03:53.404043+0000","last_unstale":"2024-07-24T22:05:27.574893+0000","last_undegraded":"2024-07-24T22:05:27.574893+0000","last_fullsized":"2024-07-24T22:05:27.574893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:03:21.912335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576738+0000","last_change":"2024-07-24T22:03:50.382364+0000","last_active":"2024-07-24T22:05:27.576738+0000","last_peered":"2024-07-24T22:05:27.576738+0000","last_clean":"2024-07-24T22:05:27.576738+0000","last_became_active":"2024-07-24T22:03:50.382029+0000","last_became_peered":"2024-07-24T22:03:50.382029+0000","last_unstale":"2024-07-24T22:05:27.576738+0000","last_undegraded":"2024-07-24T22:05:27.576738+0000","last_fullsized":"2024-07-24T22:05:27.576738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:48:10.004826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573801+0000","last_change":"2024-07-24T22:03:53.413053+0000","last_active":"2024-07-24T22:05:27.573801+0000","last_peered":"2024-07-24T22:05:27.573801+0000","last_clean":"2024-07-24T22:05:27.573801+0000","last_became_active":"2024-07-24T22:03:53.412733+0000","last_became_peered":"2024-07-24T22:03:53.412733+0000","last_unstale":"2024-07-24T22:05:27.573801+0000","last_undegraded":"2024-07-24T22:05:27.573801+0000","last_fullsized":"2024-07-24T22:05:27.573801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:16.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571346+0000","last_change":"2024-07-24T22:03:50.387314+0000","last_active":"2024-07-24T22:05:27.571346+0000","last_peered":"2024-07-24T22:05:27.571346+0000","last_clean":"2024-07-24T22:05:27.571346+0000","last_became_active":"2024-07-24T22:03:50.386919+0000","last_became_peered":"2024-07-24T22:03:50.386919+0000","last_unstale":"2024-07-24T22:05:27.571346+0000","last_undegraded":"2024-07-24T22:05:27.571346+0000","last_fullsized":"2024-07-24T22:05:27.571346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:51:03.203285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576716+0000","last_change":"2024-07-24T22:03:53.411938+0000","last_active":"2024-07-24T22:05:27.576716+0000","last_peered":"2024-07-24T22:05:27.576716+0000","last_clean":"2024-07-24T22:05:27.576716+0000","last_became_active":"2024-07-24T22:03:53.411545+0000","last_became_peered":"2024-07-24T22:03:53.411545+0000","last_unstale":"2024-07-24T22:05:27.576716+0000","last_undegraded":"2024-07-24T22:05:27.576716+0000","last_fullsized":"2024-07-24T22:05:27.576716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:41:19.370886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'52","reported_seq":100,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:06:54.622464+0000","last_change":"2024-07-24T22:03:50.384400+0000","last_active":"2024-07-24T22:06:54.622464+0000","last_peered":"2024-07-24T22:06:54.622464+0000","last_clean":"2024-07-24T22:06:54.622464+0000","last_became_active":"2024-07-24T22:03:50.383945+0000","last_became_peered":"2024-07-24T22:03:50.383945+0000","last_unstale":"2024-07-24T22:06:54.622464+0000","last_undegraded":"2024-07-24T22:06:54.622464+0000","last_fullsized":"2024-07-24T22:06:54.622464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:16.035171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":63,"num_write_kb":739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576430+0000","last_change":"2024-07-24T22:04:27.507390+0000","last_active":"2024-07-24T22:05:27.576430+0000","last_peered":"2024-07-24T22:05:27.576430+0000","last_clean":"2024-07-24T22:05:27.576430+0000","last_became_active":"2024-07-24T22:04:27.504206+0000","last_became_peered":"2024-07-24T22:04:27.504206+0000","last_unstale":"2024-07-24T22:05:27.576430+0000","last_undegraded":"2024-07-24T22:05:27.576430+0000","last_fullsized":"2024-07-24T22:05:27.576430+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:55:21.559702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696182+0000","last_change":"2024-07-24T22:03:50.511075+0000","last_active":"2024-07-24T22:05:27.696182+0000","last_peered":"2024-07-24T22:05:27.696182+0000","last_clean":"2024-07-24T22:05:27.696182+0000","last_became_active":"2024-07-24T22:03:50.510244+0000","last_became_peered":"2024-07-24T22:03:50.510244+0000","last_unstale":"2024-07-24T22:05:27.696182+0000","last_undegraded":"2024-07-24T22:05:27.696182+0000","last_fullsized":"2024-07-24T22:05:27.696182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:54:03.068211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576340+0000","last_change":"2024-07-24T22:03:53.410865+0000","last_active":"2024-07-24T22:05:27.576340+0000","last_peered":"2024-07-24T22:05:27.576340+0000","last_clean":"2024-07-24T22:05:27.576340+0000","last_became_active":"2024-07-24T22:03:53.410255+0000","last_became_peered":"2024-07-24T22:03:53.410255+0000","last_unstale":"2024-07-24T22:05:27.576340+0000","last_undegraded":"2024-07-24T22:05:27.576340+0000","last_fullsized":"2024-07-24T22:05:27.576340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:15.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576134+0000","last_change":"2024-07-24T22:02:33.494929+0000","last_active":"2024-07-24T22:05:27.576134+0000","last_peered":"2024-07-24T22:05:27.576134+0000","last_clean":"2024-07-24T22:05:27.576134+0000","last_became_active":"2024-07-24T22:02:33.489241+0000","last_became_peered":"2024-07-24T22:02:33.489241+0000","last_unstale":"2024-07-24T22:05:27.576134+0000","last_undegraded":"2024-07-24T22:05:27.576134+0000","last_fullsized":"2024-07-24T22:05:27.576134+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_clean_scrub_stamp":"2024-07-24T21:59:32.406119+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:46.421413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576268+0000","last_change":"2024-07-24T22:03:50.385093+0000","last_active":"2024-07-24T22:05:27.576268+0000","last_peered":"2024-07-24T22:05:27.576268+0000","last_clean":"2024-07-24T22:05:27.576268+0000","last_became_active":"2024-07-24T22:03:50.384639+0000","last_became_peered":"2024-07-24T22:03:50.384639+0000","last_unstale":"2024-07-24T22:05:27.576268+0000","last_undegraded":"2024-07-24T22:05:27.576268+0000","last_fullsized":"2024-07-24T22:05:27.576268+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:06:10.402336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696068+0000","last_change":"2024-07-24T22:03:53.409627+0000","last_active":"2024-07-24T22:05:27.696068+0000","last_peered":"2024-07-24T22:05:27.696068+0000","last_clean":"2024-07-24T22:05:27.696068+0000","last_became_active":"2024-07-24T22:03:53.409295+0000","last_became_peered":"2024-07-24T22:03:53.409295+0000","last_unstale":"2024-07-24T22:05:27.696068+0000","last_undegraded":"2024-07-24T22:05:27.696068+0000","last_fullsized":"2024-07-24T22:05:27.696068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:23:39.670020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576402+0000","last_change":"2024-07-24T22:03:50.385772+0000","last_active":"2024-07-24T22:05:27.576402+0000","last_peered":"2024-07-24T22:05:27.576402+0000","last_clean":"2024-07-24T22:05:27.576402+0000","last_became_active":"2024-07-24T22:03:50.385421+0000","last_became_peered":"2024-07-24T22:03:50.385421+0000","last_unstale":"2024-07-24T22:05:27.576402+0000","last_undegraded":"2024-07-24T22:05:27.576402+0000","last_fullsized":"2024-07-24T22:05:27.576402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:58:57.227697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570892+0000","last_change":"2024-07-24T22:03:53.400558+0000","last_active":"2024-07-24T22:05:27.570892+0000","last_peered":"2024-07-24T22:05:27.570892+0000","last_clean":"2024-07-24T22:05:27.570892+0000","last_became_active":"2024-07-24T22:03:53.400131+0000","last_became_peered":"2024-07-24T22:03:53.400131+0000","last_unstale":"2024-07-24T22:05:27.570892+0000","last_undegraded":"2024-07-24T22:05:27.570892+0000","last_fullsized":"2024-07-24T22:05:27.570892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:57:57.586742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571018+0000","last_change":"2024-07-24T22:03:50.510189+0000","last_active":"2024-07-24T22:05:27.571018+0000","last_peered":"2024-07-24T22:05:27.571018+0000","last_clean":"2024-07-24T22:05:27.571018+0000","last_became_active":"2024-07-24T22:03:50.509857+0000","last_became_peered":"2024-07-24T22:03:50.509857+0000","last_unstale":"2024-07-24T22:05:27.571018+0000","last_undegraded":"2024-07-24T22:05:27.571018+0000","last_fullsized":"2024-07-24T22:05:27.571018+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:05:59.240650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574703+0000","last_change":"2024-07-24T22:04:27.505187+0000","last_active":"2024-07-24T22:05:27.574703+0000","last_peered":"2024-07-24T22:05:27.574703+0000","last_clean":"2024-07-24T22:05:27.574703+0000","last_became_active":"2024-07-24T22:04:27.504785+0000","last_became_peered":"2024-07-24T22:04:27.504785+0000","last_unstale":"2024-07-24T22:05:27.574703+0000","last_undegraded":"2024-07-24T22:05:27.574703+0000","last_fullsized":"2024-07-24T22:05:27.574703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:47:33.516835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576182+0000","last_change":"2024-07-24T22:05:27.575016+0000","last_active":"2024-07-24T22:05:27.576182+0000","last_peered":"2024-07-24T22:05:27.576182+0000","last_clean":"2024-07-24T22:05:27.576182+0000","last_became_active":"2024-07-24T22:05:27.574644+0000","last_became_peered":"2024-07-24T22:05:27.574644+0000","last_unstale":"2024-07-24T22:05:27.576182+0000","last_undegraded":"2024-07-24T22:05:27.576182+0000","last_fullsized":"2024-07-24T22:05:27.576182+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:11:37.759190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588938+0000","last_change":"2024-07-24T22:03:53.399369+0000","last_active":"2024-07-24T22:05:27.588938+0000","last_peered":"2024-07-24T22:05:27.588938+0000","last_clean":"2024-07-24T22:05:27.588938+0000","last_became_active":"2024-07-24T22:03:53.399001+0000","last_became_peered":"2024-07-24T22:03:53.399001+0000","last_unstale":"2024-07-24T22:05:27.588938+0000","last_undegraded":"2024-07-24T22:05:27.588938+0000","last_fullsized":"2024-07-24T22:05:27.588938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:26:46.531080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695870+0000","last_change":"2024-07-24T22:03:50.510889+0000","last_active":"2024-07-24T22:05:27.695870+0000","last_peered":"2024-07-24T22:05:27.695870+0000","last_clean":"2024-07-24T22:05:27.695870+0000","last_became_active":"2024-07-24T22:03:50.510366+0000","last_became_peered":"2024-07-24T22:03:50.510366+0000","last_unstale":"2024-07-24T22:05:27.695870+0000","last_undegraded":"2024-07-24T22:05:27.695870+0000","last_fullsized":"2024-07-24T22:05:27.695870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:47:54.838304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589019+0000","last_change":"2024-07-24T22:03:53.398987+0000","last_active":"2024-07-24T22:05:27.589019+0000","last_peered":"2024-07-24T22:05:27.589019+0000","last_clean":"2024-07-24T22:05:27.589019+0000","last_became_active":"2024-07-24T22:03:53.398604+0000","last_became_peered":"2024-07-24T22:03:53.398604+0000","last_unstale":"2024-07-24T22:05:27.589019+0000","last_undegraded":"2024-07-24T22:05:27.589019+0000","last_fullsized":"2024-07-24T22:05:27.589019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:28:41.684174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576685+0000","last_change":"2024-07-24T22:03:50.510623+0000","last_active":"2024-07-24T22:05:27.576685+0000","last_peered":"2024-07-24T22:05:27.576685+0000","last_clean":"2024-07-24T22:05:27.576685+0000","last_became_active":"2024-07-24T22:03:50.510204+0000","last_became_peered":"2024-07-24T22:03:50.510204+0000","last_unstale":"2024-07-24T22:05:27.576685+0000","last_undegraded":"2024-07-24T22:05:27.576685+0000","last_fullsized":"2024-07-24T22:05:27.576685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:06:40.838840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571179+0000","last_change":"2024-07-24T22:03:53.400289+0000","last_active":"2024-07-24T22:05:27.571179+0000","last_peered":"2024-07-24T22:05:27.571179+0000","last_clean":"2024-07-24T22:05:27.571179+0000","last_became_active":"2024-07-24T22:03:53.399939+0000","last_became_peered":"2024-07-24T22:03:53.399939+0000","last_unstale":"2024-07-24T22:05:27.571179+0000","last_undegraded":"2024-07-24T22:05:27.571179+0000","last_fullsized":"2024-07-24T22:05:27.571179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:29:26.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:06:04.017159+0000","last_change":"2024-07-24T22:03:50.382776+0000","last_active":"2024-07-24T22:06:04.017159+0000","last_peered":"2024-07-24T22:06:04.017159+0000","last_clean":"2024-07-24T22:06:04.017159+0000","last_became_active":"2024-07-24T22:03:50.382474+0000","last_became_peered":"2024-07-24T22:03:50.382474+0000","last_unstale":"2024-07-24T22:06:04.017159+0000","last_undegraded":"2024-07-24T22:06:04.017159+0000","last_fullsized":"2024-07-24T22:06:04.017159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:59:34.688895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696694+0000","last_change":"2024-07-24T22:03:53.407883+0000","last_active":"2024-07-24T22:05:27.696694+0000","last_peered":"2024-07-24T22:05:27.696694+0000","last_clean":"2024-07-24T22:05:27.696694+0000","last_became_active":"2024-07-24T22:03:53.407524+0000","last_became_peered":"2024-07-24T22:03:53.407524+0000","last_unstale":"2024-07-24T22:05:27.696694+0000","last_undegraded":"2024-07-24T22:05:27.696694+0000","last_fullsized":"2024-07-24T22:05:27.696694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:52:25.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576771+0000","last_change":"2024-07-24T22:03:50.388789+0000","last_active":"2024-07-24T22:05:27.576771+0000","last_peered":"2024-07-24T22:05:27.576771+0000","last_clean":"2024-07-24T22:05:27.576771+0000","last_became_active":"2024-07-24T22:03:50.385439+0000","last_became_peered":"2024-07-24T22:03:50.385439+0000","last_unstale":"2024-07-24T22:05:27.576771+0000","last_undegraded":"2024-07-24T22:05:27.576771+0000","last_fullsized":"2024-07-24T22:05:27.576771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:14:25.009588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696603+0000","last_change":"2024-07-24T22:04:27.503956+0000","last_active":"2024-07-24T22:05:27.696603+0000","last_peered":"2024-07-24T22:05:27.696603+0000","last_clean":"2024-07-24T22:05:27.696603+0000","last_became_active":"2024-07-24T22:04:27.503498+0000","last_became_peered":"2024-07-24T22:04:27.503498+0000","last_unstale":"2024-07-24T22:05:27.696603+0000","last_undegraded":"2024-07-24T22:05:27.696603+0000","last_fullsized":"2024-07-24T22:05:27.696603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:23:20.294458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571757+0000","last_change":"2024-07-24T22:03:50.510687+0000","last_active":"2024-07-24T22:05:27.571757+0000","last_peered":"2024-07-24T22:05:27.571757+0000","last_clean":"2024-07-24T22:05:27.571757+0000","last_became_active":"2024-07-24T22:03:50.510310+0000","last_became_peered":"2024-07-24T22:03:50.510310+0000","last_unstale":"2024-07-24T22:05:27.571757+0000","last_undegraded":"2024-07-24T22:05:27.571757+0000","last_fullsized":"2024-07-24T22:05:27.571757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:14:29.957324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576327+0000","last_change":"2024-07-24T22:03:53.412711+0000","last_active":"2024-07-24T22:05:27.576327+0000","last_peered":"2024-07-24T22:05:27.576327+0000","last_clean":"2024-07-24T22:05:27.576327+0000","last_became_active":"2024-07-24T22:03:53.412375+0000","last_became_peered":"2024-07-24T22:03:53.412375+0000","last_unstale":"2024-07-24T22:05:27.576327+0000","last_undegraded":"2024-07-24T22:05:27.576327+0000","last_fullsized":"2024-07-24T22:05:27.576327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:55:29.441385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696331+0000","last_change":"2024-07-24T22:03:50.383094+0000","last_active":"2024-07-24T22:05:27.696331+0000","last_peered":"2024-07-24T22:05:27.696331+0000","last_clean":"2024-07-24T22:05:27.696331+0000","last_became_active":"2024-07-24T22:03:50.382687+0000","last_became_peered":"2024-07-24T22:03:50.382687+0000","last_unstale":"2024-07-24T22:05:27.696331+0000","last_undegraded":"2024-07-24T22:05:27.696331+0000","last_fullsized":"2024-07-24T22:05:27.696331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:32:02.727855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573366+0000","last_change":"2024-07-24T22:03:53.403709+0000","last_active":"2024-07-24T22:05:27.573366+0000","last_peered":"2024-07-24T22:05:27.573366+0000","last_clean":"2024-07-24T22:05:27.573366+0000","last_became_active":"2024-07-24T22:03:53.403334+0000","last_became_peered":"2024-07-24T22:03:53.403334+0000","last_unstale":"2024-07-24T22:05:27.573366+0000","last_undegraded":"2024-07-24T22:05:27.573366+0000","last_fullsized":"2024-07-24T22:05:27.573366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:27:50.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695814+0000","last_change":"2024-07-24T22:03:50.385547+0000","last_active":"2024-07-24T22:05:27.695814+0000","last_peered":"2024-07-24T22:05:27.695814+0000","last_clean":"2024-07-24T22:05:27.695814+0000","last_became_active":"2024-07-24T22:03:50.385233+0000","last_became_peered":"2024-07-24T22:03:50.385233+0000","last_unstale":"2024-07-24T22:05:27.695814+0000","last_undegraded":"2024-07-24T22:05:27.695814+0000","last_fullsized":"2024-07-24T22:05:27.695814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:40:04.647242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696043+0000","last_change":"2024-07-24T22:03:53.402386+0000","last_active":"2024-07-24T22:05:27.696043+0000","last_peered":"2024-07-24T22:05:27.696043+0000","last_clean":"2024-07-24T22:05:27.696043+0000","last_became_active":"2024-07-24T22:03:53.399363+0000","last_became_peered":"2024-07-24T22:03:53.399363+0000","last_unstale":"2024-07-24T22:05:27.696043+0000","last_undegraded":"2024-07-24T22:05:27.696043+0000","last_fullsized":"2024-07-24T22:05:27.696043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:19:05.835280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576088+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.576088+0000","last_peered":"2024-07-24T22:05:27.576088+0000","last_clean":"2024-07-24T22:05:27.576088+0000","last_became_active":"2024-07-24T22:03:50.387097+0000","last_became_peered":"2024-07-24T22:03:50.387097+0000","last_unstale":"2024-07-24T22:05:27.576088+0000","last_undegraded":"2024-07-24T22:05:27.576088+0000","last_fullsized":"2024-07-24T22:05:27.576088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:11:23.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576510+0000","last_change":"2024-07-24T22:03:53.407386+0000","last_active":"2024-07-24T22:05:27.576510+0000","last_peered":"2024-07-24T22:05:27.576510+0000","last_clean":"2024-07-24T22:05:27.576510+0000","last_became_active":"2024-07-24T22:03:53.407059+0000","last_became_peered":"2024-07-24T22:03:53.407059+0000","last_unstale":"2024-07-24T22:05:27.576510+0000","last_undegraded":"2024-07-24T22:05:27.576510+0000","last_fullsized":"2024-07-24T22:05:27.576510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:12:38.508170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695772+0000","last_change":"2024-07-24T22:04:27.567714+0000","last_active":"2024-07-24T22:05:27.695772+0000","last_peered":"2024-07-24T22:05:27.695772+0000","last_clean":"2024-07-24T22:05:27.695772+0000","last_became_active":"2024-07-24T22:04:27.567492+0000","last_became_peered":"2024-07-24T22:04:27.567492+0000","last_unstale":"2024-07-24T22:05:27.695772+0000","last_undegraded":"2024-07-24T22:05:27.695772+0000","last_fullsized":"2024-07-24T22:05:27.695772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:00:13.705346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576278+0000","last_change":"2024-07-24T22:03:50.385538+0000","last_active":"2024-07-24T22:05:27.576278+0000","last_peered":"2024-07-24T22:05:27.576278+0000","last_clean":"2024-07-24T22:05:27.576278+0000","last_became_active":"2024-07-24T22:03:50.385191+0000","last_became_peered":"2024-07-24T22:03:50.385191+0000","last_unstale":"2024-07-24T22:05:27.576278+0000","last_undegraded":"2024-07-24T22:05:27.576278+0000","last_fullsized":"2024-07-24T22:05:27.576278+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:33:37.674903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571800+0000","last_change":"2024-07-24T22:03:53.411751+0000","last_active":"2024-07-24T22:05:27.571800+0000","last_peered":"2024-07-24T22:05:27.571800+0000","last_clean":"2024-07-24T22:05:27.571800+0000","last_became_active":"2024-07-24T22:03:53.410827+0000","last_became_peered":"2024-07-24T22:03:53.410827+0000","last_unstale":"2024-07-24T22:05:27.571800+0000","last_undegraded":"2024-07-24T22:05:27.571800+0000","last_fullsized":"2024-07-24T22:05:27.571800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:07:26.439047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.584159+0000","last_change":"2024-07-24T22:05:27.581982+0000","last_active":"2024-07-24T22:05:27.584159+0000","last_peered":"2024-07-24T22:05:27.584159+0000","last_clean":"2024-07-24T22:05:27.584159+0000","last_became_active":"2024-07-24T22:05:27.577413+0000","last_became_peered":"2024-07-24T22:05:27.577413+0000","last_unstale":"2024-07-24T22:05:27.584159+0000","last_undegraded":"2024-07-24T22:05:27.584159+0000","last_fullsized":"2024-07-24T22:05:27.584159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:40:27.424379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696604+0000","last_change":"2024-07-24T22:03:53.406029+0000","last_active":"2024-07-24T22:05:27.696604+0000","last_peered":"2024-07-24T22:05:27.696604+0000","last_clean":"2024-07-24T22:05:27.696604+0000","last_became_active":"2024-07-24T22:03:53.405529+0000","last_became_peered":"2024-07-24T22:03:53.405529+0000","last_unstale":"2024-07-24T22:05:27.696604+0000","last_undegraded":"2024-07-24T22:05:27.696604+0000","last_fullsized":"2024-07-24T22:05:27.696604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:57:02.290836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696580+0000","last_change":"2024-07-24T22:03:50.510884+0000","last_active":"2024-07-24T22:05:27.696580+0000","last_peered":"2024-07-24T22:05:27.696580+0000","last_clean":"2024-07-24T22:05:27.696580+0000","last_became_active":"2024-07-24T22:03:50.509851+0000","last_became_peered":"2024-07-24T22:03:50.509851+0000","last_unstale":"2024-07-24T22:05:27.696580+0000","last_undegraded":"2024-07-24T22:05:27.696580+0000","last_fullsized":"2024-07-24T22:05:27.696580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:37:55.735488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696364+0000","last_change":"2024-07-24T22:03:53.409966+0000","last_active":"2024-07-24T22:05:27.696364+0000","last_peered":"2024-07-24T22:05:27.696364+0000","last_clean":"2024-07-24T22:05:27.696364+0000","last_became_active":"2024-07-24T22:03:53.409652+0000","last_became_peered":"2024-07-24T22:03:53.409652+0000","last_unstale":"2024-07-24T22:05:27.696364+0000","last_undegraded":"2024-07-24T22:05:27.696364+0000","last_fullsized":"2024-07-24T22:05:27.696364+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:10:53.262459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696523+0000","last_change":"2024-07-24T22:04:27.571166+0000","last_active":"2024-07-24T22:05:27.696523+0000","last_peered":"2024-07-24T22:05:27.696523+0000","last_clean":"2024-07-24T22:05:27.696523+0000","last_became_active":"2024-07-24T22:04:27.567419+0000","last_became_peered":"2024-07-24T22:04:27.567419+0000","last_unstale":"2024-07-24T22:05:27.696523+0000","last_undegraded":"2024-07-24T22:05:27.696523+0000","last_fullsized":"2024-07-24T22:05:27.696523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:37:11.513631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":462839,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":374,"num_read_kb":265,"num_write":155,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2273280,"data_stored":2174949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612661,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":937984,"data_stored":469642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808887,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29052,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716100,"statfs":{"total":95995035648,"available":95965286400,"internally_reserved":0,"allocated":2023424,"data_stored":1522362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972413,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40428,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704724,"statfs":{"total":95995035648,"available":95953637376,"internally_reserved":0,"allocated":946176,"data_stored":470341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168643,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36640,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708512,"statfs":{"total":95995035648,"available":95957516288,"internally_reserved":0,"allocated":1335296,"data_stored":862880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397573,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1540096,"data_stored":1060709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561099,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":469759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757327,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1548288,"data_stored":1060309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920851,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117080,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41256,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703896,"statfs":{"total":95995035648,"available":95952789504,"internally_reserved":0,"allocated":1740800,"data_stored":1256855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378717,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":537941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542241,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":538489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705764,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":68847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":68299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":798720,"data_stored":787096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":462235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T22:07:00.613 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph pg dump --format=json 2024-07-24T22:07:00.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:00 smithi183 ceph-mon[37007]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:07:00.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:00 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:07:01.069 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:01.541 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:01 smithi047 ceph-mon[32551]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 48 op/s 2024-07-24T22:07:01.541 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:01 smithi047 ceph-mon[32551]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-07-24T22:07:01.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.544+0000 7f813dc9d640 1 -- 172.21.15.47:0/2062613249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f813810cac0 msgr2=0x7f813810ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:01.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.544+0000 7f813dc9d640 1 --2- 172.21.15.47:0/2062613249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f813810cac0 0x7f813810ef20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8130009ca0 tx=0x7f813002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.544+0000 7f813dc9d640 1 -- 172.21.15.47:0/2062613249 shutdown_connections 2024-07-24T22:07:01.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.544+0000 7f813dc9d640 1 --2- 172.21.15.47:0/2062613249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f813810cac0 0x7f813810ef20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.544+0000 7f813dc9d640 1 --2- 172.21.15.47:0/2062613249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8138103f80 0x7f813810c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.544+0000 7f813dc9d640 1 --2- 172.21.15.47:0/2062613249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8138103660 0x7f8138103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.544+0000 7f813dc9d640 1 -- 172.21.15.47:0/2062613249 >> 172.21.15.47:0/2062613249 conn(0x7f81380fd0c0 msgr2=0x7f81380ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:01.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.544+0000 7f813dc9d640 1 -- 172.21.15.47:0/2062613249 shutdown_connections 2024-07-24T22:07:01.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.544+0000 7f813dc9d640 1 -- 172.21.15.47:0/2062613249 wait complete. 2024-07-24T22:07:01.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.544+0000 7f813dc9d640 1 Processor -- start 2024-07-24T22:07:01.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f813dc9d640 1 -- start start 2024-07-24T22:07:01.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f813dc9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8138103660 0x7f8138198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f813dc9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8138103f80 0x7f8138199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f813dc9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f813810cac0 0x7f813819e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f813dc9d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8138112770 con 0x7f8138103660 2024-07-24T22:07:01.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f813dc9d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f81381125f0 con 0x7f813810cac0 2024-07-24T22:07:01.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f813dc9d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f81381128f0 con 0x7f8138103f80 2024-07-24T22:07:01.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f81377fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8138103660 0x7f8138198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f81377fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8138103660 0x7f8138198c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33018/0 (socket says 172.21.15.47:33018) 2024-07-24T22:07:01.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f81377fe640 1 -- 172.21.15.47:0/564210008 learned_addr learned my addr 172.21.15.47:0/564210008 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:01.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f8136ffd640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8138103f80 0x7f8138199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f8137fff640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f813810cac0 0x7f813819e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f81377fe640 1 -- 172.21.15.47:0/564210008 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8138103f80 msgr2=0x7f8138199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:01.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.545+0000 7f81377fe640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8138103f80 0x7f8138199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.546+0000 7f81377fe640 1 -- 172.21.15.47:0/564210008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f813810cac0 msgr2=0x7f813819e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:01.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.546+0000 7f81377fe640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f813810cac0 0x7f813819e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.546+0000 7f81377fe640 1 -- 172.21.15.47:0/564210008 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813819ecb0 con 0x7f8138103660 2024-07-24T22:07:01.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.546+0000 7f81377fe640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8138103660 0x7f8138198c00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f812800d770 tx=0x7f812800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:01.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.546+0000 7f8134ff9640 1 -- 172.21.15.47:0/564210008 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128017070 con 0x7f8138103660 2024-07-24T22:07:01.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.546+0000 7f8134ff9640 1 -- 172.21.15.47:0/564210008 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81280054d0 con 0x7f8138103660 2024-07-24T22:07:01.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.546+0000 7f8134ff9640 1 -- 172.21.15.47:0/564210008 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128004c30 con 0x7f8138103660 2024-07-24T22:07:01.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.546+0000 7f813dc9d640 1 -- 172.21.15.47:0/564210008 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813819efa0 con 0x7f8138103660 2024-07-24T22:07:01.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.546+0000 7f813dc9d640 1 -- 172.21.15.47:0/564210008 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81381011f0 con 0x7f8138103660 2024-07-24T22:07:01.552 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:01 smithi188 ceph-mon[37380]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 48 op/s 2024-07-24T22:07:01.552 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:01 smithi188 ceph-mon[37380]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-07-24T22:07:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.548+0000 7f8134ff9640 1 -- 172.21.15.47:0/564210008 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8128004e10 con 0x7f8138103660 2024-07-24T22:07:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f814004e740 1 Processor -- start 2024-07-24T22:07:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f814004e740 1 -- start start 2024-07-24T22:07:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f814004e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 0x564f8d370a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f814004e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d370fa0 0x564f8d37c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f814004e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d37cf30 0x564f8d37f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f814004e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564f8d2e7960 con 0x564f8d370fa0 2024-07-24T22:07:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f814004e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564f8d2d6e60 con 0x564f8d37cf30 2024-07-24T22:07:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f814004e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564f8d2daea0 con 0x564f8d370680 2024-07-24T22:07:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f81377fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d370fa0 0x564f8d37c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f81377fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d370fa0 0x564f8d37c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33034/0 (socket says 172.21.15.47:33034) 2024-07-24T22:07:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f81377fe640 1 -- 172.21.15.47:0/4122526704 learned_addr learned my addr 172.21.15.47:0/4122526704 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f8136ffd640 1 --2- 172.21.15.47:0/4122526704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d37cf30 0x564f8d37f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f8137fff640 1 --2- 172.21.15.47:0/4122526704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 0x564f8d370a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.549+0000 7f8134ff9640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81200b3d40 0x7f81200b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.550+0000 7f8137fff640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81200b3d40 0x7f81200b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.550+0000 7f8134ff9640 1 -- 172.21.15.47:0/564210008 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f81280e3ad0 con 0x7f8138103660 2024-07-24T22:07:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.550+0000 7f8136ffd640 1 -- 172.21.15.47:0/4122526704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 msgr2=0x564f8d370a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.550+0000 7f8136ffd640 1 --2- 172.21.15.47:0/4122526704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 0x564f8d370a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.550+0000 7f8136ffd640 1 -- 172.21.15.47:0/4122526704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d370fa0 msgr2=0x564f8d37c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:01.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.550+0000 7f8136ffd640 1 --2- 172.21.15.47:0/4122526704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d370fa0 0x564f8d37c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.550+0000 7f8136ffd640 1 -- 172.21.15.47:0/4122526704 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f8d2602d0 con 0x564f8d37cf30 2024-07-24T22:07:01.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.550+0000 7f81377fe640 1 --2- 172.21.15.47:0/4122526704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d370fa0 0x564f8d37c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:07:01.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.550+0000 7f8136ffd640 1 --2- 172.21.15.47:0/4122526704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d37cf30 0x564f8d37f320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f813806b310 tx=0x7f812c00f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1572a864df50b3d9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:01.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.550+0000 7f8137fff640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81200b3d40 0x7f81200b6200 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8130006010 tx=0x7f813002a8c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:01.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.550+0000 7f811dffb640 1 -- 172.21.15.47:0/4122526704 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c005220 con 0x564f8d37cf30 2024-07-24T22:07:01.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.550+0000 7f811dffb640 1 -- 172.21.15.47:0/4122526704 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f812c00fe60 con 0x564f8d37cf30 2024-07-24T22:07:01.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.550+0000 7f811dffb640 1 -- 172.21.15.47:0/4122526704 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c0186a0 con 0x564f8d37cf30 2024-07-24T22:07:01.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.551+0000 7f814004e740 1 -- 172.21.15.47:0/4122526704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d37cf30 msgr2=0x564f8d37f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:01.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.551+0000 7f814004e740 1 --2- 172.21.15.47:0/4122526704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d37cf30 0x564f8d37f320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f813806b310 tx=0x7f812c00f3c0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.551+0000 7f814004e740 1 -- 172.21.15.47:0/4122526704 shutdown_connections 2024-07-24T22:07:01.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.551+0000 7f814004e740 1 --2- 172.21.15.47:0/4122526704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d37cf30 0x564f8d37f320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.551+0000 7f814004e740 1 --2- 172.21.15.47:0/4122526704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d370fa0 0x564f8d37c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.551+0000 7f814004e740 1 --2- 172.21.15.47:0/4122526704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 0x564f8d370a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.551+0000 7f814004e740 1 -- 172.21.15.47:0/4122526704 >> 172.21.15.47:0/4122526704 conn(0x564f8d36e4b0 msgr2=0x564f8d36f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:01.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.551+0000 7f814004e740 1 -- 172.21.15.47:0/4122526704 shutdown_connections 2024-07-24T22:07:01.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.551+0000 7f814004e740 1 -- 172.21.15.47:0/4122526704 wait complete. 2024-07-24T22:07:01.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.551+0000 7f814004e740 1 -- start start 2024-07-24T22:07:01.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f814004e740 1 Processor -- start 2024-07-24T22:07:01.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f814004e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370680 0x564f8d37c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f814004e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370fa0 0x564f8d379db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f814004e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d37a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f814004e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564f8d13a700 con 0x564f8d37cf30 2024-07-24T22:07:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f814004e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564f8d2795a0 con 0x564f8d370680 2024-07-24T22:07:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f814004e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564f8d37fbb0 con 0x564f8d370fa0 2024-07-24T22:07:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f814004e740 10 client.0 _ll_register_callbacks cb 0x564f8d299910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f8137fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d37a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f8137fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d37a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33044/0 (socket says 172.21.15.47:33044) 2024-07-24T22:07:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f8137fff640 1 -- 172.21.15.47:0/834739358 learned_addr learned my addr 172.21.15.47:0/834739358 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f8136ffd640 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370fa0 0x564f8d379db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f81377fe640 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370680 0x564f8d37c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f8136ffd640 1 -- 172.21.15.47:0/834739358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370680 msgr2=0x564f8d37c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f8136ffd640 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370680 0x564f8d37c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f8136ffd640 1 -- 172.21.15.47:0/834739358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 msgr2=0x564f8d37a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f8136ffd640 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d37a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f8136ffd640 1 -- 172.21.15.47:0/834739358 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f8d26c630 con 0x564f8d370fa0 2024-07-24T22:07:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.552+0000 7f8137fff640 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d37a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:07:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.553+0000 7f8136ffd640 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370fa0 0x564f8d379db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f812c000c00 tx=0x7f812c00a870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=760d392764137d41 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.553+0000 7f8116ffd640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:07:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.553+0000 7f8116ffd640 1 -- 172.21.15.47:0/834739358 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c027020 con 0x564f8d370fa0 2024-07-24T22:07:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.553+0000 7f8116ffd640 1 -- 172.21.15.47:0/834739358 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f812c005390 con 0x564f8d370fa0 2024-07-24T22:07:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.553+0000 7f814004e740 1 -- 172.21.15.47:0/834739358 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f812c00fe60 con 0x564f8d370fa0 2024-07-24T22:07:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.553+0000 7f8116ffd640 1 -- 172.21.15.47:0/834739358 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f812c032050 con 0x564f8d370fa0 2024-07-24T22:07:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.553+0000 7f814004e740 10 client.25021 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.553+0000 7f814004e740 1 -- 172.21.15.47:0/834739358 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564f8d037650 con 0x564f8d370fa0 2024-07-24T22:07:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.553+0000 7f8116ffd640 1 -- 172.21.15.47:0/834739358 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f812c00fe60 con 0x564f8d370fa0 2024-07-24T22:07:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.553+0000 7f8116ffd640 1 -- 172.21.15.47:0/834739358 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f812c003a30 con 0x564f8d370fa0 2024-07-24T22:07:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.554+0000 7f814004e740 10 client.25021 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.554+0000 7f814004e740 10 client.25021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.554+0000 7f814004e740 20 client.25021 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.554+0000 7f814004e740 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564f8d38c910 0x564f8d38ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.554+0000 7f814004e740 4 client.25021 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:07:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.554+0000 7f814004e740 1 -- 172.21.15.47:0/834739358 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f8d2e98b0 con 0x564f8d38c910 2024-07-24T22:07:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.554+0000 7f81377fe640 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564f8d38c910 0x564f8d38ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.554+0000 7f81377fe640 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564f8d38c910 0x564f8d38ed00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4eda9410a528a47 server_cookie=d41a7a645c4c389b in_seq=0 out_seq=0 2024-07-24T22:07:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.554+0000 7f8116ffd640 10 client.25021 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:01.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.555+0000 7f8116ffd640 1 -- 172.21.15.47:0/834739358 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f8d2e98b0 con 0x564f8d38c910 2024-07-24T22:07:01.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.555+0000 7f8116ffd640 10 client.25021 handle_command_reply: tid=0 2024-07-24T22:07:01.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.555+0000 7f814004e740 1 client.25021 shutdown 2024-07-24T22:07:01.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.556+0000 7f814004e740 1 -- 172.21.15.47:0/834739358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370fa0 msgr2=0x564f8d379db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:01.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.556+0000 7f814004e740 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370fa0 0x564f8d379db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f812c000c00 tx=0x7f812c00a870 comp rx=0 tx=0).stop 2024-07-24T22:07:01.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.556+0000 7f814004e740 1 -- 172.21.15.47:0/834739358 shutdown_connections 2024-07-24T22:07:01.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.556+0000 7f814004e740 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564f8d38c910 0x564f8d38ed00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.556+0000 7f814004e740 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d37a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.556+0000 7f814004e740 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370fa0 0x564f8d379db0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.556+0000 7f8116ffd640 0 client.25021 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:01.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.556+0000 7f814004e740 1 --2- 172.21.15.47:0/834739358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370680 0x564f8d37c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.556+0000 7f814004e740 1 -- 172.21.15.47:0/834739358 >> 172.21.15.47:0/834739358 conn(0x564f8d36e4b0 msgr2=0x564f8d374050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:01.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.556+0000 7f814004e740 1 -- 172.21.15.47:0/834739358 shutdown_connections 2024-07-24T22:07:01.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.556+0000 7f814004e740 1 -- 172.21.15.47:0/834739358 wait complete. 2024-07-24T22:07:01.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.556+0000 7f814004e740 20 client.25021 trim_cache size 0 max 16384 2024-07-24T22:07:01.565 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:01 smithi183 ceph-mon[37007]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 48 op/s 2024-07-24T22:07:01.565 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:01 smithi183 ceph-mon[37007]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-07-24T22:07:01.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.574+0000 7f814004e740 1 Processor -- start 2024-07-24T22:07:01.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.574+0000 7f814004e740 1 -- start start 2024-07-24T22:07:01.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.574+0000 7f814004e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 0x564f8d3747d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.574+0000 7f814004e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370fa0 0x564f8d388d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.574+0000 7f814004e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d394360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.574+0000 7f814004e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f81381ae340 con 0x564f8d37cf30 2024-07-24T22:07:01.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.574+0000 7f814004e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f81381b0bc0 con 0x564f8d370fa0 2024-07-24T22:07:01.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.574+0000 7f814004e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f81381ae9b0 con 0x564f8d370680 2024-07-24T22:07:01.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.574+0000 7f8137fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d394360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.574+0000 7f8137fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d394360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33048/0 (socket says 172.21.15.47:33048) 2024-07-24T22:07:01.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f8137fff640 1 -- 172.21.15.47:0/4234817736 learned_addr learned my addr 172.21.15.47:0/4234817736 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:01.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f81377fe640 1 --2- 172.21.15.47:0/4234817736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 0x564f8d3747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f8136ffd640 1 --2- 172.21.15.47:0/4234817736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370fa0 0x564f8d388d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f8137fff640 1 -- 172.21.15.47:0/4234817736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 msgr2=0x564f8d3747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:01.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f8137fff640 1 --2- 172.21.15.47:0/4234817736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 0x564f8d3747d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f8137fff640 1 -- 172.21.15.47:0/4234817736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370fa0 msgr2=0x564f8d388d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:01.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f8137fff640 1 --2- 172.21.15.47:0/4234817736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370fa0 0x564f8d388d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f8137fff640 1 -- 172.21.15.47:0/4234817736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f8d37fc00 con 0x564f8d37cf30 2024-07-24T22:07:01.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f81377fe640 1 --2- 172.21.15.47:0/4234817736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 0x564f8d3747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:01.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f8136ffd640 1 --2- 172.21.15.47:0/4234817736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370fa0 0x564f8d388d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:01.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f8137fff640 1 --2- 172.21.15.47:0/4234817736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d394360 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8130031a50 tx=0x7f8130005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9d1896d5012d42 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:01.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f811d7fa640 1 -- 172.21.15.47:0/4234817736 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130004240 con 0x564f8d37cf30 2024-07-24T22:07:01.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f811d7fa640 1 -- 172.21.15.47:0/4234817736 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8130036050 con 0x564f8d37cf30 2024-07-24T22:07:01.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.575+0000 7f811d7fa640 1 -- 172.21.15.47:0/4234817736 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81300305c0 con 0x564f8d37cf30 2024-07-24T22:07:01.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.576+0000 7f814004e740 1 -- 172.21.15.47:0/4234817736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 msgr2=0x564f8d394360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:01.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.576+0000 7f814004e740 1 --2- 172.21.15.47:0/4234817736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d394360 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8130031a50 tx=0x7f8130005fa0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.576+0000 7f814004e740 1 -- 172.21.15.47:0/4234817736 shutdown_connections 2024-07-24T22:07:01.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.576+0000 7f814004e740 1 --2- 172.21.15.47:0/4234817736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d394360 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.576+0000 7f814004e740 1 --2- 172.21.15.47:0/4234817736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370fa0 0x564f8d388d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.576+0000 7f814004e740 1 --2- 172.21.15.47:0/4234817736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 0x564f8d3747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.576+0000 7f814004e740 1 -- 172.21.15.47:0/4234817736 >> 172.21.15.47:0/4234817736 conn(0x564f8d36e4b0 msgr2=0x564f8d37bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:01.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.576+0000 7f814004e740 1 -- 172.21.15.47:0/4234817736 shutdown_connections 2024-07-24T22:07:01.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.576+0000 7f814004e740 1 -- 172.21.15.47:0/4234817736 wait complete. 2024-07-24T22:07:01.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.576+0000 7f814004e740 1 -- start start 2024-07-24T22:07:01.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f814004e740 1 Processor -- start 2024-07-24T22:07:01.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f814004e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 0x564f8d3856d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f814004e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370fa0 0x564f8d380ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f814004e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d381270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f814004e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f81381af080 con 0x564f8d37cf30 2024-07-24T22:07:01.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f814004e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f81381b04f0 con 0x564f8d370fa0 2024-07-24T22:07:01.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f814004e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f81381af750 con 0x564f8d370680 2024-07-24T22:07:01.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f814004e740 10 client.0 _ll_register_callbacks cb 0x7f81280a6e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:01.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f8137fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d381270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f8137fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d381270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33060/0 (socket says 172.21.15.47:33060) 2024-07-24T22:07:01.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f8137fff640 1 -- 172.21.15.47:0/1198905561 learned_addr learned my addr 172.21.15.47:0/1198905561 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f81377fe640 1 --2- 172.21.15.47:0/1198905561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 0x564f8d3856d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f8136ffd640 1 --2- 172.21.15.47:0/1198905561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370fa0 0x564f8d380ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f8137fff640 1 -- 172.21.15.47:0/1198905561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 msgr2=0x564f8d3856d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f8137fff640 1 --2- 172.21.15.47:0/1198905561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 0x564f8d3856d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f8137fff640 1 -- 172.21.15.47:0/1198905561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370fa0 msgr2=0x564f8d380ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f8137fff640 1 --2- 172.21.15.47:0/1198905561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370fa0 0x564f8d380ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.577+0000 7f8137fff640 1 -- 172.21.15.47:0/1198905561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f8d3f6330 con 0x564f8d37cf30 2024-07-24T22:07:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f8137fff640 1 --2- 172.21.15.47:0/1198905561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d381270 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f813002f390 tx=0x7f813002fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422d92cc734c1d72 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f8116ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f8116ffd640 1 -- 172.21.15.47:0/1198905561 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813005c070 con 0x564f8d37cf30 2024-07-24T22:07:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f8116ffd640 1 -- 172.21.15.47:0/1198905561 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8130004380 con 0x564f8d37cf30 2024-07-24T22:07:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f814004e740 1 -- 172.21.15.47:0/1198905561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8130036050 con 0x564f8d37cf30 2024-07-24T22:07:01.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f8116ffd640 1 -- 172.21.15.47:0/1198905561 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8130004580 con 0x564f8d37cf30 2024-07-24T22:07:01.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f814004e740 10 client.15363 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:01.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f814004e740 1 -- 172.21.15.47:0/1198905561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564f8d3f74b0 con 0x564f8d37cf30 2024-07-24T22:07:01.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f8116ffd640 1 -- 172.21.15.47:0/1198905561 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8130036050 con 0x564f8d37cf30 2024-07-24T22:07:01.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f8116ffd640 1 -- 172.21.15.47:0/1198905561 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f813004a070 con 0x564f8d37cf30 2024-07-24T22:07:01.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f814004e740 10 client.15363 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:01.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f814004e740 10 client.15363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:01.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f814004e740 20 client.15363 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:01.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f814004e740 1 --2- 172.21.15.47:0/1198905561 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564f8d3f7b70 0x564f8d3f9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:01.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f814004e740 4 client.15363 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:07:01.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.578+0000 7f814004e740 1 -- 172.21.15.47:0/1198905561 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564f8d2e5350 con 0x564f8d3f7b70 2024-07-24T22:07:01.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.579+0000 7f81377fe640 1 --2- 172.21.15.47:0/1198905561 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564f8d3f7b70 0x564f8d3f9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:01.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.579+0000 7f81377fe640 1 --2- 172.21.15.47:0/1198905561 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564f8d3f7b70 0x564f8d3f9f60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a50a4c87fa266dcb server_cookie=8825874f8f1922ad in_seq=0 out_seq=0 2024-07-24T22:07:01.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.579+0000 7f8116ffd640 10 client.15363 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:01.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.579+0000 7f8116ffd640 1 -- 172.21.15.47:0/1198905561 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564f8d2e5350 con 0x564f8d3f7b70 2024-07-24T22:07:01.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.579+0000 7f8116ffd640 10 client.15363 handle_command_reply: tid=0 2024-07-24T22:07:01.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.579+0000 7f814004e740 1 client.15363 shutdown 2024-07-24T22:07:01.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.579+0000 7f814004e740 1 -- 172.21.15.47:0/1198905561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 msgr2=0x564f8d381270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:01.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.579+0000 7f814004e740 1 --2- 172.21.15.47:0/1198905561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d381270 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f813002f390 tx=0x7f813002fb40 comp rx=0 tx=0).stop 2024-07-24T22:07:01.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f814004e740 1 -- 172.21.15.47:0/1198905561 shutdown_connections 2024-07-24T22:07:01.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f814004e740 1 --2- 172.21.15.47:0/1198905561 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564f8d3f7b70 0x564f8d3f9f60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f814004e740 1 --2- 172.21.15.47:0/1198905561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564f8d37cf30 0x564f8d381270 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f814004e740 1 --2- 172.21.15.47:0/1198905561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564f8d370fa0 0x564f8d380ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f814004e740 1 --2- 172.21.15.47:0/1198905561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564f8d370680 0x564f8d3856d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f8116ffd640 0 client.15363 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:01.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f814004e740 1 -- 172.21.15.47:0/1198905561 >> 172.21.15.47:0/1198905561 conn(0x564f8d36e4b0 msgr2=0x564f8d378630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:01.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f814004e740 1 -- 172.21.15.47:0/1198905561 shutdown_connections 2024-07-24T22:07:01.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f814004e740 1 -- 172.21.15.47:0/1198905561 wait complete. 2024-07-24T22:07:01.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f814004e740 20 client.15363 trim_cache size 0 max 16384 2024-07-24T22:07:01.588 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:07:01.588 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:07:01.588 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:07:01.588 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:07:01.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f813dc9d640 1 -- 172.21.15.47:0/564210008 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81200b3d40 msgr2=0x7f81200b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:01.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f813dc9d640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81200b3d40 0x7f81200b6200 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8130006010 tx=0x7f813002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f813dc9d640 1 -- 172.21.15.47:0/564210008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8138103660 msgr2=0x7f8138198c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:01.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f813dc9d640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8138103660 0x7f8138198c00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f812800d770 tx=0x7f812800dc30 comp rx=0 tx=0).stop 2024-07-24T22:07:01.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f813dc9d640 1 -- 172.21.15.47:0/564210008 shutdown_connections 2024-07-24T22:07:01.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f813dc9d640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81200b3d40 0x7f81200b6200 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f813dc9d640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f813810cac0 0x7f813819e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f813dc9d640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8138103f80 0x7f8138199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f813dc9d640 1 --2- 172.21.15.47:0/564210008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8138103660 0x7f8138198c00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:01.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.580+0000 7f813dc9d640 1 -- 172.21.15.47:0/564210008 >> 172.21.15.47:0/564210008 conn(0x7f81380fd0c0 msgr2=0x7f813810ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:01.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.581+0000 7f813dc9d640 1 -- 172.21.15.47:0/564210008 shutdown_connections 2024-07-24T22:07:01.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:01.581+0000 7f813dc9d640 1 -- 172.21.15.47:0/564210008 wait complete. 2024-07-24T22:07:03.067 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:07:03.068 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:07:03.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:03 smithi047 ceph-mon[32551]: pgmap v361: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 49 op/s 2024-07-24T22:07:03.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:03 smithi188 ceph-mon[37380]: pgmap v361: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 49 op/s 2024-07-24T22:07:03.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:03 smithi183 ceph-mon[37007]: pgmap v361: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 174 KiB/s wr, 49 op/s 2024-07-24T22:07:03.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.937+0000 7fe6c802d640 1 -- 172.21.15.47:0/256674136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6c01011e0 msgr2=0x7fe6c01015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:03.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.937+0000 7fe6c802d640 1 --2- 172.21.15.47:0/256674136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6c01011e0 0x7fe6c01015c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009900 tx=0x7fe6bc02a410 comp rx=0 tx=0).stop 2024-07-24T22:07:03.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.937+0000 7fe6c802d640 1 -- 172.21.15.47:0/256674136 shutdown_connections 2024-07-24T22:07:03.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.937+0000 7fe6c802d640 1 --2- 172.21.15.47:0/256674136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6c010cc20 0x7fe6c010f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:03.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.937+0000 7fe6c802d640 1 --2- 172.21.15.47:0/256674136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6c010a2f0 0x7fe6c010c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:03.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.937+0000 7fe6c802d640 1 --2- 172.21.15.47:0/256674136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6c01011e0 0x7fe6c01015c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:03.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.937+0000 7fe6c802d640 1 -- 172.21.15.47:0/256674136 >> 172.21.15.47:0/256674136 conn(0x7fe6c0076940 msgr2=0x7fe6c0076d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:03.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.937+0000 7fe6c802d640 1 -- 172.21.15.47:0/256674136 shutdown_connections 2024-07-24T22:07:03.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.937+0000 7fe6c802d640 1 -- 172.21.15.47:0/256674136 wait complete. 2024-07-24T22:07:03.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.938+0000 7fe6c802d640 1 Processor -- start 2024-07-24T22:07:03.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.938+0000 7fe6c802d640 1 -- start start 2024-07-24T22:07:03.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.938+0000 7fe6c802d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6c01011e0 0x7fe6c01021b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:03.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.938+0000 7fe6c802d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6c010a2f0 0x7fe6c01026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:03.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.938+0000 7fe6c802d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6c010cc20 0x7fe6c0102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.938+0000 7fe6c802d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c01127a0 con 0x7fe6c01011e0 2024-07-24T22:07:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.938+0000 7fe6c802d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c0112620 con 0x7fe6c010a2f0 2024-07-24T22:07:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.938+0000 7fe6c802d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c0112920 con 0x7fe6c010cc20 2024-07-24T22:07:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.938+0000 7fe6c5dc9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6c01011e0 0x7fe6c01021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6c5dc9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6c01011e0 0x7fe6c01021b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33074/0 (socket says 172.21.15.47:33074) 2024-07-24T22:07:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6c5dc9640 1 -- 172.21.15.47:0/1021786595 learned_addr learned my addr 172.21.15.47:0/1021786595 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6c5dc9640 1 -- 172.21.15.47:0/1021786595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6c010cc20 msgr2=0x7fe6c0102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6c55c8640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6c010a2f0 0x7fe6c01026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6c65ca640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6c010cc20 0x7fe6c0102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6c5dc9640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6c010cc20 0x7fe6c0102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6c5dc9640 1 -- 172.21.15.47:0/1021786595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6c010a2f0 msgr2=0x7fe6c01026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6c5dc9640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6c010a2f0 0x7fe6c01026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6c5dc9640 1 -- 172.21.15.47:0/1021786595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c01a70f0 con 0x7fe6c01011e0 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6c65ca640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6c010cc20 0x7fe6c0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6c5dc9640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6c01011e0 0x7fe6c01021b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc005940 tx=0x7fe6bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6b6ffd640 1 -- 172.21.15.47:0/1021786595 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc03f030 con 0x7fe6c01011e0 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6b6ffd640 1 -- 172.21.15.47:0/1021786595 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6bc003cb0 con 0x7fe6c01011e0 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6c802d640 1 -- 172.21.15.47:0/1021786595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c01a7380 con 0x7fe6c01011e0 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6b6ffd640 1 -- 172.21.15.47:0/1021786595 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc035070 con 0x7fe6c01011e0 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.939+0000 7fe6c802d640 1 -- 172.21.15.47:0/1021786595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c01a78e0 con 0x7fe6c01011e0 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.940+0000 7fe6c802d640 1 -- 172.21.15.47:0/1021786595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c01015c0 con 0x7fe6c01011e0 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.942+0000 7fe6b6ffd640 1 -- 172.21.15.47:0/1021786595 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe6bc042030 con 0x7fe6c01011e0 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.942+0000 7fe6b6ffd640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe6ac0b3d40 0x7fe6ac0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.942+0000 7fe6c55c8640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe6ac0b3d40 0x7fe6ac0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.942+0000 7fe6b6ffd640 1 -- 172.21.15.47:0/1021786595 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fe6bc104be0 con 0x7fe6c01011e0 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.943+0000 7fe6c55c8640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe6ac0b3d40 0x7fe6ac0b6200 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0005fd0 tx=0x7fe6b0005850 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:03.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:03.945+0000 7fe6b6ffd640 1 -- 172.21.15.47:0/1021786595 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fe6bc0cbef0 con 0x7fe6c01011e0 2024-07-24T22:07:03.963 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:04.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.146+0000 7fe6c802d640 1 -- 172.21.15.47:0/1021786595 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6c0100680 con 0x7fe6ac0b3d40 2024-07-24T22:07:04.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.150+0000 7fe6b6ffd640 1 -- 172.21.15.47:0/1021786595 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258824 (secure 0 0 0) 0x7fe6c0100680 con 0x7fe6ac0b3d40 2024-07-24T22:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:07:04.155 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-07-24T22:07:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.153+0000 7fe6c802d640 1 -- 172.21.15.47:0/1021786595 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe6ac0b3d40 msgr2=0x7fe6ac0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.153+0000 7fe6c802d640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe6ac0b3d40 0x7fe6ac0b6200 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0005fd0 tx=0x7fe6b0005850 comp rx=0 tx=0).stop 2024-07-24T22:07:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.153+0000 7fe6c802d640 1 -- 172.21.15.47:0/1021786595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6c01011e0 msgr2=0x7fe6c01021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.153+0000 7fe6c802d640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6c01011e0 0x7fe6c01021b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc005940 tx=0x7fe6bc0042f0 comp rx=0 tx=0).stop 2024-07-24T22:07:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.154+0000 7fe6c802d640 1 -- 172.21.15.47:0/1021786595 shutdown_connections 2024-07-24T22:07:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.154+0000 7fe6c802d640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe6ac0b3d40 0x7fe6ac0b6200 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.154+0000 7fe6c802d640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6c010cc20 0x7fe6c0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.154+0000 7fe6c802d640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6c010a2f0 0x7fe6c01026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.154+0000 7fe6c802d640 1 --2- 172.21.15.47:0/1021786595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6c01011e0 0x7fe6c01021b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.154+0000 7fe6c802d640 1 -- 172.21.15.47:0/1021786595 >> 172.21.15.47:0/1021786595 conn(0x7fe6c0076940 msgr2=0x7fe6c00fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:04.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.154+0000 7fe6c802d640 1 -- 172.21.15.47:0/1021786595 shutdown_connections 2024-07-24T22:07:04.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:04.154+0000 7fe6c802d640 1 -- 172.21.15.47:0/1021786595 wait complete. 2024-07-24T22:07:05.343 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2024-07-24T22:07:04.121466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1448179,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":893,"num_read_kb":723,"num_write":493,"num_write_kb":4472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952539,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":842,"ondisk_log_size":842,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":389804,"kb_used_data":15360,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124552020,"statfs":{"total":1151940427776,"available":1151541268480,"internally_reserved":0,"allocated":15728640,"data_stored":9978719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":788514,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":412,"num_write":275,"num_write_kb":2221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002850"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574007+0000","last_change":"2024-07-24T22:03:53.407929+0000","last_active":"2024-07-24T22:05:27.574007+0000","last_peered":"2024-07-24T22:05:27.574007+0000","last_clean":"2024-07-24T22:05:27.574007+0000","last_became_active":"2024-07-24T22:03:53.407508+0000","last_became_peered":"2024-07-24T22:03:53.407508+0000","last_unstale":"2024-07-24T22:05:27.574007+0000","last_undegraded":"2024-07-24T22:05:27.574007+0000","last_fullsized":"2024-07-24T22:05:27.574007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:00:35.699906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696531+0000","last_change":"2024-07-24T22:03:53.404867+0000","last_active":"2024-07-24T22:05:27.696531+0000","last_peered":"2024-07-24T22:05:27.696531+0000","last_clean":"2024-07-24T22:05:27.696531+0000","last_became_active":"2024-07-24T22:03:53.404309+0000","last_became_peered":"2024-07-24T22:03:53.404309+0000","last_unstale":"2024-07-24T22:05:27.696531+0000","last_undegraded":"2024-07-24T22:05:27.696531+0000","last_fullsized":"2024-07-24T22:05:27.696531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:21:51.238815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696402+0000","last_change":"2024-07-24T22:03:53.404368+0000","last_active":"2024-07-24T22:05:27.696402+0000","last_peered":"2024-07-24T22:05:27.696402+0000","last_clean":"2024-07-24T22:05:27.696402+0000","last_became_active":"2024-07-24T22:03:53.403941+0000","last_became_peered":"2024-07-24T22:03:53.403941+0000","last_unstale":"2024-07-24T22:05:27.696402+0000","last_undegraded":"2024-07-24T22:05:27.696402+0000","last_fullsized":"2024-07-24T22:05:27.696402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:10:09.884724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576551+0000","last_change":"2024-07-24T22:03:53.407661+0000","last_active":"2024-07-24T22:05:27.576551+0000","last_peered":"2024-07-24T22:05:27.576551+0000","last_clean":"2024-07-24T22:05:27.576551+0000","last_became_active":"2024-07-24T22:03:53.407375+0000","last_became_peered":"2024-07-24T22:03:53.407375+0000","last_unstale":"2024-07-24T22:05:27.576551+0000","last_undegraded":"2024-07-24T22:05:27.576551+0000","last_fullsized":"2024-07-24T22:05:27.576551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:34.000666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575974+0000","last_change":"2024-07-24T22:03:53.406227+0000","last_active":"2024-07-24T22:05:27.575974+0000","last_peered":"2024-07-24T22:05:27.575974+0000","last_clean":"2024-07-24T22:05:27.575974+0000","last_became_active":"2024-07-24T22:03:53.405819+0000","last_became_peered":"2024-07-24T22:03:53.405819+0000","last_unstale":"2024-07-24T22:05:27.575974+0000","last_undegraded":"2024-07-24T22:05:27.575974+0000","last_fullsized":"2024-07-24T22:05:27.575974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:59.022972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588837+0000","last_change":"2024-07-24T22:04:27.501754+0000","last_active":"2024-07-24T22:05:27.588837+0000","last_peered":"2024-07-24T22:05:27.588837+0000","last_clean":"2024-07-24T22:05:27.588837+0000","last_became_active":"2024-07-24T22:04:27.501340+0000","last_became_peered":"2024-07-24T22:04:27.501340+0000","last_unstale":"2024-07-24T22:05:27.588837+0000","last_undegraded":"2024-07-24T22:05:27.588837+0000","last_fullsized":"2024-07-24T22:05:27.588837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:38:04.880980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575969+0000","last_change":"2024-07-24T22:03:53.413012+0000","last_active":"2024-07-24T22:05:27.575969+0000","last_peered":"2024-07-24T22:05:27.575969+0000","last_clean":"2024-07-24T22:05:27.575969+0000","last_became_active":"2024-07-24T22:03:53.411791+0000","last_became_peered":"2024-07-24T22:03:53.411791+0000","last_unstale":"2024-07-24T22:05:27.575969+0000","last_undegraded":"2024-07-24T22:05:27.575969+0000","last_fullsized":"2024-07-24T22:05:27.575969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:15:02.939598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695762+0000","last_change":"2024-07-24T22:04:27.502867+0000","last_active":"2024-07-24T22:05:27.695762+0000","last_peered":"2024-07-24T22:05:27.695762+0000","last_clean":"2024-07-24T22:05:27.695762+0000","last_became_active":"2024-07-24T22:04:27.502515+0000","last_became_peered":"2024-07-24T22:04:27.502515+0000","last_unstale":"2024-07-24T22:05:27.695762+0000","last_undegraded":"2024-07-24T22:05:27.695762+0000","last_fullsized":"2024-07-24T22:05:27.695762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:58:39.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,10],"acting":[3,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572158+0000","last_change":"2024-07-24T22:03:53.413213+0000","last_active":"2024-07-24T22:05:27.572158+0000","last_peered":"2024-07-24T22:05:27.572158+0000","last_clean":"2024-07-24T22:05:27.572158+0000","last_became_active":"2024-07-24T22:03:53.412725+0000","last_became_peered":"2024-07-24T22:03:53.412725+0000","last_unstale":"2024-07-24T22:05:27.572158+0000","last_undegraded":"2024-07-24T22:05:27.572158+0000","last_fullsized":"2024-07-24T22:05:27.572158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:34:01.897965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589224+0000","last_change":"2024-07-24T22:03:53.401129+0000","last_active":"2024-07-24T22:05:27.589224+0000","last_peered":"2024-07-24T22:05:27.589224+0000","last_clean":"2024-07-24T22:05:27.589224+0000","last_became_active":"2024-07-24T22:03:53.400780+0000","last_became_peered":"2024-07-24T22:03:53.400780+0000","last_unstale":"2024-07-24T22:05:27.589224+0000","last_undegraded":"2024-07-24T22:05:27.589224+0000","last_fullsized":"2024-07-24T22:05:27.589224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:28:37.825021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576231+0000","last_change":"2024-07-24T22:03:53.406490+0000","last_active":"2024-07-24T22:05:27.576231+0000","last_peered":"2024-07-24T22:05:27.576231+0000","last_clean":"2024-07-24T22:05:27.576231+0000","last_became_active":"2024-07-24T22:03:53.406108+0000","last_became_peered":"2024-07-24T22:03:53.406108+0000","last_unstale":"2024-07-24T22:05:27.576231+0000","last_undegraded":"2024-07-24T22:05:27.576231+0000","last_fullsized":"2024-07-24T22:05:27.576231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:37.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695960+0000","last_change":"2024-07-24T22:04:27.503165+0000","last_active":"2024-07-24T22:05:27.695960+0000","last_peered":"2024-07-24T22:05:27.695960+0000","last_clean":"2024-07-24T22:05:27.695960+0000","last_became_active":"2024-07-24T22:04:27.502861+0000","last_became_peered":"2024-07-24T22:04:27.502861+0000","last_unstale":"2024-07-24T22:05:27.695960+0000","last_undegraded":"2024-07-24T22:05:27.695960+0000","last_fullsized":"2024-07-24T22:05:27.695960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:36:41.353268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571263+0000","last_change":"2024-07-24T22:03:53.392763+0000","last_active":"2024-07-24T22:05:27.571263+0000","last_peered":"2024-07-24T22:05:27.571263+0000","last_clean":"2024-07-24T22:05:27.571263+0000","last_became_active":"2024-07-24T22:03:53.392476+0000","last_became_peered":"2024-07-24T22:03:53.392476+0000","last_unstale":"2024-07-24T22:05:27.571263+0000","last_undegraded":"2024-07-24T22:05:27.571263+0000","last_fullsized":"2024-07-24T22:05:27.571263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:25:13.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696340+0000","last_change":"2024-07-24T22:03:53.406937+0000","last_active":"2024-07-24T22:05:27.696340+0000","last_peered":"2024-07-24T22:05:27.696340+0000","last_clean":"2024-07-24T22:05:27.696340+0000","last_became_active":"2024-07-24T22:03:53.406495+0000","last_became_peered":"2024-07-24T22:03:53.406495+0000","last_unstale":"2024-07-24T22:05:27.696340+0000","last_undegraded":"2024-07-24T22:05:27.696340+0000","last_fullsized":"2024-07-24T22:05:27.696340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:06:50.434751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695723+0000","last_change":"2024-07-24T22:03:53.401073+0000","last_active":"2024-07-24T22:05:27.695723+0000","last_peered":"2024-07-24T22:05:27.695723+0000","last_clean":"2024-07-24T22:05:27.695723+0000","last_became_active":"2024-07-24T22:03:53.399675+0000","last_became_peered":"2024-07-24T22:03:53.399675+0000","last_unstale":"2024-07-24T22:05:27.695723+0000","last_undegraded":"2024-07-24T22:05:27.695723+0000","last_fullsized":"2024-07-24T22:05:27.695723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:59:25.461178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571670+0000","last_change":"2024-07-24T22:03:53.408289+0000","last_active":"2024-07-24T22:05:27.571670+0000","last_peered":"2024-07-24T22:05:27.571670+0000","last_clean":"2024-07-24T22:05:27.571670+0000","last_became_active":"2024-07-24T22:03:53.407950+0000","last_became_peered":"2024-07-24T22:03:53.407950+0000","last_unstale":"2024-07-24T22:05:27.571670+0000","last_undegraded":"2024-07-24T22:05:27.571670+0000","last_fullsized":"2024-07-24T22:05:27.571670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:10:30.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574008+0000","last_change":"2024-07-24T22:03:53.409909+0000","last_active":"2024-07-24T22:05:27.574008+0000","last_peered":"2024-07-24T22:05:27.574008+0000","last_clean":"2024-07-24T22:05:27.574008+0000","last_became_active":"2024-07-24T22:03:53.409183+0000","last_became_peered":"2024-07-24T22:03:53.409183+0000","last_unstale":"2024-07-24T22:05:27.574008+0000","last_undegraded":"2024-07-24T22:05:27.574008+0000","last_fullsized":"2024-07-24T22:05:27.574008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:14:50.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695710+0000","last_change":"2024-07-24T22:03:53.401198+0000","last_active":"2024-07-24T22:05:27.695710+0000","last_peered":"2024-07-24T22:05:27.695710+0000","last_clean":"2024-07-24T22:05:27.695710+0000","last_became_active":"2024-07-24T22:03:53.400885+0000","last_became_peered":"2024-07-24T22:03:53.400885+0000","last_unstale":"2024-07-24T22:05:27.695710+0000","last_undegraded":"2024-07-24T22:05:27.695710+0000","last_fullsized":"2024-07-24T22:05:27.695710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:59:37.965714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696048+0000","last_change":"2024-07-24T22:03:53.406590+0000","last_active":"2024-07-24T22:05:27.696048+0000","last_peered":"2024-07-24T22:05:27.696048+0000","last_clean":"2024-07-24T22:05:27.696048+0000","last_became_active":"2024-07-24T22:03:53.406283+0000","last_became_peered":"2024-07-24T22:03:53.406283+0000","last_unstale":"2024-07-24T22:05:27.696048+0000","last_undegraded":"2024-07-24T22:05:27.696048+0000","last_fullsized":"2024-07-24T22:05:27.696048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:30.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573401+0000","last_change":"2024-07-24T22:03:53.408790+0000","last_active":"2024-07-24T22:05:27.573401+0000","last_peered":"2024-07-24T22:05:27.573401+0000","last_clean":"2024-07-24T22:05:27.573401+0000","last_became_active":"2024-07-24T22:03:53.408480+0000","last_became_peered":"2024-07-24T22:03:53.408480+0000","last_unstale":"2024-07-24T22:05:27.573401+0000","last_undegraded":"2024-07-24T22:05:27.573401+0000","last_fullsized":"2024-07-24T22:05:27.573401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:59.601606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571171+0000","last_change":"2024-07-24T22:03:53.407400+0000","last_active":"2024-07-24T22:05:27.571171+0000","last_peered":"2024-07-24T22:05:27.571171+0000","last_clean":"2024-07-24T22:05:27.571171+0000","last_became_active":"2024-07-24T22:03:53.407084+0000","last_became_peered":"2024-07-24T22:03:53.407084+0000","last_unstale":"2024-07-24T22:05:27.571171+0000","last_undegraded":"2024-07-24T22:05:27.571171+0000","last_fullsized":"2024-07-24T22:05:27.571171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:51:04.942504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571785+0000","last_change":"2024-07-24T22:03:53.407444+0000","last_active":"2024-07-24T22:05:27.571785+0000","last_peered":"2024-07-24T22:05:27.571785+0000","last_clean":"2024-07-24T22:05:27.571785+0000","last_became_active":"2024-07-24T22:03:53.407025+0000","last_became_peered":"2024-07-24T22:03:53.407025+0000","last_unstale":"2024-07-24T22:05:27.571785+0000","last_undegraded":"2024-07-24T22:05:27.571785+0000","last_fullsized":"2024-07-24T22:05:27.571785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:47:49.620354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696170+0000","last_change":"2024-07-24T22:03:53.406748+0000","last_active":"2024-07-24T22:05:27.696170+0000","last_peered":"2024-07-24T22:05:27.696170+0000","last_clean":"2024-07-24T22:05:27.696170+0000","last_became_active":"2024-07-24T22:03:53.406398+0000","last_became_peered":"2024-07-24T22:03:53.406398+0000","last_unstale":"2024-07-24T22:05:27.696170+0000","last_undegraded":"2024-07-24T22:05:27.696170+0000","last_fullsized":"2024-07-24T22:05:27.696170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:35:40.117375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574701+0000","last_change":"2024-07-24T22:03:53.402203+0000","last_active":"2024-07-24T22:05:27.574701+0000","last_peered":"2024-07-24T22:05:27.574701+0000","last_clean":"2024-07-24T22:05:27.574701+0000","last_became_active":"2024-07-24T22:03:53.401826+0000","last_became_peered":"2024-07-24T22:03:53.401826+0000","last_unstale":"2024-07-24T22:05:27.574701+0000","last_undegraded":"2024-07-24T22:05:27.574701+0000","last_fullsized":"2024-07-24T22:05:27.574701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:45.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696666+0000","last_change":"2024-07-24T22:03:53.408179+0000","last_active":"2024-07-24T22:05:27.696666+0000","last_peered":"2024-07-24T22:05:27.696666+0000","last_clean":"2024-07-24T22:05:27.696666+0000","last_became_active":"2024-07-24T22:03:53.407547+0000","last_became_peered":"2024-07-24T22:03:53.407547+0000","last_unstale":"2024-07-24T22:05:27.696666+0000","last_undegraded":"2024-07-24T22:05:27.696666+0000","last_fullsized":"2024-07-24T22:05:27.696666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:03:52.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696074+0000","last_change":"2024-07-24T22:03:53.408550+0000","last_active":"2024-07-24T22:05:27.696074+0000","last_peered":"2024-07-24T22:05:27.696074+0000","last_clean":"2024-07-24T22:05:27.696074+0000","last_became_active":"2024-07-24T22:03:53.408119+0000","last_became_peered":"2024-07-24T22:03:53.408119+0000","last_unstale":"2024-07-24T22:05:27.696074+0000","last_undegraded":"2024-07-24T22:05:27.696074+0000","last_fullsized":"2024-07-24T22:05:27.696074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:33:54.154606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573853+0000","last_change":"2024-07-24T22:03:53.412562+0000","last_active":"2024-07-24T22:05:27.573853+0000","last_peered":"2024-07-24T22:05:27.573853+0000","last_clean":"2024-07-24T22:05:27.573853+0000","last_became_active":"2024-07-24T22:03:53.412231+0000","last_became_peered":"2024-07-24T22:03:53.412231+0000","last_unstale":"2024-07-24T22:05:27.573853+0000","last_undegraded":"2024-07-24T22:05:27.573853+0000","last_fullsized":"2024-07-24T22:05:27.573853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:53:48.403662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571173+0000","last_change":"2024-07-24T22:03:53.398212+0000","last_active":"2024-07-24T22:05:27.571173+0000","last_peered":"2024-07-24T22:05:27.571173+0000","last_clean":"2024-07-24T22:05:27.571173+0000","last_became_active":"2024-07-24T22:03:53.397853+0000","last_became_peered":"2024-07-24T22:03:53.397853+0000","last_unstale":"2024-07-24T22:05:27.571173+0000","last_undegraded":"2024-07-24T22:05:27.571173+0000","last_fullsized":"2024-07-24T22:05:27.571173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:39:47.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696283+0000","last_change":"2024-07-24T22:03:53.397188+0000","last_active":"2024-07-24T22:05:27.696283+0000","last_peered":"2024-07-24T22:05:27.696283+0000","last_clean":"2024-07-24T22:05:27.696283+0000","last_became_active":"2024-07-24T22:03:53.396865+0000","last_became_peered":"2024-07-24T22:03:53.396865+0000","last_unstale":"2024-07-24T22:05:27.696283+0000","last_undegraded":"2024-07-24T22:05:27.696283+0000","last_fullsized":"2024-07-24T22:05:27.696283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:20:49.074330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695823+0000","last_change":"2024-07-24T22:03:53.406605+0000","last_active":"2024-07-24T22:05:27.695823+0000","last_peered":"2024-07-24T22:05:27.695823+0000","last_clean":"2024-07-24T22:05:27.695823+0000","last_became_active":"2024-07-24T22:03:53.406264+0000","last_became_peered":"2024-07-24T22:03:53.406264+0000","last_unstale":"2024-07-24T22:05:27.695823+0000","last_undegraded":"2024-07-24T22:05:27.695823+0000","last_fullsized":"2024-07-24T22:05:27.695823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:13:46.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696013+0000","last_change":"2024-07-24T22:03:53.400422+0000","last_active":"2024-07-24T22:05:27.696013+0000","last_peered":"2024-07-24T22:05:27.696013+0000","last_clean":"2024-07-24T22:05:27.696013+0000","last_became_active":"2024-07-24T22:03:53.400096+0000","last_became_peered":"2024-07-24T22:03:53.400096+0000","last_unstale":"2024-07-24T22:05:27.696013+0000","last_undegraded":"2024-07-24T22:05:27.696013+0000","last_fullsized":"2024-07-24T22:05:27.696013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:04:07.882659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573363+0000","last_change":"2024-07-24T22:03:53.413231+0000","last_active":"2024-07-24T22:05:27.573363+0000","last_peered":"2024-07-24T22:05:27.573363+0000","last_clean":"2024-07-24T22:05:27.573363+0000","last_became_active":"2024-07-24T22:03:53.412825+0000","last_became_peered":"2024-07-24T22:03:53.412825+0000","last_unstale":"2024-07-24T22:05:27.573363+0000","last_undegraded":"2024-07-24T22:05:27.573363+0000","last_fullsized":"2024-07-24T22:05:27.573363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:59:30.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575993+0000","last_change":"2024-07-24T22:03:53.409007+0000","last_active":"2024-07-24T22:05:27.575993+0000","last_peered":"2024-07-24T22:05:27.575993+0000","last_clean":"2024-07-24T22:05:27.575993+0000","last_became_active":"2024-07-24T22:03:53.408624+0000","last_became_peered":"2024-07-24T22:03:53.408624+0000","last_unstale":"2024-07-24T22:05:27.575993+0000","last_undegraded":"2024-07-24T22:05:27.575993+0000","last_fullsized":"2024-07-24T22:05:27.575993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:31:22.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575311+0000","last_change":"2024-07-24T22:03:50.388894+0000","last_active":"2024-07-24T22:05:27.575311+0000","last_peered":"2024-07-24T22:05:27.575311+0000","last_clean":"2024-07-24T22:05:27.575311+0000","last_became_active":"2024-07-24T22:03:50.388608+0000","last_became_peered":"2024-07-24T22:03:50.388608+0000","last_unstale":"2024-07-24T22:05:27.575311+0000","last_undegraded":"2024-07-24T22:05:27.575311+0000","last_fullsized":"2024-07-24T22:05:27.575311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:36:43.571415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575239+0000","last_change":"2024-07-24T22:03:53.397509+0000","last_active":"2024-07-24T22:05:27.575239+0000","last_peered":"2024-07-24T22:05:27.575239+0000","last_clean":"2024-07-24T22:05:27.575239+0000","last_became_active":"2024-07-24T22:03:53.397186+0000","last_became_peered":"2024-07-24T22:03:53.397186+0000","last_unstale":"2024-07-24T22:05:27.575239+0000","last_undegraded":"2024-07-24T22:05:27.575239+0000","last_fullsized":"2024-07-24T22:05:27.575239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:15:14.081853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588955+0000","last_change":"2024-07-24T22:03:50.383523+0000","last_active":"2024-07-24T22:05:27.588955+0000","last_peered":"2024-07-24T22:05:27.588955+0000","last_clean":"2024-07-24T22:05:27.588955+0000","last_became_active":"2024-07-24T22:03:50.383088+0000","last_became_peered":"2024-07-24T22:03:50.383088+0000","last_unstale":"2024-07-24T22:05:27.588955+0000","last_undegraded":"2024-07-24T22:05:27.588955+0000","last_fullsized":"2024-07-24T22:05:27.588955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:57:07.824581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570963+0000","last_change":"2024-07-24T22:03:50.383726+0000","last_active":"2024-07-24T22:05:27.570963+0000","last_peered":"2024-07-24T22:05:27.570963+0000","last_clean":"2024-07-24T22:05:27.570963+0000","last_became_active":"2024-07-24T22:03:50.383480+0000","last_became_peered":"2024-07-24T22:03:50.383480+0000","last_unstale":"2024-07-24T22:05:27.570963+0000","last_undegraded":"2024-07-24T22:05:27.570963+0000","last_fullsized":"2024-07-24T22:05:27.570963+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:05:05.093272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695819+0000","last_change":"2024-07-24T22:03:53.406223+0000","last_active":"2024-07-24T22:05:27.695819+0000","last_peered":"2024-07-24T22:05:27.695819+0000","last_clean":"2024-07-24T22:05:27.695819+0000","last_became_active":"2024-07-24T22:03:53.404642+0000","last_became_peered":"2024-07-24T22:03:53.404642+0000","last_unstale":"2024-07-24T22:05:27.695819+0000","last_undegraded":"2024-07-24T22:05:27.695819+0000","last_fullsized":"2024-07-24T22:05:27.695819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:00:51.849538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574889+0000","last_change":"2024-07-24T22:03:50.385780+0000","last_active":"2024-07-24T22:05:27.574889+0000","last_peered":"2024-07-24T22:05:27.574889+0000","last_clean":"2024-07-24T22:05:27.574889+0000","last_became_active":"2024-07-24T22:03:50.385488+0000","last_became_peered":"2024-07-24T22:03:50.385488+0000","last_unstale":"2024-07-24T22:05:27.574889+0000","last_undegraded":"2024-07-24T22:05:27.574889+0000","last_fullsized":"2024-07-24T22:05:27.574889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:47:35.908303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695950+0000","last_change":"2024-07-24T22:03:53.403103+0000","last_active":"2024-07-24T22:05:27.695950+0000","last_peered":"2024-07-24T22:05:27.695950+0000","last_clean":"2024-07-24T22:05:27.695950+0000","last_became_active":"2024-07-24T22:03:53.402810+0000","last_became_peered":"2024-07-24T22:03:53.402810+0000","last_unstale":"2024-07-24T22:05:27.695950+0000","last_undegraded":"2024-07-24T22:05:27.695950+0000","last_fullsized":"2024-07-24T22:05:27.695950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:15.798983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589069+0000","last_change":"2024-07-24T22:03:50.382383+0000","last_active":"2024-07-24T22:05:27.589069+0000","last_peered":"2024-07-24T22:05:27.589069+0000","last_clean":"2024-07-24T22:05:27.589069+0000","last_became_active":"2024-07-24T22:03:50.381629+0000","last_became_peered":"2024-07-24T22:03:50.381629+0000","last_unstale":"2024-07-24T22:05:27.589069+0000","last_undegraded":"2024-07-24T22:05:27.589069+0000","last_fullsized":"2024-07-24T22:05:27.589069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:17.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572154+0000","last_change":"2024-07-24T22:03:53.409587+0000","last_active":"2024-07-24T22:05:27.572154+0000","last_peered":"2024-07-24T22:05:27.572154+0000","last_clean":"2024-07-24T22:05:27.572154+0000","last_became_active":"2024-07-24T22:03:53.409240+0000","last_became_peered":"2024-07-24T22:03:53.409240+0000","last_unstale":"2024-07-24T22:05:27.572154+0000","last_undegraded":"2024-07-24T22:05:27.572154+0000","last_fullsized":"2024-07-24T22:05:27.572154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:37:18.654244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576466+0000","last_change":"2024-07-24T22:03:50.387933+0000","last_active":"2024-07-24T22:05:27.576466+0000","last_peered":"2024-07-24T22:05:27.576466+0000","last_clean":"2024-07-24T22:05:27.576466+0000","last_became_active":"2024-07-24T22:03:50.386985+0000","last_became_peered":"2024-07-24T22:03:50.386985+0000","last_unstale":"2024-07-24T22:05:27.576466+0000","last_undegraded":"2024-07-24T22:05:27.576466+0000","last_fullsized":"2024-07-24T22:05:27.576466+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:35:29.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696682+0000","last_change":"2024-07-24T22:03:53.404419+0000","last_active":"2024-07-24T22:05:27.696682+0000","last_peered":"2024-07-24T22:05:27.696682+0000","last_clean":"2024-07-24T22:05:27.696682+0000","last_became_active":"2024-07-24T22:03:53.402713+0000","last_became_peered":"2024-07-24T22:03:53.402713+0000","last_unstale":"2024-07-24T22:05:27.696682+0000","last_undegraded":"2024-07-24T22:05:27.696682+0000","last_fullsized":"2024-07-24T22:05:27.696682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:41.262686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575104+0000","last_change":"2024-07-24T22:03:50.511126+0000","last_active":"2024-07-24T22:05:27.575104+0000","last_peered":"2024-07-24T22:05:27.575104+0000","last_clean":"2024-07-24T22:05:27.575104+0000","last_became_active":"2024-07-24T22:03:50.510801+0000","last_became_peered":"2024-07-24T22:03:50.510801+0000","last_unstale":"2024-07-24T22:05:27.575104+0000","last_undegraded":"2024-07-24T22:05:27.575104+0000","last_fullsized":"2024-07-24T22:05:27.575104+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:59:37.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571928+0000","last_change":"2024-07-24T22:03:53.410202+0000","last_active":"2024-07-24T22:05:27.571928+0000","last_peered":"2024-07-24T22:05:27.571928+0000","last_clean":"2024-07-24T22:05:27.571928+0000","last_became_active":"2024-07-24T22:03:53.409884+0000","last_became_peered":"2024-07-24T22:03:53.409884+0000","last_unstale":"2024-07-24T22:05:27.571928+0000","last_undegraded":"2024-07-24T22:05:27.571928+0000","last_fullsized":"2024-07-24T22:05:27.571928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:54:02.603267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'38","reported_seq":431,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:07:00.735612+0000","last_change":"2024-07-24T22:03:50.386993+0000","last_active":"2024-07-24T22:07:00.735612+0000","last_peered":"2024-07-24T22:07:00.735612+0000","last_clean":"2024-07-24T22:07:00.735612+0000","last_became_active":"2024-07-24T22:03:50.386675+0000","last_became_peered":"2024-07-24T22:03:50.386675+0000","last_unstale":"2024-07-24T22:07:00.735612+0000","last_undegraded":"2024-07-24T22:07:00.735612+0000","last_fullsized":"2024-07-24T22:07:00.735612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:20:58.384179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69787,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":361,"num_read_kb":249,"num_write":38,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576569+0000","last_change":"2024-07-24T22:03:53.413293+0000","last_active":"2024-07-24T22:05:27.576569+0000","last_peered":"2024-07-24T22:05:27.576569+0000","last_clean":"2024-07-24T22:05:27.576569+0000","last_became_active":"2024-07-24T22:03:53.412900+0000","last_became_peered":"2024-07-24T22:03:53.412900+0000","last_unstale":"2024-07-24T22:05:27.576569+0000","last_undegraded":"2024-07-24T22:05:27.576569+0000","last_fullsized":"2024-07-24T22:05:27.576569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:11:32.553108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696109+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.696109+0000","last_peered":"2024-07-24T22:05:27.696109+0000","last_clean":"2024-07-24T22:05:27.696109+0000","last_became_active":"2024-07-24T22:03:50.387059+0000","last_became_peered":"2024-07-24T22:03:50.387059+0000","last_unstale":"2024-07-24T22:05:27.696109+0000","last_undegraded":"2024-07-24T22:05:27.696109+0000","last_fullsized":"2024-07-24T22:05:27.696109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:40:06.887090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570910+0000","last_change":"2024-07-24T22:03:53.406808+0000","last_active":"2024-07-24T22:05:27.570910+0000","last_peered":"2024-07-24T22:05:27.570910+0000","last_clean":"2024-07-24T22:05:27.570910+0000","last_became_active":"2024-07-24T22:03:53.406487+0000","last_became_peered":"2024-07-24T22:03:53.406487+0000","last_unstale":"2024-07-24T22:05:27.570910+0000","last_undegraded":"2024-07-24T22:05:27.570910+0000","last_fullsized":"2024-07-24T22:05:27.570910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:44:57.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574923+0000","last_change":"2024-07-24T22:03:50.386881+0000","last_active":"2024-07-24T22:05:27.574923+0000","last_peered":"2024-07-24T22:05:27.574923+0000","last_clean":"2024-07-24T22:05:27.574923+0000","last_became_active":"2024-07-24T22:03:50.386564+0000","last_became_peered":"2024-07-24T22:03:50.386564+0000","last_unstale":"2024-07-24T22:05:27.574923+0000","last_undegraded":"2024-07-24T22:05:27.574923+0000","last_fullsized":"2024-07-24T22:05:27.574923+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:22:22.339854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576277+0000","last_change":"2024-07-24T22:03:53.403207+0000","last_active":"2024-07-24T22:05:27.576277+0000","last_peered":"2024-07-24T22:05:27.576277+0000","last_clean":"2024-07-24T22:05:27.576277+0000","last_became_active":"2024-07-24T22:03:53.402875+0000","last_became_peered":"2024-07-24T22:03:53.402875+0000","last_unstale":"2024-07-24T22:05:27.576277+0000","last_undegraded":"2024-07-24T22:05:27.576277+0000","last_fullsized":"2024-07-24T22:05:27.576277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:25:28.866228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575960+0000","last_change":"2024-07-24T22:03:50.386721+0000","last_active":"2024-07-24T22:05:27.575960+0000","last_peered":"2024-07-24T22:05:27.575960+0000","last_clean":"2024-07-24T22:05:27.575960+0000","last_became_active":"2024-07-24T22:03:50.385654+0000","last_became_peered":"2024-07-24T22:03:50.385654+0000","last_unstale":"2024-07-24T22:05:27.575960+0000","last_undegraded":"2024-07-24T22:05:27.575960+0000","last_fullsized":"2024-07-24T22:05:27.575960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:16:15.802744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575896+0000","last_change":"2024-07-24T22:03:53.405367+0000","last_active":"2024-07-24T22:05:27.575896+0000","last_peered":"2024-07-24T22:05:27.575896+0000","last_clean":"2024-07-24T22:05:27.575896+0000","last_became_active":"2024-07-24T22:03:53.404875+0000","last_became_peered":"2024-07-24T22:03:53.404875+0000","last_unstale":"2024-07-24T22:05:27.575896+0000","last_undegraded":"2024-07-24T22:05:27.575896+0000","last_fullsized":"2024-07-24T22:05:27.575896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:42.247052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575893+0000","last_change":"2024-07-24T22:04:27.574426+0000","last_active":"2024-07-24T22:05:27.575893+0000","last_peered":"2024-07-24T22:05:27.575893+0000","last_clean":"2024-07-24T22:05:27.575893+0000","last_became_active":"2024-07-24T22:04:27.568176+0000","last_became_peered":"2024-07-24T22:04:27.568176+0000","last_unstale":"2024-07-24T22:05:27.575893+0000","last_undegraded":"2024-07-24T22:05:27.575893+0000","last_fullsized":"2024-07-24T22:05:27.575893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:20:37.620669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574893+0000","last_change":"2024-07-24T22:03:53.405136+0000","last_active":"2024-07-24T22:05:27.574893+0000","last_peered":"2024-07-24T22:05:27.574893+0000","last_clean":"2024-07-24T22:05:27.574893+0000","last_became_active":"2024-07-24T22:03:53.404043+0000","last_became_peered":"2024-07-24T22:03:53.404043+0000","last_unstale":"2024-07-24T22:05:27.574893+0000","last_undegraded":"2024-07-24T22:05:27.574893+0000","last_fullsized":"2024-07-24T22:05:27.574893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:03:21.912335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576738+0000","last_change":"2024-07-24T22:03:50.382364+0000","last_active":"2024-07-24T22:05:27.576738+0000","last_peered":"2024-07-24T22:05:27.576738+0000","last_clean":"2024-07-24T22:05:27.576738+0000","last_became_active":"2024-07-24T22:03:50.382029+0000","last_became_peered":"2024-07-24T22:03:50.382029+0000","last_unstale":"2024-07-24T22:05:27.576738+0000","last_undegraded":"2024-07-24T22:05:27.576738+0000","last_fullsized":"2024-07-24T22:05:27.576738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:48:10.004826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573801+0000","last_change":"2024-07-24T22:03:53.413053+0000","last_active":"2024-07-24T22:05:27.573801+0000","last_peered":"2024-07-24T22:05:27.573801+0000","last_clean":"2024-07-24T22:05:27.573801+0000","last_became_active":"2024-07-24T22:03:53.412733+0000","last_became_peered":"2024-07-24T22:03:53.412733+0000","last_unstale":"2024-07-24T22:05:27.573801+0000","last_undegraded":"2024-07-24T22:05:27.573801+0000","last_fullsized":"2024-07-24T22:05:27.573801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:16.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571346+0000","last_change":"2024-07-24T22:03:50.387314+0000","last_active":"2024-07-24T22:05:27.571346+0000","last_peered":"2024-07-24T22:05:27.571346+0000","last_clean":"2024-07-24T22:05:27.571346+0000","last_became_active":"2024-07-24T22:03:50.386919+0000","last_became_peered":"2024-07-24T22:03:50.386919+0000","last_unstale":"2024-07-24T22:05:27.571346+0000","last_undegraded":"2024-07-24T22:05:27.571346+0000","last_fullsized":"2024-07-24T22:05:27.571346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:51:03.203285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576716+0000","last_change":"2024-07-24T22:03:53.411938+0000","last_active":"2024-07-24T22:05:27.576716+0000","last_peered":"2024-07-24T22:05:27.576716+0000","last_clean":"2024-07-24T22:05:27.576716+0000","last_became_active":"2024-07-24T22:03:53.411545+0000","last_became_peered":"2024-07-24T22:03:53.411545+0000","last_unstale":"2024-07-24T22:05:27.576716+0000","last_undegraded":"2024-07-24T22:05:27.576716+0000","last_fullsized":"2024-07-24T22:05:27.576716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:41:19.370886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'60","reported_seq":121,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:06:55.406828+0000","last_change":"2024-07-24T22:03:50.384400+0000","last_active":"2024-07-24T22:06:55.406828+0000","last_peered":"2024-07-24T22:06:55.406828+0000","last_clean":"2024-07-24T22:06:55.406828+0000","last_became_active":"2024-07-24T22:03:50.383945+0000","last_became_peered":"2024-07-24T22:03:50.383945+0000","last_unstale":"2024-07-24T22:06:55.406828+0000","last_undegraded":"2024-07-24T22:06:55.406828+0000","last_fullsized":"2024-07-24T22:06:55.406828+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:16.035171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576430+0000","last_change":"2024-07-24T22:04:27.507390+0000","last_active":"2024-07-24T22:05:27.576430+0000","last_peered":"2024-07-24T22:05:27.576430+0000","last_clean":"2024-07-24T22:05:27.576430+0000","last_became_active":"2024-07-24T22:04:27.504206+0000","last_became_peered":"2024-07-24T22:04:27.504206+0000","last_unstale":"2024-07-24T22:05:27.576430+0000","last_undegraded":"2024-07-24T22:05:27.576430+0000","last_fullsized":"2024-07-24T22:05:27.576430+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:55:21.559702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696182+0000","last_change":"2024-07-24T22:03:50.511075+0000","last_active":"2024-07-24T22:05:27.696182+0000","last_peered":"2024-07-24T22:05:27.696182+0000","last_clean":"2024-07-24T22:05:27.696182+0000","last_became_active":"2024-07-24T22:03:50.510244+0000","last_became_peered":"2024-07-24T22:03:50.510244+0000","last_unstale":"2024-07-24T22:05:27.696182+0000","last_undegraded":"2024-07-24T22:05:27.696182+0000","last_fullsized":"2024-07-24T22:05:27.696182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:54:03.068211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576340+0000","last_change":"2024-07-24T22:03:53.410865+0000","last_active":"2024-07-24T22:05:27.576340+0000","last_peered":"2024-07-24T22:05:27.576340+0000","last_clean":"2024-07-24T22:05:27.576340+0000","last_became_active":"2024-07-24T22:03:53.410255+0000","last_became_peered":"2024-07-24T22:03:53.410255+0000","last_unstale":"2024-07-24T22:05:27.576340+0000","last_undegraded":"2024-07-24T22:05:27.576340+0000","last_fullsized":"2024-07-24T22:05:27.576340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:15.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576134+0000","last_change":"2024-07-24T22:02:33.494929+0000","last_active":"2024-07-24T22:05:27.576134+0000","last_peered":"2024-07-24T22:05:27.576134+0000","last_clean":"2024-07-24T22:05:27.576134+0000","last_became_active":"2024-07-24T22:02:33.489241+0000","last_became_peered":"2024-07-24T22:02:33.489241+0000","last_unstale":"2024-07-24T22:05:27.576134+0000","last_undegraded":"2024-07-24T22:05:27.576134+0000","last_fullsized":"2024-07-24T22:05:27.576134+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_clean_scrub_stamp":"2024-07-24T21:59:32.406119+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:46.421413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576268+0000","last_change":"2024-07-24T22:03:50.385093+0000","last_active":"2024-07-24T22:05:27.576268+0000","last_peered":"2024-07-24T22:05:27.576268+0000","last_clean":"2024-07-24T22:05:27.576268+0000","last_became_active":"2024-07-24T22:03:50.384639+0000","last_became_peered":"2024-07-24T22:03:50.384639+0000","last_unstale":"2024-07-24T22:05:27.576268+0000","last_undegraded":"2024-07-24T22:05:27.576268+0000","last_fullsized":"2024-07-24T22:05:27.576268+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:06:10.402336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696068+0000","last_change":"2024-07-24T22:03:53.409627+0000","last_active":"2024-07-24T22:05:27.696068+0000","last_peered":"2024-07-24T22:05:27.696068+0000","last_clean":"2024-07-24T22:05:27.696068+0000","last_became_active":"2024-07-24T22:03:53.409295+0000","last_became_peered":"2024-07-24T22:03:53.409295+0000","last_unstale":"2024-07-24T22:05:27.696068+0000","last_undegraded":"2024-07-24T22:05:27.696068+0000","last_fullsized":"2024-07-24T22:05:27.696068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:23:39.670020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576402+0000","last_change":"2024-07-24T22:03:50.385772+0000","last_active":"2024-07-24T22:05:27.576402+0000","last_peered":"2024-07-24T22:05:27.576402+0000","last_clean":"2024-07-24T22:05:27.576402+0000","last_became_active":"2024-07-24T22:03:50.385421+0000","last_became_peered":"2024-07-24T22:03:50.385421+0000","last_unstale":"2024-07-24T22:05:27.576402+0000","last_undegraded":"2024-07-24T22:05:27.576402+0000","last_fullsized":"2024-07-24T22:05:27.576402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:58:57.227697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570892+0000","last_change":"2024-07-24T22:03:53.400558+0000","last_active":"2024-07-24T22:05:27.570892+0000","last_peered":"2024-07-24T22:05:27.570892+0000","last_clean":"2024-07-24T22:05:27.570892+0000","last_became_active":"2024-07-24T22:03:53.400131+0000","last_became_peered":"2024-07-24T22:03:53.400131+0000","last_unstale":"2024-07-24T22:05:27.570892+0000","last_undegraded":"2024-07-24T22:05:27.570892+0000","last_fullsized":"2024-07-24T22:05:27.570892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:57:57.586742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571018+0000","last_change":"2024-07-24T22:03:50.510189+0000","last_active":"2024-07-24T22:05:27.571018+0000","last_peered":"2024-07-24T22:05:27.571018+0000","last_clean":"2024-07-24T22:05:27.571018+0000","last_became_active":"2024-07-24T22:03:50.509857+0000","last_became_peered":"2024-07-24T22:03:50.509857+0000","last_unstale":"2024-07-24T22:05:27.571018+0000","last_undegraded":"2024-07-24T22:05:27.571018+0000","last_fullsized":"2024-07-24T22:05:27.571018+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:05:59.240650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574703+0000","last_change":"2024-07-24T22:04:27.505187+0000","last_active":"2024-07-24T22:05:27.574703+0000","last_peered":"2024-07-24T22:05:27.574703+0000","last_clean":"2024-07-24T22:05:27.574703+0000","last_became_active":"2024-07-24T22:04:27.504785+0000","last_became_peered":"2024-07-24T22:04:27.504785+0000","last_unstale":"2024-07-24T22:05:27.574703+0000","last_undegraded":"2024-07-24T22:05:27.574703+0000","last_fullsized":"2024-07-24T22:05:27.574703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:47:33.516835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576182+0000","last_change":"2024-07-24T22:05:27.575016+0000","last_active":"2024-07-24T22:05:27.576182+0000","last_peered":"2024-07-24T22:05:27.576182+0000","last_clean":"2024-07-24T22:05:27.576182+0000","last_became_active":"2024-07-24T22:05:27.574644+0000","last_became_peered":"2024-07-24T22:05:27.574644+0000","last_unstale":"2024-07-24T22:05:27.576182+0000","last_undegraded":"2024-07-24T22:05:27.576182+0000","last_fullsized":"2024-07-24T22:05:27.576182+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:11:37.759190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588938+0000","last_change":"2024-07-24T22:03:53.399369+0000","last_active":"2024-07-24T22:05:27.588938+0000","last_peered":"2024-07-24T22:05:27.588938+0000","last_clean":"2024-07-24T22:05:27.588938+0000","last_became_active":"2024-07-24T22:03:53.399001+0000","last_became_peered":"2024-07-24T22:03:53.399001+0000","last_unstale":"2024-07-24T22:05:27.588938+0000","last_undegraded":"2024-07-24T22:05:27.588938+0000","last_fullsized":"2024-07-24T22:05:27.588938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:26:46.531080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695870+0000","last_change":"2024-07-24T22:03:50.510889+0000","last_active":"2024-07-24T22:05:27.695870+0000","last_peered":"2024-07-24T22:05:27.695870+0000","last_clean":"2024-07-24T22:05:27.695870+0000","last_became_active":"2024-07-24T22:03:50.510366+0000","last_became_peered":"2024-07-24T22:03:50.510366+0000","last_unstale":"2024-07-24T22:05:27.695870+0000","last_undegraded":"2024-07-24T22:05:27.695870+0000","last_fullsized":"2024-07-24T22:05:27.695870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:47:54.838304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589019+0000","last_change":"2024-07-24T22:03:53.398987+0000","last_active":"2024-07-24T22:05:27.589019+0000","last_peered":"2024-07-24T22:05:27.589019+0000","last_clean":"2024-07-24T22:05:27.589019+0000","last_became_active":"2024-07-24T22:03:53.398604+0000","last_became_peered":"2024-07-24T22:03:53.398604+0000","last_unstale":"2024-07-24T22:05:27.589019+0000","last_undegraded":"2024-07-24T22:05:27.589019+0000","last_fullsized":"2024-07-24T22:05:27.589019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:28:41.684174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576685+0000","last_change":"2024-07-24T22:03:50.510623+0000","last_active":"2024-07-24T22:05:27.576685+0000","last_peered":"2024-07-24T22:05:27.576685+0000","last_clean":"2024-07-24T22:05:27.576685+0000","last_became_active":"2024-07-24T22:03:50.510204+0000","last_became_peered":"2024-07-24T22:03:50.510204+0000","last_unstale":"2024-07-24T22:05:27.576685+0000","last_undegraded":"2024-07-24T22:05:27.576685+0000","last_fullsized":"2024-07-24T22:05:27.576685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:06:40.838840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571179+0000","last_change":"2024-07-24T22:03:53.400289+0000","last_active":"2024-07-24T22:05:27.571179+0000","last_peered":"2024-07-24T22:05:27.571179+0000","last_clean":"2024-07-24T22:05:27.571179+0000","last_became_active":"2024-07-24T22:03:53.399939+0000","last_became_peered":"2024-07-24T22:03:53.399939+0000","last_unstale":"2024-07-24T22:05:27.571179+0000","last_undegraded":"2024-07-24T22:05:27.571179+0000","last_fullsized":"2024-07-24T22:05:27.571179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:29:26.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'119","reported_seq":272,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:07:00.134043+0000","last_change":"2024-07-24T22:03:50.382776+0000","last_active":"2024-07-24T22:07:00.134043+0000","last_peered":"2024-07-24T22:07:00.134043+0000","last_clean":"2024-07-24T22:07:00.134043+0000","last_became_active":"2024-07-24T22:03:50.382474+0000","last_became_peered":"2024-07-24T22:03:50.382474+0000","last_unstale":"2024-07-24T22:07:00.134043+0000","last_undegraded":"2024-07-24T22:07:00.134043+0000","last_fullsized":"2024-07-24T22:07:00.134043+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:59:34.688895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":412,"num_read_kb":367,"num_write":222,"num_write_kb":1350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696694+0000","last_change":"2024-07-24T22:03:53.407883+0000","last_active":"2024-07-24T22:05:27.696694+0000","last_peered":"2024-07-24T22:05:27.696694+0000","last_clean":"2024-07-24T22:05:27.696694+0000","last_became_active":"2024-07-24T22:03:53.407524+0000","last_became_peered":"2024-07-24T22:03:53.407524+0000","last_unstale":"2024-07-24T22:05:27.696694+0000","last_undegraded":"2024-07-24T22:05:27.696694+0000","last_fullsized":"2024-07-24T22:05:27.696694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:52:25.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576771+0000","last_change":"2024-07-24T22:03:50.388789+0000","last_active":"2024-07-24T22:05:27.576771+0000","last_peered":"2024-07-24T22:05:27.576771+0000","last_clean":"2024-07-24T22:05:27.576771+0000","last_became_active":"2024-07-24T22:03:50.385439+0000","last_became_peered":"2024-07-24T22:03:50.385439+0000","last_unstale":"2024-07-24T22:05:27.576771+0000","last_undegraded":"2024-07-24T22:05:27.576771+0000","last_fullsized":"2024-07-24T22:05:27.576771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:14:25.009588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696603+0000","last_change":"2024-07-24T22:04:27.503956+0000","last_active":"2024-07-24T22:05:27.696603+0000","last_peered":"2024-07-24T22:05:27.696603+0000","last_clean":"2024-07-24T22:05:27.696603+0000","last_became_active":"2024-07-24T22:04:27.503498+0000","last_became_peered":"2024-07-24T22:04:27.503498+0000","last_unstale":"2024-07-24T22:05:27.696603+0000","last_undegraded":"2024-07-24T22:05:27.696603+0000","last_fullsized":"2024-07-24T22:05:27.696603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:23:20.294458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571757+0000","last_change":"2024-07-24T22:03:50.510687+0000","last_active":"2024-07-24T22:05:27.571757+0000","last_peered":"2024-07-24T22:05:27.571757+0000","last_clean":"2024-07-24T22:05:27.571757+0000","last_became_active":"2024-07-24T22:03:50.510310+0000","last_became_peered":"2024-07-24T22:03:50.510310+0000","last_unstale":"2024-07-24T22:05:27.571757+0000","last_undegraded":"2024-07-24T22:05:27.571757+0000","last_fullsized":"2024-07-24T22:05:27.571757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:14:29.957324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576327+0000","last_change":"2024-07-24T22:03:53.412711+0000","last_active":"2024-07-24T22:05:27.576327+0000","last_peered":"2024-07-24T22:05:27.576327+0000","last_clean":"2024-07-24T22:05:27.576327+0000","last_became_active":"2024-07-24T22:03:53.412375+0000","last_became_peered":"2024-07-24T22:03:53.412375+0000","last_unstale":"2024-07-24T22:05:27.576327+0000","last_undegraded":"2024-07-24T22:05:27.576327+0000","last_fullsized":"2024-07-24T22:05:27.576327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:55:29.441385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696331+0000","last_change":"2024-07-24T22:03:50.383094+0000","last_active":"2024-07-24T22:05:27.696331+0000","last_peered":"2024-07-24T22:05:27.696331+0000","last_clean":"2024-07-24T22:05:27.696331+0000","last_became_active":"2024-07-24T22:03:50.382687+0000","last_became_peered":"2024-07-24T22:03:50.382687+0000","last_unstale":"2024-07-24T22:05:27.696331+0000","last_undegraded":"2024-07-24T22:05:27.696331+0000","last_fullsized":"2024-07-24T22:05:27.696331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:32:02.727855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573366+0000","last_change":"2024-07-24T22:03:53.403709+0000","last_active":"2024-07-24T22:05:27.573366+0000","last_peered":"2024-07-24T22:05:27.573366+0000","last_clean":"2024-07-24T22:05:27.573366+0000","last_became_active":"2024-07-24T22:03:53.403334+0000","last_became_peered":"2024-07-24T22:03:53.403334+0000","last_unstale":"2024-07-24T22:05:27.573366+0000","last_undegraded":"2024-07-24T22:05:27.573366+0000","last_fullsized":"2024-07-24T22:05:27.573366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:27:50.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695814+0000","last_change":"2024-07-24T22:03:50.385547+0000","last_active":"2024-07-24T22:05:27.695814+0000","last_peered":"2024-07-24T22:05:27.695814+0000","last_clean":"2024-07-24T22:05:27.695814+0000","last_became_active":"2024-07-24T22:03:50.385233+0000","last_became_peered":"2024-07-24T22:03:50.385233+0000","last_unstale":"2024-07-24T22:05:27.695814+0000","last_undegraded":"2024-07-24T22:05:27.695814+0000","last_fullsized":"2024-07-24T22:05:27.695814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:40:04.647242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696043+0000","last_change":"2024-07-24T22:03:53.402386+0000","last_active":"2024-07-24T22:05:27.696043+0000","last_peered":"2024-07-24T22:05:27.696043+0000","last_clean":"2024-07-24T22:05:27.696043+0000","last_became_active":"2024-07-24T22:03:53.399363+0000","last_became_peered":"2024-07-24T22:03:53.399363+0000","last_unstale":"2024-07-24T22:05:27.696043+0000","last_undegraded":"2024-07-24T22:05:27.696043+0000","last_fullsized":"2024-07-24T22:05:27.696043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:19:05.835280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576088+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.576088+0000","last_peered":"2024-07-24T22:05:27.576088+0000","last_clean":"2024-07-24T22:05:27.576088+0000","last_became_active":"2024-07-24T22:03:50.387097+0000","last_became_peered":"2024-07-24T22:03:50.387097+0000","last_unstale":"2024-07-24T22:05:27.576088+0000","last_undegraded":"2024-07-24T22:05:27.576088+0000","last_fullsized":"2024-07-24T22:05:27.576088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:11:23.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576510+0000","last_change":"2024-07-24T22:03:53.407386+0000","last_active":"2024-07-24T22:05:27.576510+0000","last_peered":"2024-07-24T22:05:27.576510+0000","last_clean":"2024-07-24T22:05:27.576510+0000","last_became_active":"2024-07-24T22:03:53.407059+0000","last_became_peered":"2024-07-24T22:03:53.407059+0000","last_unstale":"2024-07-24T22:05:27.576510+0000","last_undegraded":"2024-07-24T22:05:27.576510+0000","last_fullsized":"2024-07-24T22:05:27.576510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:12:38.508170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695820+0000","last_change":"2024-07-24T22:04:27.567714+0000","last_active":"2024-07-24T22:05:27.695820+0000","last_peered":"2024-07-24T22:05:27.695820+0000","last_clean":"2024-07-24T22:05:27.695820+0000","last_became_active":"2024-07-24T22:04:27.567492+0000","last_became_peered":"2024-07-24T22:04:27.567492+0000","last_unstale":"2024-07-24T22:05:27.695820+0000","last_undegraded":"2024-07-24T22:05:27.695820+0000","last_fullsized":"2024-07-24T22:05:27.695820+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:00:13.705346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576278+0000","last_change":"2024-07-24T22:03:50.385538+0000","last_active":"2024-07-24T22:05:27.576278+0000","last_peered":"2024-07-24T22:05:27.576278+0000","last_clean":"2024-07-24T22:05:27.576278+0000","last_became_active":"2024-07-24T22:03:50.385191+0000","last_became_peered":"2024-07-24T22:03:50.385191+0000","last_unstale":"2024-07-24T22:05:27.576278+0000","last_undegraded":"2024-07-24T22:05:27.576278+0000","last_fullsized":"2024-07-24T22:05:27.576278+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:33:37.674903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571800+0000","last_change":"2024-07-24T22:03:53.411751+0000","last_active":"2024-07-24T22:05:27.571800+0000","last_peered":"2024-07-24T22:05:27.571800+0000","last_clean":"2024-07-24T22:05:27.571800+0000","last_became_active":"2024-07-24T22:03:53.410827+0000","last_became_peered":"2024-07-24T22:03:53.410827+0000","last_unstale":"2024-07-24T22:05:27.571800+0000","last_undegraded":"2024-07-24T22:05:27.571800+0000","last_fullsized":"2024-07-24T22:05:27.571800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:07:26.439047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.584159+0000","last_change":"2024-07-24T22:05:27.581982+0000","last_active":"2024-07-24T22:05:27.584159+0000","last_peered":"2024-07-24T22:05:27.584159+0000","last_clean":"2024-07-24T22:05:27.584159+0000","last_became_active":"2024-07-24T22:05:27.577413+0000","last_became_peered":"2024-07-24T22:05:27.577413+0000","last_unstale":"2024-07-24T22:05:27.584159+0000","last_undegraded":"2024-07-24T22:05:27.584159+0000","last_fullsized":"2024-07-24T22:05:27.584159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:40:27.424379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696604+0000","last_change":"2024-07-24T22:03:53.406029+0000","last_active":"2024-07-24T22:05:27.696604+0000","last_peered":"2024-07-24T22:05:27.696604+0000","last_clean":"2024-07-24T22:05:27.696604+0000","last_became_active":"2024-07-24T22:03:53.405529+0000","last_became_peered":"2024-07-24T22:03:53.405529+0000","last_unstale":"2024-07-24T22:05:27.696604+0000","last_undegraded":"2024-07-24T22:05:27.696604+0000","last_fullsized":"2024-07-24T22:05:27.696604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:57:02.290836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696580+0000","last_change":"2024-07-24T22:03:50.510884+0000","last_active":"2024-07-24T22:05:27.696580+0000","last_peered":"2024-07-24T22:05:27.696580+0000","last_clean":"2024-07-24T22:05:27.696580+0000","last_became_active":"2024-07-24T22:03:50.509851+0000","last_became_peered":"2024-07-24T22:03:50.509851+0000","last_unstale":"2024-07-24T22:05:27.696580+0000","last_undegraded":"2024-07-24T22:05:27.696580+0000","last_fullsized":"2024-07-24T22:05:27.696580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:37:55.735488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696364+0000","last_change":"2024-07-24T22:03:53.409966+0000","last_active":"2024-07-24T22:05:27.696364+0000","last_peered":"2024-07-24T22:05:27.696364+0000","last_clean":"2024-07-24T22:05:27.696364+0000","last_became_active":"2024-07-24T22:03:53.409652+0000","last_became_peered":"2024-07-24T22:03:53.409652+0000","last_unstale":"2024-07-24T22:05:27.696364+0000","last_undegraded":"2024-07-24T22:05:27.696364+0000","last_fullsized":"2024-07-24T22:05:27.696364+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:10:53.262459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:59.016697+0000","last_change":"2024-07-24T22:04:27.571166+0000","last_active":"2024-07-24T22:05:59.016697+0000","last_peered":"2024-07-24T22:05:59.016697+0000","last_clean":"2024-07-24T22:05:59.016697+0000","last_became_active":"2024-07-24T22:04:27.567419+0000","last_became_peered":"2024-07-24T22:04:27.567419+0000","last_unstale":"2024-07-24T22:05:59.016697+0000","last_undegraded":"2024-07-24T22:05:59.016697+0000","last_fullsized":"2024-07-24T22:05:59.016697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:37:11.513631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":857577,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":812,"num_read_kb":654,"num_write":368,"num_write_kb":2320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2666496,"data_stored":2571209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":248,"ondisk_log_size":248,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612662,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":937984,"data_stored":469642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29112,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716040,"statfs":{"total":95995035648,"available":95965224960,"internally_reserved":0,"allocated":2023424,"data_stored":1523884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972415,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40804,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704348,"statfs":{"total":95995035648,"available":95953252352,"internally_reserved":0,"allocated":1339392,"data_stored":863557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168644,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36640,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708512,"statfs":{"total":95995035648,"available":95957516288,"internally_reserved":0,"allocated":1335296,"data_stored":862880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397575,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1540096,"data_stored":1060709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561100,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":469759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757328,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28976,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716176,"statfs":{"total":95995035648,"available":95965364224,"internally_reserved":0,"allocated":1945600,"data_stored":1454085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920852,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117081,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41316,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703836,"statfs":{"total":95995035648,"available":95952728064,"internally_reserved":0,"allocated":1740800,"data_stored":1256855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378718,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":539463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542242,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":538489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705765,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":68847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":798720,"data_stored":787096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":463757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T22:07:05.351 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-07-24T22:07:05.351 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph pg dump --format=json 2024-07-24T22:07:05.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:05 smithi188 ceph-mon[37380]: pgmap v362: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 185 KiB/s wr, 61 op/s 2024-07-24T22:07:05.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:05 smithi188 ceph-mon[37380]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:07:05.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:05 smithi183 ceph-mon[37007]: pgmap v362: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 185 KiB/s wr, 61 op/s 2024-07-24T22:07:05.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:05 smithi183 ceph-mon[37007]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:07:05.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:05 smithi047 ceph-mon[32551]: pgmap v362: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 185 KiB/s wr, 61 op/s 2024-07-24T22:07:05.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:05 smithi047 ceph-mon[32551]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:07:06.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.295+0000 7ff8752ae640 1 -- 172.21.15.47:0/3980458554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff870101b50 msgr2=0x7ff87010e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:06.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.295+0000 7ff8752ae640 1 --2- 172.21.15.47:0/3980458554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff870101b50 0x7ff87010e8a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff864009900 tx=0x7ff86402a480 comp rx=0 tx=0).stop 2024-07-24T22:07:06.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.295+0000 7ff8752ae640 1 -- 172.21.15.47:0/3980458554 shutdown_connections 2024-07-24T22:07:06.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.295+0000 7ff8752ae640 1 --2- 172.21.15.47:0/3980458554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff87010ede0 0x7ff8701111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:06.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.295+0000 7ff8752ae640 1 --2- 172.21.15.47:0/3980458554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff870101b50 0x7ff87010e8a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:06.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.295+0000 7ff8752ae640 1 --2- 172.21.15.47:0/3980458554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff870101230 0x7ff870101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:06.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.295+0000 7ff8752ae640 1 -- 172.21.15.47:0/3980458554 >> 172.21.15.47:0/3980458554 conn(0x7ff8700fd100 msgr2=0x7ff8700ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:06.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.295+0000 7ff8752ae640 1 -- 172.21.15.47:0/3980458554 shutdown_connections 2024-07-24T22:07:06.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.295+0000 7ff8752ae640 1 -- 172.21.15.47:0/3980458554 wait complete. 2024-07-24T22:07:06.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.296+0000 7ff8752ae640 1 Processor -- start 2024-07-24T22:07:06.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.296+0000 7ff8752ae640 1 -- start start 2024-07-24T22:07:06.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.296+0000 7ff8752ae640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff870101230 0x7ff87019aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:06.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.296+0000 7ff8752ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff870101b50 0x7ff87019b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:06.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.296+0000 7ff8752ae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff87010ede0 0x7ff8701a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:06.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.296+0000 7ff8752ae640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff870114a20 con 0x7ff87010ede0 2024-07-24T22:07:06.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.296+0000 7ff8752ae640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff8701148a0 con 0x7ff870101230 2024-07-24T22:07:06.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.296+0000 7ff8752ae640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff870114ba0 con 0x7ff870101b50 2024-07-24T22:07:06.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.296+0000 7ff86f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff87010ede0 0x7ff8701a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:06.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff86f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff87010ede0 0x7ff8701a08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33258/0 (socket says 172.21.15.47:33258) 2024-07-24T22:07:06.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff86f7fe640 1 -- 172.21.15.47:0/1862915279 learned_addr learned my addr 172.21.15.47:0/1862915279 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:06.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff86effd640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff870101230 0x7ff87019aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:06.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff86e7fc640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff870101b50 0x7ff87019b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:06.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff86f7fe640 1 -- 172.21.15.47:0/1862915279 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff870101b50 msgr2=0x7ff87019b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:06.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff86f7fe640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff870101b50 0x7ff87019b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:06.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff86f7fe640 1 -- 172.21.15.47:0/1862915279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff870101230 msgr2=0x7ff87019aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:06.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff86f7fe640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff870101230 0x7ff87019aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:06.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff86f7fe640 1 -- 172.21.15.47:0/1862915279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8701a10a0 con 0x7ff87010ede0 2024-07-24T22:07:06.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff86f7fe640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff87010ede0 0x7ff8701a08d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff86800b970 tx=0x7ff86800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:06.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff857fff640 1 -- 172.21.15.47:0/1862915279 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff868019070 con 0x7ff87010ede0 2024-07-24T22:07:06.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff8752ae640 1 -- 172.21.15.47:0/1862915279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8701a1390 con 0x7ff87010ede0 2024-07-24T22:07:06.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff857fff640 1 -- 172.21.15.47:0/1862915279 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff868014440 con 0x7ff87010ede0 2024-07-24T22:07:06.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff857fff640 1 -- 172.21.15.47:0/1862915279 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8680075d0 con 0x7ff87010ede0 2024-07-24T22:07:06.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.297+0000 7ff8752ae640 1 -- 172.21.15.47:0/1862915279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8701a7a50 con 0x7ff87010ede0 2024-07-24T22:07:06.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.298+0000 7ff8752ae640 1 -- 172.21.15.47:0/1862915279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff870101690 con 0x7ff87010ede0 2024-07-24T22:07:06.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.300+0000 7ff857fff640 1 -- 172.21.15.47:0/1862915279 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7ff86801c070 con 0x7ff87010ede0 2024-07-24T22:07:06.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.300+0000 7ff857fff640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff8580b3d40 0x7ff8580b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:06.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.301+0000 7ff86effd640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff8580b3d40 0x7ff8580b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:06.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.301+0000 7ff857fff640 1 -- 172.21.15.47:0/1862915279 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ff8680e3970 con 0x7ff87010ede0 2024-07-24T22:07:06.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.301+0000 7ff86effd640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff8580b3d40 0x7ff8580b6200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff860009990 tx=0x7ff860009110 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:06.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.303+0000 7ff857fff640 1 -- 172.21.15.47:0/1862915279 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7ff8680aad90 con 0x7ff87010ede0 2024-07-24T22:07:06.472 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:06.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.552+0000 7ff8752ae640 1 -- 172.21.15.47:0/1862915279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff87019c120 con 0x7ff87010ede0 2024-07-24T22:07:06.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.553+0000 7ff857fff640 1 -- 172.21.15.47:0/1862915279 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7ff87019c120 con 0x7ff87010ede0 2024-07-24T22:07:06.555 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:07:06.555 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:07:06.555 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:07:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.555+0000 7ff8752ae640 1 -- 172.21.15.47:0/1862915279 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff8580b3d40 msgr2=0x7ff8580b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.555+0000 7ff8752ae640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff8580b3d40 0x7ff8580b6200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff860009990 tx=0x7ff860009110 comp rx=0 tx=0).stop 2024-07-24T22:07:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.555+0000 7ff8752ae640 1 -- 172.21.15.47:0/1862915279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff87010ede0 msgr2=0x7ff8701a08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.555+0000 7ff8752ae640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff87010ede0 0x7ff8701a08d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff86800b970 tx=0x7ff86800bd70 comp rx=0 tx=0).stop 2024-07-24T22:07:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.555+0000 7ff8752ae640 1 -- 172.21.15.47:0/1862915279 shutdown_connections 2024-07-24T22:07:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.555+0000 7ff8752ae640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff8580b3d40 0x7ff8580b6200 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:06.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.555+0000 7ff8752ae640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff87010ede0 0x7ff8701a08d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:06.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.555+0000 7ff8752ae640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff870101b50 0x7ff87019b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:06.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.555+0000 7ff8752ae640 1 --2- 172.21.15.47:0/1862915279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff870101230 0x7ff87019aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:06.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.555+0000 7ff8752ae640 1 -- 172.21.15.47:0/1862915279 >> 172.21.15.47:0/1862915279 conn(0x7ff8700fd100 msgr2=0x7ff870110270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:06.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.555+0000 7ff8752ae640 1 -- 172.21.15.47:0/1862915279 shutdown_connections 2024-07-24T22:07:06.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:06.555+0000 7ff8752ae640 1 -- 172.21.15.47:0/1862915279 wait complete. 2024-07-24T22:07:07.521 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:07 smithi047 ceph-mon[32551]: pgmap v363: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 196 KiB/s wr, 63 op/s 2024-07-24T22:07:07.521 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:07 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1862915279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:07.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:07 smithi188 ceph-mon[37380]: pgmap v363: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 196 KiB/s wr, 63 op/s 2024-07-24T22:07:07.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:07 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1862915279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:07.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:07 smithi183 ceph-mon[37007]: pgmap v363: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 196 KiB/s wr, 63 op/s 2024-07-24T22:07:07.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:07 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1862915279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:07.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:07:08.431 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:08.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.887+0000 7fafa861c640 1 -- 172.21.15.47:0/2939640339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafa0107a20 msgr2=0x7fafa010e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:08.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.887+0000 7fafa861c640 1 --2- 172.21.15.47:0/2939640339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafa0107a20 0x7fafa010e220 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7faf98009ca0 tx=0x7faf9802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:07:08.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.887+0000 7fafa861c640 1 -- 172.21.15.47:0/2939640339 shutdown_connections 2024-07-24T22:07:08.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.887+0000 7fafa861c640 1 --2- 172.21.15.47:0/2939640339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafa0107a20 0x7fafa010e220 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:08.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.887+0000 7fafa861c640 1 --2- 172.21.15.47:0/2939640339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa01070a0 0x7fafa01074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:08.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.887+0000 7fafa861c640 1 --2- 172.21.15.47:0/2939640339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafa0101690 0x7fafa0101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:08.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.887+0000 7fafa861c640 1 -- 172.21.15.47:0/2939640339 >> 172.21.15.47:0/2939640339 conn(0x7fafa00fd100 msgr2=0x7fafa00ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:08.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.887+0000 7fafa861c640 1 -- 172.21.15.47:0/2939640339 shutdown_connections 2024-07-24T22:07:08.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.887+0000 7fafa861c640 1 -- 172.21.15.47:0/2939640339 wait complete. 2024-07-24T22:07:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa861c640 1 Processor -- start 2024-07-24T22:07:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa861c640 1 -- start start 2024-07-24T22:07:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa861c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafa0101690 0x7fafa0199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa861c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafa01070a0 0x7fafa0199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa861c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa0107a20 0x7fafa019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa861c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fafa01116a0 con 0x7fafa01070a0 2024-07-24T22:07:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa861c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fafa0111520 con 0x7fafa0101690 2024-07-24T22:07:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa861c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fafa0111820 con 0x7fafa0107a20 2024-07-24T22:07:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa5bb7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafa01070a0 0x7fafa0199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa5bb7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafa01070a0 0x7fafa0199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33278/0 (socket says 172.21.15.47:33278) 2024-07-24T22:07:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa5bb7640 1 -- 172.21.15.47:0/3050173749 learned_addr learned my addr 172.21.15.47:0/3050173749 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa63b8640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafa0101690 0x7fafa0199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa6bb9640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa0107a20 0x7fafa019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa5bb7640 1 -- 172.21.15.47:0/3050173749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa0107a20 msgr2=0x7fafa019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa5bb7640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa0107a20 0x7fafa019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa5bb7640 1 -- 172.21.15.47:0/3050173749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafa0101690 msgr2=0x7fafa0199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa5bb7640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafa0101690 0x7fafa0199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa5bb7640 1 -- 172.21.15.47:0/3050173749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa01a4e50 con 0x7fafa01070a0 2024-07-24T22:07:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.888+0000 7fafa63b8640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafa0101690 0x7fafa0199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.889+0000 7fafa5bb7640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafa01070a0 0x7fafa0199fb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7faf9000b4a0 tx=0x7faf9000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.889+0000 7faf977fe640 1 -- 172.21.15.47:0/3050173749 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90014070 con 0x7fafa01070a0 2024-07-24T22:07:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.889+0000 7faf977fe640 1 -- 172.21.15.47:0/3050173749 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf90010ac0 con 0x7fafa01070a0 2024-07-24T22:07:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.889+0000 7fafa861c640 1 -- 172.21.15.47:0/3050173749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa01a5140 con 0x7fafa01070a0 2024-07-24T22:07:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.889+0000 7faf977fe640 1 -- 172.21.15.47:0/3050173749 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90017c30 con 0x7fafa01070a0 2024-07-24T22:07:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.889+0000 7fafa861c640 1 -- 172.21.15.47:0/3050173749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa01a5700 con 0x7fafa01070a0 2024-07-24T22:07:08.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.890+0000 7fafa861c640 1 -- 172.21.15.47:0/3050173749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa0101a70 con 0x7fafa01070a0 2024-07-24T22:07:08.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.892+0000 7faf977fe640 1 -- 172.21.15.47:0/3050173749 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7faf90017070 con 0x7fafa01070a0 2024-07-24T22:07:08.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.892+0000 7faf977fe640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faf8c0b3dc0 0x7faf8c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:08.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.892+0000 7fafa63b8640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faf8c0b3dc0 0x7faf8c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:08.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.892+0000 7faf977fe640 1 -- 172.21.15.47:0/3050173749 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7faf900e3710 con 0x7fafa01070a0 2024-07-24T22:07:08.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.893+0000 7fafa63b8640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faf8c0b3dc0 0x7faf8c0b6280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faf9c0058c0 tx=0x7faf9c005ec0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:08.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:08.895+0000 7faf977fe640 1 -- 172.21.15.47:0/3050173749 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7faf900aab30 con 0x7fafa01070a0 2024-07-24T22:07:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.998+0000 7fd69bad3640 1 -- 172.21.15.47:0/2201854245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd694103ef0 msgr2=0x7fd69410c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.998+0000 7fd69bad3640 1 --2- 172.21.15.47:0/2201854245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd694103ef0 0x7fd69410c3d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd684009900 tx=0x7fd68402a410 comp rx=0 tx=0).stop 2024-07-24T22:07:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.998+0000 7fd69bad3640 1 -- 172.21.15.47:0/2201854245 shutdown_connections 2024-07-24T22:07:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.998+0000 7fd69bad3640 1 --2- 172.21.15.47:0/2201854245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd69410c9f0 0x7fd69410ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.998+0000 7fd69bad3640 1 --2- 172.21.15.47:0/2201854245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd694103ef0 0x7fd69410c3d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.998+0000 7fd69bad3640 1 --2- 172.21.15.47:0/2201854245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6941035d0 0x7fd6941039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.998+0000 7fd69bad3640 1 -- 172.21.15.47:0/2201854245 >> 172.21.15.47:0/2201854245 conn(0x7fd6940782e0 msgr2=0x7fd6940ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.998+0000 7fd69bad3640 1 -- 172.21.15.47:0/2201854245 shutdown_connections 2024-07-24T22:07:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.998+0000 7fd69bad3640 1 -- 172.21.15.47:0/2201854245 wait complete. 2024-07-24T22:07:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.998+0000 7fd69bad3640 1 Processor -- start 2024-07-24T22:07:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.998+0000 7fd69bad3640 1 -- start start 2024-07-24T22:07:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69bad3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6941035d0 0x7fd694198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69bad3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd694103ef0 0x7fd694199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69bad3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd69410c9f0 0x7fd69419e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69bad3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd694112670 con 0x7fd6941035d0 2024-07-24T22:07:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69bad3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd6941124f0 con 0x7fd69410c9f0 2024-07-24T22:07:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69bad3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd6941127f0 con 0x7fd694103ef0 2024-07-24T22:07:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69986f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6941035d0 0x7fd694198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69986f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6941035d0 0x7fd694198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33306/0 (socket says 172.21.15.47:33306) 2024-07-24T22:07:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69986f640 1 -- 172.21.15.47:0/1901912019 learned_addr learned my addr 172.21.15.47:0/1901912019 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69a070640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd69410c9f0 0x7fd69419e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69906e640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd694103ef0 0x7fd694199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69986f640 1 -- 172.21.15.47:0/1901912019 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd694103ef0 msgr2=0x7fd694199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69986f640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd694103ef0 0x7fd694199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69986f640 1 -- 172.21.15.47:0/1901912019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd69410c9f0 msgr2=0x7fd69419e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69986f640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd69410c9f0 0x7fd69419e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69986f640 1 -- 172.21.15.47:0/1901912019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69419ecb0 con 0x7fd6941035d0 2024-07-24T22:07:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69986f640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6941035d0 0x7fd694198c10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd69000d950 tx=0x7fd69000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd68affd640 1 -- 172.21.15.47:0/1901912019 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690017070 con 0x7fd6941035d0 2024-07-24T22:07:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd69bad3640 1 -- 172.21.15.47:0/1901912019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69419efa0 con 0x7fd6941035d0 2024-07-24T22:07:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd68affd640 1 -- 172.21.15.47:0/1901912019 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd690009c30 con 0x7fd6941035d0 2024-07-24T22:07:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:08.999+0000 7fd68affd640 1 -- 172.21.15.47:0/1901912019 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69000f620 con 0x7fd6941035d0 2024-07-24T22:07:09.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.000+0000 7fd69bad3640 1 -- 172.21.15.47:0/1901912019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6941a5660 con 0x7fd6941035d0 2024-07-24T22:07:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.002+0000 7fd69e820740 1 Processor -- start 2024-07-24T22:07:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.002+0000 7fd68affd640 1 -- 172.21.15.47:0/1901912019 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fd690010460 con 0x7fd6941035d0 2024-07-24T22:07:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69e820740 1 -- start start 2024-07-24T22:07:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69e820740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed8c90 0x5637ffed9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69e820740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffed95b0 0x5637ffee5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69e820740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffee5540 0x5637ffee7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69e820740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5637ffe4e280 con 0x5637ffee5540 2024-07-24T22:07:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69e820740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5637ffe3d780 con 0x5637ffed95b0 2024-07-24T22:07:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69e820740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5637ffe417c0 con 0x5637ffed8c90 2024-07-24T22:07:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69906e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffee5540 0x5637ffee7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69906e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffee5540 0x5637ffee7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33314/0 (socket says 172.21.15.47:33314) 2024-07-24T22:07:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69906e640 1 -- 172.21.15.47:0/1715322569 learned_addr learned my addr 172.21.15.47:0/1715322569 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69906e640 1 -- 172.21.15.47:0/1715322569 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed8c90 msgr2=0x5637ffed9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69906e640 1 --2- 172.21.15.47:0/1715322569 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed8c90 0x5637ffed9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69906e640 1 -- 172.21.15.47:0/1715322569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffed95b0 msgr2=0x5637ffee5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69906e640 1 --2- 172.21.15.47:0/1715322569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffed95b0 0x5637ffee5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd69906e640 1 -- 172.21.15.47:0/1715322569 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ffba1790 con 0x5637ffee5540 2024-07-24T22:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.003+0000 7fd68affd640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd6800b3d40 0x7fd6800b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.004+0000 7fd69906e640 1 --2- 172.21.15.47:0/1715322569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffee5540 0x5637ffee7930 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd684031440 tx=0x7fd684032b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1304f85d0aaff9e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.004+0000 7fd69a070640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd6800b3d40 0x7fd6800b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.004+0000 7fd68affd640 1 -- 172.21.15.47:0/1901912019 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fd6900e3cf0 con 0x7fd6941035d0 2024-07-24T22:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.004+0000 7fd67ffff640 1 -- 172.21.15.47:0/1715322569 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68403f070 con 0x5637ffee5540 2024-07-24T22:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.004+0000 7fd67ffff640 1 -- 172.21.15.47:0/1715322569 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd684004030 con 0x5637ffee5540 2024-07-24T22:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.004+0000 7fd67ffff640 1 -- 172.21.15.47:0/1715322569 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684035070 con 0x5637ffee5540 2024-07-24T22:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.005+0000 7fd69e820740 1 -- 172.21.15.47:0/1715322569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffee5540 msgr2=0x5637ffee7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.005+0000 7fd69a070640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd6800b3d40 0x7fd6800b6200 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd68c005fd0 tx=0x7fd68c009b00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.005+0000 7fd69e820740 1 --2- 172.21.15.47:0/1715322569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffee5540 0x5637ffee7930 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd684031440 tx=0x7fd684032b60 comp rx=0 tx=0).stop 2024-07-24T22:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.005+0000 7fd69e820740 1 -- 172.21.15.47:0/1715322569 shutdown_connections 2024-07-24T22:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.005+0000 7fd69e820740 1 --2- 172.21.15.47:0/1715322569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffee5540 0x5637ffee7930 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.005+0000 7fd69e820740 1 --2- 172.21.15.47:0/1715322569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffed95b0 0x5637ffee5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.005+0000 7fd69e820740 1 --2- 172.21.15.47:0/1715322569 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed8c90 0x5637ffed9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.005+0000 7fd69e820740 1 -- 172.21.15.47:0/1715322569 >> 172.21.15.47:0/1715322569 conn(0x5637ffed6ac0 msgr2=0x5637ffed7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.005+0000 7fd69e820740 1 -- 172.21.15.47:0/1715322569 shutdown_connections 2024-07-24T22:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.005+0000 7fd69e820740 1 -- 172.21.15.47:0/1715322569 wait complete. 2024-07-24T22:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.005+0000 7fd69e820740 1 -- start start 2024-07-24T22:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.005+0000 7fd69e820740 1 Processor -- start 2024-07-24T22:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69e820740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 0x5637ffee4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69e820740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed95b0 0x5637ffee21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69e820740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 0x5637ffee2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69e820740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5637ffd77ab0 con 0x5637ffed8c90 2024-07-24T22:07:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69e820740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5637ffdc59e0 con 0x5637ffee5540 2024-07-24T22:07:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69e820740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5637ffee81c0 con 0x5637ffed95b0 2024-07-24T22:07:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69e820740 10 client.0 _ll_register_callbacks cb 0x5637ffb4da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69986f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 0x5637ffee4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69986f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 0x5637ffee4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33330/0 (socket says 172.21.15.47:33330) 2024-07-24T22:07:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69986f640 1 -- 172.21.15.47:0/3495038996 learned_addr learned my addr 172.21.15.47:0/3495038996 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69a070640 1 --2- 172.21.15.47:0/3495038996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 0x5637ffee2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69986f640 1 -- 172.21.15.47:0/3495038996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed95b0 msgr2=0x5637ffee21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69986f640 1 --2- 172.21.15.47:0/3495038996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed95b0 0x5637ffee21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69986f640 1 -- 172.21.15.47:0/3495038996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 msgr2=0x5637ffee2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69986f640 1 --2- 172.21.15.47:0/3495038996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 0x5637ffee2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69986f640 1 -- 172.21.15.47:0/3495038996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637ffc1a620 con 0x5637ffed8c90 2024-07-24T22:07:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69a070640 1 --2- 172.21.15.47:0/3495038996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 0x5637ffee2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69986f640 1 --2- 172.21.15.47:0/3495038996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 0x5637ffee4d10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd6900e14a0 tx=0x7fd6900aa070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b90abc1ffb85731 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd67d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd67d7fa640 1 -- 172.21.15.47:0/3495038996 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690020070 con 0x5637ffed8c90 2024-07-24T22:07:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd67d7fa640 1 -- 172.21.15.47:0/3495038996 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fd6900a6ef0 con 0x5637ffed8c90 2024-07-24T22:07:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.006+0000 7fd69e820740 1 -- 172.21.15.47:0/3495038996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5637ffdecce0 con 0x5637ffed8c90 2024-07-24T22:07:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.007+0000 7fd67d7fa640 1 -- 172.21.15.47:0/3495038996 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd6900aa410 con 0x5637ffed8c90 2024-07-24T22:07:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.007+0000 7fd69e820740 10 client.15393 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.007+0000 7fd69e820740 1 -- 172.21.15.47:0/3495038996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5637ffef39d0 con 0x5637ffed8c90 2024-07-24T22:07:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.007+0000 7fd67d7fa640 1 -- 172.21.15.47:0/3495038996 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5637ffdecce0 con 0x5637ffed8c90 2024-07-24T22:07:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.007+0000 7fd67d7fa640 1 -- 172.21.15.47:0/3495038996 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd6900e1b90 con 0x5637ffed8c90 2024-07-24T22:07:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.007+0000 7fd69e820740 10 client.15393 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.007+0000 7fd69e820740 10 client.15393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.007+0000 7fd69e820740 20 client.15393 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.007+0000 7fd69e820740 1 --2- 172.21.15.47:0/3495038996 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5637ffef4e40 0x5637ffef7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.007+0000 7fd69e820740 4 client.15393 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:07:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.007+0000 7fd69e820740 1 -- 172.21.15.47:0/3495038996 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637ffe501d0 con 0x5637ffef4e40 2024-07-24T22:07:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.007+0000 7fd69906e640 1 --2- 172.21.15.47:0/3495038996 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5637ffef4e40 0x5637ffef7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.008+0000 7fd67d7fa640 10 client.15393 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:09.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.008+0000 7fd69906e640 1 --2- 172.21.15.47:0/3495038996 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5637ffef4e40 0x5637ffef7230 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc79d5ebd3b268bd server_cookie=61effc579d81647f in_seq=0 out_seq=0 2024-07-24T22:07:09.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd67d7fa640 1 -- 172.21.15.47:0/3495038996 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637ffe501d0 con 0x5637ffef4e40 2024-07-24T22:07:09.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd67d7fa640 10 client.15393 handle_command_reply: tid=0 2024-07-24T22:07:09.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd69e820740 1 client.15393 shutdown 2024-07-24T22:07:09.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd69e820740 1 -- 172.21.15.47:0/3495038996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 msgr2=0x5637ffee4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:09.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd69e820740 1 --2- 172.21.15.47:0/3495038996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 0x5637ffee4d10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd6900e14a0 tx=0x7fd6900aa070 comp rx=0 tx=0).stop 2024-07-24T22:07:09.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd69e820740 1 -- 172.21.15.47:0/3495038996 shutdown_connections 2024-07-24T22:07:09.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd69e820740 1 --2- 172.21.15.47:0/3495038996 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5637ffef4e40 0x5637ffef7230 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd69e820740 1 --2- 172.21.15.47:0/3495038996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 0x5637ffee2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd69e820740 1 --2- 172.21.15.47:0/3495038996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed95b0 0x5637ffee21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd69e820740 1 --2- 172.21.15.47:0/3495038996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 0x5637ffee4d10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd67d7fa640 0 client.15393 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:09.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd69e820740 1 -- 172.21.15.47:0/3495038996 >> 172.21.15.47:0/3495038996 conn(0x5637ffed6ac0 msgr2=0x5637ffedc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:09.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd69e820740 1 -- 172.21.15.47:0/3495038996 shutdown_connections 2024-07-24T22:07:09.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd69e820740 1 -- 172.21.15.47:0/3495038996 wait complete. 2024-07-24T22:07:09.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.010+0000 7fd69e820740 20 client.15393 trim_cache size 0 max 16384 2024-07-24T22:07:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.026+0000 7fd69e820740 1 Processor -- start 2024-07-24T22:07:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.026+0000 7fd69e820740 1 -- start start 2024-07-24T22:07:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.026+0000 7fd69e820740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 0x5637ffef12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.026+0000 7fd69e820740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed95b0 0x5637ffed7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.026+0000 7fd69e820740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 0x5637ffefcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.026+0000 7fd69e820740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd6941abfc0 con 0x5637ffed8c90 2024-07-24T22:07:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.026+0000 7fd69e820740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd6941ae860 con 0x5637ffee5540 2024-07-24T22:07:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.026+0000 7fd69e820740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd6941ac650 con 0x5637ffed95b0 2024-07-24T22:07:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.027+0000 7fd69986f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 0x5637ffef12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.027+0000 7fd69986f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 0x5637ffef12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33342/0 (socket says 172.21.15.47:33342) 2024-07-24T22:07:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.027+0000 7fd69986f640 1 -- 172.21.15.47:0/837453094 learned_addr learned my addr 172.21.15.47:0/837453094 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.027+0000 7fd69986f640 1 -- 172.21.15.47:0/837453094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed95b0 msgr2=0x5637ffed7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.027+0000 7fd69986f640 1 --2- 172.21.15.47:0/837453094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed95b0 0x5637ffed7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.027+0000 7fd69a070640 1 --2- 172.21.15.47:0/837453094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 0x5637ffefcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.027+0000 7fd69986f640 1 -- 172.21.15.47:0/837453094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 msgr2=0x5637ffefcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.027+0000 7fd69986f640 1 --2- 172.21.15.47:0/837453094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 0x5637ffefcb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.027+0000 7fd69986f640 1 -- 172.21.15.47:0/837453094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ffee06d0 con 0x5637ffed8c90 2024-07-24T22:07:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.027+0000 7fd69986f640 1 --2- 172.21.15.47:0/837453094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 0x5637ffef12e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd6900aa5b0 tx=0x7fd6900aa1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19db6fd5c3a93209 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.027+0000 7fd67f7fe640 1 -- 172.21.15.47:0/837453094 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690020070 con 0x5637ffed8c90 2024-07-24T22:07:09.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.027+0000 7fd67f7fe640 1 -- 172.21.15.47:0/837453094 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6900a6080 con 0x5637ffed8c90 2024-07-24T22:07:09.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.027+0000 7fd67f7fe640 1 -- 172.21.15.47:0/837453094 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6900a9d70 con 0x5637ffed8c90 2024-07-24T22:07:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.028+0000 7fd69e820740 1 -- 172.21.15.47:0/837453094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 msgr2=0x5637ffef12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.028+0000 7fd69e820740 1 --2- 172.21.15.47:0/837453094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 0x5637ffef12e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd6900aa5b0 tx=0x7fd6900aa1a0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.028+0000 7fd69e820740 1 -- 172.21.15.47:0/837453094 shutdown_connections 2024-07-24T22:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.028+0000 7fd69e820740 1 --2- 172.21.15.47:0/837453094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 0x5637ffefcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.028+0000 7fd69e820740 1 --2- 172.21.15.47:0/837453094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed95b0 0x5637ffed7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.028+0000 7fd69e820740 1 --2- 172.21.15.47:0/837453094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed8c90 0x5637ffef12e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.028+0000 7fd69e820740 1 -- 172.21.15.47:0/837453094 >> 172.21.15.47:0/837453094 conn(0x5637ffed6ac0 msgr2=0x5637ffed77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.028+0000 7fd69e820740 1 -- 172.21.15.47:0/837453094 shutdown_connections 2024-07-24T22:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.028+0000 7fd69e820740 1 -- 172.21.15.47:0/837453094 wait complete. 2024-07-24T22:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.028+0000 7fd69e820740 1 -- start start 2024-07-24T22:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.028+0000 7fd69e820740 1 Processor -- start 2024-07-24T22:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69e820740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed8c90 0x5637ffeea5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69e820740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed95b0 0x5637ffeeab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69e820740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 0x5637fff5daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69e820740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd6941acd20 con 0x5637ffed95b0 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69e820740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd6941ae190 con 0x5637ffee5540 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69e820740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd6941ad3f0 con 0x5637ffed8c90 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69e820740 10 client.0 _ll_register_callbacks cb 0x7fd6900e18f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69906e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed95b0 0x5637ffeeab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69906e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed95b0 0x5637ffeeab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33348/0 (socket says 172.21.15.47:33348) 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69906e640 1 -- 172.21.15.47:0/2345542335 learned_addr learned my addr 172.21.15.47:0/2345542335 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69a070640 1 --2- 172.21.15.47:0/2345542335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 0x5637fff5daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69986f640 1 --2- 172.21.15.47:0/2345542335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed8c90 0x5637ffeea5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69906e640 1 -- 172.21.15.47:0/2345542335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed8c90 msgr2=0x5637ffeea5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69906e640 1 --2- 172.21.15.47:0/2345542335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed8c90 0x5637ffeea5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69906e640 1 -- 172.21.15.47:0/2345542335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 msgr2=0x5637fff5daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69906e640 1 --2- 172.21.15.47:0/2345542335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 0x5637fff5daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69906e640 1 -- 172.21.15.47:0/2345542335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637ffeeb410 con 0x5637ffed95b0 2024-07-24T22:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd69906e640 1 --2- 172.21.15.47:0/2345542335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed95b0 0x5637ffeeab10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x5637ffed7380 tx=0x7fd684005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90ad08725d8babb server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.029+0000 7fd67d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd67d7fa640 1 -- 172.21.15.47:0/2345542335 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684035070 con 0x5637ffed95b0 2024-07-24T22:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd67d7fa640 1 -- 172.21.15.47:0/2345542335 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fd684031cd0 con 0x5637ffed95b0 2024-07-24T22:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd69e820740 1 -- 172.21.15.47:0/2345542335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6900a6080 con 0x5637ffed95b0 2024-07-24T22:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd67d7fa640 1 -- 172.21.15.47:0/2345542335 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd68403f040 con 0x5637ffed95b0 2024-07-24T22:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd69e820740 10 client.15399 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd69e820740 1 -- 172.21.15.47:0/2345542335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5637fff5f170 con 0x5637ffed95b0 2024-07-24T22:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd67d7fa640 1 -- 172.21.15.47:0/2345542335 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6900a6080 con 0x5637ffed95b0 2024-07-24T22:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd67d7fa640 1 -- 172.21.15.47:0/2345542335 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd6840035f0 con 0x5637ffed95b0 2024-07-24T22:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd69e820740 10 client.15399 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd69e820740 10 client.15399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd69e820740 20 client.15399 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd69e820740 1 --2- 172.21.15.47:0/2345542335 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5637fff5f450 0x5637fff61840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd69e820740 4 client.15399 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:07:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.030+0000 7fd69e820740 1 -- 172.21.15.47:0/2345542335 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5637ffe4bc70 con 0x5637fff5f450 2024-07-24T22:07:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.031+0000 7fd69986f640 1 --2- 172.21.15.47:0/2345542335 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5637fff5f450 0x5637fff61840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.031+0000 7fd67d7fa640 10 client.15399 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.031+0000 7fd69986f640 1 --2- 172.21.15.47:0/2345542335 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5637fff5f450 0x5637fff61840 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c09740a111ce6794 server_cookie=f04fe6e1da422bf7 in_seq=0 out_seq=0 2024-07-24T22:07:09.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.041+0000 7fd67d7fa640 1 -- 172.21.15.47:0/2345542335 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5637ffe4bc70 con 0x5637fff5f450 2024-07-24T22:07:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.041+0000 7fd67d7fa640 10 client.15399 handle_command_reply: tid=0 2024-07-24T22:07:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.041+0000 7fd69e820740 1 client.15399 shutdown 2024-07-24T22:07:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.041+0000 7fd69e820740 1 -- 172.21.15.47:0/2345542335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed95b0 msgr2=0x5637ffeeab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.041+0000 7fd69e820740 1 --2- 172.21.15.47:0/2345542335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed95b0 0x5637ffeeab10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x5637ffed7380 tx=0x7fd684005270 comp rx=0 tx=0).stop 2024-07-24T22:07:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.041+0000 7fd69e820740 1 -- 172.21.15.47:0/2345542335 shutdown_connections 2024-07-24T22:07:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.041+0000 7fd69e820740 1 --2- 172.21.15.47:0/2345542335 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5637fff5f450 0x5637fff61840 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.041+0000 7fd69e820740 1 --2- 172.21.15.47:0/2345542335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5637ffee5540 0x5637fff5daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.041+0000 7fd69e820740 1 --2- 172.21.15.47:0/2345542335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637ffed95b0 0x5637ffeeab10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.041+0000 7fd69e820740 1 --2- 172.21.15.47:0/2345542335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ffed8c90 0x5637ffeea5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.041+0000 7fd67d7fa640 0 client.15399 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.041+0000 7fd69e820740 1 -- 172.21.15.47:0/2345542335 >> 172.21.15.47:0/2345542335 conn(0x5637ffed6ac0 msgr2=0x5637ffee3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69e820740 1 -- 172.21.15.47:0/2345542335 shutdown_connections 2024-07-24T22:07:09.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69e820740 1 -- 172.21.15.47:0/2345542335 wait complete. 2024-07-24T22:07:09.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69e820740 20 client.15399 trim_cache size 0 max 16384 2024-07-24T22:07:09.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:07:09.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:07:09.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:07:09.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:07:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69bad3640 1 -- 172.21.15.47:0/1901912019 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd6800b3d40 msgr2=0x7fd6800b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69bad3640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd6800b3d40 0x7fd6800b6200 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd68c005fd0 tx=0x7fd68c009b00 comp rx=0 tx=0).stop 2024-07-24T22:07:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69bad3640 1 -- 172.21.15.47:0/1901912019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6941035d0 msgr2=0x7fd694198c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69bad3640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6941035d0 0x7fd694198c10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd69000d950 tx=0x7fd69000de10 comp rx=0 tx=0).stop 2024-07-24T22:07:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69bad3640 1 -- 172.21.15.47:0/1901912019 shutdown_connections 2024-07-24T22:07:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69bad3640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd6800b3d40 0x7fd6800b6200 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69bad3640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd69410c9f0 0x7fd69419e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69bad3640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd694103ef0 0x7fd694199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69bad3640 1 --2- 172.21.15.47:0/1901912019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6941035d0 0x7fd694198c10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69bad3640 1 -- 172.21.15.47:0/1901912019 >> 172.21.15.47:0/1901912019 conn(0x7fd6940782e0 msgr2=0x7fd6940ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:09.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69bad3640 1 -- 172.21.15.47:0/1901912019 shutdown_connections 2024-07-24T22:07:09.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:09.042+0000 7fd69bad3640 1 -- 172.21.15.47:0/1901912019 wait complete. 2024-07-24T22:07:09.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.095+0000 7fafa861c640 1 -- 172.21.15.47:0/3050173749 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fafa0062f80 con 0x7faf8c0b3dc0 2024-07-24T22:07:09.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.099+0000 7faf977fe640 1 -- 172.21.15.47:0/3050173749 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258825 (secure 0 0 0) 0x7fafa0062f80 con 0x7faf8c0b3dc0 2024-07-24T22:07:09.103 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:07:09.104 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-07-24T22:07:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.102+0000 7fafa861c640 1 -- 172.21.15.47:0/3050173749 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faf8c0b3dc0 msgr2=0x7faf8c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.102+0000 7fafa861c640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faf8c0b3dc0 0x7faf8c0b6280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faf9c0058c0 tx=0x7faf9c005ec0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.102+0000 7fafa861c640 1 -- 172.21.15.47:0/3050173749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafa01070a0 msgr2=0x7fafa0199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.102+0000 7fafa861c640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafa01070a0 0x7fafa0199fb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7faf9000b4a0 tx=0x7faf9000b960 comp rx=0 tx=0).stop 2024-07-24T22:07:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.102+0000 7fafa861c640 1 -- 172.21.15.47:0/3050173749 shutdown_connections 2024-07-24T22:07:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.102+0000 7fafa861c640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faf8c0b3dc0 0x7faf8c0b6280 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.102+0000 7fafa861c640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa0107a20 0x7fafa019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.102+0000 7fafa861c640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafa01070a0 0x7fafa0199fb0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.102+0000 7fafa861c640 1 --2- 172.21.15.47:0/3050173749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafa0101690 0x7fafa0199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.102+0000 7fafa861c640 1 -- 172.21.15.47:0/3050173749 >> 172.21.15.47:0/3050173749 conn(0x7fafa00fd100 msgr2=0x7fafa00ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.102+0000 7fafa861c640 1 -- 172.21.15.47:0/3050173749 shutdown_connections 2024-07-24T22:07:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:09.102+0000 7fafa861c640 1 -- 172.21.15.47:0/3050173749 wait complete. 2024-07-24T22:07:09.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:09 smithi047 ceph-mon[32551]: pgmap v364: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 135 KiB/s wr, 57 op/s 2024-07-24T22:07:09.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:09 smithi188 ceph-mon[37380]: pgmap v364: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 135 KiB/s wr, 57 op/s 2024-07-24T22:07:09.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:09 smithi183 ceph-mon[37007]: pgmap v364: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 135 KiB/s wr, 57 op/s 2024-07-24T22:07:09.842 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2024-07-24T22:07:08.122259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1448239,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":915,"num_read_kb":740,"num_write":502,"num_write_kb":4607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952539,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":851,"ondisk_log_size":851,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":389864,"kb_used_data":15360,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124551960,"statfs":{"total":1151940427776,"available":1151541207040,"internally_reserved":0,"allocated":15728640,"data_stored":9980361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":394798,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":470,"num_read_kb":411,"num_write":222,"num_write_kb":1618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002548"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574007+0000","last_change":"2024-07-24T22:03:53.407929+0000","last_active":"2024-07-24T22:05:27.574007+0000","last_peered":"2024-07-24T22:05:27.574007+0000","last_clean":"2024-07-24T22:05:27.574007+0000","last_became_active":"2024-07-24T22:03:53.407508+0000","last_became_peered":"2024-07-24T22:03:53.407508+0000","last_unstale":"2024-07-24T22:05:27.574007+0000","last_undegraded":"2024-07-24T22:05:27.574007+0000","last_fullsized":"2024-07-24T22:05:27.574007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:00:35.699906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696531+0000","last_change":"2024-07-24T22:03:53.404867+0000","last_active":"2024-07-24T22:05:27.696531+0000","last_peered":"2024-07-24T22:05:27.696531+0000","last_clean":"2024-07-24T22:05:27.696531+0000","last_became_active":"2024-07-24T22:03:53.404309+0000","last_became_peered":"2024-07-24T22:03:53.404309+0000","last_unstale":"2024-07-24T22:05:27.696531+0000","last_undegraded":"2024-07-24T22:05:27.696531+0000","last_fullsized":"2024-07-24T22:05:27.696531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:21:51.238815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696402+0000","last_change":"2024-07-24T22:03:53.404368+0000","last_active":"2024-07-24T22:05:27.696402+0000","last_peered":"2024-07-24T22:05:27.696402+0000","last_clean":"2024-07-24T22:05:27.696402+0000","last_became_active":"2024-07-24T22:03:53.403941+0000","last_became_peered":"2024-07-24T22:03:53.403941+0000","last_unstale":"2024-07-24T22:05:27.696402+0000","last_undegraded":"2024-07-24T22:05:27.696402+0000","last_fullsized":"2024-07-24T22:05:27.696402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:10:09.884724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576551+0000","last_change":"2024-07-24T22:03:53.407661+0000","last_active":"2024-07-24T22:05:27.576551+0000","last_peered":"2024-07-24T22:05:27.576551+0000","last_clean":"2024-07-24T22:05:27.576551+0000","last_became_active":"2024-07-24T22:03:53.407375+0000","last_became_peered":"2024-07-24T22:03:53.407375+0000","last_unstale":"2024-07-24T22:05:27.576551+0000","last_undegraded":"2024-07-24T22:05:27.576551+0000","last_fullsized":"2024-07-24T22:05:27.576551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:34.000666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575974+0000","last_change":"2024-07-24T22:03:53.406227+0000","last_active":"2024-07-24T22:05:27.575974+0000","last_peered":"2024-07-24T22:05:27.575974+0000","last_clean":"2024-07-24T22:05:27.575974+0000","last_became_active":"2024-07-24T22:03:53.405819+0000","last_became_peered":"2024-07-24T22:03:53.405819+0000","last_unstale":"2024-07-24T22:05:27.575974+0000","last_undegraded":"2024-07-24T22:05:27.575974+0000","last_fullsized":"2024-07-24T22:05:27.575974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:59.022972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588837+0000","last_change":"2024-07-24T22:04:27.501754+0000","last_active":"2024-07-24T22:05:27.588837+0000","last_peered":"2024-07-24T22:05:27.588837+0000","last_clean":"2024-07-24T22:05:27.588837+0000","last_became_active":"2024-07-24T22:04:27.501340+0000","last_became_peered":"2024-07-24T22:04:27.501340+0000","last_unstale":"2024-07-24T22:05:27.588837+0000","last_undegraded":"2024-07-24T22:05:27.588837+0000","last_fullsized":"2024-07-24T22:05:27.588837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:38:04.880980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575969+0000","last_change":"2024-07-24T22:03:53.413012+0000","last_active":"2024-07-24T22:05:27.575969+0000","last_peered":"2024-07-24T22:05:27.575969+0000","last_clean":"2024-07-24T22:05:27.575969+0000","last_became_active":"2024-07-24T22:03:53.411791+0000","last_became_peered":"2024-07-24T22:03:53.411791+0000","last_unstale":"2024-07-24T22:05:27.575969+0000","last_undegraded":"2024-07-24T22:05:27.575969+0000","last_fullsized":"2024-07-24T22:05:27.575969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:15:02.939598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695762+0000","last_change":"2024-07-24T22:04:27.502867+0000","last_active":"2024-07-24T22:05:27.695762+0000","last_peered":"2024-07-24T22:05:27.695762+0000","last_clean":"2024-07-24T22:05:27.695762+0000","last_became_active":"2024-07-24T22:04:27.502515+0000","last_became_peered":"2024-07-24T22:04:27.502515+0000","last_unstale":"2024-07-24T22:05:27.695762+0000","last_undegraded":"2024-07-24T22:05:27.695762+0000","last_fullsized":"2024-07-24T22:05:27.695762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:58:39.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,10],"acting":[3,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572158+0000","last_change":"2024-07-24T22:03:53.413213+0000","last_active":"2024-07-24T22:05:27.572158+0000","last_peered":"2024-07-24T22:05:27.572158+0000","last_clean":"2024-07-24T22:05:27.572158+0000","last_became_active":"2024-07-24T22:03:53.412725+0000","last_became_peered":"2024-07-24T22:03:53.412725+0000","last_unstale":"2024-07-24T22:05:27.572158+0000","last_undegraded":"2024-07-24T22:05:27.572158+0000","last_fullsized":"2024-07-24T22:05:27.572158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:34:01.897965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589224+0000","last_change":"2024-07-24T22:03:53.401129+0000","last_active":"2024-07-24T22:05:27.589224+0000","last_peered":"2024-07-24T22:05:27.589224+0000","last_clean":"2024-07-24T22:05:27.589224+0000","last_became_active":"2024-07-24T22:03:53.400780+0000","last_became_peered":"2024-07-24T22:03:53.400780+0000","last_unstale":"2024-07-24T22:05:27.589224+0000","last_undegraded":"2024-07-24T22:05:27.589224+0000","last_fullsized":"2024-07-24T22:05:27.589224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:28:37.825021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576231+0000","last_change":"2024-07-24T22:03:53.406490+0000","last_active":"2024-07-24T22:05:27.576231+0000","last_peered":"2024-07-24T22:05:27.576231+0000","last_clean":"2024-07-24T22:05:27.576231+0000","last_became_active":"2024-07-24T22:03:53.406108+0000","last_became_peered":"2024-07-24T22:03:53.406108+0000","last_unstale":"2024-07-24T22:05:27.576231+0000","last_undegraded":"2024-07-24T22:05:27.576231+0000","last_fullsized":"2024-07-24T22:05:27.576231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:37.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695960+0000","last_change":"2024-07-24T22:04:27.503165+0000","last_active":"2024-07-24T22:05:27.695960+0000","last_peered":"2024-07-24T22:05:27.695960+0000","last_clean":"2024-07-24T22:05:27.695960+0000","last_became_active":"2024-07-24T22:04:27.502861+0000","last_became_peered":"2024-07-24T22:04:27.502861+0000","last_unstale":"2024-07-24T22:05:27.695960+0000","last_undegraded":"2024-07-24T22:05:27.695960+0000","last_fullsized":"2024-07-24T22:05:27.695960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:36:41.353268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571263+0000","last_change":"2024-07-24T22:03:53.392763+0000","last_active":"2024-07-24T22:05:27.571263+0000","last_peered":"2024-07-24T22:05:27.571263+0000","last_clean":"2024-07-24T22:05:27.571263+0000","last_became_active":"2024-07-24T22:03:53.392476+0000","last_became_peered":"2024-07-24T22:03:53.392476+0000","last_unstale":"2024-07-24T22:05:27.571263+0000","last_undegraded":"2024-07-24T22:05:27.571263+0000","last_fullsized":"2024-07-24T22:05:27.571263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:25:13.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696340+0000","last_change":"2024-07-24T22:03:53.406937+0000","last_active":"2024-07-24T22:05:27.696340+0000","last_peered":"2024-07-24T22:05:27.696340+0000","last_clean":"2024-07-24T22:05:27.696340+0000","last_became_active":"2024-07-24T22:03:53.406495+0000","last_became_peered":"2024-07-24T22:03:53.406495+0000","last_unstale":"2024-07-24T22:05:27.696340+0000","last_undegraded":"2024-07-24T22:05:27.696340+0000","last_fullsized":"2024-07-24T22:05:27.696340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:06:50.434751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695723+0000","last_change":"2024-07-24T22:03:53.401073+0000","last_active":"2024-07-24T22:05:27.695723+0000","last_peered":"2024-07-24T22:05:27.695723+0000","last_clean":"2024-07-24T22:05:27.695723+0000","last_became_active":"2024-07-24T22:03:53.399675+0000","last_became_peered":"2024-07-24T22:03:53.399675+0000","last_unstale":"2024-07-24T22:05:27.695723+0000","last_undegraded":"2024-07-24T22:05:27.695723+0000","last_fullsized":"2024-07-24T22:05:27.695723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:59:25.461178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571670+0000","last_change":"2024-07-24T22:03:53.408289+0000","last_active":"2024-07-24T22:05:27.571670+0000","last_peered":"2024-07-24T22:05:27.571670+0000","last_clean":"2024-07-24T22:05:27.571670+0000","last_became_active":"2024-07-24T22:03:53.407950+0000","last_became_peered":"2024-07-24T22:03:53.407950+0000","last_unstale":"2024-07-24T22:05:27.571670+0000","last_undegraded":"2024-07-24T22:05:27.571670+0000","last_fullsized":"2024-07-24T22:05:27.571670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:10:30.261774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574008+0000","last_change":"2024-07-24T22:03:53.409909+0000","last_active":"2024-07-24T22:05:27.574008+0000","last_peered":"2024-07-24T22:05:27.574008+0000","last_clean":"2024-07-24T22:05:27.574008+0000","last_became_active":"2024-07-24T22:03:53.409183+0000","last_became_peered":"2024-07-24T22:03:53.409183+0000","last_unstale":"2024-07-24T22:05:27.574008+0000","last_undegraded":"2024-07-24T22:05:27.574008+0000","last_fullsized":"2024-07-24T22:05:27.574008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:14:50.699408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695710+0000","last_change":"2024-07-24T22:03:53.401198+0000","last_active":"2024-07-24T22:05:27.695710+0000","last_peered":"2024-07-24T22:05:27.695710+0000","last_clean":"2024-07-24T22:05:27.695710+0000","last_became_active":"2024-07-24T22:03:53.400885+0000","last_became_peered":"2024-07-24T22:03:53.400885+0000","last_unstale":"2024-07-24T22:05:27.695710+0000","last_undegraded":"2024-07-24T22:05:27.695710+0000","last_fullsized":"2024-07-24T22:05:27.695710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:59:37.965714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696048+0000","last_change":"2024-07-24T22:03:53.406590+0000","last_active":"2024-07-24T22:05:27.696048+0000","last_peered":"2024-07-24T22:05:27.696048+0000","last_clean":"2024-07-24T22:05:27.696048+0000","last_became_active":"2024-07-24T22:03:53.406283+0000","last_became_peered":"2024-07-24T22:03:53.406283+0000","last_unstale":"2024-07-24T22:05:27.696048+0000","last_undegraded":"2024-07-24T22:05:27.696048+0000","last_fullsized":"2024-07-24T22:05:27.696048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:30.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573401+0000","last_change":"2024-07-24T22:03:53.408790+0000","last_active":"2024-07-24T22:05:27.573401+0000","last_peered":"2024-07-24T22:05:27.573401+0000","last_clean":"2024-07-24T22:05:27.573401+0000","last_became_active":"2024-07-24T22:03:53.408480+0000","last_became_peered":"2024-07-24T22:03:53.408480+0000","last_unstale":"2024-07-24T22:05:27.573401+0000","last_undegraded":"2024-07-24T22:05:27.573401+0000","last_fullsized":"2024-07-24T22:05:27.573401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:59.601606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571171+0000","last_change":"2024-07-24T22:03:53.407400+0000","last_active":"2024-07-24T22:05:27.571171+0000","last_peered":"2024-07-24T22:05:27.571171+0000","last_clean":"2024-07-24T22:05:27.571171+0000","last_became_active":"2024-07-24T22:03:53.407084+0000","last_became_peered":"2024-07-24T22:03:53.407084+0000","last_unstale":"2024-07-24T22:05:27.571171+0000","last_undegraded":"2024-07-24T22:05:27.571171+0000","last_fullsized":"2024-07-24T22:05:27.571171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:51:04.942504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571785+0000","last_change":"2024-07-24T22:03:53.407444+0000","last_active":"2024-07-24T22:05:27.571785+0000","last_peered":"2024-07-24T22:05:27.571785+0000","last_clean":"2024-07-24T22:05:27.571785+0000","last_became_active":"2024-07-24T22:03:53.407025+0000","last_became_peered":"2024-07-24T22:03:53.407025+0000","last_unstale":"2024-07-24T22:05:27.571785+0000","last_undegraded":"2024-07-24T22:05:27.571785+0000","last_fullsized":"2024-07-24T22:05:27.571785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:47:49.620354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696170+0000","last_change":"2024-07-24T22:03:53.406748+0000","last_active":"2024-07-24T22:05:27.696170+0000","last_peered":"2024-07-24T22:05:27.696170+0000","last_clean":"2024-07-24T22:05:27.696170+0000","last_became_active":"2024-07-24T22:03:53.406398+0000","last_became_peered":"2024-07-24T22:03:53.406398+0000","last_unstale":"2024-07-24T22:05:27.696170+0000","last_undegraded":"2024-07-24T22:05:27.696170+0000","last_fullsized":"2024-07-24T22:05:27.696170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:35:40.117375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574701+0000","last_change":"2024-07-24T22:03:53.402203+0000","last_active":"2024-07-24T22:05:27.574701+0000","last_peered":"2024-07-24T22:05:27.574701+0000","last_clean":"2024-07-24T22:05:27.574701+0000","last_became_active":"2024-07-24T22:03:53.401826+0000","last_became_peered":"2024-07-24T22:03:53.401826+0000","last_unstale":"2024-07-24T22:05:27.574701+0000","last_undegraded":"2024-07-24T22:05:27.574701+0000","last_fullsized":"2024-07-24T22:05:27.574701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:45.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696666+0000","last_change":"2024-07-24T22:03:53.408179+0000","last_active":"2024-07-24T22:05:27.696666+0000","last_peered":"2024-07-24T22:05:27.696666+0000","last_clean":"2024-07-24T22:05:27.696666+0000","last_became_active":"2024-07-24T22:03:53.407547+0000","last_became_peered":"2024-07-24T22:03:53.407547+0000","last_unstale":"2024-07-24T22:05:27.696666+0000","last_undegraded":"2024-07-24T22:05:27.696666+0000","last_fullsized":"2024-07-24T22:05:27.696666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:03:52.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696074+0000","last_change":"2024-07-24T22:03:53.408550+0000","last_active":"2024-07-24T22:05:27.696074+0000","last_peered":"2024-07-24T22:05:27.696074+0000","last_clean":"2024-07-24T22:05:27.696074+0000","last_became_active":"2024-07-24T22:03:53.408119+0000","last_became_peered":"2024-07-24T22:03:53.408119+0000","last_unstale":"2024-07-24T22:05:27.696074+0000","last_undegraded":"2024-07-24T22:05:27.696074+0000","last_fullsized":"2024-07-24T22:05:27.696074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:33:54.154606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573853+0000","last_change":"2024-07-24T22:03:53.412562+0000","last_active":"2024-07-24T22:05:27.573853+0000","last_peered":"2024-07-24T22:05:27.573853+0000","last_clean":"2024-07-24T22:05:27.573853+0000","last_became_active":"2024-07-24T22:03:53.412231+0000","last_became_peered":"2024-07-24T22:03:53.412231+0000","last_unstale":"2024-07-24T22:05:27.573853+0000","last_undegraded":"2024-07-24T22:05:27.573853+0000","last_fullsized":"2024-07-24T22:05:27.573853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:53:48.403662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571173+0000","last_change":"2024-07-24T22:03:53.398212+0000","last_active":"2024-07-24T22:05:27.571173+0000","last_peered":"2024-07-24T22:05:27.571173+0000","last_clean":"2024-07-24T22:05:27.571173+0000","last_became_active":"2024-07-24T22:03:53.397853+0000","last_became_peered":"2024-07-24T22:03:53.397853+0000","last_unstale":"2024-07-24T22:05:27.571173+0000","last_undegraded":"2024-07-24T22:05:27.571173+0000","last_fullsized":"2024-07-24T22:05:27.571173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:39:47.612586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696283+0000","last_change":"2024-07-24T22:03:53.397188+0000","last_active":"2024-07-24T22:05:27.696283+0000","last_peered":"2024-07-24T22:05:27.696283+0000","last_clean":"2024-07-24T22:05:27.696283+0000","last_became_active":"2024-07-24T22:03:53.396865+0000","last_became_peered":"2024-07-24T22:03:53.396865+0000","last_unstale":"2024-07-24T22:05:27.696283+0000","last_undegraded":"2024-07-24T22:05:27.696283+0000","last_fullsized":"2024-07-24T22:05:27.696283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:20:49.074330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695823+0000","last_change":"2024-07-24T22:03:53.406605+0000","last_active":"2024-07-24T22:05:27.695823+0000","last_peered":"2024-07-24T22:05:27.695823+0000","last_clean":"2024-07-24T22:05:27.695823+0000","last_became_active":"2024-07-24T22:03:53.406264+0000","last_became_peered":"2024-07-24T22:03:53.406264+0000","last_unstale":"2024-07-24T22:05:27.695823+0000","last_undegraded":"2024-07-24T22:05:27.695823+0000","last_fullsized":"2024-07-24T22:05:27.695823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:13:46.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696013+0000","last_change":"2024-07-24T22:03:53.400422+0000","last_active":"2024-07-24T22:05:27.696013+0000","last_peered":"2024-07-24T22:05:27.696013+0000","last_clean":"2024-07-24T22:05:27.696013+0000","last_became_active":"2024-07-24T22:03:53.400096+0000","last_became_peered":"2024-07-24T22:03:53.400096+0000","last_unstale":"2024-07-24T22:05:27.696013+0000","last_undegraded":"2024-07-24T22:05:27.696013+0000","last_fullsized":"2024-07-24T22:05:27.696013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:04:07.882659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573363+0000","last_change":"2024-07-24T22:03:53.413231+0000","last_active":"2024-07-24T22:05:27.573363+0000","last_peered":"2024-07-24T22:05:27.573363+0000","last_clean":"2024-07-24T22:05:27.573363+0000","last_became_active":"2024-07-24T22:03:53.412825+0000","last_became_peered":"2024-07-24T22:03:53.412825+0000","last_unstale":"2024-07-24T22:05:27.573363+0000","last_undegraded":"2024-07-24T22:05:27.573363+0000","last_fullsized":"2024-07-24T22:05:27.573363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:59:30.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575993+0000","last_change":"2024-07-24T22:03:53.409007+0000","last_active":"2024-07-24T22:05:27.575993+0000","last_peered":"2024-07-24T22:05:27.575993+0000","last_clean":"2024-07-24T22:05:27.575993+0000","last_became_active":"2024-07-24T22:03:53.408624+0000","last_became_peered":"2024-07-24T22:03:53.408624+0000","last_unstale":"2024-07-24T22:05:27.575993+0000","last_undegraded":"2024-07-24T22:05:27.575993+0000","last_fullsized":"2024-07-24T22:05:27.575993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:31:22.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575311+0000","last_change":"2024-07-24T22:03:50.388894+0000","last_active":"2024-07-24T22:05:27.575311+0000","last_peered":"2024-07-24T22:05:27.575311+0000","last_clean":"2024-07-24T22:05:27.575311+0000","last_became_active":"2024-07-24T22:03:50.388608+0000","last_became_peered":"2024-07-24T22:03:50.388608+0000","last_unstale":"2024-07-24T22:05:27.575311+0000","last_undegraded":"2024-07-24T22:05:27.575311+0000","last_fullsized":"2024-07-24T22:05:27.575311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:36:43.571415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575239+0000","last_change":"2024-07-24T22:03:53.397509+0000","last_active":"2024-07-24T22:05:27.575239+0000","last_peered":"2024-07-24T22:05:27.575239+0000","last_clean":"2024-07-24T22:05:27.575239+0000","last_became_active":"2024-07-24T22:03:53.397186+0000","last_became_peered":"2024-07-24T22:03:53.397186+0000","last_unstale":"2024-07-24T22:05:27.575239+0000","last_undegraded":"2024-07-24T22:05:27.575239+0000","last_fullsized":"2024-07-24T22:05:27.575239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:15:14.081853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588955+0000","last_change":"2024-07-24T22:03:50.383523+0000","last_active":"2024-07-24T22:05:27.588955+0000","last_peered":"2024-07-24T22:05:27.588955+0000","last_clean":"2024-07-24T22:05:27.588955+0000","last_became_active":"2024-07-24T22:03:50.383088+0000","last_became_peered":"2024-07-24T22:03:50.383088+0000","last_unstale":"2024-07-24T22:05:27.588955+0000","last_undegraded":"2024-07-24T22:05:27.588955+0000","last_fullsized":"2024-07-24T22:05:27.588955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:57:07.824581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570963+0000","last_change":"2024-07-24T22:03:50.383726+0000","last_active":"2024-07-24T22:05:27.570963+0000","last_peered":"2024-07-24T22:05:27.570963+0000","last_clean":"2024-07-24T22:05:27.570963+0000","last_became_active":"2024-07-24T22:03:50.383480+0000","last_became_peered":"2024-07-24T22:03:50.383480+0000","last_unstale":"2024-07-24T22:05:27.570963+0000","last_undegraded":"2024-07-24T22:05:27.570963+0000","last_fullsized":"2024-07-24T22:05:27.570963+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:05:05.093272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695819+0000","last_change":"2024-07-24T22:03:53.406223+0000","last_active":"2024-07-24T22:05:27.695819+0000","last_peered":"2024-07-24T22:05:27.695819+0000","last_clean":"2024-07-24T22:05:27.695819+0000","last_became_active":"2024-07-24T22:03:53.404642+0000","last_became_peered":"2024-07-24T22:03:53.404642+0000","last_unstale":"2024-07-24T22:05:27.695819+0000","last_undegraded":"2024-07-24T22:05:27.695819+0000","last_fullsized":"2024-07-24T22:05:27.695819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:00:51.849538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574889+0000","last_change":"2024-07-24T22:03:50.385780+0000","last_active":"2024-07-24T22:05:27.574889+0000","last_peered":"2024-07-24T22:05:27.574889+0000","last_clean":"2024-07-24T22:05:27.574889+0000","last_became_active":"2024-07-24T22:03:50.385488+0000","last_became_peered":"2024-07-24T22:03:50.385488+0000","last_unstale":"2024-07-24T22:05:27.574889+0000","last_undegraded":"2024-07-24T22:05:27.574889+0000","last_fullsized":"2024-07-24T22:05:27.574889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:47:35.908303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695950+0000","last_change":"2024-07-24T22:03:53.403103+0000","last_active":"2024-07-24T22:05:27.695950+0000","last_peered":"2024-07-24T22:05:27.695950+0000","last_clean":"2024-07-24T22:05:27.695950+0000","last_became_active":"2024-07-24T22:03:53.402810+0000","last_became_peered":"2024-07-24T22:03:53.402810+0000","last_unstale":"2024-07-24T22:05:27.695950+0000","last_undegraded":"2024-07-24T22:05:27.695950+0000","last_fullsized":"2024-07-24T22:05:27.695950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:15.798983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589069+0000","last_change":"2024-07-24T22:03:50.382383+0000","last_active":"2024-07-24T22:05:27.589069+0000","last_peered":"2024-07-24T22:05:27.589069+0000","last_clean":"2024-07-24T22:05:27.589069+0000","last_became_active":"2024-07-24T22:03:50.381629+0000","last_became_peered":"2024-07-24T22:03:50.381629+0000","last_unstale":"2024-07-24T22:05:27.589069+0000","last_undegraded":"2024-07-24T22:05:27.589069+0000","last_fullsized":"2024-07-24T22:05:27.589069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:17.181191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.572154+0000","last_change":"2024-07-24T22:03:53.409587+0000","last_active":"2024-07-24T22:05:27.572154+0000","last_peered":"2024-07-24T22:05:27.572154+0000","last_clean":"2024-07-24T22:05:27.572154+0000","last_became_active":"2024-07-24T22:03:53.409240+0000","last_became_peered":"2024-07-24T22:03:53.409240+0000","last_unstale":"2024-07-24T22:05:27.572154+0000","last_undegraded":"2024-07-24T22:05:27.572154+0000","last_fullsized":"2024-07-24T22:05:27.572154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:37:18.654244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576466+0000","last_change":"2024-07-24T22:03:50.387933+0000","last_active":"2024-07-24T22:05:27.576466+0000","last_peered":"2024-07-24T22:05:27.576466+0000","last_clean":"2024-07-24T22:05:27.576466+0000","last_became_active":"2024-07-24T22:03:50.386985+0000","last_became_peered":"2024-07-24T22:03:50.386985+0000","last_unstale":"2024-07-24T22:05:27.576466+0000","last_undegraded":"2024-07-24T22:05:27.576466+0000","last_fullsized":"2024-07-24T22:05:27.576466+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:35:29.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696682+0000","last_change":"2024-07-24T22:03:53.404419+0000","last_active":"2024-07-24T22:05:27.696682+0000","last_peered":"2024-07-24T22:05:27.696682+0000","last_clean":"2024-07-24T22:05:27.696682+0000","last_became_active":"2024-07-24T22:03:53.402713+0000","last_became_peered":"2024-07-24T22:03:53.402713+0000","last_unstale":"2024-07-24T22:05:27.696682+0000","last_undegraded":"2024-07-24T22:05:27.696682+0000","last_fullsized":"2024-07-24T22:05:27.696682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:45:41.262686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575104+0000","last_change":"2024-07-24T22:03:50.511126+0000","last_active":"2024-07-24T22:05:27.575104+0000","last_peered":"2024-07-24T22:05:27.575104+0000","last_clean":"2024-07-24T22:05:27.575104+0000","last_became_active":"2024-07-24T22:03:50.510801+0000","last_became_peered":"2024-07-24T22:03:50.510801+0000","last_unstale":"2024-07-24T22:05:27.575104+0000","last_undegraded":"2024-07-24T22:05:27.575104+0000","last_fullsized":"2024-07-24T22:05:27.575104+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:59:37.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571928+0000","last_change":"2024-07-24T22:03:53.410202+0000","last_active":"2024-07-24T22:05:27.571928+0000","last_peered":"2024-07-24T22:05:27.571928+0000","last_clean":"2024-07-24T22:05:27.571928+0000","last_became_active":"2024-07-24T22:03:53.409884+0000","last_became_peered":"2024-07-24T22:03:53.409884+0000","last_unstale":"2024-07-24T22:05:27.571928+0000","last_undegraded":"2024-07-24T22:05:27.571928+0000","last_fullsized":"2024-07-24T22:05:27.571928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:54:02.603267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'39","reported_seq":443,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:07:05.744120+0000","last_change":"2024-07-24T22:03:50.386993+0000","last_active":"2024-07-24T22:07:05.744120+0000","last_peered":"2024-07-24T22:07:05.744120+0000","last_clean":"2024-07-24T22:07:05.744120+0000","last_became_active":"2024-07-24T22:03:50.386675+0000","last_became_peered":"2024-07-24T22:03:50.386675+0000","last_unstale":"2024-07-24T22:07:05.744120+0000","last_undegraded":"2024-07-24T22:07:05.744120+0000","last_fullsized":"2024-07-24T22:07:05.744120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:20:58.384179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69847,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":372,"num_read_kb":255,"num_write":39,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576569+0000","last_change":"2024-07-24T22:03:53.413293+0000","last_active":"2024-07-24T22:05:27.576569+0000","last_peered":"2024-07-24T22:05:27.576569+0000","last_clean":"2024-07-24T22:05:27.576569+0000","last_became_active":"2024-07-24T22:03:53.412900+0000","last_became_peered":"2024-07-24T22:03:53.412900+0000","last_unstale":"2024-07-24T22:05:27.576569+0000","last_undegraded":"2024-07-24T22:05:27.576569+0000","last_fullsized":"2024-07-24T22:05:27.576569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:11:32.553108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696109+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.696109+0000","last_peered":"2024-07-24T22:05:27.696109+0000","last_clean":"2024-07-24T22:05:27.696109+0000","last_became_active":"2024-07-24T22:03:50.387059+0000","last_became_peered":"2024-07-24T22:03:50.387059+0000","last_unstale":"2024-07-24T22:05:27.696109+0000","last_undegraded":"2024-07-24T22:05:27.696109+0000","last_fullsized":"2024-07-24T22:05:27.696109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:40:06.887090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570910+0000","last_change":"2024-07-24T22:03:53.406808+0000","last_active":"2024-07-24T22:05:27.570910+0000","last_peered":"2024-07-24T22:05:27.570910+0000","last_clean":"2024-07-24T22:05:27.570910+0000","last_became_active":"2024-07-24T22:03:53.406487+0000","last_became_peered":"2024-07-24T22:03:53.406487+0000","last_unstale":"2024-07-24T22:05:27.570910+0000","last_undegraded":"2024-07-24T22:05:27.570910+0000","last_fullsized":"2024-07-24T22:05:27.570910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:44:57.732446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574923+0000","last_change":"2024-07-24T22:03:50.386881+0000","last_active":"2024-07-24T22:05:27.574923+0000","last_peered":"2024-07-24T22:05:27.574923+0000","last_clean":"2024-07-24T22:05:27.574923+0000","last_became_active":"2024-07-24T22:03:50.386564+0000","last_became_peered":"2024-07-24T22:03:50.386564+0000","last_unstale":"2024-07-24T22:05:27.574923+0000","last_undegraded":"2024-07-24T22:05:27.574923+0000","last_fullsized":"2024-07-24T22:05:27.574923+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:22:22.339854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576277+0000","last_change":"2024-07-24T22:03:53.403207+0000","last_active":"2024-07-24T22:05:27.576277+0000","last_peered":"2024-07-24T22:05:27.576277+0000","last_clean":"2024-07-24T22:05:27.576277+0000","last_became_active":"2024-07-24T22:03:53.402875+0000","last_became_peered":"2024-07-24T22:03:53.402875+0000","last_unstale":"2024-07-24T22:05:27.576277+0000","last_undegraded":"2024-07-24T22:05:27.576277+0000","last_fullsized":"2024-07-24T22:05:27.576277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:25:28.866228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575960+0000","last_change":"2024-07-24T22:03:50.386721+0000","last_active":"2024-07-24T22:05:27.575960+0000","last_peered":"2024-07-24T22:05:27.575960+0000","last_clean":"2024-07-24T22:05:27.575960+0000","last_became_active":"2024-07-24T22:03:50.385654+0000","last_became_peered":"2024-07-24T22:03:50.385654+0000","last_unstale":"2024-07-24T22:05:27.575960+0000","last_undegraded":"2024-07-24T22:05:27.575960+0000","last_fullsized":"2024-07-24T22:05:27.575960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:16:15.802744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575896+0000","last_change":"2024-07-24T22:03:53.405367+0000","last_active":"2024-07-24T22:05:27.575896+0000","last_peered":"2024-07-24T22:05:27.575896+0000","last_clean":"2024-07-24T22:05:27.575896+0000","last_became_active":"2024-07-24T22:03:53.404875+0000","last_became_peered":"2024-07-24T22:03:53.404875+0000","last_unstale":"2024-07-24T22:05:27.575896+0000","last_undegraded":"2024-07-24T22:05:27.575896+0000","last_fullsized":"2024-07-24T22:05:27.575896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:42.247052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.575893+0000","last_change":"2024-07-24T22:04:27.574426+0000","last_active":"2024-07-24T22:05:27.575893+0000","last_peered":"2024-07-24T22:05:27.575893+0000","last_clean":"2024-07-24T22:05:27.575893+0000","last_became_active":"2024-07-24T22:04:27.568176+0000","last_became_peered":"2024-07-24T22:04:27.568176+0000","last_unstale":"2024-07-24T22:05:27.575893+0000","last_undegraded":"2024-07-24T22:05:27.575893+0000","last_fullsized":"2024-07-24T22:05:27.575893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:20:37.620669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574893+0000","last_change":"2024-07-24T22:03:53.405136+0000","last_active":"2024-07-24T22:05:27.574893+0000","last_peered":"2024-07-24T22:05:27.574893+0000","last_clean":"2024-07-24T22:05:27.574893+0000","last_became_active":"2024-07-24T22:03:53.404043+0000","last_became_peered":"2024-07-24T22:03:53.404043+0000","last_unstale":"2024-07-24T22:05:27.574893+0000","last_undegraded":"2024-07-24T22:05:27.574893+0000","last_fullsized":"2024-07-24T22:05:27.574893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:03:21.912335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576738+0000","last_change":"2024-07-24T22:03:50.382364+0000","last_active":"2024-07-24T22:05:27.576738+0000","last_peered":"2024-07-24T22:05:27.576738+0000","last_clean":"2024-07-24T22:05:27.576738+0000","last_became_active":"2024-07-24T22:03:50.382029+0000","last_became_peered":"2024-07-24T22:03:50.382029+0000","last_unstale":"2024-07-24T22:05:27.576738+0000","last_undegraded":"2024-07-24T22:05:27.576738+0000","last_fullsized":"2024-07-24T22:05:27.576738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:48:10.004826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573801+0000","last_change":"2024-07-24T22:03:53.413053+0000","last_active":"2024-07-24T22:05:27.573801+0000","last_peered":"2024-07-24T22:05:27.573801+0000","last_clean":"2024-07-24T22:05:27.573801+0000","last_became_active":"2024-07-24T22:03:53.412733+0000","last_became_peered":"2024-07-24T22:03:53.412733+0000","last_unstale":"2024-07-24T22:05:27.573801+0000","last_undegraded":"2024-07-24T22:05:27.573801+0000","last_fullsized":"2024-07-24T22:05:27.573801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:47:16.495510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571346+0000","last_change":"2024-07-24T22:03:50.387314+0000","last_active":"2024-07-24T22:05:27.571346+0000","last_peered":"2024-07-24T22:05:27.571346+0000","last_clean":"2024-07-24T22:05:27.571346+0000","last_became_active":"2024-07-24T22:03:50.386919+0000","last_became_peered":"2024-07-24T22:03:50.386919+0000","last_unstale":"2024-07-24T22:05:27.571346+0000","last_undegraded":"2024-07-24T22:05:27.571346+0000","last_fullsized":"2024-07-24T22:05:27.571346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:51:03.203285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576716+0000","last_change":"2024-07-24T22:03:53.411938+0000","last_active":"2024-07-24T22:05:27.576716+0000","last_peered":"2024-07-24T22:05:27.576716+0000","last_clean":"2024-07-24T22:05:27.576716+0000","last_became_active":"2024-07-24T22:03:53.411545+0000","last_became_peered":"2024-07-24T22:03:53.411545+0000","last_unstale":"2024-07-24T22:05:27.576716+0000","last_undegraded":"2024-07-24T22:05:27.576716+0000","last_fullsized":"2024-07-24T22:05:27.576716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:41:19.370886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'68","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:07:00.129386+0000","last_change":"2024-07-24T22:03:50.384400+0000","last_active":"2024-07-24T22:07:00.129386+0000","last_peered":"2024-07-24T22:07:00.129386+0000","last_clean":"2024-07-24T22:07:00.129386+0000","last_became_active":"2024-07-24T22:03:50.383945+0000","last_became_peered":"2024-07-24T22:03:50.383945+0000","last_unstale":"2024-07-24T22:07:00.129386+0000","last_undegraded":"2024-07-24T22:07:00.129386+0000","last_fullsized":"2024-07-24T22:07:00.129386+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:16.035171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":79,"num_write_kb":1007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576430+0000","last_change":"2024-07-24T22:04:27.507390+0000","last_active":"2024-07-24T22:05:27.576430+0000","last_peered":"2024-07-24T22:05:27.576430+0000","last_clean":"2024-07-24T22:05:27.576430+0000","last_became_active":"2024-07-24T22:04:27.504206+0000","last_became_peered":"2024-07-24T22:04:27.504206+0000","last_unstale":"2024-07-24T22:05:27.576430+0000","last_undegraded":"2024-07-24T22:05:27.576430+0000","last_fullsized":"2024-07-24T22:05:27.576430+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:55:21.559702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696182+0000","last_change":"2024-07-24T22:03:50.511075+0000","last_active":"2024-07-24T22:05:27.696182+0000","last_peered":"2024-07-24T22:05:27.696182+0000","last_clean":"2024-07-24T22:05:27.696182+0000","last_became_active":"2024-07-24T22:03:50.510244+0000","last_became_peered":"2024-07-24T22:03:50.510244+0000","last_unstale":"2024-07-24T22:05:27.696182+0000","last_undegraded":"2024-07-24T22:05:27.696182+0000","last_fullsized":"2024-07-24T22:05:27.696182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:54:03.068211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576340+0000","last_change":"2024-07-24T22:03:53.410865+0000","last_active":"2024-07-24T22:05:27.576340+0000","last_peered":"2024-07-24T22:05:27.576340+0000","last_clean":"2024-07-24T22:05:27.576340+0000","last_became_active":"2024-07-24T22:03:53.410255+0000","last_became_peered":"2024-07-24T22:03:53.410255+0000","last_unstale":"2024-07-24T22:05:27.576340+0000","last_undegraded":"2024-07-24T22:05:27.576340+0000","last_fullsized":"2024-07-24T22:05:27.576340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:56:15.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576134+0000","last_change":"2024-07-24T22:02:33.494929+0000","last_active":"2024-07-24T22:05:27.576134+0000","last_peered":"2024-07-24T22:05:27.576134+0000","last_clean":"2024-07-24T22:05:27.576134+0000","last_became_active":"2024-07-24T22:02:33.489241+0000","last_became_peered":"2024-07-24T22:02:33.489241+0000","last_unstale":"2024-07-24T22:05:27.576134+0000","last_undegraded":"2024-07-24T22:05:27.576134+0000","last_fullsized":"2024-07-24T22:05:27.576134+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T21:59:32.406119+0000","last_clean_scrub_stamp":"2024-07-24T21:59:32.406119+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:46.421413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576268+0000","last_change":"2024-07-24T22:03:50.385093+0000","last_active":"2024-07-24T22:05:27.576268+0000","last_peered":"2024-07-24T22:05:27.576268+0000","last_clean":"2024-07-24T22:05:27.576268+0000","last_became_active":"2024-07-24T22:03:50.384639+0000","last_became_peered":"2024-07-24T22:03:50.384639+0000","last_unstale":"2024-07-24T22:05:27.576268+0000","last_undegraded":"2024-07-24T22:05:27.576268+0000","last_fullsized":"2024-07-24T22:05:27.576268+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:06:10.402336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696068+0000","last_change":"2024-07-24T22:03:53.409627+0000","last_active":"2024-07-24T22:05:27.696068+0000","last_peered":"2024-07-24T22:05:27.696068+0000","last_clean":"2024-07-24T22:05:27.696068+0000","last_became_active":"2024-07-24T22:03:53.409295+0000","last_became_peered":"2024-07-24T22:03:53.409295+0000","last_unstale":"2024-07-24T22:05:27.696068+0000","last_undegraded":"2024-07-24T22:05:27.696068+0000","last_fullsized":"2024-07-24T22:05:27.696068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:23:39.670020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576402+0000","last_change":"2024-07-24T22:03:50.385772+0000","last_active":"2024-07-24T22:05:27.576402+0000","last_peered":"2024-07-24T22:05:27.576402+0000","last_clean":"2024-07-24T22:05:27.576402+0000","last_became_active":"2024-07-24T22:03:50.385421+0000","last_became_peered":"2024-07-24T22:03:50.385421+0000","last_unstale":"2024-07-24T22:05:27.576402+0000","last_undegraded":"2024-07-24T22:05:27.576402+0000","last_fullsized":"2024-07-24T22:05:27.576402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:58:57.227697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.570892+0000","last_change":"2024-07-24T22:03:53.400558+0000","last_active":"2024-07-24T22:05:27.570892+0000","last_peered":"2024-07-24T22:05:27.570892+0000","last_clean":"2024-07-24T22:05:27.570892+0000","last_became_active":"2024-07-24T22:03:53.400131+0000","last_became_peered":"2024-07-24T22:03:53.400131+0000","last_unstale":"2024-07-24T22:05:27.570892+0000","last_undegraded":"2024-07-24T22:05:27.570892+0000","last_fullsized":"2024-07-24T22:05:27.570892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:57:57.586742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571018+0000","last_change":"2024-07-24T22:03:50.510189+0000","last_active":"2024-07-24T22:05:27.571018+0000","last_peered":"2024-07-24T22:05:27.571018+0000","last_clean":"2024-07-24T22:05:27.571018+0000","last_became_active":"2024-07-24T22:03:50.509857+0000","last_became_peered":"2024-07-24T22:03:50.509857+0000","last_unstale":"2024-07-24T22:05:27.571018+0000","last_undegraded":"2024-07-24T22:05:27.571018+0000","last_fullsized":"2024-07-24T22:05:27.571018+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:05:59.240650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.574703+0000","last_change":"2024-07-24T22:04:27.505187+0000","last_active":"2024-07-24T22:05:27.574703+0000","last_peered":"2024-07-24T22:05:27.574703+0000","last_clean":"2024-07-24T22:05:27.574703+0000","last_became_active":"2024-07-24T22:04:27.504785+0000","last_became_peered":"2024-07-24T22:04:27.504785+0000","last_unstale":"2024-07-24T22:05:27.574703+0000","last_undegraded":"2024-07-24T22:05:27.574703+0000","last_fullsized":"2024-07-24T22:05:27.574703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:47:33.516835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576182+0000","last_change":"2024-07-24T22:05:27.575016+0000","last_active":"2024-07-24T22:05:27.576182+0000","last_peered":"2024-07-24T22:05:27.576182+0000","last_clean":"2024-07-24T22:05:27.576182+0000","last_became_active":"2024-07-24T22:05:27.574644+0000","last_became_peered":"2024-07-24T22:05:27.574644+0000","last_unstale":"2024-07-24T22:05:27.576182+0000","last_undegraded":"2024-07-24T22:05:27.576182+0000","last_fullsized":"2024-07-24T22:05:27.576182+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:11:37.759190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.588938+0000","last_change":"2024-07-24T22:03:53.399369+0000","last_active":"2024-07-24T22:05:27.588938+0000","last_peered":"2024-07-24T22:05:27.588938+0000","last_clean":"2024-07-24T22:05:27.588938+0000","last_became_active":"2024-07-24T22:03:53.399001+0000","last_became_peered":"2024-07-24T22:03:53.399001+0000","last_unstale":"2024-07-24T22:05:27.588938+0000","last_undegraded":"2024-07-24T22:05:27.588938+0000","last_fullsized":"2024-07-24T22:05:27.588938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:26:46.531080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695870+0000","last_change":"2024-07-24T22:03:50.510889+0000","last_active":"2024-07-24T22:05:27.695870+0000","last_peered":"2024-07-24T22:05:27.695870+0000","last_clean":"2024-07-24T22:05:27.695870+0000","last_became_active":"2024-07-24T22:03:50.510366+0000","last_became_peered":"2024-07-24T22:03:50.510366+0000","last_unstale":"2024-07-24T22:05:27.695870+0000","last_undegraded":"2024-07-24T22:05:27.695870+0000","last_fullsized":"2024-07-24T22:05:27.695870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:47:54.838304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.589019+0000","last_change":"2024-07-24T22:03:53.398987+0000","last_active":"2024-07-24T22:05:27.589019+0000","last_peered":"2024-07-24T22:05:27.589019+0000","last_clean":"2024-07-24T22:05:27.589019+0000","last_became_active":"2024-07-24T22:03:53.398604+0000","last_became_peered":"2024-07-24T22:03:53.398604+0000","last_unstale":"2024-07-24T22:05:27.589019+0000","last_undegraded":"2024-07-24T22:05:27.589019+0000","last_fullsized":"2024-07-24T22:05:27.589019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:28:41.684174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576685+0000","last_change":"2024-07-24T22:03:50.510623+0000","last_active":"2024-07-24T22:05:27.576685+0000","last_peered":"2024-07-24T22:05:27.576685+0000","last_clean":"2024-07-24T22:05:27.576685+0000","last_became_active":"2024-07-24T22:03:50.510204+0000","last_became_peered":"2024-07-24T22:03:50.510204+0000","last_unstale":"2024-07-24T22:05:27.576685+0000","last_undegraded":"2024-07-24T22:05:27.576685+0000","last_fullsized":"2024-07-24T22:05:27.576685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:06:40.838840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571179+0000","last_change":"2024-07-24T22:03:53.400289+0000","last_active":"2024-07-24T22:05:27.571179+0000","last_peered":"2024-07-24T22:05:27.571179+0000","last_clean":"2024-07-24T22:05:27.571179+0000","last_became_active":"2024-07-24T22:03:53.399939+0000","last_became_peered":"2024-07-24T22:03:53.399939+0000","last_unstale":"2024-07-24T22:05:27.571179+0000","last_undegraded":"2024-07-24T22:05:27.571179+0000","last_fullsized":"2024-07-24T22:05:27.571179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:29:26.517056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'119","reported_seq":272,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:07:00.134043+0000","last_change":"2024-07-24T22:03:50.382776+0000","last_active":"2024-07-24T22:07:00.134043+0000","last_peered":"2024-07-24T22:07:00.134043+0000","last_clean":"2024-07-24T22:07:00.134043+0000","last_became_active":"2024-07-24T22:03:50.382474+0000","last_became_peered":"2024-07-24T22:03:50.382474+0000","last_unstale":"2024-07-24T22:07:00.134043+0000","last_undegraded":"2024-07-24T22:07:00.134043+0000","last_fullsized":"2024-07-24T22:07:00.134043+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:59:34.688895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":412,"num_read_kb":367,"num_write":222,"num_write_kb":1350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696694+0000","last_change":"2024-07-24T22:03:53.407883+0000","last_active":"2024-07-24T22:05:27.696694+0000","last_peered":"2024-07-24T22:05:27.696694+0000","last_clean":"2024-07-24T22:05:27.696694+0000","last_became_active":"2024-07-24T22:03:53.407524+0000","last_became_peered":"2024-07-24T22:03:53.407524+0000","last_unstale":"2024-07-24T22:05:27.696694+0000","last_undegraded":"2024-07-24T22:05:27.696694+0000","last_fullsized":"2024-07-24T22:05:27.696694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:52:25.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576771+0000","last_change":"2024-07-24T22:03:50.388789+0000","last_active":"2024-07-24T22:05:27.576771+0000","last_peered":"2024-07-24T22:05:27.576771+0000","last_clean":"2024-07-24T22:05:27.576771+0000","last_became_active":"2024-07-24T22:03:50.385439+0000","last_became_peered":"2024-07-24T22:03:50.385439+0000","last_unstale":"2024-07-24T22:05:27.576771+0000","last_undegraded":"2024-07-24T22:05:27.576771+0000","last_fullsized":"2024-07-24T22:05:27.576771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:14:25.009588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696603+0000","last_change":"2024-07-24T22:04:27.503956+0000","last_active":"2024-07-24T22:05:27.696603+0000","last_peered":"2024-07-24T22:05:27.696603+0000","last_clean":"2024-07-24T22:05:27.696603+0000","last_became_active":"2024-07-24T22:04:27.503498+0000","last_became_peered":"2024-07-24T22:04:27.503498+0000","last_unstale":"2024-07-24T22:05:27.696603+0000","last_undegraded":"2024-07-24T22:05:27.696603+0000","last_fullsized":"2024-07-24T22:05:27.696603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:23:20.294458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571757+0000","last_change":"2024-07-24T22:03:50.510687+0000","last_active":"2024-07-24T22:05:27.571757+0000","last_peered":"2024-07-24T22:05:27.571757+0000","last_clean":"2024-07-24T22:05:27.571757+0000","last_became_active":"2024-07-24T22:03:50.510310+0000","last_became_peered":"2024-07-24T22:03:50.510310+0000","last_unstale":"2024-07-24T22:05:27.571757+0000","last_undegraded":"2024-07-24T22:05:27.571757+0000","last_fullsized":"2024-07-24T22:05:27.571757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:14:29.957324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576327+0000","last_change":"2024-07-24T22:03:53.412711+0000","last_active":"2024-07-24T22:05:27.576327+0000","last_peered":"2024-07-24T22:05:27.576327+0000","last_clean":"2024-07-24T22:05:27.576327+0000","last_became_active":"2024-07-24T22:03:53.412375+0000","last_became_peered":"2024-07-24T22:03:53.412375+0000","last_unstale":"2024-07-24T22:05:27.576327+0000","last_undegraded":"2024-07-24T22:05:27.576327+0000","last_fullsized":"2024-07-24T22:05:27.576327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:55:29.441385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696331+0000","last_change":"2024-07-24T22:03:50.383094+0000","last_active":"2024-07-24T22:05:27.696331+0000","last_peered":"2024-07-24T22:05:27.696331+0000","last_clean":"2024-07-24T22:05:27.696331+0000","last_became_active":"2024-07-24T22:03:50.382687+0000","last_became_peered":"2024-07-24T22:03:50.382687+0000","last_unstale":"2024-07-24T22:05:27.696331+0000","last_undegraded":"2024-07-24T22:05:27.696331+0000","last_fullsized":"2024-07-24T22:05:27.696331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:32:02.727855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.573366+0000","last_change":"2024-07-24T22:03:53.403709+0000","last_active":"2024-07-24T22:05:27.573366+0000","last_peered":"2024-07-24T22:05:27.573366+0000","last_clean":"2024-07-24T22:05:27.573366+0000","last_became_active":"2024-07-24T22:03:53.403334+0000","last_became_peered":"2024-07-24T22:03:53.403334+0000","last_unstale":"2024-07-24T22:05:27.573366+0000","last_undegraded":"2024-07-24T22:05:27.573366+0000","last_fullsized":"2024-07-24T22:05:27.573366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T07:27:50.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695814+0000","last_change":"2024-07-24T22:03:50.385547+0000","last_active":"2024-07-24T22:05:27.695814+0000","last_peered":"2024-07-24T22:05:27.695814+0000","last_clean":"2024-07-24T22:05:27.695814+0000","last_became_active":"2024-07-24T22:03:50.385233+0000","last_became_peered":"2024-07-24T22:03:50.385233+0000","last_unstale":"2024-07-24T22:05:27.695814+0000","last_undegraded":"2024-07-24T22:05:27.695814+0000","last_fullsized":"2024-07-24T22:05:27.695814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:40:04.647242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696043+0000","last_change":"2024-07-24T22:03:53.402386+0000","last_active":"2024-07-24T22:05:27.696043+0000","last_peered":"2024-07-24T22:05:27.696043+0000","last_clean":"2024-07-24T22:05:27.696043+0000","last_became_active":"2024-07-24T22:03:53.399363+0000","last_became_peered":"2024-07-24T22:03:53.399363+0000","last_unstale":"2024-07-24T22:05:27.696043+0000","last_undegraded":"2024-07-24T22:05:27.696043+0000","last_fullsized":"2024-07-24T22:05:27.696043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T05:19:05.835280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576088+0000","last_change":"2024-07-24T22:03:50.387485+0000","last_active":"2024-07-24T22:05:27.576088+0000","last_peered":"2024-07-24T22:05:27.576088+0000","last_clean":"2024-07-24T22:05:27.576088+0000","last_became_active":"2024-07-24T22:03:50.387097+0000","last_became_peered":"2024-07-24T22:03:50.387097+0000","last_unstale":"2024-07-24T22:05:27.576088+0000","last_undegraded":"2024-07-24T22:05:27.576088+0000","last_fullsized":"2024-07-24T22:05:27.576088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:11:23.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576510+0000","last_change":"2024-07-24T22:03:53.407386+0000","last_active":"2024-07-24T22:05:27.576510+0000","last_peered":"2024-07-24T22:05:27.576510+0000","last_clean":"2024-07-24T22:05:27.576510+0000","last_became_active":"2024-07-24T22:03:53.407059+0000","last_became_peered":"2024-07-24T22:03:53.407059+0000","last_unstale":"2024-07-24T22:05:27.576510+0000","last_undegraded":"2024-07-24T22:05:27.576510+0000","last_fullsized":"2024-07-24T22:05:27.576510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:12:38.508170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.695820+0000","last_change":"2024-07-24T22:04:27.567714+0000","last_active":"2024-07-24T22:05:27.695820+0000","last_peered":"2024-07-24T22:05:27.695820+0000","last_clean":"2024-07-24T22:05:27.695820+0000","last_became_active":"2024-07-24T22:04:27.567492+0000","last_became_peered":"2024-07-24T22:04:27.567492+0000","last_unstale":"2024-07-24T22:05:27.695820+0000","last_undegraded":"2024-07-24T22:05:27.695820+0000","last_fullsized":"2024-07-24T22:05:27.695820+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:00:13.705346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.576278+0000","last_change":"2024-07-24T22:03:50.385538+0000","last_active":"2024-07-24T22:05:27.576278+0000","last_peered":"2024-07-24T22:05:27.576278+0000","last_clean":"2024-07-24T22:05:27.576278+0000","last_became_active":"2024-07-24T22:03:50.385191+0000","last_became_peered":"2024-07-24T22:03:50.385191+0000","last_unstale":"2024-07-24T22:05:27.576278+0000","last_undegraded":"2024-07-24T22:05:27.576278+0000","last_fullsized":"2024-07-24T22:05:27.576278+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:33:37.674903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.571800+0000","last_change":"2024-07-24T22:03:53.411751+0000","last_active":"2024-07-24T22:05:27.571800+0000","last_peered":"2024-07-24T22:05:27.571800+0000","last_clean":"2024-07-24T22:05:27.571800+0000","last_became_active":"2024-07-24T22:03:53.410827+0000","last_became_peered":"2024-07-24T22:03:53.410827+0000","last_unstale":"2024-07-24T22:05:27.571800+0000","last_undegraded":"2024-07-24T22:05:27.571800+0000","last_fullsized":"2024-07-24T22:05:27.571800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T09:07:26.439047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.584159+0000","last_change":"2024-07-24T22:05:27.581982+0000","last_active":"2024-07-24T22:05:27.584159+0000","last_peered":"2024-07-24T22:05:27.584159+0000","last_clean":"2024-07-24T22:05:27.584159+0000","last_became_active":"2024-07-24T22:05:27.577413+0000","last_became_peered":"2024-07-24T22:05:27.577413+0000","last_unstale":"2024-07-24T22:05:27.584159+0000","last_undegraded":"2024-07-24T22:05:27.584159+0000","last_fullsized":"2024-07-24T22:05:27.584159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:40:27.424379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696604+0000","last_change":"2024-07-24T22:03:53.406029+0000","last_active":"2024-07-24T22:05:27.696604+0000","last_peered":"2024-07-24T22:05:27.696604+0000","last_clean":"2024-07-24T22:05:27.696604+0000","last_became_active":"2024-07-24T22:03:53.405529+0000","last_became_peered":"2024-07-24T22:03:53.405529+0000","last_unstale":"2024-07-24T22:05:27.696604+0000","last_undegraded":"2024-07-24T22:05:27.696604+0000","last_fullsized":"2024-07-24T22:05:27.696604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T06:57:02.290836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696580+0000","last_change":"2024-07-24T22:03:50.510884+0000","last_active":"2024-07-24T22:05:27.696580+0000","last_peered":"2024-07-24T22:05:27.696580+0000","last_clean":"2024-07-24T22:05:27.696580+0000","last_became_active":"2024-07-24T22:03:50.509851+0000","last_became_peered":"2024-07-24T22:03:50.509851+0000","last_unstale":"2024-07-24T22:05:27.696580+0000","last_undegraded":"2024-07-24T22:05:27.696580+0000","last_fullsized":"2024-07-24T22:05:27.696580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:37:55.735488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:27.696364+0000","last_change":"2024-07-24T22:03:53.409966+0000","last_active":"2024-07-24T22:05:27.696364+0000","last_peered":"2024-07-24T22:05:27.696364+0000","last_clean":"2024-07-24T22:05:27.696364+0000","last_became_active":"2024-07-24T22:03:53.409652+0000","last_became_peered":"2024-07-24T22:03:53.409652+0000","last_unstale":"2024-07-24T22:05:27.696364+0000","last_undegraded":"2024-07-24T22:05:27.696364+0000","last_fullsized":"2024-07-24T22:05:27.696364+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:52.379403+0000","last_clean_scrub_stamp":"2024-07-24T22:03:52.379403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T08:10:53.262459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-07-24T22:05:59.016697+0000","last_change":"2024-07-24T22:04:27.571166+0000","last_active":"2024-07-24T22:05:59.016697+0000","last_peered":"2024-07-24T22:05:59.016697+0000","last_clean":"2024-07-24T22:05:59.016697+0000","last_became_active":"2024-07-24T22:04:27.567419+0000","last_became_peered":"2024-07-24T22:04:27.567419+0000","last_unstale":"2024-07-24T22:05:59.016697+0000","last_undegraded":"2024-07-24T22:05:59.016697+0000","last_fullsized":"2024-07-24T22:05:59.016697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T22:03:49.364158+0000","last_clean_scrub_stamp":"2024-07-24T22:03:49.364158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:37:11.513631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":857637,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":834,"num_read_kb":671,"num_write":377,"num_write_kb":2455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2666496,"data_stored":2572851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":257,"ondisk_log_size":257,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612663,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":937984,"data_stored":469642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808889,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29112,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716040,"statfs":{"total":95995035648,"available":95965224960,"internally_reserved":0,"allocated":2023424,"data_stored":1523944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972415,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40804,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704348,"statfs":{"total":95995035648,"available":95953252352,"internally_reserved":0,"allocated":1339392,"data_stored":863557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168645,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36640,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708512,"statfs":{"total":95995035648,"available":95957516288,"internally_reserved":0,"allocated":1335296,"data_stored":862880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397575,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1540096,"data_stored":1060709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561101,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":469759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757329,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29036,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716116,"statfs":{"total":95995035648,"available":95965302784,"internally_reserved":0,"allocated":1945600,"data_stored":1454085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920853,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117082,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41316,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703836,"statfs":{"total":95995035648,"available":95952728064,"internally_reserved":0,"allocated":1740800,"data_stored":1256855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378719,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":539523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542243,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":540011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705766,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":70369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":798720,"data_stored":787096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":463817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T22:07:09.846 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:07:10.305 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:10.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:10 smithi188 ceph-mon[37380]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:07:10.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:10 smithi183 ceph-mon[37007]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:07:10.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:10 smithi047 ceph-mon[32551]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-24T22:07:11.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:11 smithi188 ceph-mon[37380]: pgmap v365: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 135 KiB/s wr, 57 op/s 2024-07-24T22:07:11.657 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:11 smithi047 ceph-mon[32551]: pgmap v365: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 135 KiB/s wr, 57 op/s 2024-07-24T22:07:11.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:11 smithi183 ceph-mon[37007]: pgmap v365: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 135 KiB/s wr, 57 op/s 2024-07-24T22:07:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.312+0000 7fa70679d640 1 -- 172.21.15.47:0/90607472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7001036a0 msgr2=0x7fa700103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.312+0000 7fa70679d640 1 --2- 172.21.15.47:0/90607472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7001036a0 0x7fa700103a80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009900 tx=0x7fa6f002a410 comp rx=0 tx=0).stop 2024-07-24T22:07:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.312+0000 7fa70679d640 1 -- 172.21.15.47:0/90607472 shutdown_connections 2024-07-24T22:07:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.312+0000 7fa70679d640 1 --2- 172.21.15.47:0/90607472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa70010cb00 0x7fa70010ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.312+0000 7fa70679d640 1 --2- 172.21.15.47:0/90607472 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa700103fc0 0x7fa70010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.312+0000 7fa70679d640 1 --2- 172.21.15.47:0/90607472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7001036a0 0x7fa700103a80 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.312+0000 7fa70679d640 1 -- 172.21.15.47:0/90607472 >> 172.21.15.47:0/90607472 conn(0x7fa7000fd100 msgr2=0x7fa7000ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.313+0000 7fa70679d640 1 -- 172.21.15.47:0/90607472 shutdown_connections 2024-07-24T22:07:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.313+0000 7fa70679d640 1 -- 172.21.15.47:0/90607472 wait complete. 2024-07-24T22:07:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.313+0000 7fa70679d640 1 Processor -- start 2024-07-24T22:07:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.313+0000 7fa70679d640 1 -- start start 2024-07-24T22:07:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa70679d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7001036a0 0x7fa700198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa70679d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa700103fc0 0x7fa700199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa70679d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa70010cb00 0x7fa70019e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa70679d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa700112760 con 0x7fa7001036a0 2024-07-24T22:07:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa70679d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa7001125e0 con 0x7fa70010cb00 2024-07-24T22:07:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa70679d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa7001128e0 con 0x7fa700103fc0 2024-07-24T22:07:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa6fffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7001036a0 0x7fa700198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa6fffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7001036a0 0x7fa700198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33368/0 (socket says 172.21.15.47:33368) 2024-07-24T22:07:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa6fffff640 1 -- 172.21.15.47:0/1400837011 learned_addr learned my addr 172.21.15.47:0/1400837011 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa6ff7fe640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa700103fc0 0x7fa700199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa704d3a640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa70010cb00 0x7fa70019e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa6fffff640 1 -- 172.21.15.47:0/1400837011 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa700103fc0 msgr2=0x7fa700199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa6fffff640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa700103fc0 0x7fa700199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa6fffff640 1 -- 172.21.15.47:0/1400837011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa70010cb00 msgr2=0x7fa70019e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa6fffff640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa70010cb00 0x7fa70019e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa6fffff640 1 -- 172.21.15.47:0/1400837011 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70019ede0 con 0x7fa7001036a0 2024-07-24T22:07:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.314+0000 7fa6fffff640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7001036a0 0x7fa700198d30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0005940 tx=0x7fa6f00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.315+0000 7fa6fd7fa640 1 -- 172.21.15.47:0/1400837011 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f003f030 con 0x7fa7001036a0 2024-07-24T22:07:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.315+0000 7fa70679d640 1 -- 172.21.15.47:0/1400837011 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa70019f070 con 0x7fa7001036a0 2024-07-24T22:07:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.315+0000 7fa6fd7fa640 1 -- 172.21.15.47:0/1400837011 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6f0003cb0 con 0x7fa7001036a0 2024-07-24T22:07:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.315+0000 7fa6fd7fa640 1 -- 172.21.15.47:0/1400837011 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0035070 con 0x7fa7001036a0 2024-07-24T22:07:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.315+0000 7fa70679d640 1 -- 172.21.15.47:0/1400837011 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7001a5790 con 0x7fa7001036a0 2024-07-24T22:07:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.317+0000 7fa708b4e740 1 Processor -- start 2024-07-24T22:07:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.317+0000 7fa708b4e740 1 -- start start 2024-07-24T22:07:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.317+0000 7fa6fd7fa640 1 -- 172.21.15.47:0/1400837011 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fa6f0042030 con 0x7fa7001036a0 2024-07-24T22:07:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.317+0000 7fa708b4e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d36d0 0x5623ad5d3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.317+0000 7fa708b4e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d3ff0 0x5623ad5dfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa708b4e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5dff80 0x5623ad5e2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa708b4e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5623ad54a9b0 con 0x5623ad5d36d0 2024-07-24T22:07:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa708b4e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5623ad539eb0 con 0x5623ad5dff80 2024-07-24T22:07:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa708b4e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5623ad53def0 con 0x5623ad5d3ff0 2024-07-24T22:07:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa704d3a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d36d0 0x5623ad5d3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa704d3a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d36d0 0x5623ad5d3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33370/0 (socket says 172.21.15.47:33370) 2024-07-24T22:07:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa704d3a640 1 -- 172.21.15.47:0/4276570648 learned_addr learned my addr 172.21.15.47:0/4276570648 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa6fffff640 1 --2- 172.21.15.47:0/4276570648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d3ff0 0x5623ad5dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa6ff7fe640 1 --2- 172.21.15.47:0/4276570648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5dff80 0x5623ad5e2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa704d3a640 1 -- 172.21.15.47:0/4276570648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d3ff0 msgr2=0x5623ad5dfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:12.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa704d3a640 1 --2- 172.21.15.47:0/4276570648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d3ff0 0x5623ad5dfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa704d3a640 1 -- 172.21.15.47:0/4276570648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5dff80 msgr2=0x5623ad5e2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:12.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa704d3a640 1 --2- 172.21.15.47:0/4276570648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5dff80 0x5623ad5e2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa704d3a640 1 -- 172.21.15.47:0/4276570648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623ad4c3320 con 0x5623ad5d36d0 2024-07-24T22:07:12.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa6fffff640 1 --2- 172.21.15.47:0/4276570648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d3ff0 0x5623ad5dfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:12.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa704d3a640 1 --2- 172.21.15.47:0/4276570648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d36d0 0x5623ad5d3ab0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009df0 tx=0x7fa6f800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d3d56bb7750be8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:12.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa6e67fc640 1 -- 172.21.15.47:0/4276570648 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8016070 con 0x5623ad5d36d0 2024-07-24T22:07:12.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa6e67fc640 1 -- 172.21.15.47:0/4276570648 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6f8005020 con 0x5623ad5d36d0 2024-07-24T22:07:12.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.318+0000 7fa6e67fc640 1 -- 172.21.15.47:0/4276570648 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80116d0 con 0x5623ad5d36d0 2024-07-24T22:07:12.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.319+0000 7fa6fd7fa640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa6e80b3d40 0x7fa6e80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.319+0000 7fa6fffff640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa6e80b3d40 0x7fa6e80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.319+0000 7fa6fd7fa640 1 -- 172.21.15.47:0/1400837011 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa6f0104980 con 0x7fa7001036a0 2024-07-24T22:07:12.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.319+0000 7fa708b4e740 1 -- 172.21.15.47:0/4276570648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d36d0 msgr2=0x5623ad5d3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:12.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.319+0000 7fa708b4e740 1 --2- 172.21.15.47:0/4276570648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d36d0 0x5623ad5d3ab0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009df0 tx=0x7fa6f800e6c0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.319+0000 7fa6fffff640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa6e80b3d40 0x7fa6e80b6200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0102180 tx=0x7fa6f00c7560 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:12.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.319+0000 7fa708b4e740 1 -- 172.21.15.47:0/4276570648 shutdown_connections 2024-07-24T22:07:12.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.319+0000 7fa708b4e740 1 --2- 172.21.15.47:0/4276570648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5dff80 0x5623ad5e2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.319+0000 7fa708b4e740 1 --2- 172.21.15.47:0/4276570648 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d3ff0 0x5623ad5dfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.319+0000 7fa708b4e740 1 --2- 172.21.15.47:0/4276570648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d36d0 0x5623ad5d3ab0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.319+0000 7fa708b4e740 1 -- 172.21.15.47:0/4276570648 >> 172.21.15.47:0/4276570648 conn(0x5623ad5d1500 msgr2=0x5623ad5d26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:12.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.319+0000 7fa708b4e740 1 -- 172.21.15.47:0/4276570648 shutdown_connections 2024-07-24T22:07:12.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.319+0000 7fa708b4e740 1 -- 172.21.15.47:0/4276570648 wait complete. 2024-07-24T22:07:12.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa708b4e740 1 -- start start 2024-07-24T22:07:12.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa708b4e740 1 Processor -- start 2024-07-24T22:07:12.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa708b4e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 0x5623ad5dcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa708b4e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5d3ff0 0x5623ad5dd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa708b4e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 0x5623ad5dd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa708b4e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5623ad39d700 con 0x5623ad5dff80 2024-07-24T22:07:12.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa708b4e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5623ad4dc5f0 con 0x5623ad5d3ff0 2024-07-24T22:07:12.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa708b4e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5623ad5e2c00 con 0x5623ad5d36d0 2024-07-24T22:07:12.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa708b4e740 10 client.0 _ll_register_callbacks cb 0x5623ad4fc960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:12.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa704d3a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 0x5623ad5dd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa704d3a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 0x5623ad5dd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33378/0 (socket says 172.21.15.47:33378) 2024-07-24T22:07:12.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa704d3a640 1 -- 172.21.15.47:0/3739674860 learned_addr learned my addr 172.21.15.47:0/3739674860 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:12.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa6ff7fe640 1 --2- 172.21.15.47:0/3739674860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5d3ff0 0x5623ad5dd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.320+0000 7fa704d3a640 1 --2- 172.21.15.47:0/3739674860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 0x5623ad5dcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa704d3a640 1 -- 172.21.15.47:0/3739674860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 msgr2=0x5623ad5dcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa704d3a640 1 --2- 172.21.15.47:0/3739674860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 0x5623ad5dcea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa704d3a640 1 -- 172.21.15.47:0/3739674860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5d3ff0 msgr2=0x5623ad5dd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa704d3a640 1 --2- 172.21.15.47:0/3739674860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5d3ff0 0x5623ad5dd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa704d3a640 1 -- 172.21.15.47:0/3739674860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623ad4cf680 con 0x5623ad5dff80 2024-07-24T22:07:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa704d3a640 1 --2- 172.21.15.47:0/3739674860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 0x5623ad5dd920 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009ac0 tx=0x7fa6f8005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b98b3aa3e1d96e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa6df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa6df7fe640 1 -- 172.21.15.47:0/3739674860 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8016040 con 0x5623ad5dff80 2024-07-24T22:07:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa708b4e740 1 -- 172.21.15.47:0/3739674860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6f8005020 con 0x5623ad5dff80 2024-07-24T22:07:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa6df7fe640 1 -- 172.21.15.47:0/3739674860 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa6f80051d0 con 0x5623ad5dff80 2024-07-24T22:07:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa6df7fe640 1 -- 172.21.15.47:0/3739674860 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa6f80053d0 con 0x5623ad5dff80 2024-07-24T22:07:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa708b4e740 10 client.15411 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:12.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa708b4e740 1 -- 172.21.15.47:0/3739674860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5623ad29a650 con 0x5623ad5dff80 2024-07-24T22:07:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa6df7fe640 1 -- 172.21.15.47:0/3739674860 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6f8005020 con 0x5623ad5dff80 2024-07-24T22:07:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.321+0000 7fa6df7fe640 1 -- 172.21.15.47:0/3739674860 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa6f8026020 con 0x5623ad5dff80 2024-07-24T22:07:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.322+0000 7fa708b4e740 10 client.15411 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.322+0000 7fa708b4e740 10 client.15411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.322+0000 7fa708b4e740 20 client.15411 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.322+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3739674860 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5623ad5ef8e0 0x5623ad5f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.322+0000 7fa708b4e740 4 client.15411 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:07:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.322+0000 7fa708b4e740 1 -- 172.21.15.47:0/3739674860 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623ad54c900 con 0x5623ad5ef8e0 2024-07-24T22:07:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.322+0000 7fa6ff7fe640 1 --2- 172.21.15.47:0/3739674860 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5623ad5ef8e0 0x5623ad5f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.322+0000 7fa6ff7fe640 1 --2- 172.21.15.47:0/3739674860 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5623ad5ef8e0 0x5623ad5f1cd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23c871a86a1a7a90 server_cookie=f7ef8821bdea9049 in_seq=0 out_seq=0 2024-07-24T22:07:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.322+0000 7fa6df7fe640 10 client.15411 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa6df7fe640 1 -- 172.21.15.47:0/3739674860 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5623ad54c900 con 0x5623ad5ef8e0 2024-07-24T22:07:12.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa6df7fe640 10 client.15411 handle_command_reply: tid=0 2024-07-24T22:07:12.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa708b4e740 1 client.15411 shutdown 2024-07-24T22:07:12.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa708b4e740 1 -- 172.21.15.47:0/3739674860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 msgr2=0x5623ad5dd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:12.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3739674860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 0x5623ad5dd920 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009ac0 tx=0x7fa6f8005960 comp rx=0 tx=0).stop 2024-07-24T22:07:12.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa708b4e740 1 -- 172.21.15.47:0/3739674860 shutdown_connections 2024-07-24T22:07:12.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3739674860 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5623ad5ef8e0 0x5623ad5f1cd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3739674860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 0x5623ad5dd920 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3739674860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5d3ff0 0x5623ad5dd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3739674860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 0x5623ad5dcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa708b4e740 1 -- 172.21.15.47:0/3739674860 >> 172.21.15.47:0/3739674860 conn(0x5623ad5d1500 msgr2=0x5623ad5d70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:12.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa6df7fe640 0 client.15411 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:12.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa708b4e740 1 -- 172.21.15.47:0/3739674860 shutdown_connections 2024-07-24T22:07:12.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa708b4e740 1 -- 172.21.15.47:0/3739674860 wait complete. 2024-07-24T22:07:12.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.323+0000 7fa708b4e740 20 client.15411 trim_cache size 0 max 16384 2024-07-24T22:07:12.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.338+0000 7fa708b4e740 1 Processor -- start 2024-07-24T22:07:12.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.338+0000 7fa708b4e740 1 -- start start 2024-07-24T22:07:12.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.338+0000 7fa708b4e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 0x5623ad5de4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.338+0000 7fa708b4e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5d3ff0 0x5623ad5f7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.338+0000 7fa708b4e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 0x5623ad5f7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.338+0000 7fa708b4e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa7001ac170 con 0x5623ad5dff80 2024-07-24T22:07:12.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.338+0000 7fa708b4e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa7001ae9f0 con 0x5623ad5d3ff0 2024-07-24T22:07:12.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.338+0000 7fa708b4e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa7001ac7e0 con 0x5623ad5d36d0 2024-07-24T22:07:12.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.338+0000 7fa704d3a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 0x5623ad5f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.338+0000 7fa704d3a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 0x5623ad5f7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33382/0 (socket says 172.21.15.47:33382) 2024-07-24T22:07:12.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.338+0000 7fa704d3a640 1 -- 172.21.15.47:0/3552514164 learned_addr learned my addr 172.21.15.47:0/3552514164 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:12.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.338+0000 7fa704d3a640 1 --2- 172.21.15.47:0/3552514164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 0x5623ad5de4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.339+0000 7fa6ff7fe640 1 --2- 172.21.15.47:0/3552514164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5d3ff0 0x5623ad5f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.339+0000 7fa704d3a640 1 -- 172.21.15.47:0/3552514164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 msgr2=0x5623ad5de4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:12.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.339+0000 7fa704d3a640 1 --2- 172.21.15.47:0/3552514164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 0x5623ad5de4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.339+0000 7fa704d3a640 1 -- 172.21.15.47:0/3552514164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5d3ff0 msgr2=0x5623ad5f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:12.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.339+0000 7fa704d3a640 1 --2- 172.21.15.47:0/3552514164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5d3ff0 0x5623ad5f7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.339+0000 7fa704d3a640 1 -- 172.21.15.47:0/3552514164 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623ad5cce20 con 0x5623ad5dff80 2024-07-24T22:07:12.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.339+0000 7fa704d3a640 1 --2- 172.21.15.47:0/3552514164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 0x5623ad5f7950 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009d10 tx=0x7fa6f8005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f651ad1aff44d18 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:12.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.339+0000 7fa6e5ffb640 1 -- 172.21.15.47:0/3552514164 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8035070 con 0x5623ad5dff80 2024-07-24T22:07:12.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.339+0000 7fa6e5ffb640 1 -- 172.21.15.47:0/3552514164 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6f8036040 con 0x5623ad5dff80 2024-07-24T22:07:12.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.339+0000 7fa6e5ffb640 1 -- 172.21.15.47:0/3552514164 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8016070 con 0x5623ad5dff80 2024-07-24T22:07:12.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.340+0000 7fa708b4e740 1 -- 172.21.15.47:0/3552514164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 msgr2=0x5623ad5f7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:12.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.340+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3552514164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 0x5623ad5f7950 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009d10 tx=0x7fa6f8005570 comp rx=0 tx=0).stop 2024-07-24T22:07:12.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.340+0000 7fa708b4e740 1 -- 172.21.15.47:0/3552514164 shutdown_connections 2024-07-24T22:07:12.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.340+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3552514164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5dff80 0x5623ad5f7950 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.340+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3552514164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5d3ff0 0x5623ad5f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.340+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3552514164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 0x5623ad5de4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.340+0000 7fa708b4e740 1 -- 172.21.15.47:0/3552514164 >> 172.21.15.47:0/3552514164 conn(0x5623ad5d1500 msgr2=0x5623ad5d2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:12.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.340+0000 7fa708b4e740 1 -- 172.21.15.47:0/3552514164 shutdown_connections 2024-07-24T22:07:12.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.340+0000 7fa708b4e740 1 -- 172.21.15.47:0/3552514164 wait complete. 2024-07-24T22:07:12.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.341+0000 7fa708b4e740 1 -- start start 2024-07-24T22:07:12.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.341+0000 7fa708b4e740 1 Processor -- start 2024-07-24T22:07:12.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.341+0000 7fa708b4e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 0x5623ad5e3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.341+0000 7fa708b4e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d3ff0 0x5623ad5e3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.341+0000 7fa708b4e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5dff80 0x5623ad6583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.341+0000 7fa708b4e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa7001aceb0 con 0x5623ad5d3ff0 2024-07-24T22:07:12.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.341+0000 7fa708b4e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa7001ae320 con 0x5623ad5dff80 2024-07-24T22:07:12.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.341+0000 7fa708b4e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa7001ad580 con 0x5623ad5d36d0 2024-07-24T22:07:12.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.341+0000 7fa708b4e740 10 client.0 _ll_register_callbacks cb 0x7fa6f8009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:12.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.341+0000 7fa6ff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d3ff0 0x5623ad5e3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.341+0000 7fa6ff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d3ff0 0x5623ad5e3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33392/0 (socket says 172.21.15.47:33392) 2024-07-24T22:07:12.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.341+0000 7fa6ff7fe640 1 -- 172.21.15.47:0/3057115096 learned_addr learned my addr 172.21.15.47:0/3057115096 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:12.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.341+0000 7fa704d3a640 1 --2- 172.21.15.47:0/3057115096 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 0x5623ad5e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa704d3a640 1 --2- 172.21.15.47:0/3057115096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5dff80 0x5623ad6583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa6ff7fe640 1 -- 172.21.15.47:0/3057115096 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 msgr2=0x5623ad5e3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:12.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa6ff7fe640 1 --2- 172.21.15.47:0/3057115096 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 0x5623ad5e3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa6ff7fe640 1 -- 172.21.15.47:0/3057115096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5dff80 msgr2=0x5623ad6583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:12.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa6ff7fe640 1 --2- 172.21.15.47:0/3057115096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5dff80 0x5623ad6583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa6ff7fe640 1 -- 172.21.15.47:0/3057115096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623ad658ac0 con 0x5623ad5d3ff0 2024-07-24T22:07:12.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa6ff7fe640 1 --2- 172.21.15.47:0/3057115096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d3ff0 0x5623ad5e3b90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4005fd0 tx=0x7fa6f4012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32e796cd395499e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:12.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa6df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:12.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa6df7fe640 1 -- 172.21.15.47:0/3057115096 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4004240 con 0x5623ad5d3ff0 2024-07-24T22:07:12.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa6df7fe640 1 -- 172.21.15.47:0/3057115096 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa6f40043e0 con 0x5623ad5d3ff0 2024-07-24T22:07:12.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa708b4e740 1 -- 172.21.15.47:0/3057115096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6f8036040 con 0x5623ad5d3ff0 2024-07-24T22:07:12.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa6df7fe640 1 -- 172.21.15.47:0/3057115096 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa6f40035f0 con 0x5623ad5d3ff0 2024-07-24T22:07:12.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa708b4e740 10 client.15417 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:12.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.342+0000 7fa708b4e740 1 -- 172.21.15.47:0/3057115096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5623ad659e30 con 0x5623ad5d3ff0 2024-07-24T22:07:12.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.343+0000 7fa6df7fe640 1 -- 172.21.15.47:0/3057115096 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6f8036040 con 0x5623ad5d3ff0 2024-07-24T22:07:12.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.343+0000 7fa6df7fe640 1 -- 172.21.15.47:0/3057115096 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa6f401e980 con 0x5623ad5d3ff0 2024-07-24T22:07:12.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.343+0000 7fa708b4e740 10 client.15417 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:12.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.343+0000 7fa708b4e740 10 client.15417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:12.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.343+0000 7fa708b4e740 20 client.15417 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:12.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.343+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3057115096 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5623ad65a5e0 0x5623ad65ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:12.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.343+0000 7fa708b4e740 4 client.15417 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:07:12.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.343+0000 7fa708b4e740 1 -- 172.21.15.47:0/3057115096 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5623ad5483a0 con 0x5623ad65a5e0 2024-07-24T22:07:12.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.343+0000 7fa704d3a640 1 --2- 172.21.15.47:0/3057115096 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5623ad65a5e0 0x5623ad65ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:12.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa6df7fe640 10 client.15417 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:12.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa704d3a640 1 --2- 172.21.15.47:0/3057115096 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5623ad65a5e0 0x5623ad65ca00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51141f1fbbbfb904 server_cookie=7918e0d9bc42517a in_seq=0 out_seq=0 2024-07-24T22:07:12.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa6df7fe640 1 -- 172.21.15.47:0/3057115096 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5623ad5483a0 con 0x5623ad65a5e0 2024-07-24T22:07:12.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa6df7fe640 10 client.15417 handle_command_reply: tid=0 2024-07-24T22:07:12.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa708b4e740 1 client.15417 shutdown 2024-07-24T22:07:12.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa708b4e740 1 -- 172.21.15.47:0/3057115096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d3ff0 msgr2=0x5623ad5e3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:12.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3057115096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d3ff0 0x5623ad5e3b90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4005fd0 tx=0x7fa6f4012820 comp rx=0 tx=0).stop 2024-07-24T22:07:12.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa708b4e740 1 -- 172.21.15.47:0/3057115096 shutdown_connections 2024-07-24T22:07:12.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3057115096 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5623ad65a5e0 0x5623ad65ca00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3057115096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5623ad5dff80 0x5623ad6583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3057115096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5623ad5d3ff0 0x5623ad5e3b90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa708b4e740 1 --2- 172.21.15.47:0/3057115096 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5623ad5d36d0 0x5623ad5e3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa708b4e740 1 -- 172.21.15.47:0/3057115096 >> 172.21.15.47:0/3057115096 conn(0x5623ad5d1500 msgr2=0x5623ad5dce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:12.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa6df7fe640 0 client.15417 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:12.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa708b4e740 1 -- 172.21.15.47:0/3057115096 shutdown_connections 2024-07-24T22:07:12.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa708b4e740 1 -- 172.21.15.47:0/3057115096 wait complete. 2024-07-24T22:07:12.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.344+0000 7fa708b4e740 20 client.15417 trim_cache size 0 max 16384 2024-07-24T22:07:12.351 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:07:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.345+0000 7fa70679d640 1 -- 172.21.15.47:0/1400837011 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa6e80b3d40 msgr2=0x7fa6e80b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.345+0000 7fa70679d640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa6e80b3d40 0x7fa6e80b6200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0102180 tx=0x7fa6f00c7560 comp rx=0 tx=0).stop 2024-07-24T22:07:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.345+0000 7fa70679d640 1 -- 172.21.15.47:0/1400837011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7001036a0 msgr2=0x7fa700198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.345+0000 7fa70679d640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7001036a0 0x7fa700198d30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0005940 tx=0x7fa6f00042f0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.345+0000 7fa70679d640 1 -- 172.21.15.47:0/1400837011 shutdown_connections 2024-07-24T22:07:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.345+0000 7fa70679d640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa6e80b3d40 0x7fa6e80b6200 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.345+0000 7fa70679d640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa70010cb00 0x7fa70019e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.345+0000 7fa70679d640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa700103fc0 0x7fa700199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.345+0000 7fa70679d640 1 --2- 172.21.15.47:0/1400837011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7001036a0 0x7fa700198d30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.345+0000 7fa70679d640 1 -- 172.21.15.47:0/1400837011 >> 172.21.15.47:0/1400837011 conn(0x7fa7000fd100 msgr2=0x7fa7000fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.345+0000 7fa70679d640 1 -- 172.21.15.47:0/1400837011 shutdown_connections 2024-07-24T22:07:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:12.345+0000 7fa70679d640 1 -- 172.21.15.47:0/1400837011 wait complete. 2024-07-24T22:07:12.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:07:12.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:07:12.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:07:12.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:07:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:07:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:07:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:07:12.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:07:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:07:12.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:07:13.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.112+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3449319115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13c4108b20 msgr2=0x7f13c410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:13.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.112+0000 7f13ca3dd640 1 --2- 172.21.15.47:0/3449319115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13c4108b20 0x7f13c410f320 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009ca0 tx=0x7f13bc02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:07:13.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.112+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3449319115 shutdown_connections 2024-07-24T22:07:13.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.112+0000 7f13ca3dd640 1 --2- 172.21.15.47:0/3449319115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13c4108b20 0x7f13c410f320 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:13.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.112+0000 7f13ca3dd640 1 --2- 172.21.15.47:0/3449319115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c41081a0 0x7f13c41085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:13.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.112+0000 7f13ca3dd640 1 --2- 172.21.15.47:0/3449319115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13c4102790 0x7f13c4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:13.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.112+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3449319115 >> 172.21.15.47:0/3449319115 conn(0x7f13c40fe200 msgr2=0x7f13c4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:13.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.112+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3449319115 shutdown_connections 2024-07-24T22:07:13.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.112+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3449319115 wait complete. 2024-07-24T22:07:13.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.112+0000 7f13ca3dd640 1 Processor -- start 2024-07-24T22:07:13.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13ca3dd640 1 -- start start 2024-07-24T22:07:13.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13ca3dd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4102790 0x7f13c419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:13.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13ca3dd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13c41081a0 0x7f13c419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:13.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13ca3dd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13c4108b20 0x7f13c41a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:13.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13ca3dd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f13c4112740 con 0x7f13c4108b20 2024-07-24T22:07:13.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13ca3dd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f13c41125c0 con 0x7f13c4102790 2024-07-24T22:07:13.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13ca3dd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f13c41128c0 con 0x7f13c41081a0 2024-07-24T22:07:13.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13c897a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13c4108b20 0x7f13c41a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:13.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13c897a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13c4108b20 0x7f13c41a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33410/0 (socket says 172.21.15.47:33410) 2024-07-24T22:07:13.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13c897a640 1 -- 172.21.15.47:0/3994383729 learned_addr learned my addr 172.21.15.47:0/3994383729 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:13.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13c3fff640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4102790 0x7f13c419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13c37fe640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13c41081a0 0x7f13c419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13c897a640 1 -- 172.21.15.47:0/3994383729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13c41081a0 msgr2=0x7f13c419b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13c897a640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13c41081a0 0x7f13c419b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13c897a640 1 -- 172.21.15.47:0/3994383729 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4102790 msgr2=0x7f13c419ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13c897a640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4102790 0x7f13c419ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.113+0000 7f13c897a640 1 -- 172.21.15.47:0/3994383729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c41a0ec0 con 0x7f13c4108b20 2024-07-24T22:07:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.114+0000 7f13c897a640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13c4108b20 0x7f13c41a06f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0098d0 tx=0x7f13bc0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.114+0000 7f13c17fa640 1 -- 172.21.15.47:0/3994383729 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc003b70 con 0x7f13c4108b20 2024-07-24T22:07:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.114+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3994383729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c41a1150 con 0x7f13c4108b20 2024-07-24T22:07:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.114+0000 7f13c17fa640 1 -- 172.21.15.47:0/3994383729 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13bc003d10 con 0x7f13c4108b20 2024-07-24T22:07:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.114+0000 7f13c17fa640 1 -- 172.21.15.47:0/3994383729 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc02fa20 con 0x7f13c4108b20 2024-07-24T22:07:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.114+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3994383729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c41a7870 con 0x7f13c4108b20 2024-07-24T22:07:13.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.115+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3994383729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c4102b70 con 0x7f13c4108b20 2024-07-24T22:07:13.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.116+0000 7f13c17fa640 1 -- 172.21.15.47:0/3994383729 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f13bc02fbe0 con 0x7f13c4108b20 2024-07-24T22:07:13.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.117+0000 7f13c17fa640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13ac0b3d40 0x7f13ac0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:13.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.117+0000 7f13c3fff640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13ac0b3d40 0x7f13ac0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:13.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.117+0000 7f13c17fa640 1 -- 172.21.15.47:0/3994383729 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f13bc1054e0 con 0x7f13c4108b20 2024-07-24T22:07:13.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.118+0000 7f13c3fff640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13ac0b3d40 0x7f13ac0b6200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009bd0 tx=0x7f13b4005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:13.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.120+0000 7f13c17fa640 1 -- 172.21.15.47:0/3994383729 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f13bc0cc900 con 0x7f13c4108b20 2024-07-24T22:07:13.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.356+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3994383729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13c402e000 con 0x7f13c4108b20 2024-07-24T22:07:13.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.357+0000 7f13c17fa640 1 -- 172.21.15.47:0/3994383729 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f13bc0cc200 con 0x7f13c4108b20 2024-07-24T22:07:13.359 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:07:13.359 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:07:13.359 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:07:13.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.359+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3994383729 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13ac0b3d40 msgr2=0x7f13ac0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:13.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.359+0000 7f13ca3dd640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13ac0b3d40 0x7f13ac0b6200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009bd0 tx=0x7f13b4005f90 comp rx=0 tx=0).stop 2024-07-24T22:07:13.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.359+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3994383729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13c4108b20 msgr2=0x7f13c41a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:13.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.359+0000 7f13ca3dd640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13c4108b20 0x7f13c41a06f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0098d0 tx=0x7f13bc0317b0 comp rx=0 tx=0).stop 2024-07-24T22:07:13.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.359+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3994383729 shutdown_connections 2024-07-24T22:07:13.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.359+0000 7f13ca3dd640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13ac0b3d40 0x7f13ac0b6200 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:13.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.359+0000 7f13ca3dd640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13c4108b20 0x7f13c41a06f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:13.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.359+0000 7f13ca3dd640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13c41081a0 0x7f13c419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:13.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.359+0000 7f13ca3dd640 1 --2- 172.21.15.47:0/3994383729 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4102790 0x7f13c419ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:13.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.359+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3994383729 >> 172.21.15.47:0/3994383729 conn(0x7f13c40fe200 msgr2=0x7f13c4104750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:13.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.359+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3994383729 shutdown_connections 2024-07-24T22:07:13.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:13.359+0000 7f13ca3dd640 1 -- 172.21.15.47:0/3994383729 wait complete. 2024-07-24T22:07:13.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:13 smithi047 ceph-mon[32551]: pgmap v366: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-07-24T22:07:13.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:13 smithi188 ceph-mon[37380]: pgmap v366: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-07-24T22:07:13.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:13 smithi183 ceph-mon[37007]: pgmap v366: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-07-24T22:07:14.336 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:07:14.606 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:14.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:14 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3994383729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:14.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:14 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3994383729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:14.690 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:07:14.691 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:07:14.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:14 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3994383729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:15.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:15 smithi183 ceph-mon[37007]: pgmap v367: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-07-24T22:07:15.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:15 smithi047 ceph-mon[32551]: pgmap v367: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-07-24T22:07:15.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:15 smithi188 ceph-mon[37380]: pgmap v367: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-07-24T22:07:15.800 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:17.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:17 smithi047 ceph-mon[32551]: pgmap v368: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-07-24T22:07:17.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:17 smithi183 ceph-mon[37007]: pgmap v368: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-07-24T22:07:17.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.762+0000 7fb678710640 1 -- 172.21.15.47:0/2482608090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb670101650 msgr2=0x7fb670101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:17.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.762+0000 7fb678710640 1 --2- 172.21.15.47:0/2482608090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb670101650 0x7fb670101a30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009900 tx=0x7fb66c02a410 comp rx=0 tx=0).stop 2024-07-24T22:07:17.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.762+0000 7fb678710640 1 -- 172.21.15.47:0/2482608090 shutdown_connections 2024-07-24T22:07:17.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.762+0000 7fb678710640 1 --2- 172.21.15.47:0/2482608090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6701079e0 0x7fb67010e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.762+0000 7fb678710640 1 --2- 172.21.15.47:0/2482608090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb670107060 0x7fb6701074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.762+0000 7fb678710640 1 --2- 172.21.15.47:0/2482608090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb670101650 0x7fb670101a30 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.762+0000 7fb678710640 1 -- 172.21.15.47:0/2482608090 >> 172.21.15.47:0/2482608090 conn(0x7fb6700fd0c0 msgr2=0x7fb6700ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:17.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.762+0000 7fb678710640 1 -- 172.21.15.47:0/2482608090 shutdown_connections 2024-07-24T22:07:17.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.762+0000 7fb678710640 1 -- 172.21.15.47:0/2482608090 wait complete. 2024-07-24T22:07:17.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.763+0000 7fb678710640 1 Processor -- start 2024-07-24T22:07:17.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.763+0000 7fb678710640 1 -- start start 2024-07-24T22:07:17.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.763+0000 7fb678710640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb670101650 0x7fb670198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.763+0000 7fb678710640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb670107060 0x7fb6701991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.763+0000 7fb678710640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6701079e0 0x7fb67019e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.763+0000 7fb678710640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701115f0 con 0x7fb6701079e0 2024-07-24T22:07:17.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.763+0000 7fb678710640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb670111470 con 0x7fb670107060 2024-07-24T22:07:17.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.763+0000 7fb678710640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb670111770 con 0x7fb670101650 2024-07-24T22:07:17.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.763+0000 7fb676cad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6701079e0 0x7fb67019e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.763+0000 7fb676cad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6701079e0 0x7fb67019e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35454/0 (socket says 172.21.15.47:35454) 2024-07-24T22:07:17.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.763+0000 7fb676cad640 1 -- 172.21.15.47:0/418360131 learned_addr learned my addr 172.21.15.47:0/418360131 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:17.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.763+0000 7fb675cab640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb670107060 0x7fb6701991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.763+0000 7fb6764ac640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb670101650 0x7fb670198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.764+0000 7fb676cad640 1 -- 172.21.15.47:0/418360131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb670101650 msgr2=0x7fb670198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:17.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.764+0000 7fb676cad640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb670101650 0x7fb670198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.764+0000 7fb676cad640 1 -- 172.21.15.47:0/418360131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb670107060 msgr2=0x7fb6701991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:17.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.764+0000 7fb676cad640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb670107060 0x7fb6701991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.764+0000 7fb676cad640 1 -- 172.21.15.47:0/418360131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67019ed10 con 0x7fb6701079e0 2024-07-24T22:07:17.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.764+0000 7fb676cad640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6701079e0 0x7fb67019e540 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb66800cad0 tx=0x7fb66800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:17.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.764+0000 7fb6677fe640 1 -- 172.21.15.47:0/418360131 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66800ae20 con 0x7fb6701079e0 2024-07-24T22:07:17.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.764+0000 7fb6677fe640 1 -- 172.21.15.47:0/418360131 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb668005020 con 0x7fb6701079e0 2024-07-24T22:07:17.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.764+0000 7fb678710640 1 -- 172.21.15.47:0/418360131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67019f000 con 0x7fb6701079e0 2024-07-24T22:07:17.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.764+0000 7fb6677fe640 1 -- 172.21.15.47:0/418360131 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66800f6b0 con 0x7fb6701079e0 2024-07-24T22:07:17.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.764+0000 7fb678710640 1 -- 172.21.15.47:0/418360131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6701a56c0 con 0x7fb6701079e0 2024-07-24T22:07:17.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.766+0000 7fb6677fe640 1 -- 172.21.15.47:0/418360131 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fb6680051d0 con 0x7fb6701079e0 2024-07-24T22:07:17.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb67aac1740 1 Processor -- start 2024-07-24T22:07:17.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb67aac1740 1 -- start start 2024-07-24T22:07:17.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb67aac1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 0x563c73d81710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb67aac1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 0x563c73d8d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb67aac1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d8dbe0 0x563c73d8ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb67aac1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563c73cf49f0 con 0x563c73d81c50 2024-07-24T22:07:17.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb67aac1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563c73ce3ef0 con 0x563c73d81330 2024-07-24T22:07:17.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb67aac1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563c73ce7f30 con 0x563c73d8dbe0 2024-07-24T22:07:17.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb6764ac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 0x563c73d8d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb6764ac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 0x563c73d8d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35466/0 (socket says 172.21.15.47:35466) 2024-07-24T22:07:17.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb6764ac640 1 -- 172.21.15.47:0/2617272722 learned_addr learned my addr 172.21.15.47:0/2617272722 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:17.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb675cab640 1 --2- 172.21.15.47:0/2617272722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 0x563c73d81710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb675cab640 1 --2- 172.21.15.47:0/2617272722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d8dbe0 0x563c73d8ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.767+0000 7fb6677fe640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb65c0b3dc0 0x7fb65c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.768+0000 7fb6764ac640 1 -- 172.21.15.47:0/2617272722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d8dbe0 msgr2=0x563c73d8ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:17.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.768+0000 7fb6764ac640 1 --2- 172.21.15.47:0/2617272722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d8dbe0 0x563c73d8ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.768+0000 7fb6764ac640 1 -- 172.21.15.47:0/2617272722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 msgr2=0x563c73d81710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:17.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.768+0000 7fb6764ac640 1 --2- 172.21.15.47:0/2617272722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 0x563c73d81710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.768+0000 7fb6764ac640 1 -- 172.21.15.47:0/2617272722 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c73a44930 con 0x563c73d81c50 2024-07-24T22:07:17.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.768+0000 7fb675cab640 1 --2- 172.21.15.47:0/2617272722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d8dbe0 0x563c73d8ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:17.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.768+0000 7fb676cad640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb65c0b3dc0 0x7fb65c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.768+0000 7fb6764ac640 1 --2- 172.21.15.47:0/2617272722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 0x563c73d8d6a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009900 tx=0x7fb66c032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5fd7f3353cae server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:17.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.768+0000 7fb6677fe640 1 -- 172.21.15.47:0/418360131 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb6680e3f00 con 0x7fb6701079e0 2024-07-24T22:07:17.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.768+0000 7fb664ff9640 1 -- 172.21.15.47:0/2617272722 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c040070 con 0x563c73d81c50 2024-07-24T22:07:17.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.768+0000 7fb664ff9640 1 -- 172.21.15.47:0/2617272722 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb66c0316a0 con 0x563c73d81c50 2024-07-24T22:07:17.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.768+0000 7fb664ff9640 1 -- 172.21.15.47:0/2617272722 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c035040 con 0x563c73d81c50 2024-07-24T22:07:17.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.769+0000 7fb67aac1740 1 -- 172.21.15.47:0/2617272722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 msgr2=0x563c73d8d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:17.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.769+0000 7fb676cad640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb65c0b3dc0 0x7fb65c0b6280 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb6680e1700 tx=0x7fb668075f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:17.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.769+0000 7fb67aac1740 1 --2- 172.21.15.47:0/2617272722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 0x563c73d8d6a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009900 tx=0x7fb66c032e60 comp rx=0 tx=0).stop 2024-07-24T22:07:17.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.769+0000 7fb67aac1740 1 -- 172.21.15.47:0/2617272722 shutdown_connections 2024-07-24T22:07:17.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.769+0000 7fb67aac1740 1 --2- 172.21.15.47:0/2617272722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d8dbe0 0x563c73d8ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.769+0000 7fb67aac1740 1 --2- 172.21.15.47:0/2617272722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 0x563c73d8d6a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.769+0000 7fb67aac1740 1 --2- 172.21.15.47:0/2617272722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 0x563c73d81710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.769+0000 7fb67aac1740 1 -- 172.21.15.47:0/2617272722 >> 172.21.15.47:0/2617272722 conn(0x563c73d7f160 msgr2=0x563c73d80300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.769+0000 7fb67aac1740 1 -- 172.21.15.47:0/2617272722 shutdown_connections 2024-07-24T22:07:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.769+0000 7fb67aac1740 1 -- 172.21.15.47:0/2617272722 wait complete. 2024-07-24T22:07:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.769+0000 7fb67aac1740 1 -- start start 2024-07-24T22:07:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.769+0000 7fb67aac1740 1 Processor -- start 2024-07-24T22:07:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb67aac1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81330 0x563c73d8abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb67aac1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 0x563c73d8b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb67aac1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d8dbe0 0x563c73d8b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb67aac1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563c73b47890 con 0x563c73d81c50 2024-07-24T22:07:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb67aac1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563c73c86390 con 0x563c73d8dbe0 2024-07-24T22:07:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb67aac1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563c73d90800 con 0x563c73d81330 2024-07-24T22:07:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb67aac1740 10 client.0 _ll_register_callbacks cb 0x563c73c90500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb6764ac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 0x563c73d8b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb6764ac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 0x563c73d8b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35482/0 (socket says 172.21.15.47:35482) 2024-07-24T22:07:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb6764ac640 1 -- 172.21.15.47:0/3570534765 learned_addr learned my addr 172.21.15.47:0/3570534765 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb6764ac640 1 -- 172.21.15.47:0/3570534765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81330 msgr2=0x563c73d8abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb6764ac640 1 --2- 172.21.15.47:0/3570534765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81330 0x563c73d8abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb6764ac640 1 -- 172.21.15.47:0/3570534765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d8dbe0 msgr2=0x563c73d8b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb6764ac640 1 --2- 172.21.15.47:0/3570534765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d8dbe0 0x563c73d8b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb6764ac640 1 -- 172.21.15.47:0/3570534765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c73c80d60 con 0x563c73d81c50 2024-07-24T22:07:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb6764ac640 1 --2- 172.21.15.47:0/3570534765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 0x563c73d8b130 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0096c0 tx=0x7fb66c005380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1dd0e42c83af12 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb659ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb659ffb640 1 -- 172.21.15.47:0/3570534765 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c035040 con 0x563c73d81c50 2024-07-24T22:07:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb659ffb640 1 -- 172.21.15.47:0/3570534765 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb66c004030 con 0x563c73d81c50 2024-07-24T22:07:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.770+0000 7fb67aac1740 1 -- 172.21.15.47:0/3570534765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb66c0316a0 con 0x563c73d81c50 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.771+0000 7fb659ffb640 1 -- 172.21.15.47:0/3570534765 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb66c040040 con 0x563c73d81c50 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.771+0000 7fb67aac1740 10 client.15435 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.771+0000 7fb67aac1740 1 -- 172.21.15.47:0/3570534765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563c73d9c710 con 0x563c73d81c50 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.771+0000 7fb659ffb640 1 -- 172.21.15.47:0/3570534765 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb66c0316a0 con 0x563c73d81c50 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.771+0000 7fb659ffb640 1 -- 172.21.15.47:0/3570534765 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb66c04d450 con 0x563c73d81c50 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.771+0000 7fb67aac1740 10 client.15435 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.771+0000 7fb67aac1740 10 client.15435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.771+0000 7fb67aac1740 20 client.15435 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.771+0000 7fb67aac1740 1 --2- 172.21.15.47:0/3570534765 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c73d9da60 0x563c73d9fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.771+0000 7fb67aac1740 4 client.15435 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.771+0000 7fb67aac1740 1 -- 172.21.15.47:0/3570534765 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c73cf6940 con 0x563c73d9da60 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.771+0000 7fb675cab640 1 --2- 172.21.15.47:0/3570534765 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c73d9da60 0x563c73d9fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.772+0000 7fb659ffb640 10 client.15435 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:17.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.772+0000 7fb675cab640 1 --2- 172.21.15.47:0/3570534765 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c73d9da60 0x563c73d9fe50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3223c7e2cddb18a server_cookie=e418900a00d27cff in_seq=0 out_seq=0 2024-07-24T22:07:17.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb659ffb640 1 -- 172.21.15.47:0/3570534765 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c73cf6940 con 0x563c73d9da60 2024-07-24T22:07:17.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb659ffb640 10 client.15435 handle_command_reply: tid=0 2024-07-24T22:07:17.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb67aac1740 1 client.15435 shutdown 2024-07-24T22:07:17.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb67aac1740 1 -- 172.21.15.47:0/3570534765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 msgr2=0x563c73d8b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:17.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb67aac1740 1 --2- 172.21.15.47:0/3570534765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 0x563c73d8b130 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0096c0 tx=0x7fb66c005380 comp rx=0 tx=0).stop 2024-07-24T22:07:17.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb67aac1740 1 -- 172.21.15.47:0/3570534765 shutdown_connections 2024-07-24T22:07:17.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb67aac1740 1 --2- 172.21.15.47:0/3570534765 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c73d9da60 0x563c73d9fe50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb67aac1740 1 --2- 172.21.15.47:0/3570534765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d8dbe0 0x563c73d8b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb67aac1740 1 --2- 172.21.15.47:0/3570534765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d81c50 0x563c73d8b130 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb67aac1740 1 --2- 172.21.15.47:0/3570534765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81330 0x563c73d8abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb67aac1740 1 -- 172.21.15.47:0/3570534765 >> 172.21.15.47:0/3570534765 conn(0x563c73d7f160 msgr2=0x563c73d84d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:17.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb659ffb640 0 client.15435 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:17.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb67aac1740 1 -- 172.21.15.47:0/3570534765 shutdown_connections 2024-07-24T22:07:17.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb67aac1740 1 -- 172.21.15.47:0/3570534765 wait complete. 2024-07-24T22:07:17.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.773+0000 7fb67aac1740 20 client.15435 trim_cache size 0 max 16384 2024-07-24T22:07:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb67aac1740 1 Processor -- start 2024-07-24T22:07:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb67aac1740 1 -- start start 2024-07-24T22:07:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb67aac1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 0x563c73d8c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb67aac1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81c50 0x563c73d79d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb67aac1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 0x563c73d87e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb67aac1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701a9ed0 con 0x563c73d8dbe0 2024-07-24T22:07:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb67aac1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701ac750 con 0x563c73d81330 2024-07-24T22:07:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb67aac1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701aa540 con 0x563c73d81c50 2024-07-24T22:07:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb675cab640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 0x563c73d87e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb675cab640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 0x563c73d87e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35492/0 (socket says 172.21.15.47:35492) 2024-07-24T22:07:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb675cab640 1 -- 172.21.15.47:0/439662294 learned_addr learned my addr 172.21.15.47:0/439662294 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb6764ac640 1 --2- 172.21.15.47:0/439662294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81c50 0x563c73d79d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb675cab640 1 -- 172.21.15.47:0/439662294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81c50 msgr2=0x563c73d79d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb675cab640 1 --2- 172.21.15.47:0/439662294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81c50 0x563c73d79d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb675cab640 1 -- 172.21.15.47:0/439662294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 msgr2=0x563c73d8c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.792+0000 7fb675cab640 1 --2- 172.21.15.47:0/439662294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 0x563c73d8c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.793+0000 7fb675cab640 1 -- 172.21.15.47:0/439662294 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c73d80bb0 con 0x563c73d8dbe0 2024-07-24T22:07:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.793+0000 7fb675cab640 1 --2- 172.21.15.47:0/439662294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 0x563c73d87e00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb66000c010 tx=0x7fb660005540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5917e8ca7d0a4c05 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.793+0000 7fb65bfff640 1 -- 172.21.15.47:0/439662294 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660004d20 con 0x563c73d8dbe0 2024-07-24T22:07:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.793+0000 7fb65bfff640 1 -- 172.21.15.47:0/439662294 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6600035f0 con 0x563c73d8dbe0 2024-07-24T22:07:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.793+0000 7fb65bfff640 1 -- 172.21.15.47:0/439662294 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6600126c0 con 0x563c73d8dbe0 2024-07-24T22:07:17.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.793+0000 7fb67aac1740 1 -- 172.21.15.47:0/439662294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 msgr2=0x563c73d87e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:17.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.793+0000 7fb67aac1740 1 --2- 172.21.15.47:0/439662294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 0x563c73d87e00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb66000c010 tx=0x7fb660005540 comp rx=0 tx=0).stop 2024-07-24T22:07:17.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 -- 172.21.15.47:0/439662294 shutdown_connections 2024-07-24T22:07:17.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 --2- 172.21.15.47:0/439662294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 0x563c73d87e00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 --2- 172.21.15.47:0/439662294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81c50 0x563c73d79d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 --2- 172.21.15.47:0/439662294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 0x563c73d8c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 -- 172.21.15.47:0/439662294 >> 172.21.15.47:0/439662294 conn(0x563c73d7f160 msgr2=0x563c73d795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:17.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 -- 172.21.15.47:0/439662294 shutdown_connections 2024-07-24T22:07:17.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 -- 172.21.15.47:0/439662294 wait complete. 2024-07-24T22:07:17.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 -- start start 2024-07-24T22:07:17.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 Processor -- start 2024-07-24T22:07:17.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 0x563c73da1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81c50 0x563c73da1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 0x563c73e015a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701aac10 con 0x563c73d8dbe0 2024-07-24T22:07:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701ac080 con 0x563c73d81330 2024-07-24T22:07:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701ab2e0 con 0x563c73d81c50 2024-07-24T22:07:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb67aac1740 10 client.0 _ll_register_callbacks cb 0x7fb66c02ab50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb675cab640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 0x563c73e015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.794+0000 7fb675cab640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 0x563c73e015a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35498/0 (socket says 172.21.15.47:35498) 2024-07-24T22:07:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb675cab640 1 -- 172.21.15.47:0/1056579651 learned_addr learned my addr 172.21.15.47:0/1056579651 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb6764ac640 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81c50 0x563c73da1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb675cab640 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 0x563c73da1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb675cab640 1 -- 172.21.15.47:0/1056579651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81c50 msgr2=0x563c73da1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb675cab640 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81c50 0x563c73da1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb675cab640 1 -- 172.21.15.47:0/1056579651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 msgr2=0x563c73da1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb675cab640 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 0x563c73da1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb675cab640 1 -- 172.21.15.47:0/1056579651 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c73e01ce0 con 0x563c73d8dbe0 2024-07-24T22:07:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb6764ac640 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81c50 0x563c73da1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:07:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb675cab640 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 0x563c73e015a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb660004230 tx=0x7fb660003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a986d5b103f2cc server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb659ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb659ffb640 1 -- 172.21.15.47:0/1056579651 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6600044a0 con 0x563c73d8dbe0 2024-07-24T22:07:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb659ffb640 1 -- 172.21.15.47:0/1056579651 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb6600037a0 con 0x563c73d8dbe0 2024-07-24T22:07:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb67aac1740 1 -- 172.21.15.47:0/1056579651 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6600035f0 con 0x563c73d8dbe0 2024-07-24T22:07:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb659ffb640 1 -- 172.21.15.47:0/1056579651 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb6600039a0 con 0x563c73d8dbe0 2024-07-24T22:07:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb67aac1740 10 client.15441 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.795+0000 7fb67aac1740 1 -- 172.21.15.47:0/1056579651 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563c73e091a0 con 0x563c73d8dbe0 2024-07-24T22:07:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.796+0000 7fb659ffb640 1 -- 172.21.15.47:0/1056579651 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6600035f0 con 0x563c73d8dbe0 2024-07-24T22:07:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.796+0000 7fb659ffb640 1 -- 172.21.15.47:0/1056579651 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb660034c60 con 0x563c73d8dbe0 2024-07-24T22:07:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.796+0000 7fb67aac1740 10 client.15441 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.796+0000 7fb67aac1740 10 client.15441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.796+0000 7fb67aac1740 20 client.15441 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.796+0000 7fb67aac1740 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c73e098a0 0x563c73e0bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.796+0000 7fb67aac1740 4 client.15441 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:07:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.796+0000 7fb67aac1740 1 -- 172.21.15.47:0/1056579651 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563c73cf23e0 con 0x563c73e098a0 2024-07-24T22:07:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.796+0000 7fb6764ac640 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c73e098a0 0x563c73e0bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.796+0000 7fb6764ac640 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c73e098a0 0x563c73e0bcc0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e8a722b0c725897 server_cookie=510ac24f6e8c3335 in_seq=0 out_seq=0 2024-07-24T22:07:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.796+0000 7fb659ffb640 10 client.15441 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:17.803 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:17 smithi188 ceph-mon[37380]: pgmap v368: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-07-24T22:07:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.797+0000 7fb659ffb640 1 -- 172.21.15.47:0/1056579651 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563c73cf23e0 con 0x563c73e098a0 2024-07-24T22:07:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.797+0000 7fb659ffb640 10 client.15441 handle_command_reply: tid=0 2024-07-24T22:07:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.797+0000 7fb67aac1740 1 client.15441 shutdown 2024-07-24T22:07:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.797+0000 7fb67aac1740 1 -- 172.21.15.47:0/1056579651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 msgr2=0x563c73e015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.797+0000 7fb67aac1740 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 0x563c73e015a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb660004230 tx=0x7fb660003f50 comp rx=0 tx=0).stop 2024-07-24T22:07:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb67aac1740 1 -- 172.21.15.47:0/1056579651 shutdown_connections 2024-07-24T22:07:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb67aac1740 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c73e098a0 0x563c73e0bcc0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb67aac1740 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c73d8dbe0 0x563c73e015a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb67aac1740 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c73d81c50 0x563c73da1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb67aac1740 1 --2- 172.21.15.47:0/1056579651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c73d81330 0x563c73da1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb659ffb640 0 client.15441 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:17.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb67aac1740 1 -- 172.21.15.47:0/1056579651 >> 172.21.15.47:0/1056579651 conn(0x563c73d7f160 msgr2=0x563c73d79e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:17.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb67aac1740 1 -- 172.21.15.47:0/1056579651 shutdown_connections 2024-07-24T22:07:17.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb67aac1740 1 -- 172.21.15.47:0/1056579651 wait complete. 2024-07-24T22:07:17.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb67aac1740 20 client.15441 trim_cache size 0 max 16384 2024-07-24T22:07:17.805 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:07:17.805 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:07:17.805 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "f7bba0b1-483f-4c8e-a0da-17e5cd1ac770", 2024-07-24T22:07:17.805 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:07:17.805 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:07:17.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb678710640 1 -- 172.21.15.47:0/418360131 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb65c0b3dc0 msgr2=0x7fb65c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:17.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb678710640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb65c0b3dc0 0x7fb65c0b6280 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb6680e1700 tx=0x7fb668075f90 comp rx=0 tx=0).stop 2024-07-24T22:07:17.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb678710640 1 -- 172.21.15.47:0/418360131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6701079e0 msgr2=0x7fb67019e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:17.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.798+0000 7fb678710640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6701079e0 0x7fb67019e540 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb66800cad0 tx=0x7fb66800cf90 comp rx=0 tx=0).stop 2024-07-24T22:07:17.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.799+0000 7fb678710640 1 -- 172.21.15.47:0/418360131 shutdown_connections 2024-07-24T22:07:17.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.799+0000 7fb678710640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb65c0b3dc0 0x7fb65c0b6280 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.799+0000 7fb678710640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6701079e0 0x7fb67019e540 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.799+0000 7fb678710640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb670107060 0x7fb6701991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.799+0000 7fb678710640 1 --2- 172.21.15.47:0/418360131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb670101650 0x7fb670198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.799+0000 7fb678710640 1 -- 172.21.15.47:0/418360131 >> 172.21.15.47:0/418360131 conn(0x7fb6700fd0c0 msgr2=0x7fb67006a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.799+0000 7fb678710640 1 -- 172.21.15.47:0/418360131 shutdown_connections 2024-07-24T22:07:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.799+0000 7fb678710640 1 -- 172.21.15.47:0/418360131 wait complete. 2024-07-24T22:07:17.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.955+0000 7f2181a9d640 1 -- 172.21.15.47:0/2851744706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f217c103fc0 msgr2=0x7f217c10c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:17.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.955+0000 7f2181a9d640 1 --2- 172.21.15.47:0/2851744706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f217c103fc0 0x7f217c10c4b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2164009900 tx=0x7f216402a410 comp rx=0 tx=0).stop 2024-07-24T22:07:17.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.955+0000 7f2181a9d640 1 -- 172.21.15.47:0/2851744706 shutdown_connections 2024-07-24T22:07:17.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.955+0000 7f2181a9d640 1 --2- 172.21.15.47:0/2851744706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f217c10cb00 0x7f217c10ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.955+0000 7f2181a9d640 1 --2- 172.21.15.47:0/2851744706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f217c103fc0 0x7f217c10c4b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.955+0000 7f2181a9d640 1 --2- 172.21.15.47:0/2851744706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f217c1036a0 0x7f217c103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.955+0000 7f2181a9d640 1 -- 172.21.15.47:0/2851744706 >> 172.21.15.47:0/2851744706 conn(0x7f217c0fd100 msgr2=0x7f217c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:17.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.955+0000 7f2181a9d640 1 -- 172.21.15.47:0/2851744706 shutdown_connections 2024-07-24T22:07:17.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.955+0000 7f2181a9d640 1 -- 172.21.15.47:0/2851744706 wait complete. 2024-07-24T22:07:17.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.956+0000 7f2181a9d640 1 Processor -- start 2024-07-24T22:07:17.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.956+0000 7f2181a9d640 1 -- start start 2024-07-24T22:07:17.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.956+0000 7f2181a9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f217c1036a0 0x7f217c198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.956+0000 7f2181a9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f217c103fc0 0x7f217c1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.956+0000 7f2181a9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f217c10cb00 0x7f217c19e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.956+0000 7f2181a9d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f217c112760 con 0x7f217c103fc0 2024-07-24T22:07:17.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.956+0000 7f2181a9d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f217c1125e0 con 0x7f217c1036a0 2024-07-24T22:07:17.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.956+0000 7f2181a9d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f217c1128e0 con 0x7f217c10cb00 2024-07-24T22:07:17.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.956+0000 7f217affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f217c103fc0 0x7f217c1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.956+0000 7f217affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f217c103fc0 0x7f217c1991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35510/0 (socket says 172.21.15.47:35510) 2024-07-24T22:07:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.956+0000 7f217affd640 1 -- 172.21.15.47:0/2326694947 learned_addr learned my addr 172.21.15.47:0/2326694947 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.956+0000 7f217b7fe640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f217c1036a0 0x7f217c198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.956+0000 7f217bfff640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f217c10cb00 0x7f217c19e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.957+0000 7f217affd640 1 -- 172.21.15.47:0/2326694947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f217c10cb00 msgr2=0x7f217c19e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.957+0000 7f217affd640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f217c10cb00 0x7f217c19e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.957+0000 7f217affd640 1 -- 172.21.15.47:0/2326694947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f217c1036a0 msgr2=0x7f217c198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.957+0000 7f217affd640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f217c1036a0 0x7f217c198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.957+0000 7f217affd640 1 -- 172.21.15.47:0/2326694947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c19ed40 con 0x7f217c103fc0 2024-07-24T22:07:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.957+0000 7f217affd640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f217c103fc0 0x7f217c1991d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2164006010 tx=0x7f2164004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.957+0000 7f2178ff9640 1 -- 172.21.15.47:0/2326694947 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216403f030 con 0x7f217c103fc0 2024-07-24T22:07:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.957+0000 7f2178ff9640 1 -- 172.21.15.47:0/2326694947 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2164003aa0 con 0x7f217c103fc0 2024-07-24T22:07:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.957+0000 7f2181a9d640 1 -- 172.21.15.47:0/2326694947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217c19efd0 con 0x7f217c103fc0 2024-07-24T22:07:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.957+0000 7f2178ff9640 1 -- 172.21.15.47:0/2326694947 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2164035070 con 0x7f217c103fc0 2024-07-24T22:07:17.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.957+0000 7f2181a9d640 1 -- 172.21.15.47:0/2326694947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217c1a56f0 con 0x7f217c103fc0 2024-07-24T22:07:17.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.958+0000 7f2181a9d640 1 -- 172.21.15.47:0/2326694947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f217c103a80 con 0x7f217c103fc0 2024-07-24T22:07:17.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.959+0000 7f2178ff9640 1 -- 172.21.15.47:0/2326694947 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f2164042030 con 0x7f217c103fc0 2024-07-24T22:07:17.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.960+0000 7f2178ff9640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f21680b3d40 0x7f21680b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:17.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.960+0000 7f217b7fe640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f21680b3d40 0x7f21680b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:17.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.960+0000 7f2178ff9640 1 -- 172.21.15.47:0/2326694947 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f2164104460 con 0x7f217c103fc0 2024-07-24T22:07:17.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.961+0000 7f217b7fe640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f21680b3d40 0x7f21680b6200 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f216c005fd0 tx=0x7f216c009680 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:17.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:17.964+0000 7f2178ff9640 1 -- 172.21.15.47:0/2326694947 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f21640cb080 con 0x7f217c103fc0 2024-07-24T22:07:18.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.198+0000 7f2181a9d640 1 -- 172.21.15.47:0/2326694947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f217c199dc0 con 0x7f217c103fc0 2024-07-24T22:07:18.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.199+0000 7f2178ff9640 1 -- 172.21.15.47:0/2326694947 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f21640cf5d0 con 0x7f217c103fc0 2024-07-24T22:07:18.201 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:07:18.201 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:07:18.202 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:07:18.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.201+0000 7f2181a9d640 1 -- 172.21.15.47:0/2326694947 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f21680b3d40 msgr2=0x7f21680b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:18.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.201+0000 7f2181a9d640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f21680b3d40 0x7f21680b6200 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f216c005fd0 tx=0x7f216c009680 comp rx=0 tx=0).stop 2024-07-24T22:07:18.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.201+0000 7f2181a9d640 1 -- 172.21.15.47:0/2326694947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f217c103fc0 msgr2=0x7f217c1991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:18.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.201+0000 7f2181a9d640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f217c103fc0 0x7f217c1991d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2164006010 tx=0x7f2164004060 comp rx=0 tx=0).stop 2024-07-24T22:07:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.201+0000 7f2181a9d640 1 -- 172.21.15.47:0/2326694947 shutdown_connections 2024-07-24T22:07:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.201+0000 7f2181a9d640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f21680b3d40 0x7f21680b6200 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.201+0000 7f2181a9d640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f217c10cb00 0x7f217c19e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.201+0000 7f2181a9d640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f217c103fc0 0x7f217c1991d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.201+0000 7f2181a9d640 1 --2- 172.21.15.47:0/2326694947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f217c1036a0 0x7f217c198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.201+0000 7f2181a9d640 1 -- 172.21.15.47:0/2326694947 >> 172.21.15.47:0/2326694947 conn(0x7f217c0fd100 msgr2=0x7f217c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.201+0000 7f2181a9d640 1 -- 172.21.15.47:0/2326694947 shutdown_connections 2024-07-24T22:07:18.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:18.201+0000 7f2181a9d640 1 -- 172.21.15.47:0/2326694947 wait complete. 2024-07-24T22:07:18.573 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:18 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:07:18.573 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:18 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:07:18.573 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:18 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:07:18.573 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:18 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:07:18.573 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:18 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2326694947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:18.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:18 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:07:18.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:18 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:07:18.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:18 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:07:18.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:18 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:07:18.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:18 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2326694947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:18.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:18 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:07:18.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:18 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:07:18.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:18 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:07:18.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:18 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:07:18.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:18 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2326694947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:18.912 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:07:19.355 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd dump --format=json 2024-07-24T22:07:19.416 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:19.658 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:19 smithi047 ceph-mon[32551]: pgmap v369: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-07-24T22:07:19.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:19 smithi183 ceph-mon[37007]: pgmap v369: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-07-24T22:07:19.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:19 smithi188 ceph-mon[37380]: pgmap v369: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-07-24T22:07:20.592 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:20.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:20 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:07:20.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:20 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:07:20.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:20 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:07:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:21 smithi183 ceph-mon[37007]: pgmap v370: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-07-24T22:07:21.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:21 smithi047 ceph-mon[32551]: pgmap v370: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-07-24T22:07:21.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:21 smithi188 ceph-mon[37380]: pgmap v370: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-07-24T22:07:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.133+0000 7f82b6d1e640 1 -- 172.21.15.47:0/3620852800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82b010cbf0 msgr2=0x7f82b010efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.133+0000 7f82b6d1e640 1 --2- 172.21.15.47:0/3620852800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82b010cbf0 0x7f82b010efe0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009ca0 tx=0x7f82a802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 -- 172.21.15.47:0/3620852800 shutdown_connections 2024-07-24T22:07:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 --2- 172.21.15.47:0/3620852800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82b010cbf0 0x7f82b010efe0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 --2- 172.21.15.47:0/3620852800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82b010a2c0 0x7f82b010c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 --2- 172.21.15.47:0/3620852800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b01011c0 0x7f82b01015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 -- 172.21.15.47:0/3620852800 >> 172.21.15.47:0/3620852800 conn(0x7f82b00767a0 msgr2=0x7f82b0076bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 -- 172.21.15.47:0/3620852800 shutdown_connections 2024-07-24T22:07:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 -- 172.21.15.47:0/3620852800 wait complete. 2024-07-24T22:07:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 Processor -- start 2024-07-24T22:07:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 -- start start 2024-07-24T22:07:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82b01011c0 0x7f82b0102180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82b010a2c0 0x7f82b01026c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b010cbf0 0x7f82b0102c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82b0112740 con 0x7f82b010a2c0 2024-07-24T22:07:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f82b01125c0 con 0x7f82b010cbf0 2024-07-24T22:07:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82b6d1e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f82b01128c0 con 0x7f82b01011c0 2024-07-24T22:07:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.134+0000 7f82a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82b010a2c0 0x7f82b01026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82b010a2c0 0x7f82b01026c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35610/0 (socket says 172.21.15.47:35610) 2024-07-24T22:07:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82a7fff640 1 -- 172.21.15.47:0/2642926110 learned_addr learned my addr 172.21.15.47:0/2642926110 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82b4aba640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82b01011c0 0x7f82b0102180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82a7fff640 1 -- 172.21.15.47:0/2642926110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82b01011c0 msgr2=0x7f82b0102180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82a7fff640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82b01011c0 0x7f82b0102180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82a7fff640 1 -- 172.21.15.47:0/2642926110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b010cbf0 msgr2=0x7f82b0102c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82b52bb640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b010cbf0 0x7f82b0102c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82a7fff640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b010cbf0 0x7f82b0102c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82a7fff640 1 -- 172.21.15.47:0/2642926110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b01a6ff0 con 0x7f82b010a2c0 2024-07-24T22:07:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82b4aba640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82b01011c0 0x7f82b0102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82a7fff640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82b010a2c0 0x7f82b01026c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f82a000d740 tx=0x7f82a000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82a5ffb640 1 -- 172.21.15.47:0/2642926110 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a0017070 con 0x7f82b010a2c0 2024-07-24T22:07:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82a5ffb640 1 -- 172.21.15.47:0/2642926110 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82a000de50 con 0x7f82b010a2c0 2024-07-24T22:07:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82b6d1e640 1 -- 172.21.15.47:0/2642926110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b01a72e0 con 0x7f82b010a2c0 2024-07-24T22:07:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82a5ffb640 1 -- 172.21.15.47:0/2642926110 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a0004ce0 con 0x7f82b010a2c0 2024-07-24T22:07:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.135+0000 7f82b6d1e640 1 -- 172.21.15.47:0/2642926110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b01a7830 con 0x7f82b010a2c0 2024-07-24T22:07:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.138+0000 7f82a5ffb640 1 -- 172.21.15.47:0/2642926110 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f82a0004e80 con 0x7f82b010a2c0 2024-07-24T22:07:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.138+0000 7f82b9a79740 1 Processor -- start 2024-07-24T22:07:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.138+0000 7f82b9a79740 1 -- start start 2024-07-24T22:07:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.138+0000 7f82b9a79740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f51ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.138+0000 7f82b9a79740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f521e0 0x5557e3f5dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.138+0000 7f82b9a79740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f5e170 0x5557e3f60560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.138+0000 7f82b9a79740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5557e3ec7280 con 0x5557e3f518c0 2024-07-24T22:07:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.138+0000 7f82b9a79740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5557e3eb6780 con 0x5557e3f521e0 2024-07-24T22:07:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.138+0000 7f82b9a79740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5557e3eba7c0 con 0x5557e3f5e170 2024-07-24T22:07:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.138+0000 7f82b52bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f51ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82b52bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f51ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35614/0 (socket says 172.21.15.47:35614) 2024-07-24T22:07:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82b52bb640 1 -- 172.21.15.47:0/1943262631 learned_addr learned my addr 172.21.15.47:0/1943262631 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82a7fff640 1 --2- 172.21.15.47:0/1943262631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f5e170 0x5557e3f60560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82a5ffb640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f82980b3dc0 0x7f82980b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82b4aba640 1 --2- 172.21.15.47:0/1943262631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f521e0 0x5557e3f5dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82b52bb640 1 -- 172.21.15.47:0/1943262631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f5e170 msgr2=0x5557e3f60560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82b52bb640 1 --2- 172.21.15.47:0/1943262631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f5e170 0x5557e3f60560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82b52bb640 1 -- 172.21.15.47:0/1943262631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f521e0 msgr2=0x5557e3f5dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82b52bb640 1 --2- 172.21.15.47:0/1943262631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f521e0 0x5557e3f5dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82b52bb640 1 -- 172.21.15.47:0/1943262631 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557e3c1a790 con 0x5557e3f518c0 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82a7fff640 1 --2- 172.21.15.47:0/1943262631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f5e170 0x5557e3f60560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82b52bb640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f82980b3dc0 0x7f82980b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82a5ffb640 1 -- 172.21.15.47:0/2642926110 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f82a00e39e0 con 0x7f82b010a2c0 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f82b52bb640 1 --2- 172.21.15.47:0/1943262631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f51ca0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f82a8005e30 tx=0x7f82a8009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4ad95806dd974e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f8296ffd640 1 -- 172.21.15.47:0/1943262631 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a80318e0 con 0x5557e3f518c0 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f8296ffd640 1 -- 172.21.15.47:0/1943262631 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82a8036070 con 0x5557e3f518c0 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.139+0000 7f8296ffd640 1 -- 172.21.15.47:0/1943262631 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a802f940 con 0x5557e3f518c0 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.140+0000 7f82b9a79740 1 -- 172.21.15.47:0/1943262631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 msgr2=0x5557e3f51ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.140+0000 7f82b52bb640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f82980b3dc0 0x7f82980b6280 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f82a804b000 tx=0x7f82a8048000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.140+0000 7f82b9a79740 1 --2- 172.21.15.47:0/1943262631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f51ca0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f82a8005e30 tx=0x7f82a8009880 comp rx=0 tx=0).stop 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.140+0000 7f82b9a79740 1 -- 172.21.15.47:0/1943262631 shutdown_connections 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.140+0000 7f82b9a79740 1 --2- 172.21.15.47:0/1943262631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f5e170 0x5557e3f60560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.140+0000 7f82b9a79740 1 --2- 172.21.15.47:0/1943262631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f521e0 0x5557e3f5dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.140+0000 7f82b9a79740 1 --2- 172.21.15.47:0/1943262631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f51ca0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.140+0000 7f82b9a79740 1 -- 172.21.15.47:0/1943262631 >> 172.21.15.47:0/1943262631 conn(0x5557e3f4f6f0 msgr2=0x5557e3f50890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.140+0000 7f82b9a79740 1 -- 172.21.15.47:0/1943262631 shutdown_connections 2024-07-24T22:07:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.140+0000 7f82b9a79740 1 -- 172.21.15.47:0/1943262631 wait complete. 2024-07-24T22:07:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.140+0000 7f82b9a79740 1 -- start start 2024-07-24T22:07:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b9a79740 1 Processor -- start 2024-07-24T22:07:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b9a79740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f5d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b9a79740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f521e0 0x5557e3f5ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b9a79740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f5e170 0x5557e3f5b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b9a79740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5557e3df0ab0 con 0x5557e3f518c0 2024-07-24T22:07:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b9a79740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5557e3e3e9e0 con 0x5557e3f5e170 2024-07-24T22:07:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b9a79740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5557e3f60cd0 con 0x5557e3f521e0 2024-07-24T22:07:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b9a79740 10 client.0 _ll_register_callbacks cb 0x5557e3bc6a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b4aba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f5d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b4aba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f5d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35628/0 (socket says 172.21.15.47:35628) 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b4aba640 1 -- 172.21.15.47:0/54615388 learned_addr learned my addr 172.21.15.47:0/54615388 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b52bb640 1 --2- 172.21.15.47:0/54615388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f5e170 0x5557e3f5b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82a7fff640 1 --2- 172.21.15.47:0/54615388 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f521e0 0x5557e3f5ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b4aba640 1 -- 172.21.15.47:0/54615388 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f521e0 msgr2=0x5557e3f5ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.141+0000 7f82b4aba640 1 --2- 172.21.15.47:0/54615388 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f521e0 0x5557e3f5ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f82b4aba640 1 -- 172.21.15.47:0/54615388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f5e170 msgr2=0x5557e3f5b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f82b4aba640 1 --2- 172.21.15.47:0/54615388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f5e170 0x5557e3f5b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f82b4aba640 1 -- 172.21.15.47:0/54615388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557e3c93620 con 0x5557e3f518c0 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f82b4aba640 1 --2- 172.21.15.47:0/54615388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f5d850 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f82ac010840 tx=0x7f82ac010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6d4eb87ae3fb5a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f828ffff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f828ffff640 1 -- 172.21.15.47:0/54615388 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac00ecc0 con 0x5557e3f518c0 2024-07-24T22:07:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f828ffff640 1 -- 172.21.15.47:0/54615388 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f82ac011440 con 0x5557e3f518c0 2024-07-24T22:07:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f82b9a79740 1 -- 172.21.15.47:0/54615388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5557e3e65ce0 con 0x5557e3f518c0 2024-07-24T22:07:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f828ffff640 1 -- 172.21.15.47:0/54615388 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f82ac00ee60 con 0x5557e3f518c0 2024-07-24T22:07:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f82b9a79740 10 client.15477 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f82b9a79740 1 -- 172.21.15.47:0/54615388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5557e3f6c490 con 0x5557e3f518c0 2024-07-24T22:07:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f828ffff640 1 -- 172.21.15.47:0/54615388 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5557e3e65ce0 con 0x5557e3f518c0 2024-07-24T22:07:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f828ffff640 1 -- 172.21.15.47:0/54615388 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f82ac025720 con 0x5557e3f518c0 2024-07-24T22:07:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.142+0000 7f82b9a79740 10 client.15477 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.143+0000 7f82b9a79740 10 client.15477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.143+0000 7f82b9a79740 20 client.15477 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.143+0000 7f82b9a79740 1 --2- 172.21.15.47:0/54615388 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5557e3f6d900 0x5557e3f6fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.143+0000 7f82b9a79740 4 client.15477 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:07:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.143+0000 7f82b9a79740 1 -- 172.21.15.47:0/54615388 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557e3ec91d0 con 0x5557e3f6d900 2024-07-24T22:07:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.143+0000 7f82a7fff640 1 --2- 172.21.15.47:0/54615388 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5557e3f6d900 0x5557e3f6fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.143+0000 7f82a7fff640 1 --2- 172.21.15.47:0/54615388 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5557e3f6d900 0x5557e3f6fcf0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d72577945d137f3 server_cookie=333904d47bf4dac4 in_seq=0 out_seq=0 2024-07-24T22:07:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.143+0000 7f828ffff640 10 client.15477 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f828ffff640 1 -- 172.21.15.47:0/54615388 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5557e3ec91d0 con 0x5557e3f6d900 2024-07-24T22:07:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f828ffff640 10 client.15477 handle_command_reply: tid=0 2024-07-24T22:07:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f82b9a79740 1 client.15477 shutdown 2024-07-24T22:07:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f82b9a79740 1 -- 172.21.15.47:0/54615388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 msgr2=0x5557e3f5d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f82b9a79740 1 --2- 172.21.15.47:0/54615388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f5d850 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f82ac010840 tx=0x7f82ac010d00 comp rx=0 tx=0).stop 2024-07-24T22:07:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f82b9a79740 1 -- 172.21.15.47:0/54615388 shutdown_connections 2024-07-24T22:07:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f82b9a79740 1 --2- 172.21.15.47:0/54615388 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5557e3f6d900 0x5557e3f6fcf0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f82b9a79740 1 --2- 172.21.15.47:0/54615388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f5e170 0x5557e3f5b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f828ffff640 0 client.15477 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f82b9a79740 1 --2- 172.21.15.47:0/54615388 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f521e0 0x5557e3f5ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f82b9a79740 1 --2- 172.21.15.47:0/54615388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f5d850 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f82b9a79740 1 -- 172.21.15.47:0/54615388 >> 172.21.15.47:0/54615388 conn(0x5557e3f4f6f0 msgr2=0x5557e3f55290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f82b9a79740 1 -- 172.21.15.47:0/54615388 shutdown_connections 2024-07-24T22:07:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.144+0000 7f82b9a79740 1 -- 172.21.15.47:0/54615388 wait complete. 2024-07-24T22:07:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.145+0000 7f82b9a79740 20 client.15477 trim_cache size 0 max 16384 2024-07-24T22:07:22.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b9a79740 1 Processor -- start 2024-07-24T22:07:22.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b9a79740 1 -- start start 2024-07-24T22:07:22.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b9a79740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f50790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b9a79740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f521e0 0x5557e3f50cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b9a79740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f5e170 0x5557e3f75600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b9a79740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82b01ae1f0 con 0x5557e3f518c0 2024-07-24T22:07:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b9a79740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f82b01b0a70 con 0x5557e3f5e170 2024-07-24T22:07:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b9a79740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f82b01ae860 con 0x5557e3f521e0 2024-07-24T22:07:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b4aba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f50790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b4aba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f50790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35636/0 (socket says 172.21.15.47:35636) 2024-07-24T22:07:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b4aba640 1 -- 172.21.15.47:0/2270494454 learned_addr learned my addr 172.21.15.47:0/2270494454 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b4aba640 1 -- 172.21.15.47:0/2270494454 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f521e0 msgr2=0x5557e3f50cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b4aba640 1 --2- 172.21.15.47:0/2270494454 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f521e0 0x5557e3f50cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b4aba640 1 -- 172.21.15.47:0/2270494454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f5e170 msgr2=0x5557e3f75600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b52bb640 1 --2- 172.21.15.47:0/2270494454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f5e170 0x5557e3f75600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b4aba640 1 --2- 172.21.15.47:0/2270494454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f5e170 0x5557e3f75600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b4aba640 1 -- 172.21.15.47:0/2270494454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557e3f70060 con 0x5557e3f518c0 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.160+0000 7f82b52bb640 1 --2- 172.21.15.47:0/2270494454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f5e170 0x5557e3f75600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.161+0000 7f82b4aba640 1 --2- 172.21.15.47:0/2270494454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f50790 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00c670 tx=0x7f82ac00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d6edac63c27b6 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.161+0000 7f82967fc640 1 -- 172.21.15.47:0/2270494454 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac02b070 con 0x5557e3f518c0 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.161+0000 7f82967fc640 1 -- 172.21.15.47:0/2270494454 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82ac00eac0 con 0x5557e3f518c0 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.161+0000 7f82967fc640 1 -- 172.21.15.47:0/2270494454 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0055f0 con 0x5557e3f518c0 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.161+0000 7f82b9a79740 1 -- 172.21.15.47:0/2270494454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 msgr2=0x5557e3f50790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.161+0000 7f82b9a79740 1 --2- 172.21.15.47:0/2270494454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f50790 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00c670 tx=0x7f82ac00c850 comp rx=0 tx=0).stop 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.161+0000 7f82b9a79740 1 -- 172.21.15.47:0/2270494454 shutdown_connections 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.161+0000 7f82b9a79740 1 --2- 172.21.15.47:0/2270494454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f5e170 0x5557e3f75600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.161+0000 7f82b9a79740 1 --2- 172.21.15.47:0/2270494454 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f521e0 0x5557e3f50cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.161+0000 7f82b9a79740 1 --2- 172.21.15.47:0/2270494454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f518c0 0x5557e3f50790 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.161+0000 7f82b9a79740 1 -- 172.21.15.47:0/2270494454 >> 172.21.15.47:0/2270494454 conn(0x5557e3f4f6f0 msgr2=0x5557e3f59590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.161+0000 7f82b9a79740 1 -- 172.21.15.47:0/2270494454 shutdown_connections 2024-07-24T22:07:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.161+0000 7f82b9a79740 1 -- 172.21.15.47:0/2270494454 wait complete. 2024-07-24T22:07:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.162+0000 7f82b9a79740 1 -- start start 2024-07-24T22:07:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.162+0000 7f82b9a79740 1 Processor -- start 2024-07-24T22:07:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.162+0000 7f82b9a79740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f518c0 0x5557e3f66650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.162+0000 7f82b9a79740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f521e0 0x5557e3f60f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.162+0000 7f82b9a79740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f5e170 0x5557e3f614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.162+0000 7f82b9a79740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82b01aef30 con 0x5557e3f521e0 2024-07-24T22:07:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.162+0000 7f82b9a79740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f82b01b03a0 con 0x5557e3f518c0 2024-07-24T22:07:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.162+0000 7f82b9a79740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f82b01af600 con 0x5557e3f5e170 2024-07-24T22:07:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.162+0000 7f82b9a79740 10 client.0 _ll_register_callbacks cb 0x7f82ac00c430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.162+0000 7f82a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f521e0 0x5557e3f60f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.162+0000 7f82a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f521e0 0x5557e3f60f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35648/0 (socket says 172.21.15.47:35648) 2024-07-24T22:07:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.162+0000 7f82a7fff640 1 -- 172.21.15.47:0/1073484094 learned_addr learned my addr 172.21.15.47:0/1073484094 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.162+0000 7f82b4aba640 1 --2- 172.21.15.47:0/1073484094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f518c0 0x5557e3f66650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82a7fff640 1 -- 172.21.15.47:0/1073484094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f5e170 msgr2=0x5557e3f614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82a7fff640 1 --2- 172.21.15.47:0/1073484094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f5e170 0x5557e3f614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82a7fff640 1 -- 172.21.15.47:0/1073484094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f518c0 msgr2=0x5557e3f66650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82a7fff640 1 --2- 172.21.15.47:0/1073484094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f518c0 0x5557e3f66650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82a7fff640 1 -- 172.21.15.47:0/1073484094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557e3f61ce0 con 0x5557e3f521e0 2024-07-24T22:07:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82a7fff640 1 --2- 172.21.15.47:0/1073484094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f521e0 0x5557e3f60f50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f82a00047e0 tx=0x7f82a00a9f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a025f634b7f8ba23 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f828ffff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f828ffff640 1 -- 172.21.15.47:0/1073484094 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a0020040 con 0x5557e3f521e0 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f828ffff640 1 -- 172.21.15.47:0/1073484094 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f82a00a9850 con 0x5557e3f521e0 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82b9a79740 1 -- 172.21.15.47:0/1073484094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82ac00eac0 con 0x5557e3f521e0 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f828ffff640 1 -- 172.21.15.47:0/1073484094 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f82a00aacf0 con 0x5557e3f521e0 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82b9a79740 10 client.15483 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82b9a79740 1 -- 172.21.15.47:0/1073484094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5557e3fd7630 con 0x5557e3f521e0 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f828ffff640 1 -- 172.21.15.47:0/1073484094 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82ac00eac0 con 0x5557e3f521e0 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f828ffff640 1 -- 172.21.15.47:0/1073484094 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f82a00a5f60 con 0x5557e3f521e0 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82b9a79740 10 client.15483 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82b9a79740 10 client.15483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82b9a79740 20 client.15483 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82b9a79740 1 --2- 172.21.15.47:0/1073484094 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5557e3fd7d60 0x5557e3fda180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82b9a79740 4 client.15483 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:07:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.163+0000 7f82b9a79740 1 -- 172.21.15.47:0/1073484094 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5557e3ec4c70 con 0x5557e3fd7d60 2024-07-24T22:07:22.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.164+0000 7f82b4aba640 1 --2- 172.21.15.47:0/1073484094 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5557e3fd7d60 0x5557e3fda180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.164+0000 7f828ffff640 10 client.15483 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:22.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.164+0000 7f82b4aba640 1 --2- 172.21.15.47:0/1073484094 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5557e3fd7d60 0x5557e3fda180 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9455efeedacad88 server_cookie=65e74f47526ff04b in_seq=0 out_seq=0 2024-07-24T22:07:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f828ffff640 1 -- 172.21.15.47:0/1073484094 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5557e3ec4c70 con 0x5557e3fd7d60 2024-07-24T22:07:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f828ffff640 10 client.15483 handle_command_reply: tid=0 2024-07-24T22:07:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f82b9a79740 1 client.15483 shutdown 2024-07-24T22:07:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f82b9a79740 1 -- 172.21.15.47:0/1073484094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f521e0 msgr2=0x5557e3f60f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f82b9a79740 1 --2- 172.21.15.47:0/1073484094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f521e0 0x5557e3f60f50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f82a00047e0 tx=0x7f82a00a9f40 comp rx=0 tx=0).stop 2024-07-24T22:07:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f82b9a79740 1 -- 172.21.15.47:0/1073484094 shutdown_connections 2024-07-24T22:07:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f82b9a79740 1 --2- 172.21.15.47:0/1073484094 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5557e3fd7d60 0x5557e3fda180 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f82b9a79740 1 --2- 172.21.15.47:0/1073484094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5557e3f5e170 0x5557e3f614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f82b9a79740 1 --2- 172.21.15.47:0/1073484094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557e3f521e0 0x5557e3f60f50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f828ffff640 0 client.15483 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f82b9a79740 1 --2- 172.21.15.47:0/1073484094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557e3f518c0 0x5557e3f66650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f82b9a79740 1 -- 172.21.15.47:0/1073484094 >> 172.21.15.47:0/1073484094 conn(0x5557e3f4f6f0 msgr2=0x5557e3f5a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f82b9a79740 1 -- 172.21.15.47:0/1073484094 shutdown_connections 2024-07-24T22:07:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f82b9a79740 1 -- 172.21.15.47:0/1073484094 wait complete. 2024-07-24T22:07:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.168+0000 7f82b9a79740 20 client.15483 trim_cache size 0 max 16384 2024-07-24T22:07:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:07:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:07:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:07:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:07:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.169+0000 7f82b6d1e640 1 -- 172.21.15.47:0/2642926110 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f82980b3dc0 msgr2=0x7f82980b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.169+0000 7f82b6d1e640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f82980b3dc0 0x7f82980b6280 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f82a804b000 tx=0x7f82a8048000 comp rx=0 tx=0).stop 2024-07-24T22:07:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.169+0000 7f82b6d1e640 1 -- 172.21.15.47:0/2642926110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82b010a2c0 msgr2=0x7f82b01026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.169+0000 7f82b6d1e640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82b010a2c0 0x7f82b01026c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f82a000d740 tx=0x7f82a000dc00 comp rx=0 tx=0).stop 2024-07-24T22:07:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.169+0000 7f82b6d1e640 1 -- 172.21.15.47:0/2642926110 shutdown_connections 2024-07-24T22:07:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.169+0000 7f82b6d1e640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f82980b3dc0 0x7f82980b6280 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.169+0000 7f82b6d1e640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b010cbf0 0x7f82b0102c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.169+0000 7f82b6d1e640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82b010a2c0 0x7f82b01026c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.169+0000 7f82b6d1e640 1 --2- 172.21.15.47:0/2642926110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82b01011c0 0x7f82b0102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.169+0000 7f82b6d1e640 1 -- 172.21.15.47:0/2642926110 >> 172.21.15.47:0/2642926110 conn(0x7f82b00767a0 msgr2=0x7f82b00fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.169+0000 7f82b6d1e640 1 -- 172.21.15.47:0/2642926110 shutdown_connections 2024-07-24T22:07:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:22.169+0000 7f82b6d1e640 1 -- 172.21.15.47:0/2642926110 wait complete. 2024-07-24T22:07:22.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.340+0000 7f09e4e59640 1 -- 172.21.15.47:0/372148143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09e01081a0 msgr2=0x7f09e01085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.340+0000 7f09e4e59640 1 --2- 172.21.15.47:0/372148143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09e01081a0 0x7f09e01085e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009900 tx=0x7f09d402a410 comp rx=0 tx=0).stop 2024-07-24T22:07:22.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.340+0000 7f09e4e59640 1 -- 172.21.15.47:0/372148143 shutdown_connections 2024-07-24T22:07:22.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.340+0000 7f09e4e59640 1 --2- 172.21.15.47:0/372148143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09e0108b20 0x7f09e010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.340+0000 7f09e4e59640 1 --2- 172.21.15.47:0/372148143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09e01081a0 0x7f09e01085e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.340+0000 7f09e4e59640 1 --2- 172.21.15.47:0/372148143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09e0102790 0x7f09e0102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.340+0000 7f09e4e59640 1 -- 172.21.15.47:0/372148143 >> 172.21.15.47:0/372148143 conn(0x7f09e00fe200 msgr2=0x7f09e0100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:22.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.340+0000 7f09e4e59640 1 -- 172.21.15.47:0/372148143 shutdown_connections 2024-07-24T22:07:22.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.340+0000 7f09e4e59640 1 -- 172.21.15.47:0/372148143 wait complete. 2024-07-24T22:07:22.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.341+0000 7f09e4e59640 1 Processor -- start 2024-07-24T22:07:22.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.341+0000 7f09e4e59640 1 -- start start 2024-07-24T22:07:22.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.341+0000 7f09e4e59640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09e0102790 0x7f09e0198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.341+0000 7f09e4e59640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09e01081a0 0x7f09e0199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.341+0000 7f09e4e59640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09e0108b20 0x7f09e019e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09e4e59640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f09e0112740 con 0x7f09e0102790 2024-07-24T22:07:22.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09e4e59640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01125c0 con 0x7f09e0108b20 2024-07-24T22:07:22.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09e4e59640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01128c0 con 0x7f09e01081a0 2024-07-24T22:07:22.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09de59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09e0102790 0x7f09e0198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09de59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09e0102790 0x7f09e0198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35534/0 (socket says 172.21.15.47:35534) 2024-07-24T22:07:22.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09de59c640 1 -- 172.21.15.47:0/2018087193 learned_addr learned my addr 172.21.15.47:0/2018087193 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:22.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09ddd9b640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09e01081a0 0x7f09e0199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09ded9d640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09e0108b20 0x7f09e019e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09de59c640 1 -- 172.21.15.47:0/2018087193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09e01081a0 msgr2=0x7f09e0199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09de59c640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09e01081a0 0x7f09e0199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09de59c640 1 -- 172.21.15.47:0/2018087193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09e0108b20 msgr2=0x7f09e019e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09de59c640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09e0108b20 0x7f09e019e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09de59c640 1 -- 172.21.15.47:0/2018087193 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e019ed00 con 0x7f09e0102790 2024-07-24T22:07:22.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09ded9d640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09e0108b20 0x7f09e019e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:22.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09de59c640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09e0102790 0x7f09e0198c50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f09d000c920 tx=0x7f09d000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:22.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09cf7fe640 1 -- 172.21.15.47:0/2018087193 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d0007c70 con 0x7f09e0102790 2024-07-24T22:07:22.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09cf7fe640 1 -- 172.21.15.47:0/2018087193 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09d0007e10 con 0x7f09e0102790 2024-07-24T22:07:22.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09e4e59640 1 -- 172.21.15.47:0/2018087193 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e019eff0 con 0x7f09e0102790 2024-07-24T22:07:22.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09cf7fe640 1 -- 172.21.15.47:0/2018087193 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d0018820 con 0x7f09e0102790 2024-07-24T22:07:22.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.342+0000 7f09e4e59640 1 -- 172.21.15.47:0/2018087193 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e01a5880 con 0x7f09e0102790 2024-07-24T22:07:22.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.345+0000 7f09cf7fe640 1 -- 172.21.15.47:0/2018087193 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f09d000f450 con 0x7f09e0102790 2024-07-24T22:07:22.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.345+0000 7f09e720a740 1 Processor -- start 2024-07-24T22:07:22.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.345+0000 7f09e720a740 1 -- start start 2024-07-24T22:07:22.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.345+0000 7f09e720a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 0x5649f1572a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.345+0000 7f09e720a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f1572fd0 0x5649f157ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.345+0000 7f09e720a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 0x5649f1581350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.345+0000 7f09e720a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5649f14e9990 con 0x5649f157ef60 2024-07-24T22:07:22.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.345+0000 7f09e720a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5649f14d8e90 con 0x5649f1572fd0 2024-07-24T22:07:22.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.345+0000 7f09e720a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5649f14dced0 con 0x5649f15726b0 2024-07-24T22:07:22.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ddd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 0x5649f1581350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ddd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 0x5649f1581350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35548/0 (socket says 172.21.15.47:35548) 2024-07-24T22:07:22.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ddd9b640 1 -- 172.21.15.47:0/1897289385 learned_addr learned my addr 172.21.15.47:0/1897289385 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:22.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09de59c640 1 --2- 172.21.15.47:0/1897289385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f1572fd0 0x5649f157ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ded9d640 1 --2- 172.21.15.47:0/1897289385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 0x5649f1572a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ddd9b640 1 -- 172.21.15.47:0/1897289385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 msgr2=0x5649f1572a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ddd9b640 1 --2- 172.21.15.47:0/1897289385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 0x5649f1572a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ddd9b640 1 -- 172.21.15.47:0/1897289385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f1572fd0 msgr2=0x5649f157ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ddd9b640 1 --2- 172.21.15.47:0/1897289385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f1572fd0 0x5649f157ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ddd9b640 1 -- 172.21.15.47:0/1897289385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f1462300 con 0x5649f157ef60 2024-07-24T22:07:22.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09de59c640 1 --2- 172.21.15.47:0/1897289385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f1572fd0 0x5649f157ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:22.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ded9d640 1 --2- 172.21.15.47:0/1897289385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 0x5649f1572a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:22.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09cf7fe640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09c80b3dc0 0x7f09c80b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ddd9b640 1 --2- 172.21.15.47:0/1897289385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 0x5649f1581350 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f09d402a930 tx=0x7f09d4031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1667aa830638ab80 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:22.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ded9d640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09c80b3dc0 0x7f09c80b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09cf7fe640 1 -- 172.21.15.47:0/2018087193 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f09d00e40f0 con 0x7f09e0102790 2024-07-24T22:07:22.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ccff9640 1 -- 172.21.15.47:0/1897289385 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d403f070 con 0x5649f157ef60 2024-07-24T22:07:22.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ccff9640 1 -- 172.21.15.47:0/1897289385 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09d40316a0 con 0x5649f157ef60 2024-07-24T22:07:22.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.346+0000 7f09ccff9640 1 -- 172.21.15.47:0/1897289385 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4035070 con 0x5649f157ef60 2024-07-24T22:07:22.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.347+0000 7f09e720a740 1 -- 172.21.15.47:0/1897289385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 msgr2=0x5649f1581350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.347+0000 7f09ded9d640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09c80b3dc0 0x7f09c80b6280 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f09d8005fd0 tx=0x7f09d80084d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:22.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.347+0000 7f09e720a740 1 --2- 172.21.15.47:0/1897289385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 0x5649f1581350 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f09d402a930 tx=0x7f09d4031cd0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.347+0000 7f09e720a740 1 -- 172.21.15.47:0/1897289385 shutdown_connections 2024-07-24T22:07:22.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.347+0000 7f09e720a740 1 --2- 172.21.15.47:0/1897289385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 0x5649f1581350 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.347+0000 7f09e720a740 1 --2- 172.21.15.47:0/1897289385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f1572fd0 0x5649f157ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.347+0000 7f09e720a740 1 --2- 172.21.15.47:0/1897289385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 0x5649f1572a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.347+0000 7f09e720a740 1 -- 172.21.15.47:0/1897289385 >> 172.21.15.47:0/1897289385 conn(0x5649f15704e0 msgr2=0x5649f1571680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:22.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.347+0000 7f09e720a740 1 -- 172.21.15.47:0/1897289385 shutdown_connections 2024-07-24T22:07:22.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.347+0000 7f09e720a740 1 -- 172.21.15.47:0/1897289385 wait complete. 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09e720a740 1 -- start start 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09e720a740 1 Processor -- start 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09e720a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f15726b0 0x5649f157bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09e720a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 0x5649f157c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09e720a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f157ef60 0x5649f157c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09e720a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5649f133c700 con 0x5649f1572fd0 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09e720a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5649f147b5d0 con 0x5649f15726b0 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09e720a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5649f1581b80 con 0x5649f157ef60 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09e720a740 10 client.0 _ll_register_callbacks cb 0x5649f149b940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09ddd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 0x5649f157c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09ddd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 0x5649f157c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35562/0 (socket says 172.21.15.47:35562) 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09ddd9b640 1 -- 172.21.15.47:0/3160380679 learned_addr learned my addr 172.21.15.47:0/3160380679 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09de59c640 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f15726b0 0x5649f157bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09ded9d640 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f157ef60 0x5649f157c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09ddd9b640 1 -- 172.21.15.47:0/3160380679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f157ef60 msgr2=0x5649f157c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09ddd9b640 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f157ef60 0x5649f157c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09ddd9b640 1 -- 172.21.15.47:0/3160380679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f15726b0 msgr2=0x5649f157bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09ddd9b640 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f15726b0 0x5649f157bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09ddd9b640 1 -- 172.21.15.47:0/3160380679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f146e660 con 0x5649f1572fd0 2024-07-24T22:07:22.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.348+0000 7f09de59c640 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f15726b0 0x5649f157bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:22.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.349+0000 7f09ddd9b640 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 0x5649f157c3e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f09d4031440 tx=0x7f09d402aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2e122ceca00145 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:22.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.349+0000 7f09c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:22.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.349+0000 7f09c5ffb640 1 -- 172.21.15.47:0/3160380679 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d404a070 con 0x5649f1572fd0 2024-07-24T22:07:22.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.349+0000 7f09e720a740 1 -- 172.21.15.47:0/3160380679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09d40316a0 con 0x5649f1572fd0 2024-07-24T22:07:22.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.349+0000 7f09c5ffb640 1 -- 172.21.15.47:0/3160380679 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f09d4004bb0 con 0x5649f1572fd0 2024-07-24T22:07:22.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.349+0000 7f09c5ffb640 1 -- 172.21.15.47:0/3160380679 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f09d4056050 con 0x5649f1572fd0 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.349+0000 7f09e720a740 10 client.15459 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.349+0000 7f09e720a740 1 -- 172.21.15.47:0/3160380679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5649f1239650 con 0x5649f1572fd0 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.349+0000 7f09c5ffb640 1 -- 172.21.15.47:0/3160380679 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09d40316a0 con 0x5649f1572fd0 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.349+0000 7f09c5ffb640 1 -- 172.21.15.47:0/3160380679 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f09d4043400 con 0x5649f1572fd0 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.350+0000 7f09e720a740 10 client.15459 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.350+0000 7f09e720a740 10 client.15459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.350+0000 7f09e720a740 20 client.15459 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.350+0000 7f09e720a740 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649f158e840 0x5649f1590c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.350+0000 7f09e720a740 4 client.15459 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.350+0000 7f09e720a740 1 -- 172.21.15.47:0/3160380679 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649f14eb8e0 con 0x5649f158e840 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.350+0000 7f09de59c640 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649f158e840 0x5649f1590c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.350+0000 7f09c5ffb640 10 client.15459 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.350+0000 7f09de59c640 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649f158e840 0x5649f1590c30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b63ad0bcc5e3bc0 server_cookie=622c55a190a41221 in_seq=0 out_seq=0 2024-07-24T22:07:22.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09c5ffb640 1 -- 172.21.15.47:0/3160380679 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649f14eb8e0 con 0x5649f158e840 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09c5ffb640 10 client.15459 handle_command_reply: tid=0 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09e720a740 1 client.15459 shutdown 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09e720a740 1 -- 172.21.15.47:0/3160380679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 msgr2=0x5649f157c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09e720a740 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 0x5649f157c3e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f09d4031440 tx=0x7f09d402aaf0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09e720a740 1 -- 172.21.15.47:0/3160380679 shutdown_connections 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09e720a740 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649f158e840 0x5649f1590c30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09e720a740 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f157ef60 0x5649f157c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09e720a740 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 0x5649f157c3e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09e720a740 1 --2- 172.21.15.47:0/3160380679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f15726b0 0x5649f157bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09e720a740 1 -- 172.21.15.47:0/3160380679 >> 172.21.15.47:0/3160380679 conn(0x5649f15704e0 msgr2=0x5649f1576080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09c5ffb640 0 client.15459 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09e720a740 1 -- 172.21.15.47:0/3160380679 shutdown_connections 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09e720a740 1 -- 172.21.15.47:0/3160380679 wait complete. 2024-07-24T22:07:22.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.351+0000 7f09e720a740 20 client.15459 trim_cache size 0 max 16384 2024-07-24T22:07:22.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.369+0000 7f09e720a740 1 Processor -- start 2024-07-24T22:07:22.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.369+0000 7f09e720a740 1 -- start start 2024-07-24T22:07:22.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09e720a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 0x5649f157a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09e720a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 0x5649f157dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09e720a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f157ef60 0x5649f1593870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09e720a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01ac090 con 0x5649f1572fd0 2024-07-24T22:07:22.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09e720a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01ae910 con 0x5649f157ef60 2024-07-24T22:07:22.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09e720a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01ac700 con 0x5649f15726b0 2024-07-24T22:07:22.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09ddd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 0x5649f157dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09ddd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 0x5649f157dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35578/0 (socket says 172.21.15.47:35578) 2024-07-24T22:07:22.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09ddd9b640 1 -- 172.21.15.47:0/4086863974 learned_addr learned my addr 172.21.15.47:0/4086863974 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:22.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09ddd9b640 1 -- 172.21.15.47:0/4086863974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 msgr2=0x5649f157a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09ddd9b640 1 --2- 172.21.15.47:0/4086863974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 0x5649f157a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09ddd9b640 1 -- 172.21.15.47:0/4086863974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f157ef60 msgr2=0x5649f1593870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09ddd9b640 1 --2- 172.21.15.47:0/4086863974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f157ef60 0x5649f1593870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09ddd9b640 1 -- 172.21.15.47:0/4086863974 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f157ae00 con 0x5649f1572fd0 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09ddd9b640 1 --2- 172.21.15.47:0/4086863974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 0x5649f157dbe0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f09d4006010 tx=0x7f09d40315e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a351de4a1b3f1c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09c7fff640 1 -- 172.21.15.47:0/4086863974 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d404a070 con 0x5649f1572fd0 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09c7fff640 1 -- 172.21.15.47:0/4086863974 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09d4043950 con 0x5649f1572fd0 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.370+0000 7f09c7fff640 1 -- 172.21.15.47:0/4086863974 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d403f030 con 0x5649f1572fd0 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.371+0000 7f09e720a740 1 -- 172.21.15.47:0/4086863974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 msgr2=0x5649f157dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.371+0000 7f09e720a740 1 --2- 172.21.15.47:0/4086863974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 0x5649f157dbe0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f09d4006010 tx=0x7f09d40315e0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.371+0000 7f09e720a740 1 -- 172.21.15.47:0/4086863974 shutdown_connections 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.371+0000 7f09e720a740 1 --2- 172.21.15.47:0/4086863974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f157ef60 0x5649f1593870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.371+0000 7f09e720a740 1 --2- 172.21.15.47:0/4086863974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f1572fd0 0x5649f157dbe0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.371+0000 7f09e720a740 1 --2- 172.21.15.47:0/4086863974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 0x5649f157a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.371+0000 7f09e720a740 1 -- 172.21.15.47:0/4086863974 >> 172.21.15.47:0/4086863974 conn(0x5649f15704e0 msgr2=0x5649f157d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:22.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.371+0000 7f09e720a740 1 -- 172.21.15.47:0/4086863974 shutdown_connections 2024-07-24T22:07:22.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.371+0000 7f09e720a740 1 -- 172.21.15.47:0/4086863974 wait complete. 2024-07-24T22:07:22.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.371+0000 7f09e720a740 1 -- start start 2024-07-24T22:07:22.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.371+0000 7f09e720a740 1 Processor -- start 2024-07-24T22:07:22.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09e720a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 0x5649f15940b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09e720a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f1572fd0 0x5649f15915a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09e720a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 0x5649f1591c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09e720a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01acdd0 con 0x5649f157ef60 2024-07-24T22:07:22.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09e720a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01ae240 con 0x5649f1572fd0 2024-07-24T22:07:22.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09e720a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01ad4a0 con 0x5649f15726b0 2024-07-24T22:07:22.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09e720a740 10 client.0 _ll_register_callbacks cb 0x7f09d4031ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:22.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09ded9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 0x5649f1591c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09ded9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 0x5649f1591c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35586/0 (socket says 172.21.15.47:35586) 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09ded9d640 1 -- 172.21.15.47:0/3333553132 learned_addr learned my addr 172.21.15.47:0/3333553132 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09de59c640 1 --2- 172.21.15.47:0/3333553132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 0x5649f15940b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09ddd9b640 1 --2- 172.21.15.47:0/3333553132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f1572fd0 0x5649f15915a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09ded9d640 1 -- 172.21.15.47:0/3333553132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 msgr2=0x5649f15940b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09ded9d640 1 --2- 172.21.15.47:0/3333553132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 0x5649f15940b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09ded9d640 1 -- 172.21.15.47:0/3333553132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f1572fd0 msgr2=0x5649f15915a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09ded9d640 1 --2- 172.21.15.47:0/3333553132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f1572fd0 0x5649f15915a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09ded9d640 1 -- 172.21.15.47:0/3333553132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f15f8180 con 0x5649f157ef60 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09ded9d640 1 --2- 172.21.15.47:0/3333553132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 0x5649f1591c70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f09d8010e00 tx=0x7f09d8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f892baf4f0d9d1 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.372+0000 7f09c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09c5ffb640 1 -- 172.21.15.47:0/3333553132 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d801de90 con 0x5649f157ef60 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09c5ffb640 1 -- 172.21.15.47:0/3333553132 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f09d801e430 con 0x5649f157ef60 2024-07-24T22:07:22.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09e720a740 1 -- 172.21.15.47:0/3333553132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09d4043950 con 0x5649f157ef60 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09c5ffb640 1 -- 172.21.15.47:0/3333553132 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f09d801e630 con 0x5649f157ef60 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09e720a740 10 client.15465 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09e720a740 1 -- 172.21.15.47:0/3333553132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5649f15f93f0 con 0x5649f157ef60 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09c5ffb640 1 -- 172.21.15.47:0/3333553132 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09d4043950 con 0x5649f157ef60 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09c5ffb640 1 -- 172.21.15.47:0/3333553132 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f09d80279d0 con 0x5649f157ef60 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09e720a740 10 client.15465 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09e720a740 10 client.15465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09e720a740 20 client.15465 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09e720a740 1 --2- 172.21.15.47:0/3333553132 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649f15f9bc0 0x5649f15fbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09e720a740 4 client.15465 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09e720a740 1 -- 172.21.15.47:0/3333553132 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5649f14e7380 con 0x5649f15f9bc0 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.373+0000 7f09de59c640 1 --2- 172.21.15.47:0/3333553132 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649f15f9bc0 0x5649f15fbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09de59c640 1 --2- 172.21.15.47:0/3333553132 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649f15f9bc0 0x5649f15fbfe0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e00f88e7b78fc162 server_cookie=8388e82f9465beb2 in_seq=0 out_seq=0 2024-07-24T22:07:22.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09c5ffb640 10 client.15465 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09c5ffb640 1 -- 172.21.15.47:0/3333553132 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5649f14e7380 con 0x5649f15f9bc0 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09c5ffb640 10 client.15465 handle_command_reply: tid=0 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09e720a740 1 client.15465 shutdown 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09e720a740 1 -- 172.21.15.47:0/3333553132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 msgr2=0x5649f1591c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09e720a740 1 --2- 172.21.15.47:0/3333553132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 0x5649f1591c70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f09d8010e00 tx=0x7f09d8004ab0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09e720a740 1 -- 172.21.15.47:0/3333553132 shutdown_connections 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09e720a740 1 --2- 172.21.15.47:0/3333553132 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649f15f9bc0 0x5649f15fbfe0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09e720a740 1 --2- 172.21.15.47:0/3333553132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649f157ef60 0x5649f1591c70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09c5ffb640 0 client.15465 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09e720a740 1 --2- 172.21.15.47:0/3333553132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649f1572fd0 0x5649f15915a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09e720a740 1 --2- 172.21.15.47:0/3333553132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649f15726b0 0x5649f15940b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09e720a740 1 -- 172.21.15.47:0/3333553132 >> 172.21.15.47:0/3333553132 conn(0x5649f15704e0 msgr2=0x5649f1589e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09e720a740 1 -- 172.21.15.47:0/3333553132 shutdown_connections 2024-07-24T22:07:22.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09e720a740 1 -- 172.21.15.47:0/3333553132 wait complete. 2024-07-24T22:07:22.302 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:07:22.302 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:07:22.302 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:07:22.302 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:07:22.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.374+0000 7f09e720a740 20 client.15465 trim_cache size 0 max 16384 2024-07-24T22:07:22.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.375+0000 7f09e4e59640 1 -- 172.21.15.47:0/2018087193 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09c80b3dc0 msgr2=0x7f09c80b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.375+0000 7f09e4e59640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09c80b3dc0 0x7f09c80b6280 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f09d8005fd0 tx=0x7f09d80084d0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.375+0000 7f09e4e59640 1 -- 172.21.15.47:0/2018087193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09e0102790 msgr2=0x7f09e0198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:22.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.375+0000 7f09e4e59640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09e0102790 0x7f09e0198c50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f09d000c920 tx=0x7f09d000cde0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.375+0000 7f09e4e59640 1 -- 172.21.15.47:0/2018087193 shutdown_connections 2024-07-24T22:07:22.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.375+0000 7f09e4e59640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09c80b3dc0 0x7f09c80b6280 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.375+0000 7f09e4e59640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09e0108b20 0x7f09e019e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.375+0000 7f09e4e59640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09e01081a0 0x7f09e0199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.375+0000 7f09e4e59640 1 --2- 172.21.15.47:0/2018087193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09e0102790 0x7f09e0198c50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:22.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.375+0000 7f09e4e59640 1 -- 172.21.15.47:0/2018087193 >> 172.21.15.47:0/2018087193 conn(0x7f09e00fe200 msgr2=0x7f09e01005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:22.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.375+0000 7f09e4e59640 1 -- 172.21.15.47:0/2018087193 shutdown_connections 2024-07-24T22:07:22.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:21.375+0000 7f09e4e59640 1 -- 172.21.15.47:0/2018087193 wait complete. 2024-07-24T22:07:22.914 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:07:22.914 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:07:23.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.348+0000 7f3bc700e640 1 -- 172.21.15.47:0/2855010273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bc0108180 msgr2=0x7f3bc01085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:23.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.348+0000 7f3bc700e640 1 --2- 172.21.15.47:0/2855010273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bc0108180 0x7f3bc01085c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009900 tx=0x7f3bac02a410 comp rx=0 tx=0).stop 2024-07-24T22:07:23.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 -- 172.21.15.47:0/2855010273 shutdown_connections 2024-07-24T22:07:23.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 --2- 172.21.15.47:0/2855010273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bc0108b00 0x7f3bc010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:23.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 --2- 172.21.15.47:0/2855010273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bc0108180 0x7f3bc01085c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:23.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 --2- 172.21.15.47:0/2855010273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bc0102770 0x7f3bc0102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:23.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 -- 172.21.15.47:0/2855010273 >> 172.21.15.47:0/2855010273 conn(0x7f3bc00fe1c0 msgr2=0x7f3bc01005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:23.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 -- 172.21.15.47:0/2855010273 shutdown_connections 2024-07-24T22:07:23.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 -- 172.21.15.47:0/2855010273 wait complete. 2024-07-24T22:07:23.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 Processor -- start 2024-07-24T22:07:23.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 -- start start 2024-07-24T22:07:23.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bc0102770 0x7f3bc0074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:23.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bc0108180 0x7f3bc00753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bc0108b00 0x7f3bc0075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0112730 con 0x7f3bc0102770 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc01125b0 con 0x7f3bc0108180 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.349+0000 7f3bc700e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc01128b0 con 0x7f3bc0108b00 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bc4daa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bc0102770 0x7f3bc0074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bc4daa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bc0102770 0x7f3bc0074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35666/0 (socket says 172.21.15.47:35666) 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bc4daa640 1 -- 172.21.15.47:0/2577415030 learned_addr learned my addr 172.21.15.47:0/2577415030 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bc55ab640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bc0108b00 0x7f3bc0075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bbffff640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bc0108180 0x7f3bc00753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bc4daa640 1 -- 172.21.15.47:0/2577415030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bc0108b00 msgr2=0x7f3bc0075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bc4daa640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bc0108b00 0x7f3bc0075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bc4daa640 1 -- 172.21.15.47:0/2577415030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bc0108180 msgr2=0x7f3bc00753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bc4daa640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bc0108180 0x7f3bc00753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:23.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bc4daa640 1 -- 172.21.15.47:0/2577415030 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc01a7060 con 0x7f3bc0102770 2024-07-24T22:07:23.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bc55ab640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bc0108b00 0x7f3bc0075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:23.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bbffff640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bc0108180 0x7f3bc00753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:23.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bc4daa640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bc0102770 0x7f3bc0074e90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400d950 tx=0x7f3bb400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:23.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bbdffb640 1 -- 172.21.15.47:0/2577415030 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4017070 con 0x7f3bc0102770 2024-07-24T22:07:23.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bbdffb640 1 -- 172.21.15.47:0/2577415030 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bb4009c30 con 0x7f3bc0102770 2024-07-24T22:07:23.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bc700e640 1 -- 172.21.15.47:0/2577415030 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc01a7350 con 0x7f3bc0102770 2024-07-24T22:07:23.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bbdffb640 1 -- 172.21.15.47:0/2577415030 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400f620 con 0x7f3bc0102770 2024-07-24T22:07:23.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.350+0000 7f3bc700e640 1 -- 172.21.15.47:0/2577415030 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc01a78b0 con 0x7f3bc0102770 2024-07-24T22:07:23.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.351+0000 7f3bc700e640 1 -- 172.21.15.47:0/2577415030 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc0102b50 con 0x7f3bc0102770 2024-07-24T22:07:23.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.353+0000 7f3bbdffb640 1 -- 172.21.15.47:0/2577415030 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f3bb4010460 con 0x7f3bc0102770 2024-07-24T22:07:23.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.353+0000 7f3bbdffb640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3bb00b3dc0 0x7f3bb00b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:23.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.354+0000 7f3bbdffb640 1 -- 172.21.15.47:0/2577415030 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f3bb40e3c80 con 0x7f3bc0102770 2024-07-24T22:07:23.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.354+0000 7f3bbffff640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3bb00b3dc0 0x7f3bb00b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:23.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.354+0000 7f3bbffff640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3bb00b3dc0 0x7f3bb00b6280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3bac031440 tx=0x7f3bac005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:23.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.357+0000 7f3bbdffb640 1 -- 172.21.15.47:0/2577415030 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f3bb40aaf90 con 0x7f3bc0102770 2024-07-24T22:07:23.413 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:23.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:23 smithi047 ceph-mon[32551]: pgmap v371: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-07-24T22:07:23.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.572+0000 7f3bc700e640 1 -- 172.21.15.47:0/2577415030 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3bc0076190 con 0x7f3bc0102770 2024-07-24T22:07:23.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.573+0000 7f3bbdffb640 1 -- 172.21.15.47:0/2577415030 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23138 (secure 0 0 0) 0x7f3bb4009de0 con 0x7f3bc0102770 2024-07-24T22:07:23.575 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:07:23.575 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":85,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","created":"2024-07-24T21:55:28.945912+0000","modified":"2024-07-24T22:05:27.567637+0000","last_up_change":"2024-07-24T22:02:55.044691+0000","last_in_change":"2024-07-24T22:02:35.671256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T21:59:32.066678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T22:03:49.331120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T22:03:52.034826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60de2c3d-e4b7-4878-bdbb-ce3257e3706c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6803","nonce":2665889913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6805","nonce":2665889913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6809","nonce":2665889913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6807","nonce":2665889913}]},"public_addr":"172.21.15.47:6803/2665889913","cluster_addr":"172.21.15.47:6805/2665889913","heartbeat_back_addr":"172.21.15.47:6809/2665889913","heartbeat_front_addr":"172.21.15.47:6807/2665889913","state":["exists","up"]},{"osd":1,"uuid":"7f086675-3bed-47ca-a93f-fab9580068b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6801","nonce":3486494228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6803","nonce":3486494228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6807","nonce":3486494228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6805","nonce":3486494228}]},"public_addr":"172.21.15.183:6801/3486494228","cluster_addr":"172.21.15.183:6803/3486494228","heartbeat_back_addr":"172.21.15.183:6807/3486494228","heartbeat_front_addr":"172.21.15.183:6805/3486494228","state":["exists","up"]},{"osd":2,"uuid":"040fff27-6fa6-48de-9365-fcced8f89e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6801","nonce":2245903281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6803","nonce":2245903281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6807","nonce":2245903281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6805","nonce":2245903281}]},"public_addr":"172.21.15.188:6801/2245903281","cluster_addr":"172.21.15.188:6803/2245903281","heartbeat_back_addr":"172.21.15.188:6807/2245903281","heartbeat_front_addr":"172.21.15.188:6805/2245903281","state":["exists","up"]},{"osd":3,"uuid":"e129321a-9566-4bea-b982-34f7ddd1ae1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6811","nonce":236749130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6813","nonce":236749130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6817","nonce":236749130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6815","nonce":236749130}]},"public_addr":"172.21.15.47:6811/236749130","cluster_addr":"172.21.15.47:6813/236749130","heartbeat_back_addr":"172.21.15.47:6817/236749130","heartbeat_front_addr":"172.21.15.47:6815/236749130","state":["exists","up"]},{"osd":4,"uuid":"f969fba7-b0ff-4ea6-83bd-38aba32b1be1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6809","nonce":3978122107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6811","nonce":3978122107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6815","nonce":3978122107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6813","nonce":3978122107}]},"public_addr":"172.21.15.183:6809/3978122107","cluster_addr":"172.21.15.183:6811/3978122107","heartbeat_back_addr":"172.21.15.183:6815/3978122107","heartbeat_front_addr":"172.21.15.183:6813/3978122107","state":["exists","up"]},{"osd":5,"uuid":"3799c912-3d9f-4efd-9b36-569c385e4c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6809","nonce":2097128083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6811","nonce":2097128083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6815","nonce":2097128083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6813","nonce":2097128083}]},"public_addr":"172.21.15.188:6809/2097128083","cluster_addr":"172.21.15.188:6811/2097128083","heartbeat_back_addr":"172.21.15.188:6815/2097128083","heartbeat_front_addr":"172.21.15.188:6813/2097128083","state":["exists","up"]},{"osd":6,"uuid":"1a38cf12-619f-4e82-a7a5-21ee2014038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6819","nonce":2288252980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6821","nonce":2288252980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6825","nonce":2288252980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6823","nonce":2288252980}]},"public_addr":"172.21.15.47:6819/2288252980","cluster_addr":"172.21.15.47:6821/2288252980","heartbeat_back_addr":"172.21.15.47:6825/2288252980","heartbeat_front_addr":"172.21.15.47:6823/2288252980","state":["exists","up"]},{"osd":7,"uuid":"6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6817","nonce":465426514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6819","nonce":465426514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6823","nonce":465426514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6821","nonce":465426514}]},"public_addr":"172.21.15.183:6817/465426514","cluster_addr":"172.21.15.183:6819/465426514","heartbeat_back_addr":"172.21.15.183:6823/465426514","heartbeat_front_addr":"172.21.15.183:6821/465426514","state":["exists","up"]},{"osd":8,"uuid":"6dfd7252-61a6-423d-8498-cbcfa41ae1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6817","nonce":2247055658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6819","nonce":2247055658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6823","nonce":2247055658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6821","nonce":2247055658}]},"public_addr":"172.21.15.188:6817/2247055658","cluster_addr":"172.21.15.188:6819/2247055658","heartbeat_back_addr":"172.21.15.188:6823/2247055658","heartbeat_front_addr":"172.21.15.188:6821/2247055658","state":["exists","up"]},{"osd":9,"uuid":"abd93c5e-283e-4873-a241-1056f2894116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6827","nonce":2628721884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6829","nonce":2628721884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6833","nonce":2628721884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6831","nonce":2628721884}]},"public_addr":"172.21.15.47:6827/2628721884","cluster_addr":"172.21.15.47:6829/2628721884","heartbeat_back_addr":"172.21.15.47:6833/2628721884","heartbeat_front_addr":"172.21.15.47:6831/2628721884","state":["exists","up"]},{"osd":10,"uuid":"bc967f8f-ce27-4230-be70-e36927f89fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6825","nonce":3509332199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6827","nonce":3509332199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6831","nonce":3509332199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6829","nonce":3509332199}]},"public_addr":"172.21.15.183:6825/3509332199","cluster_addr":"172.21.15.183:6827/3509332199","heartbeat_back_addr":"172.21.15.183:6831/3509332199","heartbeat_front_addr":"172.21.15.183:6829/3509332199","state":["exists","up"]},{"osd":11,"uuid":"8b379865-3a5c-4a2d-aa74-a4f215027fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6825","nonce":3725107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6827","nonce":3725107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6831","nonce":3725107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6829","nonce":3725107101}]},"public_addr":"172.21.15.188:6825/3725107101","cluster_addr":"172.21.15.188:6827/3725107101","heartbeat_back_addr":"172.21.15.188:6831/3725107101","heartbeat_front_addr":"172.21.15.188:6829/3725107101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:58:44.413660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:06.554842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:28.651418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:50.995466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:13.906535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:36.632662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:59.003224+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:21.701327+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:44.017943+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:06.400895+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:29.625920+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:52.323223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3499235566":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/2112533111":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/2714360830":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/507334607":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6800/2524786594":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/1004458106":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6800/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/1046677443":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/899235864":"2024-07-25T21:56:15.044564+0000","172.21.15.47:6800/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/3057769442":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/2596054312":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6801/2524786594":"2024-07-25T21:57:25.995502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T22:07:23.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.575+0000 7f3bc700e640 1 -- 172.21.15.47:0/2577415030 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3bb00b3dc0 msgr2=0x7f3bb00b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:23.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.575+0000 7f3bc700e640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3bb00b3dc0 0x7f3bb00b6280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3bac031440 tx=0x7f3bac005a20 comp rx=0 tx=0).stop 2024-07-24T22:07:23.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.575+0000 7f3bc700e640 1 -- 172.21.15.47:0/2577415030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bc0102770 msgr2=0x7f3bc0074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:23.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.575+0000 7f3bc700e640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bc0102770 0x7f3bc0074e90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400d950 tx=0x7f3bb400de10 comp rx=0 tx=0).stop 2024-07-24T22:07:23.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.575+0000 7f3bc700e640 1 -- 172.21.15.47:0/2577415030 shutdown_connections 2024-07-24T22:07:23.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.575+0000 7f3bc700e640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3bb00b3dc0 0x7f3bb00b6280 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:23.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.575+0000 7f3bc700e640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bc0108b00 0x7f3bc0075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:23.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.575+0000 7f3bc700e640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bc0108180 0x7f3bc00753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:23.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.575+0000 7f3bc700e640 1 --2- 172.21.15.47:0/2577415030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bc0102770 0x7f3bc0074e90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:23.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.575+0000 7f3bc700e640 1 -- 172.21.15.47:0/2577415030 >> 172.21.15.47:0/2577415030 conn(0x7f3bc00fe1c0 msgr2=0x7f3bc01005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:23.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.576+0000 7f3bc700e640 1 -- 172.21.15.47:0/2577415030 shutdown_connections 2024-07-24T22:07:23.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:23.576+0000 7f3bc700e640 1 -- 172.21.15.47:0/2577415030 wait complete. 2024-07-24T22:07:23.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:23 smithi183 ceph-mon[37007]: pgmap v371: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-07-24T22:07:23.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:23 smithi188 ceph-mon[37380]: pgmap v371: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-07-24T22:07:24.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-07-24T22:07:24.571 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:24 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2577415030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:07:24.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:24 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2577415030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:07:24.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:24 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2577415030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:07:25.541 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:25 smithi047 ceph-mon[32551]: pgmap v372: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-07-24T22:07:25.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.538+0000 7faedd5ef640 1 -- 172.21.15.47:0/3239434625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed81036a0 msgr2=0x7faed8103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:25.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.538+0000 7faedd5ef640 1 --2- 172.21.15.47:0/3239434625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed81036a0 0x7faed8103a80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7faec8009900 tx=0x7faec802a3f0 comp rx=0 tx=0).stop 2024-07-24T22:07:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.538+0000 7faedd5ef640 1 -- 172.21.15.47:0/3239434625 shutdown_connections 2024-07-24T22:07:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.538+0000 7faedd5ef640 1 --2- 172.21.15.47:0/3239434625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faed810cb00 0x7faed810ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.538+0000 7faedd5ef640 1 --2- 172.21.15.47:0/3239434625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faed8103fc0 0x7faed810c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.538+0000 7faedd5ef640 1 --2- 172.21.15.47:0/3239434625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed81036a0 0x7faed8103a80 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.538+0000 7faedd5ef640 1 -- 172.21.15.47:0/3239434625 >> 172.21.15.47:0/3239434625 conn(0x7faed80fd100 msgr2=0x7faed80ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.538+0000 7faedd5ef640 1 -- 172.21.15.47:0/3239434625 shutdown_connections 2024-07-24T22:07:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.539+0000 7faedd5ef640 1 -- 172.21.15.47:0/3239434625 wait complete. 2024-07-24T22:07:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.539+0000 7faedd5ef640 1 Processor -- start 2024-07-24T22:07:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faedd5ef640 1 -- start start 2024-07-24T22:07:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faedd5ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed81036a0 0x7faed8198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faedd5ef640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faed8103fc0 0x7faed8199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faedd5ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faed810cb00 0x7faed819e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:25.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faedd5ef640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faed8112760 con 0x7faed81036a0 2024-07-24T22:07:25.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faedd5ef640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faed81125e0 con 0x7faed8103fc0 2024-07-24T22:07:25.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faedd5ef640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faed81128e0 con 0x7faed810cb00 2024-07-24T22:07:25.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faed6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed81036a0 0x7faed8198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:25.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faed6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed81036a0 0x7faed8198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41578/0 (socket says 172.21.15.47:41578) 2024-07-24T22:07:25.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faed6ffd640 1 -- 172.21.15.47:0/3286617112 learned_addr learned my addr 172.21.15.47:0/3286617112 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:25.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faed77fe640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faed810cb00 0x7faed819e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:25.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faed67fc640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faed8103fc0 0x7faed8199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:25.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faed6ffd640 1 -- 172.21.15.47:0/3286617112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faed810cb00 msgr2=0x7faed819e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:25.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faed6ffd640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faed810cb00 0x7faed819e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:25.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faed6ffd640 1 -- 172.21.15.47:0/3286617112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faed8103fc0 msgr2=0x7faed8199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:25.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faed6ffd640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faed8103fc0 0x7faed8199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faed6ffd640 1 -- 172.21.15.47:0/3286617112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed819eca0 con 0x7faed81036a0 2024-07-24T22:07:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.540+0000 7faed67fc640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faed8103fc0 0x7faed8199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.541+0000 7faed6ffd640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed81036a0 0x7faed8198bf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7faec8005940 tx=0x7faec80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.541+0000 7faebffff640 1 -- 172.21.15.47:0/3286617112 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec803f030 con 0x7faed81036a0 2024-07-24T22:07:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.541+0000 7faedd5ef640 1 -- 172.21.15.47:0/3286617112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed819ef30 con 0x7faed81036a0 2024-07-24T22:07:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.541+0000 7faebffff640 1 -- 172.21.15.47:0/3286617112 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec8003cb0 con 0x7faed81036a0 2024-07-24T22:07:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.541+0000 7faebffff640 1 -- 172.21.15.47:0/3286617112 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8035070 con 0x7faed81036a0 2024-07-24T22:07:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.541+0000 7faedd5ef640 1 -- 172.21.15.47:0/3286617112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed81a5650 con 0x7faed81036a0 2024-07-24T22:07:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.542+0000 7faedd5ef640 1 -- 172.21.15.47:0/3286617112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed8103a80 con 0x7faed81036a0 2024-07-24T22:07:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.543+0000 7faebffff640 1 -- 172.21.15.47:0/3286617112 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7faec8042030 con 0x7faed81036a0 2024-07-24T22:07:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.544+0000 7faebffff640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faec00b3d40 0x7faec00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.544+0000 7faed67fc640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faec00b3d40 0x7faec00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.544+0000 7faebffff640 1 -- 172.21.15.47:0/3286617112 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7faec8104c50 con 0x7faed81036a0 2024-07-24T22:07:25.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.544+0000 7faed67fc640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faec00b3d40 0x7faec00b6200 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faed80ff910 tx=0x7faecc005e50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:25.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.547+0000 7faebffff640 1 -- 172.21.15.47:0/3286617112 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7faec80cbf00 con 0x7faed81036a0 2024-07-24T22:07:25.620 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:25.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:25 smithi183 ceph-mon[37007]: pgmap v372: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-07-24T22:07:25.700 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:25 smithi188 ceph-mon[37380]: pgmap v372: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-07-24T22:07:25.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.789+0000 7faedd5ef640 1 -- 172.21.15.47:0/3286617112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faed81a5940 con 0x7faed81036a0 2024-07-24T22:07:25.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.790+0000 7faebffff640 1 -- 172.21.15.47:0/3286617112 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7faec80d41d0 con 0x7faed81036a0 2024-07-24T22:07:25.792 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:07:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:07:25.792 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:07:25.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.792+0000 7faedd5ef640 1 -- 172.21.15.47:0/3286617112 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faec00b3d40 msgr2=0x7faec00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:25.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.792+0000 7faedd5ef640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faec00b3d40 0x7faec00b6200 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faed80ff910 tx=0x7faecc005e50 comp rx=0 tx=0).stop 2024-07-24T22:07:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.792+0000 7faedd5ef640 1 -- 172.21.15.47:0/3286617112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed81036a0 msgr2=0x7faed8198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.792+0000 7faedd5ef640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed81036a0 0x7faed8198bf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7faec8005940 tx=0x7faec80042f0 comp rx=0 tx=0).stop 2024-07-24T22:07:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.792+0000 7faedd5ef640 1 -- 172.21.15.47:0/3286617112 shutdown_connections 2024-07-24T22:07:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.792+0000 7faedd5ef640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faec00b3d40 0x7faec00b6200 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.792+0000 7faedd5ef640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faed810cb00 0x7faed819e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.792+0000 7faedd5ef640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faed8103fc0 0x7faed8199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:25.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.792+0000 7faedd5ef640 1 --2- 172.21.15.47:0/3286617112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed81036a0 0x7faed8198bf0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:25.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.792+0000 7faedd5ef640 1 -- 172.21.15.47:0/3286617112 >> 172.21.15.47:0/3286617112 conn(0x7faed80fd100 msgr2=0x7faed810ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:25.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.792+0000 7faedd5ef640 1 -- 172.21.15.47:0/3286617112 shutdown_connections 2024-07-24T22:07:25.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:25.792+0000 7faedd5ef640 1 -- 172.21.15.47:0/3286617112 wait complete. 2024-07-24T22:07:26.486 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:07:26.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:26 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3286617112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:26.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:26 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3286617112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:26.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:26 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3286617112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:26.951 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:27.628 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:27 smithi047 ceph-mon[32551]: pgmap v373: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:07:27.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:27 smithi183 ceph-mon[37007]: pgmap v373: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:07:27.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:27 smithi188 ceph-mon[37380]: pgmap v373: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:07:29.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:29 smithi183 ceph-mon[37007]: pgmap v374: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-07-24T22:07:29.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:29 smithi047 ceph-mon[32551]: pgmap v374: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-07-24T22:07:29.797 INFO:teuthology.orchestra.run.smithi047.stdout:{"run_dir":"/var/run/ceph"} 2024-07-24T22:07:29.797 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-07-24T22:07:29.798 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1368 2024-07-24T22:07:29.798 DEBUG:tasks.quiescer:Yielding 2024-07-24T22:07:29.798 INFO:teuthology.run_tasks:Running task workunit... 2024-07-24T22:07:29.812 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-07-24T22:07:29.813 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-07-24T22:07:29.813 INFO:tasks.workunit:timeout=3h 2024-07-24T22:07:29.813 INFO:tasks.workunit:cleanup=True 2024-07-24T22:07:29.813 DEBUG:teuthology.orchestra.run.smithi047:> stat -- /home/ubuntu/cephtest/mnt.0 2024-07-24T22:07:29.814 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:07:29.815 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:29 smithi188 ceph-mon[37380]: pgmap v374: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-07-24T22:07:29.833 INFO:teuthology.orchestra.run.smithi047.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-07-24T22:07:29.833 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-07-24T22:07:29.833 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6bh/107d Inode: 1099511628283 Links: 2 2024-07-24T22:07:29.833 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T22:07:29.833 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-07-24T22:07:29.833 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-07-24 22:04:21.053250358 +0000 2024-07-24T22:07:29.833 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-07-24 22:04:21.053250358 +0000 2024-07-24T22:07:29.833 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-07-24 22:06:42.622346291 +0000 2024-07-24T22:07:29.833 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-07-24 22:04:21.053250358 +0000 2024-07-24T22:07:29.834 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-07-24T22:07:29.834 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-07-24T22:07:29.908 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-07-24T22:07:29.966 INFO:tasks.workunit.client.0.smithi047.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-07-24T22:07:30.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.260+0000 7f88ee9ec640 1 -- 172.21.15.47:0/4116352191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e8108b20 msgr2=0x7f88e810f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:30.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.260+0000 7f88ee9ec640 1 --2- 172.21.15.47:0/4116352191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e8108b20 0x7f88e810f320 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009ca0 tx=0x7f88e002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.260+0000 7f88ee9ec640 1 -- 172.21.15.47:0/4116352191 shutdown_connections 2024-07-24T22:07:30.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.260+0000 7f88ee9ec640 1 --2- 172.21.15.47:0/4116352191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e8108b20 0x7f88e810f320 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.260+0000 7f88ee9ec640 1 --2- 172.21.15.47:0/4116352191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88e81081a0 0x7f88e81085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.260+0000 7f88ee9ec640 1 --2- 172.21.15.47:0/4116352191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88e8102790 0x7f88e8102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.260+0000 7f88ee9ec640 1 -- 172.21.15.47:0/4116352191 >> 172.21.15.47:0/4116352191 conn(0x7f88e80fe200 msgr2=0x7f88e8100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:30.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.260+0000 7f88ee9ec640 1 -- 172.21.15.47:0/4116352191 shutdown_connections 2024-07-24T22:07:30.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.260+0000 7f88ee9ec640 1 -- 172.21.15.47:0/4116352191 wait complete. 2024-07-24T22:07:30.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.261+0000 7f88ee9ec640 1 Processor -- start 2024-07-24T22:07:30.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.261+0000 7f88ee9ec640 1 -- start start 2024-07-24T22:07:30.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.261+0000 7f88ee9ec640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e8102790 0x7f88e8198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88ee9ec640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88e81081a0 0x7f88e81991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88ee9ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88e8108b20 0x7f88e819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88ee9ec640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f88e8112740 con 0x7f88e8102790 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88ee9ec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81125c0 con 0x7f88e8108b20 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88ee9ec640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81128c0 con 0x7f88e81081a0 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e8102790 0x7f88e8198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e8102790 0x7f88e8198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41594/0 (socket says 172.21.15.47:41594) 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e7fff640 1 -- 172.21.15.47:0/985911465 learned_addr learned my addr 172.21.15.47:0/985911465 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88ecf89640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88e8108b20 0x7f88e819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e77fe640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88e81081a0 0x7f88e81991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e7fff640 1 -- 172.21.15.47:0/985911465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88e81081a0 msgr2=0x7f88e81991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e7fff640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88e81081a0 0x7f88e81991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e7fff640 1 -- 172.21.15.47:0/985911465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88e8108b20 msgr2=0x7f88e819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:30.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e7fff640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88e8108b20 0x7f88e819e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e7fff640 1 -- 172.21.15.47:0/985911465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e819ed20 con 0x7f88e8102790 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e77fe640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88e81081a0 0x7f88e81991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e7fff640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e8102790 0x7f88e8198c70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f88d800d950 tx=0x7f88d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e57fa640 1 -- 172.21.15.47:0/985911465 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d8017030 con 0x7f88e8102790 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e57fa640 1 -- 172.21.15.47:0/985911465 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88d8004020 con 0x7f88e8102790 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88ee9ec640 1 -- 172.21.15.47:0/985911465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e819f010 con 0x7f88e8102790 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88e57fa640 1 -- 172.21.15.47:0/985911465 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d80047a0 con 0x7f88e8102790 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.262+0000 7f88ee9ec640 1 -- 172.21.15.47:0/985911465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e81a58a0 con 0x7f88e8102790 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.265+0000 7f88e57fa640 1 -- 172.21.15.47:0/985911465 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f88d8009a30 con 0x7f88e8102790 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.265+0000 7f88f0d9d740 1 Processor -- start 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.265+0000 7f88f0d9d740 1 -- start start 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.265+0000 7f88f0d9d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x56012298cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.265+0000 7f88f0d9d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012298cff0 0x56012299ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.265+0000 7f88f0d9d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012299d390 0x56012299f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.265+0000 7f88f0d9d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5601229039b0 con 0x56012299d390 2024-07-24T22:07:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.265+0000 7f88f0d9d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5601228f2eb0 con 0x56012298c6d0 2024-07-24T22:07:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.265+0000 7f88f0d9d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5601228f6ef0 con 0x56012298cff0 2024-07-24T22:07:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012299d390 0x56012299f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012299d390 0x56012299f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41606/0 (socket says 172.21.15.47:41606) 2024-07-24T22:07:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e77fe640 1 -- 172.21.15.47:0/2002247414 learned_addr learned my addr 172.21.15.47:0/2002247414 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88ecf89640 1 --2- 172.21.15.47:0/2002247414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x56012298cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e7fff640 1 --2- 172.21.15.47:0/2002247414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012298cff0 0x56012299ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e77fe640 1 -- 172.21.15.47:0/2002247414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012298cff0 msgr2=0x56012299ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e77fe640 1 --2- 172.21.15.47:0/2002247414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012298cff0 0x56012299ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e77fe640 1 -- 172.21.15.47:0/2002247414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 msgr2=0x56012298cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e77fe640 1 --2- 172.21.15.47:0/2002247414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x56012298cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e57fa640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88d00b3dc0 0x7f88d00b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e77fe640 1 -- 172.21.15.47:0/2002247414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56012287c320 con 0x56012299d390 2024-07-24T22:07:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e7fff640 1 --2- 172.21.15.47:0/2002247414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012298cff0 0x56012299ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88ecf89640 1 --2- 172.21.15.47:0/2002247414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x56012298cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e7fff640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88d00b3dc0 0x7f88d00b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e77fe640 1 --2- 172.21.15.47:0/2002247414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012299d390 0x56012299f780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009b90 tx=0x7f88dc00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3135f8aad804269 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88e57fa640 1 -- 172.21.15.47:0/985911465 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f88d80e3ae0 con 0x7f88e8102790 2024-07-24T22:07:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88ce7fc640 1 -- 172.21.15.47:0/2002247414 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc016070 con 0x56012299d390 2024-07-24T22:07:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88ce7fc640 1 -- 172.21.15.47:0/2002247414 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88dc0054d0 con 0x56012299d390 2024-07-24T22:07:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.266+0000 7f88ce7fc640 1 -- 172.21.15.47:0/2002247414 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc011470 con 0x56012299d390 2024-07-24T22:07:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.267+0000 7f88f0d9d740 1 -- 172.21.15.47:0/2002247414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012299d390 msgr2=0x56012299f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.267+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/2002247414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012299d390 0x56012299f780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009b90 tx=0x7f88dc00e6c0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.267+0000 7f88e7fff640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88d00b3dc0 0x7f88d00b6280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f88d80e12e0 tx=0x7f88d80e3de0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.267+0000 7f88f0d9d740 1 -- 172.21.15.47:0/2002247414 shutdown_connections 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.267+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/2002247414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012299d390 0x56012299f780 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.267+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/2002247414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012298cff0 0x56012299ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.267+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/2002247414 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x56012298cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.267+0000 7f88f0d9d740 1 -- 172.21.15.47:0/2002247414 >> 172.21.15.47:0/2002247414 conn(0x56012298a500 msgr2=0x56012298b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.267+0000 7f88f0d9d740 1 -- 172.21.15.47:0/2002247414 shutdown_connections 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.267+0000 7f88f0d9d740 1 -- 172.21.15.47:0/2002247414 wait complete. 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88f0d9d740 1 -- start start 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88f0d9d740 1 Processor -- start 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88f0d9d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x56012299ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88f0d9d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x56012299a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88f0d9d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012299d390 0x56012299a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88f0d9d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560122756700 con 0x56012298cff0 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88f0d9d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5601228955f0 con 0x56012298c6d0 2024-07-24T22:07:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88f0d9d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5601229a0040 con 0x56012299d390 2024-07-24T22:07:30.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88f0d9d740 10 client.0 _ll_register_callbacks cb 0x5601228b5960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:30.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x56012299a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x56012299a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41616/0 (socket says 172.21.15.47:41616) 2024-07-24T22:07:30.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88e77fe640 1 -- 172.21.15.47:0/2223853004 learned_addr learned my addr 172.21.15.47:0/2223853004 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:30.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88ecf89640 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x56012299ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.268+0000 7f88ecf89640 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012299d390 0x56012299a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88e77fe640 1 -- 172.21.15.47:0/2223853004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012299d390 msgr2=0x56012299a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:30.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88e77fe640 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012299d390 0x56012299a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88e77fe640 1 -- 172.21.15.47:0/2223853004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 msgr2=0x56012299ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:30.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88e77fe640 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x56012299ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88e77fe640 1 -- 172.21.15.47:0/2223853004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560122888680 con 0x56012298cff0 2024-07-24T22:07:30.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88ecf89640 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012299d390 0x56012299a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:30.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88e77fe640 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x56012299a250 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f88dc000c00 tx=0x7f88dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610ed435a4e263c4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88c77fe640 1 -- 172.21.15.47:0/2223853004 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc016040 con 0x56012298cff0 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88c77fe640 1 -- 172.21.15.47:0/2223853004 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f88dc004020 con 0x56012298cff0 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88f0d9d740 1 -- 172.21.15.47:0/2223853004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88dc0054d0 con 0x56012298cff0 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88c77fe640 1 -- 172.21.15.47:0/2223853004 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f88dc009760 con 0x56012298cff0 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88f0d9d740 10 client.15507 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88f0d9d740 1 -- 172.21.15.47:0/2223853004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560122653650 con 0x56012298cff0 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.269+0000 7f88c77fe640 1 -- 172.21.15.47:0/2223853004 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88dc0054d0 con 0x56012298cff0 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.270+0000 7f88c77fe640 1 -- 172.21.15.47:0/2223853004 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f88dc00f040 con 0x56012298cff0 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.270+0000 7f88f0d9d740 10 client.15507 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.270+0000 7f88f0d9d740 10 client.15507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.270+0000 7f88f0d9d740 20 client.15507 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.270+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5601229acca0 0x5601229af090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.270+0000 7f88f0d9d740 4 client.15507 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.270+0000 7f88f0d9d740 1 -- 172.21.15.47:0/2223853004 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560122905900 con 0x5601229acca0 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.270+0000 7f88ecf89640 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5601229acca0 0x5601229af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.270+0000 7f88c77fe640 10 client.15507 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.270+0000 7f88ecf89640 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5601229acca0 0x5601229af090 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=171ff442093aba73 server_cookie=14e1cd1395369935 in_seq=0 out_seq=0 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.271+0000 7f88c77fe640 1 -- 172.21.15.47:0/2223853004 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560122905900 con 0x5601229acca0 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.271+0000 7f88c77fe640 10 client.15507 handle_command_reply: tid=0 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.271+0000 7f88f0d9d740 1 client.15507 shutdown 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.271+0000 7f88f0d9d740 1 -- 172.21.15.47:0/2223853004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 msgr2=0x56012299a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.271+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x56012299a250 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f88dc000c00 tx=0x7f88dc0048f0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.271+0000 7f88f0d9d740 1 -- 172.21.15.47:0/2223853004 shutdown_connections 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.272+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5601229acca0 0x5601229af090 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.272+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012299d390 0x56012299a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.272+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x56012299a250 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.272+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/2223853004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x56012299ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.272+0000 7f88f0d9d740 1 -- 172.21.15.47:0/2223853004 >> 172.21.15.47:0/2223853004 conn(0x56012298a500 msgr2=0x560122990030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:30.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.272+0000 7f88c77fe640 0 client.15507 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:30.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.272+0000 7f88f0d9d740 1 -- 172.21.15.47:0/2223853004 shutdown_connections 2024-07-24T22:07:30.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.272+0000 7f88f0d9d740 1 -- 172.21.15.47:0/2223853004 wait complete. 2024-07-24T22:07:30.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.272+0000 7f88f0d9d740 20 client.15507 trim_cache size 0 max 16384 2024-07-24T22:07:30.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.285+0000 7f88f0d9d740 1 Processor -- start 2024-07-24T22:07:30.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88f0d9d740 1 -- start start 2024-07-24T22:07:30.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88f0d9d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012298c6d0 0x560122997e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88f0d9d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x560122985470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88f0d9d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012299d390 0x56012298b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88f0d9d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81a9f90 con 0x56012298cff0 2024-07-24T22:07:30.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88f0d9d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81ac810 con 0x56012299d390 2024-07-24T22:07:30.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88f0d9d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81aa600 con 0x56012298c6d0 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x560122985470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x560122985470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41628/0 (socket says 172.21.15.47:41628) 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88e77fe640 1 -- 172.21.15.47:0/671250275 learned_addr learned my addr 172.21.15.47:0/671250275 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88ecf89640 1 --2- 172.21.15.47:0/671250275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012298c6d0 0x560122997e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88ecf89640 1 --2- 172.21.15.47:0/671250275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012299d390 0x56012298b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88e77fe640 1 -- 172.21.15.47:0/671250275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012298c6d0 msgr2=0x560122997e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88e77fe640 1 --2- 172.21.15.47:0/671250275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012298c6d0 0x560122997e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88e77fe640 1 -- 172.21.15.47:0/671250275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012299d390 msgr2=0x56012298b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88e77fe640 1 --2- 172.21.15.47:0/671250275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012299d390 0x56012298b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88e77fe640 1 -- 172.21.15.47:0/671250275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560122998750 con 0x56012298cff0 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88ecf89640 1 --2- 172.21.15.47:0/671250275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012299d390 0x56012298b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.286+0000 7f88e77fe640 1 --2- 172.21.15.47:0/671250275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x560122985470 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00e700 tx=0x7f88dc005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ddecc0244e5d28 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.287+0000 7f88cdffb640 1 -- 172.21.15.47:0/671250275 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc016070 con 0x56012298cff0 2024-07-24T22:07:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.287+0000 7f88cdffb640 1 -- 172.21.15.47:0/671250275 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88dc005610 con 0x56012298cff0 2024-07-24T22:07:30.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.287+0000 7f88cdffb640 1 -- 172.21.15.47:0/671250275 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc004120 con 0x56012298cff0 2024-07-24T22:07:30.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.287+0000 7f88f0d9d740 1 -- 172.21.15.47:0/671250275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 msgr2=0x560122985470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:30.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.287+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/671250275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x560122985470 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00e700 tx=0x7f88dc005ed0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.287+0000 7f88f0d9d740 1 -- 172.21.15.47:0/671250275 shutdown_connections 2024-07-24T22:07:30.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.287+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/671250275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012299d390 0x56012298b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.287+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/671250275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x560122985470 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.287+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/671250275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012298c6d0 0x560122997e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.287+0000 7f88f0d9d740 1 -- 172.21.15.47:0/671250275 >> 172.21.15.47:0/671250275 conn(0x56012298a500 msgr2=0x560122998ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:30.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.287+0000 7f88f0d9d740 1 -- 172.21.15.47:0/671250275 shutdown_connections 2024-07-24T22:07:30.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.287+0000 7f88f0d9d740 1 -- 172.21.15.47:0/671250275 wait complete. 2024-07-24T22:07:30.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.287+0000 7f88f0d9d740 1 -- start start 2024-07-24T22:07:30.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88f0d9d740 1 Processor -- start 2024-07-24T22:07:30.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88f0d9d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x5601229a5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88f0d9d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x5601229b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88f0d9d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012299d390 0x5601229b4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88f0d9d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81aacd0 con 0x56012298cff0 2024-07-24T22:07:30.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88f0d9d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81ac140 con 0x56012298c6d0 2024-07-24T22:07:30.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88f0d9d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f88e81ab3a0 con 0x56012299d390 2024-07-24T22:07:30.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88f0d9d740 10 client.0 _ll_register_callbacks cb 0x7f88dc0099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:30.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x5601229b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x5601229b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41630/0 (socket says 172.21.15.47:41630) 2024-07-24T22:07:30.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88e77fe640 1 -- 172.21.15.47:0/3728901669 learned_addr learned my addr 172.21.15.47:0/3728901669 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:30.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88ecf89640 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x5601229a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88ecf89640 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012299d390 0x5601229b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88e77fe640 1 -- 172.21.15.47:0/3728901669 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012299d390 msgr2=0x5601229b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:30.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88e77fe640 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012299d390 0x5601229b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88e77fe640 1 -- 172.21.15.47:0/3728901669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 msgr2=0x5601229a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:30.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88e77fe640 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x5601229a5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88e77fe640 1 -- 172.21.15.47:0/3728901669 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601229b4c30 con 0x56012298cff0 2024-07-24T22:07:30.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.288+0000 7f88ecf89640 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x5601229a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:30.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.289+0000 7f88e77fe640 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x5601229b3fe0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0094a0 tx=0x7f88dc004eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbd96391cb04d10 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:30.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.289+0000 7f88c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:30.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.289+0000 7f88c77fe640 1 -- 172.21.15.47:0/3728901669 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc016030 con 0x56012298cff0 2024-07-24T22:07:30.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.289+0000 7f88c77fe640 1 -- 172.21.15.47:0/3728901669 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f88dc003ea0 con 0x56012298cff0 2024-07-24T22:07:30.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.289+0000 7f88f0d9d740 1 -- 172.21.15.47:0/3728901669 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88dc005610 con 0x56012298cff0 2024-07-24T22:07:30.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.289+0000 7f88c77fe640 1 -- 172.21.15.47:0/3728901669 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f88dc0040a0 con 0x56012298cff0 2024-07-24T22:07:30.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.289+0000 7f88f0d9d740 10 client.15513 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:30.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.289+0000 7f88f0d9d740 1 -- 172.21.15.47:0/3728901669 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560122a17590 con 0x56012298cff0 2024-07-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.289+0000 7f88c77fe640 1 -- 172.21.15.47:0/3728901669 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88dc005610 con 0x56012298cff0 2024-07-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.289+0000 7f88c77fe640 1 -- 172.21.15.47:0/3728901669 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f88dc03d480 con 0x56012298cff0 2024-07-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.289+0000 7f88f0d9d740 10 client.15513 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.289+0000 7f88f0d9d740 10 client.15513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.289+0000 7f88f0d9d740 20 client.15513 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.290+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560122a17c00 0x560122a1a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.290+0000 7f88f0d9d740 4 client.15513 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.290+0000 7f88f0d9d740 1 -- 172.21.15.47:0/3728901669 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5601229013a0 con 0x560122a17c00 2024-07-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.290+0000 7f88ecf89640 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560122a17c00 0x560122a1a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.290+0000 7f88ecf89640 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560122a17c00 0x560122a1a020 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af35607475cc4016 server_cookie=124396c85db283d8 in_seq=0 out_seq=0 2024-07-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.290+0000 7f88c77fe640 10 client.15513 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.290+0000 7f88c77fe640 1 -- 172.21.15.47:0/3728901669 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5601229013a0 con 0x560122a17c00 2024-07-24T22:07:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.290+0000 7f88c77fe640 10 client.15513 handle_command_reply: tid=0 2024-07-24T22:07:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.290+0000 7f88f0d9d740 1 client.15513 shutdown 2024-07-24T22:07:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.291+0000 7f88f0d9d740 1 -- 172.21.15.47:0/3728901669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 msgr2=0x5601229b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.291+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x5601229b3fe0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0094a0 tx=0x7f88dc004eb0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.291+0000 7f88f0d9d740 1 -- 172.21.15.47:0/3728901669 shutdown_connections 2024-07-24T22:07:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.291+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560122a17c00 0x560122a1a020 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.291+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56012299d390 0x5601229b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.291+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012298cff0 0x5601229b3fe0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.291+0000 7f88f0d9d740 1 --2- 172.21.15.47:0/3728901669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56012298c6d0 0x5601229a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.291+0000 7f88f0d9d740 1 -- 172.21.15.47:0/3728901669 >> 172.21.15.47:0/3728901669 conn(0x56012298a500 msgr2=0x56012299b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.291+0000 7f88c77fe640 0 client.15513 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.291+0000 7f88f0d9d740 1 -- 172.21.15.47:0/3728901669 shutdown_connections 2024-07-24T22:07:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.291+0000 7f88f0d9d740 1 -- 172.21.15.47:0/3728901669 wait complete. 2024-07-24T22:07:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.291+0000 7f88f0d9d740 20 client.15513 trim_cache size 0 max 16384 2024-07-24T22:07:30.311 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:07:30.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.292+0000 7f88ee9ec640 1 -- 172.21.15.47:0/985911465 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88d00b3dc0 msgr2=0x7f88d00b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:30.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.292+0000 7f88ee9ec640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88d00b3dc0 0x7f88d00b6280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f88d80e12e0 tx=0x7f88d80e3de0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.292+0000 7f88ee9ec640 1 -- 172.21.15.47:0/985911465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e8102790 msgr2=0x7f88e8198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:30.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.292+0000 7f88ee9ec640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e8102790 0x7f88e8198c70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f88d800d950 tx=0x7f88d800de10 comp rx=0 tx=0).stop 2024-07-24T22:07:30.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.292+0000 7f88ee9ec640 1 -- 172.21.15.47:0/985911465 shutdown_connections 2024-07-24T22:07:30.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.292+0000 7f88ee9ec640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88d00b3dc0 0x7f88d00b6280 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.292+0000 7f88ee9ec640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88e8108b20 0x7f88e819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.292+0000 7f88ee9ec640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88e81081a0 0x7f88e81991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.292+0000 7f88ee9ec640 1 --2- 172.21.15.47:0/985911465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e8102790 0x7f88e8198c70 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:30.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.292+0000 7f88ee9ec640 1 -- 172.21.15.47:0/985911465 >> 172.21.15.47:0/985911465 conn(0x7f88e80fe200 msgr2=0x7f88e81005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:30.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.292+0000 7f88ee9ec640 1 -- 172.21.15.47:0/985911465 shutdown_connections 2024-07-24T22:07:30.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:30.292+0000 7f88ee9ec640 1 -- 172.21.15.47:0/985911465 wait complete. 2024-07-24T22:07:30.567 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:31.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:31 smithi183 ceph-mon[37007]: pgmap v375: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:31.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:31 smithi047 ceph-mon[32551]: pgmap v375: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:31.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:31 smithi188 ceph-mon[37380]: pgmap v375: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:31.977 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:07:31.977 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:07:32.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.629+0000 7f77b7bbf640 1 -- 172.21.15.47:0/1039886002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b01036a0 msgr2=0x7f77b0103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:32.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.629+0000 7f77b7bbf640 1 --2- 172.21.15.47:0/1039886002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b01036a0 0x7f77b0103a80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009900 tx=0x7f77ac02a410 comp rx=0 tx=0).stop 2024-07-24T22:07:32.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.629+0000 7f77b7bbf640 1 -- 172.21.15.47:0/1039886002 shutdown_connections 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.629+0000 7f77b7bbf640 1 --2- 172.21.15.47:0/1039886002 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77b010cb00 0x7f77b010ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.629+0000 7f77b7bbf640 1 --2- 172.21.15.47:0/1039886002 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77b0103fc0 0x7f77b010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.629+0000 7f77b7bbf640 1 --2- 172.21.15.47:0/1039886002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b01036a0 0x7f77b0103a80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.629+0000 7f77b7bbf640 1 -- 172.21.15.47:0/1039886002 >> 172.21.15.47:0/1039886002 conn(0x7f77b00fd100 msgr2=0x7f77b00ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.629+0000 7f77b7bbf640 1 -- 172.21.15.47:0/1039886002 shutdown_connections 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.629+0000 7f77b7bbf640 1 -- 172.21.15.47:0/1039886002 wait complete. 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b7bbf640 1 Processor -- start 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b7bbf640 1 -- start start 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b7bbf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b01036a0 0x7f77b0101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b7bbf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77b0103fc0 0x7f77b0101890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b7bbf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77b010cb00 0x7f77b0101dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b7bbf640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77b0112760 con 0x7f77b01036a0 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b7bbf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f77b01125e0 con 0x7f77b010cb00 2024-07-24T22:07:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b7bbf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f77b01128e0 con 0x7f77b0103fc0 2024-07-24T22:07:32.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b595b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b01036a0 0x7f77b0101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:32.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b595b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b01036a0 0x7f77b0101350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41646/0 (socket says 172.21.15.47:41646) 2024-07-24T22:07:32.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b595b640 1 -- 172.21.15.47:0/3885417164 learned_addr learned my addr 172.21.15.47:0/3885417164 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:32.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b515a640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77b0103fc0 0x7f77b0101890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:32.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b615c640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77b010cb00 0x7f77b0101dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:32.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b595b640 1 -- 172.21.15.47:0/3885417164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77b0103fc0 msgr2=0x7f77b0101890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:32.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b595b640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77b0103fc0 0x7f77b0101890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:32.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b595b640 1 -- 172.21.15.47:0/3885417164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77b010cb00 msgr2=0x7f77b0101dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:32.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b595b640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77b010cb00 0x7f77b0101dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:32.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.630+0000 7f77b595b640 1 -- 172.21.15.47:0/3885417164 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b01a7090 con 0x7f77b01036a0 2024-07-24T22:07:32.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.631+0000 7f77b595b640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b01036a0 0x7f77b0101350 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f77ac005940 tx=0x7f77ac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:32.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.631+0000 7f77a6ffd640 1 -- 172.21.15.47:0/3885417164 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac03f030 con 0x7f77b01036a0 2024-07-24T22:07:32.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.631+0000 7f77a6ffd640 1 -- 172.21.15.47:0/3885417164 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77ac003aa0 con 0x7f77b01036a0 2024-07-24T22:07:32.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.631+0000 7f77b7bbf640 1 -- 172.21.15.47:0/3885417164 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b01a7320 con 0x7f77b01036a0 2024-07-24T22:07:32.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.631+0000 7f77a6ffd640 1 -- 172.21.15.47:0/3885417164 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac035070 con 0x7f77b01036a0 2024-07-24T22:07:32.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.631+0000 7f77b7bbf640 1 -- 172.21.15.47:0/3885417164 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b01a7800 con 0x7f77b01036a0 2024-07-24T22:07:32.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.632+0000 7f77b7bbf640 1 -- 172.21.15.47:0/3885417164 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b0103a80 con 0x7f77b01036a0 2024-07-24T22:07:32.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.633+0000 7f77a6ffd640 1 -- 172.21.15.47:0/3885417164 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f77ac042030 con 0x7f77b01036a0 2024-07-24T22:07:32.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.634+0000 7f77a6ffd640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f779c0b3d40 0x7f779c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:32.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.634+0000 7f77b515a640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f779c0b3d40 0x7f779c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:32.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.634+0000 7f77a6ffd640 1 -- 172.21.15.47:0/3885417164 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f77ac104a20 con 0x7f77b01036a0 2024-07-24T22:07:32.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.635+0000 7f77b515a640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f779c0b3d40 0x7f779c0b6200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f77b0102e40 tx=0x7f77a0005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:32.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.637+0000 7f77a6ffd640 1 -- 172.21.15.47:0/3885417164 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f77ac0cbd30 con 0x7f77b01036a0 2024-07-24T22:07:32.723 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.875+0000 7f77b7bbf640 1 -- 172.21.15.47:0/3885417164 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77b01a7b20 con 0x7f77b01036a0 2024-07-24T22:07:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.875+0000 7f77a6ffd640 1 -- 172.21.15.47:0/3885417164 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f77ac0cb630 con 0x7f77b01036a0 2024-07-24T22:07:32.878 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:07:32.878 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:07:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:07:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.877+0000 7f77b7bbf640 1 -- 172.21.15.47:0/3885417164 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f779c0b3d40 msgr2=0x7f779c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.877+0000 7f77b7bbf640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f779c0b3d40 0x7f779c0b6200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f77b0102e40 tx=0x7f77a0005f90 comp rx=0 tx=0).stop 2024-07-24T22:07:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.877+0000 7f77b7bbf640 1 -- 172.21.15.47:0/3885417164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b01036a0 msgr2=0x7f77b0101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.877+0000 7f77b7bbf640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b01036a0 0x7f77b0101350 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f77ac005940 tx=0x7f77ac004270 comp rx=0 tx=0).stop 2024-07-24T22:07:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.878+0000 7f77b7bbf640 1 -- 172.21.15.47:0/3885417164 shutdown_connections 2024-07-24T22:07:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.878+0000 7f77b7bbf640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f779c0b3d40 0x7f779c0b6200 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.878+0000 7f77b7bbf640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77b010cb00 0x7f77b0101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.878+0000 7f77b7bbf640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77b0103fc0 0x7f77b0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.878+0000 7f77b7bbf640 1 --2- 172.21.15.47:0/3885417164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b01036a0 0x7f77b0101350 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.878+0000 7f77b7bbf640 1 -- 172.21.15.47:0/3885417164 >> 172.21.15.47:0/3885417164 conn(0x7f77b00fd100 msgr2=0x7f77b010ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.878+0000 7f77b7bbf640 1 -- 172.21.15.47:0/3885417164 shutdown_connections 2024-07-24T22:07:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:32.878+0000 7f77b7bbf640 1 -- 172.21.15.47:0/3885417164 wait complete. 2024-07-24T22:07:33.620 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:33 smithi047 ceph-mon[32551]: pgmap v376: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 938 B/s wr, 3 op/s 2024-07-24T22:07:33.620 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:33 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3885417164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:33.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-07-24T22:03:54.960171+0000', 'modified': '2024-07-24T22:04:10.197477+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24628}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24610': {'gid': 24610, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.188:6837/749102233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6836', 'nonce': 749102233}, {'type': 'v1', 'addr': '172.21.15.188:6837', 'nonce': 749102233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24628': {'gid': 24628, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.188:6839/3781670075', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6838', 'nonce': 3781670075}, {'type': 'v1', 'addr': '172.21.15.188:6839', 'nonce': 3781670075}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24628, 'qdb_cluster': [24628]} 2024-07-24T22:07:33.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-07-24T22:07:33.649 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.i status 2024-07-24T22:07:33.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:33 smithi183 ceph-mon[37007]: pgmap v376: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 938 B/s wr, 3 op/s 2024-07-24T22:07:33.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:33 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3885417164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:33.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:33 smithi188 ceph-mon[37380]: pgmap v376: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 938 B/s wr, 3 op/s 2024-07-24T22:07:33.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:33 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3885417164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:34.531 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.260+0000 7f7d04ba6640 1 -- 172.21.15.47:0/3229426974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d00103460 msgr2=0x7f7d00103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.260+0000 7f7d04ba6640 1 --2- 172.21.15.47:0/3229426974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d00103460 0x7f7d00103840 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009900 tx=0x7f7cf002a410 comp rx=0 tx=0).stop 2024-07-24T22:07:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.260+0000 7f7d04ba6640 1 -- 172.21.15.47:0/3229426974 shutdown_connections 2024-07-24T22:07:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.260+0000 7f7d04ba6640 1 --2- 172.21.15.47:0/3229426974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d0010ca10 0x7f7d0010ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.260+0000 7f7d04ba6640 1 --2- 172.21.15.47:0/3229426974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d00103e60 0x7f7d0010c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.260+0000 7f7d04ba6640 1 --2- 172.21.15.47:0/3229426974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d00103460 0x7f7d00103840 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.260+0000 7f7d04ba6640 1 -- 172.21.15.47:0/3229426974 >> 172.21.15.47:0/3229426974 conn(0x7f7d000fd030 msgr2=0x7f7d000ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.260+0000 7f7d04ba6640 1 -- 172.21.15.47:0/3229426974 shutdown_connections 2024-07-24T22:07:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.260+0000 7f7d04ba6640 1 -- 172.21.15.47:0/3229426974 wait complete. 2024-07-24T22:07:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.261+0000 7f7d04ba6640 1 Processor -- start 2024-07-24T22:07:35.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.261+0000 7f7d04ba6640 1 -- start start 2024-07-24T22:07:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.261+0000 7f7d04ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d00103460 0x7f7d00198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.261+0000 7f7d04ba6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d00103e60 0x7f7d00199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.261+0000 7f7d04ba6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d0010ca10 0x7f7d0019e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.261+0000 7f7d04ba6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d001126a0 con 0x7f7d00103460 2024-07-24T22:07:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.261+0000 7f7d04ba6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7d00112520 con 0x7f7d0010ca10 2024-07-24T22:07:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.261+0000 7f7d04ba6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7d00112820 con 0x7f7d00103e60 2024-07-24T22:07:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cfe59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d00103460 0x7f7d00198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cfe59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d00103460 0x7f7d00198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43906/0 (socket says 172.21.15.47:43906) 2024-07-24T22:07:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cfe59c640 1 -- 172.21.15.47:0/3615053678 learned_addr learned my addr 172.21.15.47:0/3615053678 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cf5d9b640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d00103e60 0x7f7d00199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cfed9d640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d0010ca10 0x7f7d0019e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cfe59c640 1 -- 172.21.15.47:0/3615053678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d00103e60 msgr2=0x7f7d00199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d00103e60 0x7f7d00199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cfe59c640 1 -- 172.21.15.47:0/3615053678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d0010ca10 msgr2=0x7f7d0019e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d0010ca10 0x7f7d0019e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cfe59c640 1 -- 172.21.15.47:0/3615053678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0019ec80 con 0x7f7d00103460 2024-07-24T22:07:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cf5d9b640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d00103e60 0x7f7d00199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d00103460 0x7f7d00198be0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0006010 tx=0x7f7cf00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cf7fff640 1 -- 172.21.15.47:0/3615053678 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf003f030 con 0x7f7d00103460 2024-07-24T22:07:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7d04ba6640 1 -- 172.21.15.47:0/3615053678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0019ef10 con 0x7f7d00103460 2024-07-24T22:07:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cf7fff640 1 -- 172.21.15.47:0/3615053678 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cf0003800 con 0x7f7d00103460 2024-07-24T22:07:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7cf7fff640 1 -- 172.21.15.47:0/3615053678 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0035070 con 0x7f7d00103460 2024-07-24T22:07:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.262+0000 7f7d04ba6640 1 -- 172.21.15.47:0/3615053678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d001a5630 con 0x7f7d00103460 2024-07-24T22:07:35.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.265+0000 7f7d079d0740 1 Processor -- start 2024-07-24T22:07:35.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.265+0000 7f7cf7fff640 1 -- 172.21.15.47:0/3615053678 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f7cf0003cb0 con 0x7f7d00103460 2024-07-24T22:07:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.265+0000 7f7d079d0740 1 -- start start 2024-07-24T22:07:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.265+0000 7f7d079d0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2a38c0 0x5639ee2a3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.265+0000 7f7d079d0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 0x5639ee2a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.265+0000 7f7d079d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2b8820 0x5639ee2bac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.265+0000 7f7d079d0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5639ee219280 con 0x5639ee2adc20 2024-07-24T22:07:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.265+0000 7f7d079d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5639ee208780 con 0x5639ee2b8820 2024-07-24T22:07:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.265+0000 7f7d079d0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5639ee20c7c0 con 0x5639ee2a38c0 2024-07-24T22:07:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.265+0000 7f7cfe59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 0x5639ee2a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.265+0000 7f7cfe59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 0x5639ee2a41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43908/0 (socket says 172.21.15.47:43908) 2024-07-24T22:07:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.265+0000 7f7cfe59c640 1 -- 172.21.15.47:0/2814381178 learned_addr learned my addr 172.21.15.47:0/2814381178 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.265+0000 7f7cf5d9b640 1 --2- 172.21.15.47:0/2814381178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2b8820 0x5639ee2bac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.266+0000 7f7cfed9d640 1 --2- 172.21.15.47:0/2814381178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2a38c0 0x5639ee2a3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.266+0000 7f7cfe59c640 1 -- 172.21.15.47:0/2814381178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2a38c0 msgr2=0x5639ee2a3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.266+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/2814381178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2a38c0 0x5639ee2a3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.266+0000 7f7cfe59c640 1 -- 172.21.15.47:0/2814381178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2b8820 msgr2=0x5639ee2bac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.266+0000 7f7cf7fff640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7cec0b3d40 0x7f7cec0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.266+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/2814381178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2b8820 0x5639ee2bac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.266+0000 7f7cfe59c640 1 -- 172.21.15.47:0/2814381178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639edf6c790 con 0x5639ee2adc20 2024-07-24T22:07:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.266+0000 7f7cfed9d640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7cec0b3d40 0x7f7cec0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.266+0000 7f7cf7fff640 1 -- 172.21.15.47:0/3615053678 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f7cf0104a70 con 0x7f7d00103460 2024-07-24T22:07:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.266+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/2814381178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 0x5639ee2a41e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0102130 tx=0x7f7cf00c7d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c67ef26656c336b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.266+0000 7f7cf4d99640 1 -- 172.21.15.47:0/2814381178 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0049020 con 0x5639ee2adc20 2024-07-24T22:07:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.266+0000 7f7cf4d99640 1 -- 172.21.15.47:0/2814381178 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cf00cb190 con 0x5639ee2adc20 2024-07-24T22:07:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.266+0000 7f7cf4d99640 1 -- 172.21.15.47:0/2814381178 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00cafd0 con 0x5639ee2adc20 2024-07-24T22:07:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.267+0000 7f7d079d0740 1 -- 172.21.15.47:0/2814381178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 msgr2=0x5639ee2a41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.267+0000 7f7cfed9d640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7cec0b3d40 0x7f7cec0b6200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8008dc0 tx=0x7f7cf8008570 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.267+0000 7f7d079d0740 1 --2- 172.21.15.47:0/2814381178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 0x5639ee2a41e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0102130 tx=0x7f7cf00c7d90 comp rx=0 tx=0).stop 2024-07-24T22:07:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.267+0000 7f7d079d0740 1 -- 172.21.15.47:0/2814381178 shutdown_connections 2024-07-24T22:07:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.267+0000 7f7d079d0740 1 --2- 172.21.15.47:0/2814381178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2b8820 0x5639ee2bac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.267+0000 7f7d079d0740 1 --2- 172.21.15.47:0/2814381178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 0x5639ee2a41e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.267+0000 7f7d079d0740 1 --2- 172.21.15.47:0/2814381178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2a38c0 0x5639ee2a3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.267+0000 7f7d079d0740 1 -- 172.21.15.47:0/2814381178 >> 172.21.15.47:0/2814381178 conn(0x5639ee2a16f0 msgr2=0x5639ee2a2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.267+0000 7f7d079d0740 1 -- 172.21.15.47:0/2814381178 shutdown_connections 2024-07-24T22:07:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.267+0000 7f7d079d0740 1 -- 172.21.15.47:0/2814381178 wait complete. 2024-07-24T22:07:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.267+0000 7f7d079d0740 1 -- start start 2024-07-24T22:07:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7d079d0740 1 Processor -- start 2024-07-24T22:07:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7d079d0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2a38c0 0x5639ee2ad390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7d079d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2adc20 0x5639ee2aa870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7d079d0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 0x5639ee2aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7d079d0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5639ee142ab0 con 0x5639ee2b8820 2024-07-24T22:07:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7d079d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5639ee1909e0 con 0x5639ee2adc20 2024-07-24T22:07:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7d079d0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5639ee2bb420 con 0x5639ee2a38c0 2024-07-24T22:07:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7d079d0740 10 client.0 _ll_register_callbacks cb 0x5639edf18a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7cfed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 0x5639ee2aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7cfed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 0x5639ee2aadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43920/0 (socket says 172.21.15.47:43920) 2024-07-24T22:07:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7cfed9d640 1 -- 172.21.15.47:0/485919594 learned_addr learned my addr 172.21.15.47:0/485919594 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/485919594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2a38c0 0x5639ee2ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7cf5d9b640 1 --2- 172.21.15.47:0/485919594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2adc20 0x5639ee2aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7cfed9d640 1 -- 172.21.15.47:0/485919594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2a38c0 msgr2=0x5639ee2ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7cfed9d640 1 --2- 172.21.15.47:0/485919594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2a38c0 0x5639ee2ad390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7cfed9d640 1 -- 172.21.15.47:0/485919594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2adc20 msgr2=0x5639ee2aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7cfed9d640 1 --2- 172.21.15.47:0/485919594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2adc20 0x5639ee2aa870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.268+0000 7f7cfed9d640 1 -- 172.21.15.47:0/485919594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639edfe5620 con 0x5639ee2b8820 2024-07-24T22:07:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7cfed9d640 1 --2- 172.21.15.47:0/485919594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 0x5639ee2aadb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800edb0 tx=0x7f7cf8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fcd577fa5474bf server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7ce5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7ce5ffb640 1 -- 172.21.15.47:0/485919594 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf801cd30 con 0x5639ee2b8820 2024-07-24T22:07:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7ce5ffb640 1 -- 172.21.15.47:0/485919594 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f7cf8027430 con 0x5639ee2b8820 2024-07-24T22:07:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7d079d0740 1 -- 172.21.15.47:0/485919594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5639ee1b7ce0 con 0x5639ee2b8820 2024-07-24T22:07:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7ce5ffb640 1 -- 172.21.15.47:0/485919594 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7cf8008a10 con 0x5639ee2b8820 2024-07-24T22:07:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7d079d0740 10 client.15531 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7d079d0740 1 -- 172.21.15.47:0/485919594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5639ee2c6bb0 con 0x5639ee2b8820 2024-07-24T22:07:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7ce5ffb640 1 -- 172.21.15.47:0/485919594 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5639ee1b7ce0 con 0x5639ee2b8820 2024-07-24T22:07:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7ce5ffb640 1 -- 172.21.15.47:0/485919594 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7cf801d480 con 0x5639ee2b8820 2024-07-24T22:07:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7d079d0740 10 client.15531 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7d079d0740 10 client.15531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7d079d0740 20 client.15531 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7d079d0740 1 --2- 172.21.15.47:0/485919594 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5639ee2c8070 0x5639ee2ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7d079d0740 4 client.15531 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:07:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.269+0000 7f7d079d0740 1 -- 172.21.15.47:0/485919594 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639ee21b1d0 con 0x5639ee2c8070 2024-07-24T22:07:35.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.270+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/485919594 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5639ee2c8070 0x5639ee2ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.270+0000 7f7ce5ffb640 10 client.15531 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.270+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/485919594 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5639ee2c8070 0x5639ee2ca4d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d31fa259373c236c server_cookie=9c15c2be40f43237 in_seq=0 out_seq=0 2024-07-24T22:07:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7ce5ffb640 1 -- 172.21.15.47:0/485919594 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5639ee21b1d0 con 0x5639ee2c8070 2024-07-24T22:07:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7ce5ffb640 10 client.15531 handle_command_reply: tid=0 2024-07-24T22:07:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7d079d0740 1 client.15531 shutdown 2024-07-24T22:07:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7d079d0740 1 -- 172.21.15.47:0/485919594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 msgr2=0x5639ee2aadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7d079d0740 1 --2- 172.21.15.47:0/485919594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 0x5639ee2aadb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800edb0 tx=0x7f7cf8004a40 comp rx=0 tx=0).stop 2024-07-24T22:07:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7d079d0740 1 -- 172.21.15.47:0/485919594 shutdown_connections 2024-07-24T22:07:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7d079d0740 1 --2- 172.21.15.47:0/485919594 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5639ee2c8070 0x5639ee2ca4d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7d079d0740 1 --2- 172.21.15.47:0/485919594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 0x5639ee2aadb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7d079d0740 1 --2- 172.21.15.47:0/485919594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2adc20 0x5639ee2aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7ce5ffb640 0 client.15531 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7d079d0740 1 --2- 172.21.15.47:0/485919594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2a38c0 0x5639ee2ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7d079d0740 1 -- 172.21.15.47:0/485919594 >> 172.21.15.47:0/485919594 conn(0x5639ee2a16f0 msgr2=0x5639ee2a6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7d079d0740 1 -- 172.21.15.47:0/485919594 shutdown_connections 2024-07-24T22:07:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7d079d0740 1 -- 172.21.15.47:0/485919594 wait complete. 2024-07-24T22:07:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.271+0000 7f7d079d0740 20 client.15531 trim_cache size 0 max 16384 2024-07-24T22:07:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.286+0000 7f7d079d0740 1 Processor -- start 2024-07-24T22:07:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.286+0000 7f7d079d0740 1 -- start start 2024-07-24T22:07:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.286+0000 7f7d079d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2a38c0 0x5639ee2a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.286+0000 7f7d079d0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2adc20 0x5639ee2c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.286+0000 7f7d079d0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 0x5639ee2a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.286+0000 7f7d079d0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d001a9ed0 con 0x5639ee2b8820 2024-07-24T22:07:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.286+0000 7f7d079d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7d001ac730 con 0x5639ee2a38c0 2024-07-24T22:07:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.286+0000 7f7d079d0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7d001aa520 con 0x5639ee2adc20 2024-07-24T22:07:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7cfed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 0x5639ee2a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7cfed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 0x5639ee2a7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43924/0 (socket says 172.21.15.47:43924) 2024-07-24T22:07:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7cfed9d640 1 -- 172.21.15.47:0/3355186685 learned_addr learned my addr 172.21.15.47:0/3355186685 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/3355186685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2a38c0 0x5639ee2a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7cfed9d640 1 -- 172.21.15.47:0/3355186685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2adc20 msgr2=0x5639ee2c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7cf5d9b640 1 --2- 172.21.15.47:0/3355186685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2adc20 0x5639ee2c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7cfed9d640 1 --2- 172.21.15.47:0/3355186685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2adc20 0x5639ee2c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7cfed9d640 1 -- 172.21.15.47:0/3355186685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2a38c0 msgr2=0x5639ee2a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7cfed9d640 1 --2- 172.21.15.47:0/3355186685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2a38c0 0x5639ee2a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7cfed9d640 1 -- 172.21.15.47:0/3355186685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ee2aa5f0 con 0x5639ee2b8820 2024-07-24T22:07:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7cf5d9b640 1 --2- 172.21.15.47:0/3355186685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2adc20 0x5639ee2c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/3355186685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2a38c0 0x5639ee2a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7cfed9d640 1 --2- 172.21.15.47:0/3355186685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 0x5639ee2a7be0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8016040 tx=0x7f7cf8008c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f52791981f3775 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7ce7fff640 1 -- 172.21.15.47:0/3355186685 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf801d610 con 0x5639ee2b8820 2024-07-24T22:07:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7ce7fff640 1 -- 172.21.15.47:0/3355186685 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cf801da40 con 0x5639ee2b8820 2024-07-24T22:07:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.287+0000 7f7ce7fff640 1 -- 172.21.15.47:0/3355186685 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8005330 con 0x5639ee2b8820 2024-07-24T22:07:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.288+0000 7f7d079d0740 1 -- 172.21.15.47:0/3355186685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 msgr2=0x5639ee2a7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.288+0000 7f7d079d0740 1 --2- 172.21.15.47:0/3355186685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 0x5639ee2a7be0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8016040 tx=0x7f7cf8008c30 comp rx=0 tx=0).stop 2024-07-24T22:07:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.288+0000 7f7d079d0740 1 -- 172.21.15.47:0/3355186685 shutdown_connections 2024-07-24T22:07:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.288+0000 7f7d079d0740 1 --2- 172.21.15.47:0/3355186685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2b8820 0x5639ee2a7be0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.288+0000 7f7d079d0740 1 --2- 172.21.15.47:0/3355186685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2adc20 0x5639ee2c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.288+0000 7f7d079d0740 1 --2- 172.21.15.47:0/3355186685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2a38c0 0x5639ee2a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.288+0000 7f7d079d0740 1 -- 172.21.15.47:0/3355186685 >> 172.21.15.47:0/3355186685 conn(0x5639ee2a16f0 msgr2=0x5639ee2a3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.288+0000 7f7d079d0740 1 -- 172.21.15.47:0/3355186685 shutdown_connections 2024-07-24T22:07:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.288+0000 7f7d079d0740 1 -- 172.21.15.47:0/3355186685 wait complete. 2024-07-24T22:07:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.288+0000 7f7d079d0740 1 -- start start 2024-07-24T22:07:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.288+0000 7f7d079d0740 1 Processor -- start 2024-07-24T22:07:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.288+0000 7f7d079d0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2a38c0 0x5639ee2c0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.288+0000 7f7d079d0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 0x5639ee2c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7d079d0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2b8820 0x5639ee2cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7d079d0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d001aabf0 con 0x5639ee2adc20 2024-07-24T22:07:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7d079d0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7d001ac060 con 0x5639ee2a38c0 2024-07-24T22:07:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7d079d0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7d001ab2c0 con 0x5639ee2b8820 2024-07-24T22:07:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7d079d0740 10 client.0 _ll_register_callbacks cb 0x7f7cf8008eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7cf5d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 0x5639ee2c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7cf5d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 0x5639ee2c0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43928/0 (socket says 172.21.15.47:43928) 2024-07-24T22:07:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7cf5d9b640 1 -- 172.21.15.47:0/2312080958 learned_addr learned my addr 172.21.15.47:0/2312080958 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7cfed9d640 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2b8820 0x5639ee2cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2a38c0 0x5639ee2c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7cf5d9b640 1 -- 172.21.15.47:0/2312080958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2b8820 msgr2=0x5639ee2cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7cf5d9b640 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2b8820 0x5639ee2cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7cf5d9b640 1 -- 172.21.15.47:0/2312080958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2a38c0 msgr2=0x5639ee2c0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7cf5d9b640 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2a38c0 0x5639ee2c0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7cf5d9b640 1 -- 172.21.15.47:0/2312080958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639ee2cf380 con 0x5639ee2adc20 2024-07-24T22:07:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2a38c0 0x5639ee2c0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7cf5d9b640 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 0x5639ee2c0a40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8013840 tx=0x7f7ce8013d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc85a0d05fef02ee server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7ce5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7ce5ffb640 1 -- 172.21.15.47:0/2312080958 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8011940 con 0x5639ee2adc20 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7ce5ffb640 1 -- 172.21.15.47:0/2312080958 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f7ce8011ae0 con 0x5639ee2adc20 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7d079d0740 1 -- 172.21.15.47:0/2312080958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cf801da40 con 0x5639ee2adc20 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7ce5ffb640 1 -- 172.21.15.47:0/2312080958 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7ce8011ce0 con 0x5639ee2adc20 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7d079d0740 10 client.15537 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.289+0000 7f7d079d0740 1 -- 172.21.15.47:0/2312080958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5639ee332460 con 0x5639ee2adc20 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.290+0000 7f7ce5ffb640 1 -- 172.21.15.47:0/2312080958 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cf801da40 con 0x5639ee2adc20 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.290+0000 7f7ce5ffb640 1 -- 172.21.15.47:0/2312080958 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7ce801a070 con 0x5639ee2adc20 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.290+0000 7f7d079d0740 10 client.15537 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.290+0000 7f7d079d0740 10 client.15537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.290+0000 7f7d079d0740 20 client.15537 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.290+0000 7f7d079d0740 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5639ee332c90 0x5639ee3350b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.290+0000 7f7d079d0740 4 client.15537 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.290+0000 7f7d079d0740 1 -- 172.21.15.47:0/2312080958 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5639ee216c70 con 0x5639ee332c90 2024-07-24T22:07:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.290+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5639ee332c90 0x5639ee3350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:35.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.290+0000 7f7ce5ffb640 10 client.15537 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:35.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.290+0000 7f7cfe59c640 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5639ee332c90 0x5639ee3350b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7fc4e2e8af3d2fa server_cookie=9beaba61af3c71ce in_seq=0 out_seq=0 2024-07-24T22:07:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7ce5ffb640 1 -- 172.21.15.47:0/2312080958 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5639ee216c70 con 0x5639ee332c90 2024-07-24T22:07:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7ce5ffb640 10 client.15537 handle_command_reply: tid=0 2024-07-24T22:07:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7d079d0740 1 client.15537 shutdown 2024-07-24T22:07:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7d079d0740 1 -- 172.21.15.47:0/2312080958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 msgr2=0x5639ee2c0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7d079d0740 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 0x5639ee2c0a40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8013840 tx=0x7f7ce8013d00 comp rx=0 tx=0).stop 2024-07-24T22:07:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7d079d0740 1 -- 172.21.15.47:0/2312080958 shutdown_connections 2024-07-24T22:07:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7d079d0740 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5639ee332c90 0x5639ee3350b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7d079d0740 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5639ee2b8820 0x5639ee2cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7ce5ffb640 0 client.15537 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7d079d0740 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639ee2adc20 0x5639ee2c0a40 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7d079d0740 1 --2- 172.21.15.47:0/2312080958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5639ee2a38c0 0x5639ee2c0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7d079d0740 1 -- 172.21.15.47:0/2312080958 >> 172.21.15.47:0/2312080958 conn(0x5639ee2a16f0 msgr2=0x5639ee2a6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7d079d0740 1 -- 172.21.15.47:0/2312080958 shutdown_connections 2024-07-24T22:07:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7d079d0740 1 -- 172.21.15.47:0/2312080958 wait complete. 2024-07-24T22:07:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.298+0000 7f7d079d0740 20 client.15537 trim_cache size 0 max 16384 2024-07-24T22:07:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:07:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:07:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:07:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:07:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.299+0000 7f7d04ba6640 1 -- 172.21.15.47:0/3615053678 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7cec0b3d40 msgr2=0x7f7cec0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.299+0000 7f7d04ba6640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7cec0b3d40 0x7f7cec0b6200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8008dc0 tx=0x7f7cf8008570 comp rx=0 tx=0).stop 2024-07-24T22:07:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.299+0000 7f7d04ba6640 1 -- 172.21.15.47:0/3615053678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d00103460 msgr2=0x7f7d00198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.299+0000 7f7d04ba6640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d00103460 0x7f7d00198be0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0006010 tx=0x7f7cf00042f0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.299+0000 7f7d04ba6640 1 -- 172.21.15.47:0/3615053678 shutdown_connections 2024-07-24T22:07:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.299+0000 7f7d04ba6640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7cec0b3d40 0x7f7cec0b6200 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.299+0000 7f7d04ba6640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d0010ca10 0x7f7d0019e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.299+0000 7f7d04ba6640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d00103e60 0x7f7d00199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.299+0000 7f7d04ba6640 1 --2- 172.21.15.47:0/3615053678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d00103460 0x7f7d00198be0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.299+0000 7f7d04ba6640 1 -- 172.21.15.47:0/3615053678 >> 172.21.15.47:0/3615053678 conn(0x7f7d000fd030 msgr2=0x7f7d0010ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.299+0000 7f7d04ba6640 1 -- 172.21.15.47:0/3615053678 shutdown_connections 2024-07-24T22:07:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:35.299+0000 7f7d04ba6640 1 -- 172.21.15.47:0/3615053678 wait complete. 2024-07-24T22:07:35.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:35 smithi047 ceph-mon[32551]: pgmap v377: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1023 B/s wr, 2 op/s 2024-07-24T22:07:35.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:35 smithi183 ceph-mon[37007]: pgmap v377: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1023 B/s wr, 2 op/s 2024-07-24T22:07:35.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:35 smithi188 ceph-mon[37380]: pgmap v377: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1023 B/s wr, 2 op/s 2024-07-24T22:07:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.097+0000 7fb92c1e9640 1 -- 172.21.15.47:0/3700298806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb92410cae0 msgr2=0x7fb92410ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.097+0000 7fb92c1e9640 1 --2- 172.21.15.47:0/3700298806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb92410cae0 0x7fb92410ef10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009900 tx=0x7fb91c02a410 comp rx=0 tx=0).stop 2024-07-24T22:07:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.097+0000 7fb92c1e9640 1 -- 172.21.15.47:0/3700298806 shutdown_connections 2024-07-24T22:07:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.097+0000 7fb92c1e9640 1 --2- 172.21.15.47:0/3700298806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb92410cae0 0x7fb92410ef10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.097+0000 7fb92c1e9640 1 --2- 172.21.15.47:0/3700298806 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb924103f30 0x7fb92410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.097+0000 7fb92c1e9640 1 --2- 172.21.15.47:0/3700298806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb924103530 0x7fb924103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.097+0000 7fb92c1e9640 1 -- 172.21.15.47:0/3700298806 >> 172.21.15.47:0/3700298806 conn(0x7fb9240fd0c0 msgr2=0x7fb9240ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.097+0000 7fb92c1e9640 1 -- 172.21.15.47:0/3700298806 shutdown_connections 2024-07-24T22:07:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.097+0000 7fb92c1e9640 1 -- 172.21.15.47:0/3700298806 wait complete. 2024-07-24T22:07:36.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb92c1e9640 1 Processor -- start 2024-07-24T22:07:36.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb92c1e9640 1 -- start start 2024-07-24T22:07:36.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb92c1e9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb924103530 0x7fb924198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb92c1e9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb924103f30 0x7fb924199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb92c1e9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb92410cae0 0x7fb92419e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb92c1e9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb924112710 con 0x7fb924103530 2024-07-24T22:07:36.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb92c1e9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb924112590 con 0x7fb92410cae0 2024-07-24T22:07:36.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb92c1e9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb924112890 con 0x7fb924103f30 2024-07-24T22:07:36.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb929f85640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb924103530 0x7fb924198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb929f85640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb924103530 0x7fb924198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43944/0 (socket says 172.21.15.47:43944) 2024-07-24T22:07:36.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb929f85640 1 -- 172.21.15.47:0/2703060837 learned_addr learned my addr 172.21.15.47:0/2703060837 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:36.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb92a786640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb92410cae0 0x7fb92419e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb929784640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb924103f30 0x7fb924199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb929f85640 1 -- 172.21.15.47:0/2703060837 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb924103f30 msgr2=0x7fb924199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:36.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb929f85640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb924103f30 0x7fb924199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb929f85640 1 -- 172.21.15.47:0/2703060837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb92410cae0 msgr2=0x7fb92419e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:36.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb929f85640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb92410cae0 0x7fb92419e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.098+0000 7fb929f85640 1 -- 172.21.15.47:0/2703060837 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92419ec70 con 0x7fb924103530 2024-07-24T22:07:36.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.099+0000 7fb929f85640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb924103530 0x7fb924198bc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb91400eab0 tx=0x7fb91400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:36.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.099+0000 7fb922ffd640 1 -- 172.21.15.47:0/2703060837 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91400ce40 con 0x7fb924103530 2024-07-24T22:07:36.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.099+0000 7fb922ffd640 1 -- 172.21.15.47:0/2703060837 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb914011920 con 0x7fb924103530 2024-07-24T22:07:36.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.099+0000 7fb92c1e9640 1 -- 172.21.15.47:0/2703060837 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92419ef60 con 0x7fb924103530 2024-07-24T22:07:36.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.099+0000 7fb922ffd640 1 -- 172.21.15.47:0/2703060837 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914010a30 con 0x7fb924103530 2024-07-24T22:07:36.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.099+0000 7fb92c1e9640 1 -- 172.21.15.47:0/2703060837 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9241a57f0 con 0x7fb924103530 2024-07-24T22:07:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.101+0000 7fb922ffd640 1 -- 172.21.15.47:0/2703060837 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fb914010bd0 con 0x7fb924103530 2024-07-24T22:07:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.102+0000 7fb92e59a740 1 Processor -- start 2024-07-24T22:07:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.102+0000 7fb92e59a740 1 -- start start 2024-07-24T22:07:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.102+0000 7fb922ffd640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb90c0b3dc0 0x7fb90c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.102+0000 7fb92e59a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a334fc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.102+0000 7fb92e59a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a33508290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.102+0000 7fb92e59a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 0x558a3350abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.102+0000 7fb92e59a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558a334739f0 con 0x558a334fbf20 2024-07-24T22:07:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.102+0000 7fb92e59a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558a33462ef0 con 0x558a335087d0 2024-07-24T22:07:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.102+0000 7fb92e59a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558a33466f30 con 0x558a334fc840 2024-07-24T22:07:36.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb92a786640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb90c0b3dc0 0x7fb90c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb922ffd640 1 -- 172.21.15.47:0/2703060837 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb9140e4570 con 0x7fb924103530 2024-07-24T22:07:36.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb929784640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a33508290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb929f85640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a334fc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb929784640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a33508290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:59578/0 (socket says 172.21.15.47:59578) 2024-07-24T22:07:36.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb929784640 1 -- 172.21.15.47:0/1493888042 learned_addr learned my addr 172.21.15.47:0/1493888042 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:36.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb92a786640 1 --2- 172.21.15.47:0/1493888042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 0x558a3350abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb929784640 1 -- 172.21.15.47:0/1493888042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 msgr2=0x558a3350abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb929784640 1 --2- 172.21.15.47:0/1493888042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 0x558a3350abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb929784640 1 -- 172.21.15.47:0/1493888042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 msgr2=0x558a334fc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb929784640 1 --2- 172.21.15.47:0/1493888042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a334fc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb929784640 1 -- 172.21.15.47:0/1493888042 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a331c3930 con 0x558a334fc840 2024-07-24T22:07:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb929f85640 1 --2- 172.21.15.47:0/1493888042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a334fc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:07:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.103+0000 7fb92a786640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb90c0b3dc0 0x7fb90c0b6280 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb91c006010 tx=0x7fb91c032b80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.104+0000 7fb929784640 1 --2- 172.21.15.47:0/1493888042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a33508290 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb91800b740 tx=0x7fb91800bc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd09edb9598806ee server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.104+0000 7fb90bfff640 1 -- 172.21.15.47:0/1493888042 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918003dd0 con 0x558a334fc840 2024-07-24T22:07:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.104+0000 7fb90bfff640 1 -- 172.21.15.47:0/1493888042 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb918015070 con 0x558a334fc840 2024-07-24T22:07:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.104+0000 7fb90bfff640 1 -- 172.21.15.47:0/1493888042 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918004dd0 con 0x558a334fc840 2024-07-24T22:07:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.105+0000 7fb92e59a740 1 -- 172.21.15.47:0/1493888042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 msgr2=0x558a33508290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.105+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1493888042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a33508290 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb91800b740 tx=0x7fb91800bc00 comp rx=0 tx=0).stop 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.105+0000 7fb92e59a740 1 -- 172.21.15.47:0/1493888042 shutdown_connections 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.105+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1493888042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 0x558a3350abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.105+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1493888042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a33508290 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.105+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1493888042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a334fc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.105+0000 7fb92e59a740 1 -- 172.21.15.47:0/1493888042 >> 172.21.15.47:0/1493888042 conn(0x558a334f9d50 msgr2=0x558a334faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.105+0000 7fb92e59a740 1 -- 172.21.15.47:0/1493888042 shutdown_connections 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.105+0000 7fb92e59a740 1 -- 172.21.15.47:0/1493888042 wait complete. 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.105+0000 7fb92e59a740 1 -- start start 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.105+0000 7fb92e59a740 1 Processor -- start 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb92e59a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a33505700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb92e59a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a33505c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb92e59a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 0x558a33506180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb92e59a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558a332c6890 con 0x558a334fbf20 2024-07-24T22:07:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb92e59a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558a33405390 con 0x558a335087d0 2024-07-24T22:07:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb92e59a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558a3350b450 con 0x558a334fc840 2024-07-24T22:07:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb92e59a740 10 client.0 _ll_register_callbacks cb 0x558a3340f500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb929f85640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a33505700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb929f85640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a33505700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43970/0 (socket says 172.21.15.47:43970) 2024-07-24T22:07:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb929f85640 1 -- 172.21.15.47:0/1743203214 learned_addr learned my addr 172.21.15.47:0/1743203214 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb929784640 1 --2- 172.21.15.47:0/1743203214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a33505c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb92a786640 1 --2- 172.21.15.47:0/1743203214 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 0x558a33506180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb929f85640 1 -- 172.21.15.47:0/1743203214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 msgr2=0x558a33505c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:36.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb929f85640 1 --2- 172.21.15.47:0/1743203214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a33505c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb929f85640 1 -- 172.21.15.47:0/1743203214 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 msgr2=0x558a33506180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb929f85640 1 --2- 172.21.15.47:0/1743203214 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 0x558a33506180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb929f85640 1 -- 172.21.15.47:0/1743203214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a333ffd60 con 0x558a334fbf20 2024-07-24T22:07:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb929f85640 1 --2- 172.21.15.47:0/1743203214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a33505700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb9140e1cc0 tx=0x7fb9140beb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e0e6915102ed1 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.106+0000 7fb9097fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb9097fa640 1 -- 172.21.15.47:0/1743203214 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140ab120 con 0x558a334fbf20 2024-07-24T22:07:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb9097fa640 1 -- 172.21.15.47:0/1743203214 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb914011ad0 con 0x558a334fbf20 2024-07-24T22:07:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb92e59a740 1 -- 172.21.15.47:0/1743203214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb918015070 con 0x558a334fbf20 2024-07-24T22:07:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb9097fa640 1 -- 172.21.15.47:0/1743203214 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb9140af720 con 0x558a334fbf20 2024-07-24T22:07:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb92e59a740 10 client.15549 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb92e59a740 1 -- 172.21.15.47:0/1743203214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558a33517390 con 0x558a334fbf20 2024-07-24T22:07:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb9097fa640 1 -- 172.21.15.47:0/1743203214 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb918015070 con 0x558a334fbf20 2024-07-24T22:07:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb9097fa640 1 -- 172.21.15.47:0/1743203214 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb91400f040 con 0x558a334fbf20 2024-07-24T22:07:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb92e59a740 10 client.15549 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb92e59a740 10 client.15549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb92e59a740 20 client.15549 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1743203214 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558a335187a0 0x558a3351ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb92e59a740 4 client.15549 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:07:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.107+0000 7fb92e59a740 1 -- 172.21.15.47:0/1743203214 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a33475940 con 0x558a335187a0 2024-07-24T22:07:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.108+0000 7fb929784640 1 --2- 172.21.15.47:0/1743203214 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558a335187a0 0x558a3351ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.108+0000 7fb929784640 1 --2- 172.21.15.47:0/1743203214 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558a335187a0 0x558a3351ab90 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39921cc0e8f3d124 server_cookie=aeeff86f5d819f5d in_seq=0 out_seq=0 2024-07-24T22:07:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.108+0000 7fb9097fa640 10 client.15549 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb9097fa640 1 -- 172.21.15.47:0/1743203214 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a33475940 con 0x558a335187a0 2024-07-24T22:07:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb9097fa640 10 client.15549 handle_command_reply: tid=0 2024-07-24T22:07:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb92e59a740 1 client.15549 shutdown 2024-07-24T22:07:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb92e59a740 1 -- 172.21.15.47:0/1743203214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 msgr2=0x558a33505700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1743203214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a33505700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb9140e1cc0 tx=0x7fb9140beb30 comp rx=0 tx=0).stop 2024-07-24T22:07:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb92e59a740 1 -- 172.21.15.47:0/1743203214 shutdown_connections 2024-07-24T22:07:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1743203214 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558a335187a0 0x558a3351ab90 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1743203214 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 0x558a33506180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1743203214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a33505c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1743203214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a33505700 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb9097fa640 0 client.15549 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:36.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb92e59a740 1 -- 172.21.15.47:0/1743203214 >> 172.21.15.47:0/1743203214 conn(0x558a334f9d50 msgr2=0x558a334ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:36.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb92e59a740 1 -- 172.21.15.47:0/1743203214 shutdown_connections 2024-07-24T22:07:36.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb92e59a740 1 -- 172.21.15.47:0/1743203214 wait complete. 2024-07-24T22:07:36.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.109+0000 7fb92e59a740 20 client.15549 trim_cache size 0 max 16384 2024-07-24T22:07:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb92e59a740 1 Processor -- start 2024-07-24T22:07:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb92e59a740 1 -- start start 2024-07-24T22:07:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb92e59a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a334fb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb92e59a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a335203c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb92e59a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 0x558a33520900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb92e59a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb9241ac040 con 0x558a334fbf20 2024-07-24T22:07:36.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb92e59a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb9241ae8c0 con 0x558a335087d0 2024-07-24T22:07:36.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb92e59a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb9241ac6b0 con 0x558a334fc840 2024-07-24T22:07:36.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb929f85640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a334fb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb929f85640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a334fb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43976/0 (socket says 172.21.15.47:43976) 2024-07-24T22:07:36.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb929f85640 1 -- 172.21.15.47:0/1882591981 learned_addr learned my addr 172.21.15.47:0/1882591981 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:36.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb929784640 1 --2- 172.21.15.47:0/1882591981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a335203c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb92a786640 1 --2- 172.21.15.47:0/1882591981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 0x558a33520900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb929f85640 1 -- 172.21.15.47:0/1882591981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 msgr2=0x558a335203c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:36.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb929f85640 1 --2- 172.21.15.47:0/1882591981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a335203c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb929f85640 1 -- 172.21.15.47:0/1882591981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 msgr2=0x558a33520900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:36.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb929f85640 1 --2- 172.21.15.47:0/1882591981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 0x558a33520900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb929f85640 1 -- 172.21.15.47:0/1882591981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a33500470 con 0x558a334fbf20 2024-07-24T22:07:36.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb929784640 1 --2- 172.21.15.47:0/1882591981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a335203c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:36.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.128+0000 7fb92a786640 1 --2- 172.21.15.47:0/1882591981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 0x558a33520900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:36.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.129+0000 7fb929f85640 1 --2- 172.21.15.47:0/1882591981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a334fb3e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb9140a71a0 tx=0x7fb914000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede514f97df782c7 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:36.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.129+0000 7fb90b7fe640 1 -- 172.21.15.47:0/1882591981 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140a6fe0 con 0x558a334fbf20 2024-07-24T22:07:36.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.129+0000 7fb90b7fe640 1 -- 172.21.15.47:0/1882591981 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9140be890 con 0x558a334fbf20 2024-07-24T22:07:36.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.129+0000 7fb90b7fe640 1 -- 172.21.15.47:0/1882591981 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140bbaf0 con 0x558a334fbf20 2024-07-24T22:07:36.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 -- 172.21.15.47:0/1882591981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 msgr2=0x558a334fb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:36.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1882591981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a334fb3e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb9140a71a0 tx=0x7fb914000f40 comp rx=0 tx=0).stop 2024-07-24T22:07:36.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 -- 172.21.15.47:0/1882591981 shutdown_connections 2024-07-24T22:07:36.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1882591981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a335087d0 0x558a33520900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1882591981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a335203c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 --2- 172.21.15.47:0/1882591981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a334fbf20 0x558a334fb3e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 -- 172.21.15.47:0/1882591981 >> 172.21.15.47:0/1882591981 conn(0x558a334f9d50 msgr2=0x558a33507550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 -- 172.21.15.47:0/1882591981 shutdown_connections 2024-07-24T22:07:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 -- 172.21.15.47:0/1882591981 wait complete. 2024-07-24T22:07:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 -- start start 2024-07-24T22:07:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 Processor -- start 2024-07-24T22:07:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a334fbf20 0x558a3350c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a3350cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a335087d0 0x558a3350d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb9241acd80 con 0x558a335087d0 2024-07-24T22:07:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb9241ae1f0 con 0x558a334fbf20 2024-07-24T22:07:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.130+0000 7fb92e59a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb9241ad450 con 0x558a334fc840 2024-07-24T22:07:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb92e59a740 10 client.0 _ll_register_callbacks cb 0x7fb9140becb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb92a786640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a335087d0 0x558a3350d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb92a786640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a335087d0 0x558a3350d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43986/0 (socket says 172.21.15.47:43986) 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb92a786640 1 -- 172.21.15.47:0/3885308273 learned_addr learned my addr 172.21.15.47:0/3885308273 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb929f85640 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a334fbf20 0x558a3350c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb929784640 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a3350cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb92a786640 1 -- 172.21.15.47:0/3885308273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 msgr2=0x558a3350cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb92a786640 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a3350cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb92a786640 1 -- 172.21.15.47:0/3885308273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a334fbf20 msgr2=0x558a3350c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb92a786640 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a334fbf20 0x558a3350c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb92a786640 1 -- 172.21.15.47:0/3885308273 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a33582680 con 0x558a335087d0 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb929784640 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a3350cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb929f85640 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a334fbf20 0x558a3350c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb92a786640 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a335087d0 0x558a3350d2b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb91c02a930 tx=0x7fb91c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebea91ac3a5ce3d8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb9097fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:36.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb9097fa640 1 -- 172.21.15.47:0/3885308273 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c035040 con 0x558a335087d0 2024-07-24T22:07:36.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb9097fa640 1 -- 172.21.15.47:0/3885308273 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb91c005040 con 0x558a335087d0 2024-07-24T22:07:36.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.131+0000 7fb92e59a740 1 -- 172.21.15.47:0/3885308273 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9140be890 con 0x558a335087d0 2024-07-24T22:07:36.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.132+0000 7fb9097fa640 1 -- 172.21.15.47:0/3885308273 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb91c005240 con 0x558a335087d0 2024-07-24T22:07:36.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.132+0000 7fb92e59a740 10 client.15555 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:36.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.132+0000 7fb92e59a740 1 -- 172.21.15.47:0/3885308273 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558a33583930 con 0x558a335087d0 2024-07-24T22:07:36.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.132+0000 7fb9097fa640 1 -- 172.21.15.47:0/3885308273 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9140be890 con 0x558a335087d0 2024-07-24T22:07:36.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.132+0000 7fb9097fa640 1 -- 172.21.15.47:0/3885308273 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb91c0035f0 con 0x558a335087d0 2024-07-24T22:07:36.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.132+0000 7fb92e59a740 10 client.15555 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:36.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.132+0000 7fb92e59a740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:36.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.132+0000 7fb92e59a740 20 client.15555 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:36.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.132+0000 7fb92e59a740 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558a335840e0 0x558a33586500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:36.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.132+0000 7fb92e59a740 4 client.15555 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:07:36.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.132+0000 7fb92e59a740 1 -- 172.21.15.47:0/3885308273 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558a334713e0 con 0x558a335840e0 2024-07-24T22:07:36.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.132+0000 7fb929f85640 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558a335840e0 0x558a33586500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:36.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.133+0000 7fb929f85640 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558a335840e0 0x558a33586500 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fe40c64ca449cbe server_cookie=7316b58be378dcc4 in_seq=0 out_seq=0 2024-07-24T22:07:36.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.133+0000 7fb9097fa640 10 client.15555 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:36.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb9097fa640 1 -- 172.21.15.47:0/3885308273 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558a334713e0 con 0x558a335840e0 2024-07-24T22:07:36.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb9097fa640 10 client.15555 handle_command_reply: tid=0 2024-07-24T22:07:36.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb92e59a740 1 client.15555 shutdown 2024-07-24T22:07:36.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb92e59a740 1 -- 172.21.15.47:0/3885308273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a335087d0 msgr2=0x558a3350d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:36.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb92e59a740 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a335087d0 0x558a3350d2b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb91c02a930 tx=0x7fb91c02a410 comp rx=0 tx=0).stop 2024-07-24T22:07:36.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb92e59a740 1 -- 172.21.15.47:0/3885308273 shutdown_connections 2024-07-24T22:07:36.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb92e59a740 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558a335840e0 0x558a33586500 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb92e59a740 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558a335087d0 0x558a3350d2b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb92e59a740 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558a334fc840 0x558a3350cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb92e59a740 1 --2- 172.21.15.47:0/3885308273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558a334fbf20 0x558a3350c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb92e59a740 1 -- 172.21.15.47:0/3885308273 >> 172.21.15.47:0/3885308273 conn(0x558a334f9d50 msgr2=0x558a334ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:36.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb9097fa640 0 client.15555 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:36.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb92e59a740 1 -- 172.21.15.47:0/3885308273 shutdown_connections 2024-07-24T22:07:36.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb92e59a740 1 -- 172.21.15.47:0/3885308273 wait complete. 2024-07-24T22:07:36.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.134+0000 7fb92e59a740 20 client.15555 trim_cache size 0 max 16384 2024-07-24T22:07:36.141 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:07:36.141 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:07:36.141 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "5a1a3c99-666f-4826-82bc-399b8656dae6", 2024-07-24T22:07:36.141 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:07:36.142 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:07:36.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.135+0000 7fb92c1e9640 1 -- 172.21.15.47:0/2703060837 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb90c0b3dc0 msgr2=0x7fb90c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:36.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.135+0000 7fb92c1e9640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb90c0b3dc0 0x7fb90c0b6280 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb91c006010 tx=0x7fb91c032b80 comp rx=0 tx=0).stop 2024-07-24T22:07:36.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.135+0000 7fb92c1e9640 1 -- 172.21.15.47:0/2703060837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb924103530 msgr2=0x7fb924198bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:36.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.135+0000 7fb92c1e9640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb924103530 0x7fb924198bc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb91400eab0 tx=0x7fb91400ef70 comp rx=0 tx=0).stop 2024-07-24T22:07:36.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.135+0000 7fb92c1e9640 1 -- 172.21.15.47:0/2703060837 shutdown_connections 2024-07-24T22:07:36.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.135+0000 7fb92c1e9640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb90c0b3dc0 0x7fb90c0b6280 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.135+0000 7fb92c1e9640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb92410cae0 0x7fb92419e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.135+0000 7fb92c1e9640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb924103f30 0x7fb924199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.135+0000 7fb92c1e9640 1 --2- 172.21.15.47:0/2703060837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb924103530 0x7fb924198bc0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:36.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.135+0000 7fb92c1e9640 1 -- 172.21.15.47:0/2703060837 >> 172.21.15.47:0/2703060837 conn(0x7fb9240fd0c0 msgr2=0x7fb92410ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:36.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.135+0000 7fb92c1e9640 1 -- 172.21.15.47:0/2703060837 shutdown_connections 2024-07-24T22:07:36.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:36.135+0000 7fb92c1e9640 1 -- 172.21.15.47:0/2703060837 wait complete. 2024-07-24T22:07:36.955 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:07:37.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.386+0000 7f08d9c68640 1 -- 172.21.15.47:0/2624018505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08d410cb00 msgr2=0x7f08d410ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:37.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.386+0000 7f08d9c68640 1 --2- 172.21.15.47:0/2624018505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08d410cb00 0x7f08d410ef60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009ca0 tx=0x7f08cc02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.386+0000 7f08d9c68640 1 -- 172.21.15.47:0/2624018505 shutdown_connections 2024-07-24T22:07:37.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.386+0000 7f08d9c68640 1 --2- 172.21.15.47:0/2624018505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08d410cb00 0x7f08d410ef60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.386+0000 7f08d9c68640 1 --2- 172.21.15.47:0/2624018505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08d4103fc0 0x7f08d410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.386+0000 7f08d9c68640 1 --2- 172.21.15.47:0/2624018505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08d41036a0 0x7f08d4103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.386+0000 7f08d9c68640 1 -- 172.21.15.47:0/2624018505 >> 172.21.15.47:0/2624018505 conn(0x7f08d40fd100 msgr2=0x7f08d40ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:37.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.386+0000 7f08d9c68640 1 -- 172.21.15.47:0/2624018505 shutdown_connections 2024-07-24T22:07:37.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.386+0000 7f08d9c68640 1 -- 172.21.15.47:0/2624018505 wait complete. 2024-07-24T22:07:37.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.387+0000 7f08d9c68640 1 Processor -- start 2024-07-24T22:07:37.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.387+0000 7f08d9c68640 1 -- start start 2024-07-24T22:07:37.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.387+0000 7f08d9c68640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08d41036a0 0x7f08d4101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.387+0000 7f08d9c68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08d4103fc0 0x7f08d4101890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.387+0000 7f08d9c68640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08d410cb00 0x7f08d4101dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.387+0000 7f08d9c68640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f08d4112750 con 0x7f08d4103fc0 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.387+0000 7f08d9c68640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f08d41125d0 con 0x7f08d41036a0 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.387+0000 7f08d9c68640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f08d41128d0 con 0x7f08d410cb00 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.387+0000 7f08d2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08d4103fc0 0x7f08d4101890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.387+0000 7f08d2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08d4103fc0 0x7f08d4101890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43990/0 (socket says 172.21.15.47:43990) 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.387+0000 7f08d2ffd640 1 -- 172.21.15.47:0/1346509087 learned_addr learned my addr 172.21.15.47:0/1346509087 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.387+0000 7f08d37fe640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08d41036a0 0x7f08d4101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.388+0000 7f08d3fff640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08d410cb00 0x7f08d4101dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.388+0000 7f08d2ffd640 1 -- 172.21.15.47:0/1346509087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08d410cb00 msgr2=0x7f08d4101dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.388+0000 7f08d2ffd640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08d410cb00 0x7f08d4101dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.388+0000 7f08d2ffd640 1 -- 172.21.15.47:0/1346509087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08d41036a0 msgr2=0x7f08d4101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.388+0000 7f08d2ffd640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08d41036a0 0x7f08d4101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.388+0000 7f08d2ffd640 1 -- 172.21.15.47:0/1346509087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d41a6fc0 con 0x7f08d4103fc0 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.388+0000 7f08d3fff640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08d410cb00 0x7f08d4101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.388+0000 7f08d2ffd640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08d4103fc0 0x7f08d4101890 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f08c800c970 tx=0x7f08c800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.388+0000 7f08d0ff9640 1 -- 172.21.15.47:0/1346509087 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c8007bb0 con 0x7f08d4103fc0 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.388+0000 7f08d0ff9640 1 -- 172.21.15.47:0/1346509087 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08c8007d50 con 0x7f08d4103fc0 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.388+0000 7f08d9c68640 1 -- 172.21.15.47:0/1346509087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d41a72b0 con 0x7f08d4103fc0 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.388+0000 7f08d0ff9640 1 -- 172.21.15.47:0/1346509087 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c800f7b0 con 0x7f08d4103fc0 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.388+0000 7f08d9c68640 1 -- 172.21.15.47:0/1346509087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d41a7840 con 0x7f08d4103fc0 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.391+0000 7f08dc019740 1 Processor -- start 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.391+0000 7f08d0ff9640 1 -- 172.21.15.47:0/1346509087 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f08c8018480 con 0x7f08d4103fc0 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.391+0000 7f08dc019740 1 -- start start 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.391+0000 7f08dc019740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 0x55afa51910e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.391+0000 7f08dc019740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 0x55afa5191a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.391+0000 7f08dc019740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa519d450 0x55afa519f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.391+0000 7f08dc019740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55afa5107740 con 0x55afa5192b80 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.391+0000 7f08dc019740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55afa50f6c40 con 0x55afa519d450 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.391+0000 7f08dc019740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55afa50fac80 con 0x55afa5191620 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.391+0000 7f08d3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 0x55afa51910e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.391+0000 7f08d3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 0x55afa51910e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43994/0 (socket says 172.21.15.47:43994) 2024-07-24T22:07:37.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.391+0000 7f08d3fff640 1 -- 172.21.15.47:0/3216216419 learned_addr learned my addr 172.21.15.47:0/3216216419 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:37.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08d2ffd640 1 --2- 172.21.15.47:0/3216216419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa519d450 0x55afa519f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08d37fe640 1 --2- 172.21.15.47:0/3216216419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 0x55afa5191a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08d3fff640 1 -- 172.21.15.47:0/3216216419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 msgr2=0x55afa5191a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:37.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08d3fff640 1 --2- 172.21.15.47:0/3216216419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 0x55afa5191a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08d3fff640 1 -- 172.21.15.47:0/3216216419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa519d450 msgr2=0x55afa519f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:37.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08d3fff640 1 --2- 172.21.15.47:0/3216216419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa519d450 0x55afa519f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08d3fff640 1 -- 172.21.15.47:0/3216216419 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afa50801f0 con 0x55afa5192b80 2024-07-24T22:07:37.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08d0ff9640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08bc0b3dc0 0x7f08bc0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08d37fe640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08bc0b3dc0 0x7f08bc0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08d0ff9640 1 -- 172.21.15.47:0/1346509087 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f08c80e42f0 con 0x7f08d4103fc0 2024-07-24T22:07:37.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08d3fff640 1 --2- 172.21.15.47:0/3216216419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 0x55afa51910e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f08cc006010 tx=0x7f08cc009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7575bdb5341e77c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:37.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08b9ffb640 1 -- 172.21.15.47:0/3216216419 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc031cf0 con 0x55afa5192b80 2024-07-24T22:07:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08b9ffb640 1 -- 172.21.15.47:0/3216216419 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08cc036070 con 0x55afa5192b80 2024-07-24T22:07:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.392+0000 7f08b9ffb640 1 -- 172.21.15.47:0/3216216419 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0042a0 con 0x55afa5192b80 2024-07-24T22:07:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.393+0000 7f08dc019740 1 -- 172.21.15.47:0/3216216419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 msgr2=0x55afa51910e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.393+0000 7f08dc019740 1 --2- 172.21.15.47:0/3216216419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 0x55afa51910e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f08cc006010 tx=0x7f08cc009800 comp rx=0 tx=0).stop 2024-07-24T22:07:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.393+0000 7f08d37fe640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08bc0b3dc0 0x7f08bc0b6280 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55afa5194260 tx=0x7f08c400b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.393+0000 7f08dc019740 1 -- 172.21.15.47:0/3216216419 shutdown_connections 2024-07-24T22:07:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.393+0000 7f08dc019740 1 --2- 172.21.15.47:0/3216216419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa519d450 0x55afa519f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.393+0000 7f08dc019740 1 --2- 172.21.15.47:0/3216216419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 0x55afa5191a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.393+0000 7f08dc019740 1 --2- 172.21.15.47:0/3216216419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 0x55afa51910e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.393+0000 7f08dc019740 1 -- 172.21.15.47:0/3216216419 >> 172.21.15.47:0/3216216419 conn(0x55afa512f6c0 msgr2=0x55afa518ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.393+0000 7f08dc019740 1 -- 172.21.15.47:0/3216216419 shutdown_connections 2024-07-24T22:07:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.393+0000 7f08dc019740 1 -- 172.21.15.47:0/3216216419 wait complete. 2024-07-24T22:07:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.393+0000 7f08dc019740 1 -- start start 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08dc019740 1 Processor -- start 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08dc019740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 0x55afa519cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08dc019740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa5192b80 0x55afa519a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08dc019740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa519d450 0x55afa519a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08dc019740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55afa4f5a5f0 con 0x55afa519d450 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08dc019740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55afa50994c0 con 0x55afa5192b80 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08dc019740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55afa51a0210 con 0x55afa5191620 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08dc019740 10 client.0 _ll_register_callbacks cb 0x55afa50ef0c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08d3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa519d450 0x55afa519a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08d3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa519d450 0x55afa519a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44006/0 (socket says 172.21.15.47:44006) 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08d3fff640 1 -- 172.21.15.47:0/2659043744 learned_addr learned my addr 172.21.15.47:0/2659043744 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08d2ffd640 1 --2- 172.21.15.47:0/2659043744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa5192b80 0x55afa519a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08d37fe640 1 --2- 172.21.15.47:0/2659043744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 0x55afa519cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08d3fff640 1 -- 172.21.15.47:0/2659043744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 msgr2=0x55afa519cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08d3fff640 1 --2- 172.21.15.47:0/2659043744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 0x55afa519cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08d3fff640 1 -- 172.21.15.47:0/2659043744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa5192b80 msgr2=0x55afa519a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:37.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08d3fff640 1 --2- 172.21.15.47:0/2659043744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa5192b80 0x55afa519a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.394+0000 7f08d3fff640 1 -- 172.21.15.47:0/2659043744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afa508c550 con 0x55afa519d450 2024-07-24T22:07:37.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08d3fff640 1 --2- 172.21.15.47:0/2659043744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa519d450 0x55afa519a5f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f08cc003d80 tx=0x7f08cc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab0ae90e06a7c32 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:37.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:37.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08b2ffd640 1 -- 172.21.15.47:0/2659043744 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc051020 con 0x55afa519d450 2024-07-24T22:07:37.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08b2ffd640 1 -- 172.21.15.47:0/2659043744 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f08cc031cf0 con 0x55afa519d450 2024-07-24T22:07:37.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08dc019740 1 -- 172.21.15.47:0/2659043744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08cc036070 con 0x55afa519d450 2024-07-24T22:07:37.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08b2ffd640 1 -- 172.21.15.47:0/2659043744 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f08cc05c050 con 0x55afa519d450 2024-07-24T22:07:37.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08dc019740 10 client.15567 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:37.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08dc019740 1 -- 172.21.15.47:0/2659043744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55afa4e57540 con 0x55afa519d450 2024-07-24T22:07:37.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08b2ffd640 1 -- 172.21.15.47:0/2659043744 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08cc036070 con 0x55afa519d450 2024-07-24T22:07:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08b2ffd640 1 -- 172.21.15.47:0/2659043744 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f08cc04c030 con 0x55afa519d450 2024-07-24T22:07:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08dc019740 10 client.15567 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08dc019740 10 client.15567 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-24T22:07:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08dc019740 20 client.15567 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.395+0000 7f08dc019740 1 --2- 172.21.15.47:0/2659043744 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55afa51ad9f0 0x55afa51aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.396+0000 7f08dc019740 4 client.15567 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:07:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.396+0000 7f08dc019740 1 -- 172.21.15.47:0/2659043744 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afa5109690 con 0x55afa51ad9f0 2024-07-24T22:07:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.396+0000 7f08d37fe640 1 --2- 172.21.15.47:0/2659043744 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55afa51ad9f0 0x55afa51aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.396+0000 7f08d37fe640 1 --2- 172.21.15.47:0/2659043744 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55afa51ad9f0 0x55afa51aee60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70bb6c74feaef4b3 server_cookie=44e853ffce2553a2 in_seq=0 out_seq=0 2024-07-24T22:07:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.396+0000 7f08b2ffd640 10 client.15567 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.397+0000 7f08b2ffd640 1 -- 172.21.15.47:0/2659043744 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55afa5109690 con 0x55afa51ad9f0 2024-07-24T22:07:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.397+0000 7f08b2ffd640 10 client.15567 handle_command_reply: tid=0 2024-07-24T22:07:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.397+0000 7f08dc019740 1 client.15567 shutdown 2024-07-24T22:07:37.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.397+0000 7f08dc019740 1 -- 172.21.15.47:0/2659043744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa519d450 msgr2=0x55afa519a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:37.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.397+0000 7f08dc019740 1 --2- 172.21.15.47:0/2659043744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa519d450 0x55afa519a5f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f08cc003d80 tx=0x7f08cc003970 comp rx=0 tx=0).stop 2024-07-24T22:07:37.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.397+0000 7f08dc019740 1 -- 172.21.15.47:0/2659043744 shutdown_connections 2024-07-24T22:07:37.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.397+0000 7f08dc019740 1 --2- 172.21.15.47:0/2659043744 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55afa51ad9f0 0x55afa51aee60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.397+0000 7f08dc019740 1 --2- 172.21.15.47:0/2659043744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa519d450 0x55afa519a5f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.397+0000 7f08dc019740 1 --2- 172.21.15.47:0/2659043744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa5192b80 0x55afa519a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.397+0000 7f08b2ffd640 0 client.15567 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:37.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.397+0000 7f08dc019740 1 --2- 172.21.15.47:0/2659043744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 0x55afa519cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.397+0000 7f08dc019740 1 -- 172.21.15.47:0/2659043744 >> 172.21.15.47:0/2659043744 conn(0x55afa512f6c0 msgr2=0x55afa5194ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:37.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.397+0000 7f08dc019740 1 -- 172.21.15.47:0/2659043744 shutdown_connections 2024-07-24T22:07:37.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.398+0000 7f08dc019740 1 -- 172.21.15.47:0/2659043744 wait complete. 2024-07-24T22:07:37.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.398+0000 7f08dc019740 20 client.15567 trim_cache size 0 max 16384 2024-07-24T22:07:37.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.420+0000 7f08dc019740 1 Processor -- start 2024-07-24T22:07:37.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.420+0000 7f08dc019740 1 -- start start 2024-07-24T22:07:37.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.420+0000 7f08dc019740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 0x55afa5190e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.420+0000 7f08dc019740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 0x55afa51acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.420+0000 7f08dc019740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa519d450 0x55afa518ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.420+0000 7f08dc019740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55afa51ad1a0 con 0x55afa5192b80 2024-07-24T22:07:37.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.420+0000 7f08dc019740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55afa51ad870 con 0x55afa519d450 2024-07-24T22:07:37.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.420+0000 7f08dc019740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55afa51adf40 con 0x55afa5191620 2024-07-24T22:07:37.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.420+0000 7f08d2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 0x55afa51acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.420+0000 7f08d2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 0x55afa51acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44008/0 (socket says 172.21.15.47:44008) 2024-07-24T22:07:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.420+0000 7f08d2ffd640 1 -- 172.21.15.47:0/3493032899 learned_addr learned my addr 172.21.15.47:0/3493032899 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.421+0000 7f08d37fe640 1 --2- 172.21.15.47:0/3493032899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 0x55afa5190e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.421+0000 7f08d2ffd640 1 -- 172.21.15.47:0/3493032899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 msgr2=0x55afa5190e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.421+0000 7f08d2ffd640 1 --2- 172.21.15.47:0/3493032899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 0x55afa5190e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.421+0000 7f08d2ffd640 1 -- 172.21.15.47:0/3493032899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa519d450 msgr2=0x55afa518ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.421+0000 7f08d2ffd640 1 --2- 172.21.15.47:0/3493032899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa519d450 0x55afa518ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.421+0000 7f08d2ffd640 1 -- 172.21.15.47:0/3493032899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afa51af190 con 0x55afa5192b80 2024-07-24T22:07:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.421+0000 7f08d37fe640 1 --2- 172.21.15.47:0/3493032899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 0x55afa5190e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.421+0000 7f08d2ffd640 1 --2- 172.21.15.47:0/3493032899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 0x55afa51acb40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f08c80aab90 tx=0x7f08c8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d74af80b98b24c0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.421+0000 7f08b97fa640 1 -- 172.21.15.47:0/3493032899 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c80aa600 con 0x55afa5192b80 2024-07-24T22:07:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.421+0000 7f08b97fa640 1 -- 172.21.15.47:0/3493032899 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08c80aa9a0 con 0x55afa5192b80 2024-07-24T22:07:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.421+0000 7f08b97fa640 1 -- 172.21.15.47:0/3493032899 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c80a7120 con 0x55afa5192b80 2024-07-24T22:07:37.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.422+0000 7f08dc019740 1 -- 172.21.15.47:0/3493032899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 msgr2=0x55afa51acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:37.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.422+0000 7f08dc019740 1 --2- 172.21.15.47:0/3493032899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 0x55afa51acb40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f08c80aab90 tx=0x7f08c8000bc0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.422+0000 7f08dc019740 1 -- 172.21.15.47:0/3493032899 shutdown_connections 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.422+0000 7f08dc019740 1 --2- 172.21.15.47:0/3493032899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa519d450 0x55afa518ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.422+0000 7f08dc019740 1 --2- 172.21.15.47:0/3493032899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5192b80 0x55afa51acb40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.422+0000 7f08dc019740 1 --2- 172.21.15.47:0/3493032899 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa5191620 0x55afa5190e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.422+0000 7f08dc019740 1 -- 172.21.15.47:0/3493032899 >> 172.21.15.47:0/3493032899 conn(0x55afa512f6c0 msgr2=0x55afa518a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.422+0000 7f08dc019740 1 -- 172.21.15.47:0/3493032899 shutdown_connections 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.422+0000 7f08dc019740 1 -- 172.21.15.47:0/3493032899 wait complete. 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.423+0000 7f08dc019740 1 -- start start 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.423+0000 7f08dc019740 1 Processor -- start 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.423+0000 7f08dc019740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5191620 0x55afa51b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.423+0000 7f08dc019740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa5192b80 0x55afa5194cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.423+0000 7f08dc019740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa519d450 0x55afa5195210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.423+0000 7f08dc019740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55afa51aece0 con 0x55afa5191620 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.423+0000 7f08dc019740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55afa51ae610 con 0x55afa5192b80 2024-07-24T22:07:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.423+0000 7f08dc019740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55afa51af3b0 con 0x55afa519d450 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.423+0000 7f08dc019740 10 client.0 _ll_register_callbacks cb 0x7f08c80e7c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.423+0000 7f08d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5191620 0x55afa51b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.423+0000 7f08d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5191620 0x55afa51b76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44016/0 (socket says 172.21.15.47:44016) 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.423+0000 7f08d37fe640 1 -- 172.21.15.47:0/138136176 learned_addr learned my addr 172.21.15.47:0/138136176 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08d3fff640 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa519d450 0x55afa5195210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08d2ffd640 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa5192b80 0x55afa5194cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08d37fe640 1 -- 172.21.15.47:0/138136176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa519d450 msgr2=0x55afa5195210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08d37fe640 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa519d450 0x55afa5195210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08d37fe640 1 -- 172.21.15.47:0/138136176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa5192b80 msgr2=0x55afa5194cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08d37fe640 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa5192b80 0x55afa5194cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08d37fe640 1 -- 172.21.15.47:0/138136176 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afa5195920 con 0x55afa5191620 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08d2ffd640 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa5192b80 0x55afa5194cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08d37fe640 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5191620 0x55afa51b76a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f08c4005d00 tx=0x7f08c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2932f70d7d27fff6 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:37.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08b2ffd640 1 -- 172.21.15.47:0/138136176 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c40285b0 con 0x55afa5191620 2024-07-24T22:07:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08dc019740 1 -- 172.21.15.47:0/138136176 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08c80aa9a0 con 0x55afa5191620 2024-07-24T22:07:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08b2ffd640 1 -- 172.21.15.47:0/138136176 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f08c4028750 con 0x55afa5191620 2024-07-24T22:07:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08b2ffd640 1 -- 172.21.15.47:0/138136176 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f08c4035050 con 0x55afa5191620 2024-07-24T22:07:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08dc019740 10 client.15573 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.424+0000 7f08dc019740 1 -- 172.21.15.47:0/138136176 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55afa5218220 con 0x55afa5191620 2024-07-24T22:07:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.425+0000 7f08b2ffd640 1 -- 172.21.15.47:0/138136176 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08c80aa9a0 con 0x55afa5191620 2024-07-24T22:07:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.425+0000 7f08b2ffd640 1 -- 172.21.15.47:0/138136176 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f08c4030030 con 0x55afa5191620 2024-07-24T22:07:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.425+0000 7f08dc019740 10 client.15573 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.425+0000 7f08dc019740 10 client.15573 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-24T22:07:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.425+0000 7f08dc019740 20 client.15573 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.425+0000 7f08dc019740 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55afa521cd90 0x55afa521baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.425+0000 7f08dc019740 4 client.15573 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-24T22:07:37.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.425+0000 7f08dc019740 1 -- 172.21.15.47:0/138136176 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "status"}) -- 0x55afa5105130 con 0x55afa521cd90 2024-07-24T22:07:37.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.425+0000 7f08d2ffd640 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55afa521cd90 0x55afa521baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:37.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08b2ffd640 10 client.15573 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:37.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08d2ffd640 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55afa521cd90 0x55afa521baa0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb1768ae8f585b0a server_cookie=9283d7775160d0e0 in_seq=0 out_seq=0 2024-07-24T22:07:37.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08b2ffd640 1 -- 172.21.15.47:0/138136176 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55afa5105130 con 0x55afa521cd90 2024-07-24T22:07:37.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08b2ffd640 10 client.15573 handle_command_reply: tid=0 2024-07-24T22:07:37.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08dc019740 1 client.15573 shutdown 2024-07-24T22:07:37.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08dc019740 1 -- 172.21.15.47:0/138136176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5191620 msgr2=0x55afa51b76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:37.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08dc019740 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5191620 0x55afa51b76a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f08c4005d00 tx=0x7f08c40046c0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08dc019740 1 -- 172.21.15.47:0/138136176 shutdown_connections 2024-07-24T22:07:37.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08dc019740 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55afa521cd90 0x55afa521baa0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08dc019740 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55afa519d450 0x55afa5195210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08dc019740 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55afa5192b80 0x55afa5194cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08dc019740 1 --2- 172.21.15.47:0/138136176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55afa5191620 0x55afa51b76a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08b2ffd640 0 client.15573 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:37.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08dc019740 1 -- 172.21.15.47:0/138136176 >> 172.21.15.47:0/138136176 conn(0x55afa512f6c0 msgr2=0x55afa519bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:37.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08dc019740 1 -- 172.21.15.47:0/138136176 shutdown_connections 2024-07-24T22:07:37.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.426+0000 7f08dc019740 1 -- 172.21.15.47:0/138136176 wait complete. 2024-07-24T22:07:37.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.427+0000 7f08dc019740 20 client.15573 trim_cache size 0 max 16384 2024-07-24T22:07:37.433 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:07:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "46bf760a-4a07-11ef-bcad-c7b262605968", 2024-07-24T22:07:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-07-24T22:07:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24628, 2024-07-24T22:07:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-07-24T22:07:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-07-24T22:07:37.433 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-07-24T22:07:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 222.024628011, 2024-07-24T22:07:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 20, 2024-07-24T22:07:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 85, 2024-07-24T22:07:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 81, 2024-07-24T22:07:37.434 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 247.34614790000001 2024-07-24T22:07:37.434 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:07:37.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.427+0000 7f08d9c68640 1 -- 172.21.15.47:0/1346509087 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08bc0b3dc0 msgr2=0x7f08bc0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:37.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.427+0000 7f08d9c68640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08bc0b3dc0 0x7f08bc0b6280 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55afa5194260 tx=0x7f08c400b390 comp rx=0 tx=0).stop 2024-07-24T22:07:37.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.427+0000 7f08d9c68640 1 -- 172.21.15.47:0/1346509087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08d4103fc0 msgr2=0x7f08d4101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:37.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.427+0000 7f08d9c68640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08d4103fc0 0x7f08d4101890 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f08c800c970 tx=0x7f08c800ce30 comp rx=0 tx=0).stop 2024-07-24T22:07:37.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.427+0000 7f08d9c68640 1 -- 172.21.15.47:0/1346509087 shutdown_connections 2024-07-24T22:07:37.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.427+0000 7f08d9c68640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08bc0b3dc0 0x7f08bc0b6280 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.427+0000 7f08d9c68640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08d410cb00 0x7f08d4101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.427+0000 7f08d9c68640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08d4103fc0 0x7f08d4101890 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.427+0000 7f08d9c68640 1 --2- 172.21.15.47:0/1346509087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08d41036a0 0x7f08d4101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:37.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.427+0000 7f08d9c68640 1 -- 172.21.15.47:0/1346509087 >> 172.21.15.47:0/1346509087 conn(0x7f08d40fd100 msgr2=0x7f08d410ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:37.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.427+0000 7f08d9c68640 1 -- 172.21.15.47:0/1346509087 shutdown_connections 2024-07-24T22:07:37.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:37.427+0000 7f08d9c68640 1 -- 172.21.15.47:0/1346509087 wait complete. 2024-07-24T22:07:37.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:37 smithi047 ceph-mon[32551]: pgmap v378: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1023 B/s wr, 2 op/s 2024-07-24T22:07:37.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:37 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:07:37.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:37 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:07:37.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:37 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:07:37.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:37 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:07:37.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:37 smithi183 ceph-mon[37007]: pgmap v378: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1023 B/s wr, 2 op/s 2024-07-24T22:07:37.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:37 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:07:37.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:37 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:07:37.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:37 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:07:37.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:37 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:07:37.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:37 smithi188 ceph-mon[37380]: pgmap v378: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1023 B/s wr, 2 op/s 2024-07-24T22:07:37.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:37 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:07:37.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:37 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:07:37.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:37 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:07:37.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:37 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:07:38.205 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-07-24T22:07:38.283 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:39.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:39 smithi047 ceph-mon[32551]: pgmap v379: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-07-24T22:07:39.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:39 smithi183 ceph-mon[37007]: pgmap v379: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-07-24T22:07:39.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:39 smithi188 ceph-mon[37380]: pgmap v379: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-07-24T22:07:39.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.926+0000 7f0672913640 1 -- 172.21.15.47:0/3901615024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066c1070a0 msgr2=0x7f066c1074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:39.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.926+0000 7f0672913640 1 --2- 172.21.15.47:0/3901615024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066c1070a0 0x7f066c1074e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0660009900 tx=0x7f066002a410 comp rx=0 tx=0).stop 2024-07-24T22:07:39.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.926+0000 7f0672913640 1 -- 172.21.15.47:0/3901615024 shutdown_connections 2024-07-24T22:07:39.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.926+0000 7f0672913640 1 --2- 172.21.15.47:0/3901615024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f066c107a20 0x7f066c10e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.926+0000 7f0672913640 1 --2- 172.21.15.47:0/3901615024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066c1070a0 0x7f066c1074e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.926+0000 7f0672913640 1 --2- 172.21.15.47:0/3901615024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f066c101690 0x7f066c101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.926+0000 7f0672913640 1 -- 172.21.15.47:0/3901615024 >> 172.21.15.47:0/3901615024 conn(0x7f066c0fd100 msgr2=0x7f066c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:39.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.926+0000 7f0672913640 1 -- 172.21.15.47:0/3901615024 shutdown_connections 2024-07-24T22:07:39.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.926+0000 7f0672913640 1 -- 172.21.15.47:0/3901615024 wait complete. 2024-07-24T22:07:39.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.926+0000 7f0672913640 1 Processor -- start 2024-07-24T22:07:39.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.926+0000 7f0672913640 1 -- start start 2024-07-24T22:07:39.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0672913640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f066c101690 0x7f066c198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0672913640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f066c1070a0 0x7f066c199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0672913640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066c107a20 0x7f066c19e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0672913640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f066c111620 con 0x7f066c107a20 2024-07-24T22:07:39.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0672913640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1114a0 con 0x7f066c101690 2024-07-24T22:07:39.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0672913640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1117a0 con 0x7f066c1070a0 2024-07-24T22:07:39.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0670eb0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066c107a20 0x7f066c19e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0670eb0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066c107a20 0x7f066c19e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44048/0 (socket says 172.21.15.47:44048) 2024-07-24T22:07:39.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0670eb0640 1 -- 172.21.15.47:0/835558972 learned_addr learned my addr 172.21.15.47:0/835558972 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:39.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f066bfff640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f066c101690 0x7f066c198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f066b7fe640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f066c1070a0 0x7f066c199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0670eb0640 1 -- 172.21.15.47:0/835558972 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f066c1070a0 msgr2=0x7f066c199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:39.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0670eb0640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f066c1070a0 0x7f066c199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0670eb0640 1 -- 172.21.15.47:0/835558972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f066c101690 msgr2=0x7f066c198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:39.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0670eb0640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f066c101690 0x7f066c198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0670eb0640 1 -- 172.21.15.47:0/835558972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066c19ecf0 con 0x7f066c107a20 2024-07-24T22:07:39.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f0670eb0640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066c107a20 0x7f066c19e520 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f066400eaa0 tx=0x7f066400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.927+0000 7f06697fa640 1 -- 172.21.15.47:0/835558972 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066400cdb0 con 0x7f066c107a20 2024-07-24T22:07:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.928+0000 7f06697fa640 1 -- 172.21.15.47:0/835558972 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0664005020 con 0x7f066c107a20 2024-07-24T22:07:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.928+0000 7f0672913640 1 -- 172.21.15.47:0/835558972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066c19efe0 con 0x7f066c107a20 2024-07-24T22:07:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.928+0000 7f06697fa640 1 -- 172.21.15.47:0/835558972 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06640116d0 con 0x7f066c107a20 2024-07-24T22:07:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.928+0000 7f0672913640 1 -- 172.21.15.47:0/835558972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f066c1a56a0 con 0x7f066c107a20 2024-07-24T22:07:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.930+0000 7f0674cc4740 1 Processor -- start 2024-07-24T22:07:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.930+0000 7f06697fa640 1 -- 172.21.15.47:0/835558972 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f06640051d0 con 0x7f066c107a20 2024-07-24T22:07:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.930+0000 7f0674cc4740 1 -- start start 2024-07-24T22:07:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.930+0000 7f0674cc4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9e6b0 0x5652d3d9ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.930+0000 7f0674cc4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9efd0 0x5652d3daee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.930+0000 7f0674cc4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3daf370 0x5652d3db1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.930+0000 7f0674cc4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5652d3d15990 con 0x5652d3d9e6b0 2024-07-24T22:07:39.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.930+0000 7f0674cc4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5652d3d04e90 con 0x5652d3daf370 2024-07-24T22:07:39.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.930+0000 7f0674cc4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5652d3d08ed0 con 0x5652d3d9efd0 2024-07-24T22:07:39.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.930+0000 7f066b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9e6b0 0x5652d3d9ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f066b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9e6b0 0x5652d3d9ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44054/0 (socket says 172.21.15.47:44054) 2024-07-24T22:07:39.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f066b7fe640 1 -- 172.21.15.47:0/586268303 learned_addr learned my addr 172.21.15.47:0/586268303 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:39.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f066bfff640 1 --2- 172.21.15.47:0/586268303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9efd0 0x5652d3daee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f066b7fe640 1 -- 172.21.15.47:0/586268303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9efd0 msgr2=0x5652d3daee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:39.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f066b7fe640 1 --2- 172.21.15.47:0/586268303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9efd0 0x5652d3daee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f066b7fe640 1 -- 172.21.15.47:0/586268303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3daf370 msgr2=0x5652d3db1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:39.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f066b7fe640 1 --2- 172.21.15.47:0/586268303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3daf370 0x5652d3db1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f066b7fe640 1 -- 172.21.15.47:0/586268303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652d3c8e300 con 0x5652d3d9e6b0 2024-07-24T22:07:39.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f06697fa640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f06540b3d40 0x7f06540b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f066b7fe640 1 --2- 172.21.15.47:0/586268303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9e6b0 0x5652d3d9ea90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0660009900 tx=0x7f0660009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e984bdde6e548c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:39.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f066bfff640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f06540b3d40 0x7f06540b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f06697fa640 1 -- 172.21.15.47:0/835558972 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f06640e4110 con 0x7f066c107a20 2024-07-24T22:07:39.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f06527fc640 1 -- 172.21.15.47:0/586268303 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660035040 con 0x5652d3d9e6b0 2024-07-24T22:07:39.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f06527fc640 1 -- 172.21.15.47:0/586268303 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06600316a0 con 0x5652d3d9e6b0 2024-07-24T22:07:39.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.931+0000 7f06527fc640 1 -- 172.21.15.47:0/586268303 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660004750 con 0x5652d3d9e6b0 2024-07-24T22:07:39.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.932+0000 7f0674cc4740 1 -- 172.21.15.47:0/586268303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9e6b0 msgr2=0x5652d3d9ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:39.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.932+0000 7f066bfff640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f06540b3d40 0x7f06540b6200 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5652d3da28f0 tx=0x7f065c00a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:39.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.932+0000 7f0674cc4740 1 --2- 172.21.15.47:0/586268303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9e6b0 0x5652d3d9ea90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0660009900 tx=0x7f0660009680 comp rx=0 tx=0).stop 2024-07-24T22:07:39.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.932+0000 7f0674cc4740 1 -- 172.21.15.47:0/586268303 shutdown_connections 2024-07-24T22:07:39.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.932+0000 7f0674cc4740 1 --2- 172.21.15.47:0/586268303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3daf370 0x5652d3db1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.932+0000 7f0674cc4740 1 --2- 172.21.15.47:0/586268303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9efd0 0x5652d3daee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.932+0000 7f0674cc4740 1 --2- 172.21.15.47:0/586268303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9e6b0 0x5652d3d9ea90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.932+0000 7f0674cc4740 1 -- 172.21.15.47:0/586268303 >> 172.21.15.47:0/586268303 conn(0x5652d3d9c4e0 msgr2=0x5652d3d9d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:39.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.932+0000 7f0674cc4740 1 -- 172.21.15.47:0/586268303 shutdown_connections 2024-07-24T22:07:39.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.932+0000 7f0674cc4740 1 -- 172.21.15.47:0/586268303 wait complete. 2024-07-24T22:07:39.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.932+0000 7f0674cc4740 1 -- start start 2024-07-24T22:07:39.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.933+0000 7f0674cc4740 1 Processor -- start 2024-07-24T22:07:39.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.933+0000 7f0674cc4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3d9e6b0 0x5652d3dac330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.933+0000 7f0674cc4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9efd0 0x5652d3dac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.933+0000 7f0674cc4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3daf370 0x5652d3dacdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.933+0000 7f0674cc4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5652d3b68700 con 0x5652d3daf370 2024-07-24T22:07:39.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.933+0000 7f0674cc4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5652d3ca75d0 con 0x5652d3d9e6b0 2024-07-24T22:07:39.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.933+0000 7f0674cc4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5652d3db1fc0 con 0x5652d3d9efd0 2024-07-24T22:07:39.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.933+0000 7f0674cc4740 10 client.0 _ll_register_callbacks cb 0x5652d3cc7940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:39.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.933+0000 7f0670eb0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3daf370 0x5652d3dacdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.933+0000 7f0670eb0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3daf370 0x5652d3dacdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44064/0 (socket says 172.21.15.47:44064) 2024-07-24T22:07:39.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.933+0000 7f0670eb0640 1 -- 172.21.15.47:0/2375323262 learned_addr learned my addr 172.21.15.47:0/2375323262 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:39.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.933+0000 7f066b7fe640 1 --2- 172.21.15.47:0/2375323262 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9efd0 0x5652d3dac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.933+0000 7f066bfff640 1 --2- 172.21.15.47:0/2375323262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3d9e6b0 0x5652d3dac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f0670eb0640 1 -- 172.21.15.47:0/2375323262 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9efd0 msgr2=0x5652d3dac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:39.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f0670eb0640 1 --2- 172.21.15.47:0/2375323262 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9efd0 0x5652d3dac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f0670eb0640 1 -- 172.21.15.47:0/2375323262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3d9e6b0 msgr2=0x5652d3dac330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:39.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f0670eb0640 1 --2- 172.21.15.47:0/2375323262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3d9e6b0 0x5652d3dac330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f0670eb0640 1 -- 172.21.15.47:0/2375323262 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652d3c9a660 con 0x5652d3daf370 2024-07-24T22:07:39.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f0670eb0640 1 --2- 172.21.15.47:0/2375323262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3daf370 0x5652d3dacdb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f06640a6e50 tx=0x7f06640aaa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4c6a6e668e556 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:39.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f064b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:39.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f064b7fe640 1 -- 172.21.15.47:0/2375323262 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066401f040 con 0x5652d3daf370 2024-07-24T22:07:39.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f064b7fe640 1 -- 172.21.15.47:0/2375323262 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f06640aa230 con 0x5652d3daf370 2024-07-24T22:07:39.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f0674cc4740 1 -- 172.21.15.47:0/2375323262 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06600316a0 con 0x5652d3daf370 2024-07-24T22:07:39.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f064b7fe640 1 -- 172.21.15.47:0/2375323262 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f06640a6740 con 0x5652d3daf370 2024-07-24T22:07:39.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f0674cc4740 10 client.15585 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:39.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f0674cc4740 1 -- 172.21.15.47:0/2375323262 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5652d3a65650 con 0x5652d3daf370 2024-07-24T22:07:39.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f064b7fe640 1 -- 172.21.15.47:0/2375323262 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06600316a0 con 0x5652d3daf370 2024-07-24T22:07:39.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.934+0000 7f064b7fe640 1 -- 172.21.15.47:0/2375323262 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f066400f040 con 0x5652d3daf370 2024-07-24T22:07:39.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.935+0000 7f0674cc4740 10 client.15585 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:39.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.935+0000 7f0674cc4740 10 client.15585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:39.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.935+0000 7f0674cc4740 20 client.15585 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:39.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.935+0000 7f0674cc4740 1 --2- 172.21.15.47:0/2375323262 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5652d3dbeff0 0x5652d3dc1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.935+0000 7f0674cc4740 4 client.15585 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:07:39.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.935+0000 7f0674cc4740 1 -- 172.21.15.47:0/2375323262 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652d3d178e0 con 0x5652d3dbeff0 2024-07-24T22:07:39.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.935+0000 7f066bfff640 1 --2- 172.21.15.47:0/2375323262 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5652d3dbeff0 0x5652d3dc1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.935+0000 7f064b7fe640 10 client.15585 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:39.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.935+0000 7f066bfff640 1 --2- 172.21.15.47:0/2375323262 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5652d3dbeff0 0x5652d3dc1420 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb9164b19e90ff0b server_cookie=de2a6b30ed20838a in_seq=0 out_seq=0 2024-07-24T22:07:39.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f064b7fe640 1 -- 172.21.15.47:0/2375323262 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5652d3d178e0 con 0x5652d3dbeff0 2024-07-24T22:07:39.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f064b7fe640 10 client.15585 handle_command_reply: tid=0 2024-07-24T22:07:39.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f0674cc4740 1 client.15585 shutdown 2024-07-24T22:07:39.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f0674cc4740 1 -- 172.21.15.47:0/2375323262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3daf370 msgr2=0x5652d3dacdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:39.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f0674cc4740 1 --2- 172.21.15.47:0/2375323262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3daf370 0x5652d3dacdb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f06640a6e50 tx=0x7f06640aaa20 comp rx=0 tx=0).stop 2024-07-24T22:07:39.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f0674cc4740 1 -- 172.21.15.47:0/2375323262 shutdown_connections 2024-07-24T22:07:39.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f0674cc4740 1 --2- 172.21.15.47:0/2375323262 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5652d3dbeff0 0x5652d3dc1420 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f0674cc4740 1 --2- 172.21.15.47:0/2375323262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3daf370 0x5652d3dacdb0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f0674cc4740 1 --2- 172.21.15.47:0/2375323262 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9efd0 0x5652d3dac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f064b7fe640 0 client.15585 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:39.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f0674cc4740 1 --2- 172.21.15.47:0/2375323262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3d9e6b0 0x5652d3dac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f0674cc4740 1 -- 172.21.15.47:0/2375323262 >> 172.21.15.47:0/2375323262 conn(0x5652d3d9c4e0 msgr2=0x5652d3da2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:39.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f0674cc4740 1 -- 172.21.15.47:0/2375323262 shutdown_connections 2024-07-24T22:07:39.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f0674cc4740 1 -- 172.21.15.47:0/2375323262 wait complete. 2024-07-24T22:07:39.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.936+0000 7f0674cc4740 20 client.15585 trim_cache size 0 max 16384 2024-07-24T22:07:39.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.955+0000 7f0674cc4740 1 Processor -- start 2024-07-24T22:07:39.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.955+0000 7f0674cc4740 1 -- start start 2024-07-24T22:07:39.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.955+0000 7f0674cc4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3d9e6b0 0x5652d3da9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.955+0000 7f0674cc4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 0x5652d3da1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.955+0000 7f0674cc4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3daf370 0x5652d3da0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.955+0000 7f0674cc4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1a9e80 con 0x5652d3d9efd0 2024-07-24T22:07:39.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.955+0000 7f0674cc4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1ac700 con 0x5652d3d9e6b0 2024-07-24T22:07:39.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.955+0000 7f0674cc4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1aa4f0 con 0x5652d3daf370 2024-07-24T22:07:39.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.955+0000 7f066b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 0x5652d3da1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.956+0000 7f066b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 0x5652d3da1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44072/0 (socket says 172.21.15.47:44072) 2024-07-24T22:07:39.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.956+0000 7f066b7fe640 1 -- 172.21.15.47:0/2276330115 learned_addr learned my addr 172.21.15.47:0/2276330115 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:39.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.956+0000 7f066bfff640 1 --2- 172.21.15.47:0/2276330115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3d9e6b0 0x5652d3da9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.956+0000 7f066b7fe640 1 -- 172.21.15.47:0/2276330115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3daf370 msgr2=0x5652d3da0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:39.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.956+0000 7f066b7fe640 1 --2- 172.21.15.47:0/2276330115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3daf370 0x5652d3da0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.956+0000 7f066b7fe640 1 -- 172.21.15.47:0/2276330115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3d9e6b0 msgr2=0x5652d3da9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.956+0000 7f066b7fe640 1 --2- 172.21.15.47:0/2276330115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3d9e6b0 0x5652d3da9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.956+0000 7f066b7fe640 1 -- 172.21.15.47:0/2276330115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652d3dbdaf0 con 0x5652d3d9efd0 2024-07-24T22:07:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.956+0000 7f066bfff640 1 --2- 172.21.15.47:0/2276330115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3d9e6b0 0x5652d3da9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.956+0000 7f066b7fe640 1 --2- 172.21.15.47:0/2276330115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 0x5652d3da1f00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f06600052f0 tx=0x7f0660005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf14fcc0399d8b4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.956+0000 7f0651ffb640 1 -- 172.21.15.47:0/2276330115 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660035070 con 0x5652d3d9efd0 2024-07-24T22:07:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.956+0000 7f0651ffb640 1 -- 172.21.15.47:0/2276330115 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0660004300 con 0x5652d3d9efd0 2024-07-24T22:07:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.956+0000 7f0651ffb640 1 -- 172.21.15.47:0/2276330115 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660031820 con 0x5652d3d9efd0 2024-07-24T22:07:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.957+0000 7f0674cc4740 1 -- 172.21.15.47:0/2276330115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 msgr2=0x5652d3da1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.957+0000 7f0674cc4740 1 --2- 172.21.15.47:0/2276330115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 0x5652d3da1f00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f06600052f0 tx=0x7f0660005320 comp rx=0 tx=0).stop 2024-07-24T22:07:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.957+0000 7f0674cc4740 1 -- 172.21.15.47:0/2276330115 shutdown_connections 2024-07-24T22:07:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.957+0000 7f0674cc4740 1 --2- 172.21.15.47:0/2276330115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3daf370 0x5652d3da0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.957+0000 7f0674cc4740 1 --2- 172.21.15.47:0/2276330115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 0x5652d3da1f00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.957+0000 7f0674cc4740 1 --2- 172.21.15.47:0/2276330115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3d9e6b0 0x5652d3da9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.957+0000 7f0674cc4740 1 -- 172.21.15.47:0/2276330115 >> 172.21.15.47:0/2276330115 conn(0x5652d3d9c4e0 msgr2=0x5652d3da17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.957+0000 7f0674cc4740 1 -- 172.21.15.47:0/2276330115 shutdown_connections 2024-07-24T22:07:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.957+0000 7f0674cc4740 1 -- 172.21.15.47:0/2276330115 wait complete. 2024-07-24T22:07:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.957+0000 7f0674cc4740 1 -- start start 2024-07-24T22:07:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f0674cc4740 1 Processor -- start 2024-07-24T22:07:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f0674cc4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9e6b0 0x5652d3db7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f0674cc4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 0x5652d3db79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f0674cc4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3daf370 0x5652d3d9f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f0674cc4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1aabc0 con 0x5652d3d9efd0 2024-07-24T22:07:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f0674cc4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1ac030 con 0x5652d3daf370 2024-07-24T22:07:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f0674cc4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f066c1ab290 con 0x5652d3d9e6b0 2024-07-24T22:07:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f0674cc4740 10 client.0 _ll_register_callbacks cb 0x7f06640aaba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f066b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 0x5652d3db79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f066bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9e6b0 0x5652d3db7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f066b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 0x5652d3db79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44076/0 (socket says 172.21.15.47:44076) 2024-07-24T22:07:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f066b7fe640 1 -- 172.21.15.47:0/3554458022 learned_addr learned my addr 172.21.15.47:0/3554458022 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f0670eb0640 1 --2- 172.21.15.47:0/3554458022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3daf370 0x5652d3d9f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f066b7fe640 1 -- 172.21.15.47:0/3554458022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9e6b0 msgr2=0x5652d3db7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f066b7fe640 1 --2- 172.21.15.47:0/3554458022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9e6b0 0x5652d3db7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f066b7fe640 1 -- 172.21.15.47:0/3554458022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3daf370 msgr2=0x5652d3d9f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f066b7fe640 1 --2- 172.21.15.47:0/3554458022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3daf370 0x5652d3d9f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.958+0000 7f066b7fe640 1 -- 172.21.15.47:0/3554458022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652d3dafee0 con 0x5652d3d9efd0 2024-07-24T22:07:39.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.959+0000 7f0670eb0640 1 --2- 172.21.15.47:0/3554458022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3daf370 0x5652d3d9f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:39.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.959+0000 7f066b7fe640 1 --2- 172.21.15.47:0/3554458022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 0x5652d3db79a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0660009850 tx=0x7f0660003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7c260c0f5c7678 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:39.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.959+0000 7f064b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:39.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.959+0000 7f064b7fe640 1 -- 172.21.15.47:0/3554458022 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660035040 con 0x5652d3d9efd0 2024-07-24T22:07:39.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.959+0000 7f064b7fe640 1 -- 172.21.15.47:0/3554458022 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f0660003a10 con 0x5652d3d9efd0 2024-07-24T22:07:39.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.959+0000 7f0674cc4740 1 -- 172.21.15.47:0/3554458022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0660004300 con 0x5652d3d9efd0 2024-07-24T22:07:39.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.959+0000 7f064b7fe640 1 -- 172.21.15.47:0/3554458022 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0660058050 con 0x5652d3d9efd0 2024-07-24T22:07:39.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.959+0000 7f0674cc4740 10 client.15591 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:39.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.959+0000 7f0674cc4740 1 -- 172.21.15.47:0/3554458022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5652d3da0f10 con 0x5652d3d9efd0 2024-07-24T22:07:39.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.959+0000 7f064b7fe640 1 -- 172.21.15.47:0/3554458022 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0660004300 con 0x5652d3d9efd0 2024-07-24T22:07:39.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.959+0000 7f064b7fe640 1 -- 172.21.15.47:0/3554458022 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f066003b420 con 0x5652d3d9efd0 2024-07-24T22:07:39.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.960+0000 7f0674cc4740 10 client.15591 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:39.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.960+0000 7f0674cc4740 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:39.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.960+0000 7f0674cc4740 20 client.15591 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:39.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.960+0000 7f0674cc4740 1 --2- 172.21.15.47:0/3554458022 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5652d3e2acd0 0x5652d3e2d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:39.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.960+0000 7f0674cc4740 4 client.15591 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:07:39.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.960+0000 7f0674cc4740 1 -- 172.21.15.47:0/3554458022 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5652d3d13380 con 0x5652d3e2acd0 2024-07-24T22:07:39.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.960+0000 7f066bfff640 1 --2- 172.21.15.47:0/3554458022 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5652d3e2acd0 0x5652d3e2d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:39.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.960+0000 7f066bfff640 1 --2- 172.21.15.47:0/3554458022 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5652d3e2acd0 0x5652d3e2d0c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6af839b3f17b818 server_cookie=9d75c5d1c84811c3 in_seq=0 out_seq=0 2024-07-24T22:07:39.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.960+0000 7f064b7fe640 10 client.15591 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:39.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.960+0000 7f064b7fe640 1 -- 172.21.15.47:0/3554458022 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5652d3d13380 con 0x5652d3e2acd0 2024-07-24T22:07:39.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.960+0000 7f064b7fe640 10 client.15591 handle_command_reply: tid=0 2024-07-24T22:07:39.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.960+0000 7f0674cc4740 1 client.15591 shutdown 2024-07-24T22:07:39.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0674cc4740 1 -- 172.21.15.47:0/3554458022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 msgr2=0x5652d3db79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:39.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0674cc4740 1 --2- 172.21.15.47:0/3554458022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 0x5652d3db79a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0660009850 tx=0x7f0660003820 comp rx=0 tx=0).stop 2024-07-24T22:07:39.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0674cc4740 1 -- 172.21.15.47:0/3554458022 shutdown_connections 2024-07-24T22:07:39.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0674cc4740 1 --2- 172.21.15.47:0/3554458022 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5652d3e2acd0 0x5652d3e2d0c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0674cc4740 1 --2- 172.21.15.47:0/3554458022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5652d3daf370 0x5652d3d9f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0674cc4740 1 --2- 172.21.15.47:0/3554458022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5652d3d9efd0 0x5652d3db79a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0674cc4740 1 --2- 172.21.15.47:0/3554458022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5652d3d9e6b0 0x5652d3db7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0674cc4740 1 -- 172.21.15.47:0/3554458022 >> 172.21.15.47:0/3554458022 conn(0x5652d3d9c4e0 msgr2=0x5652d3d9b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:39.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f064b7fe640 0 client.15591 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:39.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0674cc4740 1 -- 172.21.15.47:0/3554458022 shutdown_connections 2024-07-24T22:07:39.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0674cc4740 1 -- 172.21.15.47:0/3554458022 wait complete. 2024-07-24T22:07:39.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0674cc4740 20 client.15591 trim_cache size 0 max 16384 2024-07-24T22:07:39.979 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:07:39.980 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-07-24T22:07:39.980 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-07-24T22:07:39.980 INFO:teuthology.orchestra.run.smithi047.stdout: "5a1a3c99-666f-4826-82bc-399b8656dae6": { 2024-07-24T22:07:39.980 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-07-24T22:07:39.980 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "5a1a3c99-666f-4826-82bc-399b8656dae6", 2024-07-24T22:07:39.980 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-07-24T22:07:39.980 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:07:39.980 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:07:39.981 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:07:39.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0672913640 1 -- 172.21.15.47:0/835558972 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f06540b3d40 msgr2=0x7f06540b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:39.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0672913640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f06540b3d40 0x7f06540b6200 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5652d3da28f0 tx=0x7f065c00a2d0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0672913640 1 -- 172.21.15.47:0/835558972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066c107a20 msgr2=0x7f066c19e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:39.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.961+0000 7f0672913640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066c107a20 0x7f066c19e520 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f066400eaa0 tx=0x7f066400ef60 comp rx=0 tx=0).stop 2024-07-24T22:07:39.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.962+0000 7f0672913640 1 -- 172.21.15.47:0/835558972 shutdown_connections 2024-07-24T22:07:39.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.962+0000 7f0672913640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f06540b3d40 0x7f06540b6200 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.962+0000 7f0672913640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066c107a20 0x7f066c19e520 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.962+0000 7f0672913640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f066c1070a0 0x7f066c199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.962+0000 7f0672913640 1 --2- 172.21.15.47:0/835558972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f066c101690 0x7f066c198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:39.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.962+0000 7f0672913640 1 -- 172.21.15.47:0/835558972 >> 172.21.15.47:0/835558972 conn(0x7f066c0fd100 msgr2=0x7f066c06b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:39.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.962+0000 7f0672913640 1 -- 172.21.15.47:0/835558972 shutdown_connections 2024-07-24T22:07:39.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:39.962+0000 7f0672913640 1 -- 172.21.15.47:0/835558972 wait complete. 2024-07-24T22:07:40.612 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:40 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:07:40.643 INFO:tasks.cephfs.filesystem:scrub status for tag:5a1a3c99-666f-4826-82bc-399b8656dae6 - {'path': '/', 'tag': '5a1a3c99-666f-4826-82bc-399b8656dae6', 'options': 'recursive,force'} 2024-07-24T22:07:40.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:40 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:07:40.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:40 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:07:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:41 smithi183 ceph-mon[37007]: pgmap v380: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-07-24T22:07:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:41 smithi047 ceph-mon[32551]: pgmap v380: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-07-24T22:07:41.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:41 smithi188 ceph-mon[37380]: pgmap v380: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-07-24T22:07:43.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:43 smithi183 ceph-mon[37007]: pgmap v381: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-07-24T22:07:43.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:43 smithi047 ceph-mon[32551]: pgmap v381: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-07-24T22:07:43.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:43 smithi188 ceph-mon[37380]: pgmap v381: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-07-24T22:07:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:45 smithi183 ceph-mon[37007]: pgmap v382: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-07-24T22:07:45.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:45 smithi047 ceph-mon[32551]: pgmap v382: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-07-24T22:07:45.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:45 smithi188 ceph-mon[37380]: pgmap v382: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-07-24T22:07:47.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:47 smithi183 ceph-mon[37007]: pgmap v383: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-07-24T22:07:47.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:47 smithi047 ceph-mon[32551]: pgmap v383: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-07-24T22:07:47.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:47 smithi188 ceph-mon[37380]: pgmap v383: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-07-24T22:07:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.392+0000 7f89760e1640 1 -- 172.21.15.47:0/316763019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89701026a0 msgr2=0x7f8970102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.392+0000 7f89760e1640 1 --2- 172.21.15.47:0/316763019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89701026a0 0x7f8970102a80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8960009ca0 tx=0x7f896002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.392+0000 7f89760e1640 1 -- 172.21.15.47:0/316763019 shutdown_connections 2024-07-24T22:07:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.392+0000 7f89760e1640 1 --2- 172.21.15.47:0/316763019 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8970108a20 0x7f897010f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.392+0000 7f89760e1640 1 --2- 172.21.15.47:0/316763019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89701080a0 0x7f89701084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.392+0000 7f89760e1640 1 --2- 172.21.15.47:0/316763019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89701026a0 0x7f8970102a80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.392+0000 7f89760e1640 1 -- 172.21.15.47:0/316763019 >> 172.21.15.47:0/316763019 conn(0x7f89700fe0e0 msgr2=0x7f8970100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.393+0000 7f89760e1640 1 -- 172.21.15.47:0/316763019 shutdown_connections 2024-07-24T22:07:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.393+0000 7f89760e1640 1 -- 172.21.15.47:0/316763019 wait complete. 2024-07-24T22:07:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.393+0000 7f89760e1640 1 Processor -- start 2024-07-24T22:07:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.393+0000 7f89760e1640 1 -- start start 2024-07-24T22:07:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.393+0000 7f89760e1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89701026a0 0x7f8970074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.393+0000 7f89760e1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89701080a0 0x7f89700753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f89760e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8970108a20 0x7f8970075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f89760e1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8970112670 con 0x7f89701080a0 2024-07-24T22:07:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f89760e1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f89701124f0 con 0x7f89701026a0 2024-07-24T22:07:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f89760e1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f89701127f0 con 0x7f8970108a20 2024-07-24T22:07:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f896effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89701080a0 0x7f89700753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f896effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89701080a0 0x7f89700753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49642/0 (socket says 172.21.15.47:49642) 2024-07-24T22:07:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f896effd640 1 -- 172.21.15.47:0/543184138 learned_addr learned my addr 172.21.15.47:0/543184138 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f896f7fe640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89701026a0 0x7f8970074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f896ffff640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8970108a20 0x7f8970075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f896effd640 1 -- 172.21.15.47:0/543184138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8970108a20 msgr2=0x7f8970075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f896effd640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8970108a20 0x7f8970075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f896effd640 1 -- 172.21.15.47:0/543184138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89701026a0 msgr2=0x7f8970074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f896effd640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89701026a0 0x7f8970074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f896effd640 1 -- 172.21.15.47:0/543184138 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89701a7060 con 0x7f89701080a0 2024-07-24T22:07:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f896effd640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89701080a0 0x7f89700753d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f895800e9f0 tx=0x7f895800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.394+0000 7f896cff9640 1 -- 172.21.15.47:0/543184138 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895800cd80 con 0x7f89701080a0 2024-07-24T22:07:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.395+0000 7f896cff9640 1 -- 172.21.15.47:0/543184138 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89580108e0 con 0x7f89701080a0 2024-07-24T22:07:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.395+0000 7f89760e1640 1 -- 172.21.15.47:0/543184138 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89701a7350 con 0x7f89701080a0 2024-07-24T22:07:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.395+0000 7f896cff9640 1 -- 172.21.15.47:0/543184138 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958018980 con 0x7f89701080a0 2024-07-24T22:07:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.395+0000 7f89760e1640 1 -- 172.21.15.47:0/543184138 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89701a78a0 con 0x7f89701080a0 2024-07-24T22:07:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.397+0000 7f8978e30740 1 Processor -- start 2024-07-24T22:07:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.397+0000 7f8978e30740 1 -- start start 2024-07-24T22:07:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.397+0000 7f8978e30740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fc8c0 0x555d9f4fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.397+0000 7f8978e30740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f508c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f8978e30740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f509170 0x555d9f50b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f8978e30740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555d9f472280 con 0x555d9f509170 2024-07-24T22:07:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f8978e30740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555d9f461780 con 0x555d9f4fd1e0 2024-07-24T22:07:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f8978e30740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555d9f4657c0 con 0x555d9f4fc8c0 2024-07-24T22:07:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f896f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f508c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f896ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fc8c0 0x555d9f4fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f896f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f508c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:36866/0 (socket says 172.21.15.47:36866) 2024-07-24T22:07:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f896ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fc8c0 0x555d9f4fcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:45774/0 (socket says 172.21.15.47:45774) 2024-07-24T22:07:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f896f7fe640 1 -- 172.21.15.47:0/3467427748 learned_addr learned my addr 172.21.15.47:0/3467427748 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f896cff9640 1 -- 172.21.15.47:0/543184138 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8958010430 con 0x7f89701080a0 2024-07-24T22:07:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f896ffff640 1 -- 172.21.15.47:0/3467427748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 msgr2=0x555d9f508c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f896ffff640 1 --2- 172.21.15.47:0/3467427748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f508c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f896ffff640 1 -- 172.21.15.47:0/3467427748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f509170 msgr2=0x555d9f50b560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-24T22:07:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f896ffff640 1 --2- 172.21.15.47:0/3467427748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f509170 0x555d9f50b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f896ffff640 1 -- 172.21.15.47:0/3467427748 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d9f1c5790 con 0x555d9f4fc8c0 2024-07-24T22:07:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.398+0000 7f896f7fe640 1 --2- 172.21.15.47:0/3467427748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f508c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:07:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.399+0000 7f896ffff640 1 --2- 172.21.15.47:0/3467427748 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fc8c0 0x555d9f4fcca0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8968009b80 tx=0x7f8968011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97d3fb1cdcc8d4aa server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.399+0000 7f8965ffb640 1 -- 172.21.15.47:0/3467427748 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968004050 con 0x555d9f4fc8c0 2024-07-24T22:07:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.399+0000 7f8965ffb640 1 -- 172.21.15.47:0/3467427748 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89680054d0 con 0x555d9f4fc8c0 2024-07-24T22:07:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.399+0000 7f8965ffb640 1 -- 172.21.15.47:0/3467427748 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968004c40 con 0x555d9f4fc8c0 2024-07-24T22:07:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.399+0000 7f896cff9640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f895c0b3d40 0x7f895c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.399+0000 7f896f7fe640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f895c0b3d40 0x7f895c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.399+0000 7f896cff9640 1 -- 172.21.15.47:0/543184138 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f89580e4310 con 0x7f89701080a0 2024-07-24T22:07:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.400+0000 7f8978e30740 1 -- 172.21.15.47:0/3467427748 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fc8c0 msgr2=0x555d9f4fcca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.400+0000 7f896f7fe640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f895c0b3d40 0x7f895c0b6200 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x555d9f4ffa40 tx=0x7f8960009360 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.400+0000 7f8978e30740 1 --2- 172.21.15.47:0/3467427748 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fc8c0 0x555d9f4fcca0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8968009b80 tx=0x7f8968011810 comp rx=0 tx=0).stop 2024-07-24T22:07:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.400+0000 7f8978e30740 1 -- 172.21.15.47:0/3467427748 shutdown_connections 2024-07-24T22:07:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.400+0000 7f8978e30740 1 --2- 172.21.15.47:0/3467427748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f509170 0x555d9f50b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.400+0000 7f8978e30740 1 --2- 172.21.15.47:0/3467427748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f508c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.400+0000 7f8978e30740 1 --2- 172.21.15.47:0/3467427748 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fc8c0 0x555d9f4fcca0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.400+0000 7f8978e30740 1 -- 172.21.15.47:0/3467427748 >> 172.21.15.47:0/3467427748 conn(0x555d9f4fa6f0 msgr2=0x555d9f4fb890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.400+0000 7f8978e30740 1 -- 172.21.15.47:0/3467427748 shutdown_connections 2024-07-24T22:07:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.400+0000 7f8978e30740 1 -- 172.21.15.47:0/3467427748 wait complete. 2024-07-24T22:07:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.400+0000 7f8978e30740 1 -- start start 2024-07-24T22:07:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.401+0000 7f8978e30740 1 Processor -- start 2024-07-24T22:07:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.401+0000 7f8978e30740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 0x555d9f508980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.401+0000 7f8978e30740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f505e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.401+0000 7f8978e30740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f509170 0x555d9f5063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.401+0000 7f8978e30740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555d9f39bab0 con 0x555d9f4fc8c0 2024-07-24T22:07:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.401+0000 7f8978e30740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555d9f3e99e0 con 0x555d9f4fd1e0 2024-07-24T22:07:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.401+0000 7f8978e30740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555d9f50be50 con 0x555d9f509170 2024-07-24T22:07:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.401+0000 7f8978e30740 10 client.0 _ll_register_callbacks cb 0x555d9f171a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.401+0000 7f896f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 0x555d9f508980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.401+0000 7f896f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 0x555d9f508980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49660/0 (socket says 172.21.15.47:49660) 2024-07-24T22:07:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.401+0000 7f896f7fe640 1 -- 172.21.15.47:0/3111107913 learned_addr learned my addr 172.21.15.47:0/3111107913 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.401+0000 7f896ffff640 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f509170 0x555d9f5063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.401+0000 7f896effd640 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f505e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f896f7fe640 1 -- 172.21.15.47:0/3111107913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f509170 msgr2=0x555d9f5063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f896f7fe640 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f509170 0x555d9f5063a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f896f7fe640 1 -- 172.21.15.47:0/3111107913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 msgr2=0x555d9f505e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f896f7fe640 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f505e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f896f7fe640 1 -- 172.21.15.47:0/3111107913 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d9f23e620 con 0x555d9f4fc8c0 2024-07-24T22:07:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f896effd640 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f505e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:07:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f896f7fe640 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 0x555d9f508980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8960000f80 tx=0x7f896002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2425d0b1ccb9d02f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f894effd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f894effd640 1 -- 172.21.15.47:0/3111107913 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960003b80 con 0x555d9f4fc8c0 2024-07-24T22:07:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f8978e30740 1 -- 172.21.15.47:0/3111107913 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555d9f410ce0 con 0x555d9f4fc8c0 2024-07-24T22:07:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f894effd640 1 -- 172.21.15.47:0/3111107913 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8960003d20 con 0x555d9f4fc8c0 2024-07-24T22:07:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f894effd640 1 -- 172.21.15.47:0/3111107913 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8960004040 con 0x555d9f4fc8c0 2024-07-24T22:07:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f8978e30740 10 client.15600 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f8978e30740 1 -- 172.21.15.47:0/3111107913 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555d9f5176d0 con 0x555d9f4fc8c0 2024-07-24T22:07:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.402+0000 7f894effd640 1 -- 172.21.15.47:0/3111107913 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555d9f410ce0 con 0x555d9f4fc8c0 2024-07-24T22:07:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.403+0000 7f894effd640 1 -- 172.21.15.47:0/3111107913 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8960051070 con 0x555d9f4fc8c0 2024-07-24T22:07:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.403+0000 7f8978e30740 10 client.15600 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.403+0000 7f8978e30740 10 client.15600 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.403+0000 7f8978e30740 20 client.15600 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.403+0000 7f8978e30740 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555d9f518ae0 0x555d9f51af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.403+0000 7f8978e30740 4 client.15600 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:07:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.403+0000 7f8978e30740 1 -- 172.21.15.47:0/3111107913 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d9f4741d0 con 0x555d9f518ae0 2024-07-24T22:07:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.403+0000 7f896effd640 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555d9f518ae0 0x555d9f51af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.403+0000 7f894effd640 10 client.15600 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.403+0000 7f896effd640 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555d9f518ae0 0x555d9f51af10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=923ce92970ee040b server_cookie=8dfb4ed4a3fde41b in_seq=0 out_seq=0 2024-07-24T22:07:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.404+0000 7f894effd640 1 -- 172.21.15.47:0/3111107913 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d9f4741d0 con 0x555d9f518ae0 2024-07-24T22:07:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.404+0000 7f894effd640 10 client.15600 handle_command_reply: tid=0 2024-07-24T22:07:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.404+0000 7f8978e30740 1 client.15600 shutdown 2024-07-24T22:07:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.404+0000 7f8978e30740 1 -- 172.21.15.47:0/3111107913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 msgr2=0x555d9f508980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.404+0000 7f8978e30740 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 0x555d9f508980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8960000f80 tx=0x7f896002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.404+0000 7f8978e30740 1 -- 172.21.15.47:0/3111107913 shutdown_connections 2024-07-24T22:07:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.404+0000 7f8978e30740 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555d9f518ae0 0x555d9f51af10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.404+0000 7f8978e30740 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f509170 0x555d9f5063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.404+0000 7f8978e30740 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f505e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.404+0000 7f894effd640 0 client.15600 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.404+0000 7f8978e30740 1 --2- 172.21.15.47:0/3111107913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 0x555d9f508980 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.404+0000 7f8978e30740 1 -- 172.21.15.47:0/3111107913 >> 172.21.15.47:0/3111107913 conn(0x555d9f4fa6f0 msgr2=0x555d9f500290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.405+0000 7f8978e30740 1 -- 172.21.15.47:0/3111107913 shutdown_connections 2024-07-24T22:07:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.405+0000 7f8978e30740 1 -- 172.21.15.47:0/3111107913 wait complete. 2024-07-24T22:07:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.405+0000 7f8978e30740 20 client.15600 trim_cache size 0 max 16384 2024-07-24T22:07:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.421+0000 7f8978e30740 1 Processor -- start 2024-07-24T22:07:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.421+0000 7f8978e30740 1 -- start start 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.421+0000 7f8978e30740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fa6f0 0x555d9f514fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.421+0000 7f8978e30740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 0x555d9f520820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.421+0000 7f8978e30740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f520d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.421+0000 7f8978e30740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89701ae380 con 0x555d9f4fc8c0 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.421+0000 7f8978e30740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f89701b0c00 con 0x555d9f4fd1e0 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.421+0000 7f8978e30740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f89701ae9f0 con 0x555d9f4fa6f0 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f896effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 0x555d9f520820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f896effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 0x555d9f520820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49674/0 (socket says 172.21.15.47:49674) 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f896effd640 1 -- 172.21.15.47:0/3643517715 learned_addr learned my addr 172.21.15.47:0/3643517715 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f896ffff640 1 --2- 172.21.15.47:0/3643517715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f520d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f896f7fe640 1 --2- 172.21.15.47:0/3643517715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fa6f0 0x555d9f514fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f896effd640 1 -- 172.21.15.47:0/3643517715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fa6f0 msgr2=0x555d9f514fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f896effd640 1 --2- 172.21.15.47:0/3643517715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fa6f0 0x555d9f514fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f896effd640 1 -- 172.21.15.47:0/3643517715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 msgr2=0x555d9f520d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f896effd640 1 --2- 172.21.15.47:0/3643517715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f520d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f896effd640 1 -- 172.21.15.47:0/3643517715 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d9f505a40 con 0x555d9f4fc8c0 2024-07-24T22:07:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f896effd640 1 --2- 172.21.15.47:0/3643517715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 0x555d9f520820 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f895800c6a0 tx=0x7f89580e4630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e139a4f21a153d1d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f89657fa640 1 -- 172.21.15.47:0/3643517715 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89580b3fd0 con 0x555d9f4fc8c0 2024-07-24T22:07:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f89657fa640 1 -- 172.21.15.47:0/3643517715 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8958010a90 con 0x555d9f4fc8c0 2024-07-24T22:07:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.422+0000 7f89657fa640 1 -- 172.21.15.47:0/3643517715 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958018b20 con 0x555d9f4fc8c0 2024-07-24T22:07:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.423+0000 7f8978e30740 1 -- 172.21.15.47:0/3643517715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 msgr2=0x555d9f520820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.423+0000 7f8978e30740 1 --2- 172.21.15.47:0/3643517715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 0x555d9f520820 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f895800c6a0 tx=0x7f89580e4630 comp rx=0 tx=0).stop 2024-07-24T22:07:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.423+0000 7f8978e30740 1 -- 172.21.15.47:0/3643517715 shutdown_connections 2024-07-24T22:07:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.423+0000 7f8978e30740 1 --2- 172.21.15.47:0/3643517715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f520d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.423+0000 7f8978e30740 1 --2- 172.21.15.47:0/3643517715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fc8c0 0x555d9f520820 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.423+0000 7f8978e30740 1 --2- 172.21.15.47:0/3643517715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fa6f0 0x555d9f514fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.423+0000 7f8978e30740 1 -- 172.21.15.47:0/3643517715 >> 172.21.15.47:0/3643517715 conn(0x555d9f508ae0 msgr2=0x555d9f505330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.423+0000 7f8978e30740 1 -- 172.21.15.47:0/3643517715 shutdown_connections 2024-07-24T22:07:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.423+0000 7f8978e30740 1 -- 172.21.15.47:0/3643517715 wait complete. 2024-07-24T22:07:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.423+0000 7f8978e30740 1 -- start start 2024-07-24T22:07:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f8978e30740 1 Processor -- start 2024-07-24T22:07:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f8978e30740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fa6f0 0x555d9f511530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f8978e30740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fc8c0 0x555d9f50ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f8978e30740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f50ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f8978e30740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89701af0c0 con 0x555d9f4fa6f0 2024-07-24T22:07:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f8978e30740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f89701b0530 con 0x555d9f4fd1e0 2024-07-24T22:07:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f8978e30740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f89701af790 con 0x555d9f4fc8c0 2024-07-24T22:07:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f8978e30740 10 client.0 _ll_register_callbacks cb 0x7f8960009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:07:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f896f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fa6f0 0x555d9f511530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f896f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fa6f0 0x555d9f511530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49682/0 (socket says 172.21.15.47:49682) 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f896f7fe640 1 -- 172.21.15.47:0/1453092662 learned_addr learned my addr 172.21.15.47:0/1453092662 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f896effd640 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fc8c0 0x555d9f50ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f896ffff640 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f50ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f896f7fe640 1 -- 172.21.15.47:0/1453092662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fc8c0 msgr2=0x555d9f50ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f896f7fe640 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fc8c0 0x555d9f50ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f896f7fe640 1 -- 172.21.15.47:0/1453092662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 msgr2=0x555d9f50ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f896f7fe640 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f50ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f896f7fe640 1 -- 172.21.15.47:0/1453092662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d9f50f510 con 0x555d9f4fa6f0 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.424+0000 7f896ffff640 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f50ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f896f7fe640 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fa6f0 0x555d9f511530 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8960009ca0 tx=0x7f896002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4446095e930b5d72 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f894effd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f894effd640 1 -- 172.21.15.47:0/1453092662 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960031af0 con 0x555d9f4fa6f0 2024-07-24T22:07:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f894effd640 1 -- 172.21.15.47:0/1453092662 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8960003b80 con 0x555d9f4fa6f0 2024-07-24T22:07:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f8978e30740 1 -- 172.21.15.47:0/1453092662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8958010a90 con 0x555d9f4fa6f0 2024-07-24T22:07:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f894effd640 1 -- 172.21.15.47:0/1453092662 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8960068050 con 0x555d9f4fa6f0 2024-07-24T22:07:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f8978e30740 10 client.15606 fetch_fsmap learned FSMap version 20 2024-07-24T22:07:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f8978e30740 1 -- 172.21.15.47:0/1453092662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555d9f583660 con 0x555d9f4fa6f0 2024-07-24T22:07:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f894effd640 1 -- 172.21.15.47:0/1453092662 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8958010a90 con 0x555d9f4fa6f0 2024-07-24T22:07:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f894effd640 1 -- 172.21.15.47:0/1453092662 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8960051040 con 0x555d9f4fa6f0 2024-07-24T22:07:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f8978e30740 10 client.15606 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:07:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f8978e30740 10 client.15606 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:07:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f8978e30740 20 client.15606 populate_metadata read hostname 'smithi047' 2024-07-24T22:07:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f8978e30740 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555d9f509170 0x555d9f585dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f8978e30740 4 client.15606 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:07:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.425+0000 7f8978e30740 1 -- 172.21.15.47:0/1453092662 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555d9f46fc70 con 0x555d9f509170 2024-07-24T22:07:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.426+0000 7f896effd640 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555d9f509170 0x555d9f585dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.426+0000 7f894effd640 10 client.15606 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.426+0000 7f896effd640 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555d9f509170 0x555d9f585dc0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aca15016f29fa9ea server_cookie=7aaf2d3c1acacf14 in_seq=0 out_seq=0 2024-07-24T22:07:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f894effd640 1 -- 172.21.15.47:0/1453092662 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555d9f46fc70 con 0x555d9f509170 2024-07-24T22:07:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f894effd640 10 client.15606 handle_command_reply: tid=0 2024-07-24T22:07:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f8978e30740 1 client.15606 shutdown 2024-07-24T22:07:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f8978e30740 1 -- 172.21.15.47:0/1453092662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fa6f0 msgr2=0x555d9f511530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f8978e30740 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fa6f0 0x555d9f511530 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8960009ca0 tx=0x7f896002f380 comp rx=0 tx=0).stop 2024-07-24T22:07:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f8978e30740 1 -- 172.21.15.47:0/1453092662 shutdown_connections 2024-07-24T22:07:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f8978e30740 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555d9f509170 0x555d9f585dc0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f8978e30740 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555d9f4fd1e0 0x555d9f50ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f8978e30740 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555d9f4fc8c0 0x555d9f50ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f894effd640 0 client.15606 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:07:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f8978e30740 1 --2- 172.21.15.47:0/1453092662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555d9f4fa6f0 0x555d9f511530 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f8978e30740 1 -- 172.21.15.47:0/1453092662 >> 172.21.15.47:0/1453092662 conn(0x555d9f508ae0 msgr2=0x555d9f4f8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f8978e30740 1 -- 172.21.15.47:0/1453092662 shutdown_connections 2024-07-24T22:07:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f8978e30740 1 -- 172.21.15.47:0/1453092662 wait complete. 2024-07-24T22:07:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.430+0000 7f8978e30740 20 client.15606 trim_cache size 0 max 16384 2024-07-24T22:07:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:07:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:07:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:07:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:07:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.431+0000 7f89760e1640 1 -- 172.21.15.47:0/543184138 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f895c0b3d40 msgr2=0x7f895c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.431+0000 7f89760e1640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f895c0b3d40 0x7f895c0b6200 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x555d9f4ffa40 tx=0x7f8960009360 comp rx=0 tx=0).stop 2024-07-24T22:07:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.431+0000 7f89760e1640 1 -- 172.21.15.47:0/543184138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89701080a0 msgr2=0x7f89700753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.431+0000 7f89760e1640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89701080a0 0x7f89700753d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f895800e9f0 tx=0x7f895800eeb0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.431+0000 7f89760e1640 1 -- 172.21.15.47:0/543184138 shutdown_connections 2024-07-24T22:07:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.431+0000 7f89760e1640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f895c0b3d40 0x7f895c0b6200 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.431+0000 7f89760e1640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8970108a20 0x7f8970075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.431+0000 7f89760e1640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89701080a0 0x7f89700753d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.431+0000 7f89760e1640 1 --2- 172.21.15.47:0/543184138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89701026a0 0x7f8970074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.431+0000 7f89760e1640 1 -- 172.21.15.47:0/543184138 >> 172.21.15.47:0/543184138 conn(0x7f89700fe0e0 msgr2=0x7f89700fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.431+0000 7f89760e1640 1 -- 172.21.15.47:0/543184138 shutdown_connections 2024-07-24T22:07:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:07:48.431+0000 7f89760e1640 1 -- 172.21.15.47:0/543184138 wait complete. 2024-07-24T22:07:49.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:49 smithi183 ceph-mon[37007]: pgmap v384: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-07-24T22:07:49.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:49 smithi047 ceph-mon[32551]: pgmap v384: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-07-24T22:07:49.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:49 smithi188 ceph-mon[37380]: pgmap v384: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-07-24T22:07:51.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:51 smithi183 ceph-mon[37007]: pgmap v385: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:51.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:51 smithi047 ceph-mon[32551]: pgmap v385: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:51.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:51 smithi188 ceph-mon[37380]: pgmap v385: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:53.207 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-24T22:07:53.207 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-07-24T22:07:53.207 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:07:53.489 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:53.613 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:53 smithi047 ceph-mon[32551]: pgmap v386: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:53 smithi183 ceph-mon[37007]: pgmap v386: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:53.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:53 smithi188 ceph-mon[37380]: pgmap v386: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:55.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:55 smithi183 ceph-mon[37007]: pgmap v387: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:55.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:55 smithi047 ceph-mon[32551]: pgmap v387: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:55.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:55 smithi188 ceph-mon[37380]: pgmap v387: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:57.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:57 smithi183 ceph-mon[37007]: pgmap v388: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:57 smithi047 ceph-mon[32551]: pgmap v388: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:57.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:57 smithi188 ceph-mon[37380]: pgmap v388: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:58.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.251+0000 7f7916880640 1 -- 172.21.15.47:0/1332411362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7910101650 msgr2=0x7f7910101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:58.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.251+0000 7f7916880640 1 --2- 172.21.15.47:0/1332411362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7910101650 0x7f7910101a30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7900009900 tx=0x7f790002a410 comp rx=0 tx=0).stop 2024-07-24T22:07:58.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.251+0000 7f7916880640 1 -- 172.21.15.47:0/1332411362 shutdown_connections 2024-07-24T22:07:58.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.251+0000 7f7916880640 1 --2- 172.21.15.47:0/1332411362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79101079e0 0x7f791010e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:58.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.251+0000 7f7916880640 1 --2- 172.21.15.47:0/1332411362 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7910107060 0x7f79101074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:58.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.251+0000 7f7916880640 1 --2- 172.21.15.47:0/1332411362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7910101650 0x7f7910101a30 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:58.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.251+0000 7f7916880640 1 -- 172.21.15.47:0/1332411362 >> 172.21.15.47:0/1332411362 conn(0x7f79100fd0c0 msgr2=0x7f79100ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.252+0000 7f7916880640 1 -- 172.21.15.47:0/1332411362 shutdown_connections 2024-07-24T22:07:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.252+0000 7f7916880640 1 -- 172.21.15.47:0/1332411362 wait complete. 2024-07-24T22:07:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.252+0000 7f7916880640 1 Processor -- start 2024-07-24T22:07:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.252+0000 7f7916880640 1 -- start start 2024-07-24T22:07:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f7916880640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7910101650 0x7f7910198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f7916880640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7910107060 0x7f7910199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f7916880640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79101079e0 0x7f791019e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f790ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7910101650 0x7f7910198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f790ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7910101650 0x7f7910198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35910/0 (socket says 172.21.15.47:35910) 2024-07-24T22:07:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f7916880640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f79101127c0 con 0x7f7910101650 2024-07-24T22:07:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f790ffff640 1 -- 172.21.15.47:0/2033025182 learned_addr learned my addr 172.21.15.47:0/2033025182 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:07:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f7916880640 1 -- 172.21.15.47:0/2033025182 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7910112640 con 0x7f79101079e0 2024-07-24T22:07:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f7916880640 1 -- 172.21.15.47:0/2033025182 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7910112940 con 0x7f7910107060 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f790f7fe640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7910107060 0x7f7910199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f7914e1d640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79101079e0 0x7f791019e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f790ffff640 1 -- 172.21.15.47:0/2033025182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7910107060 msgr2=0x7f7910199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f790ffff640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7910107060 0x7f7910199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f790ffff640 1 -- 172.21.15.47:0/2033025182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79101079e0 msgr2=0x7f791019e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f790ffff640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79101079e0 0x7f791019e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.253+0000 7f790ffff640 1 -- 172.21.15.47:0/2033025182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791019eda0 con 0x7f7910101650 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.254+0000 7f790ffff640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7910101650 0x7f7910198cf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7900005940 tx=0x7f79000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.254+0000 7f790d7fa640 1 -- 172.21.15.47:0/2033025182 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790003f030 con 0x7f7910101650 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.254+0000 7f790d7fa640 1 -- 172.21.15.47:0/2033025182 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7900003cb0 con 0x7f7910101650 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.254+0000 7f790d7fa640 1 -- 172.21.15.47:0/2033025182 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900035070 con 0x7f7910101650 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.254+0000 7f7916880640 1 -- 172.21.15.47:0/2033025182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791019f030 con 0x7f7910101650 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.254+0000 7f7916880640 1 -- 172.21.15.47:0/2033025182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79101a5750 con 0x7f7910101650 2024-07-24T22:07:58.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.256+0000 7f7916880640 1 -- 172.21.15.47:0/2033025182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7910101a30 con 0x7f7910101650 2024-07-24T22:07:58.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.258+0000 7f790d7fa640 1 -- 172.21.15.47:0/2033025182 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f7900042030 con 0x7f7910101650 2024-07-24T22:07:58.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.259+0000 7f790d7fa640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f78f80b3e40 0x7f78f80b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:07:58.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.259+0000 7f790f7fe640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f78f80b3e40 0x7f78f80b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:07:58.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.259+0000 7f790d7fa640 1 -- 172.21.15.47:0/2033025182 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f7900104c80 con 0x7f7910101650 2024-07-24T22:07:58.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.260+0000 7f790f7fe640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f78f80b3e40 0x7f78f80b6300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7910106b20 tx=0x7f790400b590 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:07:58.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.263+0000 7f790d7fa640 1 -- 172.21.15.47:0/2033025182 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f79000cbf30 con 0x7f7910101650 2024-07-24T22:07:58.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.671+0000 7f7916880640 1 -- 172.21.15.47:0/2033025182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7910199e20 con 0x7f7910101650 2024-07-24T22:07:58.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.672+0000 7f790d7fa640 1 -- 172.21.15.47:0/2033025182 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f79000d4020 con 0x7f7910101650 2024-07-24T22:07:58.674 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:07:58.675 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:07:58.675 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:07:58.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.674+0000 7f7916880640 1 -- 172.21.15.47:0/2033025182 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f78f80b3e40 msgr2=0x7f78f80b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.674+0000 7f7916880640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f78f80b3e40 0x7f78f80b6300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7910106b20 tx=0x7f790400b590 comp rx=0 tx=0).stop 2024-07-24T22:07:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.674+0000 7f7916880640 1 -- 172.21.15.47:0/2033025182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7910101650 msgr2=0x7f7910198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:07:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.674+0000 7f7916880640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7910101650 0x7f7910198cf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7900005940 tx=0x7f79000042f0 comp rx=0 tx=0).stop 2024-07-24T22:07:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.674+0000 7f7916880640 1 -- 172.21.15.47:0/2033025182 shutdown_connections 2024-07-24T22:07:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.674+0000 7f7916880640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f78f80b3e40 0x7f78f80b6300 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.674+0000 7f7916880640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79101079e0 0x7f791019e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.674+0000 7f7916880640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7910107060 0x7f7910199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.674+0000 7f7916880640 1 --2- 172.21.15.47:0/2033025182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7910101650 0x7f7910198cf0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:07:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.674+0000 7f7916880640 1 -- 172.21.15.47:0/2033025182 >> 172.21.15.47:0/2033025182 conn(0x7f79100fd0c0 msgr2=0x7f79100ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:07:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.675+0000 7f7916880640 1 -- 172.21.15.47:0/2033025182 shutdown_connections 2024-07-24T22:07:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:07:58.675+0000 7f7916880640 1 -- 172.21.15.47:0/2033025182 wait complete. 2024-07-24T22:07:59.426 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-07-24T22:07:59.427 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-07-24T22:07:59.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:59 smithi183 ceph-mon[37007]: pgmap v389: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:59.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:07:59 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2033025182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:59.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:59 smithi047 ceph-mon[32551]: pgmap v389: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:59.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:07:59 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2033025182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:07:59.773 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:07:59.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:59 smithi188 ceph-mon[37380]: pgmap v389: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:07:59.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:07:59 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2033025182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:01.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.365+0000 7fc07f320640 1 -- 172.21.15.47:0/4081232724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc078074eb0 msgr2=0x7fc078075290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.365+0000 7fc07f320640 1 --2- 172.21.15.47:0/4081232724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc078074eb0 0x7fc078075290 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc074009900 tx=0x7fc07402a410 comp rx=0 tx=0).stop 2024-07-24T22:08:01.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.365+0000 7fc07f320640 1 -- 172.21.15.47:0/4081232724 shutdown_connections 2024-07-24T22:08:01.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.365+0000 7fc07f320640 1 --2- 172.21.15.47:0/4081232724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc07810ed70 0x7fc078111160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.365+0000 7fc07f320640 1 --2- 172.21.15.47:0/4081232724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0780757d0 0x7fc07810e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.365+0000 7fc07f320640 1 --2- 172.21.15.47:0/4081232724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc078074eb0 0x7fc078075290 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.365+0000 7fc07f320640 1 -- 172.21.15.47:0/4081232724 >> 172.21.15.47:0/4081232724 conn(0x7fc0780fe210 msgr2=0x7fc078100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:01.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.365+0000 7fc07f320640 1 -- 172.21.15.47:0/4081232724 shutdown_connections 2024-07-24T22:08:01.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.365+0000 7fc07f320640 1 -- 172.21.15.47:0/4081232724 wait complete. 2024-07-24T22:08:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.366+0000 7fc07f320640 1 Processor -- start 2024-07-24T22:08:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.367+0000 7fc07f320640 1 -- start start 2024-07-24T22:08:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.367+0000 7fc07f320640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc078074eb0 0x7fc07819aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.367+0000 7fc07f320640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0780757d0 0x7fc07819b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.367+0000 7fc07f320640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc07810ed70 0x7fc0781a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.367+0000 7fc07f320640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc0781149b0 con 0x7fc07810ed70 2024-07-24T22:08:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.367+0000 7fc07f320640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc078114830 con 0x7fc0780757d0 2024-07-24T22:08:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.367+0000 7fc07f320640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc078114b30 con 0x7fc078074eb0 2024-07-24T22:08:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.367+0000 7fc07d8bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc07810ed70 0x7fc0781a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.367+0000 7fc07d8bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc07810ed70 0x7fc0781a07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35926/0 (socket says 172.21.15.47:35926) 2024-07-24T22:08:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.367+0000 7fc07d8bd640 1 -- 172.21.15.47:0/748423466 learned_addr learned my addr 172.21.15.47:0/748423466 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.367+0000 7fc07d0bc640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc078074eb0 0x7fc07819aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.368+0000 7fc07d8bd640 1 -- 172.21.15.47:0/748423466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc078074eb0 msgr2=0x7fc07819aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.368+0000 7fc07d8bd640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc078074eb0 0x7fc07819aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.368+0000 7fc07d8bd640 1 -- 172.21.15.47:0/748423466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0780757d0 msgr2=0x7fc07819b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.368+0000 7fc07c8bb640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0780757d0 0x7fc07819b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.368+0000 7fc07d8bd640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0780757d0 0x7fc07819b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.368+0000 7fc07d8bd640 1 -- 172.21.15.47:0/748423466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0781a0f90 con 0x7fc07810ed70 2024-07-24T22:08:01.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.368+0000 7fc07d8bd640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc07810ed70 0x7fc0781a07c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc070009fd0 tx=0x7fc07000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:01.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.368+0000 7fc06e7fc640 1 -- 172.21.15.47:0/748423466 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc070004d20 con 0x7fc07810ed70 2024-07-24T22:08:01.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.368+0000 7fc06e7fc640 1 -- 172.21.15.47:0/748423466 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc070005020 con 0x7fc07810ed70 2024-07-24T22:08:01.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.369+0000 7fc07f320640 1 -- 172.21.15.47:0/748423466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0781a1280 con 0x7fc07810ed70 2024-07-24T22:08:01.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.369+0000 7fc06e7fc640 1 -- 172.21.15.47:0/748423466 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0700116b0 con 0x7fc07810ed70 2024-07-24T22:08:01.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.369+0000 7fc07f320640 1 -- 172.21.15.47:0/748423466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0781a79c0 con 0x7fc07810ed70 2024-07-24T22:08:01.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.372+0000 7fc0816d1740 1 Processor -- start 2024-07-24T22:08:01.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.373+0000 7fc06e7fc640 1 -- 172.21.15.47:0/748423466 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fc0700051d0 con 0x7fc07810ed70 2024-07-24T22:08:01.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.373+0000 7fc0816d1740 1 -- start start 2024-07-24T22:08:01.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.373+0000 7fc0816d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561754382ce0 0x5617543830c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.373+0000 7fc0816d1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 0x56175438f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.373+0000 7fc0816d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56175438f590 0x561754391980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.373+0000 7fc0816d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5617542f85e0 con 0x56175438f590 2024-07-24T22:08:01.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.373+0000 7fc0816d1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5617542e7ae0 con 0x561754383600 2024-07-24T22:08:01.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.373+0000 7fc0816d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5617542ebb20 con 0x561754382ce0 2024-07-24T22:08:01.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.373+0000 7fc07c8bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56175438f590 0x561754391980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.374+0000 7fc07c8bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56175438f590 0x561754391980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35940/0 (socket says 172.21.15.47:35940) 2024-07-24T22:08:01.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.374+0000 7fc07c8bb640 1 -- 172.21.15.47:0/4163994606 learned_addr learned my addr 172.21.15.47:0/4163994606 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:01.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.374+0000 7fc07c8bb640 1 --2- 172.21.15.47:0/4163994606 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561754382ce0 0x5617543830c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.374+0000 7fc07d0bc640 1 --2- 172.21.15.47:0/4163994606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 0x56175438f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.374+0000 7fc07c8bb640 1 -- 172.21.15.47:0/4163994606 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561754382ce0 msgr2=0x5617543830c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.374+0000 7fc07c8bb640 1 --2- 172.21.15.47:0/4163994606 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561754382ce0 0x5617543830c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.374+0000 7fc07c8bb640 1 -- 172.21.15.47:0/4163994606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 msgr2=0x56175438f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.374+0000 7fc07c8bb640 1 --2- 172.21.15.47:0/4163994606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 0x56175438f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.374+0000 7fc07c8bb640 1 -- 172.21.15.47:0/4163994606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56175427d2f0 con 0x56175438f590 2024-07-24T22:08:01.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.374+0000 7fc06e7fc640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc0640b3d40 0x7fc0640b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.375+0000 7fc06e7fc640 1 -- 172.21.15.47:0/748423466 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fc0700e4280 con 0x7fc07810ed70 2024-07-24T22:08:01.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.375+0000 7fc07d0bc640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc0640b3d40 0x7fc0640b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.375+0000 7fc07c8bb640 1 --2- 172.21.15.47:0/4163994606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56175438f590 0x561754391980 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc06800cf60 tx=0x7fc06800c170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd978ae5d9e5aebe server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:01.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.375+0000 7fc0637fe640 1 -- 172.21.15.47:0/4163994606 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06801d070 con 0x56175438f590 2024-07-24T22:08:01.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.375+0000 7fc0637fe640 1 -- 172.21.15.47:0/4163994606 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc068018b20 con 0x56175438f590 2024-07-24T22:08:01.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.375+0000 7fc0637fe640 1 -- 172.21.15.47:0/4163994606 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06800f040 con 0x56175438f590 2024-07-24T22:08:01.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.376+0000 7fc0816d1740 1 -- 172.21.15.47:0/4163994606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56175438f590 msgr2=0x561754391980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.376+0000 7fc07d0bc640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc0640b3d40 0x7fc0640b6200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc074031440 tx=0x7fc074005e60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:01.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.376+0000 7fc0816d1740 1 --2- 172.21.15.47:0/4163994606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56175438f590 0x561754391980 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc06800cf60 tx=0x7fc06800c170 comp rx=0 tx=0).stop 2024-07-24T22:08:01.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.376+0000 7fc0816d1740 1 -- 172.21.15.47:0/4163994606 shutdown_connections 2024-07-24T22:08:01.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.376+0000 7fc0816d1740 1 --2- 172.21.15.47:0/4163994606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56175438f590 0x561754391980 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.376+0000 7fc0816d1740 1 --2- 172.21.15.47:0/4163994606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 0x56175438f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.376+0000 7fc0816d1740 1 --2- 172.21.15.47:0/4163994606 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561754382ce0 0x5617543830c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.376+0000 7fc0816d1740 1 -- 172.21.15.47:0/4163994606 >> 172.21.15.47:0/4163994606 conn(0x561754380b10 msgr2=0x561754381cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.376+0000 7fc0816d1740 1 -- 172.21.15.47:0/4163994606 shutdown_connections 2024-07-24T22:08:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.376+0000 7fc0816d1740 1 -- 172.21.15.47:0/4163994606 wait complete. 2024-07-24T22:08:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.376+0000 7fc0816d1740 1 -- start start 2024-07-24T22:08:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.377+0000 7fc0816d1740 1 Processor -- start 2024-07-24T22:08:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.377+0000 7fc0816d1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754382ce0 0x56175438c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.377+0000 7fc0816d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561754383600 0x56175438ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.377+0000 7fc0816d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56175438f590 0x56175438cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.377+0000 7fc0816d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56175414b7b0 con 0x561754383600 2024-07-24T22:08:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.377+0000 7fc0816d1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56175428a100 con 0x561754382ce0 2024-07-24T22:08:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.377+0000 7fc0816d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5617543922b0 con 0x56175438f590 2024-07-24T22:08:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.378+0000 7fc07d0bc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754382ce0 0x56175438c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.378+0000 7fc07d0bc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754382ce0 0x56175438c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:59974/0 (socket says 172.21.15.47:59974) 2024-07-24T22:08:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.378+0000 7fc07d0bc640 1 -- 172.21.15.47:0/4246336289 learned_addr learned my addr 172.21.15.47:0/4246336289 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.378+0000 7fc07c8bb640 1 --2- 172.21.15.47:0/4246336289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561754383600 0x56175438ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.378+0000 7fc07d8bd640 1 --2- 172.21.15.47:0/4246336289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56175438f590 0x56175438cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.378+0000 7fc07c8bb640 1 -- 172.21.15.47:0/4246336289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56175438f590 msgr2=0x56175438cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.378+0000 7fc07c8bb640 1 --2- 172.21.15.47:0/4246336289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56175438f590 0x56175438cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.378+0000 7fc07c8bb640 1 -- 172.21.15.47:0/4246336289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754382ce0 msgr2=0x56175438c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.378+0000 7fc07c8bb640 1 --2- 172.21.15.47:0/4246336289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754382ce0 0x56175438c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.378+0000 7fc07c8bb640 1 -- 172.21.15.47:0/4246336289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56175428de50 con 0x561754383600 2024-07-24T22:08:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.378+0000 7fc0816d1740 10 client.0 _ll_register_callbacks cb 0x5617542e0630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.378+0000 7fc0816d1740 1 -- 172.21.15.47:0/4246336289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc068018b20 con 0x561754383600 2024-07-24T22:08:01.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.379+0000 7fc07c8bb640 1 --2- 172.21.15.47:0/4246336289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561754383600 0x56175438ca80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc068016560 tx=0x7fc068018720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25bccdeb85f3b295 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:01.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.379+0000 7fc060ff9640 10 client.15624 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:01.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.382+0000 7fc060ff9640 1 -- 172.21.15.47:0/4246336289 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06801d070 con 0x561754383600 2024-07-24T22:08:01.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.382+0000 7fc060ff9640 1 -- 172.21.15.47:0/4246336289 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fc068016600 con 0x561754383600 2024-07-24T22:08:01.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.382+0000 7fc060ff9640 1 -- 172.21.15.47:0/4246336289 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc068016860 con 0x561754383600 2024-07-24T22:08:01.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.382+0000 7fc0816d1740 10 client.15624 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:01.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.382+0000 7fc0816d1740 1 -- 172.21.15.47:0/4246336289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({fsmap=20}) -- 0x561754057ba0 con 0x561754383600 2024-07-24T22:08:01.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.383+0000 7fc060ff9640 1 -- 172.21.15.47:0/4246336289 <== mon.0 v2:172.21.15.47:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc068015050 con 0x561754383600 2024-07-24T22:08:01.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.383+0000 7fc0816d1740 10 client.15624 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:01.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.383+0000 7fc0816d1740 10 client.15624 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:08:01.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.383+0000 7fc0816d1740 20 client.15624 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:01.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.383+0000 7fc0816d1740 1 --2- 172.21.15.47:0/4246336289 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5617543a7550 0x5617543a9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.383+0000 7fc0816d1740 4 client.15624 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:01.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.383+0000 7fc0816d1740 1 -- 172.21.15.47:0/4246336289 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617542fa530 con 0x5617543a7550 2024-07-24T22:08:01.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.383+0000 7fc07d0bc640 1 --2- 172.21.15.47:0/4246336289 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5617543a7550 0x5617543a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.384+0000 7fc060ff9640 10 client.15624 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:01.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.384+0000 7fc07d0bc640 1 --2- 172.21.15.47:0/4246336289 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5617543a7550 0x5617543a9940 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ce6d8417b6466bb server_cookie=5a01c748ed81e99 in_seq=0 out_seq=0 2024-07-24T22:08:01.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.385+0000 7fc060ff9640 1 -- 172.21.15.47:0/4246336289 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5617542fa530 con 0x5617543a7550 2024-07-24T22:08:01.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.385+0000 7fc060ff9640 10 client.15624 handle_command_reply: tid=0 2024-07-24T22:08:01.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.385+0000 7fc0816d1740 1 client.15624 shutdown 2024-07-24T22:08:01.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.385+0000 7fc0816d1740 1 -- 172.21.15.47:0/4246336289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561754383600 msgr2=0x56175438ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.385+0000 7fc0816d1740 1 --2- 172.21.15.47:0/4246336289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561754383600 0x56175438ca80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc068016560 tx=0x7fc068018720 comp rx=0 tx=0).stop 2024-07-24T22:08:01.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.385+0000 7fc0816d1740 1 -- 172.21.15.47:0/4246336289 shutdown_connections 2024-07-24T22:08:01.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.385+0000 7fc0816d1740 1 --2- 172.21.15.47:0/4246336289 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5617543a7550 0x5617543a9940 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.385+0000 7fc0816d1740 1 --2- 172.21.15.47:0/4246336289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56175438f590 0x56175438cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.385+0000 7fc0816d1740 1 --2- 172.21.15.47:0/4246336289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561754383600 0x56175438ca80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.385+0000 7fc0816d1740 1 --2- 172.21.15.47:0/4246336289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754382ce0 0x56175438c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.385+0000 7fc0816d1740 1 -- 172.21.15.47:0/4246336289 >> 172.21.15.47:0/4246336289 conn(0x561754380b10 msgr2=0x5617543866b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:01.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.385+0000 7fc060ff9640 0 client.15624 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:01.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.385+0000 7fc0816d1740 1 -- 172.21.15.47:0/4246336289 shutdown_connections 2024-07-24T22:08:01.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.386+0000 7fc0816d1740 1 -- 172.21.15.47:0/4246336289 wait complete. 2024-07-24T22:08:01.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.386+0000 7fc0816d1740 20 client.15624 trim_cache size 0 max 16384 2024-07-24T22:08:01.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.421+0000 7fc0816d1740 1 Processor -- start 2024-07-24T22:08:01.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.421+0000 7fc0816d1740 1 -- start start 2024-07-24T22:08:01.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.421+0000 7fc0816d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561754382ce0 0x561754386e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.421+0000 7fc0816d1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 0x56175437fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.421+0000 7fc0816d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56175438f590 0x5617543aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.421+0000 7fc0816d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc0781aa000 con 0x56175438f590 2024-07-24T22:08:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.421+0000 7fc0816d1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc0781ac880 con 0x561754383600 2024-07-24T22:08:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.421+0000 7fc0816d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc0781aa670 con 0x561754382ce0 2024-07-24T22:08:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.422+0000 7fc07d0bc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561754382ce0 0x561754386e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.422+0000 7fc07d8bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56175438f590 0x5617543aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.422+0000 7fc07d0bc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561754382ce0 0x561754386e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:33084/0 (socket says 172.21.15.47:33084) 2024-07-24T22:08:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.422+0000 7fc07d0bc640 1 -- 172.21.15.47:0/1666201299 learned_addr learned my addr 172.21.15.47:0/1666201299 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.422+0000 7fc07c8bb640 1 --2- 172.21.15.47:0/1666201299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 0x56175437fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.422+0000 7fc07d0bc640 1 -- 172.21.15.47:0/1666201299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 msgr2=0x56175437fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.422+0000 7fc07d0bc640 1 --2- 172.21.15.47:0/1666201299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 0x56175437fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.422+0000 7fc07d0bc640 1 -- 172.21.15.47:0/1666201299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56175438f590 msgr2=0x5617543aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.422+0000 7fc07d0bc640 1 --2- 172.21.15.47:0/1666201299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56175438f590 0x5617543aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.422+0000 7fc07d0bc640 1 -- 172.21.15.47:0/1666201299 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56175438d810 con 0x561754382ce0 2024-07-24T22:08:01.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.422+0000 7fc07d0bc640 1 --2- 172.21.15.47:0/1666201299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561754382ce0 0x561754386e30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc074032e10 tx=0x7fc07403f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f861330f893d81e4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:01.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.423+0000 7fc062ffd640 1 -- 172.21.15.47:0/1666201299 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074035040 con 0x561754382ce0 2024-07-24T22:08:01.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.423+0000 7fc062ffd640 1 -- 172.21.15.47:0/1666201299 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc074059070 con 0x561754382ce0 2024-07-24T22:08:01.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.423+0000 7fc062ffd640 1 -- 172.21.15.47:0/1666201299 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074053770 con 0x561754382ce0 2024-07-24T22:08:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.423+0000 7fc0816d1740 1 -- 172.21.15.47:0/1666201299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561754382ce0 msgr2=0x561754386e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.423+0000 7fc0816d1740 1 --2- 172.21.15.47:0/1666201299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561754382ce0 0x561754386e30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc074032e10 tx=0x7fc07403f000 comp rx=0 tx=0).stop 2024-07-24T22:08:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.424+0000 7fc0816d1740 1 -- 172.21.15.47:0/1666201299 shutdown_connections 2024-07-24T22:08:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.424+0000 7fc0816d1740 1 --2- 172.21.15.47:0/1666201299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56175438f590 0x5617543aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.424+0000 7fc0816d1740 1 --2- 172.21.15.47:0/1666201299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 0x56175437fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.424+0000 7fc0816d1740 1 --2- 172.21.15.47:0/1666201299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561754382ce0 0x561754386e30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.424+0000 7fc0816d1740 1 -- 172.21.15.47:0/1666201299 >> 172.21.15.47:0/1666201299 conn(0x561754380b10 msgr2=0x56175438cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.424+0000 7fc0816d1740 1 -- 172.21.15.47:0/1666201299 shutdown_connections 2024-07-24T22:08:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.424+0000 7fc0816d1740 1 -- 172.21.15.47:0/1666201299 wait complete. 2024-07-24T22:08:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.424+0000 7fc0816d1740 1 -- start start 2024-07-24T22:08:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.424+0000 7fc0816d1740 1 Processor -- start 2024-07-24T22:08:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc0816d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561754382ce0 0x5617543a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc0816d1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 0x5617543895e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc0816d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56175438f590 0x561754389d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc0816d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc0781aad40 con 0x561754382ce0 2024-07-24T22:08:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc0816d1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc0781ac1b0 con 0x561754383600 2024-07-24T22:08:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc0816d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc0781ab410 con 0x56175438f590 2024-07-24T22:08:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc0816d1740 10 client.0 _ll_register_callbacks cb 0x7fc06801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc07d0bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561754382ce0 0x5617543a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc07d0bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561754382ce0 0x5617543a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35964/0 (socket says 172.21.15.47:35964) 2024-07-24T22:08:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc07d0bc640 1 -- 172.21.15.47:0/1801837491 learned_addr learned my addr 172.21.15.47:0/1801837491 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc07d8bd640 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56175438f590 0x561754389d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc07c8bb640 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 0x5617543895e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc07d0bc640 1 -- 172.21.15.47:0/1801837491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56175438f590 msgr2=0x561754389d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc07d0bc640 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56175438f590 0x561754389d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc07d0bc640 1 -- 172.21.15.47:0/1801837491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 msgr2=0x5617543895e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc07d0bc640 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 0x5617543895e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc07d0bc640 1 -- 172.21.15.47:0/1801837491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561754410f10 con 0x561754382ce0 2024-07-24T22:08:01.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.425+0000 7fc07d8bd640 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56175438f590 0x561754389d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:01.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.426+0000 7fc07d0bc640 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561754382ce0 0x5617543a06f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc074009900 tx=0x7fc07402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a32b720c662a56 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:01.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.426+0000 7fc060ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:01.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.426+0000 7fc060ff9640 1 -- 172.21.15.47:0/1801837491 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074063070 con 0x561754382ce0 2024-07-24T22:08:01.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.426+0000 7fc060ff9640 1 -- 172.21.15.47:0/1801837491 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fc074005240 con 0x561754382ce0 2024-07-24T22:08:01.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.426+0000 7fc0816d1740 1 -- 172.21.15.47:0/1801837491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc074059070 con 0x561754382ce0 2024-07-24T22:08:01.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.426+0000 7fc060ff9640 1 -- 172.21.15.47:0/1801837491 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc074004490 con 0x561754382ce0 2024-07-24T22:08:01.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.426+0000 7fc0816d1740 10 client.15630 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:01.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.426+0000 7fc0816d1740 1 -- 172.21.15.47:0/1801837491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5617544121f0 con 0x561754382ce0 2024-07-24T22:08:01.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.426+0000 7fc060ff9640 1 -- 172.21.15.47:0/1801837491 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc074005440 con 0x561754382ce0 2024-07-24T22:08:01.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.427+0000 7fc060ff9640 1 -- 172.21.15.47:0/1801837491 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc0740535c0 con 0x561754382ce0 2024-07-24T22:08:01.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.427+0000 7fc0816d1740 10 client.15630 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:01.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.427+0000 7fc0816d1740 10 client.15630 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:08:01.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.427+0000 7fc0816d1740 20 client.15630 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:01.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.427+0000 7fc0816d1740 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5617544129e0 0x561754414e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.427+0000 7fc0816d1740 4 client.15630 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-07-24T22:08:01.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.427+0000 7fc0816d1740 1 -- 172.21.15.47:0/1801837491 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x7fc074059070 con 0x5617544129e0 2024-07-24T22:08:01.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.427+0000 7fc07c8bb640 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5617544129e0 0x561754414e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.428+0000 7fc060ff9640 10 client.15630 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:01.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.428+0000 7fc07c8bb640 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5617544129e0 0x561754414e00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95be8237c5b6b155 server_cookie=d3b9e2ff52e7c606 in_seq=0 out_seq=0 2024-07-24T22:08:01.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.440+0000 7fc060ff9640 1 -- 172.21.15.47:0/1801837491 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fc074059070 con 0x5617544129e0 2024-07-24T22:08:01.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.440+0000 7fc060ff9640 10 client.15630 handle_command_reply: tid=0 2024-07-24T22:08:01.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.440+0000 7fc0816d1740 1 client.15630 shutdown 2024-07-24T22:08:01.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.441+0000 7fc0816d1740 1 -- 172.21.15.47:0/1801837491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561754382ce0 msgr2=0x5617543a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.441+0000 7fc0816d1740 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561754382ce0 0x5617543a06f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc074009900 tx=0x7fc07402a410 comp rx=0 tx=0).stop 2024-07-24T22:08:01.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.441+0000 7fc0816d1740 1 -- 172.21.15.47:0/1801837491 shutdown_connections 2024-07-24T22:08:01.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.441+0000 7fc0816d1740 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5617544129e0 0x561754414e00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.441+0000 7fc0816d1740 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56175438f590 0x561754389d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.441+0000 7fc0816d1740 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561754383600 0x5617543895e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.441+0000 7fc060ff9640 0 client.15630 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:01.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.441+0000 7fc0816d1740 1 --2- 172.21.15.47:0/1801837491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561754382ce0 0x5617543a06f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.441+0000 7fc0816d1740 1 -- 172.21.15.47:0/1801837491 >> 172.21.15.47:0/1801837491 conn(0x561754380b10 msgr2=0x5617543a2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:01.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.441+0000 7fc0816d1740 1 -- 172.21.15.47:0/1801837491 shutdown_connections 2024-07-24T22:08:01.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.441+0000 7fc0816d1740 1 -- 172.21.15.47:0/1801837491 wait complete. 2024-07-24T22:08:01.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.441+0000 7fc0816d1740 20 client.15630 trim_cache size 0 max 16384 2024-07-24T22:08:01.444 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:08:01.444 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:08:01.444 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:08:01.444 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 2, 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: "84029a6d": { 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 2, 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 140.3, 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:08:01.445 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:08:01.446 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:08:01.446 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:08:01.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:01.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:01.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:01.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:01.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:01.446 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:08:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.442+0000 7fc07f320640 1 -- 172.21.15.47:0/748423466 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc0640b3d40 msgr2=0x7fc0640b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.442+0000 7fc07f320640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc0640b3d40 0x7fc0640b6200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc074031440 tx=0x7fc074005e60 comp rx=0 tx=0).stop 2024-07-24T22:08:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.442+0000 7fc07f320640 1 -- 172.21.15.47:0/748423466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc07810ed70 msgr2=0x7fc0781a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.442+0000 7fc07f320640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc07810ed70 0x7fc0781a07c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc070009fd0 tx=0x7fc07000ee60 comp rx=0 tx=0).stop 2024-07-24T22:08:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.442+0000 7fc07f320640 1 -- 172.21.15.47:0/748423466 shutdown_connections 2024-07-24T22:08:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.442+0000 7fc07f320640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc0640b3d40 0x7fc0640b6200 secure :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc074031440 tx=0x7fc074005e60 comp rx=0 tx=0).stop 2024-07-24T22:08:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.442+0000 7fc07f320640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc07810ed70 0x7fc0781a07c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.442+0000 7fc07f320640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0780757d0 0x7fc07819b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.442+0000 7fc07f320640 1 --2- 172.21.15.47:0/748423466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc078074eb0 0x7fc07819aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.442+0000 7fc07f320640 1 -- 172.21.15.47:0/748423466 >> 172.21.15.47:0/748423466 conn(0x7fc0780fe210 msgr2=0x7fc0780fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.442+0000 7fc07f320640 1 -- 172.21.15.47:0/748423466 shutdown_connections 2024-07-24T22:08:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:01.442+0000 7fc07f320640 1 -- 172.21.15.47:0/748423466 wait complete. 2024-07-24T22:08:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.535+0000 7f9e894c5640 1 -- 172.21.15.47:0/3841468380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8410c9f0 msgr2=0x7f9e8410ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.535+0000 7f9e894c5640 1 --2- 172.21.15.47:0/3841468380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8410c9f0 0x7f9e8410ee70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009ca0 tx=0x7f9e7c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.535+0000 7f9e894c5640 1 -- 172.21.15.47:0/3841468380 shutdown_connections 2024-07-24T22:08:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.535+0000 7f9e894c5640 1 --2- 172.21.15.47:0/3841468380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8410c9f0 0x7f9e8410ee70 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.535+0000 7f9e894c5640 1 --2- 172.21.15.47:0/3841468380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e84103ef0 0x7f9e8410c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.535+0000 7f9e894c5640 1 --2- 172.21.15.47:0/3841468380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e841035d0 0x7f9e841039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.535+0000 7f9e894c5640 1 -- 172.21.15.47:0/3841468380 >> 172.21.15.47:0/3841468380 conn(0x7f9e840782e0 msgr2=0x7f9e840ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:01.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.535+0000 7f9e894c5640 1 -- 172.21.15.47:0/3841468380 shutdown_connections 2024-07-24T22:08:01.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.535+0000 7f9e894c5640 1 -- 172.21.15.47:0/3841468380 wait complete. 2024-07-24T22:08:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.536+0000 7f9e894c5640 1 Processor -- start 2024-07-24T22:08:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.536+0000 7f9e894c5640 1 -- start start 2024-07-24T22:08:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.536+0000 7f9e894c5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e841035d0 0x7f9e84198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.536+0000 7f9e894c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e84103ef0 0x7f9e841990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.536+0000 7f9e894c5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8410c9f0 0x7f9e8419e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.536+0000 7f9e894c5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9e84112660 con 0x7f9e8410c9f0 2024-07-24T22:08:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.536+0000 7f9e894c5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9e841124e0 con 0x7f9e841035d0 2024-07-24T22:08:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.536+0000 7f9e894c5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9e841127e0 con 0x7f9e84103ef0 2024-07-24T22:08:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.536+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8410c9f0 0x7f9e8419e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.536+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8410c9f0 0x7f9e8419e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35976/0 (socket says 172.21.15.47:35976) 2024-07-24T22:08:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.536+0000 7f9e837fe640 1 -- 172.21.15.47:0/1369777832 learned_addr learned my addr 172.21.15.47:0/1369777832 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.536+0000 7f9e82ffd640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e841035d0 0x7f9e84198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.536+0000 7f9e7bfff640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e84103ef0 0x7f9e841990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.537+0000 7f9e837fe640 1 -- 172.21.15.47:0/1369777832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e84103ef0 msgr2=0x7f9e841990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.537+0000 7f9e837fe640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e84103ef0 0x7f9e841990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.537+0000 7f9e837fe640 1 -- 172.21.15.47:0/1369777832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e841035d0 msgr2=0x7f9e84198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.537+0000 7f9e837fe640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e841035d0 0x7f9e84198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.537+0000 7f9e837fe640 1 -- 172.21.15.47:0/1369777832 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8419ec40 con 0x7f9e8410c9f0 2024-07-24T22:08:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.537+0000 7f9e837fe640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8410c9f0 0x7f9e8419e470 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c005e30 tx=0x7f9e7c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.537+0000 7f9e80ff9640 1 -- 172.21.15.47:0/1369777832 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c003b70 con 0x7f9e8410c9f0 2024-07-24T22:08:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.537+0000 7f9e894c5640 1 -- 172.21.15.47:0/1369777832 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8419eed0 con 0x7f9e8410c9f0 2024-07-24T22:08:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.537+0000 7f9e80ff9640 1 -- 172.21.15.47:0/1369777832 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e7c003d10 con 0x7f9e8410c9f0 2024-07-24T22:08:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.537+0000 7f9e80ff9640 1 -- 172.21.15.47:0/1369777832 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c004620 con 0x7f9e8410c9f0 2024-07-24T22:08:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.539+0000 7f9e894c5640 1 -- 172.21.15.47:0/1369777832 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e84101150 con 0x7f9e8410c9f0 2024-07-24T22:08:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.540+0000 7f9e80ff9640 1 -- 172.21.15.47:0/1369777832 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f9e7c040820 con 0x7f9e8410c9f0 2024-07-24T22:08:01.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.541+0000 7f9e80ff9640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9e700b3dc0 0x7f9e700b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.541+0000 7f9e82ffd640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9e700b3dc0 0x7f9e700b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.541+0000 7f9e80ff9640 1 -- 172.21.15.47:0/1369777832 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f9e7c10d060 con 0x7f9e8410c9f0 2024-07-24T22:08:01.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.542+0000 7f9e82ffd640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9e700b3dc0 0x7f9e700b6280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9e74005d00 tx=0x7f9e7400b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:01.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.543+0000 7f9e8c218740 1 Processor -- start 2024-07-24T22:08:01.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.543+0000 7f9e8c218740 1 -- start start 2024-07-24T22:08:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.543+0000 7f9e8c218740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70804ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.543+0000 7f9e8c218740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70810c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.543+0000 7f9e8c218740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 0x564e70813560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.543+0000 7f9e8c218740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e7077a280 con 0x564e708051e0 2024-07-24T22:08:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.543+0000 7f9e8c218740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564e70769780 con 0x564e70811170 2024-07-24T22:08:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.543+0000 7f9e8c218740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564e7076d7c0 con 0x564e708048c0 2024-07-24T22:08:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.543+0000 7f9e7bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70810c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.543+0000 7f9e7bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70810c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35978/0 (socket says 172.21.15.47:35978) 2024-07-24T22:08:01.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.543+0000 7f9e7bfff640 1 -- 172.21.15.47:0/4015009205 learned_addr learned my addr 172.21.15.47:0/4015009205 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:01.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.544+0000 7f9e82ffd640 1 --2- 172.21.15.47:0/4015009205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70804ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.544+0000 7f9e837fe640 1 --2- 172.21.15.47:0/4015009205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 0x564e70813560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.544+0000 7f9e7bfff640 1 -- 172.21.15.47:0/4015009205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 msgr2=0x564e70804ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.544+0000 7f9e7bfff640 1 --2- 172.21.15.47:0/4015009205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70804ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.544+0000 7f9e7bfff640 1 -- 172.21.15.47:0/4015009205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 msgr2=0x564e70813560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.544+0000 7f9e7bfff640 1 --2- 172.21.15.47:0/4015009205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 0x564e70813560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.544+0000 7f9e7bfff640 1 -- 172.21.15.47:0/4015009205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e704cd790 con 0x564e708051e0 2024-07-24T22:08:01.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.544+0000 7f9e7bfff640 1 --2- 172.21.15.47:0/4015009205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70810c30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009c20 tx=0x7f9e6c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d458dd555af62585 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:01.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.544+0000 7f9e797fa640 1 -- 172.21.15.47:0/4015009205 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c009dd0 con 0x564e708051e0 2024-07-24T22:08:01.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.544+0000 7f9e797fa640 1 -- 172.21.15.47:0/4015009205 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e6c005020 con 0x564e708051e0 2024-07-24T22:08:01.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.544+0000 7f9e797fa640 1 -- 172.21.15.47:0/4015009205 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c004a00 con 0x564e708051e0 2024-07-24T22:08:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.545+0000 7f9e8c218740 1 -- 172.21.15.47:0/4015009205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 msgr2=0x564e70810c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.545+0000 7f9e8c218740 1 --2- 172.21.15.47:0/4015009205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70810c30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009c20 tx=0x7f9e6c011810 comp rx=0 tx=0).stop 2024-07-24T22:08:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.545+0000 7f9e8c218740 1 -- 172.21.15.47:0/4015009205 shutdown_connections 2024-07-24T22:08:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.545+0000 7f9e8c218740 1 --2- 172.21.15.47:0/4015009205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 0x564e70813560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.545+0000 7f9e8c218740 1 --2- 172.21.15.47:0/4015009205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70810c30 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.545+0000 7f9e8c218740 1 --2- 172.21.15.47:0/4015009205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70804ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.545+0000 7f9e8c218740 1 -- 172.21.15.47:0/4015009205 >> 172.21.15.47:0/4015009205 conn(0x564e708026f0 msgr2=0x564e70803890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.545+0000 7f9e8c218740 1 -- 172.21.15.47:0/4015009205 shutdown_connections 2024-07-24T22:08:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.546+0000 7f9e8c218740 1 -- 172.21.15.47:0/4015009205 wait complete. 2024-07-24T22:08:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.546+0000 7f9e8c218740 1 -- start start 2024-07-24T22:08:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.546+0000 7f9e8c218740 1 Processor -- start 2024-07-24T22:08:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.546+0000 7f9e8c218740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70810830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.546+0000 7f9e8c218740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e708051e0 0x564e7080dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.546+0000 7f9e8c218740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e70811170 0x564e7080e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e8c218740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e706a3ab0 con 0x564e70811170 2024-07-24T22:08:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e8c218740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564e706f19e0 con 0x564e708051e0 2024-07-24T22:08:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e8c218740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564e70813e50 con 0x564e708048c0 2024-07-24T22:08:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e8c218740 10 client.0 _ll_register_callbacks cb 0x564e70479a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e70811170 0x564e7080e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e82ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70810830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e70811170 0x564e7080e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35990/0 (socket says 172.21.15.47:35990) 2024-07-24T22:08:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e82ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70810830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:33128/0 (socket says 172.21.15.47:33128) 2024-07-24T22:08:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e837fe640 1 -- 172.21.15.47:0/4161024287 learned_addr learned my addr 172.21.15.47:0/4161024287 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e7bfff640 1 --2- 172.21.15.47:0/4161024287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e708051e0 0x564e7080dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e837fe640 1 -- 172.21.15.47:0/4161024287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 msgr2=0x564e70810830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e837fe640 1 --2- 172.21.15.47:0/4161024287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70810830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e837fe640 1 -- 172.21.15.47:0/4161024287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e708051e0 msgr2=0x564e7080dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e837fe640 1 --2- 172.21.15.47:0/4161024287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e708051e0 0x564e7080dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e837fe640 1 -- 172.21.15.47:0/4161024287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e70546620 con 0x564e70811170 2024-07-24T22:08:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e837fe640 1 --2- 172.21.15.47:0/4161024287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e70811170 0x564e7080e250 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c106810 tx=0x7f9e7c0cfb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14eec3203b195c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e6a7fc640 1 -- 172.21.15.47:0/4161024287 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c0f2070 con 0x564e70811170 2024-07-24T22:08:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e6a7fc640 1 -- 172.21.15.47:0/4161024287 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f9e7c0cc2f0 con 0x564e70811170 2024-07-24T22:08:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.547+0000 7f9e8c218740 1 -- 172.21.15.47:0/4161024287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e70718ce0 con 0x564e70811170 2024-07-24T22:08:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.548+0000 7f9e6a7fc640 1 -- 172.21.15.47:0/4161024287 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9e7c0098d0 con 0x564e70811170 2024-07-24T22:08:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.548+0000 7f9e8c218740 10 client.15642 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.548+0000 7f9e8c218740 1 -- 172.21.15.47:0/4161024287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564e7081f530 con 0x564e70811170 2024-07-24T22:08:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.548+0000 7f9e6a7fc640 1 -- 172.21.15.47:0/4161024287 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e7c036040 con 0x564e70811170 2024-07-24T22:08:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.548+0000 7f9e6a7fc640 1 -- 172.21.15.47:0/4161024287 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9e7c0d8890 con 0x564e70811170 2024-07-24T22:08:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.548+0000 7f9e8c218740 10 client.15642 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.548+0000 7f9e8c218740 10 client.15642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.548+0000 7f9e8c218740 20 client.15642 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.548+0000 7f9e8c218740 1 --2- 172.21.15.47:0/4161024287 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e708209e0 0x564e70822dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.548+0000 7f9e8c218740 4 client.15642 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.548+0000 7f9e8c218740 1 -- 172.21.15.47:0/4161024287 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e70718ce0 con 0x564e708209e0 2024-07-24T22:08:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.548+0000 7f9e82ffd640 1 --2- 172.21.15.47:0/4161024287 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e708209e0 0x564e70822dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.549+0000 7f9e82ffd640 1 --2- 172.21.15.47:0/4161024287 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e708209e0 0x564e70822dd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eb50d97264bec73 server_cookie=754b30bce1ae8e31 in_seq=0 out_seq=0 2024-07-24T22:08:01.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.549+0000 7f9e6a7fc640 10 client.15642 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e6a7fc640 1 -- 172.21.15.47:0/4161024287 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e70718ce0 con 0x564e708209e0 2024-07-24T22:08:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e6a7fc640 10 client.15642 handle_command_reply: tid=0 2024-07-24T22:08:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e8c218740 1 client.15642 shutdown 2024-07-24T22:08:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e8c218740 1 -- 172.21.15.47:0/4161024287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e70811170 msgr2=0x564e7080e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e8c218740 1 --2- 172.21.15.47:0/4161024287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e70811170 0x564e7080e250 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c106810 tx=0x7f9e7c0cfb40 comp rx=0 tx=0).stop 2024-07-24T22:08:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e8c218740 1 -- 172.21.15.47:0/4161024287 shutdown_connections 2024-07-24T22:08:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e8c218740 1 --2- 172.21.15.47:0/4161024287 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e708209e0 0x564e70822dd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e8c218740 1 --2- 172.21.15.47:0/4161024287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e70811170 0x564e7080e250 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e8c218740 1 --2- 172.21.15.47:0/4161024287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e708051e0 0x564e7080dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e8c218740 1 --2- 172.21.15.47:0/4161024287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70810830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e6a7fc640 0 client.15642 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e8c218740 1 -- 172.21.15.47:0/4161024287 >> 172.21.15.47:0/4161024287 conn(0x564e708026f0 msgr2=0x564e70808290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:01.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e8c218740 1 -- 172.21.15.47:0/4161024287 shutdown_connections 2024-07-24T22:08:01.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e8c218740 1 -- 172.21.15.47:0/4161024287 wait complete. 2024-07-24T22:08:01.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.550+0000 7f9e8c218740 20 client.15642 trim_cache size 0 max 16384 2024-07-24T22:08:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.569+0000 7f9e8c218740 1 Processor -- start 2024-07-24T22:08:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.569+0000 7f9e8c218740 1 -- start start 2024-07-24T22:08:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e8c218740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70828650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e8c218740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70828b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e8c218740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 0x564e7080af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e8c218740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9e841a9ea0 con 0x564e708051e0 2024-07-24T22:08:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e8c218740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9e841ac720 con 0x564e70811170 2024-07-24T22:08:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e8c218740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9e841aa510 con 0x564e708048c0 2024-07-24T22:08:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e7bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70828b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e7bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70828b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36000/0 (socket says 172.21.15.47:36000) 2024-07-24T22:08:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e7bfff640 1 -- 172.21.15.47:0/3759720225 learned_addr learned my addr 172.21.15.47:0/3759720225 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e82ffd640 1 --2- 172.21.15.47:0/3759720225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70828650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e837fe640 1 --2- 172.21.15.47:0/3759720225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 0x564e7080af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e7bfff640 1 -- 172.21.15.47:0/3759720225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 msgr2=0x564e70828650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e7bfff640 1 --2- 172.21.15.47:0/3759720225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70828650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e7bfff640 1 -- 172.21.15.47:0/3759720225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 msgr2=0x564e7080af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e7bfff640 1 --2- 172.21.15.47:0/3759720225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 0x564e7080af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e7bfff640 1 -- 172.21.15.47:0/3759720225 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e7080daf0 con 0x564e708051e0 2024-07-24T22:08:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.570+0000 7f9e837fe640 1 --2- 172.21.15.47:0/3759720225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 0x564e7080af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:08:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.571+0000 7f9e7bfff640 1 --2- 172.21.15.47:0/3759720225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70828b90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x564e70807a40 tx=0x7f9e6c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e7aade996a9734 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.571+0000 7f9e78ff9640 1 -- 172.21.15.47:0/3759720225 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c028070 con 0x564e708051e0 2024-07-24T22:08:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.571+0000 7f9e78ff9640 1 -- 172.21.15.47:0/3759720225 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e6c005560 con 0x564e708051e0 2024-07-24T22:08:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.571+0000 7f9e78ff9640 1 -- 172.21.15.47:0/3759720225 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c01d040 con 0x564e708051e0 2024-07-24T22:08:01.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.572+0000 7f9e8c218740 1 -- 172.21.15.47:0/3759720225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 msgr2=0x564e70828b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.572+0000 7f9e8c218740 1 --2- 172.21.15.47:0/3759720225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70828b90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x564e70807a40 tx=0x7f9e6c005710 comp rx=0 tx=0).stop 2024-07-24T22:08:01.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.572+0000 7f9e8c218740 1 -- 172.21.15.47:0/3759720225 shutdown_connections 2024-07-24T22:08:01.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.572+0000 7f9e8c218740 1 --2- 172.21.15.47:0/3759720225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 0x564e7080af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.572+0000 7f9e8c218740 1 --2- 172.21.15.47:0/3759720225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70828b90 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.572+0000 7f9e8c218740 1 --2- 172.21.15.47:0/3759720225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70828650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.572+0000 7f9e8c218740 1 -- 172.21.15.47:0/3759720225 >> 172.21.15.47:0/3759720225 conn(0x564e708026f0 msgr2=0x564e70803740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:01.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.572+0000 7f9e8c218740 1 -- 172.21.15.47:0/3759720225 shutdown_connections 2024-07-24T22:08:01.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.572+0000 7f9e8c218740 1 -- 172.21.15.47:0/3759720225 wait complete. 2024-07-24T22:08:01.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e8c218740 1 -- start start 2024-07-24T22:08:01.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e8c218740 1 Processor -- start 2024-07-24T22:08:01.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e8c218740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70814a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e8c218740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70814fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e8c218740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 0x564e70883730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e8c218740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9e841aabe0 con 0x564e708051e0 2024-07-24T22:08:01.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e8c218740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9e841ac050 con 0x564e70811170 2024-07-24T22:08:01.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e8c218740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9e841ab2b0 con 0x564e708048c0 2024-07-24T22:08:01.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e8c218740 10 client.0 _ll_register_callbacks cb 0x7f9e7c10a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:01.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e7bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70814fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e7bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70814fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36014/0 (socket says 172.21.15.47:36014) 2024-07-24T22:08:01.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e7bfff640 1 -- 172.21.15.47:0/1374879132 learned_addr learned my addr 172.21.15.47:0/1374879132 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:01.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e82ffd640 1 --2- 172.21.15.47:0/1374879132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70814a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.573+0000 7f9e837fe640 1 --2- 172.21.15.47:0/1374879132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 0x564e70883730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.574+0000 7f9e7bfff640 1 -- 172.21.15.47:0/1374879132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 msgr2=0x564e70814a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.574+0000 7f9e7bfff640 1 --2- 172.21.15.47:0/1374879132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70814a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.574+0000 7f9e7bfff640 1 -- 172.21.15.47:0/1374879132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 msgr2=0x564e70883730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.574+0000 7f9e7bfff640 1 --2- 172.21.15.47:0/1374879132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 0x564e70883730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.574+0000 7f9e7bfff640 1 -- 172.21.15.47:0/1374879132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e70883e70 con 0x564e708051e0 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.574+0000 7f9e7bfff640 1 --2- 172.21.15.47:0/1374879132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70814fe0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009350 tx=0x7f9e6c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5701aba3015165f6 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.574+0000 7f9e6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.574+0000 7f9e6a7fc640 1 -- 172.21.15.47:0/1374879132 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c01d040 con 0x564e708051e0 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.574+0000 7f9e8c218740 1 -- 172.21.15.47:0/1374879132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e6c005560 con 0x564e708051e0 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.574+0000 7f9e6a7fc640 1 -- 172.21.15.47:0/1374879132 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f9e6c003800 con 0x564e708051e0 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.574+0000 7f9e6a7fc640 1 -- 172.21.15.47:0/1374879132 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9e6c03d050 con 0x564e708051e0 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.574+0000 7f9e8c218740 10 client.15648 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.574+0000 7f9e8c218740 1 -- 172.21.15.47:0/1374879132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564e7088b250 con 0x564e708051e0 2024-07-24T22:08:01.580 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.575+0000 7f9e6a7fc640 1 -- 172.21.15.47:0/1374879132 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e6c005560 con 0x564e708051e0 2024-07-24T22:08:01.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.575+0000 7f9e6a7fc640 1 -- 172.21.15.47:0/1374879132 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9e6c023560 con 0x564e708051e0 2024-07-24T22:08:01.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.575+0000 7f9e8c218740 10 client.15648 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:01.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.575+0000 7f9e8c218740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:01.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.575+0000 7f9e8c218740 20 client.15648 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:01.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.575+0000 7f9e8c218740 1 --2- 172.21.15.47:0/1374879132 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e7088b7c0 0x564e7088dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:01.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.575+0000 7f9e8c218740 4 client.15648 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:08:01.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.575+0000 7f9e8c218740 1 -- 172.21.15.47:0/1374879132 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e7077c1d0 con 0x564e7088b7c0 2024-07-24T22:08:01.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.575+0000 7f9e82ffd640 1 --2- 172.21.15.47:0/1374879132 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e7088b7c0 0x564e7088dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:01.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.576+0000 7f9e6a7fc640 10 client.15648 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:01.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.576+0000 7f9e82ffd640 1 --2- 172.21.15.47:0/1374879132 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e7088b7c0 0x564e7088dbe0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72b9116e5d6c535d server_cookie=412ca69430272c3b in_seq=0 out_seq=0 2024-07-24T22:08:01.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e6a7fc640 1 -- 172.21.15.47:0/1374879132 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564e7077c1d0 con 0x564e7088b7c0 2024-07-24T22:08:01.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e6a7fc640 10 client.15648 handle_command_reply: tid=0 2024-07-24T22:08:01.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e8c218740 1 client.15648 shutdown 2024-07-24T22:08:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e8c218740 1 -- 172.21.15.47:0/1374879132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 msgr2=0x564e70814fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e8c218740 1 --2- 172.21.15.47:0/1374879132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70814fe0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009350 tx=0x7f9e6c009820 comp rx=0 tx=0).stop 2024-07-24T22:08:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e8c218740 1 -- 172.21.15.47:0/1374879132 shutdown_connections 2024-07-24T22:08:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e8c218740 1 --2- 172.21.15.47:0/1374879132 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e7088b7c0 0x564e7088dbe0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e8c218740 1 --2- 172.21.15.47:0/1374879132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e70811170 0x564e70883730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e8c218740 1 --2- 172.21.15.47:0/1374879132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e708051e0 0x564e70814fe0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e6a7fc640 0 client.15648 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e8c218740 1 --2- 172.21.15.47:0/1374879132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e708048c0 0x564e70814a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e8c218740 1 -- 172.21.15.47:0/1374879132 >> 172.21.15.47:0/1374879132 conn(0x564e708026f0 msgr2=0x564e7080f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e8c218740 1 -- 172.21.15.47:0/1374879132 shutdown_connections 2024-07-24T22:08:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e8c218740 1 -- 172.21.15.47:0/1374879132 wait complete. 2024-07-24T22:08:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.584+0000 7f9e8c218740 20 client.15648 trim_cache size 0 max 16384 2024-07-24T22:08:01.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:08:01.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:08:01.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:08:01.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:08:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.585+0000 7f9e894c5640 1 -- 172.21.15.47:0/1369777832 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9e700b3dc0 msgr2=0x7f9e700b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.585+0000 7f9e894c5640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9e700b3dc0 0x7f9e700b6280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9e74005d00 tx=0x7f9e7400b410 comp rx=0 tx=0).stop 2024-07-24T22:08:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.585+0000 7f9e894c5640 1 -- 172.21.15.47:0/1369777832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8410c9f0 msgr2=0x7f9e8419e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.585+0000 7f9e894c5640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8410c9f0 0x7f9e8419e470 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c005e30 tx=0x7f9e7c009360 comp rx=0 tx=0).stop 2024-07-24T22:08:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.585+0000 7f9e894c5640 1 -- 172.21.15.47:0/1369777832 shutdown_connections 2024-07-24T22:08:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.585+0000 7f9e894c5640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9e700b3dc0 0x7f9e700b6280 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.585+0000 7f9e894c5640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8410c9f0 0x7f9e8419e470 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.585+0000 7f9e894c5640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e84103ef0 0x7f9e841990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.585+0000 7f9e894c5640 1 --2- 172.21.15.47:0/1369777832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e841035d0 0x7f9e84198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.585+0000 7f9e894c5640 1 -- 172.21.15.47:0/1369777832 >> 172.21.15.47:0/1369777832 conn(0x7f9e840782e0 msgr2=0x7f9e840ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.585+0000 7f9e894c5640 1 -- 172.21.15.47:0/1369777832 shutdown_connections 2024-07-24T22:08:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:01.585+0000 7f9e894c5640 1 -- 172.21.15.47:0/1369777832 wait complete. 2024-07-24T22:08:01.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:01 smithi183 ceph-mon[37007]: pgmap v390: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:08:01.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:01 smithi047 ceph-mon[32551]: pgmap v390: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:08:01.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:01 smithi188 ceph-mon[37380]: pgmap v390: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:08:02.174 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '84029a6d', quiesce took 9.0 seconds. Will release after: 11.350000000000001 2024-07-24T22:08:03.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:03 smithi183 ceph-mon[37007]: pgmap v391: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 3 op/s 2024-07-24T22:08:03.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:03 smithi047 ceph-mon[32551]: pgmap v391: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 3 op/s 2024-07-24T22:08:03.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:03 smithi188 ceph-mon[37380]: pgmap v391: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 3 op/s 2024-07-24T22:08:05.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:05 smithi183 ceph-mon[37007]: pgmap v392: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-07-24T22:08:05.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:05 smithi047 ceph-mon[32551]: pgmap v392: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-07-24T22:08:05.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:05 smithi188 ceph-mon[37380]: pgmap v392: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-07-24T22:08:07.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:07 smithi183 ceph-mon[37007]: pgmap v393: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-07-24T22:08:07.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:07 smithi047 ceph-mon[32551]: pgmap v393: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-07-24T22:08:07.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:07 smithi188 ceph-mon[37380]: pgmap v393: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-07-24T22:08:09.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:09 smithi183 ceph-mon[37007]: pgmap v394: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 19 op/s 2024-07-24T22:08:09.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:09 smithi047 ceph-mon[32551]: pgmap v394: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 19 op/s 2024-07-24T22:08:09.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:09 smithi188 ceph-mon[37380]: pgmap v394: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 19 op/s 2024-07-24T22:08:10.644 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:08:11.059 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:11.534 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:11 smithi047 ceph-mon[32551]: pgmap v395: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 18 op/s 2024-07-24T22:08:11.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:11 smithi183 ceph-mon[37007]: pgmap v395: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 18 op/s 2024-07-24T22:08:11.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:11 smithi188 ceph-mon[37380]: pgmap v395: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 18 op/s 2024-07-24T22:08:12.521 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:12 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:08:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:12 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:08:12.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:12 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:08:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.962+0000 7f977bfec640 1 -- 172.21.15.47:0/3015291122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9774107060 msgr2=0x7f97741074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.962+0000 7f977bfec640 1 --2- 172.21.15.47:0/3015291122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9774107060 0x7f97741074a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9764009860 tx=0x7f976402a340 comp rx=0 tx=0).stop 2024-07-24T22:08:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.962+0000 7f977bfec640 1 -- 172.21.15.47:0/3015291122 shutdown_connections 2024-07-24T22:08:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.962+0000 7f977bfec640 1 --2- 172.21.15.47:0/3015291122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97741079e0 0x7f977410e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.962+0000 7f977bfec640 1 --2- 172.21.15.47:0/3015291122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9774107060 0x7f97741074a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.962+0000 7f977bfec640 1 --2- 172.21.15.47:0/3015291122 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9774101650 0x7f9774101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.962+0000 7f977bfec640 1 -- 172.21.15.47:0/3015291122 >> 172.21.15.47:0/3015291122 conn(0x7f97740fd0c0 msgr2=0x7f97740ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.962+0000 7f977bfec640 1 -- 172.21.15.47:0/3015291122 shutdown_connections 2024-07-24T22:08:12.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.962+0000 7f977bfec640 1 -- 172.21.15.47:0/3015291122 wait complete. 2024-07-24T22:08:12.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.963+0000 7f977bfec640 1 Processor -- start 2024-07-24T22:08:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.963+0000 7f977bfec640 1 -- start start 2024-07-24T22:08:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.964+0000 7f977bfec640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9774101650 0x7f9774199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.964+0000 7f977bfec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9774107060 0x7f9774199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.964+0000 7f977bfec640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97741079e0 0x7f97741a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.964+0000 7f977bfec640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f97741115e0 con 0x7f97741079e0 2024-07-24T22:08:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.964+0000 7f977bfec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9774111460 con 0x7f9774107060 2024-07-24T22:08:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.964+0000 7f977bfec640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9774111760 con 0x7f9774101650 2024-07-24T22:08:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.964+0000 7f977a589640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97741079e0 0x7f97741a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.964+0000 7f977a589640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97741079e0 0x7f97741a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48326/0 (socket says 172.21.15.47:48326) 2024-07-24T22:08:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.964+0000 7f977a589640 1 -- 172.21.15.47:0/3663157560 learned_addr learned my addr 172.21.15.47:0/3663157560 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.964+0000 7f977a589640 1 -- 172.21.15.47:0/3663157560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9774101650 msgr2=0x7f9774199a50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:08:12.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.964+0000 7f977a589640 1 --2- 172.21.15.47:0/3663157560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9774101650 0x7f9774199a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.964+0000 7f977a589640 1 -- 172.21.15.47:0/3663157560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9774107060 msgr2=0x7f9774199f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T22:08:12.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.965+0000 7f977a589640 1 --2- 172.21.15.47:0/3663157560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9774107060 0x7f9774199f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.965+0000 7f977a589640 1 -- 172.21.15.47:0/3663157560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97741a5010 con 0x7f97741079e0 2024-07-24T22:08:12.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.965+0000 7f977a589640 1 --2- 172.21.15.47:0/3663157560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97741079e0 0x7f97741a4ad0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f976c009fd0 tx=0x7f976c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:12.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.965+0000 7f976affd640 1 -- 172.21.15.47:0/3663157560 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c004b20 con 0x7f97741079e0 2024-07-24T22:08:12.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.965+0000 7f976affd640 1 -- 172.21.15.47:0/3663157560 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f976c003e20 con 0x7f97741079e0 2024-07-24T22:08:12.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.965+0000 7f977bfec640 1 -- 172.21.15.47:0/3663157560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97741a51e0 con 0x7f97741079e0 2024-07-24T22:08:12.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.965+0000 7f976affd640 1 -- 172.21.15.47:0/3663157560 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c004820 con 0x7f97741079e0 2024-07-24T22:08:12.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.965+0000 7f977bfec640 1 -- 172.21.15.47:0/3663157560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97741a5640 con 0x7f97741079e0 2024-07-24T22:08:12.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.969+0000 7f977e39d740 1 Processor -- start 2024-07-24T22:08:12.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.969+0000 7f976affd640 1 -- 172.21.15.47:0/3663157560 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f976c01d020 con 0x7f97741079e0 2024-07-24T22:08:12.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.969+0000 7f977e39d740 1 -- start start 2024-07-24T22:08:12.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.970+0000 7f977e39d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975e8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:12.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.970+0000 7f977e39d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:12.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.970+0000 7f977e39d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 0x55e1975f7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:12.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.970+0000 7f977e39d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e19755f960 con 0x55e1975e8680 2024-07-24T22:08:12.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.970+0000 7f977e39d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e19754ee60 con 0x55e1975e8fa0 2024-07-24T22:08:12.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.970+0000 7f977e39d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e197552ea0 con 0x55e1975f4f30 2024-07-24T22:08:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.970+0000 7f9779d88640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.970+0000 7f9779d88640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975f49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:36628/0 (socket says 172.21.15.47:36628) 2024-07-24T22:08:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.970+0000 7f9779d88640 1 -- 172.21.15.47:0/1065689067 learned_addr learned my addr 172.21.15.47:0/1065689067 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:12.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.970+0000 7f9779587640 1 --2- 172.21.15.47:0/1065689067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975e8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.971+0000 7f9779587640 1 --2- 172.21.15.47:0/1065689067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 0x55e1975f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.971+0000 7f9779587640 1 -- 172.21.15.47:0/1065689067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 msgr2=0x55e1975f7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.971+0000 7f9779587640 1 --2- 172.21.15.47:0/1065689067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 0x55e1975f7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.971+0000 7f9779587640 1 -- 172.21.15.47:0/1065689067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 msgr2=0x55e1975f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.971+0000 7f9779587640 1 --2- 172.21.15.47:0/1065689067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.971+0000 7f9779587640 1 -- 172.21.15.47:0/1065689067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1974d82d0 con 0x55e1975e8680 2024-07-24T22:08:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.971+0000 7f9779587640 1 --2- 172.21.15.47:0/1065689067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975e8a60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9764009780 tx=0x7f9764005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d165e99fae3aa4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.971+0000 7f976affd640 1 --2- 172.21.15.47:0/3663157560 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f97600b3e90 0x7f97600b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.972+0000 7f975ffff640 1 -- 172.21.15.47:0/1065689067 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9764043070 con 0x55e1975e8680 2024-07-24T22:08:12.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.972+0000 7f975ffff640 1 -- 172.21.15.47:0/1065689067 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9764030450 con 0x55e1975e8680 2024-07-24T22:08:12.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.972+0000 7f975ffff640 1 -- 172.21.15.47:0/1065689067 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9764037040 con 0x55e1975e8680 2024-07-24T22:08:12.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.972+0000 7f9779d88640 1 --2- 172.21.15.47:0/3663157560 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f97600b3e90 0x7f97600b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:12.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.972+0000 7f976affd640 1 -- 172.21.15.47:0/3663157560 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f976c0e3ff0 con 0x7f97741079e0 2024-07-24T22:08:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.973+0000 7f977e39d740 1 -- 172.21.15.47:0/1065689067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 msgr2=0x55e1975e8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.973+0000 7f9779d88640 1 --2- 172.21.15.47:0/3663157560 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f97600b3e90 0x7f97600b6350 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55e1975e7390 tx=0x7f9770005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.973+0000 7f977e39d740 1 --2- 172.21.15.47:0/1065689067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975e8a60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9764009780 tx=0x7f9764005c90 comp rx=0 tx=0).stop 2024-07-24T22:08:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.973+0000 7f977e39d740 1 -- 172.21.15.47:0/1065689067 shutdown_connections 2024-07-24T22:08:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.973+0000 7f977e39d740 1 --2- 172.21.15.47:0/1065689067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 0x55e1975f7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.973+0000 7f977e39d740 1 --2- 172.21.15.47:0/1065689067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.973+0000 7f977e39d740 1 --2- 172.21.15.47:0/1065689067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975e8a60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.973+0000 7f977e39d740 1 -- 172.21.15.47:0/1065689067 >> 172.21.15.47:0/1065689067 conn(0x55e1975e64b0 msgr2=0x55e1975e7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.973+0000 7f977e39d740 1 -- 172.21.15.47:0/1065689067 shutdown_connections 2024-07-24T22:08:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.973+0000 7f977e39d740 1 -- 172.21.15.47:0/1065689067 wait complete. 2024-07-24T22:08:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.974+0000 7f977e39d740 1 -- start start 2024-07-24T22:08:12.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.974+0000 7f977e39d740 1 Processor -- start 2024-07-24T22:08:12.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.974+0000 7f977e39d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:12.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.974+0000 7f977e39d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975f2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:12.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.974+0000 7f977e39d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 0x55e1975f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f977e39d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e1973b2700 con 0x55e1975e8680 2024-07-24T22:08:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f977e39d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e1974f15a0 con 0x55e1975e8fa0 2024-07-24T22:08:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f977e39d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e1975f7b50 con 0x55e1975f4f30 2024-07-24T22:08:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f9779d88640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f9779d88640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975f1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48340/0 (socket says 172.21.15.47:48340) 2024-07-24T22:08:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f9779d88640 1 -- 172.21.15.47:0/2688187478 learned_addr learned my addr 172.21.15.47:0/2688187478 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f977a589640 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 0x55e1975f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f9779587640 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f977e39d740 10 client.0 _ll_register_callbacks cb 0x55e197511910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f977a589640 1 -- 172.21.15.47:0/2688187478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 msgr2=0x55e1975f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f977a589640 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975f2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f977a589640 1 -- 172.21.15.47:0/2688187478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 msgr2=0x55e1975f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f977a589640 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975f1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f977a589640 1 -- 172.21.15.47:0/2688187478 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1974e4630 con 0x55e1975f4f30 2024-07-24T22:08:12.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.975+0000 7f9779d88640 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:12.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.976+0000 7f977a589640 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 0x55e1975f29c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f976c0e1710 tx=0x7f976c0aa550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=976bedc37fe02be0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:12.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.976+0000 7f975d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:08:12.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.976+0000 7f975d7fa640 1 -- 172.21.15.47:0/2688187478 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c01a040 con 0x55e1975f4f30 2024-07-24T22:08:12.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.976+0000 7f975d7fa640 1 -- 172.21.15.47:0/2688187478 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f976c0b3820 con 0x55e1975f4f30 2024-07-24T22:08:12.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.976+0000 7f977e39d740 1 -- 172.21.15.47:0/2688187478 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9764030450 con 0x55e1975f4f30 2024-07-24T22:08:12.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.976+0000 7f975d7fa640 1 -- 172.21.15.47:0/2688187478 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f976c004de0 con 0x55e1975f4f30 2024-07-24T22:08:12.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.976+0000 7f977e39d740 10 client.25246 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:12.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.976+0000 7f977e39d740 1 -- 172.21.15.47:0/2688187478 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e1972af650 con 0x55e1975f4f30 2024-07-24T22:08:12.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.976+0000 7f975d7fa640 1 -- 172.21.15.47:0/2688187478 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f976c0aa710 con 0x55e1975f4f30 2024-07-24T22:08:12.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.976+0000 7f975d7fa640 1 -- 172.21.15.47:0/2688187478 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f976c00b040 con 0x55e1975f4f30 2024-07-24T22:08:12.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.977+0000 7f977e39d740 10 client.25246 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:12.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.977+0000 7f977e39d740 10 client.25246 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.977+0000 7f977e39d740 20 client.25246 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.977+0000 7f977e39d740 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e197608e80 0x55e19760b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.977+0000 7f977e39d740 4 client.25246 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.977+0000 7f977e39d740 1 -- 172.21.15.47:0/2688187478 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9764030450 con 0x55e197608e80 2024-07-24T22:08:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.977+0000 7f9779d88640 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e197608e80 0x55e19760b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.978+0000 7f9779d88640 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e197608e80 0x55e19760b2e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e90219136d799f9 server_cookie=853effeb412d8f26 in_seq=0 out_seq=0 2024-07-24T22:08:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.978+0000 7f975d7fa640 10 client.25246 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.978+0000 7f975d7fa640 1 -- 172.21.15.47:0/2688187478 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f9764030450 con 0x55e197608e80 2024-07-24T22:08:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.978+0000 7f975d7fa640 10 client.25246 handle_command_reply: tid=0 2024-07-24T22:08:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.978+0000 7f977e39d740 1 client.25246 shutdown 2024-07-24T22:08:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.979+0000 7f977e39d740 1 -- 172.21.15.47:0/2688187478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 msgr2=0x55e1975f29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.979+0000 7f977e39d740 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 0x55e1975f29c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f976c0e1710 tx=0x7f976c0aa550 comp rx=0 tx=0).stop 2024-07-24T22:08:12.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.979+0000 7f977e39d740 1 -- 172.21.15.47:0/2688187478 shutdown_connections 2024-07-24T22:08:12.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.979+0000 7f977e39d740 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e197608e80 0x55e19760b2e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.979+0000 7f977e39d740 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 0x55e1975f29c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.979+0000 7f977e39d740 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.979+0000 7f975d7fa640 0 client.25246 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:12.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.979+0000 7f977e39d740 1 --2- 172.21.15.47:0/2688187478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:12.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.979+0000 7f977e39d740 1 -- 172.21.15.47:0/2688187478 >> 172.21.15.47:0/2688187478 conn(0x55e1975e64b0 msgr2=0x55e1975ec050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:12.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.979+0000 7f977e39d740 1 -- 172.21.15.47:0/2688187478 shutdown_connections 2024-07-24T22:08:12.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.979+0000 7f977e39d740 1 -- 172.21.15.47:0/2688187478 wait complete. 2024-07-24T22:08:12.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:12.979+0000 7f977e39d740 20 client.25246 trim_cache size 0 max 16384 2024-07-24T22:08:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.015+0000 7f977e39d740 1 Processor -- start 2024-07-24T22:08:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.015+0000 7f977e39d740 1 -- start start 2024-07-24T22:08:13.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f977e39d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8680 0x55e197610bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:13.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f977e39d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975e8fa0 0x55e1976110f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:13.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f977e39d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975f4f30 0x55e1975f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:13.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f977e39d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f97741a9d70 con 0x55e1975f4f30 2024-07-24T22:08:13.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f977e39d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f97741ac5f0 con 0x55e1975e8680 2024-07-24T22:08:13.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f977e39d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f97741aa3e0 con 0x55e1975e8fa0 2024-07-24T22:08:13.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f9779d88640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8680 0x55e197610bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:13.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f9779d88640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8680 0x55e197610bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:36648/0 (socket says 172.21.15.47:36648) 2024-07-24T22:08:13.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f9779d88640 1 -- 172.21.15.47:0/1983487102 learned_addr learned my addr 172.21.15.47:0/1983487102 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:13.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f977a589640 1 --2- 172.21.15.47:0/1983487102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975f4f30 0x55e1975f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:13.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f9779587640 1 --2- 172.21.15.47:0/1983487102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975e8fa0 0x55e1976110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:13.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f9779d88640 1 -- 172.21.15.47:0/1983487102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975e8fa0 msgr2=0x55e1976110f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:13.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f9779d88640 1 --2- 172.21.15.47:0/1983487102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975e8fa0 0x55e1976110f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f9779d88640 1 -- 172.21.15.47:0/1983487102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975f4f30 msgr2=0x55e1975f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:13.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f9779d88640 1 --2- 172.21.15.47:0/1983487102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975f4f30 0x55e1975f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f9779d88640 1 -- 172.21.15.47:0/1983487102 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1975f7a90 con 0x55e1975e8680 2024-07-24T22:08:13.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.016+0000 7f977a589640 1 --2- 172.21.15.47:0/1983487102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975f4f30 0x55e1975f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:13.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.017+0000 7f9779d88640 1 --2- 172.21.15.47:0/1983487102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8680 0x55e197610bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55e19760bb20 tx=0x7f9770014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=776598e5809d658e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:13.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.017+0000 7f975f7fe640 1 -- 172.21.15.47:0/1983487102 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977002d070 con 0x55e1975e8680 2024-07-24T22:08:13.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.017+0000 7f975f7fe640 1 -- 172.21.15.47:0/1983487102 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97700272d0 con 0x55e1975e8680 2024-07-24T22:08:13.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.017+0000 7f975f7fe640 1 -- 172.21.15.47:0/1983487102 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977001e690 con 0x55e1975e8680 2024-07-24T22:08:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.018+0000 7f977e39d740 1 -- 172.21.15.47:0/1983487102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8680 msgr2=0x55e197610bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.018+0000 7f977e39d740 1 --2- 172.21.15.47:0/1983487102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8680 0x55e197610bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55e19760bb20 tx=0x7f9770014000 comp rx=0 tx=0).stop 2024-07-24T22:08:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.018+0000 7f977e39d740 1 -- 172.21.15.47:0/1983487102 shutdown_connections 2024-07-24T22:08:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.018+0000 7f977e39d740 1 --2- 172.21.15.47:0/1983487102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975f4f30 0x55e1975f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.018+0000 7f977e39d740 1 --2- 172.21.15.47:0/1983487102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975e8fa0 0x55e1976110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.018+0000 7f977e39d740 1 --2- 172.21.15.47:0/1983487102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8680 0x55e197610bb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.018+0000 7f977e39d740 1 -- 172.21.15.47:0/1983487102 >> 172.21.15.47:0/1983487102 conn(0x55e1975e64b0 msgr2=0x55e1975f3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.018+0000 7f977e39d740 1 -- 172.21.15.47:0/1983487102 shutdown_connections 2024-07-24T22:08:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.018+0000 7f977e39d740 1 -- 172.21.15.47:0/1983487102 wait complete. 2024-07-24T22:08:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.018+0000 7f977e39d740 1 -- start start 2024-07-24T22:08:13.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.018+0000 7f977e39d740 1 Processor -- start 2024-07-24T22:08:13.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.019+0000 7f977e39d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975fd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:13.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.019+0000 7f977e39d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975fd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:13.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.019+0000 7f977e39d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 0x55e197602e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.019+0000 7f9779d88640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975fd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.019+0000 7f9779d88640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975fd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48348/0 (socket says 172.21.15.47:48348) 2024-07-24T22:08:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.019+0000 7f9779d88640 1 -- 172.21.15.47:0/1662805303 learned_addr learned my addr 172.21.15.47:0/1662805303 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.019+0000 7f977e39d740 1 -- 172.21.15.47:0/1662805303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f97741aaab0 con 0x55e1975e8680 2024-07-24T22:08:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.019+0000 7f977e39d740 1 -- 172.21.15.47:0/1662805303 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f97741abf20 con 0x55e1975e8fa0 2024-07-24T22:08:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.019+0000 7f977e39d740 1 -- 172.21.15.47:0/1662805303 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f97741ab180 con 0x55e1975f4f30 2024-07-24T22:08:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.020+0000 7f9779587640 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975fd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.020+0000 7f977a589640 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 0x55e197602e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.020+0000 7f9779d88640 1 -- 172.21.15.47:0/1662805303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 msgr2=0x55e197602e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.020+0000 7f9779d88640 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 0x55e197602e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.020+0000 7f9779d88640 1 -- 172.21.15.47:0/1662805303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 msgr2=0x55e1975fd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.020+0000 7f9779d88640 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975fd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.020+0000 7f9779d88640 1 -- 172.21.15.47:0/1662805303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e197603640 con 0x55e1975e8680 2024-07-24T22:08:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.020+0000 7f9779587640 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975fd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:08:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.020+0000 7f977e39d740 10 client.0 _ll_register_callbacks cb 0x7f976c004cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.020+0000 7f977e39d740 1 -- 172.21.15.47:0/1662805303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97700272d0 con 0x55e1975e8680 2024-07-24T22:08:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.020+0000 7f9779d88640 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975fd0b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9770003d70 tx=0x7f9770003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b29a384a8b8be26 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.020+0000 7f975d7fa640 10 client.15666 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.021+0000 7f975d7fa640 1 -- 172.21.15.47:0/1662805303 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770038050 con 0x55e1975e8680 2024-07-24T22:08:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.021+0000 7f975d7fa640 1 -- 172.21.15.47:0/1662805303 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f9770026040 con 0x55e1975e8680 2024-07-24T22:08:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.021+0000 7f975d7fa640 1 -- 172.21.15.47:0/1662805303 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f977002d030 con 0x55e1975e8680 2024-07-24T22:08:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.021+0000 7f977e39d740 10 client.15666 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.021+0000 7f977e39d740 1 -- 172.21.15.47:0/1662805303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({fsmap=20}) -- 0x55e1975f9b10 con 0x55e1975e8680 2024-07-24T22:08:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.021+0000 7f975d7fa640 1 -- 172.21.15.47:0/1662805303 <== mon.0 v2:172.21.15.47:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9770005030 con 0x55e1975e8680 2024-07-24T22:08:13.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.021+0000 7f977e39d740 10 client.15666 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:13.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.021+0000 7f977e39d740 10 client.15666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:13.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.021+0000 7f977e39d740 20 client.15666 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:13.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.021+0000 7f977e39d740 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e197678570 0x55e19767a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:13.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.021+0000 7f977e39d740 4 client.15666 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:08:13.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.021+0000 7f977e39d740 1 -- 172.21.15.47:0/1662805303 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e1975618b0 con 0x55e197678570 2024-07-24T22:08:13.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.022+0000 7f9779587640 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e197678570 0x55e19767a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:13.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.022+0000 7f9779587640 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e197678570 0x55e19767a960 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d84346bc70a8564f server_cookie=8e872319da08d142 in_seq=0 out_seq=0 2024-07-24T22:08:13.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.022+0000 7f975d7fa640 10 client.15666 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:13.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.022+0000 7f975d7fa640 1 -- 172.21.15.47:0/1662805303 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e1975618b0 con 0x55e197678570 2024-07-24T22:08:13.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.022+0000 7f975d7fa640 10 client.15666 handle_command_reply: tid=0 2024-07-24T22:08:13.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.022+0000 7f977e39d740 1 client.15666 shutdown 2024-07-24T22:08:13.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.023+0000 7f977e39d740 1 -- 172.21.15.47:0/1662805303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 msgr2=0x55e1975fd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:13.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.023+0000 7f977e39d740 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975fd0b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9770003d70 tx=0x7f9770003da0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.023+0000 7f977e39d740 1 -- 172.21.15.47:0/1662805303 shutdown_connections 2024-07-24T22:08:13.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.023+0000 7f977e39d740 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e197678570 0x55e19767a960 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.023+0000 7f975d7fa640 0 client.15666 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:13.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.023+0000 7f977e39d740 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e1975f4f30 0x55e197602e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.023+0000 7f977e39d740 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1975e8fa0 0x55e1975fd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.023+0000 7f977e39d740 1 --2- 172.21.15.47:0/1662805303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1975e8680 0x55e1975fd0b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.023+0000 7f977e39d740 1 -- 172.21.15.47:0/1662805303 >> 172.21.15.47:0/1662805303 conn(0x55e1975e64b0 msgr2=0x55e1975eb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.023+0000 7f977e39d740 1 -- 172.21.15.47:0/1662805303 shutdown_connections 2024-07-24T22:08:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.023+0000 7f977e39d740 1 -- 172.21.15.47:0/1662805303 wait complete. 2024-07-24T22:08:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.024+0000 7f977e39d740 20 client.15666 trim_cache size 0 max 16384 2024-07-24T22:08:13.030 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:08:13.030 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:08:13.030 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:08:13.031 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:08:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.024+0000 7f977bfec640 1 -- 172.21.15.47:0/3663157560 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f97600b3e90 msgr2=0x7f97600b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.024+0000 7f977bfec640 1 --2- 172.21.15.47:0/3663157560 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f97600b3e90 0x7f97600b6350 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55e1975e7390 tx=0x7f9770005f90 comp rx=0 tx=0).stop 2024-07-24T22:08:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.024+0000 7f977bfec640 1 -- 172.21.15.47:0/3663157560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97741079e0 msgr2=0x7f97741a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.024+0000 7f977bfec640 1 --2- 172.21.15.47:0/3663157560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97741079e0 0x7f97741a4ad0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f976c009fd0 tx=0x7f976c00c800 comp rx=0 tx=0).stop 2024-07-24T22:08:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.024+0000 7f977bfec640 1 -- 172.21.15.47:0/3663157560 shutdown_connections 2024-07-24T22:08:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.024+0000 7f977bfec640 1 --2- 172.21.15.47:0/3663157560 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f97600b3e90 0x7f97600b6350 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.024+0000 7f977bfec640 1 --2- 172.21.15.47:0/3663157560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97741079e0 0x7f97741a4ad0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.024+0000 7f977bfec640 1 --2- 172.21.15.47:0/3663157560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9774107060 0x7f9774199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.024+0000 7f977bfec640 1 --2- 172.21.15.47:0/3663157560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9774101650 0x7f9774199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:13.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.024+0000 7f977bfec640 1 -- 172.21.15.47:0/3663157560 >> 172.21.15.47:0/3663157560 conn(0x7f97740fd0c0 msgr2=0x7f97740ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:13.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.025+0000 7f977bfec640 1 -- 172.21.15.47:0/3663157560 shutdown_connections 2024-07-24T22:08:13.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:13.025+0000 7f977bfec640 1 -- 172.21.15.47:0/3663157560 wait complete. 2024-07-24T22:08:13.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:13 smithi047 ceph-mon[32551]: pgmap v396: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 19 op/s 2024-07-24T22:08:13.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:13 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:08:13.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:13 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:08:13.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:13 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:08:13.525 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:08:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:13 smithi183 ceph-mon[37007]: pgmap v396: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 19 op/s 2024-07-24T22:08:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:13 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:08:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:13 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:08:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:13 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:08:13.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:13 smithi188 ceph-mon[37380]: pgmap v396: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 19 op/s 2024-07-24T22:08:13.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:13 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:08:13.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:13 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:08:13.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:13 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:08:13.805 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:08:13.805 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:08:13.974 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:14.684 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.682+0000 7f142bfcb640 1 -- 172.21.15.47:0/3569146272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1424107910 msgr2=0x7f142410e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.682+0000 7f142bfcb640 1 --2- 172.21.15.47:0/3569146272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1424107910 0x7f142410e110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f141c009ca0 tx=0x7f141c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.682+0000 7f142bfcb640 1 -- 172.21.15.47:0/3569146272 shutdown_connections 2024-07-24T22:08:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.682+0000 7f142bfcb640 1 --2- 172.21.15.47:0/3569146272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1424107910 0x7f142410e110 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.682+0000 7f142bfcb640 1 --2- 172.21.15.47:0/3569146272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1424106f90 0x7f14241073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.682+0000 7f142bfcb640 1 --2- 172.21.15.47:0/3569146272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14241015e0 0x7f14241019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.682+0000 7f142bfcb640 1 -- 172.21.15.47:0/3569146272 >> 172.21.15.47:0/3569146272 conn(0x7f14240782e0 msgr2=0x7f14240ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.683+0000 7f142bfcb640 1 -- 172.21.15.47:0/3569146272 shutdown_connections 2024-07-24T22:08:14.685 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.683+0000 7f142bfcb640 1 -- 172.21.15.47:0/3569146272 wait complete. 2024-07-24T22:08:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.683+0000 7f142bfcb640 1 Processor -- start 2024-07-24T22:08:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.683+0000 7f142bfcb640 1 -- start start 2024-07-24T22:08:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.683+0000 7f142bfcb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14241015e0 0x7f1424198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.684+0000 7f142bfcb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1424106f90 0x7f1424199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.687 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.684+0000 7f142bfcb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1424107910 0x7f142419e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.684+0000 7f142bfcb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1424111560 con 0x7f14241015e0 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.684+0000 7f142bfcb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f14241113e0 con 0x7f1424107910 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.684+0000 7f142bfcb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f14241116e0 con 0x7f1424106f90 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.684+0000 7f1429566640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1424106f90 0x7f1424199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.684+0000 7f1429566640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1424106f90 0x7f1424199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:49236/0 (socket says 172.21.15.47:49236) 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.684+0000 7f1429566640 1 -- 172.21.15.47:0/1703685562 learned_addr learned my addr 172.21.15.47:0/1703685562 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.684+0000 7f1429d67640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14241015e0 0x7f1424198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.684+0000 7f142a568640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1424107910 0x7f142419e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.684+0000 7f1429566640 1 -- 172.21.15.47:0/1703685562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1424107910 msgr2=0x7f142419e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.684+0000 7f1429566640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1424107910 0x7f142419e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.684+0000 7f1429566640 1 -- 172.21.15.47:0/1703685562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14241015e0 msgr2=0x7f1424198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.685+0000 7f1429566640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14241015e0 0x7f1424198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.685+0000 7f1429566640 1 -- 172.21.15.47:0/1703685562 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142419eca0 con 0x7f1424106f90 2024-07-24T22:08:14.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.685+0000 7f1429d67640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14241015e0 0x7f1424198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.685+0000 7f1429566640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1424106f90 0x7f1424199140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f141400e970 tx=0x7f141400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.685+0000 7f141affd640 1 -- 172.21.15.47:0/1703685562 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141400ccc0 con 0x7f1424106f90 2024-07-24T22:08:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.685+0000 7f141affd640 1 -- 172.21.15.47:0/1703685562 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f141400ce60 con 0x7f1424106f90 2024-07-24T22:08:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.685+0000 7f142bfcb640 1 -- 172.21.15.47:0/1703685562 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f142419ef90 con 0x7f1424106f90 2024-07-24T22:08:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.685+0000 7f141affd640 1 -- 172.21.15.47:0/1703685562 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414010430 con 0x7f1424106f90 2024-07-24T22:08:14.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.685+0000 7f142bfcb640 1 -- 172.21.15.47:0/1703685562 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14240fd660 con 0x7f1424106f90 2024-07-24T22:08:14.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.688+0000 7f142edff740 1 Processor -- start 2024-07-24T22:08:14.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.689+0000 7f141affd640 1 -- 172.21.15.47:0/1703685562 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f14140046c0 con 0x7f1424106f90 2024-07-24T22:08:14.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.689+0000 7f142edff740 1 -- start start 2024-07-24T22:08:14.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.689+0000 7f142edff740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 0x563c56d9aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.689+0000 7f142edff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9b1e0 0x563c56da6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.689+0000 7f142edff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56da7170 0x563c56da9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f142edff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563c56d10280 con 0x563c56d9b1e0 2024-07-24T22:08:14.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f142edff740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563c56cff780 con 0x563c56da7170 2024-07-24T22:08:14.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f142edff740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563c56d037c0 con 0x563c56d9a8c0 2024-07-24T22:08:14.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f142a568640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 0x563c56d9aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f142a568640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 0x563c56d9aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:49244/0 (socket says 172.21.15.47:49244) 2024-07-24T22:08:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f142a568640 1 -- 172.21.15.47:0/3586039521 learned_addr learned my addr 172.21.15.47:0/3586039521 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f1429566640 1 --2- 172.21.15.47:0/3586039521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56da7170 0x563c56da9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f1429d67640 1 --2- 172.21.15.47:0/3586039521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9b1e0 0x563c56da6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f141affd640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f14100b3d70 0x7f14100b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f142a568640 1 -- 172.21.15.47:0/3586039521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56da7170 msgr2=0x563c56da9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f142a568640 1 --2- 172.21.15.47:0/3586039521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56da7170 0x563c56da9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f142a568640 1 -- 172.21.15.47:0/3586039521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9b1e0 msgr2=0x563c56da6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f142a568640 1 --2- 172.21.15.47:0/3586039521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9b1e0 0x563c56da6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.690+0000 7f142a568640 1 -- 172.21.15.47:0/3586039521 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c56a63790 con 0x563c56d9a8c0 2024-07-24T22:08:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.691+0000 7f141affd640 1 -- 172.21.15.47:0/1703685562 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f14140e43a0 con 0x7f1424106f90 2024-07-24T22:08:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.691+0000 7f1429d67640 1 --2- 172.21.15.47:0/3586039521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9b1e0 0x563c56da6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.691+0000 7f142a568640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f14100b3d70 0x7f14100b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.691+0000 7f142a568640 1 --2- 172.21.15.47:0/3586039521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 0x563c56d9aca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f141c009ca0 tx=0x7f141c009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11ec140dfc814a15 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.691+0000 7f140ffff640 1 -- 172.21.15.47:0/3586039521 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c031920 con 0x563c56d9a8c0 2024-07-24T22:08:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.691+0000 7f140ffff640 1 -- 172.21.15.47:0/3586039521 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f141c036030 con 0x563c56d9a8c0 2024-07-24T22:08:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.691+0000 7f140ffff640 1 -- 172.21.15.47:0/3586039521 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c0047e0 con 0x563c56d9a8c0 2024-07-24T22:08:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.691+0000 7f142a568640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f14100b3d70 0x7f14100b6230 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f141c04a000 tx=0x7f141c04b000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.692+0000 7f142edff740 1 -- 172.21.15.47:0/3586039521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 msgr2=0x563c56d9aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.692+0000 7f142edff740 1 --2- 172.21.15.47:0/3586039521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 0x563c56d9aca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f141c009ca0 tx=0x7f141c009800 comp rx=0 tx=0).stop 2024-07-24T22:08:14.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.692+0000 7f142edff740 1 -- 172.21.15.47:0/3586039521 shutdown_connections 2024-07-24T22:08:14.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.692+0000 7f142edff740 1 --2- 172.21.15.47:0/3586039521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56da7170 0x563c56da9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.692+0000 7f142edff740 1 --2- 172.21.15.47:0/3586039521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9b1e0 0x563c56da6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.692+0000 7f142edff740 1 --2- 172.21.15.47:0/3586039521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 0x563c56d9aca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.692+0000 7f142edff740 1 -- 172.21.15.47:0/3586039521 >> 172.21.15.47:0/3586039521 conn(0x563c56d986f0 msgr2=0x563c56d99890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:14.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.692+0000 7f142edff740 1 -- 172.21.15.47:0/3586039521 shutdown_connections 2024-07-24T22:08:14.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.693+0000 7f142edff740 1 -- 172.21.15.47:0/3586039521 wait complete. 2024-07-24T22:08:14.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.693+0000 7f142edff740 1 -- start start 2024-07-24T22:08:14.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.693+0000 7f142edff740 1 Processor -- start 2024-07-24T22:08:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.693+0000 7f142edff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9a8c0 0x563c56da68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.693+0000 7f142edff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9b1e0 0x563c56da3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f142edff740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56da7170 0x563c56da4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f142edff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563c56c39ab0 con 0x563c56d9b1e0 2024-07-24T22:08:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f142edff740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563c56c879e0 con 0x563c56d9a8c0 2024-07-24T22:08:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f142edff740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563c56da9cd0 con 0x563c56da7170 2024-07-24T22:08:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f142edff740 10 client.0 _ll_register_callbacks cb 0x563c56a0fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f1429d67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9a8c0 0x563c56da68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f1429d67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9a8c0 0x563c56da68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:36702/0 (socket says 172.21.15.47:36702) 2024-07-24T22:08:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f1429d67640 1 -- 172.21.15.47:0/2867422807 learned_addr learned my addr 172.21.15.47:0/2867422807 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f142a568640 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56da7170 0x563c56da4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f1429d67640 1 -- 172.21.15.47:0/2867422807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56da7170 msgr2=0x563c56da4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f1429566640 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9b1e0 0x563c56da3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f1429d67640 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56da7170 0x563c56da4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f1429d67640 1 -- 172.21.15.47:0/2867422807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9b1e0 msgr2=0x563c56da3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f1429d67640 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9b1e0 0x563c56da3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f1429d67640 1 -- 172.21.15.47:0/2867422807 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c56adc620 con 0x563c56d9a8c0 2024-07-24T22:08:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f142a568640 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56da7170 0x563c56da4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.694+0000 7f1429566640 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9b1e0 0x563c56da3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.695+0000 7f1429d67640 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9a8c0 0x563c56da68e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1420012780 tx=0x7f1420012c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3314e576f576f118 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.695+0000 7f140d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:08:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.695+0000 7f140d7fa640 1 -- 172.21.15.47:0/2867422807 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142001f060 con 0x563c56d9a8c0 2024-07-24T22:08:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.695+0000 7f140d7fa640 1 -- 172.21.15.47:0/2867422807 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f1420010dc0 con 0x563c56d9a8c0 2024-07-24T22:08:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.695+0000 7f142edff740 1 -- 172.21.15.47:0/2867422807 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c56caece0 con 0x563c56d9a8c0 2024-07-24T22:08:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.695+0000 7f140d7fa640 1 -- 172.21.15.47:0/2867422807 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f142001a430 con 0x563c56d9a8c0 2024-07-24T22:08:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.695+0000 7f142edff740 10 client.25220 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.695+0000 7f142edff740 1 -- 172.21.15.47:0/2867422807 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563c56db5450 con 0x563c56d9a8c0 2024-07-24T22:08:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.695+0000 7f140d7fa640 1 -- 172.21.15.47:0/2867422807 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f142001aa80 con 0x563c56d9a8c0 2024-07-24T22:08:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.695+0000 7f140d7fa640 1 -- 172.21.15.47:0/2867422807 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1420022870 con 0x563c56d9a8c0 2024-07-24T22:08:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.695+0000 7f142edff740 10 client.25220 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.695+0000 7f142edff740 10 client.25220 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.695+0000 7f142edff740 20 client.25220 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.696+0000 7f142edff740 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c56db6910 0x563c56db8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.696+0000 7f142edff740 4 client.25220 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.696+0000 7f142edff740 1 -- 172.21.15.47:0/2867422807 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c56caece0 con 0x563c56db6910 2024-07-24T22:08:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.696+0000 7f1429566640 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c56db6910 0x563c56db8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.696+0000 7f140d7fa640 10 client.25220 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.696+0000 7f1429566640 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c56db6910 0x563c56db8d00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb93238c03bcbea8 server_cookie=71ecf600b0631abf in_seq=0 out_seq=0 2024-07-24T22:08:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.697+0000 7f140d7fa640 1 -- 172.21.15.47:0/2867422807 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c56caece0 con 0x563c56db6910 2024-07-24T22:08:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.697+0000 7f140d7fa640 10 client.25220 handle_command_reply: tid=0 2024-07-24T22:08:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.697+0000 7f142edff740 1 client.25220 shutdown 2024-07-24T22:08:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.697+0000 7f142edff740 1 -- 172.21.15.47:0/2867422807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9a8c0 msgr2=0x563c56da68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.697+0000 7f142edff740 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9a8c0 0x563c56da68e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1420012780 tx=0x7f1420012c40 comp rx=0 tx=0).stop 2024-07-24T22:08:14.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.697+0000 7f142edff740 1 -- 172.21.15.47:0/2867422807 shutdown_connections 2024-07-24T22:08:14.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.697+0000 7f142edff740 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c56db6910 0x563c56db8d00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.697+0000 7f140d7fa640 0 client.25220 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:14.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.697+0000 7f142edff740 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56da7170 0x563c56da4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.697+0000 7f142edff740 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9b1e0 0x563c56da3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.697+0000 7f142edff740 1 --2- 172.21.15.47:0/2867422807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9a8c0 0x563c56da68e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.698+0000 7f142edff740 1 -- 172.21.15.47:0/2867422807 >> 172.21.15.47:0/2867422807 conn(0x563c56d986f0 msgr2=0x563c56d9e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:14.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.698+0000 7f142edff740 1 -- 172.21.15.47:0/2867422807 shutdown_connections 2024-07-24T22:08:14.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.698+0000 7f142edff740 1 -- 172.21.15.47:0/2867422807 wait complete. 2024-07-24T22:08:14.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.698+0000 7f142edff740 20 client.25220 trim_cache size 0 max 16384 2024-07-24T22:08:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.722+0000 7f142edff740 1 Processor -- start 2024-07-24T22:08:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.722+0000 7f142edff740 1 -- start start 2024-07-24T22:08:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.723+0000 7f142edff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9a8c0 0x563c56da2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.723+0000 7f142edff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 0x563c56da2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.723+0000 7f142edff740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56da7170 0x563c56dbe610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.723+0000 7f1429d67640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9a8c0 0x563c56da2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.723+0000 7f1429d67640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9a8c0 0x563c56da2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48406/0 (socket says 172.21.15.47:48406) 2024-07-24T22:08:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.723+0000 7f1429566640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 0x563c56da2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.723+0000 7f1429566640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 0x563c56da2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:36714/0 (socket says 172.21.15.47:36714) 2024-07-24T22:08:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.723+0000 7f1429d67640 1 -- 172.21.15.47:0/803474709 learned_addr learned my addr 172.21.15.47:0/803474709 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.724+0000 7f142edff740 1 -- 172.21.15.47:0/803474709 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f14241ae260 con 0x563c56d9a8c0 2024-07-24T22:08:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.724+0000 7f142a568640 1 --2- 172.21.15.47:0/803474709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56da7170 0x563c56dbe610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.724+0000 7f142edff740 1 -- 172.21.15.47:0/803474709 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f14241b0ae0 con 0x563c56d9b1e0 2024-07-24T22:08:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.724+0000 7f142edff740 1 -- 172.21.15.47:0/803474709 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f14241ae8d0 con 0x563c56da7170 2024-07-24T22:08:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.724+0000 7f1429566640 1 -- 172.21.15.47:0/803474709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56da7170 msgr2=0x563c56dbe610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.724+0000 7f1429566640 1 --2- 172.21.15.47:0/803474709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56da7170 0x563c56dbe610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.724+0000 7f1429566640 1 -- 172.21.15.47:0/803474709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9a8c0 msgr2=0x563c56da2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.724+0000 7f1429566640 1 --2- 172.21.15.47:0/803474709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9a8c0 0x563c56da2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.724+0000 7f1429566640 1 -- 172.21.15.47:0/803474709 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c56db9070 con 0x563c56d9b1e0 2024-07-24T22:08:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.724+0000 7f1429d67640 1 --2- 172.21.15.47:0/803474709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9a8c0 0x563c56da2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:08:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.725+0000 7f1429566640 1 --2- 172.21.15.47:0/803474709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 0x563c56da2b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f14140e1af0 tx=0x7f14140e7ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdbc5952da2aae84 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.725+0000 7f140f7fe640 1 -- 172.21.15.47:0/803474709 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14140aa720 con 0x563c56d9b1e0 2024-07-24T22:08:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.725+0000 7f140f7fe640 1 -- 172.21.15.47:0/803474709 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14140aaac0 con 0x563c56d9b1e0 2024-07-24T22:08:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.725+0000 7f140f7fe640 1 -- 172.21.15.47:0/803474709 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14140a7240 con 0x563c56d9b1e0 2024-07-24T22:08:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.726+0000 7f142edff740 1 -- 172.21.15.47:0/803474709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 msgr2=0x563c56da2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.726+0000 7f142edff740 1 --2- 172.21.15.47:0/803474709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 0x563c56da2b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f14140e1af0 tx=0x7f14140e7ef0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.728+0000 7f142edff740 1 -- 172.21.15.47:0/803474709 shutdown_connections 2024-07-24T22:08:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.728+0000 7f142edff740 1 --2- 172.21.15.47:0/803474709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56da7170 0x563c56dbe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.728+0000 7f142edff740 1 --2- 172.21.15.47:0/803474709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 0x563c56da2b60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.728+0000 7f142edff740 1 --2- 172.21.15.47:0/803474709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56d9a8c0 0x563c56da2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.728+0000 7f142edff740 1 -- 172.21.15.47:0/803474709 >> 172.21.15.47:0/803474709 conn(0x563c56d986f0 msgr2=0x563c56d993d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.728+0000 7f142edff740 1 -- 172.21.15.47:0/803474709 shutdown_connections 2024-07-24T22:08:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.728+0000 7f142edff740 1 -- 172.21.15.47:0/803474709 wait complete. 2024-07-24T22:08:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.728+0000 7f142edff740 1 -- start start 2024-07-24T22:08:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.728+0000 7f142edff740 1 Processor -- start 2024-07-24T22:08:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.729+0000 7f142edff740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 0x563c56dab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.729+0000 7f142edff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 0x563c56daba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.729+0000 7f142edff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56da7170 0x563c56dabf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.730+0000 7f1429d67640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 0x563c56dab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.730+0000 7f1429d67640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 0x563c56dab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:49266/0 (socket says 172.21.15.47:49266) 2024-07-24T22:08:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.730+0000 7f1429566640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 0x563c56daba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.730+0000 7f1429566640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 0x563c56daba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:36726/0 (socket says 172.21.15.47:36726) 2024-07-24T22:08:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.730+0000 7f142a568640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56da7170 0x563c56dabf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.730+0000 7f142a568640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56da7170 0x563c56dabf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48418/0 (socket says 172.21.15.47:48418) 2024-07-24T22:08:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.730+0000 7f1429d67640 1 -- 172.21.15.47:0/1318340742 learned_addr learned my addr 172.21.15.47:0/1318340742 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.730+0000 7f142edff740 1 -- 172.21.15.47:0/1318340742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f14241aefa0 con 0x563c56da7170 2024-07-24T22:08:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.730+0000 7f142edff740 1 -- 172.21.15.47:0/1318340742 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f14241b0410 con 0x563c56d9b1e0 2024-07-24T22:08:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.730+0000 7f142edff740 1 -- 172.21.15.47:0/1318340742 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f14241af670 con 0x563c56d9a8c0 2024-07-24T22:08:14.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.731+0000 7f1429d67640 1 -- 172.21.15.47:0/1318340742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 msgr2=0x563c56daba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:14.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.731+0000 7f1429d67640 1 --2- 172.21.15.47:0/1318340742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 0x563c56daba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.731+0000 7f1429d67640 1 -- 172.21.15.47:0/1318340742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56da7170 msgr2=0x563c56dabf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:14.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.731+0000 7f1429d67640 1 --2- 172.21.15.47:0/1318340742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56da7170 0x563c56dabf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.731+0000 7f1429d67640 1 -- 172.21.15.47:0/1318340742 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c56e28030 con 0x563c56d9a8c0 2024-07-24T22:08:14.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.731+0000 7f1429566640 1 --2- 172.21.15.47:0/1318340742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 0x563c56daba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:14.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.731+0000 7f142a568640 1 --2- 172.21.15.47:0/1318340742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56da7170 0x563c56dabf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:08:14.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.731+0000 7f1429d67640 1 --2- 172.21.15.47:0/1318340742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 0x563c56dab510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1420005270 tx=0x7f14200052a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8342d17722ad96e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.731+0000 7f140d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.731+0000 7f140d7fa640 1 -- 172.21.15.47:0/1318340742 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14200225b0 con 0x563c56d9a8c0 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.731+0000 7f142edff740 10 client.0 _ll_register_callbacks cb 0x7f1420009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.732+0000 7f140d7fa640 1 -- 172.21.15.47:0/1318340742 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f1420022750 con 0x563c56d9a8c0 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.732+0000 7f142edff740 1 -- 172.21.15.47:0/1318340742 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c56da6c70 con 0x563c56d9a8c0 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.732+0000 7f140d7fa640 1 -- 172.21.15.47:0/1318340742 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f14200107a0 con 0x563c56d9a8c0 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.732+0000 7f142edff740 10 client.25270 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.732+0000 7f142edff740 1 -- 172.21.15.47:0/1318340742 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({fsmap=20}) -- 0x563c56e290a0 con 0x563c56d9a8c0 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.733+0000 7f140d7fa640 1 -- 172.21.15.47:0/1318340742 <== mon.1 v2:172.21.15.188:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1420034050 con 0x563c56d9a8c0 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.733+0000 7f142edff740 10 client.25270 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.733+0000 7f142edff740 10 client.25270 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.733+0000 7f142edff740 20 client.25270 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.733+0000 7f142edff740 1 --2- 172.21.15.47:0/1318340742 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c56e297a0 0x563c56e2bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.733+0000 7f142edff740 4 client.25270 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:08:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.733+0000 7f142edff740 1 -- 172.21.15.47:0/1318340742 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c56d121d0 con 0x563c56e297a0 2024-07-24T22:08:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.734+0000 7f1429566640 1 --2- 172.21.15.47:0/1318340742 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c56e297a0 0x563c56e2bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.734+0000 7f1429566640 1 --2- 172.21.15.47:0/1318340742 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c56e297a0 0x563c56e2bc60 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa0b57af7528e2d8 server_cookie=5960bfaa580d0910 in_seq=0 out_seq=0 2024-07-24T22:08:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.734+0000 7f140d7fa640 10 client.25270 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.738+0000 7f140d7fa640 1 -- 172.21.15.47:0/1318340742 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563c56d121d0 con 0x563c56e297a0 2024-07-24T22:08:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.738+0000 7f140d7fa640 10 client.25270 handle_command_reply: tid=0 2024-07-24T22:08:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.739+0000 7f142edff740 1 client.25270 shutdown 2024-07-24T22:08:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.739+0000 7f142edff740 1 -- 172.21.15.47:0/1318340742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 msgr2=0x563c56dab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.739+0000 7f142edff740 1 --2- 172.21.15.47:0/1318340742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 0x563c56dab510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1420005270 tx=0x7f14200052a0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.739+0000 7f142edff740 1 -- 172.21.15.47:0/1318340742 shutdown_connections 2024-07-24T22:08:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.739+0000 7f142edff740 1 --2- 172.21.15.47:0/1318340742 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563c56e297a0 0x563c56e2bc60 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.739+0000 7f142edff740 1 --2- 172.21.15.47:0/1318340742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c56da7170 0x563c56dabf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.739+0000 7f142edff740 1 --2- 172.21.15.47:0/1318340742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563c56d9b1e0 0x563c56daba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.739+0000 7f142edff740 1 --2- 172.21.15.47:0/1318340742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563c56d9a8c0 0x563c56dab510 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.739+0000 7f142edff740 1 -- 172.21.15.47:0/1318340742 >> 172.21.15.47:0/1318340742 conn(0x563c56d986f0 msgr2=0x563c56da3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.739+0000 7f140d7fa640 0 client.25270 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.739+0000 7f142edff740 1 -- 172.21.15.47:0/1318340742 shutdown_connections 2024-07-24T22:08:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.739+0000 7f142edff740 1 -- 172.21.15.47:0/1318340742 wait complete. 2024-07-24T22:08:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.740+0000 7f142edff740 20 client.25270 trim_cache size 0 max 16384 2024-07-24T22:08:14.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:08:14.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:08:14.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:08:14.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:08:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.740+0000 7f142bfcb640 1 -- 172.21.15.47:0/1703685562 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f14100b3d70 msgr2=0x7f14100b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.740+0000 7f142bfcb640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f14100b3d70 0x7f14100b6230 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f141c04a000 tx=0x7f141c04b000 comp rx=0 tx=0).stop 2024-07-24T22:08:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.741+0000 7f142bfcb640 1 -- 172.21.15.47:0/1703685562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1424106f90 msgr2=0x7f1424199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.741+0000 7f142bfcb640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1424106f90 0x7f1424199140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f141400e970 tx=0x7f141400ed70 comp rx=0 tx=0).stop 2024-07-24T22:08:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.741+0000 7f142bfcb640 1 -- 172.21.15.47:0/1703685562 shutdown_connections 2024-07-24T22:08:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.741+0000 7f142bfcb640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f14100b3d70 0x7f14100b6230 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.741+0000 7f142bfcb640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1424107910 0x7f142419e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.741+0000 7f142bfcb640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1424106f90 0x7f1424199140 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.741+0000 7f142bfcb640 1 --2- 172.21.15.47:0/1703685562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14241015e0 0x7f1424198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.741+0000 7f142bfcb640 1 -- 172.21.15.47:0/1703685562 >> 172.21.15.47:0/1703685562 conn(0x7f14240782e0 msgr2=0x7f14240698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.741+0000 7f142bfcb640 1 -- 172.21.15.47:0/1703685562 shutdown_connections 2024-07-24T22:08:14.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:14.741+0000 7f142bfcb640 1 -- 172.21.15.47:0/1703685562 wait complete. 2024-07-24T22:08:15.317 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:15.566 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:15 smithi047 ceph-mon[32551]: pgmap v397: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 18 op/s 2024-07-24T22:08:15.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:15 smithi183 ceph-mon[37007]: pgmap v397: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 18 op/s 2024-07-24T22:08:15.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:15 smithi188 ceph-mon[37380]: pgmap v397: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 18 op/s 2024-07-24T22:08:16.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.045+0000 7f5f7775e640 1 -- 172.21.15.47:0/1828895241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f7010cac0 msgr2=0x7f5f7010ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:16.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.045+0000 7f5f7775e640 1 --2- 172.21.15.47:0/1828895241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f7010cac0 0x7f5f7010ef20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009ca0 tx=0x7f5f6802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:08:16.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.046+0000 7f5f7775e640 1 -- 172.21.15.47:0/1828895241 shutdown_connections 2024-07-24T22:08:16.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.046+0000 7f5f7775e640 1 --2- 172.21.15.47:0/1828895241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f7010cac0 0x7f5f7010ef20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:16.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.046+0000 7f5f7775e640 1 --2- 172.21.15.47:0/1828895241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f70103f80 0x7f5f7010c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:16.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.046+0000 7f5f7775e640 1 --2- 172.21.15.47:0/1828895241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f70103660 0x7f5f70103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:16.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.046+0000 7f5f7775e640 1 -- 172.21.15.47:0/1828895241 >> 172.21.15.47:0/1828895241 conn(0x7f5f700fd0c0 msgr2=0x7f5f700ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:16.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.047+0000 7f5f7775e640 1 -- 172.21.15.47:0/1828895241 shutdown_connections 2024-07-24T22:08:16.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.047+0000 7f5f7775e640 1 -- 172.21.15.47:0/1828895241 wait complete. 2024-07-24T22:08:16.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.047+0000 7f5f7775e640 1 Processor -- start 2024-07-24T22:08:16.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.048+0000 7f5f7775e640 1 -- start start 2024-07-24T22:08:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.048+0000 7f5f7775e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f70103660 0x7f5f70198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.048+0000 7f5f7775e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f70103f80 0x7f5f70199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.048+0000 7f5f7775e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f7010cac0 0x7f5f7019e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.048+0000 7f5f7775e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5f70112710 con 0x7f5f7010cac0 2024-07-24T22:08:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.048+0000 7f5f7775e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5f70112590 con 0x7f5f70103660 2024-07-24T22:08:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.048+0000 7f5f7775e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5f70112890 con 0x7f5f70103f80 2024-07-24T22:08:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.048+0000 7f5f74cf9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f70103f80 0x7f5f70199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:16.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.048+0000 7f5f74cf9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f70103f80 0x7f5f70199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:59974/0 (socket says 172.21.15.47:59974) 2024-07-24T22:08:16.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.048+0000 7f5f74cf9640 1 -- 172.21.15.47:0/3323296860 learned_addr learned my addr 172.21.15.47:0/3323296860 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:16.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.048+0000 7f5f75cfb640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f7010cac0 0x7f5f7019e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:16.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.048+0000 7f5f754fa640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f70103660 0x7f5f70198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.049+0000 7f5f74cf9640 1 -- 172.21.15.47:0/3323296860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f70103660 msgr2=0x7f5f70198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.049+0000 7f5f74cf9640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f70103660 0x7f5f70198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.049+0000 7f5f74cf9640 1 -- 172.21.15.47:0/3323296860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f7010cac0 msgr2=0x7f5f7019e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.049+0000 7f5f74cf9640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f7010cac0 0x7f5f7019e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.049+0000 7f5f74cf9640 1 -- 172.21.15.47:0/3323296860 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7019ec90 con 0x7f5f70103f80 2024-07-24T22:08:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.049+0000 7f5f75cfb640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f7010cac0 0x7f5f7019e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:08:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.049+0000 7f5f74cf9640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f70103f80 0x7f5f70199120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000c970 tx=0x7f5f6000ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.049+0000 7f5f667fc640 1 -- 172.21.15.47:0/3323296860 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f60007bb0 con 0x7f5f70103f80 2024-07-24T22:08:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.049+0000 7f5f667fc640 1 -- 172.21.15.47:0/3323296860 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f60007d50 con 0x7f5f70103f80 2024-07-24T22:08:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.049+0000 7f5f7775e640 1 -- 172.21.15.47:0/3323296860 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7019ef80 con 0x7f5f70103f80 2024-07-24T22:08:16.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.050+0000 7f5f667fc640 1 -- 172.21.15.47:0/3323296860 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000f7b0 con 0x7f5f70103f80 2024-07-24T22:08:16.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.050+0000 7f5f7775e640 1 -- 172.21.15.47:0/3323296860 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f701a5810 con 0x7f5f70103f80 2024-07-24T22:08:16.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.051+0000 7f5f7775e640 1 -- 172.21.15.47:0/3323296860 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f70103a40 con 0x7f5f70103f80 2024-07-24T22:08:16.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.053+0000 7f5f667fc640 1 -- 172.21.15.47:0/3323296860 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f5f60018480 con 0x7f5f70103f80 2024-07-24T22:08:16.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.054+0000 7f5f667fc640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5f5c0b3dc0 0x7f5f5c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:16.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.055+0000 7f5f754fa640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5f5c0b3dc0 0x7f5f5c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:16.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.055+0000 7f5f667fc640 1 -- 172.21.15.47:0/3323296860 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f5f600e41d0 con 0x7f5f70103f80 2024-07-24T22:08:16.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.055+0000 7f5f754fa640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5f5c0b3dc0 0x7f5f5c0b6280 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00bbe0 tx=0x7f5f6c00b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:16.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.059+0000 7f5f667fc640 1 -- 172.21.15.47:0/3323296860 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f5f600ab4d0 con 0x7f5f70103f80 2024-07-24T22:08:16.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.317+0000 7f5f7775e640 1 -- 172.21.15.47:0/3323296860 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f701a59e0 con 0x7f5f70103f80 2024-07-24T22:08:16.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.318+0000 7f5f667fc640 1 -- 172.21.15.47:0/3323296860 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f5f600aadd0 con 0x7f5f70103f80 2024-07-24T22:08:16.320 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:08:16.321 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:08:16.321 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:08:16.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.320+0000 7f5f7775e640 1 -- 172.21.15.47:0/3323296860 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5f5c0b3dc0 msgr2=0x7f5f5c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:16.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.320+0000 7f5f7775e640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5f5c0b3dc0 0x7f5f5c0b6280 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00bbe0 tx=0x7f5f6c00b390 comp rx=0 tx=0).stop 2024-07-24T22:08:16.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.320+0000 7f5f7775e640 1 -- 172.21.15.47:0/3323296860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f70103f80 msgr2=0x7f5f70199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:16.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.320+0000 7f5f7775e640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f70103f80 0x7f5f70199120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000c970 tx=0x7f5f6000ce30 comp rx=0 tx=0).stop 2024-07-24T22:08:16.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.321+0000 7f5f7775e640 1 -- 172.21.15.47:0/3323296860 shutdown_connections 2024-07-24T22:08:16.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.321+0000 7f5f7775e640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5f5c0b3dc0 0x7f5f5c0b6280 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:16.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.321+0000 7f5f7775e640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f7010cac0 0x7f5f7019e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:16.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.321+0000 7f5f7775e640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f70103f80 0x7f5f70199120 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:16.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.321+0000 7f5f7775e640 1 --2- 172.21.15.47:0/3323296860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f70103660 0x7f5f70198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:16.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.321+0000 7f5f7775e640 1 -- 172.21.15.47:0/3323296860 >> 172.21.15.47:0/3323296860 conn(0x7f5f700fd0c0 msgr2=0x7f5f7010eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:16.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.321+0000 7f5f7775e640 1 -- 172.21.15.47:0/3323296860 shutdown_connections 2024-07-24T22:08:16.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:16.321+0000 7f5f7775e640 1 -- 172.21.15.47:0/3323296860 wait complete. 2024-07-24T22:08:16.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:16 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3323296860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:16.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:16 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3323296860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:16.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:16 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3323296860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:17.637 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:17 smithi047 ceph-mon[32551]: pgmap v398: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 14 KiB/s wr, 4 op/s 2024-07-24T22:08:17.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:17 smithi183 ceph-mon[37007]: pgmap v398: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 14 KiB/s wr, 4 op/s 2024-07-24T22:08:17.670 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db --set-id 84029a6d --release --await' 2024-07-24T22:08:17.670 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db --set-id 84029a6d --release --await 2024-07-24T22:08:17.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:17 smithi188 ceph-mon[37380]: pgmap v398: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 14 KiB/s wr, 4 op/s 2024-07-24T22:08:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.245+0000 7faaa8fe0640 1 -- 172.21.15.47:0/3161988711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaa4101650 msgr2=0x7faaa4101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.245+0000 7faaa8fe0640 1 --2- 172.21.15.47:0/3161988711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaa4101650 0x7faaa4101a30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faa94009980 tx=0x7faa9402e820 comp rx=0 tx=0).stop 2024-07-24T22:08:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.246+0000 7faaa8fe0640 1 -- 172.21.15.47:0/3161988711 shutdown_connections 2024-07-24T22:08:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.246+0000 7faaa8fe0640 1 --2- 172.21.15.47:0/3161988711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaa41079e0 0x7faaa410e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.246+0000 7faaa8fe0640 1 --2- 172.21.15.47:0/3161988711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faaa4107060 0x7faaa41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.246+0000 7faaa8fe0640 1 --2- 172.21.15.47:0/3161988711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaa4101650 0x7faaa4101a30 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.246+0000 7faaa8fe0640 1 -- 172.21.15.47:0/3161988711 >> 172.21.15.47:0/3161988711 conn(0x7faaa40fd0c0 msgr2=0x7faaa40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.246+0000 7faaa8fe0640 1 -- 172.21.15.47:0/3161988711 shutdown_connections 2024-07-24T22:08:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.246+0000 7faaa8fe0640 1 -- 172.21.15.47:0/3161988711 wait complete. 2024-07-24T22:08:18.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.247+0000 7faaa8fe0640 1 Processor -- start 2024-07-24T22:08:18.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.247+0000 7faaa8fe0640 1 -- start start 2024-07-24T22:08:18.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.248+0000 7faaa8fe0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaa4101650 0x7faaa4196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:18.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.248+0000 7faaa8fe0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaa4107060 0x7faaa4196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.248+0000 7faaa259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaa4101650 0x7faaa4196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.248+0000 7faaa259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaa4101650 0x7faaa4196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40160/0 (socket says 172.21.15.47:40160) 2024-07-24T22:08:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.248+0000 7faaa259c640 1 -- 172.21.15.47:0/2616882504 learned_addr learned my addr 172.21.15.47:0/2616882504 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.248+0000 7faaa8fe0640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faaa41079e0 0x7faaa419c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.249+0000 7faaa8fe0640 1 -- 172.21.15.47:0/2616882504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faaa41105e0 con 0x7faaa4101650 2024-07-24T22:08:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.249+0000 7faaa1d9b640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaa4107060 0x7faaa4196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.249+0000 7faaa8fe0640 1 -- 172.21.15.47:0/2616882504 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faaa4110460 con 0x7faaa41079e0 2024-07-24T22:08:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.249+0000 7faaa8fe0640 1 -- 172.21.15.47:0/2616882504 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faaa4110760 con 0x7faaa4107060 2024-07-24T22:08:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.249+0000 7faaa2d9d640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faaa41079e0 0x7faaa419c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:18.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.250+0000 7faaa259c640 1 -- 172.21.15.47:0/2616882504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaa4107060 msgr2=0x7faaa4196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:18.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.250+0000 7faaa259c640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaa4107060 0x7faaa4196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:18.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.250+0000 7faaa259c640 1 -- 172.21.15.47:0/2616882504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faaa41079e0 msgr2=0x7faaa419c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:18.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.250+0000 7faaa259c640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faaa41079e0 0x7faaa419c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:18.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.250+0000 7faaa259c640 1 -- 172.21.15.47:0/2616882504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa419cac0 con 0x7faaa4101650 2024-07-24T22:08:18.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.250+0000 7faaa259c640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaa4101650 0x7faaa4196a10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7faa94009430 tx=0x7faa940366c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:18.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.250+0000 7faa937fe640 1 -- 172.21.15.47:0/2616882504 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94045070 con 0x7faaa4101650 2024-07-24T22:08:18.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.250+0000 7faa937fe640 1 -- 172.21.15.47:0/2616882504 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa940368b0 con 0x7faaa4101650 2024-07-24T22:08:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.250+0000 7faa937fe640 1 -- 172.21.15.47:0/2616882504 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94040480 con 0x7faaa4101650 2024-07-24T22:08:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.250+0000 7faaa8fe0640 1 -- 172.21.15.47:0/2616882504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa419cd50 con 0x7faaa4101650 2024-07-24T22:08:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.250+0000 7faaa8fe0640 1 -- 172.21.15.47:0/2616882504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa41a3470 con 0x7faaa4101650 2024-07-24T22:08:18.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.253+0000 7faaa8fe0640 1 -- 172.21.15.47:0/2616882504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa4101a30 con 0x7faaa4101650 2024-07-24T22:08:18.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.255+0000 7faa937fe640 1 -- 172.21.15.47:0/2616882504 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7faa940035f0 con 0x7faaa4101650 2024-07-24T22:08:18.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.256+0000 7faa937fe640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faa8c0b3d40 0x7faa8c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:18.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.256+0000 7faa937fe640 1 -- 172.21.15.47:0/2616882504 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7faa94104170 con 0x7faaa4101650 2024-07-24T22:08:18.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.256+0000 7faaa1d9b640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faa8c0b3d40 0x7faa8c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:18.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.257+0000 7faaa1d9b640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faa8c0b3d40 0x7faa8c0b6200 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faaa41068b0 tx=0x7faa98017040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:18.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.264+0000 7faa937fe640 1 -- 172.21.15.47:0/2616882504 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7faa940cb420 con 0x7faaa4101650 2024-07-24T22:08:18.291 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:18.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.702+0000 7faaa8fe0640 1 -- 172.21.15.47:0/2616882504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaa402e000 con 0x7faaa4101650 2024-07-24T22:08:18.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.703+0000 7faa937fe640 1 -- 172.21.15.47:0/2616882504 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7faa940cad20 con 0x7faaa4101650 2024-07-24T22:08:18.705 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:08:18.705 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:08:18.705 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:08:18.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.706+0000 7faaa8fe0640 1 -- 172.21.15.47:0/2616882504 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faa8c0b3d40 msgr2=0x7faa8c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:18.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.706+0000 7faaa8fe0640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faa8c0b3d40 0x7faa8c0b6200 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faaa41068b0 tx=0x7faa98017040 comp rx=0 tx=0).stop 2024-07-24T22:08:18.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.706+0000 7faaa8fe0640 1 -- 172.21.15.47:0/2616882504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaa4101650 msgr2=0x7faaa4196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:18.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.706+0000 7faaa8fe0640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaa4101650 0x7faaa4196a10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7faa94009430 tx=0x7faa940366c0 comp rx=0 tx=0).stop 2024-07-24T22:08:18.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.706+0000 7faaa8fe0640 1 -- 172.21.15.47:0/2616882504 shutdown_connections 2024-07-24T22:08:18.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.706+0000 7faaa8fe0640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7faa8c0b3d40 0x7faa8c0b6200 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:18.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.706+0000 7faaa8fe0640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faaa41079e0 0x7faaa419c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:18.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.706+0000 7faaa8fe0640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaa4107060 0x7faaa4196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:18.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.706+0000 7faaa8fe0640 1 --2- 172.21.15.47:0/2616882504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaa4101650 0x7faaa4196a10 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:18.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.706+0000 7faaa8fe0640 1 -- 172.21.15.47:0/2616882504 >> 172.21.15.47:0/2616882504 conn(0x7faaa40fd0c0 msgr2=0x7faaa40ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:18.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.707+0000 7faaa8fe0640 1 -- 172.21.15.47:0/2616882504 shutdown_connections 2024-07-24T22:08:18.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:18.707+0000 7faaa8fe0640 1 -- 172.21.15.47:0/2616882504 wait complete. 2024-07-24T22:08:19.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:19 smithi047 ceph-mon[32551]: pgmap v399: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.7 KiB/s wr, 3 op/s 2024-07-24T22:08:19.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:19 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2616882504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:19.737 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:08:19.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:19 smithi188 ceph-mon[37380]: pgmap v399: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.7 KiB/s wr, 3 op/s 2024-07-24T22:08:19.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:19 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2616882504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:19.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:19 smithi183 ceph-mon[37007]: pgmap v399: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.7 KiB/s wr, 3 op/s 2024-07-24T22:08:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:19 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2616882504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:20.236 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.935+0000 7f8dc414a640 1 -- 172.21.15.47:0/3083621396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dbc101650 msgr2=0x7f8dbc101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.935+0000 7f8dc414a640 1 --2- 172.21.15.47:0/3083621396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dbc101650 0x7f8dbc101a30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009900 tx=0x7f8db802a410 comp rx=0 tx=0).stop 2024-07-24T22:08:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.935+0000 7f8dc414a640 1 -- 172.21.15.47:0/3083621396 shutdown_connections 2024-07-24T22:08:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.935+0000 7f8dc414a640 1 --2- 172.21.15.47:0/3083621396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dbc1079e0 0x7f8dbc10e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.935+0000 7f8dc414a640 1 --2- 172.21.15.47:0/3083621396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc107060 0x7f8dbc1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.935+0000 7f8dc414a640 1 --2- 172.21.15.47:0/3083621396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dbc101650 0x7f8dbc101a30 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.935+0000 7f8dc414a640 1 -- 172.21.15.47:0/3083621396 >> 172.21.15.47:0/3083621396 conn(0x7f8dbc0fd0c0 msgr2=0x7f8dbc0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.936+0000 7f8dc414a640 1 -- 172.21.15.47:0/3083621396 shutdown_connections 2024-07-24T22:08:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.936+0000 7f8dc414a640 1 -- 172.21.15.47:0/3083621396 wait complete. 2024-07-24T22:08:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.937+0000 7f8dc414a640 1 Processor -- start 2024-07-24T22:08:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.938+0000 7f8dc414a640 1 -- start start 2024-07-24T22:08:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.938+0000 7f8dc414a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc101650 0x7f8dbc196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.938+0000 7f8dc414a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dbc107060 0x7f8dbc196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.938+0000 7f8dc414a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dbc1079e0 0x7f8dbc19c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.938+0000 7f8dc414a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1105e0 con 0x7f8dbc1079e0 2024-07-24T22:08:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.938+0000 7f8dc414a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc110460 con 0x7f8dbc101650 2024-07-24T22:08:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.938+0000 7f8dc414a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc110760 con 0x7f8dbc107060 2024-07-24T22:08:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.938+0000 7f8dc26e7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dbc1079e0 0x7f8dbc19c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.938+0000 7f8dc1ee6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc101650 0x7f8dbc196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.938+0000 7f8dc26e7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dbc1079e0 0x7f8dbc19c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40180/0 (socket says 172.21.15.47:40180) 2024-07-24T22:08:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.938+0000 7f8dc26e7640 1 -- 172.21.15.47:0/397847499 learned_addr learned my addr 172.21.15.47:0/397847499 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.938+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dbc107060 0x7f8dbc196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.939+0000 7f8dc16e5640 1 -- 172.21.15.47:0/397847499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc101650 msgr2=0x7f8dbc196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.939+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc101650 0x7f8dbc196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.939+0000 7f8dc16e5640 1 -- 172.21.15.47:0/397847499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dbc1079e0 msgr2=0x7f8dbc19c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.939+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dbc1079e0 0x7f8dbc19c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.939+0000 7f8dc16e5640 1 -- 172.21.15.47:0/397847499 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc19c8e0 con 0x7f8dbc107060 2024-07-24T22:08:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.939+0000 7f8dc26e7640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dbc1079e0 0x7f8dbc19c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:08:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.939+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dbc107060 0x7f8dbc196d70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009e60 tx=0x7f8dac00edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.939+0000 7f8db2ffd640 1 -- 172.21.15.47:0/397847499 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac024070 con 0x7f8dbc107060 2024-07-24T22:08:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.939+0000 7f8db2ffd640 1 -- 172.21.15.47:0/397847499 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dac00cd60 con 0x7f8dbc107060 2024-07-24T22:08:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.939+0000 7f8db2ffd640 1 -- 172.21.15.47:0/397847499 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac01d340 con 0x7f8dbc107060 2024-07-24T22:08:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.939+0000 7f8dc414a640 1 -- 172.21.15.47:0/397847499 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dbc19cbd0 con 0x7f8dbc107060 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.940+0000 7f8dc414a640 1 -- 172.21.15.47:0/397847499 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dbc1a3290 con 0x7f8dbc107060 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.943+0000 7f8dc64fb740 1 Processor -- start 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.943+0000 7f8dc64fb740 1 -- start start 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.943+0000 7f8db2ffd640 1 -- 172.21.15.47:0/397847499 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8dac027070 con 0x7f8dbc107060 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.944+0000 7f8dc64fb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a3a30 0x55d24c5a3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.944+0000 7f8dc64fb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a4350 0x55d24c5afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.944+0000 7f8dc64fb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 0x55d24c5b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.944+0000 7f8dc64fb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d24c51add0 con 0x55d24c5b02e0 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.944+0000 7f8dc64fb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d24c50a2d0 con 0x55d24c5a4350 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.944+0000 7f8dc64fb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d24c50e310 con 0x55d24c5a3a30 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.944+0000 7f8dc16e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 0x55d24c5b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.944+0000 7f8dc16e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 0x55d24c5b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40194/0 (socket says 172.21.15.47:40194) 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.944+0000 7f8dc16e5640 1 -- 172.21.15.47:0/2090509830 learned_addr learned my addr 172.21.15.47:0/2090509830 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:20.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.944+0000 7f8dc1ee6640 1 --2- 172.21.15.47:0/2090509830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a4350 0x55d24c5afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.945+0000 7f8dc16e5640 1 -- 172.21.15.47:0/2090509830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a3a30 msgr2=0x55d24c5a3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.945+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/2090509830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a3a30 0x55d24c5a3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.945+0000 7f8dc16e5640 1 -- 172.21.15.47:0/2090509830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a4350 msgr2=0x55d24c5afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.945+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/2090509830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a4350 0x55d24c5afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.945+0000 7f8dc16e5640 1 -- 172.21.15.47:0/2090509830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d24c26ab00 con 0x55d24c5b02e0 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.945+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/2090509830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 0x55d24c5b26d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0e9b20 tx=0x7f8dac0f4430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0651a6b59c1b9d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.945+0000 7f8da7fff640 1 -- 172.21.15.47:0/2090509830 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0ee310 con 0x55d24c5b02e0 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.946+0000 7f8da7fff640 1 -- 172.21.15.47:0/2090509830 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dac0ee4b0 con 0x55d24c5b02e0 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.946+0000 7f8da7fff640 1 -- 172.21.15.47:0/2090509830 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0fb8e0 con 0x55d24c5b02e0 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.946+0000 7f8db2ffd640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8da80b3dc0 0x7f8da80b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.946+0000 7f8db2ffd640 1 -- 172.21.15.47:0/397847499 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8dac0ec3e0 con 0x7f8dbc107060 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.946+0000 7f8dc26e7640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8da80b3dc0 0x7f8da80b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.947+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2090509830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 msgr2=0x55d24c5b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.947+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2090509830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 0x55d24c5b26d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0e9b20 tx=0x7f8dac0f4430 comp rx=0 tx=0).stop 2024-07-24T22:08:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.947+0000 7f8dc26e7640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8da80b3dc0 0x7f8da80b6280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8db40093a0 tx=0x7f8db400e040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.947+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2090509830 shutdown_connections 2024-07-24T22:08:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.947+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2090509830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 0x55d24c5b26d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.947+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2090509830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a4350 0x55d24c5afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.947+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2090509830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a3a30 0x55d24c5a3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.947+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2090509830 >> 172.21.15.47:0/2090509830 conn(0x55d24c5a1860 msgr2=0x55d24c5a2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.948+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2090509830 shutdown_connections 2024-07-24T22:08:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.948+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2090509830 wait complete. 2024-07-24T22:08:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.948+0000 7f8dc64fb740 1 -- start start 2024-07-24T22:08:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.948+0000 7f8dc64fb740 1 Processor -- start 2024-07-24T22:08:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc64fb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a3a30 0x55d24c5ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc64fb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a4350 0x55d24c5ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc64fb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 0x55d24c5add40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc26e7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 0x55d24c5add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:20.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc26e7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 0x55d24c5add40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40208/0 (socket says 172.21.15.47:40208) 2024-07-24T22:08:20.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc26e7640 1 -- 172.21.15.47:0/2871992230 learned_addr learned my addr 172.21.15.47:0/2871992230 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:20.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2871992230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d24c36dbb0 con 0x55d24c5b02e0 2024-07-24T22:08:20.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2871992230 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d24c4ac900 con 0x55d24c5a3a30 2024-07-24T22:08:20.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2871992230 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d24c5b2f60 con 0x55d24c5a4350 2024-07-24T22:08:20.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc1ee6640 1 --2- 172.21.15.47:0/2871992230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a3a30 0x55d24c5ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:20.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc64fb740 10 client.0 _ll_register_callbacks cb 0x55d24c4b6c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:20.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/2871992230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a4350 0x55d24c5ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:20.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc26e7640 1 -- 172.21.15.47:0/2871992230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a4350 msgr2=0x55d24c5ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc26e7640 1 --2- 172.21.15.47:0/2871992230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a4350 0x55d24c5ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc26e7640 1 -- 172.21.15.47:0/2871992230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a3a30 msgr2=0x55d24c5ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc26e7640 1 --2- 172.21.15.47:0/2871992230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a3a30 0x55d24c5ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.949+0000 7f8dc26e7640 1 -- 172.21.15.47:0/2871992230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d24c2e1960 con 0x55d24c5b02e0 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.950+0000 7f8dc26e7640 1 --2- 172.21.15.47:0/2871992230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 0x55d24c5add40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8db4017db0 tx=0x7f8db4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a47a2e80148aa0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.950+0000 7f8da57fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.950+0000 7f8da57fa640 1 -- 172.21.15.47:0/2871992230 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db4026060 con 0x55d24c5b02e0 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.950+0000 7f8da57fa640 1 -- 172.21.15.47:0/2871992230 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8db40215f0 con 0x55d24c5b02e0 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.950+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2871992230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dac0ee4b0 con 0x55d24c5b02e0 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.950+0000 7f8da57fa640 1 -- 172.21.15.47:0/2871992230 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8db40217f0 con 0x55d24c5b02e0 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.950+0000 7f8dc64fb740 10 client.15702 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.950+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2871992230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d24c5bebb0 con 0x55d24c5b02e0 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.950+0000 7f8da57fa640 1 -- 172.21.15.47:0/2871992230 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8db4021e40 con 0x55d24c5b02e0 2024-07-24T22:08:20.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.951+0000 7f8da57fa640 1 -- 172.21.15.47:0/2871992230 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8db4029ae0 con 0x55d24c5b02e0 2024-07-24T22:08:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.951+0000 7f8dc64fb740 10 client.15702 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.951+0000 7f8dc64fb740 10 client.15702 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:08:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.951+0000 7f8dc64fb740 20 client.15702 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.951+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2871992230 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d24c5c00c0 0x55d24c5c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.951+0000 7f8dc64fb740 4 client.15702 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.951+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2871992230 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8dac0ee4b0 con 0x55d24c5c00c0 2024-07-24T22:08:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.951+0000 7f8dc1ee6640 1 --2- 172.21.15.47:0/2871992230 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d24c5c00c0 0x55d24c5c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.952+0000 7f8da57fa640 10 client.15702 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.952+0000 7f8dc1ee6640 1 --2- 172.21.15.47:0/2871992230 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d24c5c00c0 0x55d24c5c24e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cda07bf28fd44f02 server_cookie=bba2aff87d15d4fd in_seq=0 out_seq=0 2024-07-24T22:08:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8da57fa640 1 -- 172.21.15.47:0/2871992230 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8dac0ee4b0 con 0x55d24c5c00c0 2024-07-24T22:08:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8da57fa640 10 client.15702 handle_command_reply: tid=0 2024-07-24T22:08:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8dc64fb740 1 client.15702 shutdown 2024-07-24T22:08:20.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2871992230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 msgr2=0x55d24c5add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:20.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2871992230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 0x55d24c5add40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8db4017db0 tx=0x7f8db4004ab0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2871992230 shutdown_connections 2024-07-24T22:08:20.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2871992230 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d24c5c00c0 0x55d24c5c24e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2871992230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5b02e0 0x55d24c5add40 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2871992230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a4350 0x55d24c5ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8da57fa640 0 client.15702 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:20.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2871992230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a3a30 0x55d24c5ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:20.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2871992230 >> 172.21.15.47:0/2871992230 conn(0x55d24c5a1860 msgr2=0x55d24c5a7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:20.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2871992230 shutdown_connections 2024-07-24T22:08:20.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.953+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2871992230 wait complete. 2024-07-24T22:08:20.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.954+0000 7f8dc64fb740 20 client.15702 trim_cache size 0 max 16384 2024-07-24T22:08:20.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.990+0000 7f8dc64fb740 1 Processor -- start 2024-07-24T22:08:20.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.990+0000 7f8dc64fb740 1 -- start start 2024-07-24T22:08:20.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.990+0000 7f8dc64fb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a3a30 0x55d24c5a7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.990+0000 7f8dc64fb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a4350 0x55d24c5c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.990+0000 7f8dc16e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a4350 0x55d24c5c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:20.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.990+0000 7f8dc16e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a4350 0x55d24c5c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40218/0 (socket says 172.21.15.47:40218) 2024-07-24T22:08:20.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.990+0000 7f8dc16e5640 1 -- 172.21.15.47:0/2976145409 learned_addr learned my addr 172.21.15.47:0/2976145409 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:20.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.990+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2976145409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5b02e0 0x55d24c5c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:20.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.990+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2976145409 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1a9e40 con 0x55d24c5a4350 2024-07-24T22:08:20.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.991+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2976145409 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1ac6c0 con 0x55d24c5b02e0 2024-07-24T22:08:20.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.991+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2976145409 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1aa4b0 con 0x55d24c5a3a30 2024-07-24T22:08:20.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.991+0000 7f8dc26e7640 1 --2- 172.21.15.47:0/2976145409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5b02e0 0x55d24c5c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:20.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.991+0000 7f8dc1ee6640 1 --2- 172.21.15.47:0/2976145409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a3a30 0x55d24c5a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:20.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.991+0000 7f8dc16e5640 1 -- 172.21.15.47:0/2976145409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a3a30 msgr2=0x55d24c5a7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:21.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.991+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/2976145409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a3a30 0x55d24c5a7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.991+0000 7f8dc16e5640 1 -- 172.21.15.47:0/2976145409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5b02e0 msgr2=0x55d24c5c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:21.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.991+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/2976145409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5b02e0 0x55d24c5c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.991+0000 7f8dc16e5640 1 -- 172.21.15.47:0/2976145409 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d24c251e90 con 0x55d24c5a4350 2024-07-24T22:08:21.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.991+0000 7f8dc26e7640 1 --2- 172.21.15.47:0/2976145409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5b02e0 0x55d24c5c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:21.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.991+0000 7f8dc1ee6640 1 --2- 172.21.15.47:0/2976145409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a3a30 0x55d24c5a7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:21.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.991+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/2976145409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a4350 0x55d24c5c7db0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0f42c0 tx=0x7f8dac01f8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b0a5c615e7a6dd server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:21.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.992+0000 7f8da77fe640 1 -- 172.21.15.47:0/2976145409 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0b2f20 con 0x55d24c5a4350 2024-07-24T22:08:21.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.992+0000 7f8da77fe640 1 -- 172.21.15.47:0/2976145409 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dac0b2c60 con 0x55d24c5a4350 2024-07-24T22:08:21.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.992+0000 7f8da77fe640 1 -- 172.21.15.47:0/2976145409 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0b28c0 con 0x55d24c5a4350 2024-07-24T22:08:21.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.993+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2976145409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a4350 msgr2=0x55d24c5c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:21.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.993+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2976145409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a4350 0x55d24c5c7db0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0f42c0 tx=0x7f8dac01f8e0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.993+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2976145409 shutdown_connections 2024-07-24T22:08:21.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.993+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2976145409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5b02e0 0x55d24c5c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.993+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2976145409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a4350 0x55d24c5c7db0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.993+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/2976145409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5a3a30 0x55d24c5a7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.993+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2976145409 >> 172.21.15.47:0/2976145409 conn(0x55d24c5a1860 msgr2=0x55d24c5a6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:21.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.993+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2976145409 shutdown_connections 2024-07-24T22:08:21.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.993+0000 7f8dc64fb740 1 -- 172.21.15.47:0/2976145409 wait complete. 2024-07-24T22:08:21.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.994+0000 7f8dc64fb740 1 -- start start 2024-07-24T22:08:21.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.994+0000 7f8dc64fb740 1 Processor -- start 2024-07-24T22:08:21.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.994+0000 7f8dc64fb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a3a30 0x55d24c5b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:21.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.994+0000 7f8dc64fb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a4350 0x55d24c5b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:21.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.994+0000 7f8dc1ee6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a3a30 0x55d24c5b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:21.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.994+0000 7f8dc1ee6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a3a30 0x55d24c5b85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40234/0 (socket says 172.21.15.47:40234) 2024-07-24T22:08:21.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.994+0000 7f8dc1ee6640 1 -- 172.21.15.47:0/804131 learned_addr learned my addr 172.21.15.47:0/804131 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:21.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.995+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a4350 0x55d24c5b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:21.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.995+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5b02e0 0x55d24c5b5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:21.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.995+0000 7f8dc64fb740 1 -- 172.21.15.47:0/804131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1aab80 con 0x55d24c5a3a30 2024-07-24T22:08:21.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.995+0000 7f8dc64fb740 1 -- 172.21.15.47:0/804131 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1abff0 con 0x55d24c5a4350 2024-07-24T22:08:21.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.995+0000 7f8dc64fb740 1 -- 172.21.15.47:0/804131 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1ab250 con 0x55d24c5b02e0 2024-07-24T22:08:21.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.995+0000 7f8dc26e7640 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5b02e0 0x55d24c5b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:21.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.995+0000 7f8dc64fb740 10 client.0 _ll_register_callbacks cb 0x7f8db4017ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:21.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.995+0000 7f8dc1ee6640 1 -- 172.21.15.47:0/804131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5b02e0 msgr2=0x55d24c5b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:21.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.995+0000 7f8dc1ee6640 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5b02e0 0x55d24c5b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.995+0000 7f8dc1ee6640 1 -- 172.21.15.47:0/804131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a4350 msgr2=0x55d24c5b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:21.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.995+0000 7f8dc1ee6640 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a4350 0x55d24c5b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.995+0000 7f8dc1ee6640 1 -- 172.21.15.47:0/804131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d24c5b5580 con 0x55d24c5a3a30 2024-07-24T22:08:21.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.996+0000 7f8dc1ee6640 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a3a30 0x55d24c5b85f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8db8005940 tx=0x7f8db8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c4ba753648c0eb server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:21.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.996+0000 7f8da57fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:21.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.996+0000 7f8da57fa640 1 -- 172.21.15.47:0/804131 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db8035040 con 0x55d24c5a3a30 2024-07-24T22:08:21.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.996+0000 7f8da57fa640 1 -- 172.21.15.47:0/804131 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8db8005220 con 0x55d24c5a3a30 2024-07-24T22:08:21.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.996+0000 7f8dc64fb740 1 -- 172.21.15.47:0/804131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dac0b2c60 con 0x55d24c5a3a30 2024-07-24T22:08:21.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.997+0000 7f8da57fa640 1 -- 172.21.15.47:0/804131 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8db8031e30 con 0x55d24c5a3a30 2024-07-24T22:08:21.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.997+0000 7f8dc64fb740 10 client.15708 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:21.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.997+0000 7f8dc64fb740 1 -- 172.21.15.47:0/804131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d24c62ba80 con 0x55d24c5a3a30 2024-07-24T22:08:21.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.997+0000 7f8da57fa640 1 -- 172.21.15.47:0/804131 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dac0b2c60 con 0x55d24c5a3a30 2024-07-24T22:08:21.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.997+0000 7f8da57fa640 1 -- 172.21.15.47:0/804131 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8db8047500 con 0x55d24c5a3a30 2024-07-24T22:08:21.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.997+0000 7f8dc64fb740 10 client.15708 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:21.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.997+0000 7f8dc64fb740 10 client.15708 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:08:21.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.997+0000 7f8dc64fb740 20 client.15708 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:21.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.997+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d24c62c280 0x55d24c62e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:21.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.997+0000 7f8dc64fb740 4 client.15708 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "84029a6d", "release": true, "await": true}] 2024-07-24T22:08:21.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.997+0000 7f8dc64fb740 1 -- 172.21.15.47:0/804131 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "set_id": "84029a6d", "release": true, "await": true}) -- 0x55d24c51cd20 con 0x55d24c62c280 2024-07-24T22:08:21.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.998+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d24c62c280 0x55d24c62e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:21.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.999+0000 7f8da57fa640 10 client.15708 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:21.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:20.999+0000 7f8dc16e5640 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d24c62c280 0x55d24c62e6a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=944c5ef372ac708c server_cookie=b9b6ac7aa913983e in_seq=0 out_seq=0 2024-07-24T22:08:21.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8da57fa640 1 -- 172.21.15.47:0/804131 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55d24c51cd20 con 0x55d24c62c280 2024-07-24T22:08:21.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8da57fa640 10 client.15708 handle_command_reply: tid=0 2024-07-24T22:08:21.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8dc64fb740 1 client.15708 shutdown 2024-07-24T22:08:21.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8dc64fb740 1 -- 172.21.15.47:0/804131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a3a30 msgr2=0x55d24c5b85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:21.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a3a30 0x55d24c5b85f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8db8005940 tx=0x7f8db8005fd0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8dc64fb740 1 -- 172.21.15.47:0/804131 shutdown_connections 2024-07-24T22:08:21.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d24c62c280 0x55d24c62e6a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8da57fa640 0 client.15708 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:21.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d24c5b02e0 0x55d24c5b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d24c5a4350 0x55d24c5b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8dc64fb740 1 --2- 172.21.15.47:0/804131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d24c5a3a30 0x55d24c5b85f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8dc64fb740 1 -- 172.21.15.47:0/804131 >> 172.21.15.47:0/804131 conn(0x55d24c5a1860 msgr2=0x55d24c5a7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:21.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8dc64fb740 1 -- 172.21.15.47:0/804131 shutdown_connections 2024-07-24T22:08:21.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8dc64fb740 1 -- 172.21.15.47:0/804131 wait complete. 2024-07-24T22:08:21.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.001+0000 7f8dc64fb740 20 client.15708 trim_cache size 0 max 16384 2024-07-24T22:08:21.008 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:08:21.008 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:08:21.009 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:08:21.009 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 4, 2024-07-24T22:08:21.009 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:08:21.009 INFO:teuthology.orchestra.run.smithi047.stdout: "84029a6d": { 2024-07-24T22:08:21.009 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 4, 2024-07-24T22:08:21.009 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:08:21.009 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:08:21.009 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:08:21.009 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:08:21.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:08:21.010 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:08:21.010 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 140.3, 2024-07-24T22:08:21.010 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:08:21.010 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:08:21.010 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:08:21.010 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:08:21.010 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:08:21.010 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:08:21.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:21.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:21.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:21.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:21.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:21.011 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:08:21.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.002+0000 7f8dc414a640 1 -- 172.21.15.47:0/397847499 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8da80b3dc0 msgr2=0x7f8da80b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:21.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.002+0000 7f8dc414a640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8da80b3dc0 0x7f8da80b6280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8db40093a0 tx=0x7f8db400e040 comp rx=0 tx=0).stop 2024-07-24T22:08:21.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.002+0000 7f8dc414a640 1 -- 172.21.15.47:0/397847499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dbc107060 msgr2=0x7f8dbc196d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:21.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.002+0000 7f8dc414a640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dbc107060 0x7f8dbc196d70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009e60 tx=0x7f8dac00edc0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.002+0000 7f8dc414a640 1 -- 172.21.15.47:0/397847499 shutdown_connections 2024-07-24T22:08:21.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.002+0000 7f8dc414a640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8da80b3dc0 0x7f8da80b6280 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.002+0000 7f8dc414a640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dbc1079e0 0x7f8dbc19c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.002+0000 7f8dc414a640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dbc107060 0x7f8dbc196d70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.002+0000 7f8dc414a640 1 --2- 172.21.15.47:0/397847499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc101650 0x7f8dbc196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:21.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.002+0000 7f8dc414a640 1 -- 172.21.15.47:0/397847499 >> 172.21.15.47:0/397847499 conn(0x7f8dbc0fd0c0 msgr2=0x7f8dbc103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:21.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.004+0000 7f8dc414a640 1 -- 172.21.15.47:0/397847499 shutdown_connections 2024-07-24T22:08:21.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:21.004+0000 7f8dc414a640 1 -- 172.21.15.47:0/397847499 wait complete. 2024-07-24T22:08:21.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:21 smithi047 ceph-mon[32551]: pgmap v400: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:08:21.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:21 smithi188 ceph-mon[37380]: pgmap v400: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:08:21.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:21 smithi183 ceph-mon[37007]: pgmap v400: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:08:22.260 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '84029a6d', total seconds elapsed: 29.1 2024-07-24T22:08:22.260 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-07-24T22:08:22.261 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:08:22.932 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:23.513 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:23 smithi047 ceph-mon[32551]: pgmap v401: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 341 B/s wr, 3 op/s 2024-07-24T22:08:23.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.509+0000 7f7ed7153640 1 -- 172.21.15.47:0/147489769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ed0108170 msgr2=0x7f7ed01085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:23.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.509+0000 7f7ed7153640 1 --2- 172.21.15.47:0/147489769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ed0108170 0x7f7ed01085b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009900 tx=0x7f7ec002a410 comp rx=0 tx=0).stop 2024-07-24T22:08:23.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.510+0000 7f7ed7153640 1 -- 172.21.15.47:0/147489769 shutdown_connections 2024-07-24T22:08:23.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.510+0000 7f7ed7153640 1 --2- 172.21.15.47:0/147489769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed0108af0 0x7f7ed010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.510+0000 7f7ed7153640 1 --2- 172.21.15.47:0/147489769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ed0108170 0x7f7ed01085b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.510+0000 7f7ed7153640 1 --2- 172.21.15.47:0/147489769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ed0102760 0x7f7ed0102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.510+0000 7f7ed7153640 1 -- 172.21.15.47:0/147489769 >> 172.21.15.47:0/147489769 conn(0x7f7ed00fe210 msgr2=0x7f7ed0100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:23.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.510+0000 7f7ed7153640 1 -- 172.21.15.47:0/147489769 shutdown_connections 2024-07-24T22:08:23.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.510+0000 7f7ed7153640 1 -- 172.21.15.47:0/147489769 wait complete. 2024-07-24T22:08:23.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.510+0000 7f7ed7153640 1 Processor -- start 2024-07-24T22:08:23.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.511+0000 7f7ed7153640 1 -- start start 2024-07-24T22:08:23.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.511+0000 7f7ed7153640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed0102760 0x7f7ed0198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.511+0000 7f7ed7153640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ed0108170 0x7f7ed01991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.511+0000 7f7ed7153640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ed0108af0 0x7f7ed019e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.511+0000 7f7ed4eef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed0102760 0x7f7ed0198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.511+0000 7f7ed7153640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed0112720 con 0x7f7ed0108af0 2024-07-24T22:08:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.511+0000 7f7ec7fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ed0108170 0x7f7ed01991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.511+0000 7f7ed4eef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed0102760 0x7f7ed0198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:60056/0 (socket says 172.21.15.47:60056) 2024-07-24T22:08:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.511+0000 7f7ed4eef640 1 -- 172.21.15.47:0/3966920951 learned_addr learned my addr 172.21.15.47:0/3966920951 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.511+0000 7f7ed7153640 1 -- 172.21.15.47:0/3966920951 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01125a0 con 0x7f7ed0108170 2024-07-24T22:08:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.511+0000 7f7ed7153640 1 -- 172.21.15.47:0/3966920951 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01128a0 con 0x7f7ed0102760 2024-07-24T22:08:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.511+0000 7f7ed56f0640 1 --2- 172.21.15.47:0/3966920951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ed0108af0 0x7f7ed019e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.512+0000 7f7ed4eef640 1 -- 172.21.15.47:0/3966920951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ed0108170 msgr2=0x7f7ed01991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:23.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.512+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/3966920951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ed0108170 0x7f7ed01991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.512+0000 7f7ed4eef640 1 -- 172.21.15.47:0/3966920951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ed0108af0 msgr2=0x7f7ed019e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:23.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.512+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/3966920951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ed0108af0 0x7f7ed019e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.512+0000 7f7ed4eef640 1 -- 172.21.15.47:0/3966920951 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed019ed20 con 0x7f7ed0102760 2024-07-24T22:08:23.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.512+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/3966920951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed0102760 0x7f7ed0198c70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009c20 tx=0x7f7ecc00b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:23.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.512+0000 7f7ec5ffb640 1 -- 172.21.15.47:0/3966920951 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc01e070 con 0x7f7ed0102760 2024-07-24T22:08:23.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.512+0000 7f7ec5ffb640 1 -- 172.21.15.47:0/3966920951 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ecc0198c0 con 0x7f7ed0102760 2024-07-24T22:08:23.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.512+0000 7f7ed7153640 1 -- 172.21.15.47:0/3966920951 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed019f010 con 0x7f7ed0102760 2024-07-24T22:08:23.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.513+0000 7f7ec5ffb640 1 -- 172.21.15.47:0/3966920951 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0187d0 con 0x7f7ed0102760 2024-07-24T22:08:23.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.513+0000 7f7ed7153640 1 -- 172.21.15.47:0/3966920951 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed0074d70 con 0x7f7ed0102760 2024-07-24T22:08:23.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.515+0000 7f7ec5ffb640 1 -- 172.21.15.47:0/3966920951 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f7ecc021070 con 0x7f7ed0102760 2024-07-24T22:08:23.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.515+0000 7f7ed9504740 1 Processor -- start 2024-07-24T22:08:23.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.516+0000 7f7ec5ffb640 1 --2- 172.21.15.47:0/3966920951 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7eb80b3dc0 0x7f7eb80b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.516+0000 7f7ec5ffb640 1 -- 172.21.15.47:0/3966920951 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f7ecc0e7790 con 0x7f7ed0102760 2024-07-24T22:08:23.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.516+0000 7f7ed9504740 1 -- start start 2024-07-24T22:08:23.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.516+0000 7f7ed56f0640 1 --2- 172.21.15.47:0/3966920951 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7eb80b3dc0 0x7f7eb80b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.516+0000 7f7ed9504740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 0x55effd759ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.516+0000 7f7ed9504740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd759ff0 0x55effd776a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.516+0000 7f7ed9504740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd779380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.516+0000 7f7ed9504740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55effd6d09b0 con 0x55effd7596d0 2024-07-24T22:08:23.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.516+0000 7f7ed9504740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55effd6bfeb0 con 0x55effd759ff0 2024-07-24T22:08:23.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.516+0000 7f7ed9504740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55effd6c3ef0 con 0x55effd776f90 2024-07-24T22:08:23.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.517+0000 7f7ed4eef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 0x55effd759ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.517+0000 7f7ed4eef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 0x55effd759ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40268/0 (socket says 172.21.15.47:40268) 2024-07-24T22:08:23.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.517+0000 7f7ed4eef640 1 -- 172.21.15.47:0/3809324965 learned_addr learned my addr 172.21.15.47:0/3809324965 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:23.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.517+0000 7f7ec7fff640 1 --2- 172.21.15.47:0/3809324965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd759ff0 0x55effd776a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.517+0000 7f7ed4eef640 1 -- 172.21.15.47:0/3809324965 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 msgr2=0x55effd779380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-24T22:08:23.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.517+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/3809324965 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd779380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.517+0000 7f7ed4eef640 1 -- 172.21.15.47:0/3809324965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd759ff0 msgr2=0x55effd776a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:23.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.517+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/3809324965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd759ff0 0x55effd776a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.517+0000 7f7ed4eef640 1 -- 172.21.15.47:0/3809324965 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effd649320 con 0x55effd7596d0 2024-07-24T22:08:23.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.517+0000 7f7ed56f0640 1 --2- 172.21.15.47:0/3966920951 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7eb80b3dc0 0x7f7eb80b6280 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8005fd0 tx=0x7f7ec8009500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:23.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.517+0000 7f7ec7fff640 1 --2- 172.21.15.47:0/3809324965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd759ff0 0x55effd776a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:23.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.517+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/3809324965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 0x55effd759ab0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009bf0 tx=0x7f7ecc0ae080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27f43cfb880d501 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:23.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.518+0000 7f7eb6ffd640 1 -- 172.21.15.47:0/3809324965 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0c8070 con 0x55effd7596d0 2024-07-24T22:08:23.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.518+0000 7f7eb6ffd640 1 -- 172.21.15.47:0/3809324965 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ecc019a70 con 0x55effd7596d0 2024-07-24T22:08:23.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.518+0000 7f7eb6ffd640 1 -- 172.21.15.47:0/3809324965 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0a8dd0 con 0x55effd7596d0 2024-07-24T22:08:23.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.519+0000 7f7ed9504740 1 -- 172.21.15.47:0/3809324965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 msgr2=0x55effd759ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:23.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.519+0000 7f7ed9504740 1 --2- 172.21.15.47:0/3809324965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 0x55effd759ab0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009bf0 tx=0x7f7ecc0ae080 comp rx=0 tx=0).stop 2024-07-24T22:08:23.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.519+0000 7f7ed9504740 1 -- 172.21.15.47:0/3809324965 shutdown_connections 2024-07-24T22:08:23.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.519+0000 7f7ed9504740 1 --2- 172.21.15.47:0/3809324965 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd779380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.519+0000 7f7ed9504740 1 --2- 172.21.15.47:0/3809324965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd759ff0 0x55effd776a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.519+0000 7f7ed9504740 1 --2- 172.21.15.47:0/3809324965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 0x55effd759ab0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.519+0000 7f7ed9504740 1 -- 172.21.15.47:0/3809324965 >> 172.21.15.47:0/3809324965 conn(0x55effd757500 msgr2=0x55effd7586a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:23.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.519+0000 7f7ed9504740 1 -- 172.21.15.47:0/3809324965 shutdown_connections 2024-07-24T22:08:23.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.519+0000 7f7ed9504740 1 -- 172.21.15.47:0/3809324965 wait complete. 2024-07-24T22:08:23.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.519+0000 7f7ed9504740 1 -- start start 2024-07-24T22:08:23.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.519+0000 7f7ed9504740 1 Processor -- start 2024-07-24T22:08:23.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.520+0000 7f7ed9504740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 0x55effd774040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.520+0000 7f7ed9504740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd759ff0 0x55effd774580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.520+0000 7f7ed9504740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd774ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.520+0000 7f7ed9504740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55effd523700 con 0x55effd7596d0 2024-07-24T22:08:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.520+0000 7f7ed9504740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55effd6625f0 con 0x55effd759ff0 2024-07-24T22:08:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.520+0000 7f7ed9504740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55effd779c40 con 0x55effd776f90 2024-07-24T22:08:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.520+0000 7f7ed9504740 10 client.0 _ll_register_callbacks cb 0x55effd682960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.520+0000 7f7ed4eef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 0x55effd774040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.520+0000 7f7ed4eef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 0x55effd774040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40276/0 (socket says 172.21.15.47:40276) 2024-07-24T22:08:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.520+0000 7f7ed4eef640 1 -- 172.21.15.47:0/505026780 learned_addr learned my addr 172.21.15.47:0/505026780 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.521+0000 7f7ed56f0640 1 --2- 172.21.15.47:0/505026780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd774ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.521+0000 7f7ec7fff640 1 --2- 172.21.15.47:0/505026780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd759ff0 0x55effd774580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.521+0000 7f7ed4eef640 1 -- 172.21.15.47:0/505026780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 msgr2=0x55effd774ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.521+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/505026780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd774ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.521+0000 7f7ed4eef640 1 -- 172.21.15.47:0/505026780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd759ff0 msgr2=0x55effd774580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.521+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/505026780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd759ff0 0x55effd774580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.521+0000 7f7ed4eef640 1 -- 172.21.15.47:0/505026780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55effd655680 con 0x55effd7596d0 2024-07-24T22:08:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.521+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/505026780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 0x55effd774040 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0e7ab0 tx=0x7f7ecc0a8e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794aa1124000cb82 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.521+0000 7f7eaffff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.521+0000 7f7eaffff640 1 -- 172.21.15.47:0/505026780 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0c8040 con 0x55effd7596d0 2024-07-24T22:08:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.522+0000 7f7eaffff640 1 -- 172.21.15.47:0/505026780 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f7ecc019620 con 0x55effd7596d0 2024-07-24T22:08:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.522+0000 7f7ed9504740 1 -- 172.21.15.47:0/505026780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ecc019a70 con 0x55effd7596d0 2024-07-24T22:08:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.522+0000 7f7eaffff640 1 -- 172.21.15.47:0/505026780 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7ecc0ad6b0 con 0x55effd7596d0 2024-07-24T22:08:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.522+0000 7f7ed9504740 10 client.15717 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.522+0000 7f7ed9504740 1 -- 172.21.15.47:0/505026780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55effd420650 con 0x55effd7596d0 2024-07-24T22:08:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.522+0000 7f7eaffff640 1 -- 172.21.15.47:0/505026780 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ecc019a70 con 0x55effd7596d0 2024-07-24T22:08:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.522+0000 7f7eaffff640 1 -- 172.21.15.47:0/505026780 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7ecc0cf400 con 0x55effd7596d0 2024-07-24T22:08:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.522+0000 7f7ed9504740 10 client.15717 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.522+0000 7f7ed9504740 10 client.15717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.522+0000 7f7ed9504740 20 client.15717 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.522+0000 7f7ed9504740 1 --2- 172.21.15.47:0/505026780 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55effd786a10 0x55effd788e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.523+0000 7f7ed9504740 4 client.15717 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.523+0000 7f7ed9504740 1 -- 172.21.15.47:0/505026780 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55effd6d2900 con 0x55effd786a10 2024-07-24T22:08:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.523+0000 7f7ec7fff640 1 --2- 172.21.15.47:0/505026780 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55effd786a10 0x55effd788e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.523+0000 7f7ec7fff640 1 --2- 172.21.15.47:0/505026780 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55effd786a10 0x55effd788e00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cbb8592238fa782 server_cookie=e2da0af326a53e12 in_seq=0 out_seq=0 2024-07-24T22:08:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.523+0000 7f7eaffff640 10 client.15717 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.524+0000 7f7eaffff640 1 -- 172.21.15.47:0/505026780 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55effd6d2900 con 0x55effd786a10 2024-07-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.524+0000 7f7eaffff640 10 client.15717 handle_command_reply: tid=0 2024-07-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.524+0000 7f7ed9504740 1 client.15717 shutdown 2024-07-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.524+0000 7f7ed9504740 1 -- 172.21.15.47:0/505026780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 msgr2=0x55effd774040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.524+0000 7f7ed9504740 1 --2- 172.21.15.47:0/505026780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 0x55effd774040 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0e7ab0 tx=0x7f7ecc0a8e20 comp rx=0 tx=0).stop 2024-07-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.524+0000 7f7ed9504740 1 -- 172.21.15.47:0/505026780 shutdown_connections 2024-07-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.524+0000 7f7ed9504740 1 --2- 172.21.15.47:0/505026780 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55effd786a10 0x55effd788e00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.524+0000 7f7ed9504740 1 --2- 172.21.15.47:0/505026780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd774ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.524+0000 7f7eaffff640 0 client.15717 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.524+0000 7f7ed9504740 1 --2- 172.21.15.47:0/505026780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd759ff0 0x55effd774580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.524+0000 7f7ed9504740 1 --2- 172.21.15.47:0/505026780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd7596d0 0x55effd774040 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.524+0000 7f7ed9504740 1 -- 172.21.15.47:0/505026780 >> 172.21.15.47:0/505026780 conn(0x55effd757500 msgr2=0x55effd75d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.525+0000 7f7ed9504740 1 -- 172.21.15.47:0/505026780 shutdown_connections 2024-07-24T22:08:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.525+0000 7f7ed9504740 1 -- 172.21.15.47:0/505026780 wait complete. 2024-07-24T22:08:23.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.525+0000 7f7ed9504740 20 client.15717 trim_cache size 0 max 16384 2024-07-24T22:08:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.540+0000 7f7ed9504740 1 Processor -- start 2024-07-24T22:08:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.540+0000 7f7ed9504740 1 -- start start 2024-07-24T22:08:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.540+0000 7f7ed9504740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd7596d0 0x55effd758cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.540+0000 7f7ed9504740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd759ff0 0x55effd771a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.540+0000 7f7ed9504740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd775620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.540+0000 7f7ed9504740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed0070ec0 con 0x55effd759ff0 2024-07-24T22:08:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.540+0000 7f7ed9504740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed0073740 con 0x55effd7596d0 2024-07-24T22:08:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.540+0000 7f7ed9504740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed0071530 con 0x55effd776f90 2024-07-24T22:08:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.540+0000 7f7ec7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd759ff0 0x55effd771a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.541+0000 7f7ed4eef640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd7596d0 0x55effd758cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.541+0000 7f7ed4eef640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd7596d0 0x55effd758cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:47688/0 (socket says 172.21.15.47:47688) 2024-07-24T22:08:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.541+0000 7f7ed4eef640 1 -- 172.21.15.47:0/2712200867 learned_addr learned my addr 172.21.15.47:0/2712200867 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.541+0000 7f7ed4eef640 1 -- 172.21.15.47:0/2712200867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 msgr2=0x55effd775620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.541+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/2712200867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd775620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.541+0000 7f7ed4eef640 1 -- 172.21.15.47:0/2712200867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd759ff0 msgr2=0x55effd771a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.541+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/2712200867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd759ff0 0x55effd771a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.541+0000 7f7ed4eef640 1 -- 172.21.15.47:0/2712200867 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effd751b00 con 0x55effd7596d0 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.541+0000 7f7ec7fff640 1 --2- 172.21.15.47:0/2712200867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd759ff0 0x55effd771a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.541+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/2712200867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd7596d0 0x55effd758cd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0aa4d0 tx=0x7f7ecc0ae220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc868c6f58c4754d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.541+0000 7f7eb67fc640 1 -- 172.21.15.47:0/2712200867 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0c8070 con 0x55effd7596d0 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.541+0000 7f7eb67fc640 1 -- 172.21.15.47:0/2712200867 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ecc019a70 con 0x55effd7596d0 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.541+0000 7f7eb67fc640 1 -- 172.21.15.47:0/2712200867 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0ad290 con 0x55effd7596d0 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.542+0000 7f7ed9504740 1 -- 172.21.15.47:0/2712200867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd7596d0 msgr2=0x55effd758cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.542+0000 7f7ed9504740 1 --2- 172.21.15.47:0/2712200867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd7596d0 0x55effd758cd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0aa4d0 tx=0x7f7ecc0ae220 comp rx=0 tx=0).stop 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.542+0000 7f7ed9504740 1 -- 172.21.15.47:0/2712200867 shutdown_connections 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.542+0000 7f7ed9504740 1 --2- 172.21.15.47:0/2712200867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd775620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.542+0000 7f7ed9504740 1 --2- 172.21.15.47:0/2712200867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd759ff0 0x55effd771a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.542+0000 7f7ed9504740 1 --2- 172.21.15.47:0/2712200867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd7596d0 0x55effd758cd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.542+0000 7f7ed9504740 1 -- 172.21.15.47:0/2712200867 >> 172.21.15.47:0/2712200867 conn(0x55effd757500 msgr2=0x55effd7585c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.542+0000 7f7ed9504740 1 -- 172.21.15.47:0/2712200867 shutdown_connections 2024-07-24T22:08:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.542+0000 7f7ed9504740 1 -- 172.21.15.47:0/2712200867 wait complete. 2024-07-24T22:08:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.543+0000 7f7ed9504740 1 -- start start 2024-07-24T22:08:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.543+0000 7f7ed9504740 1 Processor -- start 2024-07-24T22:08:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.543+0000 7f7ed9504740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd7596d0 0x55effd78c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.543+0000 7f7ed9504740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd759ff0 0x55effd75b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.543+0000 7f7ed9504740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd75b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ec7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd759ff0 0x55effd75b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ec7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd759ff0 0x55effd75b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40296/0 (socket says 172.21.15.47:40296) 2024-07-24T22:08:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ed9504740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed0071c00 con 0x55effd759ff0 2024-07-24T22:08:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ec7fff640 1 -- 172.21.15.47:0/3507063344 learned_addr learned my addr 172.21.15.47:0/3507063344 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ed9504740 1 -- 172.21.15.47:0/3507063344 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed0073070 con 0x55effd7596d0 2024-07-24T22:08:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ed9504740 1 -- 172.21.15.47:0/3507063344 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed00722d0 con 0x55effd776f90 2024-07-24T22:08:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ed9504740 10 client.0 _ll_register_callbacks cb 0x7f7ecc0c6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd7596d0 0x55effd78c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ed56f0640 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd75b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ec7fff640 1 -- 172.21.15.47:0/3507063344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 msgr2=0x55effd75b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ec7fff640 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd75b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ec7fff640 1 -- 172.21.15.47:0/3507063344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd7596d0 msgr2=0x55effd78c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ec7fff640 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd7596d0 0x55effd78c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ec7fff640 1 -- 172.21.15.47:0/3507063344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55effd7f8b50 con 0x55effd759ff0 2024-07-24T22:08:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ed56f0640 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd75b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7ec7fff640 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd759ff0 0x55effd75b2a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00096c0 tx=0x7f7ec002ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448584c7a18bc50d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7eaffff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.544+0000 7f7eaffff640 1 -- 172.21.15.47:0/3507063344 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0035040 con 0x55effd759ff0 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.545+0000 7f7eaffff640 1 -- 172.21.15.47:0/3507063344 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f7ec0004250 con 0x55effd759ff0 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.545+0000 7f7ed9504740 1 -- 172.21.15.47:0/3507063344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ecc019a70 con 0x55effd759ff0 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.545+0000 7f7eaffff640 1 -- 172.21.15.47:0/3507063344 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7ec0051050 con 0x55effd759ff0 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.545+0000 7f7ed9504740 10 client.15720 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.545+0000 7f7ed9504740 1 -- 172.21.15.47:0/3507063344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55effd7f9d00 con 0x55effd759ff0 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.545+0000 7f7eaffff640 1 -- 172.21.15.47:0/3507063344 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ecc019a70 con 0x55effd759ff0 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.545+0000 7f7eaffff640 1 -- 172.21.15.47:0/3507063344 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7ec0004b40 con 0x55effd759ff0 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.545+0000 7f7ed9504740 10 client.15720 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.545+0000 7f7ed9504740 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.545+0000 7f7ed9504740 20 client.15720 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.545+0000 7f7ed9504740 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55effd7fa4a0 0x55effd7fc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.545+0000 7f7ed9504740 4 client.15720 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:08:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.545+0000 7f7ed9504740 1 -- 172.21.15.47:0/3507063344 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55effd6ce3a0 con 0x55effd7fa4a0 2024-07-24T22:08:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.546+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55effd7fa4a0 0x55effd7fc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.546+0000 7f7eaffff640 10 client.15720 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.546+0000 7f7ed4eef640 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55effd7fa4a0 0x55effd7fc8c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f96e9828b1d8c8d8 server_cookie=3d3ed0efd913f77f in_seq=0 out_seq=0 2024-07-24T22:08:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.546+0000 7f7eaffff640 1 -- 172.21.15.47:0/3507063344 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55effd6ce3a0 con 0x55effd7fa4a0 2024-07-24T22:08:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.546+0000 7f7eaffff640 10 client.15720 handle_command_reply: tid=0 2024-07-24T22:08:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.547+0000 7f7ed9504740 1 client.15720 shutdown 2024-07-24T22:08:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.547+0000 7f7ed9504740 1 -- 172.21.15.47:0/3507063344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd759ff0 msgr2=0x55effd75b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.547+0000 7f7ed9504740 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd759ff0 0x55effd75b2a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00096c0 tx=0x7f7ec002ab10 comp rx=0 tx=0).stop 2024-07-24T22:08:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.547+0000 7f7ed9504740 1 -- 172.21.15.47:0/3507063344 shutdown_connections 2024-07-24T22:08:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.547+0000 7f7ed9504740 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55effd7fa4a0 0x55effd7fc8c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.547+0000 7f7ed9504740 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55effd776f90 0x55effd75b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.547+0000 7f7eaffff640 0 client.15720 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:23.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.547+0000 7f7ed9504740 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55effd759ff0 0x55effd75b2a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.547+0000 7f7ed9504740 1 --2- 172.21.15.47:0/3507063344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55effd7596d0 0x55effd78c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.547+0000 7f7ed9504740 1 -- 172.21.15.47:0/3507063344 >> 172.21.15.47:0/3507063344 conn(0x55effd757500 msgr2=0x55effd75c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:23.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.547+0000 7f7ed9504740 1 -- 172.21.15.47:0/3507063344 shutdown_connections 2024-07-24T22:08:23.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.547+0000 7f7ed9504740 1 -- 172.21.15.47:0/3507063344 wait complete. 2024-07-24T22:08:23.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.547+0000 7f7ed9504740 20 client.15720 trim_cache size 0 max 16384 2024-07-24T22:08:23.557 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:08:23.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.548+0000 7f7ed7153640 1 -- 172.21.15.47:0/3966920951 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7eb80b3dc0 msgr2=0x7f7eb80b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:23.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.548+0000 7f7ed7153640 1 --2- 172.21.15.47:0/3966920951 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7eb80b3dc0 0x7f7eb80b6280 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8005fd0 tx=0x7f7ec8009500 comp rx=0 tx=0).stop 2024-07-24T22:08:23.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.548+0000 7f7ed7153640 1 -- 172.21.15.47:0/3966920951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed0102760 msgr2=0x7f7ed0198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:23.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.548+0000 7f7ed7153640 1 --2- 172.21.15.47:0/3966920951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed0102760 0x7f7ed0198c70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009c20 tx=0x7f7ecc00b690 comp rx=0 tx=0).stop 2024-07-24T22:08:23.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.548+0000 7f7ed7153640 1 -- 172.21.15.47:0/3966920951 shutdown_connections 2024-07-24T22:08:23.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.548+0000 7f7ed7153640 1 --2- 172.21.15.47:0/3966920951 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7eb80b3dc0 0x7f7eb80b6280 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.549+0000 7f7ed7153640 1 --2- 172.21.15.47:0/3966920951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ed0108af0 0x7f7ed019e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.549+0000 7f7ed7153640 1 --2- 172.21.15.47:0/3966920951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ed0108170 0x7f7ed01991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.549+0000 7f7ed7153640 1 --2- 172.21.15.47:0/3966920951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed0102760 0x7f7ed0198c70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:23.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.549+0000 7f7ed7153640 1 -- 172.21.15.47:0/3966920951 >> 172.21.15.47:0/3966920951 conn(0x7f7ed00fe210 msgr2=0x7f7ed0100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:23.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.549+0000 7f7ed7153640 1 -- 172.21.15.47:0/3966920951 shutdown_connections 2024-07-24T22:08:23.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:23.549+0000 7f7ed7153640 1 -- 172.21.15.47:0/3966920951 wait complete. 2024-07-24T22:08:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:23 smithi188 ceph-mon[37380]: pgmap v401: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 341 B/s wr, 3 op/s 2024-07-24T22:08:23.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:23 smithi183 ceph-mon[37007]: pgmap v401: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 341 B/s wr, 3 op/s 2024-07-24T22:08:25.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:25 smithi047 ceph-mon[32551]: pgmap v402: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:08:25.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:25 smithi188 ceph-mon[37380]: pgmap v402: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:08:25.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:25 smithi183 ceph-mon[37007]: pgmap v402: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:08:25.927 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:08:25.927 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:08:26.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.989+0000 7f6a117b5640 1 -- 172.21.15.47:0/1567880630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c1081c0 msgr2=0x7f6a0c108600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:26.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.989+0000 7f6a117b5640 1 --2- 172.21.15.47:0/1567880630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c1081c0 0x7f6a0c108600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009860 tx=0x7f6a0002a340 comp rx=0 tx=0).stop 2024-07-24T22:08:26.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.989+0000 7f6a117b5640 1 -- 172.21.15.47:0/1567880630 shutdown_connections 2024-07-24T22:08:26.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.989+0000 7f6a117b5640 1 --2- 172.21.15.47:0/1567880630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a0c108b40 0x7f6a0c10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:26.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.989+0000 7f6a117b5640 1 --2- 172.21.15.47:0/1567880630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c1081c0 0x7f6a0c108600 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:26.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.989+0000 7f6a117b5640 1 --2- 172.21.15.47:0/1567880630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a0c1027b0 0x7f6a0c102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:26.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.989+0000 7f6a117b5640 1 -- 172.21.15.47:0/1567880630 >> 172.21.15.47:0/1567880630 conn(0x7f6a0c0fe240 msgr2=0x7f6a0c100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:26.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.989+0000 7f6a117b5640 1 -- 172.21.15.47:0/1567880630 shutdown_connections 2024-07-24T22:08:26.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.989+0000 7f6a117b5640 1 -- 172.21.15.47:0/1567880630 wait complete. 2024-07-24T22:08:26.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.990+0000 7f6a117b5640 1 Processor -- start 2024-07-24T22:08:26.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.990+0000 7f6a117b5640 1 -- start start 2024-07-24T22:08:26.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.991+0000 7f6a117b5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c1027b0 0x7f6a0c076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:26.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.991+0000 7f6a117b5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a0c1081c0 0x7f6a0c074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:26.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.991+0000 7f6a117b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a0c108b40 0x7f6a0c0754c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.991+0000 7f6a117b5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c112750 con 0x7f6a0c108b40 2024-07-24T22:08:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.991+0000 7f6a117b5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1125d0 con 0x7f6a0c1081c0 2024-07-24T22:08:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.991+0000 7f6a0a7fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a0c1081c0 0x7f6a0c074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.991+0000 7f6a0a7fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a0c1081c0 0x7f6a0c074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:40930/0 (socket says 172.21.15.47:40930) 2024-07-24T22:08:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.991+0000 7f6a0a7fc640 1 -- 172.21.15.47:0/2754884657 learned_addr learned my addr 172.21.15.47:0/2754884657 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.991+0000 7f6a117b5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1128d0 con 0x7f6a0c1027b0 2024-07-24T22:08:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.991+0000 7f6a0b7fe640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a0c108b40 0x7f6a0c0754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.991+0000 7f6a0affd640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c1027b0 0x7f6a0c076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.992+0000 7f6a0a7fc640 1 -- 172.21.15.47:0/2754884657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c1027b0 msgr2=0x7f6a0c076940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.992+0000 7f6a0a7fc640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c1027b0 0x7f6a0c076940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.992+0000 7f6a0a7fc640 1 -- 172.21.15.47:0/2754884657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a0c108b40 msgr2=0x7f6a0c0754c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.992+0000 7f6a0a7fc640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a0c108b40 0x7f6a0c0754c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.992+0000 7f6a0a7fc640 1 -- 172.21.15.47:0/2754884657 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c1ab5e0 con 0x7f6a0c1081c0 2024-07-24T22:08:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.992+0000 7f6a0affd640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c1027b0 0x7f6a0c076940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.992+0000 7f6a0a7fc640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a0c1081c0 0x7f6a0c074e90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6a000303f0 tx=0x7f6a00032da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.992+0000 7f69f3fff640 1 -- 172.21.15.47:0/2754884657 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00040020 con 0x7f6a0c1081c0 2024-07-24T22:08:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.992+0000 7f69f3fff640 1 -- 172.21.15.47:0/2754884657 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a00030dd0 con 0x7f6a0c1081c0 2024-07-24T22:08:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.992+0000 7f69f3fff640 1 -- 172.21.15.47:0/2754884657 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00037040 con 0x7f6a0c1081c0 2024-07-24T22:08:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.992+0000 7f6a117b5640 1 -- 172.21.15.47:0/2754884657 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0c1ab7b0 con 0x7f6a0c1081c0 2024-07-24T22:08:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.993+0000 7f6a117b5640 1 -- 172.21.15.47:0/2754884657 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0c1abb50 con 0x7f6a0c1081c0 2024-07-24T22:08:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.994+0000 7f6a117b5640 1 -- 172.21.15.47:0/2754884657 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0c102b90 con 0x7f6a0c1081c0 2024-07-24T22:08:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.995+0000 7f69f3fff640 1 -- 172.21.15.47:0/2754884657 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f6a00043020 con 0x7f6a0c1081c0 2024-07-24T22:08:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.996+0000 7f69f3fff640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69f40b3dc0 0x7f69f40b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.997+0000 7f6a0affd640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69f40b3dc0 0x7f69f40b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.997+0000 7f69f3fff640 1 -- 172.21.15.47:0/2754884657 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f6a00103f50 con 0x7f6a0c1081c0 2024-07-24T22:08:26.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:25.997+0000 7f6a0affd640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69f40b3dc0 0x7f69f40b6280 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009c50 tx=0x7f69fc005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:26.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.000+0000 7f69f3fff640 1 -- 172.21.15.47:0/2754884657 <== mon.2 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f6a0004a020 con 0x7f6a0c1081c0 2024-07-24T22:08:26.298 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:26.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.328+0000 7f6a117b5640 1 -- 172.21.15.47:0/2754884657 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a0c076190 con 0x7f6a0c1081c0 2024-07-24T22:08:26.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.329+0000 7f69f3fff640 1 -- 172.21.15.47:0/2754884657 <== mon.2 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f6a000328c0 con 0x7f6a0c1081c0 2024-07-24T22:08:26.331 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:08:26.331 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:08:26.331 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:08:26.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.331+0000 7f6a117b5640 1 -- 172.21.15.47:0/2754884657 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69f40b3dc0 msgr2=0x7f69f40b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:26.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.331+0000 7f6a117b5640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69f40b3dc0 0x7f69f40b6280 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009c50 tx=0x7f69fc005f90 comp rx=0 tx=0).stop 2024-07-24T22:08:26.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.332+0000 7f6a117b5640 1 -- 172.21.15.47:0/2754884657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a0c1081c0 msgr2=0x7f6a0c074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:26.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.332+0000 7f6a117b5640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a0c1081c0 0x7f6a0c074e90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6a000303f0 tx=0x7f6a00032da0 comp rx=0 tx=0).stop 2024-07-24T22:08:26.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.332+0000 7f6a117b5640 1 -- 172.21.15.47:0/2754884657 shutdown_connections 2024-07-24T22:08:26.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.332+0000 7f6a117b5640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69f40b3dc0 0x7f69f40b6280 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:26.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.332+0000 7f6a117b5640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a0c108b40 0x7f6a0c0754c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:26.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.332+0000 7f6a117b5640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a0c1081c0 0x7f6a0c074e90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:26.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.332+0000 7f6a117b5640 1 --2- 172.21.15.47:0/2754884657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c1027b0 0x7f6a0c076940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:26.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.332+0000 7f6a117b5640 1 -- 172.21.15.47:0/2754884657 >> 172.21.15.47:0/2754884657 conn(0x7f6a0c0fe240 msgr2=0x7f6a0c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:26.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.332+0000 7f6a117b5640 1 -- 172.21.15.47:0/2754884657 shutdown_connections 2024-07-24T22:08:26.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:26.332+0000 7f6a117b5640 1 -- 172.21.15.47:0/2754884657 wait complete. 2024-07-24T22:08:26.578 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:26 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2754884657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:26.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:26 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2754884657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:26.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:26 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2754884657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:27.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:27 smithi047 ceph-mon[32551]: pgmap v403: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:08:27.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:27 smithi188 ceph-mon[37380]: pgmap v403: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:08:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.850+0000 7ff690172640 1 -- 172.21.15.47:0/1489527617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff688106f90 msgr2=0x7ff6881073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.850+0000 7ff690172640 1 --2- 172.21.15.47:0/1489527617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff688106f90 0x7ff6881073d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff678009900 tx=0x7ff67802a410 comp rx=0 tx=0).stop 2024-07-24T22:08:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.850+0000 7ff690172640 1 -- 172.21.15.47:0/1489527617 shutdown_connections 2024-07-24T22:08:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.850+0000 7ff690172640 1 --2- 172.21.15.47:0/1489527617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff688107910 0x7ff68810e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.850+0000 7ff690172640 1 --2- 172.21.15.47:0/1489527617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff688106f90 0x7ff6881073d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.850+0000 7ff690172640 1 --2- 172.21.15.47:0/1489527617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6881015e0 0x7ff6881019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.850+0000 7ff690172640 1 -- 172.21.15.47:0/1489527617 >> 172.21.15.47:0/1489527617 conn(0x7ff6880782e0 msgr2=0x7ff6880ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.850+0000 7ff690172640 1 -- 172.21.15.47:0/1489527617 shutdown_connections 2024-07-24T22:08:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.850+0000 7ff690172640 1 -- 172.21.15.47:0/1489527617 wait complete. 2024-07-24T22:08:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff690172640 1 Processor -- start 2024-07-24T22:08:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff690172640 1 -- start start 2024-07-24T22:08:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff690172640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6881015e0 0x7ff68819ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff690172640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff688106f90 0x7ff68819b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff690172640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff688107910 0x7ff6881a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff690172640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881126f0 con 0x7ff688106f90 2024-07-24T22:08:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff690172640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff688112570 con 0x7ff688107910 2024-07-24T22:08:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff690172640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff688112870 con 0x7ff6881015e0 2024-07-24T22:08:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff68d70d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff688106f90 0x7ff68819b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff68d70d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff688106f90 0x7ff68819b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40932/0 (socket says 172.21.15.47:40932) 2024-07-24T22:08:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff68d70d640 1 -- 172.21.15.47:0/2970422021 learned_addr learned my addr 172.21.15.47:0/2970422021 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff68e70f640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff688107910 0x7ff6881a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff68df0e640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6881015e0 0x7ff68819ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff68d70d640 1 -- 172.21.15.47:0/2970422021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6881015e0 msgr2=0x7ff68819ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff68d70d640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6881015e0 0x7ff68819ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff68d70d640 1 -- 172.21.15.47:0/2970422021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff688107910 msgr2=0x7ff6881a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff68d70d640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff688107910 0x7ff6881a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.851+0000 7ff68d70d640 1 -- 172.21.15.47:0/2970422021 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6881a0f00 con 0x7ff688106f90 2024-07-24T22:08:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.852+0000 7ff68d70d640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff688106f90 0x7ff68819b3a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff678005940 tx=0x7ff6780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.852+0000 7ff67effd640 1 -- 172.21.15.47:0/2970422021 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67803f030 con 0x7ff688106f90 2024-07-24T22:08:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.852+0000 7ff67effd640 1 -- 172.21.15.47:0/2970422021 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff678003cb0 con 0x7ff688106f90 2024-07-24T22:08:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.852+0000 7ff690172640 1 -- 172.21.15.47:0/2970422021 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6881a1190 con 0x7ff688106f90 2024-07-24T22:08:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.852+0000 7ff67effd640 1 -- 172.21.15.47:0/2970422021 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678035070 con 0x7ff688106f90 2024-07-24T22:08:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.852+0000 7ff690172640 1 -- 172.21.15.47:0/2970422021 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6881a7930 con 0x7ff688106f90 2024-07-24T22:08:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.854+0000 7ff67effd640 1 -- 172.21.15.47:0/2970422021 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7ff678042030 con 0x7ff688106f90 2024-07-24T22:08:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.854+0000 7ff692f9e740 1 Processor -- start 2024-07-24T22:08:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff692f9e740 1 -- start start 2024-07-24T22:08:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff692f9e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce959748c0 0x55ce95974ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff692f9e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce95980c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff692f9e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce95981170 0x55ce95983560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff692f9e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ce958ea280 con 0x55ce959751e0 2024-07-24T22:08:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff692f9e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ce958d9780 con 0x55ce959748c0 2024-07-24T22:08:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff692f9e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ce958dd7c0 con 0x55ce95981170 2024-07-24T22:08:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff68df0e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce95980c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff68df0e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce95980c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40948/0 (socket says 172.21.15.47:40948) 2024-07-24T22:08:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff68df0e640 1 -- 172.21.15.47:0/3924505672 learned_addr learned my addr 172.21.15.47:0/3924505672 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff67effd640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff6740b3dc0 0x7ff6740b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff68d70d640 1 --2- 172.21.15.47:0/3924505672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce95981170 0x55ce95983560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff68e70f640 1 --2- 172.21.15.47:0/3924505672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce959748c0 0x55ce95974ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff68e70f640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff6740b3dc0 0x7ff6740b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff68df0e640 1 -- 172.21.15.47:0/3924505672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce95981170 msgr2=0x55ce95983560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff68df0e640 1 --2- 172.21.15.47:0/3924505672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce95981170 0x55ce95983560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.855+0000 7ff68df0e640 1 -- 172.21.15.47:0/3924505672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce959748c0 msgr2=0x55ce95974ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.856+0000 7ff68df0e640 1 --2- 172.21.15.47:0/3924505672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce959748c0 0x55ce95974ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.856+0000 7ff68df0e640 1 -- 172.21.15.47:0/3924505672 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce9563d790 con 0x55ce959751e0 2024-07-24T22:08:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.856+0000 7ff68d70d640 1 --2- 172.21.15.47:0/3924505672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce95981170 0x55ce95983560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.856+0000 7ff67effd640 1 -- 172.21.15.47:0/2970422021 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ff6781047d0 con 0x7ff688106f90 2024-07-24T22:08:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.856+0000 7ff68df0e640 1 --2- 172.21.15.47:0/3924505672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce95980c30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff684009a70 tx=0x7ff684009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1842d2473517d54 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.856+0000 7ff68e70f640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff6740b3dc0 0x7ff6740b6280 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff680005fd0 tx=0x7ff680009600 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.856+0000 7ff673fff640 1 -- 172.21.15.47:0/3924505672 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684017070 con 0x55ce959751e0 2024-07-24T22:08:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.856+0000 7ff673fff640 1 -- 172.21.15.47:0/3924505672 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff684013470 con 0x55ce959751e0 2024-07-24T22:08:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.856+0000 7ff673fff640 1 -- 172.21.15.47:0/3924505672 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684012630 con 0x55ce959751e0 2024-07-24T22:08:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.857+0000 7ff692f9e740 1 -- 172.21.15.47:0/3924505672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 msgr2=0x55ce95980c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.857+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3924505672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce95980c30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff684009a70 tx=0x7ff684009f30 comp rx=0 tx=0).stop 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.857+0000 7ff692f9e740 1 -- 172.21.15.47:0/3924505672 shutdown_connections 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.857+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3924505672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce95981170 0x55ce95983560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.857+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3924505672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce95980c30 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.857+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3924505672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce959748c0 0x55ce95974ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.857+0000 7ff692f9e740 1 -- 172.21.15.47:0/3924505672 >> 172.21.15.47:0/3924505672 conn(0x55ce959726f0 msgr2=0x55ce95973890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.857+0000 7ff692f9e740 1 -- 172.21.15.47:0/3924505672 shutdown_connections 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.857+0000 7ff692f9e740 1 -- 172.21.15.47:0/3924505672 wait complete. 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.857+0000 7ff692f9e740 1 -- start start 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.857+0000 7ff692f9e740 1 Processor -- start 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff692f9e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959748c0 0x55ce95980800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff692f9e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce9597dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff692f9e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff692f9e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ce95813ab0 con 0x55ce959751e0 2024-07-24T22:08:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff692f9e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ce958619e0 con 0x55ce95981170 2024-07-24T22:08:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff692f9e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ce95983e50 con 0x55ce959748c0 2024-07-24T22:08:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff692f9e740 10 client.0 _ll_register_callbacks cb 0x55ce955e9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff68d70d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce9597dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff68d70d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce9597dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40956/0 (socket says 172.21.15.47:40956) 2024-07-24T22:08:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff68d70d640 1 -- 172.21.15.47:0/3705212684 learned_addr learned my addr 172.21.15.47:0/3705212684 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff68df0e640 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959748c0 0x55ce95980800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff68e70f640 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff68d70d640 1 -- 172.21.15.47:0/3705212684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959748c0 msgr2=0x55ce95980800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff68d70d640 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959748c0 0x55ce95980800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff68d70d640 1 -- 172.21.15.47:0/3705212684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 msgr2=0x55ce9597e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff68d70d640 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff68d70d640 1 -- 172.21.15.47:0/3705212684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce956b6620 con 0x55ce959751e0 2024-07-24T22:08:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff68e70f640 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff68d70d640 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce9597dce0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff678003fd0 tx=0x7ff6780044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f885f146651ac0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.858+0000 7ff6717fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff6717fa640 1 -- 172.21.15.47:0/3705212684 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678049070 con 0x55ce959751e0 2024-07-24T22:08:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff692f9e740 1 -- 172.21.15.47:0/3705212684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ce95888ce0 con 0x55ce959751e0 2024-07-24T22:08:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff6717fa640 1 -- 172.21.15.47:0/3705212684 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ff6780d3fe0 con 0x55ce959751e0 2024-07-24T22:08:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff6717fa640 1 -- 172.21.15.47:0/3705212684 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff6780cad10 con 0x55ce959751e0 2024-07-24T22:08:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff692f9e740 10 client.15738 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff692f9e740 1 -- 172.21.15.47:0/3705212684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ce9598f560 con 0x55ce959751e0 2024-07-24T22:08:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff6717fa640 1 -- 172.21.15.47:0/3705212684 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ce95888ce0 con 0x55ce959751e0 2024-07-24T22:08:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff6717fa640 1 -- 172.21.15.47:0/3705212684 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff6780ca620 con 0x55ce959751e0 2024-07-24T22:08:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff692f9e740 10 client.15738 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff692f9e740 10 client.15738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff692f9e740 20 client.15738 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ce95990a10 0x55ce95992e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff692f9e740 4 client.15738 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.859+0000 7ff692f9e740 1 -- 172.21.15.47:0/3705212684 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce958ec1d0 con 0x55ce95990a10 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.860+0000 7ff68df0e640 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ce95990a10 0x55ce95992e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.860+0000 7ff68df0e640 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ce95990a10 0x55ce95992e00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c576d9dce5da2a46 server_cookie=892f077cb86f37bf in_seq=0 out_seq=0 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.860+0000 7ff6717fa640 10 client.15738 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff6717fa640 1 -- 172.21.15.47:0/3705212684 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce958ec1d0 con 0x55ce95990a10 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff6717fa640 10 client.15738 handle_command_reply: tid=0 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff692f9e740 1 client.15738 shutdown 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff692f9e740 1 -- 172.21.15.47:0/3705212684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 msgr2=0x55ce9597dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce9597dce0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff678003fd0 tx=0x7ff6780044e0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff692f9e740 1 -- 172.21.15.47:0/3705212684 shutdown_connections 2024-07-24T22:08:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ce95990a10 0x55ce95992e00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce9597dce0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff6717fa640 0 client.15738 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3705212684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959748c0 0x55ce95980800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff692f9e740 1 -- 172.21.15.47:0/3705212684 >> 172.21.15.47:0/3705212684 conn(0x55ce959726f0 msgr2=0x55ce95978290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff692f9e740 1 -- 172.21.15.47:0/3705212684 shutdown_connections 2024-07-24T22:08:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff692f9e740 1 -- 172.21.15.47:0/3705212684 wait complete. 2024-07-24T22:08:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.861+0000 7ff692f9e740 20 client.15738 trim_cache size 0 max 16384 2024-07-24T22:08:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.888+0000 7ff692f9e740 1 Processor -- start 2024-07-24T22:08:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff692f9e740 1 -- start start 2024-07-24T22:08:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff692f9e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959748c0 0x55ce959986c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff692f9e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce95998c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff692f9e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff692f9e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881ae320 con 0x55ce959751e0 2024-07-24T22:08:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff692f9e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881b0ba0 con 0x55ce95981170 2024-07-24T22:08:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff692f9e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881ae990 con 0x55ce959748c0 2024-07-24T22:08:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff68d70d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce95998c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff68d70d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce95998c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40960/0 (socket says 172.21.15.47:40960) 2024-07-24T22:08:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff68d70d640 1 -- 172.21.15.47:0/3876763504 learned_addr learned my addr 172.21.15.47:0/3876763504 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff68e70f640 1 --2- 172.21.15.47:0/3876763504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff68df0e640 1 --2- 172.21.15.47:0/3876763504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959748c0 0x55ce959986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff68d70d640 1 -- 172.21.15.47:0/3876763504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959748c0 msgr2=0x55ce959986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff68d70d640 1 --2- 172.21.15.47:0/3876763504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959748c0 0x55ce959986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff68d70d640 1 -- 172.21.15.47:0/3876763504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 msgr2=0x55ce9597aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff68d70d640 1 --2- 172.21.15.47:0/3876763504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.889+0000 7ff68d70d640 1 -- 172.21.15.47:0/3876763504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce95975010 con 0x55ce959751e0 2024-07-24T22:08:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.890+0000 7ff68d70d640 1 --2- 172.21.15.47:0/3876763504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce95998c00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff678004620 tx=0x7ff6780c7a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e2885507409c6d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.890+0000 7ff6737fe640 1 -- 172.21.15.47:0/3876763504 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678049070 con 0x55ce959751e0 2024-07-24T22:08:27.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.890+0000 7ff6737fe640 1 -- 172.21.15.47:0/3876763504 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6780cbac0 con 0x55ce959751e0 2024-07-24T22:08:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.890+0000 7ff6737fe640 1 -- 172.21.15.47:0/3876763504 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678005d50 con 0x55ce959751e0 2024-07-24T22:08:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.891+0000 7ff692f9e740 1 -- 172.21.15.47:0/3876763504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 msgr2=0x55ce95998c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.891+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3876763504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce95998c00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff678004620 tx=0x7ff6780c7a10 comp rx=0 tx=0).stop 2024-07-24T22:08:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.891+0000 7ff692f9e740 1 -- 172.21.15.47:0/3876763504 shutdown_connections 2024-07-24T22:08:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.891+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3876763504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.891+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3876763504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959751e0 0x55ce95998c00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.891+0000 7ff692f9e740 1 --2- 172.21.15.47:0/3876763504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959748c0 0x55ce959986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.891+0000 7ff692f9e740 1 -- 172.21.15.47:0/3876763504 >> 172.21.15.47:0/3876763504 conn(0x55ce959726f0 msgr2=0x55ce9597c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.891+0000 7ff692f9e740 1 -- 172.21.15.47:0/3876763504 shutdown_connections 2024-07-24T22:08:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.891+0000 7ff692f9e740 1 -- 172.21.15.47:0/3876763504 wait complete. 2024-07-24T22:08:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.891+0000 7ff692f9e740 1 -- start start 2024-07-24T22:08:27.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.891+0000 7ff692f9e740 1 Processor -- start 2024-07-24T22:08:27.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff692f9e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959748c0 0x55ce9597a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff692f9e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959751e0 0x55ce9597a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff692f9e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff692f9e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881af060 con 0x55ce959748c0 2024-07-24T22:08:27.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff692f9e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881b04d0 con 0x55ce95981170 2024-07-24T22:08:27.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff692f9e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881af730 con 0x55ce959751e0 2024-07-24T22:08:27.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff692f9e740 10 client.0 _ll_register_callbacks cb 0x7ff678004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:27.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff68df0e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959748c0 0x55ce9597a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff68df0e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959748c0 0x55ce9597a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40972/0 (socket says 172.21.15.47:40972) 2024-07-24T22:08:27.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff68df0e640 1 -- 172.21.15.47:0/4204370909 learned_addr learned my addr 172.21.15.47:0/4204370909 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:27.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff68d70d640 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959751e0 0x55ce9597a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff68df0e640 1 -- 172.21.15.47:0/4204370909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959751e0 msgr2=0x55ce9597a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:27.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff68e70f640 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff68df0e640 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959751e0 0x55ce9597a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff68df0e640 1 -- 172.21.15.47:0/4204370909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 msgr2=0x55ce9597ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:27.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff68df0e640 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff68df0e640 1 -- 172.21.15.47:0/4204370909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce959883b0 con 0x55ce959748c0 2024-07-24T22:08:27.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff68d70d640 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959751e0 0x55ce9597a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:27.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff68e70f640 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:27.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff68df0e640 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959748c0 0x55ce9597a2e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff684025fd0 tx=0x7ff684000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8759cba9132eb03b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:27.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff6717fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:27.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff6717fa640 1 -- 172.21.15.47:0/4204370909 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684017040 con 0x55ce959748c0 2024-07-24T22:08:27.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff6717fa640 1 -- 172.21.15.47:0/4204370909 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ff68400edc0 con 0x55ce959748c0 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.892+0000 7ff692f9e740 1 -- 172.21.15.47:0/4204370909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6780cbac0 con 0x55ce959748c0 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.893+0000 7ff6717fa640 1 -- 172.21.15.47:0/4204370909 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff684035050 con 0x55ce959748c0 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.893+0000 7ff692f9e740 10 client.15744 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.893+0000 7ff692f9e740 1 -- 172.21.15.47:0/4204370909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ce959896c0 con 0x55ce959748c0 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.893+0000 7ff6717fa640 1 -- 172.21.15.47:0/4204370909 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6780cbac0 con 0x55ce959748c0 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.893+0000 7ff6717fa640 1 -- 172.21.15.47:0/4204370909 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff684025850 con 0x55ce959748c0 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.893+0000 7ff692f9e740 10 client.15744 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.893+0000 7ff692f9e740 10 client.15744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.893+0000 7ff692f9e740 20 client.15744 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.893+0000 7ff692f9e740 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ce95989b90 0x55ce959fd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.893+0000 7ff692f9e740 4 client.15744 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.893+0000 7ff692f9e740 1 -- 172.21.15.47:0/4204370909 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ce958e7c70 con 0x55ce95989b90 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.893+0000 7ff68d70d640 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ce95989b90 0x55ce959fd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:27.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.894+0000 7ff6717fa640 10 client.15744 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:27.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.894+0000 7ff68d70d640 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ce95989b90 0x55ce959fd6a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2eb348213df7ef server_cookie=a60f7b97ecbb3977 in_seq=0 out_seq=0 2024-07-24T22:08:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.897+0000 7ff6717fa640 1 -- 172.21.15.47:0/4204370909 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ce958e7c70 con 0x55ce95989b90 2024-07-24T22:08:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.897+0000 7ff6717fa640 10 client.15744 handle_command_reply: tid=0 2024-07-24T22:08:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.897+0000 7ff692f9e740 1 client.15744 shutdown 2024-07-24T22:08:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.897+0000 7ff692f9e740 1 -- 172.21.15.47:0/4204370909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959748c0 msgr2=0x55ce9597a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.897+0000 7ff692f9e740 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959748c0 0x55ce9597a2e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff684025fd0 tx=0x7ff684000bc0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.897+0000 7ff692f9e740 1 -- 172.21.15.47:0/4204370909 shutdown_connections 2024-07-24T22:08:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.897+0000 7ff692f9e740 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ce95989b90 0x55ce959fd6a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff6717fa640 0 client.15744 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.897+0000 7ff692f9e740 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ce95981170 0x55ce9597ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff692f9e740 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ce959751e0 0x55ce9597a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff692f9e740 1 --2- 172.21.15.47:0/4204370909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ce959748c0 0x55ce9597a2e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff692f9e740 1 -- 172.21.15.47:0/4204370909 >> 172.21.15.47:0/4204370909 conn(0x55ce959726f0 msgr2=0x55ce95970f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff692f9e740 1 -- 172.21.15.47:0/4204370909 shutdown_connections 2024-07-24T22:08:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff692f9e740 1 -- 172.21.15.47:0/4204370909 wait complete. 2024-07-24T22:08:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff692f9e740 20 client.15744 trim_cache size 0 max 16384 2024-07-24T22:08:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:08:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:08:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:08:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:08:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff690172640 1 -- 172.21.15.47:0/2970422021 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff6740b3dc0 msgr2=0x7ff6740b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff690172640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff6740b3dc0 0x7ff6740b6280 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff680005fd0 tx=0x7ff680009600 comp rx=0 tx=0).stop 2024-07-24T22:08:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff690172640 1 -- 172.21.15.47:0/2970422021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff688106f90 msgr2=0x7ff68819b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff690172640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff688106f90 0x7ff68819b3a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff678005940 tx=0x7ff6780042f0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff690172640 1 -- 172.21.15.47:0/2970422021 shutdown_connections 2024-07-24T22:08:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff690172640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff6740b3dc0 0x7ff6740b6280 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff690172640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff688107910 0x7ff6881a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff690172640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff688106f90 0x7ff68819b3a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff690172640 1 --2- 172.21.15.47:0/2970422021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6881015e0 0x7ff68819ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff690172640 1 -- 172.21.15.47:0/2970422021 >> 172.21.15.47:0/2970422021 conn(0x7ff6880782e0 msgr2=0x7ff6880698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff690172640 1 -- 172.21.15.47:0/2970422021 shutdown_connections 2024-07-24T22:08:27.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:27.898+0000 7ff690172640 1 -- 172.21.15.47:0/2970422021 wait complete. 2024-07-24T22:08:27.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:27 smithi183 ceph-mon[37007]: pgmap v403: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:08:28.597 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-07-24T22:08:28.598 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-07-24T22:08:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.156+0000 7f41e96c8640 1 -- 172.21.15.47:0/1722941408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e4103f80 msgr2=0x7f41e410c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.156+0000 7f41e96c8640 1 --2- 172.21.15.47:0/1722941408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e4103f80 0x7f41e410c470 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009900 tx=0x7f41cc02a410 comp rx=0 tx=0).stop 2024-07-24T22:08:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.156+0000 7f41e96c8640 1 -- 172.21.15.47:0/1722941408 shutdown_connections 2024-07-24T22:08:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.156+0000 7f41e96c8640 1 --2- 172.21.15.47:0/1722941408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41e410cac0 0x7f41e410ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.156+0000 7f41e96c8640 1 --2- 172.21.15.47:0/1722941408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e4103f80 0x7f41e410c470 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.156+0000 7f41e96c8640 1 --2- 172.21.15.47:0/1722941408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41e4103660 0x7f41e4103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.156+0000 7f41e96c8640 1 -- 172.21.15.47:0/1722941408 >> 172.21.15.47:0/1722941408 conn(0x7f41e40fd0c0 msgr2=0x7f41e40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.156+0000 7f41e96c8640 1 -- 172.21.15.47:0/1722941408 shutdown_connections 2024-07-24T22:08:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.156+0000 7f41e96c8640 1 -- 172.21.15.47:0/1722941408 wait complete. 2024-07-24T22:08:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.157+0000 7f41e96c8640 1 Processor -- start 2024-07-24T22:08:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.157+0000 7f41e96c8640 1 -- start start 2024-07-24T22:08:29.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.157+0000 7f41e96c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41e4103660 0x7f41e4101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.157+0000 7f41e96c8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41e4103f80 0x7f41e4101850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.157+0000 7f41e96c8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e410cac0 0x7f41e4101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.157+0000 7f41e96c8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41e4112700 con 0x7f41e410cac0 2024-07-24T22:08:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.157+0000 7f41e96c8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f41e4112580 con 0x7f41e4103f80 2024-07-24T22:08:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.157+0000 7f41e96c8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f41e4112880 con 0x7f41e4103660 2024-07-24T22:08:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.157+0000 7f41e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e410cac0 0x7f41e4101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.157+0000 7f41e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e410cac0 0x7f41e4101d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40978/0 (socket says 172.21.15.47:40978) 2024-07-24T22:08:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.157+0000 7f41e37fe640 1 -- 172.21.15.47:0/3013661848 learned_addr learned my addr 172.21.15.47:0/3013661848 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.157+0000 7f41e2ffd640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41e4103660 0x7f41e4101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.158+0000 7f41dbfff640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41e4103f80 0x7f41e4101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.158+0000 7f41e37fe640 1 -- 172.21.15.47:0/3013661848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41e4103660 msgr2=0x7f41e4101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.158+0000 7f41e37fe640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41e4103660 0x7f41e4101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.158+0000 7f41e37fe640 1 -- 172.21.15.47:0/3013661848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41e4103f80 msgr2=0x7f41e4101850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.158+0000 7f41e37fe640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41e4103f80 0x7f41e4101850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.158+0000 7f41e37fe640 1 -- 172.21.15.47:0/3013661848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e41a7050 con 0x7f41e410cac0 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.158+0000 7f41e37fe640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e410cac0 0x7f41e4101d90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00eaa0 tx=0x7f41dc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.158+0000 7f41e0ff9640 1 -- 172.21.15.47:0/3013661848 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00cdb0 con 0x7f41e410cac0 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.158+0000 7f41e0ff9640 1 -- 172.21.15.47:0/3013661848 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41dc005020 con 0x7f41e410cac0 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.158+0000 7f41e96c8640 1 -- 172.21.15.47:0/3013661848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e41a7340 con 0x7f41e410cac0 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.158+0000 7f41e0ff9640 1 -- 172.21.15.47:0/3013661848 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc0116d0 con 0x7f41e410cac0 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.158+0000 7f41e96c8640 1 -- 172.21.15.47:0/3013661848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e41a7800 con 0x7f41e410cac0 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.161+0000 7f41eba79740 1 Processor -- start 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.162+0000 7f41e0ff9640 1 -- 172.21.15.47:0/3013661848 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f41dc0051d0 con 0x7f41e410cac0 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.162+0000 7f41eba79740 1 -- start start 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41eba79740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd4f20 0x564b54dd5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41eba79740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd5840 0x564b54de1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41eba79740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54de17d0 0x564b54de3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41eba79740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564b54d4c9f0 con 0x564b54dd5840 2024-07-24T22:08:29.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41eba79740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564b54d3bef0 con 0x564b54dd4f20 2024-07-24T22:08:29.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41eba79740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564b54d3ff30 con 0x564b54de17d0 2024-07-24T22:08:29.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41e2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd5840 0x564b54de1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41e2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd5840 0x564b54de1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40984/0 (socket says 172.21.15.47:40984) 2024-07-24T22:08:29.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41e2ffd640 1 -- 172.21.15.47:0/1333854233 learned_addr learned my addr 172.21.15.47:0/1333854233 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:29.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41dbfff640 1 --2- 172.21.15.47:0/1333854233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd4f20 0x564b54dd5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41dbfff640 1 --2- 172.21.15.47:0/1333854233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54de17d0 0x564b54de3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41e2ffd640 1 -- 172.21.15.47:0/1333854233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54de17d0 msgr2=0x564b54de3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:29.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41e2ffd640 1 --2- 172.21.15.47:0/1333854233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54de17d0 0x564b54de3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41e2ffd640 1 -- 172.21.15.47:0/1333854233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd4f20 msgr2=0x564b54dd5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:29.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41e2ffd640 1 --2- 172.21.15.47:0/1333854233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd4f20 0x564b54dd5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41e2ffd640 1 -- 172.21.15.47:0/1333854233 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b54a9c930 con 0x564b54dd5840 2024-07-24T22:08:29.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41dbfff640 1 --2- 172.21.15.47:0/1333854233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54de17d0 0x564b54de3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41e0ff9640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f41d00b3d40 0x7f41d00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.163+0000 7f41e2ffd640 1 --2- 172.21.15.47:0/1333854233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd5840 0x564b54de1290 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f41d400ac20 tx=0x7f41d400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ff1be05503fe9c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.164+0000 7f41dbfff640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f41d00b3d40 0x7f41d00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.164+0000 7f41e0ff9640 1 -- 172.21.15.47:0/3013661848 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f41dc0e4170 con 0x7f41e410cac0 2024-07-24T22:08:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.164+0000 7f41d97fa640 1 -- 172.21.15.47:0/1333854233 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d401d070 con 0x564b54dd5840 2024-07-24T22:08:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.164+0000 7f41d97fa640 1 -- 172.21.15.47:0/1333854233 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41d4018af0 con 0x564b54dd5840 2024-07-24T22:08:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.164+0000 7f41d97fa640 1 -- 172.21.15.47:0/1333854233 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4010aa0 con 0x564b54dd5840 2024-07-24T22:08:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.165+0000 7f41dbfff640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f41d00b3d40 0x7f41d00b6200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f41cc000c00 tx=0x7f41cc005780 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.165+0000 7f41eba79740 1 -- 172.21.15.47:0/1333854233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd5840 msgr2=0x564b54de1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.165+0000 7f41eba79740 1 --2- 172.21.15.47:0/1333854233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd5840 0x564b54de1290 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f41d400ac20 tx=0x7f41d400f790 comp rx=0 tx=0).stop 2024-07-24T22:08:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.165+0000 7f41eba79740 1 -- 172.21.15.47:0/1333854233 shutdown_connections 2024-07-24T22:08:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.165+0000 7f41eba79740 1 --2- 172.21.15.47:0/1333854233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54de17d0 0x564b54de3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.165+0000 7f41eba79740 1 --2- 172.21.15.47:0/1333854233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd5840 0x564b54de1290 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.165+0000 7f41eba79740 1 --2- 172.21.15.47:0/1333854233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd4f20 0x564b54dd5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.165+0000 7f41eba79740 1 -- 172.21.15.47:0/1333854233 >> 172.21.15.47:0/1333854233 conn(0x564b54dd2d50 msgr2=0x564b54dd3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.165+0000 7f41eba79740 1 -- 172.21.15.47:0/1333854233 shutdown_connections 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.165+0000 7f41eba79740 1 -- 172.21.15.47:0/1333854233 wait complete. 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.165+0000 7f41eba79740 1 -- start start 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41eba79740 1 Processor -- start 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41eba79740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd4f20 0x564b54dde7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41eba79740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd5840 0x564b54dded00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41eba79740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 0x564b54ddf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41eba79740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564b54b9f890 con 0x564b54de17d0 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41eba79740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564b54cde390 con 0x564b54dd5840 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41eba79740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564b54de4450 con 0x564b54dd4f20 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41eba79740 10 client.0 _ll_register_callbacks cb 0x564b54ce8500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:29.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 0x564b54ddf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 0x564b54ddf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40996/0 (socket says 172.21.15.47:40996) 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41e37fe640 1 -- 172.21.15.47:0/1951417136 learned_addr learned my addr 172.21.15.47:0/1951417136 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41e2ffd640 1 --2- 172.21.15.47:0/1951417136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd4f20 0x564b54dde7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41dbfff640 1 --2- 172.21.15.47:0/1951417136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd5840 0x564b54dded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41e37fe640 1 -- 172.21.15.47:0/1951417136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd4f20 msgr2=0x564b54dde7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41e37fe640 1 --2- 172.21.15.47:0/1951417136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd4f20 0x564b54dde7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41e37fe640 1 -- 172.21.15.47:0/1951417136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd5840 msgr2=0x564b54dded00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.166+0000 7f41e37fe640 1 --2- 172.21.15.47:0/1951417136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd5840 0x564b54dded00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41e37fe640 1 -- 172.21.15.47:0/1951417136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b54cd8d60 con 0x564b54de17d0 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41e37fe640 1 --2- 172.21.15.47:0/1951417136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 0x564b54ddf240 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009270 tx=0x7f41dc0a7310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a77da0f7b3d60f8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41ca7fc640 1 -- 172.21.15.47:0/1951417136 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc01f040 con 0x564b54de17d0 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41ca7fc640 1 -- 172.21.15.47:0/1951417136 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f41dc0aa030 con 0x564b54de17d0 2024-07-24T22:08:29.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41eba79740 1 -- 172.21.15.47:0/1951417136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41d4018af0 con 0x564b54de17d0 2024-07-24T22:08:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41ca7fc640 1 -- 172.21.15.47:0/1951417136 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f41dc0aa230 con 0x564b54de17d0 2024-07-24T22:08:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41eba79740 10 client.15756 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41eba79740 1 -- 172.21.15.47:0/1951417136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564b54df03e0 con 0x564b54de17d0 2024-07-24T22:08:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41ca7fc640 1 -- 172.21.15.47:0/1951417136 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41d4018af0 con 0x564b54de17d0 2024-07-24T22:08:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41ca7fc640 1 -- 172.21.15.47:0/1951417136 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f41dc00f040 con 0x564b54de17d0 2024-07-24T22:08:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41eba79740 10 client.15756 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41eba79740 10 client.15756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.167+0000 7f41eba79740 20 client.15756 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.168+0000 7f41eba79740 1 --2- 172.21.15.47:0/1951417136 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b54df18a0 0x564b54df3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.168+0000 7f41eba79740 4 client.15756 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.168+0000 7f41eba79740 1 -- 172.21.15.47:0/1951417136 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b54d4e940 con 0x564b54df18a0 2024-07-24T22:08:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.168+0000 7f41e2ffd640 1 --2- 172.21.15.47:0/1951417136 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b54df18a0 0x564b54df3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.168+0000 7f41e2ffd640 1 --2- 172.21.15.47:0/1951417136 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b54df18a0 0x564b54df3d00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60146dab3a07df3a server_cookie=42a7e5272ed0146 in_seq=0 out_seq=0 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.168+0000 7f41ca7fc640 10 client.15756 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.169+0000 7f41ca7fc640 1 -- 172.21.15.47:0/1951417136 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b54d4e940 con 0x564b54df18a0 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.169+0000 7f41ca7fc640 10 client.15756 handle_command_reply: tid=0 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.169+0000 7f41eba79740 1 client.15756 shutdown 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.169+0000 7f41eba79740 1 -- 172.21.15.47:0/1951417136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 msgr2=0x564b54ddf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.169+0000 7f41eba79740 1 --2- 172.21.15.47:0/1951417136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 0x564b54ddf240 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009270 tx=0x7f41dc0a7310 comp rx=0 tx=0).stop 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.169+0000 7f41eba79740 1 -- 172.21.15.47:0/1951417136 shutdown_connections 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.169+0000 7f41eba79740 1 --2- 172.21.15.47:0/1951417136 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b54df18a0 0x564b54df3d00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.169+0000 7f41eba79740 1 --2- 172.21.15.47:0/1951417136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 0x564b54ddf240 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.169+0000 7f41eba79740 1 --2- 172.21.15.47:0/1951417136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd5840 0x564b54dded00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.169+0000 7f41ca7fc640 0 client.15756 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.169+0000 7f41eba79740 1 --2- 172.21.15.47:0/1951417136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd4f20 0x564b54dde7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.169+0000 7f41eba79740 1 -- 172.21.15.47:0/1951417136 >> 172.21.15.47:0/1951417136 conn(0x564b54dd2d50 msgr2=0x564b54dd88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:29.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.169+0000 7f41eba79740 1 -- 172.21.15.47:0/1951417136 shutdown_connections 2024-07-24T22:08:29.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.170+0000 7f41eba79740 1 -- 172.21.15.47:0/1951417136 wait complete. 2024-07-24T22:08:29.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.170+0000 7f41eba79740 20 client.15756 trim_cache size 0 max 16384 2024-07-24T22:08:29.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.188+0000 7f41eba79740 1 Processor -- start 2024-07-24T22:08:29.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.188+0000 7f41eba79740 1 -- start start 2024-07-24T22:08:29.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.188+0000 7f41eba79740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd4f20 0x564b54dd8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.188+0000 7f41eba79740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd5840 0x564b54df95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.188+0000 7f41eba79740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54de17d0 0x564b54df9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.188+0000 7f41eba79740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41e41ae330 con 0x564b54dd4f20 2024-07-24T22:08:29.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.188+0000 7f41eba79740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f41e41b0bb0 con 0x564b54de17d0 2024-07-24T22:08:29.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.188+0000 7f41eba79740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f41e41ae9a0 con 0x564b54dd5840 2024-07-24T22:08:29.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.188+0000 7f41e2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd4f20 0x564b54dd8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.188+0000 7f41e2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd4f20 0x564b54dd8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41004/0 (socket says 172.21.15.47:41004) 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.188+0000 7f41e2ffd640 1 -- 172.21.15.47:0/1014751380 learned_addr learned my addr 172.21.15.47:0/1014751380 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.188+0000 7f41e37fe640 1 --2- 172.21.15.47:0/1014751380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54de17d0 0x564b54df9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.189+0000 7f41dbfff640 1 --2- 172.21.15.47:0/1014751380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd5840 0x564b54df95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.189+0000 7f41e2ffd640 1 -- 172.21.15.47:0/1014751380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd5840 msgr2=0x564b54df95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.189+0000 7f41e2ffd640 1 --2- 172.21.15.47:0/1014751380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd5840 0x564b54df95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.189+0000 7f41e2ffd640 1 -- 172.21.15.47:0/1014751380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54de17d0 msgr2=0x564b54df9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.189+0000 7f41e2ffd640 1 --2- 172.21.15.47:0/1014751380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54de17d0 0x564b54df9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.189+0000 7f41e2ffd640 1 -- 172.21.15.47:0/1014751380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b54dd3a30 con 0x564b54dd4f20 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.189+0000 7f41dbfff640 1 --2- 172.21.15.47:0/1014751380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd5840 0x564b54df95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.189+0000 7f41e2ffd640 1 --2- 172.21.15.47:0/1014751380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd4f20 0x564b54dd8770 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f41d4010610 tx=0x7f41d400a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6760bb1661ea248 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.189+0000 7f41d8ff9640 1 -- 172.21.15.47:0/1014751380 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4032070 con 0x564b54dd4f20 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.189+0000 7f41d8ff9640 1 -- 172.21.15.47:0/1014751380 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41d401e040 con 0x564b54dd4f20 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.189+0000 7f41d8ff9640 1 -- 172.21.15.47:0/1014751380 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d401d040 con 0x564b54dd4f20 2024-07-24T22:08:29.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 -- 172.21.15.47:0/1014751380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd4f20 msgr2=0x564b54dd8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 --2- 172.21.15.47:0/1014751380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd4f20 0x564b54dd8770 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f41d4010610 tx=0x7f41d400a4d0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 -- 172.21.15.47:0/1014751380 shutdown_connections 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 --2- 172.21.15.47:0/1014751380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54de17d0 0x564b54df9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 --2- 172.21.15.47:0/1014751380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd5840 0x564b54df95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 --2- 172.21.15.47:0/1014751380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54dd4f20 0x564b54dd8770 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 -- 172.21.15.47:0/1014751380 >> 172.21.15.47:0/1014751380 conn(0x564b54dd2d50 msgr2=0x564b54dd8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 -- 172.21.15.47:0/1014751380 shutdown_connections 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 -- 172.21.15.47:0/1014751380 wait complete. 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 -- start start 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 Processor -- start 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd4f20 0x564b54de96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd5840 0x564b54de9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.190+0000 7f41eba79740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 0x564b54de66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41eba79740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41e41af070 con 0x564b54de17d0 2024-07-24T22:08:29.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41eba79740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f41e41b04e0 con 0x564b54dd4f20 2024-07-24T22:08:29.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41eba79740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f41e41af740 con 0x564b54dd5840 2024-07-24T22:08:29.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41eba79740 10 client.0 _ll_register_callbacks cb 0x7f41dc0aaa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:29.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 0x564b54de66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 0x564b54de66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41006/0 (socket says 172.21.15.47:41006) 2024-07-24T22:08:29.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41e37fe640 1 -- 172.21.15.47:0/4030185516 learned_addr learned my addr 172.21.15.47:0/4030185516 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:29.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41e2ffd640 1 --2- 172.21.15.47:0/4030185516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd4f20 0x564b54de96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41dbfff640 1 --2- 172.21.15.47:0/4030185516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd5840 0x564b54de9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41e37fe640 1 -- 172.21.15.47:0/4030185516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd5840 msgr2=0x564b54de9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:29.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41e37fe640 1 --2- 172.21.15.47:0/4030185516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd5840 0x564b54de9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41e37fe640 1 -- 172.21.15.47:0/4030185516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd4f20 msgr2=0x564b54de96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:29.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41e37fe640 1 --2- 172.21.15.47:0/4030185516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd4f20 0x564b54de96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41e37fe640 1 -- 172.21.15.47:0/4030185516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b54de6cf0 con 0x564b54de17d0 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41e37fe640 1 --2- 172.21.15.47:0/4030185516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 0x564b54de66b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f41dc0a9f30 tx=0x7f41dc0a9cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1770f6da14f942b6 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41ca7fc640 1 -- 172.21.15.47:0/4030185516 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc01f070 con 0x564b54de17d0 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41ca7fc640 1 -- 172.21.15.47:0/4030185516 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f41dc0a73c0 con 0x564b54de17d0 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41eba79740 1 -- 172.21.15.47:0/4030185516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41d401e040 con 0x564b54de17d0 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.191+0000 7f41ca7fc640 1 -- 172.21.15.47:0/4030185516 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f41dc0aa720 con 0x564b54de17d0 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.192+0000 7f41eba79740 10 client.15762 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.192+0000 7f41eba79740 1 -- 172.21.15.47:0/4030185516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564b54e5ce80 con 0x564b54de17d0 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.192+0000 7f41ca7fc640 1 -- 172.21.15.47:0/4030185516 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41d401e040 con 0x564b54de17d0 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.192+0000 7f41ca7fc640 1 -- 172.21.15.47:0/4030185516 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f41dc0920b0 con 0x564b54de17d0 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.192+0000 7f41eba79740 10 client.15762 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.192+0000 7f41eba79740 10 client.15762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.192+0000 7f41eba79740 20 client.15762 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:29.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.192+0000 7f41eba79740 1 --2- 172.21.15.47:0/4030185516 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b54e5d570 0x564b54e5f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:29.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.192+0000 7f41eba79740 4 client.15762 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:08:29.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.192+0000 7f41eba79740 1 -- 172.21.15.47:0/4030185516 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564b54d4a3e0 con 0x564b54e5d570 2024-07-24T22:08:29.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.192+0000 7f41e2ffd640 1 --2- 172.21.15.47:0/4030185516 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b54e5d570 0x564b54e5f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:29.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.193+0000 7f41ca7fc640 10 client.15762 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:29.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.193+0000 7f41e2ffd640 1 --2- 172.21.15.47:0/4030185516 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b54e5d570 0x564b54e5f990 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb7052d548de51bc server_cookie=455fb177857ac0cd in_seq=0 out_seq=0 2024-07-24T22:08:29.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.194+0000 7f41ca7fc640 1 -- 172.21.15.47:0/4030185516 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564b54d4a3e0 con 0x564b54e5d570 2024-07-24T22:08:29.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.194+0000 7f41ca7fc640 10 client.15762 handle_command_reply: tid=0 2024-07-24T22:08:29.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.195+0000 7f41eba79740 1 client.15762 shutdown 2024-07-24T22:08:29.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.195+0000 7f41eba79740 1 -- 172.21.15.47:0/4030185516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 msgr2=0x564b54de66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:29.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.195+0000 7f41eba79740 1 --2- 172.21.15.47:0/4030185516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 0x564b54de66b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f41dc0a9f30 tx=0x7f41dc0a9cd0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.195+0000 7f41eba79740 1 -- 172.21.15.47:0/4030185516 shutdown_connections 2024-07-24T22:08:29.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.195+0000 7f41eba79740 1 --2- 172.21.15.47:0/4030185516 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b54e5d570 0x564b54e5f990 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.195+0000 7f41eba79740 1 --2- 172.21.15.47:0/4030185516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b54de17d0 0x564b54de66b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.195+0000 7f41eba79740 1 --2- 172.21.15.47:0/4030185516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b54dd5840 0x564b54de9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.195+0000 7f41eba79740 1 --2- 172.21.15.47:0/4030185516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b54dd4f20 0x564b54de96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.195+0000 7f41eba79740 1 -- 172.21.15.47:0/4030185516 >> 172.21.15.47:0/4030185516 conn(0x564b54dd2d50 msgr2=0x564b54dd8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:29.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.195+0000 7f41ca7fc640 0 client.15762 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:29.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.195+0000 7f41eba79740 1 -- 172.21.15.47:0/4030185516 shutdown_connections 2024-07-24T22:08:29.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.195+0000 7f41eba79740 1 -- 172.21.15.47:0/4030185516 wait complete. 2024-07-24T22:08:29.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.195+0000 7f41eba79740 20 client.15762 trim_cache size 0 max 16384 2024-07-24T22:08:29.213 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:08:29.213 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:08:29.213 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "ecbba24f-07ab-4777-9d85-afe49b4bfde1", 2024-07-24T22:08:29.213 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:08:29.214 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:08:29.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.196+0000 7f41e96c8640 1 -- 172.21.15.47:0/3013661848 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f41d00b3d40 msgr2=0x7f41d00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:29.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.196+0000 7f41e96c8640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f41d00b3d40 0x7f41d00b6200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f41cc000c00 tx=0x7f41cc005780 comp rx=0 tx=0).stop 2024-07-24T22:08:29.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.196+0000 7f41e96c8640 1 -- 172.21.15.47:0/3013661848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e410cac0 msgr2=0x7f41e4101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:29.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.196+0000 7f41e96c8640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e410cac0 0x7f41e4101d90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00eaa0 tx=0x7f41dc00ef60 comp rx=0 tx=0).stop 2024-07-24T22:08:29.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.196+0000 7f41e96c8640 1 -- 172.21.15.47:0/3013661848 shutdown_connections 2024-07-24T22:08:29.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.196+0000 7f41e96c8640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f41d00b3d40 0x7f41d00b6200 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.196+0000 7f41e96c8640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e410cac0 0x7f41e4101d90 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.196+0000 7f41e96c8640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41e4103f80 0x7f41e4101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.196+0000 7f41e96c8640 1 --2- 172.21.15.47:0/3013661848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41e4103660 0x7f41e4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:29.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.196+0000 7f41e96c8640 1 -- 172.21.15.47:0/3013661848 >> 172.21.15.47:0/3013661848 conn(0x7f41e40fd0c0 msgr2=0x7f41e40fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:29.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.196+0000 7f41e96c8640 1 -- 172.21.15.47:0/3013661848 shutdown_connections 2024-07-24T22:08:29.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:29.196+0000 7f41e96c8640 1 -- 172.21.15.47:0/3013661848 wait complete. 2024-07-24T22:08:29.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:29 smithi047 ceph-mon[32551]: pgmap v404: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:08:29.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:29 smithi188 ceph-mon[37380]: pgmap v404: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:08:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:29 smithi183 ceph-mon[37007]: pgmap v404: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:08:29.940 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:08:29.991 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:30.373 INFO:tasks.workunit.client.0.smithi047.stderr:Updating files: 89% (11311/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-07-24T22:08:30.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:30 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:08:30.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:30 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:08:30.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:30 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:08:30.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:30 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:08:30.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:30 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:08:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-07-24T22:08:30.722 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-07-24T22:08:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-07-24T22:08:30.722 INFO:tasks.workunit.client.0.smithi047.stderr:changes and commit them, and you can discard any commits you make in this 2024-07-24T22:08:30.723 INFO:tasks.workunit.client.0.smithi047.stderr:state without impacting any branches by switching back to a branch. 2024-07-24T22:08:30.723 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-07-24T22:08:30.723 INFO:tasks.workunit.client.0.smithi047.stderr:If you want to create a new branch to retain commits you create, you may 2024-07-24T22:08:30.723 INFO:tasks.workunit.client.0.smithi047.stderr:do so (now or later) by using -c with the switch command. Example: 2024-07-24T22:08:30.723 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-07-24T22:08:30.723 INFO:tasks.workunit.client.0.smithi047.stderr: git switch -c 2024-07-24T22:08:30.723 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-07-24T22:08:30.723 INFO:tasks.workunit.client.0.smithi047.stderr:Or undo this operation with: 2024-07-24T22:08:30.723 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-07-24T22:08:30.723 INFO:tasks.workunit.client.0.smithi047.stderr: git switch - 2024-07-24T22:08:30.723 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-07-24T22:08:30.723 INFO:tasks.workunit.client.0.smithi047.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-07-24T22:08:30.723 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-07-24T22:08:30.724 INFO:tasks.workunit.client.0.smithi047.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-07-24T22:08:30.725 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-07-24T22:08:30.784 INFO:tasks.workunit.client.0.smithi047.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-07-24T22:08:30.786 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-07-24T22:08:30.786 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-07-24T22:08:30.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:30 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:08:30.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:30 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:08:30.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:30 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:08:30.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:30 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:08:30.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:30 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:08:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:30 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:08:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:30 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:08:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:30 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:08:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:30 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:08:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:30 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:08:31.528 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:31.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:31 smithi188 ceph-mon[37380]: pgmap v405: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:08:31.813 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:31 smithi183 ceph-mon[37007]: pgmap v405: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:08:31.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:31 smithi047 ceph-mon[32551]: pgmap v405: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:08:32.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.405+0000 7ffbbd503640 1 -- 172.21.15.47:0/2773802435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbb8101690 msgr2=0x7ffbb8101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:32.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.405+0000 7ffbbd503640 1 --2- 172.21.15.47:0/2773802435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbb8101690 0x7ffbb8101a70 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009900 tx=0x7ffba802a410 comp rx=0 tx=0).stop 2024-07-24T22:08:32.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.405+0000 7ffbbd503640 1 -- 172.21.15.47:0/2773802435 shutdown_connections 2024-07-24T22:08:32.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.405+0000 7ffbbd503640 1 --2- 172.21.15.47:0/2773802435 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbb8107a20 0x7ffbb810e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.405+0000 7ffbbd503640 1 --2- 172.21.15.47:0/2773802435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbb81070a0 0x7ffbb81074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.405+0000 7ffbbd503640 1 --2- 172.21.15.47:0/2773802435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbb8101690 0x7ffbb8101a70 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.405+0000 7ffbbd503640 1 -- 172.21.15.47:0/2773802435 >> 172.21.15.47:0/2773802435 conn(0x7ffbb80fd100 msgr2=0x7ffbb80ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.405+0000 7ffbbd503640 1 -- 172.21.15.47:0/2773802435 shutdown_connections 2024-07-24T22:08:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.405+0000 7ffbbd503640 1 -- 172.21.15.47:0/2773802435 wait complete. 2024-07-24T22:08:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.406+0000 7ffbbd503640 1 Processor -- start 2024-07-24T22:08:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.406+0000 7ffbbd503640 1 -- start start 2024-07-24T22:08:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.406+0000 7ffbbd503640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbb8101690 0x7ffbb819ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.406+0000 7ffbbd503640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbb81070a0 0x7ffbb819b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.406+0000 7ffbbd503640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbb8107a20 0x7ffbb81a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.406+0000 7ffbbd503640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81127c0 con 0x7ffbb8107a20 2024-07-24T22:08:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.406+0000 7ffbbd503640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb8112640 con 0x7ffbb81070a0 2024-07-24T22:08:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.406+0000 7ffbbd503640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb8112940 con 0x7ffbb8101690 2024-07-24T22:08:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.406+0000 7ffbb77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbb8107a20 0x7ffbb81a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffbb77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbb8107a20 0x7ffbb81a06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41024/0 (socket says 172.21.15.47:41024) 2024-07-24T22:08:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffbb77fe640 1 -- 172.21.15.47:0/2774300124 learned_addr learned my addr 172.21.15.47:0/2774300124 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffbb6ffd640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbb8101690 0x7ffbb819ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbb81070a0 0x7ffbb819b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffbb77fe640 1 -- 172.21.15.47:0/2774300124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbb8101690 msgr2=0x7ffbb819ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffbb77fe640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbb8101690 0x7ffbb819ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffbb77fe640 1 -- 172.21.15.47:0/2774300124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbb81070a0 msgr2=0x7ffbb819b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffbb77fe640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbb81070a0 0x7ffbb819b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffbb77fe640 1 -- 172.21.15.47:0/2774300124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb81a0eb0 con 0x7ffbb8107a20 2024-07-24T22:08:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffbb77fe640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbb8107a20 0x7ffbb81a06e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000eaa0 tx=0x7ffbb000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffb9ffff640 1 -- 172.21.15.47:0/2774300124 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000cdb0 con 0x7ffbb8107a20 2024-07-24T22:08:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffb9ffff640 1 -- 172.21.15.47:0/2774300124 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb0005020 con 0x7ffbb8107a20 2024-07-24T22:08:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffbbd503640 1 -- 172.21.15.47:0/2774300124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb81a11a0 con 0x7ffbb8107a20 2024-07-24T22:08:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffb9ffff640 1 -- 172.21.15.47:0/2774300124 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb00116d0 con 0x7ffbb8107a20 2024-07-24T22:08:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.407+0000 7ffbbd503640 1 -- 172.21.15.47:0/2774300124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb81a7860 con 0x7ffbb8107a20 2024-07-24T22:08:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.410+0000 7ffb9ffff640 1 -- 172.21.15.47:0/2774300124 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7ffbb00051d0 con 0x7ffbb8107a20 2024-07-24T22:08:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.410+0000 7ffbbf8b4740 1 Processor -- start 2024-07-24T22:08:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.410+0000 7ffbbf8b4740 1 -- start start 2024-07-24T22:08:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.410+0000 7ffbbf8b4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64ead10 0x559fe64eb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.410+0000 7ffbbf8b4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64eb630 0x559fe64f7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.410+0000 7ffbbf8b4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64f75c0 0x559fe64f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.410+0000 7ffbbf8b4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559fe6460610 con 0x559fe64f75c0 2024-07-24T22:08:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.410+0000 7ffbbf8b4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x559fe644fb10 con 0x559fe64ead10 2024-07-24T22:08:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.410+0000 7ffbbf8b4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559fe6453b50 con 0x559fe64eb630 2024-07-24T22:08:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.410+0000 7ffbb67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64f75c0 0x559fe64f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffbb67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64f75c0 0x559fe64f99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41032/0 (socket says 172.21.15.47:41032) 2024-07-24T22:08:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffbb67fc640 1 -- 172.21.15.47:0/1989495857 learned_addr learned my addr 172.21.15.47:0/1989495857 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffb9ffff640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffba00b3d40 0x7ffba00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffbb6ffd640 1 --2- 172.21.15.47:0/1989495857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64eb630 0x559fe64f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/1989495857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64ead10 0x559fe64eb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffbb67fc640 1 -- 172.21.15.47:0/1989495857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64eb630 msgr2=0x559fe64f7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/1989495857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64eb630 0x559fe64f7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffbb77fe640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffba00b3d40 0x7ffba00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffbb67fc640 1 -- 172.21.15.47:0/1989495857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64ead10 msgr2=0x559fe64eb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/1989495857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64ead10 0x559fe64eb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffbb67fc640 1 -- 172.21.15.47:0/1989495857 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fe63e5320 con 0x559fe64f75c0 2024-07-24T22:08:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffbb6ffd640 1 --2- 172.21.15.47:0/1989495857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64eb630 0x559fe64f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffb9ffff640 1 -- 172.21.15.47:0/2774300124 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ffbb00e4110 con 0x7ffbb8107a20 2024-07-24T22:08:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/1989495857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64f75c0 0x559fe64f99b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0125c0 tx=0x7ffbac00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c690f6fe944efd3c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffb9d7fa640 1 -- 172.21.15.47:0/1989495857 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac0106b0 con 0x559fe64f75c0 2024-07-24T22:08:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffb9d7fa640 1 -- 172.21.15.47:0/1989495857 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbac010d00 con 0x559fe64f75c0 2024-07-24T22:08:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.411+0000 7ffb9d7fa640 1 -- 172.21.15.47:0/1989495857 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac01dcc0 con 0x559fe64f75c0 2024-07-24T22:08:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.412+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/1989495857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64f75c0 msgr2=0x559fe64f99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.412+0000 7ffbb77fe640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffba00b3d40 0x7ffba00b6200 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00a6e50 tx=0x7ffbb0005890 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.412+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/1989495857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64f75c0 0x559fe64f99b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0125c0 tx=0x7ffbac00b870 comp rx=0 tx=0).stop 2024-07-24T22:08:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.412+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/1989495857 shutdown_connections 2024-07-24T22:08:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.412+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/1989495857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64f75c0 0x559fe64f99b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.412+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/1989495857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64eb630 0x559fe64f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.412+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/1989495857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64ead10 0x559fe64eb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.412+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/1989495857 >> 172.21.15.47:0/1989495857 conn(0x559fe64e8b40 msgr2=0x559fe64e9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.412+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/1989495857 shutdown_connections 2024-07-24T22:08:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.412+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/1989495857 wait complete. 2024-07-24T22:08:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.412+0000 7ffbbf8b4740 1 -- start start 2024-07-24T22:08:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.412+0000 7ffbbf8b4740 1 Processor -- start 2024-07-24T22:08:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbbf8b4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64ead10 0x559fe64f4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbbf8b4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 0x559fe64f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbbf8b4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64f75c0 0x559fe64f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbbf8b4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559fe62b37b0 con 0x559fe64eb630 2024-07-24T22:08:32.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbbf8b4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x559fe63f2130 con 0x559fe64ead10 2024-07-24T22:08:32.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbbf8b4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559fe64fa2e0 con 0x559fe64f75c0 2024-07-24T22:08:32.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbbf8b4740 10 client.0 _ll_register_callbacks cb 0x559fe6448660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:32.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbb6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 0x559fe64f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbb6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 0x559fe64f4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41042/0 (socket says 172.21.15.47:41042) 2024-07-24T22:08:32.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbb6ffd640 1 -- 172.21.15.47:0/3967423233 learned_addr learned my addr 172.21.15.47:0/3967423233 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:32.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64f75c0 0x559fe64f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64ead10 0x559fe64f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbb6ffd640 1 -- 172.21.15.47:0/3967423233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64f75c0 msgr2=0x559fe64f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:32.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbb6ffd640 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64f75c0 0x559fe64f4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbb6ffd640 1 -- 172.21.15.47:0/3967423233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64ead10 msgr2=0x559fe64f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:32.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbb6ffd640 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64ead10 0x559fe64f4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbb6ffd640 1 -- 172.21.15.47:0/3967423233 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fe63f5e80 con 0x559fe64eb630 2024-07-24T22:08:32.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64ead10 0x559fe64f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:32.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffbb6ffd640 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 0x559fe64f4a90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ffba8033000 tx=0x7ffba8032f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5ff865eddac3ca server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:32.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.413+0000 7ffb9aff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:32.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffb9aff5640 1 -- 172.21.15.47:0/3967423233 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8035040 con 0x559fe64eb630 2024-07-24T22:08:32.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffb9aff5640 1 -- 172.21.15.47:0/3967423233 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ffba8004050 con 0x559fe64eb630 2024-07-24T22:08:32.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3967423233 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbac010d00 con 0x559fe64eb630 2024-07-24T22:08:32.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffb9aff5640 1 -- 172.21.15.47:0/3967423233 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ffba8004250 con 0x559fe64eb630 2024-07-24T22:08:32.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffbbf8b4740 10 client.15774 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:32.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3967423233 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559fe61bfba0 con 0x559fe64eb630 2024-07-24T22:08:32.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffb9aff5640 1 -- 172.21.15.47:0/3967423233 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbac010d00 con 0x559fe64eb630 2024-07-24T22:08:32.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffb9aff5640 1 -- 172.21.15.47:0/3967423233 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ffba8004a80 con 0x559fe64eb630 2024-07-24T22:08:32.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffbbf8b4740 10 client.15774 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:32.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffbbf8b4740 10 client.15774 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:08:32.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffbbf8b4740 20 client.15774 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:32.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559fe6507190 0x559fe6509610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffbbf8b4740 4 client.15774 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:32.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.414+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3967423233 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fe6462560 con 0x559fe6507190 2024-07-24T22:08:32.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.415+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559fe6507190 0x559fe6509610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.415+0000 7ffb9aff5640 10 client.15774 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:32.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.415+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559fe6507190 0x559fe6509610 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7061e49c9449e642 server_cookie=f0d222f6a4a607e9 in_seq=0 out_seq=0 2024-07-24T22:08:32.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffb9aff5640 1 -- 172.21.15.47:0/3967423233 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559fe6462560 con 0x559fe6507190 2024-07-24T22:08:32.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffb9aff5640 10 client.15774 handle_command_reply: tid=0 2024-07-24T22:08:32.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffbbf8b4740 1 client.15774 shutdown 2024-07-24T22:08:32.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3967423233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 msgr2=0x559fe64f4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:32.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 0x559fe64f4a90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ffba8033000 tx=0x7ffba8032f00 comp rx=0 tx=0).stop 2024-07-24T22:08:32.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3967423233 shutdown_connections 2024-07-24T22:08:32.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559fe6507190 0x559fe6509610 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64f75c0 0x559fe64f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 0x559fe64f4a90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffb9aff5640 0 client.15774 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:32.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/3967423233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64ead10 0x559fe64f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3967423233 >> 172.21.15.47:0/3967423233 conn(0x559fe64e8b40 msgr2=0x559fe64ee6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:32.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3967423233 shutdown_connections 2024-07-24T22:08:32.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3967423233 wait complete. 2024-07-24T22:08:32.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.416+0000 7ffbbf8b4740 20 client.15774 trim_cache size 0 max 16384 2024-07-24T22:08:32.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.434+0000 7ffbbf8b4740 1 Processor -- start 2024-07-24T22:08:32.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.434+0000 7ffbbf8b4740 1 -- start start 2024-07-24T22:08:32.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbbf8b4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64ead10 0x559fe64f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbbf8b4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 0x559fe64eee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbbf8b4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64f75c0 0x559fe64f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbbf8b4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81ae300 con 0x559fe64eb630 2024-07-24T22:08:32.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbbf8b4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81b0b80 con 0x559fe64f75c0 2024-07-24T22:08:32.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbbf8b4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81ae970 con 0x559fe64ead10 2024-07-24T22:08:32.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbb6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 0x559fe64eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbb6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 0x559fe64eee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41052/0 (socket says 172.21.15.47:41052) 2024-07-24T22:08:32.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbb6ffd640 1 -- 172.21.15.47:0/1977715519 learned_addr learned my addr 172.21.15.47:0/1977715519 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:32.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/1977715519 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64ead10 0x559fe64f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/1977715519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64f75c0 0x559fe64f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbb6ffd640 1 -- 172.21.15.47:0/1977715519 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64ead10 msgr2=0x559fe64f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:32.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbb6ffd640 1 --2- 172.21.15.47:0/1977715519 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64ead10 0x559fe64f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbb6ffd640 1 -- 172.21.15.47:0/1977715519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64f75c0 msgr2=0x559fe64f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:32.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbb6ffd640 1 --2- 172.21.15.47:0/1977715519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64f75c0 0x559fe64f2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbb6ffd640 1 -- 172.21.15.47:0/1977715519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fe64eb420 con 0x559fe64eb630 2024-07-24T22:08:32.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffbb6ffd640 1 --2- 172.21.15.47:0/1977715519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 0x559fe64eee60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ffba802a930 tx=0x7ffba802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cc299df4514b8f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:32.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.435+0000 7ffb9cff9640 1 -- 172.21.15.47:0/1977715519 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8035030 con 0x559fe64eb630 2024-07-24T22:08:32.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.436+0000 7ffb9cff9640 1 -- 172.21.15.47:0/1977715519 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffba8040070 con 0x559fe64eb630 2024-07-24T22:08:32.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.436+0000 7ffb9cff9640 1 -- 172.21.15.47:0/1977715519 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8051070 con 0x559fe64eb630 2024-07-24T22:08:32.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.436+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/1977715519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 msgr2=0x559fe64eee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:32.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.436+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/1977715519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 0x559fe64eee60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ffba802a930 tx=0x7ffba802a410 comp rx=0 tx=0).stop 2024-07-24T22:08:32.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.436+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/1977715519 shutdown_connections 2024-07-24T22:08:32.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.436+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/1977715519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64f75c0 0x559fe64f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.436+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/1977715519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64eb630 0x559fe64eee60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.436+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/1977715519 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64ead10 0x559fe64f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.436+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/1977715519 >> 172.21.15.47:0/1977715519 conn(0x559fe64e8b40 msgr2=0x559fe64f4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:32.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.436+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/1977715519 shutdown_connections 2024-07-24T22:08:32.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.436+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/1977715519 wait complete. 2024-07-24T22:08:32.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbbf8b4740 1 -- start start 2024-07-24T22:08:32.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbbf8b4740 1 Processor -- start 2024-07-24T22:08:32.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbbf8b4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64ead10 0x559fe64ffa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbbf8b4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64eb630 0x559fe64fbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbbf8b4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64f75c0 0x559fe64fc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbbf8b4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81af040 con 0x559fe64ead10 2024-07-24T22:08:32.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbbf8b4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81b04b0 con 0x559fe64f75c0 2024-07-24T22:08:32.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbbf8b4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81af710 con 0x559fe64eb630 2024-07-24T22:08:32.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbbf8b4740 10 client.0 _ll_register_callbacks cb 0x7ffba8005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:32.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbb67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64ead10 0x559fe64ffa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbb67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64ead10 0x559fe64ffa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41068/0 (socket says 172.21.15.47:41068) 2024-07-24T22:08:32.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbb67fc640 1 -- 172.21.15.47:0/3505667886 learned_addr learned my addr 172.21.15.47:0/3505667886 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:32.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbb6ffd640 1 --2- 172.21.15.47:0/3505667886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64eb630 0x559fe64fbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/3505667886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64f75c0 0x559fe64fc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbb67fc640 1 -- 172.21.15.47:0/3505667886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64eb630 msgr2=0x559fe64fbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:32.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/3505667886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64eb630 0x559fe64fbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbb67fc640 1 -- 172.21.15.47:0/3505667886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64f75c0 msgr2=0x559fe64fc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:32.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/3505667886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64f75c0 0x559fe64fc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.437+0000 7ffbb67fc640 1 -- 172.21.15.47:0/3505667886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fe64fcaa0 con 0x559fe64ead10 2024-07-24T22:08:32.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.438+0000 7ffbb67fc640 1 --2- 172.21.15.47:0/3505667886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64ead10 0x559fe64ffa40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00b840 tx=0x7ffba8032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f70e7a59d5c9b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:32.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.438+0000 7ffb9aff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:32.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffb9aff5640 1 -- 172.21.15.47:0/3505667886 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac023040 con 0x559fe64ead10 2024-07-24T22:08:32.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffb9aff5640 1 -- 172.21.15.47:0/3505667886 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ffbac01db90 con 0x559fe64ead10 2024-07-24T22:08:32.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3505667886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffba8040070 con 0x559fe64ead10 2024-07-24T22:08:32.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffb9aff5640 1 -- 172.21.15.47:0/3505667886 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ffbac01dd90 con 0x559fe64ead10 2024-07-24T22:08:32.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffbbf8b4740 10 client.15780 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:32.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3505667886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559fe6572d50 con 0x559fe64ead10 2024-07-24T22:08:32.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffb9aff5640 1 -- 172.21.15.47:0/3505667886 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffba8040070 con 0x559fe64ead10 2024-07-24T22:08:32.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffb9aff5640 1 -- 172.21.15.47:0/3505667886 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ffbac034020 con 0x559fe64ead10 2024-07-24T22:08:32.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffbbf8b4740 10 client.15780 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:32.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffbbf8b4740 10 client.15780 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:08:32.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffbbf8b4740 20 client.15780 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:32.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/3505667886 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559fe6573380 0x559fe65757a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:32.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffbbf8b4740 4 client.15780 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-07-24T22:08:32.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.439+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3505667886 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x559fe645e000 con 0x559fe6573380 2024-07-24T22:08:32.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.440+0000 7ffbb6ffd640 1 --2- 172.21.15.47:0/3505667886 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559fe6573380 0x559fe65757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:32.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.440+0000 7ffbb6ffd640 1 --2- 172.21.15.47:0/3505667886 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559fe6573380 0x559fe65757a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35de4d8753ef7a39 server_cookie=c9bc2374968a3c98 in_seq=0 out_seq=0 2024-07-24T22:08:32.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.440+0000 7ffb9aff5640 10 client.15780 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:32.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.444+0000 7ffb9aff5640 1 -- 172.21.15.47:0/3505667886 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559fe645e000 con 0x559fe6573380 2024-07-24T22:08:32.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.444+0000 7ffb9aff5640 10 client.15780 handle_command_reply: tid=0 2024-07-24T22:08:32.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.444+0000 7ffbbf8b4740 1 client.15780 shutdown 2024-07-24T22:08:32.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3505667886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64ead10 msgr2=0x559fe64ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:32.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/3505667886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64ead10 0x559fe64ffa40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00b840 tx=0x7ffba8032b20 comp rx=0 tx=0).stop 2024-07-24T22:08:32.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3505667886 shutdown_connections 2024-07-24T22:08:32.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/3505667886 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559fe6573380 0x559fe65757a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.477 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:08:32.477 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:08:32.477 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:08:32.477 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 6, 2024-07-24T22:08:32.478 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:08:32.478 INFO:teuthology.orchestra.run.smithi047.stdout: "9a3ad881": { 2024-07-24T22:08:32.478 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 6, 2024-07-24T22:08:32.478 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:08:32.478 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:08:32.478 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:08:32.478 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:08:32.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:08:32.478 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:08:32.478 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 140.3, 2024-07-24T22:08:32.478 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:08:32.479 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:08:32.479 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:08:32.479 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:08:32.479 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:08:32.479 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:08:32.479 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:32.479 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:32.479 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:32.479 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:32.479 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:32.479 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:08:32.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/3505667886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559fe64f75c0 0x559fe64fc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/3505667886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559fe64eb630 0x559fe64fbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffb9aff5640 0 client.15780 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:32.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbf8b4740 1 --2- 172.21.15.47:0/3505667886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559fe64ead10 0x559fe64ffa40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3505667886 >> 172.21.15.47:0/3505667886 conn(0x559fe64e8b40 msgr2=0x559fe6502420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:32.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3505667886 shutdown_connections 2024-07-24T22:08:32.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbf8b4740 1 -- 172.21.15.47:0/3505667886 wait complete. 2024-07-24T22:08:32.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbf8b4740 20 client.15780 trim_cache size 0 max 16384 2024-07-24T22:08:32.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbd503640 1 -- 172.21.15.47:0/2774300124 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffba00b3d40 msgr2=0x7ffba00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:32.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbd503640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffba00b3d40 0x7ffba00b6200 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00a6e50 tx=0x7ffbb0005890 comp rx=0 tx=0).stop 2024-07-24T22:08:32.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.445+0000 7ffbbd503640 1 -- 172.21.15.47:0/2774300124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbb8107a20 msgr2=0x7ffbb81a06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:32.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.446+0000 7ffbbd503640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbb8107a20 0x7ffbb81a06e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000eaa0 tx=0x7ffbb000ef60 comp rx=0 tx=0).stop 2024-07-24T22:08:32.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.446+0000 7ffbbd503640 1 -- 172.21.15.47:0/2774300124 shutdown_connections 2024-07-24T22:08:32.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.446+0000 7ffbbd503640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ffba00b3d40 0x7ffba00b6200 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.446+0000 7ffbbd503640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbb8107a20 0x7ffbb81a06e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.446+0000 7ffbbd503640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbb81070a0 0x7ffbb819b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.446+0000 7ffbbd503640 1 --2- 172.21.15.47:0/2774300124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffbb8101690 0x7ffbb819ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:32.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.446+0000 7ffbbd503640 1 -- 172.21.15.47:0/2774300124 >> 172.21.15.47:0/2774300124 conn(0x7ffbb80fd100 msgr2=0x7ffbb8103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:32.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.446+0000 7ffbbd503640 1 -- 172.21.15.47:0/2774300124 shutdown_connections 2024-07-24T22:08:32.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:32.446+0000 7ffbbd503640 1 -- 172.21.15.47:0/2774300124 wait complete. 2024-07-24T22:08:32.824 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-07-24T22:08:32.878 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-07-24T22:08:32.919 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-07-24T22:08:32.921 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-07-24T22:08:32.921 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-07-24T22:08:32.966 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-07-24T22:08:32.969 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T22:08:32.969 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-07-24T22:08:32.985 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2024-07-24T22:08:32.987 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2024-07-24T22:08:32.987 DEBUG:teuthology.orchestra.run.smithi047:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2024-07-24T22:08:33.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:33 smithi047 ceph-mon[32551]: pgmap v406: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-07-24T22:08:33.762 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9a3ad881', quiesce took 11.5 seconds. Will release after: 8.850000000000001 2024-07-24T22:08:33.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:33 smithi188 ceph-mon[37380]: pgmap v406: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-07-24T22:08:33.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:33 smithi183 ceph-mon[37007]: pgmap v406: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-07-24T22:08:34.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.658+0000 7f01adf0a640 1 -- 172.21.15.47:0/2387954655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a8103f80 msgr2=0x7f01a810c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:34.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.658+0000 7f01adf0a640 1 --2- 172.21.15.47:0/2387954655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a8103f80 0x7f01a810c470 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f019c009900 tx=0x7f019c02a410 comp rx=0 tx=0).stop 2024-07-24T22:08:34.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.658+0000 7f01adf0a640 1 -- 172.21.15.47:0/2387954655 shutdown_connections 2024-07-24T22:08:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.658+0000 7f01adf0a640 1 --2- 172.21.15.47:0/2387954655 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a810cac0 0x7f01a810ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.658+0000 7f01adf0a640 1 --2- 172.21.15.47:0/2387954655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a8103f80 0x7f01a810c470 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.658+0000 7f01adf0a640 1 --2- 172.21.15.47:0/2387954655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01a8103660 0x7f01a8103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.658+0000 7f01adf0a640 1 -- 172.21.15.47:0/2387954655 >> 172.21.15.47:0/2387954655 conn(0x7f01a80fd0c0 msgr2=0x7f01a80ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.658+0000 7f01adf0a640 1 -- 172.21.15.47:0/2387954655 shutdown_connections 2024-07-24T22:08:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.658+0000 7f01adf0a640 1 -- 172.21.15.47:0/2387954655 wait complete. 2024-07-24T22:08:34.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.659+0000 7f01adf0a640 1 Processor -- start 2024-07-24T22:08:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.659+0000 7f01adf0a640 1 -- start start 2024-07-24T22:08:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.659+0000 7f01adf0a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8103660 0x7f01a8101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.659+0000 7f01adf0a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a8103f80 0x7f01a8101850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.659+0000 7f01adf0a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01a810cac0 0x7f01a8101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.659+0000 7f01adf0a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01a8112700 con 0x7f01a8103f80 2024-07-24T22:08:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.659+0000 7f01adf0a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f01a8112580 con 0x7f01a8103660 2024-07-24T22:08:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.659+0000 7f01adf0a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f01a8112880 con 0x7f01a810cac0 2024-07-24T22:08:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.659+0000 7f01a6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a8103f80 0x7f01a8101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.659+0000 7f01a6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a8103f80 0x7f01a8101850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41100/0 (socket says 172.21.15.47:41100) 2024-07-24T22:08:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.659+0000 7f01a6ffd640 1 -- 172.21.15.47:0/309934685 learned_addr learned my addr 172.21.15.47:0/309934685 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:34.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.659+0000 7f01a77fe640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8103660 0x7f01a8101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.660+0000 7f01a7fff640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01a810cac0 0x7f01a8101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.660+0000 7f01a6ffd640 1 -- 172.21.15.47:0/309934685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01a810cac0 msgr2=0x7f01a8101d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:34.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.660+0000 7f01a6ffd640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01a810cac0 0x7f01a8101d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.660+0000 7f01a6ffd640 1 -- 172.21.15.47:0/309934685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8103660 msgr2=0x7f01a8101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:34.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.660+0000 7f01a6ffd640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8103660 0x7f01a8101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.660+0000 7f01a6ffd640 1 -- 172.21.15.47:0/309934685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a81a7050 con 0x7f01a8103f80 2024-07-24T22:08:34.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.660+0000 7f01a6ffd640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a8103f80 0x7f01a8101850 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f019c006010 tx=0x7f019c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:34.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.660+0000 7f01a4ff9640 1 -- 172.21.15.47:0/309934685 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c03f030 con 0x7f01a8103f80 2024-07-24T22:08:34.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.660+0000 7f01a4ff9640 1 -- 172.21.15.47:0/309934685 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f019c003aa0 con 0x7f01a8103f80 2024-07-24T22:08:34.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.660+0000 7f01adf0a640 1 -- 172.21.15.47:0/309934685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a81a72e0 con 0x7f01a8103f80 2024-07-24T22:08:34.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.660+0000 7f01a4ff9640 1 -- 172.21.15.47:0/309934685 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c035070 con 0x7f01a8103f80 2024-07-24T22:08:34.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.660+0000 7f01adf0a640 1 -- 172.21.15.47:0/309934685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a81a7810 con 0x7f01a8103f80 2024-07-24T22:08:34.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.663+0000 7f01a4ff9640 1 -- 172.21.15.47:0/309934685 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f019c042030 con 0x7f01a8103f80 2024-07-24T22:08:34.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.663+0000 7f01b02bb740 1 Processor -- start 2024-07-24T22:08:34.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.663+0000 7f01b02bb740 1 -- start start 2024-07-24T22:08:34.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.663+0000 7f01b02bb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 0x55726a222a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.663+0000 7f01b02bb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a222fa0 0x55726a22e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.663+0000 7f01b02bb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a22ef30 0x55726a231320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.663+0000 7f01b02bb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55726a199960 con 0x55726a222fa0 2024-07-24T22:08:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.663+0000 7f01b02bb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55726a188e60 con 0x55726a22ef30 2024-07-24T22:08:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.663+0000 7f01b02bb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55726a18cea0 con 0x55726a222680 2024-07-24T22:08:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.663+0000 7f01a77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a222fa0 0x55726a22e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.663+0000 7f01a77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a222fa0 0x55726a22e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41110/0 (socket says 172.21.15.47:41110) 2024-07-24T22:08:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.663+0000 7f01a77fe640 1 -- 172.21.15.47:0/651286594 learned_addr learned my addr 172.21.15.47:0/651286594 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.664+0000 7f01a7fff640 1 --2- 172.21.15.47:0/651286594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 0x55726a222a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.664+0000 7f01a4ff9640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f01900b3dc0 0x7f01900b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.664+0000 7f01a77fe640 1 -- 172.21.15.47:0/651286594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 msgr2=0x55726a222a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.664+0000 7f01a77fe640 1 --2- 172.21.15.47:0/651286594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 0x55726a222a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.664+0000 7f01a77fe640 1 -- 172.21.15.47:0/651286594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a22ef30 msgr2=0x55726a231320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.664+0000 7f01a77fe640 1 --2- 172.21.15.47:0/651286594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a22ef30 0x55726a231320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.664+0000 7f01a77fe640 1 -- 172.21.15.47:0/651286594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726a1122d0 con 0x55726a222fa0 2024-07-24T22:08:34.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.664+0000 7f01a7fff640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f01900b3dc0 0x7f01900b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.664+0000 7f01a4ff9640 1 -- 172.21.15.47:0/309934685 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f019c1044e0 con 0x7f01a8103f80 2024-07-24T22:08:34.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.664+0000 7f01a77fe640 1 --2- 172.21.15.47:0/651286594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a222fa0 0x55726a22e9f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f019800bd10 tx=0x7f01980107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b33562aa1f04d94 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:34.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.664+0000 7f018dffb640 1 -- 172.21.15.47:0/651286594 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198004030 con 0x55726a222fa0 2024-07-24T22:08:34.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.664+0000 7f018dffb640 1 -- 172.21.15.47:0/651286594 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01980035f0 con 0x55726a222fa0 2024-07-24T22:08:34.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.664+0000 7f018dffb640 1 -- 172.21.15.47:0/651286594 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198011770 con 0x55726a222fa0 2024-07-24T22:08:34.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.665+0000 7f01b02bb740 1 -- 172.21.15.47:0/651286594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a222fa0 msgr2=0x55726a22e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:34.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.665+0000 7f01b02bb740 1 --2- 172.21.15.47:0/651286594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a222fa0 0x55726a22e9f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f019800bd10 tx=0x7f01980107a0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.665+0000 7f01a7fff640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f01900b3dc0 0x7f01900b6280 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f01a81033d0 tx=0x7f01a0004a40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.665+0000 7f01b02bb740 1 -- 172.21.15.47:0/651286594 shutdown_connections 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.665+0000 7f01b02bb740 1 --2- 172.21.15.47:0/651286594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a22ef30 0x55726a231320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.665+0000 7f01b02bb740 1 --2- 172.21.15.47:0/651286594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a222fa0 0x55726a22e9f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.665+0000 7f01b02bb740 1 --2- 172.21.15.47:0/651286594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 0x55726a222a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.665+0000 7f01b02bb740 1 -- 172.21.15.47:0/651286594 >> 172.21.15.47:0/651286594 conn(0x55726a2204b0 msgr2=0x55726a221650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.665+0000 7f01b02bb740 1 -- 172.21.15.47:0/651286594 shutdown_connections 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.665+0000 7f01b02bb740 1 -- 172.21.15.47:0/651286594 wait complete. 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.665+0000 7f01b02bb740 1 -- start start 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.666+0000 7f01b02bb740 1 Processor -- start 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.666+0000 7f01b02bb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222680 0x55726a22bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.666+0000 7f01b02bb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222fa0 0x55726a22c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.666+0000 7f01b02bb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a22c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.666+0000 7f01b02bb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557269fec700 con 0x55726a22ef30 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.666+0000 7f01b02bb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55726a12b5a0 con 0x55726a222680 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.666+0000 7f01b02bb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55726a231bb0 con 0x55726a222fa0 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.666+0000 7f01b02bb740 10 client.0 _ll_register_callbacks cb 0x55726a14b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.666+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a22c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.666+0000 7f01a77fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222680 0x55726a22bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.666+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a22c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41114/0 (socket says 172.21.15.47:41114) 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.666+0000 7f01a7fff640 1 -- 172.21.15.47:0/4128857684 learned_addr learned my addr 172.21.15.47:0/4128857684 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.666+0000 7f01a6ffd640 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222fa0 0x55726a22c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f01a7fff640 1 -- 172.21.15.47:0/4128857684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222fa0 msgr2=0x55726a22c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f01a7fff640 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222fa0 0x55726a22c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f01a7fff640 1 -- 172.21.15.47:0/4128857684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222680 msgr2=0x55726a22bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f01a7fff640 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222680 0x55726a22bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f01a7fff640 1 -- 172.21.15.47:0/4128857684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55726a11e630 con 0x55726a22ef30 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f01a77fe640 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222680 0x55726a22bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:08:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f01a6ffd640 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222fa0 0x55726a22c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f01a7fff640 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a22c950 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f01a0005c20 tx=0x7f01a00074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc34d1456e5ddcd5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f0186ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f0186ffd640 1 -- 172.21.15.47:0/4128857684 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a001dd50 con 0x55726a22ef30 2024-07-24T22:08:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f0186ffd640 1 -- 172.21.15.47:0/4128857684 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f01a001b450 con 0x55726a22ef30 2024-07-24T22:08:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f01b02bb740 1 -- 172.21.15.47:0/4128857684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01980035f0 con 0x55726a22ef30 2024-07-24T22:08:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f0186ffd640 1 -- 172.21.15.47:0/4128857684 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f01a001b650 con 0x55726a22ef30 2024-07-24T22:08:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f01b02bb740 10 client.15792 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f01b02bb740 1 -- 172.21.15.47:0/4128857684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557269ee9650 con 0x55726a22ef30 2024-07-24T22:08:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.667+0000 7f0186ffd640 1 -- 172.21.15.47:0/4128857684 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01980035f0 con 0x55726a22ef30 2024-07-24T22:08:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.668+0000 7f0186ffd640 1 -- 172.21.15.47:0/4128857684 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f01a0024070 con 0x55726a22ef30 2024-07-24T22:08:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.668+0000 7f01b02bb740 10 client.15792 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.668+0000 7f01b02bb740 10 client.15792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.668+0000 7f01b02bb740 20 client.15792 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:34.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.668+0000 7f01b02bb740 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55726a23eb30 0x55726a240f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.668+0000 7f01b02bb740 4 client.15792 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:34.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.668+0000 7f01b02bb740 1 -- 172.21.15.47:0/4128857684 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55726a19b8b0 con 0x55726a23eb30 2024-07-24T22:08:34.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.668+0000 7f01a77fe640 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55726a23eb30 0x55726a240f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.669+0000 7f01a77fe640 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55726a23eb30 0x55726a240f60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc83c2466a830a70 server_cookie=ac98c9fa13880e7f in_seq=0 out_seq=0 2024-07-24T22:08:34.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.669+0000 7f0186ffd640 10 client.15792 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.669+0000 7f0186ffd640 1 -- 172.21.15.47:0/4128857684 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55726a19b8b0 con 0x55726a23eb30 2024-07-24T22:08:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.669+0000 7f0186ffd640 10 client.15792 handle_command_reply: tid=0 2024-07-24T22:08:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.669+0000 7f01b02bb740 1 client.15792 shutdown 2024-07-24T22:08:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.670+0000 7f01b02bb740 1 -- 172.21.15.47:0/4128857684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 msgr2=0x55726a22c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.670+0000 7f01b02bb740 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a22c950 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f01a0005c20 tx=0x7f01a00074f0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.670+0000 7f01b02bb740 1 -- 172.21.15.47:0/4128857684 shutdown_connections 2024-07-24T22:08:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.670+0000 7f01b02bb740 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55726a23eb30 0x55726a240f60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.670+0000 7f01b02bb740 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a22c950 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.670+0000 7f01b02bb740 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222fa0 0x55726a22c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.670+0000 7f01b02bb740 1 --2- 172.21.15.47:0/4128857684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222680 0x55726a22bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.670+0000 7f01b02bb740 1 -- 172.21.15.47:0/4128857684 >> 172.21.15.47:0/4128857684 conn(0x55726a2204b0 msgr2=0x55726a226050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:34.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.670+0000 7f0186ffd640 0 client.15792 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:34.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.670+0000 7f01b02bb740 1 -- 172.21.15.47:0/4128857684 shutdown_connections 2024-07-24T22:08:34.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.670+0000 7f01b02bb740 1 -- 172.21.15.47:0/4128857684 wait complete. 2024-07-24T22:08:34.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.670+0000 7f01b02bb740 20 client.15792 trim_cache size 0 max 16384 2024-07-24T22:08:34.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.688+0000 7f01b02bb740 1 Processor -- start 2024-07-24T22:08:34.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.688+0000 7f01b02bb740 1 -- start start 2024-07-24T22:08:34.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01b02bb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 0x55726a22dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01b02bb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222fa0 0x55726a2267d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01b02bb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a246830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01b02bb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81ae340 con 0x55726a22ef30 2024-07-24T22:08:34.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01b02bb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81b0bc0 con 0x55726a222fa0 2024-07-24T22:08:34.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01b02bb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81ae9b0 con 0x55726a222680 2024-07-24T22:08:34.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a246830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a246830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41128/0 (socket says 172.21.15.47:41128) 2024-07-24T22:08:34.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01a7fff640 1 -- 172.21.15.47:0/1275256112 learned_addr learned my addr 172.21.15.47:0/1275256112 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:34.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01a77fe640 1 --2- 172.21.15.47:0/1275256112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 0x55726a22dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01a6ffd640 1 --2- 172.21.15.47:0/1275256112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222fa0 0x55726a2267d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01a7fff640 1 -- 172.21.15.47:0/1275256112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 msgr2=0x55726a22dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:34.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01a7fff640 1 --2- 172.21.15.47:0/1275256112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 0x55726a22dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01a7fff640 1 -- 172.21.15.47:0/1275256112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222fa0 msgr2=0x55726a2267d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:34.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01a7fff640 1 --2- 172.21.15.47:0/1275256112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222fa0 0x55726a2267d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01a7fff640 1 -- 172.21.15.47:0/1275256112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726a2412d0 con 0x55726a22ef30 2024-07-24T22:08:34.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01a77fe640 1 --2- 172.21.15.47:0/1275256112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 0x55726a22dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:34.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f01a7fff640 1 --2- 172.21.15.47:0/1275256112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a246830 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f01a0011010 tx=0x7f01a0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6aba5b68381865 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:34.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f018d7fa640 1 -- 172.21.15.47:0/1275256112 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a001d0c0 con 0x55726a22ef30 2024-07-24T22:08:34.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f018d7fa640 1 -- 172.21.15.47:0/1275256112 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01a0026440 con 0x55726a22ef30 2024-07-24T22:08:34.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.689+0000 7f018d7fa640 1 -- 172.21.15.47:0/1275256112 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a001b7f0 con 0x55726a22ef30 2024-07-24T22:08:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.690+0000 7f01b02bb740 1 -- 172.21.15.47:0/1275256112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 msgr2=0x55726a246830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.690+0000 7f01b02bb740 1 --2- 172.21.15.47:0/1275256112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a246830 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f01a0011010 tx=0x7f01a0007f60 comp rx=0 tx=0).stop 2024-07-24T22:08:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.690+0000 7f01b02bb740 1 -- 172.21.15.47:0/1275256112 shutdown_connections 2024-07-24T22:08:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.690+0000 7f01b02bb740 1 --2- 172.21.15.47:0/1275256112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a246830 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.690+0000 7f01b02bb740 1 --2- 172.21.15.47:0/1275256112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222fa0 0x55726a2267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.690+0000 7f01b02bb740 1 --2- 172.21.15.47:0/1275256112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 0x55726a22dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.690+0000 7f01b02bb740 1 -- 172.21.15.47:0/1275256112 >> 172.21.15.47:0/1275256112 conn(0x55726a2204b0 msgr2=0x55726a22c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.690+0000 7f01b02bb740 1 -- 172.21.15.47:0/1275256112 shutdown_connections 2024-07-24T22:08:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.690+0000 7f01b02bb740 1 -- 172.21.15.47:0/1275256112 wait complete. 2024-07-24T22:08:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.690+0000 7f01b02bb740 1 -- start start 2024-07-24T22:08:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01b02bb740 1 Processor -- start 2024-07-24T22:08:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01b02bb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 0x55726a2326f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01b02bb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222fa0 0x55726a232c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01b02bb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a2a1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01b02bb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81af080 con 0x55726a22ef30 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01b02bb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81b04f0 con 0x55726a222fa0 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01b02bb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81af750 con 0x55726a222680 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01b02bb740 10 client.0 _ll_register_callbacks cb 0x7f01a0007b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a2a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a2a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41134/0 (socket says 172.21.15.47:41134) 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01a7fff640 1 -- 172.21.15.47:0/165972224 learned_addr learned my addr 172.21.15.47:0/165972224 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01a77fe640 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 0x55726a2326f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01a6ffd640 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222fa0 0x55726a232c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01a7fff640 1 -- 172.21.15.47:0/165972224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 msgr2=0x55726a2326f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01a7fff640 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 0x55726a2326f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01a7fff640 1 -- 172.21.15.47:0/165972224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222fa0 msgr2=0x55726a232c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01a7fff640 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222fa0 0x55726a232c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01a7fff640 1 -- 172.21.15.47:0/165972224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55726a22cd70 con 0x55726a22ef30 2024-07-24T22:08:34.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.691+0000 7f01a6ffd640 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222fa0 0x55726a232c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f01a7fff640 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a2a1830 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f01a0004cc0 tx=0x7f01a0007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a9b949e8e27e57 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f0186ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f0186ffd640 1 -- 172.21.15.47:0/165972224 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a0043060 con 0x55726a22ef30 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f01b02bb740 1 -- 172.21.15.47:0/165972224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01a0026440 con 0x55726a22ef30 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f0186ffd640 1 -- 172.21.15.47:0/165972224 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f01a001db50 con 0x55726a22ef30 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f0186ffd640 1 -- 172.21.15.47:0/165972224 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f01a001dd50 con 0x55726a22ef30 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f01b02bb740 10 client.15798 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f01b02bb740 1 -- 172.21.15.47:0/165972224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55726a2a9220 con 0x55726a22ef30 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f0186ffd640 1 -- 172.21.15.47:0/165972224 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01a0026440 con 0x55726a22ef30 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f0186ffd640 1 -- 172.21.15.47:0/165972224 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f01a0035070 con 0x55726a22ef30 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f01b02bb740 10 client.15798 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f01b02bb740 10 client.15798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f01b02bb740 20 client.15798 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:34.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.692+0000 7f01b02bb740 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55726a2a97d0 0x55726a2abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.693+0000 7f01b02bb740 4 client.15798 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.693+0000 7f01b02bb740 1 -- 172.21.15.47:0/165972224 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55726a197350 con 0x55726a2a97d0 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.693+0000 7f01a77fe640 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55726a2a97d0 0x55726a2abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.693+0000 7f01a77fe640 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55726a2a97d0 0x55726a2abbf0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec49e1639bb4d5c5 server_cookie=dc3623495bb8421e in_seq=0 out_seq=0 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.693+0000 7f0186ffd640 10 client.15798 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.693+0000 7f0186ffd640 1 -- 172.21.15.47:0/165972224 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55726a197350 con 0x55726a2a97d0 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.693+0000 7f0186ffd640 10 client.15798 handle_command_reply: tid=0 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.693+0000 7f01b02bb740 1 client.15798 shutdown 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01b02bb740 1 -- 172.21.15.47:0/165972224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 msgr2=0x55726a2a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01b02bb740 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a2a1830 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f01a0004cc0 tx=0x7f01a0007d20 comp rx=0 tx=0).stop 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01b02bb740 1 -- 172.21.15.47:0/165972224 shutdown_connections 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01b02bb740 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55726a2a97d0 0x55726a2abbf0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01b02bb740 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55726a22ef30 0x55726a2a1830 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01b02bb740 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55726a222fa0 0x55726a232c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f0186ffd640 0 client.15798 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01b02bb740 1 --2- 172.21.15.47:0/165972224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55726a222680 0x55726a2326f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01b02bb740 1 -- 172.21.15.47:0/165972224 >> 172.21.15.47:0/165972224 conn(0x55726a2204b0 msgr2=0x55726a21ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01b02bb740 1 -- 172.21.15.47:0/165972224 shutdown_connections 2024-07-24T22:08:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01b02bb740 1 -- 172.21.15.47:0/165972224 wait complete. 2024-07-24T22:08:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01b02bb740 20 client.15798 trim_cache size 0 max 16384 2024-07-24T22:08:34.702 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:08:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:08:34.702 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:08:34.702 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:08:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01adf0a640 1 -- 172.21.15.47:0/309934685 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f01900b3dc0 msgr2=0x7f01900b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01adf0a640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f01900b3dc0 0x7f01900b6280 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f01a81033d0 tx=0x7f01a0004a40 comp rx=0 tx=0).stop 2024-07-24T22:08:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01adf0a640 1 -- 172.21.15.47:0/309934685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a8103f80 msgr2=0x7f01a8101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.694+0000 7f01adf0a640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a8103f80 0x7f01a8101850 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f019c006010 tx=0x7f019c004060 comp rx=0 tx=0).stop 2024-07-24T22:08:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.695+0000 7f01adf0a640 1 -- 172.21.15.47:0/309934685 shutdown_connections 2024-07-24T22:08:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.695+0000 7f01adf0a640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f01900b3dc0 0x7f01900b6280 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.695+0000 7f01adf0a640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01a810cac0 0x7f01a8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.695+0000 7f01adf0a640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a8103f80 0x7f01a8101850 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.695+0000 7f01adf0a640 1 --2- 172.21.15.47:0/309934685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8103660 0x7f01a8101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:34.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.695+0000 7f01adf0a640 1 -- 172.21.15.47:0/309934685 >> 172.21.15.47:0/309934685 conn(0x7f01a80fd0c0 msgr2=0x7f01a810ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:34.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.695+0000 7f01adf0a640 1 -- 172.21.15.47:0/309934685 shutdown_connections 2024-07-24T22:08:34.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:34.695+0000 7f01adf0a640 1 -- 172.21.15.47:0/309934685 wait complete. 2024-07-24T22:08:35.500 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:08:35.501 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:08:35.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:35 smithi047 ceph-mon[32551]: pgmap v407: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 341 B/s wr, 3 op/s 2024-07-24T22:08:35.768 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:35.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:35 smithi188 ceph-mon[37380]: pgmap v407: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 341 B/s wr, 3 op/s 2024-07-24T22:08:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:35 smithi183 ceph-mon[37007]: pgmap v407: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 341 B/s wr, 3 op/s 2024-07-24T22:08:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.415+0000 7f3b710fb640 1 -- 172.21.15.47:0/2013233626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b6c1036a0 msgr2=0x7f3b6c103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.415+0000 7f3b710fb640 1 --2- 172.21.15.47:0/2013233626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b6c1036a0 0x7f3b6c103a80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009900 tx=0x7f3b6402a3f0 comp rx=0 tx=0).stop 2024-07-24T22:08:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.415+0000 7f3b710fb640 1 -- 172.21.15.47:0/2013233626 shutdown_connections 2024-07-24T22:08:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.415+0000 7f3b710fb640 1 --2- 172.21.15.47:0/2013233626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b6c10cb00 0x7f3b6c10ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.415+0000 7f3b710fb640 1 --2- 172.21.15.47:0/2013233626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b6c103fc0 0x7f3b6c10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.415+0000 7f3b710fb640 1 --2- 172.21.15.47:0/2013233626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b6c1036a0 0x7f3b6c103a80 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.415+0000 7f3b710fb640 1 -- 172.21.15.47:0/2013233626 >> 172.21.15.47:0/2013233626 conn(0x7f3b6c0fd100 msgr2=0x7f3b6c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.415+0000 7f3b710fb640 1 -- 172.21.15.47:0/2013233626 shutdown_connections 2024-07-24T22:08:37.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.416+0000 7f3b710fb640 1 -- 172.21.15.47:0/2013233626 wait complete. 2024-07-24T22:08:37.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.417+0000 7f3b710fb640 1 Processor -- start 2024-07-24T22:08:37.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.417+0000 7f3b710fb640 1 -- start start 2024-07-24T22:08:37.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.417+0000 7f3b710fb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b6c1036a0 0x7f3b6c198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:37.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.417+0000 7f3b710fb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b6c103fc0 0x7f3b6c199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:37.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.417+0000 7f3b710fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b6c10cb00 0x7f3b6c19e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:37.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.417+0000 7f3b710fb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c112740 con 0x7f3b6c10cb00 2024-07-24T22:08:37.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.417+0000 7f3b710fb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c1125c0 con 0x7f3b6c1036a0 2024-07-24T22:08:37.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.417+0000 7f3b710fb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c1128c0 con 0x7f3b6c103fc0 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.417+0000 7f3b6b59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b6c10cb00 0x7f3b6c19e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.417+0000 7f3b6b59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b6c10cb00 0x7f3b6c19e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56740/0 (socket says 172.21.15.47:56740) 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.417+0000 7f3b6b59e640 1 -- 172.21.15.47:0/309526381 learned_addr learned my addr 172.21.15.47:0/309526381 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.417+0000 7f3b6ad9d640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b6c1036a0 0x7f3b6c198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.417+0000 7f3b6a59c640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b6c103fc0 0x7f3b6c199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.418+0000 7f3b6b59e640 1 -- 172.21.15.47:0/309526381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b6c103fc0 msgr2=0x7f3b6c199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.418+0000 7f3b6b59e640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b6c103fc0 0x7f3b6c199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.418+0000 7f3b6b59e640 1 -- 172.21.15.47:0/309526381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b6c1036a0 msgr2=0x7f3b6c198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.418+0000 7f3b6b59e640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b6c1036a0 0x7f3b6c198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.418+0000 7f3b6b59e640 1 -- 172.21.15.47:0/309526381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6c19ed00 con 0x7f3b6c10cb00 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.418+0000 7f3b6b59e640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b6c10cb00 0x7f3b6c19e530 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00eb10 tx=0x7f3b5c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.418+0000 7f3b53fff640 1 -- 172.21.15.47:0/309526381 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c004b20 con 0x7f3b6c10cb00 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.418+0000 7f3b53fff640 1 -- 172.21.15.47:0/309526381 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b5c004cc0 con 0x7f3b6c10cb00 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.418+0000 7f3b710fb640 1 -- 172.21.15.47:0/309526381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6c19eff0 con 0x7f3b6c10cb00 2024-07-24T22:08:37.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.418+0000 7f3b53fff640 1 -- 172.21.15.47:0/309526381 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c010670 con 0x7f3b6c10cb00 2024-07-24T22:08:37.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.418+0000 7f3b710fb640 1 -- 172.21.15.47:0/309526381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b6c1a56b0 con 0x7f3b6c10cb00 2024-07-24T22:08:37.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.419+0000 7f3b710fb640 1 -- 172.21.15.47:0/309526381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6c103a80 con 0x7f3b6c10cb00 2024-07-24T22:08:37.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.421+0000 7f3b53fff640 1 -- 172.21.15.47:0/309526381 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f3b5c005000 con 0x7f3b6c10cb00 2024-07-24T22:08:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.422+0000 7f3b53fff640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3b540b3dc0 0x7f3b540b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.422+0000 7f3b6ad9d640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3b540b3dc0 0x7f3b540b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.422+0000 7f3b53fff640 1 -- 172.21.15.47:0/309526381 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f3b5c0e4730 con 0x7f3b6c10cb00 2024-07-24T22:08:37.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.423+0000 7f3b6ad9d640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3b540b3dc0 0x7f3b540b6280 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3b64031440 tx=0x7f3b64005b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:37.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.425+0000 7f3b53fff640 1 -- 172.21.15.47:0/309526381 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f3b5c0555e0 con 0x7f3b6c10cb00 2024-07-24T22:08:37.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.662+0000 7f3b710fb640 1 -- 172.21.15.47:0/309526381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b6c1a5a30 con 0x7f3b6c10cb00 2024-07-24T22:08:37.665 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:37 smithi047 ceph-mon[32551]: pgmap v408: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 341 B/s wr, 3 op/s 2024-07-24T22:08:37.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.663+0000 7f3b53fff640 1 -- 172.21.15.47:0/309526381 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f3b5c0ab9e0 con 0x7f3b6c10cb00 2024-07-24T22:08:37.665 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:08:37.666 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:08:37.666 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:08:37.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.665+0000 7f3b710fb640 1 -- 172.21.15.47:0/309526381 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3b540b3dc0 msgr2=0x7f3b540b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.665+0000 7f3b710fb640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3b540b3dc0 0x7f3b540b6280 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3b64031440 tx=0x7f3b64005b50 comp rx=0 tx=0).stop 2024-07-24T22:08:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.665+0000 7f3b710fb640 1 -- 172.21.15.47:0/309526381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b6c10cb00 msgr2=0x7f3b6c19e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.665+0000 7f3b710fb640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b6c10cb00 0x7f3b6c19e530 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00eb10 tx=0x7f3b5c00c2d0 comp rx=0 tx=0).stop 2024-07-24T22:08:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.665+0000 7f3b710fb640 1 -- 172.21.15.47:0/309526381 shutdown_connections 2024-07-24T22:08:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.665+0000 7f3b710fb640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3b540b3dc0 0x7f3b540b6280 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.665+0000 7f3b710fb640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b6c10cb00 0x7f3b6c19e530 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.665+0000 7f3b710fb640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b6c103fc0 0x7f3b6c199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.665+0000 7f3b710fb640 1 --2- 172.21.15.47:0/309526381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b6c1036a0 0x7f3b6c198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.665+0000 7f3b710fb640 1 -- 172.21.15.47:0/309526381 >> 172.21.15.47:0/309526381 conn(0x7f3b6c0fd100 msgr2=0x7f3b6c10ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.665+0000 7f3b710fb640 1 -- 172.21.15.47:0/309526381 shutdown_connections 2024-07-24T22:08:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:37.665+0000 7f3b710fb640 1 -- 172.21.15.47:0/309526381 wait complete. 2024-07-24T22:08:37.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:37 smithi188 ceph-mon[37380]: pgmap v408: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 341 B/s wr, 3 op/s 2024-07-24T22:08:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:37 smithi183 ceph-mon[37007]: pgmap v408: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 341 B/s wr, 3 op/s 2024-07-24T22:08:38.408 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:08:38.680 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:38.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:38 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/309526381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:38.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:38 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/309526381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:38.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:38 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/309526381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:39.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:39 smithi188 ceph-mon[37380]: pgmap v409: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-07-24T22:08:39.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:39 smithi047 ceph-mon[32551]: pgmap v409: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-07-24T22:08:39.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:39 smithi183 ceph-mon[37007]: pgmap v409: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-07-24T22:08:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.366+0000 7f776d4c9640 1 -- 172.21.15.47:0/2710691799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768107a00 msgr2=0x7f776810e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.366+0000 7f776d4c9640 1 --2- 172.21.15.47:0/2710691799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768107a00 0x7f776810e200 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7760009900 tx=0x7f776002a410 comp rx=0 tx=0).stop 2024-07-24T22:08:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.366+0000 7f776d4c9640 1 -- 172.21.15.47:0/2710691799 shutdown_connections 2024-07-24T22:08:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.366+0000 7f776d4c9640 1 --2- 172.21.15.47:0/2710691799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768107a00 0x7f776810e200 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.366+0000 7f776d4c9640 1 --2- 172.21.15.47:0/2710691799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7768107080 0x7f77681074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.366+0000 7f776d4c9640 1 --2- 172.21.15.47:0/2710691799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7768101670 0x7f7768101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.366+0000 7f776d4c9640 1 -- 172.21.15.47:0/2710691799 >> 172.21.15.47:0/2710691799 conn(0x7f77680fd0e0 msgr2=0x7f77680ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.366+0000 7f776d4c9640 1 -- 172.21.15.47:0/2710691799 shutdown_connections 2024-07-24T22:08:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.366+0000 7f776d4c9640 1 -- 172.21.15.47:0/2710691799 wait complete. 2024-07-24T22:08:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.366+0000 7f776d4c9640 1 Processor -- start 2024-07-24T22:08:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f776d4c9640 1 -- start start 2024-07-24T22:08:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f776d4c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768101670 0x7f7768197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f776d4c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7768107080 0x7f7768198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f776d4c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7768107a00 0x7f776819d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f776d4c9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7768111630 con 0x7f7768101670 2024-07-24T22:08:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f776d4c9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f77681114b0 con 0x7f7768107080 2024-07-24T22:08:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f776d4c9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f77681117b0 con 0x7f7768107a00 2024-07-24T22:08:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f7766ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768101670 0x7f7768197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f7766ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768101670 0x7f7768197ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56764/0 (socket says 172.21.15.47:56764) 2024-07-24T22:08:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f7766ffd640 1 -- 172.21.15.47:0/4054477649 learned_addr learned my addr 172.21.15.47:0/4054477649 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f77667fc640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7768107080 0x7f7768198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f77677fe640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7768107a00 0x7f776819d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f7766ffd640 1 -- 172.21.15.47:0/4054477649 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7768107a00 msgr2=0x7f776819d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f7766ffd640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7768107a00 0x7f776819d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f7766ffd640 1 -- 172.21.15.47:0/4054477649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7768107080 msgr2=0x7f7768198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f7766ffd640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7768107080 0x7f7768198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f7766ffd640 1 -- 172.21.15.47:0/4054477649 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776819db70 con 0x7f7768101670 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.367+0000 7f77677fe640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7768107a00 0x7f776819d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.368+0000 7f7766ffd640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768101670 0x7f7768197ac0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f775800eab0 tx=0x7f775800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.368+0000 7f774ffff640 1 -- 172.21.15.47:0/4054477649 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775800ce40 con 0x7f7768101670 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.368+0000 7f774ffff640 1 -- 172.21.15.47:0/4054477649 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7758011920 con 0x7f7768101670 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.368+0000 7f776d4c9640 1 -- 172.21.15.47:0/4054477649 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776819de60 con 0x7f7768101670 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.368+0000 7f774ffff640 1 -- 172.21.15.47:0/4054477649 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758010a30 con 0x7f7768101670 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.368+0000 7f776d4c9640 1 -- 172.21.15.47:0/4054477649 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77681a46f0 con 0x7f7768101670 2024-07-24T22:08:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.370+0000 7f776f87a740 1 Processor -- start 2024-07-24T22:08:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.370+0000 7f774ffff640 1 -- 172.21.15.47:0/4054477649 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f7758010bd0 con 0x7f7768101670 2024-07-24T22:08:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.370+0000 7f776f87a740 1 -- start start 2024-07-24T22:08:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f776f87a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5e6d0 0x556765e5eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f776f87a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5eff0 0x556765e6aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f776f87a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 0x556765e6d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f776f87a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556765dd59b0 con 0x556765e6af80 2024-07-24T22:08:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f776f87a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556765dc4eb0 con 0x556765e5e6d0 2024-07-24T22:08:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f776f87a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556765dc8ef0 con 0x556765e5eff0 2024-07-24T22:08:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f77667fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 0x556765e6d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f77667fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 0x556765e6d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56780/0 (socket says 172.21.15.47:56780) 2024-07-24T22:08:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f77667fc640 1 -- 172.21.15.47:0/1733709654 learned_addr learned my addr 172.21.15.47:0/1733709654 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f7766ffd640 1 --2- 172.21.15.47:0/1733709654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5eff0 0x556765e6aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f77677fe640 1 --2- 172.21.15.47:0/1733709654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5e6d0 0x556765e5eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f77667fc640 1 -- 172.21.15.47:0/1733709654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5eff0 msgr2=0x556765e6aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:40.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f77667fc640 1 --2- 172.21.15.47:0/1733709654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5eff0 0x556765e6aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f77667fc640 1 -- 172.21.15.47:0/1733709654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5e6d0 msgr2=0x556765e5eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:40.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f77667fc640 1 --2- 172.21.15.47:0/1733709654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5e6d0 0x556765e5eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f77667fc640 1 -- 172.21.15.47:0/1733709654 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556765d4e320 con 0x556765e6af80 2024-07-24T22:08:40.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f77677fe640 1 --2- 172.21.15.47:0/1733709654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5e6d0 0x556765e5eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:40.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f774ffff640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77500b3dc0 0x7f77500b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.371+0000 7f77667fc640 1 --2- 172.21.15.47:0/1733709654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 0x556765e6d370 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f775c00bcb0 tx=0x7f775c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393bc50da11dde0e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:40.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.372+0000 7f77677fe640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77500b3dc0 0x7f77500b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.372+0000 7f774ffff640 1 -- 172.21.15.47:0/4054477649 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f77580e45f0 con 0x7f7768101670 2024-07-24T22:08:40.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.372+0000 7f774d7fa640 1 -- 172.21.15.47:0/1733709654 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c004030 con 0x556765e6af80 2024-07-24T22:08:40.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.372+0000 7f774d7fa640 1 -- 172.21.15.47:0/1733709654 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f775c0041d0 con 0x556765e6af80 2024-07-24T22:08:40.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.372+0000 7f774d7fa640 1 -- 172.21.15.47:0/1733709654 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c0117b0 con 0x556765e6af80 2024-07-24T22:08:40.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.372+0000 7f776f87a740 1 -- 172.21.15.47:0/1733709654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 msgr2=0x556765e6d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:40.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.372+0000 7f77677fe640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77500b3dc0 0x7f77500b6280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7760005ab0 tx=0x7f7760005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:40.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.372+0000 7f776f87a740 1 --2- 172.21.15.47:0/1733709654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 0x556765e6d370 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f775c00bcb0 tx=0x7f775c0107a0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 -- 172.21.15.47:0/1733709654 shutdown_connections 2024-07-24T22:08:40.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 --2- 172.21.15.47:0/1733709654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 0x556765e6d370 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 --2- 172.21.15.47:0/1733709654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5eff0 0x556765e6aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 --2- 172.21.15.47:0/1733709654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5e6d0 0x556765e5eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 -- 172.21.15.47:0/1733709654 >> 172.21.15.47:0/1733709654 conn(0x556765e5c500 msgr2=0x556765e5d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:40.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 -- 172.21.15.47:0/1733709654 shutdown_connections 2024-07-24T22:08:40.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 -- 172.21.15.47:0/1733709654 wait complete. 2024-07-24T22:08:40.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 -- start start 2024-07-24T22:08:40.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 Processor -- start 2024-07-24T22:08:40.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5e6d0 0x556765e67f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5eff0 0x556765e684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e6af80 0x556765e68a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556765c28700 con 0x556765e5e6d0 2024-07-24T22:08:40.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556765d675f0 con 0x556765e5eff0 2024-07-24T22:08:40.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556765e6fdb0 con 0x556765e6af80 2024-07-24T22:08:40.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f776f87a740 10 client.0 _ll_register_callbacks cb 0x556765d87960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:40.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.373+0000 7f7766ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5e6d0 0x556765e67f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f7766ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5e6d0 0x556765e67f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56786/0 (socket says 172.21.15.47:56786) 2024-07-24T22:08:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f7766ffd640 1 -- 172.21.15.47:0/2940398499 learned_addr learned my addr 172.21.15.47:0/2940398499 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f77677fe640 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e6af80 0x556765e68a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f77667fc640 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5eff0 0x556765e684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f7766ffd640 1 -- 172.21.15.47:0/2940398499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e6af80 msgr2=0x556765e68a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f7766ffd640 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e6af80 0x556765e68a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f7766ffd640 1 -- 172.21.15.47:0/2940398499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5eff0 msgr2=0x556765e684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f7766ffd640 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5eff0 0x556765e684c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f7766ffd640 1 -- 172.21.15.47:0/2940398499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556765d5a680 con 0x556765e5e6d0 2024-07-24T22:08:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f77677fe640 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e6af80 0x556765e68a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f77667fc640 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5eff0 0x556765e684c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f7766ffd640 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5e6d0 0x556765e67f80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f77580e1da0 tx=0x7f7758011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92d494dd39d37bf server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f774aff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f774aff5640 1 -- 172.21.15.47:0/2940398499 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580aa970 con 0x556765e5e6d0 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f774aff5640 1 -- 172.21.15.47:0/2940398499 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f77580b3e20 con 0x556765e5e6d0 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f776f87a740 1 -- 172.21.15.47:0/2940398499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f775c0041d0 con 0x556765e5e6d0 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f774aff5640 1 -- 172.21.15.47:0/2940398499 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f77580aad10 con 0x556765e5e6d0 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f776f87a740 10 client.15816 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.374+0000 7f776f87a740 1 -- 172.21.15.47:0/2940398499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556765b25650 con 0x556765e5e6d0 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.375+0000 7f774aff5640 1 -- 172.21.15.47:0/2940398499 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f775c0041d0 con 0x556765e5e6d0 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.375+0000 7f774aff5640 1 -- 172.21.15.47:0/2940398499 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f775800f040 con 0x556765e5e6d0 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.375+0000 7f776f87a740 10 client.15816 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.375+0000 7f776f87a740 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.375+0000 7f776f87a740 20 client.15816 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.375+0000 7f776f87a740 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556765e7cc00 0x556765e7f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.375+0000 7f776f87a740 4 client.15816 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.375+0000 7f776f87a740 1 -- 172.21.15.47:0/2940398499 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556765dd7900 con 0x556765e7cc00 2024-07-24T22:08:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.375+0000 7f77667fc640 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556765e7cc00 0x556765e7f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f77667fc640 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556765e7cc00 0x556765e7f030 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9508123ab5abda78 server_cookie=9d1ec4c62998e197 in_seq=0 out_seq=0 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f774aff5640 10 client.15816 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f774aff5640 1 -- 172.21.15.47:0/2940398499 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556765dd7900 con 0x556765e7cc00 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f774aff5640 10 client.15816 handle_command_reply: tid=0 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f776f87a740 1 client.15816 shutdown 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f776f87a740 1 -- 172.21.15.47:0/2940398499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5e6d0 msgr2=0x556765e67f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f776f87a740 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5e6d0 0x556765e67f80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f77580e1da0 tx=0x7f7758011d00 comp rx=0 tx=0).stop 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f776f87a740 1 -- 172.21.15.47:0/2940398499 shutdown_connections 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f776f87a740 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556765e7cc00 0x556765e7f030 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f776f87a740 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e6af80 0x556765e68a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f774aff5640 0 client.15816 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f776f87a740 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5eff0 0x556765e684c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f776f87a740 1 --2- 172.21.15.47:0/2940398499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5e6d0 0x556765e67f80 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.376+0000 7f776f87a740 1 -- 172.21.15.47:0/2940398499 >> 172.21.15.47:0/2940398499 conn(0x556765e5c500 msgr2=0x556765e620a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:40.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.377+0000 7f776f87a740 1 -- 172.21.15.47:0/2940398499 shutdown_connections 2024-07-24T22:08:40.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.377+0000 7f776f87a740 1 -- 172.21.15.47:0/2940398499 wait complete. 2024-07-24T22:08:40.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.377+0000 7f776f87a740 20 client.15816 trim_cache size 0 max 16384 2024-07-24T22:08:40.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.390+0000 7f776f87a740 1 Processor -- start 2024-07-24T22:08:40.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f776f87a740 1 -- start start 2024-07-24T22:08:40.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f776f87a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5e6d0 0x556765e848b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f776f87a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5eff0 0x556765e84df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f776f87a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e6af80 0x556765e65190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f776f87a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77681a9ec0 con 0x556765e5eff0 2024-07-24T22:08:40.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f776f87a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f77681ac740 con 0x556765e6af80 2024-07-24T22:08:40.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f776f87a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f77681aa530 con 0x556765e5e6d0 2024-07-24T22:08:40.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f77667fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5eff0 0x556765e84df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f77667fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5eff0 0x556765e84df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56802/0 (socket says 172.21.15.47:56802) 2024-07-24T22:08:40.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f77667fc640 1 -- 172.21.15.47:0/1899679612 learned_addr learned my addr 172.21.15.47:0/1899679612 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:40.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f7766ffd640 1 --2- 172.21.15.47:0/1899679612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5e6d0 0x556765e848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f77667fc640 1 -- 172.21.15.47:0/1899679612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5e6d0 msgr2=0x556765e848b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:40.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f77667fc640 1 --2- 172.21.15.47:0/1899679612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5e6d0 0x556765e848b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f77667fc640 1 -- 172.21.15.47:0/1899679612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e6af80 msgr2=0x556765e65190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:40.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f77667fc640 1 --2- 172.21.15.47:0/1899679612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e6af80 0x556765e65190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f77667fc640 1 -- 172.21.15.47:0/1899679612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556765e57e90 con 0x556765e5eff0 2024-07-24T22:08:40.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.391+0000 7f77667fc640 1 --2- 172.21.15.47:0/1899679612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5eff0 0x556765e84df0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f775c00bcb0 tx=0x7f775c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f038e7dc91eec6 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:40.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.392+0000 7f774cff9640 1 -- 172.21.15.47:0/1899679612 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c005040 con 0x556765e5eff0 2024-07-24T22:08:40.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.392+0000 7f774cff9640 1 -- 172.21.15.47:0/1899679612 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f775c0035f0 con 0x556765e5eff0 2024-07-24T22:08:40.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.392+0000 7f774cff9640 1 -- 172.21.15.47:0/1899679612 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c0116a0 con 0x556765e5eff0 2024-07-24T22:08:40.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.392+0000 7f776f87a740 1 -- 172.21.15.47:0/1899679612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5eff0 msgr2=0x556765e84df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:40.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.392+0000 7f776f87a740 1 --2- 172.21.15.47:0/1899679612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5eff0 0x556765e84df0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f775c00bcb0 tx=0x7f775c00b7b0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.392+0000 7f776f87a740 1 -- 172.21.15.47:0/1899679612 shutdown_connections 2024-07-24T22:08:40.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.392+0000 7f776f87a740 1 --2- 172.21.15.47:0/1899679612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e6af80 0x556765e65190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.392+0000 7f776f87a740 1 --2- 172.21.15.47:0/1899679612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e5eff0 0x556765e84df0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.392+0000 7f776f87a740 1 --2- 172.21.15.47:0/1899679612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5e6d0 0x556765e848b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.392+0000 7f776f87a740 1 -- 172.21.15.47:0/1899679612 >> 172.21.15.47:0/1899679612 conn(0x556765e5c500 msgr2=0x556765e69dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:40.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.392+0000 7f776f87a740 1 -- 172.21.15.47:0/1899679612 shutdown_connections 2024-07-24T22:08:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.392+0000 7f776f87a740 1 -- 172.21.15.47:0/1899679612 wait complete. 2024-07-24T22:08:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.393+0000 7f776f87a740 1 -- start start 2024-07-24T22:08:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.393+0000 7f776f87a740 1 Processor -- start 2024-07-24T22:08:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.393+0000 7f776f87a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5e6d0 0x556765ee3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.393+0000 7f776f87a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5eff0 0x556765e74ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.393+0000 7f776f87a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 0x556765e75530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.393+0000 7f776f87a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77681aac00 con 0x556765e6af80 2024-07-24T22:08:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.393+0000 7f776f87a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f77681ac070 con 0x556765e5e6d0 2024-07-24T22:08:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.393+0000 7f776f87a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f77681ab2d0 con 0x556765e5eff0 2024-07-24T22:08:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.393+0000 7f776f87a740 10 client.0 _ll_register_callbacks cb 0x7f77580103d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.393+0000 7f77677fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 0x556765e75530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.393+0000 7f77677fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 0x556765e75530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56806/0 (socket says 172.21.15.47:56806) 2024-07-24T22:08:40.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.393+0000 7f77677fe640 1 -- 172.21.15.47:0/1153178085 learned_addr learned my addr 172.21.15.47:0/1153178085 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.393+0000 7f7766ffd640 1 --2- 172.21.15.47:0/1153178085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5e6d0 0x556765ee3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f77667fc640 1 --2- 172.21.15.47:0/1153178085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5eff0 0x556765e74ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f77677fe640 1 -- 172.21.15.47:0/1153178085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5eff0 msgr2=0x556765e74ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f77677fe640 1 --2- 172.21.15.47:0/1153178085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5eff0 0x556765e74ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f77677fe640 1 -- 172.21.15.47:0/1153178085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5e6d0 msgr2=0x556765ee3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f77677fe640 1 --2- 172.21.15.47:0/1153178085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5e6d0 0x556765ee3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f77677fe640 1 -- 172.21.15.47:0/1153178085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556765e75b70 con 0x556765e6af80 2024-07-24T22:08:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f77677fe640 1 --2- 172.21.15.47:0/1153178085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 0x556765e75530 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7760009900 tx=0x7f776002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6005b4472ce81c43 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f774aff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f774aff5640 1 -- 172.21.15.47:0/1153178085 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7760035050 con 0x556765e6af80 2024-07-24T22:08:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f774aff5640 1 -- 172.21.15.47:0/1153178085 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f7760005450 con 0x556765e6af80 2024-07-24T22:08:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f776f87a740 1 -- 172.21.15.47:0/1153178085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f775c0035f0 con 0x556765e6af80 2024-07-24T22:08:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f774aff5640 1 -- 172.21.15.47:0/1153178085 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7760005650 con 0x556765e6af80 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f776f87a740 10 client.15822 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.394+0000 7f776f87a740 1 -- 172.21.15.47:0/1153178085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556765eee470 con 0x556765e6af80 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.395+0000 7f774aff5640 1 -- 172.21.15.47:0/1153178085 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f775c0035f0 con 0x556765e6af80 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.395+0000 7f774aff5640 1 -- 172.21.15.47:0/1153178085 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f77600037d0 con 0x556765e6af80 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.395+0000 7f776f87a740 10 client.15822 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.395+0000 7f776f87a740 10 client.15822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.395+0000 7f776f87a740 20 client.15822 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.395+0000 7f776f87a740 1 --2- 172.21.15.47:0/1153178085 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556765e7cc00 0x556765ef0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.395+0000 7f776f87a740 4 client.15822 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.395+0000 7f776f87a740 1 -- 172.21.15.47:0/1153178085 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556765e677e0 con 0x556765e7cc00 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.395+0000 7f7766ffd640 1 --2- 172.21.15.47:0/1153178085 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556765e7cc00 0x556765ef0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f7766ffd640 1 --2- 172.21.15.47:0/1153178085 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556765e7cc00 0x556765ef0c90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e18e587d0ab9d8 server_cookie=7e6b10f7d4a3999b in_seq=0 out_seq=0 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f774aff5640 10 client.15822 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f774aff5640 1 -- 172.21.15.47:0/1153178085 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556765e677e0 con 0x556765e7cc00 2024-07-24T22:08:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f774aff5640 10 client.15822 handle_command_reply: tid=0 2024-07-24T22:08:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f776f87a740 1 client.15822 shutdown 2024-07-24T22:08:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f776f87a740 1 -- 172.21.15.47:0/1153178085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 msgr2=0x556765e75530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f776f87a740 1 --2- 172.21.15.47:0/1153178085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 0x556765e75530 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7760009900 tx=0x7f776002a410 comp rx=0 tx=0).stop 2024-07-24T22:08:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f776f87a740 1 -- 172.21.15.47:0/1153178085 shutdown_connections 2024-07-24T22:08:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f776f87a740 1 --2- 172.21.15.47:0/1153178085 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556765e7cc00 0x556765ef0c90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f776f87a740 1 --2- 172.21.15.47:0/1153178085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556765e6af80 0x556765e75530 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f776f87a740 1 --2- 172.21.15.47:0/1153178085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556765e5eff0 0x556765e74ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f776f87a740 1 --2- 172.21.15.47:0/1153178085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556765e5e6d0 0x556765ee3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f776f87a740 1 -- 172.21.15.47:0/1153178085 >> 172.21.15.47:0/1153178085 conn(0x556765e5c500 msgr2=0x556765e67ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f774aff5640 0 client.15822 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f776f87a740 1 -- 172.21.15.47:0/1153178085 shutdown_connections 2024-07-24T22:08:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f776f87a740 1 -- 172.21.15.47:0/1153178085 wait complete. 2024-07-24T22:08:40.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.396+0000 7f776f87a740 20 client.15822 trim_cache size 0 max 16384 2024-07-24T22:08:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:08:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.397+0000 7f776d4c9640 1 -- 172.21.15.47:0/4054477649 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77500b3dc0 msgr2=0x7f77500b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.397+0000 7f776d4c9640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77500b3dc0 0x7f77500b6280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7760005ab0 tx=0x7f7760005a20 comp rx=0 tx=0).stop 2024-07-24T22:08:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.397+0000 7f776d4c9640 1 -- 172.21.15.47:0/4054477649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768101670 msgr2=0x7f7768197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.397+0000 7f776d4c9640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768101670 0x7f7768197ac0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f775800eab0 tx=0x7f775800ef70 comp rx=0 tx=0).stop 2024-07-24T22:08:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.397+0000 7f776d4c9640 1 -- 172.21.15.47:0/4054477649 shutdown_connections 2024-07-24T22:08:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.397+0000 7f776d4c9640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77500b3dc0 0x7f77500b6280 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.397+0000 7f776d4c9640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7768107a00 0x7f776819d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.397+0000 7f776d4c9640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7768107080 0x7f7768198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.397+0000 7f776d4c9640 1 --2- 172.21.15.47:0/4054477649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7768101670 0x7f7768197ac0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.397+0000 7f776d4c9640 1 -- 172.21.15.47:0/4054477649 >> 172.21.15.47:0/4054477649 conn(0x7f77680fd0e0 msgr2=0x7f77680ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.397+0000 7f776d4c9640 1 -- 172.21.15.47:0/4054477649 shutdown_connections 2024-07-24T22:08:40.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:40.397+0000 7f776d4c9640 1 -- 172.21.15.47:0/4054477649 wait complete. 2024-07-24T22:08:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.992+0000 7f1532841640 1 -- 172.21.15.47:0/2744003103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c10ca30 msgr2=0x7f152c10eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.992+0000 7f1532841640 1 --2- 172.21.15.47:0/2744003103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c10ca30 0x7f152c10eeb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1524009ca0 tx=0x7f152402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.992+0000 7f1532841640 1 -- 172.21.15.47:0/2744003103 shutdown_connections 2024-07-24T22:08:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.992+0000 7f1532841640 1 --2- 172.21.15.47:0/2744003103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c10ca30 0x7f152c10eeb0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.992+0000 7f1532841640 1 --2- 172.21.15.47:0/2744003103 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f152c103f00 0x7f152c10c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.992+0000 7f1532841640 1 --2- 172.21.15.47:0/2744003103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f152c1035e0 0x7f152c1039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.992+0000 7f1532841640 1 -- 172.21.15.47:0/2744003103 >> 172.21.15.47:0/2744003103 conn(0x7f152c0fd030 msgr2=0x7f152c0ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.992+0000 7f1532841640 1 -- 172.21.15.47:0/2744003103 shutdown_connections 2024-07-24T22:08:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.992+0000 7f1532841640 1 -- 172.21.15.47:0/2744003103 wait complete. 2024-07-24T22:08:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.993+0000 7f1532841640 1 Processor -- start 2024-07-24T22:08:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.993+0000 7f1532841640 1 -- start start 2024-07-24T22:08:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.993+0000 7f1532841640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f152c1035e0 0x7f152c101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.993+0000 7f1532841640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c103f00 0x7f152c1017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.993+0000 7f1532841640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f152c10ca30 0x7f152c101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.993+0000 7f1532841640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f152c1126a0 con 0x7f152c103f00 2024-07-24T22:08:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.993+0000 7f1532841640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f152c112520 con 0x7f152c10ca30 2024-07-24T22:08:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.993+0000 7f1532841640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f152c112820 con 0x7f152c1035e0 2024-07-24T22:08:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.993+0000 7f1523fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c103f00 0x7f152c1017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.993+0000 7f1523fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c103f00 0x7f152c1017c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56830/0 (socket says 172.21.15.47:56830) 2024-07-24T22:08:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.993+0000 7f1523fff640 1 -- 172.21.15.47:0/1030083440 learned_addr learned my addr 172.21.15.47:0/1030083440 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f152bfff640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f152c1035e0 0x7f152c101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f1530dde640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f152c10ca30 0x7f152c101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f1523fff640 1 -- 172.21.15.47:0/1030083440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f152c1035e0 msgr2=0x7f152c101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f1523fff640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f152c1035e0 0x7f152c101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f1523fff640 1 -- 172.21.15.47:0/1030083440 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f152c10ca30 msgr2=0x7f152c101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f1523fff640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f152c10ca30 0x7f152c101d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f1523fff640 1 -- 172.21.15.47:0/1030083440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152c1a6f30 con 0x7f152c103f00 2024-07-24T22:08:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f1530dde640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f152c10ca30 0x7f152c101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f1523fff640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c103f00 0x7f152c1017c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f151400c970 tx=0x7f151400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f1529ffb640 1 -- 172.21.15.47:0/1030083440 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514007bb0 con 0x7f152c103f00 2024-07-24T22:08:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f1529ffb640 1 -- 172.21.15.47:0/1030083440 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1514007d50 con 0x7f152c103f00 2024-07-24T22:08:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f1529ffb640 1 -- 172.21.15.47:0/1030083440 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151400f7b0 con 0x7f152c103f00 2024-07-24T22:08:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f1532841640 1 -- 172.21.15.47:0/1030083440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152c1a7220 con 0x7f152c103f00 2024-07-24T22:08:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.994+0000 7f1532841640 1 -- 172.21.15.47:0/1030083440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f152c1a7720 con 0x7f152c103f00 2024-07-24T22:08:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1535596740 1 Processor -- start 2024-07-24T22:08:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1529ffb640 1 -- 172.21.15.47:0/1030083440 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f1514018480 con 0x7f152c103f00 2024-07-24T22:08:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1535596740 1 -- start start 2024-07-24T22:08:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1535596740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 0x55dca00a1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1535596740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 0x55dca00ad000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1535596740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00af930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1535596740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dca0016280 con 0x55dca00ad540 2024-07-24T22:08:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1535596740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55dca0005780 con 0x55dca00a0c90 2024-07-24T22:08:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1535596740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55dca00097c0 con 0x55dca00a15b0 2024-07-24T22:08:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1523fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1523fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56832/0 (socket says 172.21.15.47:56832) 2024-07-24T22:08:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1523fff640 1 -- 172.21.15.47:0/1586298182 learned_addr learned my addr 172.21.15.47:0/1586298182 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1530dde640 1 --2- 172.21.15.47:0/1586298182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 0x55dca00a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f152bfff640 1 --2- 172.21.15.47:0/1586298182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 0x55dca00ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1523fff640 1 -- 172.21.15.47:0/1586298182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 msgr2=0x55dca00ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:41.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1523fff640 1 --2- 172.21.15.47:0/1586298182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 0x55dca00ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1523fff640 1 -- 172.21.15.47:0/1586298182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 msgr2=0x55dca00a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:41.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1523fff640 1 --2- 172.21.15.47:0/1586298182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 0x55dca00a1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.997+0000 7f1523fff640 1 -- 172.21.15.47:0/1586298182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc9fd69790 con 0x55dca00ad540 2024-07-24T22:08:41.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.998+0000 7f1529ffb640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15180b3d40 0x7f15180b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.998+0000 7f1523fff640 1 --2- 172.21.15.47:0/1586298182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00af930 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f15140e1a40 tx=0x7f15140ec640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc4416894361f16 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:41.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.998+0000 7f1530dde640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15180b3d40 0x7f15180b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.998+0000 7f15227fc640 1 -- 172.21.15.47:0/1586298182 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15140a6e10 con 0x55dca00ad540 2024-07-24T22:08:41.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.998+0000 7f1529ffb640 1 -- 172.21.15.47:0/1030083440 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f15140e4350 con 0x7f152c103f00 2024-07-24T22:08:41.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.998+0000 7f15227fc640 1 -- 172.21.15.47:0/1586298182 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15140ece40 con 0x55dca00ad540 2024-07-24T22:08:41.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.998+0000 7f15227fc640 1 -- 172.21.15.47:0/1586298182 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15140aa6c0 con 0x55dca00ad540 2024-07-24T22:08:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.999+0000 7f1535596740 1 -- 172.21.15.47:0/1586298182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 msgr2=0x55dca00af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.999+0000 7f1530dde640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15180b3d40 0x7f15180b6200 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1524009a60 tx=0x7f1524005c30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.999+0000 7f1535596740 1 --2- 172.21.15.47:0/1586298182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00af930 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f15140e1a40 tx=0x7f15140ec640 comp rx=0 tx=0).stop 2024-07-24T22:08:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.999+0000 7f1535596740 1 -- 172.21.15.47:0/1586298182 shutdown_connections 2024-07-24T22:08:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.999+0000 7f1535596740 1 --2- 172.21.15.47:0/1586298182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00af930 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.999+0000 7f1535596740 1 --2- 172.21.15.47:0/1586298182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 0x55dca00ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.999+0000 7f1535596740 1 --2- 172.21.15.47:0/1586298182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 0x55dca00a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.999+0000 7f1535596740 1 -- 172.21.15.47:0/1586298182 >> 172.21.15.47:0/1586298182 conn(0x55dca009eac0 msgr2=0x55dca009fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.999+0000 7f1535596740 1 -- 172.21.15.47:0/1586298182 shutdown_connections 2024-07-24T22:08:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.999+0000 7f1535596740 1 -- 172.21.15.47:0/1586298182 wait complete. 2024-07-24T22:08:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.999+0000 7f1535596740 1 -- start start 2024-07-24T22:08:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:40.999+0000 7f1535596740 1 Processor -- start 2024-07-24T22:08:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1535596740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a0c90 0x55dca00acca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1535596740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00a15b0 0x55dca00aa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1535596740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00ad540 0x55dca00aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1535596740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dc9ff3fab0 con 0x55dca00a15b0 2024-07-24T22:08:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1535596740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55dc9ff8d9e0 con 0x55dca00ad540 2024-07-24T22:08:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1535596740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55dca00b0220 con 0x55dca00a0c90 2024-07-24T22:08:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1535596740 10 client.0 _ll_register_callbacks cb 0x55dc9fd15a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1523fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00a15b0 0x55dca00aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1523fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00a15b0 0x55dca00aa180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56844/0 (socket says 172.21.15.47:56844) 2024-07-24T22:08:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1523fff640 1 -- 172.21.15.47:0/3523353866 learned_addr learned my addr 172.21.15.47:0/3523353866 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f152bfff640 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a0c90 0x55dca00acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1530dde640 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00ad540 0x55dca00aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1523fff640 1 -- 172.21.15.47:0/3523353866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a0c90 msgr2=0x55dca00acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1523fff640 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a0c90 0x55dca00acca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1523fff640 1 -- 172.21.15.47:0/3523353866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00ad540 msgr2=0x55dca00aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1523fff640 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00ad540 0x55dca00aa6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1523fff640 1 -- 172.21.15.47:0/3523353866 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc9fde2620 con 0x55dca00a15b0 2024-07-24T22:08:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f152bfff640 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a0c90 0x55dca00acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1523fff640 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00a15b0 0x55dca00aa180 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f15140a6fd0 tx=0x7f1514018d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80af709e7959b736 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f150b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f150b7fe640 1 -- 172.21.15.47:0/3523353866 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15140aa8a0 con 0x55dca00a15b0 2024-07-24T22:08:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f150b7fe640 1 -- 172.21.15.47:0/3523353866 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f1514018770 con 0x55dca00a15b0 2024-07-24T22:08:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f1535596740 1 -- 172.21.15.47:0/3523353866 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dc9ffb4ce0 con 0x55dca00a15b0 2024-07-24T22:08:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.000+0000 7f150b7fe640 1 -- 172.21.15.47:0/3523353866 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f15140aad20 con 0x55dca00a15b0 2024-07-24T22:08:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.001+0000 7f1535596740 10 client.15834 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.001+0000 7f1535596740 1 -- 172.21.15.47:0/3523353866 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dca00bb9d0 con 0x55dca00a15b0 2024-07-24T22:08:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.001+0000 7f150b7fe640 1 -- 172.21.15.47:0/3523353866 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55dc9ffb4ce0 con 0x55dca00a15b0 2024-07-24T22:08:41.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.001+0000 7f150b7fe640 1 -- 172.21.15.47:0/3523353866 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f15140ab1b0 con 0x55dca00a15b0 2024-07-24T22:08:41.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.001+0000 7f1535596740 10 client.15834 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:41.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.001+0000 7f1535596740 10 client.15834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:41.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.001+0000 7f1535596740 20 client.15834 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:41.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.001+0000 7f1535596740 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dca00bcd20 0x55dca00bf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.001+0000 7f1535596740 4 client.15834 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.001+0000 7f1535596740 1 -- 172.21.15.47:0/3523353866 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dca00181d0 con 0x55dca00bcd20 2024-07-24T22:08:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.001+0000 7f152bfff640 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dca00bcd20 0x55dca00bf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.002+0000 7f150b7fe640 10 client.15834 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.002+0000 7f152bfff640 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dca00bcd20 0x55dca00bf110 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc97e6017e9eb3b2 server_cookie=cac0e6d551e51908 in_seq=0 out_seq=0 2024-07-24T22:08:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.002+0000 7f150b7fe640 1 -- 172.21.15.47:0/3523353866 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dca00181d0 con 0x55dca00bcd20 2024-07-24T22:08:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.002+0000 7f150b7fe640 10 client.15834 handle_command_reply: tid=0 2024-07-24T22:08:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.002+0000 7f1535596740 1 client.15834 shutdown 2024-07-24T22:08:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.002+0000 7f1535596740 1 -- 172.21.15.47:0/3523353866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00a15b0 msgr2=0x55dca00aa180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.002+0000 7f1535596740 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00a15b0 0x55dca00aa180 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f15140a6fd0 tx=0x7f1514018d70 comp rx=0 tx=0).stop 2024-07-24T22:08:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.003+0000 7f1535596740 1 -- 172.21.15.47:0/3523353866 shutdown_connections 2024-07-24T22:08:41.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.003+0000 7f1535596740 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dca00bcd20 0x55dca00bf110 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.003+0000 7f1535596740 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00ad540 0x55dca00aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.003+0000 7f150b7fe640 0 client.15834 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:41.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.003+0000 7f1535596740 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00a15b0 0x55dca00aa180 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.003+0000 7f1535596740 1 --2- 172.21.15.47:0/3523353866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a0c90 0x55dca00acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.003+0000 7f1535596740 1 -- 172.21.15.47:0/3523353866 >> 172.21.15.47:0/3523353866 conn(0x55dca009eac0 msgr2=0x55dca00a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:41.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.003+0000 7f1535596740 1 -- 172.21.15.47:0/3523353866 shutdown_connections 2024-07-24T22:08:41.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.003+0000 7f1535596740 1 -- 172.21.15.47:0/3523353866 wait complete. 2024-07-24T22:08:41.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.003+0000 7f1535596740 20 client.15834 trim_cache size 0 max 16384 2024-07-24T22:08:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1535596740 1 Processor -- start 2024-07-24T22:08:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1535596740 1 -- start start 2024-07-24T22:08:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1535596740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 0x55dca009fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1535596740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 0x55dca00a7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1535596740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1535596740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f152c1ae250 con 0x55dca00ad540 2024-07-24T22:08:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1535596740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f152c1b0ad0 con 0x55dca00a0c90 2024-07-24T22:08:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1535596740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f152c1ae8c0 con 0x55dca00a15b0 2024-07-24T22:08:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1530dde640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1530dde640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00a78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56852/0 (socket says 172.21.15.47:56852) 2024-07-24T22:08:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1530dde640 1 -- 172.21.15.47:0/3323384320 learned_addr learned my addr 172.21.15.47:0/3323384320 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1523fff640 1 --2- 172.21.15.47:0/3323384320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 0x55dca00a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f152bfff640 1 --2- 172.21.15.47:0/3323384320 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 0x55dca009fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1530dde640 1 -- 172.21.15.47:0/3323384320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 msgr2=0x55dca00a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1530dde640 1 --2- 172.21.15.47:0/3323384320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 0x55dca00a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1530dde640 1 -- 172.21.15.47:0/3323384320 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 msgr2=0x55dca009fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1530dde640 1 --2- 172.21.15.47:0/3323384320 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 0x55dca009fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.018+0000 7f1530dde640 1 -- 172.21.15.47:0/3323384320 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca00a13e0 con 0x55dca00ad540 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.019+0000 7f1530dde640 1 --2- 172.21.15.47:0/3323384320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00a78b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f152402ade0 tx=0x7f1524041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cdfb2aab152707 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.019+0000 7f1521ffb640 1 -- 172.21.15.47:0/3323384320 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1524003970 con 0x55dca00ad540 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.019+0000 7f1521ffb640 1 -- 172.21.15.47:0/3323384320 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1524036040 con 0x55dca00ad540 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.019+0000 7f1521ffb640 1 -- 172.21.15.47:0/3323384320 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15240046d0 con 0x55dca00ad540 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.019+0000 7f1535596740 1 -- 172.21.15.47:0/3323384320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 msgr2=0x55dca00a78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.019+0000 7f1535596740 1 --2- 172.21.15.47:0/3323384320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00a78b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f152402ade0 tx=0x7f1524041000 comp rx=0 tx=0).stop 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.019+0000 7f1535596740 1 -- 172.21.15.47:0/3323384320 shutdown_connections 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.019+0000 7f1535596740 1 --2- 172.21.15.47:0/3323384320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00a78b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.019+0000 7f1535596740 1 --2- 172.21.15.47:0/3323384320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 0x55dca00a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.019+0000 7f1535596740 1 --2- 172.21.15.47:0/3323384320 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 0x55dca009fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.019+0000 7f1535596740 1 -- 172.21.15.47:0/3323384320 >> 172.21.15.47:0/3323384320 conn(0x55dca009eac0 msgr2=0x55dca00a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.019+0000 7f1535596740 1 -- 172.21.15.47:0/3323384320 shutdown_connections 2024-07-24T22:08:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.019+0000 7f1535596740 1 -- 172.21.15.47:0/3323384320 wait complete. 2024-07-24T22:08:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f1535596740 1 -- start start 2024-07-24T22:08:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f1535596740 1 Processor -- start 2024-07-24T22:08:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f1535596740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 0x55dca00c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f1535596740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 0x55dca00c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f1535596740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f1535596740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f152c1aef90 con 0x55dca00ad540 2024-07-24T22:08:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f1535596740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f152c1b0400 con 0x55dca00a0c90 2024-07-24T22:08:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f1535596740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f152c1af660 con 0x55dca00a15b0 2024-07-24T22:08:41.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f1535596740 10 client.0 _ll_register_callbacks cb 0x7f1524009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:41.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f1530dde640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f1530dde640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00c19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56864/0 (socket says 172.21.15.47:56864) 2024-07-24T22:08:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f1530dde640 1 -- 172.21.15.47:0/3392729675 learned_addr learned my addr 172.21.15.47:0/3392729675 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f1523fff640 1 --2- 172.21.15.47:0/3392729675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 0x55dca00c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.020+0000 7f152bfff640 1 --2- 172.21.15.47:0/3392729675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 0x55dca00c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f1530dde640 1 -- 172.21.15.47:0/3392729675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 msgr2=0x55dca00c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f1530dde640 1 --2- 172.21.15.47:0/3392729675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 0x55dca00c14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f1530dde640 1 -- 172.21.15.47:0/3392729675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 msgr2=0x55dca00c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f1530dde640 1 --2- 172.21.15.47:0/3392729675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 0x55dca00c0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f1530dde640 1 -- 172.21.15.47:0/3392729675 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca0125660 con 0x55dca00ad540 2024-07-24T22:08:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f1530dde640 1 --2- 172.21.15.47:0/3392729675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00c19f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f152402a900 tx=0x7f15240095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79727d18311d7767 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f150b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f150b7fe640 1 -- 172.21.15.47:0/3392729675 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1524059030 con 0x55dca00ad540 2024-07-24T22:08:41.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f150b7fe640 1 -- 172.21.15.47:0/3392729675 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f152404f040 con 0x55dca00ad540 2024-07-24T22:08:41.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f1535596740 1 -- 172.21.15.47:0/3392729675 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1524036040 con 0x55dca00ad540 2024-07-24T22:08:41.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f150b7fe640 1 -- 172.21.15.47:0/3392729675 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f152402f870 con 0x55dca00ad540 2024-07-24T22:08:41.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f1535596740 10 client.15840 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:41.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f1535596740 1 -- 172.21.15.47:0/3392729675 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dca0126970 con 0x55dca00ad540 2024-07-24T22:08:41.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f150b7fe640 1 -- 172.21.15.47:0/3392729675 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1524036040 con 0x55dca00ad540 2024-07-24T22:08:41.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.021+0000 7f150b7fe640 1 -- 172.21.15.47:0/3392729675 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1524030c40 con 0x55dca00ad540 2024-07-24T22:08:41.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.022+0000 7f1535596740 10 client.15840 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:41.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.022+0000 7f1535596740 10 client.15840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:41.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.022+0000 7f1535596740 20 client.15840 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:41.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.022+0000 7f1535596740 1 --2- 172.21.15.47:0/3392729675 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dca0127040 0x55dca0129460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:41.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.022+0000 7f1535596740 4 client.15840 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:08:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.022+0000 7f1535596740 1 -- 172.21.15.47:0/3392729675 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dca0013c70 con 0x55dca0127040 2024-07-24T22:08:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.022+0000 7f152bfff640 1 --2- 172.21.15.47:0/3392729675 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dca0127040 0x55dca0129460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.022+0000 7f152bfff640 1 --2- 172.21.15.47:0/3392729675 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dca0127040 0x55dca0129460 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b01488c3680a488 server_cookie=17a7c582b0917ac9 in_seq=0 out_seq=0 2024-07-24T22:08:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.022+0000 7f150b7fe640 10 client.15840 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.027+0000 7f150b7fe640 1 -- 172.21.15.47:0/3392729675 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dca0013c70 con 0x55dca0127040 2024-07-24T22:08:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.027+0000 7f150b7fe640 10 client.15840 handle_command_reply: tid=0 2024-07-24T22:08:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.027+0000 7f1535596740 1 client.15840 shutdown 2024-07-24T22:08:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.027+0000 7f1535596740 1 -- 172.21.15.47:0/3392729675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 msgr2=0x55dca00c19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.027+0000 7f1535596740 1 --2- 172.21.15.47:0/3392729675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00c19f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f152402a900 tx=0x7f15240095c0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.027+0000 7f1535596740 1 -- 172.21.15.47:0/3392729675 shutdown_connections 2024-07-24T22:08:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.027+0000 7f1535596740 1 --2- 172.21.15.47:0/3392729675 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dca0127040 0x55dca0129460 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.027+0000 7f1535596740 1 --2- 172.21.15.47:0/3392729675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dca00ad540 0x55dca00c19f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.027+0000 7f1535596740 1 --2- 172.21.15.47:0/3392729675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dca00a15b0 0x55dca00c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.027+0000 7f1535596740 1 --2- 172.21.15.47:0/3392729675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dca00a0c90 0x55dca00c0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.027+0000 7f150b7fe640 0 client.15840 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.027+0000 7f1535596740 1 -- 172.21.15.47:0/3392729675 >> 172.21.15.47:0/3392729675 conn(0x55dca009eac0 msgr2=0x55dca00ab630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1535596740 1 -- 172.21.15.47:0/3392729675 shutdown_connections 2024-07-24T22:08:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1535596740 1 -- 172.21.15.47:0/3392729675 wait complete. 2024-07-24T22:08:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1535596740 20 client.15840 trim_cache size 0 max 16384 2024-07-24T22:08:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:08:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:08:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:08:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:08:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1532841640 1 -- 172.21.15.47:0/1030083440 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15180b3d40 msgr2=0x7f15180b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1532841640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15180b3d40 0x7f15180b6200 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1524009a60 tx=0x7f1524005c30 comp rx=0 tx=0).stop 2024-07-24T22:08:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1532841640 1 -- 172.21.15.47:0/1030083440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c103f00 msgr2=0x7f152c1017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1532841640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c103f00 0x7f152c1017c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f151400c970 tx=0x7f151400ce30 comp rx=0 tx=0).stop 2024-07-24T22:08:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1532841640 1 -- 172.21.15.47:0/1030083440 shutdown_connections 2024-07-24T22:08:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1532841640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15180b3d40 0x7f15180b6200 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1532841640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f152c10ca30 0x7f152c101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1532841640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c103f00 0x7f152c1017c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1532841640 1 --2- 172.21.15.47:0/1030083440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f152c1035e0 0x7f152c101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1532841640 1 -- 172.21.15.47:0/1030083440 >> 172.21.15.47:0/1030083440 conn(0x7f152c0fd030 msgr2=0x7f152c10ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1532841640 1 -- 172.21.15.47:0/1030083440 shutdown_connections 2024-07-24T22:08:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:41.028+0000 7f1532841640 1 -- 172.21.15.47:0/1030083440 wait complete. 2024-07-24T22:08:41.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:41 smithi188 ceph-mon[37380]: pgmap v410: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-07-24T22:08:41.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:41 smithi183 ceph-mon[37007]: pgmap v410: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-07-24T22:08:41.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:41 smithi047 ceph-mon[32551]: pgmap v410: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-07-24T22:08:42.077 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:08:42.078 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:08:42.358 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:42.613 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:08:43.640 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:43.765 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:43 smithi047 ceph-mon[32551]: pgmap v411: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-07-24T22:08:43.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:43 smithi188 ceph-mon[37380]: pgmap v411: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-07-24T22:08:43.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:43 smithi183 ceph-mon[37007]: pgmap v411: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-07-24T22:08:44.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.452+0000 7fdb9991d640 1 -- 172.21.15.47:0/340882121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94107a20 msgr2=0x7fdb9410e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:44.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.452+0000 7fdb9991d640 1 --2- 172.21.15.47:0/340882121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94107a20 0x7fdb9410e220 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009ca0 tx=0x7fdb8c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.453+0000 7fdb9991d640 1 -- 172.21.15.47:0/340882121 shutdown_connections 2024-07-24T22:08:44.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.453+0000 7fdb9991d640 1 --2- 172.21.15.47:0/340882121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94107a20 0x7fdb9410e220 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.453+0000 7fdb9991d640 1 --2- 172.21.15.47:0/340882121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb941070a0 0x7fdb941074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.453+0000 7fdb9991d640 1 --2- 172.21.15.47:0/340882121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb94101690 0x7fdb94101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.453+0000 7fdb9991d640 1 -- 172.21.15.47:0/340882121 >> 172.21.15.47:0/340882121 conn(0x7fdb940fd100 msgr2=0x7fdb940ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.453+0000 7fdb9991d640 1 -- 172.21.15.47:0/340882121 shutdown_connections 2024-07-24T22:08:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.453+0000 7fdb9991d640 1 -- 172.21.15.47:0/340882121 wait complete. 2024-07-24T22:08:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.453+0000 7fdb9991d640 1 Processor -- start 2024-07-24T22:08:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.453+0000 7fdb9991d640 1 -- start start 2024-07-24T22:08:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.453+0000 7fdb9991d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94101690 0x7fdb94199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.453+0000 7fdb9991d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb941070a0 0x7fdb94199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.453+0000 7fdb9991d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb94107a20 0x7fdb9419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb9991d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941116a0 con 0x7fdb94101690 2024-07-24T22:08:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb9991d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94111520 con 0x7fdb94107a20 2024-07-24T22:08:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb9991d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94111820 con 0x7fdb941070a0 2024-07-24T22:08:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb92ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94101690 0x7fdb94199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb92ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94101690 0x7fdb94199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56884/0 (socket says 172.21.15.47:56884) 2024-07-24T22:08:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb92ffd640 1 -- 172.21.15.47:0/2915253423 learned_addr learned my addr 172.21.15.47:0/2915253423 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb8bfff640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb941070a0 0x7fdb94199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb92ffd640 1 -- 172.21.15.47:0/2915253423 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb941070a0 msgr2=0x7fdb94199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb92ffd640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb941070a0 0x7fdb94199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb92ffd640 1 -- 172.21.15.47:0/2915253423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb94107a20 msgr2=0x7fdb9419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb937fe640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb94107a20 0x7fdb9419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb92ffd640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb94107a20 0x7fdb9419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb92ffd640 1 -- 172.21.15.47:0/2915253423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb941a4e60 con 0x7fdb94101690 2024-07-24T22:08:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.454+0000 7fdb92ffd640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94101690 0x7fdb94199a80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400e9f0 tx=0x7fdb8400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:44.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.455+0000 7fdb9891b640 1 -- 172.21.15.47:0/2915253423 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8400cd80 con 0x7fdb94101690 2024-07-24T22:08:44.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.455+0000 7fdb9891b640 1 -- 172.21.15.47:0/2915253423 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb840108e0 con 0x7fdb94101690 2024-07-24T22:08:44.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.455+0000 7fdb9991d640 1 -- 172.21.15.47:0/2915253423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb941a5150 con 0x7fdb94101690 2024-07-24T22:08:44.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.455+0000 7fdb9891b640 1 -- 172.21.15.47:0/2915253423 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84018980 con 0x7fdb94101690 2024-07-24T22:08:44.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.455+0000 7fdb9991d640 1 -- 172.21.15.47:0/2915253423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb941a56e0 con 0x7fdb94101690 2024-07-24T22:08:44.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.457+0000 7fdb9891b640 1 -- 172.21.15.47:0/2915253423 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fdb84010430 con 0x7fdb94101690 2024-07-24T22:08:44.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.457+0000 7fdb9bcce740 1 Processor -- start 2024-07-24T22:08:44.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb9bcce740 1 -- start start 2024-07-24T22:08:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb9bcce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b4eb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb9bcce740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb9bcce740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 0x56402b4fdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb9bcce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56402b4629f0 con 0x56402b4eaf20 2024-07-24T22:08:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb9bcce740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56402b451ef0 con 0x56402b4fbbe0 2024-07-24T22:08:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb9bcce740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56402b455f30 con 0x56402b4eb840 2024-07-24T22:08:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b4eb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b4eb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56896/0 (socket says 172.21.15.47:56896) 2024-07-24T22:08:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb937fe640 1 -- 172.21.15.47:0/1806114688 learned_addr learned my addr 172.21.15.47:0/1806114688 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb92ffd640 1 --2- 172.21.15.47:0/1806114688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb8bfff640 1 --2- 172.21.15.47:0/1806114688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 0x56402b4fdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb937fe640 1 -- 172.21.15.47:0/1806114688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 msgr2=0x56402b4fb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb937fe640 1 --2- 172.21.15.47:0/1806114688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4fb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb937fe640 1 -- 172.21.15.47:0/1806114688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 msgr2=0x56402b4fdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb937fe640 1 --2- 172.21.15.47:0/1806114688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 0x56402b4fdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb937fe640 1 -- 172.21.15.47:0/1806114688 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56402b1b2930 con 0x56402b4eaf20 2024-07-24T22:08:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb8bfff640 1 --2- 172.21.15.47:0/1806114688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 0x56402b4fdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:08:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.458+0000 7fdb9891b640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdb800b3dc0 0x7fdb800b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.459+0000 7fdb92ffd640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdb800b3dc0 0x7fdb800b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.459+0000 7fdb937fe640 1 --2- 172.21.15.47:0/1806114688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b4eb300 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c02ade0 tx=0x7fdb8c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33abf2f76d099a58 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.459+0000 7fdb9891b640 1 -- 172.21.15.47:0/2915253423 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fdb840e4340 con 0x7fdb94101690 2024-07-24T22:08:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.459+0000 7fdb89ffb640 1 -- 172.21.15.47:0/1806114688 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c031cf0 con 0x56402b4eaf20 2024-07-24T22:08:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.459+0000 7fdb89ffb640 1 -- 172.21.15.47:0/1806114688 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb8c036070 con 0x56402b4eaf20 2024-07-24T22:08:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.459+0000 7fdb89ffb640 1 -- 172.21.15.47:0/1806114688 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c004040 con 0x56402b4eaf20 2024-07-24T22:08:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.460+0000 7fdb9bcce740 1 -- 172.21.15.47:0/1806114688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 msgr2=0x56402b4eb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.460+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/1806114688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b4eb300 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c02ade0 tx=0x7fdb8c005f30 comp rx=0 tx=0).stop 2024-07-24T22:08:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.460+0000 7fdb92ffd640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdb800b3dc0 0x7fdb800b6280 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdb840e1b40 tx=0x7fdb840e9040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.460+0000 7fdb9bcce740 1 -- 172.21.15.47:0/1806114688 shutdown_connections 2024-07-24T22:08:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.460+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/1806114688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 0x56402b4fdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.460+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/1806114688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.460+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/1806114688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b4eb300 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.460+0000 7fdb9bcce740 1 -- 172.21.15.47:0/1806114688 >> 172.21.15.47:0/1806114688 conn(0x56402b4e8d50 msgr2=0x56402b4e9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:44.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.460+0000 7fdb9bcce740 1 -- 172.21.15.47:0/1806114688 shutdown_connections 2024-07-24T22:08:44.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.460+0000 7fdb9bcce740 1 -- 172.21.15.47:0/1806114688 wait complete. 2024-07-24T22:08:44.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.460+0000 7fdb9bcce740 1 -- start start 2024-07-24T22:08:44.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb9bcce740 1 Processor -- start 2024-07-24T22:08:44.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb9bcce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b4fb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb9bcce740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4f8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb9bcce740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 0x56402b4f9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb9bcce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56402b2b5890 con 0x56402b4eaf20 2024-07-24T22:08:44.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb9bcce740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56402b3f4390 con 0x56402b4fbbe0 2024-07-24T22:08:44.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb9bcce740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56402b4fe830 con 0x56402b4eb840 2024-07-24T22:08:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb9bcce740 10 client.0 _ll_register_callbacks cb 0x56402b3fe500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b4fb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b4fb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56904/0 (socket says 172.21.15.47:56904) 2024-07-24T22:08:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb937fe640 1 -- 172.21.15.47:0/3131427708 learned_addr learned my addr 172.21.15.47:0/3131427708 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb8bfff640 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4f8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb937fe640 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 0x56402b4f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb8bfff640 1 -- 172.21.15.47:0/3131427708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 msgr2=0x56402b4f9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb8bfff640 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 0x56402b4f9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb8bfff640 1 -- 172.21.15.47:0/3131427708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 msgr2=0x56402b4fb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb8bfff640 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b4fb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb8bfff640 1 -- 172.21.15.47:0/3131427708 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56402b3eed60 con 0x56402b4eb840 2024-07-24T22:08:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.461+0000 7fdb937fe640 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b4fb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:08:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.462+0000 7fdb8bfff640 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4f8ae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0126d0 tx=0x7fdb7c012b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80a74f9ace1c685 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.462+0000 7fdb72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:08:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.462+0000 7fdb72ffd640 1 -- 172.21.15.47:0/3131427708 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c004050 con 0x56402b4eb840 2024-07-24T22:08:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.462+0000 7fdb9bcce740 1 -- 172.21.15.47:0/3131427708 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb8c036070 con 0x56402b4eb840 2024-07-24T22:08:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.462+0000 7fdb72ffd640 1 -- 172.21.15.47:0/3131427708 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fdb7c0041f0 con 0x56402b4eb840 2024-07-24T22:08:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.462+0000 7fdb72ffd640 1 -- 172.21.15.47:0/3131427708 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdb7c0043f0 con 0x56402b4eb840 2024-07-24T22:08:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.462+0000 7fdb9bcce740 10 client.25414 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.462+0000 7fdb9bcce740 1 -- 172.21.15.47:0/3131427708 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56402b50a750 con 0x56402b4eb840 2024-07-24T22:08:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.462+0000 7fdb72ffd640 1 -- 172.21.15.47:0/3131427708 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb8c036070 con 0x56402b4eb840 2024-07-24T22:08:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.463+0000 7fdb72ffd640 1 -- 172.21.15.47:0/3131427708 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdb7c003b50 con 0x56402b4eb840 2024-07-24T22:08:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.463+0000 7fdb9bcce740 10 client.25414 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.463+0000 7fdb9bcce740 10 client.25414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.463+0000 7fdb9bcce740 20 client.25414 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.463+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56402b50bb60 0x56402b50df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.463+0000 7fdb9bcce740 4 client.25414 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.463+0000 7fdb9bcce740 1 -- 172.21.15.47:0/3131427708 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56402b464940 con 0x56402b50bb60 2024-07-24T22:08:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.463+0000 7fdb937fe640 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56402b50bb60 0x56402b50df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.463+0000 7fdb937fe640 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56402b50bb60 0x56402b50df50 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1797694b4ca66c2d server_cookie=98cb0c63920ae788 in_seq=0 out_seq=0 2024-07-24T22:08:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.463+0000 7fdb72ffd640 10 client.25414 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.464+0000 7fdb72ffd640 1 -- 172.21.15.47:0/3131427708 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56402b464940 con 0x56402b50bb60 2024-07-24T22:08:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.464+0000 7fdb72ffd640 10 client.25414 handle_command_reply: tid=0 2024-07-24T22:08:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.464+0000 7fdb9bcce740 1 client.25414 shutdown 2024-07-24T22:08:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.465+0000 7fdb9bcce740 1 -- 172.21.15.47:0/3131427708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 msgr2=0x56402b4f8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.465+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4f8ae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0126d0 tx=0x7fdb7c012b90 comp rx=0 tx=0).stop 2024-07-24T22:08:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.465+0000 7fdb9bcce740 1 -- 172.21.15.47:0/3131427708 shutdown_connections 2024-07-24T22:08:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.465+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56402b50bb60 0x56402b50df50 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.465+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 0x56402b4f9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.465+0000 7fdb72ffd640 0 client.25414 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.465+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4f8ae0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.465+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/3131427708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b4fb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.465+0000 7fdb9bcce740 1 -- 172.21.15.47:0/3131427708 >> 172.21.15.47:0/3131427708 conn(0x56402b4e8d50 msgr2=0x56402b4ee880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.465+0000 7fdb9bcce740 1 -- 172.21.15.47:0/3131427708 shutdown_connections 2024-07-24T22:08:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.465+0000 7fdb9bcce740 1 -- 172.21.15.47:0/3131427708 wait complete. 2024-07-24T22:08:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.465+0000 7fdb9bcce740 20 client.25414 trim_cache size 0 max 16384 2024-07-24T22:08:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb9bcce740 1 Processor -- start 2024-07-24T22:08:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb9bcce740 1 -- start start 2024-07-24T22:08:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb9bcce740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4eaf20 0x56402b4f6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb9bcce740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4ea520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb9bcce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4fbbe0 0x56402b4fc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb9bcce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941a9f90 con 0x56402b4fbbe0 2024-07-24T22:08:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb9bcce740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941ac810 con 0x56402b4eaf20 2024-07-24T22:08:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb9bcce740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941aa600 con 0x56402b4eb840 2024-07-24T22:08:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4fbbe0 0x56402b4fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4fbbe0 0x56402b4fc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56916/0 (socket says 172.21.15.47:56916) 2024-07-24T22:08:44.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb937fe640 1 -- 172.21.15.47:0/4224054082 learned_addr learned my addr 172.21.15.47:0/4224054082 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb937fe640 1 -- 172.21.15.47:0/4224054082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 msgr2=0x56402b4ea520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb8bfff640 1 --2- 172.21.15.47:0/4224054082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4ea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb937fe640 1 --2- 172.21.15.47:0/4224054082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4ea520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb937fe640 1 -- 172.21.15.47:0/4224054082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4eaf20 msgr2=0x56402b4f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.484+0000 7fdb937fe640 1 --2- 172.21.15.47:0/4224054082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4eaf20 0x56402b4f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.485+0000 7fdb937fe640 1 -- 172.21.15.47:0/4224054082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56402b4f7a40 con 0x56402b4fbbe0 2024-07-24T22:08:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.485+0000 7fdb8bfff640 1 --2- 172.21.15.47:0/4224054082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4ea520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.485+0000 7fdb937fe640 1 --2- 172.21.15.47:0/4224054082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4fbbe0 0x56402b4fc020 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009ca0 tx=0x7fdb8c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae75dcf4be4c754 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.485+0000 7fdb897fa640 1 -- 172.21.15.47:0/4224054082 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c0317e0 con 0x56402b4fbbe0 2024-07-24T22:08:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.485+0000 7fdb897fa640 1 -- 172.21.15.47:0/4224054082 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb8c036040 con 0x56402b4fbbe0 2024-07-24T22:08:44.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.485+0000 7fdb897fa640 1 -- 172.21.15.47:0/4224054082 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c030820 con 0x56402b4fbbe0 2024-07-24T22:08:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.486+0000 7fdb9bcce740 1 -- 172.21.15.47:0/4224054082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4fbbe0 msgr2=0x56402b4fc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.486+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/4224054082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4fbbe0 0x56402b4fc020 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009ca0 tx=0x7fdb8c003ce0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.486+0000 7fdb9bcce740 1 -- 172.21.15.47:0/4224054082 shutdown_connections 2024-07-24T22:08:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.486+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/4224054082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4fbbe0 0x56402b4fc020 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.486+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/4224054082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b4ea520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.486+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/4224054082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4eaf20 0x56402b4f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.486+0000 7fdb9bcce740 1 -- 172.21.15.47:0/4224054082 >> 172.21.15.47:0/4224054082 conn(0x56402b4e8d50 msgr2=0x56402b4e9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.486+0000 7fdb9bcce740 1 -- 172.21.15.47:0/4224054082 shutdown_connections 2024-07-24T22:08:44.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.486+0000 7fdb9bcce740 1 -- 172.21.15.47:0/4224054082 wait complete. 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.486+0000 7fdb9bcce740 1 -- start start 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.486+0000 7fdb9bcce740 1 Processor -- start 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb9bcce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b503ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb9bcce740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b504000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb9bcce740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 0x56402b4f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb9bcce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941aacd0 con 0x56402b4eaf20 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb9bcce740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941ac140 con 0x56402b4fbbe0 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb9bcce740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941ab3a0 con 0x56402b4eb840 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb9bcce740 10 client.0 _ll_register_callbacks cb 0x7fdb7c009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b503ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b503ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56926/0 (socket says 172.21.15.47:56926) 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb937fe640 1 -- 172.21.15.47:0/2860532699 learned_addr learned my addr 172.21.15.47:0/2860532699 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb8bfff640 1 --2- 172.21.15.47:0/2860532699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b504000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb937fe640 1 -- 172.21.15.47:0/2860532699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 msgr2=0x56402b504000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb937fe640 1 --2- 172.21.15.47:0/2860532699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b504000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb937fe640 1 -- 172.21.15.47:0/2860532699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 msgr2=0x56402b4f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb937fe640 1 --2- 172.21.15.47:0/2860532699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 0x56402b4f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.487+0000 7fdb937fe640 1 -- 172.21.15.47:0/2860532699 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56402b4f6890 con 0x56402b4eaf20 2024-07-24T22:08:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb937fe640 1 --2- 172.21.15.47:0/2860532699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b503ac0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0097b0 tx=0x7fdb8c005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3704be5254c3f715 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb72ffd640 1 -- 172.21.15.47:0/2860532699 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c031650 con 0x56402b4eaf20 2024-07-24T22:08:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb72ffd640 1 -- 172.21.15.47:0/2860532699 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fdb8c0317f0 con 0x56402b4eaf20 2024-07-24T22:08:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb9bcce740 1 -- 172.21.15.47:0/2860532699 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb8c036040 con 0x56402b4eaf20 2024-07-24T22:08:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb72ffd640 1 -- 172.21.15.47:0/2860532699 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdb8c02f610 con 0x56402b4eaf20 2024-07-24T22:08:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb9bcce740 10 client.15858 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb9bcce740 1 -- 172.21.15.47:0/2860532699 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56402b57b490 con 0x56402b4eaf20 2024-07-24T22:08:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb72ffd640 1 -- 172.21.15.47:0/2860532699 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb8c036040 con 0x56402b4eaf20 2024-07-24T22:08:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb72ffd640 1 -- 172.21.15.47:0/2860532699 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdb8c030b60 con 0x56402b4eaf20 2024-07-24T22:08:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb9bcce740 10 client.15858 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb9bcce740 10 client.15858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb9bcce740 20 client.15858 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/2860532699 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56402b57b710 0x56402b57db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb9bcce740 4 client.15858 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:08:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.488+0000 7fdb9bcce740 1 -- 172.21.15.47:0/2860532699 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56402b4fc700 con 0x56402b57b710 2024-07-24T22:08:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.489+0000 7fdb8bfff640 1 --2- 172.21.15.47:0/2860532699 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56402b57b710 0x56402b57db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.489+0000 7fdb72ffd640 10 client.15858 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:44.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.489+0000 7fdb8bfff640 1 --2- 172.21.15.47:0/2860532699 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56402b57b710 0x56402b57db00 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8766ff1e58546f1a server_cookie=4bfade2c563652e6 in_seq=0 out_seq=0 2024-07-24T22:08:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.490+0000 7fdb72ffd640 1 -- 172.21.15.47:0/2860532699 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56402b4fc700 con 0x56402b57b710 2024-07-24T22:08:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.490+0000 7fdb72ffd640 10 client.15858 handle_command_reply: tid=0 2024-07-24T22:08:44.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.490+0000 7fdb9bcce740 1 client.15858 shutdown 2024-07-24T22:08:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.490+0000 7fdb9bcce740 1 -- 172.21.15.47:0/2860532699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 msgr2=0x56402b503ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.490+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/2860532699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b503ac0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0097b0 tx=0x7fdb8c005fa0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.490+0000 7fdb9bcce740 1 -- 172.21.15.47:0/2860532699 shutdown_connections 2024-07-24T22:08:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.490+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/2860532699 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56402b57b710 0x56402b57db00 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.490+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/2860532699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56402b4fbbe0 0x56402b4f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.490+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/2860532699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56402b4eb840 0x56402b504000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.490+0000 7fdb9bcce740 1 --2- 172.21.15.47:0/2860532699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56402b4eaf20 0x56402b503ac0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.490+0000 7fdb9bcce740 1 -- 172.21.15.47:0/2860532699 >> 172.21.15.47:0/2860532699 conn(0x56402b4e8d50 msgr2=0x56402b4e9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.490+0000 7fdb72ffd640 0 client.15858 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9bcce740 1 -- 172.21.15.47:0/2860532699 shutdown_connections 2024-07-24T22:08:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9bcce740 1 -- 172.21.15.47:0/2860532699 wait complete. 2024-07-24T22:08:44.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9bcce740 20 client.15858 trim_cache size 0 max 16384 2024-07-24T22:08:44.497 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:08:44.497 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:08:44.497 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "936cd80b-5f16-4a63-8907-c14e7cca299a", 2024-07-24T22:08:44.497 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:08:44.497 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:08:44.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9991d640 1 -- 172.21.15.47:0/2915253423 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdb800b3dc0 msgr2=0x7fdb800b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9991d640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdb800b3dc0 0x7fdb800b6280 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdb840e1b40 tx=0x7fdb840e9040 comp rx=0 tx=0).stop 2024-07-24T22:08:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9991d640 1 -- 172.21.15.47:0/2915253423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94101690 msgr2=0x7fdb94199a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9991d640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94101690 0x7fdb94199a80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400e9f0 tx=0x7fdb8400eeb0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9991d640 1 -- 172.21.15.47:0/2915253423 shutdown_connections 2024-07-24T22:08:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9991d640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdb800b3dc0 0x7fdb800b6280 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9991d640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb94107a20 0x7fdb9419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9991d640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb941070a0 0x7fdb94199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9991d640 1 --2- 172.21.15.47:0/2915253423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94101690 0x7fdb94199a80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9991d640 1 -- 172.21.15.47:0/2915253423 >> 172.21.15.47:0/2915253423 conn(0x7fdb940fd100 msgr2=0x7fdb940ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9991d640 1 -- 172.21.15.47:0/2915253423 shutdown_connections 2024-07-24T22:08:44.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:44.491+0000 7fdb9991d640 1 -- 172.21.15.47:0/2915253423 wait complete. 2024-07-24T22:08:45.610 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:45 smithi047 ceph-mon[32551]: pgmap v412: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-07-24T22:08:45.610 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:45 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:08:45.610 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:45 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:08:45.610 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:45 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:08:45.610 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:45 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:08:45.610 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:45 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:08:45.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:45 smithi188 ceph-mon[37380]: pgmap v412: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-07-24T22:08:45.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:45 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:08:45.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:45 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:08:45.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:45 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:08:45.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:45 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:08:45.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:45 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:08:45.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:45 smithi183 ceph-mon[37007]: pgmap v412: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-07-24T22:08:45.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:45 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:08:45.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:45 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:08:45.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:45 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:08:45.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:45 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:08:45.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:45 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:08:45.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:08:46.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.542+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/241193371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f4107060 msgr2=0x7fa1f41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.542+0000 7fa1fb3a3640 1 --2- 172.21.15.47:0/241193371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f4107060 0x7fa1f41074a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009900 tx=0x7fa1e402a410 comp rx=0 tx=0).stop 2024-07-24T22:08:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.542+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/241193371 shutdown_connections 2024-07-24T22:08:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.542+0000 7fa1fb3a3640 1 --2- 172.21.15.47:0/241193371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1f41079e0 0x7fa1f410e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.542+0000 7fa1fb3a3640 1 --2- 172.21.15.47:0/241193371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f4107060 0x7fa1f41074a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.542+0000 7fa1fb3a3640 1 --2- 172.21.15.47:0/241193371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1f4101650 0x7fa1f4101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.542+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/241193371 >> 172.21.15.47:0/241193371 conn(0x7fa1f40fd0c0 msgr2=0x7fa1f40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.542+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/241193371 shutdown_connections 2024-07-24T22:08:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.542+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/241193371 wait complete. 2024-07-24T22:08:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.543+0000 7fa1fb3a3640 1 Processor -- start 2024-07-24T22:08:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.543+0000 7fa1fb3a3640 1 -- start start 2024-07-24T22:08:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.543+0000 7fa1fb3a3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1f4101650 0x7fa1f4198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:46.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1fb3a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f4107060 0x7fa1f4199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:46.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1fb3a3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1f41079e0 0x7fa1f419e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:46.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1fb3a3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f41116e0 con 0x7fa1f4107060 2024-07-24T22:08:46.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1fb3a3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f4111560 con 0x7fa1f4101650 2024-07-24T22:08:46.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1fb3a3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f4111860 con 0x7fa1f41079e0 2024-07-24T22:08:46.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1f893e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f4107060 0x7fa1f4199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:46.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1f893e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f4107060 0x7fa1f4199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59072/0 (socket says 172.21.15.47:59072) 2024-07-24T22:08:46.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1f893e640 1 -- 172.21.15.47:0/1617473931 learned_addr learned my addr 172.21.15.47:0/1617473931 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:46.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1f913f640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1f4101650 0x7fa1f4198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:46.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1f9940640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1f41079e0 0x7fa1f419e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:46.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1f893e640 1 -- 172.21.15.47:0/1617473931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1f41079e0 msgr2=0x7fa1f419e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:46.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1f893e640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1f41079e0 0x7fa1f419e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:46.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1f893e640 1 -- 172.21.15.47:0/1617473931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1f4101650 msgr2=0x7fa1f4198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:46.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1f893e640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1f4101650 0x7fa1f4198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:46.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1f893e640 1 -- 172.21.15.47:0/1617473931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f419eeb0 con 0x7fa1f4107060 2024-07-24T22:08:46.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1f9940640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1f41079e0 0x7fa1f419e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:46.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1f893e640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f4107060 0x7fa1f4199340 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4006010 tx=0x7fa1e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:46.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1ea7fc640 1 -- 172.21.15.47:0/1617473931 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e403f030 con 0x7fa1f4107060 2024-07-24T22:08:46.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/1617473931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f419f140 con 0x7fa1f4107060 2024-07-24T22:08:46.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1ea7fc640 1 -- 172.21.15.47:0/1617473931 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1e4003800 con 0x7fa1f4107060 2024-07-24T22:08:46.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.544+0000 7fa1ea7fc640 1 -- 172.21.15.47:0/1617473931 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4035070 con 0x7fa1f4107060 2024-07-24T22:08:46.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.545+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/1617473931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f41a5860 con 0x7fa1f4107060 2024-07-24T22:08:46.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.546+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/1617473931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f4101ab0 con 0x7fa1f4107060 2024-07-24T22:08:46.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.547+0000 7fa1ea7fc640 1 -- 172.21.15.47:0/1617473931 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fa1e4003cb0 con 0x7fa1f4107060 2024-07-24T22:08:46.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.548+0000 7fa1ea7fc640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa1e00b3dc0 0x7fa1e00b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:46.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.548+0000 7fa1f913f640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa1e00b3dc0 0x7fa1e00b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:46.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.548+0000 7fa1ea7fc640 1 -- 172.21.15.47:0/1617473931 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa1e4104850 con 0x7fa1f4107060 2024-07-24T22:08:46.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.549+0000 7fa1f913f640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa1e00b3dc0 0x7fa1e00b6280 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009990 tx=0x7fa1f0009110 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:46.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.552+0000 7fa1ea7fc640 1 -- 172.21.15.47:0/1617473931 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fa1e40cbb60 con 0x7fa1f4107060 2024-07-24T22:08:46.597 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:46.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.795+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/1617473931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1f4199f30 con 0x7fa1f4107060 2024-07-24T22:08:46.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.796+0000 7fa1ea7fc640 1 -- 172.21.15.47:0/1617473931 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7fa1e40cb460 con 0x7fa1f4107060 2024-07-24T22:08:46.799 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:08:46.799 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:08:46.799 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:08:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.798+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/1617473931 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa1e00b3dc0 msgr2=0x7fa1e00b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.798+0000 7fa1fb3a3640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa1e00b3dc0 0x7fa1e00b6280 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009990 tx=0x7fa1f0009110 comp rx=0 tx=0).stop 2024-07-24T22:08:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.798+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/1617473931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f4107060 msgr2=0x7fa1f4199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.798+0000 7fa1fb3a3640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f4107060 0x7fa1f4199340 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4006010 tx=0x7fa1e40042f0 comp rx=0 tx=0).stop 2024-07-24T22:08:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.799+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/1617473931 shutdown_connections 2024-07-24T22:08:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.799+0000 7fa1fb3a3640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa1e00b3dc0 0x7fa1e00b6280 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.799+0000 7fa1fb3a3640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1f41079e0 0x7fa1f419e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.799+0000 7fa1fb3a3640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1f4107060 0x7fa1f4199340 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.799+0000 7fa1fb3a3640 1 --2- 172.21.15.47:0/1617473931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1f4101650 0x7fa1f4198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.799+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/1617473931 >> 172.21.15.47:0/1617473931 conn(0x7fa1f40fd0c0 msgr2=0x7fa1f406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.799+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/1617473931 shutdown_connections 2024-07-24T22:08:46.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:46.799+0000 7fa1fb3a3640 1 -- 172.21.15.47:0/1617473931 wait complete. 2024-07-24T22:08:47.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:47 smithi188 ceph-mon[37380]: pgmap v413: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-07-24T22:08:47.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:47 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1617473931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:47.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:47 smithi183 ceph-mon[37007]: pgmap v413: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-07-24T22:08:47.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:47 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1617473931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:47.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:47 smithi047 ceph-mon[32551]: pgmap v413: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-07-24T22:08:47.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:47 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1617473931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:48.088 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db --set-id 9a3ad881 --release --await' 2024-07-24T22:08:48.088 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db --set-id 9a3ad881 --release --await 2024-07-24T22:08:49.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.082+0000 7f86cf1ba640 1 -- 172.21.15.47:0/3898574721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c8102790 msgr2=0x7f86c8102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:49.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.082+0000 7f86cf1ba640 1 --2- 172.21.15.47:0/3898574721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c8102790 0x7f86c8102b70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009900 tx=0x7f86bc02a410 comp rx=0 tx=0).stop 2024-07-24T22:08:49.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.082+0000 7f86cf1ba640 1 -- 172.21.15.47:0/3898574721 shutdown_connections 2024-07-24T22:08:49.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.082+0000 7f86cf1ba640 1 --2- 172.21.15.47:0/3898574721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86c8108b20 0x7f86c810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.082+0000 7f86cf1ba640 1 --2- 172.21.15.47:0/3898574721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86c81081a0 0x7f86c81085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.082+0000 7f86cf1ba640 1 --2- 172.21.15.47:0/3898574721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c8102790 0x7f86c8102b70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.082+0000 7f86cf1ba640 1 -- 172.21.15.47:0/3898574721 >> 172.21.15.47:0/3898574721 conn(0x7f86c80fe200 msgr2=0x7f86c8100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:49.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.082+0000 7f86cf1ba640 1 -- 172.21.15.47:0/3898574721 shutdown_connections 2024-07-24T22:08:49.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.082+0000 7f86cf1ba640 1 -- 172.21.15.47:0/3898574721 wait complete. 2024-07-24T22:08:49.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.083+0000 7f86cf1ba640 1 Processor -- start 2024-07-24T22:08:49.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.083+0000 7f86cf1ba640 1 -- start start 2024-07-24T22:08:49.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.083+0000 7f86cf1ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86c8102790 0x7f86c8198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.083+0000 7f86cf1ba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c81081a0 0x7f86c8199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.083+0000 7f86cf1ba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86c8108b20 0x7f86c819e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.083+0000 7f86cf1ba640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81127a0 con 0x7f86c81081a0 2024-07-24T22:08:49.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.083+0000 7f86cf1ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f86c8112620 con 0x7f86c8102790 2024-07-24T22:08:49.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.083+0000 7f86cf1ba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f86c8112920 con 0x7f86c8108b20 2024-07-24T22:08:49.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.083+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c81081a0 0x7f86c8199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.083+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c81081a0 0x7f86c8199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59100/0 (socket says 172.21.15.47:59100) 2024-07-24T22:08:49.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.083+0000 7f86c7fff640 1 -- 172.21.15.47:0/4023051882 learned_addr learned my addr 172.21.15.47:0/4023051882 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:49.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.083+0000 7f86ccf56640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86c8102790 0x7f86c8198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.083+0000 7f86cd757640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86c8108b20 0x7f86c819e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.084+0000 7f86c7fff640 1 -- 172.21.15.47:0/4023051882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86c8108b20 msgr2=0x7f86c819e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:49.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.084+0000 7f86c7fff640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86c8108b20 0x7f86c819e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.084+0000 7f86c7fff640 1 -- 172.21.15.47:0/4023051882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86c8102790 msgr2=0x7f86c8198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:49.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.084+0000 7f86c7fff640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86c8102790 0x7f86c8198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.084+0000 7f86c7fff640 1 -- 172.21.15.47:0/4023051882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c819ede0 con 0x7f86c81081a0 2024-07-24T22:08:49.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.084+0000 7f86c7fff640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c81081a0 0x7f86c8199270 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f86b400b4a0 tx=0x7f86b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:49.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.084+0000 7f86c5ffb640 1 -- 172.21.15.47:0/4023051882 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b4014070 con 0x7f86c81081a0 2024-07-24T22:08:49.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.084+0000 7f86cf1ba640 1 -- 172.21.15.47:0/4023051882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c819f0d0 con 0x7f86c81081a0 2024-07-24T22:08:49.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.084+0000 7f86c5ffb640 1 -- 172.21.15.47:0/4023051882 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86b4010ac0 con 0x7f86c81081a0 2024-07-24T22:08:49.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.084+0000 7f86c5ffb640 1 -- 172.21.15.47:0/4023051882 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b4017c30 con 0x7f86c81081a0 2024-07-24T22:08:49.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.084+0000 7f86cf1ba640 1 -- 172.21.15.47:0/4023051882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c8074d70 con 0x7f86c81081a0 2024-07-24T22:08:49.090 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.087+0000 7f86d156b740 1 Processor -- start 2024-07-24T22:08:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.087+0000 7f86c5ffb640 1 -- 172.21.15.47:0/4023051882 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f86b4017070 con 0x7f86c81081a0 2024-07-24T22:08:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.087+0000 7f86d156b740 1 -- start start 2024-07-24T22:08:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.087+0000 7f86d156b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb51a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.087+0000 7f86d156b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb5d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.087+0000 7f86d156b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb60320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.087+0000 7f86d156b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5572aeac8960 con 0x5572aeb51fa0 2024-07-24T22:08:49.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.087+0000 7f86d156b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5572aeab7e60 con 0x5572aeb51680 2024-07-24T22:08:49.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.087+0000 7f86d156b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5572aeabbea0 con 0x5572aeb5df30 2024-07-24T22:08:49.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.087+0000 7f86ccf56640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb5d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.087+0000 7f86ccf56640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb5d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59116/0 (socket says 172.21.15.47:59116) 2024-07-24T22:08:49.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.087+0000 7f86ccf56640 1 -- 172.21.15.47:0/1878141560 learned_addr learned my addr 172.21.15.47:0/1878141560 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:49.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.088+0000 7f86cd757640 1 --2- 172.21.15.47:0/1878141560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb51a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.088+0000 7f86c7fff640 1 --2- 172.21.15.47:0/1878141560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb60320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.088+0000 7f86ccf56640 1 -- 172.21.15.47:0/1878141560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 msgr2=0x5572aeb60320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:49.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.088+0000 7f86ccf56640 1 --2- 172.21.15.47:0/1878141560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb60320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.088+0000 7f86ccf56640 1 -- 172.21.15.47:0/1878141560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 msgr2=0x5572aeb51a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.088+0000 7f86ccf56640 1 --2- 172.21.15.47:0/1878141560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb51a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.088+0000 7f86ccf56640 1 -- 172.21.15.47:0/1878141560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572aea412d0 con 0x5572aeb51fa0 2024-07-24T22:08:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.088+0000 7f86c7fff640 1 --2- 172.21.15.47:0/1878141560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb60320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.088+0000 7f86ccf56640 1 --2- 172.21.15.47:0/1878141560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb5d9f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009900 tx=0x7f86bc032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0fbb497d6382b4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.088+0000 7f86c5ffb640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86b80b3d40 0x7f86b80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.088+0000 7f86b2ffd640 1 -- 172.21.15.47:0/1878141560 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc040070 con 0x5572aeb51fa0 2024-07-24T22:08:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.088+0000 7f86cd757640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86b80b3d40 0x7f86b80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.089+0000 7f86b2ffd640 1 -- 172.21.15.47:0/1878141560 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86bc0316a0 con 0x5572aeb51fa0 2024-07-24T22:08:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.089+0000 7f86b2ffd640 1 -- 172.21.15.47:0/1878141560 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc035040 con 0x5572aeb51fa0 2024-07-24T22:08:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.089+0000 7f86c5ffb640 1 -- 172.21.15.47:0/4023051882 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f86b40e3560 con 0x7f86c81081a0 2024-07-24T22:08:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.089+0000 7f86d156b740 1 -- 172.21.15.47:0/1878141560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 msgr2=0x5572aeb5d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.089+0000 7f86cd757640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86b80b3d40 0x7f86b80b6200 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f86c0005fd0 tx=0x7f86c0009600 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.089+0000 7f86d156b740 1 --2- 172.21.15.47:0/1878141560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb5d9f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009900 tx=0x7f86bc032e60 comp rx=0 tx=0).stop 2024-07-24T22:08:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.089+0000 7f86d156b740 1 -- 172.21.15.47:0/1878141560 shutdown_connections 2024-07-24T22:08:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.089+0000 7f86d156b740 1 --2- 172.21.15.47:0/1878141560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb60320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.089+0000 7f86d156b740 1 --2- 172.21.15.47:0/1878141560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb5d9f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.089+0000 7f86d156b740 1 --2- 172.21.15.47:0/1878141560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb51a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.089+0000 7f86d156b740 1 -- 172.21.15.47:0/1878141560 >> 172.21.15.47:0/1878141560 conn(0x5572aeb4f4b0 msgr2=0x5572aeb50650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.090+0000 7f86d156b740 1 -- 172.21.15.47:0/1878141560 shutdown_connections 2024-07-24T22:08:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.090+0000 7f86d156b740 1 -- 172.21.15.47:0/1878141560 wait complete. 2024-07-24T22:08:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.090+0000 7f86d156b740 1 -- start start 2024-07-24T22:08:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.090+0000 7f86d156b740 1 Processor -- start 2024-07-24T22:08:49.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86d156b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb5aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86d156b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb5b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86d156b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb5b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86d156b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5572ae91b700 con 0x5572aeb51fa0 2024-07-24T22:08:49.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86d156b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5572aea5a5a0 con 0x5572aeb51680 2024-07-24T22:08:49.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86d156b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5572aeb60b50 con 0x5572aeb5df30 2024-07-24T22:08:49.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86d156b740 10 client.0 _ll_register_callbacks cb 0x5572aea7a910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:49.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb5b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86ccf56640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb5aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb5b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59128/0 (socket says 172.21.15.47:59128) 2024-07-24T22:08:49.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86c7fff640 1 -- 172.21.15.47:0/81712617 learned_addr learned my addr 172.21.15.47:0/81712617 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:49.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86cd757640 1 --2- 172.21.15.47:0/81712617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb5b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86c7fff640 1 -- 172.21.15.47:0/81712617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 msgr2=0x5572aeb5b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:49.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86c7fff640 1 --2- 172.21.15.47:0/81712617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb5b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86c7fff640 1 -- 172.21.15.47:0/81712617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 msgr2=0x5572aeb5aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:49.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86c7fff640 1 --2- 172.21.15.47:0/81712617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb5aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86c7fff640 1 -- 172.21.15.47:0/81712617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572aea4d630 con 0x5572aeb51fa0 2024-07-24T22:08:49.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.091+0000 7f86cd757640 1 --2- 172.21.15.47:0/81712617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb5b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86c7fff640 1 --2- 172.21.15.47:0/81712617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb5b430 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f86b400be60 tx=0x7f86b40a9b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89901853801c1b49 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86a7fff640 1 -- 172.21.15.47:0/81712617 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b401e070 con 0x5572aeb51fa0 2024-07-24T22:08:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86a7fff640 1 -- 172.21.15.47:0/81712617 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f86b40a65c0 con 0x5572aeb51fa0 2024-07-24T22:08:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86d156b740 1 -- 172.21.15.47:0/81712617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86bc0316a0 con 0x5572aeb51fa0 2024-07-24T22:08:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86a7fff640 1 -- 172.21.15.47:0/81712617 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f86b40aa330 con 0x5572aeb51fa0 2024-07-24T22:08:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86d156b740 10 client.15876 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86d156b740 1 -- 172.21.15.47:0/81712617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5572ae818650 con 0x5572aeb51fa0 2024-07-24T22:08:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86a7fff640 1 -- 172.21.15.47:0/81712617 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86bc0316a0 con 0x5572aeb51fa0 2024-07-24T22:08:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86a7fff640 1 -- 172.21.15.47:0/81712617 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f86b40b2ea0 con 0x5572aeb51fa0 2024-07-24T22:08:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86d156b740 10 client.15876 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86d156b740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86d156b740 20 client.15876 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86d156b740 1 --2- 172.21.15.47:0/81712617 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572aeb6d920 0x5572aeb6fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86d156b740 4 client.15876 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.092+0000 7f86d156b740 1 -- 172.21.15.47:0/81712617 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572aeaca8b0 con 0x5572aeb6d920 2024-07-24T22:08:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.093+0000 7f86ccf56640 1 --2- 172.21.15.47:0/81712617 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572aeb6d920 0x5572aeb6fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.094+0000 7f86ccf56640 1 --2- 172.21.15.47:0/81712617 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572aeb6d920 0x5572aeb6fdc0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bf7913dc4e31443 server_cookie=3194415032478747 in_seq=0 out_seq=0 2024-07-24T22:08:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.094+0000 7f86a7fff640 10 client.15876 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.094+0000 7f86a7fff640 1 -- 172.21.15.47:0/81712617 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572aeaca8b0 con 0x5572aeb6d920 2024-07-24T22:08:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.094+0000 7f86a7fff640 10 client.15876 handle_command_reply: tid=0 2024-07-24T22:08:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.094+0000 7f86d156b740 1 client.15876 shutdown 2024-07-24T22:08:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.095+0000 7f86d156b740 1 -- 172.21.15.47:0/81712617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 msgr2=0x5572aeb5b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.095+0000 7f86d156b740 1 --2- 172.21.15.47:0/81712617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb5b430 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f86b400be60 tx=0x7f86b40a9b60 comp rx=0 tx=0).stop 2024-07-24T22:08:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.095+0000 7f86d156b740 1 -- 172.21.15.47:0/81712617 shutdown_connections 2024-07-24T22:08:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.095+0000 7f86d156b740 1 --2- 172.21.15.47:0/81712617 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572aeb6d920 0x5572aeb6fdc0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.095+0000 7f86d156b740 1 --2- 172.21.15.47:0/81712617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb5b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.095+0000 7f86d156b740 1 --2- 172.21.15.47:0/81712617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb5b430 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.095+0000 7f86d156b740 1 --2- 172.21.15.47:0/81712617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb5aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.095+0000 7f86a7fff640 0 client.15876 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.095+0000 7f86d156b740 1 -- 172.21.15.47:0/81712617 >> 172.21.15.47:0/81712617 conn(0x5572aeb4f4b0 msgr2=0x5572aeb55050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.095+0000 7f86d156b740 1 -- 172.21.15.47:0/81712617 shutdown_connections 2024-07-24T22:08:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.095+0000 7f86d156b740 1 -- 172.21.15.47:0/81712617 wait complete. 2024-07-24T22:08:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.095+0000 7f86d156b740 20 client.15876 trim_cache size 0 max 16384 2024-07-24T22:08:49.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86d156b740 1 Processor -- start 2024-07-24T22:08:49.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86d156b740 1 -- start start 2024-07-24T22:08:49.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86d156b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb75640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86d156b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb75b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86d156b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb59770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86d156b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81ae360 con 0x5572aeb51fa0 2024-07-24T22:08:49.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86d156b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81b0be0 con 0x5572aeb51680 2024-07-24T22:08:49.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86d156b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81ae9d0 con 0x5572aeb5df30 2024-07-24T22:08:49.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb75b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb75b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59134/0 (socket says 172.21.15.47:59134) 2024-07-24T22:08:49.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86c7fff640 1 -- 172.21.15.47:0/2780636075 learned_addr learned my addr 172.21.15.47:0/2780636075 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:49.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86ccf56640 1 --2- 172.21.15.47:0/2780636075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb75640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86cd757640 1 --2- 172.21.15.47:0/2780636075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb59770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86c7fff640 1 -- 172.21.15.47:0/2780636075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 msgr2=0x5572aeb59770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:49.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86c7fff640 1 --2- 172.21.15.47:0/2780636075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb59770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86c7fff640 1 -- 172.21.15.47:0/2780636075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 msgr2=0x5572aeb75640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:49.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86c7fff640 1 --2- 172.21.15.47:0/2780636075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb75640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.115+0000 7f86c7fff640 1 -- 172.21.15.47:0/2780636075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572aeb593f0 con 0x5572aeb51fa0 2024-07-24T22:08:49.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.116+0000 7f86cd757640 1 --2- 172.21.15.47:0/2780636075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb59770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:49.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.116+0000 7f86c7fff640 1 --2- 172.21.15.47:0/2780636075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb75b80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f86b40a75a0 tx=0x7f86b4017650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e175fd258ca916be server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:49.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.116+0000 7f86b27fc640 1 -- 172.21.15.47:0/2780636075 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b401e030 con 0x5572aeb51fa0 2024-07-24T22:08:49.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.116+0000 7f86b27fc640 1 -- 172.21.15.47:0/2780636075 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86b40b3330 con 0x5572aeb51fa0 2024-07-24T22:08:49.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.116+0000 7f86b27fc640 1 -- 172.21.15.47:0/2780636075 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b40a9590 con 0x5572aeb51fa0 2024-07-24T22:08:49.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.117+0000 7f86d156b740 1 -- 172.21.15.47:0/2780636075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 msgr2=0x5572aeb75b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:49.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.117+0000 7f86d156b740 1 --2- 172.21.15.47:0/2780636075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb75b80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f86b40a75a0 tx=0x7f86b4017650 comp rx=0 tx=0).stop 2024-07-24T22:08:49.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.117+0000 7f86d156b740 1 -- 172.21.15.47:0/2780636075 shutdown_connections 2024-07-24T22:08:49.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.117+0000 7f86d156b740 1 --2- 172.21.15.47:0/2780636075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb59770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.117+0000 7f86d156b740 1 --2- 172.21.15.47:0/2780636075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb75b80 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.117+0000 7f86d156b740 1 --2- 172.21.15.47:0/2780636075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb75640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.117+0000 7f86d156b740 1 -- 172.21.15.47:0/2780636075 >> 172.21.15.47:0/2780636075 conn(0x5572aeb4f4b0 msgr2=0x5572aeb5cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:49.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.117+0000 7f86d156b740 1 -- 172.21.15.47:0/2780636075 shutdown_connections 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.117+0000 7f86d156b740 1 -- 172.21.15.47:0/2780636075 wait complete. 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.117+0000 7f86d156b740 1 -- start start 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.117+0000 7f86d156b740 1 Processor -- start 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86d156b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb660e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86d156b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb66660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86d156b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb61760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb66660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb66660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59144/0 (socket says 172.21.15.47:59144) 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86c7fff640 1 -- 172.21.15.47:0/3151702968 learned_addr learned my addr 172.21.15.47:0/3151702968 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86d156b740 1 -- 172.21.15.47:0/3151702968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81af0a0 con 0x5572aeb51fa0 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86d156b740 1 -- 172.21.15.47:0/3151702968 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81b0510 con 0x5572aeb51680 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86d156b740 1 -- 172.21.15.47:0/3151702968 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81af770 con 0x5572aeb5df30 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86d156b740 10 client.0 _ll_register_callbacks cb 0x7f86b4017550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86ccf56640 1 --2- 172.21.15.47:0/3151702968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86c7fff640 1 -- 172.21.15.47:0/3151702968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 msgr2=0x5572aeb61760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86c7fff640 1 --2- 172.21.15.47:0/3151702968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb61760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86c7fff640 1 -- 172.21.15.47:0/3151702968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 msgr2=0x5572aeb660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86c7fff640 1 --2- 172.21.15.47:0/3151702968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb660e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.118+0000 7f86c7fff640 1 -- 172.21.15.47:0/3151702968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572aeb61f90 con 0x5572aeb51fa0 2024-07-24T22:08:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.119+0000 7f86c7fff640 1 --2- 172.21.15.47:0/3151702968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb66660 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f86b400be60 tx=0x7f86b40e34c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22449d7904a694e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.119+0000 7f86a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.119+0000 7f86a7fff640 1 -- 172.21.15.47:0/3151702968 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b401e070 con 0x5572aeb51fa0 2024-07-24T22:08:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.119+0000 7f86a7fff640 1 -- 172.21.15.47:0/3151702968 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f86b40a65c0 con 0x5572aeb51fa0 2024-07-24T22:08:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.119+0000 7f86d156b740 1 -- 172.21.15.47:0/3151702968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86b40b3330 con 0x5572aeb51fa0 2024-07-24T22:08:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.119+0000 7f86a7fff640 1 -- 172.21.15.47:0/3151702968 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f86b4010610 con 0x5572aeb51fa0 2024-07-24T22:08:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.119+0000 7f86d156b740 10 client.15882 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.120+0000 7f86d156b740 1 -- 172.21.15.47:0/3151702968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5572aebe0a70 con 0x5572aeb51fa0 2024-07-24T22:08:49.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.120+0000 7f86a7fff640 1 -- 172.21.15.47:0/3151702968 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86b40b3330 con 0x5572aeb51fa0 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.120+0000 7f86a7fff640 1 -- 172.21.15.47:0/3151702968 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f86b40a9000 con 0x5572aeb51fa0 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.120+0000 7f86d156b740 10 client.15882 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.120+0000 7f86d156b740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.120+0000 7f86d156b740 20 client.15882 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.120+0000 7f86d156b740 1 --2- 172.21.15.47:0/3151702968 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572aebe0de0 0x5572aebe3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.120+0000 7f86d156b740 4 client.15882 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.120+0000 7f86d156b740 1 -- 172.21.15.47:0/3151702968 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5572aeac6350 con 0x5572aebe0de0 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.120+0000 7f86ccf56640 1 --2- 172.21.15.47:0/3151702968 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572aebe0de0 0x5572aebe3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86a7fff640 10 client.15882 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86ccf56640 1 --2- 172.21.15.47:0/3151702968 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572aebe0de0 0x5572aebe3200 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeaf58fcb93baedc server_cookie=c03c2480581362ac in_seq=0 out_seq=0 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86a7fff640 1 -- 172.21.15.47:0/3151702968 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5572aeac6350 con 0x5572aebe0de0 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86a7fff640 10 client.15882 handle_command_reply: tid=0 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86d156b740 1 client.15882 shutdown 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86d156b740 1 -- 172.21.15.47:0/3151702968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 msgr2=0x5572aeb66660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86d156b740 1 --2- 172.21.15.47:0/3151702968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb66660 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f86b400be60 tx=0x7f86b40e34c0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86d156b740 1 -- 172.21.15.47:0/3151702968 shutdown_connections 2024-07-24T22:08:49.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86d156b740 1 --2- 172.21.15.47:0/3151702968 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572aebe0de0 0x5572aebe3200 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86d156b740 1 --2- 172.21.15.47:0/3151702968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572aeb5df30 0x5572aeb61760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86d156b740 1 --2- 172.21.15.47:0/3151702968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572aeb51fa0 0x5572aeb66660 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86d156b740 1 --2- 172.21.15.47:0/3151702968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572aeb51680 0x5572aeb660e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86d156b740 1 -- 172.21.15.47:0/3151702968 >> 172.21.15.47:0/3151702968 conn(0x5572aeb4f4b0 msgr2=0x5572aeb5ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:49.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.121+0000 7f86a7fff640 0 client.15882 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:49.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.122+0000 7f86d156b740 1 -- 172.21.15.47:0/3151702968 shutdown_connections 2024-07-24T22:08:49.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.122+0000 7f86d156b740 1 -- 172.21.15.47:0/3151702968 wait complete. 2024-07-24T22:08:49.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.122+0000 7f86d156b740 20 client.15882 trim_cache size 0 max 16384 2024-07-24T22:08:49.129 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:08:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:08:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:08:49.129 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:08:49.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.122+0000 7f86cf1ba640 1 -- 172.21.15.47:0/4023051882 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86b80b3d40 msgr2=0x7f86b80b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.123+0000 7f86cf1ba640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86b80b3d40 0x7f86b80b6200 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f86c0005fd0 tx=0x7f86c0009600 comp rx=0 tx=0).stop 2024-07-24T22:08:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.123+0000 7f86cf1ba640 1 -- 172.21.15.47:0/4023051882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c81081a0 msgr2=0x7f86c8199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.123+0000 7f86cf1ba640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c81081a0 0x7f86c8199270 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f86b400b4a0 tx=0x7f86b400b960 comp rx=0 tx=0).stop 2024-07-24T22:08:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.123+0000 7f86cf1ba640 1 -- 172.21.15.47:0/4023051882 shutdown_connections 2024-07-24T22:08:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.123+0000 7f86cf1ba640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86b80b3d40 0x7f86b80b6200 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.123+0000 7f86cf1ba640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86c8108b20 0x7f86c819e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.123+0000 7f86cf1ba640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86c81081a0 0x7f86c8199270 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.123+0000 7f86cf1ba640 1 --2- 172.21.15.47:0/4023051882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86c8102790 0x7f86c8198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.123+0000 7f86cf1ba640 1 -- 172.21.15.47:0/4023051882 >> 172.21.15.47:0/4023051882 conn(0x7f86c80fe200 msgr2=0x7f86c81005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.123+0000 7f86cf1ba640 1 -- 172.21.15.47:0/4023051882 shutdown_connections 2024-07-24T22:08:49.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:49.123+0000 7f86cf1ba640 1 -- 172.21.15.47:0/4023051882 wait complete. 2024-07-24T22:08:49.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:49 smithi047 ceph-mon[32551]: pgmap v414: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-07-24T22:08:49.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:49 smithi188 ceph-mon[37380]: pgmap v414: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-07-24T22:08:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:49 smithi183 ceph-mon[37007]: pgmap v414: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-07-24T22:08:50.620 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:08:50.620 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:08:51.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.545+0000 7fbde087e640 1 -- 172.21.15.47:0/2108421793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbddc102790 msgr2=0x7fbddc102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:51.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.545+0000 7fbde087e640 1 --2- 172.21.15.47:0/2108421793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbddc102790 0x7fbddc102b70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009900 tx=0x7fbdcc02a410 comp rx=0 tx=0).stop 2024-07-24T22:08:51.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.545+0000 7fbde087e640 1 -- 172.21.15.47:0/2108421793 shutdown_connections 2024-07-24T22:08:51.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.545+0000 7fbde087e640 1 --2- 172.21.15.47:0/2108421793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbddc108b20 0x7fbddc10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.545+0000 7fbde087e640 1 --2- 172.21.15.47:0/2108421793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbddc1081a0 0x7fbddc1085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.545+0000 7fbde087e640 1 --2- 172.21.15.47:0/2108421793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbddc102790 0x7fbddc102b70 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.545+0000 7fbde087e640 1 -- 172.21.15.47:0/2108421793 >> 172.21.15.47:0/2108421793 conn(0x7fbddc0fe200 msgr2=0x7fbddc100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.545+0000 7fbde087e640 1 -- 172.21.15.47:0/2108421793 shutdown_connections 2024-07-24T22:08:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.545+0000 7fbde087e640 1 -- 172.21.15.47:0/2108421793 wait complete. 2024-07-24T22:08:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.546+0000 7fbde087e640 1 Processor -- start 2024-07-24T22:08:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.546+0000 7fbde087e640 1 -- start start 2024-07-24T22:08:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.546+0000 7fbde087e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbddc102790 0x7fbddc074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.546+0000 7fbde087e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbddc1081a0 0x7fbddc0753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.546+0000 7fbde087e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbddc108b20 0x7fbddc075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.546+0000 7fbde087e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc112740 con 0x7fbddc1081a0 2024-07-24T22:08:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.546+0000 7fbde087e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc1125c0 con 0x7fbddc102790 2024-07-24T22:08:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.546+0000 7fbde087e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc1128c0 con 0x7fbddc108b20 2024-07-24T22:08:51.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.546+0000 7fbdd9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbddc1081a0 0x7fbddc0753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.546+0000 7fbdd9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbddc1081a0 0x7fbddc0753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59174/0 (socket says 172.21.15.47:59174) 2024-07-24T22:08:51.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.546+0000 7fbdd9d9b640 1 -- 172.21.15.47:0/3531150626 learned_addr learned my addr 172.21.15.47:0/3531150626 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:51.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.546+0000 7fbdda59c640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbddc102790 0x7fbddc074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.546+0000 7fbddad9d640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbddc108b20 0x7fbddc075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.547+0000 7fbdd9d9b640 1 -- 172.21.15.47:0/3531150626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbddc108b20 msgr2=0x7fbddc075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:51.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.547+0000 7fbdd9d9b640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbddc108b20 0x7fbddc075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.547+0000 7fbdd9d9b640 1 -- 172.21.15.47:0/3531150626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbddc102790 msgr2=0x7fbddc074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:51.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.547+0000 7fbdd9d9b640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbddc102790 0x7fbddc074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.547+0000 7fbdd9d9b640 1 -- 172.21.15.47:0/3531150626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbddc1a7050 con 0x7fbddc1081a0 2024-07-24T22:08:51.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.547+0000 7fbdd9d9b640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbddc1081a0 0x7fbddc0753d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000c890 tx=0x7fbdd000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:51.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.547+0000 7fbdcb7fe640 1 -- 172.21.15.47:0/3531150626 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0004220 con 0x7fbddc1081a0 2024-07-24T22:08:51.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.547+0000 7fbdcb7fe640 1 -- 172.21.15.47:0/3531150626 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdd00043c0 con 0x7fbddc1081a0 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.547+0000 7fbde087e640 1 -- 172.21.15.47:0/3531150626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbddc1a7340 con 0x7fbddc1081a0 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.547+0000 7fbdcb7fe640 1 -- 172.21.15.47:0/3531150626 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0004a00 con 0x7fbddc1081a0 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.547+0000 7fbde087e640 1 -- 172.21.15.47:0/3531150626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbddc1a78d0 con 0x7fbddc1081a0 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbdcb7fe640 1 -- 172.21.15.47:0/3531150626 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fbdd00079b0 con 0x7fbddc1081a0 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbde2c2f740 1 Processor -- start 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbde2c2f740 1 -- start start 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbde2c2f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf841fa30 0x55daf841fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbde2c2f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 0x55daf842bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbde2c2f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf842c2e0 0x55daf842e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbde2c2f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55daf8396dd0 con 0x55daf8420350 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbde2c2f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55daf83862d0 con 0x55daf842c2e0 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbde2c2f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55daf838a310 con 0x55daf841fa30 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbdda59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 0x55daf842bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbdda59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 0x55daf842bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59190/0 (socket says 172.21.15.47:59190) 2024-07-24T22:08:51.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbdda59c640 1 -- 172.21.15.47:0/1855641810 learned_addr learned my addr 172.21.15.47:0/1855641810 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:51.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbdd9d9b640 1 --2- 172.21.15.47:0/1855641810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf842c2e0 0x55daf842e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.550+0000 7fbddad9d640 1 --2- 172.21.15.47:0/1855641810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf841fa30 0x55daf841fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.551+0000 7fbdcb7fe640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbdc40b3dc0 0x7fbdc40b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.551+0000 7fbdda59c640 1 -- 172.21.15.47:0/1855641810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf841fa30 msgr2=0x55daf841fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:51.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.551+0000 7fbdda59c640 1 --2- 172.21.15.47:0/1855641810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf841fa30 0x55daf841fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.551+0000 7fbdda59c640 1 -- 172.21.15.47:0/1855641810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf842c2e0 msgr2=0x55daf842e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:51.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.551+0000 7fbdda59c640 1 --2- 172.21.15.47:0/1855641810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf842c2e0 0x55daf842e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.551+0000 7fbdda59c640 1 -- 172.21.15.47:0/1855641810 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daf80e6b00 con 0x55daf8420350 2024-07-24T22:08:51.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.551+0000 7fbddad9d640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbdc40b3dc0 0x7fbdc40b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.551+0000 7fbdcb7fe640 1 -- 172.21.15.47:0/3531150626 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fbdd00e3d60 con 0x7fbddc1081a0 2024-07-24T22:08:51.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.551+0000 7fbdda59c640 1 --2- 172.21.15.47:0/1855641810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 0x55daf842bda0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009900 tx=0x7fbdcc032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d15dd31b882f65a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:51.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.551+0000 7fbdc8ff9640 1 -- 172.21.15.47:0/1855641810 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc040070 con 0x55daf8420350 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.551+0000 7fbddad9d640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbdc40b3dc0 0x7fbdc40b6280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbddc076f50 tx=0x7fbdd4004a40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.551+0000 7fbdc8ff9640 1 -- 172.21.15.47:0/1855641810 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdcc0316a0 con 0x55daf8420350 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.551+0000 7fbdc8ff9640 1 -- 172.21.15.47:0/1855641810 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc035040 con 0x55daf8420350 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.552+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1855641810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 msgr2=0x55daf842bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.552+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1855641810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 0x55daf842bda0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009900 tx=0x7fbdcc032e60 comp rx=0 tx=0).stop 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.552+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1855641810 shutdown_connections 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.552+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1855641810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf842c2e0 0x55daf842e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.552+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1855641810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 0x55daf842bda0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.552+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1855641810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf841fa30 0x55daf841fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.552+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1855641810 >> 172.21.15.47:0/1855641810 conn(0x55daf841d860 msgr2=0x55daf841ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.552+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1855641810 shutdown_connections 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.552+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1855641810 wait complete. 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.552+0000 7fbde2c2f740 1 -- start start 2024-07-24T22:08:51.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbde2c2f740 1 Processor -- start 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbde2c2f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf841fa30 0x55daf8429230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbde2c2f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf8420350 0x55daf8429770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbde2c2f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf842c2e0 0x55daf8429cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbde2c2f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55daf81e9bb0 con 0x55daf842c2e0 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbde2c2f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55daf8328900 con 0x55daf841fa30 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbde2c2f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55daf842ef00 con 0x55daf8420350 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbde2c2f740 10 client.0 _ll_register_callbacks cb 0x55daf8332c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbddad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf842c2e0 0x55daf8429cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbddad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf842c2e0 0x55daf8429cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59196/0 (socket says 172.21.15.47:59196) 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbddad9d640 1 -- 172.21.15.47:0/311707523 learned_addr learned my addr 172.21.15.47:0/311707523 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbdd9d9b640 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf8420350 0x55daf8429770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbdda59c640 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf841fa30 0x55daf8429230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbddad9d640 1 -- 172.21.15.47:0/311707523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf8420350 msgr2=0x55daf8429770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbddad9d640 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf8420350 0x55daf8429770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbddad9d640 1 -- 172.21.15.47:0/311707523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf841fa30 msgr2=0x55daf8429230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbddad9d640 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf841fa30 0x55daf8429230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbddad9d640 1 -- 172.21.15.47:0/311707523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daf815d960 con 0x55daf842c2e0 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbdda59c640 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf841fa30 0x55daf8429230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbddad9d640 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf842c2e0 0x55daf8429cb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4013970 tx=0x7fbdd4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57627105a24bdc52 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.553+0000 7fbdc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbdc1ffb640 1 -- 172.21.15.47:0/311707523 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd401ed70 con 0x55daf842c2e0 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbdc1ffb640 1 -- 172.21.15.47:0/311707523 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fbdd4028470 con 0x55daf842c2e0 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbde2c2f740 1 -- 172.21.15.47:0/311707523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdcc0316a0 con 0x55daf842c2e0 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbdc1ffb640 1 -- 172.21.15.47:0/311707523 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbdd4028670 con 0x55daf842c2e0 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbde2c2f740 10 client.15894 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbde2c2f740 1 -- 172.21.15.47:0/311707523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55daf843aad0 con 0x55daf842c2e0 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbdc1ffb640 1 -- 172.21.15.47:0/311707523 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdcc0316a0 con 0x55daf842c2e0 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbdc1ffb640 1 -- 172.21.15.47:0/311707523 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbdd400f040 con 0x55daf842c2e0 2024-07-24T22:08:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbde2c2f740 10 client.15894 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbde2c2f740 10 client.15894 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:08:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbde2c2f740 20 client.15894 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55daf843bf90 0x55daf843e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbde2c2f740 4 client.15894 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.554+0000 7fbde2c2f740 1 -- 172.21.15.47:0/311707523 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55daf8398d20 con 0x55daf843bf90 2024-07-24T22:08:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.555+0000 7fbdda59c640 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55daf843bf90 0x55daf843e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.555+0000 7fbdda59c640 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55daf843bf90 0x55daf843e3d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ee90da6b15bcf3a server_cookie=27d845b3b02fac8e in_seq=0 out_seq=0 2024-07-24T22:08:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.555+0000 7fbdc1ffb640 10 client.15894 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbdc1ffb640 1 -- 172.21.15.47:0/311707523 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55daf8398d20 con 0x55daf843bf90 2024-07-24T22:08:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbdc1ffb640 10 client.15894 handle_command_reply: tid=0 2024-07-24T22:08:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbde2c2f740 1 client.15894 shutdown 2024-07-24T22:08:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbde2c2f740 1 -- 172.21.15.47:0/311707523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf842c2e0 msgr2=0x55daf8429cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf842c2e0 0x55daf8429cb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4013970 tx=0x7fbdd4004ab0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbde2c2f740 1 -- 172.21.15.47:0/311707523 shutdown_connections 2024-07-24T22:08:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55daf843bf90 0x55daf843e3d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf842c2e0 0x55daf8429cb0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf8420350 0x55daf8429770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/311707523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf841fa30 0x55daf8429230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbdc1ffb640 0 client.15894 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbde2c2f740 1 -- 172.21.15.47:0/311707523 >> 172.21.15.47:0/311707523 conn(0x55daf841d860 msgr2=0x55daf8423400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbde2c2f740 1 -- 172.21.15.47:0/311707523 shutdown_connections 2024-07-24T22:08:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbde2c2f740 1 -- 172.21.15.47:0/311707523 wait complete. 2024-07-24T22:08:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.556+0000 7fbde2c2f740 20 client.15894 trim_cache size 0 max 16384 2024-07-24T22:08:51.574 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.575+0000 7fbde2c2f740 1 Processor -- start 2024-07-24T22:08:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.575+0000 7fbde2c2f740 1 -- start start 2024-07-24T22:08:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.575+0000 7fbde2c2f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf841fa30 0x55daf8423b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.575+0000 7fbde2c2f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 0x55daf84298b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.575+0000 7fbde2c2f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf842c2e0 0x55daf8443ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.575+0000 7fbde2c2f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc1ae340 con 0x55daf8420350 2024-07-24T22:08:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.575+0000 7fbde2c2f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc1b0bc0 con 0x55daf842c2e0 2024-07-24T22:08:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.575+0000 7fbde2c2f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc1ae9b0 con 0x55daf841fa30 2024-07-24T22:08:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.575+0000 7fbdd9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 0x55daf84298b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.575+0000 7fbdd9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 0x55daf84298b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59200/0 (socket says 172.21.15.47:59200) 2024-07-24T22:08:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.575+0000 7fbdd9d9b640 1 -- 172.21.15.47:0/1650461927 learned_addr learned my addr 172.21.15.47:0/1650461927 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.575+0000 7fbdda59c640 1 --2- 172.21.15.47:0/1650461927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf841fa30 0x55daf8423b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.576+0000 7fbddad9d640 1 --2- 172.21.15.47:0/1650461927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf842c2e0 0x55daf8443ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.576+0000 7fbdd9d9b640 1 -- 172.21.15.47:0/1650461927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf841fa30 msgr2=0x55daf8423b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.576+0000 7fbdd9d9b640 1 --2- 172.21.15.47:0/1650461927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf841fa30 0x55daf8423b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.576+0000 7fbdd9d9b640 1 -- 172.21.15.47:0/1650461927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf842c2e0 msgr2=0x55daf8443ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.576+0000 7fbdd9d9b640 1 --2- 172.21.15.47:0/1650461927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf842c2e0 0x55daf8443ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.576+0000 7fbdd9d9b640 1 -- 172.21.15.47:0/1650461927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daf8419190 con 0x55daf8420350 2024-07-24T22:08:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.576+0000 7fbddad9d640 1 --2- 172.21.15.47:0/1650461927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf842c2e0 0x55daf8443ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:08:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.576+0000 7fbdd9d9b640 1 --2- 172.21.15.47:0/1650461927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 0x55daf84298b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0000c00 tx=0x7fbdd00e7810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bc2ccb7552d342 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.576+0000 7fbdc3fff640 1 -- 172.21.15.47:0/1650461927 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd001d040 con 0x55daf8420350 2024-07-24T22:08:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.576+0000 7fbdc3fff640 1 -- 172.21.15.47:0/1650461927 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdd00b3310 con 0x55daf8420350 2024-07-24T22:08:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.576+0000 7fbdc3fff640 1 -- 172.21.15.47:0/1650461927 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00aa910 con 0x55daf8420350 2024-07-24T22:08:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.577+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1650461927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 msgr2=0x55daf84298b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.577+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1650461927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 0x55daf84298b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0000c00 tx=0x7fbdd00e7810 comp rx=0 tx=0).stop 2024-07-24T22:08:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.577+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1650461927 shutdown_connections 2024-07-24T22:08:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.577+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1650461927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf842c2e0 0x55daf8443ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.577+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1650461927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf8420350 0x55daf84298b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.577+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1650461927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf841fa30 0x55daf8423b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.577+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1650461927 >> 172.21.15.47:0/1650461927 conn(0x55daf841d860 msgr2=0x55daf84291a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.577+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1650461927 shutdown_connections 2024-07-24T22:08:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.577+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1650461927 wait complete. 2024-07-24T22:08:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.577+0000 7fbde2c2f740 1 -- start start 2024-07-24T22:08:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbde2c2f740 1 Processor -- start 2024-07-24T22:08:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbde2c2f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf841fa30 0x55daf84316c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbde2c2f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf8420350 0x55daf8431c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbde2c2f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf842c2e0 0x55daf8432140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbde2c2f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc1af080 con 0x55daf841fa30 2024-07-24T22:08:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbde2c2f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc1b04f0 con 0x55daf8420350 2024-07-24T22:08:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbde2c2f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc1af750 con 0x55daf842c2e0 2024-07-24T22:08:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbde2c2f740 10 client.0 _ll_register_callbacks cb 0x7fbdd4013620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbdda59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf841fa30 0x55daf84316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbdda59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf841fa30 0x55daf84316c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59210/0 (socket says 172.21.15.47:59210) 2024-07-24T22:08:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbdda59c640 1 -- 172.21.15.47:0/1166074816 learned_addr learned my addr 172.21.15.47:0/1166074816 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbddad9d640 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf842c2e0 0x55daf8432140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbdd9d9b640 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf8420350 0x55daf8431c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbddad9d640 1 -- 172.21.15.47:0/1166074816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf8420350 msgr2=0x55daf8431c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbddad9d640 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf8420350 0x55daf8431c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbddad9d640 1 -- 172.21.15.47:0/1166074816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf841fa30 msgr2=0x55daf84316c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbddad9d640 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf841fa30 0x55daf84316c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbddad9d640 1 -- 172.21.15.47:0/1166074816 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daf84a5dd0 con 0x55daf842c2e0 2024-07-24T22:08:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.578+0000 7fbdda59c640 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf841fa30 0x55daf84316c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:08:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.579+0000 7fbddad9d640 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf842c2e0 0x55daf8432140 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbdd401c5a0 tx=0x7fbdd40284f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6477e78c662741c4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.579+0000 7fbdc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:08:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.579+0000 7fbdc1ffb640 1 -- 172.21.15.47:0/1166074816 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd401eb70 con 0x55daf842c2e0 2024-07-24T22:08:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.579+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1166074816 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdd00b3310 con 0x55daf842c2e0 2024-07-24T22:08:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.579+0000 7fbdc1ffb640 1 -- 172.21.15.47:0/1166074816 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fbdd401ed10 con 0x55daf842c2e0 2024-07-24T22:08:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.579+0000 7fbdc1ffb640 1 -- 172.21.15.47:0/1166074816 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbdd4028810 con 0x55daf842c2e0 2024-07-24T22:08:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.579+0000 7fbde2c2f740 10 client.25441 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.579+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1166074816 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55daf84a7080 con 0x55daf842c2e0 2024-07-24T22:08:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.579+0000 7fbdc1ffb640 1 -- 172.21.15.47:0/1166074816 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdd00b3310 con 0x55daf842c2e0 2024-07-24T22:08:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.580+0000 7fbdc1ffb640 1 -- 172.21.15.47:0/1166074816 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbdd40399e0 con 0x55daf842c2e0 2024-07-24T22:08:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.580+0000 7fbde2c2f740 10 client.25441 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.580+0000 7fbde2c2f740 10 client.25441 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:08:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.580+0000 7fbde2c2f740 20 client.25441 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.580+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55daf84a77a0 0x55daf84a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.580+0000 7fbde2c2f740 4 client.25441 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9a3ad881", "release": true, "await": true}] 2024-07-24T22:08:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.580+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1166074816 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9a3ad881", "release": true, "await": true}) -- 0x55daf83947c0 con 0x55daf84a77a0 2024-07-24T22:08:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.580+0000 7fbdda59c640 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55daf84a77a0 0x55daf84a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:51.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.580+0000 7fbdda59c640 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55daf84a77a0 0x55daf84a9bc0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64686cc375d92a40 server_cookie=774b3d467c1c8c7d in_seq=0 out_seq=0 2024-07-24T22:08:51.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.580+0000 7fbdc1ffb640 10 client.25441 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:51.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbdc1ffb640 1 -- 172.21.15.47:0/1166074816 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55daf83947c0 con 0x55daf84a77a0 2024-07-24T22:08:51.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbdc1ffb640 10 client.25441 handle_command_reply: tid=0 2024-07-24T22:08:51.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbde2c2f740 1 client.25441 shutdown 2024-07-24T22:08:51.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1166074816 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf842c2e0 msgr2=0x55daf8432140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:51.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf842c2e0 0x55daf8432140 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbdd401c5a0 tx=0x7fbdd40284f0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1166074816 shutdown_connections 2024-07-24T22:08:51.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55daf84a77a0 0x55daf84a9bc0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55daf842c2e0 0x55daf8432140 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55daf8420350 0x55daf8431c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbde2c2f740 1 --2- 172.21.15.47:0/1166074816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55daf841fa30 0x55daf84316c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1166074816 >> 172.21.15.47:0/1166074816 conn(0x55daf841d860 msgr2=0x55daf8437860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:51.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbdc1ffb640 0 client.25441 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:51.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1166074816 shutdown_connections 2024-07-24T22:08:51.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbde2c2f740 1 -- 172.21.15.47:0/1166074816 wait complete. 2024-07-24T22:08:51.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.583+0000 7fbde2c2f740 20 client.25441 trim_cache size 0 max 16384 2024-07-24T22:08:51.589 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:08:51.589 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:08:51.589 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:08:51.589 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 8, 2024-07-24T22:08:51.589 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:08:51.589 INFO:teuthology.orchestra.run.smithi047.stdout: "9a3ad881": { 2024-07-24T22:08:51.590 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 8, 2024-07-24T22:08:51.590 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:08:51.590 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:08:51.590 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:08:51.590 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:08:51.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:08:51.590 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:08:51.590 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 140.3, 2024-07-24T22:08:51.590 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:08:51.590 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:08:51.590 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:08:51.590 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:08:51.591 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:08:51.591 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:08:51.591 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:51.591 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:51.591 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:51.591 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:51.591 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:08:51.591 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:08:51.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.584+0000 7fbde087e640 1 -- 172.21.15.47:0/3531150626 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbdc40b3dc0 msgr2=0x7fbdc40b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:51.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.584+0000 7fbde087e640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbdc40b3dc0 0x7fbdc40b6280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbddc076f50 tx=0x7fbdd4004a40 comp rx=0 tx=0).stop 2024-07-24T22:08:51.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.584+0000 7fbde087e640 1 -- 172.21.15.47:0/3531150626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbddc1081a0 msgr2=0x7fbddc0753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:51.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.584+0000 7fbde087e640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbddc1081a0 0x7fbddc0753d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000c890 tx=0x7fbdd000cd50 comp rx=0 tx=0).stop 2024-07-24T22:08:51.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.584+0000 7fbde087e640 1 -- 172.21.15.47:0/3531150626 shutdown_connections 2024-07-24T22:08:51.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.584+0000 7fbde087e640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbdc40b3dc0 0x7fbdc40b6280 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.584+0000 7fbde087e640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbddc108b20 0x7fbddc075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.584+0000 7fbde087e640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbddc1081a0 0x7fbddc0753d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.584+0000 7fbde087e640 1 --2- 172.21.15.47:0/3531150626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbddc102790 0x7fbddc074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:51.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.584+0000 7fbde087e640 1 -- 172.21.15.47:0/3531150626 >> 172.21.15.47:0/3531150626 conn(0x7fbddc0fe200 msgr2=0x7fbddc0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:51.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.585+0000 7fbde087e640 1 -- 172.21.15.47:0/3531150626 shutdown_connections 2024-07-24T22:08:51.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:51.585+0000 7fbde087e640 1 -- 172.21.15.47:0/3531150626 wait complete. 2024-07-24T22:08:51.593 INFO:tasks.workunit.client.0.smithi047.stdout:getting iogen 2024-07-24T22:08:51.593 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'getting iogen' 2024-07-24T22:08:51.593 INFO:tasks.workunit.client.0.smithi047.stderr:+ wget http://download.ceph.com/qa/iogen_3.1p0.tar 2024-07-24T22:08:51.598 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:51 smithi047 ceph-mon[32551]: pgmap v415: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 341 B/s wr, 3 op/s 2024-07-24T22:08:51.660 INFO:tasks.workunit.client.0.smithi047.stderr:--2024-07-24 22:08:51-- http://download.ceph.com/qa/iogen_3.1p0.tar 2024-07-24T22:08:51.661 INFO:tasks.workunit.client.0.smithi047.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-07-24T22:08:51.684 INFO:tasks.workunit.client.0.smithi047.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-07-24T22:08:51.706 INFO:tasks.workunit.client.0.smithi047.stderr:HTTP request sent, awaiting response... 200 OK 2024-07-24T22:08:51.706 INFO:tasks.workunit.client.0.smithi047.stderr:Length: 8071 (7.9K) [application/octet-stream] 2024-07-24T22:08:51.707 INFO:tasks.workunit.client.0.smithi047.stderr:Saving to: ‘iogen_3.1p0.tar’ 2024-07-24T22:08:51.710 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-07-24T22:08:51.710 INFO:tasks.workunit.client.0.smithi047.stderr: 0K ....... 100% 1.26G=0s 2024-07-24T22:08:51.710 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-07-24T22:08:51.710 INFO:tasks.workunit.client.0.smithi047.stderr:2024-07-24 22:08:51 (1.26 GB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2024-07-24T22:08:51.710 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-07-24T22:08:51.710 INFO:tasks.workunit.client.0.smithi047.stderr:+ tar -xvzf iogen_3.1p0.tar 2024-07-24T22:08:51.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:51 smithi188 ceph-mon[37380]: pgmap v415: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 341 B/s wr, 3 op/s 2024-07-24T22:08:51.833 INFO:tasks.workunit.client.0.smithi047.stdout:iogen_3.1p0 2024-07-24T22:08:51.835 INFO:tasks.workunit.client.0.smithi047.stdout:iogen_3.1p0/src 2024-07-24T22:08:51.836 INFO:tasks.workunit.client.0.smithi047.stdout:iogen_3.1p0/src/iogen.8 2024-07-24T22:08:51.838 INFO:tasks.workunit.client.0.smithi047.stdout:iogen_3.1p0/src/iogen.c 2024-07-24T22:08:51.839 INFO:tasks.workunit.client.0.smithi047.stdout:iogen_3.1p0/README 2024-07-24T22:08:51.841 INFO:tasks.workunit.client.0.smithi047.stdout:iogen_3.1p0/Makefile.bsd 2024-07-24T22:08:51.842 INFO:tasks.workunit.client.0.smithi047.stdout:iogen_3.1p0/Makefile 2024-07-24T22:08:51.844 INFO:tasks.workunit.client.0.smithi047.stderr:+ cd iogen_3.1p0 2024-07-24T22:08:51.844 INFO:tasks.workunit.client.0.smithi047.stdout:making iogen 2024-07-24T22:08:51.844 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'making iogen' 2024-07-24T22:08:51.844 INFO:tasks.workunit.client.0.smithi047.stderr:+ make 2024-07-24T22:08:51.852 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2024-07-24T22:08:51.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:51 smithi183 ceph-mon[37007]: pgmap v415: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 341 B/s wr, 3 op/s 2024-07-24T22:08:52.495 INFO:tasks.workunit.client.0.smithi047.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2024-07-24T22:08:52.765 INFO:tasks.workunit.client.0.smithi047.stdout:running iogen 2024-07-24T22:08:52.765 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'running iogen' 2024-07-24T22:08:52.766 INFO:tasks.workunit.client.0.smithi047.stderr:+ ./iogen -n 5 -s 2g 2024-07-24T22:08:52.766 INFO:tasks.workunit.client.0.smithi047.stderr:child spawned 100789 2024-07-24T22:08:52.766 INFO:tasks.workunit.client.0.smithi047.stderr:child spawned 100790 2024-07-24T22:08:52.767 INFO:tasks.workunit.client.0.smithi047.stderr:child spawned 100791 2024-07-24T22:08:52.767 INFO:tasks.workunit.client.0.smithi047.stderr:child spawned 100792 2024-07-24T22:08:52.767 INFO:tasks.workunit.client.0.smithi047.stderr:child spawned 100793 2024-07-24T22:08:52.767 INFO:tasks.workunit.client.0.smithi047.stdout:sleep for 10 min 2024-07-24T22:08:52.767 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'sleep for 10 min' 2024-07-24T22:08:52.767 INFO:tasks.workunit.client.0.smithi047.stderr:+ sleep 600 2024-07-24T22:08:53.421 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9a3ad881', total seconds elapsed: 31.2 2024-07-24T22:08:53.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:53 smithi047 ceph-mon[32551]: pgmap v416: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 4 op/s 2024-07-24T22:08:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:53 smithi188 ceph-mon[37380]: pgmap v416: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 4 op/s 2024-07-24T22:08:53.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:53 smithi183 ceph-mon[37007]: pgmap v416: 97 pgs: 97 active+clean; 1.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 4 op/s 2024-07-24T22:08:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.184+0000 7febcaf1e640 1 -- 172.21.15.47:0/4145702107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4113010 msgr2=0x7febc4115490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.184+0000 7febcaf1e640 1 --2- 172.21.15.47:0/4145702107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4113010 0x7febc4115490 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7febbc01acb0 tx=0x7febbc03b920 comp rx=0 tx=0).stop 2024-07-24T22:08:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.185+0000 7febcaf1e640 1 -- 172.21.15.47:0/4145702107 shutdown_connections 2024-07-24T22:08:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.185+0000 7febcaf1e640 1 --2- 172.21.15.47:0/4145702107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4113010 0x7febc4115490 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.185+0000 7febcaf1e640 1 --2- 172.21.15.47:0/4145702107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febc410a510 0x7febc41129f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.185+0000 7febcaf1e640 1 --2- 172.21.15.47:0/4145702107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7febc4109bf0 0x7febc4109fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.185+0000 7febcaf1e640 1 -- 172.21.15.47:0/4145702107 >> 172.21.15.47:0/4145702107 conn(0x7febc40782a0 msgr2=0x7febc407a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:54.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.185+0000 7febcaf1e640 1 -- 172.21.15.47:0/4145702107 shutdown_connections 2024-07-24T22:08:54.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.187+0000 7febcaf1e640 1 -- 172.21.15.47:0/4145702107 wait complete. 2024-07-24T22:08:54.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.188+0000 7febcaf1e640 1 Processor -- start 2024-07-24T22:08:54.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.190+0000 7febcaf1e640 1 -- start start 2024-07-24T22:08:54.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.190+0000 7febcaf1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4109bf0 0x7febc4112510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.190+0000 7febcaf1e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7febc410a510 0x7febc410e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.190+0000 7febcaf1e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febc4113010 0x7febc410ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.190+0000 7febcaf1e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7febc406ee80 con 0x7febc4109bf0 2024-07-24T22:08:54.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.190+0000 7febcaf1e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7febc406ed00 con 0x7febc4113010 2024-07-24T22:08:54.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.190+0000 7febcaf1e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7febc406f000 con 0x7febc410a510 2024-07-24T22:08:54.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.192+0000 7febc94bb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febc4113010 0x7febc410ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.192+0000 7febc8cba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4109bf0 0x7febc4112510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.192+0000 7febc94bb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febc4113010 0x7febc410ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:59724/0 (socket says 172.21.15.47:59724) 2024-07-24T22:08:54.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.192+0000 7febc94bb640 1 -- 172.21.15.47:0/2565551384 learned_addr learned my addr 172.21.15.47:0/2565551384 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:54.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.194+0000 7febc94bb640 1 -- 172.21.15.47:0/2565551384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7febc410a510 msgr2=0x7febc410e790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:08:54.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.194+0000 7febc94bb640 1 --2- 172.21.15.47:0/2565551384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7febc410a510 0x7febc410e790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.194+0000 7febc94bb640 1 -- 172.21.15.47:0/2565551384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4109bf0 msgr2=0x7febc4112510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:54.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.195+0000 7febc94bb640 1 --2- 172.21.15.47:0/2565551384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4109bf0 0x7febc4112510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.195+0000 7febc94bb640 1 -- 172.21.15.47:0/2565551384 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc410f340 con 0x7febc4113010 2024-07-24T22:08:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.196+0000 7febc94bb640 1 --2- 172.21.15.47:0/2565551384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febc4113010 0x7febc410ecd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7febbc006010 tx=0x7febbc003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.201+0000 7febc1ffb640 1 -- 172.21.15.47:0/2565551384 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc045030 con 0x7febc4113010 2024-07-24T22:08:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.201+0000 7febc1ffb640 1 -- 172.21.15.47:0/2565551384 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febbc04f070 con 0x7febc4113010 2024-07-24T22:08:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.201+0000 7febc1ffb640 1 -- 172.21.15.47:0/2565551384 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc0046a0 con 0x7febc4113010 2024-07-24T22:08:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.203+0000 7febcaf1e640 1 -- 172.21.15.47:0/2565551384 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc410f5d0 con 0x7febc4113010 2024-07-24T22:08:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.203+0000 7febcaf1e640 1 -- 172.21.15.47:0/2565551384 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc407d650 con 0x7febc4113010 2024-07-24T22:08:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.210+0000 7febcdc79740 1 Processor -- start 2024-07-24T22:08:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.210+0000 7febcdc79740 1 -- start start 2024-07-24T22:08:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.211+0000 7febcdc79740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651989268c0 0x565198926ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.211+0000 7febcdc79740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989271e0 0x565198954c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.211+0000 7febcdc79740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x565198955180 0x565198957570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.211+0000 7febcdc79740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56519889c280 con 0x5651989271e0 2024-07-24T22:08:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.211+0000 7febcdc79740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56519888b780 con 0x5651989268c0 2024-07-24T22:08:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.211+0000 7febcdc79740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56519888f7c0 con 0x565198955180 2024-07-24T22:08:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.217+0000 7febc3fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x565198955180 0x565198957570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.217+0000 7febc3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651989268c0 0x565198926ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.217+0000 7febc8cba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989271e0 0x565198954c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.217+0000 7febc8cba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989271e0 0x565198954c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59236/0 (socket says 172.21.15.47:59236) 2024-07-24T22:08:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.217+0000 7febc8cba640 1 -- 172.21.15.47:0/1811890920 learned_addr learned my addr 172.21.15.47:0/1811890920 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.223+0000 7febc1ffb640 1 -- 172.21.15.47:0/2565551384 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7febbc048020 con 0x7febc4113010 2024-07-24T22:08:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.223+0000 7febc8cba640 1 -- 172.21.15.47:0/1811890920 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x565198955180 msgr2=0x565198957570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.223+0000 7febc8cba640 1 --2- 172.21.15.47:0/1811890920 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x565198955180 0x565198957570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.223+0000 7febc8cba640 1 -- 172.21.15.47:0/1811890920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651989268c0 msgr2=0x565198926ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.223+0000 7febc8cba640 1 --2- 172.21.15.47:0/1811890920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651989268c0 0x565198926ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.223+0000 7febc8cba640 1 -- 172.21.15.47:0/1811890920 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651985ef790 con 0x5651989271e0 2024-07-24T22:08:54.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.227+0000 7febc8cba640 1 --2- 172.21.15.47:0/1811890920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989271e0 0x565198954c40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7febb400a8d0 tx=0x7febb400ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93878120fc7cd7 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.228+0000 7febaaffd640 1 -- 172.21.15.47:0/1811890920 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4015070 con 0x5651989271e0 2024-07-24T22:08:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.228+0000 7febc1ffb640 1 --2- 172.21.15.47:0/2565551384 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7febac0b3f70 0x7febac0b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.228+0000 7febaaffd640 1 -- 172.21.15.47:0/1811890920 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb40113f0 con 0x5651989271e0 2024-07-24T22:08:54.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.228+0000 7febc1ffb640 1 -- 172.21.15.47:0/2565551384 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7febbc116f00 con 0x7febc4113010 2024-07-24T22:08:54.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.228+0000 7febc3fff640 1 --2- 172.21.15.47:0/2565551384 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7febac0b3f70 0x7febac0b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.229+0000 7febaaffd640 1 -- 172.21.15.47:0/1811890920 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb40185a0 con 0x5651989271e0 2024-07-24T22:08:54.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.229+0000 7febcdc79740 1 -- 172.21.15.47:0/1811890920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989271e0 msgr2=0x565198954c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:54.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.229+0000 7febcdc79740 1 --2- 172.21.15.47:0/1811890920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989271e0 0x565198954c40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7febb400a8d0 tx=0x7febb400ad90 comp rx=0 tx=0).stop 2024-07-24T22:08:54.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.229+0000 7febcdc79740 1 -- 172.21.15.47:0/1811890920 shutdown_connections 2024-07-24T22:08:54.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.229+0000 7febcdc79740 1 --2- 172.21.15.47:0/1811890920 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x565198955180 0x565198957570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.229+0000 7febcdc79740 1 --2- 172.21.15.47:0/1811890920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989271e0 0x565198954c40 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.229+0000 7febcdc79740 1 --2- 172.21.15.47:0/1811890920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651989268c0 0x565198926ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.229+0000 7febcdc79740 1 -- 172.21.15.47:0/1811890920 >> 172.21.15.47:0/1811890920 conn(0x5651989246f0 msgr2=0x565198925890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:54.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.230+0000 7febc3fff640 1 --2- 172.21.15.47:0/2565551384 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7febac0b3f70 0x7febac0b6430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7febc4112250 tx=0x7febb8004840 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:54.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.230+0000 7febcdc79740 1 -- 172.21.15.47:0/1811890920 shutdown_connections 2024-07-24T22:08:54.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.230+0000 7febcdc79740 1 -- 172.21.15.47:0/1811890920 wait complete. 2024-07-24T22:08:54.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.231+0000 7febcdc79740 1 -- start start 2024-07-24T22:08:54.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.231+0000 7febcdc79740 1 Processor -- start 2024-07-24T22:08:54.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.232+0000 7febcdc79740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989268c0 0x565198954800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.232+0000 7febcdc79740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651989271e0 0x565198951ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.232+0000 7febcdc79740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x565198955180 0x565198952220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.232+0000 7febcdc79740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5651987c5ab0 con 0x5651989268c0 2024-07-24T22:08:54.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.232+0000 7febcdc79740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5651988139e0 con 0x5651989271e0 2024-07-24T22:08:54.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.232+0000 7febcdc79740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x565198957eb0 con 0x565198955180 2024-07-24T22:08:54.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.232+0000 7febcdc79740 10 client.0 _ll_register_callbacks cb 0x56519859ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:54.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.232+0000 7febc94bb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x565198955180 0x565198952220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.232+0000 7febc94bb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x565198955180 0x565198952220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:60218/0 (socket says 172.21.15.47:60218) 2024-07-24T22:08:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.232+0000 7febc94bb640 1 -- 172.21.15.47:0/2313262149 learned_addr learned my addr 172.21.15.47:0/2313262149 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.232+0000 7febc8cba640 1 --2- 172.21.15.47:0/2313262149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989268c0 0x565198954800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.233+0000 7febc94bb640 1 -- 172.21.15.47:0/2313262149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651989271e0 msgr2=0x565198951ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:08:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.233+0000 7febc94bb640 1 --2- 172.21.15.47:0/2313262149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651989271e0 0x565198951ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.233+0000 7febc94bb640 1 -- 172.21.15.47:0/2313262149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989268c0 msgr2=0x565198954800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.233+0000 7febc94bb640 1 --2- 172.21.15.47:0/2313262149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989268c0 0x565198954800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.233+0000 7febc94bb640 1 -- 172.21.15.47:0/2313262149 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565198668620 con 0x565198955180 2024-07-24T22:08:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.233+0000 7febc8cba640 1 --2- 172.21.15.47:0/2313262149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989268c0 0x565198954800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:08:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.234+0000 7febc94bb640 1 --2- 172.21.15.47:0/2313262149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x565198955180 0x565198952220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7febbc003c10 tx=0x7febbc0d9410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ee2f9ddd37a9e92 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.234+0000 7feba3fff640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:08:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.234+0000 7feba3fff640 1 -- 172.21.15.47:0/2313262149 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc0de2c0 con 0x565198955180 2024-07-24T22:08:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.234+0000 7feba3fff640 1 -- 172.21.15.47:0/2313262149 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7febbc0d9e50 con 0x565198955180 2024-07-24T22:08:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.234+0000 7febcdc79740 1 -- 172.21.15.47:0/2313262149 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56519883ace0 con 0x565198955180 2024-07-24T22:08:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.235+0000 7feba3fff640 1 -- 172.21.15.47:0/2313262149 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7febbc0fd050 con 0x565198955180 2024-07-24T22:08:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.235+0000 7febcdc79740 10 client.25447 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.235+0000 7febcdc79740 1 -- 172.21.15.47:0/2313262149 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x565198963650 con 0x565198955180 2024-07-24T22:08:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.235+0000 7feba3fff640 1 -- 172.21.15.47:0/2313262149 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febbc0ddbc0 con 0x565198955180 2024-07-24T22:08:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.236+0000 7feba3fff640 1 -- 172.21.15.47:0/2313262149 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7febbc0e67e0 con 0x565198955180 2024-07-24T22:08:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.236+0000 7febcdc79740 10 client.25447 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.236+0000 7febcdc79740 10 client.25447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.236+0000 7febcdc79740 20 client.25447 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.236+0000 7febcdc79740 1 --2- 172.21.15.47:0/2313262149 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x565198964b80 0x565198967000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.236+0000 7febcdc79740 4 client.25447 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:08:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.236+0000 7febcdc79740 1 -- 172.21.15.47:0/2313262149 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56519883ace0 con 0x565198964b80 2024-07-24T22:08:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.237+0000 7febc8cba640 1 --2- 172.21.15.47:0/2313262149 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x565198964b80 0x565198967000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.239+0000 7febc8cba640 1 --2- 172.21.15.47:0/2313262149 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x565198964b80 0x565198967000 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa851fee69d5028b server_cookie=fb8b9c6da76b55f5 in_seq=0 out_seq=0 2024-07-24T22:08:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.240+0000 7feba3fff640 10 client.25447 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:54.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.243+0000 7feba3fff640 1 -- 172.21.15.47:0/2313262149 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56519883ace0 con 0x565198964b80 2024-07-24T22:08:54.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.243+0000 7feba3fff640 10 client.25447 handle_command_reply: tid=0 2024-07-24T22:08:54.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.244+0000 7febcdc79740 1 client.25447 shutdown 2024-07-24T22:08:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.244+0000 7febcdc79740 1 -- 172.21.15.47:0/2313262149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x565198955180 msgr2=0x565198952220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.244+0000 7febcdc79740 1 --2- 172.21.15.47:0/2313262149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x565198955180 0x565198952220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7febbc003c10 tx=0x7febbc0d9410 comp rx=0 tx=0).stop 2024-07-24T22:08:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.244+0000 7febcdc79740 1 -- 172.21.15.47:0/2313262149 shutdown_connections 2024-07-24T22:08:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.244+0000 7febcdc79740 1 --2- 172.21.15.47:0/2313262149 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x565198964b80 0x565198967000 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.244+0000 7febcdc79740 1 --2- 172.21.15.47:0/2313262149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x565198955180 0x565198952220 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.244+0000 7febcdc79740 1 --2- 172.21.15.47:0/2313262149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651989271e0 0x565198951ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.244+0000 7febcdc79740 1 --2- 172.21.15.47:0/2313262149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989268c0 0x565198954800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.244+0000 7febcdc79740 1 -- 172.21.15.47:0/2313262149 >> 172.21.15.47:0/2313262149 conn(0x5651989246f0 msgr2=0x56519892a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.245+0000 7feba3fff640 0 client.25447 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.245+0000 7febcdc79740 1 -- 172.21.15.47:0/2313262149 shutdown_connections 2024-07-24T22:08:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.245+0000 7febcdc79740 1 -- 172.21.15.47:0/2313262149 wait complete. 2024-07-24T22:08:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.245+0000 7febcdc79740 20 client.25447 trim_cache size 0 max 16384 2024-07-24T22:08:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.289+0000 7febcdc79740 1 Processor -- start 2024-07-24T22:08:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.289+0000 7febcdc79740 1 -- start start 2024-07-24T22:08:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.289+0000 7febcdc79740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651989268c0 0x565198956e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.289+0000 7febcdc79740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5651989271e0 0x565198957340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.289+0000 7febcdc79740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565198955180 0x5651989255e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.289+0000 7febcdc79740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7febb000c810 con 0x565198955180 2024-07-24T22:08:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.289+0000 7febcdc79740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7febb000f090 con 0x5651989268c0 2024-07-24T22:08:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.289+0000 7febcdc79740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7febb000ce80 con 0x5651989271e0 2024-07-24T22:08:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.289+0000 7febc94bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565198955180 0x5651989255e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.290+0000 7febc94bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565198955180 0x5651989255e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59258/0 (socket says 172.21.15.47:59258) 2024-07-24T22:08:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.290+0000 7febc94bb640 1 -- 172.21.15.47:0/321916384 learned_addr learned my addr 172.21.15.47:0/321916384 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.290+0000 7febc94bb640 1 -- 172.21.15.47:0/321916384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5651989271e0 msgr2=0x565198957340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.290+0000 7febc94bb640 1 --2- 172.21.15.47:0/321916384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5651989271e0 0x565198957340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.290+0000 7febc94bb640 1 -- 172.21.15.47:0/321916384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651989268c0 msgr2=0x565198956e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.290+0000 7febc94bb640 1 --2- 172.21.15.47:0/321916384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651989268c0 0x565198956e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.290+0000 7febc94bb640 1 -- 172.21.15.47:0/321916384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565198927010 con 0x565198955180 2024-07-24T22:08:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.291+0000 7febc94bb640 1 --2- 172.21.15.47:0/321916384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565198955180 0x5651989255e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7febbc0d9c40 tx=0x7febbc003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef27d68a8450aafc server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.293+0000 7febaa7fc640 1 -- 172.21.15.47:0/321916384 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc0eb030 con 0x565198955180 2024-07-24T22:08:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.293+0000 7febaa7fc640 1 -- 172.21.15.47:0/321916384 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febbc0de2c0 con 0x565198955180 2024-07-24T22:08:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.293+0000 7febaa7fc640 1 -- 172.21.15.47:0/321916384 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc0e21c0 con 0x565198955180 2024-07-24T22:08:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.295+0000 7febcdc79740 1 -- 172.21.15.47:0/321916384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565198955180 msgr2=0x5651989255e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.295+0000 7febcdc79740 1 --2- 172.21.15.47:0/321916384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565198955180 0x5651989255e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7febbc0d9c40 tx=0x7febbc003f50 comp rx=0 tx=0).stop 2024-07-24T22:08:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.295+0000 7febcdc79740 1 -- 172.21.15.47:0/321916384 shutdown_connections 2024-07-24T22:08:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.295+0000 7febcdc79740 1 --2- 172.21.15.47:0/321916384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565198955180 0x5651989255e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.295+0000 7febcdc79740 1 --2- 172.21.15.47:0/321916384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5651989271e0 0x565198957340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.295+0000 7febcdc79740 1 --2- 172.21.15.47:0/321916384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5651989268c0 0x565198956e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.295+0000 7febcdc79740 1 -- 172.21.15.47:0/321916384 >> 172.21.15.47:0/321916384 conn(0x5651989246f0 msgr2=0x565198951cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:54.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.295+0000 7febcdc79740 1 -- 172.21.15.47:0/321916384 shutdown_connections 2024-07-24T22:08:54.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.295+0000 7febcdc79740 1 -- 172.21.15.47:0/321916384 wait complete. 2024-07-24T22:08:54.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.296+0000 7febcdc79740 1 -- start start 2024-07-24T22:08:54.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.296+0000 7febcdc79740 1 Processor -- start 2024-07-24T22:08:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.297+0000 7febcdc79740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989268c0 0x56519896d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.297+0000 7febcdc79740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5651989271e0 0x56519895d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.297+0000 7febcdc79740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565198955180 0x56519895d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.297+0000 7febcdc79740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7febb000d550 con 0x5651989268c0 2024-07-24T22:08:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.297+0000 7febcdc79740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7febb000e9c0 con 0x565198955180 2024-07-24T22:08:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.297+0000 7febcdc79740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7febb000dc20 con 0x5651989271e0 2024-07-24T22:08:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.297+0000 7febcdc79740 10 client.0 _ll_register_callbacks cb 0x7febbc0dd330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:08:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.298+0000 7febc8cba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989268c0 0x56519896d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.298+0000 7febc8cba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989268c0 0x56519896d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59262/0 (socket says 172.21.15.47:59262) 2024-07-24T22:08:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.298+0000 7febc8cba640 1 -- 172.21.15.47:0/540590667 learned_addr learned my addr 172.21.15.47:0/540590667 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.298+0000 7febc94bb640 1 --2- 172.21.15.47:0/540590667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565198955180 0x56519895d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.299+0000 7febc3fff640 1 --2- 172.21.15.47:0/540590667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5651989271e0 0x56519895d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.299+0000 7febc8cba640 1 -- 172.21.15.47:0/540590667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5651989271e0 msgr2=0x56519895d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.299+0000 7febc8cba640 1 --2- 172.21.15.47:0/540590667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5651989271e0 0x56519895d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.299+0000 7febc8cba640 1 -- 172.21.15.47:0/540590667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565198955180 msgr2=0x56519895d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:08:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.299+0000 7febc8cba640 1 --2- 172.21.15.47:0/540590667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565198955180 0x56519895d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.299+0000 7febc8cba640 1 -- 172.21.15.47:0/540590667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519896b9c0 con 0x5651989268c0 2024-07-24T22:08:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.299+0000 7febc8cba640 1 --2- 172.21.15.47:0/540590667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989268c0 0x56519896d120 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7febb400c520 tx=0x7febb40119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803ab71f9cb05cae server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.299+0000 7feba3fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:08:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.299+0000 7feba3fff640 1 -- 172.21.15.47:0/540590667 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4015040 con 0x5651989268c0 2024-07-24T22:08:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.300+0000 7feba3fff640 1 -- 172.21.15.47:0/540590667 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7febb400cad0 con 0x5651989268c0 2024-07-24T22:08:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.300+0000 7febcdc79740 1 -- 172.21.15.47:0/540590667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febbc0de2c0 con 0x5651989268c0 2024-07-24T22:08:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.300+0000 7feba3fff640 1 -- 172.21.15.47:0/540590667 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7febb4011e40 con 0x5651989268c0 2024-07-24T22:08:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.301+0000 7febcdc79740 10 client.15915 fetch_fsmap learned FSMap version 20 2024-07-24T22:08:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.301+0000 7febcdc79740 1 -- 172.21.15.47:0/540590667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5651989cece0 con 0x5651989268c0 2024-07-24T22:08:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.302+0000 7feba3fff640 1 -- 172.21.15.47:0/540590667 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb4011aa0 con 0x5651989268c0 2024-07-24T22:08:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.302+0000 7feba3fff640 1 -- 172.21.15.47:0/540590667 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7febb4024070 con 0x5651989268c0 2024-07-24T22:08:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.302+0000 7febcdc79740 10 client.15915 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:08:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.302+0000 7febcdc79740 10 client.15915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:08:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.302+0000 7febcdc79740 20 client.15915 populate_metadata read hostname 'smithi047' 2024-07-24T22:08:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.302+0000 7febcdc79740 1 --2- 172.21.15.47:0/540590667 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5651989cf180 0x5651989d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.302+0000 7febcdc79740 4 client.15915 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:08:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.302+0000 7febcdc79740 1 -- 172.21.15.47:0/540590667 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7febbc0de2c0 con 0x5651989cf180 2024-07-24T22:08:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.305+0000 7febc3fff640 1 --2- 172.21.15.47:0/540590667 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5651989cf180 0x5651989d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.309+0000 7feba3fff640 10 client.15915 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.309+0000 7febc3fff640 1 --2- 172.21.15.47:0/540590667 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5651989cf180 0x5651989d1570 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=322d5c413752e634 server_cookie=6b176283ec2dbc40 in_seq=0 out_seq=0 2024-07-24T22:08:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.793+0000 7feba3fff640 1 -- 172.21.15.47:0/540590667 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7febbc0de2c0 con 0x5651989cf180 2024-07-24T22:08:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.793+0000 7feba3fff640 10 client.15915 handle_command_reply: tid=0 2024-07-24T22:08:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.793+0000 7febcdc79740 1 client.15915 shutdown 2024-07-24T22:08:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.793+0000 7febcdc79740 1 -- 172.21.15.47:0/540590667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989268c0 msgr2=0x56519896d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.793+0000 7febcdc79740 1 --2- 172.21.15.47:0/540590667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989268c0 0x56519896d120 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7febb400c520 tx=0x7febb40119b0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.794+0000 7febcdc79740 1 -- 172.21.15.47:0/540590667 shutdown_connections 2024-07-24T22:08:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.794+0000 7febcdc79740 1 --2- 172.21.15.47:0/540590667 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5651989cf180 0x5651989d1570 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.794+0000 7febcdc79740 1 --2- 172.21.15.47:0/540590667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565198955180 0x56519895d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.794+0000 7febcdc79740 1 --2- 172.21.15.47:0/540590667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5651989271e0 0x56519895d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.794+0000 7febcdc79740 1 --2- 172.21.15.47:0/540590667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5651989268c0 0x56519896d120 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.794+0000 7febcdc79740 1 -- 172.21.15.47:0/540590667 >> 172.21.15.47:0/540590667 conn(0x5651989246f0 msgr2=0x565198950170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.794+0000 7feba3fff640 0 client.15915 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:08:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.794+0000 7febcdc79740 1 -- 172.21.15.47:0/540590667 shutdown_connections 2024-07-24T22:08:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.794+0000 7febcdc79740 1 -- 172.21.15.47:0/540590667 wait complete. 2024-07-24T22:08:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.794+0000 7febcdc79740 20 client.15915 trim_cache size 0 max 16384 2024-07-24T22:08:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:08:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:08:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:08:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:08:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.807+0000 7febcaf1e640 1 -- 172.21.15.47:0/2565551384 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7febac0b3f70 msgr2=0x7febac0b6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.807+0000 7febcaf1e640 1 --2- 172.21.15.47:0/2565551384 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7febac0b3f70 0x7febac0b6430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7febc4112250 tx=0x7febb8004840 comp rx=0 tx=0).stop 2024-07-24T22:08:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.807+0000 7febcaf1e640 1 -- 172.21.15.47:0/2565551384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febc4113010 msgr2=0x7febc410ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.807+0000 7febcaf1e640 1 --2- 172.21.15.47:0/2565551384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febc4113010 0x7febc410ecd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7febbc006010 tx=0x7febbc003ba0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.807+0000 7febcaf1e640 1 -- 172.21.15.47:0/2565551384 shutdown_connections 2024-07-24T22:08:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.807+0000 7febcaf1e640 1 --2- 172.21.15.47:0/2565551384 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7febac0b3f70 0x7febac0b6430 secure :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7febc4112250 tx=0x7febb8004840 comp rx=0 tx=0).stop 2024-07-24T22:08:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.807+0000 7febcaf1e640 1 --2- 172.21.15.47:0/2565551384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febc4113010 0x7febc410ecd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.807+0000 7febcaf1e640 1 --2- 172.21.15.47:0/2565551384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7febc410a510 0x7febc410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.807+0000 7febcaf1e640 1 --2- 172.21.15.47:0/2565551384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4109bf0 0x7febc4112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.807+0000 7febcaf1e640 1 -- 172.21.15.47:0/2565551384 >> 172.21.15.47:0/2565551384 conn(0x7febc40782a0 msgr2=0x7febc407a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.808+0000 7febcaf1e640 1 -- 172.21.15.47:0/2565551384 shutdown_connections 2024-07-24T22:08:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:08:54.809+0000 7febcaf1e640 1 -- 172.21.15.47:0/2565551384 wait complete. 2024-07-24T22:08:55.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:55 smithi188 ceph-mon[37380]: pgmap v417: 97 pgs: 97 active+clean; 69 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5.7 MiB/s wr, 4 op/s 2024-07-24T22:08:55.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:55 smithi183 ceph-mon[37007]: pgmap v417: 97 pgs: 97 active+clean; 69 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5.7 MiB/s wr, 4 op/s 2024-07-24T22:08:55.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:55 smithi047 ceph-mon[32551]: pgmap v417: 97 pgs: 97 active+clean; 69 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5.7 MiB/s wr, 4 op/s 2024-07-24T22:08:56.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.920+0000 7f637228b640 1 -- 172.21.15.47:0/3274593292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c10a390 msgr2=0x7f636c10a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:56.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.920+0000 7f637228b640 1 --2- 172.21.15.47:0/3274593292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c10a390 0x7f636c10a7d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6354009900 tx=0x7f635402a440 comp rx=0 tx=0).stop 2024-07-24T22:08:56.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.920+0000 7f637228b640 1 -- 172.21.15.47:0/3274593292 shutdown_connections 2024-07-24T22:08:56.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.920+0000 7f637228b640 1 --2- 172.21.15.47:0/3274593292 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f636c10ad10 0x7f636c111510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:56.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.920+0000 7f637228b640 1 --2- 172.21.15.47:0/3274593292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c10a390 0x7f636c10a7d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:56.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.920+0000 7f637228b640 1 --2- 172.21.15.47:0/3274593292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f636c104980 0x7f636c104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:56.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.920+0000 7f637228b640 1 -- 172.21.15.47:0/3274593292 >> 172.21.15.47:0/3274593292 conn(0x7f636c1003b0 msgr2=0x7f636c1027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:56.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.920+0000 7f637228b640 1 -- 172.21.15.47:0/3274593292 shutdown_connections 2024-07-24T22:08:56.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.920+0000 7f637228b640 1 -- 172.21.15.47:0/3274593292 wait complete. 2024-07-24T22:08:56.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.922+0000 7f637228b640 1 Processor -- start 2024-07-24T22:08:56.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.922+0000 7f637228b640 1 -- start start 2024-07-24T22:08:56.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f637228b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c104980 0x7f636c19afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:56.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f637228b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f636c10a390 0x7f636c19b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:56.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f637228b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f636c10ad10 0x7f636c1a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:56.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f637228b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f636c114a50 con 0x7f636c104980 2024-07-24T22:08:56.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f637228b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f636c1148d0 con 0x7f636c10ad10 2024-07-24T22:08:56.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f637228b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f636c114bd0 con 0x7f636c10a390 2024-07-24T22:08:56.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f636bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c104980 0x7f636c19afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:56.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f636bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c104980 0x7f636c19afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50538/0 (socket says 172.21.15.47:50538) 2024-07-24T22:08:56.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f636bfff640 1 -- 172.21.15.47:0/2464658358 learned_addr learned my addr 172.21.15.47:0/2464658358 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:08:56.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f636bfff640 1 -- 172.21.15.47:0/2464658358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f636c10a390 msgr2=0x7f636c19b520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:08:56.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f636bfff640 1 --2- 172.21.15.47:0/2464658358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f636c10a390 0x7f636c19b520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:56.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f636bfff640 1 -- 172.21.15.47:0/2464658358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f636c10ad10 msgr2=0x7f636c1a08c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:08:56.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f636bfff640 1 --2- 172.21.15.47:0/2464658358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f636c10ad10 0x7f636c1a08c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:56.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.923+0000 7f636bfff640 1 -- 172.21.15.47:0/2464658358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c1a1090 con 0x7f636c104980 2024-07-24T22:08:56.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.924+0000 7f636bfff640 1 --2- 172.21.15.47:0/2464658358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c104980 0x7f636c19afe0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f635c00ba50 tx=0x7f635c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:56.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.924+0000 7f6369ffb640 1 -- 172.21.15.47:0/2464658358 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c019070 con 0x7f636c104980 2024-07-24T22:08:56.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.924+0000 7f637228b640 1 -- 172.21.15.47:0/2464658358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636c1a1380 con 0x7f636c104980 2024-07-24T22:08:56.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.924+0000 7f6369ffb640 1 -- 172.21.15.47:0/2464658358 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f635c00cc10 con 0x7f636c104980 2024-07-24T22:08:56.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.924+0000 7f6369ffb640 1 -- 172.21.15.47:0/2464658358 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c0075d0 con 0x7f636c104980 2024-07-24T22:08:56.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.924+0000 7f637228b640 1 -- 172.21.15.47:0/2464658358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f636c1a7ac0 con 0x7f636c104980 2024-07-24T22:08:56.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.926+0000 7f637228b640 1 -- 172.21.15.47:0/2464658358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f636c104de0 con 0x7f636c104980 2024-07-24T22:08:56.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.927+0000 7f6369ffb640 1 -- 172.21.15.47:0/2464658358 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f635c01c070 con 0x7f636c104980 2024-07-24T22:08:56.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.929+0000 7f6369ffb640 1 --2- 172.21.15.47:0/2464658358 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63580b3d40 0x7f63580b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:08:56.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.930+0000 7f63637fe640 1 --2- 172.21.15.47:0/2464658358 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63580b3d40 0x7f63580b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:08:56.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.933+0000 7f6369ffb640 1 -- 172.21.15.47:0/2464658358 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f635c0e3630 con 0x7f636c104980 2024-07-24T22:08:56.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.933+0000 7f63637fe640 1 --2- 172.21.15.47:0/2464658358 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63580b3d40 0x7f63580b6200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f63540096c0 tx=0x7f6354000bc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:08:56.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:56.939+0000 7f6369ffb640 1 -- 172.21.15.47:0/2464658358 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f635c0aaa50 con 0x7f636c104980 2024-07-24T22:08:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.337+0000 7f637228b640 1 -- 172.21.15.47:0/2464658358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f636c02e000 con 0x7f636c104980 2024-07-24T22:08:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.338+0000 7f6369ffb640 1 -- 172.21.15.47:0/2464658358 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f635c0aa350 con 0x7f636c104980 2024-07-24T22:08:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:08:57.341 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:08:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:08:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.342+0000 7f637228b640 1 -- 172.21.15.47:0/2464658358 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63580b3d40 msgr2=0x7f63580b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.342+0000 7f637228b640 1 --2- 172.21.15.47:0/2464658358 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63580b3d40 0x7f63580b6200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f63540096c0 tx=0x7f6354000bc0 comp rx=0 tx=0).stop 2024-07-24T22:08:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.342+0000 7f637228b640 1 -- 172.21.15.47:0/2464658358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c104980 msgr2=0x7f636c19afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:08:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.342+0000 7f637228b640 1 --2- 172.21.15.47:0/2464658358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c104980 0x7f636c19afe0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f635c00ba50 tx=0x7f635c00bf10 comp rx=0 tx=0).stop 2024-07-24T22:08:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.342+0000 7f637228b640 1 -- 172.21.15.47:0/2464658358 shutdown_connections 2024-07-24T22:08:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.342+0000 7f637228b640 1 --2- 172.21.15.47:0/2464658358 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63580b3d40 0x7f63580b6200 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.342+0000 7f637228b640 1 --2- 172.21.15.47:0/2464658358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f636c10ad10 0x7f636c1a08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.342+0000 7f637228b640 1 --2- 172.21.15.47:0/2464658358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f636c10a390 0x7f636c19b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.342+0000 7f637228b640 1 --2- 172.21.15.47:0/2464658358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c104980 0x7f636c19afe0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:08:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.342+0000 7f637228b640 1 -- 172.21.15.47:0/2464658358 >> 172.21.15.47:0/2464658358 conn(0x7f636c1003b0 msgr2=0x7f636c1027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:08:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.343+0000 7f637228b640 1 -- 172.21.15.47:0/2464658358 shutdown_connections 2024-07-24T22:08:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:08:57.343+0000 7f637228b640 1 -- 172.21.15.47:0/2464658358 wait complete. 2024-07-24T22:08:57.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:57 smithi047 ceph-mon[32551]: pgmap v418: 97 pgs: 97 active+clean; 513 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 43 MiB/s wr, 14 op/s 2024-07-24T22:08:57.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:57 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2464658358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:57.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:57 smithi183 ceph-mon[37007]: pgmap v418: 97 pgs: 97 active+clean; 513 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 43 MiB/s wr, 14 op/s 2024-07-24T22:08:57.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:57 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2464658358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:58.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:57 smithi188 ceph-mon[37380]: pgmap v418: 97 pgs: 97 active+clean; 513 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 43 MiB/s wr, 14 op/s 2024-07-24T22:08:58.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:57 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2464658358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:08:58.824 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:08:59.330 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:08:59.858 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:08:59 smithi047 ceph-mon[32551]: pgmap v419: 97 pgs: 97 active+clean; 2.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 198 MiB/s wr, 189 op/s 2024-07-24T22:08:59.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:08:59 smithi183 ceph-mon[37007]: pgmap v419: 97 pgs: 97 active+clean; 2.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 198 MiB/s wr, 189 op/s 2024-07-24T22:09:00.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:08:59 smithi188 ceph-mon[37380]: pgmap v419: 97 pgs: 97 active+clean; 2.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 198 MiB/s wr, 189 op/s 2024-07-24T22:09:01.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:01 smithi047 ceph-mon[32551]: pgmap v420: 97 pgs: 97 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 313 MiB/s wr, 306 op/s 2024-07-24T22:09:02.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:01 smithi188 ceph-mon[37380]: pgmap v420: 97 pgs: 97 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 313 MiB/s wr, 306 op/s 2024-07-24T22:09:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.013+0000 7f32a9c8b640 1 -- 172.21.15.47:0/4010010614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32a4102790 msgr2=0x7f32a4102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.013+0000 7f32a9c8b640 1 --2- 172.21.15.47:0/4010010614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32a4102790 0x7f32a4102b70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3294009900 tx=0x7f329402a410 comp rx=0 tx=0).stop 2024-07-24T22:09:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.013+0000 7f32a9c8b640 1 -- 172.21.15.47:0/4010010614 shutdown_connections 2024-07-24T22:09:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.013+0000 7f32a9c8b640 1 --2- 172.21.15.47:0/4010010614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32a4108b20 0x7f32a410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.013+0000 7f32a9c8b640 1 --2- 172.21.15.47:0/4010010614 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f32a41081a0 0x7f32a41085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.013+0000 7f32a9c8b640 1 --2- 172.21.15.47:0/4010010614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32a4102790 0x7f32a4102b70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.013+0000 7f32a9c8b640 1 -- 172.21.15.47:0/4010010614 >> 172.21.15.47:0/4010010614 conn(0x7f32a40fe200 msgr2=0x7f32a4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.013+0000 7f32a9c8b640 1 -- 172.21.15.47:0/4010010614 shutdown_connections 2024-07-24T22:09:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.013+0000 7f32a9c8b640 1 -- 172.21.15.47:0/4010010614 wait complete. 2024-07-24T22:09:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.014+0000 7f32a9c8b640 1 Processor -- start 2024-07-24T22:09:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.014+0000 7f32a9c8b640 1 -- start start 2024-07-24T22:09:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.014+0000 7f32a9c8b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32a4102790 0x7f32a4198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.014+0000 7f32a9c8b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32a41081a0 0x7f32a4199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.014+0000 7f32a9c8b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f32a4108b20 0x7f32a419e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.014+0000 7f32a9c8b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f32a4112740 con 0x7f32a4102790 2024-07-24T22:09:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.014+0000 7f32a9c8b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f32a41125c0 con 0x7f32a41081a0 2024-07-24T22:09:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.014+0000 7f32a9c8b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f32a41128c0 con 0x7f32a4108b20 2024-07-24T22:09:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.014+0000 7f32a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32a4102790 0x7f32a4198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.014+0000 7f32a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32a4102790 0x7f32a4198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50544/0 (socket says 172.21.15.47:50544) 2024-07-24T22:09:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.014+0000 7f32a37fe640 1 -- 172.21.15.47:0/3667334630 learned_addr learned my addr 172.21.15.47:0/3667334630 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.014+0000 7f32a3fff640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f32a4108b20 0x7f32a419e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.014+0000 7f329affd640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32a41081a0 0x7f32a4199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.015+0000 7f32a3fff640 1 -- 172.21.15.47:0/3667334630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32a41081a0 msgr2=0x7f32a4199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.015+0000 7f32a3fff640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32a41081a0 0x7f32a4199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.015+0000 7f32a3fff640 1 -- 172.21.15.47:0/3667334630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32a4102790 msgr2=0x7f32a4198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.015+0000 7f32a3fff640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32a4102790 0x7f32a4198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.015+0000 7f32a3fff640 1 -- 172.21.15.47:0/3667334630 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a419ed00 con 0x7f32a4108b20 2024-07-24T22:09:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.015+0000 7f32a37fe640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32a4102790 0x7f32a4198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.015+0000 7f32a3fff640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f32a4108b20 0x7f32a419e530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f329c009fd0 tx=0x7f329c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.015+0000 7f32a17fa640 1 -- 172.21.15.47:0/3667334630 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c00ce20 con 0x7f32a4108b20 2024-07-24T22:09:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.015+0000 7f32a17fa640 1 -- 172.21.15.47:0/3667334630 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f329c005020 con 0x7f32a4108b20 2024-07-24T22:09:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.015+0000 7f32a9c8b640 1 -- 172.21.15.47:0/3667334630 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a419eff0 con 0x7f32a4108b20 2024-07-24T22:09:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.015+0000 7f32a17fa640 1 -- 172.21.15.47:0/3667334630 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c010690 con 0x7f32a4108b20 2024-07-24T22:09:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.015+0000 7f32a9c8b640 1 -- 172.21.15.47:0/3667334630 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a41a56b0 con 0x7f32a4108b20 2024-07-24T22:09:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.018+0000 7f32ac03c740 1 Processor -- start 2024-07-24T22:09:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.018+0000 7f32a17fa640 1 -- 172.21.15.47:0/3667334630 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f329c0054d0 con 0x7f32a4108b20 2024-07-24T22:09:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.018+0000 7f32ac03c740 1 -- start start 2024-07-24T22:09:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.018+0000 7f32ac03c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151cafbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.018+0000 7f32ac03c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb07a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.018+0000 7f32ac03c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cb07f80 0x56151cb0a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.018+0000 7f32ac03c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56151ca729b0 con 0x56151cafbff0 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.018+0000 7f32ac03c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56151ca61eb0 con 0x56151cb07f80 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.018+0000 7f32ac03c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56151ca65ef0 con 0x56151cafb6d0 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.018+0000 7f32a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb07a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.018+0000 7f329affd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151cafbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.018+0000 7f32a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb07a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50556/0 (socket says 172.21.15.47:50556) 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.018+0000 7f32a37fe640 1 -- 172.21.15.47:0/3107843654 learned_addr learned my addr 172.21.15.47:0/3107843654 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.019+0000 7f329affd640 1 --2- 172.21.15.47:0/3107843654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cb07f80 0x56151cb0a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.019+0000 7f329affd640 1 -- 172.21.15.47:0/3107843654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cb07f80 msgr2=0x56151cb0a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.019+0000 7f329affd640 1 --2- 172.21.15.47:0/3107843654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cb07f80 0x56151cb0a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.019+0000 7f329affd640 1 -- 172.21.15.47:0/3107843654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 msgr2=0x56151cb07a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.019+0000 7f329affd640 1 --2- 172.21.15.47:0/3107843654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb07a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.019+0000 7f329affd640 1 -- 172.21.15.47:0/3107843654 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56151c9eb320 con 0x56151cafb6d0 2024-07-24T22:09:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.019+0000 7f32a17fa640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f32900b3d40 0x7f32900b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.019+0000 7f329affd640 1 --2- 172.21.15.47:0/3107843654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151cafbab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f32a4105090 tx=0x7f328c0096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=501a72a9b0533a42 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.019+0000 7f32a37fe640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f32900b3d40 0x7f32900b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.019+0000 7f32a17fa640 1 -- 172.21.15.47:0/3667334630 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f329c0e4710 con 0x7f32a4108b20 2024-07-24T22:09:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.019+0000 7f3299ffb640 1 -- 172.21.15.47:0/3107843654 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c004030 con 0x56151cafb6d0 2024-07-24T22:09:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.019+0000 7f3299ffb640 1 -- 172.21.15.47:0/3107843654 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f328c0035f0 con 0x56151cafb6d0 2024-07-24T22:09:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.019+0000 7f3299ffb640 1 -- 172.21.15.47:0/3107843654 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c010700 con 0x56151cafb6d0 2024-07-24T22:09:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.020+0000 7f32ac03c740 1 -- 172.21.15.47:0/3107843654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 msgr2=0x56151cafbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.020+0000 7f32ac03c740 1 --2- 172.21.15.47:0/3107843654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151cafbab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f32a4105090 tx=0x7f328c0096a0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.020+0000 7f32a37fe640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f32900b3d40 0x7f32900b6200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x56151cafa3e0 tx=0x7f32940058d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.020+0000 7f32ac03c740 1 -- 172.21.15.47:0/3107843654 shutdown_connections 2024-07-24T22:09:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.020+0000 7f32ac03c740 1 --2- 172.21.15.47:0/3107843654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cb07f80 0x56151cb0a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.020+0000 7f32ac03c740 1 --2- 172.21.15.47:0/3107843654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb07a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.020+0000 7f32ac03c740 1 --2- 172.21.15.47:0/3107843654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151cafbab0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.020+0000 7f32ac03c740 1 -- 172.21.15.47:0/3107843654 >> 172.21.15.47:0/3107843654 conn(0x56151caf9500 msgr2=0x56151cafa6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:02.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.020+0000 7f32ac03c740 1 -- 172.21.15.47:0/3107843654 shutdown_connections 2024-07-24T22:09:02.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.020+0000 7f32ac03c740 1 -- 172.21.15.47:0/3107843654 wait complete. 2024-07-24T22:09:02.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.020+0000 7f32ac03c740 1 -- start start 2024-07-24T22:09:02.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f32ac03c740 1 Processor -- start 2024-07-24T22:09:02.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f32ac03c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151cb04ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f32ac03c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb05420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f32ac03c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cb07f80 0x56151cb05960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f32ac03c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56151c8c5700 con 0x56151cafbff0 2024-07-24T22:09:02.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f32ac03c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56151ca045f0 con 0x56151cb07f80 2024-07-24T22:09:02.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f32ac03c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56151cb0ac00 con 0x56151cafb6d0 2024-07-24T22:09:02.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f32ac03c740 10 client.0 _ll_register_callbacks cb 0x56151ca24960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:02.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f329affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb05420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f329affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb05420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50560/0 (socket says 172.21.15.47:50560) 2024-07-24T22:09:02.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f329affd640 1 -- 172.21.15.47:0/383067143 learned_addr learned my addr 172.21.15.47:0/383067143 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:02.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f32a37fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151cb04ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f32a3fff640 1 --2- 172.21.15.47:0/383067143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cb07f80 0x56151cb05960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f329affd640 1 -- 172.21.15.47:0/383067143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 msgr2=0x56151cb04ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:02.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f329affd640 1 --2- 172.21.15.47:0/383067143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151cb04ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f329affd640 1 -- 172.21.15.47:0/383067143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cb07f80 msgr2=0x56151cb05960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:02.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f329affd640 1 --2- 172.21.15.47:0/383067143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cb07f80 0x56151cb05960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.021+0000 7f329affd640 1 -- 172.21.15.47:0/383067143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56151c9f7680 con 0x56151cafbff0 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.022+0000 7f329affd640 1 --2- 172.21.15.47:0/383067143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb05420 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f328c005db0 tx=0x7f328c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddeb43818996220 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.022+0000 7f3282ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.022+0000 7f3282ffd640 1 -- 172.21.15.47:0/383067143 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c004210 con 0x56151cafbff0 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.022+0000 7f3282ffd640 1 -- 172.21.15.47:0/383067143 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f328c0043b0 con 0x56151cafbff0 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.022+0000 7f32ac03c740 1 -- 172.21.15.47:0/383067143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f328c0035f0 con 0x56151cafbff0 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.022+0000 7f3282ffd640 1 -- 172.21.15.47:0/383067143 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f328c0104a0 con 0x56151cafbff0 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.022+0000 7f32ac03c740 10 client.15933 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.022+0000 7f32ac03c740 1 -- 172.21.15.47:0/383067143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56151c7c2650 con 0x56151cafbff0 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.022+0000 7f3282ffd640 1 -- 172.21.15.47:0/383067143 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f328c0035f0 con 0x56151cafbff0 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.022+0000 7f3282ffd640 1 -- 172.21.15.47:0/383067143 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f328c0314f0 con 0x56151cafbff0 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.022+0000 7f32ac03c740 10 client.15933 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.022+0000 7f32ac03c740 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.022+0000 7f32ac03c740 20 client.15933 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.023+0000 7f32ac03c740 1 --2- 172.21.15.47:0/383067143 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56151cb17940 0x56151cb19d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.023+0000 7f32ac03c740 4 client.15933 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:09:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.023+0000 7f32ac03c740 1 -- 172.21.15.47:0/383067143 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56151ca74900 con 0x56151cb17940 2024-07-24T22:09:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.023+0000 7f32a37fe640 1 --2- 172.21.15.47:0/383067143 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56151cb17940 0x56151cb19d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.023+0000 7f32a37fe640 1 --2- 172.21.15.47:0/383067143 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56151cb17940 0x56151cb19d30 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=825ae356309d0a1d server_cookie=ec1597eccaffb429 in_seq=0 out_seq=0 2024-07-24T22:09:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.023+0000 7f3282ffd640 10 client.15933 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f3282ffd640 1 -- 172.21.15.47:0/383067143 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56151ca74900 con 0x56151cb17940 2024-07-24T22:09:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f3282ffd640 10 client.15933 handle_command_reply: tid=0 2024-07-24T22:09:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f32ac03c740 1 client.15933 shutdown 2024-07-24T22:09:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f32ac03c740 1 -- 172.21.15.47:0/383067143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 msgr2=0x56151cb05420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f32ac03c740 1 --2- 172.21.15.47:0/383067143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb05420 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f328c005db0 tx=0x7f328c003c80 comp rx=0 tx=0).stop 2024-07-24T22:09:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f32ac03c740 1 -- 172.21.15.47:0/383067143 shutdown_connections 2024-07-24T22:09:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f32ac03c740 1 --2- 172.21.15.47:0/383067143 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56151cb17940 0x56151cb19d30 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f32ac03c740 1 --2- 172.21.15.47:0/383067143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cb07f80 0x56151cb05960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f32ac03c740 1 --2- 172.21.15.47:0/383067143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb05420 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f32ac03c740 1 --2- 172.21.15.47:0/383067143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151cb04ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f3282ffd640 0 client.15933 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f32ac03c740 1 -- 172.21.15.47:0/383067143 >> 172.21.15.47:0/383067143 conn(0x56151caf9500 msgr2=0x56151caff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f32ac03c740 1 -- 172.21.15.47:0/383067143 shutdown_connections 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f32ac03c740 1 -- 172.21.15.47:0/383067143 wait complete. 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.024+0000 7f32ac03c740 20 client.15933 trim_cache size 0 max 16384 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.038+0000 7f32ac03c740 1 Processor -- start 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.038+0000 7f32ac03c740 1 -- start start 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f32ac03c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151caff2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f32ac03c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cafbff0 0x56151cb1f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f32ac03c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cb07f80 0x56151cb1f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f32ac03c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f32a41ac0d0 con 0x56151cb07f80 2024-07-24T22:09:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f32ac03c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f32a41ae950 con 0x56151cafbff0 2024-07-24T22:09:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f32ac03c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f32a41ac740 con 0x56151cafb6d0 2024-07-24T22:09:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f32a3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cb07f80 0x56151cb1f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f32a3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cb07f80 0x56151cb1f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50568/0 (socket says 172.21.15.47:50568) 2024-07-24T22:09:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f32a3fff640 1 -- 172.21.15.47:0/924215456 learned_addr learned my addr 172.21.15.47:0/924215456 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f32a37fe640 1 --2- 172.21.15.47:0/924215456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151caff2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f329affd640 1 --2- 172.21.15.47:0/924215456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cafbff0 0x56151cb1f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f329affd640 1 -- 172.21.15.47:0/924215456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 msgr2=0x56151caff2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f329affd640 1 --2- 172.21.15.47:0/924215456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151caff2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f329affd640 1 -- 172.21.15.47:0/924215456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cb07f80 msgr2=0x56151cb1f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f329affd640 1 --2- 172.21.15.47:0/924215456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cb07f80 0x56151cb1f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f329affd640 1 -- 172.21.15.47:0/924215456 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56151cb05d80 con 0x56151cafbff0 2024-07-24T22:09:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f32a3fff640 1 --2- 172.21.15.47:0/924215456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cb07f80 0x56151cb1f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f32a37fe640 1 --2- 172.21.15.47:0/924215456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151caff2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.039+0000 7f329affd640 1 --2- 172.21.15.47:0/924215456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cafbff0 0x56151cb1f330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f328c000c00 tx=0x7f328c009800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7755a76f53723762 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.040+0000 7f32997fa640 1 -- 172.21.15.47:0/924215456 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c0035f0 con 0x56151cafbff0 2024-07-24T22:09:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.040+0000 7f32997fa640 1 -- 172.21.15.47:0/924215456 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f328c036020 con 0x56151cafbff0 2024-07-24T22:09:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.040+0000 7f32997fa640 1 -- 172.21.15.47:0/924215456 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c009940 con 0x56151cafbff0 2024-07-24T22:09:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.040+0000 7f32ac03c740 1 -- 172.21.15.47:0/924215456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cafbff0 msgr2=0x56151cb1f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.040+0000 7f32ac03c740 1 --2- 172.21.15.47:0/924215456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cafbff0 0x56151cb1f330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f328c000c00 tx=0x7f328c009800 comp rx=0 tx=0).stop 2024-07-24T22:09:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.040+0000 7f32ac03c740 1 -- 172.21.15.47:0/924215456 shutdown_connections 2024-07-24T22:09:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.040+0000 7f32ac03c740 1 --2- 172.21.15.47:0/924215456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cb07f80 0x56151cb1f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.040+0000 7f32ac03c740 1 --2- 172.21.15.47:0/924215456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cafbff0 0x56151cb1f330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.040+0000 7f32ac03c740 1 --2- 172.21.15.47:0/924215456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cafb6d0 0x56151caff2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.040+0000 7f32ac03c740 1 -- 172.21.15.47:0/924215456 >> 172.21.15.47:0/924215456 conn(0x56151caf9500 msgr2=0x56151cb05670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.040+0000 7f32ac03c740 1 -- 172.21.15.47:0/924215456 shutdown_connections 2024-07-24T22:09:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.040+0000 7f32ac03c740 1 -- 172.21.15.47:0/924215456 wait complete. 2024-07-24T22:09:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f32ac03c740 1 -- start start 2024-07-24T22:09:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f32ac03c740 1 Processor -- start 2024-07-24T22:09:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f32ac03c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cafb6d0 0x56151cb103c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f32ac03c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb0b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f32ac03c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cb07f80 0x56151cb0be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f32ac03c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f32a41ace10 con 0x56151cafbff0 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f32ac03c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f32a41ae280 con 0x56151cafb6d0 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f32ac03c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f32a41ad4e0 con 0x56151cb07f80 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f32ac03c740 10 client.0 _ll_register_callbacks cb 0x7f328c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f329affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb0b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f329affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb0b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50578/0 (socket says 172.21.15.47:50578) 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f329affd640 1 -- 172.21.15.47:0/1878785395 learned_addr learned my addr 172.21.15.47:0/1878785395 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f32a3fff640 1 --2- 172.21.15.47:0/1878785395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cb07f80 0x56151cb0be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.041+0000 7f32a37fe640 1 --2- 172.21.15.47:0/1878785395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cafb6d0 0x56151cb103c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f329affd640 1 -- 172.21.15.47:0/1878785395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cb07f80 msgr2=0x56151cb0be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f329affd640 1 --2- 172.21.15.47:0/1878785395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cb07f80 0x56151cb0be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f329affd640 1 -- 172.21.15.47:0/1878785395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cafb6d0 msgr2=0x56151cb103c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f329affd640 1 --2- 172.21.15.47:0/1878785395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cafb6d0 0x56151cb103c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f329affd640 1 -- 172.21.15.47:0/1878785395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56151cb0c490 con 0x56151cafbff0 2024-07-24T22:09:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f329affd640 1 --2- 172.21.15.47:0/1878785395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb0b8e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f328c009380 tx=0x7f328c0133e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4f05a62abf5676 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f3282ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:09:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f3282ffd640 1 -- 172.21.15.47:0/1878785395 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c0035f0 con 0x56151cafbff0 2024-07-24T22:09:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f3282ffd640 1 -- 172.21.15.47:0/1878785395 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f328c005290 con 0x56151cafbff0 2024-07-24T22:09:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f32ac03c740 1 -- 172.21.15.47:0/1878785395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f328c036020 con 0x56151cafbff0 2024-07-24T22:09:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f3282ffd640 1 -- 172.21.15.47:0/1878785395 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f328c0054d0 con 0x56151cafbff0 2024-07-24T22:09:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f32ac03c740 10 client.15939 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f32ac03c740 1 -- 172.21.15.47:0/1878785395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56151cb821b0 con 0x56151cafbff0 2024-07-24T22:09:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.042+0000 7f3282ffd640 1 -- 172.21.15.47:0/1878785395 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f328c036020 con 0x56151cafbff0 2024-07-24T22:09:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.043+0000 7f3282ffd640 1 -- 172.21.15.47:0/1878785395 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f328c010c10 con 0x56151cafbff0 2024-07-24T22:09:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.043+0000 7f32ac03c740 10 client.15939 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.043+0000 7f32ac03c740 10 client.15939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.043+0000 7f32ac03c740 20 client.15939 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.043+0000 7f32ac03c740 1 --2- 172.21.15.47:0/1878785395 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56151cb82870 0x56151cb84c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:02.073 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:09:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.043+0000 7f32ac03c740 4 client.15939 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:09:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.043+0000 7f32ac03c740 1 -- 172.21.15.47:0/1878785395 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56151cb1a120 con 0x56151cb82870 2024-07-24T22:09:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.043+0000 7f32a37fe640 1 --2- 172.21.15.47:0/1878785395 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56151cb82870 0x56151cb84c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.043+0000 7f3282ffd640 10 client.15939 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.043+0000 7f32a37fe640 1 --2- 172.21.15.47:0/1878785395 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56151cb82870 0x56151cb84c90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=862d254fe33de2 server_cookie=f0c55bbe17028807 in_seq=0 out_seq=0 2024-07-24T22:09:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.043+0000 7f3282ffd640 1 -- 172.21.15.47:0/1878785395 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56151cb1a120 con 0x56151cb82870 2024-07-24T22:09:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.043+0000 7f3282ffd640 10 client.15939 handle_command_reply: tid=0 2024-07-24T22:09:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.043+0000 7f32ac03c740 1 client.15939 shutdown 2024-07-24T22:09:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32ac03c740 1 -- 172.21.15.47:0/1878785395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 msgr2=0x56151cb0b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32ac03c740 1 --2- 172.21.15.47:0/1878785395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb0b8e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f328c009380 tx=0x7f328c0133e0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32ac03c740 1 -- 172.21.15.47:0/1878785395 shutdown_connections 2024-07-24T22:09:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32ac03c740 1 --2- 172.21.15.47:0/1878785395 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56151cb82870 0x56151cb84c90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32ac03c740 1 --2- 172.21.15.47:0/1878785395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56151cb07f80 0x56151cb0be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32ac03c740 1 --2- 172.21.15.47:0/1878785395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56151cafbff0 0x56151cb0b8e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f3282ffd640 0 client.15939 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32ac03c740 1 --2- 172.21.15.47:0/1878785395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56151cafb6d0 0x56151cb103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32ac03c740 1 -- 172.21.15.47:0/1878785395 >> 172.21.15.47:0/1878785395 conn(0x56151caf9500 msgr2=0x56151cb12d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32ac03c740 1 -- 172.21.15.47:0/1878785395 shutdown_connections 2024-07-24T22:09:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32ac03c740 1 -- 172.21.15.47:0/1878785395 wait complete. 2024-07-24T22:09:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32ac03c740 20 client.15939 trim_cache size 0 max 16384 2024-07-24T22:09:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32a9c8b640 1 -- 172.21.15.47:0/3667334630 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f32900b3d40 msgr2=0x7f32900b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32a9c8b640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f32900b3d40 0x7f32900b6200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x56151cafa3e0 tx=0x7f32940058d0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32a9c8b640 1 -- 172.21.15.47:0/3667334630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f32a4108b20 msgr2=0x7f32a419e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.044+0000 7f32a9c8b640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f32a4108b20 0x7f32a419e530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f329c009fd0 tx=0x7f329c00ef10 comp rx=0 tx=0).stop 2024-07-24T22:09:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.045+0000 7f32a9c8b640 1 -- 172.21.15.47:0/3667334630 shutdown_connections 2024-07-24T22:09:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.045+0000 7f32a9c8b640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f32900b3d40 0x7f32900b6200 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.045+0000 7f32a9c8b640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f32a4108b20 0x7f32a419e530 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.045+0000 7f32a9c8b640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32a41081a0 0x7f32a4199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.045+0000 7f32a9c8b640 1 --2- 172.21.15.47:0/3667334630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32a4102790 0x7f32a4198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.045+0000 7f32a9c8b640 1 -- 172.21.15.47:0/3667334630 >> 172.21.15.47:0/3667334630 conn(0x7f32a40fe200 msgr2=0x7f32a41005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.045+0000 7f32a9c8b640 1 -- 172.21.15.47:0/3667334630 shutdown_connections 2024-07-24T22:09:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:02.045+0000 7f32a9c8b640 1 -- 172.21.15.47:0/3667334630 wait complete. 2024-07-24T22:09:02.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:01 smithi183 ceph-mon[37007]: pgmap v420: 97 pgs: 97 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 313 MiB/s wr, 306 op/s 2024-07-24T22:09:03.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:03 smithi047 ceph-mon[32551]: pgmap v421: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 482 MiB/s wr, 402 op/s 2024-07-24T22:09:04.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:03 smithi188 ceph-mon[37380]: pgmap v421: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 482 MiB/s wr, 402 op/s 2024-07-24T22:09:04.136 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:09:04.136 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:09:04.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:03 smithi183 ceph-mon[37007]: pgmap v421: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 482 MiB/s wr, 402 op/s 2024-07-24T22:09:04.580 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:09:05.945 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:05 smithi047 ceph-mon[32551]: pgmap v422: 97 pgs: 97 active+clean; 6.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 595 MiB/s wr, 669 op/s 2024-07-24T22:09:06.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:05 smithi188 ceph-mon[37380]: pgmap v422: 97 pgs: 97 active+clean; 6.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 595 MiB/s wr, 669 op/s 2024-07-24T22:09:06.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:05 smithi183 ceph-mon[37007]: pgmap v422: 97 pgs: 97 active+clean; 6.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 595 MiB/s wr, 669 op/s 2024-07-24T22:09:07.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.572+0000 7f4bbdd6f640 1 -- 172.21.15.47:0/1741531485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb8109b40 msgr2=0x7f4bb8109f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:07.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.572+0000 7f4bbdd6f640 1 --2- 172.21.15.47:0/1741531485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb8109b40 0x7f4bb8109f20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009ca0 tx=0x7f4ba802a940 comp rx=0 tx=0).stop 2024-07-24T22:09:07.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.573+0000 7f4bbdd6f640 1 -- 172.21.15.47:0/1741531485 shutdown_connections 2024-07-24T22:09:07.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.573+0000 7f4bbdd6f640 1 --2- 172.21.15.47:0/1741531485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bb8115400 0x7f4bb81177f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.573+0000 7f4bbdd6f640 1 --2- 172.21.15.47:0/1741531485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bb810a460 0x7f4bb8114ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.573+0000 7f4bbdd6f640 1 --2- 172.21.15.47:0/1741531485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb8109b40 0x7f4bb8109f20 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.573+0000 7f4bbdd6f640 1 -- 172.21.15.47:0/1741531485 >> 172.21.15.47:0/1741531485 conn(0x7f4bb806d980 msgr2=0x7f4bb806dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:07.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.579+0000 7f4bbdd6f640 1 -- 172.21.15.47:0/1741531485 shutdown_connections 2024-07-24T22:09:07.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.580+0000 7f4bbdd6f640 1 -- 172.21.15.47:0/1741531485 wait complete. 2024-07-24T22:09:07.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.582+0000 7f4bbdd6f640 1 Processor -- start 2024-07-24T22:09:07.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.583+0000 7f4bbdd6f640 1 -- start start 2024-07-24T22:09:07.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.583+0000 7f4bbdd6f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bb8109b40 0x7f4bb8114c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.583+0000 7f4bbdd6f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb810a460 0x7f4bb8111e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.583+0000 7f4bbdd6f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bb8115400 0x7f4bb81123d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.583+0000 7f4bbdd6f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb810c700 con 0x7f4bb810a460 2024-07-24T22:09:07.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.583+0000 7f4bbdd6f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb810c580 con 0x7f4bb8109b40 2024-07-24T22:09:07.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.583+0000 7f4bbdd6f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb810c880 con 0x7f4bb8115400 2024-07-24T22:09:07.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.584+0000 7f4bb6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb810a460 0x7f4bb8111e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:07.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.585+0000 7f4bb6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb810a460 0x7f4bb8111e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55760/0 (socket says 172.21.15.47:55760) 2024-07-24T22:09:07.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.585+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/1174635808 learned_addr learned my addr 172.21.15.47:0/1174635808 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:07.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.587+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/1174635808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bb8115400 msgr2=0x7f4bb81123d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:09:07.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.587+0000 7f4bb6ffd640 1 --2- 172.21.15.47:0/1174635808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bb8115400 0x7f4bb81123d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.587+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/1174635808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bb8109b40 msgr2=0x7f4bb8114c40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:09:07.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.587+0000 7f4bb6ffd640 1 --2- 172.21.15.47:0/1174635808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bb8109b40 0x7f4bb8114c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.588+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/1174635808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb8112c90 con 0x7f4bb810a460 2024-07-24T22:09:07.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.588+0000 7f4bb6ffd640 1 --2- 172.21.15.47:0/1174635808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb810a460 0x7f4bb8111e90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00c890 tx=0x7f4bac00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:07.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.590+0000 7f4bb4ff9640 1 -- 172.21.15.47:0/1174635808 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac004220 con 0x7f4bb810a460 2024-07-24T22:09:07.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.590+0000 7f4bbdd6f640 1 -- 172.21.15.47:0/1174635808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb811d9e0 con 0x7f4bb810a460 2024-07-24T22:09:07.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.590+0000 7f4bbdd6f640 1 -- 172.21.15.47:0/1174635808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb811df20 con 0x7f4bb810a460 2024-07-24T22:09:07.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.598+0000 7f4bc0120740 1 Processor -- start 2024-07-24T22:09:07.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.598+0000 7f4bb4ff9640 1 -- 172.21.15.47:0/1174635808 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bac0043c0 con 0x7f4bb810a460 2024-07-24T22:09:07.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.598+0000 7f4bb4ff9640 1 -- 172.21.15.47:0/1174635808 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac004a00 con 0x7f4bb810a460 2024-07-24T22:09:07.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.599+0000 7f4bc0120740 1 -- start start 2024-07-24T22:09:07.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.600+0000 7f4bc0120740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a0f20 0x55c8de0a1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.600+0000 7f4bc0120740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a1840 0x55c8de0ad290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.600+0000 7f4bc0120740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0ad7d0 0x55c8de0afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.600+0000 7f4bc0120740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8de0189f0 con 0x55c8de0a0f20 2024-07-24T22:09:07.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.600+0000 7f4bc0120740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c8de007ef0 con 0x55c8de0ad7d0 2024-07-24T22:09:07.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.600+0000 7f4bc0120740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c8de00bf30 con 0x55c8de0a1840 2024-07-24T22:09:07.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.603+0000 7f4bb7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a0f20 0x55c8de0a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:07.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.603+0000 7f4bb7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a0f20 0x55c8de0a1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55766/0 (socket says 172.21.15.47:55766) 2024-07-24T22:09:07.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.603+0000 7f4bb7fff640 1 -- 172.21.15.47:0/4199686910 learned_addr learned my addr 172.21.15.47:0/4199686910 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:07.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.608+0000 7f4bb4ff9640 1 -- 172.21.15.47:0/1174635808 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f4bac005290 con 0x7f4bb810a460 2024-07-24T22:09:07.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.609+0000 7f4bb77fe640 1 --2- 172.21.15.47:0/4199686910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a1840 0x55c8de0ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:07.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.613+0000 7f4bb7fff640 1 -- 172.21.15.47:0/4199686910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a1840 msgr2=0x55c8de0ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:07.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.613+0000 7f4bb7fff640 1 --2- 172.21.15.47:0/4199686910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a1840 0x55c8de0ad290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.613+0000 7f4bb7fff640 1 -- 172.21.15.47:0/4199686910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0ad7d0 msgr2=0x55c8de0afbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:09:07.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.613+0000 7f4bb7fff640 1 --2- 172.21.15.47:0/4199686910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0ad7d0 0x55c8de0afbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.613+0000 7f4bb7fff640 1 -- 172.21.15.47:0/4199686910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ddd68930 con 0x55c8de0a0f20 2024-07-24T22:09:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.613+0000 7f4bb4ff9640 1 --2- 172.21.15.47:0/1174635808 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4ba00b3ec0 0x7f4ba00b6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.615+0000 7f4bb4ff9640 1 -- 172.21.15.47:0/1174635808 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f4bac0a6cc0 con 0x7f4bb810a460 2024-07-24T22:09:07.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.616+0000 7f4bb7fff640 1 --2- 172.21.15.47:0/4199686910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a0f20 0x55c8de0a1300 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000a8d0 tx=0x7f4bb000ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f9272d61119578b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:07.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.618+0000 7f4b9dffb640 1 -- 172.21.15.47:0/4199686910 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000ccc0 con 0x55c8de0a0f20 2024-07-24T22:09:07.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.618+0000 7f4b9dffb640 1 -- 172.21.15.47:0/4199686910 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb0005020 con 0x55c8de0a0f20 2024-07-24T22:09:07.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.618+0000 7f4bb77fe640 1 --2- 172.21.15.47:0/1174635808 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4ba00b3ec0 0x7f4ba00b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:07.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.620+0000 7f4bc0120740 1 -- 172.21.15.47:0/4199686910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a0f20 msgr2=0x55c8de0a1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:07.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.620+0000 7f4bc0120740 1 --2- 172.21.15.47:0/4199686910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a0f20 0x55c8de0a1300 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000a8d0 tx=0x7f4bb000ad90 comp rx=0 tx=0).stop 2024-07-24T22:09:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.626+0000 7f4bc0120740 1 -- 172.21.15.47:0/4199686910 shutdown_connections 2024-07-24T22:09:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.626+0000 7f4bc0120740 1 --2- 172.21.15.47:0/4199686910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0ad7d0 0x55c8de0afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.626+0000 7f4bc0120740 1 --2- 172.21.15.47:0/4199686910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a1840 0x55c8de0ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.626+0000 7f4bc0120740 1 --2- 172.21.15.47:0/4199686910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a0f20 0x55c8de0a1300 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.626+0000 7f4bc0120740 1 -- 172.21.15.47:0/4199686910 >> 172.21.15.47:0/4199686910 conn(0x55c8de09ed50 msgr2=0x55c8de09fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:07.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.628+0000 7f4bb77fe640 1 --2- 172.21.15.47:0/1174635808 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4ba00b3ec0 0x7f4ba00b6380 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8030040 tx=0x7f4ba802ae40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:07.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.630+0000 7f4bc0120740 1 -- 172.21.15.47:0/4199686910 shutdown_connections 2024-07-24T22:09:07.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.634+0000 7f4bc0120740 1 -- 172.21.15.47:0/4199686910 wait complete. 2024-07-24T22:09:07.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.635+0000 7f4bc0120740 1 -- start start 2024-07-24T22:09:07.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.636+0000 7f4bc0120740 1 Processor -- start 2024-07-24T22:09:07.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.637+0000 7f4bc0120740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a0f20 0x55c8de0ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.638+0000 7f4bc0120740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0a1840 0x55c8de0aa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.638+0000 7f4bc0120740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0ad7d0 0x55c8de0aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.638+0000 7f4bc0120740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8dde6b890 con 0x55c8de0ad7d0 2024-07-24T22:09:07.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.638+0000 7f4bc0120740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c8ddfaa390 con 0x55c8de0a1840 2024-07-24T22:09:07.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.638+0000 7f4bc0120740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c8de0b04a0 con 0x55c8de0a0f20 2024-07-24T22:09:07.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.638+0000 7f4bc0120740 10 client.0 _ll_register_callbacks cb 0x55c8ddfb4500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:07.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.639+0000 7f4bb7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0ad7d0 0x55c8de0aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:07.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.639+0000 7f4bb7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0ad7d0 0x55c8de0aadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55768/0 (socket says 172.21.15.47:55768) 2024-07-24T22:09:07.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.639+0000 7f4bb7fff640 1 -- 172.21.15.47:0/3707399073 learned_addr learned my addr 172.21.15.47:0/3707399073 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:07.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.639+0000 7f4bb77fe640 1 --2- 172.21.15.47:0/3707399073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a0f20 0x55c8de0ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:07.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.641+0000 7f4bb7fff640 1 -- 172.21.15.47:0/3707399073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a0f20 msgr2=0x55c8de0ad1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:07.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.641+0000 7f4bb7fff640 1 --2- 172.21.15.47:0/3707399073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a0f20 0x55c8de0ad1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.641+0000 7f4bb7fff640 1 -- 172.21.15.47:0/3707399073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0a1840 msgr2=0x55c8de0aa630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:09:07.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.641+0000 7f4bb7fff640 1 --2- 172.21.15.47:0/3707399073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0a1840 0x55c8de0aa630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.641+0000 7f4bb7fff640 1 -- 172.21.15.47:0/3707399073 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8ddfa4d60 con 0x55c8de0ad7d0 2024-07-24T22:09:07.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.644+0000 7f4bb7fff640 1 --2- 172.21.15.47:0/3707399073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0ad7d0 0x55c8de0aadc0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0005400 tx=0x7f4bb0005430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2887e66144a7da server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:07.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.644+0000 7f4b96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:09:07.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.648+0000 7f4b96ffd640 1 -- 172.21.15.47:0/3707399073 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0027060 con 0x55c8de0ad7d0 2024-07-24T22:09:07.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.649+0000 7f4bc0120740 1 -- 172.21.15.47:0/3707399073 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bb0005020 con 0x55c8de0ad7d0 2024-07-24T22:09:07.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.649+0000 7f4b96ffd640 1 -- 172.21.15.47:0/3707399073 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f4bb000f650 con 0x55c8de0ad7d0 2024-07-24T22:09:07.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.651+0000 7f4b96ffd640 1 -- 172.21.15.47:0/3707399073 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4bb000a4f0 con 0x55c8de0ad7d0 2024-07-24T22:09:07.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.652+0000 7f4bc0120740 10 client.15951 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:07.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.652+0000 7f4bc0120740 1 -- 172.21.15.47:0/3707399073 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c8de0bc360 con 0x55c8de0ad7d0 2024-07-24T22:09:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.655+0000 7f4b96ffd640 1 -- 172.21.15.47:0/3707399073 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb0005020 con 0x55c8de0ad7d0 2024-07-24T22:09:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.655+0000 7f4b96ffd640 1 -- 172.21.15.47:0/3707399073 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4bb0021070 con 0x55c8de0ad7d0 2024-07-24T22:09:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.656+0000 7f4bc0120740 10 client.15951 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.657+0000 7f4bc0120740 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.657+0000 7f4bc0120740 20 client.15951 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.657+0000 7f4bc0120740 1 --2- 172.21.15.47:0/3707399073 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c8de0bdb00 0x55c8de0bff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.657+0000 7f4bc0120740 4 client.15951 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:09:07.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.657+0000 7f4bc0120740 1 -- 172.21.15.47:0/3707399073 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8de01a940 con 0x55c8de0bdb00 2024-07-24T22:09:07.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.658+0000 7f4bb77fe640 1 --2- 172.21.15.47:0/3707399073 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c8de0bdb00 0x55c8de0bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:07.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.663+0000 7f4bb77fe640 1 --2- 172.21.15.47:0/3707399073 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c8de0bdb00 0x55c8de0bff60 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d8d484d56d8fc0e server_cookie=cfa026cf782acbf1 in_seq=0 out_seq=0 2024-07-24T22:09:07.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.663+0000 7f4b96ffd640 10 client.15951 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:07.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.666+0000 7f4b96ffd640 1 -- 172.21.15.47:0/3707399073 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8de01a940 con 0x55c8de0bdb00 2024-07-24T22:09:07.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.666+0000 7f4b96ffd640 10 client.15951 handle_command_reply: tid=0 2024-07-24T22:09:07.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.667+0000 7f4bc0120740 1 client.15951 shutdown 2024-07-24T22:09:07.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.667+0000 7f4bc0120740 1 -- 172.21.15.47:0/3707399073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0ad7d0 msgr2=0x55c8de0aadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:07.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.667+0000 7f4bc0120740 1 --2- 172.21.15.47:0/3707399073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0ad7d0 0x55c8de0aadc0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0005400 tx=0x7f4bb0005430 comp rx=0 tx=0).stop 2024-07-24T22:09:07.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.668+0000 7f4bc0120740 1 -- 172.21.15.47:0/3707399073 shutdown_connections 2024-07-24T22:09:07.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.668+0000 7f4bc0120740 1 --2- 172.21.15.47:0/3707399073 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c8de0bdb00 0x55c8de0bff60 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.668+0000 7f4bc0120740 1 --2- 172.21.15.47:0/3707399073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0ad7d0 0x55c8de0aadc0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.668+0000 7f4bc0120740 1 --2- 172.21.15.47:0/3707399073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0a1840 0x55c8de0aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.668+0000 7f4bc0120740 1 --2- 172.21.15.47:0/3707399073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a0f20 0x55c8de0ad1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.668+0000 7f4bc0120740 1 -- 172.21.15.47:0/3707399073 >> 172.21.15.47:0/3707399073 conn(0x55c8de09ed50 msgr2=0x55c8de0a48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:07.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.669+0000 7f4b96ffd640 0 client.15951 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:07.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.670+0000 7f4bc0120740 1 -- 172.21.15.47:0/3707399073 shutdown_connections 2024-07-24T22:09:07.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.670+0000 7f4bc0120740 1 -- 172.21.15.47:0/3707399073 wait complete. 2024-07-24T22:09:07.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.670+0000 7f4bc0120740 20 client.15951 trim_cache size 0 max 16384 2024-07-24T22:09:07.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.725+0000 7f4bc0120740 1 Processor -- start 2024-07-24T22:09:07.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.725+0000 7f4bc0120740 1 -- start start 2024-07-24T22:09:07.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.725+0000 7f4bc0120740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0a0f20 0x55c8de0a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.726+0000 7f4bc0120740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a1840 0x55c8de0a4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.726+0000 7f4bc0120740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0ad7d0 0x55c8de0c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.726+0000 7f4bc0120740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba400c950 con 0x55c8de0a1840 2024-07-24T22:09:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.726+0000 7f4bb6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a1840 0x55c8de0a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:07.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.726+0000 7f4bb6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a1840 0x55c8de0a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55772/0 (socket says 172.21.15.47:55772) 2024-07-24T22:09:07.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.727+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/810194959 learned_addr learned my addr 172.21.15.47:0/810194959 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:07.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.727+0000 7f4bb7fff640 1 --2- 172.21.15.47:0/810194959 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0ad7d0 0x55c8de0c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:07.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.727+0000 7f4bc0120740 1 -- 172.21.15.47:0/810194959 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba400f1d0 con 0x55c8de0a0f20 2024-07-24T22:09:07.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.727+0000 7f4bc0120740 1 -- 172.21.15.47:0/810194959 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba400cfc0 con 0x55c8de0ad7d0 2024-07-24T22:09:07.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.729+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/810194959 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0ad7d0 msgr2=0x55c8de0c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:07.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.729+0000 7f4bb6ffd640 1 --2- 172.21.15.47:0/810194959 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0ad7d0 0x55c8de0c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.729+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/810194959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0a0f20 msgr2=0x55c8de0a04f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:09:07.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.729+0000 7f4bb6ffd640 1 --2- 172.21.15.47:0/810194959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0a0f20 0x55c8de0a04f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.729+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/810194959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8de09f750 con 0x55c8de0a1840 2024-07-24T22:09:07.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.730+0000 7f4bb6ffd640 1 --2- 172.21.15.47:0/810194959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a1840 0x55c8de0a4770 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0aa660 tx=0x7f4bac0b30c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5762bbf9c8bca480 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:07.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.732+0000 7f4b9d7fa640 1 -- 172.21.15.47:0/810194959 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac01d070 con 0x55c8de0a1840 2024-07-24T22:09:07.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.733+0000 7f4b9d7fa640 1 -- 172.21.15.47:0/810194959 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bac0aa6d0 con 0x55c8de0a1840 2024-07-24T22:09:07.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.733+0000 7f4b9d7fa640 1 -- 172.21.15.47:0/810194959 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0cbbd0 con 0x55c8de0a1840 2024-07-24T22:09:07.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.734+0000 7f4bc0120740 1 -- 172.21.15.47:0/810194959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a1840 msgr2=0x55c8de0a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:07.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.734+0000 7f4bc0120740 1 --2- 172.21.15.47:0/810194959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a1840 0x55c8de0a4770 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0aa660 tx=0x7f4bac0b30c0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.735+0000 7f4bc0120740 1 -- 172.21.15.47:0/810194959 shutdown_connections 2024-07-24T22:09:07.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.735+0000 7f4bc0120740 1 --2- 172.21.15.47:0/810194959 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0ad7d0 0x55c8de0c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.735+0000 7f4bc0120740 1 --2- 172.21.15.47:0/810194959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0a1840 0x55c8de0a4770 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.735+0000 7f4bc0120740 1 --2- 172.21.15.47:0/810194959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0a0f20 0x55c8de0a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.735+0000 7f4bc0120740 1 -- 172.21.15.47:0/810194959 >> 172.21.15.47:0/810194959 conn(0x55c8de09ed50 msgr2=0x55c8de0a4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:07.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.735+0000 7f4bc0120740 1 -- 172.21.15.47:0/810194959 shutdown_connections 2024-07-24T22:09:07.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.735+0000 7f4bc0120740 1 -- 172.21.15.47:0/810194959 wait complete. 2024-07-24T22:09:07.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.736+0000 7f4bc0120740 1 -- start start 2024-07-24T22:09:07.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.737+0000 7f4bc0120740 1 Processor -- start 2024-07-24T22:09:07.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.737+0000 7f4bc0120740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a0f20 0x55c8de0a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.738+0000 7f4bc0120740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0a1840 0x55c8de0a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.738+0000 7f4bc0120740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0ad7d0 0x55c8de0a8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.738+0000 7f4bc0120740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba400d690 con 0x55c8de0ad7d0 2024-07-24T22:09:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.738+0000 7f4bb77fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a0f20 0x55c8de0a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.738+0000 7f4bb77fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a0f20 0x55c8de0a77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:34796/0 (socket says 172.21.15.47:34796) 2024-07-24T22:09:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.738+0000 7f4bb77fe640 1 -- 172.21.15.47:0/553965158 learned_addr learned my addr 172.21.15.47:0/553965158 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.738+0000 7f4bb6ffd640 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0a1840 0x55c8de0a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.738+0000 7f4bc0120740 1 -- 172.21.15.47:0/553965158 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba400eb00 con 0x55c8de0a1840 2024-07-24T22:09:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.738+0000 7f4bc0120740 1 -- 172.21.15.47:0/553965158 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba400dd60 con 0x55c8de0a0f20 2024-07-24T22:09:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.739+0000 7f4bc0120740 10 client.0 _ll_register_callbacks cb 0x7f4bb000ccd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.739+0000 7f4bb7fff640 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0ad7d0 0x55c8de0a8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.739+0000 7f4bb77fe640 1 -- 172.21.15.47:0/553965158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0a1840 msgr2=0x55c8de0a7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.739+0000 7f4bb77fe640 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0a1840 0x55c8de0a7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.740+0000 7f4bb77fe640 1 -- 172.21.15.47:0/553965158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0ad7d0 msgr2=0x55c8de0a8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.740+0000 7f4bb77fe640 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0ad7d0 0x55c8de0a8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.740+0000 7f4bb77fe640 1 -- 172.21.15.47:0/553965158 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8de0b4ff0 con 0x55c8de0a0f20 2024-07-24T22:09:07.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.740+0000 7f4bb7fff640 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0ad7d0 0x55c8de0a8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:09:07.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.741+0000 7f4bb77fe640 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a0f20 0x55c8de0a77a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ba802af30 tx=0x7f4ba802a940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d65ad0fd6f358e24 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:07.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.742+0000 7f4b96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:09:07.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.762+0000 7f4b96ffd640 1 -- 172.21.15.47:0/553965158 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8034070 con 0x55c8de0a0f20 2024-07-24T22:09:07.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.762+0000 7f4b96ffd640 1 -- 172.21.15.47:0/553965158 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f4ba8004040 con 0x55c8de0a0f20 2024-07-24T22:09:07.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.762+0000 7f4bc0120740 1 -- 172.21.15.47:0/553965158 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bac0aa6d0 con 0x55c8de0a0f20 2024-07-24T22:09:07.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.763+0000 7f4b96ffd640 1 -- 172.21.15.47:0/553965158 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4ba8004240 con 0x55c8de0a0f20 2024-07-24T22:09:07.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.763+0000 7f4bc0120740 10 client.25477 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:07.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.763+0000 7f4bc0120740 1 -- 172.21.15.47:0/553965158 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c8de128c30 con 0x55c8de0a0f20 2024-07-24T22:09:07.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.765+0000 7f4b96ffd640 1 -- 172.21.15.47:0/553965158 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ba8030640 con 0x55c8de0a0f20 2024-07-24T22:09:07.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.766+0000 7f4b96ffd640 1 -- 172.21.15.47:0/553965158 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4ba8041040 con 0x55c8de0a0f20 2024-07-24T22:09:07.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.766+0000 7f4bc0120740 10 client.25477 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:07.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.766+0000 7f4bc0120740 10 client.25477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:07.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.766+0000 7f4bc0120740 20 client.25477 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:07.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.766+0000 7f4bc0120740 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c8de1293e0 0x55c8de12b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:07.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.766+0000 7f4bc0120740 4 client.25477 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:09:07.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.766+0000 7f4bc0120740 1 -- 172.21.15.47:0/553965158 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f4bac0aa6d0 con 0x55c8de1293e0 2024-07-24T22:09:07.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.768+0000 7f4bb6ffd640 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c8de1293e0 0x55c8de12b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:07.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.771+0000 7f4bb6ffd640 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c8de1293e0 0x55c8de12b800 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6441bbf99e32b1b4 server_cookie=67a13c94769d32f8 in_seq=0 out_seq=0 2024-07-24T22:09:07.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.771+0000 7f4b96ffd640 10 client.25477 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:07.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.773+0000 7f4b96ffd640 1 -- 172.21.15.47:0/553965158 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f4bac0aa6d0 con 0x55c8de1293e0 2024-07-24T22:09:07.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.773+0000 7f4b96ffd640 10 client.25477 handle_command_reply: tid=0 2024-07-24T22:09:07.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.773+0000 7f4bc0120740 1 client.25477 shutdown 2024-07-24T22:09:07.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.773+0000 7f4bc0120740 1 -- 172.21.15.47:0/553965158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a0f20 msgr2=0x55c8de0a77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:07.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.773+0000 7f4bc0120740 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a0f20 0x55c8de0a77a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ba802af30 tx=0x7f4ba802a940 comp rx=0 tx=0).stop 2024-07-24T22:09:07.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.774+0000 7f4bc0120740 1 -- 172.21.15.47:0/553965158 shutdown_connections 2024-07-24T22:09:07.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.774+0000 7f4bc0120740 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c8de1293e0 0x55c8de12b800 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.774+0000 7f4bc0120740 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8de0ad7d0 0x55c8de0a8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.774+0000 7f4bc0120740 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c8de0a1840 0x55c8de0a7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.774+0000 7f4bc0120740 1 --2- 172.21.15.47:0/553965158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c8de0a0f20 0x55c8de0a77a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.774+0000 7f4bc0120740 1 -- 172.21.15.47:0/553965158 >> 172.21.15.47:0/553965158 conn(0x55c8de09ed50 msgr2=0x55c8de0a4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:07.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.774+0000 7f4b96ffd640 0 client.25477 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:07.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.774+0000 7f4bc0120740 1 -- 172.21.15.47:0/553965158 shutdown_connections 2024-07-24T22:09:07.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.774+0000 7f4bc0120740 1 -- 172.21.15.47:0/553965158 wait complete. 2024-07-24T22:09:07.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.774+0000 7f4bc0120740 20 client.25477 trim_cache size 0 max 16384 2024-07-24T22:09:07.777 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:09:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:09:07.777 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "b7d41c1b-19e4-4b38-8b41-815d72db9c95", 2024-07-24T22:09:07.778 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:09:07.778 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:09:07.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.776+0000 7f4bbdd6f640 1 -- 172.21.15.47:0/1174635808 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4ba00b3ec0 msgr2=0x7f4ba00b6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:07.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.776+0000 7f4bbdd6f640 1 --2- 172.21.15.47:0/1174635808 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4ba00b3ec0 0x7f4ba00b6380 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8030040 tx=0x7f4ba802ae40 comp rx=0 tx=0).stop 2024-07-24T22:09:07.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.776+0000 7f4bbdd6f640 1 -- 172.21.15.47:0/1174635808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb810a460 msgr2=0x7f4bb8111e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:07.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.776+0000 7f4bbdd6f640 1 --2- 172.21.15.47:0/1174635808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb810a460 0x7f4bb8111e90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00c890 tx=0x7f4bac00cd50 comp rx=0 tx=0).stop 2024-07-24T22:09:07.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.776+0000 7f4bbdd6f640 1 -- 172.21.15.47:0/1174635808 shutdown_connections 2024-07-24T22:09:07.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.776+0000 7f4bbdd6f640 1 --2- 172.21.15.47:0/1174635808 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4ba00b3ec0 0x7f4ba00b6380 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.776+0000 7f4bbdd6f640 1 --2- 172.21.15.47:0/1174635808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bb8115400 0x7f4bb81123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.776+0000 7f4bbdd6f640 1 --2- 172.21.15.47:0/1174635808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bb810a460 0x7f4bb8111e90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.776+0000 7f4bbdd6f640 1 --2- 172.21.15.47:0/1174635808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bb8109b40 0x7f4bb8114c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:07.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.776+0000 7f4bbdd6f640 1 -- 172.21.15.47:0/1174635808 >> 172.21.15.47:0/1174635808 conn(0x7f4bb806d980 msgr2=0x7f4bb8072260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:07.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.776+0000 7f4bbdd6f640 1 -- 172.21.15.47:0/1174635808 shutdown_connections 2024-07-24T22:09:07.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:07.776+0000 7f4bbdd6f640 1 -- 172.21.15.47:0/1174635808 wait complete. 2024-07-24T22:09:08.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:07 smithi188 ceph-mon[37380]: pgmap v423: 97 pgs: 97 active+clean; 7.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 678 MiB/s wr, 885 op/s 2024-07-24T22:09:08.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:07 smithi183 ceph-mon[37007]: pgmap v423: 97 pgs: 97 active+clean; 7.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 678 MiB/s wr, 885 op/s 2024-07-24T22:09:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.177+0000 7f3a65d8a640 1 -- 172.21.15.47:0/3931521570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a6010a460 msgr2=0x7f3a60114ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.177+0000 7f3a65d8a640 1 --2- 172.21.15.47:0/3931521570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a6010a460 0x7f3a60114ec0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009900 tx=0x7f3a4802a410 comp rx=0 tx=0).stop 2024-07-24T22:09:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.177+0000 7f3a65d8a640 1 -- 172.21.15.47:0/3931521570 shutdown_connections 2024-07-24T22:09:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.177+0000 7f3a65d8a640 1 --2- 172.21.15.47:0/3931521570 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a60115400 0x7f3a601177f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.177+0000 7f3a65d8a640 1 --2- 172.21.15.47:0/3931521570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a6010a460 0x7f3a60114ec0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.177+0000 7f3a65d8a640 1 --2- 172.21.15.47:0/3931521570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a60109b40 0x7f3a60109f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.177+0000 7f3a65d8a640 1 -- 172.21.15.47:0/3931521570 >> 172.21.15.47:0/3931521570 conn(0x7f3a6006d760 msgr2=0x7f3a6006db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.177+0000 7f3a65d8a640 1 -- 172.21.15.47:0/3931521570 shutdown_connections 2024-07-24T22:09:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.177+0000 7f3a65d8a640 1 -- 172.21.15.47:0/3931521570 wait complete. 2024-07-24T22:09:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.178+0000 7f3a65d8a640 1 Processor -- start 2024-07-24T22:09:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.179+0000 7f3a65d8a640 1 -- start start 2024-07-24T22:09:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.179+0000 7f3a65d8a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a60109b40 0x7f3a601a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.179+0000 7f3a65d8a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a6010a460 0x7f3a601a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.179+0000 7f3a65d8a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a60115400 0x7f3a601a6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.179+0000 7f3a65d8a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6011ae70 con 0x7f3a60109b40 2024-07-24T22:09:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.179+0000 7f3a65d8a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6011acf0 con 0x7f3a60115400 2024-07-24T22:09:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.179+0000 7f3a65d8a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6011aff0 con 0x7f3a6010a460 2024-07-24T22:09:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.180+0000 7f3a5f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a60109b40 0x7f3a601a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.180+0000 7f3a5effd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a6010a460 0x7f3a601a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.180+0000 7f3a5effd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a6010a460 0x7f3a601a19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:34826/0 (socket says 172.21.15.47:34826) 2024-07-24T22:09:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.180+0000 7f3a5f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a60109b40 0x7f3a601a1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55798/0 (socket says 172.21.15.47:55798) 2024-07-24T22:09:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.180+0000 7f3a5effd640 1 -- 172.21.15.47:0/654798563 learned_addr learned my addr 172.21.15.47:0/654798563 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.180+0000 7f3a5ffff640 1 --2- 172.21.15.47:0/654798563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a60115400 0x7f3a601a6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.180+0000 7f3a5f7fe640 1 -- 172.21.15.47:0/654798563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a6010a460 msgr2=0x7f3a601a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.180+0000 7f3a5f7fe640 1 --2- 172.21.15.47:0/654798563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a6010a460 0x7f3a601a19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.180+0000 7f3a5f7fe640 1 -- 172.21.15.47:0/654798563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a60115400 msgr2=0x7f3a601a6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.180+0000 7f3a5f7fe640 1 --2- 172.21.15.47:0/654798563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a60115400 0x7f3a601a6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.180+0000 7f3a5f7fe640 1 -- 172.21.15.47:0/654798563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a601a7530 con 0x7f3a60109b40 2024-07-24T22:09:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.181+0000 7f3a5f7fe640 1 --2- 172.21.15.47:0/654798563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a60109b40 0x7f3a601a1490 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009e60 tx=0x7f3a5000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.181+0000 7f3a5cff9640 1 -- 172.21.15.47:0/654798563 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a50020070 con 0x7f3a60109b40 2024-07-24T22:09:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.181+0000 7f3a5cff9640 1 -- 172.21.15.47:0/654798563 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a5000ccc0 con 0x7f3a60109b40 2024-07-24T22:09:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.182+0000 7f3a65d8a640 1 -- 172.21.15.47:0/654798563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a601a7820 con 0x7f3a60109b40 2024-07-24T22:09:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.182+0000 7f3a65d8a640 1 -- 172.21.15.47:0/654798563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a6010ac50 con 0x7f3a60109b40 2024-07-24T22:09:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.183+0000 7f3a5cff9640 1 -- 172.21.15.47:0/654798563 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5001ba80 con 0x7f3a60109b40 2024-07-24T22:09:08.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:07 smithi047 ceph-mon[32551]: pgmap v423: 97 pgs: 97 active+clean; 7.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 678 MiB/s wr, 885 op/s 2024-07-24T22:09:08.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.185+0000 7f3a68bbc740 1 Processor -- start 2024-07-24T22:09:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.186+0000 7f3a68bbc740 1 -- start start 2024-07-24T22:09:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.186+0000 7f3a68bbc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5632960618c0 0x563296061ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.186+0000 7f3a68bbc740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296076440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.186+0000 7f3a68bbc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563296076980 0x563296078d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.186+0000 7f3a68bbc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563295fd7280 con 0x5632960618c0 2024-07-24T22:09:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.186+0000 7f3a68bbc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563295fc6780 con 0x563296076980 2024-07-24T22:09:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.186+0000 7f3a68bbc740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563295fca7c0 con 0x5632960621e0 2024-07-24T22:09:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.187+0000 7f3a5effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563296076980 0x563296078d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.187+0000 7f3a5effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563296076980 0x563296078d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:41344/0 (socket says 172.21.15.47:41344) 2024-07-24T22:09:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.187+0000 7f3a5effd640 1 -- 172.21.15.47:0/4170306887 learned_addr learned my addr 172.21.15.47:0/4170306887 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.187+0000 7f3a5ffff640 1 --2- 172.21.15.47:0/4170306887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5632960618c0 0x563296061ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.187+0000 7f3a5effd640 1 -- 172.21.15.47:0/4170306887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 msgr2=0x563296076440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-24T22:09:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.187+0000 7f3a5effd640 1 --2- 172.21.15.47:0/4170306887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296076440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.187+0000 7f3a5effd640 1 -- 172.21.15.47:0/4170306887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5632960618c0 msgr2=0x563296061ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.187+0000 7f3a5effd640 1 --2- 172.21.15.47:0/4170306887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5632960618c0 0x563296061ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.187+0000 7f3a5effd640 1 -- 172.21.15.47:0/4170306887 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563295d2a790 con 0x563296076980 2024-07-24T22:09:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.188+0000 7f3a5effd640 1 --2- 172.21.15.47:0/4170306887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563296076980 0x563296078d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a48000c00 tx=0x7f3a48031c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5763f9a76ba84128 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.188+0000 7f3a5cff9640 1 -- 172.21.15.47:0/654798563 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f3a50023070 con 0x7f3a60109b40 2024-07-24T22:09:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.188+0000 7f3a55ffb640 1 -- 172.21.15.47:0/4170306887 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48040070 con 0x563296076980 2024-07-24T22:09:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.189+0000 7f3a55ffb640 1 -- 172.21.15.47:0/4170306887 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a480316a0 con 0x563296076980 2024-07-24T22:09:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.189+0000 7f3a55ffb640 1 -- 172.21.15.47:0/4170306887 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48035040 con 0x563296076980 2024-07-24T22:09:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.190+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4170306887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563296076980 msgr2=0x563296078d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.190+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/4170306887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563296076980 0x563296078d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a48000c00 tx=0x7f3a48031c40 comp rx=0 tx=0).stop 2024-07-24T22:09:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.190+0000 7f3a5cff9640 1 --2- 172.21.15.47:0/654798563 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3a4c0b3f10 0x7f3a4c0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.191+0000 7f3a5ffff640 1 --2- 172.21.15.47:0/654798563 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3a4c0b3f10 0x7f3a4c0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.191+0000 7f3a5cff9640 1 -- 172.21.15.47:0/654798563 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f3a500e39a0 con 0x7f3a60109b40 2024-07-24T22:09:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.192+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4170306887 shutdown_connections 2024-07-24T22:09:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.192+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/4170306887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x563296076980 0x563296078d70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.192+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/4170306887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296076440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.192+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/4170306887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5632960618c0 0x563296061ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.192+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4170306887 >> 172.21.15.47:0/4170306887 conn(0x56329605f6f0 msgr2=0x563296060890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.193+0000 7f3a5ffff640 1 --2- 172.21.15.47:0/654798563 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3a4c0b3f10 0x7f3a4c0b63d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3a6006b9a0 tx=0x7f3a58009600 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.193+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4170306887 shutdown_connections 2024-07-24T22:09:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.193+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4170306887 wait complete. 2024-07-24T22:09:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.194+0000 7f3a68bbc740 1 -- start start 2024-07-24T22:09:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.194+0000 7f3a68bbc740 1 Processor -- start 2024-07-24T22:09:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.195+0000 7f3a68bbc740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960618c0 0x563296076120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.195+0000 7f3a68bbc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5632960621e0 0x563296073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.195+0000 7f3a68bbc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563296076980 0x563296073b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.196+0000 7f3a5effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5632960621e0 0x563296073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.196+0000 7f3a5effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5632960621e0 0x563296073600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:41356/0 (socket says 172.21.15.47:41356) 2024-07-24T22:09:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.196+0000 7f3a5ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563296076980 0x563296073b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.196+0000 7f3a5ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563296076980 0x563296073b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55804/0 (socket says 172.21.15.47:55804) 2024-07-24T22:09:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.196+0000 7f3a5effd640 1 -- 172.21.15.47:0/4158681895 learned_addr learned my addr 172.21.15.47:0/4158681895 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.196+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4158681895 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563295f00ab0 con 0x563296076980 2024-07-24T22:09:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.196+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4158681895 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563295f4e9e0 con 0x5632960621e0 2024-07-24T22:09:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.196+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4158681895 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563296079600 con 0x5632960618c0 2024-07-24T22:09:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.197+0000 7f3a68bbc740 10 client.0 _ll_register_callbacks cb 0x563295cd6a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.197+0000 7f3a5f7fe640 1 --2- 172.21.15.47:0/4158681895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960618c0 0x563296076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.197+0000 7f3a5effd640 1 -- 172.21.15.47:0/4158681895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960618c0 msgr2=0x563296076120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.197+0000 7f3a5effd640 1 --2- 172.21.15.47:0/4158681895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960618c0 0x563296076120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.197+0000 7f3a5effd640 1 -- 172.21.15.47:0/4158681895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563296076980 msgr2=0x563296073b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.197+0000 7f3a5effd640 1 --2- 172.21.15.47:0/4158681895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563296076980 0x563296073b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.197+0000 7f3a5effd640 1 -- 172.21.15.47:0/4158681895 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563295da3620 con 0x5632960621e0 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.197+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4158681895 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563295f75ce0 con 0x5632960621e0 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.197+0000 7f3a5effd640 1 --2- 172.21.15.47:0/4158681895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5632960621e0 0x563296073600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009430 tx=0x7f3a48005710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fd0f0149d418df4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.197+0000 7f3a3effd640 10 client.25439 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.197+0000 7f3a3effd640 1 -- 172.21.15.47:0/4158681895 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4804d060 con 0x5632960621e0 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.198+0000 7f3a3effd640 1 -- 172.21.15.47:0/4158681895 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f3a480318b0 con 0x5632960621e0 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.198+0000 7f3a3effd640 1 -- 172.21.15.47:0/4158681895 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3a48040070 con 0x5632960621e0 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.198+0000 7f3a68bbc740 10 client.25439 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.198+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4158681895 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({fsmap=20}) -- 0x563296084d10 con 0x5632960621e0 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.198+0000 7f3a3effd640 1 -- 172.21.15.47:0/4158681895 <== mon.2 v2:172.21.15.183:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3a48004030 con 0x5632960621e0 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.198+0000 7f3a68bbc740 10 client.25439 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.198+0000 7f3a68bbc740 10 client.25439 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.198+0000 7f3a68bbc740 20 client.25439 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.198+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/4158681895 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563296086060 0x563296088450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.198+0000 7f3a68bbc740 4 client.25439 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:09:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.198+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4158681895 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563295fd91d0 con 0x563296086060 2024-07-24T22:09:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.199+0000 7f3a5f7fe640 1 --2- 172.21.15.47:0/4158681895 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563296086060 0x563296088450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.202+0000 7f3a5f7fe640 1 --2- 172.21.15.47:0/4158681895 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563296086060 0x563296088450 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1922ca0911715d09 server_cookie=e4d9e28da5f032d in_seq=0 out_seq=0 2024-07-24T22:09:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.202+0000 7f3a3effd640 10 client.25439 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.207+0000 7f3a3effd640 1 -- 172.21.15.47:0/4158681895 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563295fd91d0 con 0x563296086060 2024-07-24T22:09:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.207+0000 7f3a3effd640 10 client.25439 handle_command_reply: tid=0 2024-07-24T22:09:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.208+0000 7f3a68bbc740 1 client.25439 shutdown 2024-07-24T22:09:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.208+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4158681895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5632960621e0 msgr2=0x563296073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.208+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/4158681895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5632960621e0 0x563296073600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009430 tx=0x7f3a48005710 comp rx=0 tx=0).stop 2024-07-24T22:09:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.208+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4158681895 shutdown_connections 2024-07-24T22:09:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.208+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/4158681895 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563296086060 0x563296088450 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.208+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/4158681895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563296076980 0x563296073b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.208+0000 7f3a3effd640 0 client.25439 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.208+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/4158681895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5632960621e0 0x563296073600 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.208+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/4158681895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960618c0 0x563296076120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.208+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4158681895 >> 172.21.15.47:0/4158681895 conn(0x56329605f6f0 msgr2=0x563296065290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.208+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4158681895 shutdown_connections 2024-07-24T22:09:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.208+0000 7f3a68bbc740 1 -- 172.21.15.47:0/4158681895 wait complete. 2024-07-24T22:09:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.209+0000 7f3a68bbc740 20 client.25439 trim_cache size 0 max 16384 2024-07-24T22:09:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.245+0000 7f3a68bbc740 1 Processor -- start 2024-07-24T22:09:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.245+0000 7f3a68bbc740 1 -- start start 2024-07-24T22:09:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.245+0000 7f3a68bbc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56329605f6f0 0x563296060f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.245+0000 7f3a68bbc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5632960618c0 0x56329605efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.245+0000 7f3a68bbc740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296066a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.245+0000 7f3a68bbc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4000c7f0 con 0x5632960618c0 2024-07-24T22:09:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.245+0000 7f3a68bbc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4000f070 con 0x56329605f6f0 2024-07-24T22:09:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.245+0000 7f3a68bbc740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4000ce60 con 0x5632960621e0 2024-07-24T22:09:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.245+0000 7f3a5effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5632960618c0 0x56329605efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.245+0000 7f3a5f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56329605f6f0 0x563296060f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.245+0000 7f3a5effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5632960618c0 0x56329605efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55812/0 (socket says 172.21.15.47:55812) 2024-07-24T22:09:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.245+0000 7f3a5effd640 1 -- 172.21.15.47:0/2337409661 learned_addr learned my addr 172.21.15.47:0/2337409661 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.245+0000 7f3a5ffff640 1 --2- 172.21.15.47:0/2337409661 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.246+0000 7f3a5effd640 1 -- 172.21.15.47:0/2337409661 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 msgr2=0x563296066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.246+0000 7f3a5effd640 1 --2- 172.21.15.47:0/2337409661 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296066a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.246+0000 7f3a5effd640 1 -- 172.21.15.47:0/2337409661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56329605f6f0 msgr2=0x563296060f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.246+0000 7f3a5effd640 1 --2- 172.21.15.47:0/2337409661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56329605f6f0 0x563296060f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.246+0000 7f3a5effd640 1 -- 172.21.15.47:0/2337409661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563296071ae0 con 0x5632960618c0 2024-07-24T22:09:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.246+0000 7f3a5f7fe640 1 --2- 172.21.15.47:0/2337409661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56329605f6f0 0x563296060f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.246+0000 7f3a5ffff640 1 --2- 172.21.15.47:0/2337409661 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296066a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:09:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.246+0000 7f3a5effd640 1 --2- 172.21.15.47:0/2337409661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5632960618c0 0x56329605efa0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009a20 tx=0x7f3a48048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee39909851bd33c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.246+0000 7f3a557fa640 1 -- 172.21.15.47:0/2337409661 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48035040 con 0x5632960618c0 2024-07-24T22:09:08.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.246+0000 7f3a557fa640 1 -- 172.21.15.47:0/2337409661 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563295f75ce0 con 0x5632960618c0 2024-07-24T22:09:08.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.246+0000 7f3a557fa640 1 -- 172.21.15.47:0/2337409661 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4803c6a0 con 0x5632960618c0 2024-07-24T22:09:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.247+0000 7f3a68bbc740 1 -- 172.21.15.47:0/2337409661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5632960618c0 msgr2=0x56329605efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.247+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/2337409661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5632960618c0 0x56329605efa0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009a20 tx=0x7f3a48048000 comp rx=0 tx=0).stop 2024-07-24T22:09:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.247+0000 7f3a68bbc740 1 -- 172.21.15.47:0/2337409661 shutdown_connections 2024-07-24T22:09:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.247+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/2337409661 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296066a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.247+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/2337409661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5632960618c0 0x56329605efa0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.247+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/2337409661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56329605f6f0 0x563296060f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.247+0000 7f3a68bbc740 1 -- 172.21.15.47:0/2337409661 >> 172.21.15.47:0/2337409661 conn(0x563296073170 msgr2=0x563296060800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.247+0000 7f3a68bbc740 1 -- 172.21.15.47:0/2337409661 shutdown_connections 2024-07-24T22:09:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.247+0000 7f3a68bbc740 1 -- 172.21.15.47:0/2337409661 wait complete. 2024-07-24T22:09:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a68bbc740 1 -- start start 2024-07-24T22:09:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a68bbc740 1 Processor -- start 2024-07-24T22:09:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a68bbc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56329605f6f0 0x56329608b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a68bbc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5632960618c0 0x563296063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a68bbc740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296063580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a68bbc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4000d530 con 0x56329605f6f0 2024-07-24T22:09:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a68bbc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4000e9a0 con 0x5632960618c0 2024-07-24T22:09:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a68bbc740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4000dc00 con 0x5632960621e0 2024-07-24T22:09:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a68bbc740 10 client.0 _ll_register_callbacks cb 0x7f3a48031b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a5f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56329605f6f0 0x56329608b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a5ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296063580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a5ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296063580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:34858/0 (socket says 172.21.15.47:34858) 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a5f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56329605f6f0 0x56329608b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55826/0 (socket says 172.21.15.47:55826) 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a5ffff640 1 -- 172.21.15.47:0/908844894 learned_addr learned my addr 172.21.15.47:0/908844894 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.248+0000 7f3a5effd640 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5632960618c0 0x563296063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.249+0000 7f3a5effd640 1 -- 172.21.15.47:0/908844894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 msgr2=0x563296063580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.249+0000 7f3a5effd640 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296063580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.249+0000 7f3a5effd640 1 -- 172.21.15.47:0/908844894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56329605f6f0 msgr2=0x56329608b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.249+0000 7f3a5effd640 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56329605f6f0 0x56329608b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.249+0000 7f3a5effd640 1 -- 172.21.15.47:0/908844894 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563296063b40 con 0x5632960618c0 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.249+0000 7f3a5f7fe640 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56329605f6f0 0x56329608b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.249+0000 7f3a5ffff640 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296063580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.249+0000 7f3a5effd640 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5632960618c0 0x563296063040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a48005c40 tx=0x7f3a480049a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f02ee8346e65c52e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.249+0000 7f3a3effd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.249+0000 7f3a3effd640 1 -- 172.21.15.47:0/908844894 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4804d070 con 0x5632960618c0 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.249+0000 7f3a3effd640 1 -- 172.21.15.47:0/908844894 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f3a4803c650 con 0x5632960618c0 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.249+0000 7f3a68bbc740 1 -- 172.21.15.47:0/908844894 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563295f75ce0 con 0x5632960618c0 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.250+0000 7f3a3effd640 1 -- 172.21.15.47:0/908844894 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3a48035040 con 0x5632960618c0 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.250+0000 7f3a68bbc740 10 client.25445 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.250+0000 7f3a68bbc740 1 -- 172.21.15.47:0/908844894 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5632960f0770 con 0x5632960618c0 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.250+0000 7f3a3effd640 1 -- 172.21.15.47:0/908844894 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563295f75ce0 con 0x5632960618c0 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.250+0000 7f3a3effd640 1 -- 172.21.15.47:0/908844894 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3a4805b430 con 0x5632960618c0 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.250+0000 7f3a68bbc740 10 client.25445 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.250+0000 7f3a68bbc740 10 client.25445 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.250+0000 7f3a68bbc740 20 client.25445 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.250+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563296076980 0x5632960f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:08.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.250+0000 7f3a68bbc740 4 client.25445 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:09:08.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.250+0000 7f3a68bbc740 1 -- 172.21.15.47:0/908844894 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563295fd4c70 con 0x563296076980 2024-07-24T22:09:08.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.250+0000 7f3a5f7fe640 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563296076980 0x5632960f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:08.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.251+0000 7f3a3effd640 10 client.25445 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:08.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:08.251+0000 7f3a5f7fe640 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563296076980 0x5632960f2c50 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=804a400a143df007 server_cookie=b088301037f8d6e4 in_seq=0 out_seq=0 2024-07-24T22:09:09.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:08 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:09:09.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:08 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:09:09.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:08 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:09:09.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:08 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:09:09.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:08 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:09:09.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:08 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:09:09.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:08 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:09:09.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:08 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:09:09.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:08 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:09:09.426 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:09:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:09:10.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:09 smithi183 ceph-mon[37007]: pgmap v424: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 808 MiB/s wr, 1.42k op/s 2024-07-24T22:09:10.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:09 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:09:10.166 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:09 smithi047 ceph-mon[32551]: pgmap v424: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 808 MiB/s wr, 1.42k op/s 2024-07-24T22:09:10.166 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:09 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:09:10.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:09 smithi188 ceph-mon[37380]: pgmap v424: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 808 MiB/s wr, 1.42k op/s 2024-07-24T22:09:10.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:09 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:09:11.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.271+0000 7f3a3effd640 1 -- 172.21.15.47:0/908844894 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563295fd4c70 con 0x563296076980 2024-07-24T22:09:11.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.271+0000 7f3a3effd640 10 client.25445 handle_command_reply: tid=0 2024-07-24T22:09:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.271+0000 7f3a68bbc740 1 client.25445 shutdown 2024-07-24T22:09:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.271+0000 7f3a68bbc740 1 -- 172.21.15.47:0/908844894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5632960618c0 msgr2=0x563296063040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.272+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5632960618c0 0x563296063040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a48005c40 tx=0x7f3a480049a0 comp rx=0 tx=0).stop 2024-07-24T22:09:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.272+0000 7f3a68bbc740 1 -- 172.21.15.47:0/908844894 shutdown_connections 2024-07-24T22:09:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.272+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563296076980 0x5632960f2c50 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.272+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5632960621e0 0x563296063580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.272+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5632960618c0 0x563296063040 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.272+0000 7f3a68bbc740 1 --2- 172.21.15.47:0/908844894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56329605f6f0 0x56329608b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.272+0000 7f3a68bbc740 1 -- 172.21.15.47:0/908844894 >> 172.21.15.47:0/908844894 conn(0x563296073170 msgr2=0x563296074970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.272+0000 7f3a3effd640 0 client.25445 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.272+0000 7f3a68bbc740 1 -- 172.21.15.47:0/908844894 shutdown_connections 2024-07-24T22:09:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.272+0000 7f3a68bbc740 1 -- 172.21.15.47:0/908844894 wait complete. 2024-07-24T22:09:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.273+0000 7f3a68bbc740 20 client.25445 trim_cache size 0 max 16384 2024-07-24T22:09:11.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:09:11.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:09:11.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:09:11.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:09:11.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.277+0000 7f3a65d8a640 1 -- 172.21.15.47:0/654798563 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3a4c0b3f10 msgr2=0x7f3a4c0b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:11.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.277+0000 7f3a65d8a640 1 --2- 172.21.15.47:0/654798563 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3a4c0b3f10 0x7f3a4c0b63d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3a6006b9a0 tx=0x7f3a58009600 comp rx=0 tx=0).stop 2024-07-24T22:09:11.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.277+0000 7f3a65d8a640 1 -- 172.21.15.47:0/654798563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a60109b40 msgr2=0x7f3a601a1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:11.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.277+0000 7f3a65d8a640 1 --2- 172.21.15.47:0/654798563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a60109b40 0x7f3a601a1490 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009e60 tx=0x7f3a5000edc0 comp rx=0 tx=0).stop 2024-07-24T22:09:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.280+0000 7f3a65d8a640 1 -- 172.21.15.47:0/654798563 shutdown_connections 2024-07-24T22:09:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.280+0000 7f3a65d8a640 1 --2- 172.21.15.47:0/654798563 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3a4c0b3f10 0x7f3a4c0b63d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.280+0000 7f3a65d8a640 1 --2- 172.21.15.47:0/654798563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a60115400 0x7f3a601a6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.280+0000 7f3a65d8a640 1 --2- 172.21.15.47:0/654798563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a6010a460 0x7f3a601a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.280+0000 7f3a65d8a640 1 --2- 172.21.15.47:0/654798563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a60109b40 0x7f3a601a1490 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.280+0000 7f3a65d8a640 1 -- 172.21.15.47:0/654798563 >> 172.21.15.47:0/654798563 conn(0x7f3a6006d760 msgr2=0x7f3a60071180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.283+0000 7f3a65d8a640 1 -- 172.21.15.47:0/654798563 shutdown_connections 2024-07-24T22:09:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:11.283+0000 7f3a65d8a640 1 -- 172.21.15.47:0/654798563 wait complete. 2024-07-24T22:09:11.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:11 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:09:11.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:11 smithi183 ceph-mon[37007]: pgmap v425: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 764 MiB/s wr, 1.62k op/s 2024-07-24T22:09:11.441 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:11 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:09:11.441 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:11 smithi047 ceph-mon[32551]: pgmap v425: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 764 MiB/s wr, 1.62k op/s 2024-07-24T22:09:11.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:11 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:09:11.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:11 smithi188 ceph-mon[37380]: pgmap v425: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 764 MiB/s wr, 1.62k op/s 2024-07-24T22:09:13.378 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:13 smithi047 ceph-mon[32551]: pgmap v426: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 754 MiB/s wr, 1.74k op/s 2024-07-24T22:09:13.378 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:13 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:09:13.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:13 smithi188 ceph-mon[37380]: pgmap v426: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 754 MiB/s wr, 1.74k op/s 2024-07-24T22:09:13.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:13 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:09:13.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.569+0000 7f936ddff640 1 -- 172.21.15.47:0/2175541411 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936811ba90 msgr2=0x7f936811de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:13.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.569+0000 7f936ddff640 1 --2- 172.21.15.47:0/2175541411 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936811ba90 0x7f936811de80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9360009ca0 tx=0x7f936002a980 comp rx=0 tx=0).stop 2024-07-24T22:09:13.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.571+0000 7f936ddff640 1 -- 172.21.15.47:0/2175541411 shutdown_connections 2024-07-24T22:09:13.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.571+0000 7f936ddff640 1 --2- 172.21.15.47:0/2175541411 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936811ba90 0x7f936811de80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.571+0000 7f936ddff640 1 --2- 172.21.15.47:0/2175541411 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9368109f20 0x7f936810a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.571+0000 7f936ddff640 1 --2- 172.21.15.47:0/2175541411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9368109b40 0x7f9368110ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.571+0000 7f936ddff640 1 -- 172.21.15.47:0/2175541411 >> 172.21.15.47:0/2175541411 conn(0x7f936806d980 msgr2=0x7f936806dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:13.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.575+0000 7f936ddff640 1 -- 172.21.15.47:0/2175541411 shutdown_connections 2024-07-24T22:09:13.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.577+0000 7f936ddff640 1 -- 172.21.15.47:0/2175541411 wait complete. 2024-07-24T22:09:13.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.578+0000 7f936ddff640 1 Processor -- start 2024-07-24T22:09:13.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.583+0000 7f936ddff640 1 -- start start 2024-07-24T22:09:13.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.583+0000 7f936ddff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9368109b40 0x7f93681a7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.583+0000 7f936ddff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9368109f20 0x7f93681a7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.583+0000 7f936ddff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936811ba90 0x7f93681ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.583+0000 7f936ddff640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9368121500 con 0x7f9368109f20 2024-07-24T22:09:13.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.583+0000 7f936ddff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9368121380 con 0x7f9368109b40 2024-07-24T22:09:13.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.583+0000 7f936ddff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9368121680 con 0x7f936811ba90 2024-07-24T22:09:13.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.586+0000 7f9367fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936811ba90 0x7f93681ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.586+0000 7f9367fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936811ba90 0x7f93681ad370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:34868/0 (socket says 172.21.15.47:34868) 2024-07-24T22:09:13.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.586+0000 7f9367fff640 1 -- 172.21.15.47:0/2735164607 learned_addr learned my addr 172.21.15.47:0/2735164607 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:13.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.587+0000 7f935ffff640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9368109f20 0x7f93681a7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.587+0000 7f93677fe640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9368109b40 0x7f93681a7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.590+0000 7f9367fff640 1 -- 172.21.15.47:0/2735164607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9368109b40 msgr2=0x7f93681a7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.590+0000 7f9367fff640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9368109b40 0x7f93681a7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.590+0000 7f9367fff640 1 -- 172.21.15.47:0/2735164607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9368109f20 msgr2=0x7f93681a7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.590+0000 7f9367fff640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9368109f20 0x7f93681a7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.590+0000 7f9367fff640 1 -- 172.21.15.47:0/2735164607 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93681adb40 con 0x7f936811ba90 2024-07-24T22:09:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.594+0000 7f9367fff640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936811ba90 0x7f93681ad370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9360005e30 tx=0x7f9360003f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.596+0000 7f93657fa640 1 -- 172.21.15.47:0/2735164607 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9360047070 con 0x7f936811ba90 2024-07-24T22:09:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.596+0000 7f936ddff640 1 -- 172.21.15.47:0/2735164607 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93681addd0 con 0x7f936811ba90 2024-07-24T22:09:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.596+0000 7f936ddff640 1 -- 172.21.15.47:0/2735164607 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93681b44f0 con 0x7f936811ba90 2024-07-24T22:09:13.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.607+0000 7f93701b0740 1 Processor -- start 2024-07-24T22:09:13.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.607+0000 7f93701b0740 1 -- start start 2024-07-24T22:09:13.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.607+0000 7f93701b0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 0x556c55beba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.608+0000 7f93701b0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55bebfa0 0x556c55bf79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.608+0000 7f935ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 0x556c55beba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.608+0000 7f935ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 0x556c55beba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:34872/0 (socket says 172.21.15.47:34872) 2024-07-24T22:09:13.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.608+0000 7f935ffff640 1 -- 172.21.15.47:0/967613001 learned_addr learned my addr 172.21.15.47:0/967613001 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:13.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.608+0000 7f93701b0740 1 --2- 172.21.15.47:0/967613001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 0x556c55bfa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.608+0000 7f93701b0740 1 -- 172.21.15.47:0/967613001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556c55b62960 con 0x556c55bebfa0 2024-07-24T22:09:13.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.608+0000 7f93701b0740 1 -- 172.21.15.47:0/967613001 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556c55b51e60 con 0x556c55bf7f30 2024-07-24T22:09:13.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.608+0000 7f93701b0740 1 -- 172.21.15.47:0/967613001 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556c55b55ea0 con 0x556c55beb680 2024-07-24T22:09:13.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.609+0000 7f93657fa640 1 -- 172.21.15.47:0/2735164607 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9360030b30 con 0x7f936811ba90 2024-07-24T22:09:13.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.609+0000 7f935ffff640 1 --2- 172.21.15.47:0/967613001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 0x556c55bfa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.609+0000 7f935ffff640 1 -- 172.21.15.47:0/967613001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 msgr2=0x556c55bfa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:13.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.609+0000 7f935ffff640 1 --2- 172.21.15.47:0/967613001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 0x556c55bfa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.609+0000 7f935ffff640 1 -- 172.21.15.47:0/967613001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55bebfa0 msgr2=0x556c55bf79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:13.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.609+0000 7f935ffff640 1 --2- 172.21.15.47:0/967613001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55bebfa0 0x556c55bf79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.609+0000 7f935ffff640 1 -- 172.21.15.47:0/967613001 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c55adb2d0 con 0x556c55beb680 2024-07-24T22:09:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.610+0000 7f935ffff640 1 --2- 172.21.15.47:0/967613001 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 0x556c55beba60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9358009d90 tx=0x7f9358009730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac3c4b14a3dbadb server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.609+0000 7f93657fa640 1 -- 172.21.15.47:0/2735164607 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9360034070 con 0x7f936811ba90 2024-07-24T22:09:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.610+0000 7f93657fa640 1 -- 172.21.15.47:0/2735164607 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f9360037020 con 0x7f936811ba90 2024-07-24T22:09:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.610+0000 7f935dffb640 1 -- 172.21.15.47:0/967613001 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935800f480 con 0x556c55beb680 2024-07-24T22:09:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.610+0000 7f935dffb640 1 -- 172.21.15.47:0/967613001 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f935800fad0 con 0x556c55beb680 2024-07-24T22:09:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.610+0000 7f935dffb640 1 -- 172.21.15.47:0/967613001 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9358011ae0 con 0x556c55beb680 2024-07-24T22:09:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.611+0000 7f93657fa640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f93540b3f80 0x7f93540b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.612+0000 7f93657fa640 1 -- 172.21.15.47:0/2735164607 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f93601059d0 con 0x7f936811ba90 2024-07-24T22:09:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.614+0000 7f93677fe640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f93540b3f80 0x7f93540b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.615+0000 7f93701b0740 1 -- 172.21.15.47:0/967613001 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 msgr2=0x556c55beba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.615+0000 7f93701b0740 1 --2- 172.21.15.47:0/967613001 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 0x556c55beba60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9358009d90 tx=0x7f9358009730 comp rx=0 tx=0).stop 2024-07-24T22:09:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.615+0000 7f93701b0740 1 -- 172.21.15.47:0/967613001 shutdown_connections 2024-07-24T22:09:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.615+0000 7f93701b0740 1 --2- 172.21.15.47:0/967613001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 0x556c55bfa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.615+0000 7f93701b0740 1 --2- 172.21.15.47:0/967613001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55bebfa0 0x556c55bf79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.615+0000 7f93701b0740 1 --2- 172.21.15.47:0/967613001 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 0x556c55beba60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.616+0000 7f93701b0740 1 -- 172.21.15.47:0/967613001 >> 172.21.15.47:0/967613001 conn(0x556c55be94b0 msgr2=0x556c55bea650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.617+0000 7f93677fe640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f93540b3f80 0x7f93540b6440 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9350005fd0 tx=0x7f9350009450 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.618+0000 7f93701b0740 1 -- 172.21.15.47:0/967613001 shutdown_connections 2024-07-24T22:09:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.618+0000 7f93701b0740 1 -- 172.21.15.47:0/967613001 wait complete. 2024-07-24T22:09:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.618+0000 7f93701b0740 1 -- start start 2024-07-24T22:09:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.619+0000 7f93701b0740 1 Processor -- start 2024-07-24T22:09:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.619+0000 7f93701b0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 0x556c55bf4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.619+0000 7f93701b0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bebfa0 0x556c55bf53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.619+0000 7f93701b0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55bf7f30 0x556c55bf58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.619+0000 7f935ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bebfa0 0x556c55bf53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.619+0000 7f935ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bebfa0 0x556c55bf53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:41406/0 (socket says 172.21.15.47:41406) 2024-07-24T22:09:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.620+0000 7f93677fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 0x556c55bf4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.620+0000 7f93677fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 0x556c55bf4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:34884/0 (socket says 172.21.15.47:34884) 2024-07-24T22:09:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.620+0000 7f935ffff640 1 -- 172.21.15.47:0/1722783331 learned_addr learned my addr 172.21.15.47:0/1722783331 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.620+0000 7f93701b0740 1 -- 172.21.15.47:0/1722783331 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556c559b5700 con 0x556c55bf7f30 2024-07-24T22:09:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.620+0000 7f93701b0740 1 -- 172.21.15.47:0/1722783331 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556c55af45a0 con 0x556c55bebfa0 2024-07-24T22:09:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.620+0000 7f93701b0740 1 -- 172.21.15.47:0/1722783331 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556c55bfabb0 con 0x556c55beb680 2024-07-24T22:09:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.620+0000 7f93677fe640 1 -- 172.21.15.47:0/1722783331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bebfa0 msgr2=0x556c55bf53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.621+0000 7f93677fe640 1 --2- 172.21.15.47:0/1722783331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bebfa0 0x556c55bf53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.621+0000 7f93677fe640 1 -- 172.21.15.47:0/1722783331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55bf7f30 msgr2=0x556c55bf58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.621+0000 7f93677fe640 1 --2- 172.21.15.47:0/1722783331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55bf7f30 0x556c55bf58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.621+0000 7f93677fe640 1 -- 172.21.15.47:0/1722783331 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c55ae7630 con 0x556c55beb680 2024-07-24T22:09:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.621+0000 7f93677fe640 1 --2- 172.21.15.47:0/1722783331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 0x556c55bf4e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x556c55bea390 tx=0x7f9350004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c2dbd436d1394c0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.621+0000 7f93701b0740 10 client.0 _ll_register_callbacks cb 0x556c55b14910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.622+0000 7f93701b0740 1 -- 172.21.15.47:0/1722783331 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f935800fad0 con 0x556c55beb680 2024-07-24T22:09:13.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.622+0000 7f9346ffd640 10 client.25504 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:09:13.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.622+0000 7f9346ffd640 1 -- 172.21.15.47:0/1722783331 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350022020 con 0x556c55beb680 2024-07-24T22:09:13.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.623+0000 7f9346ffd640 1 -- 172.21.15.47:0/1722783331 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f9350010690 con 0x556c55beb680 2024-07-24T22:09:13.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.623+0000 7f9346ffd640 1 -- 172.21.15.47:0/1722783331 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f935002d050 con 0x556c55beb680 2024-07-24T22:09:13.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.623+0000 7f93701b0740 10 client.25504 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:13.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.623+0000 7f93701b0740 1 -- 172.21.15.47:0/1722783331 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({fsmap=20}) -- 0x556c558b2650 con 0x556c55beb680 2024-07-24T22:09:13.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.624+0000 7f9346ffd640 1 -- 172.21.15.47:0/1722783331 <== mon.1 v2:172.21.15.188:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f935000f040 con 0x556c55beb680 2024-07-24T22:09:13.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.624+0000 7f93701b0740 10 client.25504 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:13.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.624+0000 7f93701b0740 10 client.25504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:13.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.624+0000 7f93701b0740 20 client.25504 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:13.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.624+0000 7f93701b0740 1 --2- 172.21.15.47:0/1722783331 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556c55c078d0 0x556c55c09d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.624+0000 7f93701b0740 4 client.25504 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:09:13.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.624+0000 7f935ffff640 1 --2- 172.21.15.47:0/1722783331 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556c55c078d0 0x556c55c09d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.624+0000 7f93701b0740 1 -- 172.21.15.47:0/1722783331 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f935800fad0 con 0x556c55c078d0 2024-07-24T22:09:13.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.625+0000 7f935ffff640 1 --2- 172.21.15.47:0/1722783331 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556c55c078d0 0x556c55c09d40 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb3db0d211545623 server_cookie=476da618c1b1dc72 in_seq=0 out_seq=0 2024-07-24T22:09:13.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.625+0000 7f9346ffd640 10 client.25504 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:13.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.626+0000 7f9346ffd640 1 -- 172.21.15.47:0/1722783331 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f935800fad0 con 0x556c55c078d0 2024-07-24T22:09:13.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.626+0000 7f9346ffd640 10 client.25504 handle_command_reply: tid=0 2024-07-24T22:09:13.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.626+0000 7f93701b0740 1 client.25504 shutdown 2024-07-24T22:09:13.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.630+0000 7f93701b0740 1 -- 172.21.15.47:0/1722783331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 msgr2=0x556c55bf4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:13.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.631+0000 7f93701b0740 1 --2- 172.21.15.47:0/1722783331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 0x556c55bf4e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x556c55bea390 tx=0x7f9350004730 comp rx=0 tx=0).stop 2024-07-24T22:09:13.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.631+0000 7f93701b0740 1 -- 172.21.15.47:0/1722783331 shutdown_connections 2024-07-24T22:09:13.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.631+0000 7f93701b0740 1 --2- 172.21.15.47:0/1722783331 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556c55c078d0 0x556c55c09d40 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.631+0000 7f93701b0740 1 --2- 172.21.15.47:0/1722783331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55bf7f30 0x556c55bf58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.631+0000 7f9346ffd640 0 client.25504 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:13.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.631+0000 7f93701b0740 1 --2- 172.21.15.47:0/1722783331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bebfa0 0x556c55bf53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.631+0000 7f93701b0740 1 --2- 172.21.15.47:0/1722783331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55beb680 0x556c55bf4e60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.631+0000 7f93701b0740 1 -- 172.21.15.47:0/1722783331 >> 172.21.15.47:0/1722783331 conn(0x556c55be94b0 msgr2=0x556c55bef050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.641+0000 7f93701b0740 1 -- 172.21.15.47:0/1722783331 shutdown_connections 2024-07-24T22:09:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.641+0000 7f93701b0740 1 -- 172.21.15.47:0/1722783331 wait complete. 2024-07-24T22:09:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.641+0000 7f93701b0740 20 client.25504 trim_cache size 0 max 16384 2024-07-24T22:09:13.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:13 smithi183 ceph-mon[37007]: pgmap v426: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 754 MiB/s wr, 1.74k op/s 2024-07-24T22:09:13.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:13 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:09:13.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.692+0000 7f93701b0740 1 Processor -- start 2024-07-24T22:09:13.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.692+0000 7f93701b0740 1 -- start start 2024-07-24T22:09:13.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.694+0000 7f93701b0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55beb680 0x556c55bf3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.694+0000 7f93701b0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55bebfa0 0x556c55beabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.694+0000 7f93701b0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 0x556c55bf6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.694+0000 7f93701b0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f934800c840 con 0x556c55beb680 2024-07-24T22:09:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.694+0000 7f93701b0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f934800f0c0 con 0x556c55bf7f30 2024-07-24T22:09:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.694+0000 7f93701b0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f934800ceb0 con 0x556c55bebfa0 2024-07-24T22:09:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.696+0000 7f9367fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 0x556c55bf6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.696+0000 7f9367fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 0x556c55bf6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:41422/0 (socket says 172.21.15.47:41422) 2024-07-24T22:09:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.696+0000 7f9367fff640 1 -- 172.21.15.47:0/2821821569 learned_addr learned my addr 172.21.15.47:0/2821821569 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.696+0000 7f935ffff640 1 --2- 172.21.15.47:0/2821821569 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55bebfa0 0x556c55beabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.696+0000 7f9367fff640 1 -- 172.21.15.47:0/2821821569 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55bebfa0 msgr2=0x556c55beabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.696+0000 7f9367fff640 1 --2- 172.21.15.47:0/2821821569 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55bebfa0 0x556c55beabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.696+0000 7f9367fff640 1 -- 172.21.15.47:0/2821821569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55beb680 msgr2=0x556c55bf3d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-24T22:09:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.696+0000 7f9367fff640 1 --2- 172.21.15.47:0/2821821569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55beb680 0x556c55bf3d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.696+0000 7f9367fff640 1 -- 172.21.15.47:0/2821821569 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c55bebdd0 con 0x556c55bf7f30 2024-07-24T22:09:13.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.706+0000 7f9367fff640 1 --2- 172.21.15.47:0/2821821569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 0x556c55bf6ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9360030040 tx=0x7f93600cbec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8247a3d9d18ffa8c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.710+0000 7f935d7fa640 1 -- 172.21.15.47:0/2821821569 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93600cc690 con 0x556c55bf7f30 2024-07-24T22:09:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.710+0000 7f935d7fa640 1 -- 172.21.15.47:0/2821821569 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93600d0c90 con 0x556c55bf7f30 2024-07-24T22:09:13.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.710+0000 7f935d7fa640 1 -- 172.21.15.47:0/2821821569 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93600c8aa0 con 0x556c55bf7f30 2024-07-24T22:09:13.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.716+0000 7f93701b0740 1 -- 172.21.15.47:0/2821821569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 msgr2=0x556c55bf6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:13.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.716+0000 7f93701b0740 1 --2- 172.21.15.47:0/2821821569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 0x556c55bf6ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9360030040 tx=0x7f93600cbec0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.719+0000 7f93701b0740 1 -- 172.21.15.47:0/2821821569 shutdown_connections 2024-07-24T22:09:13.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.719+0000 7f93701b0740 1 --2- 172.21.15.47:0/2821821569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 0x556c55bf6ba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.719+0000 7f93701b0740 1 --2- 172.21.15.47:0/2821821569 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55bebfa0 0x556c55beabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.719+0000 7f93701b0740 1 --2- 172.21.15.47:0/2821821569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55beb680 0x556c55bf3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.719+0000 7f93701b0740 1 -- 172.21.15.47:0/2821821569 >> 172.21.15.47:0/2821821569 conn(0x556c55be94b0 msgr2=0x556c55bf6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.723+0000 7f93701b0740 1 -- 172.21.15.47:0/2821821569 shutdown_connections 2024-07-24T22:09:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.726+0000 7f93701b0740 1 -- 172.21.15.47:0/2821821569 wait complete. 2024-07-24T22:09:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.726+0000 7f93701b0740 1 -- start start 2024-07-24T22:09:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.727+0000 7f93701b0740 1 Processor -- start 2024-07-24T22:09:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.727+0000 7f93701b0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55beb680 0x556c55c00570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.728+0000 7f93701b0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55bebfa0 0x556c55bf1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.728+0000 7f93701b0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 0x556c55bf2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.728+0000 7f93701b0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f934800d580 con 0x556c55beb680 2024-07-24T22:09:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.728+0000 7f93701b0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f934800e9f0 con 0x556c55bf7f30 2024-07-24T22:09:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.728+0000 7f93701b0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f934800dc50 con 0x556c55bebfa0 2024-07-24T22:09:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.728+0000 7f93701b0740 10 client.0 _ll_register_callbacks cb 0x7f935000edf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.728+0000 7f93677fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55beb680 0x556c55c00570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.729+0000 7f93677fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55beb680 0x556c55c00570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55872/0 (socket says 172.21.15.47:55872) 2024-07-24T22:09:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.729+0000 7f93677fe640 1 -- 172.21.15.47:0/3695107212 learned_addr learned my addr 172.21.15.47:0/3695107212 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.729+0000 7f935ffff640 1 --2- 172.21.15.47:0/3695107212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55bebfa0 0x556c55bf1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.729+0000 7f93677fe640 1 -- 172.21.15.47:0/3695107212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55bebfa0 msgr2=0x556c55bf1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.729+0000 7f93677fe640 1 --2- 172.21.15.47:0/3695107212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55bebfa0 0x556c55bf1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.729+0000 7f93677fe640 1 -- 172.21.15.47:0/3695107212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 msgr2=0x556c55bf2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:13.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.729+0000 7f93677fe640 1 --2- 172.21.15.47:0/3695107212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 0x556c55bf2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.729+0000 7f93677fe640 1 -- 172.21.15.47:0/3695107212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c55bf2990 con 0x556c55beb680 2024-07-24T22:09:13.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.730+0000 7f93677fe640 1 --2- 172.21.15.47:0/3695107212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55beb680 0x556c55c00570 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9350005820 tx=0x7f9350013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f12706c8ae98ae server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:13.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.730+0000 7f9346ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:09:13.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.731+0000 7f9346ffd640 1 -- 172.21.15.47:0/3695107212 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935003b670 con 0x556c55beb680 2024-07-24T22:09:13.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.731+0000 7f9346ffd640 1 -- 172.21.15.47:0/3695107212 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f935003b810 con 0x556c55beb680 2024-07-24T22:09:13.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.732+0000 7f93701b0740 1 -- 172.21.15.47:0/3695107212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93600d0c90 con 0x556c55beb680 2024-07-24T22:09:13.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.737+0000 7f9346ffd640 1 -- 172.21.15.47:0/3695107212 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f935003ba10 con 0x556c55beb680 2024-07-24T22:09:13.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.737+0000 7f93701b0740 10 client.15981 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:13.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.737+0000 7f93701b0740 1 -- 172.21.15.47:0/3695107212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556c55c6a720 con 0x556c55beb680 2024-07-24T22:09:13.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.743+0000 7f9346ffd640 1 -- 172.21.15.47:0/3695107212 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93600d0c90 con 0x556c55beb680 2024-07-24T22:09:13.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.743+0000 7f9346ffd640 1 -- 172.21.15.47:0/3695107212 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f935001e8f0 con 0x556c55beb680 2024-07-24T22:09:13.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.745+0000 7f93701b0740 10 client.15981 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:13.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.745+0000 7f93701b0740 10 client.15981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:13.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.745+0000 7f93701b0740 20 client.15981 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:13.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.745+0000 7f93701b0740 1 --2- 172.21.15.47:0/3695107212 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556c55c078d0 0x556c55c6cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:13.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.745+0000 7f93701b0740 4 client.15981 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:09:13.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.745+0000 7f93701b0740 1 -- 172.21.15.47:0/3695107212 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556c55b648b0 con 0x556c55c078d0 2024-07-24T22:09:13.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.746+0000 7f935ffff640 1 --2- 172.21.15.47:0/3695107212 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556c55c078d0 0x556c55c6cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:13.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.750+0000 7f9346ffd640 10 client.15981 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:13.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.750+0000 7f935ffff640 1 --2- 172.21.15.47:0/3695107212 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556c55c078d0 0x556c55c6cec0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85e805266fb68587 server_cookie=9a75d63df2b411e7 in_seq=0 out_seq=0 2024-07-24T22:09:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.754+0000 7f9346ffd640 1 -- 172.21.15.47:0/3695107212 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556c55b648b0 con 0x556c55c078d0 2024-07-24T22:09:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.754+0000 7f9346ffd640 10 client.15981 handle_command_reply: tid=0 2024-07-24T22:09:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.754+0000 7f93701b0740 1 client.15981 shutdown 2024-07-24T22:09:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.757+0000 7f93701b0740 1 -- 172.21.15.47:0/3695107212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55beb680 msgr2=0x556c55c00570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:13.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.757+0000 7f93701b0740 1 --2- 172.21.15.47:0/3695107212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55beb680 0x556c55c00570 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9350005820 tx=0x7f9350013000 comp rx=0 tx=0).stop 2024-07-24T22:09:13.764 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:09:13.764 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:09:13.765 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:09:13.765 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:09:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.758+0000 7f93701b0740 1 -- 172.21.15.47:0/3695107212 shutdown_connections 2024-07-24T22:09:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.758+0000 7f93701b0740 1 --2- 172.21.15.47:0/3695107212 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556c55c078d0 0x556c55c6cec0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.758+0000 7f93701b0740 1 --2- 172.21.15.47:0/3695107212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556c55bf7f30 0x556c55bf2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.758+0000 7f93701b0740 1 --2- 172.21.15.47:0/3695107212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556c55bebfa0 0x556c55bf1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.759+0000 7f93701b0740 1 --2- 172.21.15.47:0/3695107212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c55beb680 0x556c55c00570 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.759+0000 7f93701b0740 1 -- 172.21.15.47:0/3695107212 >> 172.21.15.47:0/3695107212 conn(0x556c55be94b0 msgr2=0x556c55bf6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.759+0000 7f9346ffd640 0 client.15981 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.759+0000 7f93701b0740 1 -- 172.21.15.47:0/3695107212 shutdown_connections 2024-07-24T22:09:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.759+0000 7f93701b0740 1 -- 172.21.15.47:0/3695107212 wait complete. 2024-07-24T22:09:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.759+0000 7f93701b0740 20 client.15981 trim_cache size 0 max 16384 2024-07-24T22:09:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.762+0000 7f936ddff640 1 -- 172.21.15.47:0/2735164607 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f93540b3f80 msgr2=0x7f93540b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.762+0000 7f936ddff640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f93540b3f80 0x7f93540b6440 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9350005fd0 tx=0x7f9350009450 comp rx=0 tx=0).stop 2024-07-24T22:09:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.762+0000 7f936ddff640 1 -- 172.21.15.47:0/2735164607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936811ba90 msgr2=0x7f93681ad370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.763+0000 7f936ddff640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936811ba90 0x7f93681ad370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9360005e30 tx=0x7f9360003f30 comp rx=0 tx=0).stop 2024-07-24T22:09:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.763+0000 7f936ddff640 1 -- 172.21.15.47:0/2735164607 shutdown_connections 2024-07-24T22:09:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.763+0000 7f936ddff640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f93540b3f80 0x7f93540b6440 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9350005fd0 tx=0x7f9350009450 comp rx=0 tx=0).stop 2024-07-24T22:09:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.763+0000 7f936ddff640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936811ba90 0x7f93681ad370 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.763+0000 7f936ddff640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9368109f20 0x7f93681a7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.763+0000 7f936ddff640 1 --2- 172.21.15.47:0/2735164607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9368109b40 0x7f93681a7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:13.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.763+0000 7f936ddff640 1 -- 172.21.15.47:0/2735164607 >> 172.21.15.47:0/2735164607 conn(0x7f936806d980 msgr2=0x7f936811c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:13.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.763+0000 7f936ddff640 1 -- 172.21.15.47:0/2735164607 shutdown_connections 2024-07-24T22:09:13.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:13.763+0000 7f936ddff640 1 -- 172.21.15.47:0/2735164607 wait complete. 2024-07-24T22:09:14.888 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:09:14.889 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:09:15.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:15 smithi188 ceph-mon[37380]: pgmap v427: 97 pgs: 97 active+clean; 14 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 731 MiB/s wr, 2.15k op/s 2024-07-24T22:09:15.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:09:15.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:09:15.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:15 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:09:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:09:15.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:15 smithi183 ceph-mon[37007]: pgmap v427: 97 pgs: 97 active+clean; 14 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 731 MiB/s wr, 2.15k op/s 2024-07-24T22:09:15.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:09:15.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:09:15.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:15 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:09:15.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:15 smithi047 ceph-mon[32551]: pgmap v427: 97 pgs: 97 active+clean; 14 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 731 MiB/s wr, 2.15k op/s 2024-07-24T22:09:15.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:09:15.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:09:15.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:15 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:09:17.621 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:17 smithi047 ceph-mon[32551]: pgmap v428: 97 pgs: 97 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 705 MiB/s wr, 2.25k op/s 2024-07-24T22:09:17.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:17 smithi183 ceph-mon[37007]: pgmap v428: 97 pgs: 97 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 705 MiB/s wr, 2.25k op/s 2024-07-24T22:09:17.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:17 smithi188 ceph-mon[37380]: pgmap v428: 97 pgs: 97 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 705 MiB/s wr, 2.25k op/s 2024-07-24T22:09:18.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.318+0000 7f6abcc17640 1 -- 172.21.15.47:0/3788284033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab8107060 msgr2=0x7f6ab81074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:18.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.318+0000 7f6abcc17640 1 --2- 172.21.15.47:0/3788284033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab8107060 0x7f6ab81074a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009900 tx=0x7f6aac02a3f0 comp rx=0 tx=0).stop 2024-07-24T22:09:18.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.319+0000 7f6abcc17640 1 -- 172.21.15.47:0/3788284033 shutdown_connections 2024-07-24T22:09:18.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.319+0000 7f6abcc17640 1 --2- 172.21.15.47:0/3788284033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ab81079e0 0x7f6ab810e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:18.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.319+0000 7f6abcc17640 1 --2- 172.21.15.47:0/3788284033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab8107060 0x7f6ab81074a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:18.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.319+0000 7f6abcc17640 1 --2- 172.21.15.47:0/3788284033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ab8101650 0x7f6ab8101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:18.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.319+0000 7f6abcc17640 1 -- 172.21.15.47:0/3788284033 >> 172.21.15.47:0/3788284033 conn(0x7f6ab80fd0c0 msgr2=0x7f6ab80ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:18.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.320+0000 7f6abcc17640 1 -- 172.21.15.47:0/3788284033 shutdown_connections 2024-07-24T22:09:18.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.320+0000 7f6abcc17640 1 -- 172.21.15.47:0/3788284033 wait complete. 2024-07-24T22:09:18.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.323+0000 7f6abcc17640 1 Processor -- start 2024-07-24T22:09:18.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.323+0000 7f6abcc17640 1 -- start start 2024-07-24T22:09:18.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.323+0000 7f6abcc17640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab8101650 0x7f6ab819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:18.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.323+0000 7f6abcc17640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ab8107060 0x7f6ab819fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:18.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.323+0000 7f6abcc17640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ab81079e0 0x7f6ab81a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:18.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.323+0000 7f6abcc17640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab8111630 con 0x7f6ab8101650 2024-07-24T22:09:18.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.323+0000 7f6abcc17640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab81114b0 con 0x7f6ab81079e0 2024-07-24T22:09:18.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.323+0000 7f6abcc17640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab81117b0 con 0x7f6ab8107060 2024-07-24T22:09:18.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.324+0000 7f6ab659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab8101650 0x7f6ab819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:18.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.324+0000 7f6ab659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab8101650 0x7f6ab819f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42398/0 (socket says 172.21.15.47:42398) 2024-07-24T22:09:18.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.324+0000 7f6ab659c640 1 -- 172.21.15.47:0/2168113120 learned_addr learned my addr 172.21.15.47:0/2168113120 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:18.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.324+0000 7f6ab5d9b640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ab8107060 0x7f6ab819fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:18.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.325+0000 7f6ab6d9d640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ab81079e0 0x7f6ab81a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:18.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.325+0000 7f6ab5d9b640 1 -- 172.21.15.47:0/2168113120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ab81079e0 msgr2=0x7f6ab81a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:18.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.325+0000 7f6ab5d9b640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ab81079e0 0x7f6ab81a4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:18.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.325+0000 7f6ab5d9b640 1 -- 172.21.15.47:0/2168113120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab8101650 msgr2=0x7f6ab819f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:18.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.325+0000 7f6ab5d9b640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab8101650 0x7f6ab819f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:18.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.325+0000 7f6ab5d9b640 1 -- 172.21.15.47:0/2168113120 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab81a5360 con 0x7f6ab8107060 2024-07-24T22:09:18.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.327+0000 7f6ab5d9b640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ab8107060 0x7f6ab819fa20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6aac02a9e0 tx=0x7f6aac003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:18.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.327+0000 7f6aa77fe640 1 -- 172.21.15.47:0/2168113120 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac03f070 con 0x7f6ab8107060 2024-07-24T22:09:18.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.327+0000 7f6aa77fe640 1 -- 172.21.15.47:0/2168113120 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aac031b50 con 0x7f6ab8107060 2024-07-24T22:09:18.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.327+0000 7f6abcc17640 1 -- 172.21.15.47:0/2168113120 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab81a55f0 con 0x7f6ab8107060 2024-07-24T22:09:18.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.327+0000 7f6aa77fe640 1 -- 172.21.15.47:0/2168113120 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac035030 con 0x7f6ab8107060 2024-07-24T22:09:18.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.328+0000 7f6abcc17640 1 -- 172.21.15.47:0/2168113120 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab806c560 con 0x7f6ab8107060 2024-07-24T22:09:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.331+0000 7f6abcc17640 1 -- 172.21.15.47:0/2168113120 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab8102900 con 0x7f6ab8107060 2024-07-24T22:09:18.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.334+0000 7f6aa77fe640 1 -- 172.21.15.47:0/2168113120 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f6aac042070 con 0x7f6ab8107060 2024-07-24T22:09:18.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.336+0000 7f6aa77fe640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aa00b3dc0 0x7f6aa00b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:18.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.337+0000 7f6aa77fe640 1 -- 172.21.15.47:0/2168113120 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f6aac104d00 con 0x7f6ab8107060 2024-07-24T22:09:18.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.337+0000 7f6ab659c640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aa00b3dc0 0x7f6aa00b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:18.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.338+0000 7f6ab659c640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aa00b3dc0 0x7f6aa00b6280 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009c90 tx=0x7f6aa8005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:18.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.338+0000 7f6aa77fe640 1 -- 172.21.15.47:0/2168113120 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f6aac031d00 con 0x7f6ab8107060 2024-07-24T22:09:18.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.817+0000 7f6abcc17640 1 -- 172.21.15.47:0/2168113120 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ab806c880 con 0x7f6ab8107060 2024-07-24T22:09:18.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.818+0000 7f6aa77fe640 1 -- 172.21.15.47:0/2168113120 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f6aac0cbfb0 con 0x7f6ab8107060 2024-07-24T22:09:18.821 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:09:18.821 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:09:18.821 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:09:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.822+0000 7f6abcc17640 1 -- 172.21.15.47:0/2168113120 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aa00b3dc0 msgr2=0x7f6aa00b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.822+0000 7f6abcc17640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aa00b3dc0 0x7f6aa00b6280 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009c90 tx=0x7f6aa8005f90 comp rx=0 tx=0).stop 2024-07-24T22:09:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.822+0000 7f6abcc17640 1 -- 172.21.15.47:0/2168113120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ab8107060 msgr2=0x7f6ab819fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.822+0000 7f6abcc17640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ab8107060 0x7f6ab819fa20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6aac02a9e0 tx=0x7f6aac003b90 comp rx=0 tx=0).stop 2024-07-24T22:09:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.822+0000 7f6abcc17640 1 -- 172.21.15.47:0/2168113120 shutdown_connections 2024-07-24T22:09:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.822+0000 7f6abcc17640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aa00b3dc0 0x7f6aa00b6280 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.822+0000 7f6abcc17640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ab81079e0 0x7f6ab81a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.822+0000 7f6abcc17640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ab8107060 0x7f6ab819fa20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.822+0000 7f6abcc17640 1 --2- 172.21.15.47:0/2168113120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab8101650 0x7f6ab819f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:18.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.822+0000 7f6abcc17640 1 -- 172.21.15.47:0/2168113120 >> 172.21.15.47:0/2168113120 conn(0x7f6ab80fd0c0 msgr2=0x7f6ab80ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:18.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.822+0000 7f6abcc17640 1 -- 172.21.15.47:0/2168113120 shutdown_connections 2024-07-24T22:09:18.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:18.822+0000 7f6abcc17640 1 -- 172.21.15.47:0/2168113120 wait complete. 2024-07-24T22:09:19.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:19 smithi047 ceph-mon[32551]: pgmap v429: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 779 MiB/s wr, 2.65k op/s 2024-07-24T22:09:19.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:19 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2168113120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:09:19.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:19 smithi188 ceph-mon[37380]: pgmap v429: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 779 MiB/s wr, 2.65k op/s 2024-07-24T22:09:19.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:19 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2168113120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:09:19.838 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:09:19.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:19 smithi183 ceph-mon[37007]: pgmap v429: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 779 MiB/s wr, 2.65k op/s 2024-07-24T22:09:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:19 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2168113120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:09:20.374 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:09:21.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:21 smithi188 ceph-mon[37380]: pgmap v430: 97 pgs: 97 active+clean; 17 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 718 MiB/s wr, 2.19k op/s 2024-07-24T22:09:21.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:21 smithi183 ceph-mon[37007]: pgmap v430: 97 pgs: 97 active+clean; 17 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 718 MiB/s wr, 2.19k op/s 2024-07-24T22:09:21.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:21 smithi047 ceph-mon[32551]: pgmap v430: 97 pgs: 97 active+clean; 17 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 718 MiB/s wr, 2.19k op/s 2024-07-24T22:09:22.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.765+0000 7f13a1efa640 1 -- 172.21.15.47:0/162707312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f139c107260 msgr2=0x7f139c107640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:22.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.765+0000 7f13a1efa640 1 --2- 172.21.15.47:0/162707312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f139c107260 0x7f139c107640 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f138c009900 tx=0x7f138c02a410 comp rx=0 tx=0).stop 2024-07-24T22:09:22.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.766+0000 7f13a1efa640 1 -- 172.21.15.47:0/162707312 shutdown_connections 2024-07-24T22:09:22.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.766+0000 7f13a1efa640 1 --2- 172.21.15.47:0/162707312 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f139c106900 0x7f139c10e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.766+0000 7f13a1efa640 1 --2- 172.21.15.47:0/162707312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f139c105f80 0x7f139c1063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.766+0000 7f13a1efa640 1 --2- 172.21.15.47:0/162707312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f139c107260 0x7f139c107640 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.766+0000 7f13a1efa640 1 -- 172.21.15.47:0/162707312 >> 172.21.15.47:0/162707312 conn(0x7f139c0fc3f0 msgr2=0x7f139c0fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:22.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.767+0000 7f13a1efa640 1 -- 172.21.15.47:0/162707312 shutdown_connections 2024-07-24T22:09:22.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.767+0000 7f13a1efa640 1 -- 172.21.15.47:0/162707312 wait complete. 2024-07-24T22:09:22.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.768+0000 7f13a1efa640 1 Processor -- start 2024-07-24T22:09:22.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.769+0000 7f13a1efa640 1 -- start start 2024-07-24T22:09:22.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.769+0000 7f13a1efa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f139c105f80 0x7f139c103b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.769+0000 7f13a1efa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f139c106900 0x7f139c102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.769+0000 7f13a1efa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f139c107260 0x7f139c102690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.769+0000 7f13a1efa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f139c111740 con 0x7f139c107260 2024-07-24T22:09:22.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.769+0000 7f13a1efa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f139c1115c0 con 0x7f139c106900 2024-07-24T22:09:22.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.769+0000 7f13a1efa640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f139c1118c0 con 0x7f139c105f80 2024-07-24T22:09:22.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.769+0000 7f139bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f139c107260 0x7f139c102690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:22.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.769+0000 7f139bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f139c107260 0x7f139c102690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42422/0 (socket says 172.21.15.47:42422) 2024-07-24T22:09:22.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.769+0000 7f139bfff640 1 -- 172.21.15.47:0/754184620 learned_addr learned my addr 172.21.15.47:0/754184620 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:22.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.770+0000 7f139b7fe640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f139c105f80 0x7f139c103b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:22.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.770+0000 7f139bfff640 1 -- 172.21.15.47:0/754184620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f139c105f80 msgr2=0x7f139c103b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:22.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.770+0000 7f139bfff640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f139c105f80 0x7f139c103b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.770+0000 7f139bfff640 1 -- 172.21.15.47:0/754184620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f139c106900 msgr2=0x7f139c102060 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:09:22.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.770+0000 7f139bfff640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f139c106900 0x7f139c102060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.770+0000 7f139bfff640 1 -- 172.21.15.47:0/754184620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c19cf00 con 0x7f139c107260 2024-07-24T22:09:22.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.770+0000 7f139b7fe640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f139c105f80 0x7f139c103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:09:22.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.771+0000 7f139bfff640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f139c107260 0x7f139c102690 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f139400b970 tx=0x7f139400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:22.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.771+0000 7f1398ff9640 1 -- 172.21.15.47:0/754184620 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394019070 con 0x7f139c107260 2024-07-24T22:09:22.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.771+0000 7f13a1efa640 1 -- 172.21.15.47:0/754184620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139c19d1f0 con 0x7f139c107260 2024-07-24T22:09:22.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.771+0000 7f13a1efa640 1 -- 172.21.15.47:0/754184620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139c19d730 con 0x7f139c107260 2024-07-24T22:09:22.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.772+0000 7f1398ff9640 1 -- 172.21.15.47:0/754184620 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f139401d3b0 con 0x7f139c107260 2024-07-24T22:09:22.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.773+0000 7f1398ff9640 1 -- 172.21.15.47:0/754184620 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394023060 con 0x7f139c107260 2024-07-24T22:09:22.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.775+0000 7f13a42ab740 1 Processor -- start 2024-07-24T22:09:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.777+0000 7f1398ff9640 1 -- 172.21.15.47:0/754184620 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f139401c070 con 0x7f139c107260 2024-07-24T22:09:22.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.778+0000 7f1398ff9640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13840b3dc0 0x7f13840b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.780+0000 7f139affd640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13840b3dc0 0x7f13840b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:22.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.780+0000 7f1398ff9640 1 -- 172.21.15.47:0/754184620 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f13940e34d0 con 0x7f139c107260 2024-07-24T22:09:22.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.781+0000 7f139affd640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13840b3dc0 0x7f13840b6280 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f139c19ccf0 tx=0x7f1390006bd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:22.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.782+0000 7f13a42ab740 1 -- start start 2024-07-24T22:09:22.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.782+0000 7f13a42ab740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55764456c6d0 0x55764456cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.783+0000 7f13a42ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644578a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.783+0000 7f13a42ab740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557644578f80 0x55764457b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.783+0000 7f13a42ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5576444e39b0 con 0x55764456cff0 2024-07-24T22:09:22.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.783+0000 7f13a42ab740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5576444d2eb0 con 0x557644578f80 2024-07-24T22:09:22.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.783+0000 7f13a42ab740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5576444d6ef0 con 0x55764456c6d0 2024-07-24T22:09:22.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.783+0000 7f139affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644578a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:22.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.783+0000 7f139affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644578a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42436/0 (socket says 172.21.15.47:42436) 2024-07-24T22:09:22.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.783+0000 7f139affd640 1 -- 172.21.15.47:0/510948397 learned_addr learned my addr 172.21.15.47:0/510948397 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:22.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.783+0000 7f139affd640 1 -- 172.21.15.47:0/510948397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55764456c6d0 msgr2=0x55764456cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:22.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.783+0000 7f139affd640 1 --2- 172.21.15.47:0/510948397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55764456c6d0 0x55764456cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.783+0000 7f139affd640 1 -- 172.21.15.47:0/510948397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557644578f80 msgr2=0x55764457b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:22.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.783+0000 7f139affd640 1 --2- 172.21.15.47:0/510948397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557644578f80 0x55764457b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.783+0000 7f139affd640 1 -- 172.21.15.47:0/510948397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55764445c320 con 0x55764456cff0 2024-07-24T22:09:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.784+0000 7f139affd640 1 --2- 172.21.15.47:0/510948397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644578a40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1390013820 tx=0x7f139000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff604e781a34739 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.784+0000 7f1381ffb640 1 -- 172.21.15.47:0/510948397 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390012b10 con 0x55764456cff0 2024-07-24T22:09:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.784+0000 7f1381ffb640 1 -- 172.21.15.47:0/510948397 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1390022070 con 0x55764456cff0 2024-07-24T22:09:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.784+0000 7f1381ffb640 1 -- 172.21.15.47:0/510948397 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13900105c0 con 0x55764456cff0 2024-07-24T22:09:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.785+0000 7f13a42ab740 1 -- 172.21.15.47:0/510948397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 msgr2=0x557644578a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.785+0000 7f13a42ab740 1 --2- 172.21.15.47:0/510948397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644578a40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1390013820 tx=0x7f139000e000 comp rx=0 tx=0).stop 2024-07-24T22:09:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.786+0000 7f13a42ab740 1 -- 172.21.15.47:0/510948397 shutdown_connections 2024-07-24T22:09:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.786+0000 7f13a42ab740 1 --2- 172.21.15.47:0/510948397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557644578f80 0x55764457b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.786+0000 7f13a42ab740 1 --2- 172.21.15.47:0/510948397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644578a40 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.786+0000 7f13a42ab740 1 --2- 172.21.15.47:0/510948397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55764456c6d0 0x55764456cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.786+0000 7f13a42ab740 1 -- 172.21.15.47:0/510948397 >> 172.21.15.47:0/510948397 conn(0x55764456a500 msgr2=0x55764456b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.786+0000 7f13a42ab740 1 -- 172.21.15.47:0/510948397 shutdown_connections 2024-07-24T22:09:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.786+0000 7f13a42ab740 1 -- 172.21.15.47:0/510948397 wait complete. 2024-07-24T22:09:22.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.786+0000 7f13a42ab740 1 -- start start 2024-07-24T22:09:22.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.787+0000 7f13a42ab740 1 Processor -- start 2024-07-24T22:09:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.787+0000 7f13a42ab740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456c6d0 0x557644575ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.787+0000 7f13a42ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644576410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.787+0000 7f13a42ab740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557644578f80 0x557644576950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.787+0000 7f13a42ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557644336700 con 0x55764456cff0 2024-07-24T22:09:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.787+0000 7f13a42ab740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5576444755f0 con 0x55764456c6d0 2024-07-24T22:09:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.787+0000 7f13a42ab740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55764457bc50 con 0x557644578f80 2024-07-24T22:09:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.787+0000 7f139affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644576410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:22.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.787+0000 7f139affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644576410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42446/0 (socket says 172.21.15.47:42446) 2024-07-24T22:09:22.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.787+0000 7f139affd640 1 -- 172.21.15.47:0/1302639577 learned_addr learned my addr 172.21.15.47:0/1302639577 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:22.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.787+0000 7f13a42ab740 10 client.0 _ll_register_callbacks cb 0x557644495960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.788+0000 7f139affd640 1 -- 172.21.15.47:0/1302639577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557644578f80 msgr2=0x557644576950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.788+0000 7f139affd640 1 --2- 172.21.15.47:0/1302639577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557644578f80 0x557644576950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.788+0000 7f139affd640 1 -- 172.21.15.47:0/1302639577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456c6d0 msgr2=0x557644575ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:09:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.788+0000 7f139affd640 1 --2- 172.21.15.47:0/1302639577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456c6d0 0x557644575ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.788+0000 7f139affd640 1 -- 172.21.15.47:0/1302639577 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557644468680 con 0x55764456cff0 2024-07-24T22:09:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.788+0000 7f139affd640 1 --2- 172.21.15.47:0/1302639577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644576410 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f139001dcf0 tx=0x7f1390012b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17931cd318805ac server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.789+0000 7f137affd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:09:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.789+0000 7f137affd640 1 -- 172.21.15.47:0/1302639577 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139002c070 con 0x55764456cff0 2024-07-24T22:09:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.789+0000 7f137affd640 1 -- 172.21.15.47:0/1302639577 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f1390026620 con 0x55764456cff0 2024-07-24T22:09:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.789+0000 7f13a42ab740 1 -- 172.21.15.47:0/1302639577 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1390022070 con 0x55764456cff0 2024-07-24T22:09:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.790+0000 7f137affd640 1 -- 172.21.15.47:0/1302639577 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1390038050 con 0x55764456cff0 2024-07-24T22:09:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.790+0000 7f13a42ab740 10 client.15999 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:22.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.790+0000 7f13a42ab740 1 -- 172.21.15.47:0/1302639577 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557644233650 con 0x55764456cff0 2024-07-24T22:09:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.791+0000 7f137affd640 1 -- 172.21.15.47:0/1302639577 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1390022070 con 0x55764456cff0 2024-07-24T22:09:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.791+0000 7f137affd640 1 -- 172.21.15.47:0/1302639577 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1390012070 con 0x55764456cff0 2024-07-24T22:09:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.791+0000 7f13a42ab740 10 client.15999 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.791+0000 7f13a42ab740 10 client.15999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.792+0000 7f13a42ab740 20 client.15999 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.792+0000 7f13a42ab740 1 --2- 172.21.15.47:0/1302639577 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557644588980 0x55764458ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.792+0000 7f13a42ab740 4 client.15999 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:09:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.792+0000 7f13a42ab740 1 -- 172.21.15.47:0/1302639577 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576444e5900 con 0x557644588980 2024-07-24T22:09:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.792+0000 7f139b7fe640 1 --2- 172.21.15.47:0/1302639577 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557644588980 0x55764458ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.794+0000 7f137affd640 10 client.15999 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.794+0000 7f139b7fe640 1 --2- 172.21.15.47:0/1302639577 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557644588980 0x55764458ad70 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dea96c328f5ad4a1 server_cookie=875f253fd1929941 in_seq=0 out_seq=0 2024-07-24T22:09:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.796+0000 7f137affd640 1 -- 172.21.15.47:0/1302639577 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576444e5900 con 0x557644588980 2024-07-24T22:09:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.796+0000 7f137affd640 10 client.15999 handle_command_reply: tid=0 2024-07-24T22:09:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.796+0000 7f13a42ab740 1 client.15999 shutdown 2024-07-24T22:09:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.797+0000 7f13a42ab740 1 -- 172.21.15.47:0/1302639577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 msgr2=0x557644576410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.797+0000 7f13a42ab740 1 --2- 172.21.15.47:0/1302639577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644576410 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f139001dcf0 tx=0x7f1390012b20 comp rx=0 tx=0).stop 2024-07-24T22:09:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.797+0000 7f13a42ab740 1 -- 172.21.15.47:0/1302639577 shutdown_connections 2024-07-24T22:09:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.797+0000 7f13a42ab740 1 --2- 172.21.15.47:0/1302639577 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557644588980 0x55764458ad70 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.797+0000 7f13a42ab740 1 --2- 172.21.15.47:0/1302639577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557644578f80 0x557644576950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.797+0000 7f137affd640 0 client.15999 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:22.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.797+0000 7f13a42ab740 1 --2- 172.21.15.47:0/1302639577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644576410 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.797+0000 7f13a42ab740 1 --2- 172.21.15.47:0/1302639577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456c6d0 0x557644575ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.797+0000 7f13a42ab740 1 -- 172.21.15.47:0/1302639577 >> 172.21.15.47:0/1302639577 conn(0x55764456a500 msgr2=0x5576445700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.798+0000 7f13a42ab740 1 -- 172.21.15.47:0/1302639577 shutdown_connections 2024-07-24T22:09:22.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.798+0000 7f13a42ab740 1 -- 172.21.15.47:0/1302639577 wait complete. 2024-07-24T22:09:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.798+0000 7f13a42ab740 20 client.15999 trim_cache size 0 max 16384 2024-07-24T22:09:22.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.818+0000 7f13a42ab740 1 Processor -- start 2024-07-24T22:09:22.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.818+0000 7f13a42ab740 1 -- start start 2024-07-24T22:09:22.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.818+0000 7f13a42ab740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55764456c6d0 0x557644570820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.818+0000 7f13a42ab740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456cff0 0x557644590500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f13a42ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557644578f80 0x557644590a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f13a42ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f138800c810 con 0x557644578f80 2024-07-24T22:09:22.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f13a42ab740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f138800f090 con 0x55764456cff0 2024-07-24T22:09:22.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f13a42ab740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f138800ce80 con 0x55764456c6d0 2024-07-24T22:09:22.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f139affd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456cff0 0x557644590500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:22.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f139affd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456cff0 0x557644590500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:41998/0 (socket says 172.21.15.47:41998) 2024-07-24T22:09:22.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f139affd640 1 -- 172.21.15.47:0/1697667707 learned_addr learned my addr 172.21.15.47:0/1697667707 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:22.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f139b7fe640 1 --2- 172.21.15.47:0/1697667707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55764456c6d0 0x557644570820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:22.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f139bfff640 1 --2- 172.21.15.47:0/1697667707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557644578f80 0x557644590a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:22.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f139affd640 1 -- 172.21.15.47:0/1697667707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55764456c6d0 msgr2=0x557644570820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:22.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f139affd640 1 --2- 172.21.15.47:0/1697667707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55764456c6d0 0x557644570820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f139affd640 1 -- 172.21.15.47:0/1697667707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557644578f80 msgr2=0x557644590a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f139affd640 1 --2- 172.21.15.47:0/1697667707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557644578f80 0x557644590a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f139affd640 1 -- 172.21.15.47:0/1697667707 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557644564a90 con 0x55764456cff0 2024-07-24T22:09:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.819+0000 7f139b7fe640 1 --2- 172.21.15.47:0/1697667707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55764456c6d0 0x557644570820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:09:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.820+0000 7f139affd640 1 --2- 172.21.15.47:0/1697667707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456cff0 0x557644590500 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1390012360 tx=0x7f1390006da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d69c367df927cf3 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.820+0000 7f13817fa640 1 -- 172.21.15.47:0/1697667707 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139002c040 con 0x55764456cff0 2024-07-24T22:09:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.820+0000 7f13817fa640 1 -- 172.21.15.47:0/1697667707 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1390022070 con 0x55764456cff0 2024-07-24T22:09:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.820+0000 7f13817fa640 1 -- 172.21.15.47:0/1697667707 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139001d8d0 con 0x55764456cff0 2024-07-24T22:09:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.821+0000 7f13a42ab740 1 -- 172.21.15.47:0/1697667707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456cff0 msgr2=0x557644590500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.821+0000 7f13a42ab740 1 --2- 172.21.15.47:0/1697667707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456cff0 0x557644590500 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1390012360 tx=0x7f1390006da0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.821+0000 7f13a42ab740 1 -- 172.21.15.47:0/1697667707 shutdown_connections 2024-07-24T22:09:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.821+0000 7f13a42ab740 1 --2- 172.21.15.47:0/1697667707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557644578f80 0x557644590a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.821+0000 7f13a42ab740 1 --2- 172.21.15.47:0/1697667707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456cff0 0x557644590500 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.821+0000 7f13a42ab740 1 --2- 172.21.15.47:0/1697667707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55764456c6d0 0x557644570820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.821+0000 7f13a42ab740 1 -- 172.21.15.47:0/1697667707 >> 172.21.15.47:0/1697667707 conn(0x55764456a500 msgr2=0x557644577d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:22.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.821+0000 7f13a42ab740 1 -- 172.21.15.47:0/1697667707 shutdown_connections 2024-07-24T22:09:22.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.821+0000 7f13a42ab740 1 -- 172.21.15.47:0/1697667707 wait complete. 2024-07-24T22:09:22.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.821+0000 7f13a42ab740 1 -- start start 2024-07-24T22:09:22.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.823+0000 7f13a42ab740 1 Processor -- start 2024-07-24T22:09:22.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.823+0000 7f13a42ab740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456c6d0 0x557644581630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.823+0000 7f13a42ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644572cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.823+0000 7f13a42ab740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557644578f80 0x557644573210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.823+0000 7f13a42ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f138800d550 con 0x55764456cff0 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.823+0000 7f13a42ab740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f138800e9c0 con 0x55764456c6d0 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.823+0000 7f13a42ab740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f138800dc20 con 0x557644578f80 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.823+0000 7f139b7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456c6d0 0x557644581630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.823+0000 7f139affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644572cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.823+0000 7f139b7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456c6d0 0x557644581630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:42008/0 (socket says 172.21.15.47:42008) 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.823+0000 7f139b7fe640 1 -- 172.21.15.47:0/3089372159 learned_addr learned my addr 172.21.15.47:0/3089372159 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.824+0000 7f13a42ab740 10 client.0 _ll_register_callbacks cb 0x7f1390013720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.824+0000 7f139bfff640 1 --2- 172.21.15.47:0/3089372159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557644578f80 0x557644573210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.824+0000 7f139b7fe640 1 -- 172.21.15.47:0/3089372159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557644578f80 msgr2=0x557644573210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.824+0000 7f139b7fe640 1 --2- 172.21.15.47:0/3089372159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557644578f80 0x557644573210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.824+0000 7f139b7fe640 1 -- 172.21.15.47:0/3089372159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 msgr2=0x557644572cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.824+0000 7f139b7fe640 1 --2- 172.21.15.47:0/3089372159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644572cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.824+0000 7f139b7fe640 1 -- 172.21.15.47:0/3089372159 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557644573a40 con 0x55764456c6d0 2024-07-24T22:09:22.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.824+0000 7f139bfff640 1 --2- 172.21.15.47:0/3089372159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557644578f80 0x557644573210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:09:22.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.824+0000 7f139b7fe640 1 --2- 172.21.15.47:0/3089372159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456c6d0 0x557644581630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55764458b4a0 tx=0x7f138c005090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=562798c12a9e8b68 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:22.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.824+0000 7f137affd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:09:22.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.825+0000 7f137affd640 1 -- 172.21.15.47:0/3089372159 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c035040 con 0x55764456c6d0 2024-07-24T22:09:22.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.825+0000 7f137affd640 1 -- 172.21.15.47:0/3089372159 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f138c005590 con 0x55764456c6d0 2024-07-24T22:09:22.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.825+0000 7f13a42ab740 1 -- 172.21.15.47:0/3089372159 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1390022070 con 0x55764456c6d0 2024-07-24T22:09:22.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.825+0000 7f137affd640 1 -- 172.21.15.47:0/3089372159 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f138c0046c0 con 0x55764456c6d0 2024-07-24T22:09:22.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.825+0000 7f13a42ab740 10 client.25463 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:22.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.825+0000 7f13a42ab740 1 -- 172.21.15.47:0/3089372159 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5576445f3500 con 0x55764456c6d0 2024-07-24T22:09:22.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.825+0000 7f137affd640 1 -- 172.21.15.47:0/3089372159 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1390022070 con 0x55764456c6d0 2024-07-24T22:09:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.825+0000 7f137affd640 1 -- 172.21.15.47:0/3089372159 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f138c031ae0 con 0x55764456c6d0 2024-07-24T22:09:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.825+0000 7f13a42ab740 10 client.25463 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.826+0000 7f13a42ab740 10 client.25463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.826+0000 7f13a42ab740 20 client.25463 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.826+0000 7f13a42ab740 1 --2- 172.21.15.47:0/3089372159 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557644588980 0x5576445f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.826+0000 7f13a42ab740 4 client.25463 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:09:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.826+0000 7f13a42ab740 1 -- 172.21.15.47:0/3089372159 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576444e13a0 con 0x557644588980 2024-07-24T22:09:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.826+0000 7f139affd640 1 --2- 172.21.15.47:0/3089372159 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557644588980 0x5576445f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.826+0000 7f137affd640 10 client.25463 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.826+0000 7f139affd640 1 --2- 172.21.15.47:0/3089372159 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557644588980 0x5576445f5ca0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51369a766ad4a3a8 server_cookie=d5de368c0828d455 in_seq=0 out_seq=0 2024-07-24T22:09:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.826+0000 7f137affd640 1 -- 172.21.15.47:0/3089372159 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576444e13a0 con 0x557644588980 2024-07-24T22:09:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.826+0000 7f137affd640 10 client.25463 handle_command_reply: tid=0 2024-07-24T22:09:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.826+0000 7f13a42ab740 1 client.25463 shutdown 2024-07-24T22:09:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.828+0000 7f13a42ab740 1 -- 172.21.15.47:0/3089372159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456c6d0 msgr2=0x557644581630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.828+0000 7f13a42ab740 1 --2- 172.21.15.47:0/3089372159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456c6d0 0x557644581630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55764458b4a0 tx=0x7f138c005090 comp rx=0 tx=0).stop 2024-07-24T22:09:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.828+0000 7f13a42ab740 1 -- 172.21.15.47:0/3089372159 shutdown_connections 2024-07-24T22:09:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.828+0000 7f13a42ab740 1 --2- 172.21.15.47:0/3089372159 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557644588980 0x5576445f5ca0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.828+0000 7f13a42ab740 1 --2- 172.21.15.47:0/3089372159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557644578f80 0x557644573210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.828+0000 7f13a42ab740 1 --2- 172.21.15.47:0/3089372159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55764456cff0 0x557644572cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.828+0000 7f13a42ab740 1 --2- 172.21.15.47:0/3089372159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55764456c6d0 0x557644581630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.828+0000 7f137affd640 0 client.25463 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.828+0000 7f13a42ab740 1 -- 172.21.15.47:0/3089372159 >> 172.21.15.47:0/3089372159 conn(0x55764456a500 msgr2=0x557644577500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:22.833 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:09:22.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.828+0000 7f13a42ab740 1 -- 172.21.15.47:0/3089372159 shutdown_connections 2024-07-24T22:09:22.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.828+0000 7f13a42ab740 1 -- 172.21.15.47:0/3089372159 wait complete. 2024-07-24T22:09:22.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.828+0000 7f13a42ab740 20 client.25463 trim_cache size 0 max 16384 2024-07-24T22:09:22.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.829+0000 7f13a1efa640 1 -- 172.21.15.47:0/754184620 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13840b3dc0 msgr2=0x7f13840b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:22.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.829+0000 7f13a1efa640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13840b3dc0 0x7f13840b6280 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f139c19ccf0 tx=0x7f1390006bd0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.829+0000 7f13a1efa640 1 -- 172.21.15.47:0/754184620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f139c107260 msgr2=0x7f139c102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:22.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.829+0000 7f13a1efa640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f139c107260 0x7f139c102690 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f139400b970 tx=0x7f139400be30 comp rx=0 tx=0).stop 2024-07-24T22:09:22.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.829+0000 7f13a1efa640 1 -- 172.21.15.47:0/754184620 shutdown_connections 2024-07-24T22:09:22.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.829+0000 7f13a1efa640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13840b3dc0 0x7f13840b6280 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.829+0000 7f13a1efa640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f139c107260 0x7f139c102690 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.829+0000 7f13a1efa640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f139c106900 0x7f139c102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.829+0000 7f13a1efa640 1 --2- 172.21.15.47:0/754184620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f139c105f80 0x7f139c103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.829+0000 7f13a1efa640 1 -- 172.21.15.47:0/754184620 >> 172.21.15.47:0/754184620 conn(0x7f139c0fc3f0 msgr2=0x7f139c0fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.829+0000 7f13a1efa640 1 -- 172.21.15.47:0/754184620 shutdown_connections 2024-07-24T22:09:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:22.829+0000 7f13a1efa640 1 -- 172.21.15.47:0/754184620 wait complete. 2024-07-24T22:09:23.801 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:23 smithi047 ceph-mon[32551]: pgmap v431: 97 pgs: 97 active+clean; 17 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 711 MiB/s wr, 1.90k op/s 2024-07-24T22:09:23.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:23 smithi183 ceph-mon[37007]: pgmap v431: 97 pgs: 97 active+clean; 17 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 711 MiB/s wr, 1.90k op/s 2024-07-24T22:09:24.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:23 smithi188 ceph-mon[37380]: pgmap v431: 97 pgs: 97 active+clean; 17 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 711 MiB/s wr, 1.90k op/s 2024-07-24T22:09:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.490+0000 7ff21aebe640 1 -- 172.21.15.47:0/1958908048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff214103490 msgr2=0x7ff214103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.490+0000 7ff21aebe640 1 --2- 172.21.15.47:0/1958908048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff214103490 0x7ff214103870 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff210009900 tx=0x7ff21002a410 comp rx=0 tx=0).stop 2024-07-24T22:09:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.491+0000 7ff21aebe640 1 -- 172.21.15.47:0/1958908048 shutdown_connections 2024-07-24T22:09:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.491+0000 7ff21aebe640 1 --2- 172.21.15.47:0/1958908048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff21410ca40 0x7ff21410ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.491+0000 7ff21aebe640 1 --2- 172.21.15.47:0/1958908048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff214103e90 0x7ff21410c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.491+0000 7ff21aebe640 1 --2- 172.21.15.47:0/1958908048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff214103490 0x7ff214103870 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.491+0000 7ff21aebe640 1 -- 172.21.15.47:0/1958908048 >> 172.21.15.47:0/1958908048 conn(0x7ff2140782e0 msgr2=0x7ff2140ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.491+0000 7ff21aebe640 1 -- 172.21.15.47:0/1958908048 shutdown_connections 2024-07-24T22:09:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.491+0000 7ff21aebe640 1 -- 172.21.15.47:0/1958908048 wait complete. 2024-07-24T22:09:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.491+0000 7ff21aebe640 1 Processor -- start 2024-07-24T22:09:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff21aebe640 1 -- start start 2024-07-24T22:09:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff21aebe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff214103490 0x7ff214198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff21aebe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff214103e90 0x7ff214199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff21aebe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff21410ca40 0x7ff21419e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff21aebe640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff214112670 con 0x7ff21410ca40 2024-07-24T22:09:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff21aebe640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff2141124f0 con 0x7ff214103490 2024-07-24T22:09:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff21aebe640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff2141127f0 con 0x7ff214103e90 2024-07-24T22:09:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff20bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff214103e90 0x7ff214199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff218c5a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff214103490 0x7ff214198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff21945b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff21410ca40 0x7ff21419e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff20bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff214103e90 0x7ff214199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:42336/0 (socket says 172.21.15.47:42336) 2024-07-24T22:09:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff20bfff640 1 -- 172.21.15.47:0/2536197739 learned_addr learned my addr 172.21.15.47:0/2536197739 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff218c5a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff214103490 0x7ff214198c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:42022/0 (socket says 172.21.15.47:42022) 2024-07-24T22:09:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff20bfff640 1 -- 172.21.15.47:0/2536197739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff214103490 msgr2=0x7ff214198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff20bfff640 1 --2- 172.21.15.47:0/2536197739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff214103490 0x7ff214198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff20bfff640 1 -- 172.21.15.47:0/2536197739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff21410ca40 msgr2=0x7ff21419e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff20bfff640 1 --2- 172.21.15.47:0/2536197739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff21410ca40 0x7ff21419e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.492+0000 7ff20bfff640 1 -- 172.21.15.47:0/2536197739 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21419ecd0 con 0x7ff214103e90 2024-07-24T22:09:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.493+0000 7ff20bfff640 1 --2- 172.21.15.47:0/2536197739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff214103e90 0x7ff214199170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff20400e9f0 tx=0x7ff20400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.493+0000 7ff209ffb640 1 -- 172.21.15.47:0/2536197739 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20400ccc0 con 0x7ff214103e90 2024-07-24T22:09:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.493+0000 7ff209ffb640 1 -- 172.21.15.47:0/2536197739 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff20400ce60 con 0x7ff214103e90 2024-07-24T22:09:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.493+0000 7ff21aebe640 1 -- 172.21.15.47:0/2536197739 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff21419efc0 con 0x7ff214103e90 2024-07-24T22:09:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.493+0000 7ff209ffb640 1 -- 172.21.15.47:0/2536197739 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff204010430 con 0x7ff214103e90 2024-07-24T22:09:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.493+0000 7ff21aebe640 1 -- 172.21.15.47:0/2536197739 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2141a5680 con 0x7ff214103e90 2024-07-24T22:09:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.496+0000 7ff209ffb640 1 -- 172.21.15.47:0/2536197739 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7ff2040046c0 con 0x7ff214103e90 2024-07-24T22:09:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.496+0000 7ff209ffb640 1 --2- 172.21.15.47:0/2536197739 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff1fc0b3d40 0x7ff1fc0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.497+0000 7ff209ffb640 1 -- 172.21.15.47:0/2536197739 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ff2040e43e0 con 0x7ff214103e90 2024-07-24T22:09:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.497+0000 7ff218c5a640 1 --2- 172.21.15.47:0/2536197739 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff1fc0b3d40 0x7ff1fc0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.497+0000 7ff218c5a640 1 --2- 172.21.15.47:0/2536197739 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff1fc0b3d40 0x7ff1fc0b6200 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff210031440 tx=0x7ff210005b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.497+0000 7ff21dc13740 1 Processor -- start 2024-07-24T22:09:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.497+0000 7ff21dc13740 1 -- start start 2024-07-24T22:09:24.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff21dc13740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 0x556ad1730ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff21dc13740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad17311e0 0x556ad173cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff21dc13740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad173d170 0x556ad173f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff21dc13740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556ad16a6280 con 0x556ad17308c0 2024-07-24T22:09:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff21dc13740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556ad1695780 con 0x556ad17311e0 2024-07-24T22:09:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff21dc13740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556ad16997c0 con 0x556ad173d170 2024-07-24T22:09:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff218c5a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 0x556ad1730ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff218c5a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 0x556ad1730ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42480/0 (socket says 172.21.15.47:42480) 2024-07-24T22:09:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff218c5a640 1 -- 172.21.15.47:0/2093609515 learned_addr learned my addr 172.21.15.47:0/2093609515 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff20bfff640 1 --2- 172.21.15.47:0/2093609515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad17311e0 0x556ad173cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff21945b640 1 --2- 172.21.15.47:0/2093609515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad173d170 0x556ad173f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff218c5a640 1 -- 172.21.15.47:0/2093609515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad173d170 msgr2=0x556ad173f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff218c5a640 1 --2- 172.21.15.47:0/2093609515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad173d170 0x556ad173f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff218c5a640 1 -- 172.21.15.47:0/2093609515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad17311e0 msgr2=0x556ad173cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff218c5a640 1 --2- 172.21.15.47:0/2093609515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad17311e0 0x556ad173cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff218c5a640 1 -- 172.21.15.47:0/2093609515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ad13f9790 con 0x556ad17308c0 2024-07-24T22:09:24.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff20bfff640 1 --2- 172.21.15.47:0/2093609515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad17311e0 0x556ad173cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:24.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.498+0000 7ff218c5a640 1 --2- 172.21.15.47:0/2093609515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 0x556ad1730ca0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff210009900 tx=0x7ff21003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc6b26088b9c13f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:24.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.499+0000 7ff1faffd640 1 -- 172.21.15.47:0/2093609515 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff210035040 con 0x556ad17308c0 2024-07-24T22:09:24.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.499+0000 7ff1faffd640 1 -- 172.21.15.47:0/2093609515 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff21004d070 con 0x556ad17308c0 2024-07-24T22:09:24.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.499+0000 7ff1faffd640 1 -- 172.21.15.47:0/2093609515 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2100055c0 con 0x556ad17308c0 2024-07-24T22:09:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.500+0000 7ff21dc13740 1 -- 172.21.15.47:0/2093609515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 msgr2=0x556ad1730ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.500+0000 7ff21dc13740 1 --2- 172.21.15.47:0/2093609515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 0x556ad1730ca0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff210009900 tx=0x7ff21003d000 comp rx=0 tx=0).stop 2024-07-24T22:09:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.500+0000 7ff21dc13740 1 -- 172.21.15.47:0/2093609515 shutdown_connections 2024-07-24T22:09:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.500+0000 7ff21dc13740 1 --2- 172.21.15.47:0/2093609515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad173d170 0x556ad173f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.500+0000 7ff21dc13740 1 --2- 172.21.15.47:0/2093609515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad17311e0 0x556ad173cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.500+0000 7ff21dc13740 1 --2- 172.21.15.47:0/2093609515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 0x556ad1730ca0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.500+0000 7ff21dc13740 1 -- 172.21.15.47:0/2093609515 >> 172.21.15.47:0/2093609515 conn(0x556ad172e6f0 msgr2=0x556ad172f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.500+0000 7ff21dc13740 1 -- 172.21.15.47:0/2093609515 shutdown_connections 2024-07-24T22:09:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.500+0000 7ff21dc13740 1 -- 172.21.15.47:0/2093609515 wait complete. 2024-07-24T22:09:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.500+0000 7ff21dc13740 1 -- start start 2024-07-24T22:09:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.500+0000 7ff21dc13740 1 Processor -- start 2024-07-24T22:09:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.501+0000 7ff21dc13740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17308c0 0x556ad173c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.501+0000 7ff21dc13740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 0x556ad1739d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.501+0000 7ff21dc13740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 0x556ad173a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.501+0000 7ff21dc13740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556ad15cfab0 con 0x556ad17311e0 2024-07-24T22:09:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.501+0000 7ff21dc13740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556ad161d9e0 con 0x556ad173d170 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.501+0000 7ff21dc13740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556ad173fdf0 con 0x556ad17308c0 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.501+0000 7ff20bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 0x556ad1739d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.501+0000 7ff218c5a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17308c0 0x556ad173c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.501+0000 7ff21945b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 0x556ad173a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.501+0000 7ff218c5a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17308c0 0x556ad173c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:42352/0 (socket says 172.21.15.47:42352) 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.501+0000 7ff20bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 0x556ad1739d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42496/0 (socket says 172.21.15.47:42496) 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.501+0000 7ff21dc13740 10 client.0 _ll_register_callbacks cb 0x556ad13a5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.501+0000 7ff218c5a640 1 -- 172.21.15.47:0/1285334082 learned_addr learned my addr 172.21.15.47:0/1285334082 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.502+0000 7ff21945b640 1 -- 172.21.15.47:0/1285334082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17308c0 msgr2=0x556ad173c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.502+0000 7ff21945b640 1 --2- 172.21.15.47:0/1285334082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17308c0 0x556ad173c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.502+0000 7ff21945b640 1 -- 172.21.15.47:0/1285334082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 msgr2=0x556ad1739d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.502+0000 7ff21945b640 1 --2- 172.21.15.47:0/1285334082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 0x556ad1739d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.502+0000 7ff21945b640 1 -- 172.21.15.47:0/1285334082 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ad1472620 con 0x556ad173d170 2024-07-24T22:09:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.502+0000 7ff20bfff640 1 --2- 172.21.15.47:0/1285334082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 0x556ad1739d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.502+0000 7ff21945b640 1 --2- 172.21.15.47:0/1285334082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 0x556ad173a290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff20c005fd0 tx=0x7ff20c00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=911461ce5df3518d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.502+0000 7ff1f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:09:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.502+0000 7ff1f3fff640 1 -- 172.21.15.47:0/1285334082 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00fe60 con 0x556ad173d170 2024-07-24T22:09:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.502+0000 7ff21dc13740 1 -- 172.21.15.47:0/1285334082 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556ad1644ce0 con 0x556ad173d170 2024-07-24T22:09:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.502+0000 7ff1f3fff640 1 -- 172.21.15.47:0/1285334082 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ff20c0120d0 con 0x556ad173d170 2024-07-24T22:09:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.503+0000 7ff1f3fff640 1 -- 172.21.15.47:0/1285334082 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff20c003970 con 0x556ad173d170 2024-07-24T22:09:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.503+0000 7ff21dc13740 10 client.25475 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.503+0000 7ff21dc13740 1 -- 172.21.15.47:0/1285334082 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556ad174b5e0 con 0x556ad173d170 2024-07-24T22:09:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.503+0000 7ff1f3fff640 1 -- 172.21.15.47:0/1285334082 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556ad1644ce0 con 0x556ad173d170 2024-07-24T22:09:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.503+0000 7ff1f3fff640 1 -- 172.21.15.47:0/1285334082 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff20c01c460 con 0x556ad173d170 2024-07-24T22:09:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.503+0000 7ff21dc13740 10 client.25475 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.503+0000 7ff21dc13740 10 client.25475 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.503+0000 7ff21dc13740 20 client.25475 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.503+0000 7ff21dc13740 1 --2- 172.21.15.47:0/1285334082 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556ad174ca50 0x556ad174ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.503+0000 7ff21dc13740 4 client.25475 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:09:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.503+0000 7ff21dc13740 1 -- 172.21.15.47:0/1285334082 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ad16a81d0 con 0x556ad174ca50 2024-07-24T22:09:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.503+0000 7ff218c5a640 1 --2- 172.21.15.47:0/1285334082 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556ad174ca50 0x556ad174ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.504+0000 7ff1f3fff640 10 client.25475 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.504+0000 7ff218c5a640 1 --2- 172.21.15.47:0/1285334082 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556ad174ca50 0x556ad174ee40 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d0d943538c6528c server_cookie=5b8b7b4ad66a692e in_seq=0 out_seq=0 2024-07-24T22:09:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.505+0000 7ff1f3fff640 1 -- 172.21.15.47:0/1285334082 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ad16a81d0 con 0x556ad174ca50 2024-07-24T22:09:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.505+0000 7ff1f3fff640 10 client.25475 handle_command_reply: tid=0 2024-07-24T22:09:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.505+0000 7ff21dc13740 1 client.25475 shutdown 2024-07-24T22:09:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.505+0000 7ff21dc13740 1 -- 172.21.15.47:0/1285334082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 msgr2=0x556ad173a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.505+0000 7ff21dc13740 1 --2- 172.21.15.47:0/1285334082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 0x556ad173a290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff20c005fd0 tx=0x7ff20c00f790 comp rx=0 tx=0).stop 2024-07-24T22:09:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.506+0000 7ff21dc13740 1 -- 172.21.15.47:0/1285334082 shutdown_connections 2024-07-24T22:09:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.506+0000 7ff21dc13740 1 --2- 172.21.15.47:0/1285334082 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556ad174ca50 0x556ad174ee40 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.506+0000 7ff21dc13740 1 --2- 172.21.15.47:0/1285334082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 0x556ad173a290 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.506+0000 7ff1f3fff640 0 client.25475 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.506+0000 7ff21dc13740 1 --2- 172.21.15.47:0/1285334082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 0x556ad1739d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.506+0000 7ff21dc13740 1 --2- 172.21.15.47:0/1285334082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17308c0 0x556ad173c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.506+0000 7ff21dc13740 1 -- 172.21.15.47:0/1285334082 >> 172.21.15.47:0/1285334082 conn(0x556ad172e6f0 msgr2=0x556ad1734220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.506+0000 7ff21dc13740 1 -- 172.21.15.47:0/1285334082 shutdown_connections 2024-07-24T22:09:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.506+0000 7ff21dc13740 1 -- 172.21.15.47:0/1285334082 wait complete. 2024-07-24T22:09:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.506+0000 7ff21dc13740 20 client.25475 trim_cache size 0 max 16384 2024-07-24T22:09:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.523+0000 7ff21dc13740 1 Processor -- start 2024-07-24T22:09:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.523+0000 7ff21dc13740 1 -- start start 2024-07-24T22:09:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.523+0000 7ff21dc13740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17308c0 0x556ad17385b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.523+0000 7ff21dc13740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 0x556ad1738af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.523+0000 7ff21dc13740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 0x556ad1754760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.523+0000 7ff21dc13740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2141ac050 con 0x556ad17311e0 2024-07-24T22:09:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.523+0000 7ff21dc13740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff2141ae8d0 con 0x556ad173d170 2024-07-24T22:09:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.523+0000 7ff21dc13740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff2141ac6c0 con 0x556ad17308c0 2024-07-24T22:09:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.523+0000 7ff20bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 0x556ad1738af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.524+0000 7ff20bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 0x556ad1738af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42498/0 (socket says 172.21.15.47:42498) 2024-07-24T22:09:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.524+0000 7ff20bfff640 1 -- 172.21.15.47:0/1244236452 learned_addr learned my addr 172.21.15.47:0/1244236452 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.524+0000 7ff218c5a640 1 --2- 172.21.15.47:0/1244236452 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17308c0 0x556ad17385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.524+0000 7ff21945b640 1 --2- 172.21.15.47:0/1244236452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 0x556ad1754760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.524+0000 7ff20bfff640 1 -- 172.21.15.47:0/1244236452 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17308c0 msgr2=0x556ad17385b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.524+0000 7ff20bfff640 1 --2- 172.21.15.47:0/1244236452 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17308c0 0x556ad17385b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.524+0000 7ff20bfff640 1 -- 172.21.15.47:0/1244236452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 msgr2=0x556ad1754760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.524+0000 7ff20bfff640 1 --2- 172.21.15.47:0/1244236452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 0x556ad1754760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.524+0000 7ff20bfff640 1 -- 172.21.15.47:0/1244236452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ad1731010 con 0x556ad17311e0 2024-07-24T22:09:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.524+0000 7ff20bfff640 1 --2- 172.21.15.47:0/1244236452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 0x556ad1738af0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff204009380 tx=0x7ff2040aab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7504b0513a0a56 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.524+0000 7ff1fa7fc640 1 -- 172.21.15.47:0/1244236452 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2040af5f0 con 0x556ad17311e0 2024-07-24T22:09:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.524+0000 7ff1fa7fc640 1 -- 172.21.15.47:0/1244236452 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2040b40a0 con 0x556ad17311e0 2024-07-24T22:09:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.524+0000 7ff1fa7fc640 1 -- 172.21.15.47:0/1244236452 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2040a6960 con 0x556ad17311e0 2024-07-24T22:09:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.525+0000 7ff21dc13740 1 -- 172.21.15.47:0/1244236452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 msgr2=0x556ad1738af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.525+0000 7ff21dc13740 1 --2- 172.21.15.47:0/1244236452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 0x556ad1738af0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff204009380 tx=0x7ff2040aab00 comp rx=0 tx=0).stop 2024-07-24T22:09:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.525+0000 7ff21dc13740 1 -- 172.21.15.47:0/1244236452 shutdown_connections 2024-07-24T22:09:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.525+0000 7ff21dc13740 1 --2- 172.21.15.47:0/1244236452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 0x556ad1754760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.525+0000 7ff21dc13740 1 --2- 172.21.15.47:0/1244236452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17311e0 0x556ad1738af0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.525+0000 7ff21dc13740 1 --2- 172.21.15.47:0/1244236452 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17308c0 0x556ad17385b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.525+0000 7ff21dc13740 1 -- 172.21.15.47:0/1244236452 >> 172.21.15.47:0/1244236452 conn(0x556ad172e6f0 msgr2=0x556ad172f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.525+0000 7ff21dc13740 1 -- 172.21.15.47:0/1244236452 shutdown_connections 2024-07-24T22:09:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.525+0000 7ff21dc13740 1 -- 172.21.15.47:0/1244236452 wait complete. 2024-07-24T22:09:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff21dc13740 1 -- start start 2024-07-24T22:09:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff21dc13740 1 Processor -- start 2024-07-24T22:09:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff21dc13740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 0x556ad1742130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff21dc13740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17311e0 0x556ad1742670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff21dc13740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 0x556ad1742bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff21dc13740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2141acd90 con 0x556ad17308c0 2024-07-24T22:09:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff21dc13740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff2141ae200 con 0x556ad173d170 2024-07-24T22:09:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff21dc13740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff2141ad460 con 0x556ad17311e0 2024-07-24T22:09:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff21dc13740 10 client.0 _ll_register_callbacks cb 0x7ff20c009bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff218c5a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 0x556ad1742130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff20bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17311e0 0x556ad1742670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff20bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17311e0 0x556ad1742670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:42360/0 (socket says 172.21.15.47:42360) 2024-07-24T22:09:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff218c5a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 0x556ad1742130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42500/0 (socket says 172.21.15.47:42500) 2024-07-24T22:09:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff20bfff640 1 -- 172.21.15.47:0/2478248997 learned_addr learned my addr 172.21.15.47:0/2478248997 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.526+0000 7ff21945b640 1 --2- 172.21.15.47:0/2478248997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 0x556ad1742bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff218c5a640 1 -- 172.21.15.47:0/2478248997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17311e0 msgr2=0x556ad1742670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff218c5a640 1 --2- 172.21.15.47:0/2478248997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17311e0 0x556ad1742670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff218c5a640 1 -- 172.21.15.47:0/2478248997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 msgr2=0x556ad1742bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff218c5a640 1 --2- 172.21.15.47:0/2478248997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 0x556ad1742bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff218c5a640 1 -- 172.21.15.47:0/2478248997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ad17b9d40 con 0x556ad17308c0 2024-07-24T22:09:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff20bfff640 1 --2- 172.21.15.47:0/2478248997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17311e0 0x556ad1742670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff218c5a640 1 --2- 172.21.15.47:0/2478248997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 0x556ad1742130 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff21002a450 tx=0x7ff210031830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b536c5b6e90492f8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff1f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:09:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff1f3fff640 1 -- 172.21.15.47:0/2478248997 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff210035040 con 0x556ad17308c0 2024-07-24T22:09:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff1f3fff640 1 -- 172.21.15.47:0/2478248997 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ff21005b3b0 con 0x556ad17308c0 2024-07-24T22:09:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff21dc13740 1 -- 172.21.15.47:0/2478248997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2040b40a0 con 0x556ad17308c0 2024-07-24T22:09:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff1f3fff640 1 -- 172.21.15.47:0/2478248997 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff21006a050 con 0x556ad17308c0 2024-07-24T22:09:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff21dc13740 10 client.16023 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.527+0000 7ff21dc13740 1 -- 172.21.15.47:0/2478248997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556ad17bb0b0 con 0x556ad17308c0 2024-07-24T22:09:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.528+0000 7ff1f3fff640 1 -- 172.21.15.47:0/2478248997 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2040b40a0 con 0x556ad17308c0 2024-07-24T22:09:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.528+0000 7ff1f3fff640 1 -- 172.21.15.47:0/2478248997 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff210004870 con 0x556ad17308c0 2024-07-24T22:09:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.528+0000 7ff21dc13740 10 client.16023 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.528+0000 7ff21dc13740 10 client.16023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.528+0000 7ff21dc13740 20 client.16023 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.528+0000 7ff21dc13740 1 --2- 172.21.15.47:0/2478248997 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556ad17bb3f0 0x556ad17bd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.528+0000 7ff21dc13740 4 client.16023 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:09:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.528+0000 7ff21dc13740 1 -- 172.21.15.47:0/2478248997 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ad16a3c70 con 0x556ad17bb3f0 2024-07-24T22:09:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.528+0000 7ff20bfff640 1 --2- 172.21.15.47:0/2478248997 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556ad17bb3f0 0x556ad17bd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.528+0000 7ff1f3fff640 10 client.16023 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:24.529+0000 7ff20bfff640 1 --2- 172.21.15.47:0/2478248997 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556ad17bb3f0 0x556ad17bd7e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=579375b645ddcaaf server_cookie=707b503b9db55f52 in_seq=0 out_seq=0 2024-07-24T22:09:24.804 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:09:24.804 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:09:25.516 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:09:25.850 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:25 smithi188 ceph-mon[37380]: pgmap v432: 97 pgs: 97 active+clean; 18 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 740 MiB/s wr, 1.81k op/s 2024-07-24T22:09:25.857 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:25 smithi047 ceph-mon[32551]: pgmap v432: 97 pgs: 97 active+clean; 18 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 740 MiB/s wr, 1.81k op/s 2024-07-24T22:09:25.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:25 smithi183 ceph-mon[37007]: pgmap v432: 97 pgs: 97 active+clean; 18 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 740 MiB/s wr, 1.81k op/s 2024-07-24T22:09:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.259+0000 7ff1f3fff640 1 -- 172.21.15.47:0/2478248997 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ad16a3c70 con 0x556ad17bb3f0 2024-07-24T22:09:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.259+0000 7ff1f3fff640 10 client.16023 handle_command_reply: tid=0 2024-07-24T22:09:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.259+0000 7ff21dc13740 1 client.16023 shutdown 2024-07-24T22:09:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.259+0000 7ff21dc13740 1 -- 172.21.15.47:0/2478248997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 msgr2=0x556ad1742130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.259+0000 7ff21dc13740 1 --2- 172.21.15.47:0/2478248997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 0x556ad1742130 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff21002a450 tx=0x7ff210031830 comp rx=0 tx=0).stop 2024-07-24T22:09:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.261+0000 7ff21dc13740 1 -- 172.21.15.47:0/2478248997 shutdown_connections 2024-07-24T22:09:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.261+0000 7ff21dc13740 1 --2- 172.21.15.47:0/2478248997 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556ad17bb3f0 0x556ad17bd7e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.261+0000 7ff21dc13740 1 --2- 172.21.15.47:0/2478248997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556ad173d170 0x556ad1742bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.261+0000 7ff21dc13740 1 --2- 172.21.15.47:0/2478248997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556ad17311e0 0x556ad1742670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.261+0000 7ff21dc13740 1 --2- 172.21.15.47:0/2478248997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556ad17308c0 0x556ad1742130 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.261+0000 7ff21dc13740 1 -- 172.21.15.47:0/2478248997 >> 172.21.15.47:0/2478248997 conn(0x556ad172e6f0 msgr2=0x556ad1738180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.261+0000 7ff1f3fff640 0 client.16023 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.261+0000 7ff21dc13740 1 -- 172.21.15.47:0/2478248997 shutdown_connections 2024-07-24T22:09:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.261+0000 7ff21dc13740 1 -- 172.21.15.47:0/2478248997 wait complete. 2024-07-24T22:09:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.262+0000 7ff21dc13740 20 client.16023 trim_cache size 0 max 16384 2024-07-24T22:09:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:09:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:09:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:09:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:09:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.275+0000 7ff21aebe640 1 -- 172.21.15.47:0/2536197739 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff1fc0b3d40 msgr2=0x7ff1fc0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.275+0000 7ff21aebe640 1 --2- 172.21.15.47:0/2536197739 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff1fc0b3d40 0x7ff1fc0b6200 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff210031440 tx=0x7ff210005b50 comp rx=0 tx=0).stop 2024-07-24T22:09:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.275+0000 7ff21aebe640 1 -- 172.21.15.47:0/2536197739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff214103e90 msgr2=0x7ff214199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.275+0000 7ff21aebe640 1 --2- 172.21.15.47:0/2536197739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff214103e90 0x7ff214199170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff20400e9f0 tx=0x7ff20400edf0 comp rx=0 tx=0).stop 2024-07-24T22:09:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.284+0000 7ff21aebe640 1 -- 172.21.15.47:0/2536197739 shutdown_connections 2024-07-24T22:09:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.284+0000 7ff21aebe640 1 --2- 172.21.15.47:0/2536197739 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff1fc0b3d40 0x7ff1fc0b6200 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.284+0000 7ff21aebe640 1 --2- 172.21.15.47:0/2536197739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff21410ca40 0x7ff21419e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.284+0000 7ff21aebe640 1 --2- 172.21.15.47:0/2536197739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff214103e90 0x7ff214199170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.284+0000 7ff21aebe640 1 --2- 172.21.15.47:0/2536197739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff214103490 0x7ff214198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.284+0000 7ff21aebe640 1 -- 172.21.15.47:0/2536197739 >> 172.21.15.47:0/2536197739 conn(0x7ff2140782e0 msgr2=0x7ff2140ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.288+0000 7ff21aebe640 1 -- 172.21.15.47:0/2536197739 shutdown_connections 2024-07-24T22:09:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:27.288+0000 7ff21aebe640 1 -- 172.21.15.47:0/2536197739 wait complete. 2024-07-24T22:09:27.852 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:27 smithi047 ceph-mon[32551]: pgmap v433: 97 pgs: 97 active+clean; 18 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 663 MiB/s wr, 1.40k op/s 2024-07-24T22:09:28.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:27 smithi188 ceph-mon[37380]: pgmap v433: 97 pgs: 97 active+clean; 18 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 663 MiB/s wr, 1.40k op/s 2024-07-24T22:09:28.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.094+0000 7f68bfc12640 1 -- 172.21.15.47:0/2416900750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68b8108b20 msgr2=0x7f68b810f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:28.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.094+0000 7f68bfc12640 1 --2- 172.21.15.47:0/2416900750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68b8108b20 0x7f68b810f320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009be0 tx=0x7f68b002a6c0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.094+0000 7f68bfc12640 1 -- 172.21.15.47:0/2416900750 shutdown_connections 2024-07-24T22:09:28.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.094+0000 7f68bfc12640 1 --2- 172.21.15.47:0/2416900750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68b8108b20 0x7f68b810f320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.094+0000 7f68bfc12640 1 --2- 172.21.15.47:0/2416900750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b81081a0 0x7f68b81085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.094+0000 7f68bfc12640 1 --2- 172.21.15.47:0/2416900750 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68b8102790 0x7f68b8102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.094+0000 7f68bfc12640 1 -- 172.21.15.47:0/2416900750 >> 172.21.15.47:0/2416900750 conn(0x7f68b80fe200 msgr2=0x7f68b8100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:28.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.095+0000 7f68bfc12640 1 -- 172.21.15.47:0/2416900750 shutdown_connections 2024-07-24T22:09:28.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.095+0000 7f68bfc12640 1 -- 172.21.15.47:0/2416900750 wait complete. 2024-07-24T22:09:28.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.096+0000 7f68bfc12640 1 Processor -- start 2024-07-24T22:09:28.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.096+0000 7f68bfc12640 1 -- start start 2024-07-24T22:09:28.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.096+0000 7f68bfc12640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68b8102790 0x7f68b8198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.096+0000 7f68bfc12640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b81081a0 0x7f68b81991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.096+0000 7f68bfc12640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68b8108b20 0x7f68b819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.096+0000 7f68bfc12640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68b8112740 con 0x7f68b81081a0 2024-07-24T22:09:28.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.096+0000 7f68bfc12640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81125c0 con 0x7f68b8102790 2024-07-24T22:09:28.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.096+0000 7f68bfc12640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81128c0 con 0x7f68b8108b20 2024-07-24T22:09:28.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.096+0000 7f68bd9ae640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68b8102790 0x7f68b8198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.096+0000 7f68bd9ae640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68b8102790 0x7f68b8198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:37576/0 (socket says 172.21.15.47:37576) 2024-07-24T22:09:28.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.096+0000 7f68bd9ae640 1 -- 172.21.15.47:0/871785610 learned_addr learned my addr 172.21.15.47:0/871785610 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:28.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.096+0000 7f68bd1ad640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b81081a0 0x7f68b81991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.097+0000 7f68be1af640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68b8108b20 0x7f68b819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.097+0000 7f68bd9ae640 1 -- 172.21.15.47:0/871785610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68b8108b20 msgr2=0x7f68b819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:28.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.097+0000 7f68bd9ae640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68b8108b20 0x7f68b819e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.097+0000 7f68bd9ae640 1 -- 172.21.15.47:0/871785610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b81081a0 msgr2=0x7f68b81991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:28.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.097+0000 7f68bd9ae640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b81081a0 0x7f68b81991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.097+0000 7f68bd9ae640 1 -- 172.21.15.47:0/871785610 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b819ed20 con 0x7f68b8102790 2024-07-24T22:09:28.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.097+0000 7f68bd9ae640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68b8102790 0x7f68b8198c70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f68b400d770 tx=0x7f68b400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:28.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.097+0000 7f68aeffd640 1 -- 172.21.15.47:0/871785610 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4017070 con 0x7f68b8102790 2024-07-24T22:09:28.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.097+0000 7f68aeffd640 1 -- 172.21.15.47:0/871785610 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68b40054d0 con 0x7f68b8102790 2024-07-24T22:09:28.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.097+0000 7f68aeffd640 1 -- 172.21.15.47:0/871785610 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4004c30 con 0x7f68b8102790 2024-07-24T22:09:28.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.098+0000 7f68bfc12640 1 -- 172.21.15.47:0/871785610 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b819f010 con 0x7f68b8102790 2024-07-24T22:09:28.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.098+0000 7f68bfc12640 1 -- 172.21.15.47:0/871785610 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b81a56d0 con 0x7f68b8102790 2024-07-24T22:09:28.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.102+0000 7f68c1fc3740 1 Processor -- start 2024-07-24T22:09:28.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.102+0000 7f68c1fc3740 1 -- start start 2024-07-24T22:09:28.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.102+0000 7f68c1fc3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fad4f20 0x55cf8fad5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.102+0000 7f68c1fc3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8fae56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.102+0000 7f68c1fc3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fae5be0 0x55cf8fae7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.102+0000 7f68c1fc3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cf8fa4c9f0 con 0x55cf8fae5be0 2024-07-24T22:09:28.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.102+0000 7f68c1fc3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cf8fa3bef0 con 0x55cf8fad5840 2024-07-24T22:09:28.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.102+0000 7f68c1fc3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55cf8fa3ff30 con 0x55cf8fad4f20 2024-07-24T22:09:28.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.102+0000 7f68aeffd640 1 -- 172.21.15.47:0/871785610 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f68b4004dd0 con 0x7f68b8102790 2024-07-24T22:09:28.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.103+0000 7f68be1af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fad4f20 0x55cf8fad5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.103+0000 7f68be1af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fad4f20 0x55cf8fad5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:40544/0 (socket says 172.21.15.47:40544) 2024-07-24T22:09:28.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.103+0000 7f68be1af640 1 -- 172.21.15.47:0/3171333718 learned_addr learned my addr 172.21.15.47:0/3171333718 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:28.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.103+0000 7f68bd9ae640 1 --2- 172.21.15.47:0/3171333718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8fae56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.103+0000 7f68bd1ad640 1 --2- 172.21.15.47:0/3171333718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fae5be0 0x55cf8fae7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.104+0000 7f68bd1ad640 1 -- 172.21.15.47:0/3171333718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fad4f20 msgr2=0x55cf8fad5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:28.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.104+0000 7f68bd1ad640 1 --2- 172.21.15.47:0/3171333718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fad4f20 0x55cf8fad5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.104+0000 7f68bd1ad640 1 -- 172.21.15.47:0/3171333718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 msgr2=0x55cf8fae56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:28.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.104+0000 7f68bd1ad640 1 --2- 172.21.15.47:0/3171333718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8fae56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.104+0000 7f68bd1ad640 1 -- 172.21.15.47:0/3171333718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf8f79c930 con 0x55cf8fae5be0 2024-07-24T22:09:28.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.104+0000 7f68be1af640 1 --2- 172.21.15.47:0/3171333718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fad4f20 0x55cf8fad5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:28.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.104+0000 7f68aeffd640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f68a40b3e40 0x7f68a40b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.104+0000 7f68bd1ad640 1 --2- 172.21.15.47:0/3171333718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fae5be0 0x55cf8fae7fd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009c30 tx=0x7f68a80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed9c3c89a264aa7 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.105+0000 7f68aeffd640 1 -- 172.21.15.47:0/871785610 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f68b40e3700 con 0x7f68b8102790 2024-07-24T22:09:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.105+0000 7f68a3fff640 1 -- 172.21.15.47:0/3171333718 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a801c480 con 0x55cf8fae5be0 2024-07-24T22:09:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.105+0000 7f68a3fff640 1 -- 172.21.15.47:0/3171333718 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68a801cad0 con 0x55cf8fae5be0 2024-07-24T22:09:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.105+0000 7f68a3fff640 1 -- 172.21.15.47:0/3171333718 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8011ab0 con 0x55cf8fae5be0 2024-07-24T22:09:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.105+0000 7f68be1af640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f68a40b3e40 0x7f68a40b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.106+0000 7f68c1fc3740 1 -- 172.21.15.47:0/3171333718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fae5be0 msgr2=0x55cf8fae7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:28.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.106+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/3171333718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fae5be0 0x55cf8fae7fd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009c30 tx=0x7f68a80107a0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.106+0000 7f68be1af640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f68a40b3e40 0x7f68a40b6300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f68b0005f00 tx=0x7f68b0005bf0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:28.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.106+0000 7f68c1fc3740 1 -- 172.21.15.47:0/3171333718 shutdown_connections 2024-07-24T22:09:28.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.106+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/3171333718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fae5be0 0x55cf8fae7fd0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.106+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/3171333718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8fae56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.106+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/3171333718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fad4f20 0x55cf8fad5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.106+0000 7f68c1fc3740 1 -- 172.21.15.47:0/3171333718 >> 172.21.15.47:0/3171333718 conn(0x55cf8fad2d50 msgr2=0x55cf8fad3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:28.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.106+0000 7f68c1fc3740 1 -- 172.21.15.47:0/3171333718 shutdown_connections 2024-07-24T22:09:28.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.106+0000 7f68c1fc3740 1 -- 172.21.15.47:0/3171333718 wait complete. 2024-07-24T22:09:28.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.107+0000 7f68c1fc3740 1 -- start start 2024-07-24T22:09:28.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.107+0000 7f68c1fc3740 1 Processor -- start 2024-07-24T22:09:28.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.107+0000 7f68c1fc3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8fae2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.107+0000 7f68c1fc3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8fae3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68c1fc3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8fae3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68c1fc3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cf8f89f890 con 0x55cf8fad4f20 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68c1fc3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cf8f9de390 con 0x55cf8fad5840 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68c1fc3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55cf8fae88e0 con 0x55cf8fae5be0 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68c1fc3740 10 client.0 _ll_register_callbacks cb 0x55cf8f9e8500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68bd9ae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8fae2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68bd9ae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8fae2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55902/0 (socket says 172.21.15.47:55902) 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68bd9ae640 1 -- 172.21.15.47:0/2574592678 learned_addr learned my addr 172.21.15.47:0/2574592678 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68be1af640 1 --2- 172.21.15.47:0/2574592678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8fae3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68bd1ad640 1 --2- 172.21.15.47:0/2574592678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8fae3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68bd9ae640 1 -- 172.21.15.47:0/2574592678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 msgr2=0x55cf8fae3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68bd9ae640 1 --2- 172.21.15.47:0/2574592678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8fae3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68bd9ae640 1 -- 172.21.15.47:0/2574592678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 msgr2=0x55cf8fae3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68bd9ae640 1 --2- 172.21.15.47:0/2574592678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8fae3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.108+0000 7f68bd9ae640 1 -- 172.21.15.47:0/2574592678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf8f9d8d60 con 0x55cf8fad4f20 2024-07-24T22:09:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.109+0000 7f68a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:09:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.109+0000 7f68bd9ae640 1 --2- 172.21.15.47:0/2574592678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8fae2b10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009610 tx=0x7f68b40e12f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700ab30edcba2a82 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.109+0000 7f68a17fa640 1 -- 172.21.15.47:0/2574592678 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b40a9ab0 con 0x55cf8fad4f20 2024-07-24T22:09:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.109+0000 7f68c1fc3740 1 -- 172.21.15.47:0/2574592678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68a801cad0 con 0x55cf8fad4f20 2024-07-24T22:09:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.110+0000 7f68a17fa640 1 -- 172.21.15.47:0/2574592678 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f68b40a6930 con 0x55cf8fad4f20 2024-07-24T22:09:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.110+0000 7f68a17fa640 1 -- 172.21.15.47:0/2574592678 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f68b40a9ab0 con 0x55cf8fad4f20 2024-07-24T22:09:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.110+0000 7f68c1fc3740 10 client.16035 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.110+0000 7f68c1fc3740 1 -- 172.21.15.47:0/2574592678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cf8faf47e0 con 0x55cf8fad4f20 2024-07-24T22:09:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.111+0000 7f68a17fa640 1 -- 172.21.15.47:0/2574592678 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68a801cad0 con 0x55cf8fad4f20 2024-07-24T22:09:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.111+0000 7f68a17fa640 1 -- 172.21.15.47:0/2574592678 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f68b40050c0 con 0x55cf8fad4f20 2024-07-24T22:09:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.111+0000 7f68c1fc3740 10 client.16035 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.112+0000 7f68c1fc3740 10 client.16035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.112+0000 7f68c1fc3740 20 client.16035 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.112+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/2574592678 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cf8faf5c40 0x55cf8faf8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.112+0000 7f68c1fc3740 4 client.16035 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:09:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.112+0000 7f68c1fc3740 1 -- 172.21.15.47:0/2574592678 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf8fa4e940 con 0x55cf8faf5c40 2024-07-24T22:09:28.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:27 smithi183 ceph-mon[37007]: pgmap v433: 97 pgs: 97 active+clean; 18 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 663 MiB/s wr, 1.40k op/s 2024-07-24T22:09:28.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.214+0000 7f68bd1ad640 1 --2- 172.21.15.47:0/2574592678 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cf8faf5c40 0x55cf8faf8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.424+0000 7f68bd1ad640 1 --2- 172.21.15.47:0/2574592678 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cf8faf5c40 0x55cf8faf8030 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c85f874ccddc9fa2 server_cookie=63c090eb5fd3d37e in_seq=0 out_seq=0 2024-07-24T22:09:28.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.424+0000 7f68a17fa640 10 client.16035 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:28.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.427+0000 7f68a17fa640 1 -- 172.21.15.47:0/2574592678 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf8fa4e940 con 0x55cf8faf5c40 2024-07-24T22:09:28.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.427+0000 7f68a17fa640 10 client.16035 handle_command_reply: tid=0 2024-07-24T22:09:28.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.427+0000 7f68c1fc3740 1 client.16035 shutdown 2024-07-24T22:09:28.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.427+0000 7f68c1fc3740 1 -- 172.21.15.47:0/2574592678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 msgr2=0x55cf8fae2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:28.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.427+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/2574592678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8fae2b10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009610 tx=0x7f68b40e12f0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.428+0000 7f68c1fc3740 1 -- 172.21.15.47:0/2574592678 shutdown_connections 2024-07-24T22:09:28.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.428+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/2574592678 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cf8faf5c40 0x55cf8faf8030 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.428+0000 7f68a17fa640 0 client.16035 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:28.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.428+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/2574592678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8fae3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.428+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/2574592678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8fae3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.428+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/2574592678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8fae2b10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.428+0000 7f68c1fc3740 1 -- 172.21.15.47:0/2574592678 >> 172.21.15.47:0/2574592678 conn(0x55cf8fad2d50 msgr2=0x55cf8fad88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:28.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.428+0000 7f68c1fc3740 1 -- 172.21.15.47:0/2574592678 shutdown_connections 2024-07-24T22:09:28.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.429+0000 7f68c1fc3740 1 -- 172.21.15.47:0/2574592678 wait complete. 2024-07-24T22:09:28.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.429+0000 7f68c1fc3740 20 client.16035 trim_cache size 0 max 16384 2024-07-24T22:09:28.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.483+0000 7f68c1fc3740 1 Processor -- start 2024-07-24T22:09:28.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.487+0000 7f68c1fc3740 1 -- start start 2024-07-24T22:09:28.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.488+0000 7f68c1fc3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8fae0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.489+0000 7f68c1fc3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8faf1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.489+0000 7f68c1fc3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8faf1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.489+0000 7f68c1fc3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81aa190 con 0x55cf8fad4f20 2024-07-24T22:09:28.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.489+0000 7f68c1fc3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81aca70 con 0x55cf8fad5840 2024-07-24T22:09:28.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.489+0000 7f68c1fc3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81aa860 con 0x55cf8fae5be0 2024-07-24T22:09:28.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.492+0000 7f68be1af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8faf1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.492+0000 7f68be1af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8faf1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:40548/0 (socket says 172.21.15.47:40548) 2024-07-24T22:09:28.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.492+0000 7f68be1af640 1 -- 172.21.15.47:0/3012251537 learned_addr learned my addr 172.21.15.47:0/3012251537 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:28.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.493+0000 7f68bd1ad640 1 --2- 172.21.15.47:0/3012251537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8faf1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.493+0000 7f68bd9ae640 1 --2- 172.21.15.47:0/3012251537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8fae0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.493+0000 7f68be1af640 1 -- 172.21.15.47:0/3012251537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 msgr2=0x55cf8faf1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:28.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.493+0000 7f68be1af640 1 --2- 172.21.15.47:0/3012251537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8faf1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.493+0000 7f68be1af640 1 -- 172.21.15.47:0/3012251537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 msgr2=0x55cf8fae0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:28.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.493+0000 7f68be1af640 1 --2- 172.21.15.47:0/3012251537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8fae0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.493+0000 7f68be1af640 1 -- 172.21.15.47:0/3012251537 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf8fad5670 con 0x55cf8fae5be0 2024-07-24T22:09:28.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.496+0000 7f68be1af640 1 --2- 172.21.15.47:0/3012251537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8faf1640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f68b0005cc0 tx=0x7f68b003f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56eddce4d8ccec5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:28.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.497+0000 7f68a37fe640 1 -- 172.21.15.47:0/3012251537 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b0036040 con 0x55cf8fae5be0 2024-07-24T22:09:28.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.498+0000 7f68a37fe640 1 -- 172.21.15.47:0/3012251537 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68b0030c30 con 0x55cf8fae5be0 2024-07-24T22:09:28.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.498+0000 7f68a37fe640 1 -- 172.21.15.47:0/3012251537 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b0031680 con 0x55cf8fae5be0 2024-07-24T22:09:28.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.500+0000 7f68c1fc3740 1 -- 172.21.15.47:0/3012251537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 msgr2=0x55cf8faf1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:28.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.500+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/3012251537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8faf1640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f68b0005cc0 tx=0x7f68b003f000 comp rx=0 tx=0).stop 2024-07-24T22:09:28.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.500+0000 7f68c1fc3740 1 -- 172.21.15.47:0/3012251537 shutdown_connections 2024-07-24T22:09:28.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.500+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/3012251537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8faf1640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.501+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/3012251537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8faf1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.501+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/3012251537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8fae0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.501+0000 7f68c1fc3740 1 -- 172.21.15.47:0/3012251537 >> 172.21.15.47:0/3012251537 conn(0x55cf8fad2d50 msgr2=0x55cf8faf09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:28.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.504+0000 7f68c1fc3740 1 -- 172.21.15.47:0/3012251537 shutdown_connections 2024-07-24T22:09:28.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.504+0000 7f68c1fc3740 1 -- 172.21.15.47:0/3012251537 wait complete. 2024-07-24T22:09:28.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.505+0000 7f68c1fc3740 1 -- start start 2024-07-24T22:09:28.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.506+0000 7f68c1fc3740 1 Processor -- start 2024-07-24T22:09:28.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.507+0000 7f68c1fc3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8faedb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.507+0000 7f68c1fc3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8faee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.507+0000 7f68c1fc3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8faeab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.507+0000 7f68c1fc3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81aaf30 con 0x55cf8fad4f20 2024-07-24T22:09:28.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.507+0000 7f68c1fc3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81ac3a0 con 0x55cf8fad5840 2024-07-24T22:09:28.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.507+0000 7f68c1fc3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81ab600 con 0x55cf8fae5be0 2024-07-24T22:09:28.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.507+0000 7f68c1fc3740 10 client.0 _ll_register_callbacks cb 0x7f68b400de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:28.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.508+0000 7f68bd9ae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8faedb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.508+0000 7f68bd9ae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8faedb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55922/0 (socket says 172.21.15.47:55922) 2024-07-24T22:09:28.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.508+0000 7f68bd9ae640 1 -- 172.21.15.47:0/1794674660 learned_addr learned my addr 172.21.15.47:0/1794674660 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:28.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.509+0000 7f68bd1ad640 1 --2- 172.21.15.47:0/1794674660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8faee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.509+0000 7f68be1af640 1 --2- 172.21.15.47:0/1794674660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8faeab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.509+0000 7f68bd1ad640 1 -- 172.21.15.47:0/1794674660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 msgr2=0x55cf8faeab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:28.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.509+0000 7f68bd1ad640 1 --2- 172.21.15.47:0/1794674660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8faeab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.509+0000 7f68bd1ad640 1 -- 172.21.15.47:0/1794674660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 msgr2=0x55cf8faedb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:28.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.509+0000 7f68bd1ad640 1 --2- 172.21.15.47:0/1794674660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8faedb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.509+0000 7f68bd1ad640 1 -- 172.21.15.47:0/1794674660 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf8faeb080 con 0x55cf8fad5840 2024-07-24T22:09:28.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.510+0000 7f68bd1ad640 1 --2- 172.21.15.47:0/1794674660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8faee0b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f68a8000c00 tx=0x7f68a8009860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9651bf12486a1895 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:28.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.513+0000 7f68a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:09:28.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.513+0000 7f68a17fa640 1 -- 172.21.15.47:0/1794674660 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8005040 con 0x55cf8fad5840 2024-07-24T22:09:28.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.513+0000 7f68c1fc3740 1 -- 172.21.15.47:0/1794674660 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68b0030c30 con 0x55cf8fad5840 2024-07-24T22:09:28.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.513+0000 7f68a17fa640 1 -- 172.21.15.47:0/1794674660 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f68a80051e0 con 0x55cf8fad5840 2024-07-24T22:09:28.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.516+0000 7f68a17fa640 1 -- 172.21.15.47:0/1794674660 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f68a80053e0 con 0x55cf8fad5840 2024-07-24T22:09:28.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.516+0000 7f68c1fc3740 10 client.25499 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:28.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.516+0000 7f68c1fc3740 1 -- 172.21.15.47:0/1794674660 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cf8fadb3c0 con 0x55cf8fad5840 2024-07-24T22:09:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.518+0000 7f68a17fa640 1 -- 172.21.15.47:0/1794674660 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68a8005580 con 0x55cf8fad5840 2024-07-24T22:09:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.518+0000 7f68a17fa640 1 -- 172.21.15.47:0/1794674660 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f68a8003830 con 0x55cf8fad5840 2024-07-24T22:09:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.519+0000 7f68c1fc3740 10 client.25499 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.519+0000 7f68c1fc3740 10 client.25499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.519+0000 7f68c1fc3740 20 client.25499 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.519+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/1794674660 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cf8faf5c40 0x55cf8fadd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.519+0000 7f68c1fc3740 4 client.25499 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:09:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.519+0000 7f68c1fc3740 1 -- 172.21.15.47:0/1794674660 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f68b0030c30 con 0x55cf8faf5c40 2024-07-24T22:09:28.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.520+0000 7f68bd9ae640 1 --2- 172.21.15.47:0/1794674660 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cf8faf5c40 0x55cf8fadd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:28.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.523+0000 7f68a17fa640 10 client.25499 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:28.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.523+0000 7f68bd9ae640 1 --2- 172.21.15.47:0/1794674660 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cf8faf5c40 0x55cf8fadd7d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6a0750bc6496fee server_cookie=64c07c041f1b94bf in_seq=0 out_seq=0 2024-07-24T22:09:28.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.527+0000 7f68a17fa640 1 -- 172.21.15.47:0/1794674660 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f68b0030c30 con 0x55cf8faf5c40 2024-07-24T22:09:28.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.527+0000 7f68a17fa640 10 client.25499 handle_command_reply: tid=0 2024-07-24T22:09:28.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.528+0000 7f68c1fc3740 1 client.25499 shutdown 2024-07-24T22:09:28.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.529+0000 7f68c1fc3740 1 -- 172.21.15.47:0/1794674660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 msgr2=0x55cf8faee0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:28.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.529+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/1794674660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8faee0b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f68a8000c00 tx=0x7f68a8009860 comp rx=0 tx=0).stop 2024-07-24T22:09:28.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.529+0000 7f68c1fc3740 1 -- 172.21.15.47:0/1794674660 shutdown_connections 2024-07-24T22:09:28.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.529+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/1794674660 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cf8faf5c40 0x55cf8fadd7d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.529+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/1794674660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cf8fae5be0 0x55cf8faeab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.529+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/1794674660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf8fad5840 0x55cf8faee0b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.529+0000 7f68c1fc3740 1 --2- 172.21.15.47:0/1794674660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf8fad4f20 0x55cf8faedb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.529+0000 7f68c1fc3740 1 -- 172.21.15.47:0/1794674660 >> 172.21.15.47:0/1794674660 conn(0x55cf8fad2d50 msgr2=0x55cf8faf1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:28.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.529+0000 7f68a17fa640 0 client.25499 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:28.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.529+0000 7f68c1fc3740 1 -- 172.21.15.47:0/1794674660 shutdown_connections 2024-07-24T22:09:28.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.529+0000 7f68c1fc3740 1 -- 172.21.15.47:0/1794674660 wait complete. 2024-07-24T22:09:28.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.529+0000 7f68c1fc3740 20 client.25499 trim_cache size 0 max 16384 2024-07-24T22:09:28.534 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:09:28.534 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:09:28.534 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "3d915aee-9220-4732-a050-5dfdf1b39481", 2024-07-24T22:09:28.534 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:09:28.534 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:09:28.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.533+0000 7f68bfc12640 1 -- 172.21.15.47:0/871785610 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f68a40b3e40 msgr2=0x7f68a40b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:28.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.533+0000 7f68bfc12640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f68a40b3e40 0x7f68a40b6300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f68b0005f00 tx=0x7f68b0005bf0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.533+0000 7f68bfc12640 1 -- 172.21.15.47:0/871785610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68b8102790 msgr2=0x7f68b8198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:28.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.533+0000 7f68bfc12640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68b8102790 0x7f68b8198c70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f68b400d770 tx=0x7f68b400dc30 comp rx=0 tx=0).stop 2024-07-24T22:09:28.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.533+0000 7f68bfc12640 1 -- 172.21.15.47:0/871785610 shutdown_connections 2024-07-24T22:09:28.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.533+0000 7f68bfc12640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f68a40b3e40 0x7f68a40b6300 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.533+0000 7f68bfc12640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68b8108b20 0x7f68b819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.533+0000 7f68bfc12640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b81081a0 0x7f68b81991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.533+0000 7f68bfc12640 1 --2- 172.21.15.47:0/871785610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68b8102790 0x7f68b8198c70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:28.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.533+0000 7f68bfc12640 1 -- 172.21.15.47:0/871785610 >> 172.21.15.47:0/871785610 conn(0x7f68b80fe200 msgr2=0x7f68b80fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:28.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.534+0000 7f68bfc12640 1 -- 172.21.15.47:0/871785610 shutdown_connections 2024-07-24T22:09:28.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:28.534+0000 7f68bfc12640 1 -- 172.21.15.47:0/871785610 wait complete. 2024-07-24T22:09:29.704 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:09:29.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:29 smithi047 ceph-mon[32551]: pgmap v434: 97 pgs: 97 active+clean; 19 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 737 MiB/s wr, 1.19k op/s 2024-07-24T22:09:29.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:29 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:09:29.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:29 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:09:29.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:29 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:09:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:29 smithi188 ceph-mon[37380]: pgmap v434: 97 pgs: 97 active+clean; 19 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 737 MiB/s wr, 1.19k op/s 2024-07-24T22:09:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:29 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:09:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:29 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:09:30.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:29 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:09:30.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:29 smithi183 ceph-mon[37007]: pgmap v434: 97 pgs: 97 active+clean; 19 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 737 MiB/s wr, 1.19k op/s 2024-07-24T22:09:30.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:29 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:09:30.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:29 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:09:30.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:29 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:09:30.164 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:09:31.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:31 smithi047 ceph-mon[32551]: pgmap v435: 97 pgs: 97 active+clean; 20 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 659 MiB/s wr, 725 op/s 2024-07-24T22:09:31.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:31 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:09:32.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:31 smithi183 ceph-mon[37007]: pgmap v435: 97 pgs: 97 active+clean; 20 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 659 MiB/s wr, 725 op/s 2024-07-24T22:09:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:31 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:09:32.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:31 smithi188 ceph-mon[37380]: pgmap v435: 97 pgs: 97 active+clean; 20 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 659 MiB/s wr, 725 op/s 2024-07-24T22:09:32.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:31 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:09:32.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.654+0000 7f352b59e640 1 -- 172.21.15.47:0/2294155747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f352c107ff0 msgr2=0x7f352c108430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:32.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.654+0000 7f352b59e640 1 --2- 172.21.15.47:0/2294155747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f352c107ff0 0x7f352c108430 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f351c009ca0 tx=0x7f351c02a8e0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.655+0000 7f352b59e640 1 -- 172.21.15.47:0/2294155747 shutdown_connections 2024-07-24T22:09:32.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.655+0000 7f352b59e640 1 --2- 172.21.15.47:0/2294155747 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f352c108970 0x7f352c10f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.655+0000 7f352b59e640 1 --2- 172.21.15.47:0/2294155747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f352c107ff0 0x7f352c108430 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.655+0000 7f352b59e640 1 --2- 172.21.15.47:0/2294155747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f352c1025e0 0x7f352c1029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.655+0000 7f352b59e640 1 -- 172.21.15.47:0/2294155747 >> 172.21.15.47:0/2294155747 conn(0x7f352c0fe010 msgr2=0x7f352c100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:32.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.657+0000 7f352b59e640 1 -- 172.21.15.47:0/2294155747 shutdown_connections 2024-07-24T22:09:32.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.658+0000 7f352b59e640 1 -- 172.21.15.47:0/2294155747 wait complete. 2024-07-24T22:09:32.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.660+0000 7f352b59e640 1 Processor -- start 2024-07-24T22:09:32.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.662+0000 7f352b59e640 1 -- start start 2024-07-24T22:09:32.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.663+0000 7f352b59e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f352c1025e0 0x7f352c071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.663+0000 7f352b59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f352c107ff0 0x7f352c072310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.663+0000 7f352b59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f352c108970 0x7f352c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.663+0000 7f352b59e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f352c110410 con 0x7f352c107ff0 2024-07-24T22:09:32.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.663+0000 7f352b59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f352c110290 con 0x7f352c108970 2024-07-24T22:09:32.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.663+0000 7f352b59e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f352c110590 con 0x7f352c1025e0 2024-07-24T22:09:32.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.664+0000 7f352ad9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f352c108970 0x7f352c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.664+0000 7f3529d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f352c107ff0 0x7f352c072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.664+0000 7f3529d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f352c107ff0 0x7f352c072310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55940/0 (socket says 172.21.15.47:55940) 2024-07-24T22:09:32.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.664+0000 7f3529d9b640 1 -- 172.21.15.47:0/2288924634 learned_addr learned my addr 172.21.15.47:0/2288924634 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:32.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.665+0000 7f3529d9b640 1 -- 172.21.15.47:0/2288924634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f352c1025e0 msgr2=0x7f352c071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:32.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.665+0000 7f352a59c640 1 --2- 172.21.15.47:0/2288924634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f352c1025e0 0x7f352c071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.665+0000 7f3529d9b640 1 --2- 172.21.15.47:0/2288924634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f352c1025e0 0x7f352c071db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.665+0000 7f3529d9b640 1 -- 172.21.15.47:0/2288924634 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f352c108970 msgr2=0x7f352c06d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:32.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.665+0000 7f3529d9b640 1 --2- 172.21.15.47:0/2288924634 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f352c108970 0x7f352c06d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.666+0000 7f3529d9b640 1 -- 172.21.15.47:0/2288924634 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352c06d9f0 con 0x7f352c107ff0 2024-07-24T22:09:32.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.667+0000 7f3529d9b640 1 --2- 172.21.15.47:0/2288924634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f352c107ff0 0x7f352c072310 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f351c006010 tx=0x7f351c030bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:32.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.668+0000 7f35237fe640 1 -- 172.21.15.47:0/2288924634 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c03b810 con 0x7f352c107ff0 2024-07-24T22:09:32.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.669+0000 7f352b59e640 1 -- 172.21.15.47:0/2288924634 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f352c06dc80 con 0x7f352c107ff0 2024-07-24T22:09:32.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.669+0000 7f352b59e640 1 -- 172.21.15.47:0/2288924634 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f352c072de0 con 0x7f352c107ff0 2024-07-24T22:09:32.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.671+0000 7f35237fe640 1 -- 172.21.15.47:0/2288924634 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f351c030e80 con 0x7f352c107ff0 2024-07-24T22:09:32.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.672+0000 7f35237fe640 1 -- 172.21.15.47:0/2288924634 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c03b810 con 0x7f352c107ff0 2024-07-24T22:09:32.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.676+0000 7f35332de740 1 Processor -- start 2024-07-24T22:09:32.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.676+0000 7f35332de740 1 -- start start 2024-07-24T22:09:32.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.677+0000 7f35332de740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1c870 0x55d394d1cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.677+0000 7f35332de740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1d190 0x55d394d28be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.677+0000 7f35332de740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d29120 0x55d394d2b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.677+0000 7f35332de740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d394c93960 con 0x55d394d1d190 2024-07-24T22:09:32.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.677+0000 7f35332de740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d394c82e60 con 0x55d394d29120 2024-07-24T22:09:32.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.677+0000 7f35332de740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d394c86ea0 con 0x55d394d1c870 2024-07-24T22:09:32.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.678+0000 7f352a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1d190 0x55d394d28be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.679+0000 7f352a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1d190 0x55d394d28be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55942/0 (socket says 172.21.15.47:55942) 2024-07-24T22:09:32.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.679+0000 7f352a59c640 1 -- 172.21.15.47:0/3474981831 learned_addr learned my addr 172.21.15.47:0/3474981831 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:32.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.680+0000 7f352ad9d640 1 --2- 172.21.15.47:0/3474981831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1c870 0x55d394d1cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.680+0000 7f352a59c640 1 -- 172.21.15.47:0/3474981831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1c870 msgr2=0x55d394d1cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:32.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.680+0000 7f352a59c640 1 --2- 172.21.15.47:0/3474981831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1c870 0x55d394d1cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.680+0000 7f352a59c640 1 -- 172.21.15.47:0/3474981831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d29120 msgr2=0x55d394d2b510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-24T22:09:32.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.680+0000 7f352a59c640 1 --2- 172.21.15.47:0/3474981831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d29120 0x55d394d2b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.680+0000 7f35237fe640 1 -- 172.21.15.47:0/2288924634 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f351c043030 con 0x7f352c107ff0 2024-07-24T22:09:32.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.680+0000 7f352a59c640 1 -- 172.21.15.47:0/3474981831 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d394c0c2d0 con 0x55d394d1d190 2024-07-24T22:09:32.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.681+0000 7f352ad9d640 1 --2- 172.21.15.47:0/3474981831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1c870 0x55d394d1cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:09:32.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.682+0000 7f35237fe640 1 --2- 172.21.15.47:0/2288924634 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f35180b42c0 0x7f35180b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.683+0000 7f35237fe640 1 -- 172.21.15.47:0/2288924634 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f351c03b610 con 0x7f352c107ff0 2024-07-24T22:09:32.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.683+0000 7f352ad9d640 1 --2- 172.21.15.47:0/2288924634 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f35180b42c0 0x7f35180b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.683+0000 7f352a59c640 1 --2- 172.21.15.47:0/3474981831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1d190 0x55d394d28be0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f351400baa0 tx=0x7f351400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286c31f08cd52dc8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:32.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.684+0000 7f3520ff9640 1 -- 172.21.15.47:0/3474981831 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3514017420 con 0x55d394d1d190 2024-07-24T22:09:32.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.684+0000 7f3520ff9640 1 -- 172.21.15.47:0/3474981831 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3514017a70 con 0x55d394d1d190 2024-07-24T22:09:32.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.686+0000 7f35332de740 1 -- 172.21.15.47:0/3474981831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1d190 msgr2=0x55d394d28be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:32.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.686+0000 7f3520ff9640 1 -- 172.21.15.47:0/3474981831 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3514017420 con 0x55d394d1d190 2024-07-24T22:09:32.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.686+0000 7f35332de740 1 --2- 172.21.15.47:0/3474981831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1d190 0x55d394d28be0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f351400baa0 tx=0x7f351400bf60 comp rx=0 tx=0).stop 2024-07-24T22:09:32.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.687+0000 7f35332de740 1 -- 172.21.15.47:0/3474981831 shutdown_connections 2024-07-24T22:09:32.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.687+0000 7f35332de740 1 --2- 172.21.15.47:0/3474981831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d29120 0x55d394d2b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.687+0000 7f35332de740 1 --2- 172.21.15.47:0/3474981831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1d190 0x55d394d28be0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.687+0000 7f35332de740 1 --2- 172.21.15.47:0/3474981831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1c870 0x55d394d1cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.687+0000 7f35332de740 1 -- 172.21.15.47:0/3474981831 >> 172.21.15.47:0/3474981831 conn(0x55d394d1a6a0 msgr2=0x55d394d1b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:32.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.687+0000 7f352ad9d640 1 --2- 172.21.15.47:0/2288924634 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f35180b42c0 0x7f35180b6780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3524009c10 tx=0x7f35240092a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:32.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.688+0000 7f35332de740 1 -- 172.21.15.47:0/3474981831 shutdown_connections 2024-07-24T22:09:32.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.688+0000 7f35332de740 1 -- 172.21.15.47:0/3474981831 wait complete. 2024-07-24T22:09:32.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.689+0000 7f35332de740 1 -- start start 2024-07-24T22:09:32.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.689+0000 7f35332de740 1 Processor -- start 2024-07-24T22:09:32.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.690+0000 7f35332de740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d1c870 0x55d394d28b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.690+0000 7f35332de740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1d190 0x55d394d25fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.690+0000 7f35332de740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d29120 0x55d394d26760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.690+0000 7f35332de740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d394ae6700 con 0x55d394d29120 2024-07-24T22:09:32.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.690+0000 7f35332de740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d394c255a0 con 0x55d394d1c870 2024-07-24T22:09:32.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.690+0000 7f35332de740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d394d2bdf0 con 0x55d394d1d190 2024-07-24T22:09:32.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.690+0000 7f35332de740 10 client.0 _ll_register_callbacks cb 0x55d394c45910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:32.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.691+0000 7f352ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d29120 0x55d394d26760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.691+0000 7f352ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d29120 0x55d394d26760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55958/0 (socket says 172.21.15.47:55958) 2024-07-24T22:09:32.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.691+0000 7f352ad9d640 1 -- 172.21.15.47:0/641908394 learned_addr learned my addr 172.21.15.47:0/641908394 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:32.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.692+0000 7f352ad9d640 1 -- 172.21.15.47:0/641908394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1d190 msgr2=0x55d394d25fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:09:32.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.692+0000 7f352ad9d640 1 --2- 172.21.15.47:0/641908394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1d190 0x55d394d25fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.692+0000 7f352a59c640 1 --2- 172.21.15.47:0/641908394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d1c870 0x55d394d28b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.692+0000 7f352ad9d640 1 -- 172.21.15.47:0/641908394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d1c870 msgr2=0x55d394d28b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:32.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.692+0000 7f352ad9d640 1 --2- 172.21.15.47:0/641908394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d1c870 0x55d394d28b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.692+0000 7f352ad9d640 1 -- 172.21.15.47:0/641908394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d394c18630 con 0x55d394d29120 2024-07-24T22:09:32.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.693+0000 7f352ad9d640 1 --2- 172.21.15.47:0/641908394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d29120 0x55d394d26760 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3524009f90 tx=0x7f3524004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93075a7343c043 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:32.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.693+0000 7f3511ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:09:32.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.694+0000 7f3511ffb640 1 -- 172.21.15.47:0/641908394 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524022070 con 0x55d394d29120 2024-07-24T22:09:32.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.694+0000 7f35332de740 1 -- 172.21.15.47:0/641908394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3514017a70 con 0x55d394d29120 2024-07-24T22:09:32.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.694+0000 7f3511ffb640 1 -- 172.21.15.47:0/641908394 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f352401e860 con 0x55d394d29120 2024-07-24T22:09:32.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.694+0000 7f3511ffb640 1 -- 172.21.15.47:0/641908394 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f352402e050 con 0x55d394d29120 2024-07-24T22:09:32.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.694+0000 7f35332de740 10 client.16053 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:32.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.694+0000 7f35332de740 1 -- 172.21.15.47:0/641908394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d3949e3650 con 0x55d394d29120 2024-07-24T22:09:32.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.695+0000 7f3511ffb640 1 -- 172.21.15.47:0/641908394 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3514017a70 con 0x55d394d29120 2024-07-24T22:09:32.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.696+0000 7f3511ffb640 1 -- 172.21.15.47:0/641908394 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3524010b90 con 0x55d394d29120 2024-07-24T22:09:32.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.697+0000 7f35332de740 10 client.16053 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:32.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.697+0000 7f35332de740 10 client.16053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:32.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.697+0000 7f35332de740 20 client.16053 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:32.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.697+0000 7f35332de740 1 --2- 172.21.15.47:0/641908394 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d394d38f40 0x55d394d3b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.697+0000 7f35332de740 4 client.16053 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:09:32.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.697+0000 7f35332de740 1 -- 172.21.15.47:0/641908394 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d394c958b0 con 0x55d394d38f40 2024-07-24T22:09:32.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.698+0000 7f352a59c640 1 --2- 172.21.15.47:0/641908394 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d394d38f40 0x55d394d3b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.705+0000 7f352a59c640 1 --2- 172.21.15.47:0/641908394 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d394d38f40 0x55d394d3b330 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7723e693cf9747b server_cookie=5f43efc3cd5602f9 in_seq=0 out_seq=0 2024-07-24T22:09:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.705+0000 7f3511ffb640 10 client.16053 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.708+0000 7f3511ffb640 1 -- 172.21.15.47:0/641908394 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d394c958b0 con 0x55d394d38f40 2024-07-24T22:09:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.708+0000 7f3511ffb640 10 client.16053 handle_command_reply: tid=0 2024-07-24T22:09:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.708+0000 7f35332de740 1 client.16053 shutdown 2024-07-24T22:09:32.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.711+0000 7f35332de740 1 -- 172.21.15.47:0/641908394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d29120 msgr2=0x55d394d26760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:32.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.711+0000 7f35332de740 1 --2- 172.21.15.47:0/641908394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d29120 0x55d394d26760 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3524009f90 tx=0x7f3524004730 comp rx=0 tx=0).stop 2024-07-24T22:09:32.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.711+0000 7f35332de740 1 -- 172.21.15.47:0/641908394 shutdown_connections 2024-07-24T22:09:32.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.711+0000 7f35332de740 1 --2- 172.21.15.47:0/641908394 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d394d38f40 0x55d394d3b330 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.711+0000 7f35332de740 1 --2- 172.21.15.47:0/641908394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d29120 0x55d394d26760 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.711+0000 7f35332de740 1 --2- 172.21.15.47:0/641908394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1d190 0x55d394d25fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.711+0000 7f35332de740 1 --2- 172.21.15.47:0/641908394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d1c870 0x55d394d28b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.711+0000 7f35332de740 1 -- 172.21.15.47:0/641908394 >> 172.21.15.47:0/641908394 conn(0x55d394d1a6a0 msgr2=0x55d394d20240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:32.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.711+0000 7f3511ffb640 0 client.16053 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:32.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.712+0000 7f35332de740 1 -- 172.21.15.47:0/641908394 shutdown_connections 2024-07-24T22:09:32.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.712+0000 7f35332de740 1 -- 172.21.15.47:0/641908394 wait complete. 2024-07-24T22:09:32.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.712+0000 7f35332de740 20 client.16053 trim_cache size 0 max 16384 2024-07-24T22:09:32.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.770+0000 7f35332de740 1 Processor -- start 2024-07-24T22:09:32.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.770+0000 7f35332de740 1 -- start start 2024-07-24T22:09:32.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.772+0000 7f35332de740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1c870 0x55d394d209c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.773+0000 7f35332de740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d1d190 0x55d394d15580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.774+0000 7f35332de740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d29120 0x55d394d40a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.776+0000 7f35332de740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f350c00c840 con 0x55d394d29120 2024-07-24T22:09:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.777+0000 7f352a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1c870 0x55d394d209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.777+0000 7f352a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1c870 0x55d394d209c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:40602/0 (socket says 172.21.15.47:40602) 2024-07-24T22:09:32.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.777+0000 7f352a59c640 1 -- 172.21.15.47:0/766341759 learned_addr learned my addr 172.21.15.47:0/766341759 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:32.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.778+0000 7f35332de740 1 -- 172.21.15.47:0/766341759 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f350c00f0c0 con 0x55d394d1d190 2024-07-24T22:09:32.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.778+0000 7f35332de740 1 -- 172.21.15.47:0/766341759 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f350c00ceb0 con 0x55d394d1c870 2024-07-24T22:09:32.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.778+0000 7f352ad9d640 1 --2- 172.21.15.47:0/766341759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d29120 0x55d394d40a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.778+0000 7f3529d9b640 1 --2- 172.21.15.47:0/766341759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d1d190 0x55d394d15580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.779+0000 7f352ad9d640 1 -- 172.21.15.47:0/766341759 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1c870 msgr2=0x55d394d209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:32.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.779+0000 7f352ad9d640 1 --2- 172.21.15.47:0/766341759 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1c870 0x55d394d209c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.779+0000 7f352ad9d640 1 -- 172.21.15.47:0/766341759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d1d190 msgr2=0x55d394d15580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:32.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.779+0000 7f352ad9d640 1 --2- 172.21.15.47:0/766341759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d1d190 0x55d394d15580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.779+0000 7f352ad9d640 1 -- 172.21.15.47:0/766341759 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d394d1b0a0 con 0x55d394d29120 2024-07-24T22:09:32.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.781+0000 7f352ad9d640 1 --2- 172.21.15.47:0/766341759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d29120 0x55d394d40a20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3524026520 tx=0x7f3524009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba742e7bd961b04a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:32.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.786+0000 7f3513fff640 1 -- 172.21.15.47:0/766341759 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524036020 con 0x55d394d29120 2024-07-24T22:09:32.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.787+0000 7f3513fff640 1 -- 172.21.15.47:0/766341759 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35240047a0 con 0x55d394d29120 2024-07-24T22:09:32.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.787+0000 7f3513fff640 1 -- 172.21.15.47:0/766341759 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524022070 con 0x55d394d29120 2024-07-24T22:09:32.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.788+0000 7f35332de740 1 -- 172.21.15.47:0/766341759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d29120 msgr2=0x55d394d40a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:32.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.788+0000 7f35332de740 1 --2- 172.21.15.47:0/766341759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d29120 0x55d394d40a20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3524026520 tx=0x7f3524009ca0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.789+0000 7f35332de740 1 -- 172.21.15.47:0/766341759 shutdown_connections 2024-07-24T22:09:32.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.789+0000 7f35332de740 1 --2- 172.21.15.47:0/766341759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d29120 0x55d394d40a20 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.789+0000 7f35332de740 1 --2- 172.21.15.47:0/766341759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d1d190 0x55d394d15580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.789+0000 7f35332de740 1 --2- 172.21.15.47:0/766341759 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1c870 0x55d394d209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.789+0000 7f35332de740 1 -- 172.21.15.47:0/766341759 >> 172.21.15.47:0/766341759 conn(0x55d394d1a6a0 msgr2=0x55d394d24850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:32.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.789+0000 7f35332de740 1 -- 172.21.15.47:0/766341759 shutdown_connections 2024-07-24T22:09:32.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.790+0000 7f35332de740 1 -- 172.21.15.47:0/766341759 wait complete. 2024-07-24T22:09:32.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.790+0000 7f35332de740 1 -- start start 2024-07-24T22:09:32.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.791+0000 7f35332de740 1 Processor -- start 2024-07-24T22:09:32.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.791+0000 7f35332de740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1c870 0x55d394d315c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.792+0000 7f35332de740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1d190 0x55d394d2ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.792+0000 7f35332de740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d29120 0x55d394d2cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.792+0000 7f35332de740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f350c00d580 con 0x55d394d1c870 2024-07-24T22:09:32.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.792+0000 7f35332de740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f350c00e9f0 con 0x55d394d29120 2024-07-24T22:09:32.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.792+0000 7f35332de740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f350c00dc50 con 0x55d394d1d190 2024-07-24T22:09:32.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.792+0000 7f35332de740 10 client.0 _ll_register_callbacks cb 0x7f3524015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:32.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.792+0000 7f352a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1c870 0x55d394d315c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.793+0000 7f352a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1c870 0x55d394d315c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55962/0 (socket says 172.21.15.47:55962) 2024-07-24T22:09:32.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.793+0000 7f352a59c640 1 -- 172.21.15.47:0/449882496 learned_addr learned my addr 172.21.15.47:0/449882496 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:32.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.793+0000 7f352a59c640 1 -- 172.21.15.47:0/449882496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1d190 msgr2=0x55d394d2ca90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:09:32.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.793+0000 7f352a59c640 1 --2- 172.21.15.47:0/449882496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1d190 0x55d394d2ca90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.793+0000 7f352a59c640 1 -- 172.21.15.47:0/449882496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d29120 msgr2=0x55d394d2cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:32.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.793+0000 7f352a59c640 1 --2- 172.21.15.47:0/449882496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d29120 0x55d394d2cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.793+0000 7f352a59c640 1 -- 172.21.15.47:0/449882496 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d394d2d5c0 con 0x55d394d1c870 2024-07-24T22:09:32.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.794+0000 7f352a59c640 1 --2- 172.21.15.47:0/449882496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1c870 0x55d394d315c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f351400c010 tx=0x7f351400f620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509a34cbb598be99 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:32.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.798+0000 7f3511ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:09:32.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.798+0000 7f3511ffb640 1 -- 172.21.15.47:0/449882496 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3514005040 con 0x55d394d1c870 2024-07-24T22:09:32.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.798+0000 7f3511ffb640 1 -- 172.21.15.47:0/449882496 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f35140051e0 con 0x55d394d1c870 2024-07-24T22:09:32.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.800+0000 7f35332de740 1 -- 172.21.15.47:0/449882496 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35240047a0 con 0x55d394d1c870 2024-07-24T22:09:32.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.805+0000 7f3511ffb640 1 -- 172.21.15.47:0/449882496 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f35140053e0 con 0x55d394d1c870 2024-07-24T22:09:32.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.805+0000 7f35332de740 10 client.16059 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.805+0000 7f35332de740 1 -- 172.21.15.47:0/449882496 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d394da3820 con 0x55d394d1c870 2024-07-24T22:09:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.806+0000 7f3511ffb640 1 -- 172.21.15.47:0/449882496 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35240047a0 con 0x55d394d1c870 2024-07-24T22:09:32.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.809+0000 7f3511ffb640 1 -- 172.21.15.47:0/449882496 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3514004a40 con 0x55d394d1c870 2024-07-24T22:09:32.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.810+0000 7f35332de740 10 client.16059 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:32.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.810+0000 7f35332de740 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:32.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.810+0000 7f35332de740 20 client.16059 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:32.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.810+0000 7f35332de740 1 --2- 172.21.15.47:0/449882496 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d394da3e60 0x55d394da62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:32.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.810+0000 7f35332de740 4 client.16059 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:09:32.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.810+0000 7f35332de740 1 -- 172.21.15.47:0/449882496 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d394c91350 con 0x55d394da3e60 2024-07-24T22:09:32.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.814+0000 7f3529d9b640 1 --2- 172.21.15.47:0/449882496 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d394da3e60 0x55d394da62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:32.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.820+0000 7f3529d9b640 1 --2- 172.21.15.47:0/449882496 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d394da3e60 0x55d394da62a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8c4739ccff641a2 server_cookie=d434ee69ed5092cd in_seq=0 out_seq=0 2024-07-24T22:09:32.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.820+0000 7f3511ffb640 10 client.16059 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:32.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.822+0000 7f3511ffb640 1 -- 172.21.15.47:0/449882496 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d394c91350 con 0x55d394da3e60 2024-07-24T22:09:32.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.823+0000 7f3511ffb640 10 client.16059 handle_command_reply: tid=0 2024-07-24T22:09:32.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.823+0000 7f35332de740 1 client.16059 shutdown 2024-07-24T22:09:32.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.823+0000 7f35332de740 1 -- 172.21.15.47:0/449882496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1c870 msgr2=0x55d394d315c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:32.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.823+0000 7f35332de740 1 --2- 172.21.15.47:0/449882496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1c870 0x55d394d315c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f351400c010 tx=0x7f351400f620 comp rx=0 tx=0).stop 2024-07-24T22:09:32.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.828+0000 7f35332de740 1 -- 172.21.15.47:0/449882496 shutdown_connections 2024-07-24T22:09:32.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.828+0000 7f35332de740 1 --2- 172.21.15.47:0/449882496 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d394da3e60 0x55d394da62a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.828+0000 7f35332de740 1 --2- 172.21.15.47:0/449882496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d394d29120 0x55d394d2cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.828+0000 7f35332de740 1 --2- 172.21.15.47:0/449882496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d394d1d190 0x55d394d2ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.828+0000 7f35332de740 1 --2- 172.21.15.47:0/449882496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d394d1c870 0x55d394d315c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.828+0000 7f35332de740 1 -- 172.21.15.47:0/449882496 >> 172.21.15.47:0/449882496 conn(0x55d394d1a6a0 msgr2=0x55d394d19680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:32.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.828+0000 7f3511ffb640 0 client.16059 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:32.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.829+0000 7f35332de740 1 -- 172.21.15.47:0/449882496 shutdown_connections 2024-07-24T22:09:32.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.832+0000 7f35332de740 1 -- 172.21.15.47:0/449882496 wait complete. 2024-07-24T22:09:32.843 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:09:32.844 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-07-24T22:09:32.844 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-07-24T22:09:32.844 INFO:teuthology.orchestra.run.smithi047.stdout: "3d915aee-9220-4732-a050-5dfdf1b39481": { 2024-07-24T22:09:32.844 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-07-24T22:09:32.844 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "3d915aee-9220-4732-a050-5dfdf1b39481", 2024-07-24T22:09:32.844 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-07-24T22:09:32.844 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:09:32.844 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:09:32.844 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:09:32.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.835+0000 7f35332de740 20 client.16059 trim_cache size 0 max 16384 2024-07-24T22:09:32.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.836+0000 7f352b59e640 1 -- 172.21.15.47:0/2288924634 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f35180b42c0 msgr2=0x7f35180b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.836+0000 7f352b59e640 1 --2- 172.21.15.47:0/2288924634 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f35180b42c0 0x7f35180b6780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3524009c10 tx=0x7f35240092a0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.837+0000 7f352b59e640 1 -- 172.21.15.47:0/2288924634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f352c107ff0 msgr2=0x7f352c072310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.837+0000 7f352b59e640 1 --2- 172.21.15.47:0/2288924634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f352c107ff0 0x7f352c072310 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f351c006010 tx=0x7f351c030bd0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.837+0000 7f352b59e640 1 -- 172.21.15.47:0/2288924634 shutdown_connections 2024-07-24T22:09:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.837+0000 7f352b59e640 1 --2- 172.21.15.47:0/2288924634 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f35180b42c0 0x7f35180b6780 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.837+0000 7f352b59e640 1 --2- 172.21.15.47:0/2288924634 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f352c108970 0x7f352c06d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.837+0000 7f352b59e640 1 --2- 172.21.15.47:0/2288924634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f352c107ff0 0x7f352c072310 secure :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f351c006010 tx=0x7f351c030bd0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.837+0000 7f352b59e640 1 --2- 172.21.15.47:0/2288924634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f352c1025e0 0x7f352c071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:32.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.837+0000 7f352b59e640 1 -- 172.21.15.47:0/2288924634 >> 172.21.15.47:0/2288924634 conn(0x7f352c0fe010 msgr2=0x7f352c1066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:32.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.838+0000 7f352b59e640 1 -- 172.21.15.47:0/2288924634 shutdown_connections 2024-07-24T22:09:32.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:09:32.840+0000 7f352b59e640 1 -- 172.21.15.47:0/2288924634 wait complete. 2024-07-24T22:09:33.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:32 smithi183 ceph-mon[37007]: pgmap v436: 97 pgs: 97 active+clean; 20 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 637 MiB/s wr, 890 op/s 2024-07-24T22:09:33.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:32 smithi047 ceph-mon[32551]: pgmap v436: 97 pgs: 97 active+clean; 20 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 637 MiB/s wr, 890 op/s 2024-07-24T22:09:33.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:32 smithi188 ceph-mon[37380]: pgmap v436: 97 pgs: 97 active+clean; 20 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 637 MiB/s wr, 890 op/s 2024-07-24T22:09:33.697 INFO:tasks.cephfs.filesystem:scrub status for tag:3d915aee-9220-4732-a050-5dfdf1b39481 - {'path': '/', 'tag': '3d915aee-9220-4732-a050-5dfdf1b39481', 'options': 'recursive,force'} 2024-07-24T22:09:35.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:35 smithi183 ceph-mon[37007]: pgmap v437: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 651 MiB/s wr, 1.03k op/s 2024-07-24T22:09:35.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:35 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:09:35.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:35 smithi047 ceph-mon[32551]: pgmap v437: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 651 MiB/s wr, 1.03k op/s 2024-07-24T22:09:35.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:35 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:09:35.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:35 smithi188 ceph-mon[37380]: pgmap v437: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 651 MiB/s wr, 1.03k op/s 2024-07-24T22:09:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:35 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:09:37.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:37 smithi183 ceph-mon[37007]: pgmap v438: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 593 MiB/s wr, 941 op/s 2024-07-24T22:09:37.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:37 smithi047 ceph-mon[32551]: pgmap v438: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 593 MiB/s wr, 941 op/s 2024-07-24T22:09:37.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:37 smithi188 ceph-mon[37380]: pgmap v438: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 593 MiB/s wr, 941 op/s 2024-07-24T22:09:39.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:39 smithi183 ceph-mon[37007]: pgmap v439: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 667 MiB/s wr, 913 op/s 2024-07-24T22:09:39.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:39 smithi047 ceph-mon[32551]: pgmap v439: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 667 MiB/s wr, 913 op/s 2024-07-24T22:09:39.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:39 smithi188 ceph-mon[37380]: pgmap v439: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 667 MiB/s wr, 913 op/s 2024-07-24T22:09:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.453+0000 7f433ec8b640 1 -- 172.21.15.47:0/1871528298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4338103ec0 msgr2=0x7f433810c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.453+0000 7f433ec8b640 1 --2- 172.21.15.47:0/1871528298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4338103ec0 0x7f433810c3a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4320009900 tx=0x7f432002a410 comp rx=0 tx=0).stop 2024-07-24T22:09:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.454+0000 7f433ec8b640 1 -- 172.21.15.47:0/1871528298 shutdown_connections 2024-07-24T22:09:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.454+0000 7f433ec8b640 1 --2- 172.21.15.47:0/1871528298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f433810c9f0 0x7f433810ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.454+0000 7f433ec8b640 1 --2- 172.21.15.47:0/1871528298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4338103ec0 0x7f433810c3a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.454+0000 7f433ec8b640 1 --2- 172.21.15.47:0/1871528298 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43381035a0 0x7f4338103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.454+0000 7f433ec8b640 1 -- 172.21.15.47:0/1871528298 >> 172.21.15.47:0/1871528298 conn(0x7f43380fd010 msgr2=0x7f43380ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.454+0000 7f433ec8b640 1 -- 172.21.15.47:0/1871528298 shutdown_connections 2024-07-24T22:09:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.454+0000 7f433ec8b640 1 -- 172.21.15.47:0/1871528298 wait complete. 2024-07-24T22:09:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.454+0000 7f433ec8b640 1 Processor -- start 2024-07-24T22:09:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.454+0000 7f433ec8b640 1 -- start start 2024-07-24T22:09:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.454+0000 7f433ec8b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43381035a0 0x7f4338198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ec8b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4338103ec0 0x7f4338199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ec8b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f433810c9f0 0x7f433819e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ec8b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43381126c0 con 0x7f4338103ec0 2024-07-24T22:09:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ec8b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4338112540 con 0x7f43381035a0 2024-07-24T22:09:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ec8b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4338112840 con 0x7f433810c9f0 2024-07-24T22:09:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f4337fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4338103ec0 0x7f4338199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ca27640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43381035a0 0x7f4338198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ca27640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43381035a0 0x7f4338198c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:39114/0 (socket says 172.21.15.47:39114) 2024-07-24T22:09:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ca27640 1 -- 172.21.15.47:0/2209626782 learned_addr learned my addr 172.21.15.47:0/2209626782 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f4337fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4338103ec0 0x7f4338199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53902/0 (socket says 172.21.15.47:53902) 2024-07-24T22:09:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433d228640 1 --2- 172.21.15.47:0/2209626782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f433810c9f0 0x7f433819e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ca27640 1 -- 172.21.15.47:0/2209626782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f433810c9f0 msgr2=0x7f433819e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ca27640 1 --2- 172.21.15.47:0/2209626782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f433810c9f0 0x7f433819e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ca27640 1 -- 172.21.15.47:0/2209626782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4338103ec0 msgr2=0x7f4338199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ca27640 1 --2- 172.21.15.47:0/2209626782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4338103ec0 0x7f4338199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ca27640 1 -- 172.21.15.47:0/2209626782 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433819ecc0 con 0x7f43381035a0 2024-07-24T22:09:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.455+0000 7f433ca27640 1 --2- 172.21.15.47:0/2209626782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43381035a0 0x7f4338198c20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f432800eb90 tx=0x7f432800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.456+0000 7f4335ffb640 1 -- 172.21.15.47:0/2209626782 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4328004d20 con 0x7f43381035a0 2024-07-24T22:09:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.456+0000 7f4335ffb640 1 -- 172.21.15.47:0/2209626782 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f432800ee90 con 0x7f43381035a0 2024-07-24T22:09:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.456+0000 7f4335ffb640 1 -- 172.21.15.47:0/2209626782 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4328010670 con 0x7f43381035a0 2024-07-24T22:09:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.456+0000 7f433ec8b640 1 -- 172.21.15.47:0/2209626782 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f433819efb0 con 0x7f43381035a0 2024-07-24T22:09:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.456+0000 7f433ec8b640 1 -- 172.21.15.47:0/2209626782 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43381a5670 con 0x7f43381035a0 2024-07-24T22:09:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.458+0000 7f4335ffb640 1 -- 172.21.15.47:0/2209626782 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f4328005020 con 0x7f43381035a0 2024-07-24T22:09:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.459+0000 7f43419e2740 1 Processor -- start 2024-07-24T22:09:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.459+0000 7f43419e2740 1 -- start start 2024-07-24T22:09:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.459+0000 7f43419e2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a68eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.459+0000 7f43419e2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a69ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.459+0000 7f43419e2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a69d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.459+0000 7f43419e2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a32a604280 con 0x55a32a69b170 2024-07-24T22:09:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.459+0000 7f43419e2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a32a5f3780 con 0x55a32a68f1e0 2024-07-24T22:09:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.459+0000 7f43419e2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a32a5f77c0 con 0x55a32a68e8c0 2024-07-24T22:09:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.459+0000 7f433d228640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a68eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.459+0000 7f433d228640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a68eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51734/0 (socket says 172.21.15.47:51734) 2024-07-24T22:09:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.459+0000 7f433d228640 1 -- 172.21.15.47:0/880909539 learned_addr learned my addr 172.21.15.47:0/880909539 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.459+0000 7f4337fff640 1 --2- 172.21.15.47:0/880909539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a69d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.460+0000 7f433ca27640 1 --2- 172.21.15.47:0/880909539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a69ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.460+0000 7f4335ffb640 1 --2- 172.21.15.47:0/2209626782 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f43240b3dc0 0x7f43240b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.460+0000 7f433d228640 1 -- 172.21.15.47:0/880909539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 msgr2=0x55a32a69ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.460+0000 7f433d228640 1 --2- 172.21.15.47:0/880909539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a69ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.460+0000 7f433d228640 1 -- 172.21.15.47:0/880909539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 msgr2=0x55a32a69d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.460+0000 7f433d228640 1 --2- 172.21.15.47:0/880909539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a69d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.460+0000 7f433d228640 1 -- 172.21.15.47:0/880909539 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a32a357790 con 0x55a32a68e8c0 2024-07-24T22:09:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.460+0000 7f4335ffb640 1 -- 172.21.15.47:0/2209626782 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f43280e4610 con 0x7f43381035a0 2024-07-24T22:09:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.460+0000 7f433d228640 1 --2- 172.21.15.47:0/2209626782 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f43240b3dc0 0x7f43240b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.460+0000 7f433d228640 1 --2- 172.21.15.47:0/880909539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a68eca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4330009ca0 tx=0x7f4330011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e69bd493e6d6ed77 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.460+0000 7f432effd640 1 -- 172.21.15.47:0/880909539 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433001b870 con 0x55a32a68e8c0 2024-07-24T22:09:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.460+0000 7f432effd640 1 -- 172.21.15.47:0/880909539 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4330019d80 con 0x55a32a68e8c0 2024-07-24T22:09:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.460+0000 7f432effd640 1 -- 172.21.15.47:0/880909539 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433000eb50 con 0x55a32a68e8c0 2024-07-24T22:09:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.461+0000 7f43419e2740 1 -- 172.21.15.47:0/880909539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 msgr2=0x55a32a68eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.461+0000 7f433d228640 1 --2- 172.21.15.47:0/2209626782 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f43240b3dc0 0x7f43240b6280 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4330020000 tx=0x7f4330021000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.461+0000 7f43419e2740 1 --2- 172.21.15.47:0/880909539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a68eca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4330009ca0 tx=0x7f4330011810 comp rx=0 tx=0).stop 2024-07-24T22:09:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.461+0000 7f43419e2740 1 -- 172.21.15.47:0/880909539 shutdown_connections 2024-07-24T22:09:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.461+0000 7f43419e2740 1 --2- 172.21.15.47:0/880909539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a69d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.461+0000 7f43419e2740 1 --2- 172.21.15.47:0/880909539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a69ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.461+0000 7f43419e2740 1 --2- 172.21.15.47:0/880909539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a68eca0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.461+0000 7f43419e2740 1 -- 172.21.15.47:0/880909539 >> 172.21.15.47:0/880909539 conn(0x55a32a68c6f0 msgr2=0x55a32a68d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.461+0000 7f43419e2740 1 -- 172.21.15.47:0/880909539 shutdown_connections 2024-07-24T22:09:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.461+0000 7f43419e2740 1 -- 172.21.15.47:0/880909539 wait complete. 2024-07-24T22:09:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.461+0000 7f43419e2740 1 -- start start 2024-07-24T22:09:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.462+0000 7f43419e2740 1 Processor -- start 2024-07-24T22:09:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.462+0000 7f43419e2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68e8c0 0x55a32a69a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.462+0000 7f43419e2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68f1e0 0x55a32a697d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.462+0000 7f43419e2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a698290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.462+0000 7f43419e2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a32a52dab0 con 0x55a32a69b170 2024-07-24T22:09:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.462+0000 7f43419e2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a32a57b9e0 con 0x55a32a68e8c0 2024-07-24T22:09:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.462+0000 7f43419e2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a32a69de50 con 0x55a32a68f1e0 2024-07-24T22:09:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.462+0000 7f43419e2740 10 client.0 _ll_register_callbacks cb 0x55a32a303a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.462+0000 7f433d228640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a698290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.462+0000 7f4337fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68f1e0 0x55a32a697d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.462+0000 7f4337fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68f1e0 0x55a32a697d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51736/0 (socket says 172.21.15.47:51736) 2024-07-24T22:09:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.462+0000 7f433d228640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a698290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53916/0 (socket says 172.21.15.47:53916) 2024-07-24T22:09:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.462+0000 7f4337fff640 1 -- 172.21.15.47:0/612393335 learned_addr learned my addr 172.21.15.47:0/612393335 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.463+0000 7f433ca27640 1 --2- 172.21.15.47:0/612393335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68e8c0 0x55a32a69a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.463+0000 7f4337fff640 1 -- 172.21.15.47:0/612393335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68e8c0 msgr2=0x55a32a69a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.463+0000 7f4337fff640 1 --2- 172.21.15.47:0/612393335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68e8c0 0x55a32a69a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.463+0000 7f4337fff640 1 -- 172.21.15.47:0/612393335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 msgr2=0x55a32a698290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.463+0000 7f4337fff640 1 --2- 172.21.15.47:0/612393335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a698290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.463+0000 7f4337fff640 1 -- 172.21.15.47:0/612393335 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a32a3d0620 con 0x55a32a68f1e0 2024-07-24T22:09:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.463+0000 7f4337fff640 1 --2- 172.21.15.47:0/612393335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68f1e0 0x55a32a697d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4320009900 tx=0x7f43200043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1258e8c9ccd2fcdd server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.463+0000 7f4317fff640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:09:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.464+0000 7f4317fff640 1 -- 172.21.15.47:0/612393335 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4320035040 con 0x55a32a68f1e0 2024-07-24T22:09:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.464+0000 7f4317fff640 1 -- 172.21.15.47:0/612393335 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f4320005450 con 0x55a32a68f1e0 2024-07-24T22:09:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.464+0000 7f43419e2740 1 -- 172.21.15.47:0/612393335 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a32a5a2ce0 con 0x55a32a68f1e0 2024-07-24T22:09:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.464+0000 7f4317fff640 1 -- 172.21.15.47:0/612393335 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4320005650 con 0x55a32a68f1e0 2024-07-24T22:09:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.464+0000 7f43419e2740 10 client.25564 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.464+0000 7f43419e2740 1 -- 172.21.15.47:0/612393335 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a32a6a95f0 con 0x55a32a68f1e0 2024-07-24T22:09:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.465+0000 7f4317fff640 1 -- 172.21.15.47:0/612393335 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a32a5a2ce0 con 0x55a32a68f1e0 2024-07-24T22:09:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.465+0000 7f4317fff640 1 -- 172.21.15.47:0/612393335 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4320003a70 con 0x55a32a68f1e0 2024-07-24T22:09:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.465+0000 7f43419e2740 10 client.25564 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.465+0000 7f43419e2740 10 client.25564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.465+0000 7f43419e2740 20 client.25564 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.465+0000 7f43419e2740 1 --2- 172.21.15.47:0/612393335 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a32a6aaab0 0x55a32a6acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.465+0000 7f43419e2740 4 client.25564 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:09:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.465+0000 7f43419e2740 1 -- 172.21.15.47:0/612393335 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a32a6061d0 con 0x55a32a6aaab0 2024-07-24T22:09:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.466+0000 7f433ca27640 1 --2- 172.21.15.47:0/612393335 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a32a6aaab0 0x55a32a6acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.466+0000 7f433ca27640 1 --2- 172.21.15.47:0/612393335 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a32a6aaab0 0x55a32a6acea0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=525680fb1103149c server_cookie=a2c1e522444f55f7 in_seq=0 out_seq=0 2024-07-24T22:09:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.466+0000 7f4317fff640 10 client.25564 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.467+0000 7f4317fff640 1 -- 172.21.15.47:0/612393335 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a32a6061d0 con 0x55a32a6aaab0 2024-07-24T22:09:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.467+0000 7f4317fff640 10 client.25564 handle_command_reply: tid=0 2024-07-24T22:09:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.467+0000 7f43419e2740 1 client.25564 shutdown 2024-07-24T22:09:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.468+0000 7f43419e2740 1 -- 172.21.15.47:0/612393335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68f1e0 msgr2=0x55a32a697d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.468+0000 7f43419e2740 1 --2- 172.21.15.47:0/612393335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68f1e0 0x55a32a697d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4320009900 tx=0x7f43200043b0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.468+0000 7f43419e2740 1 -- 172.21.15.47:0/612393335 shutdown_connections 2024-07-24T22:09:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.468+0000 7f43419e2740 1 --2- 172.21.15.47:0/612393335 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a32a6aaab0 0x55a32a6acea0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.468+0000 7f43419e2740 1 --2- 172.21.15.47:0/612393335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a698290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.468+0000 7f43419e2740 1 --2- 172.21.15.47:0/612393335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68f1e0 0x55a32a697d50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.468+0000 7f43419e2740 1 --2- 172.21.15.47:0/612393335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68e8c0 0x55a32a69a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.468+0000 7f4317fff640 0 client.25564 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.468+0000 7f43419e2740 1 -- 172.21.15.47:0/612393335 >> 172.21.15.47:0/612393335 conn(0x55a32a68c6f0 msgr2=0x55a32a692290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.468+0000 7f43419e2740 1 -- 172.21.15.47:0/612393335 shutdown_connections 2024-07-24T22:09:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.468+0000 7f43419e2740 1 -- 172.21.15.47:0/612393335 wait complete. 2024-07-24T22:09:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.468+0000 7f43419e2740 20 client.25564 trim_cache size 0 max 16384 2024-07-24T22:09:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.487+0000 7f43419e2740 1 Processor -- start 2024-07-24T22:09:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.487+0000 7f43419e2740 1 -- start start 2024-07-24T22:09:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f43419e2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a68de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f43419e2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a6b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f43419e2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a6b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f43419e2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43381ac070 con 0x55a32a69b170 2024-07-24T22:09:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f43419e2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f43381ae8f0 con 0x55a32a68f1e0 2024-07-24T22:09:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f43419e2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f43381ac6e0 con 0x55a32a68e8c0 2024-07-24T22:09:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f433d228640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a6b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f433d228640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a6b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53926/0 (socket says 172.21.15.47:53926) 2024-07-24T22:09:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f433d228640 1 -- 172.21.15.47:0/3584437941 learned_addr learned my addr 172.21.15.47:0/3584437941 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f433ca27640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a68de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f4337fff640 1 --2- 172.21.15.47:0/3584437941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a6b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f433d228640 1 -- 172.21.15.47:0/3584437941 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 msgr2=0x55a32a68de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f433d228640 1 --2- 172.21.15.47:0/3584437941 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a68de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f433d228640 1 -- 172.21.15.47:0/3584437941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 msgr2=0x55a32a6b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f433d228640 1 --2- 172.21.15.47:0/3584437941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a6b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f433d228640 1 -- 172.21.15.47:0/3584437941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a32a6ad210 con 0x55a32a69b170 2024-07-24T22:09:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f433ca27640 1 --2- 172.21.15.47:0/3584437941 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a68de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f4337fff640 1 --2- 172.21.15.47:0/3584437941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a6b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.488+0000 7f433d228640 1 --2- 172.21.15.47:0/3584437941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a6b2cb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4330011d10 tx=0x7f4330027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22c267b1876d481 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.489+0000 7f432e7fc640 1 -- 172.21.15.47:0/3584437941 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433000ee50 con 0x55a32a69b170 2024-07-24T22:09:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.489+0000 7f432e7fc640 1 -- 172.21.15.47:0/3584437941 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4330004040 con 0x55a32a69b170 2024-07-24T22:09:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.489+0000 7f432e7fc640 1 -- 172.21.15.47:0/3584437941 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4330019b80 con 0x55a32a69b170 2024-07-24T22:09:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.489+0000 7f43419e2740 1 -- 172.21.15.47:0/3584437941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 msgr2=0x55a32a6b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.489+0000 7f43419e2740 1 --2- 172.21.15.47:0/3584437941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a6b2cb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4330011d10 tx=0x7f4330027000 comp rx=0 tx=0).stop 2024-07-24T22:09:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.490+0000 7f43419e2740 1 -- 172.21.15.47:0/3584437941 shutdown_connections 2024-07-24T22:09:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.490+0000 7f43419e2740 1 --2- 172.21.15.47:0/3584437941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a6b2cb0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.490+0000 7f43419e2740 1 --2- 172.21.15.47:0/3584437941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a6b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.490+0000 7f43419e2740 1 --2- 172.21.15.47:0/3584437941 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a68de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.490+0000 7f43419e2740 1 -- 172.21.15.47:0/3584437941 >> 172.21.15.47:0/3584437941 conn(0x55a32a68c6f0 msgr2=0x55a32a68d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.490+0000 7f43419e2740 1 -- 172.21.15.47:0/3584437941 shutdown_connections 2024-07-24T22:09:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.490+0000 7f43419e2740 1 -- 172.21.15.47:0/3584437941 wait complete. 2024-07-24T22:09:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.490+0000 7f43419e2740 1 -- start start 2024-07-24T22:09:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.490+0000 7f43419e2740 1 Processor -- start 2024-07-24T22:09:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f43419e2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a6a34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f43419e2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a6a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f43419e2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a69ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f43419e2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43381acdb0 con 0x55a32a69b170 2024-07-24T22:09:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f43419e2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f43381ae220 con 0x55a32a68f1e0 2024-07-24T22:09:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f43419e2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f43381ad480 con 0x55a32a68e8c0 2024-07-24T22:09:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f43419e2740 10 client.0 _ll_register_callbacks cb 0x7f43280093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f433ca27640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a6a34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f433d228640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a69ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f4337fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a6a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f433ca27640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a6a34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51746/0 (socket says 172.21.15.47:51746) 2024-07-24T22:09:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f433ca27640 1 -- 172.21.15.47:0/65692679 learned_addr learned my addr 172.21.15.47:0/65692679 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f4337fff640 1 -- 172.21.15.47:0/65692679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 msgr2=0x55a32a6a34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f4337fff640 1 --2- 172.21.15.47:0/65692679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a6a34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f4337fff640 1 -- 172.21.15.47:0/65692679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 msgr2=0x55a32a69ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f4337fff640 1 --2- 172.21.15.47:0/65692679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a69ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f4337fff640 1 -- 172.21.15.47:0/65692679 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a32a69f3f0 con 0x55a32a68f1e0 2024-07-24T22:09:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f433d228640 1 --2- 172.21.15.47:0/65692679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a69ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.491+0000 7f433ca27640 1 --2- 172.21.15.47:0/65692679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a6a34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.492+0000 7f4337fff640 1 --2- 172.21.15.47:0/65692679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a6a3a50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4320003e70 tx=0x7f43200055c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb03272cac1e9e5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.492+0000 7f4317fff640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:09:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.492+0000 7f4317fff640 1 -- 172.21.15.47:0/65692679 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4320035070 con 0x55a32a68f1e0 2024-07-24T22:09:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.492+0000 7f4317fff640 1 -- 172.21.15.47:0/65692679 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f4320031b70 con 0x55a32a68f1e0 2024-07-24T22:09:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.492+0000 7f43419e2740 1 -- 172.21.15.47:0/65692679 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4330004040 con 0x55a32a68f1e0 2024-07-24T22:09:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.492+0000 7f4317fff640 1 -- 172.21.15.47:0/65692679 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4320000e60 con 0x55a32a68f1e0 2024-07-24T22:09:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.492+0000 7f43419e2740 10 client.25520 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.492+0000 7f43419e2740 1 -- 172.21.15.47:0/65692679 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a32a7154a0 con 0x55a32a68f1e0 2024-07-24T22:09:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.492+0000 7f4317fff640 1 -- 172.21.15.47:0/65692679 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4330004040 con 0x55a32a68f1e0 2024-07-24T22:09:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.492+0000 7f4317fff640 1 -- 172.21.15.47:0/65692679 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f43200046c0 con 0x55a32a68f1e0 2024-07-24T22:09:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.493+0000 7f43419e2740 10 client.25520 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.493+0000 7f43419e2740 10 client.25520 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.493+0000 7f43419e2740 20 client.25520 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.493+0000 7f43419e2740 1 --2- 172.21.15.47:0/65692679 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a32a715c20 0x55a32a718040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.493+0000 7f43419e2740 4 client.25520 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:09:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.493+0000 7f43419e2740 1 -- 172.21.15.47:0/65692679 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a32a601c70 con 0x55a32a715c20 2024-07-24T22:09:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.493+0000 7f433ca27640 1 --2- 172.21.15.47:0/65692679 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a32a715c20 0x55a32a718040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.493+0000 7f4317fff640 10 client.25520 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:40.493+0000 7f433ca27640 1 --2- 172.21.15.47:0/65692679 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a32a715c20 0x55a32a718040 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2447498ef7777cf server_cookie=c575be0b544beb36 in_seq=0 out_seq=0 2024-07-24T22:09:41.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:41 smithi047 ceph-mon[32551]: pgmap v440: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 590 MiB/s wr, 794 op/s 2024-07-24T22:09:41.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:41 smithi188 ceph-mon[37380]: pgmap v440: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 590 MiB/s wr, 794 op/s 2024-07-24T22:09:41.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:41 smithi183 ceph-mon[37007]: pgmap v440: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 590 MiB/s wr, 794 op/s 2024-07-24T22:09:42.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.663+0000 7f4317fff640 1 -- 172.21.15.47:0/65692679 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a32a601c70 con 0x55a32a715c20 2024-07-24T22:09:42.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.663+0000 7f4317fff640 10 client.25520 handle_command_reply: tid=0 2024-07-24T22:09:42.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.663+0000 7f43419e2740 1 client.25520 shutdown 2024-07-24T22:09:42.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.664+0000 7f43419e2740 1 -- 172.21.15.47:0/65692679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 msgr2=0x55a32a6a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:42.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.664+0000 7f43419e2740 1 --2- 172.21.15.47:0/65692679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a6a3a50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4320003e70 tx=0x7f43200055c0 comp rx=0 tx=0).stop 2024-07-24T22:09:42.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.664+0000 7f43419e2740 1 -- 172.21.15.47:0/65692679 shutdown_connections 2024-07-24T22:09:42.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.664+0000 7f43419e2740 1 --2- 172.21.15.47:0/65692679 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a32a715c20 0x55a32a718040 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:42.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.664+0000 7f43419e2740 1 --2- 172.21.15.47:0/65692679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a32a69b170 0x55a32a69ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.664+0000 7f43419e2740 1 --2- 172.21.15.47:0/65692679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a32a68f1e0 0x55a32a6a3a50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.664+0000 7f43419e2740 1 --2- 172.21.15.47:0/65692679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a32a68e8c0 0x55a32a6a34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.664+0000 7f43419e2740 1 -- 172.21.15.47:0/65692679 >> 172.21.15.47:0/65692679 conn(0x55a32a68c6f0 msgr2=0x55a32a68af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.664+0000 7f4317fff640 0 client.25520 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.665+0000 7f43419e2740 1 -- 172.21.15.47:0/65692679 shutdown_connections 2024-07-24T22:09:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.665+0000 7f43419e2740 1 -- 172.21.15.47:0/65692679 wait complete. 2024-07-24T22:09:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.665+0000 7f43419e2740 20 client.25520 trim_cache size 0 max 16384 2024-07-24T22:09:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:09:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:09:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:09:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:09:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.667+0000 7f433ec8b640 1 -- 172.21.15.47:0/2209626782 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f43240b3dc0 msgr2=0x7f43240b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.667+0000 7f433ec8b640 1 --2- 172.21.15.47:0/2209626782 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f43240b3dc0 0x7f43240b6280 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4330020000 tx=0x7f4330021000 comp rx=0 tx=0).stop 2024-07-24T22:09:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.667+0000 7f433ec8b640 1 -- 172.21.15.47:0/2209626782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43381035a0 msgr2=0x7f4338198c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.667+0000 7f433ec8b640 1 --2- 172.21.15.47:0/2209626782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43381035a0 0x7f4338198c20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f432800eb90 tx=0x7f432800c6a0 comp rx=0 tx=0).stop 2024-07-24T22:09:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.668+0000 7f433ec8b640 1 -- 172.21.15.47:0/2209626782 shutdown_connections 2024-07-24T22:09:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.668+0000 7f433ec8b640 1 --2- 172.21.15.47:0/2209626782 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f43240b3dc0 0x7f43240b6280 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.668+0000 7f433ec8b640 1 --2- 172.21.15.47:0/2209626782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f433810c9f0 0x7f433819e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.668+0000 7f433ec8b640 1 --2- 172.21.15.47:0/2209626782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4338103ec0 0x7f4338199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.668+0000 7f433ec8b640 1 --2- 172.21.15.47:0/2209626782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43381035a0 0x7f4338198c20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.668+0000 7f433ec8b640 1 -- 172.21.15.47:0/2209626782 >> 172.21.15.47:0/2209626782 conn(0x7f43380fd010 msgr2=0x7f43380fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.668+0000 7f433ec8b640 1 -- 172.21.15.47:0/2209626782 shutdown_connections 2024-07-24T22:09:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:42.669+0000 7f433ec8b640 1 -- 172.21.15.47:0/2209626782 wait complete. 2024-07-24T22:09:43.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:43 smithi188 ceph-mon[37380]: pgmap v441: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 588 MiB/s wr, 729 op/s 2024-07-24T22:09:43.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:43 smithi183 ceph-mon[37007]: pgmap v441: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 588 MiB/s wr, 729 op/s 2024-07-24T22:09:43.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:43 smithi047 ceph-mon[32551]: pgmap v441: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 588 MiB/s wr, 729 op/s 2024-07-24T22:09:45.743 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:45 smithi047 ceph-mon[32551]: pgmap v442: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 617 MiB/s wr, 632 op/s 2024-07-24T22:09:45.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:45 smithi188 ceph-mon[37380]: pgmap v442: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 617 MiB/s wr, 632 op/s 2024-07-24T22:09:45.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:45 smithi183 ceph-mon[37007]: pgmap v442: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 617 MiB/s wr, 632 op/s 2024-07-24T22:09:47.777 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:47 smithi047 ceph-mon[32551]: pgmap v443: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 556 MiB/s wr, 461 op/s 2024-07-24T22:09:47.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:47 smithi183 ceph-mon[37007]: pgmap v443: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 556 MiB/s wr, 461 op/s 2024-07-24T22:09:48.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:47 smithi188 ceph-mon[37380]: pgmap v443: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 556 MiB/s wr, 461 op/s 2024-07-24T22:09:49.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:49 smithi183 ceph-mon[37007]: pgmap v444: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 593 MiB/s wr, 497 op/s 2024-07-24T22:09:49.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:49 smithi047 ceph-mon[32551]: pgmap v444: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 593 MiB/s wr, 497 op/s 2024-07-24T22:09:50.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:49 smithi188 ceph-mon[37380]: pgmap v444: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 593 MiB/s wr, 497 op/s 2024-07-24T22:09:51.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:51 smithi183 ceph-mon[37007]: pgmap v445: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 510 MiB/s wr, 467 op/s 2024-07-24T22:09:51.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:51 smithi047 ceph-mon[32551]: pgmap v445: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 510 MiB/s wr, 467 op/s 2024-07-24T22:09:52.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:51 smithi188 ceph-mon[37380]: pgmap v445: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 510 MiB/s wr, 467 op/s 2024-07-24T22:09:53.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:53 smithi183 ceph-mon[37007]: pgmap v446: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 483 MiB/s wr, 453 op/s 2024-07-24T22:09:53.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:53 smithi047 ceph-mon[32551]: pgmap v446: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 483 MiB/s wr, 453 op/s 2024-07-24T22:09:54.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:53 smithi188 ceph-mon[37380]: pgmap v446: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 483 MiB/s wr, 453 op/s 2024-07-24T22:09:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.803+0000 7f6954fbb640 1 -- 172.21.15.47:0/812252702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6950107910 msgr2=0x7f695010e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.803+0000 7f6954fbb640 1 --2- 172.21.15.47:0/812252702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6950107910 0x7f695010e110 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6948009ca0 tx=0x7f694802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.803+0000 7f6954fbb640 1 -- 172.21.15.47:0/812252702 shutdown_connections 2024-07-24T22:09:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.803+0000 7f6954fbb640 1 --2- 172.21.15.47:0/812252702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6950107910 0x7f695010e110 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.803+0000 7f6954fbb640 1 --2- 172.21.15.47:0/812252702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6950106f90 0x7f69501073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.803+0000 7f6954fbb640 1 --2- 172.21.15.47:0/812252702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69501015e0 0x7f69501019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.803+0000 7f6954fbb640 1 -- 172.21.15.47:0/812252702 >> 172.21.15.47:0/812252702 conn(0x7f69500782e0 msgr2=0x7f69500ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.803+0000 7f6954fbb640 1 -- 172.21.15.47:0/812252702 shutdown_connections 2024-07-24T22:09:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.803+0000 7f6954fbb640 1 -- 172.21.15.47:0/812252702 wait complete. 2024-07-24T22:09:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.804+0000 7f6954fbb640 1 Processor -- start 2024-07-24T22:09:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.804+0000 7f6954fbb640 1 -- start start 2024-07-24T22:09:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.804+0000 7f6954fbb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69501015e0 0x7f6950198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.804+0000 7f6954fbb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6950106f90 0x7f69501990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.804+0000 7f6954fbb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6950107910 0x7f695019e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.804+0000 7f6954fbb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69501126f0 con 0x7f6950107910 2024-07-24T22:09:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.804+0000 7f6954fbb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6950112570 con 0x7f6950106f90 2024-07-24T22:09:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.804+0000 7f6954fbb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6950112870 con 0x7f69501015e0 2024-07-24T22:09:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.805+0000 7f694ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6950107910 0x7f695019e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.805+0000 7f694ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6950107910 0x7f695019e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37054/0 (socket says 172.21.15.47:37054) 2024-07-24T22:09:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.805+0000 7f694e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69501015e0 0x7f6950198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.805+0000 7f694ed9d640 1 -- 172.21.15.47:0/2811612411 learned_addr learned my addr 172.21.15.47:0/2811612411 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.805+0000 7f6947fff640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6950106f90 0x7f69501990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.805+0000 7f694e59c640 1 -- 172.21.15.47:0/2811612411 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6950106f90 msgr2=0x7f69501990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.805+0000 7f694e59c640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6950106f90 0x7f69501990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.805+0000 7f694e59c640 1 -- 172.21.15.47:0/2811612411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6950107910 msgr2=0x7f695019e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.805+0000 7f694e59c640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6950107910 0x7f695019e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.805+0000 7f694e59c640 1 -- 172.21.15.47:0/2811612411 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695019ec10 con 0x7f69501015e0 2024-07-24T22:09:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.805+0000 7f694ed9d640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6950107910 0x7f695019e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.805+0000 7f694e59c640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69501015e0 0x7f6950198b70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f694000e9f0 tx=0x7f694000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.806+0000 7f69477fe640 1 -- 172.21.15.47:0/2811612411 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694000cd80 con 0x7f69501015e0 2024-07-24T22:09:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.806+0000 7f69477fe640 1 -- 172.21.15.47:0/2811612411 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69400035f0 con 0x7f69501015e0 2024-07-24T22:09:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.806+0000 7f69477fe640 1 -- 172.21.15.47:0/2811612411 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940010670 con 0x7f69501015e0 2024-07-24T22:09:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.806+0000 7f6954fbb640 1 -- 172.21.15.47:0/2811612411 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695019ef00 con 0x7f69501015e0 2024-07-24T22:09:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.806+0000 7f6954fbb640 1 -- 172.21.15.47:0/2811612411 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69501a55c0 con 0x7f69501015e0 2024-07-24T22:09:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.809+0000 7f69477fe640 1 -- 172.21.15.47:0/2811612411 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f69400037a0 con 0x7f69501015e0 2024-07-24T22:09:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.810+0000 7f6957def740 1 Processor -- start 2024-07-24T22:09:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.810+0000 7f6957def740 1 -- start start 2024-07-24T22:09:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.810+0000 7f6957def740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02075c90 0x55aa02076070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.810+0000 7f6957def740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa02082000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.810+0000 7f6957def740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02082540 0x55aa02084930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.810+0000 7f6957def740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55aa01feb280 con 0x55aa02075c90 2024-07-24T22:09:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.810+0000 7f6957def740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55aa01fda780 con 0x55aa02082540 2024-07-24T22:09:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.810+0000 7f6957def740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55aa01fde7c0 con 0x55aa020765b0 2024-07-24T22:09:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f69477fe640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f693c0b3d40 0x7f693c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f694e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa02082000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f694e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa02082000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51912/0 (socket says 172.21.15.47:51912) 2024-07-24T22:09:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f694e59c640 1 -- 172.21.15.47:0/3790963523 learned_addr learned my addr 172.21.15.47:0/3790963523 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f6947fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02082540 0x55aa02084930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f694ed9d640 1 --2- 172.21.15.47:0/3790963523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02075c90 0x55aa02076070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f6947fff640 1 -- 172.21.15.47:0/3790963523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 msgr2=0x55aa02082000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f6947fff640 1 --2- 172.21.15.47:0/3790963523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa02082000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f6947fff640 1 -- 172.21.15.47:0/3790963523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02075c90 msgr2=0x55aa02076070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f6947fff640 1 --2- 172.21.15.47:0/3790963523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02075c90 0x55aa02076070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f6947fff640 1 -- 172.21.15.47:0/3790963523 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa01d3e790 con 0x55aa02082540 2024-07-24T22:09:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f69477fe640 1 -- 172.21.15.47:0/2811612411 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f69400e4260 con 0x7f69501015e0 2024-07-24T22:09:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f694ed9d640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f693c0b3d40 0x7f693c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f6947fff640 1 --2- 172.21.15.47:0/3790963523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02082540 0x55aa02084930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6938009bf0 tx=0x7f6938011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e755660591eba4a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.811+0000 7f6944ff9640 1 -- 172.21.15.47:0/3790963523 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938009da0 con 0x55aa02082540 2024-07-24T22:09:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.812+0000 7f6944ff9640 1 -- 172.21.15.47:0/3790963523 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6938005020 con 0x55aa02082540 2024-07-24T22:09:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.812+0000 7f6944ff9640 1 -- 172.21.15.47:0/3790963523 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938004b60 con 0x55aa02082540 2024-07-24T22:09:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.812+0000 7f6957def740 1 -- 172.21.15.47:0/3790963523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02082540 msgr2=0x55aa02084930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.812+0000 7f6957def740 1 --2- 172.21.15.47:0/3790963523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02082540 0x55aa02084930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6938009bf0 tx=0x7f6938011810 comp rx=0 tx=0).stop 2024-07-24T22:09:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.812+0000 7f694ed9d640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f693c0b3d40 0x7f693c0b6200 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6948004af0 tx=0x7f694802a8c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.812+0000 7f6957def740 1 -- 172.21.15.47:0/3790963523 shutdown_connections 2024-07-24T22:09:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.812+0000 7f6957def740 1 --2- 172.21.15.47:0/3790963523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02082540 0x55aa02084930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.812+0000 7f6957def740 1 --2- 172.21.15.47:0/3790963523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa02082000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.812+0000 7f6957def740 1 --2- 172.21.15.47:0/3790963523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02075c90 0x55aa02076070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.812+0000 7f6957def740 1 -- 172.21.15.47:0/3790963523 >> 172.21.15.47:0/3790963523 conn(0x55aa02073ac0 msgr2=0x55aa02074c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.813+0000 7f6957def740 1 -- 172.21.15.47:0/3790963523 shutdown_connections 2024-07-24T22:09:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.813+0000 7f6957def740 1 -- 172.21.15.47:0/3790963523 wait complete. 2024-07-24T22:09:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.813+0000 7f6957def740 1 -- start start 2024-07-24T22:09:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.813+0000 7f6957def740 1 Processor -- start 2024-07-24T22:09:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.813+0000 7f6957def740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa02075c90 0x55aa02081c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.813+0000 7f6957def740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa020765b0 0x55aa0207f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f6957def740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02082540 0x55aa0207f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f6957def740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55aa01f14ab0 con 0x55aa02082540 2024-07-24T22:09:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f6957def740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55aa01f629e0 con 0x55aa020765b0 2024-07-24T22:09:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f6957def740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55aa02085220 con 0x55aa02075c90 2024-07-24T22:09:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f6957def740 10 client.0 _ll_register_callbacks cb 0x55aa01ceaa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f694e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa02075c90 0x55aa02081c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f694e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa02075c90 0x55aa02081c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51916/0 (socket says 172.21.15.47:51916) 2024-07-24T22:09:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f694e59c640 1 -- 172.21.15.47:0/4207387094 learned_addr learned my addr 172.21.15.47:0/4207387094 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f6947fff640 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa020765b0 0x55aa0207f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f694ed9d640 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02082540 0x55aa0207f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f6947fff640 1 -- 172.21.15.47:0/4207387094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa02075c90 msgr2=0x55aa02081c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f6947fff640 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa02075c90 0x55aa02081c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f6947fff640 1 -- 172.21.15.47:0/4207387094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02082540 msgr2=0x55aa0207f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f6947fff640 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02082540 0x55aa0207f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f6947fff640 1 -- 172.21.15.47:0/4207387094 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa01db7620 con 0x55aa020765b0 2024-07-24T22:09:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f694e59c640 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa02075c90 0x55aa02081c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:09:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f6947fff640 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa020765b0 0x55aa0207f150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f69380057c0 tx=0x7f6938019a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e77394390c6e8a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.814+0000 7f6935ffb640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:09:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6935ffb640 1 -- 172.21.15.47:0/4207387094 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938029020 con 0x55aa020765b0 2024-07-24T22:09:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6935ffb640 1 -- 172.21.15.47:0/4207387094 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f6938019c80 con 0x55aa020765b0 2024-07-24T22:09:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6957def740 1 -- 172.21.15.47:0/4207387094 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aa01f89ce0 con 0x55aa020765b0 2024-07-24T22:09:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6935ffb640 1 -- 172.21.15.47:0/4207387094 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6938034050 con 0x55aa020765b0 2024-07-24T22:09:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6957def740 10 client.25532 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6957def740 1 -- 172.21.15.47:0/4207387094 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55aa020909d0 con 0x55aa020765b0 2024-07-24T22:09:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6935ffb640 1 -- 172.21.15.47:0/4207387094 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55aa01f89ce0 con 0x55aa020765b0 2024-07-24T22:09:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6935ffb640 1 -- 172.21.15.47:0/4207387094 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6938025cd0 con 0x55aa020765b0 2024-07-24T22:09:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6957def740 10 client.25532 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6957def740 10 client.25532 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6957def740 20 client.25532 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6957def740 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55aa02091de0 0x55aa020941d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6957def740 4 client.25532 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:09:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.815+0000 7f6957def740 1 -- 172.21.15.47:0/4207387094 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa01fed1d0 con 0x55aa02091de0 2024-07-24T22:09:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.816+0000 7f694e59c640 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55aa02091de0 0x55aa020941d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.816+0000 7f6935ffb640 10 client.25532 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.816+0000 7f694e59c640 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55aa02091de0 0x55aa020941d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f98024eab1f2befe server_cookie=2f2483164fa31ba9 in_seq=0 out_seq=0 2024-07-24T22:09:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.817+0000 7f6935ffb640 1 -- 172.21.15.47:0/4207387094 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa01fed1d0 con 0x55aa02091de0 2024-07-24T22:09:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.817+0000 7f6935ffb640 10 client.25532 handle_command_reply: tid=0 2024-07-24T22:09:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.817+0000 7f6957def740 1 client.25532 shutdown 2024-07-24T22:09:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.818+0000 7f6957def740 1 -- 172.21.15.47:0/4207387094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa020765b0 msgr2=0x55aa0207f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.818+0000 7f6957def740 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa020765b0 0x55aa0207f150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f69380057c0 tx=0x7f6938019a90 comp rx=0 tx=0).stop 2024-07-24T22:09:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.818+0000 7f6957def740 1 -- 172.21.15.47:0/4207387094 shutdown_connections 2024-07-24T22:09:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.818+0000 7f6957def740 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55aa02091de0 0x55aa020941d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.818+0000 7f6957def740 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02082540 0x55aa0207f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.818+0000 7f6957def740 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa020765b0 0x55aa0207f150 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.818+0000 7f6935ffb640 0 client.25532 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.818+0000 7f6957def740 1 --2- 172.21.15.47:0/4207387094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa02075c90 0x55aa02081c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.818+0000 7f6957def740 1 -- 172.21.15.47:0/4207387094 >> 172.21.15.47:0/4207387094 conn(0x55aa02073ac0 msgr2=0x55aa02079660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.818+0000 7f6957def740 1 -- 172.21.15.47:0/4207387094 shutdown_connections 2024-07-24T22:09:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.818+0000 7f6957def740 1 -- 172.21.15.47:0/4207387094 wait complete. 2024-07-24T22:09:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.818+0000 7f6957def740 20 client.25532 trim_cache size 0 max 16384 2024-07-24T22:09:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.898+0000 7f6957def740 1 Processor -- start 2024-07-24T22:09:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.902+0000 7f6957def740 1 -- start start 2024-07-24T22:09:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.903+0000 7f6957def740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02075c90 0x55aa0207a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.903+0000 7f6957def740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa02099940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.904+0000 7f6957def740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02082540 0x55aa02099e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.904+0000 7f6957def740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69501ac0d0 con 0x55aa02082540 2024-07-24T22:09:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.904+0000 7f6957def740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f69501ae950 con 0x55aa02075c90 2024-07-24T22:09:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.904+0000 7f6957def740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f69501ac740 con 0x55aa020765b0 2024-07-24T22:09:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.907+0000 7f694ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02082540 0x55aa02099e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.907+0000 7f694ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02082540 0x55aa02099e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37064/0 (socket says 172.21.15.47:37064) 2024-07-24T22:09:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.907+0000 7f694ed9d640 1 -- 172.21.15.47:0/1586288764 learned_addr learned my addr 172.21.15.47:0/1586288764 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.909+0000 7f694e59c640 1 --2- 172.21.15.47:0/1586288764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02075c90 0x55aa0207a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.909+0000 7f6947fff640 1 --2- 172.21.15.47:0/1586288764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa02099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.918+0000 7f6947fff640 1 -- 172.21.15.47:0/1586288764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02075c90 msgr2=0x55aa0207a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.918+0000 7f6947fff640 1 --2- 172.21.15.47:0/1586288764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02075c90 0x55aa0207a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.918+0000 7f6947fff640 1 -- 172.21.15.47:0/1586288764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02082540 msgr2=0x55aa02099e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.918+0000 7f6947fff640 1 --2- 172.21.15.47:0/1586288764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02082540 0x55aa02099e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.918+0000 7f6947fff640 1 -- 172.21.15.47:0/1586288764 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa0207ac00 con 0x55aa020765b0 2024-07-24T22:09:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.926+0000 7f6947fff640 1 --2- 172.21.15.47:0/1586288764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa02099940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69380193e0 tx=0x7f6938009af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a74cea6ab83f089 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.930+0000 7f6937fff640 1 -- 172.21.15.47:0/1586288764 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938016070 con 0x55aa020765b0 2024-07-24T22:09:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.931+0000 7f6937fff640 1 -- 172.21.15.47:0/1586288764 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69380238b0 con 0x55aa020765b0 2024-07-24T22:09:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.932+0000 7f6937fff640 1 -- 172.21.15.47:0/1586288764 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938029040 con 0x55aa020765b0 2024-07-24T22:09:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.932+0000 7f6957def740 1 -- 172.21.15.47:0/1586288764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 msgr2=0x55aa02099940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.932+0000 7f6957def740 1 --2- 172.21.15.47:0/1586288764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa02099940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69380193e0 tx=0x7f6938009af0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.932+0000 7f6957def740 1 -- 172.21.15.47:0/1586288764 shutdown_connections 2024-07-24T22:09:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.932+0000 7f6957def740 1 --2- 172.21.15.47:0/1586288764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02082540 0x55aa02099e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.932+0000 7f6957def740 1 --2- 172.21.15.47:0/1586288764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa02099940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.932+0000 7f6957def740 1 --2- 172.21.15.47:0/1586288764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02075c90 0x55aa0207a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.932+0000 7f6957def740 1 -- 172.21.15.47:0/1586288764 >> 172.21.15.47:0/1586288764 conn(0x55aa02073ac0 msgr2=0x55aa02079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.933+0000 7f6957def740 1 -- 172.21.15.47:0/1586288764 shutdown_connections 2024-07-24T22:09:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.933+0000 7f6957def740 1 -- 172.21.15.47:0/1586288764 wait complete. 2024-07-24T22:09:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.934+0000 7f6957def740 1 -- start start 2024-07-24T22:09:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.934+0000 7f6957def740 1 Processor -- start 2024-07-24T22:09:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.935+0000 7f6957def740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02075c90 0x55aa0207cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.935+0000 7f6957def740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa0208a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.935+0000 7f6957def740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02082540 0x55aa0208ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.935+0000 7f6957def740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69501ace10 con 0x55aa02075c90 2024-07-24T22:09:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.935+0000 7f6957def740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f69501ae280 con 0x55aa02082540 2024-07-24T22:09:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.935+0000 7f6957def740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f69501ad4e0 con 0x55aa020765b0 2024-07-24T22:09:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.935+0000 7f6957def740 10 client.0 _ll_register_callbacks cb 0x7f6938005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:09:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.936+0000 7f694e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02075c90 0x55aa0207cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.936+0000 7f694e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02075c90 0x55aa0207cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37066/0 (socket says 172.21.15.47:37066) 2024-07-24T22:09:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.936+0000 7f694e59c640 1 -- 172.21.15.47:0/1704483200 learned_addr learned my addr 172.21.15.47:0/1704483200 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:09:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.937+0000 7f6947fff640 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa0208a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.937+0000 7f694ed9d640 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02082540 0x55aa0208ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.937+0000 7f694e59c640 1 -- 172.21.15.47:0/1704483200 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 msgr2=0x55aa0208a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.937+0000 7f694e59c640 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa0208a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.937+0000 7f694e59c640 1 -- 172.21.15.47:0/1704483200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02082540 msgr2=0x55aa0208ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:09:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.937+0000 7f694e59c640 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02082540 0x55aa0208ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.937+0000 7f694e59c640 1 -- 172.21.15.47:0/1704483200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa0207b500 con 0x55aa02075c90 2024-07-24T22:09:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.937+0000 7f694ed9d640 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02082540 0x55aa0208ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:09:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.937+0000 7f694e59c640 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02075c90 0x55aa0207cde0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6940000c00 tx=0x7f69400a6e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f265ff4247de3 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:09:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.937+0000 7f6935ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:09:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.938+0000 7f6935ffb640 1 -- 172.21.15.47:0/1704483200 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69400af470 con 0x55aa02075c90 2024-07-24T22:09:55.943 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:55 smithi047 ceph-mon[32551]: pgmap v447: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 545 MiB/s wr, 431 op/s 2024-07-24T22:09:55.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.938+0000 7f6957def740 1 -- 172.21.15.47:0/1704483200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69380238b0 con 0x55aa02075c90 2024-07-24T22:09:55.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.938+0000 7f6935ffb640 1 -- 172.21.15.47:0/1704483200 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f69400e1c30 con 0x55aa02075c90 2024-07-24T22:09:55.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.938+0000 7f6935ffb640 1 -- 172.21.15.47:0/1704483200 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f69400b3f20 con 0x55aa02075c90 2024-07-24T22:09:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.939+0000 7f6957def740 10 client.16095 fetch_fsmap learned FSMap version 20 2024-07-24T22:09:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.939+0000 7f6957def740 1 -- 172.21.15.47:0/1704483200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55aa020fbde0 con 0x55aa02075c90 2024-07-24T22:09:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.940+0000 7f6935ffb640 1 -- 172.21.15.47:0/1704483200 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69380238b0 con 0x55aa02075c90 2024-07-24T22:09:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.940+0000 7f6935ffb640 1 -- 172.21.15.47:0/1704483200 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f69400a9b40 con 0x55aa02075c90 2024-07-24T22:09:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.940+0000 7f6957def740 10 client.16095 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:09:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.940+0000 7f6957def740 10 client.16095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:09:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.940+0000 7f6957def740 20 client.16095 populate_metadata read hostname 'smithi047' 2024-07-24T22:09:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.940+0000 7f6957def740 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55aa020fc500 0x55aa020fe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:09:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.940+0000 7f6957def740 4 client.16095 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:09:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.940+0000 7f6957def740 1 -- 172.21.15.47:0/1704483200 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aa01fe8c70 con 0x55aa020fc500 2024-07-24T22:09:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.943+0000 7f6947fff640 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55aa020fc500 0x55aa020fe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:09:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.953+0000 7f6947fff640 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55aa020fc500 0x55aa020fe8f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e1f89547864a289 server_cookie=38dd93a25299921a in_seq=0 out_seq=0 2024-07-24T22:09:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:55.953+0000 7f6935ffb640 10 client.16095 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:56.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:55 smithi188 ceph-mon[37380]: pgmap v447: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 545 MiB/s wr, 431 op/s 2024-07-24T22:09:56.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:55 smithi183 ceph-mon[37007]: pgmap v447: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 545 MiB/s wr, 431 op/s 2024-07-24T22:09:58.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:57 smithi188 ceph-mon[37380]: pgmap v448: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 502 MiB/s wr, 321 op/s 2024-07-24T22:09:58.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:57 smithi183 ceph-mon[37007]: pgmap v448: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 502 MiB/s wr, 321 op/s 2024-07-24T22:09:58.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:57 smithi047 ceph-mon[32551]: pgmap v448: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 502 MiB/s wr, 321 op/s 2024-07-24T22:09:58.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.873+0000 7f6935ffb640 1 -- 172.21.15.47:0/1704483200 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aa01fe8c70 con 0x55aa020fc500 2024-07-24T22:09:58.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.873+0000 7f6935ffb640 10 client.16095 handle_command_reply: tid=0 2024-07-24T22:09:58.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.873+0000 7f6957def740 1 client.16095 shutdown 2024-07-24T22:09:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.873+0000 7f6957def740 1 -- 172.21.15.47:0/1704483200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02075c90 msgr2=0x55aa0207cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.873+0000 7f6957def740 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02075c90 0x55aa0207cde0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6940000c00 tx=0x7f69400a6e60 comp rx=0 tx=0).stop 2024-07-24T22:09:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.873+0000 7f6957def740 1 -- 172.21.15.47:0/1704483200 shutdown_connections 2024-07-24T22:09:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.873+0000 7f6957def740 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55aa020fc500 0x55aa020fe8f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.873+0000 7f6957def740 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55aa02082540 0x55aa0208ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.873+0000 7f6957def740 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55aa020765b0 0x55aa0208a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.873+0000 7f6957def740 1 --2- 172.21.15.47:0/1704483200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa02075c90 0x55aa0207cde0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.873+0000 7f6957def740 1 -- 172.21.15.47:0/1704483200 >> 172.21.15.47:0/1704483200 conn(0x55aa02073ac0 msgr2=0x55aa02072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.873+0000 7f6935ffb640 0 client.16095 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:09:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.873+0000 7f6957def740 1 -- 172.21.15.47:0/1704483200 shutdown_connections 2024-07-24T22:09:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.874+0000 7f6957def740 1 -- 172.21.15.47:0/1704483200 wait complete. 2024-07-24T22:09:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.874+0000 7f6957def740 20 client.16095 trim_cache size 0 max 16384 2024-07-24T22:09:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:09:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:09:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:09:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:09:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.874+0000 7f6954fbb640 1 -- 172.21.15.47:0/2811612411 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f693c0b3d40 msgr2=0x7f693c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.874+0000 7f6954fbb640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f693c0b3d40 0x7f693c0b6200 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6948004af0 tx=0x7f694802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:09:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.874+0000 7f6954fbb640 1 -- 172.21.15.47:0/2811612411 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69501015e0 msgr2=0x7f6950198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:09:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.874+0000 7f6954fbb640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69501015e0 0x7f6950198b70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f694000e9f0 tx=0x7f694000eeb0 comp rx=0 tx=0).stop 2024-07-24T22:09:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.875+0000 7f6954fbb640 1 -- 172.21.15.47:0/2811612411 shutdown_connections 2024-07-24T22:09:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.875+0000 7f6954fbb640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f693c0b3d40 0x7f693c0b6200 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.875+0000 7f6954fbb640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6950107910 0x7f695019e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.875+0000 7f6954fbb640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6950106f90 0x7f69501990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.875+0000 7f6954fbb640 1 --2- 172.21.15.47:0/2811612411 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69501015e0 0x7f6950198b70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:09:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.875+0000 7f6954fbb640 1 -- 172.21.15.47:0/2811612411 >> 172.21.15.47:0/2811612411 conn(0x7f69500782e0 msgr2=0x7f69501066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:09:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.875+0000 7f6954fbb640 1 -- 172.21.15.47:0/2811612411 shutdown_connections 2024-07-24T22:09:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:09:58.875+0000 7f6954fbb640 1 -- 172.21.15.47:0/2811612411 wait complete. 2024-07-24T22:10:00.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:09:59 smithi047 ceph-mon[32551]: pgmap v449: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 571 MiB/s wr, 338 op/s 2024-07-24T22:10:00.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:09:59 smithi188 ceph-mon[37380]: pgmap v449: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 571 MiB/s wr, 338 op/s 2024-07-24T22:10:00.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:09:59 smithi183 ceph-mon[37007]: pgmap v449: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 571 MiB/s wr, 338 op/s 2024-07-24T22:10:01.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:00 smithi188 ceph-mon[37380]: overall HEALTH_OK 2024-07-24T22:10:01.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:00 smithi188 ceph-mon[37380]: pgmap v450: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 537 MiB/s wr, 303 op/s 2024-07-24T22:10:01.312 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:00 smithi183 ceph-mon[37007]: overall HEALTH_OK 2024-07-24T22:10:01.312 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:00 smithi183 ceph-mon[37007]: pgmap v450: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 537 MiB/s wr, 303 op/s 2024-07-24T22:10:01.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:00 smithi047 ceph-mon[32551]: overall HEALTH_OK 2024-07-24T22:10:01.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:00 smithi047 ceph-mon[32551]: pgmap v450: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 537 MiB/s wr, 303 op/s 2024-07-24T22:10:03.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:03 smithi183 ceph-mon[37007]: pgmap v451: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 557 MiB/s wr, 330 op/s 2024-07-24T22:10:03.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:03 smithi047 ceph-mon[32551]: pgmap v451: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 557 MiB/s wr, 330 op/s 2024-07-24T22:10:03.698 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:10:03.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:03 smithi188 ceph-mon[37380]: pgmap v451: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 557 MiB/s wr, 330 op/s 2024-07-24T22:10:04.035 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:10:05.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:05 smithi047 ceph-mon[32551]: pgmap v452: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 593 MiB/s wr, 390 op/s 2024-07-24T22:10:05.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:05 smithi188 ceph-mon[37380]: pgmap v452: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 593 MiB/s wr, 390 op/s 2024-07-24T22:10:05.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:05 smithi183 ceph-mon[37007]: pgmap v452: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 593 MiB/s wr, 390 op/s 2024-07-24T22:10:06.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.817+0000 7f827486a640 1 -- 172.21.15.47:0/1610679274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8270101650 msgr2=0x7f8270101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:06.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.817+0000 7f827486a640 1 --2- 172.21.15.47:0/1610679274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8270101650 0x7f8270101a30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8260009900 tx=0x7f826002a440 comp rx=0 tx=0).stop 2024-07-24T22:10:06.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.817+0000 7f827486a640 1 -- 172.21.15.47:0/1610679274 shutdown_connections 2024-07-24T22:10:06.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.817+0000 7f827486a640 1 --2- 172.21.15.47:0/1610679274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82701079e0 0x7f827010e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.817+0000 7f827486a640 1 --2- 172.21.15.47:0/1610679274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8270107060 0x7f82701074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.817+0000 7f827486a640 1 --2- 172.21.15.47:0/1610679274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8270101650 0x7f8270101a30 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.817+0000 7f827486a640 1 -- 172.21.15.47:0/1610679274 >> 172.21.15.47:0/1610679274 conn(0x7f82700fd0c0 msgr2=0x7f82700ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:06.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.817+0000 7f827486a640 1 -- 172.21.15.47:0/1610679274 shutdown_connections 2024-07-24T22:10:06.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.817+0000 7f827486a640 1 -- 172.21.15.47:0/1610679274 wait complete. 2024-07-24T22:10:06.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.818+0000 7f827486a640 1 Processor -- start 2024-07-24T22:10:06.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.819+0000 7f827486a640 1 -- start start 2024-07-24T22:10:06.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.819+0000 7f827486a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8270101650 0x7f8270197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.819+0000 7f827486a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8270107060 0x7f8270198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.819+0000 7f827486a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82701079e0 0x7f827019d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.819+0000 7f827486a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8270111720 con 0x7f82701079e0 2024-07-24T22:10:06.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.819+0000 7f827486a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f82701115a0 con 0x7f8270107060 2024-07-24T22:10:06.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.819+0000 7f827486a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f82701118a0 con 0x7f8270101650 2024-07-24T22:10:06.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.819+0000 7f826ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82701079e0 0x7f827019d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.819+0000 7f826ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82701079e0 0x7f827019d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44594/0 (socket says 172.21.15.47:44594) 2024-07-24T22:10:06.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.819+0000 7f826ed9d640 1 -- 172.21.15.47:0/2588056447 learned_addr learned my addr 172.21.15.47:0/2588056447 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:06.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.820+0000 7f826e59c640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8270101650 0x7f8270197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.820+0000 7f8267fff640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8270107060 0x7f8270198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.820+0000 7f826ed9d640 1 -- 172.21.15.47:0/2588056447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8270101650 msgr2=0x7f8270197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:06.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.820+0000 7f826ed9d640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8270101650 0x7f8270197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.820+0000 7f826ed9d640 1 -- 172.21.15.47:0/2588056447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8270107060 msgr2=0x7f8270198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:06.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.820+0000 7f826ed9d640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8270107060 0x7f8270198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.820+0000 7f826ed9d640 1 -- 172.21.15.47:0/2588056447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827019dda0 con 0x7f82701079e0 2024-07-24T22:10:06.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.820+0000 7f826ed9d640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82701079e0 0x7f827019d5d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f826800b990 tx=0x7f826800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:06.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.821+0000 7f82677fe640 1 -- 172.21.15.47:0/2588056447 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826801b070 con 0x7f82701079e0 2024-07-24T22:10:06.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.821+0000 7f82677fe640 1 -- 172.21.15.47:0/2588056447 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f826800edb0 con 0x7f82701079e0 2024-07-24T22:10:06.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.821+0000 7f827486a640 1 -- 172.21.15.47:0/2588056447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827019e090 con 0x7f82701079e0 2024-07-24T22:10:06.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.821+0000 7f82677fe640 1 -- 172.21.15.47:0/2588056447 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82680078b0 con 0x7f82701079e0 2024-07-24T22:10:06.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.821+0000 7f827486a640 1 -- 172.21.15.47:0/2588056447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f827006a4f0 con 0x7f82701079e0 2024-07-24T22:10:06.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.825+0000 7f82677fe640 1 -- 172.21.15.47:0/2588056447 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f826801e070 con 0x7f82701079e0 2024-07-24T22:10:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.826+0000 7f82677fe640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f825c0b3dc0 0x7f825c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.827+0000 7f82677fe640 1 -- 172.21.15.47:0/2588056447 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f82680e58b0 con 0x7f82701079e0 2024-07-24T22:10:06.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.827+0000 7f826e59c640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f825c0b3dc0 0x7f825c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.827+0000 7f8276c1b740 1 Processor -- start 2024-07-24T22:10:06.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.827+0000 7f8276c1b740 1 -- start start 2024-07-24T22:10:06.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.828+0000 7f8276c1b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a45be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.828+0000 7f8276c1b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 0x55f95a467e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.828+0000 7f8276c1b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a468340 0x55f95a46a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.828+0000 7f8276c1b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f95a3ce960 con 0x55f95a45ba90 2024-07-24T22:10:06.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.828+0000 7f8276c1b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f95a3bde60 con 0x55f95a45c3b0 2024-07-24T22:10:06.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.828+0000 7f8276c1b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f95a3c1ea0 con 0x55f95a468340 2024-07-24T22:10:06.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.828+0000 7f826e59c640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f825c0b3dc0 0x7f825c0b6280 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8260031440 tx=0x7f8260005d10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:06.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.828+0000 7f826e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a45be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.828+0000 7f826e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a45be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44598/0 (socket says 172.21.15.47:44598) 2024-07-24T22:10:06.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.828+0000 7f826e59c640 1 -- 172.21.15.47:0/986706055 learned_addr learned my addr 172.21.15.47:0/986706055 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:06.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.828+0000 7f826ed9d640 1 --2- 172.21.15.47:0/986706055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a468340 0x55f95a46a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.829+0000 7f826e59c640 1 -- 172.21.15.47:0/986706055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a468340 msgr2=0x55f95a46a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.829+0000 7f826e59c640 1 --2- 172.21.15.47:0/986706055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a468340 0x55f95a46a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.829+0000 7f826e59c640 1 -- 172.21.15.47:0/986706055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 msgr2=0x55f95a467e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.829+0000 7f826e59c640 1 --2- 172.21.15.47:0/986706055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 0x55f95a467e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.829+0000 7f826e59c640 1 -- 172.21.15.47:0/986706055 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f95a3472d0 con 0x55f95a45ba90 2024-07-24T22:10:06.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.829+0000 7f826e59c640 1 --2- 172.21.15.47:0/986706055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a45be70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8260009900 tx=0x7f826003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d542ce3cd4ff21 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:06.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.830+0000 7f8264ff9640 1 -- 172.21.15.47:0/986706055 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826004c070 con 0x55f95a45ba90 2024-07-24T22:10:06.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.830+0000 7f8264ff9640 1 -- 172.21.15.47:0/986706055 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8260004440 con 0x55f95a45ba90 2024-07-24T22:10:06.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.830+0000 7f8264ff9640 1 -- 172.21.15.47:0/986706055 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826004c070 con 0x55f95a45ba90 2024-07-24T22:10:06.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.831+0000 7f8276c1b740 1 -- 172.21.15.47:0/986706055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 msgr2=0x55f95a45be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:06.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.831+0000 7f8276c1b740 1 --2- 172.21.15.47:0/986706055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a45be70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8260009900 tx=0x7f826003c000 comp rx=0 tx=0).stop 2024-07-24T22:10:06.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.831+0000 7f8276c1b740 1 -- 172.21.15.47:0/986706055 shutdown_connections 2024-07-24T22:10:06.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.831+0000 7f8276c1b740 1 --2- 172.21.15.47:0/986706055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a468340 0x55f95a46a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.831+0000 7f8276c1b740 1 --2- 172.21.15.47:0/986706055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 0x55f95a467e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.831+0000 7f8276c1b740 1 --2- 172.21.15.47:0/986706055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a45be70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.831+0000 7f8276c1b740 1 -- 172.21.15.47:0/986706055 >> 172.21.15.47:0/986706055 conn(0x55f95a4598c0 msgr2=0x55f95a45aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:06.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.831+0000 7f8276c1b740 1 -- 172.21.15.47:0/986706055 shutdown_connections 2024-07-24T22:10:06.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.831+0000 7f8276c1b740 1 -- 172.21.15.47:0/986706055 wait complete. 2024-07-24T22:10:06.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.832+0000 7f8276c1b740 1 -- start start 2024-07-24T22:10:06.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.832+0000 7f8276c1b740 1 Processor -- start 2024-07-24T22:10:06.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.832+0000 7f8276c1b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a467de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.832+0000 7f8276c1b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 0x55f95a465250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.832+0000 7f8276c1b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a468340 0x55f95a4659e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.832+0000 7f8276c1b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f95a221700 con 0x55f95a45ba90 2024-07-24T22:10:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.832+0000 7f8276c1b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f95a3605a0 con 0x55f95a45c3b0 2024-07-24T22:10:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.832+0000 7f8276c1b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f95a46afb0 con 0x55f95a468340 2024-07-24T22:10:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.832+0000 7f8276c1b740 10 client.0 _ll_register_callbacks cb 0x55f95a380910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.832+0000 7f826e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a467de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.832+0000 7f826e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a467de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44612/0 (socket says 172.21.15.47:44612) 2024-07-24T22:10:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.832+0000 7f826e59c640 1 -- 172.21.15.47:0/2584579212 learned_addr learned my addr 172.21.15.47:0/2584579212 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.833+0000 7f8267fff640 1 --2- 172.21.15.47:0/2584579212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 0x55f95a465250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.833+0000 7f826e59c640 1 -- 172.21.15.47:0/2584579212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a468340 msgr2=0x55f95a4659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.833+0000 7f826e59c640 1 --2- 172.21.15.47:0/2584579212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a468340 0x55f95a4659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.833+0000 7f826e59c640 1 -- 172.21.15.47:0/2584579212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 msgr2=0x55f95a465250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:06.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.833+0000 7f826e59c640 1 --2- 172.21.15.47:0/2584579212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 0x55f95a465250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.833+0000 7f826e59c640 1 -- 172.21.15.47:0/2584579212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f95a353630 con 0x55f95a45ba90 2024-07-24T22:10:06.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.833+0000 7f826e59c640 1 --2- 172.21.15.47:0/2584579212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a467de0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8260048bd0 tx=0x7f8260048c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12de57d53b38ffe server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:06.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.833+0000 7f8255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:10:06.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.834+0000 7f8255ffb640 1 -- 172.21.15.47:0/2584579212 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260069060 con 0x55f95a45ba90 2024-07-24T22:10:06.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.834+0000 7f8255ffb640 1 -- 172.21.15.47:0/2584579212 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8260004240 con 0x55f95a45ba90 2024-07-24T22:10:06.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.834+0000 7f8276c1b740 1 -- 172.21.15.47:0/2584579212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8260004440 con 0x55f95a45ba90 2024-07-24T22:10:06.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.834+0000 7f8255ffb640 1 -- 172.21.15.47:0/2584579212 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f826004c070 con 0x55f95a45ba90 2024-07-24T22:10:06.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.834+0000 7f8276c1b740 10 client.16107 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:06.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.834+0000 7f8276c1b740 1 -- 172.21.15.47:0/2584579212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f95a11e650 con 0x55f95a45ba90 2024-07-24T22:10:06.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.835+0000 7f8255ffb640 1 -- 172.21.15.47:0/2584579212 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8260048e20 con 0x55f95a45ba90 2024-07-24T22:10:06.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.835+0000 7f8255ffb640 1 -- 172.21.15.47:0/2584579212 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f82600647c0 con 0x55f95a45ba90 2024-07-24T22:10:06.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.836+0000 7f8276c1b740 10 client.16107 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:06.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.836+0000 7f8276c1b740 10 client.16107 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:06.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.836+0000 7f8276c1b740 20 client.16107 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:06.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.836+0000 7f8276c1b740 1 --2- 172.21.15.47:0/2584579212 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f95a455ec0 0x55f95a458340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.836+0000 7f8276c1b740 4 client.16107 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:10:06.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.836+0000 7f8276c1b740 1 -- 172.21.15.47:0/2584579212 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8260004440 con 0x55f95a455ec0 2024-07-24T22:10:06.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.839+0000 7f8267fff640 1 --2- 172.21.15.47:0/2584579212 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f95a455ec0 0x55f95a458340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.840+0000 7f8255ffb640 10 client.16107 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:06.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.840+0000 7f8267fff640 1 --2- 172.21.15.47:0/2584579212 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f95a455ec0 0x55f95a458340 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b6acfed95494fc3 server_cookie=97dc47e11e77515a in_seq=0 out_seq=0 2024-07-24T22:10:06.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.840+0000 7f8255ffb640 1 -- 172.21.15.47:0/2584579212 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8260004440 con 0x55f95a455ec0 2024-07-24T22:10:06.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.840+0000 7f8255ffb640 10 client.16107 handle_command_reply: tid=0 2024-07-24T22:10:06.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.840+0000 7f8276c1b740 1 client.16107 shutdown 2024-07-24T22:10:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.841+0000 7f8276c1b740 1 -- 172.21.15.47:0/2584579212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 msgr2=0x55f95a467de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.841+0000 7f8276c1b740 1 --2- 172.21.15.47:0/2584579212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a467de0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8260048bd0 tx=0x7f8260048c00 comp rx=0 tx=0).stop 2024-07-24T22:10:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.841+0000 7f8276c1b740 1 -- 172.21.15.47:0/2584579212 shutdown_connections 2024-07-24T22:10:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.841+0000 7f8276c1b740 1 --2- 172.21.15.47:0/2584579212 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f95a455ec0 0x55f95a458340 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.841+0000 7f8276c1b740 1 --2- 172.21.15.47:0/2584579212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a468340 0x55f95a4659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.841+0000 7f8276c1b740 1 --2- 172.21.15.47:0/2584579212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 0x55f95a465250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.841+0000 7f8255ffb640 0 client.16107 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.841+0000 7f8276c1b740 1 --2- 172.21.15.47:0/2584579212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a467de0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.841+0000 7f8276c1b740 1 -- 172.21.15.47:0/2584579212 >> 172.21.15.47:0/2584579212 conn(0x55f95a4598c0 msgr2=0x55f95a454520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.841+0000 7f8276c1b740 1 -- 172.21.15.47:0/2584579212 shutdown_connections 2024-07-24T22:10:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.841+0000 7f8276c1b740 1 -- 172.21.15.47:0/2584579212 wait complete. 2024-07-24T22:10:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.841+0000 7f8276c1b740 20 client.16107 trim_cache size 0 max 16384 2024-07-24T22:10:06.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.860+0000 7f8276c1b740 1 Processor -- start 2024-07-24T22:10:06.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.860+0000 7f8276c1b740 1 -- start start 2024-07-24T22:10:06.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.860+0000 7f8276c1b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45ba90 0x55f95a466f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.860+0000 7f8276c1b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a45c3b0 0x55f95a462440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.860+0000 7f8276c1b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a468340 0x55f95a462980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.860+0000 7f8276c1b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82701aa070 con 0x55f95a468340 2024-07-24T22:10:06.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.860+0000 7f8276c1b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f82701ac8f0 con 0x55f95a45ba90 2024-07-24T22:10:06.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.860+0000 7f8276c1b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f82701aa6e0 con 0x55f95a45c3b0 2024-07-24T22:10:06.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.860+0000 7f826ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a468340 0x55f95a462980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.861+0000 7f826ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a468340 0x55f95a462980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44620/0 (socket says 172.21.15.47:44620) 2024-07-24T22:10:06.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.861+0000 7f826ed9d640 1 -- 172.21.15.47:0/411071149 learned_addr learned my addr 172.21.15.47:0/411071149 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:06.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.861+0000 7f8267fff640 1 --2- 172.21.15.47:0/411071149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a45c3b0 0x55f95a462440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.861+0000 7f826e59c640 1 --2- 172.21.15.47:0/411071149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45ba90 0x55f95a466f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.861+0000 7f8267fff640 1 -- 172.21.15.47:0/411071149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45ba90 msgr2=0x55f95a466f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.861+0000 7f8267fff640 1 --2- 172.21.15.47:0/411071149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45ba90 0x55f95a466f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.861+0000 7f8267fff640 1 -- 172.21.15.47:0/411071149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a468340 msgr2=0x55f95a462980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.861+0000 7f8267fff640 1 --2- 172.21.15.47:0/411071149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a468340 0x55f95a462980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.861+0000 7f8267fff640 1 -- 172.21.15.47:0/411071149 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f95a4664f0 con 0x55f95a45c3b0 2024-07-24T22:10:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.861+0000 7f826ed9d640 1 --2- 172.21.15.47:0/411071149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a468340 0x55f95a462980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:10:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.861+0000 7f8267fff640 1 --2- 172.21.15.47:0/411071149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a45c3b0 0x55f95a462440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55f95a458910 tx=0x7f825800cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c36cbcd12222508 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.862+0000 7f8257fff640 1 -- 172.21.15.47:0/411071149 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258015950 con 0x55f95a45c3b0 2024-07-24T22:10:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.862+0000 7f8257fff640 1 -- 172.21.15.47:0/411071149 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8258013430 con 0x55f95a45c3b0 2024-07-24T22:10:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.862+0000 7f8257fff640 1 -- 172.21.15.47:0/411071149 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825801c3f0 con 0x55f95a45c3b0 2024-07-24T22:10:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.862+0000 7f8276c1b740 1 -- 172.21.15.47:0/411071149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a45c3b0 msgr2=0x55f95a462440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.862+0000 7f8276c1b740 1 --2- 172.21.15.47:0/411071149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a45c3b0 0x55f95a462440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55f95a458910 tx=0x7f825800cdb0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.862+0000 7f8276c1b740 1 -- 172.21.15.47:0/411071149 shutdown_connections 2024-07-24T22:10:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.862+0000 7f8276c1b740 1 --2- 172.21.15.47:0/411071149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a468340 0x55f95a462980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.862+0000 7f8276c1b740 1 --2- 172.21.15.47:0/411071149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a45c3b0 0x55f95a462440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.862+0000 7f8276c1b740 1 --2- 172.21.15.47:0/411071149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45ba90 0x55f95a466f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.862+0000 7f8276c1b740 1 -- 172.21.15.47:0/411071149 >> 172.21.15.47:0/411071149 conn(0x55f95a4598c0 msgr2=0x55f95a466860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.863+0000 7f8276c1b740 1 -- 172.21.15.47:0/411071149 shutdown_connections 2024-07-24T22:10:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.863+0000 7f8276c1b740 1 -- 172.21.15.47:0/411071149 wait complete. 2024-07-24T22:10:06.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.863+0000 7f8276c1b740 1 -- start start 2024-07-24T22:10:06.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.863+0000 7f8276c1b740 1 Processor -- start 2024-07-24T22:10:06.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.864+0000 7f8276c1b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a47c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.864+0000 7f8276c1b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 0x55f95a479630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.864+0000 7f8276c1b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a468340 0x55f95a479b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.864+0000 7f8276c1b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82701aadb0 con 0x55f95a45ba90 2024-07-24T22:10:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.864+0000 7f8276c1b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f82701ac220 con 0x55f95a45c3b0 2024-07-24T22:10:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.864+0000 7f8276c1b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f82701ab480 con 0x55f95a468340 2024-07-24T22:10:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.864+0000 7f8276c1b740 10 client.0 _ll_register_callbacks cb 0x7f82680b3f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.864+0000 7f826e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a47c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.864+0000 7f826e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a47c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44630/0 (socket says 172.21.15.47:44630) 2024-07-24T22:10:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.864+0000 7f826e59c640 1 -- 172.21.15.47:0/3165427124 learned_addr learned my addr 172.21.15.47:0/3165427124 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.864+0000 7f8267fff640 1 --2- 172.21.15.47:0/3165427124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 0x55f95a479630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.864+0000 7f826e59c640 1 -- 172.21.15.47:0/3165427124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a468340 msgr2=0x55f95a479b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.864+0000 7f826e59c640 1 --2- 172.21.15.47:0/3165427124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a468340 0x55f95a479b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.865+0000 7f826e59c640 1 -- 172.21.15.47:0/3165427124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 msgr2=0x55f95a479630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.865+0000 7f826e59c640 1 --2- 172.21.15.47:0/3165427124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 0x55f95a479630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.865+0000 7f826e59c640 1 -- 172.21.15.47:0/3165427124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f95a47a3a0 con 0x55f95a45ba90 2024-07-24T22:10:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.865+0000 7f8267fff640 1 --2- 172.21.15.47:0/3165427124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 0x55f95a479630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:10:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.865+0000 7f826e59c640 1 --2- 172.21.15.47:0/3165427124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a47c140 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8260064cb0 tx=0x7f826003b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23f8da20bdca173 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.865+0000 7f8255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:10:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.865+0000 7f8255ffb640 1 -- 172.21.15.47:0/3165427124 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826003f040 con 0x55f95a45ba90 2024-07-24T22:10:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.865+0000 7f8255ffb640 1 -- 172.21.15.47:0/3165427124 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f82600647c0 con 0x55f95a45ba90 2024-07-24T22:10:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.865+0000 7f8276c1b740 1 -- 172.21.15.47:0/3165427124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8258013430 con 0x55f95a45ba90 2024-07-24T22:10:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.865+0000 7f8255ffb640 1 -- 172.21.15.47:0/3165427124 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8260035050 con 0x55f95a45ba90 2024-07-24T22:10:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.866+0000 7f8276c1b740 10 client.16113 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.866+0000 7f8276c1b740 1 -- 172.21.15.47:0/3165427124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f95a4deb10 con 0x55f95a45ba90 2024-07-24T22:10:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.866+0000 7f8255ffb640 1 -- 172.21.15.47:0/3165427124 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8258013430 con 0x55f95a45ba90 2024-07-24T22:10:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.866+0000 7f8255ffb640 1 -- 172.21.15.47:0/3165427124 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f826003b940 con 0x55f95a45ba90 2024-07-24T22:10:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.866+0000 7f8276c1b740 10 client.16113 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.866+0000 7f8276c1b740 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:06.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.866+0000 7f8276c1b740 20 client.16113 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:06.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.866+0000 7f8276c1b740 1 --2- 172.21.15.47:0/3165427124 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f95a4df2c0 0x55f95a4e16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:06.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.866+0000 7f8276c1b740 4 client.16113 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:10:06.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.866+0000 7f8276c1b740 1 -- 172.21.15.47:0/3165427124 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f95a3d08b0 con 0x55f95a4df2c0 2024-07-24T22:10:06.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.866+0000 7f8267fff640 1 --2- 172.21.15.47:0/3165427124 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f95a4df2c0 0x55f95a4e16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:06.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.867+0000 7f8255ffb640 10 client.16113 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:06.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.867+0000 7f8267fff640 1 --2- 172.21.15.47:0/3165427124 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f95a4df2c0 0x55f95a4e16e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35f14c9391f057c4 server_cookie=411d169ab4fae18c in_seq=0 out_seq=0 2024-07-24T22:10:06.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.867+0000 7f8255ffb640 1 -- 172.21.15.47:0/3165427124 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f95a3d08b0 con 0x55f95a4df2c0 2024-07-24T22:10:06.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.867+0000 7f8255ffb640 10 client.16113 handle_command_reply: tid=0 2024-07-24T22:10:06.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.867+0000 7f8276c1b740 1 client.16113 shutdown 2024-07-24T22:10:06.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.867+0000 7f8276c1b740 1 -- 172.21.15.47:0/3165427124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 msgr2=0x55f95a47c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:06.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.867+0000 7f8276c1b740 1 --2- 172.21.15.47:0/3165427124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a47c140 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8260064cb0 tx=0x7f826003b4b0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f8276c1b740 1 -- 172.21.15.47:0/3165427124 shutdown_connections 2024-07-24T22:10:06.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f8276c1b740 1 --2- 172.21.15.47:0/3165427124 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f95a4df2c0 0x55f95a4e16e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f8276c1b740 1 --2- 172.21.15.47:0/3165427124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f95a468340 0x55f95a479b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f8276c1b740 1 --2- 172.21.15.47:0/3165427124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f95a45c3b0 0x55f95a479630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f8276c1b740 1 --2- 172.21.15.47:0/3165427124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f95a45ba90 0x55f95a47c140 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f8276c1b740 1 -- 172.21.15.47:0/3165427124 >> 172.21.15.47:0/3165427124 conn(0x55f95a4598c0 msgr2=0x55f95a4642d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:06.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f8255ffb640 0 client.16113 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:06.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f8276c1b740 1 -- 172.21.15.47:0/3165427124 shutdown_connections 2024-07-24T22:10:06.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f8276c1b740 1 -- 172.21.15.47:0/3165427124 wait complete. 2024-07-24T22:10:06.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f8276c1b740 20 client.16113 trim_cache size 0 max 16384 2024-07-24T22:10:06.875 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:10:06.875 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:10:06.875 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:10:06.875 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:10:06.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f827486a640 1 -- 172.21.15.47:0/2588056447 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f825c0b3dc0 msgr2=0x7f825c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:06.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f827486a640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f825c0b3dc0 0x7f825c0b6280 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8260031440 tx=0x7f8260005d10 comp rx=0 tx=0).stop 2024-07-24T22:10:06.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f827486a640 1 -- 172.21.15.47:0/2588056447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82701079e0 msgr2=0x7f827019d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:06.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.868+0000 7f827486a640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82701079e0 0x7f827019d5d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f826800b990 tx=0x7f826800be50 comp rx=0 tx=0).stop 2024-07-24T22:10:06.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.869+0000 7f827486a640 1 -- 172.21.15.47:0/2588056447 shutdown_connections 2024-07-24T22:10:06.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.869+0000 7f827486a640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f825c0b3dc0 0x7f825c0b6280 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.869+0000 7f827486a640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82701079e0 0x7f827019d5d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.869+0000 7f827486a640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8270107060 0x7f8270198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.869+0000 7f827486a640 1 --2- 172.21.15.47:0/2588056447 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8270101650 0x7f8270197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:06.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.869+0000 7f827486a640 1 -- 172.21.15.47:0/2588056447 >> 172.21.15.47:0/2588056447 conn(0x7f82700fd0c0 msgr2=0x7f82700ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:06.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.869+0000 7f827486a640 1 -- 172.21.15.47:0/2588056447 shutdown_connections 2024-07-24T22:10:06.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:06.869+0000 7f827486a640 1 -- 172.21.15.47:0/2588056447 wait complete. 2024-07-24T22:10:07.370 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:07 smithi047 ceph-mon[32551]: pgmap v453: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 498 MiB/s wr, 368 op/s 2024-07-24T22:10:07.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:07 smithi183 ceph-mon[37007]: pgmap v453: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 498 MiB/s wr, 368 op/s 2024-07-24T22:10:07.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:07 smithi188 ceph-mon[37380]: pgmap v453: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 498 MiB/s wr, 368 op/s 2024-07-24T22:10:08.045 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:10:08.045 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:10:08.781 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:10:09.008 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-24T22:10:09.009 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-07-24T22:10:09.009 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:10:09.434 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:09 smithi047 ceph-mon[32551]: pgmap v454: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 516 MiB/s wr, 522 op/s 2024-07-24T22:10:09.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:09 smithi183 ceph-mon[37007]: pgmap v454: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 516 MiB/s wr, 522 op/s 2024-07-24T22:10:09.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:09 smithi188 ceph-mon[37380]: pgmap v454: 97 pgs: 97 active+clean; 20 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 516 MiB/s wr, 522 op/s 2024-07-24T22:10:11.473 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:11 smithi047 ceph-mon[32551]: pgmap v455: 97 pgs: 97 active+clean; 21 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 693 KiB/s rd, 495 MiB/s wr, 894 op/s 2024-07-24T22:10:11.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:11 smithi183 ceph-mon[37007]: pgmap v455: 97 pgs: 97 active+clean; 21 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 693 KiB/s rd, 495 MiB/s wr, 894 op/s 2024-07-24T22:10:11.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.574+0000 7f96a32ae640 1 -- 172.21.15.47:0/4210461178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f969c103660 msgr2=0x7f969c103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:11.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.574+0000 7f96a32ae640 1 --2- 172.21.15.47:0/4210461178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f969c103660 0x7f969c103a40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9698009900 tx=0x7f969802a410 comp rx=0 tx=0).stop 2024-07-24T22:10:11.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.574+0000 7f96a32ae640 1 -- 172.21.15.47:0/4210461178 shutdown_connections 2024-07-24T22:10:11.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.574+0000 7f96a32ae640 1 --2- 172.21.15.47:0/4210461178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c10cac0 0x7f969c10ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:11.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.574+0000 7f96a32ae640 1 --2- 172.21.15.47:0/4210461178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f969c103f80 0x7f969c10c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:11.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.574+0000 7f96a32ae640 1 --2- 172.21.15.47:0/4210461178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f969c103660 0x7f969c103a40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:11.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.574+0000 7f96a32ae640 1 -- 172.21.15.47:0/4210461178 >> 172.21.15.47:0/4210461178 conn(0x7f969c0fd0c0 msgr2=0x7f969c0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:11.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.574+0000 7f96a32ae640 1 -- 172.21.15.47:0/4210461178 shutdown_connections 2024-07-24T22:10:11.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.574+0000 7f96a32ae640 1 -- 172.21.15.47:0/4210461178 wait complete. 2024-07-24T22:10:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a32ae640 1 Processor -- start 2024-07-24T22:10:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a32ae640 1 -- start start 2024-07-24T22:10:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a32ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f969c103660 0x7f969c198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a32ae640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f969c103f80 0x7f969c1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a32ae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c10cac0 0x7f969c19e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a32ae640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f969c112700 con 0x7f969c10cac0 2024-07-24T22:10:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a32ae640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f969c112580 con 0x7f969c103f80 2024-07-24T22:10:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a32ae640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f969c112880 con 0x7f969c103660 2024-07-24T22:10:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a0849640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f969c103f80 0x7f969c1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a184b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c10cac0 0x7f969c19e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a0849640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f969c103f80 0x7f969c1991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:37422/0 (socket says 172.21.15.47:37422) 2024-07-24T22:10:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a184b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c10cac0 0x7f969c19e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44640/0 (socket says 172.21.15.47:44640) 2024-07-24T22:10:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a0849640 1 -- 172.21.15.47:0/1476421595 learned_addr learned my addr 172.21.15.47:0/1476421595 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a104a640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f969c103660 0x7f969c198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a0849640 1 -- 172.21.15.47:0/1476421595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f969c103660 msgr2=0x7f969c198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.575+0000 7f96a0849640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f969c103660 0x7f969c198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.576+0000 7f96a0849640 1 -- 172.21.15.47:0/1476421595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c10cac0 msgr2=0x7f969c19e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.576+0000 7f96a0849640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c10cac0 0x7f969c19e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.576+0000 7f96a0849640 1 -- 172.21.15.47:0/1476421595 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c19ed40 con 0x7f969c103f80 2024-07-24T22:10:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.576+0000 7f96a184b640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c10cac0 0x7f969c19e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:10:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.576+0000 7f96a0849640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f969c103f80 0x7f969c1991d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f968c00e9c0 tx=0x7f968c00edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.576+0000 7f96927fc640 1 -- 172.21.15.47:0/1476421595 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c004220 con 0x7f969c103f80 2024-07-24T22:10:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.576+0000 7f96a32ae640 1 -- 172.21.15.47:0/1476421595 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969c19f030 con 0x7f969c103f80 2024-07-24T22:10:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.576+0000 7f96a32ae640 1 -- 172.21.15.47:0/1476421595 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f969c1a58c0 con 0x7f969c103f80 2024-07-24T22:10:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.576+0000 7f96927fc640 1 -- 172.21.15.47:0/1476421595 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f968c0043c0 con 0x7f969c103f80 2024-07-24T22:10:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.576+0000 7f96927fc640 1 -- 172.21.15.47:0/1476421595 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c003df0 con 0x7f969c103f80 2024-07-24T22:10:11.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.578+0000 7f96a32ae640 1 -- 172.21.15.47:0/1476421595 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96800052c0 con 0x7f969c103f80 2024-07-24T22:10:11.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.579+0000 7f96927fc640 1 -- 172.21.15.47:0/1476421595 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f968c0035f0 con 0x7f969c103f80 2024-07-24T22:10:11.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.580+0000 7f96927fc640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f96880b3dc0 0x7f96880b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:11.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.580+0000 7f96927fc640 1 -- 172.21.15.47:0/1476421595 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f968c0e44d0 con 0x7f969c103f80 2024-07-24T22:10:11.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.580+0000 7f96a104a640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f96880b3dc0 0x7f96880b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:11.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.580+0000 7f96a104a640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f96880b3dc0 0x7f96880b6280 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9698031440 tx=0x7f96980095f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:11.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.584+0000 7f96927fc640 1 -- 172.21.15.47:0/1476421595 <== mon.2 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f968c0ab7e0 con 0x7f969c103f80 2024-07-24T22:10:11.694 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:10:11.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:11 smithi188 ceph-mon[37380]: pgmap v455: 97 pgs: 97 active+clean; 21 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 693 KiB/s rd, 495 MiB/s wr, 894 op/s 2024-07-24T22:10:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:10:11.893 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:10:11.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.886+0000 7f96a32ae640 1 -- 172.21.15.47:0/1476421595 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9680005880 con 0x7f969c103f80 2024-07-24T22:10:11.893 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:10:11.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.889+0000 7f96927fc640 1 -- 172.21.15.47:0/1476421595 <== mon.2 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f968c0ab0e0 con 0x7f969c103f80 2024-07-24T22:10:11.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.898+0000 7f96a32ae640 1 -- 172.21.15.47:0/1476421595 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f96880b3dc0 msgr2=0x7f96880b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:11.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.898+0000 7f96a32ae640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f96880b3dc0 0x7f96880b6280 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9698031440 tx=0x7f96980095f0 comp rx=0 tx=0).stop 2024-07-24T22:10:11.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.898+0000 7f96a32ae640 1 -- 172.21.15.47:0/1476421595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f969c103f80 msgr2=0x7f969c1991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:11.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.898+0000 7f96a32ae640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f969c103f80 0x7f969c1991d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f968c00e9c0 tx=0x7f968c00edc0 comp rx=0 tx=0).stop 2024-07-24T22:10:11.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.900+0000 7f96a32ae640 1 -- 172.21.15.47:0/1476421595 shutdown_connections 2024-07-24T22:10:11.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.901+0000 7f96a32ae640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f96880b3dc0 0x7f96880b6280 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:11.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.901+0000 7f96a32ae640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c10cac0 0x7f969c19e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:11.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.901+0000 7f96a32ae640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f969c103f80 0x7f969c1991d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:11.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.901+0000 7f96a32ae640 1 --2- 172.21.15.47:0/1476421595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f969c103660 0x7f969c198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:11.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.901+0000 7f96a32ae640 1 -- 172.21.15.47:0/1476421595 >> 172.21.15.47:0/1476421595 conn(0x7f969c0fd0c0 msgr2=0x7f969c0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:11.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.901+0000 7f96a32ae640 1 -- 172.21.15.47:0/1476421595 shutdown_connections 2024-07-24T22:10:11.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:11.901+0000 7f96a32ae640 1 -- 172.21.15.47:0/1476421595 wait complete. 2024-07-24T22:10:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.079+0000 7f2898409640 1 -- 172.21.15.47:0/4266933796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2890107040 msgr2=0x7f2890107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.079+0000 7f2898409640 1 --2- 172.21.15.47:0/4266933796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2890107040 0x7f2890107480 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2880009900 tx=0x7f288002a410 comp rx=0 tx=0).stop 2024-07-24T22:10:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.080+0000 7f2898409640 1 -- 172.21.15.47:0/4266933796 shutdown_connections 2024-07-24T22:10:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.080+0000 7f2898409640 1 --2- 172.21.15.47:0/4266933796 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28901079c0 0x7f289010e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.080+0000 7f2898409640 1 --2- 172.21.15.47:0/4266933796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2890107040 0x7f2890107480 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.080+0000 7f2898409640 1 --2- 172.21.15.47:0/4266933796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2890101640 0x7f2890101a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.080+0000 7f2898409640 1 -- 172.21.15.47:0/4266933796 >> 172.21.15.47:0/4266933796 conn(0x7f28900fd080 msgr2=0x7f28900ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.080+0000 7f2898409640 1 -- 172.21.15.47:0/4266933796 shutdown_connections 2024-07-24T22:10:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.080+0000 7f2898409640 1 -- 172.21.15.47:0/4266933796 wait complete. 2024-07-24T22:10:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.080+0000 7f2898409640 1 Processor -- start 2024-07-24T22:10:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.080+0000 7f2898409640 1 -- start start 2024-07-24T22:10:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.081+0000 7f2898409640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2890101640 0x7f289019af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.081+0000 7f2898409640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2890107040 0x7f289019b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.081+0000 7f28959a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2890107040 0x7f289019b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.081+0000 7f28959a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2890107040 0x7f289019b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44654/0 (socket says 172.21.15.47:44654) 2024-07-24T22:10:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.081+0000 7f28961a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2890101640 0x7f289019af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.081+0000 7f28961a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2890101640 0x7f289019af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:55060/0 (socket says 172.21.15.47:55060) 2024-07-24T22:10:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.081+0000 7f2898409640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28901079c0 0x7f28901a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.081+0000 7f28959a4640 1 -- 172.21.15.47:0/3102341243 learned_addr learned my addr 172.21.15.47:0/3102341243 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.081+0000 7f2898409640 1 -- 172.21.15.47:0/3102341243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f28901116b0 con 0x7f2890107040 2024-07-24T22:10:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.081+0000 7f2898409640 1 -- 172.21.15.47:0/3102341243 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2890111530 con 0x7f28901079c0 2024-07-24T22:10:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.081+0000 7f2898409640 1 -- 172.21.15.47:0/3102341243 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2890111830 con 0x7f2890101640 2024-07-24T22:10:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.081+0000 7f28969a6640 1 --2- 172.21.15.47:0/3102341243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28901079c0 0x7f28901a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.082+0000 7f28959a4640 1 -- 172.21.15.47:0/3102341243 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2890101640 msgr2=0x7f289019af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.082+0000 7f28959a4640 1 --2- 172.21.15.47:0/3102341243 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2890101640 0x7f289019af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.082+0000 7f28959a4640 1 -- 172.21.15.47:0/3102341243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28901079c0 msgr2=0x7f28901a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.082+0000 7f28959a4640 1 --2- 172.21.15.47:0/3102341243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28901079c0 0x7f28901a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.082+0000 7f28959a4640 1 -- 172.21.15.47:0/3102341243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28901a0fc0 con 0x7f2890107040 2024-07-24T22:10:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.082+0000 7f28959a4640 1 --2- 172.21.15.47:0/3102341243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2890107040 0x7f289019b460 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2880005ab0 tx=0x7f2880003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.082+0000 7f28877fe640 1 -- 172.21.15.47:0/3102341243 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288003f070 con 0x7f2890107040 2024-07-24T22:10:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.082+0000 7f28877fe640 1 -- 172.21.15.47:0/3102341243 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2880031d60 con 0x7f2890107040 2024-07-24T22:10:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.082+0000 7f28877fe640 1 -- 172.21.15.47:0/3102341243 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880035030 con 0x7f2890107040 2024-07-24T22:10:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.082+0000 7f2898409640 1 -- 172.21.15.47:0/3102341243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28901a1250 con 0x7f2890107040 2024-07-24T22:10:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.083+0000 7f2898409640 1 -- 172.21.15.47:0/3102341243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28901a7970 con 0x7f2890107040 2024-07-24T22:10:12.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.086+0000 7f289b235740 1 Processor -- start 2024-07-24T22:10:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.086+0000 7f289b235740 1 -- start start 2024-07-24T22:10:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f28877fe640 1 -- 172.21.15.47:0/3102341243 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f2880042070 con 0x7f2890107040 2024-07-24T22:10:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f289b235740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca438c0 0x557a6ca43ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f289b235740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca4fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f289b235740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca50170 0x557a6ca52560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f289b235740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557a6c9b9280 con 0x557a6ca438c0 2024-07-24T22:10:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f289b235740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557a6c9a8780 con 0x557a6ca441e0 2024-07-24T22:10:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f289b235740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557a6c9ac7c0 con 0x557a6ca50170 2024-07-24T22:10:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f28969a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca438c0 0x557a6ca43ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f28969a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca438c0 0x557a6ca43ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44660/0 (socket says 172.21.15.47:44660) 2024-07-24T22:10:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f28969a6640 1 -- 172.21.15.47:0/3799128479 learned_addr learned my addr 172.21.15.47:0/3799128479 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f28961a5640 1 --2- 172.21.15.47:0/3799128479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca4fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f28969a6640 1 -- 172.21.15.47:0/3799128479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca50170 msgr2=0x557a6ca52560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f28969a6640 1 --2- 172.21.15.47:0/3799128479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca50170 0x557a6ca52560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f28969a6640 1 -- 172.21.15.47:0/3799128479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 msgr2=0x557a6ca4fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f28969a6640 1 --2- 172.21.15.47:0/3799128479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca4fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.087+0000 7f28969a6640 1 -- 172.21.15.47:0/3799128479 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a6c70c790 con 0x557a6ca438c0 2024-07-24T22:10:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.088+0000 7f28969a6640 1 --2- 172.21.15.47:0/3799128479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca438c0 0x557a6ca43ca0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f288800a430 tx=0x7f2888009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ae53d0c54a3e62 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.088+0000 7f2884bfe640 1 -- 172.21.15.47:0/3799128479 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888013790 con 0x557a6ca438c0 2024-07-24T22:10:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.088+0000 7f2884bfe640 1 -- 172.21.15.47:0/3799128479 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2888019070 con 0x557a6ca438c0 2024-07-24T22:10:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.088+0000 7f28877fe640 1 --2- 172.21.15.47:0/3102341243 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f287c0b3e40 0x7f287c0b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.088+0000 7f2884bfe640 1 -- 172.21.15.47:0/3799128479 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888014ce0 con 0x557a6ca438c0 2024-07-24T22:10:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.088+0000 7f28961a5640 1 --2- 172.21.15.47:0/3102341243 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f287c0b3e40 0x7f287c0b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.088+0000 7f28877fe640 1 -- 172.21.15.47:0/3102341243 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f28801048c0 con 0x7f2890107040 2024-07-24T22:10:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.089+0000 7f289b235740 1 -- 172.21.15.47:0/3799128479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca438c0 msgr2=0x557a6ca43ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.089+0000 7f28961a5640 1 --2- 172.21.15.47:0/3102341243 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f287c0b3e40 0x7f287c0b6300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x557a6ca46a40 tx=0x7f288c00b4d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.089+0000 7f289b235740 1 --2- 172.21.15.47:0/3799128479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca438c0 0x557a6ca43ca0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f288800a430 tx=0x7f2888009650 comp rx=0 tx=0).stop 2024-07-24T22:10:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.089+0000 7f289b235740 1 -- 172.21.15.47:0/3799128479 shutdown_connections 2024-07-24T22:10:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.089+0000 7f289b235740 1 --2- 172.21.15.47:0/3799128479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca50170 0x557a6ca52560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.089+0000 7f289b235740 1 --2- 172.21.15.47:0/3799128479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca4fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.089+0000 7f289b235740 1 --2- 172.21.15.47:0/3799128479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca438c0 0x557a6ca43ca0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.089+0000 7f289b235740 1 -- 172.21.15.47:0/3799128479 >> 172.21.15.47:0/3799128479 conn(0x557a6ca416f0 msgr2=0x557a6ca42890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.089+0000 7f289b235740 1 -- 172.21.15.47:0/3799128479 shutdown_connections 2024-07-24T22:10:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.089+0000 7f289b235740 1 -- 172.21.15.47:0/3799128479 wait complete. 2024-07-24T22:10:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.090+0000 7f289b235740 1 -- start start 2024-07-24T22:10:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.090+0000 7f289b235740 1 Processor -- start 2024-07-24T22:10:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.090+0000 7f289b235740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca438c0 0x557a6ca4f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.090+0000 7f289b235740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca4ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.090+0000 7f289b235740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca50170 0x557a6ca4d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.090+0000 7f289b235740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557a6c8e2ab0 con 0x557a6ca50170 2024-07-24T22:10:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.090+0000 7f289b235740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557a6c9309e0 con 0x557a6ca441e0 2024-07-24T22:10:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.090+0000 7f289b235740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557a6ca52e50 con 0x557a6ca438c0 2024-07-24T22:10:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.090+0000 7f289b235740 10 client.0 _ll_register_callbacks cb 0x557a6c6b8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.090+0000 7f28969a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca50170 0x557a6ca4d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.090+0000 7f28969a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca50170 0x557a6ca4d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44674/0 (socket says 172.21.15.47:44674) 2024-07-24T22:10:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.090+0000 7f28969a6640 1 -- 172.21.15.47:0/2364469040 learned_addr learned my addr 172.21.15.47:0/2364469040 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.090+0000 7f28959a4640 1 --2- 172.21.15.47:0/2364469040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca4ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.091+0000 7f28969a6640 1 -- 172.21.15.47:0/2364469040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca438c0 msgr2=0x557a6ca4f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.091+0000 7f28969a6640 1 --2- 172.21.15.47:0/2364469040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca438c0 0x557a6ca4f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.091+0000 7f28969a6640 1 -- 172.21.15.47:0/2364469040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 msgr2=0x557a6ca4ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.091+0000 7f28969a6640 1 --2- 172.21.15.47:0/2364469040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca4ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.091+0000 7f28969a6640 1 -- 172.21.15.47:0/2364469040 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a6c785620 con 0x557a6ca50170 2024-07-24T22:10:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.091+0000 7f28969a6640 1 --2- 172.21.15.47:0/2364469040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca50170 0x557a6ca4d370 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f288800afd0 tx=0x7f2888009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9761353080539857 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.091+0000 7f2879ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:10:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.091+0000 7f2879ffb640 1 -- 172.21.15.47:0/2364469040 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888013590 con 0x557a6ca50170 2024-07-24T22:10:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.091+0000 7f2879ffb640 1 -- 172.21.15.47:0/2364469040 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f2888013730 con 0x557a6ca50170 2024-07-24T22:10:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.091+0000 7f289b235740 1 -- 172.21.15.47:0/2364469040 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557a6c957ce0 con 0x557a6ca50170 2024-07-24T22:10:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.091+0000 7f2879ffb640 1 -- 172.21.15.47:0/2364469040 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2888013930 con 0x557a6ca50170 2024-07-24T22:10:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.091+0000 7f289b235740 10 client.16131 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.091+0000 7f289b235740 1 -- 172.21.15.47:0/2364469040 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557a6ca66ef0 con 0x557a6ca50170 2024-07-24T22:10:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.092+0000 7f2879ffb640 1 -- 172.21.15.47:0/2364469040 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2888019040 con 0x557a6ca50170 2024-07-24T22:10:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.092+0000 7f2879ffb640 1 -- 172.21.15.47:0/2364469040 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2888030bd0 con 0x557a6ca50170 2024-07-24T22:10:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.092+0000 7f289b235740 10 client.16131 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.092+0000 7f289b235740 10 client.16131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.092+0000 7f289b235740 20 client.16131 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.092+0000 7f289b235740 1 --2- 172.21.15.47:0/2364469040 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557a6ca682f0 0x557a6ca6a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.092+0000 7f289b235740 4 client.16131 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:10:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.092+0000 7f289b235740 1 -- 172.21.15.47:0/2364469040 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a6c957ce0 con 0x557a6ca682f0 2024-07-24T22:10:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.093+0000 7f28961a5640 1 --2- 172.21.15.47:0/2364469040 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557a6ca682f0 0x557a6ca6a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.093+0000 7f2879ffb640 10 client.16131 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.093+0000 7f28961a5640 1 --2- 172.21.15.47:0/2364469040 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557a6ca682f0 0x557a6ca6a6e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3905cb80731e8a server_cookie=87ec111d970161fe in_seq=0 out_seq=0 2024-07-24T22:10:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.094+0000 7f2879ffb640 1 -- 172.21.15.47:0/2364469040 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a6c957ce0 con 0x557a6ca682f0 2024-07-24T22:10:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.094+0000 7f2879ffb640 10 client.16131 handle_command_reply: tid=0 2024-07-24T22:10:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.094+0000 7f289b235740 1 client.16131 shutdown 2024-07-24T22:10:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.095+0000 7f289b235740 1 -- 172.21.15.47:0/2364469040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca50170 msgr2=0x557a6ca4d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.095+0000 7f289b235740 1 --2- 172.21.15.47:0/2364469040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca50170 0x557a6ca4d370 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f288800afd0 tx=0x7f2888009ce0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.095+0000 7f289b235740 1 -- 172.21.15.47:0/2364469040 shutdown_connections 2024-07-24T22:10:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.095+0000 7f289b235740 1 --2- 172.21.15.47:0/2364469040 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557a6ca682f0 0x557a6ca6a6e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.095+0000 7f289b235740 1 --2- 172.21.15.47:0/2364469040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca50170 0x557a6ca4d370 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.095+0000 7f2879ffb640 0 client.16131 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.095+0000 7f289b235740 1 --2- 172.21.15.47:0/2364469040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca4ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.095+0000 7f289b235740 1 --2- 172.21.15.47:0/2364469040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca438c0 0x557a6ca4f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.095+0000 7f289b235740 1 -- 172.21.15.47:0/2364469040 >> 172.21.15.47:0/2364469040 conn(0x557a6ca416f0 msgr2=0x557a6ca47290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:12.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.095+0000 7f289b235740 1 -- 172.21.15.47:0/2364469040 shutdown_connections 2024-07-24T22:10:12.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.095+0000 7f289b235740 1 -- 172.21.15.47:0/2364469040 wait complete. 2024-07-24T22:10:12.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.095+0000 7f289b235740 20 client.16131 trim_cache size 0 max 16384 2024-07-24T22:10:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.111+0000 7f289b235740 1 Processor -- start 2024-07-24T22:10:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.111+0000 7f289b235740 1 -- start start 2024-07-24T22:10:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.111+0000 7f289b235740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca438c0 0x557a6ca48280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.111+0000 7f289b235740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca6d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.111+0000 7f289b235740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca50170 0x557a6ca6dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.111+0000 7f289b235740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f28901aa070 con 0x557a6ca438c0 2024-07-24T22:10:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.111+0000 7f289b235740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f28901ac8b0 con 0x557a6ca441e0 2024-07-24T22:10:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.111+0000 7f289b235740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f28901aa6c0 con 0x557a6ca50170 2024-07-24T22:10:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.111+0000 7f28969a6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca50170 0x557a6ca6dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.111+0000 7f28969a6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca50170 0x557a6ca6dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:55084/0 (socket says 172.21.15.47:55084) 2024-07-24T22:10:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.111+0000 7f28969a6640 1 -- 172.21.15.47:0/2275756011 learned_addr learned my addr 172.21.15.47:0/2275756011 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.111+0000 7f28961a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca438c0 0x557a6ca48280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.111+0000 7f28959a4640 1 --2- 172.21.15.47:0/2275756011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca6d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.112+0000 7f28969a6640 1 -- 172.21.15.47:0/2275756011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 msgr2=0x557a6ca6d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.112+0000 7f28969a6640 1 --2- 172.21.15.47:0/2275756011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca6d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.112+0000 7f28969a6640 1 -- 172.21.15.47:0/2275756011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca438c0 msgr2=0x557a6ca48280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.112+0000 7f28969a6640 1 --2- 172.21.15.47:0/2275756011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca438c0 0x557a6ca48280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.112+0000 7f28969a6640 1 -- 172.21.15.47:0/2275756011 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a6ca4cc10 con 0x557a6ca50170 2024-07-24T22:10:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.112+0000 7f28969a6640 1 --2- 172.21.15.47:0/2275756011 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca50170 0x557a6ca6dc40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2888004b90 tx=0x7f2888009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db9d37896ee0dc01 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:12.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.126+0000 7f287bfff640 1 -- 172.21.15.47:0/2275756011 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288800ae30 con 0x557a6ca50170 2024-07-24T22:10:12.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.126+0000 7f287bfff640 1 -- 172.21.15.47:0/2275756011 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2888035020 con 0x557a6ca50170 2024-07-24T22:10:12.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.126+0000 7f287bfff640 1 -- 172.21.15.47:0/2275756011 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288801dc80 con 0x557a6ca50170 2024-07-24T22:10:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.127+0000 7f289b235740 1 -- 172.21.15.47:0/2275756011 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca50170 msgr2=0x557a6ca6dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.127+0000 7f289b235740 1 --2- 172.21.15.47:0/2275756011 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca50170 0x557a6ca6dc40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2888004b90 tx=0x7f2888009f00 comp rx=0 tx=0).stop 2024-07-24T22:10:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.127+0000 7f289b235740 1 -- 172.21.15.47:0/2275756011 shutdown_connections 2024-07-24T22:10:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.127+0000 7f289b235740 1 --2- 172.21.15.47:0/2275756011 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca50170 0x557a6ca6dc40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.127+0000 7f289b235740 1 --2- 172.21.15.47:0/2275756011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca6d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.127+0000 7f289b235740 1 --2- 172.21.15.47:0/2275756011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca438c0 0x557a6ca48280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.127+0000 7f289b235740 1 -- 172.21.15.47:0/2275756011 >> 172.21.15.47:0/2275756011 conn(0x557a6ca416f0 msgr2=0x557a6ca47b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.128+0000 7f289b235740 1 -- 172.21.15.47:0/2275756011 shutdown_connections 2024-07-24T22:10:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.128+0000 7f289b235740 1 -- 172.21.15.47:0/2275756011 wait complete. 2024-07-24T22:10:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.128+0000 7f289b235740 1 -- start start 2024-07-24T22:10:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.128+0000 7f289b235740 1 Processor -- start 2024-07-24T22:10:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f289b235740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca438c0 0x557a6ca6a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f289b235740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca6aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f289b235740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca50170 0x557a6cad0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f28961a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca438c0 0x557a6ca6a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f28959a4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca6aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f28961a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca438c0 0x557a6ca6a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:55100/0 (socket says 172.21.15.47:55100) 2024-07-24T22:10:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f28959a4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca6aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:37486/0 (socket says 172.21.15.47:37486) 2024-07-24T22:10:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f28969a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca50170 0x557a6cad0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f28961a5640 1 -- 172.21.15.47:0/3424933089 learned_addr learned my addr 172.21.15.47:0/3424933089 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f289b235740 1 -- 172.21.15.47:0/3424933089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f28901aad70 con 0x557a6ca50170 2024-07-24T22:10:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f289b235740 1 -- 172.21.15.47:0/3424933089 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f28901ac1e0 con 0x557a6ca441e0 2024-07-24T22:10:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f289b235740 1 -- 172.21.15.47:0/3424933089 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f28901ab440 con 0x557a6ca438c0 2024-07-24T22:10:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f289b235740 10 client.0 _ll_register_callbacks cb 0x7f288c00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f28961a5640 1 -- 172.21.15.47:0/3424933089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 msgr2=0x557a6ca6aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f28961a5640 1 --2- 172.21.15.47:0/3424933089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca6aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f28961a5640 1 -- 172.21.15.47:0/3424933089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca50170 msgr2=0x557a6cad0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f28961a5640 1 --2- 172.21.15.47:0/3424933089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca50170 0x557a6cad0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.129+0000 7f28961a5640 1 -- 172.21.15.47:0/3424933089 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a6cad1160 con 0x557a6ca438c0 2024-07-24T22:10:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.130+0000 7f28961a5640 1 --2- 172.21.15.47:0/3424933089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca438c0 0x557a6ca6a960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x557a6c8e2b10 tx=0x7f288c014040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbb059aebee1eb6c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.130+0000 7f2879ffb640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:10:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.130+0000 7f2879ffb640 1 -- 172.21.15.47:0/3424933089 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c036060 con 0x557a6ca438c0 2024-07-24T22:10:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.130+0000 7f2879ffb640 1 -- 172.21.15.47:0/3424933089 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f288c01de30 con 0x557a6ca438c0 2024-07-24T22:10:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.130+0000 7f289b235740 1 -- 172.21.15.47:0/3424933089 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2888035020 con 0x557a6ca438c0 2024-07-24T22:10:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.130+0000 7f2879ffb640 1 -- 172.21.15.47:0/3424933089 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f288c027370 con 0x557a6ca438c0 2024-07-24T22:10:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.130+0000 7f289b235740 10 client.25612 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.130+0000 7f289b235740 1 -- 172.21.15.47:0/3424933089 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557a6cad23c0 con 0x557a6ca438c0 2024-07-24T22:10:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.131+0000 7f2879ffb640 1 -- 172.21.15.47:0/3424933089 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2888035020 con 0x557a6ca438c0 2024-07-24T22:10:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.131+0000 7f2879ffb640 1 -- 172.21.15.47:0/3424933089 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f288c027050 con 0x557a6ca438c0 2024-07-24T22:10:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.131+0000 7f289b235740 10 client.25612 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.131+0000 7f289b235740 10 client.25612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.131+0000 7f289b235740 20 client.25612 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.131+0000 7f289b235740 1 --2- 172.21.15.47:0/3424933089 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557a6cad2b20 0x557a6cad4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.131+0000 7f289b235740 4 client.25612 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:10:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.131+0000 7f289b235740 1 -- 172.21.15.47:0/3424933089 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557a6c9bb1d0 con 0x557a6cad2b20 2024-07-24T22:10:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.131+0000 7f28959a4640 1 --2- 172.21.15.47:0/3424933089 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557a6cad2b20 0x557a6cad4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.132+0000 7f2879ffb640 10 client.25612 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:12.132+0000 7f28959a4640 1 --2- 172.21.15.47:0/3424933089 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557a6cad2b20 0x557a6cad4f40 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67735f82713b1595 server_cookie=97e7c8da04ca0460 in_seq=0 out_seq=0 2024-07-24T22:10:12.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:12 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1476421595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:10:12.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:12 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1476421595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:10:12.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:12 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1476421595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:10:13.430 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:13 smithi047 ceph-mon[32551]: pgmap v456: 97 pgs: 97 active+clean; 21 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 693 KiB/s rd, 497 MiB/s wr, 1.29k op/s 2024-07-24T22:10:13.486 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:10:13.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:13 smithi188 ceph-mon[37380]: pgmap v456: 97 pgs: 97 active+clean; 21 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 693 KiB/s rd, 497 MiB/s wr, 1.29k op/s 2024-07-24T22:10:13.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:13 smithi183 ceph-mon[37007]: pgmap v456: 97 pgs: 97 active+clean; 21 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 693 KiB/s rd, 497 MiB/s wr, 1.29k op/s 2024-07-24T22:10:15.077 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:10:15.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:15 smithi188 ceph-mon[37380]: pgmap v457: 97 pgs: 97 active+clean; 22 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 507 MiB/s wr, 1.71k op/s 2024-07-24T22:10:15.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:15 smithi047 ceph-mon[32551]: pgmap v457: 97 pgs: 97 active+clean; 22 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 507 MiB/s wr, 1.71k op/s 2024-07-24T22:10:15.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:15 smithi183 ceph-mon[37007]: pgmap v457: 97 pgs: 97 active+clean; 22 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 507 MiB/s wr, 1.71k op/s 2024-07-24T22:10:16.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.100+0000 7f5d992ca640 1 -- 172.21.15.47:0/1826873275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d94108af0 msgr2=0x7f5d9410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:16.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.100+0000 7f5d992ca640 1 --2- 172.21.15.47:0/1826873275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d94108af0 0x7f5d9410f2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009ca0 tx=0x7f5d8c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:10:16.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.100+0000 7f5d992ca640 1 -- 172.21.15.47:0/1826873275 shutdown_connections 2024-07-24T22:10:16.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.100+0000 7f5d992ca640 1 --2- 172.21.15.47:0/1826873275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d94108af0 0x7f5d9410f2f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:16.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.100+0000 7f5d992ca640 1 --2- 172.21.15.47:0/1826873275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d94108170 0x7f5d941085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:16.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.100+0000 7f5d992ca640 1 --2- 172.21.15.47:0/1826873275 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d94102760 0x7f5d94102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:16.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.100+0000 7f5d992ca640 1 -- 172.21.15.47:0/1826873275 >> 172.21.15.47:0/1826873275 conn(0x7f5d940fe210 msgr2=0x7f5d94100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:16.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.100+0000 7f5d992ca640 1 -- 172.21.15.47:0/1826873275 shutdown_connections 2024-07-24T22:10:16.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.100+0000 7f5d992ca640 1 -- 172.21.15.47:0/1826873275 wait complete. 2024-07-24T22:10:16.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.101+0000 7f5d992ca640 1 Processor -- start 2024-07-24T22:10:16.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.102+0000 7f5d992ca640 1 -- start start 2024-07-24T22:10:16.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.102+0000 7f5d992ca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d94102760 0x7f5d9410e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:16.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.103+0000 7f5d92ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d94102760 0x7f5d9410e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:16.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.103+0000 7f5d92ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d94102760 0x7f5d9410e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60060/0 (socket says 172.21.15.47:60060) 2024-07-24T22:10:16.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.103+0000 7f5d92ffd640 1 -- 172.21.15.47:0/2789698464 learned_addr learned my addr 172.21.15.47:0/2789698464 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:16.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.103+0000 7f5d992ca640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d94108170 0x7f5d9410e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:16.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.103+0000 7f5d992ca640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d94108af0 0x7f5d941a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:16.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.103+0000 7f5d992ca640 1 -- 172.21.15.47:0/2789698464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5d94112720 con 0x7f5d94102760 2024-07-24T22:10:16.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.103+0000 7f5d937fe640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d94108af0 0x7f5d941a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:16.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.103+0000 7f5d992ca640 1 -- 172.21.15.47:0/2789698464 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5d941125a0 con 0x7f5d94108af0 2024-07-24T22:10:16.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.104+0000 7f5d992ca640 1 -- 172.21.15.47:0/2789698464 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5d941128a0 con 0x7f5d94108170 2024-07-24T22:10:16.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.104+0000 7f5d927fc640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d94108170 0x7f5d9410e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:16.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.104+0000 7f5d937fe640 1 -- 172.21.15.47:0/2789698464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d94108170 msgr2=0x7f5d9410e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:16.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.104+0000 7f5d937fe640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d94108170 0x7f5d9410e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:16.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.104+0000 7f5d937fe640 1 -- 172.21.15.47:0/2789698464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d94102760 msgr2=0x7f5d9410e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:16.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.104+0000 7f5d937fe640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d94102760 0x7f5d9410e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:16.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.104+0000 7f5d937fe640 1 -- 172.21.15.47:0/2789698464 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d941a5300 con 0x7f5d94108af0 2024-07-24T22:10:16.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.105+0000 7f5d937fe640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d94108af0 0x7f5d941a4b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c02ade0 tx=0x7f5d8c0319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:16.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.106+0000 7f5d7bfff640 1 -- 172.21.15.47:0/2789698464 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c003bf0 con 0x7f5d94108af0 2024-07-24T22:10:16.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.106+0000 7f5d7bfff640 1 -- 172.21.15.47:0/2789698464 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d8c003d90 con 0x7f5d94108af0 2024-07-24T22:10:16.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.106+0000 7f5d7bfff640 1 -- 172.21.15.47:0/2789698464 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c02fbd0 con 0x7f5d94108af0 2024-07-24T22:10:16.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.107+0000 7f5d992ca640 1 -- 172.21.15.47:0/2789698464 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d941a5590 con 0x7f5d94108af0 2024-07-24T22:10:16.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.107+0000 7f5d992ca640 1 -- 172.21.15.47:0/2789698464 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d941abcb0 con 0x7f5d94108af0 2024-07-24T22:10:16.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.109+0000 7f5d992ca640 1 -- 172.21.15.47:0/2789698464 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d94102b40 con 0x7f5d94108af0 2024-07-24T22:10:16.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.111+0000 7f5d7bfff640 1 -- 172.21.15.47:0/2789698464 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f5d8c02fd70 con 0x7f5d94108af0 2024-07-24T22:10:16.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.112+0000 7f5d7bfff640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5d7c0b3e90 0x7f5d7c0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:16.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.112+0000 7f5d92ffd640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5d7c0b3e90 0x7f5d7c0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:16.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.112+0000 7f5d7bfff640 1 -- 172.21.15.47:0/2789698464 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f5d8c1053c0 con 0x7f5d94108af0 2024-07-24T22:10:16.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.113+0000 7f5d92ffd640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5d7c0b3e90 0x7f5d7c0b6350 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5d84005fd0 tx=0x7f5d8400b4a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:16.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.116+0000 7f5d7bfff640 1 -- 172.21.15.47:0/2789698464 <== mon.2 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f5d8c0098b0 con 0x7f5d94108af0 2024-07-24T22:10:16.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.447+0000 7f5d992ca640 1 -- 172.21.15.47:0/2789698464 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d941a03e0 con 0x7f5d94108af0 2024-07-24T22:10:16.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.448+0000 7f5d7bfff640 1 -- 172.21.15.47:0/2789698464 <== mon.2 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f5d8c0cc7e0 con 0x7f5d94108af0 2024-07-24T22:10:16.451 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:10:16.451 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:10:16.451 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:10:16.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.453+0000 7f5d992ca640 1 -- 172.21.15.47:0/2789698464 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5d7c0b3e90 msgr2=0x7f5d7c0b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:16.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.453+0000 7f5d992ca640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5d7c0b3e90 0x7f5d7c0b6350 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5d84005fd0 tx=0x7f5d8400b4a0 comp rx=0 tx=0).stop 2024-07-24T22:10:16.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.453+0000 7f5d992ca640 1 -- 172.21.15.47:0/2789698464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d94108af0 msgr2=0x7f5d941a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:16.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.453+0000 7f5d992ca640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d94108af0 0x7f5d941a4b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c02ade0 tx=0x7f5d8c0319f0 comp rx=0 tx=0).stop 2024-07-24T22:10:16.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.453+0000 7f5d992ca640 1 -- 172.21.15.47:0/2789698464 shutdown_connections 2024-07-24T22:10:16.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.453+0000 7f5d992ca640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5d7c0b3e90 0x7f5d7c0b6350 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:16.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.453+0000 7f5d992ca640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d94108af0 0x7f5d941a4b30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:16.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.453+0000 7f5d992ca640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d94108170 0x7f5d9410e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:16.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.453+0000 7f5d992ca640 1 --2- 172.21.15.47:0/2789698464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d94102760 0x7f5d9410e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:16.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.453+0000 7f5d992ca640 1 -- 172.21.15.47:0/2789698464 >> 172.21.15.47:0/2789698464 conn(0x7f5d940fe210 msgr2=0x7f5d941067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:16.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.454+0000 7f5d992ca640 1 -- 172.21.15.47:0/2789698464 shutdown_connections 2024-07-24T22:10:16.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:16.454+0000 7f5d992ca640 1 -- 172.21.15.47:0/2789698464 wait complete. 2024-07-24T22:10:16.649 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:16 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:10:16.649 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:16 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:10:16.649 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:16 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:10:16.649 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:16 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:10:16.649 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:16 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2789698464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:10:16.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:16 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:10:16.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:16 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:10:16.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:16 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:10:16.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:16 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:10:16.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:16 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2789698464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:10:16.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:16 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:10:16.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:16 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:10:16.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:16 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:10:16.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:16 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:10:16.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:16 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2789698464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:10:17.584 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-07-24T22:10:17.584 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-07-24T22:10:17.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:17 smithi188 ceph-mon[37380]: pgmap v458: 97 pgs: 97 active+clean; 22 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 1012 KiB/s rd, 462 MiB/s wr, 1.97k op/s 2024-07-24T22:10:17.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:17 smithi183 ceph-mon[37007]: pgmap v458: 97 pgs: 97 active+clean; 22 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 1012 KiB/s rd, 462 MiB/s wr, 1.97k op/s 2024-07-24T22:10:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:17 smithi047 ceph-mon[32551]: pgmap v458: 97 pgs: 97 active+clean; 22 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 1012 KiB/s rd, 462 MiB/s wr, 1.97k op/s 2024-07-24T22:10:18.272 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:10:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.402+0000 7f2879ffb640 1 -- 172.21.15.47:0/3424933089 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557a6c9bb1d0 con 0x557a6cad2b20 2024-07-24T22:10:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.402+0000 7f2879ffb640 10 client.25612 handle_command_reply: tid=0 2024-07-24T22:10:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.402+0000 7f289b235740 1 client.25612 shutdown 2024-07-24T22:10:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.403+0000 7f289b235740 1 -- 172.21.15.47:0/3424933089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca438c0 msgr2=0x557a6ca6a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.403+0000 7f289b235740 1 --2- 172.21.15.47:0/3424933089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca438c0 0x557a6ca6a960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x557a6c8e2b10 tx=0x7f288c014040 comp rx=0 tx=0).stop 2024-07-24T22:10:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.403+0000 7f289b235740 1 -- 172.21.15.47:0/3424933089 shutdown_connections 2024-07-24T22:10:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.403+0000 7f289b235740 1 --2- 172.21.15.47:0/3424933089 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557a6cad2b20 0x557a6cad4f40 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.403+0000 7f289b235740 1 --2- 172.21.15.47:0/3424933089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a6ca50170 0x557a6cad0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.403+0000 7f289b235740 1 --2- 172.21.15.47:0/3424933089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557a6ca441e0 0x557a6ca6aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.403+0000 7f289b235740 1 --2- 172.21.15.47:0/3424933089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a6ca438c0 0x557a6ca6a960 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.403+0000 7f289b235740 1 -- 172.21.15.47:0/3424933089 >> 172.21.15.47:0/3424933089 conn(0x557a6ca416f0 msgr2=0x557a6ca4eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.403+0000 7f2879ffb640 0 client.25612 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.404+0000 7f289b235740 1 -- 172.21.15.47:0/3424933089 shutdown_connections 2024-07-24T22:10:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.404+0000 7f289b235740 1 -- 172.21.15.47:0/3424933089 wait complete. 2024-07-24T22:10:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.404+0000 7f289b235740 20 client.25612 trim_cache size 0 max 16384 2024-07-24T22:10:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:10:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:10:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:10:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:10:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.405+0000 7f2898409640 1 -- 172.21.15.47:0/3102341243 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f287c0b3e40 msgr2=0x7f287c0b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.405+0000 7f2898409640 1 --2- 172.21.15.47:0/3102341243 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f287c0b3e40 0x7f287c0b6300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x557a6ca46a40 tx=0x7f288c00b4d0 comp rx=0 tx=0).stop 2024-07-24T22:10:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.405+0000 7f2898409640 1 -- 172.21.15.47:0/3102341243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2890107040 msgr2=0x7f289019b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.405+0000 7f2898409640 1 --2- 172.21.15.47:0/3102341243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2890107040 0x7f289019b460 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2880005ab0 tx=0x7f2880003cd0 comp rx=0 tx=0).stop 2024-07-24T22:10:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.405+0000 7f2898409640 1 -- 172.21.15.47:0/3102341243 shutdown_connections 2024-07-24T22:10:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.405+0000 7f2898409640 1 --2- 172.21.15.47:0/3102341243 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f287c0b3e40 0x7f287c0b6300 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.405+0000 7f2898409640 1 --2- 172.21.15.47:0/3102341243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28901079c0 0x7f28901a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.405+0000 7f2898409640 1 --2- 172.21.15.47:0/3102341243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2890107040 0x7f289019b460 secure :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2880005ab0 tx=0x7f2880003cd0 comp rx=0 tx=0).stop 2024-07-24T22:10:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.405+0000 7f2898409640 1 --2- 172.21.15.47:0/3102341243 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2890101640 0x7f289019af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.405+0000 7f2898409640 1 -- 172.21.15.47:0/3102341243 >> 172.21.15.47:0/3102341243 conn(0x7f28900fd080 msgr2=0x7f2890104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.406+0000 7f2898409640 1 -- 172.21.15.47:0/3102341243 shutdown_connections 2024-07-24T22:10:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:18.406+0000 7f2898409640 1 -- 172.21.15.47:0/3102341243 wait complete. 2024-07-24T22:10:19.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.298+0000 7ff70559a640 1 -- 172.21.15.47:0/3838075585 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc0035f0 con 0x7ff708109b40 2024-07-24T22:10:19.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.299+0000 7ff70cdcc640 1 -- 172.21.15.47:0/3838075585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff708109b40 msgr2=0x7ff708110ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:19.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.299+0000 7ff70cdcc640 1 --2- 172.21.15.47:0/3838075585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff708109b40 0x7ff708110ba0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009900 tx=0x7ff6fc02a4b0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.299+0000 7ff70cdcc640 1 -- 172.21.15.47:0/3838075585 shutdown_connections 2024-07-24T22:10:19.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.299+0000 7ff70cdcc640 1 --2- 172.21.15.47:0/3838075585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff70811ba90 0x7ff70811de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.299+0000 7ff70cdcc640 1 --2- 172.21.15.47:0/3838075585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff708109f20 0x7ff70810a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.299+0000 7ff70cdcc640 1 --2- 172.21.15.47:0/3838075585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff708109b40 0x7ff708110ba0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.299+0000 7ff70cdcc640 1 -- 172.21.15.47:0/3838075585 >> 172.21.15.47:0/3838075585 conn(0x7ff70806d980 msgr2=0x7ff70806dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:19.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.300+0000 7ff70cdcc640 1 -- 172.21.15.47:0/3838075585 shutdown_connections 2024-07-24T22:10:19.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.300+0000 7ff70cdcc640 1 -- 172.21.15.47:0/3838075585 wait complete. 2024-07-24T22:10:19.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.301+0000 7ff70cdcc640 1 Processor -- start 2024-07-24T22:10:19.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.301+0000 7ff70cdcc640 1 -- start start 2024-07-24T22:10:19.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.301+0000 7ff70cdcc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff708109b40 0x7ff7081a7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.302+0000 7ff70cdcc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff708109f20 0x7ff7081a8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.302+0000 7ff70cdcc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff70811ba90 0x7ff7081ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.302+0000 7ff70cdcc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff708121550 con 0x7ff708109b40 2024-07-24T22:10:19.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.302+0000 7ff70cdcc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff7081213d0 con 0x7ff708109f20 2024-07-24T22:10:19.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.302+0000 7ff70cdcc640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff7081216d0 con 0x7ff70811ba90 2024-07-24T22:10:19.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.302+0000 7ff70659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff708109b40 0x7ff7081a7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.302+0000 7ff70659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff708109b40 0x7ff7081a7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60080/0 (socket says 172.21.15.47:60080) 2024-07-24T22:10:19.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.302+0000 7ff70659c640 1 -- 172.21.15.47:0/4129891274 learned_addr learned my addr 172.21.15.47:0/4129891274 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:19.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.303+0000 7ff70659c640 1 -- 172.21.15.47:0/4129891274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff70811ba90 msgr2=0x7ff7081ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:19.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.303+0000 7ff70659c640 1 --2- 172.21.15.47:0/4129891274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff70811ba90 0x7ff7081ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.303+0000 7ff70659c640 1 -- 172.21.15.47:0/4129891274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff708109f20 msgr2=0x7ff7081a8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:19.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.303+0000 7ff70659c640 1 --2- 172.21.15.47:0/4129891274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff708109f20 0x7ff7081a8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.303+0000 7ff70659c640 1 -- 172.21.15.47:0/4129891274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7081adbb0 con 0x7ff708109b40 2024-07-24T22:10:19.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.304+0000 7ff70659c640 1 --2- 172.21.15.47:0/4129891274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff708109b40 0x7ff7081a7b00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc006010 tx=0x7ff6fc031ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:19.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.306+0000 7ff6f77fe640 1 -- 172.21.15.47:0/4129891274 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc040030 con 0x7ff708109b40 2024-07-24T22:10:19.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.306+0000 7ff6f77fe640 1 -- 172.21.15.47:0/4129891274 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6fc03c8f0 con 0x7ff708109b40 2024-07-24T22:10:19.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.306+0000 7ff6f77fe640 1 -- 172.21.15.47:0/4129891274 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc044980 con 0x7ff708109b40 2024-07-24T22:10:19.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.306+0000 7ff70cdcc640 1 -- 172.21.15.47:0/4129891274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7081ade40 con 0x7ff708109b40 2024-07-24T22:10:19.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.306+0000 7ff70cdcc640 1 -- 172.21.15.47:0/4129891274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7081b4560 con 0x7ff708109b40 2024-07-24T22:10:19.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.311+0000 7ff70f17d740 1 Processor -- start 2024-07-24T22:10:19.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.311+0000 7ff70f17d740 1 -- start start 2024-07-24T22:10:19.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.312+0000 7ff70f17d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3c6d0 0x556387e3cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.312+0000 7ff70f17d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3cff0 0x556387e48a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.312+0000 7ff70f17d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e48f80 0x556387e4b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.312+0000 7ff70f17d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556387db39b0 con 0x556387e3cff0 2024-07-24T22:10:19.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.312+0000 7ff70f17d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556387da2eb0 con 0x556387e3c6d0 2024-07-24T22:10:19.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.312+0000 7ff70f17d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556387da6ef0 con 0x556387e48f80 2024-07-24T22:10:19.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.314+0000 7ff705d9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e48f80 0x556387e4b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.315+0000 7ff6f77fe640 1 -- 172.21.15.47:0/4129891274 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7ff6fc043030 con 0x7ff708109b40 2024-07-24T22:10:19.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.315+0000 7ff706d9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3c6d0 0x556387e3cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.315+0000 7ff70659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3cff0 0x556387e48a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.315+0000 7ff705d9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e48f80 0x556387e4b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:48426/0 (socket says 172.21.15.47:48426) 2024-07-24T22:10:19.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.315+0000 7ff705d9b640 1 -- 172.21.15.47:0/3162795911 learned_addr learned my addr 172.21.15.47:0/3162795911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:19.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.316+0000 7ff6f77fe640 1 --2- 172.21.15.47:0/4129891274 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff6f00b3f10 0x7ff6f00b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.318+0000 7ff6f77fe640 1 -- 172.21.15.47:0/4129891274 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ff6fc104650 con 0x7ff708109b40 2024-07-24T22:10:19.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.318+0000 7ff70659c640 1 -- 172.21.15.47:0/3162795911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e48f80 msgr2=0x556387e4b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:19.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.318+0000 7ff70659c640 1 --2- 172.21.15.47:0/3162795911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e48f80 0x556387e4b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.318+0000 7ff70659c640 1 -- 172.21.15.47:0/3162795911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3c6d0 msgr2=0x556387e3cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:19.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.318+0000 7ff70659c640 1 --2- 172.21.15.47:0/3162795911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3c6d0 0x556387e3cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.319+0000 7ff70659c640 1 -- 172.21.15.47:0/3162795911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556387d2c320 con 0x556387e3cff0 2024-07-24T22:10:19.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.320+0000 7ff706d9d640 1 --2- 172.21.15.47:0/4129891274 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff6f00b3f10 0x7ff6f00b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.320+0000 7ff70659c640 1 --2- 172.21.15.47:0/3162795911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3cff0 0x556387e48a40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc101d40 tx=0x7ff6fc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13c427e71756b97 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:19.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.321+0000 7ff6f4ff9640 1 -- 172.21.15.47:0/3162795911 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc04a050 con 0x556387e3cff0 2024-07-24T22:10:19.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.321+0000 7ff6f4ff9640 1 -- 172.21.15.47:0/3162795911 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6fc0cad10 con 0x556387e3cff0 2024-07-24T22:10:19.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.322+0000 7ff6f4ff9640 1 -- 172.21.15.47:0/3162795911 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc101fc0 con 0x556387e3cff0 2024-07-24T22:10:19.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.323+0000 7ff70f17d740 1 -- 172.21.15.47:0/3162795911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3cff0 msgr2=0x556387e48a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:19.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.323+0000 7ff706d9d640 1 --2- 172.21.15.47:0/4129891274 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff6f00b3f10 0x7ff6f00b63d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff700005c40 tx=0x7ff700004a40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:19.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.323+0000 7ff70f17d740 1 --2- 172.21.15.47:0/3162795911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3cff0 0x556387e48a40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc101d40 tx=0x7ff6fc009260 comp rx=0 tx=0).stop 2024-07-24T22:10:19.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.323+0000 7ff70f17d740 1 -- 172.21.15.47:0/3162795911 shutdown_connections 2024-07-24T22:10:19.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.323+0000 7ff70f17d740 1 --2- 172.21.15.47:0/3162795911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e48f80 0x556387e4b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.323+0000 7ff70f17d740 1 --2- 172.21.15.47:0/3162795911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3cff0 0x556387e48a40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.323+0000 7ff70f17d740 1 --2- 172.21.15.47:0/3162795911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3c6d0 0x556387e3cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.323+0000 7ff70f17d740 1 -- 172.21.15.47:0/3162795911 >> 172.21.15.47:0/3162795911 conn(0x556387e3a500 msgr2=0x556387e3b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:19.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.323+0000 7ff70f17d740 1 -- 172.21.15.47:0/3162795911 shutdown_connections 2024-07-24T22:10:19.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.323+0000 7ff70f17d740 1 -- 172.21.15.47:0/3162795911 wait complete. 2024-07-24T22:10:19.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.324+0000 7ff70f17d740 1 -- start start 2024-07-24T22:10:19.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.324+0000 7ff70f17d740 1 Processor -- start 2024-07-24T22:10:19.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.325+0000 7ff70f17d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 0x556387e45f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.325+0000 7ff70f17d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3cff0 0x556387e464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.325+0000 7ff70f17d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e48f80 0x556387e46a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.325+0000 7ff70f17d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556387c06700 con 0x556387e3c6d0 2024-07-24T22:10:19.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.325+0000 7ff70f17d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556387d455f0 con 0x556387e3cff0 2024-07-24T22:10:19.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.325+0000 7ff70f17d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556387e4b9c0 con 0x556387e48f80 2024-07-24T22:10:19.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.325+0000 7ff70f17d740 10 client.0 _ll_register_callbacks cb 0x556387d65960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:19.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.325+0000 7ff70659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 0x556387e45f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.325+0000 7ff70659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 0x556387e45f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60102/0 (socket says 172.21.15.47:60102) 2024-07-24T22:10:19.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.325+0000 7ff70659c640 1 -- 172.21.15.47:0/121612196 learned_addr learned my addr 172.21.15.47:0/121612196 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:19.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.326+0000 7ff705d9b640 1 --2- 172.21.15.47:0/121612196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3cff0 0x556387e464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.326+0000 7ff706d9d640 1 --2- 172.21.15.47:0/121612196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e48f80 0x556387e46a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.326+0000 7ff70659c640 1 -- 172.21.15.47:0/121612196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e48f80 msgr2=0x556387e46a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:19.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.326+0000 7ff70659c640 1 --2- 172.21.15.47:0/121612196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e48f80 0x556387e46a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.327+0000 7ff70659c640 1 -- 172.21.15.47:0/121612196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3cff0 msgr2=0x556387e464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:19.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.327+0000 7ff70659c640 1 --2- 172.21.15.47:0/121612196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3cff0 0x556387e464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.327+0000 7ff70659c640 1 -- 172.21.15.47:0/121612196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556387d38680 con 0x556387e3c6d0 2024-07-24T22:10:19.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.327+0000 7ff70659c640 1 --2- 172.21.15.47:0/121612196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 0x556387e45f80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0cb190 tx=0x7ff6fc03ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1e30139f55953b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:19.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.327+0000 7ff6edffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:10:19.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.328+0000 7ff6edffb640 1 -- 172.21.15.47:0/121612196 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc0ca970 con 0x556387e3c6d0 2024-07-24T22:10:19.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.328+0000 7ff6edffb640 1 -- 172.21.15.47:0/121612196 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ff6fc0cb460 con 0x556387e3c6d0 2024-07-24T22:10:19.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.329+0000 7ff70f17d740 1 -- 172.21.15.47:0/121612196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6fc0cad10 con 0x556387e3c6d0 2024-07-24T22:10:19.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.329+0000 7ff6edffb640 1 -- 172.21.15.47:0/121612196 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff6fc04a030 con 0x556387e3c6d0 2024-07-24T22:10:19.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.330+0000 7ff70f17d740 10 client.16155 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:19.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.330+0000 7ff70f17d740 1 -- 172.21.15.47:0/121612196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556387b03650 con 0x556387e3c6d0 2024-07-24T22:10:19.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.331+0000 7ff6edffb640 1 -- 172.21.15.47:0/121612196 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6fc0cad10 con 0x556387e3c6d0 2024-07-24T22:10:19.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.331+0000 7ff6edffb640 1 -- 172.21.15.47:0/121612196 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff6fc0d3e20 con 0x556387e3c6d0 2024-07-24T22:10:19.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.331+0000 7ff70f17d740 10 client.16155 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:19.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.331+0000 7ff70f17d740 10 client.16155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:19.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.331+0000 7ff70f17d740 20 client.16155 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:19.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.331+0000 7ff70f17d740 1 --2- 172.21.15.47:0/121612196 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556387e58660 0x556387e5aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.331+0000 7ff70f17d740 4 client.16155 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:10:19.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.331+0000 7ff70f17d740 1 -- 172.21.15.47:0/121612196 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556387db5900 con 0x556387e58660 2024-07-24T22:10:19.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.333+0000 7ff705d9b640 1 --2- 172.21.15.47:0/121612196 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556387e58660 0x556387e5aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.333+0000 7ff705d9b640 1 --2- 172.21.15.47:0/121612196 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556387e58660 0x556387e5aa50 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50e0a886572ee3f0 server_cookie=978c66e5a73fd77b in_seq=0 out_seq=0 2024-07-24T22:10:19.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.333+0000 7ff6edffb640 10 client.16155 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:19.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.335+0000 7ff6edffb640 1 -- 172.21.15.47:0/121612196 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556387db5900 con 0x556387e58660 2024-07-24T22:10:19.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.335+0000 7ff6edffb640 10 client.16155 handle_command_reply: tid=0 2024-07-24T22:10:19.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.335+0000 7ff70f17d740 1 client.16155 shutdown 2024-07-24T22:10:19.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.335+0000 7ff70f17d740 1 -- 172.21.15.47:0/121612196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 msgr2=0x556387e45f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:19.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.335+0000 7ff70f17d740 1 --2- 172.21.15.47:0/121612196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 0x556387e45f80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0cb190 tx=0x7ff6fc03ccd0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.336+0000 7ff70f17d740 1 -- 172.21.15.47:0/121612196 shutdown_connections 2024-07-24T22:10:19.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.336+0000 7ff70f17d740 1 --2- 172.21.15.47:0/121612196 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556387e58660 0x556387e5aa50 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.336+0000 7ff70f17d740 1 --2- 172.21.15.47:0/121612196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e48f80 0x556387e46a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.336+0000 7ff70f17d740 1 --2- 172.21.15.47:0/121612196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3cff0 0x556387e464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.336+0000 7ff70f17d740 1 --2- 172.21.15.47:0/121612196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 0x556387e45f80 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.336+0000 7ff70f17d740 1 -- 172.21.15.47:0/121612196 >> 172.21.15.47:0/121612196 conn(0x556387e3a500 msgr2=0x556387e400a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:19.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.336+0000 7ff6edffb640 0 client.16155 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:19.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.337+0000 7ff70f17d740 1 -- 172.21.15.47:0/121612196 shutdown_connections 2024-07-24T22:10:19.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.338+0000 7ff70f17d740 1 -- 172.21.15.47:0/121612196 wait complete. 2024-07-24T22:10:19.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.338+0000 7ff70f17d740 20 client.16155 trim_cache size 0 max 16384 2024-07-24T22:10:19.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.373+0000 7ff70f17d740 1 Processor -- start 2024-07-24T22:10:19.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.373+0000 7ff70f17d740 1 -- start start 2024-07-24T22:10:19.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.374+0000 7ff70f17d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e3c6d0 0x556387e602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.374+0000 7ff70f17d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3cff0 0x556387e607e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.374+0000 7ff70f17d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e48f80 0x556387e43190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.374+0000 7ff70f17d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff7081bb0c0 con 0x556387e48f80 2024-07-24T22:10:19.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.374+0000 7ff70f17d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff7081bd940 con 0x556387e3cff0 2024-07-24T22:10:19.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.374+0000 7ff70f17d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff7081bb730 con 0x556387e3c6d0 2024-07-24T22:10:19.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.374+0000 7ff70659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e3c6d0 0x556387e602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.374+0000 7ff705d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3cff0 0x556387e607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.374+0000 7ff705d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3cff0 0x556387e607e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:34952/0 (socket says 172.21.15.47:34952) 2024-07-24T22:10:19.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.374+0000 7ff70659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e3c6d0 0x556387e602a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:48442/0 (socket says 172.21.15.47:48442) 2024-07-24T22:10:19.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.374+0000 7ff705d9b640 1 -- 172.21.15.47:0/1687536063 learned_addr learned my addr 172.21.15.47:0/1687536063 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:19.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.375+0000 7ff706d9d640 1 --2- 172.21.15.47:0/1687536063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e48f80 0x556387e43190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.375+0000 7ff706d9d640 1 -- 172.21.15.47:0/1687536063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e3c6d0 msgr2=0x556387e602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:19.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.375+0000 7ff706d9d640 1 --2- 172.21.15.47:0/1687536063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e3c6d0 0x556387e602a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.375+0000 7ff706d9d640 1 -- 172.21.15.47:0/1687536063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3cff0 msgr2=0x556387e607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:19.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.376+0000 7ff706d9d640 1 --2- 172.21.15.47:0/1687536063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3cff0 0x556387e607e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.376+0000 7ff706d9d640 1 -- 172.21.15.47:0/1687536063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556387e5b010 con 0x556387e48f80 2024-07-24T22:10:19.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.376+0000 7ff705d9b640 1 --2- 172.21.15.47:0/1687536063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3cff0 0x556387e607e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:10:19.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.377+0000 7ff706d9d640 1 --2- 172.21.15.47:0/1687536063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e48f80 0x556387e43190 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff700005fd0 tx=0x7ff700013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cf6bc5f01ca9c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:19.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.377+0000 7ff6effff640 1 -- 172.21.15.47:0/1687536063 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70002b070 con 0x556387e48f80 2024-07-24T22:10:19.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.378+0000 7ff6effff640 1 -- 172.21.15.47:0/1687536063 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff70001b900 con 0x556387e48f80 2024-07-24T22:10:19.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.378+0000 7ff6effff640 1 -- 172.21.15.47:0/1687536063 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7000268b0 con 0x556387e48f80 2024-07-24T22:10:19.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.380+0000 7ff70f17d740 1 -- 172.21.15.47:0/1687536063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e48f80 msgr2=0x556387e43190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:19.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.381+0000 7ff70f17d740 1 --2- 172.21.15.47:0/1687536063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e48f80 0x556387e43190 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff700005fd0 tx=0x7ff700013000 comp rx=0 tx=0).stop 2024-07-24T22:10:19.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.381+0000 7ff70f17d740 1 -- 172.21.15.47:0/1687536063 shutdown_connections 2024-07-24T22:10:19.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.381+0000 7ff70f17d740 1 --2- 172.21.15.47:0/1687536063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e48f80 0x556387e43190 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.381+0000 7ff70f17d740 1 --2- 172.21.15.47:0/1687536063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e3cff0 0x556387e607e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.381+0000 7ff70f17d740 1 --2- 172.21.15.47:0/1687536063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e3c6d0 0x556387e602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.381+0000 7ff70f17d740 1 -- 172.21.15.47:0/1687536063 >> 172.21.15.47:0/1687536063 conn(0x556387e3a500 msgr2=0x556387e47cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:19.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.382+0000 7ff70f17d740 1 -- 172.21.15.47:0/1687536063 shutdown_connections 2024-07-24T22:10:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.383+0000 7ff70f17d740 1 -- 172.21.15.47:0/1687536063 wait complete. 2024-07-24T22:10:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.384+0000 7ff70f17d740 1 -- start start 2024-07-24T22:10:19.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.384+0000 7ff70f17d740 1 Processor -- start 2024-07-24T22:10:19.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.388+0000 7ff70f17d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 0x556387e51540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.388+0000 7ff70f17d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e3cff0 0x556387e4ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.389+0000 7ff70f17d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e48f80 0x556387e4d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.389+0000 7ff70f17d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff7081bbe00 con 0x556387e3c6d0 2024-07-24T22:10:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.390+0000 7ff70f17d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff7081bd270 con 0x556387e48f80 2024-07-24T22:10:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.390+0000 7ff70f17d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff7081bc4d0 con 0x556387e3cff0 2024-07-24T22:10:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.390+0000 7ff70f17d740 10 client.0 _ll_register_callbacks cb 0x7ff6f8009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:19.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.391+0000 7ff70659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 0x556387e51540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.391+0000 7ff70659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 0x556387e51540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60124/0 (socket says 172.21.15.47:60124) 2024-07-24T22:10:19.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.391+0000 7ff70659c640 1 -- 172.21.15.47:0/2716079465 learned_addr learned my addr 172.21.15.47:0/2716079465 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:19.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.394+0000 7ff705d9b640 1 --2- 172.21.15.47:0/2716079465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e3cff0 0x556387e4ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.394+0000 7ff706d9d640 1 --2- 172.21.15.47:0/2716079465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e48f80 0x556387e4d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.395+0000 7ff70659c640 1 -- 172.21.15.47:0/2716079465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e3cff0 msgr2=0x556387e4ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:19.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.395+0000 7ff70659c640 1 --2- 172.21.15.47:0/2716079465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e3cff0 0x556387e4ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.395+0000 7ff70659c640 1 -- 172.21.15.47:0/2716079465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e48f80 msgr2=0x556387e4d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:19.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.395+0000 7ff70659c640 1 --2- 172.21.15.47:0/2716079465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e48f80 0x556387e4d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.395+0000 7ff70659c640 1 -- 172.21.15.47:0/2716079465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556387ec2270 con 0x556387e3c6d0 2024-07-24T22:10:19.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.398+0000 7ff70659c640 1 --2- 172.21.15.47:0/2716079465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 0x556387e51540 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0c7280 tx=0x7ff6fc0ec510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0fe727bde3c215 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:19.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.399+0000 7ff6edffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:10:19.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.402+0000 7ff6edffb640 1 -- 172.21.15.47:0/2716079465 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc0ca970 con 0x556387e3c6d0 2024-07-24T22:10:19.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.402+0000 7ff70f17d740 1 -- 172.21.15.47:0/2716079465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff70001b900 con 0x556387e3c6d0 2024-07-24T22:10:19.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.402+0000 7ff6edffb640 1 -- 172.21.15.47:0/2716079465 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7ff6fc0c77f0 con 0x556387e3c6d0 2024-07-24T22:10:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.405+0000 7ff6edffb640 1 -- 172.21.15.47:0/2716079465 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff6fc0c70c0 con 0x556387e3c6d0 2024-07-24T22:10:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.405+0000 7ff70f17d740 10 client.16161 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.405+0000 7ff70f17d740 1 -- 172.21.15.47:0/2716079465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556387ec2270 con 0x556387e3c6d0 2024-07-24T22:10:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.407+0000 7ff6edffb640 1 -- 172.21.15.47:0/2716079465 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff70001b900 con 0x556387e3c6d0 2024-07-24T22:10:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.407+0000 7ff6edffb640 1 -- 172.21.15.47:0/2716079465 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff6fc0ca4b0 con 0x556387e3c6d0 2024-07-24T22:10:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.408+0000 7ff70f17d740 10 client.16161 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.408+0000 7ff70f17d740 10 client.16161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.408+0000 7ff70f17d740 20 client.16161 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.408+0000 7ff70f17d740 1 --2- 172.21.15.47:0/2716079465 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556387ec38b0 0x556387ec5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.408+0000 7ff70f17d740 4 client.16161 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:10:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.408+0000 7ff70f17d740 1 -- 172.21.15.47:0/2716079465 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556387db13a0 con 0x556387ec38b0 2024-07-24T22:10:19.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.419+0000 7ff705d9b640 1 --2- 172.21.15.47:0/2716079465 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556387ec38b0 0x556387ec5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:19.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.430+0000 7ff705d9b640 1 --2- 172.21.15.47:0/2716079465 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556387ec38b0 0x556387ec5cd0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19c66c4cfcc71159 server_cookie=de956277489511d9 in_seq=0 out_seq=0 2024-07-24T22:10:19.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.431+0000 7ff6edffb640 10 client.16161 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:19.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.436+0000 7ff6edffb640 1 -- 172.21.15.47:0/2716079465 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556387db13a0 con 0x556387ec38b0 2024-07-24T22:10:19.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.436+0000 7ff6edffb640 10 client.16161 handle_command_reply: tid=0 2024-07-24T22:10:19.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.436+0000 7ff70f17d740 1 client.16161 shutdown 2024-07-24T22:10:19.449 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:10:19.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.442+0000 7ff70f17d740 1 -- 172.21.15.47:0/2716079465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 msgr2=0x556387e51540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:19.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.442+0000 7ff70f17d740 1 --2- 172.21.15.47:0/2716079465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 0x556387e51540 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0c7280 tx=0x7ff6fc0ec510 comp rx=0 tx=0).stop 2024-07-24T22:10:19.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.443+0000 7ff70f17d740 1 -- 172.21.15.47:0/2716079465 shutdown_connections 2024-07-24T22:10:19.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.443+0000 7ff70f17d740 1 --2- 172.21.15.47:0/2716079465 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556387ec38b0 0x556387ec5cd0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.443+0000 7ff70f17d740 1 --2- 172.21.15.47:0/2716079465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556387e48f80 0x556387e4d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.443+0000 7ff70f17d740 1 --2- 172.21.15.47:0/2716079465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556387e3cff0 0x556387e4ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.443+0000 7ff70f17d740 1 --2- 172.21.15.47:0/2716079465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556387e3c6d0 0x556387e51540 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.443+0000 7ff70f17d740 1 -- 172.21.15.47:0/2716079465 >> 172.21.15.47:0/2716079465 conn(0x556387e3a500 msgr2=0x556387e473e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:19.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.443+0000 7ff6edffb640 0 client.16161 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:19.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.443+0000 7ff70f17d740 1 -- 172.21.15.47:0/2716079465 shutdown_connections 2024-07-24T22:10:19.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.443+0000 7ff70f17d740 1 -- 172.21.15.47:0/2716079465 wait complete. 2024-07-24T22:10:19.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.443+0000 7ff70f17d740 20 client.16161 trim_cache size 0 max 16384 2024-07-24T22:10:19.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.448+0000 7ff70cdcc640 1 -- 172.21.15.47:0/4129891274 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff6f00b3f10 msgr2=0x7ff6f00b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:19.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.448+0000 7ff70cdcc640 1 --2- 172.21.15.47:0/4129891274 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff6f00b3f10 0x7ff6f00b63d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff700005c40 tx=0x7ff700004a40 comp rx=0 tx=0).stop 2024-07-24T22:10:19.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.448+0000 7ff70cdcc640 1 -- 172.21.15.47:0/4129891274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff708109b40 msgr2=0x7ff7081a7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:19.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.448+0000 7ff70cdcc640 1 --2- 172.21.15.47:0/4129891274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff708109b40 0x7ff7081a7b00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc006010 tx=0x7ff6fc031ad0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.452+0000 7ff70cdcc640 1 -- 172.21.15.47:0/4129891274 shutdown_connections 2024-07-24T22:10:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.452+0000 7ff70cdcc640 1 --2- 172.21.15.47:0/4129891274 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff6f00b3f10 0x7ff6f00b63d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.452+0000 7ff70cdcc640 1 --2- 172.21.15.47:0/4129891274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff70811ba90 0x7ff7081ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.452+0000 7ff70cdcc640 1 --2- 172.21.15.47:0/4129891274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff708109f20 0x7ff7081a8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.452+0000 7ff70cdcc640 1 --2- 172.21.15.47:0/4129891274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff708109b40 0x7ff7081a7b00 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.453+0000 7ff70cdcc640 1 -- 172.21.15.47:0/4129891274 >> 172.21.15.47:0/4129891274 conn(0x7ff70806d980 msgr2=0x7ff70811c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.453+0000 7ff70cdcc640 1 -- 172.21.15.47:0/4129891274 shutdown_connections 2024-07-24T22:10:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:19.453+0000 7ff70cdcc640 1 -- 172.21.15.47:0/4129891274 wait complete. 2024-07-24T22:10:19.855 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:19 smithi047 ceph-mon[32551]: pgmap v459: 97 pgs: 97 active+clean; 22 GiB data, 66 GiB used, 1006 GiB / 1.0 TiB avail; 1012 KiB/s rd, 479 MiB/s wr, 2.53k op/s 2024-07-24T22:10:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:19 smithi183 ceph-mon[37007]: pgmap v459: 97 pgs: 97 active+clean; 22 GiB data, 66 GiB used, 1006 GiB / 1.0 TiB avail; 1012 KiB/s rd, 479 MiB/s wr, 2.53k op/s 2024-07-24T22:10:20.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:19 smithi188 ceph-mon[37380]: pgmap v459: 97 pgs: 97 active+clean; 22 GiB data, 66 GiB used, 1006 GiB / 1.0 TiB avail; 1012 KiB/s rd, 479 MiB/s wr, 2.53k op/s 2024-07-24T22:10:21.863 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:21 smithi047 ceph-mon[32551]: pgmap v460: 97 pgs: 97 active+clean; 22 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 465 MiB/s wr, 2.81k op/s 2024-07-24T22:10:21.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:21 smithi183 ceph-mon[37007]: pgmap v460: 97 pgs: 97 active+clean; 22 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 465 MiB/s wr, 2.81k op/s 2024-07-24T22:10:21.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.995+0000 7f552dffb640 1 -- 172.21.15.47:0/2213138943 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55240318a0 con 0x7f5530108160 2024-07-24T22:10:21.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.996+0000 7f55356d6640 1 -- 172.21.15.47:0/2213138943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5530108160 msgr2=0x7f55301085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:21.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.996+0000 7f55356d6640 1 --2- 172.21.15.47:0/2213138943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5530108160 0x7f55301085a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5524009900 tx=0x7f552402a410 comp rx=0 tx=0).stop 2024-07-24T22:10:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.996+0000 7f55356d6640 1 -- 172.21.15.47:0/2213138943 shutdown_connections 2024-07-24T22:10:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.996+0000 7f55356d6640 1 --2- 172.21.15.47:0/2213138943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5530108ae0 0x7f553010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.996+0000 7f55356d6640 1 --2- 172.21.15.47:0/2213138943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5530108160 0x7f55301085a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.996+0000 7f55356d6640 1 --2- 172.21.15.47:0/2213138943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5530102750 0x7f5530102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.996+0000 7f55356d6640 1 -- 172.21.15.47:0/2213138943 >> 172.21.15.47:0/2213138943 conn(0x7f55300fe200 msgr2=0x7f5530100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:22.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.996+0000 7f55356d6640 1 -- 172.21.15.47:0/2213138943 shutdown_connections 2024-07-24T22:10:22.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.996+0000 7f55356d6640 1 -- 172.21.15.47:0/2213138943 wait complete. 2024-07-24T22:10:22.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.997+0000 7f55356d6640 1 Processor -- start 2024-07-24T22:10:22.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.998+0000 7f55356d6640 1 -- start start 2024-07-24T22:10:22.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.998+0000 7f55356d6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5530102750 0x7f553010e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.998+0000 7f55356d6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5530108160 0x7f553010ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.999+0000 7f55356d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5530108ae0 0x7f55301a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.999+0000 7f55356d6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5530112760 con 0x7f5530108160 2024-07-24T22:10:22.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.999+0000 7f55356d6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f55301125e0 con 0x7f5530102750 2024-07-24T22:10:22.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.999+0000 7f55356d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f55301128e0 con 0x7f5530108ae0 2024-07-24T22:10:22.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.999+0000 7f552e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5530108160 0x7f553010ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.999+0000 7f552e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5530108160 0x7f553010ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60150/0 (socket says 172.21.15.47:60150) 2024-07-24T22:10:22.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.999+0000 7f552e7fc640 1 -- 172.21.15.47:0/3167097774 learned_addr learned my addr 172.21.15.47:0/3167097774 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:22.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:21.999+0000 7f552effd640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5530102750 0x7f553010e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.000+0000 7f552f7fe640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5530108ae0 0x7f55301a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.000+0000 7f552e7fc640 1 -- 172.21.15.47:0/3167097774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5530108ae0 msgr2=0x7f55301a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:22.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.001+0000 7f552e7fc640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5530108ae0 0x7f55301a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.001+0000 7f552e7fc640 1 -- 172.21.15.47:0/3167097774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5530102750 msgr2=0x7f553010e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.001+0000 7f552e7fc640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5530102750 0x7f553010e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.001+0000 7f552e7fc640 1 -- 172.21.15.47:0/3167097774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55301a2100 con 0x7f5530108160 2024-07-24T22:10:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.001+0000 7f552f7fe640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5530108ae0 0x7f55301a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:10:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.001+0000 7f552effd640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5530102750 0x7f553010e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:10:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.001+0000 7f552e7fc640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5530108160 0x7f553010ebb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5524005940 tx=0x7f5524004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.002+0000 7f5517fff640 1 -- 172.21.15.47:0/3167097774 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552403f030 con 0x7f5530108160 2024-07-24T22:10:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.002+0000 7f55356d6640 1 -- 172.21.15.47:0/3167097774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55301a2390 con 0x7f5530108160 2024-07-24T22:10:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.002+0000 7f5517fff640 1 -- 172.21.15.47:0/3167097774 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5524003aa0 con 0x7f5530108160 2024-07-24T22:10:22.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.002+0000 7f55356d6640 1 -- 172.21.15.47:0/3167097774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55301abcf0 con 0x7f5530108160 2024-07-24T22:10:22.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.002+0000 7f5517fff640 1 -- 172.21.15.47:0/3167097774 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524049060 con 0x7f5530108160 2024-07-24T22:10:22.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.006+0000 7f5537a87740 1 Processor -- start 2024-07-24T22:10:22.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.007+0000 7f5537a87740 1 -- start start 2024-07-24T22:10:22.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.008+0000 7f5537a87740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0987f6cd0 0x55f0987f5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.008+0000 7f5537a87740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 0x55f0987f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.008+0000 7f5537a87740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0988015a0 0x55f098803990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.008+0000 7f5537a87740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f09876b670 con 0x55f0987f5770 2024-07-24T22:10:22.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.008+0000 7f5537a87740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f09875ab70 con 0x55f0988015a0 2024-07-24T22:10:22.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.008+0000 7f5537a87740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f09875ebb0 con 0x55f0987f6cd0 2024-07-24T22:10:22.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.009+0000 7f552effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 0x55f0987f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.009+0000 7f552effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 0x55f0987f5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60164/0 (socket says 172.21.15.47:60164) 2024-07-24T22:10:22.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.009+0000 7f552effd640 1 -- 172.21.15.47:0/2385503267 learned_addr learned my addr 172.21.15.47:0/2385503267 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:22.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.009+0000 7f5517fff640 1 -- 172.21.15.47:0/3167097774 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f5524042030 con 0x7f5530108160 2024-07-24T22:10:22.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.010+0000 7f552f7fe640 1 --2- 172.21.15.47:0/2385503267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0987f6cd0 0x55f0987f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.010+0000 7f552effd640 1 -- 172.21.15.47:0/2385503267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0987f6cd0 msgr2=0x55f0987f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:22.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.010+0000 7f552effd640 1 --2- 172.21.15.47:0/2385503267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0987f6cd0 0x55f0987f5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.010+0000 7f552effd640 1 -- 172.21.15.47:0/2385503267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0988015a0 msgr2=0x55f098803990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:10:22.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.010+0000 7f552effd640 1 --2- 172.21.15.47:0/2385503267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0988015a0 0x55f098803990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.010+0000 7f552effd640 1 -- 172.21.15.47:0/2385503267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0986f2d30 con 0x55f0987f5770 2024-07-24T22:10:22.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.010+0000 7f5517fff640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f55180b3dc0 0x7f55180b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.010+0000 7f5517fff640 1 -- 172.21.15.47:0/3167097774 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f5524103eb0 con 0x7f5530108160 2024-07-24T22:10:22.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.011+0000 7f552f7fe640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f55180b3dc0 0x7f55180b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.011+0000 7f552effd640 1 --2- 172.21.15.47:0/2385503267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 0x55f0987f5b90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5520009e70 tx=0x7f552000e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4d3727af8eef84 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:22.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.011+0000 7f55157fa640 1 -- 172.21.15.47:0/2385503267 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520017070 con 0x55f0987f5770 2024-07-24T22:10:22.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.012+0000 7f55157fa640 1 -- 172.21.15.47:0/2385503267 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5520013920 con 0x55f0987f5770 2024-07-24T22:10:22.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.012+0000 7f552f7fe640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f55180b3dc0 0x7f55180b6280 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5528005fd0 tx=0x7f5528009500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:22.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.012+0000 7f55157fa640 1 -- 172.21.15.47:0/2385503267 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55200129c0 con 0x55f0987f5770 2024-07-24T22:10:22.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.014+0000 7f5537a87740 1 -- 172.21.15.47:0/2385503267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 msgr2=0x55f0987f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:22.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.014+0000 7f5537a87740 1 --2- 172.21.15.47:0/2385503267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 0x55f0987f5b90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5520009e70 tx=0x7f552000e5a0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.014+0000 7f5537a87740 1 -- 172.21.15.47:0/2385503267 shutdown_connections 2024-07-24T22:10:22.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.014+0000 7f5537a87740 1 --2- 172.21.15.47:0/2385503267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0988015a0 0x55f098803990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.014+0000 7f5537a87740 1 --2- 172.21.15.47:0/2385503267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 0x55f0987f5b90 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.014+0000 7f5537a87740 1 --2- 172.21.15.47:0/2385503267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0987f6cd0 0x55f0987f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.014+0000 7f5537a87740 1 -- 172.21.15.47:0/2385503267 >> 172.21.15.47:0/2385503267 conn(0x55f0987bf720 msgr2=0x55f0987f3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:22.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.015+0000 7f5537a87740 1 -- 172.21.15.47:0/2385503267 shutdown_connections 2024-07-24T22:10:22.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.015+0000 7f5537a87740 1 -- 172.21.15.47:0/2385503267 wait complete. 2024-07-24T22:10:22.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.016+0000 7f5537a87740 1 -- start start 2024-07-24T22:10:22.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.016+0000 7f5537a87740 1 Processor -- start 2024-07-24T22:10:22.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.016+0000 7f5537a87740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 0x55f098801030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.016+0000 7f5537a87740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f6cd0 0x55f0987fe4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.016+0000 7f5537a87740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0988015a0 0x55f0987fec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.017+0000 7f5537a87740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f0985be7a0 con 0x55f0987f5770 2024-07-24T22:10:22.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.017+0000 7f5537a87740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f0986fcff0 con 0x55f0987f6cd0 2024-07-24T22:10:22.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.017+0000 7f5537a87740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f098804460 con 0x55f0988015a0 2024-07-24T22:10:22.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.017+0000 7f552effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 0x55f098801030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.017+0000 7f552effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 0x55f098801030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60176/0 (socket says 172.21.15.47:60176) 2024-07-24T22:10:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.017+0000 7f552effd640 1 -- 172.21.15.47:0/2941198169 learned_addr learned my addr 172.21.15.47:0/2941198169 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.017+0000 7f552e7fc640 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f6cd0 0x55f0987fe4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.017+0000 7f5537a87740 10 client.0 _ll_register_callbacks cb 0x55f098468090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:22.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.018+0000 7f552f7fe640 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0988015a0 0x55f0987fec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.018+0000 7f552effd640 1 -- 172.21.15.47:0/2941198169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0988015a0 msgr2=0x55f0987fec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:22.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.018+0000 7f552effd640 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0988015a0 0x55f0987fec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.018+0000 7f552effd640 1 -- 172.21.15.47:0/2941198169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f6cd0 msgr2=0x55f0987fe4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:22.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.018+0000 7f552effd640 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f6cd0 0x55f0987fe4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.018+0000 7f552effd640 1 -- 172.21.15.47:0/2941198169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0987010a0 con 0x55f0987f5770 2024-07-24T22:10:22.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.018+0000 7f5537a87740 1 -- 172.21.15.47:0/2941198169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5520013920 con 0x55f0987f5770 2024-07-24T22:10:22.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.018+0000 7f552e7fc640 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f6cd0 0x55f0987fe4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:10:22.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.018+0000 7f552effd640 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 0x55f098801030 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5520014d40 tx=0x7f55200047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1426786582ed575 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:22.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.018+0000 7f5512ff5640 10 client.16173 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:10:22.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.019+0000 7f5512ff5640 1 -- 172.21.15.47:0/2941198169 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520017040 con 0x55f0987f5770 2024-07-24T22:10:22.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.019+0000 7f5512ff5640 1 -- 172.21.15.47:0/2941198169 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f5520012a50 con 0x55f0987f5770 2024-07-24T22:10:22.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.019+0000 7f5512ff5640 1 -- 172.21.15.47:0/2941198169 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5520012cb0 con 0x55f0987f5770 2024-07-24T22:10:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.019+0000 7f5537a87740 10 client.16173 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.019+0000 7f5537a87740 1 -- 172.21.15.47:0/2941198169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({fsmap=20}) -- 0x55f0984cab90 con 0x55f0987f5770 2024-07-24T22:10:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.020+0000 7f5512ff5640 1 -- 172.21.15.47:0/2941198169 <== mon.0 v2:172.21.15.47:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5520023070 con 0x55f0987f5770 2024-07-24T22:10:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.020+0000 7f5537a87740 10 client.16173 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.020+0000 7f5537a87740 10 client.16173 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:10:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.020+0000 7f5537a87740 20 client.16173 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.020+0000 7f5537a87740 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f098811440 0x55f098813830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.020+0000 7f5537a87740 4 client.16173 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:10:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.020+0000 7f5537a87740 1 -- 172.21.15.47:0/2941198169 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f09876d5c0 con 0x55f098811440 2024-07-24T22:10:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.022+0000 7f552e7fc640 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f098811440 0x55f098813830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.026+0000 7f552e7fc640 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f098811440 0x55f098813830 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed767d2c4651786e server_cookie=89fb11875c8dc0bf in_seq=0 out_seq=0 2024-07-24T22:10:22.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.026+0000 7f5512ff5640 10 client.16173 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:22.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.029+0000 7f5512ff5640 1 -- 172.21.15.47:0/2941198169 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f09876d5c0 con 0x55f098811440 2024-07-24T22:10:22.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.029+0000 7f5512ff5640 10 client.16173 handle_command_reply: tid=0 2024-07-24T22:10:22.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.029+0000 7f5537a87740 1 client.16173 shutdown 2024-07-24T22:10:22.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.029+0000 7f5537a87740 1 -- 172.21.15.47:0/2941198169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 msgr2=0x55f098801030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:22.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.029+0000 7f5537a87740 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 0x55f098801030 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5520014d40 tx=0x7f55200047d0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.030+0000 7f5537a87740 1 -- 172.21.15.47:0/2941198169 shutdown_connections 2024-07-24T22:10:22.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.030+0000 7f5537a87740 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f098811440 0x55f098813830 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.030+0000 7f5512ff5640 0 client.16173 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:22.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.030+0000 7f5537a87740 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0988015a0 0x55f0987fec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.030+0000 7f5537a87740 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f6cd0 0x55f0987fe4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.030+0000 7f5537a87740 1 --2- 172.21.15.47:0/2941198169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f5770 0x55f098801030 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.030+0000 7f5537a87740 1 -- 172.21.15.47:0/2941198169 >> 172.21.15.47:0/2941198169 conn(0x55f0987bf720 msgr2=0x55f0987f8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:22.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.030+0000 7f5537a87740 1 -- 172.21.15.47:0/2941198169 shutdown_connections 2024-07-24T22:10:22.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.030+0000 7f5537a87740 1 -- 172.21.15.47:0/2941198169 wait complete. 2024-07-24T22:10:22.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.030+0000 7f5537a87740 20 client.16173 trim_cache size 0 max 16384 2024-07-24T22:10:22.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:21 smithi188 ceph-mon[37380]: pgmap v460: 97 pgs: 97 active+clean; 22 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 465 MiB/s wr, 2.81k op/s 2024-07-24T22:10:22.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.057+0000 7f5537a87740 1 Processor -- start 2024-07-24T22:10:22.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.057+0000 7f5537a87740 1 -- start start 2024-07-24T22:10:22.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.057+0000 7f5537a87740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f5770 0x55f0987f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.057+0000 7f5537a87740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f6cd0 0x55f0988001c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.057+0000 7f5537a87740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0988015a0 0x55f0987f2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.057+0000 7f5537a87740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f551c00c770 con 0x55f0987f6cd0 2024-07-24T22:10:22.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.057+0000 7f5537a87740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f551c00eff0 con 0x55f0987f5770 2024-07-24T22:10:22.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.057+0000 7f5537a87740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f551c00cde0 con 0x55f0988015a0 2024-07-24T22:10:22.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.057+0000 7f552e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f6cd0 0x55f0988001c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.057+0000 7f552effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f5770 0x55f0987f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.057+0000 7f552e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f6cd0 0x55f0988001c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60184/0 (socket says 172.21.15.47:60184) 2024-07-24T22:10:22.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.057+0000 7f552e7fc640 1 -- 172.21.15.47:0/1702110489 learned_addr learned my addr 172.21.15.47:0/1702110489 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:22.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.057+0000 7f552f7fe640 1 --2- 172.21.15.47:0/1702110489 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0988015a0 0x55f0987f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.058+0000 7f552effd640 1 -- 172.21.15.47:0/1702110489 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0988015a0 msgr2=0x55f0987f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:22.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.058+0000 7f552effd640 1 --2- 172.21.15.47:0/1702110489 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0988015a0 0x55f0987f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.058+0000 7f552effd640 1 -- 172.21.15.47:0/1702110489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f6cd0 msgr2=0x55f0988001c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:22.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.058+0000 7f552effd640 1 --2- 172.21.15.47:0/1702110489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f6cd0 0x55f0988001c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.058+0000 7f552effd640 1 -- 172.21.15.47:0/1702110489 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f098813c90 con 0x55f0987f5770 2024-07-24T22:10:22.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.058+0000 7f552f7fe640 1 --2- 172.21.15.47:0/1702110489 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0988015a0 0x55f0987f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:10:22.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.058+0000 7f552e7fc640 1 --2- 172.21.15.47:0/1702110489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f6cd0 0x55f0988001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:10:22.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.058+0000 7f552effd640 1 --2- 172.21.15.47:0/1702110489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f5770 0x55f0987f4f10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5520014d10 tx=0x7f552001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13a022ae1e096614 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:22.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.058+0000 7f5514ff9640 1 -- 172.21.15.47:0/1702110489 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520017070 con 0x55f0987f5770 2024-07-24T22:10:22.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.058+0000 7f5514ff9640 1 -- 172.21.15.47:0/1702110489 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5520036070 con 0x55f0987f5770 2024-07-24T22:10:22.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.058+0000 7f5514ff9640 1 -- 172.21.15.47:0/1702110489 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520006570 con 0x55f0987f5770 2024-07-24T22:10:22.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.059+0000 7f5537a87740 1 -- 172.21.15.47:0/1702110489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f5770 msgr2=0x55f0987f4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:22.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.059+0000 7f5537a87740 1 --2- 172.21.15.47:0/1702110489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f5770 0x55f0987f4f10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5520014d10 tx=0x7f552001f000 comp rx=0 tx=0).stop 2024-07-24T22:10:22.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.059+0000 7f5537a87740 1 -- 172.21.15.47:0/1702110489 shutdown_connections 2024-07-24T22:10:22.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.059+0000 7f5537a87740 1 --2- 172.21.15.47:0/1702110489 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0988015a0 0x55f0987f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.059+0000 7f5537a87740 1 --2- 172.21.15.47:0/1702110489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0987f6cd0 0x55f0988001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.059+0000 7f5537a87740 1 --2- 172.21.15.47:0/1702110489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f5770 0x55f0987f4f10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.059+0000 7f5537a87740 1 -- 172.21.15.47:0/1702110489 >> 172.21.15.47:0/1702110489 conn(0x55f0987bf720 msgr2=0x55f0987ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:22.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.059+0000 7f5537a87740 1 -- 172.21.15.47:0/1702110489 shutdown_connections 2024-07-24T22:10:22.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.059+0000 7f5537a87740 1 -- 172.21.15.47:0/1702110489 wait complete. 2024-07-24T22:10:22.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.060+0000 7f5537a87740 1 -- start start 2024-07-24T22:10:22.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.060+0000 7f5537a87740 1 Processor -- start 2024-07-24T22:10:22.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.060+0000 7f5537a87740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f5770 0x55f098809b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.060+0000 7f5537a87740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0987f6cd0 0x55f09880a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.060+0000 7f5537a87740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0988015a0 0x55f0988187f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.060+0000 7f552e7fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0987f6cd0 0x55f09880a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.060+0000 7f552effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f5770 0x55f098809b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.060+0000 7f552e7fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0987f6cd0 0x55f09880a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:48514/0 (socket says 172.21.15.47:48514) 2024-07-24T22:10:22.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.060+0000 7f552effd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f5770 0x55f098809b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:35010/0 (socket says 172.21.15.47:35010) 2024-07-24T22:10:22.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.060+0000 7f552f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0988015a0 0x55f0988187f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.060+0000 7f552f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0988015a0 0x55f0988187f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60196/0 (socket says 172.21.15.47:60196) 2024-07-24T22:10:22.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.061+0000 7f5537a87740 1 -- 172.21.15.47:0/3499370500 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f551c00d4b0 con 0x55f0988015a0 2024-07-24T22:10:22.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.060+0000 7f552e7fc640 1 -- 172.21.15.47:0/3499370500 learned_addr learned my addr 172.21.15.47:0/3499370500 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:22.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.061+0000 7f5537a87740 1 -- 172.21.15.47:0/3499370500 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f551c00e920 con 0x55f0987f5770 2024-07-24T22:10:22.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.061+0000 7f5537a87740 1 -- 172.21.15.47:0/3499370500 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f551c00db80 con 0x55f0987f6cd0 2024-07-24T22:10:22.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.061+0000 7f5537a87740 10 client.0 _ll_register_callbacks cb 0x7f5520009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:22.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.061+0000 7f552effd640 1 -- 172.21.15.47:0/3499370500 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0987f6cd0 msgr2=0x55f09880a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:22.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.061+0000 7f552effd640 1 --2- 172.21.15.47:0/3499370500 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0987f6cd0 0x55f09880a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.061+0000 7f552effd640 1 -- 172.21.15.47:0/3499370500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0988015a0 msgr2=0x55f0988187f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:22.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.061+0000 7f552effd640 1 --2- 172.21.15.47:0/3499370500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0988015a0 0x55f0988187f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.061+0000 7f552effd640 1 -- 172.21.15.47:0/3499370500 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f098819020 con 0x55f0987f5770 2024-07-24T22:10:22.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.061+0000 7f552e7fc640 1 --2- 172.21.15.47:0/3499370500 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0987f6cd0 0x55f09880a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:10:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.061+0000 7f552effd640 1 --2- 172.21.15.47:0/3499370500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f5770 0x55f098809b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5520001eb0 tx=0x7f5520012c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc85c0f01067f7a7 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.061+0000 7f5512ff5640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:10:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5512ff5640 1 -- 172.21.15.47:0/3499370500 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552003f060 con 0x55f0987f5770 2024-07-24T22:10:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5512ff5640 1 -- 172.21.15.47:0/3499370500 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f55200064f0 con 0x55f0987f5770 2024-07-24T22:10:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5537a87740 1 -- 172.21.15.47:0/3499370500 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5520036070 con 0x55f0987f5770 2024-07-24T22:10:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5512ff5640 1 -- 172.21.15.47:0/3499370500 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5520017040 con 0x55f0987f5770 2024-07-24T22:10:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5537a87740 10 client.25598 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5537a87740 1 -- 172.21.15.47:0/3499370500 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f098809490 con 0x55f0987f5770 2024-07-24T22:10:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5512ff5640 1 -- 172.21.15.47:0/3499370500 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5520036070 con 0x55f0987f5770 2024-07-24T22:10:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5512ff5640 1 -- 172.21.15.47:0/3499370500 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5520023040 con 0x55f0987f5770 2024-07-24T22:10:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5537a87740 10 client.25598 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5537a87740 10 client.25598 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:10:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5537a87740 20 client.25598 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5537a87740 1 --2- 172.21.15.47:0/3499370500 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f098811440 0x55f09887e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5537a87740 4 client.25598 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-07-24T22:10:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.062+0000 7f5537a87740 1 -- 172.21.15.47:0/3499370500 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55f098769060 con 0x55f098811440 2024-07-24T22:10:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.063+0000 7f552e7fc640 1 --2- 172.21.15.47:0/3499370500 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f098811440 0x55f09887e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.063+0000 7f5512ff5640 10 client.25598 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.063+0000 7f552e7fc640 1 --2- 172.21.15.47:0/3499370500 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f098811440 0x55f09887e2e0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b855987895c6869a server_cookie=1c273ed5387fc8bf in_seq=0 out_seq=0 2024-07-24T22:10:22.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.356+0000 7f5512ff5640 1 -- 172.21.15.47:0/3499370500 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55f098769060 con 0x55f098811440 2024-07-24T22:10:22.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.356+0000 7f5512ff5640 10 client.25598 handle_command_reply: tid=0 2024-07-24T22:10:22.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.356+0000 7f5537a87740 1 client.25598 shutdown 2024-07-24T22:10:22.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.356+0000 7f5537a87740 1 -- 172.21.15.47:0/3499370500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f5770 msgr2=0x55f098809b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:22.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.356+0000 7f5537a87740 1 --2- 172.21.15.47:0/3499370500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f5770 0x55f098809b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5520001eb0 tx=0x7f5520012c10 comp rx=0 tx=0).stop 2024-07-24T22:10:22.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f5537a87740 1 -- 172.21.15.47:0/3499370500 shutdown_connections 2024-07-24T22:10:22.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f5537a87740 1 --2- 172.21.15.47:0/3499370500 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f098811440 0x55f09887e2e0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f5537a87740 1 --2- 172.21.15.47:0/3499370500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0988015a0 0x55f0988187f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f5537a87740 1 --2- 172.21.15.47:0/3499370500 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f0987f6cd0 0x55f09880a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f5512ff5640 0 client.25598 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:22.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f5537a87740 1 --2- 172.21.15.47:0/3499370500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0987f5770 0x55f098809b00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f5537a87740 1 -- 172.21.15.47:0/3499370500 >> 172.21.15.47:0/3499370500 conn(0x55f0987bf720 msgr2=0x55f0988002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:22.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f5537a87740 1 -- 172.21.15.47:0/3499370500 shutdown_connections 2024-07-24T22:10:22.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f5537a87740 1 -- 172.21.15.47:0/3499370500 wait complete. 2024-07-24T22:10:22.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f5537a87740 20 client.25598 trim_cache size 0 max 16384 2024-07-24T22:10:22.360 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:10:22.360 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:10:22.361 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:10:22.361 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 10, 2024-07-24T22:10:22.361 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:10:22.361 INFO:teuthology.orchestra.run.smithi047.stdout: "d677965": { 2024-07-24T22:10:22.361 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 10, 2024-07-24T22:10:22.361 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:10:22.361 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:10:22.361 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:10:22.361 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:10:22.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:10:22.361 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:10:22.362 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 150.0, 2024-07-24T22:10:22.362 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:10:22.362 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:10:22.362 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:10:22.362 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:10:22.362 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:10:22.362 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:10:22.362 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:22.362 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:22.362 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:22.362 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:22.362 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:22.363 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:10:22.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f55356d6640 1 -- 172.21.15.47:0/3167097774 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f55180b3dc0 msgr2=0x7f55180b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:22.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f55356d6640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f55180b3dc0 0x7f55180b6280 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5528005fd0 tx=0x7f5528009500 comp rx=0 tx=0).stop 2024-07-24T22:10:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f55356d6640 1 -- 172.21.15.47:0/3167097774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5530108160 msgr2=0x7f553010ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f55356d6640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5530108160 0x7f553010ebb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5524005940 tx=0x7f5524004270 comp rx=0 tx=0).stop 2024-07-24T22:10:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f55356d6640 1 -- 172.21.15.47:0/3167097774 shutdown_connections 2024-07-24T22:10:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f55356d6640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f55180b3dc0 0x7f55180b6280 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f55356d6640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5530108ae0 0x7f55301a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f55356d6640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5530108160 0x7f553010ebb0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f55356d6640 1 --2- 172.21.15.47:0/3167097774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5530102750 0x7f553010e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.357+0000 7f55356d6640 1 -- 172.21.15.47:0/3167097774 >> 172.21.15.47:0/3167097774 conn(0x7f55300fe200 msgr2=0x7f5530105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.358+0000 7f55356d6640 1 -- 172.21.15.47:0/3167097774 shutdown_connections 2024-07-24T22:10:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:22.358+0000 7f55356d6640 1 -- 172.21.15.47:0/3167097774 wait complete. 2024-07-24T22:10:22.615 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:10:22.616 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:10:23.149 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd677965', quiesce took 14.1 seconds. Will release after: 15.9 2024-07-24T22:10:23.217 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:10:23.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:23 smithi183 ceph-mon[37007]: pgmap v461: 97 pgs: 97 active+clean; 23 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 441 MiB/s wr, 2.40k op/s 2024-07-24T22:10:23.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:23 smithi047 ceph-mon[32551]: pgmap v461: 97 pgs: 97 active+clean; 23 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 441 MiB/s wr, 2.40k op/s 2024-07-24T22:10:24.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:23 smithi188 ceph-mon[37380]: pgmap v461: 97 pgs: 97 active+clean; 23 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 441 MiB/s wr, 2.40k op/s 2024-07-24T22:10:25.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.129+0000 7f8b27bcd640 1 -- 172.21.15.47:0/2803572505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b20107a00 msgr2=0x7f8b2010e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:25.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.129+0000 7f8b27bcd640 1 --2- 172.21.15.47:0/2803572505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b20107a00 0x7f8b2010e200 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009900 tx=0x7f8b1802a410 comp rx=0 tx=0).stop 2024-07-24T22:10:25.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.129+0000 7f8b27bcd640 1 -- 172.21.15.47:0/2803572505 shutdown_connections 2024-07-24T22:10:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.129+0000 7f8b27bcd640 1 --2- 172.21.15.47:0/2803572505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b20107a00 0x7f8b2010e200 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.129+0000 7f8b27bcd640 1 --2- 172.21.15.47:0/2803572505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b20107080 0x7f8b201074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.129+0000 7f8b27bcd640 1 --2- 172.21.15.47:0/2803572505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b20101670 0x7f8b20101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.129+0000 7f8b27bcd640 1 -- 172.21.15.47:0/2803572505 >> 172.21.15.47:0/2803572505 conn(0x7f8b200fd0e0 msgr2=0x7f8b200ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.129+0000 7f8b27bcd640 1 -- 172.21.15.47:0/2803572505 shutdown_connections 2024-07-24T22:10:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.129+0000 7f8b27bcd640 1 -- 172.21.15.47:0/2803572505 wait complete. 2024-07-24T22:10:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.129+0000 7f8b27bcd640 1 Processor -- start 2024-07-24T22:10:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.129+0000 7f8b27bcd640 1 -- start start 2024-07-24T22:10:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b27bcd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b20101670 0x7f8b2019ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b27bcd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b20107080 0x7f8b2019b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b27bcd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b20107a00 0x7f8b201a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b27bcd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b20111630 con 0x7f8b20107a00 2024-07-24T22:10:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b27bcd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8b201114b0 con 0x7f8b20101670 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b27bcd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8b201117b0 con 0x7f8b20107080 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b2616a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b20107a00 0x7f8b201a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b2616a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b20107a00 0x7f8b201a06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40688/0 (socket says 172.21.15.47:40688) 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b2616a640 1 -- 172.21.15.47:0/3539963904 learned_addr learned my addr 172.21.15.47:0/3539963904 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b25168640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b20107080 0x7f8b2019b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b25969640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b20101670 0x7f8b2019ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b2616a640 1 -- 172.21.15.47:0/3539963904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b20107080 msgr2=0x7f8b2019b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b2616a640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b20107080 0x7f8b2019b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b2616a640 1 -- 172.21.15.47:0/3539963904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b20101670 msgr2=0x7f8b2019ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b2616a640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b20101670 0x7f8b2019ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b2616a640 1 -- 172.21.15.47:0/3539963904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b201a0e90 con 0x7f8b20107a00 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b25969640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b20101670 0x7f8b2019ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b2616a640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b20107a00 0x7f8b201a06c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8b18004770 tx=0x7f8b18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.130+0000 7f8b1effd640 1 -- 172.21.15.47:0/3539963904 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1803f030 con 0x7f8b20107a00 2024-07-24T22:10:25.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.131+0000 7f8b27bcd640 1 -- 172.21.15.47:0/3539963904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b201a1120 con 0x7f8b20107a00 2024-07-24T22:10:25.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.131+0000 7f8b1effd640 1 -- 172.21.15.47:0/3539963904 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b18003aa0 con 0x7f8b20107a00 2024-07-24T22:10:25.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.131+0000 7f8b1effd640 1 -- 172.21.15.47:0/3539963904 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b18035070 con 0x7f8b20107a00 2024-07-24T22:10:25.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.131+0000 7f8b27bcd640 1 -- 172.21.15.47:0/3539963904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b201a7840 con 0x7f8b20107a00 2024-07-24T22:10:25.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.133+0000 7f8b29f7e740 1 Processor -- start 2024-07-24T22:10:25.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.133+0000 7f8b1effd640 1 -- 172.21.15.47:0/3539963904 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8b18042030 con 0x7f8b20107a00 2024-07-24T22:10:25.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.133+0000 7f8b29f7e740 1 -- start start 2024-07-24T22:10:25.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b29f7e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed2ff20 0x55f57ed30300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b29f7e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed30840 0x55f57ed3c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b29f7e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed3c7d0 0x55f57ed3ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b29f7e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f57eca79f0 con 0x55f57ed30840 2024-07-24T22:10:25.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b29f7e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f57ec96ef0 con 0x55f57ed2ff20 2024-07-24T22:10:25.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b29f7e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f57ec9af30 con 0x55f57ed3c7d0 2024-07-24T22:10:25.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b25969640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed30840 0x55f57ed3c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b25969640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed30840 0x55f57ed3c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40704/0 (socket says 172.21.15.47:40704) 2024-07-24T22:10:25.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b25969640 1 -- 172.21.15.47:0/3070898188 learned_addr learned my addr 172.21.15.47:0/3070898188 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:25.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b25168640 1 --2- 172.21.15.47:0/3070898188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed3c7d0 0x55f57ed3ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b25168640 1 --2- 172.21.15.47:0/3070898188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed2ff20 0x55f57ed30300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b25969640 1 -- 172.21.15.47:0/3070898188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed3c7d0 msgr2=0x55f57ed3ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:25.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b25969640 1 --2- 172.21.15.47:0/3070898188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed3c7d0 0x55f57ed3ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b1effd640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b080b3d40 0x7f8b080b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b25969640 1 -- 172.21.15.47:0/3070898188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed2ff20 msgr2=0x55f57ed30300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:25.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b25969640 1 --2- 172.21.15.47:0/3070898188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed2ff20 0x55f57ed30300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b25969640 1 -- 172.21.15.47:0/3070898188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f57e9f7930 con 0x55f57ed30840 2024-07-24T22:10:25.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.134+0000 7f8b2616a640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b080b3d40 0x7f8b080b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.135+0000 7f8b25969640 1 --2- 172.21.15.47:0/3070898188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed30840 0x55f57ed3c290 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005fd0 tx=0x7f8b1000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcc399eaa8780ba server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.135+0000 7f8b1effd640 1 -- 172.21.15.47:0/3539963904 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8b18104560 con 0x7f8b20107a00 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.135+0000 7f8b07fff640 1 -- 172.21.15.47:0/3070898188 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10016070 con 0x55f57ed30840 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.135+0000 7f8b07fff640 1 -- 172.21.15.47:0/3070898188 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b100054d0 con 0x55f57ed30840 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.135+0000 7f8b07fff640 1 -- 172.21.15.47:0/3070898188 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10011470 con 0x55f57ed30840 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.135+0000 7f8b29f7e740 1 -- 172.21.15.47:0/3070898188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed30840 msgr2=0x55f57ed3c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.135+0000 7f8b2616a640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b080b3d40 0x7f8b080b6200 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8b18101d60 tx=0x7f8b1803b5d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.135+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/3070898188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed30840 0x55f57ed3c290 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005fd0 tx=0x7f8b1000e6c0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.136+0000 7f8b29f7e740 1 -- 172.21.15.47:0/3070898188 shutdown_connections 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.136+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/3070898188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed3c7d0 0x55f57ed3ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.136+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/3070898188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed30840 0x55f57ed3c290 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.136+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/3070898188 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed2ff20 0x55f57ed30300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.136+0000 7f8b29f7e740 1 -- 172.21.15.47:0/3070898188 >> 172.21.15.47:0/3070898188 conn(0x55f57ed2dd50 msgr2=0x55f57ed2eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.136+0000 7f8b29f7e740 1 -- 172.21.15.47:0/3070898188 shutdown_connections 2024-07-24T22:10:25.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.136+0000 7f8b29f7e740 1 -- 172.21.15.47:0/3070898188 wait complete. 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.136+0000 7f8b29f7e740 1 -- start start 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.136+0000 7f8b29f7e740 1 Processor -- start 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.136+0000 7f8b29f7e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 0x55f57ed3c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.136+0000 7f8b29f7e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed30840 0x55f57ed39690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b29f7e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed3c7d0 0x55f57ed39e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b29f7e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f57eafa890 con 0x55f57ed2ff20 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b29f7e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f57ec39390 con 0x55f57ed30840 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b29f7e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f57ed3f450 con 0x55f57ed3c7d0 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b29f7e740 10 client.0 _ll_register_callbacks cb 0x55f57ec43500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b25168640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 0x55f57ed3c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b25168640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 0x55f57ed3c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40710/0 (socket says 172.21.15.47:40710) 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b25168640 1 -- 172.21.15.47:0/3135809690 learned_addr learned my addr 172.21.15.47:0/3135809690 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b25969640 1 --2- 172.21.15.47:0/3135809690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed30840 0x55f57ed39690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b25168640 1 -- 172.21.15.47:0/3135809690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed3c7d0 msgr2=0x55f57ed39e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b25168640 1 --2- 172.21.15.47:0/3135809690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed3c7d0 0x55f57ed39e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b25168640 1 -- 172.21.15.47:0/3135809690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed30840 msgr2=0x55f57ed39690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b25168640 1 --2- 172.21.15.47:0/3135809690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed30840 0x55f57ed39690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b25168640 1 -- 172.21.15.47:0/3135809690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f57ec33d60 con 0x55f57ed2ff20 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b25168640 1 --2- 172.21.15.47:0/3135809690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 0x55f57ed3c240 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8b14014440 tx=0x7f8b1400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acabe657e0956f9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b057fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b057fa640 1 -- 172.21.15.47:0/3135809690 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14004b20 con 0x55f57ed2ff20 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b057fa640 1 -- 172.21.15.47:0/3135809690 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8b14004cc0 con 0x55f57ed2ff20 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.137+0000 7f8b29f7e740 1 -- 172.21.15.47:0/3135809690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b100054d0 con 0x55f57ed2ff20 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.138+0000 7f8b057fa640 1 -- 172.21.15.47:0/3135809690 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8b14003970 con 0x55f57ed2ff20 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.138+0000 7f8b29f7e740 10 client.16191 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.138+0000 7f8b29f7e740 1 -- 172.21.15.47:0/3135809690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f57ed4b360 con 0x55f57ed2ff20 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.138+0000 7f8b057fa640 1 -- 172.21.15.47:0/3135809690 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b100054d0 con 0x55f57ed2ff20 2024-07-24T22:10:25.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.138+0000 7f8b057fa640 1 -- 172.21.15.47:0/3135809690 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8b1401d580 con 0x55f57ed2ff20 2024-07-24T22:10:25.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.138+0000 7f8b29f7e740 10 client.16191 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:25.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.138+0000 7f8b29f7e740 10 client.16191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:25.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.138+0000 7f8b29f7e740 20 client.16191 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:25.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.138+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/3135809690 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f57ed4c810 0x55f57ed4ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.138+0000 7f8b29f7e740 4 client.16191 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:10:25.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.138+0000 7f8b29f7e740 1 -- 172.21.15.47:0/3135809690 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f57eca9940 con 0x55f57ed4c810 2024-07-24T22:10:25.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.138+0000 7f8b25969640 1 --2- 172.21.15.47:0/3135809690 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f57ed4c810 0x55f57ed4ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.139+0000 7f8b25969640 1 --2- 172.21.15.47:0/3135809690 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f57ed4c810 0x55f57ed4ec90 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbcf39e9d48d5012 server_cookie=7bbbe0a3684460ed in_seq=0 out_seq=0 2024-07-24T22:10:25.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.139+0000 7f8b057fa640 10 client.16191 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:25.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.139+0000 7f8b057fa640 1 -- 172.21.15.47:0/3135809690 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f57eca9940 con 0x55f57ed4c810 2024-07-24T22:10:25.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.139+0000 7f8b057fa640 10 client.16191 handle_command_reply: tid=0 2024-07-24T22:10:25.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.139+0000 7f8b29f7e740 1 client.16191 shutdown 2024-07-24T22:10:25.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.140+0000 7f8b29f7e740 1 -- 172.21.15.47:0/3135809690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 msgr2=0x55f57ed3c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:25.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.140+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/3135809690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 0x55f57ed3c240 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8b14014440 tx=0x7f8b1400a620 comp rx=0 tx=0).stop 2024-07-24T22:10:25.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.140+0000 7f8b29f7e740 1 -- 172.21.15.47:0/3135809690 shutdown_connections 2024-07-24T22:10:25.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.140+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/3135809690 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f57ed4c810 0x55f57ed4ec90 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.140+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/3135809690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed3c7d0 0x55f57ed39e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.140+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/3135809690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed30840 0x55f57ed39690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.140+0000 7f8b057fa640 0 client.16191 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:25.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.140+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/3135809690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 0x55f57ed3c240 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.140+0000 7f8b29f7e740 1 -- 172.21.15.47:0/3135809690 >> 172.21.15.47:0/3135809690 conn(0x55f57ed2dd50 msgr2=0x55f57ed338f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:25.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.140+0000 7f8b29f7e740 1 -- 172.21.15.47:0/3135809690 shutdown_connections 2024-07-24T22:10:25.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.140+0000 7f8b29f7e740 1 -- 172.21.15.47:0/3135809690 wait complete. 2024-07-24T22:10:25.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.140+0000 7f8b29f7e740 20 client.16191 trim_cache size 0 max 16384 2024-07-24T22:10:25.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.160+0000 7f8b29f7e740 1 Processor -- start 2024-07-24T22:10:25.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.160+0000 7f8b29f7e740 1 -- start start 2024-07-24T22:10:25.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.160+0000 7f8b29f7e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed2ff20 0x55f57ed2cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.160+0000 7f8b29f7e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed30840 0x55f57ed54560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.160+0000 7f8b29f7e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed3c7d0 0x55f57ed54aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.160+0000 7f8b29f7e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b201ae300 con 0x55f57ed3c7d0 2024-07-24T22:10:25.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.160+0000 7f8b29f7e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8b201b0b80 con 0x55f57ed2ff20 2024-07-24T22:10:25.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.160+0000 7f8b29f7e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8b201ae970 con 0x55f57ed30840 2024-07-24T22:10:25.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b25168640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed3c7d0 0x55f57ed54aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b25168640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed3c7d0 0x55f57ed54aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40724/0 (socket says 172.21.15.47:40724) 2024-07-24T22:10:25.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b25168640 1 -- 172.21.15.47:0/2431673004 learned_addr learned my addr 172.21.15.47:0/2431673004 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:25.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b25969640 1 --2- 172.21.15.47:0/2431673004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed30840 0x55f57ed54560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b25168640 1 --2- 172.21.15.47:0/2431673004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed2ff20 0x55f57ed2cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b25168640 1 -- 172.21.15.47:0/2431673004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed30840 msgr2=0x55f57ed54560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:25.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b25168640 1 --2- 172.21.15.47:0/2431673004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed30840 0x55f57ed54560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b25168640 1 -- 172.21.15.47:0/2431673004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed2ff20 msgr2=0x55f57ed2cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:25.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b25168640 1 --2- 172.21.15.47:0/2431673004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed2ff20 0x55f57ed2cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b25168640 1 -- 172.21.15.47:0/2431673004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f57ed2f840 con 0x55f57ed3c7d0 2024-07-24T22:10:25.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b25168640 1 --2- 172.21.15.47:0/2431673004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed3c7d0 0x55f57ed54aa0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400afd0 tx=0x7f8b1400a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd48a7e9a4f0bb1d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:25.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b077fe640 1 -- 172.21.15.47:0/2431673004 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1401dc90 con 0x55f57ed3c7d0 2024-07-24T22:10:25.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b077fe640 1 -- 172.21.15.47:0/2431673004 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b14026930 con 0x55f57ed3c7d0 2024-07-24T22:10:25.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.161+0000 7f8b077fe640 1 -- 172.21.15.47:0/2431673004 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b140107a0 con 0x55f57ed3c7d0 2024-07-24T22:10:25.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.162+0000 7f8b29f7e740 1 -- 172.21.15.47:0/2431673004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed3c7d0 msgr2=0x55f57ed54aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:25.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.162+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/2431673004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed3c7d0 0x55f57ed54aa0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400afd0 tx=0x7f8b1400a590 comp rx=0 tx=0).stop 2024-07-24T22:10:25.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.162+0000 7f8b29f7e740 1 -- 172.21.15.47:0/2431673004 shutdown_connections 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.162+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/2431673004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed3c7d0 0x55f57ed54aa0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.162+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/2431673004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed30840 0x55f57ed54560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.162+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/2431673004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed2ff20 0x55f57ed2cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.162+0000 7f8b29f7e740 1 -- 172.21.15.47:0/2431673004 >> 172.21.15.47:0/2431673004 conn(0x55f57ed2dd50 msgr2=0x55f57ed2c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.162+0000 7f8b29f7e740 1 -- 172.21.15.47:0/2431673004 shutdown_connections 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.162+0000 7f8b29f7e740 1 -- 172.21.15.47:0/2431673004 wait complete. 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.162+0000 7f8b29f7e740 1 -- start start 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b29f7e740 1 Processor -- start 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b29f7e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 0x55f57ed44900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b29f7e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed30840 0x55f57ed44e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b29f7e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed3c7d0 0x55f57ed3f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b29f7e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b201af040 con 0x55f57ed2ff20 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b29f7e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8b201b04b0 con 0x55f57ed3c7d0 2024-07-24T22:10:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b29f7e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8b201af710 con 0x55f57ed30840 2024-07-24T22:10:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b29f7e740 10 client.0 _ll_register_callbacks cb 0x7f8b14014360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b25168640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 0x55f57ed44900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b25168640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 0x55f57ed44900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40726/0 (socket says 172.21.15.47:40726) 2024-07-24T22:10:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b25168640 1 -- 172.21.15.47:0/700733560 learned_addr learned my addr 172.21.15.47:0/700733560 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b25969640 1 --2- 172.21.15.47:0/700733560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed30840 0x55f57ed44e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b25168640 1 --2- 172.21.15.47:0/700733560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed3c7d0 0x55f57ed3f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b25168640 1 -- 172.21.15.47:0/700733560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed30840 msgr2=0x55f57ed44e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b25168640 1 --2- 172.21.15.47:0/700733560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed30840 0x55f57ed44e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b25168640 1 -- 172.21.15.47:0/700733560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed3c7d0 msgr2=0x55f57ed3f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b25168640 1 --2- 172.21.15.47:0/700733560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed3c7d0 0x55f57ed3f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.163+0000 7f8b25168640 1 -- 172.21.15.47:0/700733560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f57ed3ff40 con 0x55f57ed2ff20 2024-07-24T22:10:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.164+0000 7f8b25168640 1 --2- 172.21.15.47:0/700733560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 0x55f57ed44900 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8b14002230 tx=0x7f8b14005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6b5789d8d39ece server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.164+0000 7f8b057fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:10:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.164+0000 7f8b057fa640 1 -- 172.21.15.47:0/700733560 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1403f060 con 0x55f57ed2ff20 2024-07-24T22:10:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.164+0000 7f8b057fa640 1 -- 172.21.15.47:0/700733560 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8b14026ae0 con 0x55f57ed2ff20 2024-07-24T22:10:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.164+0000 7f8b29f7e740 1 -- 172.21.15.47:0/700733560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b14026930 con 0x55f57ed2ff20 2024-07-24T22:10:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.164+0000 7f8b057fa640 1 -- 172.21.15.47:0/700733560 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8b14026ce0 con 0x55f57ed2ff20 2024-07-24T22:10:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.164+0000 7f8b29f7e740 10 client.16197 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.164+0000 7f8b29f7e740 1 -- 172.21.15.47:0/700733560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f57edb80d0 con 0x55f57ed2ff20 2024-07-24T22:10:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.164+0000 7f8b057fa640 1 -- 172.21.15.47:0/700733560 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b14026930 con 0x55f57ed2ff20 2024-07-24T22:10:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.164+0000 7f8b057fa640 1 -- 172.21.15.47:0/700733560 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8b14037440 con 0x55f57ed2ff20 2024-07-24T22:10:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.165+0000 7f8b29f7e740 10 client.16197 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.165+0000 7f8b29f7e740 10 client.16197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.165+0000 7f8b29f7e740 20 client.16197 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.165+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/700733560 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f57edb8740 0x55f57edbab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.165+0000 7f8b29f7e740 4 client.16197 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:10:25.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.165+0000 7f8b29f7e740 1 -- 172.21.15.47:0/700733560 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f57eca53e0 con 0x55f57edb8740 2024-07-24T22:10:25.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.165+0000 7f8b25969640 1 --2- 172.21.15.47:0/700733560 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f57edb8740 0x55f57edbab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:25.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.165+0000 7f8b057fa640 10 client.16197 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:25.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.165+0000 7f8b25969640 1 --2- 172.21.15.47:0/700733560 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f57edb8740 0x55f57edbab60 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aa7b06743cb04 server_cookie=11596ae3c58be55b in_seq=0 out_seq=0 2024-07-24T22:10:25.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.166+0000 7f8b057fa640 1 -- 172.21.15.47:0/700733560 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f57eca53e0 con 0x55f57edb8740 2024-07-24T22:10:25.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.166+0000 7f8b057fa640 10 client.16197 handle_command_reply: tid=0 2024-07-24T22:10:25.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.166+0000 7f8b29f7e740 1 client.16197 shutdown 2024-07-24T22:10:25.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.166+0000 7f8b29f7e740 1 -- 172.21.15.47:0/700733560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 msgr2=0x55f57ed44900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:25.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.166+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/700733560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 0x55f57ed44900 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8b14002230 tx=0x7f8b14005fa0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b29f7e740 1 -- 172.21.15.47:0/700733560 shutdown_connections 2024-07-24T22:10:25.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/700733560 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f57edb8740 0x55f57edbab60 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/700733560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f57ed3c7d0 0x55f57ed3f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/700733560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f57ed30840 0x55f57ed44e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b29f7e740 1 --2- 172.21.15.47:0/700733560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f57ed2ff20 0x55f57ed44900 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b29f7e740 1 -- 172.21.15.47:0/700733560 >> 172.21.15.47:0/700733560 conn(0x55f57ed2dd50 msgr2=0x55f57ed33880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:25.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b057fa640 0 client.16197 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:25.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b29f7e740 1 -- 172.21.15.47:0/700733560 shutdown_connections 2024-07-24T22:10:25.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b29f7e740 1 -- 172.21.15.47:0/700733560 wait complete. 2024-07-24T22:10:25.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b29f7e740 20 client.16197 trim_cache size 0 max 16384 2024-07-24T22:10:25.173 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:10:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:10:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "c1f1184a-27ca-442c-bc9d-24b5a5313c4b", 2024-07-24T22:10:25.173 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:10:25.173 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:10:25.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b27bcd640 1 -- 172.21.15.47:0/3539963904 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b080b3d40 msgr2=0x7f8b080b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:25.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b27bcd640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b080b3d40 0x7f8b080b6200 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8b18101d60 tx=0x7f8b1803b5d0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b27bcd640 1 -- 172.21.15.47:0/3539963904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b20107a00 msgr2=0x7f8b201a06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:25.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b27bcd640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b20107a00 0x7f8b201a06c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8b18004770 tx=0x7f8b18004270 comp rx=0 tx=0).stop 2024-07-24T22:10:25.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b27bcd640 1 -- 172.21.15.47:0/3539963904 shutdown_connections 2024-07-24T22:10:25.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b27bcd640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b080b3d40 0x7f8b080b6200 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b27bcd640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b20107a00 0x7f8b201a06c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b27bcd640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b20107080 0x7f8b2019b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b27bcd640 1 --2- 172.21.15.47:0/3539963904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b20101670 0x7f8b2019ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:25.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.167+0000 7f8b27bcd640 1 -- 172.21.15.47:0/3539963904 >> 172.21.15.47:0/3539963904 conn(0x7f8b200fd0e0 msgr2=0x7f8b2006ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:25.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.168+0000 7f8b27bcd640 1 -- 172.21.15.47:0/3539963904 shutdown_connections 2024-07-24T22:10:25.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:25.168+0000 7f8b27bcd640 1 -- 172.21.15.47:0/3539963904 wait complete. 2024-07-24T22:10:25.633 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:25 smithi047 ceph-mon[32551]: pgmap v462: 97 pgs: 97 active+clean; 24 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 469 MiB/s wr, 1.99k op/s 2024-07-24T22:10:25.633 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:25 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:10:25.633 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:25 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:10:25.633 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:25 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:10:25.633 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:25 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:10:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:25 smithi183 ceph-mon[37007]: pgmap v462: 97 pgs: 97 active+clean; 24 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 469 MiB/s wr, 1.99k op/s 2024-07-24T22:10:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:25 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:10:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:25 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:10:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:25 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:10:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:25 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:10:25.944 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:10:26.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:25 smithi188 ceph-mon[37380]: pgmap v462: 97 pgs: 97 active+clean; 24 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 469 MiB/s wr, 1.99k op/s 2024-07-24T22:10:26.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:25 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:10:26.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:25 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:10:26.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:25 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:10:26.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:25 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:10:26.210 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:10:27.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:27 smithi047 ceph-mon[32551]: pgmap v463: 97 pgs: 97 active+clean; 24 GiB data, 72 GiB used, 1000 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 416 MiB/s wr, 1.52k op/s 2024-07-24T22:10:27.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:27 smithi183 ceph-mon[37007]: pgmap v463: 97 pgs: 97 active+clean; 24 GiB data, 72 GiB used, 1000 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 416 MiB/s wr, 1.52k op/s 2024-07-24T22:10:28.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.031+0000 7f136f514640 1 -- 172.21.15.47:0/3775264601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1368103f80 msgr2=0x7f136810c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:28.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.031+0000 7f136f514640 1 --2- 172.21.15.47:0/3775264601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1368103f80 0x7f136810c470 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f135c009900 tx=0x7f135c02a410 comp rx=0 tx=0).stop 2024-07-24T22:10:28.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.031+0000 7f136f514640 1 -- 172.21.15.47:0/3775264601 shutdown_connections 2024-07-24T22:10:28.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.031+0000 7f136f514640 1 --2- 172.21.15.47:0/3775264601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f136810cac0 0x7f136810ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.031+0000 7f136f514640 1 --2- 172.21.15.47:0/3775264601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1368103f80 0x7f136810c470 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.031+0000 7f136f514640 1 --2- 172.21.15.47:0/3775264601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1368103660 0x7f1368103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.031+0000 7f136f514640 1 -- 172.21.15.47:0/3775264601 >> 172.21.15.47:0/3775264601 conn(0x7f13680fd0c0 msgr2=0x7f13680ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:28.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.031+0000 7f136f514640 1 -- 172.21.15.47:0/3775264601 shutdown_connections 2024-07-24T22:10:28.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.031+0000 7f136f514640 1 -- 172.21.15.47:0/3775264601 wait complete. 2024-07-24T22:10:28.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.032+0000 7f136f514640 1 Processor -- start 2024-07-24T22:10:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.032+0000 7f136f514640 1 -- start start 2024-07-24T22:10:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.032+0000 7f136f514640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1368103660 0x7f1368101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.032+0000 7f136f514640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1368103f80 0x7f1368101850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.032+0000 7f136f514640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f136810cac0 0x7f1368101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.032+0000 7f136f514640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1368112720 con 0x7f1368103f80 2024-07-24T22:10:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.032+0000 7f136f514640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f13681125a0 con 0x7f1368103660 2024-07-24T22:10:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.032+0000 7f136f514640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f13681128a0 con 0x7f136810cac0 2024-07-24T22:10:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.032+0000 7f136caaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1368103f80 0x7f1368101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.032+0000 7f136caaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1368103f80 0x7f1368101850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40742/0 (socket says 172.21.15.47:40742) 2024-07-24T22:10:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.032+0000 7f136caaf640 1 -- 172.21.15.47:0/354906010 learned_addr learned my addr 172.21.15.47:0/354906010 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.032+0000 7f136d2b0640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1368103660 0x7f1368101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.032+0000 7f136dab1640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f136810cac0 0x7f1368101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.033+0000 7f136caaf640 1 -- 172.21.15.47:0/354906010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f136810cac0 msgr2=0x7f1368101d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.033+0000 7f136caaf640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f136810cac0 0x7f1368101d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.033+0000 7f136caaf640 1 -- 172.21.15.47:0/354906010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1368103660 msgr2=0x7f1368101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.033+0000 7f136caaf640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1368103660 0x7f1368101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.033+0000 7f136caaf640 1 -- 172.21.15.47:0/354906010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13681a7110 con 0x7f1368103f80 2024-07-24T22:10:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.033+0000 7f136dab1640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f136810cac0 0x7f1368101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:10:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.033+0000 7f136caaf640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1368103f80 0x7f1368101850 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f135c006010 tx=0x7f135c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.033+0000 7f13667fc640 1 -- 172.21.15.47:0/354906010 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c03f030 con 0x7f1368103f80 2024-07-24T22:10:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.033+0000 7f13667fc640 1 -- 172.21.15.47:0/354906010 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f135c003aa0 con 0x7f1368103f80 2024-07-24T22:10:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.033+0000 7f136f514640 1 -- 172.21.15.47:0/354906010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13681a73a0 con 0x7f1368103f80 2024-07-24T22:10:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.033+0000 7f13667fc640 1 -- 172.21.15.47:0/354906010 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c035070 con 0x7f1368103f80 2024-07-24T22:10:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.033+0000 7f136f514640 1 -- 172.21.15.47:0/354906010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13681a7880 con 0x7f1368103f80 2024-07-24T22:10:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f13667fc640 1 -- 172.21.15.47:0/354906010 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f135c042030 con 0x7f1368103f80 2024-07-24T22:10:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f13718c5740 1 Processor -- start 2024-07-24T22:10:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f13718c5740 1 -- start start 2024-07-24T22:10:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f13718c5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 0x55a0e9f57a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f13718c5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f63a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f13718c5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f63f60 0x55a0e9f66350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f13718c5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a0e9ece990 con 0x55a0e9f63f60 2024-07-24T22:10:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f13718c5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a0e9ebde90 con 0x55a0e9f57fd0 2024-07-24T22:10:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f13718c5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a0e9ec1ed0 con 0x55a0e9f576b0 2024-07-24T22:10:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f136caaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f63f60 0x55a0e9f66350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f136dab1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 0x55a0e9f57a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f136caaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f63f60 0x55a0e9f66350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40744/0 (socket says 172.21.15.47:40744) 2024-07-24T22:10:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f136caaf640 1 -- 172.21.15.47:0/1823345309 learned_addr learned my addr 172.21.15.47:0/1823345309 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.036+0000 7f136d2b0640 1 --2- 172.21.15.47:0/1823345309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f63a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.037+0000 7f13667fc640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13500b3d40 0x7f13500b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.037+0000 7f136dab1640 1 -- 172.21.15.47:0/1823345309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f57fd0 msgr2=0x55a0e9f63a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.037+0000 7f136dab1640 1 --2- 172.21.15.47:0/1823345309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f63a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.037+0000 7f136dab1640 1 -- 172.21.15.47:0/1823345309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f63f60 msgr2=0x55a0e9f66350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.037+0000 7f136dab1640 1 --2- 172.21.15.47:0/1823345309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f63f60 0x55a0e9f66350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.037+0000 7f136dab1640 1 -- 172.21.15.47:0/1823345309 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e9e47300 con 0x55a0e9f576b0 2024-07-24T22:10:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.037+0000 7f136d2b0640 1 --2- 172.21.15.47:0/1823345309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f63a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:10:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.037+0000 7f13667fc640 1 -- 172.21.15.47:0/354906010 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f135c104510 con 0x7f1368103f80 2024-07-24T22:10:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.037+0000 7f136dab1640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13500b3d40 0x7f13500b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.037+0000 7f136dab1640 1 --2- 172.21.15.47:0/1823345309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 0x55a0e9f57a90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13681033d0 tx=0x7f136000cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66c75ca9ba0d372a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.038+0000 7f134f7fe640 1 -- 172.21.15.47:0/1823345309 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136001c610 con 0x55a0e9f576b0 2024-07-24T22:10:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.038+0000 7f136dab1640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13500b3d40 0x7f13500b6200 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f136001d000 tx=0x7f1360020000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.038+0000 7f134f7fe640 1 -- 172.21.15.47:0/1823345309 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f136001cc60 con 0x55a0e9f576b0 2024-07-24T22:10:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.038+0000 7f134f7fe640 1 -- 172.21.15.47:0/1823345309 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360024a30 con 0x55a0e9f576b0 2024-07-24T22:10:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.038+0000 7f13718c5740 1 -- 172.21.15.47:0/1823345309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 msgr2=0x55a0e9f57a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.038+0000 7f13718c5740 1 --2- 172.21.15.47:0/1823345309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 0x55a0e9f57a90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13681033d0 tx=0x7f136000cf30 comp rx=0 tx=0).stop 2024-07-24T22:10:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.039+0000 7f13718c5740 1 -- 172.21.15.47:0/1823345309 shutdown_connections 2024-07-24T22:10:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.039+0000 7f13718c5740 1 --2- 172.21.15.47:0/1823345309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f63f60 0x55a0e9f66350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.039+0000 7f13718c5740 1 --2- 172.21.15.47:0/1823345309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f63a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.039+0000 7f13718c5740 1 --2- 172.21.15.47:0/1823345309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 0x55a0e9f57a90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.039+0000 7f13718c5740 1 -- 172.21.15.47:0/1823345309 >> 172.21.15.47:0/1823345309 conn(0x55a0e9f554e0 msgr2=0x55a0e9f56680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.039+0000 7f13718c5740 1 -- 172.21.15.47:0/1823345309 shutdown_connections 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.039+0000 7f13718c5740 1 -- 172.21.15.47:0/1823345309 wait complete. 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.039+0000 7f13718c5740 1 -- start start 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.039+0000 7f13718c5740 1 Processor -- start 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.039+0000 7f13718c5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 0x55a0e9f60ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f13718c5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f61400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f13718c5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f63f60 0x55a0e9f61940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f13718c5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a0e9d21700 con 0x55a0e9f63f60 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f13718c5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a0e9e605d0 con 0x55a0e9f57fd0 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f13718c5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a0e9f66be0 con 0x55a0e9f576b0 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f13718c5740 10 client.0 _ll_register_callbacks cb 0x55a0e9e80940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f136dab1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f63f60 0x55a0e9f61940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f136dab1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f63f60 0x55a0e9f61940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40752/0 (socket says 172.21.15.47:40752) 2024-07-24T22:10:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f136dab1640 1 -- 172.21.15.47:0/838614190 learned_addr learned my addr 172.21.15.47:0/838614190 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f136d2b0640 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 0x55a0e9f60ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f136caaf640 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f61400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f136dab1640 1 -- 172.21.15.47:0/838614190 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 msgr2=0x55a0e9f60ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f136dab1640 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 0x55a0e9f60ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f136dab1640 1 -- 172.21.15.47:0/838614190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f57fd0 msgr2=0x55a0e9f61400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f136dab1640 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f61400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f136dab1640 1 -- 172.21.15.47:0/838614190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e9e53660 con 0x55a0e9f63f60 2024-07-24T22:10:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f136caaf640 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f61400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:10:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f136dab1640 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f63f60 0x55a0e9f61940 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1360024fe0 tx=0x7f1360024440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6333fba746cee146 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.040+0000 7f134cff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:10:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f134cff9640 1 -- 172.21.15.47:0/838614190 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360036060 con 0x55a0e9f63f60 2024-07-24T22:10:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f134cff9640 1 -- 172.21.15.47:0/838614190 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f136000c5a0 con 0x55a0e9f63f60 2024-07-24T22:10:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f13718c5740 1 -- 172.21.15.47:0/838614190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f136001cc60 con 0x55a0e9f63f60 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f134cff9640 1 -- 172.21.15.47:0/838614190 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f13600247b0 con 0x55a0e9f63f60 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f13718c5740 10 client.16209 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f13718c5740 1 -- 172.21.15.47:0/838614190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a0e9c1e650 con 0x55a0e9f63f60 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f134cff9640 1 -- 172.21.15.47:0/838614190 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f136001cc60 con 0x55a0e9f63f60 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f134cff9640 1 -- 172.21.15.47:0/838614190 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f136001c670 con 0x55a0e9f63f60 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f13718c5740 10 client.16209 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f13718c5740 10 client.16209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f13718c5740 20 client.16209 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f13718c5740 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a0e9f73970 0x55a0e9f75d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f13718c5740 4 client.16209 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.041+0000 7f13718c5740 1 -- 172.21.15.47:0/838614190 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0e9ed08e0 con 0x55a0e9f73970 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.042+0000 7f136d2b0640 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a0e9f73970 0x55a0e9f75d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.042+0000 7f136d2b0640 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a0e9f73970 0x55a0e9f75d60 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3b3b83d8940e5b server_cookie=ebcc5d65bce1b3d8 in_seq=0 out_seq=0 2024-07-24T22:10:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.042+0000 7f134cff9640 10 client.16209 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f134cff9640 1 -- 172.21.15.47:0/838614190 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0e9ed08e0 con 0x55a0e9f73970 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f134cff9640 10 client.16209 handle_command_reply: tid=0 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f13718c5740 1 client.16209 shutdown 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f13718c5740 1 -- 172.21.15.47:0/838614190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f63f60 msgr2=0x55a0e9f61940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f13718c5740 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f63f60 0x55a0e9f61940 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1360024fe0 tx=0x7f1360024440 comp rx=0 tx=0).stop 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f13718c5740 1 -- 172.21.15.47:0/838614190 shutdown_connections 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f13718c5740 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a0e9f73970 0x55a0e9f75d60 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f134cff9640 0 client.16209 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f13718c5740 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f63f60 0x55a0e9f61940 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f13718c5740 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f61400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f13718c5740 1 --2- 172.21.15.47:0/838614190 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 0x55a0e9f60ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f13718c5740 1 -- 172.21.15.47:0/838614190 >> 172.21.15.47:0/838614190 conn(0x55a0e9f554e0 msgr2=0x55a0e9f5b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f13718c5740 1 -- 172.21.15.47:0/838614190 shutdown_connections 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f13718c5740 1 -- 172.21.15.47:0/838614190 wait complete. 2024-07-24T22:10:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.043+0000 7f13718c5740 20 client.16209 trim_cache size 0 max 16384 2024-07-24T22:10:28.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:27 smithi188 ceph-mon[37380]: pgmap v463: 97 pgs: 97 active+clean; 24 GiB data, 72 GiB used, 1000 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 416 MiB/s wr, 1.52k op/s 2024-07-24T22:10:28.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f13718c5740 1 Processor -- start 2024-07-24T22:10:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f13718c5740 1 -- start start 2024-07-24T22:10:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f13718c5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f576b0 0x55a0e9f62fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f13718c5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f7b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f13718c5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f63f60 0x55a0e9f7b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f13718c5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f13681ae360 con 0x55a0e9f576b0 2024-07-24T22:10:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f13718c5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f13681b0be0 con 0x55a0e9f63f60 2024-07-24T22:10:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f13718c5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f13681ae9d0 con 0x55a0e9f57fd0 2024-07-24T22:10:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f136d2b0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f576b0 0x55a0e9f62fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f136d2b0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f576b0 0x55a0e9f62fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40762/0 (socket says 172.21.15.47:40762) 2024-07-24T22:10:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f136d2b0640 1 -- 172.21.15.47:0/1548477813 learned_addr learned my addr 172.21.15.47:0/1548477813 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f136caaf640 1 --2- 172.21.15.47:0/1548477813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f7b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f136d2b0640 1 -- 172.21.15.47:0/1548477813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f57fd0 msgr2=0x55a0e9f7b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:28.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f136d2b0640 1 --2- 172.21.15.47:0/1548477813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f7b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f136dab1640 1 --2- 172.21.15.47:0/1548477813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f63f60 0x55a0e9f7b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f136d2b0640 1 -- 172.21.15.47:0/1548477813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f63f60 msgr2=0x55a0e9f7b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:28.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f136d2b0640 1 --2- 172.21.15.47:0/1548477813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f63f60 0x55a0e9f7b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f136d2b0640 1 -- 172.21.15.47:0/1548477813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e9f57e00 con 0x55a0e9f576b0 2024-07-24T22:10:28.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.062+0000 7f136caaf640 1 --2- 172.21.15.47:0/1548477813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f7b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:10:28.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.063+0000 7f136d2b0640 1 --2- 172.21.15.47:0/1548477813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f576b0 0x55a0e9f62fc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f13580147c0 tx=0x7f1358014c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b0e4dab8414ccd server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:28.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.063+0000 7f134effd640 1 -- 172.21.15.47:0/1548477813 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358014db0 con 0x55a0e9f576b0 2024-07-24T22:10:28.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.063+0000 7f134effd640 1 -- 172.21.15.47:0/1548477813 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13580140d0 con 0x55a0e9f576b0 2024-07-24T22:10:28.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.063+0000 7f134effd640 1 -- 172.21.15.47:0/1548477813 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358005020 con 0x55a0e9f576b0 2024-07-24T22:10:28.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.063+0000 7f13718c5740 1 -- 172.21.15.47:0/1548477813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f576b0 msgr2=0x55a0e9f62fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:28.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.063+0000 7f13718c5740 1 --2- 172.21.15.47:0/1548477813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f576b0 0x55a0e9f62fc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f13580147c0 tx=0x7f1358014c80 comp rx=0 tx=0).stop 2024-07-24T22:10:28.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 -- 172.21.15.47:0/1548477813 shutdown_connections 2024-07-24T22:10:28.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 --2- 172.21.15.47:0/1548477813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f63f60 0x55a0e9f7b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 --2- 172.21.15.47:0/1548477813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f7b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 --2- 172.21.15.47:0/1548477813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f576b0 0x55a0e9f62fc0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 -- 172.21.15.47:0/1548477813 >> 172.21.15.47:0/1548477813 conn(0x55a0e9f554e0 msgr2=0x55a0e9f54550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:28.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 -- 172.21.15.47:0/1548477813 shutdown_connections 2024-07-24T22:10:28.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 -- 172.21.15.47:0/1548477813 wait complete. 2024-07-24T22:10:28.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 -- start start 2024-07-24T22:10:28.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 Processor -- start 2024-07-24T22:10:28.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 0x55a0e9f6c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f678f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f63f60 0x55a0e9f67e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f13681af0a0 con 0x55a0e9f57fd0 2024-07-24T22:10:28.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f13681b0510 con 0x55a0e9f63f60 2024-07-24T22:10:28.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.064+0000 7f13718c5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f13681af770 con 0x55a0e9f576b0 2024-07-24T22:10:28.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f13718c5740 10 client.0 _ll_register_callbacks cb 0x7f1360014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:28.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f136caaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f136caaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f678f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40768/0 (socket says 172.21.15.47:40768) 2024-07-24T22:10:28.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f136caaf640 1 -- 172.21.15.47:0/531871978 learned_addr learned my addr 172.21.15.47:0/531871978 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:28.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f136d2b0640 1 --2- 172.21.15.47:0/531871978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 0x55a0e9f6c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f136caaf640 1 -- 172.21.15.47:0/531871978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 msgr2=0x55a0e9f6c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f136caaf640 1 --2- 172.21.15.47:0/531871978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 0x55a0e9f6c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f136dab1640 1 --2- 172.21.15.47:0/531871978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f63f60 0x55a0e9f67e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f136caaf640 1 -- 172.21.15.47:0/531871978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f63f60 msgr2=0x55a0e9f67e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f136caaf640 1 --2- 172.21.15.47:0/531871978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f63f60 0x55a0e9f67e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f136caaf640 1 -- 172.21.15.47:0/531871978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e9f68570 con 0x55a0e9f57fd0 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f136caaf640 1 --2- 172.21.15.47:0/531871978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f678f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f135c0cb010 tx=0x7f135c004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ae140402933171 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f134cff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f134cff9640 1 -- 172.21.15.47:0/531871978 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c049070 con 0x55a0e9f57fd0 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f134cff9640 1 -- 172.21.15.47:0/531871978 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f135c0cb2e0 con 0x55a0e9f57fd0 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f13718c5740 1 -- 172.21.15.47:0/531871978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13580140d0 con 0x55a0e9f57fd0 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f134cff9640 1 -- 172.21.15.47:0/531871978 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f135c0cae50 con 0x55a0e9f57fd0 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f13718c5740 10 client.16215 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.065+0000 7f13718c5740 1 -- 172.21.15.47:0/531871978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a0e9fde220 con 0x55a0e9f57fd0 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.066+0000 7f134cff9640 1 -- 172.21.15.47:0/531871978 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13580140d0 con 0x55a0e9f57fd0 2024-07-24T22:10:28.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.066+0000 7f134cff9640 1 -- 172.21.15.47:0/531871978 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f135c0d3ca0 con 0x55a0e9f57fd0 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.066+0000 7f13718c5740 10 client.16215 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.066+0000 7f13718c5740 10 client.16215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.066+0000 7f13718c5740 20 client.16215 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.066+0000 7f13718c5740 1 --2- 172.21.15.47:0/531871978 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a0e9f73970 0x55a0e9fe0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.066+0000 7f13718c5740 4 client.16215 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.066+0000 7f13718c5740 1 -- 172.21.15.47:0/531871978 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a0e9ecc380 con 0x55a0e9f73970 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.066+0000 7f136d2b0640 1 --2- 172.21.15.47:0/531871978 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a0e9f73970 0x55a0e9fe0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f136d2b0640 1 --2- 172.21.15.47:0/531871978 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a0e9f73970 0x55a0e9fe0a10 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad15d832b5f514d4 server_cookie=c8a7b65652cc152b in_seq=0 out_seq=0 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f134cff9640 10 client.16215 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f134cff9640 1 -- 172.21.15.47:0/531871978 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a0e9ecc380 con 0x55a0e9f73970 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f134cff9640 10 client.16215 handle_command_reply: tid=0 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f13718c5740 1 client.16215 shutdown 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f13718c5740 1 -- 172.21.15.47:0/531871978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f57fd0 msgr2=0x55a0e9f678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:28.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f13718c5740 1 --2- 172.21.15.47:0/531871978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f678f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f135c0cb010 tx=0x7f135c004550 comp rx=0 tx=0).stop 2024-07-24T22:10:28.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f13718c5740 1 -- 172.21.15.47:0/531871978 shutdown_connections 2024-07-24T22:10:28.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f13718c5740 1 --2- 172.21.15.47:0/531871978 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a0e9f73970 0x55a0e9fe0a10 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f13718c5740 1 --2- 172.21.15.47:0/531871978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a0e9f63f60 0x55a0e9f67e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f13718c5740 1 --2- 172.21.15.47:0/531871978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a0e9f57fd0 0x55a0e9f678f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f13718c5740 1 --2- 172.21.15.47:0/531871978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a0e9f576b0 0x55a0e9f6c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f13718c5740 1 -- 172.21.15.47:0/531871978 >> 172.21.15.47:0/531871978 conn(0x55a0e9f554e0 msgr2=0x55a0e9f5a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:28.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f134cff9640 0 client.16215 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:28.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f13718c5740 1 -- 172.21.15.47:0/531871978 shutdown_connections 2024-07-24T22:10:28.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f13718c5740 1 -- 172.21.15.47:0/531871978 wait complete. 2024-07-24T22:10:28.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.067+0000 7f13718c5740 20 client.16215 trim_cache size 0 max 16384 2024-07-24T22:10:28.074 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:10:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-07-24T22:10:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-07-24T22:10:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: "c1f1184a-27ca-442c-bc9d-24b5a5313c4b": { 2024-07-24T22:10:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-07-24T22:10:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "c1f1184a-27ca-442c-bc9d-24b5a5313c4b", 2024-07-24T22:10:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-07-24T22:10:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:28.075 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:10:28.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.068+0000 7f136f514640 1 -- 172.21.15.47:0/354906010 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13500b3d40 msgr2=0x7f13500b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:28.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.068+0000 7f136f514640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13500b3d40 0x7f13500b6200 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f136001d000 tx=0x7f1360020000 comp rx=0 tx=0).stop 2024-07-24T22:10:28.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.068+0000 7f136f514640 1 -- 172.21.15.47:0/354906010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1368103f80 msgr2=0x7f1368101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:28.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.068+0000 7f136f514640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1368103f80 0x7f1368101850 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f135c006010 tx=0x7f135c004060 comp rx=0 tx=0).stop 2024-07-24T22:10:28.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.068+0000 7f136f514640 1 -- 172.21.15.47:0/354906010 shutdown_connections 2024-07-24T22:10:28.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.068+0000 7f136f514640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f13500b3d40 0x7f13500b6200 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.068+0000 7f136f514640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f136810cac0 0x7f1368101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.068+0000 7f136f514640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1368103f80 0x7f1368101850 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.068+0000 7f136f514640 1 --2- 172.21.15.47:0/354906010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1368103660 0x7f1368101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:28.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.068+0000 7f136f514640 1 -- 172.21.15.47:0/354906010 >> 172.21.15.47:0/354906010 conn(0x7f13680fd0c0 msgr2=0x7f13680fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:28.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.068+0000 7f136f514640 1 -- 172.21.15.47:0/354906010 shutdown_connections 2024-07-24T22:10:28.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:28.068+0000 7f136f514640 1 -- 172.21.15.47:0/354906010 wait complete. 2024-07-24T22:10:28.818 INFO:tasks.cephfs.filesystem:scrub status for tag:c1f1184a-27ca-442c-bc9d-24b5a5313c4b - {'path': '/', 'tag': 'c1f1184a-27ca-442c-bc9d-24b5a5313c4b', 'options': 'recursive,force'} 2024-07-24T22:10:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:29 smithi183 ceph-mon[37007]: pgmap v464: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 383 MiB/s wr, 1.18k op/s 2024-07-24T22:10:29.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:29 smithi047 ceph-mon[32551]: pgmap v464: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 383 MiB/s wr, 1.18k op/s 2024-07-24T22:10:30.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:29 smithi188 ceph-mon[37380]: pgmap v464: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 383 MiB/s wr, 1.18k op/s 2024-07-24T22:10:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:30 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:10:30.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:30 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:10:31.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:30 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:10:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.517+0000 7f79cab19640 1 -- 172.21.15.47:0/3644809192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79c4107950 msgr2=0x7f79c410e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.517+0000 7f79cab19640 1 --2- 172.21.15.47:0/3644809192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79c4107950 0x7f79c410e150 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009ca0 tx=0x7f79bc02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.517+0000 7f79cab19640 1 -- 172.21.15.47:0/3644809192 shutdown_connections 2024-07-24T22:10:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.517+0000 7f79cab19640 1 --2- 172.21.15.47:0/3644809192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79c4107950 0x7f79c410e150 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.517+0000 7f79cab19640 1 --2- 172.21.15.47:0/3644809192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c4106fd0 0x7f79c4107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.517+0000 7f79cab19640 1 --2- 172.21.15.47:0/3644809192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79c41015d0 0x7f79c41019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.517+0000 7f79cab19640 1 -- 172.21.15.47:0/3644809192 >> 172.21.15.47:0/3644809192 conn(0x7f79c40fd030 msgr2=0x7f79c40ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.517+0000 7f79cab19640 1 -- 172.21.15.47:0/3644809192 shutdown_connections 2024-07-24T22:10:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.517+0000 7f79cab19640 1 -- 172.21.15.47:0/3644809192 wait complete. 2024-07-24T22:10:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.517+0000 7f79cab19640 1 Processor -- start 2024-07-24T22:10:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.517+0000 7f79cab19640 1 -- start start 2024-07-24T22:10:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79cab19640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c41015d0 0x7f79c4198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79cab19640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79c4106fd0 0x7f79c4199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79cab19640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79c4107950 0x7f79c419e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79cab19640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f79c41115d0 con 0x7f79c4107950 2024-07-24T22:10:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79cab19640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f79c4111450 con 0x7f79c41015d0 2024-07-24T22:10:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79cab19640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f79c4111750 con 0x7f79c4106fd0 2024-07-24T22:10:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79c90b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79c4107950 0x7f79c419e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79c90b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79c4107950 0x7f79c419e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40786/0 (socket says 172.21.15.47:40786) 2024-07-24T22:10:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79c90b6640 1 -- 172.21.15.47:0/1226946466 learned_addr learned my addr 172.21.15.47:0/1226946466 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79c88b5640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c41015d0 0x7f79c4198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79bbfff640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79c4106fd0 0x7f79c4199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79c90b6640 1 -- 172.21.15.47:0/1226946466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79c4106fd0 msgr2=0x7f79c4199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79c90b6640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79c4106fd0 0x7f79c4199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79c90b6640 1 -- 172.21.15.47:0/1226946466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c41015d0 msgr2=0x7f79c4198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79c90b6640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c41015d0 0x7f79c4198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.518+0000 7f79c90b6640 1 -- 172.21.15.47:0/1226946466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c419ebc0 con 0x7f79c4107950 2024-07-24T22:10:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.519+0000 7f79c90b6640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79c4107950 0x7f79c419e3f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009430 tx=0x7f79bc0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.519+0000 7f79b9ffb640 1 -- 172.21.15.47:0/1226946466 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc003b70 con 0x7f79c4107950 2024-07-24T22:10:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.519+0000 7f79cab19640 1 -- 172.21.15.47:0/1226946466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c419ee50 con 0x7f79c4107950 2024-07-24T22:10:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.519+0000 7f79b9ffb640 1 -- 172.21.15.47:0/1226946466 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79bc003d10 con 0x7f79c4107950 2024-07-24T22:10:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.519+0000 7f79b9ffb640 1 -- 172.21.15.47:0/1226946466 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc02fa30 con 0x7f79c4107950 2024-07-24T22:10:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.519+0000 7f79cab19640 1 -- 172.21.15.47:0/1226946466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c41a5570 con 0x7f79c4107950 2024-07-24T22:10:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79cd86a740 1 Processor -- start 2024-07-24T22:10:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79b9ffb640 1 -- 172.21.15.47:0/1226946466 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f79bc02fbd0 con 0x7f79c4107950 2024-07-24T22:10:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79cd86a740 1 -- start start 2024-07-24T22:10:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79cd86a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x5578851560b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79cd86a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5578851565f0 0x557885162040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79cd86a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x557885164970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79cd86a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5578850c7280 con 0x557885155cd0 2024-07-24T22:10:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79cd86a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5578850b6780 con 0x5578851565f0 2024-07-24T22:10:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79cd86a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5578850ba7c0 con 0x557885162580 2024-07-24T22:10:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79bbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x5578851560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79bbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x5578851560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40802/0 (socket says 172.21.15.47:40802) 2024-07-24T22:10:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79bbfff640 1 -- 172.21.15.47:0/2616462583 learned_addr learned my addr 172.21.15.47:0/2616462583 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79c88b5640 1 --2- 172.21.15.47:0/2616462583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5578851565f0 0x557885162040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79bbfff640 1 --2- 172.21.15.47:0/2616462583 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x557885164970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79bbfff640 1 -- 172.21.15.47:0/2616462583 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 msgr2=0x557885164970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79bbfff640 1 --2- 172.21.15.47:0/2616462583 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x557885164970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79bbfff640 1 -- 172.21.15.47:0/2616462583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5578851565f0 msgr2=0x557885162040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79bbfff640 1 --2- 172.21.15.47:0/2616462583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5578851565f0 0x557885162040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.522+0000 7f79bbfff640 1 -- 172.21.15.47:0/2616462583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557884e1a790 con 0x557885155cd0 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.523+0000 7f79b9ffb640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f79ac0b3d40 0x7f79ac0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.523+0000 7f79bbfff640 1 --2- 172.21.15.47:0/2616462583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x5578851560b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f79b400bfa0 tx=0x7f79b400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7795cf9aba8c16b7 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.523+0000 7f79c88b5640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f79ac0b3d40 0x7f79ac0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.523+0000 7f79b9ffb640 1 -- 172.21.15.47:0/1226946466 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f79bc105380 con 0x7f79c4107950 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.523+0000 7f79aaffd640 1 -- 172.21.15.47:0/2616462583 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b4004030 con 0x557885155cd0 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.523+0000 7f79aaffd640 1 -- 172.21.15.47:0/2616462583 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79b40041d0 con 0x557885155cd0 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.523+0000 7f79aaffd640 1 -- 172.21.15.47:0/2616462583 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b40106c0 con 0x557885155cd0 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.524+0000 7f79cd86a740 1 -- 172.21.15.47:0/2616462583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 msgr2=0x5578851560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.524+0000 7f79c88b5640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f79ac0b3d40 0x7f79ac0b6200 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x557885158e50 tx=0x7f79c000a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.524+0000 7f79cd86a740 1 --2- 172.21.15.47:0/2616462583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x5578851560b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f79b400bfa0 tx=0x7f79b400b840 comp rx=0 tx=0).stop 2024-07-24T22:10:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.524+0000 7f79cd86a740 1 -- 172.21.15.47:0/2616462583 shutdown_connections 2024-07-24T22:10:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.524+0000 7f79cd86a740 1 --2- 172.21.15.47:0/2616462583 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x557885164970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.524+0000 7f79cd86a740 1 --2- 172.21.15.47:0/2616462583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5578851565f0 0x557885162040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.524+0000 7f79cd86a740 1 --2- 172.21.15.47:0/2616462583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x5578851560b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.524+0000 7f79cd86a740 1 -- 172.21.15.47:0/2616462583 >> 172.21.15.47:0/2616462583 conn(0x557885153b00 msgr2=0x557885154ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.524+0000 7f79cd86a740 1 -- 172.21.15.47:0/2616462583 shutdown_connections 2024-07-24T22:10:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.524+0000 7f79cd86a740 1 -- 172.21.15.47:0/2616462583 wait complete. 2024-07-24T22:10:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.524+0000 7f79cd86a740 1 -- start start 2024-07-24T22:10:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.524+0000 7f79cd86a740 1 Processor -- start 2024-07-24T22:10:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79cd86a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x557885161d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79cd86a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578851565f0 0x55788515f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79cd86a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557885162580 0x55788515f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79cd86a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557884ff0ab0 con 0x557885155cd0 2024-07-24T22:10:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79cd86a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55788503e9e0 con 0x557885162580 2024-07-24T22:10:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79cd86a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557885165260 con 0x5578851565f0 2024-07-24T22:10:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79cd86a740 10 client.0 _ll_register_callbacks cb 0x557884dc6a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79c88b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x557885161d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79c88b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x557885161d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40812/0 (socket says 172.21.15.47:40812) 2024-07-24T22:10:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79c88b5640 1 -- 172.21.15.47:0/3805658644 learned_addr learned my addr 172.21.15.47:0/3805658644 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79bbfff640 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578851565f0 0x55788515f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79c90b6640 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557885162580 0x55788515f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79c88b5640 1 -- 172.21.15.47:0/3805658644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578851565f0 msgr2=0x55788515f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79c88b5640 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578851565f0 0x55788515f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79c88b5640 1 -- 172.21.15.47:0/3805658644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557885162580 msgr2=0x55788515f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79c88b5640 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557885162580 0x55788515f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79c88b5640 1 -- 172.21.15.47:0/3805658644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557884e93620 con 0x557885155cd0 2024-07-24T22:10:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79bbfff640 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578851565f0 0x55788515f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:10:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.525+0000 7f79c90b6640 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557885162580 0x55788515f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:10:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79c88b5640 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x557885161d10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f79c001c9d0 tx=0x7f79c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2aac31b4736e108 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:10:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79a3fff640 1 -- 172.21.15.47:0/3805658644 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c002c060 con 0x557885155cd0 2024-07-24T22:10:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79a3fff640 1 -- 172.21.15.47:0/3805658644 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f79c0016030 con 0x557885155cd0 2024-07-24T22:10:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79cd86a740 1 -- 172.21.15.47:0/3805658644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557885065ce0 con 0x557885155cd0 2024-07-24T22:10:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79a3fff640 1 -- 172.21.15.47:0/3805658644 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f79c0027420 con 0x557885155cd0 2024-07-24T22:10:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79cd86a740 10 client.16227 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79cd86a740 1 -- 172.21.15.47:0/3805658644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557885170af0 con 0x557885155cd0 2024-07-24T22:10:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79a3fff640 1 -- 172.21.15.47:0/3805658644 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557885065ce0 con 0x557885155cd0 2024-07-24T22:10:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79a3fff640 1 -- 172.21.15.47:0/3805658644 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f79c001a640 con 0x557885155cd0 2024-07-24T22:10:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79cd86a740 10 client.16227 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79cd86a740 10 client.16227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79cd86a740 20 client.16227 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79cd86a740 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557885172000 0x5578851743f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79cd86a740 4 client.16227 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:10:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.526+0000 7f79cd86a740 1 -- 172.21.15.47:0/3805658644 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578850c91d0 con 0x557885172000 2024-07-24T22:10:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.527+0000 7f79bbfff640 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557885172000 0x5578851743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.527+0000 7f79a3fff640 10 client.16227 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.527+0000 7f79bbfff640 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557885172000 0x5578851743f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64588d8f520ac782 server_cookie=97596ea00378410a in_seq=0 out_seq=0 2024-07-24T22:10:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79a3fff640 1 -- 172.21.15.47:0/3805658644 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5578850c91d0 con 0x557885172000 2024-07-24T22:10:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79a3fff640 10 client.16227 handle_command_reply: tid=0 2024-07-24T22:10:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79cd86a740 1 client.16227 shutdown 2024-07-24T22:10:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79cd86a740 1 -- 172.21.15.47:0/3805658644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 msgr2=0x557885161d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79cd86a740 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x557885161d10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f79c001c9d0 tx=0x7f79c0004730 comp rx=0 tx=0).stop 2024-07-24T22:10:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79cd86a740 1 -- 172.21.15.47:0/3805658644 shutdown_connections 2024-07-24T22:10:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79cd86a740 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557885172000 0x5578851743f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79cd86a740 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557885162580 0x55788515f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79cd86a740 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578851565f0 0x55788515f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79a3fff640 0 client.16227 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79cd86a740 1 --2- 172.21.15.47:0/3805658644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x557885161d10 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79cd86a740 1 -- 172.21.15.47:0/3805658644 >> 172.21.15.47:0/3805658644 conn(0x557885153b00 msgr2=0x5578851596a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79cd86a740 1 -- 172.21.15.47:0/3805658644 shutdown_connections 2024-07-24T22:10:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79cd86a740 1 -- 172.21.15.47:0/3805658644 wait complete. 2024-07-24T22:10:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.528+0000 7f79cd86a740 20 client.16227 trim_cache size 0 max 16384 2024-07-24T22:10:31.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79cd86a740 1 Processor -- start 2024-07-24T22:10:31.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79cd86a740 1 -- start start 2024-07-24T22:10:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79cd86a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557885155cd0 0x55788516e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79cd86a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5578851565f0 0x557885179cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79cd86a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x55788517a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79cd86a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f79c41a9df0 con 0x5578851565f0 2024-07-24T22:10:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79cd86a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f79c41ac670 con 0x557885155cd0 2024-07-24T22:10:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79cd86a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f79c41aa460 con 0x557885162580 2024-07-24T22:10:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79bbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5578851565f0 0x557885179cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79bbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5578851565f0 0x557885179cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40824/0 (socket says 172.21.15.47:40824) 2024-07-24T22:10:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79bbfff640 1 -- 172.21.15.47:0/3381633919 learned_addr learned my addr 172.21.15.47:0/3381633919 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79c88b5640 1 --2- 172.21.15.47:0/3381633919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557885155cd0 0x55788516e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79bbfff640 1 -- 172.21.15.47:0/3381633919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 msgr2=0x55788517a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:31.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79c90b6640 1 --2- 172.21.15.47:0/3381633919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x55788517a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79bbfff640 1 --2- 172.21.15.47:0/3381633919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x55788517a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79bbfff640 1 -- 172.21.15.47:0/3381633919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557885155cd0 msgr2=0x55788516e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79bbfff640 1 --2- 172.21.15.47:0/3381633919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557885155cd0 0x55788516e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79bbfff640 1 -- 172.21.15.47:0/3381633919 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557885156420 con 0x5578851565f0 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79c88b5640 1 --2- 172.21.15.47:0/3381633919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557885155cd0 0x55788516e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79c90b6640 1 --2- 172.21.15.47:0/3381633919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x55788517a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.544+0000 7f79bbfff640 1 --2- 172.21.15.47:0/3381633919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5578851565f0 0x557885179cc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f79b4015010 tx=0x7f79b4003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259c3359cd71207 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.545+0000 7f79aa7fc640 1 -- 172.21.15.47:0/3381633919 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b40037f0 con 0x5578851565f0 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.545+0000 7f79aa7fc640 1 -- 172.21.15.47:0/3381633919 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79b4003990 con 0x5578851565f0 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.545+0000 7f79aa7fc640 1 -- 172.21.15.47:0/3381633919 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b4010940 con 0x5578851565f0 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.545+0000 7f79cd86a740 1 -- 172.21.15.47:0/3381633919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5578851565f0 msgr2=0x557885179cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.545+0000 7f79cd86a740 1 --2- 172.21.15.47:0/3381633919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5578851565f0 0x557885179cc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f79b4015010 tx=0x7f79b4003c50 comp rx=0 tx=0).stop 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.545+0000 7f79cd86a740 1 -- 172.21.15.47:0/3381633919 shutdown_connections 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.545+0000 7f79cd86a740 1 --2- 172.21.15.47:0/3381633919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x55788517a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.545+0000 7f79cd86a740 1 --2- 172.21.15.47:0/3381633919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5578851565f0 0x557885179cc0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.545+0000 7f79cd86a740 1 --2- 172.21.15.47:0/3381633919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557885155cd0 0x55788516e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.545+0000 7f79cd86a740 1 -- 172.21.15.47:0/3381633919 >> 172.21.15.47:0/3381633919 conn(0x557885153b00 msgr2=0x55788515e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.545+0000 7f79cd86a740 1 -- 172.21.15.47:0/3381633919 shutdown_connections 2024-07-24T22:10:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.545+0000 7f79cd86a740 1 -- 172.21.15.47:0/3381633919 wait complete. 2024-07-24T22:10:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.545+0000 7f79cd86a740 1 -- start start 2024-07-24T22:10:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79cd86a740 1 Processor -- start 2024-07-24T22:10:31.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79cd86a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x557885167d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79cd86a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5578851565f0 0x557885168260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79cd86a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x5578851dac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79cd86a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f79c41aab30 con 0x557885155cd0 2024-07-24T22:10:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79cd86a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f79c41abfa0 con 0x5578851565f0 2024-07-24T22:10:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79cd86a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f79c41ab200 con 0x557885162580 2024-07-24T22:10:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79cd86a740 10 client.0 _ll_register_callbacks cb 0x7f79c000a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79c88b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x557885167d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79c88b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x557885167d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40830/0 (socket says 172.21.15.47:40830) 2024-07-24T22:10:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79c88b5640 1 -- 172.21.15.47:0/1288467323 learned_addr learned my addr 172.21.15.47:0/1288467323 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79c90b6640 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x5578851dac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79bbfff640 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5578851565f0 0x557885168260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79c88b5640 1 -- 172.21.15.47:0/1288467323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 msgr2=0x5578851dac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79c88b5640 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x5578851dac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79c88b5640 1 -- 172.21.15.47:0/1288467323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5578851565f0 msgr2=0x557885168260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79c88b5640 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5578851565f0 0x557885168260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79c88b5640 1 -- 172.21.15.47:0/1288467323 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557885155240 con 0x557885155cd0 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79c90b6640 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x5578851dac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.546+0000 7f79bbfff640 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5578851565f0 0x557885168260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79c88b5640 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x557885167d20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f79c0017040 tx=0x7f79c001a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5fefcaab7144f9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79a3fff640 1 -- 172.21.15.47:0/1288467323 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c001c7c0 con 0x557885155cd0 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79a3fff640 1 -- 172.21.15.47:0/1288467323 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f79c0005020 con 0x557885155cd0 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79cd86a740 1 -- 172.21.15.47:0/1288467323 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79b4003990 con 0x557885155cd0 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79a3fff640 1 -- 172.21.15.47:0/1288467323 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f79c0005220 con 0x557885155cd0 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79cd86a740 10 client.16233 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79cd86a740 1 -- 172.21.15.47:0/1288467323 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5578851dc400 con 0x557885155cd0 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79a3fff640 1 -- 172.21.15.47:0/1288467323 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79b4003990 con 0x557885155cd0 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79a3fff640 1 -- 172.21.15.47:0/1288467323 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f79c00047a0 con 0x557885155cd0 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79cd86a740 10 client.16233 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79cd86a740 10 client.16233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79cd86a740 20 client.16233 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79cd86a740 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5578851dcba0 0x5578851defc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79cd86a740 4 client.16233 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:10:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.547+0000 7f79cd86a740 1 -- 172.21.15.47:0/1288467323 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5578850c4c70 con 0x5578851dcba0 2024-07-24T22:10:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.548+0000 7f79bbfff640 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5578851dcba0 0x5578851defc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.548+0000 7f79a3fff640 10 client.16233 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.548+0000 7f79bbfff640 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5578851dcba0 0x5578851defc0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a9f72ab49c75239 server_cookie=3a6163ce363a4460 in_seq=0 out_seq=0 2024-07-24T22:10:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.562+0000 7f79a3fff640 1 -- 172.21.15.47:0/1288467323 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5578850c4c70 con 0x5578851dcba0 2024-07-24T22:10:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.562+0000 7f79a3fff640 10 client.16233 handle_command_reply: tid=0 2024-07-24T22:10:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.562+0000 7f79cd86a740 1 client.16233 shutdown 2024-07-24T22:10:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.563+0000 7f79cd86a740 1 -- 172.21.15.47:0/1288467323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 msgr2=0x557885167d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.563+0000 7f79cd86a740 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x557885167d20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f79c0017040 tx=0x7f79c001a6d0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.563+0000 7f79cd86a740 1 -- 172.21.15.47:0/1288467323 shutdown_connections 2024-07-24T22:10:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.563+0000 7f79cd86a740 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5578851dcba0 0x5578851defc0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.563+0000 7f79cd86a740 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557885162580 0x5578851dac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.563+0000 7f79a3fff640 0 client.16233 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.563+0000 7f79cd86a740 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5578851565f0 0x557885168260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.563+0000 7f79cd86a740 1 --2- 172.21.15.47:0/1288467323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557885155cd0 0x557885167d20 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.563+0000 7f79cd86a740 1 -- 172.21.15.47:0/1288467323 >> 172.21.15.47:0/1288467323 conn(0x557885153b00 msgr2=0x55788514df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.564+0000 7f79cd86a740 1 -- 172.21.15.47:0/1288467323 shutdown_connections 2024-07-24T22:10:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.564+0000 7f79cd86a740 1 -- 172.21.15.47:0/1288467323 wait complete. 2024-07-24T22:10:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.564+0000 7f79cd86a740 20 client.16233 trim_cache size 0 max 16384 2024-07-24T22:10:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:10:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:10:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:10:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:10:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.565+0000 7f79cab19640 1 -- 172.21.15.47:0/1226946466 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f79ac0b3d40 msgr2=0x7f79ac0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.565+0000 7f79cab19640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f79ac0b3d40 0x7f79ac0b6200 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x557885158e50 tx=0x7f79c000a2d0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.565+0000 7f79cab19640 1 -- 172.21.15.47:0/1226946466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79c4107950 msgr2=0x7f79c419e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.565+0000 7f79cab19640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79c4107950 0x7f79c419e3f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009430 tx=0x7f79bc0319f0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.565+0000 7f79cab19640 1 -- 172.21.15.47:0/1226946466 shutdown_connections 2024-07-24T22:10:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.565+0000 7f79cab19640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f79ac0b3d40 0x7f79ac0b6200 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.565+0000 7f79cab19640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79c4107950 0x7f79c419e3f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.565+0000 7f79cab19640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79c4106fd0 0x7f79c4199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.565+0000 7f79cab19640 1 --2- 172.21.15.47:0/1226946466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c41015d0 0x7f79c4198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.565+0000 7f79cab19640 1 -- 172.21.15.47:0/1226946466 >> 172.21.15.47:0/1226946466 conn(0x7f79c40fd030 msgr2=0x7f79c4105fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.565+0000 7f79cab19640 1 -- 172.21.15.47:0/1226946466 shutdown_connections 2024-07-24T22:10:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:31.565+0000 7f79cab19640 1 -- 172.21.15.47:0/1226946466 wait complete. 2024-07-24T22:10:31.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:31 smithi183 ceph-mon[37007]: pgmap v465: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 328 MiB/s wr, 583 op/s 2024-07-24T22:10:31.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:31 smithi047 ceph-mon[32551]: pgmap v465: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 328 MiB/s wr, 583 op/s 2024-07-24T22:10:32.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:31 smithi188 ceph-mon[37380]: pgmap v465: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 328 MiB/s wr, 583 op/s 2024-07-24T22:10:33.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:33 smithi183 ceph-mon[37007]: pgmap v466: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 260 MiB/s wr, 111 op/s 2024-07-24T22:10:33.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:33 smithi047 ceph-mon[32551]: pgmap v466: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 260 MiB/s wr, 111 op/s 2024-07-24T22:10:34.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:33 smithi188 ceph-mon[37380]: pgmap v466: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 260 MiB/s wr, 111 op/s 2024-07-24T22:10:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:35 smithi183 ceph-mon[37007]: pgmap v467: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 823 KiB/s rd, 185 MiB/s wr, 68 op/s 2024-07-24T22:10:35.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:35 smithi047 ceph-mon[32551]: pgmap v467: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 823 KiB/s rd, 185 MiB/s wr, 68 op/s 2024-07-24T22:10:36.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:35 smithi188 ceph-mon[37380]: pgmap v467: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 823 KiB/s rd, 185 MiB/s wr, 68 op/s 2024-07-24T22:10:37.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:37 smithi183 ceph-mon[37007]: pgmap v468: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 145 KiB/s rd, 83 MiB/s wr, 36 op/s 2024-07-24T22:10:37.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:37 smithi047 ceph-mon[32551]: pgmap v468: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 145 KiB/s rd, 83 MiB/s wr, 36 op/s 2024-07-24T22:10:38.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:37 smithi188 ceph-mon[37380]: pgmap v468: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 145 KiB/s rd, 83 MiB/s wr, 36 op/s 2024-07-24T22:10:39.051 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:10:39.316 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:10:39.768 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:39 smithi047 ceph-mon[32551]: pgmap v469: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 12 KiB/s rd, 56 MiB/s wr, 27 op/s 2024-07-24T22:10:40.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:39 smithi188 ceph-mon[37380]: pgmap v469: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 12 KiB/s rd, 56 MiB/s wr, 27 op/s 2024-07-24T22:10:40.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:39 smithi183 ceph-mon[37007]: pgmap v469: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 12 KiB/s rd, 56 MiB/s wr, 27 op/s 2024-07-24T22:10:41.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.192+0000 7f88bbbac640 1 -- 172.21.15.47:0/3221379810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88b4101690 msgr2=0x7f88b4101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:41.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.192+0000 7f88bbbac640 1 --2- 172.21.15.47:0/3221379810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88b4101690 0x7f88b4101a70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f88b0009900 tx=0x7f88b002a410 comp rx=0 tx=0).stop 2024-07-24T22:10:41.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.192+0000 7f88bbbac640 1 -- 172.21.15.47:0/3221379810 shutdown_connections 2024-07-24T22:10:41.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.192+0000 7f88bbbac640 1 --2- 172.21.15.47:0/3221379810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88b4107a20 0x7f88b410e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:41.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.192+0000 7f88bbbac640 1 --2- 172.21.15.47:0/3221379810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88b41070a0 0x7f88b41074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:41.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.192+0000 7f88bbbac640 1 --2- 172.21.15.47:0/3221379810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88b4101690 0x7f88b4101a70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:41.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.192+0000 7f88bbbac640 1 -- 172.21.15.47:0/3221379810 >> 172.21.15.47:0/3221379810 conn(0x7f88b40fd100 msgr2=0x7f88b40ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:41.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.193+0000 7f88bbbac640 1 -- 172.21.15.47:0/3221379810 shutdown_connections 2024-07-24T22:10:41.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.193+0000 7f88bbbac640 1 -- 172.21.15.47:0/3221379810 wait complete. 2024-07-24T22:10:41.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.193+0000 7f88bbbac640 1 Processor -- start 2024-07-24T22:10:41.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.193+0000 7f88bbbac640 1 -- start start 2024-07-24T22:10:41.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.193+0000 7f88bbbac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88b4101690 0x7f88b4198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:41.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.193+0000 7f88bbbac640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88b41070a0 0x7f88b41990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:41.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88bbbac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88b4107a20 0x7f88b419e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:41.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88bbbac640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f88b4111630 con 0x7f88b4107a20 2024-07-24T22:10:41.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88bbbac640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f88b41114b0 con 0x7f88b41070a0 2024-07-24T22:10:41.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88bbbac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f88b41117b0 con 0x7f88b4101690 2024-07-24T22:10:41.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88ba149640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88b4107a20 0x7f88b419e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:41.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88ba149640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88b4107a20 0x7f88b419e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40664/0 (socket says 172.21.15.47:40664) 2024-07-24T22:10:41.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88ba149640 1 -- 172.21.15.47:0/3372187680 learned_addr learned my addr 172.21.15.47:0/3372187680 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:41.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88b9147640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88b41070a0 0x7f88b41990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:41.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88b9948640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88b4101690 0x7f88b4198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:41.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88ba149640 1 -- 172.21.15.47:0/3372187680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88b4101690 msgr2=0x7f88b4198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:41.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88ba149640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88b4101690 0x7f88b4198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:41.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88ba149640 1 -- 172.21.15.47:0/3372187680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88b41070a0 msgr2=0x7f88b41990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:41.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88ba149640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88b41070a0 0x7f88b41990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:41.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88ba149640 1 -- 172.21.15.47:0/3372187680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b419ec60 con 0x7f88b4107a20 2024-07-24T22:10:41.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88ba149640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88b4107a20 0x7f88b419e490 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00cce0 tx=0x7f88ac00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:41.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88aaffd640 1 -- 172.21.15.47:0/3372187680 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac00f450 con 0x7f88b4107a20 2024-07-24T22:10:41.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88aaffd640 1 -- 172.21.15.47:0/3372187680 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88ac00faa0 con 0x7f88b4107a20 2024-07-24T22:10:41.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.194+0000 7f88bbbac640 1 -- 172.21.15.47:0/3372187680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b419ef50 con 0x7f88b4107a20 2024-07-24T22:10:41.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.195+0000 7f88aaffd640 1 -- 172.21.15.47:0/3372187680 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac018a80 con 0x7f88b4107a20 2024-07-24T22:10:41.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.195+0000 7f88bbbac640 1 -- 172.21.15.47:0/3372187680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b40fd670 con 0x7f88b4107a20 2024-07-24T22:10:41.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.196+0000 7f88bbbac640 1 -- 172.21.15.47:0/3372187680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88b4102940 con 0x7f88b4107a20 2024-07-24T22:10:41.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.197+0000 7f88aaffd640 1 -- 172.21.15.47:0/3372187680 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f88ac00fc50 con 0x7f88b4107a20 2024-07-24T22:10:41.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.198+0000 7f88aaffd640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88a00b3d40 0x7f88a00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:41.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.198+0000 7f88b9948640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88a00b3d40 0x7f88a00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:41.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.198+0000 7f88aaffd640 1 -- 172.21.15.47:0/3372187680 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f88ac0e4890 con 0x7f88b4107a20 2024-07-24T22:10:41.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.198+0000 7f88b9948640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88a00b3d40 0x7f88a00b6200 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f88b0031440 tx=0x7f88b0005e80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:41.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.201+0000 7f88aaffd640 1 -- 172.21.15.47:0/3372187680 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f88ac014030 con 0x7f88b4107a20 2024-07-24T22:10:41.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.434+0000 7f88bbbac640 1 -- 172.21.15.47:0/3372187680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88b4101a70 con 0x7f88b4107a20 2024-07-24T22:10:41.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.435+0000 7f88aaffd640 1 -- 172.21.15.47:0/3372187680 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f88ac0abb40 con 0x7f88b4107a20 2024-07-24T22:10:41.437 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:10:41.437 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:10:41.438 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:10:41.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.438+0000 7f88bbbac640 1 -- 172.21.15.47:0/3372187680 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88a00b3d40 msgr2=0x7f88a00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:41.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.438+0000 7f88bbbac640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88a00b3d40 0x7f88a00b6200 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f88b0031440 tx=0x7f88b0005e80 comp rx=0 tx=0).stop 2024-07-24T22:10:41.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.438+0000 7f88bbbac640 1 -- 172.21.15.47:0/3372187680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88b4107a20 msgr2=0x7f88b419e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:41.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.438+0000 7f88bbbac640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88b4107a20 0x7f88b419e490 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00cce0 tx=0x7f88ac00a620 comp rx=0 tx=0).stop 2024-07-24T22:10:41.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.438+0000 7f88bbbac640 1 -- 172.21.15.47:0/3372187680 shutdown_connections 2024-07-24T22:10:41.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.438+0000 7f88bbbac640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88a00b3d40 0x7f88a00b6200 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:41.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.438+0000 7f88bbbac640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88b4107a20 0x7f88b419e490 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:41.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.438+0000 7f88bbbac640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88b41070a0 0x7f88b41990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:41.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.438+0000 7f88bbbac640 1 --2- 172.21.15.47:0/3372187680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88b4101690 0x7f88b4198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:41.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.438+0000 7f88bbbac640 1 -- 172.21.15.47:0/3372187680 >> 172.21.15.47:0/3372187680 conn(0x7f88b40fd100 msgr2=0x7f88b406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:41.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.439+0000 7f88bbbac640 1 -- 172.21.15.47:0/3372187680 shutdown_connections 2024-07-24T22:10:41.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:41.439+0000 7f88bbbac640 1 -- 172.21.15.47:0/3372187680 wait complete. 2024-07-24T22:10:41.716 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:41 smithi047 ceph-mon[32551]: pgmap v470: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 10 KiB/s rd, 50 MiB/s wr, 23 op/s 2024-07-24T22:10:41.716 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:41 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3372187680' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:10:42.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:41 smithi188 ceph-mon[37380]: pgmap v470: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 10 KiB/s rd, 50 MiB/s wr, 23 op/s 2024-07-24T22:10:42.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:41 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3372187680' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:10:42.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:41 smithi183 ceph-mon[37007]: pgmap v470: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 10 KiB/s rd, 50 MiB/s wr, 23 op/s 2024-07-24T22:10:42.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:41 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3372187680' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:10:42.219 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db --set-id d677965 --release --await' 2024-07-24T22:10:42.220 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db --set-id d677965 --release --await 2024-07-24T22:10:42.497 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:10:43.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:43 smithi047 ceph-mon[32551]: pgmap v471: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 6.0 KiB/s rd, 47 MiB/s wr, 19 op/s 2024-07-24T22:10:44.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:43 smithi188 ceph-mon[37380]: pgmap v471: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 6.0 KiB/s rd, 47 MiB/s wr, 19 op/s 2024-07-24T22:10:44.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:43 smithi183 ceph-mon[37007]: pgmap v471: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 6.0 KiB/s rd, 47 MiB/s wr, 19 op/s 2024-07-24T22:10:44.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.341+0000 7fe698a57640 1 -- 172.21.15.47:0/2331464501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe694104630 msgr2=0x7fe694104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.341+0000 7fe698a57640 1 --2- 172.21.15.47:0/2331464501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe694104630 0x7fe694104a70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe68800adb0 tx=0x7fe68802b7a0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.341+0000 7fe698a57640 1 -- 172.21.15.47:0/2331464501 shutdown_connections 2024-07-24T22:10:44.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.341+0000 7fe698a57640 1 --2- 172.21.15.47:0/2331464501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe694104fb0 0x7fe69410d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.341+0000 7fe698a57640 1 --2- 172.21.15.47:0/2331464501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe694104630 0x7fe694104a70 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.341+0000 7fe698a57640 1 --2- 172.21.15.47:0/2331464501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe694101250 0x7fe694101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.341+0000 7fe698a57640 1 -- 172.21.15.47:0/2331464501 >> 172.21.15.47:0/2331464501 conn(0x7fe694076890 msgr2=0x7fe694076ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:44.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.341+0000 7fe698a57640 1 -- 172.21.15.47:0/2331464501 shutdown_connections 2024-07-24T22:10:44.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.341+0000 7fe698a57640 1 -- 172.21.15.47:0/2331464501 wait complete. 2024-07-24T22:10:44.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.342+0000 7fe698a57640 1 Processor -- start 2024-07-24T22:10:44.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.342+0000 7fe698a57640 1 -- start start 2024-07-24T22:10:44.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.342+0000 7fe698a57640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe694101250 0x7fe694198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.342+0000 7fe698a57640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe694104630 0x7fe694199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.342+0000 7fe698a57640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe694104fb0 0x7fe69419e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.342+0000 7fe698a57640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6941105e0 con 0x7fe694104fb0 2024-07-24T22:10:44.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.342+0000 7fe698a57640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe694110460 con 0x7fe694101250 2024-07-24T22:10:44.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.342+0000 7fe698a57640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe694110760 con 0x7fe694104630 2024-07-24T22:10:44.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.342+0000 7fe691d9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe694104630 0x7fe694199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.342+0000 7fe69259c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe694101250 0x7fe694198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.342+0000 7fe691d9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe694104630 0x7fe694199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:44964/0 (socket says 172.21.15.47:44964) 2024-07-24T22:10:44.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.342+0000 7fe691d9b640 1 -- 172.21.15.47:0/2571765010 learned_addr learned my addr 172.21.15.47:0/2571765010 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:44.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.342+0000 7fe692d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe694104fb0 0x7fe69419e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.343+0000 7fe69259c640 1 -- 172.21.15.47:0/2571765010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe694104630 msgr2=0x7fe694199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.343+0000 7fe69259c640 1 --2- 172.21.15.47:0/2571765010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe694104630 0x7fe694199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.343+0000 7fe69259c640 1 -- 172.21.15.47:0/2571765010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe694104fb0 msgr2=0x7fe69419e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.343+0000 7fe69259c640 1 --2- 172.21.15.47:0/2571765010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe694104fb0 0x7fe69419e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.343+0000 7fe69259c640 1 -- 172.21.15.47:0/2571765010 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69419ed80 con 0x7fe694101250 2024-07-24T22:10:44.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.343+0000 7fe692d9d640 1 --2- 172.21.15.47:0/2571765010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe694104fb0 0x7fe69419e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:10:44.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.343+0000 7fe69259c640 1 --2- 172.21.15.47:0/2571765010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe694101250 0x7fe694198cd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe68400e9f0 tx=0x7fe68400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:44.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.343+0000 7fe6837fe640 1 -- 172.21.15.47:0/2571765010 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68400ccc0 con 0x7fe694101250 2024-07-24T22:10:44.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.343+0000 7fe698a57640 1 -- 172.21.15.47:0/2571765010 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69419f070 con 0x7fe694101250 2024-07-24T22:10:44.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.343+0000 7fe698a57640 1 -- 172.21.15.47:0/2571765010 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6941a5730 con 0x7fe694101250 2024-07-24T22:10:44.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.343+0000 7fe6837fe640 1 -- 172.21.15.47:0/2571765010 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6840044d0 con 0x7fe694101250 2024-07-24T22:10:44.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.343+0000 7fe6837fe640 1 -- 172.21.15.47:0/2571765010 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68401c070 con 0x7fe694101250 2024-07-24T22:10:44.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.346+0000 7fe69ae08740 1 Processor -- start 2024-07-24T22:10:44.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.346+0000 7fe6837fe640 1 -- 172.21.15.47:0/2571765010 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe684005020 con 0x7fe694101250 2024-07-24T22:10:44.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.346+0000 7fe69ae08740 1 -- start start 2024-07-24T22:10:44.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.346+0000 7fe69ae08740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d8e40 0x562ff03d9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.346+0000 7fe69ae08740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d9760 0x562ff03e51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.346+0000 7fe69ae08740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03e56f0 0x562ff03e7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.346+0000 7fe69ae08740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562ff034bdd0 con 0x562ff03e56f0 2024-07-24T22:10:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.346+0000 7fe69ae08740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562ff033b2d0 con 0x562ff03d8e40 2024-07-24T22:10:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.346+0000 7fe69ae08740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562ff033f310 con 0x562ff03d9760 2024-07-24T22:10:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe69259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d9760 0x562ff03e51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe69259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d9760 0x562ff03e51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:44974/0 (socket says 172.21.15.47:44974) 2024-07-24T22:10:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe69259c640 1 -- 172.21.15.47:0/3951626697 learned_addr learned my addr 172.21.15.47:0/3951626697 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe691d9b640 1 --2- 172.21.15.47:0/3951626697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03e56f0 0x562ff03e7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe692d9d640 1 --2- 172.21.15.47:0/3951626697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d8e40 0x562ff03d9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe69259c640 1 -- 172.21.15.47:0/3951626697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d8e40 msgr2=0x562ff03d9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe69259c640 1 --2- 172.21.15.47:0/3951626697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d8e40 0x562ff03d9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe69259c640 1 -- 172.21.15.47:0/3951626697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03e56f0 msgr2=0x562ff03e7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe69259c640 1 --2- 172.21.15.47:0/3951626697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03e56f0 0x562ff03e7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe69259c640 1 -- 172.21.15.47:0/3951626697 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ff009bb00 con 0x562ff03d9760 2024-07-24T22:10:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe6837fe640 1 --2- 172.21.15.47:0/2571765010 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe67c0b3d40 0x7fe67c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe69259c640 1 --2- 172.21.15.47:0/3951626697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d9760 0x562ff03e51b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6840e15d0 tx=0x7fe6840ec270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ec1d2ce72e8f92b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe692d9d640 1 --2- 172.21.15.47:0/2571765010 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe67c0b3d40 0x7fe67c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.347+0000 7fe6837fe640 1 -- 172.21.15.47:0/2571765010 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fe6840e3f10 con 0x7fe694101250 2024-07-24T22:10:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.348+0000 7fe680ff9640 1 -- 172.21.15.47:0/3951626697 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6840a69e0 con 0x562ff03d9760 2024-07-24T22:10:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.348+0000 7fe680ff9640 1 -- 172.21.15.47:0/3951626697 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6840abe50 con 0x562ff03d9760 2024-07-24T22:10:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.348+0000 7fe692d9d640 1 --2- 172.21.15.47:0/2571765010 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe67c0b3d40 0x7fe67c0b6200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe68c012640 tx=0x7fe68c005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:44.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.348+0000 7fe680ff9640 1 -- 172.21.15.47:0/3951626697 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6840aa290 con 0x562ff03d9760 2024-07-24T22:10:44.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.349+0000 7fe69ae08740 1 -- 172.21.15.47:0/3951626697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d9760 msgr2=0x562ff03e51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.349+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3951626697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d9760 0x562ff03e51b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6840e15d0 tx=0x7fe6840ec270 comp rx=0 tx=0).stop 2024-07-24T22:10:44.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.349+0000 7fe69ae08740 1 -- 172.21.15.47:0/3951626697 shutdown_connections 2024-07-24T22:10:44.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.349+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3951626697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03e56f0 0x562ff03e7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.349+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3951626697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d9760 0x562ff03e51b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.349+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3951626697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d8e40 0x562ff03d9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.349+0000 7fe69ae08740 1 -- 172.21.15.47:0/3951626697 >> 172.21.15.47:0/3951626697 conn(0x562ff03d6c70 msgr2=0x562ff03d7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:44.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.349+0000 7fe69ae08740 1 -- 172.21.15.47:0/3951626697 shutdown_connections 2024-07-24T22:10:44.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.349+0000 7fe69ae08740 1 -- 172.21.15.47:0/3951626697 wait complete. 2024-07-24T22:10:44.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.349+0000 7fe69ae08740 1 -- start start 2024-07-24T22:10:44.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.349+0000 7fe69ae08740 1 Processor -- start 2024-07-24T22:10:44.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe69ae08740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d8e40 0x562ff03e5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe69ae08740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d9760 0x562ff03e25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe69ae08740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03e56f0 0x562ff03e2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe69ae08740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562ff019ebb0 con 0x562ff03d8e40 2024-07-24T22:10:44.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe69ae08740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562ff02dd900 con 0x562ff03d9760 2024-07-24T22:10:44.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe69ae08740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562ff03e8370 con 0x562ff03e56f0 2024-07-24T22:10:44.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe69ae08740 10 client.0 _ll_register_callbacks cb 0x562ff02e7c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:44.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe69259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d8e40 0x562ff03e5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe69259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d8e40 0x562ff03e5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40692/0 (socket says 172.21.15.47:40692) 2024-07-24T22:10:44.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe69259c640 1 -- 172.21.15.47:0/3202960678 learned_addr learned my addr 172.21.15.47:0/3202960678 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:44.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe691d9b640 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d9760 0x562ff03e25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe692d9d640 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03e56f0 0x562ff03e2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe691d9b640 1 -- 172.21.15.47:0/3202960678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03e56f0 msgr2=0x562ff03e2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe691d9b640 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03e56f0 0x562ff03e2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe691d9b640 1 -- 172.21.15.47:0/3202960678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d8e40 msgr2=0x562ff03e5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe691d9b640 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d8e40 0x562ff03e5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe691d9b640 1 -- 172.21.15.47:0/3202960678 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ff0112960 con 0x562ff03d9760 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe69259c640 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d8e40 0x562ff03e5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe691d9b640 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d9760 0x562ff03e25b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe688031040 tx=0x7fe6880314e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d98ae5c0f5cd0c9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.350+0000 7fe679ffb640 1 -- 172.21.15.47:0/3202960678 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688003cc0 con 0x562ff03d9760 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe679ffb640 1 -- 172.21.15.47:0/3202960678 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fe688032400 con 0x562ff03d9760 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe69ae08740 1 -- 172.21.15.47:0/3202960678 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6840abe50 con 0x562ff03d9760 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe679ffb640 1 -- 172.21.15.47:0/3202960678 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe688003e60 con 0x562ff03d9760 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe69ae08740 10 client.25649 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe69ae08740 1 -- 172.21.15.47:0/3202960678 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562ff03f3ec0 con 0x562ff03d9760 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe679ffb640 1 -- 172.21.15.47:0/3202960678 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6840abe50 con 0x562ff03d9760 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe679ffb640 1 -- 172.21.15.47:0/3202960678 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe688031610 con 0x562ff03d9760 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe69ae08740 10 client.25649 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe69ae08740 10 client.25649 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:10:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe69ae08740 20 client.25649 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562ff03f53d0 0x562ff03f7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe69ae08740 4 client.25649 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:10:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe69ae08740 1 -- 172.21.15.47:0/3202960678 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ff034dd20 con 0x562ff03f53d0 2024-07-24T22:10:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.351+0000 7fe69259c640 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562ff03f53d0 0x562ff03f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.352+0000 7fe69259c640 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562ff03f53d0 0x562ff03f7800 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=377c39e89b8b72eb server_cookie=5b9feddd52f47f1c in_seq=0 out_seq=0 2024-07-24T22:10:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.352+0000 7fe679ffb640 10 client.25649 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.352+0000 7fe679ffb640 1 -- 172.21.15.47:0/3202960678 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ff034dd20 con 0x562ff03f53d0 2024-07-24T22:10:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.352+0000 7fe679ffb640 10 client.25649 handle_command_reply: tid=0 2024-07-24T22:10:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.352+0000 7fe69ae08740 1 client.25649 shutdown 2024-07-24T22:10:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.353+0000 7fe69ae08740 1 -- 172.21.15.47:0/3202960678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d9760 msgr2=0x562ff03e25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.353+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d9760 0x562ff03e25b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe688031040 tx=0x7fe6880314e0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.353+0000 7fe69ae08740 1 -- 172.21.15.47:0/3202960678 shutdown_connections 2024-07-24T22:10:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.353+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562ff03f53d0 0x562ff03f7800 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.353+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03e56f0 0x562ff03e2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.353+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d9760 0x562ff03e25b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.353+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3202960678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d8e40 0x562ff03e5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.353+0000 7fe679ffb640 0 client.25649 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.353+0000 7fe69ae08740 1 -- 172.21.15.47:0/3202960678 >> 172.21.15.47:0/3202960678 conn(0x562ff03d6c70 msgr2=0x562ff03dc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.353+0000 7fe69ae08740 1 -- 172.21.15.47:0/3202960678 shutdown_connections 2024-07-24T22:10:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.353+0000 7fe69ae08740 1 -- 172.21.15.47:0/3202960678 wait complete. 2024-07-24T22:10:44.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.353+0000 7fe69ae08740 20 client.25649 trim_cache size 0 max 16384 2024-07-24T22:10:44.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.371+0000 7fe69ae08740 1 Processor -- start 2024-07-24T22:10:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.371+0000 7fe69ae08740 1 -- start start 2024-07-24T22:10:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe69ae08740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d8e40 0x562ff03e5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe69ae08740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d9760 0x562ff03d83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe69ae08740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03e56f0 0x562ff03fd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe69ae08740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe67400c810 con 0x562ff03e56f0 2024-07-24T22:10:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe69ae08740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe67400f090 con 0x562ff03d8e40 2024-07-24T22:10:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe69ae08740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe67400ce80 con 0x562ff03d9760 2024-07-24T22:10:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe692d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03e56f0 0x562ff03fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe692d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03e56f0 0x562ff03fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40706/0 (socket says 172.21.15.47:40706) 2024-07-24T22:10:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe69259c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d8e40 0x562ff03e5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe692d9d640 1 -- 172.21.15.47:0/3745495480 learned_addr learned my addr 172.21.15.47:0/3745495480 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe691d9b640 1 --2- 172.21.15.47:0/3745495480 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d9760 0x562ff03d83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe692d9d640 1 -- 172.21.15.47:0/3745495480 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d9760 msgr2=0x562ff03d83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe692d9d640 1 --2- 172.21.15.47:0/3745495480 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d9760 0x562ff03d83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe692d9d640 1 -- 172.21.15.47:0/3745495480 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d8e40 msgr2=0x562ff03e5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe692d9d640 1 --2- 172.21.15.47:0/3745495480 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d8e40 0x562ff03e5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe692d9d640 1 -- 172.21.15.47:0/3745495480 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ff03e1510 con 0x562ff03e56f0 2024-07-24T22:10:44.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.372+0000 7fe692d9d640 1 --2- 172.21.15.47:0/3745495480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03e56f0 0x562ff03fd110 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe68c003620 tx=0x7fe68c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5626c2a6bf1737 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:44.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.373+0000 7fe67bfff640 1 -- 172.21.15.47:0/3745495480 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c005020 con 0x562ff03e56f0 2024-07-24T22:10:44.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.373+0000 7fe67bfff640 1 -- 172.21.15.47:0/3745495480 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe68c0047a0 con 0x562ff03e56f0 2024-07-24T22:10:44.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.373+0000 7fe67bfff640 1 -- 172.21.15.47:0/3745495480 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c00f980 con 0x562ff03e56f0 2024-07-24T22:10:44.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.373+0000 7fe69ae08740 1 -- 172.21.15.47:0/3745495480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03e56f0 msgr2=0x562ff03fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.373+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3745495480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03e56f0 0x562ff03fd110 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe68c003620 tx=0x7fe68c01b000 comp rx=0 tx=0).stop 2024-07-24T22:10:44.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.373+0000 7fe69ae08740 1 -- 172.21.15.47:0/3745495480 shutdown_connections 2024-07-24T22:10:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.373+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3745495480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03e56f0 0x562ff03fd110 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.373+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3745495480 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d9760 0x562ff03d83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.373+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3745495480 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03d8e40 0x562ff03e5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.373+0000 7fe69ae08740 1 -- 172.21.15.47:0/3745495480 >> 172.21.15.47:0/3745495480 conn(0x562ff03d6c70 msgr2=0x562ff03d7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.373+0000 7fe69ae08740 1 -- 172.21.15.47:0/3745495480 shutdown_connections 2024-07-24T22:10:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe69ae08740 1 -- 172.21.15.47:0/3745495480 wait complete. 2024-07-24T22:10:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe69ae08740 1 -- start start 2024-07-24T22:10:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe69ae08740 1 Processor -- start 2024-07-24T22:10:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe69ae08740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d8e40 0x562ff03ed880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe69ae08740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d9760 0x562ff03eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe69ae08740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03e56f0 0x562ff03e8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe69ae08740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe67400d550 con 0x562ff03d9760 2024-07-24T22:10:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe69ae08740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe67400e9c0 con 0x562ff03e56f0 2024-07-24T22:10:44.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe69ae08740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe67400dc20 con 0x562ff03d8e40 2024-07-24T22:10:44.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe69ae08740 10 client.0 _ll_register_callbacks cb 0x7fe6880313a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:44.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe691d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d9760 0x562ff03eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe691d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d9760 0x562ff03eddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40714/0 (socket says 172.21.15.47:40714) 2024-07-24T22:10:44.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe691d9b640 1 -- 172.21.15.47:0/3460370975 learned_addr learned my addr 172.21.15.47:0/3460370975 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:44.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe69259c640 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d8e40 0x562ff03ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.374+0000 7fe692d9d640 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03e56f0 0x562ff03e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe691d9b640 1 -- 172.21.15.47:0/3460370975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d8e40 msgr2=0x562ff03ed880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe691d9b640 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d8e40 0x562ff03ed880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe691d9b640 1 -- 172.21.15.47:0/3460370975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03e56f0 msgr2=0x562ff03e8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe691d9b640 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03e56f0 0x562ff03e8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe691d9b640 1 -- 172.21.15.47:0/3460370975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ff03e8d40 con 0x562ff03d9760 2024-07-24T22:10:44.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe692d9d640 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03e56f0 0x562ff03e8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:10:44.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe691d9b640 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d9760 0x562ff03eddc0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe688031a30 tx=0x7fe688031780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e8e63e4526fc37 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:44.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:10:44.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe679ffb640 1 -- 172.21.15.47:0/3460370975 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688003cc0 con 0x562ff03d9760 2024-07-24T22:10:44.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe679ffb640 1 -- 172.21.15.47:0/3460370975 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fe688032610 con 0x562ff03d9760 2024-07-24T22:10:44.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe69ae08740 1 -- 172.21.15.47:0/3460370975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe68c0047a0 con 0x562ff03d9760 2024-07-24T22:10:44.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe679ffb640 1 -- 172.21.15.47:0/3460370975 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe688032830 con 0x562ff03d9760 2024-07-24T22:10:44.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe69ae08740 10 client.16257 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:44.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe69ae08740 1 -- 172.21.15.47:0/3460370975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562ff0460b00 con 0x562ff03d9760 2024-07-24T22:10:44.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.375+0000 7fe679ffb640 1 -- 172.21.15.47:0/3460370975 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe68c0047a0 con 0x562ff03d9760 2024-07-24T22:10:44.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.376+0000 7fe679ffb640 1 -- 172.21.15.47:0/3460370975 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe688030510 con 0x562ff03d9760 2024-07-24T22:10:44.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.376+0000 7fe69ae08740 10 client.16257 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:44.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.376+0000 7fe69ae08740 10 client.16257 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:10:44.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.376+0000 7fe69ae08740 20 client.16257 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:44.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.376+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562ff04612b0 0x562ff04636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.376+0000 7fe69ae08740 4 client.16257 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d677965", "release": true, "await": true}] 2024-07-24T22:10:44.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.376+0000 7fe69ae08740 1 -- 172.21.15.47:0/3460370975 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d677965", "release": true, "await": true}) -- 0x562ff03497c0 con 0x562ff04612b0 2024-07-24T22:10:44.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.376+0000 7fe69259c640 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562ff04612b0 0x562ff04636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.376+0000 7fe679ffb640 10 client.16257 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:44.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.376+0000 7fe69259c640 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562ff04612b0 0x562ff04636d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faf0ceec4382a967 server_cookie=be62b9360d533dbc in_seq=0 out_seq=0 2024-07-24T22:10:44.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe679ffb640 1 -- 172.21.15.47:0/3460370975 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x562ff03497c0 con 0x562ff04612b0 2024-07-24T22:10:44.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe679ffb640 10 client.16257 handle_command_reply: tid=0 2024-07-24T22:10:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe69ae08740 1 client.16257 shutdown 2024-07-24T22:10:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe69ae08740 1 -- 172.21.15.47:0/3460370975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d9760 msgr2=0x562ff03eddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d9760 0x562ff03eddc0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe688031a30 tx=0x7fe688031780 comp rx=0 tx=0).stop 2024-07-24T22:10:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe69ae08740 1 -- 172.21.15.47:0/3460370975 shutdown_connections 2024-07-24T22:10:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562ff04612b0 0x562ff04636d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ff03e56f0 0x562ff03e8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe679ffb640 0 client.16257 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ff03d9760 0x562ff03eddc0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe69ae08740 1 --2- 172.21.15.47:0/3460370975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562ff03d8e40 0x562ff03ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe69ae08740 1 -- 172.21.15.47:0/3460370975 >> 172.21.15.47:0/3460370975 conn(0x562ff03d6c70 msgr2=0x562ff03e3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe69ae08740 1 -- 172.21.15.47:0/3460370975 shutdown_connections 2024-07-24T22:10:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe69ae08740 1 -- 172.21.15.47:0/3460370975 wait complete. 2024-07-24T22:10:44.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.380+0000 7fe69ae08740 20 client.16257 trim_cache size 0 max 16384 2024-07-24T22:10:44.386 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:10:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:10:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:10:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 12, 2024-07-24T22:10:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:10:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "d677965": { 2024-07-24T22:10:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 12, 2024-07-24T22:10:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:10:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:10:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:10:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:10:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:10:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:10:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 150.0, 2024-07-24T22:10:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:10:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:10:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:10:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:10:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:10:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:10:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:44.388 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:10:44.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.381+0000 7fe698a57640 1 -- 172.21.15.47:0/2571765010 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe67c0b3d40 msgr2=0x7fe67c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.381+0000 7fe698a57640 1 --2- 172.21.15.47:0/2571765010 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe67c0b3d40 0x7fe67c0b6200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe68c012640 tx=0x7fe68c005f90 comp rx=0 tx=0).stop 2024-07-24T22:10:44.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.381+0000 7fe698a57640 1 -- 172.21.15.47:0/2571765010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe694101250 msgr2=0x7fe694198cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.381+0000 7fe698a57640 1 --2- 172.21.15.47:0/2571765010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe694101250 0x7fe694198cd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe68400e9f0 tx=0x7fe68400eeb0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.381+0000 7fe698a57640 1 -- 172.21.15.47:0/2571765010 shutdown_connections 2024-07-24T22:10:44.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.381+0000 7fe698a57640 1 --2- 172.21.15.47:0/2571765010 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe67c0b3d40 0x7fe67c0b6200 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.381+0000 7fe698a57640 1 --2- 172.21.15.47:0/2571765010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe694104fb0 0x7fe69419e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.381+0000 7fe698a57640 1 --2- 172.21.15.47:0/2571765010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe694104630 0x7fe694199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.381+0000 7fe698a57640 1 --2- 172.21.15.47:0/2571765010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe694101250 0x7fe694198cd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.381+0000 7fe698a57640 1 -- 172.21.15.47:0/2571765010 >> 172.21.15.47:0/2571765010 conn(0x7fe694076890 msgr2=0x7fe6941029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:44.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.382+0000 7fe698a57640 1 -- 172.21.15.47:0/2571765010 shutdown_connections 2024-07-24T22:10:44.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:44.382+0000 7fe698a57640 1 -- 172.21.15.47:0/2571765010 wait complete. 2024-07-24T22:10:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.712+0000 7fed8c126640 1 -- 172.21.15.47:0/1964213440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed8410a280 msgr2=0x7fed8410c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.712+0000 7fed8c126640 1 --2- 172.21.15.47:0/1964213440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed8410a280 0x7fed8410c670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fed78009900 tx=0x7fed7802a410 comp rx=0 tx=0).stop 2024-07-24T22:10:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.713+0000 7fed8c126640 1 -- 172.21.15.47:0/1964213440 shutdown_connections 2024-07-24T22:10:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.713+0000 7fed8c126640 1 --2- 172.21.15.47:0/1964213440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed8410cbb0 0x7fed8410efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.713+0000 7fed8c126640 1 --2- 172.21.15.47:0/1964213440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed8410a280 0x7fed8410c670 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.713+0000 7fed8c126640 1 --2- 172.21.15.47:0/1964213440 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed84101180 0x7fed84101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.713+0000 7fed8c126640 1 -- 172.21.15.47:0/1964213440 >> 172.21.15.47:0/1964213440 conn(0x7fed84076860 msgr2=0x7fed84076c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.713+0000 7fed8c126640 1 -- 172.21.15.47:0/1964213440 shutdown_connections 2024-07-24T22:10:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.713+0000 7fed8c126640 1 -- 172.21.15.47:0/1964213440 wait complete. 2024-07-24T22:10:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed8c126640 1 Processor -- start 2024-07-24T22:10:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed8c126640 1 -- start start 2024-07-24T22:10:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed8c126640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed84101180 0x7fed84198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed8c126640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed8410a280 0x7fed84199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed8c126640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed8410cbb0 0x7fed8419e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed8c126640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fed841126a0 con 0x7fed84101180 2024-07-24T22:10:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed8c126640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fed84112520 con 0x7fed8410cbb0 2024-07-24T22:10:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed8c126640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fed84112820 con 0x7fed8410a280 2024-07-24T22:10:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed8a6c3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed8410cbb0 0x7fed8419e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed89ec2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed84101180 0x7fed84198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed896c1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed8410a280 0x7fed84199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed8a6c3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed8410cbb0 0x7fed8419e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:39076/0 (socket says 172.21.15.47:39076) 2024-07-24T22:10:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed8a6c3640 1 -- 172.21.15.47:0/1363569109 learned_addr learned my addr 172.21.15.47:0/1363569109 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.714+0000 7fed89ec2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed84101180 0x7fed84198c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40722/0 (socket says 172.21.15.47:40722) 2024-07-24T22:10:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.715+0000 7fed8a6c3640 1 -- 172.21.15.47:0/1363569109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed8410a280 msgr2=0x7fed84199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.715+0000 7fed8a6c3640 1 --2- 172.21.15.47:0/1363569109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed8410a280 0x7fed84199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.715+0000 7fed8a6c3640 1 -- 172.21.15.47:0/1363569109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed84101180 msgr2=0x7fed84198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.715+0000 7fed8a6c3640 1 --2- 172.21.15.47:0/1363569109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed84101180 0x7fed84198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.715+0000 7fed8a6c3640 1 -- 172.21.15.47:0/1363569109 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8419ecc0 con 0x7fed8410cbb0 2024-07-24T22:10:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.715+0000 7fed8a6c3640 1 --2- 172.21.15.47:0/1363569109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed8410cbb0 0x7fed8419e4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009fd0 tx=0x7fed7c00b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.715+0000 7fed76ffd640 1 -- 172.21.15.47:0/1363569109 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c017070 con 0x7fed8410cbb0 2024-07-24T22:10:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.715+0000 7fed76ffd640 1 -- 172.21.15.47:0/1363569109 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed7c003e20 con 0x7fed8410cbb0 2024-07-24T22:10:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.715+0000 7fed8c126640 1 -- 172.21.15.47:0/1363569109 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed8419efb0 con 0x7fed8410cbb0 2024-07-24T22:10:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.715+0000 7fed76ffd640 1 -- 172.21.15.47:0/1363569109 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c010460 con 0x7fed8410cbb0 2024-07-24T22:10:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.715+0000 7fed8c126640 1 -- 172.21.15.47:0/1363569109 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed841a5670 con 0x7fed8410cbb0 2024-07-24T22:10:44.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.718+0000 7fed8ee7d740 1 Processor -- start 2024-07-24T22:10:44.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.719+0000 7fed76ffd640 1 -- 172.21.15.47:0/1363569109 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fed7c003970 con 0x7fed8410cbb0 2024-07-24T22:10:44.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.719+0000 7fed8ee7d740 1 -- start start 2024-07-24T22:10:44.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.719+0000 7fed8ee7d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be38c0 0x5569f8be3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.719+0000 7fed8ee7d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 0x5569f8bf4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.719+0000 7fed8ee7d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 0x5569f8bf6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.719+0000 7fed8ee7d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5569f8b59280 con 0x5569f8be38c0 2024-07-24T22:10:44.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.719+0000 7fed8ee7d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5569f8b48780 con 0x5569f8be41e0 2024-07-24T22:10:44.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.719+0000 7fed8ee7d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5569f8b4c7c0 con 0x5569f8bf4580 2024-07-24T22:10:44.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.720+0000 7fed896c1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be38c0 0x5569f8be3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.720+0000 7fed89ec2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 0x5569f8bf4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.720+0000 7fed89ec2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 0x5569f8bf4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:39080/0 (socket says 172.21.15.47:39080) 2024-07-24T22:10:44.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.720+0000 7fed89ec2640 1 -- 172.21.15.47:0/4149489041 learned_addr learned my addr 172.21.15.47:0/4149489041 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:44.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.720+0000 7fed896c1640 1 --2- 172.21.15.47:0/4149489041 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 0x5569f8bf6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.720+0000 7fed89ec2640 1 -- 172.21.15.47:0/4149489041 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 msgr2=0x5569f8bf6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.721+0000 7fed76ffd640 1 --2- 172.21.15.47:0/1363569109 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fed700b3dc0 0x7fed700b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.721+0000 7fed89ec2640 1 --2- 172.21.15.47:0/4149489041 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 0x5569f8bf6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.721+0000 7fed89ec2640 1 -- 172.21.15.47:0/4149489041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be38c0 msgr2=0x5569f8be3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.721+0000 7fed89ec2640 1 --2- 172.21.15.47:0/4149489041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be38c0 0x5569f8be3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.721+0000 7fed89ec2640 1 -- 172.21.15.47:0/4149489041 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569f88ac790 con 0x5569f8be41e0 2024-07-24T22:10:44.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.721+0000 7fed896c1640 1 --2- 172.21.15.47:0/4149489041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be38c0 0x5569f8be3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:10:44.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.721+0000 7fed76ffd640 1 -- 172.21.15.47:0/1363569109 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fed7c0e3cc0 con 0x7fed8410cbb0 2024-07-24T22:10:44.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.721+0000 7fed8a6c3640 1 --2- 172.21.15.47:0/1363569109 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fed700b3dc0 0x7fed700b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.721+0000 7fed89ec2640 1 --2- 172.21.15.47:0/4149489041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 0x5569f8bf4040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed80009cf0 tx=0x7fed80011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ff7aa5539c2c8b9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:44.728 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.721+0000 7fed6ffff640 1 -- 172.21.15.47:0/4149489041 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8001e070 con 0x5569f8be41e0 2024-07-24T22:10:44.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.721+0000 7fed6ffff640 1 -- 172.21.15.47:0/4149489041 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed80019ae0 con 0x5569f8be41e0 2024-07-24T22:10:44.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.721+0000 7fed6ffff640 1 -- 172.21.15.47:0/4149489041 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8000e970 con 0x5569f8be41e0 2024-07-24T22:10:44.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.722+0000 7fed8ee7d740 1 -- 172.21.15.47:0/4149489041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 msgr2=0x5569f8bf4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.722+0000 7fed8a6c3640 1 --2- 172.21.15.47:0/1363569109 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fed700b3dc0 0x7fed700b6280 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0aa910 tx=0x7fed7c0e3fc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:44.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.722+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/4149489041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 0x5569f8bf4040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed80009cf0 tx=0x7fed80011810 comp rx=0 tx=0).stop 2024-07-24T22:10:44.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.722+0000 7fed8ee7d740 1 -- 172.21.15.47:0/4149489041 shutdown_connections 2024-07-24T22:10:44.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.722+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/4149489041 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 0x5569f8bf6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.722+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/4149489041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 0x5569f8bf4040 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.722+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/4149489041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be38c0 0x5569f8be3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.722+0000 7fed8ee7d740 1 -- 172.21.15.47:0/4149489041 >> 172.21.15.47:0/4149489041 conn(0x5569f8be16f0 msgr2=0x5569f8be2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:44.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.722+0000 7fed8ee7d740 1 -- 172.21.15.47:0/4149489041 shutdown_connections 2024-07-24T22:10:44.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.723+0000 7fed8ee7d740 1 -- 172.21.15.47:0/4149489041 wait complete. 2024-07-24T22:10:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.723+0000 7fed8ee7d740 1 -- start start 2024-07-24T22:10:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.723+0000 7fed8ee7d740 1 Processor -- start 2024-07-24T22:10:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed8ee7d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be38c0 0x5569f8bf3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed8ee7d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be41e0 0x5569f8bf1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed8ee7d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 0x5569f8bf1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed8ee7d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5569f8a82ab0 con 0x5569f8be41e0 2024-07-24T22:10:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed8ee7d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5569f8ad09e0 con 0x5569f8be38c0 2024-07-24T22:10:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed8ee7d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5569f8bf7260 con 0x5569f8bf4580 2024-07-24T22:10:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed8ee7d740 10 client.0 _ll_register_callbacks cb 0x5569f8858a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed896c1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be38c0 0x5569f8bf3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed896c1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be38c0 0x5569f8bf3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:39088/0 (socket says 172.21.15.47:39088) 2024-07-24T22:10:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed896c1640 1 -- 172.21.15.47:0/3703812001 learned_addr learned my addr 172.21.15.47:0/3703812001 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed896c1640 1 --2- 172.21.15.47:0/3703812001 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 0x5569f8bf1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed89ec2640 1 --2- 172.21.15.47:0/3703812001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be41e0 0x5569f8bf1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed896c1640 1 -- 172.21.15.47:0/3703812001 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 msgr2=0x5569f8bf1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed896c1640 1 --2- 172.21.15.47:0/3703812001 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 0x5569f8bf1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed896c1640 1 -- 172.21.15.47:0/3703812001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be41e0 msgr2=0x5569f8bf1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed896c1640 1 --2- 172.21.15.47:0/3703812001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be41e0 0x5569f8bf1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.724+0000 7fed896c1640 1 -- 172.21.15.47:0/3703812001 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569f8925620 con 0x5569f8be38c0 2024-07-24T22:10:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.725+0000 7fed896c1640 1 --2- 172.21.15.47:0/3703812001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be38c0 0x5569f8bf3d20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fed78006010 tx=0x7fed7802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cb5189937f17109 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.725+0000 7fed6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:10:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.725+0000 7fed6d7fa640 1 -- 172.21.15.47:0/3703812001 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78035030 con 0x5569f8be38c0 2024-07-24T22:10:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.725+0000 7fed8ee7d740 1 -- 172.21.15.47:0/3703812001 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5569f8af7ce0 con 0x5569f8be38c0 2024-07-24T22:10:44.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.725+0000 7fed6d7fa640 1 -- 172.21.15.47:0/3703812001 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fed7803d720 con 0x5569f8be38c0 2024-07-24T22:10:44.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.725+0000 7fed6d7fa640 1 -- 172.21.15.47:0/3703812001 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fed7803d920 con 0x5569f8be38c0 2024-07-24T22:10:44.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.725+0000 7fed8ee7d740 10 client.25667 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:44.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.725+0000 7fed8ee7d740 1 -- 172.21.15.47:0/3703812001 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5569f8c02a30 con 0x5569f8be38c0 2024-07-24T22:10:44.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.725+0000 7fed6d7fa640 1 -- 172.21.15.47:0/3703812001 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5569f8af7ce0 con 0x5569f8be38c0 2024-07-24T22:10:44.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.726+0000 7fed6d7fa640 1 -- 172.21.15.47:0/3703812001 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fed78054a20 con 0x5569f8be38c0 2024-07-24T22:10:44.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.726+0000 7fed8ee7d740 10 client.25667 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:44.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.726+0000 7fed8ee7d740 10 client.25667 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:44.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.726+0000 7fed8ee7d740 20 client.25667 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:44.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.726+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/3703812001 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5569f8c03ea0 0x5569f8c06290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.726+0000 7fed8ee7d740 4 client.25667 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:10:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.726+0000 7fed8ee7d740 1 -- 172.21.15.47:0/3703812001 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569f8b5b1d0 con 0x5569f8c03ea0 2024-07-24T22:10:44.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.726+0000 7fed89ec2640 1 --2- 172.21.15.47:0/3703812001 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5569f8c03ea0 0x5569f8c06290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.726+0000 7fed6d7fa640 10 client.25667 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:44.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.727+0000 7fed89ec2640 1 --2- 172.21.15.47:0/3703812001 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5569f8c03ea0 0x5569f8c06290 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aa10c581bdf380d server_cookie=decf0db8dbe31783 in_seq=0 out_seq=0 2024-07-24T22:10:44.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.728+0000 7fed6d7fa640 1 -- 172.21.15.47:0/3703812001 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569f8b5b1d0 con 0x5569f8c03ea0 2024-07-24T22:10:44.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.728+0000 7fed6d7fa640 10 client.25667 handle_command_reply: tid=0 2024-07-24T22:10:44.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.728+0000 7fed8ee7d740 1 client.25667 shutdown 2024-07-24T22:10:44.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.728+0000 7fed8ee7d740 1 -- 172.21.15.47:0/3703812001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be38c0 msgr2=0x5569f8bf3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.728+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/3703812001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be38c0 0x5569f8bf3d20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fed78006010 tx=0x7fed7802a410 comp rx=0 tx=0).stop 2024-07-24T22:10:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.728+0000 7fed8ee7d740 1 -- 172.21.15.47:0/3703812001 shutdown_connections 2024-07-24T22:10:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.728+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/3703812001 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5569f8c03ea0 0x5569f8c06290 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.728+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/3703812001 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 0x5569f8bf1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.728+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/3703812001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be41e0 0x5569f8bf1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.728+0000 7fed6d7fa640 0 client.25667 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.728+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/3703812001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be38c0 0x5569f8bf3d20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.728+0000 7fed8ee7d740 1 -- 172.21.15.47:0/3703812001 >> 172.21.15.47:0/3703812001 conn(0x5569f8be16f0 msgr2=0x5569f8be7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.729+0000 7fed8ee7d740 1 -- 172.21.15.47:0/3703812001 shutdown_connections 2024-07-24T22:10:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.729+0000 7fed8ee7d740 1 -- 172.21.15.47:0/3703812001 wait complete. 2024-07-24T22:10:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.729+0000 7fed8ee7d740 20 client.25667 trim_cache size 0 max 16384 2024-07-24T22:10:44.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.779+0000 7fed8ee7d740 1 Processor -- start 2024-07-24T22:10:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.780+0000 7fed8ee7d740 1 -- start start 2024-07-24T22:10:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.781+0000 7fed8ee7d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8be38c0 0x5569f8c003b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.781+0000 7fed8ee7d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be41e0 0x5569f8be23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.781+0000 7fed8ee7d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8bf4580 0x5569f8be2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.781+0000 7fed8ee7d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fed841a9ef0 con 0x5569f8be41e0 2024-07-24T22:10:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.781+0000 7fed8ee7d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fed841ac770 con 0x5569f8bf4580 2024-07-24T22:10:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.781+0000 7fed8ee7d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fed841aa560 con 0x5569f8be38c0 2024-07-24T22:10:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.784+0000 7fed89ec2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be41e0 0x5569f8be23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.785+0000 7fed89ec2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be41e0 0x5569f8be23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40746/0 (socket says 172.21.15.47:40746) 2024-07-24T22:10:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.785+0000 7fed89ec2640 1 -- 172.21.15.47:0/736617913 learned_addr learned my addr 172.21.15.47:0/736617913 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.786+0000 7fed89ec2640 1 -- 172.21.15.47:0/736617913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8be38c0 msgr2=0x5569f8c003b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-24T22:10:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.786+0000 7fed89ec2640 1 --2- 172.21.15.47:0/736617913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8be38c0 0x5569f8c003b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.786+0000 7fed89ec2640 1 -- 172.21.15.47:0/736617913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8bf4580 msgr2=0x5569f8be2910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-24T22:10:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.786+0000 7fed89ec2640 1 --2- 172.21.15.47:0/736617913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8bf4580 0x5569f8be2910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.786+0000 7fed89ec2640 1 -- 172.21.15.47:0/736617913 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569f8be4010 con 0x5569f8be41e0 2024-07-24T22:10:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.787+0000 7fed89ec2640 1 --2- 172.21.15.47:0/736617913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be41e0 0x5569f8be23d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fed80013010 tx=0x7fed8000e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ea3bc9904fcd24 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.788+0000 7fed6f7fe640 1 -- 172.21.15.47:0/736617913 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8001e040 con 0x5569f8be41e0 2024-07-24T22:10:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.789+0000 7fed6f7fe640 1 -- 172.21.15.47:0/736617913 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed80031070 con 0x5569f8be41e0 2024-07-24T22:10:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.790+0000 7fed6f7fe640 1 -- 172.21.15.47:0/736617913 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed80003870 con 0x5569f8be41e0 2024-07-24T22:10:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.790+0000 7fed8ee7d740 1 -- 172.21.15.47:0/736617913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be41e0 msgr2=0x5569f8be23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.790+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/736617913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be41e0 0x5569f8be23d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fed80013010 tx=0x7fed8000e540 comp rx=0 tx=0).stop 2024-07-24T22:10:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.793+0000 7fed8ee7d740 1 -- 172.21.15.47:0/736617913 shutdown_connections 2024-07-24T22:10:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.793+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/736617913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8bf4580 0x5569f8be2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.793+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/736617913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be41e0 0x5569f8be23d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.793+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/736617913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8be38c0 0x5569f8c003b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.793+0000 7fed8ee7d740 1 -- 172.21.15.47:0/736617913 >> 172.21.15.47:0/736617913 conn(0x5569f8be16f0 msgr2=0x5569f8bf62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.795+0000 7fed8ee7d740 1 -- 172.21.15.47:0/736617913 shutdown_connections 2024-07-24T22:10:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.805+0000 7fed8ee7d740 1 -- 172.21.15.47:0/736617913 wait complete. 2024-07-24T22:10:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.805+0000 7fed8ee7d740 1 -- start start 2024-07-24T22:10:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.806+0000 7fed8ee7d740 1 Processor -- start 2024-07-24T22:10:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.807+0000 7fed8ee7d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be38c0 0x5569f8c0bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.807+0000 7fed8ee7d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 0x5569f8c0c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.807+0000 7fed8ee7d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 0x5569f8bf85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.807+0000 7fed8ee7d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fed841aac30 con 0x5569f8be38c0 2024-07-24T22:10:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.807+0000 7fed8ee7d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fed841ac0a0 con 0x5569f8be41e0 2024-07-24T22:10:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.807+0000 7fed8ee7d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fed841ab300 con 0x5569f8bf4580 2024-07-24T22:10:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.807+0000 7fed8ee7d740 10 client.0 _ll_register_callbacks cb 0x7fed78009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.808+0000 7fed89ec2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 0x5569f8c0c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.808+0000 7fed89ec2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 0x5569f8c0c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:41532/0 (socket says 172.21.15.47:41532) 2024-07-24T22:10:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.808+0000 7fed89ec2640 1 -- 172.21.15.47:0/2524022170 learned_addr learned my addr 172.21.15.47:0/2524022170 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.810+0000 7fed896c1640 1 --2- 172.21.15.47:0/2524022170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 0x5569f8bf85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.810+0000 7fed89ec2640 1 -- 172.21.15.47:0/2524022170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 msgr2=0x5569f8bf85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.810+0000 7fed89ec2640 1 --2- 172.21.15.47:0/2524022170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 0x5569f8bf85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.810+0000 7fed89ec2640 1 -- 172.21.15.47:0/2524022170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be38c0 msgr2=0x5569f8c0bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.810+0000 7fed89ec2640 1 --2- 172.21.15.47:0/2524022170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be38c0 0x5569f8c0bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.810+0000 7fed89ec2640 1 -- 172.21.15.47:0/2524022170 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569f8bf8d10 con 0x5569f8be41e0 2024-07-24T22:10:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.812+0000 7fed89ec2640 1 --2- 172.21.15.47:0/2524022170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 0x5569f8c0c0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fed8002e040 tx=0x7fed80005a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6234b792dd2eb4d3 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.813+0000 7fed6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:10:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.814+0000 7fed6d7fa640 1 -- 172.21.15.47:0/2524022170 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8003b020 con 0x5569f8be41e0 2024-07-24T22:10:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.814+0000 7fed8ee7d740 1 -- 172.21.15.47:0/2524022170 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed80031070 con 0x5569f8be41e0 2024-07-24T22:10:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.814+0000 7fed6d7fa640 1 -- 172.21.15.47:0/2524022170 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fed8000e870 con 0x5569f8be41e0 2024-07-24T22:10:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.816+0000 7fed6d7fa640 1 -- 172.21.15.47:0/2524022170 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fed80046050 con 0x5569f8be41e0 2024-07-24T22:10:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.820+0000 7fed8ee7d740 10 client.25670 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.820+0000 7fed8ee7d740 1 -- 172.21.15.47:0/2524022170 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5569f8bfc0d0 con 0x5569f8be41e0 2024-07-24T22:10:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.824+0000 7fed6d7fa640 1 -- 172.21.15.47:0/2524022170 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed80031070 con 0x5569f8be41e0 2024-07-24T22:10:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.825+0000 7fed6d7fa640 1 -- 172.21.15.47:0/2524022170 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fed80003a00 con 0x5569f8be41e0 2024-07-24T22:10:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.828+0000 7fed8ee7d740 10 client.25670 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.828+0000 7fed8ee7d740 10 client.25670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:10:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.828+0000 7fed8ee7d740 20 client.25670 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.828+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/2524022170 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5569f8bfc660 0x5569f8bfca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.828+0000 7fed8ee7d740 4 client.25670 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:10:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.828+0000 7fed8ee7d740 1 -- 172.21.15.47:0/2524022170 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5569f8b56c70 con 0x5569f8bfc660 2024-07-24T22:10:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.831+0000 7fed896c1640 1 --2- 172.21.15.47:0/2524022170 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5569f8bfc660 0x5569f8bfca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.851+0000 7fed6d7fa640 10 client.25670 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:44.851+0000 7fed896c1640 1 --2- 172.21.15.47:0/2524022170 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5569f8bfc660 0x5569f8bfca70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57c971fef591d15b server_cookie=b5eb513e009afdb7 in_seq=0 out_seq=0 2024-07-24T22:10:45.539 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd677965', total seconds elapsed: 36.5 2024-07-24T22:10:45.539 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-07-24T22:10:45.539 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:10:45.944 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:45 smithi047 ceph-mon[32551]: pgmap v472: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 999 GiB / 1.0 TiB avail; 5.6 KiB/s rd, 48 MiB/s wr, 19 op/s 2024-07-24T22:10:46.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:45 smithi188 ceph-mon[37380]: pgmap v472: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 999 GiB / 1.0 TiB avail; 5.6 KiB/s rd, 48 MiB/s wr, 19 op/s 2024-07-24T22:10:46.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:45 smithi183 ceph-mon[37007]: pgmap v472: 97 pgs: 97 active+clean; 24 GiB data, 73 GiB used, 999 GiB / 1.0 TiB avail; 5.6 KiB/s rd, 48 MiB/s wr, 19 op/s 2024-07-24T22:10:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:10:47.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.975+0000 7fed6d7fa640 1 -- 172.21.15.47:0/2524022170 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5569f8b56c70 con 0x5569f8bfc660 2024-07-24T22:10:47.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.975+0000 7fed6d7fa640 10 client.25670 handle_command_reply: tid=0 2024-07-24T22:10:47.978 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.975+0000 7fed8ee7d740 1 client.25670 shutdown 2024-07-24T22:10:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.978+0000 7fed8ee7d740 1 -- 172.21.15.47:0/2524022170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 msgr2=0x5569f8c0c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.978+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/2524022170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 0x5569f8c0c0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fed8002e040 tx=0x7fed80005a70 comp rx=0 tx=0).stop 2024-07-24T22:10:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.978+0000 7fed8ee7d740 1 -- 172.21.15.47:0/2524022170 shutdown_connections 2024-07-24T22:10:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.978+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/2524022170 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5569f8bfc660 0x5569f8bfca70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.978+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/2524022170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5569f8bf4580 0x5569f8bf85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.978+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/2524022170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569f8be41e0 0x5569f8c0c0a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.978+0000 7fed8ee7d740 1 --2- 172.21.15.47:0/2524022170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569f8be38c0 0x5569f8c0bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.978+0000 7fed6d7fa640 0 client.25670 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.978+0000 7fed8ee7d740 1 -- 172.21.15.47:0/2524022170 >> 172.21.15.47:0/2524022170 conn(0x5569f8be16f0 msgr2=0x5569f8be23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.979+0000 7fed8ee7d740 1 -- 172.21.15.47:0/2524022170 shutdown_connections 2024-07-24T22:10:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.979+0000 7fed8ee7d740 1 -- 172.21.15.47:0/2524022170 wait complete. 2024-07-24T22:10:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.982+0000 7fed8ee7d740 20 client.25670 trim_cache size 0 max 16384 2024-07-24T22:10:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:10:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:10:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:10:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:10:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.998+0000 7fed8c126640 1 -- 172.21.15.47:0/1363569109 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fed700b3dc0 msgr2=0x7fed700b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.998+0000 7fed8c126640 1 --2- 172.21.15.47:0/1363569109 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fed700b3dc0 0x7fed700b6280 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0aa910 tx=0x7fed7c0e3fc0 comp rx=0 tx=0).stop 2024-07-24T22:10:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.998+0000 7fed8c126640 1 -- 172.21.15.47:0/1363569109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed8410cbb0 msgr2=0x7fed8419e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.998+0000 7fed8c126640 1 --2- 172.21.15.47:0/1363569109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed8410cbb0 0x7fed8419e4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009fd0 tx=0x7fed7c00b260 comp rx=0 tx=0).stop 2024-07-24T22:10:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.998+0000 7fed8c126640 1 -- 172.21.15.47:0/1363569109 shutdown_connections 2024-07-24T22:10:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.998+0000 7fed8c126640 1 --2- 172.21.15.47:0/1363569109 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fed700b3dc0 0x7fed700b6280 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.998+0000 7fed8c126640 1 --2- 172.21.15.47:0/1363569109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed8410cbb0 0x7fed8419e4f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.998+0000 7fed8c126640 1 --2- 172.21.15.47:0/1363569109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed8410a280 0x7fed84199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.998+0000 7fed8c126640 1 --2- 172.21.15.47:0/1363569109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed84101180 0x7fed84198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.998+0000 7fed8c126640 1 -- 172.21.15.47:0/1363569109 >> 172.21.15.47:0/1363569109 conn(0x7fed84076860 msgr2=0x7fed840fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.998+0000 7fed8c126640 1 -- 172.21.15.47:0/1363569109 shutdown_connections 2024-07-24T22:10:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:10:47.998+0000 7fed8c126640 1 -- 172.21.15.47:0/1363569109 wait complete. 2024-07-24T22:10:48.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:47 smithi188 ceph-mon[37380]: pgmap v473: 97 pgs: 97 active+clean; 24 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 5.9 KiB/s rd, 61 MiB/s wr, 34 op/s 2024-07-24T22:10:48.138 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:47 smithi047 ceph-mon[32551]: pgmap v473: 97 pgs: 97 active+clean; 24 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 5.9 KiB/s rd, 61 MiB/s wr, 34 op/s 2024-07-24T22:10:48.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:47 smithi183 ceph-mon[37007]: pgmap v473: 97 pgs: 97 active+clean; 24 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 5.9 KiB/s rd, 61 MiB/s wr, 34 op/s 2024-07-24T22:10:49.818 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:49 smithi047 ceph-mon[32551]: pgmap v474: 97 pgs: 97 active+clean; 25 GiB data, 76 GiB used, 996 GiB / 1.0 TiB avail; 464 KiB/s rd, 140 MiB/s wr, 150 op/s 2024-07-24T22:10:50.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.928+0000 7fc64ac9a640 1 -- 172.21.15.47:0/3837498963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc644107150 msgr2=0x7fc644107590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:50.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.928+0000 7fc64ac9a640 1 --2- 172.21.15.47:0/3837498963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc644107150 0x7fc644107590 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc630009930 tx=0x7fc63002a420 comp rx=0 tx=0).stop 2024-07-24T22:10:50.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.928+0000 7fc64ac9a640 1 -- 172.21.15.47:0/3837498963 shutdown_connections 2024-07-24T22:10:50.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.928+0000 7fc64ac9a640 1 --2- 172.21.15.47:0/3837498963 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc644107ad0 0x7fc64410e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:50.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.928+0000 7fc64ac9a640 1 --2- 172.21.15.47:0/3837498963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc644107150 0x7fc644107590 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:50.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.928+0000 7fc64ac9a640 1 --2- 172.21.15.47:0/3837498963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644102360 0x7fc644102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:50.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.928+0000 7fc64ac9a640 1 -- 172.21.15.47:0/3837498963 >> 172.21.15.47:0/3837498963 conn(0x7fc644076890 msgr2=0x7fc644076ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:50.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.928+0000 7fc64ac9a640 1 -- 172.21.15.47:0/3837498963 shutdown_connections 2024-07-24T22:10:50.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.928+0000 7fc64ac9a640 1 -- 172.21.15.47:0/3837498963 wait complete. 2024-07-24T22:10:50.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.929+0000 7fc64ac9a640 1 Processor -- start 2024-07-24T22:10:50.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.929+0000 7fc64ac9a640 1 -- start start 2024-07-24T22:10:50.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.929+0000 7fc64ac9a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc644102360 0x7fc644197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:50.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.929+0000 7fc64ac9a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc644107150 0x7fc644197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:50.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.929+0000 7fc64ac9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644107ad0 0x7fc644198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:50.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.929+0000 7fc64ac9a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc644111630 con 0x7fc644107ad0 2024-07-24T22:10:50.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.929+0000 7fc64ac9a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc6441114b0 con 0x7fc644102360 2024-07-24T22:10:50.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.929+0000 7fc64ac9a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc6441117b0 con 0x7fc644107150 2024-07-24T22:10:50.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.929+0000 7fc649237640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644107ad0 0x7fc644198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:50.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.929+0000 7fc649237640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644107ad0 0x7fc644198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49954/0 (socket says 172.21.15.47:49954) 2024-07-24T22:10:50.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.929+0000 7fc649237640 1 -- 172.21.15.47:0/2777677816 learned_addr learned my addr 172.21.15.47:0/2777677816 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:50.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.929+0000 7fc643fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc644107150 0x7fc644197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:50.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.930+0000 7fc643fff640 1 -- 172.21.15.47:0/2777677816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc644102360 msgr2=0x7fc644197910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:10:50.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.930+0000 7fc643fff640 1 --2- 172.21.15.47:0/2777677816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc644102360 0x7fc644197910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:50.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.930+0000 7fc643fff640 1 -- 172.21.15.47:0/2777677816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644107ad0 msgr2=0x7fc644198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:50.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.930+0000 7fc643fff640 1 --2- 172.21.15.47:0/2777677816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644107ad0 0x7fc644198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:50.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.930+0000 7fc643fff640 1 -- 172.21.15.47:0/2777677816 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6441a70f0 con 0x7fc644107150 2024-07-24T22:10:50.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.930+0000 7fc643fff640 1 --2- 172.21.15.47:0/2777677816 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc644107150 0x7fc644197e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc63002a940 tx=0x7fc630003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:50.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.930+0000 7fc641ffb640 1 -- 172.21.15.47:0/2777677816 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63003f070 con 0x7fc644107150 2024-07-24T22:10:50.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.930+0000 7fc641ffb640 1 -- 172.21.15.47:0/2777677816 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc630031b60 con 0x7fc644107150 2024-07-24T22:10:50.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.931+0000 7fc64ac9a640 1 -- 172.21.15.47:0/2777677816 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6441a7380 con 0x7fc644107150 2024-07-24T22:10:50.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.931+0000 7fc641ffb640 1 -- 172.21.15.47:0/2777677816 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630035030 con 0x7fc644107150 2024-07-24T22:10:50.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.931+0000 7fc64ac9a640 1 -- 172.21.15.47:0/2777677816 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6441a7880 con 0x7fc644107150 2024-07-24T22:10:50.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.933+0000 7fc64ac9a640 1 -- 172.21.15.47:0/2777677816 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc644102740 con 0x7fc644107150 2024-07-24T22:10:50.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.934+0000 7fc641ffb640 1 -- 172.21.15.47:0/2777677816 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fc630042070 con 0x7fc644107150 2024-07-24T22:10:50.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.935+0000 7fc641ffb640 1 --2- 172.21.15.47:0/2777677816 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc6340b3dc0 0x7fc6340b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:50.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.936+0000 7fc648a36640 1 --2- 172.21.15.47:0/2777677816 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc6340b3dc0 0x7fc6340b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:50.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.936+0000 7fc641ffb640 1 -- 172.21.15.47:0/2777677816 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fc6301045a0 con 0x7fc644107150 2024-07-24T22:10:50.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.936+0000 7fc648a36640 1 --2- 172.21.15.47:0/2777677816 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc6340b3dc0 0x7fc6340b6280 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc638009a60 tx=0x7fc638005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:50.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:49.939+0000 7fc641ffb640 1 -- 172.21.15.47:0/2777677816 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fc6300cb8b0 con 0x7fc644107150 2024-07-24T22:10:50.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:49 smithi188 ceph-mon[37380]: pgmap v474: 97 pgs: 97 active+clean; 25 GiB data, 76 GiB used, 996 GiB / 1.0 TiB avail; 464 KiB/s rd, 140 MiB/s wr, 150 op/s 2024-07-24T22:10:50.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:49 smithi183 ceph-mon[37007]: pgmap v474: 97 pgs: 97 active+clean; 25 GiB data, 76 GiB used, 996 GiB / 1.0 TiB avail; 464 KiB/s rd, 140 MiB/s wr, 150 op/s 2024-07-24T22:10:50.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.343+0000 7fc64ac9a640 1 -- 172.21.15.47:0/2777677816 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc64402e000 con 0x7fc644107150 2024-07-24T22:10:50.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.345+0000 7fc641ffb640 1 -- 172.21.15.47:0/2777677816 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7fc6300cb1b0 con 0x7fc644107150 2024-07-24T22:10:50.347 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:10:50.348 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:10:50.348 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:10:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.349+0000 7fc64ac9a640 1 -- 172.21.15.47:0/2777677816 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc6340b3dc0 msgr2=0x7fc6340b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.349+0000 7fc64ac9a640 1 --2- 172.21.15.47:0/2777677816 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc6340b3dc0 0x7fc6340b6280 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc638009a60 tx=0x7fc638005f90 comp rx=0 tx=0).stop 2024-07-24T22:10:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.349+0000 7fc64ac9a640 1 -- 172.21.15.47:0/2777677816 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc644107150 msgr2=0x7fc644197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.349+0000 7fc64ac9a640 1 --2- 172.21.15.47:0/2777677816 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc644107150 0x7fc644197e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc63002a940 tx=0x7fc630003c10 comp rx=0 tx=0).stop 2024-07-24T22:10:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.349+0000 7fc64ac9a640 1 -- 172.21.15.47:0/2777677816 shutdown_connections 2024-07-24T22:10:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.349+0000 7fc64ac9a640 1 --2- 172.21.15.47:0/2777677816 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc6340b3dc0 0x7fc6340b6280 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:50.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.349+0000 7fc64ac9a640 1 --2- 172.21.15.47:0/2777677816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc644107ad0 0x7fc644198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:50.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.349+0000 7fc64ac9a640 1 --2- 172.21.15.47:0/2777677816 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc644107150 0x7fc644197e50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:50.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.349+0000 7fc64ac9a640 1 --2- 172.21.15.47:0/2777677816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc644102360 0x7fc644197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:50.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.349+0000 7fc64ac9a640 1 -- 172.21.15.47:0/2777677816 >> 172.21.15.47:0/2777677816 conn(0x7fc644076890 msgr2=0x7fc6440ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:50.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.349+0000 7fc64ac9a640 1 -- 172.21.15.47:0/2777677816 shutdown_connections 2024-07-24T22:10:50.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:50.349+0000 7fc64ac9a640 1 -- 172.21.15.47:0/2777677816 wait complete. 2024-07-24T22:10:51.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:50 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2777677816' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:10:51.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:50 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2777677816' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:10:51.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:50 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2777677816' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:10:51.499 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-07-24T22:10:51.499 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-07-24T22:10:52.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:51 smithi183 ceph-mon[37007]: pgmap v475: 97 pgs: 97 active+clean; 27 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 664 KiB/s rd, 281 MiB/s wr, 469 op/s 2024-07-24T22:10:52.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:51 smithi047 ceph-mon[32551]: pgmap v475: 97 pgs: 97 active+clean; 27 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 664 KiB/s rd, 281 MiB/s wr, 469 op/s 2024-07-24T22:10:52.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:51 smithi188 ceph-mon[37380]: pgmap v475: 97 pgs: 97 active+clean; 27 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 664 KiB/s rd, 281 MiB/s wr, 469 op/s 2024-07-24T22:10:52.387 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:10:53.302 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:52 smithi188 ceph-mon[37380]: pgmap v476: 97 pgs: 97 active+clean; 28 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 346 MiB/s wr, 711 op/s 2024-07-24T22:10:53.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:52 smithi183 ceph-mon[37007]: pgmap v476: 97 pgs: 97 active+clean; 28 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 346 MiB/s wr, 711 op/s 2024-07-24T22:10:53.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:52 smithi047 ceph-mon[32551]: pgmap v476: 97 pgs: 97 active+clean; 28 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 346 MiB/s wr, 711 op/s 2024-07-24T22:10:54.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.716+0000 7f106c80e640 1 -- 172.21.15.47:0/4101696968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1068107a00 msgr2=0x7f106810e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:54.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.716+0000 7f106c80e640 1 --2- 172.21.15.47:0/4101696968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1068107a00 0x7f106810e200 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1058009900 tx=0x7f105802a410 comp rx=0 tx=0).stop 2024-07-24T22:10:54.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.717+0000 7f106c80e640 1 -- 172.21.15.47:0/4101696968 shutdown_connections 2024-07-24T22:10:54.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.717+0000 7f106c80e640 1 --2- 172.21.15.47:0/4101696968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1068107a00 0x7f106810e200 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.717+0000 7f106c80e640 1 --2- 172.21.15.47:0/4101696968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1068107080 0x7f10681074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.717+0000 7f106c80e640 1 --2- 172.21.15.47:0/4101696968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1068101670 0x7f1068101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.717+0000 7f106c80e640 1 -- 172.21.15.47:0/4101696968 >> 172.21.15.47:0/4101696968 conn(0x7f10680fd120 msgr2=0x7f10680ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.717+0000 7f106c80e640 1 -- 172.21.15.47:0/4101696968 shutdown_connections 2024-07-24T22:10:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.717+0000 7f106c80e640 1 -- 172.21.15.47:0/4101696968 wait complete. 2024-07-24T22:10:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.718+0000 7f106c80e640 1 Processor -- start 2024-07-24T22:10:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.718+0000 7f106c80e640 1 -- start start 2024-07-24T22:10:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.718+0000 7f106c80e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1068101670 0x7f1068198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.718+0000 7f106c80e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1068107080 0x7f10681991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.718+0000 7f106c80e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1068107a00 0x7f106819e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.718+0000 7f106c80e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f10681127a0 con 0x7f1068107a00 2024-07-24T22:10:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.718+0000 7f106c80e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1068112620 con 0x7f1068101670 2024-07-24T22:10:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.718+0000 7f106c80e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1068112920 con 0x7f1068107080 2024-07-24T22:10:54.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.718+0000 7f1065d9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1068107080 0x7f10681991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.718+0000 7f106659c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1068101670 0x7f1068198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.718+0000 7f1066d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1068107a00 0x7f106819e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.718+0000 7f1065d9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1068107080 0x7f10681991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:41140/0 (socket says 172.21.15.47:41140) 2024-07-24T22:10:54.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.718+0000 7f1065d9b640 1 -- 172.21.15.47:0/15436799 learned_addr learned my addr 172.21.15.47:0/15436799 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.719+0000 7f106659c640 1 -- 172.21.15.47:0/15436799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1068107080 msgr2=0x7f10681991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.719+0000 7f106659c640 1 --2- 172.21.15.47:0/15436799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1068107080 0x7f10681991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.719+0000 7f106659c640 1 -- 172.21.15.47:0/15436799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1068107a00 msgr2=0x7f106819e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.719+0000 7f106659c640 1 --2- 172.21.15.47:0/15436799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1068107a00 0x7f106819e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.719+0000 7f106659c640 1 -- 172.21.15.47:0/15436799 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f106819ed40 con 0x7f1068101670 2024-07-24T22:10:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.719+0000 7f1065d9b640 1 --2- 172.21.15.47:0/15436799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1068107080 0x7f10681991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:10:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.719+0000 7f106659c640 1 --2- 172.21.15.47:0/15436799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1068101670 0x7f1068198c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f106000e9f0 tx=0x7f106000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:54.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.719+0000 7f105f7fe640 1 -- 172.21.15.47:0/15436799 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106000cd80 con 0x7f1068101670 2024-07-24T22:10:54.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.719+0000 7f105f7fe640 1 -- 172.21.15.47:0/15436799 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1060011920 con 0x7f1068101670 2024-07-24T22:10:54.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.719+0000 7f106c80e640 1 -- 172.21.15.47:0/15436799 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f106819f030 con 0x7f1068101670 2024-07-24T22:10:54.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.719+0000 7f105f7fe640 1 -- 172.21.15.47:0/15436799 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060010970 con 0x7f1068101670 2024-07-24T22:10:54.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.719+0000 7f106c80e640 1 -- 172.21.15.47:0/15436799 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10681a56f0 con 0x7f1068101670 2024-07-24T22:10:54.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.722+0000 7f106ebbf740 1 Processor -- start 2024-07-24T22:10:54.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.722+0000 7f105f7fe640 1 -- 172.21.15.47:0/15436799 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f1060011470 con 0x7f1068101670 2024-07-24T22:10:54.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.723+0000 7f106ebbf740 1 -- start start 2024-07-24T22:10:54.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.723+0000 7f106ebbf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f59ecd0 0x558c9f59d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.723+0000 7f106ebbf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59d770 0x558c9f59db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.723+0000 7f106ebbf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f5a95a0 0x558c9f5ab990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.723+0000 7f106ebbf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558c9f513670 con 0x558c9f59d770 2024-07-24T22:10:54.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.723+0000 7f106ebbf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558c9f502b70 con 0x558c9f59ecd0 2024-07-24T22:10:54.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.723+0000 7f106ebbf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558c9f506bb0 con 0x558c9f5a95a0 2024-07-24T22:10:54.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.723+0000 7f1065d9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f5a95a0 0x558c9f5ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.723+0000 7f106659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59d770 0x558c9f59db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.723+0000 7f1065d9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f5a95a0 0x558c9f5ab990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:41154/0 (socket says 172.21.15.47:41154) 2024-07-24T22:10:54.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.723+0000 7f1065d9b640 1 -- 172.21.15.47:0/63960839 learned_addr learned my addr 172.21.15.47:0/63960839 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:54.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.723+0000 7f1066d9d640 1 --2- 172.21.15.47:0/63960839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f59ecd0 0x558c9f59d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.723+0000 7f1065d9b640 1 -- 172.21.15.47:0/63960839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f59ecd0 msgr2=0x558c9f59d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:54.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.724+0000 7f1065d9b640 1 --2- 172.21.15.47:0/63960839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f59ecd0 0x558c9f59d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.724+0000 7f1065d9b640 1 -- 172.21.15.47:0/63960839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59d770 msgr2=0x558c9f59db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:54.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.724+0000 7f1065d9b640 1 --2- 172.21.15.47:0/63960839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59d770 0x558c9f59db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.724+0000 7f1065d9b640 1 -- 172.21.15.47:0/63960839 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c9f49ad30 con 0x558c9f5a95a0 2024-07-24T22:10:54.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.724+0000 7f1066d9d640 1 --2- 172.21.15.47:0/63960839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f59ecd0 0x558c9f59d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:10:54.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.724+0000 7f1065d9b640 1 --2- 172.21.15.47:0/63960839 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f5a95a0 0x558c9f5ab990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f10500115c0 tx=0x7f1050009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b8bcb2a9f6029c0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:54.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.724+0000 7f105f7fe640 1 --2- 172.21.15.47:0/15436799 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f10540b3d40 0x7f10540b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.724+0000 7f105cff9640 1 -- 172.21.15.47:0/63960839 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105001e070 con 0x558c9f5a95a0 2024-07-24T22:10:54.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.724+0000 7f105cff9640 1 -- 172.21.15.47:0/63960839 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f105000faf0 con 0x558c9f5a95a0 2024-07-24T22:10:54.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.724+0000 7f105cff9640 1 -- 172.21.15.47:0/63960839 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050019c60 con 0x558c9f5a95a0 2024-07-24T22:10:54.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.724+0000 7f1066d9d640 1 --2- 172.21.15.47:0/15436799 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f10540b3d40 0x7f10540b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.724+0000 7f105f7fe640 1 -- 172.21.15.47:0/15436799 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f10600e44f0 con 0x7f1068101670 2024-07-24T22:10:54.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.725+0000 7f106ebbf740 1 -- 172.21.15.47:0/63960839 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f5a95a0 msgr2=0x558c9f5ab990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:54.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.725+0000 7f106ebbf740 1 --2- 172.21.15.47:0/63960839 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f5a95a0 0x558c9f5ab990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f10500115c0 tx=0x7f1050009f90 comp rx=0 tx=0).stop 2024-07-24T22:10:54.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.725+0000 7f1066d9d640 1 --2- 172.21.15.47:0/15436799 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f10540b3d40 0x7f10540b6200 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1058006010 tx=0x7f10580058d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:54.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.725+0000 7f106ebbf740 1 -- 172.21.15.47:0/63960839 shutdown_connections 2024-07-24T22:10:54.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.725+0000 7f106ebbf740 1 --2- 172.21.15.47:0/63960839 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f5a95a0 0x558c9f5ab990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.725+0000 7f106ebbf740 1 --2- 172.21.15.47:0/63960839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59d770 0x558c9f59db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.725+0000 7f106ebbf740 1 --2- 172.21.15.47:0/63960839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f59ecd0 0x558c9f59d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.725+0000 7f106ebbf740 1 -- 172.21.15.47:0/63960839 >> 172.21.15.47:0/63960839 conn(0x558c9f567720 msgr2=0x558c9f59b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:54.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.725+0000 7f106ebbf740 1 -- 172.21.15.47:0/63960839 shutdown_connections 2024-07-24T22:10:54.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.725+0000 7f106ebbf740 1 -- 172.21.15.47:0/63960839 wait complete. 2024-07-24T22:10:54.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f106ebbf740 1 -- start start 2024-07-24T22:10:54.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f106ebbf740 1 Processor -- start 2024-07-24T22:10:54.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f106ebbf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59d770 0x558c9f5a9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f106ebbf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59ecd0 0x558c9f5a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f106ebbf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f5a95a0 0x558c9f5a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f106ebbf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558c9f3667a0 con 0x558c9f59ecd0 2024-07-24T22:10:54.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f106ebbf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558c9f4a4ff0 con 0x558c9f5a95a0 2024-07-24T22:10:54.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f106ebbf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558c9f5ac460 con 0x558c9f59d770 2024-07-24T22:10:54.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f106ebbf740 10 client.0 _ll_register_callbacks cb 0x558c9f210090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:54.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f1065d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59ecd0 0x558c9f5a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f106659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59d770 0x558c9f5a9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f1066d9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f5a95a0 0x558c9f5a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f106659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59d770 0x558c9f5a9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:41162/0 (socket says 172.21.15.47:41162) 2024-07-24T22:10:54.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f106659c640 1 -- 172.21.15.47:0/3446398428 learned_addr learned my addr 172.21.15.47:0/3446398428 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:54.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.726+0000 7f1065d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59ecd0 0x558c9f5a64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50008/0 (socket says 172.21.15.47:50008) 2024-07-24T22:10:54.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f106659c640 1 -- 172.21.15.47:0/3446398428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f5a95a0 msgr2=0x558c9f5a6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:54.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f106659c640 1 --2- 172.21.15.47:0/3446398428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f5a95a0 0x558c9f5a6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f106659c640 1 -- 172.21.15.47:0/3446398428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59ecd0 msgr2=0x558c9f5a64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:54.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f106659c640 1 --2- 172.21.15.47:0/3446398428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59ecd0 0x558c9f5a64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f106659c640 1 -- 172.21.15.47:0/3446398428 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c9f4a90a0 con 0x558c9f59d770 2024-07-24T22:10:54.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f1065d9b640 1 --2- 172.21.15.47:0/3446398428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59ecd0 0x558c9f5a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:10:54.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f106659c640 1 --2- 172.21.15.47:0/3446398428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59d770 0x558c9f5a9060 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f10600e1ca0 tx=0x7f10600a7040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cea9d197a35a80c4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:54.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f104dffb640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:10:54.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f104dffb640 1 -- 172.21.15.47:0/3446398428 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060011760 con 0x558c9f59d770 2024-07-24T22:10:54.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f104dffb640 1 -- 172.21.15.47:0/3446398428 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f10600a7390 con 0x558c9f59d770 2024-07-24T22:10:54.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f106ebbf740 1 -- 172.21.15.47:0/3446398428 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f105000faf0 con 0x558c9f59d770 2024-07-24T22:10:54.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f104dffb640 1 -- 172.21.15.47:0/3446398428 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f10600aac10 con 0x558c9f59d770 2024-07-24T22:10:54.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f106ebbf740 10 client.25729 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:54.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.727+0000 7f106ebbf740 1 -- 172.21.15.47:0/3446398428 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558c9f272b90 con 0x558c9f59d770 2024-07-24T22:10:54.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.728+0000 7f104dffb640 1 -- 172.21.15.47:0/3446398428 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f105000faf0 con 0x558c9f59d770 2024-07-24T22:10:54.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.728+0000 7f104dffb640 1 -- 172.21.15.47:0/3446398428 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f106000f040 con 0x558c9f59d770 2024-07-24T22:10:54.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.728+0000 7f106ebbf740 10 client.25729 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:54.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.728+0000 7f106ebbf740 10 client.25729 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:10:54.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.728+0000 7f106ebbf740 20 client.25729 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:54.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.728+0000 7f106ebbf740 1 --2- 172.21.15.47:0/3446398428 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558c9f5b95f0 0x558c9f5bba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.728+0000 7f106ebbf740 4 client.25729 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:10:54.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.728+0000 7f106ebbf740 1 -- 172.21.15.47:0/3446398428 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c9f5155c0 con 0x558c9f5b95f0 2024-07-24T22:10:54.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.728+0000 7f1065d9b640 1 --2- 172.21.15.47:0/3446398428 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558c9f5b95f0 0x558c9f5bba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.729+0000 7f104dffb640 10 client.25729 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:54.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.729+0000 7f1065d9b640 1 --2- 172.21.15.47:0/3446398428 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558c9f5b95f0 0x558c9f5bba60 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=175174a96c3ecf11 server_cookie=8f231d8f58495859 in_seq=0 out_seq=0 2024-07-24T22:10:54.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.729+0000 7f104dffb640 1 -- 172.21.15.47:0/3446398428 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c9f5155c0 con 0x558c9f5b95f0 2024-07-24T22:10:54.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.729+0000 7f104dffb640 10 client.25729 handle_command_reply: tid=0 2024-07-24T22:10:54.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.729+0000 7f106ebbf740 1 client.25729 shutdown 2024-07-24T22:10:54.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.730+0000 7f106ebbf740 1 -- 172.21.15.47:0/3446398428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59d770 msgr2=0x558c9f5a9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:54.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.730+0000 7f106ebbf740 1 --2- 172.21.15.47:0/3446398428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59d770 0x558c9f5a9060 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f10600e1ca0 tx=0x7f10600a7040 comp rx=0 tx=0).stop 2024-07-24T22:10:54.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.730+0000 7f106ebbf740 1 -- 172.21.15.47:0/3446398428 shutdown_connections 2024-07-24T22:10:54.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.730+0000 7f106ebbf740 1 --2- 172.21.15.47:0/3446398428 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558c9f5b95f0 0x558c9f5bba60 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.730+0000 7f104dffb640 0 client.25729 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:54.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.730+0000 7f106ebbf740 1 --2- 172.21.15.47:0/3446398428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f5a95a0 0x558c9f5a6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.730+0000 7f106ebbf740 1 --2- 172.21.15.47:0/3446398428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59ecd0 0x558c9f5a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.730+0000 7f106ebbf740 1 --2- 172.21.15.47:0/3446398428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59d770 0x558c9f5a9060 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.730+0000 7f106ebbf740 1 -- 172.21.15.47:0/3446398428 >> 172.21.15.47:0/3446398428 conn(0x558c9f567720 msgr2=0x558c9f5a0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:54.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.730+0000 7f106ebbf740 1 -- 172.21.15.47:0/3446398428 shutdown_connections 2024-07-24T22:10:54.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.730+0000 7f106ebbf740 1 -- 172.21.15.47:0/3446398428 wait complete. 2024-07-24T22:10:54.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.730+0000 7f106ebbf740 20 client.25729 trim_cache size 0 max 16384 2024-07-24T22:10:54.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.748+0000 7f106ebbf740 1 Processor -- start 2024-07-24T22:10:54.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.748+0000 7f106ebbf740 1 -- start start 2024-07-24T22:10:54.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f106ebbf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59d770 0x558c9f59b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f106ebbf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59ecd0 0x558c9f59cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f106ebbf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f5a95a0 0x558c9f5c1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f106ebbf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f10681ae350 con 0x558c9f59d770 2024-07-24T22:10:54.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f106ebbf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f10681b0bd0 con 0x558c9f5a95a0 2024-07-24T22:10:54.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f106ebbf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f10681ae9c0 con 0x558c9f59ecd0 2024-07-24T22:10:54.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f106659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59d770 0x558c9f59b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f106659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59d770 0x558c9f59b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50012/0 (socket says 172.21.15.47:50012) 2024-07-24T22:10:54.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f106659c640 1 -- 172.21.15.47:0/97372930 learned_addr learned my addr 172.21.15.47:0/97372930 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:54.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f1066d9d640 1 --2- 172.21.15.47:0/97372930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f5a95a0 0x558c9f5c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f1065d9b640 1 --2- 172.21.15.47:0/97372930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59ecd0 0x558c9f59cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f1066d9d640 1 -- 172.21.15.47:0/97372930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59ecd0 msgr2=0x558c9f59cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:54.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f1066d9d640 1 --2- 172.21.15.47:0/97372930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59ecd0 0x558c9f59cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f1066d9d640 1 -- 172.21.15.47:0/97372930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59d770 msgr2=0x558c9f59b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:54.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f1066d9d640 1 --2- 172.21.15.47:0/97372930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59d770 0x558c9f59b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.749+0000 7f1066d9d640 1 -- 172.21.15.47:0/97372930 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c9f5abd00 con 0x558c9f5a95a0 2024-07-24T22:10:54.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.750+0000 7f1066d9d640 1 --2- 172.21.15.47:0/97372930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f5a95a0 0x558c9f5c1330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1058005940 tx=0x7f105803e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11d6aa5f813c720e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:54.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.750+0000 7f104ffff640 1 -- 172.21.15.47:0/97372930 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1058035040 con 0x558c9f5a95a0 2024-07-24T22:10:54.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.750+0000 7f104ffff640 1 -- 172.21.15.47:0/97372930 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f105804d070 con 0x558c9f5a95a0 2024-07-24T22:10:54.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.750+0000 7f104ffff640 1 -- 172.21.15.47:0/97372930 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1058004a40 con 0x558c9f5a95a0 2024-07-24T22:10:54.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.751+0000 7f106ebbf740 1 -- 172.21.15.47:0/97372930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f5a95a0 msgr2=0x558c9f5c1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:54.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.751+0000 7f106ebbf740 1 --2- 172.21.15.47:0/97372930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f5a95a0 0x558c9f5c1330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1058005940 tx=0x7f105803e000 comp rx=0 tx=0).stop 2024-07-24T22:10:54.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.751+0000 7f106ebbf740 1 -- 172.21.15.47:0/97372930 shutdown_connections 2024-07-24T22:10:54.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.751+0000 7f106ebbf740 1 --2- 172.21.15.47:0/97372930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f5a95a0 0x558c9f5c1330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.751+0000 7f106ebbf740 1 --2- 172.21.15.47:0/97372930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59ecd0 0x558c9f59cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.751+0000 7f106ebbf740 1 --2- 172.21.15.47:0/97372930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f59d770 0x558c9f59b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.751+0000 7f106ebbf740 1 -- 172.21.15.47:0/97372930 >> 172.21.15.47:0/97372930 conn(0x558c9f567720 msgr2=0x558c9f59a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:54.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.751+0000 7f106ebbf740 1 -- 172.21.15.47:0/97372930 shutdown_connections 2024-07-24T22:10:54.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.751+0000 7f106ebbf740 1 -- 172.21.15.47:0/97372930 wait complete. 2024-07-24T22:10:54.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.752+0000 7f106ebbf740 1 -- start start 2024-07-24T22:10:54.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.752+0000 7f106ebbf740 1 Processor -- start 2024-07-24T22:10:54.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.752+0000 7f106ebbf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f59d770 0x558c9f5b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.752+0000 7f106ebbf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59ecd0 0x558c9f5b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.752+0000 7f106ebbf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f5a95a0 0x558c9f5ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106ebbf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f10681af090 con 0x558c9f5a95a0 2024-07-24T22:10:54.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106ebbf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f10681b0500 con 0x558c9f59d770 2024-07-24T22:10:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106ebbf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f10681af760 con 0x558c9f59ecd0 2024-07-24T22:10:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f1066d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f5a95a0 0x558c9f5ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106659c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f59d770 0x558c9f5b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106ebbf740 10 client.0 _ll_register_callbacks cb 0x7f1060005f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:10:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106659c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f59d770 0x558c9f5b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:41592/0 (socket says 172.21.15.47:41592) 2024-07-24T22:10:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f1066d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f5a95a0 0x558c9f5ac6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50022/0 (socket says 172.21.15.47:50022) 2024-07-24T22:10:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106659c640 1 -- 172.21.15.47:0/2937108687 learned_addr learned my addr 172.21.15.47:0/2937108687 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:10:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f1065d9b640 1 --2- 172.21.15.47:0/2937108687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59ecd0 0x558c9f5b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106659c640 1 -- 172.21.15.47:0/2937108687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59ecd0 msgr2=0x558c9f5b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106659c640 1 --2- 172.21.15.47:0/2937108687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59ecd0 0x558c9f5b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106659c640 1 -- 172.21.15.47:0/2937108687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f5a95a0 msgr2=0x558c9f5ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:10:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106659c640 1 --2- 172.21.15.47:0/2937108687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f5a95a0 0x558c9f5ac6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106659c640 1 -- 172.21.15.47:0/2937108687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c9f5acda0 con 0x558c9f59d770 2024-07-24T22:10:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106659c640 1 --2- 172.21.15.47:0/2937108687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f59d770 0x558c9f5b18e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10600e2240 tx=0x7f10600b4070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=507ddeb72d5b5f0f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:10:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f104dffb640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:10:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f104dffb640 1 -- 172.21.15.47:0/2937108687 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060011760 con 0x558c9f59d770 2024-07-24T22:10:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f104dffb640 1 -- 172.21.15.47:0/2937108687 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f10600aa570 con 0x558c9f59d770 2024-07-24T22:10:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.753+0000 7f106ebbf740 1 -- 172.21.15.47:0/2937108687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f105804d070 con 0x558c9f59d770 2024-07-24T22:10:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.754+0000 7f104dffb640 1 -- 172.21.15.47:0/2937108687 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f10600ab800 con 0x558c9f59d770 2024-07-24T22:10:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.754+0000 7f106ebbf740 10 client.25691 fetch_fsmap learned FSMap version 20 2024-07-24T22:10:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.754+0000 7f106ebbf740 1 -- 172.21.15.47:0/2937108687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558c9f624cc0 con 0x558c9f59d770 2024-07-24T22:10:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.754+0000 7f104dffb640 1 -- 172.21.15.47:0/2937108687 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f105804d070 con 0x558c9f59d770 2024-07-24T22:10:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.754+0000 7f104dffb640 1 -- 172.21.15.47:0/2937108687 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f10600a9dd0 con 0x558c9f59d770 2024-07-24T22:10:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.754+0000 7f106ebbf740 10 client.25691 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:10:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.754+0000 7f106ebbf740 10 client.25691 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:10:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.754+0000 7f106ebbf740 20 client.25691 populate_metadata read hostname 'smithi047' 2024-07-24T22:10:54.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.754+0000 7f106ebbf740 1 --2- 172.21.15.47:0/2937108687 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558c9f625350 0x558c9f627770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:10:54.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.754+0000 7f106ebbf740 4 client.25691 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-07-24T22:10:54.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.754+0000 7f106ebbf740 1 -- 172.21.15.47:0/2937108687 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x558c9f511060 con 0x558c9f625350 2024-07-24T22:10:54.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.754+0000 7f1065d9b640 1 --2- 172.21.15.47:0/2937108687 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558c9f625350 0x558c9f627770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:10:54.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.755+0000 7f1065d9b640 1 --2- 172.21.15.47:0/2937108687 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558c9f625350 0x558c9f627770 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37f1c61e64459d00 server_cookie=dcdf91413ff7f47c in_seq=0 out_seq=0 2024-07-24T22:10:54.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:54.755+0000 7f104dffb640 10 client.25691 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.536+0000 7f104dffb640 1 -- 172.21.15.47:0/2937108687 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558c9f511060 con 0x558c9f625350 2024-07-24T22:10:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.536+0000 7f104dffb640 10 client.25691 handle_command_reply: tid=0 2024-07-24T22:10:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.536+0000 7f106ebbf740 1 client.25691 shutdown 2024-07-24T22:10:55.539 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:55 smithi047 ceph-mon[32551]: pgmap v477: 97 pgs: 97 active+clean; 29 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 485 MiB/s wr, 1.09k op/s 2024-07-24T22:10:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.536+0000 7f106ebbf740 1 -- 172.21.15.47:0/2937108687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f59d770 msgr2=0x558c9f5b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.536+0000 7f106ebbf740 1 --2- 172.21.15.47:0/2937108687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f59d770 0x558c9f5b18e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10600e2240 tx=0x7f10600b4070 comp rx=0 tx=0).stop 2024-07-24T22:10:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.537+0000 7f106ebbf740 1 -- 172.21.15.47:0/2937108687 shutdown_connections 2024-07-24T22:10:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.537+0000 7f106ebbf740 1 --2- 172.21.15.47:0/2937108687 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558c9f625350 0x558c9f627770 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.537+0000 7f106ebbf740 1 --2- 172.21.15.47:0/2937108687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c9f5a95a0 0x558c9f5ac6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.537+0000 7f106ebbf740 1 --2- 172.21.15.47:0/2937108687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558c9f59ecd0 0x558c9f5b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.537+0000 7f106ebbf740 1 --2- 172.21.15.47:0/2937108687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558c9f59d770 0x558c9f5b18e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.537+0000 7f104dffb640 0 client.25691 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:10:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.537+0000 7f106ebbf740 1 -- 172.21.15.47:0/2937108687 >> 172.21.15.47:0/2937108687 conn(0x558c9f567720 msgr2=0x558c9f59a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.537+0000 7f106ebbf740 1 -- 172.21.15.47:0/2937108687 shutdown_connections 2024-07-24T22:10:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.537+0000 7f106ebbf740 1 -- 172.21.15.47:0/2937108687 wait complete. 2024-07-24T22:10:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.537+0000 7f106ebbf740 20 client.25691 trim_cache size 0 max 16384 2024-07-24T22:10:55.541 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:10:55.541 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:10:55.541 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:10:55.541 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 14, 2024-07-24T22:10:55.541 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:10:55.541 INFO:teuthology.orchestra.run.smithi047.stdout: "e791e86c": { 2024-07-24T22:10:55.541 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 14, 2024-07-24T22:10:55.541 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:10:55.542 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:10:55.542 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:10:55.542 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:10:55.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:10:55.542 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:10:55.542 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 150.0, 2024-07-24T22:10:55.542 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:10:55.542 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:10:55.542 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:10:55.542 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:10:55.542 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:10:55.542 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:10:55.542 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:55.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:55.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:55.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:55.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:10:55.543 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:10:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.538+0000 7f106c80e640 1 -- 172.21.15.47:0/15436799 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f10540b3d40 msgr2=0x7f10540b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.538+0000 7f106c80e640 1 --2- 172.21.15.47:0/15436799 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f10540b3d40 0x7f10540b6200 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1058006010 tx=0x7f10580058d0 comp rx=0 tx=0).stop 2024-07-24T22:10:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.538+0000 7f106c80e640 1 -- 172.21.15.47:0/15436799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1068101670 msgr2=0x7f1068198c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:10:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.538+0000 7f106c80e640 1 --2- 172.21.15.47:0/15436799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1068101670 0x7f1068198c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f106000e9f0 tx=0x7f106000eeb0 comp rx=0 tx=0).stop 2024-07-24T22:10:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.538+0000 7f106c80e640 1 -- 172.21.15.47:0/15436799 shutdown_connections 2024-07-24T22:10:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.538+0000 7f106c80e640 1 --2- 172.21.15.47:0/15436799 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f10540b3d40 0x7f10540b6200 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.538+0000 7f106c80e640 1 --2- 172.21.15.47:0/15436799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1068107a00 0x7f106819e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.538+0000 7f106c80e640 1 --2- 172.21.15.47:0/15436799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1068107080 0x7f10681991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.538+0000 7f106c80e640 1 --2- 172.21.15.47:0/15436799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1068101670 0x7f1068198c90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:10:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.538+0000 7f106c80e640 1 -- 172.21.15.47:0/15436799 >> 172.21.15.47:0/15436799 conn(0x7f10680fd120 msgr2=0x7f10680ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:10:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.538+0000 7f106c80e640 1 -- 172.21.15.47:0/15436799 shutdown_connections 2024-07-24T22:10:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:10:55.538+0000 7f106c80e640 1 -- 172.21.15.47:0/15436799 wait complete. 2024-07-24T22:10:55.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:55 smithi188 ceph-mon[37380]: pgmap v477: 97 pgs: 97 active+clean; 29 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 485 MiB/s wr, 1.09k op/s 2024-07-24T22:10:55.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:55 smithi183 ceph-mon[37007]: pgmap v477: 97 pgs: 97 active+clean; 29 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 485 MiB/s wr, 1.09k op/s 2024-07-24T22:10:56.458 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e791e86c', quiesce took 10.9 seconds. Will release after: 19.1 2024-07-24T22:10:57.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:57 smithi188 ceph-mon[37380]: pgmap v478: 97 pgs: 97 active+clean; 29 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 538 MiB/s wr, 1.16k op/s 2024-07-24T22:10:57.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:57 smithi183 ceph-mon[37007]: pgmap v478: 97 pgs: 97 active+clean; 29 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 538 MiB/s wr, 1.16k op/s 2024-07-24T22:10:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:57 smithi047 ceph-mon[32551]: pgmap v478: 97 pgs: 97 active+clean; 29 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 538 MiB/s wr, 1.16k op/s 2024-07-24T22:10:58.819 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:10:59.100 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:10:59.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:10:59 smithi047 ceph-mon[32551]: pgmap v479: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 582 MiB/s wr, 1.19k op/s 2024-07-24T22:10:59.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:10:59 smithi188 ceph-mon[37380]: pgmap v479: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 582 MiB/s wr, 1.19k op/s 2024-07-24T22:10:59.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:10:59 smithi183 ceph-mon[37007]: pgmap v479: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 582 MiB/s wr, 1.19k op/s 2024-07-24T22:11:01.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.053+0000 7f2e22074640 1 -- 172.21.15.47:0/88121959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e1c103660 msgr2=0x7f2e1c103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.053+0000 7f2e22074640 1 --2- 172.21.15.47:0/88121959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e1c103660 0x7f2e1c103a40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009900 tx=0x7f2e0c02a440 comp rx=0 tx=0).stop 2024-07-24T22:11:01.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.053+0000 7f2e22074640 1 -- 172.21.15.47:0/88121959 shutdown_connections 2024-07-24T22:11:01.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.053+0000 7f2e22074640 1 --2- 172.21.15.47:0/88121959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e1c10cac0 0x7f2e1c10ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.053+0000 7f2e22074640 1 --2- 172.21.15.47:0/88121959 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e1c103f80 0x7f2e1c10c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.053+0000 7f2e22074640 1 --2- 172.21.15.47:0/88121959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e1c103660 0x7f2e1c103a40 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.053+0000 7f2e22074640 1 -- 172.21.15.47:0/88121959 >> 172.21.15.47:0/88121959 conn(0x7f2e1c0fd0c0 msgr2=0x7f2e1c0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:01.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.053+0000 7f2e22074640 1 -- 172.21.15.47:0/88121959 shutdown_connections 2024-07-24T22:11:01.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.053+0000 7f2e22074640 1 -- 172.21.15.47:0/88121959 wait complete. 2024-07-24T22:11:01.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.054+0000 7f2e22074640 1 Processor -- start 2024-07-24T22:11:01.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.054+0000 7f2e22074640 1 -- start start 2024-07-24T22:11:01.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.054+0000 7f2e22074640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e1c103660 0x7f2e1c198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.054+0000 7f2e22074640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e1c103f80 0x7f2e1c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.054+0000 7f2e22074640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e1c10cac0 0x7f2e1c19e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.054+0000 7f2e22074640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c112830 con 0x7f2e1c103660 2024-07-24T22:11:01.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.054+0000 7f2e22074640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1126b0 con 0x7f2e1c103f80 2024-07-24T22:11:01.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.054+0000 7f2e22074640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1129b0 con 0x7f2e1c10cac0 2024-07-24T22:11:01.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.054+0000 7f2e1b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e1c103660 0x7f2e1c198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.054+0000 7f2e1b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e1c103660 0x7f2e1c198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60366/0 (socket says 172.21.15.47:60366) 2024-07-24T22:11:01.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.054+0000 7f2e1b7fe640 1 -- 172.21.15.47:0/3530845369 learned_addr learned my addr 172.21.15.47:0/3530845369 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:01.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.055+0000 7f2e1b7fe640 1 -- 172.21.15.47:0/3530845369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e1c10cac0 msgr2=0x7f2e1c19e700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:11:01.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.055+0000 7f2e1b7fe640 1 --2- 172.21.15.47:0/3530845369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e1c10cac0 0x7f2e1c19e700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.055+0000 7f2e1b7fe640 1 -- 172.21.15.47:0/3530845369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e1c103f80 msgr2=0x7f2e1c199360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T22:11:01.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.055+0000 7f2e1b7fe640 1 --2- 172.21.15.47:0/3530845369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e1c103f80 0x7f2e1c199360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.055+0000 7f2e1b7fe640 1 -- 172.21.15.47:0/3530845369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1c19eed0 con 0x7f2e1c103660 2024-07-24T22:11:01.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.055+0000 7f2e1b7fe640 1 --2- 172.21.15.47:0/3530845369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e1c103660 0x7f2e1c198e20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c005940 tx=0x7f2e0c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:01.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.055+0000 7f2e197fa640 1 -- 172.21.15.47:0/3530845369 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c03f030 con 0x7f2e1c103660 2024-07-24T22:11:01.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.055+0000 7f2e22074640 1 -- 172.21.15.47:0/3530845369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1c19f160 con 0x7f2e1c103660 2024-07-24T22:11:01.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.055+0000 7f2e197fa640 1 -- 172.21.15.47:0/3530845369 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e0c003aa0 con 0x7f2e1c103660 2024-07-24T22:11:01.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.055+0000 7f2e197fa640 1 -- 172.21.15.47:0/3530845369 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c035070 con 0x7f2e1c103660 2024-07-24T22:11:01.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.056+0000 7f2e22074640 1 -- 172.21.15.47:0/3530845369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e1c1a5880 con 0x7f2e1c103660 2024-07-24T22:11:01.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.060+0000 7f2e24425740 1 Processor -- start 2024-07-24T22:11:01.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.060+0000 7f2e24425740 1 -- start start 2024-07-24T22:11:01.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.061+0000 7f2e24425740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 0x56152adb7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.061+0000 7f2e24425740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adc3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.061+0000 7f2e24425740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 0x56152adc6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.061+0000 7f2e24425740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56152ad2e990 con 0x56152adb7fd0 2024-07-24T22:11:01.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.061+0000 7f2e24425740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56152ad1de90 con 0x56152adc3f60 2024-07-24T22:11:01.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.061+0000 7f2e24425740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56152ad21ed0 con 0x56152adb76b0 2024-07-24T22:11:01.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.061+0000 7f2e1b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adc3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.061+0000 7f2e1b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adc3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60382/0 (socket says 172.21.15.47:60382) 2024-07-24T22:11:01.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.061+0000 7f2e1b7fe640 1 -- 172.21.15.47:0/332555491 learned_addr learned my addr 172.21.15.47:0/332555491 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:01.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.061+0000 7f2e197fa640 1 -- 172.21.15.47:0/3530845369 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f2e0c042030 con 0x7f2e1c103660 2024-07-24T22:11:01.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.062+0000 7f2e1b7fe640 1 -- 172.21.15.47:0/332555491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 msgr2=0x56152adb7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.062+0000 7f2e1b7fe640 1 --2- 172.21.15.47:0/332555491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 0x56152adb7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.062+0000 7f2e1b7fe640 1 -- 172.21.15.47:0/332555491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 msgr2=0x56152adc6350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:11:01.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.062+0000 7f2e1b7fe640 1 --2- 172.21.15.47:0/332555491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 0x56152adc6350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.062+0000 7f2e1b7fe640 1 -- 172.21.15.47:0/332555491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56152aca7300 con 0x56152adb7fd0 2024-07-24T22:11:01.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.062+0000 7f2e1b7fe640 1 --2- 172.21.15.47:0/332555491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adc3a20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c101d70 tx=0x7f2e0c10ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7487c171299d06 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:01.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.062+0000 7f2e11ffb640 1 -- 172.21.15.47:0/332555491 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c10cd10 con 0x56152adb7fd0 2024-07-24T22:11:01.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.062+0000 7f2e11ffb640 1 -- 172.21.15.47:0/332555491 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e0c1168b0 con 0x56152adb7fd0 2024-07-24T22:11:01.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.063+0000 7f2e197fa640 1 --2- 172.21.15.47:0/3530845369 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2e080b3dc0 0x7f2e080b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.063+0000 7f2e1bfff640 1 --2- 172.21.15.47:0/3530845369 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2e080b3dc0 0x7f2e080b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.063+0000 7f2e197fa640 1 -- 172.21.15.47:0/3530845369 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f2e0c104740 con 0x7f2e1c103660 2024-07-24T22:11:01.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.063+0000 7f2e11ffb640 1 -- 172.21.15.47:0/332555491 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c10e800 con 0x56152adb7fd0 2024-07-24T22:11:01.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.064+0000 7f2e24425740 1 -- 172.21.15.47:0/332555491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 msgr2=0x56152adc3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.064+0000 7f2e24425740 1 --2- 172.21.15.47:0/332555491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adc3a20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c101d70 tx=0x7f2e0c10ad30 comp rx=0 tx=0).stop 2024-07-24T22:11:01.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.064+0000 7f2e24425740 1 -- 172.21.15.47:0/332555491 shutdown_connections 2024-07-24T22:11:01.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.064+0000 7f2e24425740 1 --2- 172.21.15.47:0/332555491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 0x56152adc6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.064+0000 7f2e24425740 1 --2- 172.21.15.47:0/332555491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adc3a20 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.064+0000 7f2e24425740 1 --2- 172.21.15.47:0/332555491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 0x56152adb7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.064+0000 7f2e24425740 1 -- 172.21.15.47:0/332555491 >> 172.21.15.47:0/332555491 conn(0x56152adb54e0 msgr2=0x56152adb6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:01.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.065+0000 7f2e1bfff640 1 --2- 172.21.15.47:0/3530845369 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2e080b3dc0 0x7f2e080b6280 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400aab0 tx=0x7f2e14009250 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:01.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.065+0000 7f2e24425740 1 -- 172.21.15.47:0/332555491 shutdown_connections 2024-07-24T22:11:01.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.065+0000 7f2e24425740 1 -- 172.21.15.47:0/332555491 wait complete. 2024-07-24T22:11:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.066+0000 7f2e24425740 1 -- start start 2024-07-24T22:11:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.066+0000 7f2e24425740 1 Processor -- start 2024-07-24T22:11:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.067+0000 7f2e24425740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 0x56152adc0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.067+0000 7f2e24425740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adc1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.067+0000 7f2e24425740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 0x56152adc1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.067+0000 7f2e24425740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56152ab81700 con 0x56152adb7fd0 2024-07-24T22:11:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.067+0000 7f2e24425740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56152acc05d0 con 0x56152adc3f60 2024-07-24T22:11:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.067+0000 7f2e24425740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56152adcadb0 con 0x56152adb76b0 2024-07-24T22:11:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.067+0000 7f2e24425740 10 client.0 _ll_register_callbacks cb 0x56152ace0940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.067+0000 7f2e13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adc1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.067+0000 7f2e13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adc1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60388/0 (socket says 172.21.15.47:60388) 2024-07-24T22:11:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.067+0000 7f2e13fff640 1 -- 172.21.15.47:0/315155814 learned_addr learned my addr 172.21.15.47:0/315155814 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:01.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.068+0000 7f2e13fff640 1 -- 172.21.15.47:0/315155814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 msgr2=0x56152adc0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.068+0000 7f2e13fff640 1 --2- 172.21.15.47:0/315155814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 0x56152adc0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.068+0000 7f2e13fff640 1 -- 172.21.15.47:0/315155814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 msgr2=0x56152adc1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.068+0000 7f2e13fff640 1 --2- 172.21.15.47:0/315155814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 0x56152adc1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.068+0000 7f2e13fff640 1 -- 172.21.15.47:0/315155814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56152acb3660 con 0x56152adb7fd0 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.068+0000 7f2dfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.068+0000 7f2e13fff640 1 --2- 172.21.15.47:0/315155814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adc1400 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2e04009dc0 tx=0x7f2e0400b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f1e7811766b515 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.069+0000 7f2dfaffd640 1 -- 172.21.15.47:0/315155814 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e04015020 con 0x56152adb7fd0 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.069+0000 7f2e24425740 1 -- 172.21.15.47:0/315155814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e0c1168b0 con 0x56152adb7fd0 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.069+0000 7f2dfaffd640 1 -- 172.21.15.47:0/315155814 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f2e0400bdd0 con 0x56152adb7fd0 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.069+0000 7f2dfaffd640 1 -- 172.21.15.47:0/315155814 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2e04015020 con 0x56152adb7fd0 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.069+0000 7f2e24425740 10 client.16305 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.069+0000 7f2e24425740 1 -- 172.21.15.47:0/315155814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56152aa7e650 con 0x56152adb7fd0 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.070+0000 7f2dfaffd640 1 -- 172.21.15.47:0/315155814 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e0c1168b0 con 0x56152adb7fd0 2024-07-24T22:11:01.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.070+0000 7f2dfaffd640 1 -- 172.21.15.47:0/315155814 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2e04022020 con 0x56152adb7fd0 2024-07-24T22:11:01.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.070+0000 7f2e24425740 10 client.16305 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:01.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.070+0000 7f2e24425740 10 client.16305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:01.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.070+0000 7f2e24425740 20 client.16305 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:01.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.070+0000 7f2e24425740 1 --2- 172.21.15.47:0/315155814 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56152add7ff0 0x56152adda490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.070+0000 7f2e24425740 4 client.16305 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:11:01.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.070+0000 7f2e24425740 1 -- 172.21.15.47:0/315155814 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56152ad308e0 con 0x56152add7ff0 2024-07-24T22:11:01.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.072+0000 7f2e1b7fe640 1 --2- 172.21.15.47:0/315155814 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56152add7ff0 0x56152adda490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.080+0000 7f2e1b7fe640 1 --2- 172.21.15.47:0/315155814 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56152add7ff0 0x56152adda490 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5831f4ba0ead4cd4 server_cookie=1f67a19c1ba82e9b in_seq=0 out_seq=0 2024-07-24T22:11:01.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.080+0000 7f2dfaffd640 10 client.16305 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:01.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.083+0000 7f2dfaffd640 1 -- 172.21.15.47:0/315155814 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56152ad308e0 con 0x56152add7ff0 2024-07-24T22:11:01.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.083+0000 7f2dfaffd640 10 client.16305 handle_command_reply: tid=0 2024-07-24T22:11:01.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.083+0000 7f2e24425740 1 client.16305 shutdown 2024-07-24T22:11:01.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.083+0000 7f2e24425740 1 -- 172.21.15.47:0/315155814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 msgr2=0x56152adc1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.083+0000 7f2e24425740 1 --2- 172.21.15.47:0/315155814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adc1400 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2e04009dc0 tx=0x7f2e0400b4b0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.084+0000 7f2e24425740 1 -- 172.21.15.47:0/315155814 shutdown_connections 2024-07-24T22:11:01.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.084+0000 7f2e24425740 1 --2- 172.21.15.47:0/315155814 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56152add7ff0 0x56152adda490 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.084+0000 7f2dfaffd640 0 client.16305 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:01.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.084+0000 7f2e24425740 1 --2- 172.21.15.47:0/315155814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 0x56152adc1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.084+0000 7f2e24425740 1 --2- 172.21.15.47:0/315155814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adc1400 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.084+0000 7f2e24425740 1 --2- 172.21.15.47:0/315155814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 0x56152adc0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.084+0000 7f2e24425740 1 -- 172.21.15.47:0/315155814 >> 172.21.15.47:0/315155814 conn(0x56152adb54e0 msgr2=0x56152adbb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:01.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.084+0000 7f2e24425740 1 -- 172.21.15.47:0/315155814 shutdown_connections 2024-07-24T22:11:01.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.085+0000 7f2e24425740 1 -- 172.21.15.47:0/315155814 wait complete. 2024-07-24T22:11:01.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.085+0000 7f2e24425740 20 client.16305 trim_cache size 0 max 16384 2024-07-24T22:11:01.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.114+0000 7f2e24425740 1 Processor -- start 2024-07-24T22:11:01.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.114+0000 7f2e24425740 1 -- start start 2024-07-24T22:11:01.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.115+0000 7f2e24425740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adb76b0 0x56152adc2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.115+0000 7f2e24425740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb7fd0 0x56152addfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.115+0000 7f2e24425740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adc3f60 0x56152ade02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.115+0000 7f2e24425740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1aa2e0 con 0x56152adc3f60 2024-07-24T22:11:01.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.115+0000 7f2e24425740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1acbc0 con 0x56152adb76b0 2024-07-24T22:11:01.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.115+0000 7f2e24425740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1aa9b0 con 0x56152adb7fd0 2024-07-24T22:11:01.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.115+0000 7f2e1bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adc3f60 0x56152ade02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.115+0000 7f2e1bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adc3f60 0x56152ade02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60400/0 (socket says 172.21.15.47:60400) 2024-07-24T22:11:01.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.115+0000 7f2e1bfff640 1 -- 172.21.15.47:0/3486445379 learned_addr learned my addr 172.21.15.47:0/3486445379 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:01.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.115+0000 7f2e1b7fe640 1 --2- 172.21.15.47:0/3486445379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adb76b0 0x56152adc2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.115+0000 7f2e1bfff640 1 -- 172.21.15.47:0/3486445379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb7fd0 msgr2=0x56152addfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.115+0000 7f2e1bfff640 1 --2- 172.21.15.47:0/3486445379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb7fd0 0x56152addfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.116+0000 7f2e1bfff640 1 -- 172.21.15.47:0/3486445379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adb76b0 msgr2=0x56152adc2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.116+0000 7f2e1bfff640 1 --2- 172.21.15.47:0/3486445379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adb76b0 0x56152adc2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.116+0000 7f2e1bfff640 1 -- 172.21.15.47:0/3486445379 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56152adbf3c0 con 0x56152adc3f60 2024-07-24T22:11:01.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.116+0000 7f2e1bfff640 1 --2- 172.21.15.47:0/3486445379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adc3f60 0x56152ade02e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2e14004aa0 tx=0x7f2e1400f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef05f27722cec2b6 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:01.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.116+0000 7f2e117fa640 1 -- 172.21.15.47:0/3486445379 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1401a830 con 0x56152adc3f60 2024-07-24T22:11:01.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.116+0000 7f2e117fa640 1 -- 172.21.15.47:0/3486445379 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e14022400 con 0x56152adc3f60 2024-07-24T22:11:01.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.116+0000 7f2e117fa640 1 -- 172.21.15.47:0/3486445379 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14018610 con 0x56152adc3f60 2024-07-24T22:11:01.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.117+0000 7f2e24425740 1 -- 172.21.15.47:0/3486445379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adc3f60 msgr2=0x56152ade02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.117+0000 7f2e24425740 1 --2- 172.21.15.47:0/3486445379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adc3f60 0x56152ade02e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2e14004aa0 tx=0x7f2e1400f070 comp rx=0 tx=0).stop 2024-07-24T22:11:01.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.117+0000 7f2e24425740 1 -- 172.21.15.47:0/3486445379 shutdown_connections 2024-07-24T22:11:01.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.117+0000 7f2e24425740 1 --2- 172.21.15.47:0/3486445379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adc3f60 0x56152ade02e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.117+0000 7f2e24425740 1 --2- 172.21.15.47:0/3486445379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb7fd0 0x56152addfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.117+0000 7f2e24425740 1 --2- 172.21.15.47:0/3486445379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adb76b0 0x56152adc2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.117+0000 7f2e24425740 1 -- 172.21.15.47:0/3486445379 >> 172.21.15.47:0/3486445379 conn(0x56152adb54e0 msgr2=0x56152adc24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:01.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.118+0000 7f2e24425740 1 -- 172.21.15.47:0/3486445379 shutdown_connections 2024-07-24T22:11:01.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.118+0000 7f2e24425740 1 -- 172.21.15.47:0/3486445379 wait complete. 2024-07-24T22:11:01.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.118+0000 7f2e24425740 1 -- start start 2024-07-24T22:11:01.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.119+0000 7f2e24425740 1 Processor -- start 2024-07-24T22:11:01.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.119+0000 7f2e24425740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 0x56152add03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.119+0000 7f2e24425740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adcb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.119+0000 7f2e24425740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 0x56152adcbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.120+0000 7f2e24425740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1ab080 con 0x56152adb7fd0 2024-07-24T22:11:01.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.120+0000 7f2e24425740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1ac4f0 con 0x56152adc3f60 2024-07-24T22:11:01.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.120+0000 7f2e24425740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c1ab750 con 0x56152adb76b0 2024-07-24T22:11:01.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.120+0000 7f2e1b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 0x56152add03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.120+0000 7f2e1b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 0x56152add03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:36532/0 (socket says 172.21.15.47:36532) 2024-07-24T22:11:01.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.120+0000 7f2e1b7fe640 1 -- 172.21.15.47:0/2965777578 learned_addr learned my addr 172.21.15.47:0/2965777578 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:01.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.120+0000 7f2e1bfff640 1 --2- 172.21.15.47:0/2965777578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 0x56152adcbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.120+0000 7f2e24425740 10 client.0 _ll_register_callbacks cb 0x7f2e1c06b4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:01.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.120+0000 7f2e13fff640 1 --2- 172.21.15.47:0/2965777578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adcb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.121+0000 7f2e1bfff640 1 -- 172.21.15.47:0/2965777578 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 msgr2=0x56152add03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.121+0000 7f2e1bfff640 1 --2- 172.21.15.47:0/2965777578 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 0x56152add03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.121+0000 7f2e1bfff640 1 -- 172.21.15.47:0/2965777578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 msgr2=0x56152adcb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.121+0000 7f2e1bfff640 1 --2- 172.21.15.47:0/2965777578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adcb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.121+0000 7f2e1bfff640 1 -- 172.21.15.47:0/2965777578 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56152adcc340 con 0x56152adc3f60 2024-07-24T22:11:01.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.121+0000 7f2e1bfff640 1 --2- 172.21.15.47:0/2965777578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 0x56152adcbdd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e14021000 tx=0x7f2e1400cdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc0f2a389f01342a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:01.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.121+0000 7f2dfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:11:01.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.122+0000 7f2dfaffd640 1 -- 172.21.15.47:0/2965777578 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14027070 con 0x56152adc3f60 2024-07-24T22:11:01.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.122+0000 7f2dfaffd640 1 -- 172.21.15.47:0/2965777578 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f2e1401aa40 con 0x56152adc3f60 2024-07-24T22:11:01.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.122+0000 7f2e24425740 1 -- 172.21.15.47:0/2965777578 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e14022400 con 0x56152adc3f60 2024-07-24T22:11:01.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.122+0000 7f2dfaffd640 1 -- 172.21.15.47:0/2965777578 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2e1401ac40 con 0x56152adc3f60 2024-07-24T22:11:01.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.123+0000 7f2e24425740 10 client.25697 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:01.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.123+0000 7f2e24425740 1 -- 172.21.15.47:0/2965777578 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56152ae42ae0 con 0x56152adc3f60 2024-07-24T22:11:01.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.123+0000 7f2dfaffd640 1 -- 172.21.15.47:0/2965777578 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e14022400 con 0x56152adc3f60 2024-07-24T22:11:01.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.123+0000 7f2dfaffd640 1 -- 172.21.15.47:0/2965777578 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2e140363d0 con 0x56152adc3f60 2024-07-24T22:11:01.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.123+0000 7f2e24425740 10 client.25697 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:01.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.124+0000 7f2e24425740 10 client.25697 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:01.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.124+0000 7f2e24425740 20 client.25697 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:01.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.124+0000 7f2e24425740 1 --2- 172.21.15.47:0/2965777578 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56152ae43060 0x56152ae45480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.124+0000 7f2e24425740 4 client.25697 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:11:01.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.124+0000 7f2e24425740 1 -- 172.21.15.47:0/2965777578 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56152ad2c380 con 0x56152ae43060 2024-07-24T22:11:01.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.125+0000 7f2e1b7fe640 1 --2- 172.21.15.47:0/2965777578 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56152ae43060 0x56152ae45480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.126+0000 7f2dfaffd640 10 client.25697 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:01.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.126+0000 7f2e1b7fe640 1 --2- 172.21.15.47:0/2965777578 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56152ae43060 0x56152ae45480 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5336cf3699e22535 server_cookie=faef8d3f9e8a6809 in_seq=0 out_seq=0 2024-07-24T22:11:01.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.127+0000 7f2dfaffd640 1 -- 172.21.15.47:0/2965777578 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56152ad2c380 con 0x56152ae43060 2024-07-24T22:11:01.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.127+0000 7f2dfaffd640 10 client.25697 handle_command_reply: tid=0 2024-07-24T22:11:01.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.127+0000 7f2e24425740 1 client.25697 shutdown 2024-07-24T22:11:01.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.128+0000 7f2e24425740 1 -- 172.21.15.47:0/2965777578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 msgr2=0x56152adcbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.128+0000 7f2e24425740 1 --2- 172.21.15.47:0/2965777578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 0x56152adcbdd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e14021000 tx=0x7f2e1400cdd0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.128+0000 7f2e24425740 1 -- 172.21.15.47:0/2965777578 shutdown_connections 2024-07-24T22:11:01.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.128+0000 7f2e24425740 1 --2- 172.21.15.47:0/2965777578 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56152ae43060 0x56152ae45480 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.128+0000 7f2dfaffd640 0 client.25697 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:01.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.128+0000 7f2e24425740 1 --2- 172.21.15.47:0/2965777578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56152adc3f60 0x56152adcbdd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.128+0000 7f2e24425740 1 --2- 172.21.15.47:0/2965777578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adb7fd0 0x56152adcb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.128+0000 7f2e24425740 1 --2- 172.21.15.47:0/2965777578 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56152adb76b0 0x56152add03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.128+0000 7f2e24425740 1 -- 172.21.15.47:0/2965777578 >> 172.21.15.47:0/2965777578 conn(0x56152adb54e0 msgr2=0x56152adc2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:01.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.128+0000 7f2e24425740 1 -- 172.21.15.47:0/2965777578 shutdown_connections 2024-07-24T22:11:01.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.129+0000 7f2e24425740 1 -- 172.21.15.47:0/2965777578 wait complete. 2024-07-24T22:11:01.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.129+0000 7f2e24425740 20 client.25697 trim_cache size 0 max 16384 2024-07-24T22:11:01.132 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:11:01.132 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:11:01.132 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:11:01.132 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:11:01.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.130+0000 7f2e22074640 1 -- 172.21.15.47:0/3530845369 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2e080b3dc0 msgr2=0x7f2e080b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.130+0000 7f2e22074640 1 --2- 172.21.15.47:0/3530845369 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2e080b3dc0 0x7f2e080b6280 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400aab0 tx=0x7f2e14009250 comp rx=0 tx=0).stop 2024-07-24T22:11:01.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.130+0000 7f2e22074640 1 -- 172.21.15.47:0/3530845369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e1c103660 msgr2=0x7f2e1c198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.130+0000 7f2e22074640 1 --2- 172.21.15.47:0/3530845369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e1c103660 0x7f2e1c198e20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c005940 tx=0x7f2e0c004270 comp rx=0 tx=0).stop 2024-07-24T22:11:01.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.130+0000 7f2e22074640 1 -- 172.21.15.47:0/3530845369 shutdown_connections 2024-07-24T22:11:01.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.130+0000 7f2e22074640 1 --2- 172.21.15.47:0/3530845369 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2e080b3dc0 0x7f2e080b6280 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.130+0000 7f2e22074640 1 --2- 172.21.15.47:0/3530845369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e1c10cac0 0x7f2e1c19e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.130+0000 7f2e22074640 1 --2- 172.21.15.47:0/3530845369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e1c103f80 0x7f2e1c199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.130+0000 7f2e22074640 1 --2- 172.21.15.47:0/3530845369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e1c103660 0x7f2e1c198e20 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.130+0000 7f2e22074640 1 -- 172.21.15.47:0/3530845369 >> 172.21.15.47:0/3530845369 conn(0x7f2e1c0fd0c0 msgr2=0x7f2e1c0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:01.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.130+0000 7f2e22074640 1 -- 172.21.15.47:0/3530845369 shutdown_connections 2024-07-24T22:11:01.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:01.130+0000 7f2e22074640 1 -- 172.21.15.47:0/3530845369 wait complete. 2024-07-24T22:11:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.182+0000 7f99375b0640 1 -- 172.21.15.47:0/2477391998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f993010c9f0 msgr2=0x7f993010ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.182+0000 7f99375b0640 1 --2- 172.21.15.47:0/2477391998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f993010c9f0 0x7f993010ee70 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9928009ca0 tx=0x7f992802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.182+0000 7f99375b0640 1 -- 172.21.15.47:0/2477391998 shutdown_connections 2024-07-24T22:11:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.182+0000 7f99375b0640 1 --2- 172.21.15.47:0/2477391998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f993010c9f0 0x7f993010ee70 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.182+0000 7f99375b0640 1 --2- 172.21.15.47:0/2477391998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9930103ef0 0x7f993010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.182+0000 7f99375b0640 1 --2- 172.21.15.47:0/2477391998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99301035d0 0x7f99301039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.182+0000 7f99375b0640 1 -- 172.21.15.47:0/2477391998 >> 172.21.15.47:0/2477391998 conn(0x7f99300782e0 msgr2=0x7f99300ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.182+0000 7f99375b0640 1 -- 172.21.15.47:0/2477391998 shutdown_connections 2024-07-24T22:11:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.182+0000 7f99375b0640 1 -- 172.21.15.47:0/2477391998 wait complete. 2024-07-24T22:11:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.183+0000 7f99375b0640 1 Processor -- start 2024-07-24T22:11:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.183+0000 7f99375b0640 1 -- start start 2024-07-24T22:11:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.183+0000 7f99375b0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99301035d0 0x7f9930101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.183+0000 7f99375b0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9930103ef0 0x7f99301017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.183+0000 7f99375b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f993010c9f0 0x7f9930101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f99375b0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9930112670 con 0x7f9930103ef0 2024-07-24T22:11:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f99375b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f99301124f0 con 0x7f993010c9f0 2024-07-24T22:11:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f99375b0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f99301127f0 con 0x7f99301035d0 2024-07-24T22:11:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f9934b4b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9930103ef0 0x7f99301017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f993534c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99301035d0 0x7f9930101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f9934b4b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9930103ef0 0x7f99301017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60424/0 (socket says 172.21.15.47:60424) 2024-07-24T22:11:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f9934b4b640 1 -- 172.21.15.47:0/635942689 learned_addr learned my addr 172.21.15.47:0/635942689 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f9935b4d640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f993010c9f0 0x7f9930101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f9934b4b640 1 -- 172.21.15.47:0/635942689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99301035d0 msgr2=0x7f9930101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f9934b4b640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99301035d0 0x7f9930101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f9934b4b640 1 -- 172.21.15.47:0/635942689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f993010c9f0 msgr2=0x7f9930101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f9934b4b640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f993010c9f0 0x7f9930101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f9934b4b640 1 -- 172.21.15.47:0/635942689 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99301a6fa0 con 0x7f9930103ef0 2024-07-24T22:11:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f993534c640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99301035d0 0x7f9930101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:11:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f9934b4b640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9930103ef0 0x7f99301017b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f992000e9c0 tx=0x7f992000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f99267fc640 1 -- 172.21.15.47:0/635942689 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992000cd80 con 0x7f9930103ef0 2024-07-24T22:11:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f99267fc640 1 -- 172.21.15.47:0/635942689 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99200035f0 con 0x7f9930103ef0 2024-07-24T22:11:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f99375b0640 1 -- 172.21.15.47:0/635942689 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99301a7290 con 0x7f9930103ef0 2024-07-24T22:11:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f99267fc640 1 -- 172.21.15.47:0/635942689 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9920010690 con 0x7f9930103ef0 2024-07-24T22:11:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.184+0000 7f99375b0640 1 -- 172.21.15.47:0/635942689 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99301a7830 con 0x7f9930103ef0 2024-07-24T22:11:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.187+0000 7f99267fc640 1 -- 172.21.15.47:0/635942689 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f99200037a0 con 0x7f9930103ef0 2024-07-24T22:11:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.188+0000 7f993a3e1740 1 Processor -- start 2024-07-24T22:11:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.188+0000 7f993a3e1740 1 -- start start 2024-07-24T22:11:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.188+0000 7f993a3e1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a81c90 0x562654a82070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.188+0000 7f993a3e1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a825b0 0x562654a8e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.188+0000 7f993a3e1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a8e540 0x562654a90930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.188+0000 7f993a3e1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5626549f7280 con 0x562654a825b0 2024-07-24T22:11:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.188+0000 7f993a3e1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5626549e6780 con 0x562654a8e540 2024-07-24T22:11:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.188+0000 7f993a3e1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5626549ea7c0 con 0x562654a81c90 2024-07-24T22:11:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.188+0000 7f993534c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a825b0 0x562654a8e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.188+0000 7f993534c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a825b0 0x562654a8e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60428/0 (socket says 172.21.15.47:60428) 2024-07-24T22:11:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.188+0000 7f9934b4b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a8e540 0x562654a90930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.188+0000 7f993534c640 1 -- 172.21.15.47:0/1490021715 learned_addr learned my addr 172.21.15.47:0/1490021715 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.188+0000 7f9935b4d640 1 --2- 172.21.15.47:0/1490021715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a81c90 0x562654a82070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f99267fc640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f991c0b3dc0 0x7f991c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f993534c640 1 -- 172.21.15.47:0/1490021715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a81c90 msgr2=0x562654a82070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f993534c640 1 --2- 172.21.15.47:0/1490021715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a81c90 0x562654a82070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f993534c640 1 -- 172.21.15.47:0/1490021715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a8e540 msgr2=0x562654a90930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f993534c640 1 --2- 172.21.15.47:0/1490021715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a8e540 0x562654a90930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f993534c640 1 -- 172.21.15.47:0/1490021715 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56265474a790 con 0x562654a825b0 2024-07-24T22:11:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f9935b4d640 1 --2- 172.21.15.47:0/1490021715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a81c90 0x562654a82070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:11:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f9934b4b640 1 --2- 172.21.15.47:0/1490021715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a8e540 0x562654a90930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:11:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f9935b4d640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f991c0b3dc0 0x7f991c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f99267fc640 1 -- 172.21.15.47:0/635942689 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f99200e43f0 con 0x7f9930103ef0 2024-07-24T22:11:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f993534c640 1 --2- 172.21.15.47:0/1490021715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a825b0 0x562654a8e000 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f992c0115c0 tx=0x7f992c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bf0461fe7830eb server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f991b7fe640 1 -- 172.21.15.47:0/1490021715 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c00f640 con 0x562654a825b0 2024-07-24T22:11:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f991b7fe640 1 -- 172.21.15.47:0/1490021715 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f992c00fc90 con 0x562654a825b0 2024-07-24T22:11:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.189+0000 7f991b7fe640 1 -- 172.21.15.47:0/1490021715 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c019ce0 con 0x562654a825b0 2024-07-24T22:11:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.190+0000 7f993a3e1740 1 -- 172.21.15.47:0/1490021715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a825b0 msgr2=0x562654a8e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.190+0000 7f9935b4d640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f991c0b3dc0 0x7f991c0b6280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f992802f4c0 tx=0x7f99280095c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.190+0000 7f993a3e1740 1 --2- 172.21.15.47:0/1490021715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a825b0 0x562654a8e000 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f992c0115c0 tx=0x7f992c011a80 comp rx=0 tx=0).stop 2024-07-24T22:11:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.190+0000 7f993a3e1740 1 -- 172.21.15.47:0/1490021715 shutdown_connections 2024-07-24T22:11:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.190+0000 7f993a3e1740 1 --2- 172.21.15.47:0/1490021715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a8e540 0x562654a90930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.190+0000 7f993a3e1740 1 --2- 172.21.15.47:0/1490021715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a825b0 0x562654a8e000 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.190+0000 7f993a3e1740 1 --2- 172.21.15.47:0/1490021715 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a81c90 0x562654a82070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.190+0000 7f993a3e1740 1 -- 172.21.15.47:0/1490021715 >> 172.21.15.47:0/1490021715 conn(0x562654a7fac0 msgr2=0x562654a80c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.190+0000 7f993a3e1740 1 -- 172.21.15.47:0/1490021715 shutdown_connections 2024-07-24T22:11:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.191+0000 7f993a3e1740 1 -- 172.21.15.47:0/1490021715 wait complete. 2024-07-24T22:11:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.191+0000 7f993a3e1740 1 -- start start 2024-07-24T22:11:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.191+0000 7f993a3e1740 1 Processor -- start 2024-07-24T22:11:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.191+0000 7f993a3e1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a81c90 0x562654a8dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.191+0000 7f993a3e1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a825b0 0x562654a8b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.191+0000 7f993a3e1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a8e540 0x562654a8b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f993a3e1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562654920ab0 con 0x562654a825b0 2024-07-24T22:11:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f993a3e1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56265496e9e0 con 0x562654a81c90 2024-07-24T22:11:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f993a3e1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562654a91220 con 0x562654a8e540 2024-07-24T22:11:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f9934b4b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a825b0 0x562654a8b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f9935b4d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a8e540 0x562654a8b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f993534c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a81c90 0x562654a8dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f993534c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a81c90 0x562654a8dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:36374/0 (socket says 172.21.15.47:36374) 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f993534c640 1 -- 172.21.15.47:0/3235267967 learned_addr learned my addr 172.21.15.47:0/3235267967 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f9934b4b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a825b0 0x562654a8b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60434/0 (socket says 172.21.15.47:60434) 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f993a3e1740 10 client.0 _ll_register_callbacks cb 0x5626546f6a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f9935b4d640 1 -- 172.21.15.47:0/3235267967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a81c90 msgr2=0x562654a8dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f9935b4d640 1 --2- 172.21.15.47:0/3235267967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a81c90 0x562654a8dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f9935b4d640 1 -- 172.21.15.47:0/3235267967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a825b0 msgr2=0x562654a8b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f9935b4d640 1 --2- 172.21.15.47:0/3235267967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a825b0 0x562654a8b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f9935b4d640 1 -- 172.21.15.47:0/3235267967 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626547c3620 con 0x562654a8e540 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.192+0000 7f9935b4d640 1 --2- 172.21.15.47:0/3235267967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a8e540 0x562654a8b710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9928005cc0 tx=0x7f992802a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27434070c36add97 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.193+0000 7f9918ff9640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:11:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.193+0000 7f9918ff9640 1 -- 172.21.15.47:0/3235267967 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992802f310 con 0x562654a8e540 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.193+0000 7f9918ff9640 1 -- 172.21.15.47:0/3235267967 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f9928004250 con 0x562654a8e540 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.193+0000 7f993a3e1740 1 -- 172.21.15.47:0/3235267967 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562654995ce0 con 0x562654a8e540 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.193+0000 7f9918ff9640 1 -- 172.21.15.47:0/3235267967 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9928004450 con 0x562654a8e540 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.193+0000 7f993a3e1740 10 client.25750 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.193+0000 7f993a3e1740 1 -- 172.21.15.47:0/3235267967 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562654a9c9f0 con 0x562654a8e540 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.193+0000 7f9918ff9640 1 -- 172.21.15.47:0/3235267967 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562654995ce0 con 0x562654a8e540 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.193+0000 7f9918ff9640 1 -- 172.21.15.47:0/3235267967 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f99280305c0 con 0x562654a8e540 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.193+0000 7f993a3e1740 10 client.25750 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.193+0000 7f993a3e1740 10 client.25750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.193+0000 7f993a3e1740 20 client.25750 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.194+0000 7f993a3e1740 1 --2- 172.21.15.47:0/3235267967 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562654a9def0 0x562654aa0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.194+0000 7f993a3e1740 4 client.25750 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.194+0000 7f993a3e1740 1 -- 172.21.15.47:0/3235267967 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626549f91d0 con 0x562654a9def0 2024-07-24T22:11:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.194+0000 7f993534c640 1 --2- 172.21.15.47:0/3235267967 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562654a9def0 0x562654aa0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.194+0000 7f993534c640 1 --2- 172.21.15.47:0/3235267967 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562654a9def0 0x562654aa0340 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88f1c2864c6f24bf server_cookie=7243b1332b400f31 in_seq=0 out_seq=0 2024-07-24T22:11:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.194+0000 7f9918ff9640 10 client.25750 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f9918ff9640 1 -- 172.21.15.47:0/3235267967 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5626549f91d0 con 0x562654a9def0 2024-07-24T22:11:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f9918ff9640 10 client.25750 handle_command_reply: tid=0 2024-07-24T22:11:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f993a3e1740 1 client.25750 shutdown 2024-07-24T22:11:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f993a3e1740 1 -- 172.21.15.47:0/3235267967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a8e540 msgr2=0x562654a8b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f993a3e1740 1 --2- 172.21.15.47:0/3235267967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a8e540 0x562654a8b710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9928005cc0 tx=0x7f992802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f993a3e1740 1 -- 172.21.15.47:0/3235267967 shutdown_connections 2024-07-24T22:11:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f993a3e1740 1 --2- 172.21.15.47:0/3235267967 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562654a9def0 0x562654aa0340 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f993a3e1740 1 --2- 172.21.15.47:0/3235267967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a8e540 0x562654a8b710 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f9918ff9640 0 client.25750 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f993a3e1740 1 --2- 172.21.15.47:0/3235267967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a825b0 0x562654a8b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f993a3e1740 1 --2- 172.21.15.47:0/3235267967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a81c90 0x562654a8dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f993a3e1740 1 -- 172.21.15.47:0/3235267967 >> 172.21.15.47:0/3235267967 conn(0x562654a7fac0 msgr2=0x562654a85660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f993a3e1740 1 -- 172.21.15.47:0/3235267967 shutdown_connections 2024-07-24T22:11:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.195+0000 7f993a3e1740 1 -- 172.21.15.47:0/3235267967 wait complete. 2024-07-24T22:11:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.196+0000 7f993a3e1740 20 client.25750 trim_cache size 0 max 16384 2024-07-24T22:11:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.213+0000 7f993a3e1740 1 Processor -- start 2024-07-24T22:11:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.213+0000 7f993a3e1740 1 -- start start 2024-07-24T22:11:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f993a3e1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a81c90 0x562654a9a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f993a3e1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a825b0 0x562654a8ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f993a3e1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a8e540 0x562654aa5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f993a3e1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f99301ae2e0 con 0x562654a8e540 2024-07-24T22:11:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f993a3e1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f99301b0b60 con 0x562654a81c90 2024-07-24T22:11:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f993a3e1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f99301ae950 con 0x562654a825b0 2024-07-24T22:11:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f9935b4d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a8e540 0x562654aa5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f9935b4d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a8e540 0x562654aa5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60440/0 (socket says 172.21.15.47:60440) 2024-07-24T22:11:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f9935b4d640 1 -- 172.21.15.47:0/3453011397 learned_addr learned my addr 172.21.15.47:0/3453011397 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f9934b4b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a825b0 0x562654a8ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f993534c640 1 --2- 172.21.15.47:0/3453011397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a81c90 0x562654a9a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f9935b4d640 1 -- 172.21.15.47:0/3453011397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a825b0 msgr2=0x562654a8ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f9935b4d640 1 --2- 172.21.15.47:0/3453011397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a825b0 0x562654a8ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f9935b4d640 1 -- 172.21.15.47:0/3453011397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a81c90 msgr2=0x562654a9a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f9935b4d640 1 --2- 172.21.15.47:0/3453011397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a81c90 0x562654a9a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f9935b4d640 1 -- 172.21.15.47:0/3453011397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562654a7f8f0 con 0x562654a8e540 2024-07-24T22:11:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f9935b4d640 1 --2- 172.21.15.47:0/3453011397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a8e540 0x562654aa5c50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f992802ade0 tx=0x7f9928005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66acd0049c68205d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.214+0000 7f991affd640 1 -- 172.21.15.47:0/3453011397 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928060030 con 0x562654a8e540 2024-07-24T22:11:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.215+0000 7f991affd640 1 -- 172.21.15.47:0/3453011397 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f992804e030 con 0x562654a8e540 2024-07-24T22:11:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.215+0000 7f991affd640 1 -- 172.21.15.47:0/3453011397 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99280305c0 con 0x562654a8e540 2024-07-24T22:11:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.215+0000 7f993a3e1740 1 -- 172.21.15.47:0/3453011397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a8e540 msgr2=0x562654aa5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.215+0000 7f993a3e1740 1 --2- 172.21.15.47:0/3453011397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a8e540 0x562654aa5c50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f992802ade0 tx=0x7f9928005b70 comp rx=0 tx=0).stop 2024-07-24T22:11:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.215+0000 7f993a3e1740 1 -- 172.21.15.47:0/3453011397 shutdown_connections 2024-07-24T22:11:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.215+0000 7f993a3e1740 1 --2- 172.21.15.47:0/3453011397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a8e540 0x562654aa5c50 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.215+0000 7f993a3e1740 1 --2- 172.21.15.47:0/3453011397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a825b0 0x562654a8ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.215+0000 7f993a3e1740 1 --2- 172.21.15.47:0/3453011397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a81c90 0x562654a9a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.216+0000 7f993a3e1740 1 -- 172.21.15.47:0/3453011397 >> 172.21.15.47:0/3453011397 conn(0x562654a7fac0 msgr2=0x562654a8c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.216+0000 7f993a3e1740 1 -- 172.21.15.47:0/3453011397 shutdown_connections 2024-07-24T22:11:01.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.216+0000 7f993a3e1740 1 -- 172.21.15.47:0/3453011397 wait complete. 2024-07-24T22:11:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.216+0000 7f993a3e1740 1 -- start start 2024-07-24T22:11:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.216+0000 7f993a3e1740 1 Processor -- start 2024-07-24T22:11:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.216+0000 7f993a3e1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a81c90 0x562654a93320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.216+0000 7f993a3e1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a825b0 0x562654a93860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.216+0000 7f993a3e1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a8e540 0x562654a93da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.216+0000 7f993a3e1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f99301af020 con 0x562654a81c90 2024-07-24T22:11:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f993a3e1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f99301b0490 con 0x562654a8e540 2024-07-24T22:11:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f993a3e1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f99301af6f0 con 0x562654a825b0 2024-07-24T22:11:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f993534c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a81c90 0x562654a93320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f993a3e1740 10 client.0 _ll_register_callbacks cb 0x7f992c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f993534c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a81c90 0x562654a93320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60450/0 (socket says 172.21.15.47:60450) 2024-07-24T22:11:01.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f993534c640 1 -- 172.21.15.47:0/288027803 learned_addr learned my addr 172.21.15.47:0/288027803 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f9934b4b640 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a825b0 0x562654a93860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f9935b4d640 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a8e540 0x562654a93da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f9935b4d640 1 -- 172.21.15.47:0/288027803 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a825b0 msgr2=0x562654a93860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f9935b4d640 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a825b0 0x562654a93860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f9935b4d640 1 -- 172.21.15.47:0/288027803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a81c90 msgr2=0x562654a93320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f9935b4d640 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a81c90 0x562654a93320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f9935b4d640 1 -- 172.21.15.47:0/288027803 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562654a8af50 con 0x562654a8e540 2024-07-24T22:11:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f993534c640 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a81c90 0x562654a93320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:11:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f9935b4d640 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a8e540 0x562654a93da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9928030ab0 tx=0x7f99280045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5acdc88f8d1ecbb8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f9918ff9640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:11:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.217+0000 7f9918ff9640 1 -- 172.21.15.47:0/288027803 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99280047d0 con 0x562654a8e540 2024-07-24T22:11:01.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f9918ff9640 1 -- 172.21.15.47:0/288027803 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f9928005c60 con 0x562654a8e540 2024-07-24T22:11:01.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f993a3e1740 1 -- 172.21.15.47:0/288027803 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f992804e030 con 0x562654a8e540 2024-07-24T22:11:01.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f9918ff9640 1 -- 172.21.15.47:0/288027803 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9928030c20 con 0x562654a8e540 2024-07-24T22:11:01.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f993a3e1740 10 client.25715 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:01.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f993a3e1740 1 -- 172.21.15.47:0/288027803 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562654b07dc0 con 0x562654a8e540 2024-07-24T22:11:01.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f9918ff9640 1 -- 172.21.15.47:0/288027803 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f992804e030 con 0x562654a8e540 2024-07-24T22:11:01.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f9918ff9640 1 -- 172.21.15.47:0/288027803 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f992805b430 con 0x562654a8e540 2024-07-24T22:11:01.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f993a3e1740 10 client.25715 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:01.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f993a3e1740 10 client.25715 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:01.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f993a3e1740 20 client.25715 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:01.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f993a3e1740 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562654a9def0 0x562654b0a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:01.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f993a3e1740 4 client.25715 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:11:01.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f993a3e1740 1 -- 172.21.15.47:0/288027803 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5626549f4c70 con 0x562654a9def0 2024-07-24T22:11:01.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.218+0000 7f993534c640 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562654a9def0 0x562654b0a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.219+0000 7f993534c640 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562654a9def0 0x562654b0a4c0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c257e68d28662398 server_cookie=ea06644eeb312e06 in_seq=0 out_seq=0 2024-07-24T22:11:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.219+0000 7f9918ff9640 10 client.25715 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.230+0000 7f9918ff9640 1 -- 172.21.15.47:0/288027803 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5626549f4c70 con 0x562654a9def0 2024-07-24T22:11:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.230+0000 7f9918ff9640 10 client.25715 handle_command_reply: tid=0 2024-07-24T22:11:01.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.231+0000 7f993a3e1740 1 client.25715 shutdown 2024-07-24T22:11:01.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.231+0000 7f993a3e1740 1 -- 172.21.15.47:0/288027803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a8e540 msgr2=0x562654a93da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.231+0000 7f993a3e1740 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a8e540 0x562654a93da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9928030ab0 tx=0x7f99280045f0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.231+0000 7f993a3e1740 1 -- 172.21.15.47:0/288027803 shutdown_connections 2024-07-24T22:11:01.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.231+0000 7f993a3e1740 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562654a9def0 0x562654b0a4c0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.231+0000 7f993a3e1740 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562654a8e540 0x562654a93da0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.231+0000 7f9918ff9640 0 client.25715 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:01.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.231+0000 7f993a3e1740 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562654a825b0 0x562654a93860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.231+0000 7f993a3e1740 1 --2- 172.21.15.47:0/288027803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562654a81c90 0x562654a93320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.231+0000 7f993a3e1740 1 -- 172.21.15.47:0/288027803 >> 172.21.15.47:0/288027803 conn(0x562654a7fac0 msgr2=0x562654a80fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:01.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.232+0000 7f993a3e1740 1 -- 172.21.15.47:0/288027803 shutdown_connections 2024-07-24T22:11:01.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.232+0000 7f993a3e1740 1 -- 172.21.15.47:0/288027803 wait complete. 2024-07-24T22:11:01.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.232+0000 7f993a3e1740 20 client.25715 trim_cache size 0 max 16384 2024-07-24T22:11:01.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:11:01.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:11:01.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:11:01.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:11:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.233+0000 7f99375b0640 1 -- 172.21.15.47:0/635942689 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f991c0b3dc0 msgr2=0x7f991c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.233+0000 7f99375b0640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f991c0b3dc0 0x7f991c0b6280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f992802f4c0 tx=0x7f99280095c0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.233+0000 7f99375b0640 1 -- 172.21.15.47:0/635942689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9930103ef0 msgr2=0x7f99301017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.233+0000 7f99375b0640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9930103ef0 0x7f99301017b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f992000e9c0 tx=0x7f992000ee80 comp rx=0 tx=0).stop 2024-07-24T22:11:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.233+0000 7f99375b0640 1 -- 172.21.15.47:0/635942689 shutdown_connections 2024-07-24T22:11:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.233+0000 7f99375b0640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f991c0b3dc0 0x7f991c0b6280 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.233+0000 7f99375b0640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f993010c9f0 0x7f9930101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.233+0000 7f99375b0640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9930103ef0 0x7f99301017b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.233+0000 7f99375b0640 1 --2- 172.21.15.47:0/635942689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f99301035d0 0x7f9930101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.233+0000 7f99375b0640 1 -- 172.21.15.47:0/635942689 >> 172.21.15.47:0/635942689 conn(0x7f99300782e0 msgr2=0x7f99300fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.233+0000 7f99375b0640 1 -- 172.21.15.47:0/635942689 shutdown_connections 2024-07-24T22:11:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:01.233+0000 7f99375b0640 1 -- 172.21.15.47:0/635942689 wait complete. 2024-07-24T22:11:01.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:01 smithi047 ceph-mon[32551]: pgmap v480: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 523 MiB/s wr, 1.09k op/s 2024-07-24T22:11:01.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:01 smithi188 ceph-mon[37380]: pgmap v480: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 523 MiB/s wr, 1.09k op/s 2024-07-24T22:11:01.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:01 smithi183 ceph-mon[37007]: pgmap v480: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 523 MiB/s wr, 1.09k op/s 2024-07-24T22:11:02.017 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:11:02.017 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:11:02.286 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:11:03.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:03 smithi188 ceph-mon[37380]: pgmap v481: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 379 MiB/s wr, 775 op/s 2024-07-24T22:11:03.607 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:03 smithi047 ceph-mon[32551]: pgmap v481: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 379 MiB/s wr, 775 op/s 2024-07-24T22:11:03.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:03 smithi183 ceph-mon[37007]: pgmap v481: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 379 MiB/s wr, 775 op/s 2024-07-24T22:11:04.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.222+0000 7f7384a78640 1 -- 172.21.15.47:0/3981654303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738010a2f0 msgr2=0x7f738010c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:04.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.222+0000 7f7384a78640 1 --2- 172.21.15.47:0/3981654303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738010a2f0 0x7f738010c6e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7374009900 tx=0x7f737402a410 comp rx=0 tx=0).stop 2024-07-24T22:11:04.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.222+0000 7f7384a78640 1 -- 172.21.15.47:0/3981654303 shutdown_connections 2024-07-24T22:11:04.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.222+0000 7f7384a78640 1 --2- 172.21.15.47:0/3981654303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f738010cc20 0x7f738010f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:04.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.222+0000 7f7384a78640 1 --2- 172.21.15.47:0/3981654303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738010a2f0 0x7f738010c6e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:04.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.222+0000 7f7384a78640 1 --2- 172.21.15.47:0/3981654303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73801011e0 0x7f73801015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:04.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.222+0000 7f7384a78640 1 -- 172.21.15.47:0/3981654303 >> 172.21.15.47:0/3981654303 conn(0x7f7380076940 msgr2=0x7f7380076d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:04.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.222+0000 7f7384a78640 1 -- 172.21.15.47:0/3981654303 shutdown_connections 2024-07-24T22:11:04.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.222+0000 7f7384a78640 1 -- 172.21.15.47:0/3981654303 wait complete. 2024-07-24T22:11:04.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.223+0000 7f7384a78640 1 Processor -- start 2024-07-24T22:11:04.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.223+0000 7f7384a78640 1 -- start start 2024-07-24T22:11:04.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.223+0000 7f7384a78640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73801011e0 0x7f73801021b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:04.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.223+0000 7f7384a78640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f738010a2f0 0x7f73801026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:04.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.223+0000 7f7384a78640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738010cc20 0x7f7380102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:04.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.223+0000 7f7384a78640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7380112800 con 0x7f738010cc20 2024-07-24T22:11:04.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.223+0000 7f7384a78640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7380112680 con 0x7f73801011e0 2024-07-24T22:11:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.223+0000 7f7384a78640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7380112980 con 0x7f738010a2f0 2024-07-24T22:11:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f737ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738010cc20 0x7f7380102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f737ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738010cc20 0x7f7380102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60474/0 (socket says 172.21.15.47:60474) 2024-07-24T22:11:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f737ed9d640 1 -- 172.21.15.47:0/902569322 learned_addr learned my addr 172.21.15.47:0/902569322 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f737e59c640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73801011e0 0x7f73801021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f737dd9b640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f738010a2f0 0x7f73801026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f737ed9d640 1 -- 172.21.15.47:0/902569322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f738010a2f0 msgr2=0x7f73801026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f737ed9d640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f738010a2f0 0x7f73801026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f737ed9d640 1 -- 172.21.15.47:0/902569322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73801011e0 msgr2=0x7f73801021b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f737ed9d640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73801011e0 0x7f73801021b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f737ed9d640 1 -- 172.21.15.47:0/902569322 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73801a7250 con 0x7f738010cc20 2024-07-24T22:11:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f737e59c640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73801011e0 0x7f73801021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:11:04.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f737ed9d640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738010cc20 0x7f7380102c30 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7378009fd0 tx=0x7f737800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:04.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f736f7fe640 1 -- 172.21.15.47:0/902569322 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378011830 con 0x7f738010cc20 2024-07-24T22:11:04.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f7384a78640 1 -- 172.21.15.47:0/902569322 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73801a7540 con 0x7f738010cc20 2024-07-24T22:11:04.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f736f7fe640 1 -- 172.21.15.47:0/902569322 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7378016070 con 0x7f738010cc20 2024-07-24T22:11:04.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f736f7fe640 1 -- 172.21.15.47:0/902569322 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378010de0 con 0x7f738010cc20 2024-07-24T22:11:04.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.224+0000 7f7384a78640 1 -- 172.21.15.47:0/902569322 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73801a7a50 con 0x7f738010cc20 2024-07-24T22:11:04.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.226+0000 7f7384a78640 1 -- 172.21.15.47:0/902569322 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7380101640 con 0x7f738010cc20 2024-07-24T22:11:04.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.227+0000 7f736f7fe640 1 -- 172.21.15.47:0/902569322 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f73780119d0 con 0x7f738010cc20 2024-07-24T22:11:04.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.228+0000 7f736f7fe640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f73680b3d40 0x7f73680b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:04.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.228+0000 7f737e59c640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f73680b3d40 0x7f73680b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:04.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.228+0000 7f736f7fe640 1 -- 172.21.15.47:0/902569322 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f73780e3d80 con 0x7f738010cc20 2024-07-24T22:11:04.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.229+0000 7f737e59c640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f73680b3d40 0x7f73680b6200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7370009fa0 tx=0x7f7370009570 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:04.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.231+0000 7f736f7fe640 1 -- 172.21.15.47:0/902569322 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f73780ab140 con 0x7f738010cc20 2024-07-24T22:11:04.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.463+0000 7f7384a78640 1 -- 172.21.15.47:0/902569322 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73801a7d70 con 0x7f738010cc20 2024-07-24T22:11:04.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.463+0000 7f736f7fe640 1 -- 172.21.15.47:0/902569322 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f73780aaa40 con 0x7f738010cc20 2024-07-24T22:11:04.466 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:11:04.466 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:11:04.466 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:11:04.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.465+0000 7f7384a78640 1 -- 172.21.15.47:0/902569322 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f73680b3d40 msgr2=0x7f73680b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:04.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.465+0000 7f7384a78640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f73680b3d40 0x7f73680b6200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7370009fa0 tx=0x7f7370009570 comp rx=0 tx=0).stop 2024-07-24T22:11:04.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.465+0000 7f7384a78640 1 -- 172.21.15.47:0/902569322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738010cc20 msgr2=0x7f7380102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:04.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.465+0000 7f7384a78640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738010cc20 0x7f7380102c30 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7378009fd0 tx=0x7f737800b8e0 comp rx=0 tx=0).stop 2024-07-24T22:11:04.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.465+0000 7f7384a78640 1 -- 172.21.15.47:0/902569322 shutdown_connections 2024-07-24T22:11:04.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.465+0000 7f7384a78640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f73680b3d40 0x7f73680b6200 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:04.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.465+0000 7f7384a78640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738010cc20 0x7f7380102c30 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:04.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.465+0000 7f7384a78640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f738010a2f0 0x7f73801026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:04.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.465+0000 7f7384a78640 1 --2- 172.21.15.47:0/902569322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73801011e0 0x7f73801021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:04.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.465+0000 7f7384a78640 1 -- 172.21.15.47:0/902569322 >> 172.21.15.47:0/902569322 conn(0x7f7380076940 msgr2=0x7f73800fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:04.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.466+0000 7f7384a78640 1 -- 172.21.15.47:0/902569322 shutdown_connections 2024-07-24T22:11:04.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:04.466+0000 7f7384a78640 1 -- 172.21.15.47:0/902569322 wait complete. 2024-07-24T22:11:05.298 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:11:05.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:05 smithi188 ceph-mon[37380]: pgmap v482: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 318 MiB/s wr, 558 op/s 2024-07-24T22:11:05.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:05 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/902569322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:11:05.575 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:11:05.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:05 smithi183 ceph-mon[37007]: pgmap v482: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 318 MiB/s wr, 558 op/s 2024-07-24T22:11:05.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:05 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/902569322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:11:05.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:05 smithi047 ceph-mon[32551]: pgmap v482: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 318 MiB/s wr, 558 op/s 2024-07-24T22:11:05.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:05 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/902569322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:11:07.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:07 smithi188 ceph-mon[37380]: pgmap v483: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 780 KiB/s rd, 178 MiB/s wr, 182 op/s 2024-07-24T22:11:07.603 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:07 smithi047 ceph-mon[32551]: pgmap v483: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 780 KiB/s rd, 178 MiB/s wr, 182 op/s 2024-07-24T22:11:07.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:07 smithi183 ceph-mon[37007]: pgmap v483: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 780 KiB/s rd, 178 MiB/s wr, 182 op/s 2024-07-24T22:11:07.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.690+0000 7fb08c169640 1 -- 172.21.15.47:0/1471117454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb084101650 msgr2=0x7fb084101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.690+0000 7fb08c169640 1 --2- 172.21.15.47:0/1471117454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb084101650 0x7fb084101a30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009900 tx=0x7fb07c02a410 comp rx=0 tx=0).stop 2024-07-24T22:11:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.690+0000 7fb08c169640 1 -- 172.21.15.47:0/1471117454 shutdown_connections 2024-07-24T22:11:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.690+0000 7fb08c169640 1 --2- 172.21.15.47:0/1471117454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0841079e0 0x7fb08410e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.690+0000 7fb08c169640 1 --2- 172.21.15.47:0/1471117454 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb084107060 0x7fb0841074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.690+0000 7fb08c169640 1 --2- 172.21.15.47:0/1471117454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb084101650 0x7fb084101a30 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.690+0000 7fb08c169640 1 -- 172.21.15.47:0/1471117454 >> 172.21.15.47:0/1471117454 conn(0x7fb0840fd0c0 msgr2=0x7fb0840ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.690+0000 7fb08c169640 1 -- 172.21.15.47:0/1471117454 shutdown_connections 2024-07-24T22:11:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.690+0000 7fb08c169640 1 -- 172.21.15.47:0/1471117454 wait complete. 2024-07-24T22:11:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb08c169640 1 Processor -- start 2024-07-24T22:11:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb08c169640 1 -- start start 2024-07-24T22:11:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb08c169640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb084101650 0x7fb084198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb08c169640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb084107060 0x7fb084199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb08c169640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0841079e0 0x7fb08419e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb08c169640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb084112780 con 0x7fb084101650 2024-07-24T22:11:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb08c169640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb084112600 con 0x7fb0841079e0 2024-07-24T22:11:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb08c169640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb084112900 con 0x7fb084107060 2024-07-24T22:11:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb089f05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb084101650 0x7fb084198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb089f05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb084101650 0x7fb084198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57722/0 (socket says 172.21.15.47:57722) 2024-07-24T22:11:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb089f05640 1 -- 172.21.15.47:0/2754738427 learned_addr learned my addr 172.21.15.47:0/2754738427 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb08a706640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0841079e0 0x7fb08419e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb089704640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb084107060 0x7fb084199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb089f05640 1 -- 172.21.15.47:0/2754738427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb084107060 msgr2=0x7fb084199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb089f05640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb084107060 0x7fb084199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb089f05640 1 -- 172.21.15.47:0/2754738427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0841079e0 msgr2=0x7fb08419e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:07.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb089f05640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0841079e0 0x7fb08419e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.691+0000 7fb089f05640 1 -- 172.21.15.47:0/2754738427 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08419eca0 con 0x7fb084101650 2024-07-24T22:11:07.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.692+0000 7fb089f05640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb084101650 0x7fb084198bf0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb07c006010 tx=0x7fb07c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:07.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.692+0000 7fb082ffd640 1 -- 172.21.15.47:0/2754738427 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c03f030 con 0x7fb084101650 2024-07-24T22:11:07.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.692+0000 7fb082ffd640 1 -- 172.21.15.47:0/2754738427 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb07c003800 con 0x7fb084101650 2024-07-24T22:11:07.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.692+0000 7fb082ffd640 1 -- 172.21.15.47:0/2754738427 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c035070 con 0x7fb084101650 2024-07-24T22:11:07.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.692+0000 7fb08c169640 1 -- 172.21.15.47:0/2754738427 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08419ef30 con 0x7fb084101650 2024-07-24T22:11:07.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.692+0000 7fb08c169640 1 -- 172.21.15.47:0/2754738427 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0841a5650 con 0x7fb084101650 2024-07-24T22:11:07.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.694+0000 7fb082ffd640 1 -- 172.21.15.47:0/2754738427 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fb07c003cb0 con 0x7fb084101650 2024-07-24T22:11:07.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.694+0000 7fb08e51a740 1 Processor -- start 2024-07-24T22:11:07.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08e51a740 1 -- start start 2024-07-24T22:11:07.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08e51a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 0x55a651e08ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08e51a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e08ff0 0x55a651e14a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08e51a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e14f80 0x55a651e17370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08e51a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a651d7f9b0 con 0x55a651e086d0 2024-07-24T22:11:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08e51a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a651d6eeb0 con 0x55a651e14f80 2024-07-24T22:11:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08e51a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a651d72ef0 con 0x55a651e08ff0 2024-07-24T22:11:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08a706640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 0x55a651e08ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08a706640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 0x55a651e08ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57736/0 (socket says 172.21.15.47:57736) 2024-07-24T22:11:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08a706640 1 -- 172.21.15.47:0/1769014568 learned_addr learned my addr 172.21.15.47:0/1769014568 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb089f05640 1 --2- 172.21.15.47:0/1769014568 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e08ff0 0x55a651e14a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb089704640 1 --2- 172.21.15.47:0/1769014568 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e14f80 0x55a651e17370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb082ffd640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb06c0b3dc0 0x7fb06c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08a706640 1 -- 172.21.15.47:0/1769014568 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e08ff0 msgr2=0x55a651e14a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:07.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08a706640 1 --2- 172.21.15.47:0/1769014568 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e08ff0 0x55a651e14a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08a706640 1 -- 172.21.15.47:0/1769014568 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e14f80 msgr2=0x55a651e17370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:07.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.695+0000 7fb08a706640 1 --2- 172.21.15.47:0/1769014568 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e14f80 0x55a651e17370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.696+0000 7fb08a706640 1 -- 172.21.15.47:0/1769014568 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a651cf8320 con 0x55a651e086d0 2024-07-24T22:11:07.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.696+0000 7fb082ffd640 1 -- 172.21.15.47:0/2754738427 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb07c104a40 con 0x7fb084101650 2024-07-24T22:11:07.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.696+0000 7fb08a706640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb06c0b3dc0 0x7fb06c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.696+0000 7fb08a706640 1 --2- 172.21.15.47:0/1769014568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 0x55a651e08ab0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb074008dc0 tx=0x7fb07400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406f15bd783d4852 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:07.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.696+0000 7fb06bfff640 1 -- 172.21.15.47:0/1769014568 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074020070 con 0x55a651e086d0 2024-07-24T22:11:07.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.696+0000 7fb06bfff640 1 -- 172.21.15.47:0/1769014568 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb07400f3c0 con 0x55a651e086d0 2024-07-24T22:11:07.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.696+0000 7fb06bfff640 1 -- 172.21.15.47:0/1769014568 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074014070 con 0x55a651e086d0 2024-07-24T22:11:07.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.697+0000 7fb08e51a740 1 -- 172.21.15.47:0/1769014568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 msgr2=0x55a651e08ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:07.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.697+0000 7fb08a706640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb06c0b3dc0 0x7fb06c0b6280 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb07401d000 tx=0x7fb074020000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:07.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.697+0000 7fb08e51a740 1 --2- 172.21.15.47:0/1769014568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 0x55a651e08ab0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb074008dc0 tx=0x7fb07400e720 comp rx=0 tx=0).stop 2024-07-24T22:11:07.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.697+0000 7fb08e51a740 1 -- 172.21.15.47:0/1769014568 shutdown_connections 2024-07-24T22:11:07.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.697+0000 7fb08e51a740 1 --2- 172.21.15.47:0/1769014568 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e14f80 0x55a651e17370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.697+0000 7fb08e51a740 1 --2- 172.21.15.47:0/1769014568 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e08ff0 0x55a651e14a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.697+0000 7fb08e51a740 1 --2- 172.21.15.47:0/1769014568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 0x55a651e08ab0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.697+0000 7fb08e51a740 1 -- 172.21.15.47:0/1769014568 >> 172.21.15.47:0/1769014568 conn(0x55a651e06500 msgr2=0x55a651e076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:07.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.697+0000 7fb08e51a740 1 -- 172.21.15.47:0/1769014568 shutdown_connections 2024-07-24T22:11:07.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.697+0000 7fb08e51a740 1 -- 172.21.15.47:0/1769014568 wait complete. 2024-07-24T22:11:07.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.697+0000 7fb08e51a740 1 -- start start 2024-07-24T22:11:07.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.697+0000 7fb08e51a740 1 Processor -- start 2024-07-24T22:11:07.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08e51a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e086d0 0x55a651e14a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08e51a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e08ff0 0x55a651e11ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08e51a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e14f80 0x55a651e12660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08e51a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a651bd2700 con 0x55a651e14f80 2024-07-24T22:11:07.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08e51a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a651d115f0 con 0x55a651e08ff0 2024-07-24T22:11:07.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08e51a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a651e17c00 con 0x55a651e086d0 2024-07-24T22:11:07.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08e51a740 10 client.0 _ll_register_callbacks cb 0x55a651d31960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:07.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08a706640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e14f80 0x55a651e12660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08a706640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e14f80 0x55a651e12660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57750/0 (socket says 172.21.15.47:57750) 2024-07-24T22:11:07.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08a706640 1 -- 172.21.15.47:0/2239552731 learned_addr learned my addr 172.21.15.47:0/2239552731 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:07.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb089704640 1 --2- 172.21.15.47:0/2239552731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e08ff0 0x55a651e11ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb089f05640 1 --2- 172.21.15.47:0/2239552731 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e086d0 0x55a651e14a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08a706640 1 -- 172.21.15.47:0/2239552731 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e086d0 msgr2=0x55a651e14a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:07.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08a706640 1 --2- 172.21.15.47:0/2239552731 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e086d0 0x55a651e14a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08a706640 1 -- 172.21.15.47:0/2239552731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e08ff0 msgr2=0x55a651e11ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:07.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08a706640 1 --2- 172.21.15.47:0/2239552731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e08ff0 0x55a651e11ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08a706640 1 -- 172.21.15.47:0/2239552731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a651d04680 con 0x55a651e14f80 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb08a706640 1 --2- 172.21.15.47:0/2239552731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e14f80 0x55a651e12660 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb07400f7a0 tx=0x7fb07400f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9438de79f4bb0c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.698+0000 7fb0697fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb0697fa640 1 -- 172.21.15.47:0/2239552731 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074033060 con 0x55a651e14f80 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb08e51a740 1 -- 172.21.15.47:0/2239552731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb07400f3c0 con 0x55a651e14f80 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb0697fa640 1 -- 172.21.15.47:0/2239552731 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb07401adf0 con 0x55a651e14f80 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb0697fa640 1 -- 172.21.15.47:0/2239552731 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb074014040 con 0x55a651e14f80 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb08e51a740 10 client.16347 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb08e51a740 1 -- 172.21.15.47:0/2239552731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a651acf650 con 0x55a651e14f80 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb0697fa640 1 -- 172.21.15.47:0/2239552731 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb07400f3c0 con 0x55a651e14f80 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb0697fa640 1 -- 172.21.15.47:0/2239552731 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb07402d030 con 0x55a651e14f80 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb08e51a740 10 client.16347 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb08e51a740 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb08e51a740 20 client.16347 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:07.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb08e51a740 1 --2- 172.21.15.47:0/2239552731 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a651e248e0 0x55a651e26cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb08e51a740 4 client.16347 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:11:07.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.699+0000 7fb08e51a740 1 -- 172.21.15.47:0/2239552731 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a651d81900 con 0x55a651e248e0 2024-07-24T22:11:07.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.700+0000 7fb089f05640 1 --2- 172.21.15.47:0/2239552731 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a651e248e0 0x55a651e26cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.700+0000 7fb089f05640 1 --2- 172.21.15.47:0/2239552731 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a651e248e0 0x55a651e26cd0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6942df87a5e2b64 server_cookie=40fee09d369f110 in_seq=0 out_seq=0 2024-07-24T22:11:07.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.700+0000 7fb0697fa640 10 client.16347 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:07.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb0697fa640 1 -- 172.21.15.47:0/2239552731 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a651d81900 con 0x55a651e248e0 2024-07-24T22:11:07.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb0697fa640 10 client.16347 handle_command_reply: tid=0 2024-07-24T22:11:07.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb08e51a740 1 client.16347 shutdown 2024-07-24T22:11:07.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb08e51a740 1 -- 172.21.15.47:0/2239552731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e14f80 msgr2=0x55a651e12660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:07.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb08e51a740 1 --2- 172.21.15.47:0/2239552731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e14f80 0x55a651e12660 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb07400f7a0 tx=0x7fb07400f7d0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb08e51a740 1 -- 172.21.15.47:0/2239552731 shutdown_connections 2024-07-24T22:11:07.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb08e51a740 1 --2- 172.21.15.47:0/2239552731 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a651e248e0 0x55a651e26cd0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb08e51a740 1 --2- 172.21.15.47:0/2239552731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e14f80 0x55a651e12660 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb08e51a740 1 --2- 172.21.15.47:0/2239552731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e08ff0 0x55a651e11ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb0697fa640 0 client.16347 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:07.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb08e51a740 1 --2- 172.21.15.47:0/2239552731 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e086d0 0x55a651e14a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb08e51a740 1 -- 172.21.15.47:0/2239552731 >> 172.21.15.47:0/2239552731 conn(0x55a651e06500 msgr2=0x55a651e0c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:07.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb08e51a740 1 -- 172.21.15.47:0/2239552731 shutdown_connections 2024-07-24T22:11:07.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb08e51a740 1 -- 172.21.15.47:0/2239552731 wait complete. 2024-07-24T22:11:07.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.701+0000 7fb08e51a740 20 client.16347 trim_cache size 0 max 16384 2024-07-24T22:11:07.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.715+0000 7fb08e51a740 1 Processor -- start 2024-07-24T22:11:07.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.715+0000 7fb08e51a740 1 -- start start 2024-07-24T22:11:07.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.715+0000 7fb08e51a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 0x55a651e2c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.715+0000 7fb08e51a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e08ff0 0x55a651e2c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.715+0000 7fb08e51a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e14f80 0x55a651e0f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.715+0000 7fb08e51a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb0841ac0e0 con 0x55a651e086d0 2024-07-24T22:11:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.715+0000 7fb08e51a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb0841ae960 con 0x55a651e08ff0 2024-07-24T22:11:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.715+0000 7fb08e51a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb0841ac750 con 0x55a651e14f80 2024-07-24T22:11:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.715+0000 7fb089f05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 0x55a651e2c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.715+0000 7fb089f05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 0x55a651e2c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57766/0 (socket says 172.21.15.47:57766) 2024-07-24T22:11:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.715+0000 7fb089f05640 1 -- 172.21.15.47:0/2891349753 learned_addr learned my addr 172.21.15.47:0/2891349753 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.715+0000 7fb089704640 1 --2- 172.21.15.47:0/2891349753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e08ff0 0x55a651e2c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.716+0000 7fb089f05640 1 -- 172.21.15.47:0/2891349753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e14f80 msgr2=0x55a651e0f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.716+0000 7fb08a706640 1 --2- 172.21.15.47:0/2891349753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e14f80 0x55a651e0f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.716+0000 7fb089f05640 1 --2- 172.21.15.47:0/2891349753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e14f80 0x55a651e0f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.716+0000 7fb089f05640 1 -- 172.21.15.47:0/2891349753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e08ff0 msgr2=0x55a651e2c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.716+0000 7fb089f05640 1 --2- 172.21.15.47:0/2891349753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e08ff0 0x55a651e2c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.716+0000 7fb089f05640 1 -- 172.21.15.47:0/2891349753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a651e12240 con 0x55a651e086d0 2024-07-24T22:11:07.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.716+0000 7fb089704640 1 --2- 172.21.15.47:0/2891349753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e08ff0 0x55a651e2c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:11:07.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.716+0000 7fb089f05640 1 --2- 172.21.15.47:0/2891349753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 0x55a651e2c490 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb07c005ec0 tx=0x7fb07c0044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6397a205e1bf547d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:07.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.716+0000 7fb06b7fe640 1 -- 172.21.15.47:0/2891349753 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c049040 con 0x55a651e086d0 2024-07-24T22:11:07.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.716+0000 7fb06b7fe640 1 -- 172.21.15.47:0/2891349753 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb07c0cb160 con 0x55a651e086d0 2024-07-24T22:11:07.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.716+0000 7fb06b7fe640 1 -- 172.21.15.47:0/2891349753 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c102410 con 0x55a651e086d0 2024-07-24T22:11:07.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.717+0000 7fb08e51a740 1 -- 172.21.15.47:0/2891349753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 msgr2=0x55a651e2c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:07.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.717+0000 7fb08e51a740 1 --2- 172.21.15.47:0/2891349753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 0x55a651e2c490 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb07c005ec0 tx=0x7fb07c0044e0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.717+0000 7fb08e51a740 1 -- 172.21.15.47:0/2891349753 shutdown_connections 2024-07-24T22:11:07.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.717+0000 7fb08e51a740 1 --2- 172.21.15.47:0/2891349753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e14f80 0x55a651e0f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.717+0000 7fb08e51a740 1 --2- 172.21.15.47:0/2891349753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e08ff0 0x55a651e2c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.717+0000 7fb08e51a740 1 --2- 172.21.15.47:0/2891349753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e086d0 0x55a651e2c490 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.717+0000 7fb08e51a740 1 -- 172.21.15.47:0/2891349753 >> 172.21.15.47:0/2891349753 conn(0x55a651e06500 msgr2=0x55a651e13ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.717+0000 7fb08e51a740 1 -- 172.21.15.47:0/2891349753 shutdown_connections 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.717+0000 7fb08e51a740 1 -- 172.21.15.47:0/2891349753 wait complete. 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.717+0000 7fb08e51a740 1 -- start start 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.717+0000 7fb08e51a740 1 Processor -- start 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb08e51a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e086d0 0x55a651e0ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb08e51a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e08ff0 0x55a651e0f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb08e51a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e14f80 0x55a651e0f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb08e51a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb0841ace20 con 0x55a651e08ff0 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb08e51a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb0841ae290 con 0x55a651e086d0 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb08e51a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb0841ad4f0 con 0x55a651e14f80 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb08e51a740 10 client.0 _ll_register_callbacks cb 0x7fb07401e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:07.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb089704640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e08ff0 0x55a651e0f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb089704640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e08ff0 0x55a651e0f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57782/0 (socket says 172.21.15.47:57782) 2024-07-24T22:11:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb089704640 1 -- 172.21.15.47:0/869424831 learned_addr learned my addr 172.21.15.47:0/869424831 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb089f05640 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e086d0 0x55a651e0ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb08a706640 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e14f80 0x55a651e0f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb089704640 1 -- 172.21.15.47:0/869424831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e14f80 msgr2=0x55a651e0f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb089704640 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e14f80 0x55a651e0f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb089704640 1 -- 172.21.15.47:0/869424831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e086d0 msgr2=0x55a651e0ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb089704640 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e086d0 0x55a651e0ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb089704640 1 -- 172.21.15.47:0/869424831 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a651e14db0 con 0x55a651e08ff0 2024-07-24T22:11:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.718+0000 7fb089f05640 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e086d0 0x55a651e0ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:11:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb089704640 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e08ff0 0x55a651e0f470 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb07800cc60 tx=0x7fb0780039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3af43aca0690b4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb0697fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb0697fa640 1 -- 172.21.15.47:0/869424831 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078005220 con 0x55a651e08ff0 2024-07-24T22:11:07.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb0697fa640 1 -- 172.21.15.47:0/869424831 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb0780053c0 con 0x55a651e08ff0 2024-07-24T22:11:07.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb08e51a740 1 -- 172.21.15.47:0/869424831 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb07c0cb160 con 0x55a651e08ff0 2024-07-24T22:11:07.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb0697fa640 1 -- 172.21.15.47:0/869424831 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb0780055c0 con 0x55a651e08ff0 2024-07-24T22:11:07.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb08e51a740 10 client.16353 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:07.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb08e51a740 1 -- 172.21.15.47:0/869424831 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a651e8f640 con 0x55a651e08ff0 2024-07-24T22:11:07.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb0697fa640 1 -- 172.21.15.47:0/869424831 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb07c0cb160 con 0x55a651e08ff0 2024-07-24T22:11:07.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb0697fa640 1 -- 172.21.15.47:0/869424831 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb078010a10 con 0x55a651e08ff0 2024-07-24T22:11:07.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb08e51a740 10 client.16353 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:07.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb08e51a740 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:07.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb08e51a740 20 client.16353 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:07.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb08e51a740 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a651e8fde0 0x55a651e92200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:07.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb08e51a740 4 client.16353 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:11:07.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.719+0000 7fb08e51a740 1 -- 172.21.15.47:0/869424831 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a651d7d3a0 con 0x55a651e8fde0 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.720+0000 7fb089f05640 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a651e8fde0 0x55a651e92200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.720+0000 7fb089f05640 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a651e8fde0 0x55a651e92200 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab5e5b8fd223a2f3 server_cookie=11a74543b2cbe3c5 in_seq=0 out_seq=0 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.720+0000 7fb0697fa640 10 client.16353 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.720+0000 7fb0697fa640 1 -- 172.21.15.47:0/869424831 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a651d7d3a0 con 0x55a651e8fde0 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.720+0000 7fb0697fa640 10 client.16353 handle_command_reply: tid=0 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.720+0000 7fb08e51a740 1 client.16353 shutdown 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.720+0000 7fb08e51a740 1 -- 172.21.15.47:0/869424831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e08ff0 msgr2=0x55a651e0f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.720+0000 7fb08e51a740 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e08ff0 0x55a651e0f470 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb07800cc60 tx=0x7fb0780039c0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.720+0000 7fb08e51a740 1 -- 172.21.15.47:0/869424831 shutdown_connections 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.720+0000 7fb08e51a740 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a651e8fde0 0x55a651e92200 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.720+0000 7fb08e51a740 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a651e14f80 0x55a651e0f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.720+0000 7fb08e51a740 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a651e08ff0 0x55a651e0f470 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08e51a740 1 --2- 172.21.15.47:0/869424831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a651e086d0 0x55a651e0ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb0697fa640 0 client.16353 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:07.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08e51a740 1 -- 172.21.15.47:0/869424831 >> 172.21.15.47:0/869424831 conn(0x55a651e06500 msgr2=0x55a651e04d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:07.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08e51a740 1 -- 172.21.15.47:0/869424831 shutdown_connections 2024-07-24T22:11:07.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08e51a740 1 -- 172.21.15.47:0/869424831 wait complete. 2024-07-24T22:11:07.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08e51a740 20 client.16353 trim_cache size 0 max 16384 2024-07-24T22:11:07.728 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:11:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08c169640 1 -- 172.21.15.47:0/2754738427 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb06c0b3dc0 msgr2=0x7fb06c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08c169640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb06c0b3dc0 0x7fb06c0b6280 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb07401d000 tx=0x7fb074020000 comp rx=0 tx=0).stop 2024-07-24T22:11:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08c169640 1 -- 172.21.15.47:0/2754738427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb084101650 msgr2=0x7fb084198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08c169640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb084101650 0x7fb084198bf0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb07c006010 tx=0x7fb07c0042f0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08c169640 1 -- 172.21.15.47:0/2754738427 shutdown_connections 2024-07-24T22:11:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08c169640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb06c0b3dc0 0x7fb06c0b6280 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08c169640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0841079e0 0x7fb08419e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08c169640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb084107060 0x7fb084199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08c169640 1 --2- 172.21.15.47:0/2754738427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb084101650 0x7fb084198bf0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:07.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08c169640 1 -- 172.21.15.47:0/2754738427 >> 172.21.15.47:0/2754738427 conn(0x7fb0840fd0c0 msgr2=0x7fb0840ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:07.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08c169640 1 -- 172.21.15.47:0/2754738427 shutdown_connections 2024-07-24T22:11:07.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:07.721+0000 7fb08c169640 1 -- 172.21.15.47:0/2754738427 wait complete. 2024-07-24T22:11:09.562 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:11:09.563 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:11:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:09 smithi047 ceph-mon[32551]: pgmap v484: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 395 KiB/s rd, 128 MiB/s wr, 126 op/s 2024-07-24T22:11:09.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:09 smithi183 ceph-mon[37007]: pgmap v484: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 395 KiB/s rd, 128 MiB/s wr, 126 op/s 2024-07-24T22:11:09.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:09 smithi188 ceph-mon[37380]: pgmap v484: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 395 KiB/s rd, 128 MiB/s wr, 126 op/s 2024-07-24T22:11:09.843 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:11:11.637 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:11 smithi047 ceph-mon[32551]: pgmap v485: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 395 KiB/s rd, 75 MiB/s wr, 85 op/s 2024-07-24T22:11:11.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:11 smithi183 ceph-mon[37007]: pgmap v485: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 395 KiB/s rd, 75 MiB/s wr, 85 op/s 2024-07-24T22:11:11.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:11 smithi188 ceph-mon[37380]: pgmap v485: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 395 KiB/s rd, 75 MiB/s wr, 85 op/s 2024-07-24T22:11:11.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.849+0000 7f51029de640 1 -- 172.21.15.47:0/3736862473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50fc108b20 msgr2=0x7f50fc10f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:11.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.849+0000 7f51029de640 1 --2- 172.21.15.47:0/3736862473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50fc108b20 0x7f50fc10f320 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f50f4009ca0 tx=0x7f50f402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.849+0000 7f51029de640 1 -- 172.21.15.47:0/3736862473 shutdown_connections 2024-07-24T22:11:11.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.849+0000 7f51029de640 1 --2- 172.21.15.47:0/3736862473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50fc108b20 0x7f50fc10f320 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.849+0000 7f51029de640 1 --2- 172.21.15.47:0/3736862473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50fc1081a0 0x7f50fc1085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.849+0000 7f51029de640 1 --2- 172.21.15.47:0/3736862473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50fc102790 0x7f50fc102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.849+0000 7f51029de640 1 -- 172.21.15.47:0/3736862473 >> 172.21.15.47:0/3736862473 conn(0x7f50fc0fe200 msgr2=0x7f50fc100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:11.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.849+0000 7f51029de640 1 -- 172.21.15.47:0/3736862473 shutdown_connections 2024-07-24T22:11:11.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.849+0000 7f51029de640 1 -- 172.21.15.47:0/3736862473 wait complete. 2024-07-24T22:11:11.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.850+0000 7f51029de640 1 Processor -- start 2024-07-24T22:11:11.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.850+0000 7f51029de640 1 -- start start 2024-07-24T22:11:11.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.850+0000 7f51029de640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50fc102790 0x7f50fc074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.850+0000 7f51029de640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50fc1081a0 0x7f50fc0753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.850+0000 7f51029de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50fc108b20 0x7f50fc075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.850+0000 7f51029de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc112740 con 0x7f50fc108b20 2024-07-24T22:11:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.850+0000 7f51029de640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc1125c0 con 0x7f50fc102790 2024-07-24T22:11:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.850+0000 7f51029de640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc1128c0 con 0x7f50fc1081a0 2024-07-24T22:11:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.850+0000 7f5100f7b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50fc108b20 0x7f50fc075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.850+0000 7f50fbfff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50fc102790 0x7f50fc074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.850+0000 7f5100f7b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50fc108b20 0x7f50fc075910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57808/0 (socket says 172.21.15.47:57808) 2024-07-24T22:11:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.850+0000 7f5100f7b640 1 -- 172.21.15.47:0/3908438491 learned_addr learned my addr 172.21.15.47:0/3908438491 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.850+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50fc1081a0 0x7f50fc0753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.851+0000 7f5100f7b640 1 -- 172.21.15.47:0/3908438491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50fc1081a0 msgr2=0x7f50fc0753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.851+0000 7f5100f7b640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50fc1081a0 0x7f50fc0753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.851+0000 7f5100f7b640 1 -- 172.21.15.47:0/3908438491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50fc102790 msgr2=0x7f50fc074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.851+0000 7f5100f7b640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50fc102790 0x7f50fc074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.851+0000 7f5100f7b640 1 -- 172.21.15.47:0/3908438491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50fc1a6fd0 con 0x7f50fc108b20 2024-07-24T22:11:11.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.851+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50fc1081a0 0x7f50fc0753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:11:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.851+0000 7f5100f7b640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50fc108b20 0x7f50fc075910 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f50f4005cc0 tx=0x7f50f402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.851+0000 7f50f97fa640 1 -- 172.21.15.47:0/3908438491 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f4003bf0 con 0x7f50fc108b20 2024-07-24T22:11:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.851+0000 7f50f97fa640 1 -- 172.21.15.47:0/3908438491 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50f4003d90 con 0x7f50fc108b20 2024-07-24T22:11:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.851+0000 7f51029de640 1 -- 172.21.15.47:0/3908438491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50fc1a7260 con 0x7f50fc108b20 2024-07-24T22:11:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.851+0000 7f50f97fa640 1 -- 172.21.15.47:0/3908438491 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f402fb20 con 0x7f50fc108b20 2024-07-24T22:11:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.851+0000 7f51029de640 1 -- 172.21.15.47:0/3908438491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50fc1a77a0 con 0x7f50fc108b20 2024-07-24T22:11:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.853+0000 7f5104d8f740 1 Processor -- start 2024-07-24T22:11:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.853+0000 7f50f97fa640 1 -- 172.21.15.47:0/3908438491 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f50f4004580 con 0x7f50fc108b20 2024-07-24T22:11:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f5104d8f740 1 -- start start 2024-07-24T22:11:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f5104d8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28554f30 0x55dc28555310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f5104d8f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28555850 0x55dc285612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f5104d8f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 0x55dc28563bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f5104d8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dc284cc9f0 con 0x55dc28554f30 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f5104d8f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55dc284bbef0 con 0x55dc28555850 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f5104d8f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55dc284bff30 con 0x55dc285617e0 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f50fb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28554f30 0x55dc28555310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f50fb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28554f30 0x55dc28555310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57824/0 (socket says 172.21.15.47:57824) 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f50fb7fe640 1 -- 172.21.15.47:0/3777624322 learned_addr learned my addr 172.21.15.47:0/3777624322 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/3777624322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 0x55dc28563bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f50fbfff640 1 --2- 172.21.15.47:0/3777624322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28555850 0x55dc285612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f50fb7fe640 1 -- 172.21.15.47:0/3777624322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 msgr2=0x55dc28563bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/3777624322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 0x55dc28563bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f50fb7fe640 1 -- 172.21.15.47:0/3777624322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28555850 msgr2=0x55dc285612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/3777624322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28555850 0x55dc285612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f50fb7fe640 1 -- 172.21.15.47:0/3777624322 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc2821c930 con 0x55dc28554f30 2024-07-24T22:11:11.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f50f97fa640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50e40b3d40 0x7f50e40b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.854+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/3777624322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28554f30 0x55dc28555310 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009fa0 tx=0x7f50f0009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77644a5455087ca3 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:11.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.855+0000 7f50fbfff640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50e40b3d40 0x7f50e40b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.855+0000 7f50f97fa640 1 -- 172.21.15.47:0/3908438491 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f50f41054e0 con 0x7f50fc108b20 2024-07-24T22:11:11.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.855+0000 7f50e27fc640 1 -- 172.21.15.47:0/3777624322 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f00134c0 con 0x55dc28554f30 2024-07-24T22:11:11.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.855+0000 7f50e27fc640 1 -- 172.21.15.47:0/3777624322 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50f001b070 con 0x55dc28554f30 2024-07-24T22:11:11.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.855+0000 7f50e27fc640 1 -- 172.21.15.47:0/3777624322 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f00134c0 con 0x55dc28554f30 2024-07-24T22:11:11.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.855+0000 7f5104d8f740 1 -- 172.21.15.47:0/3777624322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28554f30 msgr2=0x55dc28555310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:11.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.855+0000 7f50fbfff640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50e40b3d40 0x7f50e40b6200 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55dc28553c40 tx=0x7f50ec00a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:11.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.855+0000 7f5104d8f740 1 --2- 172.21.15.47:0/3777624322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28554f30 0x55dc28555310 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009fa0 tx=0x7f50f0009650 comp rx=0 tx=0).stop 2024-07-24T22:11:11.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.855+0000 7f5104d8f740 1 -- 172.21.15.47:0/3777624322 shutdown_connections 2024-07-24T22:11:11.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.855+0000 7f5104d8f740 1 --2- 172.21.15.47:0/3777624322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 0x55dc28563bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 1 --2- 172.21.15.47:0/3777624322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28555850 0x55dc285612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 1 --2- 172.21.15.47:0/3777624322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28554f30 0x55dc28555310 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 1 -- 172.21.15.47:0/3777624322 >> 172.21.15.47:0/3777624322 conn(0x55dc28552d60 msgr2=0x55dc28553f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 1 -- 172.21.15.47:0/3777624322 shutdown_connections 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 1 -- 172.21.15.47:0/3777624322 wait complete. 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 1 -- start start 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 1 Processor -- start 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28554f30 0x55dc2855e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 0x55dc2855ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 0x55dc2855f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dc2831f890 con 0x55dc28555850 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55dc2845e390 con 0x55dc28554f30 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55dc28564400 con 0x55dc285617e0 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.856+0000 7f5104d8f740 10 client.0 _ll_register_callbacks cb 0x55dc28468500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:11.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50fb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 0x55dc2855ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50fb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 0x55dc2855ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57830/0 (socket says 172.21.15.47:57830) 2024-07-24T22:11:11.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50fb7fe640 1 -- 172.21.15.47:0/3484344015 learned_addr learned my addr 172.21.15.47:0/3484344015 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:11.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50fbfff640 1 --2- 172.21.15.47:0/3484344015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28554f30 0x55dc2855e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f5100f7b640 1 --2- 172.21.15.47:0/3484344015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 0x55dc2855f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50fb7fe640 1 -- 172.21.15.47:0/3484344015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 msgr2=0x55dc2855f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:11.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/3484344015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 0x55dc2855f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50fb7fe640 1 -- 172.21.15.47:0/3484344015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28554f30 msgr2=0x55dc2855e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:11.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/3484344015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28554f30 0x55dc2855e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50fb7fe640 1 -- 172.21.15.47:0/3484344015 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc28458d60 con 0x55dc28555850 2024-07-24T22:11:11.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/3484344015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 0x55dc2855ece0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009980 tx=0x7f50f0009d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d67ef99afdc025 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:11.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:11.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50db7fe640 1 -- 172.21.15.47:0/3484344015 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0005450 con 0x55dc28555850 2024-07-24T22:11:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50db7fe640 1 -- 172.21.15.47:0/3484344015 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f50f00134c0 con 0x55dc28555850 2024-07-24T22:11:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f5104d8f740 1 -- 172.21.15.47:0/3484344015 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50f001b070 con 0x55dc28555850 2024-07-24T22:11:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f50db7fe640 1 -- 172.21.15.47:0/3484344015 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f50f00055f0 con 0x55dc28555850 2024-07-24T22:11:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f5104d8f740 10 client.16365 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.857+0000 7f5104d8f740 1 -- 172.21.15.47:0/3484344015 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dc28570350 con 0x55dc28555850 2024-07-24T22:11:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.858+0000 7f50db7fe640 1 -- 172.21.15.47:0/3484344015 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50f001b070 con 0x55dc28555850 2024-07-24T22:11:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.858+0000 7f50db7fe640 1 -- 172.21.15.47:0/3484344015 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f50f000c070 con 0x55dc28555850 2024-07-24T22:11:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.858+0000 7f5104d8f740 10 client.16365 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.858+0000 7f5104d8f740 10 client.16365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.858+0000 7f5104d8f740 20 client.16365 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.858+0000 7f5104d8f740 1 --2- 172.21.15.47:0/3484344015 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dc285716a0 0x55dc28573a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.858+0000 7f5104d8f740 4 client.16365 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:11:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.858+0000 7f5104d8f740 1 -- 172.21.15.47:0/3484344015 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc284ce940 con 0x55dc285716a0 2024-07-24T22:11:11.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.858+0000 7f50fbfff640 1 --2- 172.21.15.47:0/3484344015 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dc285716a0 0x55dc28573a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.858+0000 7f50fbfff640 1 --2- 172.21.15.47:0/3484344015 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dc285716a0 0x55dc28573a90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7a284233e9c2ce9 server_cookie=ea462f8ba2a1e344 in_seq=0 out_seq=0 2024-07-24T22:11:11.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.858+0000 7f50db7fe640 10 client.16365 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:11.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.859+0000 7f50db7fe640 1 -- 172.21.15.47:0/3484344015 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc284ce940 con 0x55dc285716a0 2024-07-24T22:11:11.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.859+0000 7f50db7fe640 10 client.16365 handle_command_reply: tid=0 2024-07-24T22:11:11.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.859+0000 7f5104d8f740 1 client.16365 shutdown 2024-07-24T22:11:11.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.859+0000 7f5104d8f740 1 -- 172.21.15.47:0/3484344015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 msgr2=0x55dc2855ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:11.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.859+0000 7f5104d8f740 1 --2- 172.21.15.47:0/3484344015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 0x55dc2855ece0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009980 tx=0x7f50f0009d80 comp rx=0 tx=0).stop 2024-07-24T22:11:11.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.859+0000 7f5104d8f740 1 -- 172.21.15.47:0/3484344015 shutdown_connections 2024-07-24T22:11:11.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.859+0000 7f5104d8f740 1 --2- 172.21.15.47:0/3484344015 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dc285716a0 0x55dc28573a90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.859+0000 7f5104d8f740 1 --2- 172.21.15.47:0/3484344015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 0x55dc2855f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.859+0000 7f5104d8f740 1 --2- 172.21.15.47:0/3484344015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 0x55dc2855ece0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.859+0000 7f50db7fe640 0 client.16365 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:11.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.859+0000 7f5104d8f740 1 --2- 172.21.15.47:0/3484344015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28554f30 0x55dc2855e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.859+0000 7f5104d8f740 1 -- 172.21.15.47:0/3484344015 >> 172.21.15.47:0/3484344015 conn(0x55dc28552d60 msgr2=0x55dc28558900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:11.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.860+0000 7f5104d8f740 1 -- 172.21.15.47:0/3484344015 shutdown_connections 2024-07-24T22:11:11.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.860+0000 7f5104d8f740 1 -- 172.21.15.47:0/3484344015 wait complete. 2024-07-24T22:11:11.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.860+0000 7f5104d8f740 20 client.16365 trim_cache size 0 max 16384 2024-07-24T22:11:11.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.878+0000 7f5104d8f740 1 Processor -- start 2024-07-24T22:11:11.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.878+0000 7f5104d8f740 1 -- start start 2024-07-24T22:11:11.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5104d8f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc28554f30 0x55dc28560440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5104d8f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28555850 0x55dc28558780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5104d8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc285617e0 0x55dc28579110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5104d8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc1ae280 con 0x55dc285617e0 2024-07-24T22:11:11.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5104d8f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc1b0b00 con 0x55dc28555850 2024-07-24T22:11:11.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5104d8f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc1ae8f0 con 0x55dc28554f30 2024-07-24T22:11:11.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5100f7b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc285617e0 0x55dc28579110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5100f7b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc285617e0 0x55dc28579110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57846/0 (socket says 172.21.15.47:57846) 2024-07-24T22:11:11.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5100f7b640 1 -- 172.21.15.47:0/1103669538 learned_addr learned my addr 172.21.15.47:0/1103669538 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:11.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/1103669538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28555850 0x55dc28558780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f50fbfff640 1 --2- 172.21.15.47:0/1103669538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc28554f30 0x55dc28560440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5100f7b640 1 -- 172.21.15.47:0/1103669538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc28554f30 msgr2=0x55dc28560440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:11.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5100f7b640 1 --2- 172.21.15.47:0/1103669538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc28554f30 0x55dc28560440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5100f7b640 1 -- 172.21.15.47:0/1103669538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28555850 msgr2=0x55dc28558780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:11.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5100f7b640 1 --2- 172.21.15.47:0/1103669538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28555850 0x55dc28558780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5100f7b640 1 -- 172.21.15.47:0/1103669538 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc2854e620 con 0x55dc285617e0 2024-07-24T22:11:11.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/1103669538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28555850 0x55dc28558780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:11:11.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f5100f7b640 1 --2- 172.21.15.47:0/1103669538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc285617e0 0x55dc28579110 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f50f4004af0 tx=0x7f50f40cc8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e622ed7965a14e2c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:11.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f50e1ffb640 1 -- 172.21.15.47:0/1103669538 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f40d07a0 con 0x55dc285617e0 2024-07-24T22:11:11.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f50e1ffb640 1 -- 172.21.15.47:0/1103669538 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50f4036040 con 0x55dc285617e0 2024-07-24T22:11:11.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.879+0000 7f50e1ffb640 1 -- 172.21.15.47:0/1103669538 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f40cc400 con 0x55dc285617e0 2024-07-24T22:11:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.880+0000 7f5104d8f740 1 -- 172.21.15.47:0/1103669538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc285617e0 msgr2=0x55dc28579110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.880+0000 7f5104d8f740 1 --2- 172.21.15.47:0/1103669538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc285617e0 0x55dc28579110 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f50f4004af0 tx=0x7f50f40cc8a0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.880+0000 7f5104d8f740 1 -- 172.21.15.47:0/1103669538 shutdown_connections 2024-07-24T22:11:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.880+0000 7f5104d8f740 1 --2- 172.21.15.47:0/1103669538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc285617e0 0x55dc28579110 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.880+0000 7f5104d8f740 1 --2- 172.21.15.47:0/1103669538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28555850 0x55dc28558780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.880+0000 7f5104d8f740 1 --2- 172.21.15.47:0/1103669538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc28554f30 0x55dc28560440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.880+0000 7f5104d8f740 1 -- 172.21.15.47:0/1103669538 >> 172.21.15.47:0/1103669538 conn(0x55dc28552d60 msgr2=0x55dc28558070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.880+0000 7f5104d8f740 1 -- 172.21.15.47:0/1103669538 shutdown_connections 2024-07-24T22:11:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.880+0000 7f5104d8f740 1 -- 172.21.15.47:0/1103669538 wait complete. 2024-07-24T22:11:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.880+0000 7f5104d8f740 1 -- start start 2024-07-24T22:11:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f5104d8f740 1 Processor -- start 2024-07-24T22:11:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f5104d8f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28554f30 0x55dc28569dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f5104d8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 0x55dc28566660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f5104d8f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 0x55dc28566c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f5104d8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc1aefc0 con 0x55dc28555850 2024-07-24T22:11:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f5104d8f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc1b0430 con 0x55dc28554f30 2024-07-24T22:11:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f5104d8f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc1af690 con 0x55dc285617e0 2024-07-24T22:11:11.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f5104d8f740 10 client.0 _ll_register_callbacks cb 0x7f50f0013de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f50fb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 0x55dc28566660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f50fb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 0x55dc28566660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57848/0 (socket says 172.21.15.47:57848) 2024-07-24T22:11:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f50fb7fe640 1 -- 172.21.15.47:0/1526196539 learned_addr learned my addr 172.21.15.47:0/1526196539 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f50fbfff640 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28554f30 0x55dc28569dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f5100f7b640 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 0x55dc28566c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f50fb7fe640 1 -- 172.21.15.47:0/1526196539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 msgr2=0x55dc28566c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 0x55dc28566c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f50fb7fe640 1 -- 172.21.15.47:0/1526196539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28554f30 msgr2=0x55dc28569dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28554f30 0x55dc28569dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f50fb7fe640 1 -- 172.21.15.47:0/1526196539 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc28567450 con 0x55dc28555850 2024-07-24T22:11:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f5100f7b640 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 0x55dc28566c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:11:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.881+0000 7f50fb7fe640 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 0x55dc28566660 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f50f00155a0 tx=0x7f50f0012490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e0aa9fb6449c13 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:11.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f50db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:11.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f50db7fe640 1 -- 172.21.15.47:0/1526196539 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0036060 con 0x55dc28555850 2024-07-24T22:11:11.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f50db7fe640 1 -- 172.21.15.47:0/1526196539 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f50f0004620 con 0x55dc28555850 2024-07-24T22:11:11.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f5104d8f740 1 -- 172.21.15.47:0/1526196539 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50f4036040 con 0x55dc28555850 2024-07-24T22:11:11.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f50db7fe640 1 -- 172.21.15.47:0/1526196539 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f50f0004820 con 0x55dc28555850 2024-07-24T22:11:11.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f5104d8f740 10 client.16371 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:11.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f5104d8f740 1 -- 172.21.15.47:0/1526196539 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dc285dd210 con 0x55dc28555850 2024-07-24T22:11:11.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f50db7fe640 1 -- 172.21.15.47:0/1526196539 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50f4036040 con 0x55dc28555850 2024-07-24T22:11:11.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f50db7fe640 1 -- 172.21.15.47:0/1526196539 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f50f000c040 con 0x55dc28555850 2024-07-24T22:11:11.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f5104d8f740 10 client.16371 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:11.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f5104d8f740 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:11.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f5104d8f740 20 client.16371 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:11.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f5104d8f740 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dc285dd870 0x55dc285dfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:11.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f5104d8f740 4 client.16371 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:11:11.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.882+0000 7f5104d8f740 1 -- 172.21.15.47:0/1526196539 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dc284ca3e0 con 0x55dc285dd870 2024-07-24T22:11:11.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.883+0000 7f50fbfff640 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dc285dd870 0x55dc285dfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:11.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.883+0000 7f50db7fe640 10 client.16371 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:11.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.883+0000 7f50fbfff640 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dc285dd870 0x55dc285dfc60 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6b0f9ce3eff57b8 server_cookie=8f1f8e4604ef5096 in_seq=0 out_seq=0 2024-07-24T22:11:11.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f50db7fe640 1 -- 172.21.15.47:0/1526196539 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dc284ca3e0 con 0x55dc285dd870 2024-07-24T22:11:11.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f50db7fe640 10 client.16371 handle_command_reply: tid=0 2024-07-24T22:11:11.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f5104d8f740 1 client.16371 shutdown 2024-07-24T22:11:11.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f5104d8f740 1 -- 172.21.15.47:0/1526196539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 msgr2=0x55dc28566660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:11.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f5104d8f740 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 0x55dc28566660 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f50f00155a0 tx=0x7f50f0012490 comp rx=0 tx=0).stop 2024-07-24T22:11:11.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f5104d8f740 1 -- 172.21.15.47:0/1526196539 shutdown_connections 2024-07-24T22:11:11.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f5104d8f740 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dc285dd870 0x55dc285dfc60 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f5104d8f740 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc285617e0 0x55dc28566c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f5104d8f740 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dc28555850 0x55dc28566660 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f5104d8f740 1 --2- 172.21.15.47:0/1526196539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dc28554f30 0x55dc28569dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f5104d8f740 1 -- 172.21.15.47:0/1526196539 >> 172.21.15.47:0/1526196539 conn(0x55dc28552d60 msgr2=0x55dc28558890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:11.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f50db7fe640 0 client.16371 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:11.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f5104d8f740 1 -- 172.21.15.47:0/1526196539 shutdown_connections 2024-07-24T22:11:11.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f5104d8f740 1 -- 172.21.15.47:0/1526196539 wait complete. 2024-07-24T22:11:11.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.884+0000 7f5104d8f740 20 client.16371 trim_cache size 0 max 16384 2024-07-24T22:11:11.892 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:11:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:11:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "48f99953-b583-4ff5-942b-0367dac46c16", 2024-07-24T22:11:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:11:11.893 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:11:11.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.885+0000 7f51029de640 1 -- 172.21.15.47:0/3908438491 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50e40b3d40 msgr2=0x7f50e40b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:11.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.885+0000 7f51029de640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50e40b3d40 0x7f50e40b6200 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55dc28553c40 tx=0x7f50ec00a2d0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.885+0000 7f51029de640 1 -- 172.21.15.47:0/3908438491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50fc108b20 msgr2=0x7f50fc075910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:11.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.885+0000 7f51029de640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50fc108b20 0x7f50fc075910 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f50f4005cc0 tx=0x7f50f402f380 comp rx=0 tx=0).stop 2024-07-24T22:11:11.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.885+0000 7f51029de640 1 -- 172.21.15.47:0/3908438491 shutdown_connections 2024-07-24T22:11:11.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.885+0000 7f51029de640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50e40b3d40 0x7f50e40b6200 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.885+0000 7f51029de640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50fc108b20 0x7f50fc075910 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.885+0000 7f51029de640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50fc1081a0 0x7f50fc0753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.885+0000 7f51029de640 1 --2- 172.21.15.47:0/3908438491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50fc102790 0x7f50fc074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:11.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.885+0000 7f51029de640 1 -- 172.21.15.47:0/3908438491 >> 172.21.15.47:0/3908438491 conn(0x7f50fc0fe200 msgr2=0x7f50fc1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:11.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.885+0000 7f51029de640 1 -- 172.21.15.47:0/3908438491 shutdown_connections 2024-07-24T22:11:11.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:11.885+0000 7f51029de640 1 -- 172.21.15.47:0/3908438491 wait complete. 2024-07-24T22:11:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:12 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:11:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:12 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:11:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:12 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:11:12.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:12 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:11:12.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:12 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:11:12.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:12 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:11:12.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:12 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:11:12.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:12 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:11:12.783 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:11:12.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:12 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:11:12.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:12 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:11:12.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:12 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:11:12.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:12 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:11:13.099 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:11:13.622 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:13 smithi047 ceph-mon[32551]: pgmap v486: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 16 KiB/s rd, 52 MiB/s wr, 64 op/s 2024-07-24T22:11:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:13 smithi183 ceph-mon[37007]: pgmap v486: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 16 KiB/s rd, 52 MiB/s wr, 64 op/s 2024-07-24T22:11:13.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:13 smithi188 ceph-mon[37380]: pgmap v486: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 16 KiB/s rd, 52 MiB/s wr, 64 op/s 2024-07-24T22:11:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.325+0000 7f2d74d60640 1 -- 172.21.15.47:0/2316507174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d70106fd0 msgr2=0x7f2d70107410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.325+0000 7f2d74d60640 1 --2- 172.21.15.47:0/2316507174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d70106fd0 0x7f2d70107410 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009900 tx=0x7f2d5802a410 comp rx=0 tx=0).stop 2024-07-24T22:11:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.325+0000 7f2d74d60640 1 -- 172.21.15.47:0/2316507174 shutdown_connections 2024-07-24T22:11:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.325+0000 7f2d74d60640 1 --2- 172.21.15.47:0/2316507174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d70107950 0x7f2d7010e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.325+0000 7f2d74d60640 1 --2- 172.21.15.47:0/2316507174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d70106fd0 0x7f2d70107410 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.325+0000 7f2d74d60640 1 --2- 172.21.15.47:0/2316507174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2d701015d0 0x7f2d701019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.325+0000 7f2d74d60640 1 -- 172.21.15.47:0/2316507174 >> 172.21.15.47:0/2316507174 conn(0x7f2d700fd030 msgr2=0x7f2d700ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.325+0000 7f2d74d60640 1 -- 172.21.15.47:0/2316507174 shutdown_connections 2024-07-24T22:11:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.325+0000 7f2d74d60640 1 -- 172.21.15.47:0/2316507174 wait complete. 2024-07-24T22:11:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.326+0000 7f2d74d60640 1 Processor -- start 2024-07-24T22:11:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.326+0000 7f2d74d60640 1 -- start start 2024-07-24T22:11:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.326+0000 7f2d74d60640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d701015d0 0x7f2d700fd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.326+0000 7f2d74d60640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d70106fd0 0x7f2d700fda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.326+0000 7f2d74d60640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2d70107950 0x7f2d700fdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d74d60640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2d70111590 con 0x7f2d701015d0 2024-07-24T22:11:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d74d60640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2d70111410 con 0x7f2d70106fd0 2024-07-24T22:11:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d74d60640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2d70111710 con 0x7f2d70107950 2024-07-24T22:11:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d6e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d701015d0 0x7f2d700fd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d6e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d701015d0 0x7f2d700fd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57864/0 (socket says 172.21.15.47:57864) 2024-07-24T22:11:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d6e59c640 1 -- 172.21.15.47:0/1453129473 learned_addr learned my addr 172.21.15.47:0/1453129473 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d65d9b640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d70106fd0 0x7f2d700fda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d6ed9d640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2d70107950 0x7f2d700fdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d6e59c640 1 -- 172.21.15.47:0/1453129473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2d70107950 msgr2=0x7f2d700fdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d6e59c640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2d70107950 0x7f2d700fdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d6e59c640 1 -- 172.21.15.47:0/1453129473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d70106fd0 msgr2=0x7f2d700fda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d6e59c640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d70106fd0 0x7f2d700fda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d6e59c640 1 -- 172.21.15.47:0/1453129473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d701a7070 con 0x7f2d701015d0 2024-07-24T22:11:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.327+0000 7f2d6e59c640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d701015d0 0x7f2d700fd530 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000d770 tx=0x7f2d6000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.328+0000 7f2d67fff640 1 -- 172.21.15.47:0/1453129473 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60017070 con 0x7f2d701015d0 2024-07-24T22:11:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.328+0000 7f2d67fff640 1 -- 172.21.15.47:0/1453129473 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d600054d0 con 0x7f2d701015d0 2024-07-24T22:11:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.328+0000 7f2d74d60640 1 -- 172.21.15.47:0/1453129473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d701a7360 con 0x7f2d701015d0 2024-07-24T22:11:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.328+0000 7f2d67fff640 1 -- 172.21.15.47:0/1453129473 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60004c30 con 0x7f2d701015d0 2024-07-24T22:11:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.328+0000 7f2d74d60640 1 -- 172.21.15.47:0/1453129473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d701a7830 con 0x7f2d701015d0 2024-07-24T22:11:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.330+0000 7f2d67fff640 1 -- 172.21.15.47:0/1453129473 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f2d60004e10 con 0x7f2d701015d0 2024-07-24T22:11:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.331+0000 7f2d77b8f740 1 Processor -- start 2024-07-24T22:11:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.331+0000 7f2d77b8f740 1 -- start start 2024-07-24T22:11:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.331+0000 7f2d77b8f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d0c90 0x564b272d1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.331+0000 7f2d77b8f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d15b0 0x564b272dd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.331+0000 7f2d77b8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 0x564b272df930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.331+0000 7f2d77b8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564b27246280 con 0x564b272dd540 2024-07-24T22:11:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.331+0000 7f2d77b8f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564b27235780 con 0x564b272d0c90 2024-07-24T22:11:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.331+0000 7f2d77b8f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564b272397c0 con 0x564b272d15b0 2024-07-24T22:11:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.331+0000 7f2d65d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 0x564b272df930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.331+0000 7f2d65d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 0x564b272df930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57874/0 (socket says 172.21.15.47:57874) 2024-07-24T22:11:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.331+0000 7f2d65d9b640 1 -- 172.21.15.47:0/2659557513 learned_addr learned my addr 172.21.15.47:0/2659557513 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.331+0000 7f2d6ed9d640 1 --2- 172.21.15.47:0/2659557513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d0c90 0x564b272d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d67fff640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2d5c0b3d40 0x7f2d5c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d6e59c640 1 --2- 172.21.15.47:0/2659557513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d15b0 0x564b272dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d6ed9d640 1 -- 172.21.15.47:0/2659557513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d15b0 msgr2=0x564b272dd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d6ed9d640 1 --2- 172.21.15.47:0/2659557513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d15b0 0x564b272dd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d6ed9d640 1 -- 172.21.15.47:0/2659557513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 msgr2=0x564b272df930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d6ed9d640 1 --2- 172.21.15.47:0/2659557513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 0x564b272df930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d6ed9d640 1 -- 172.21.15.47:0/2659557513 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b26f99790 con 0x564b272d0c90 2024-07-24T22:11:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d65d9b640 1 --2- 172.21.15.47:0/2659557513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 0x564b272df930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:11:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d6ed9d640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2d5c0b3d40 0x7f2d5c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d67fff640 1 -- 172.21.15.47:0/1453129473 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f2d600e3ad0 con 0x7f2d701015d0 2024-07-24T22:11:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d6ed9d640 1 --2- 172.21.15.47:0/2659557513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d0c90 0x564b272d1070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2d68010440 tx=0x7f2d68010900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef1ef6d3f7459cb2 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d64d99640 1 -- 172.21.15.47:0/2659557513 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68003970 con 0x564b272d0c90 2024-07-24T22:11:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d64d99640 1 -- 172.21.15.47:0/2659557513 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d680134c0 con 0x564b272d0c90 2024-07-24T22:11:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.332+0000 7f2d64d99640 1 -- 172.21.15.47:0/2659557513 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6801d400 con 0x564b272d0c90 2024-07-24T22:11:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.333+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2659557513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d0c90 msgr2=0x564b272d1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.333+0000 7f2d6ed9d640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2d5c0b3d40 0x7f2d5c0b6200 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2d68021000 tx=0x7f2d6801e000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.333+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2659557513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d0c90 0x564b272d1070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2d68010440 tx=0x7f2d68010900 comp rx=0 tx=0).stop 2024-07-24T22:11:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.333+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2659557513 shutdown_connections 2024-07-24T22:11:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.333+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2659557513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 0x564b272df930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.333+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2659557513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d15b0 0x564b272dd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.333+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2659557513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d0c90 0x564b272d1070 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.333+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2659557513 >> 172.21.15.47:0/2659557513 conn(0x564b272ceac0 msgr2=0x564b272cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.333+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2659557513 shutdown_connections 2024-07-24T22:11:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.333+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2659557513 wait complete. 2024-07-24T22:11:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.333+0000 7f2d77b8f740 1 -- start start 2024-07-24T22:11:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d77b8f740 1 Processor -- start 2024-07-24T22:11:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d77b8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 0x564b272dcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d77b8f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d15b0 0x564b272da130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d77b8f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272dd540 0x564b272da670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d77b8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564b2716fab0 con 0x564b272d0c90 2024-07-24T22:11:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d77b8f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564b271bd9e0 con 0x564b272d15b0 2024-07-24T22:11:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d77b8f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564b272e0220 con 0x564b272dd540 2024-07-24T22:11:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d77b8f740 10 client.0 _ll_register_callbacks cb 0x564b26f45a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d6e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 0x564b272dcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d6e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 0x564b272dcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57884/0 (socket says 172.21.15.47:57884) 2024-07-24T22:11:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d6e59c640 1 -- 172.21.15.47:0/2662386469 learned_addr learned my addr 172.21.15.47:0/2662386469 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d6ed9d640 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272dd540 0x564b272da670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d65d9b640 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d15b0 0x564b272da130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d6e59c640 1 -- 172.21.15.47:0/2662386469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272dd540 msgr2=0x564b272da670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d6e59c640 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272dd540 0x564b272da670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d6e59c640 1 -- 172.21.15.47:0/2662386469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d15b0 msgr2=0x564b272da130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d6e59c640 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d15b0 0x564b272da130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d6e59c640 1 -- 172.21.15.47:0/2662386469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b27012620 con 0x564b272d0c90 2024-07-24T22:11:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d65d9b640 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d15b0 0x564b272da130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:11:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d6e59c640 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 0x564b272dcc50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2d600a6ef0 tx=0x7f2d600aa080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f476e1627fb65ade server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.334+0000 7f2d55ffb640 1 -- 172.21.15.47:0/2662386469 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60020070 con 0x564b272d0c90 2024-07-24T22:11:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d55ffb640 1 -- 172.21.15.47:0/2662386469 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f2d600e1440 con 0x564b272d0c90 2024-07-24T22:11:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2662386469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564b271e4ce0 con 0x564b272d0c90 2024-07-24T22:11:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d55ffb640 1 -- 172.21.15.47:0/2662386469 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2d600e1640 con 0x564b272d0c90 2024-07-24T22:11:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d77b8f740 10 client.16383 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2662386469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564b272eb9d0 con 0x564b272d0c90 2024-07-24T22:11:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d55ffb640 1 -- 172.21.15.47:0/2662386469 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564b271e4ce0 con 0x564b272d0c90 2024-07-24T22:11:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d55ffb640 1 -- 172.21.15.47:0/2662386469 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2d600b32a0 con 0x564b272d0c90 2024-07-24T22:11:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d77b8f740 10 client.16383 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d77b8f740 10 client.16383 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d77b8f740 20 client.16383 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b272ece90 0x564b272ef280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d77b8f740 4 client.16383 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:11:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2662386469 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b272481d0 con 0x564b272ece90 2024-07-24T22:11:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.335+0000 7f2d65d9b640 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b272ece90 0x564b272ef280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.336+0000 7f2d55ffb640 10 client.16383 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.336+0000 7f2d65d9b640 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b272ece90 0x564b272ef280 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41bd5b8866945757 server_cookie=cab8049d43910ccf in_seq=0 out_seq=0 2024-07-24T22:11:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.336+0000 7f2d55ffb640 1 -- 172.21.15.47:0/2662386469 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b272481d0 con 0x564b272ece90 2024-07-24T22:11:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.336+0000 7f2d55ffb640 10 client.16383 handle_command_reply: tid=0 2024-07-24T22:11:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.336+0000 7f2d77b8f740 1 client.16383 shutdown 2024-07-24T22:11:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.337+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2662386469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 msgr2=0x564b272dcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.337+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 0x564b272dcc50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2d600a6ef0 tx=0x7f2d600aa080 comp rx=0 tx=0).stop 2024-07-24T22:11:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.337+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2662386469 shutdown_connections 2024-07-24T22:11:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.337+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b272ece90 0x564b272ef280 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.337+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272dd540 0x564b272da670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.337+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d15b0 0x564b272da130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.337+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2662386469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 0x564b272dcc50 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.337+0000 7f2d55ffb640 0 client.16383 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.337+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2662386469 >> 172.21.15.47:0/2662386469 conn(0x564b272ceac0 msgr2=0x564b272d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.337+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2662386469 shutdown_connections 2024-07-24T22:11:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.337+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2662386469 wait complete. 2024-07-24T22:11:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.337+0000 7f2d77b8f740 20 client.16383 trim_cache size 0 max 16384 2024-07-24T22:11:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d77b8f740 1 Processor -- start 2024-07-24T22:11:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d77b8f740 1 -- start start 2024-07-24T22:11:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d77b8f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d0c90 0x564b272d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d77b8f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d15b0 0x564b272dcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d77b8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 0x564b272f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d77b8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701ae2a0 con 0x564b272dd540 2024-07-24T22:11:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d77b8f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701b0b20 con 0x564b272d15b0 2024-07-24T22:11:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d77b8f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701ae910 con 0x564b272d0c90 2024-07-24T22:11:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d6ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 0x564b272f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d6ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 0x564b272f4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57894/0 (socket says 172.21.15.47:57894) 2024-07-24T22:11:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d6ed9d640 1 -- 172.21.15.47:0/2968599827 learned_addr learned my addr 172.21.15.47:0/2968599827 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d6e59c640 1 --2- 172.21.15.47:0/2968599827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d0c90 0x564b272d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d65d9b640 1 --2- 172.21.15.47:0/2968599827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d15b0 0x564b272dcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d6ed9d640 1 -- 172.21.15.47:0/2968599827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d0c90 msgr2=0x564b272d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d6ed9d640 1 --2- 172.21.15.47:0/2968599827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d0c90 0x564b272d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d6ed9d640 1 -- 172.21.15.47:0/2968599827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d15b0 msgr2=0x564b272dcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d6ed9d640 1 --2- 172.21.15.47:0/2968599827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d15b0 0x564b272dcb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.353+0000 7f2d6ed9d640 1 -- 172.21.15.47:0/2968599827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b272ef5f0 con 0x564b272dd540 2024-07-24T22:11:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.354+0000 7f2d6ed9d640 1 --2- 172.21.15.47:0/2968599827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 0x564b272f4af0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2d68006010 tx=0x7f2d680093c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75daa51273adeffb server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.354+0000 7f2d57fff640 1 -- 172.21.15.47:0/2968599827 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d680134c0 con 0x564b272dd540 2024-07-24T22:11:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.354+0000 7f2d57fff640 1 -- 172.21.15.47:0/2968599827 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d6801dc50 con 0x564b272dd540 2024-07-24T22:11:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.354+0000 7f2d57fff640 1 -- 172.21.15.47:0/2968599827 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68004d00 con 0x564b272dd540 2024-07-24T22:11:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.354+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2968599827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 msgr2=0x564b272f4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.354+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2968599827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 0x564b272f4af0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2d68006010 tx=0x7f2d680093c0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2968599827 shutdown_connections 2024-07-24T22:11:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2968599827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272dd540 0x564b272f4af0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2968599827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272d15b0 0x564b272dcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/2968599827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d0c90 0x564b272d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2968599827 >> 172.21.15.47:0/2968599827 conn(0x564b272ceac0 msgr2=0x564b272cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2968599827 shutdown_connections 2024-07-24T22:11:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 -- 172.21.15.47:0/2968599827 wait complete. 2024-07-24T22:11:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 -- start start 2024-07-24T22:11:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 Processor -- start 2024-07-24T22:11:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 0x564b272e0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d15b0 0x564b272e0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272dd540 0x564b27355ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701aefe0 con 0x564b272d0c90 2024-07-24T22:11:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701b0450 con 0x564b272dd540 2024-07-24T22:11:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701af6b0 con 0x564b272d15b0 2024-07-24T22:11:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.355+0000 7f2d77b8f740 10 client.0 _ll_register_callbacks cb 0x7f2d60009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d6e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 0x564b272e0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d6e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 0x564b272e0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57896/0 (socket says 172.21.15.47:57896) 2024-07-24T22:11:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d6e59c640 1 -- 172.21.15.47:0/1414697260 learned_addr learned my addr 172.21.15.47:0/1414697260 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d65d9b640 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d15b0 0x564b272e0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d6ed9d640 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272dd540 0x564b27355ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d6e59c640 1 -- 172.21.15.47:0/1414697260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d15b0 msgr2=0x564b272e0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d6e59c640 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d15b0 0x564b272e0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d6e59c640 1 -- 172.21.15.47:0/1414697260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272dd540 msgr2=0x564b27355ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d6e59c640 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272dd540 0x564b27355ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d6e59c640 1 -- 172.21.15.47:0/1414697260 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b27356070 con 0x564b272d0c90 2024-07-24T22:11:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d6ed9d640 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272dd540 0x564b27355ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:11:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d6e59c640 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 0x564b272e0a80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009f40 tx=0x7f2d600a9fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211c3fe786de94ae server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d55ffb640 1 -- 172.21.15.47:0/1414697260 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d600aec80 con 0x564b272d0c90 2024-07-24T22:11:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d55ffb640 1 -- 172.21.15.47:0/1414697260 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f2d600a69c0 con 0x564b272d0c90 2024-07-24T22:11:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d77b8f740 1 -- 172.21.15.47:0/1414697260 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d6801dc50 con 0x564b272d0c90 2024-07-24T22:11:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d55ffb640 1 -- 172.21.15.47:0/1414697260 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2d600de050 con 0x564b272d0c90 2024-07-24T22:11:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d77b8f740 10 client.16389 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.356+0000 7f2d77b8f740 1 -- 172.21.15.47:0/1414697260 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564b27357360 con 0x564b272d0c90 2024-07-24T22:11:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.357+0000 7f2d55ffb640 1 -- 172.21.15.47:0/1414697260 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d6801dc50 con 0x564b272d0c90 2024-07-24T22:11:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.357+0000 7f2d55ffb640 1 -- 172.21.15.47:0/1414697260 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2d600a9990 con 0x564b272d0c90 2024-07-24T22:11:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.357+0000 7f2d77b8f740 10 client.16389 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.357+0000 7f2d77b8f740 10 client.16389 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.357+0000 7f2d77b8f740 20 client.16389 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.357+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b27357a50 0x564b27359e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.357+0000 7f2d77b8f740 4 client.16389 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:11:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.357+0000 7f2d77b8f740 1 -- 172.21.15.47:0/1414697260 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564b27243c70 con 0x564b27357a50 2024-07-24T22:11:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.357+0000 7f2d65d9b640 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b27357a50 0x564b27359e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.358+0000 7f2d65d9b640 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b27357a50 0x564b27359e40 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17da61e4a538d551 server_cookie=a213ad9d6b8a39d2 in_seq=0 out_seq=0 2024-07-24T22:11:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.358+0000 7f2d55ffb640 10 client.16389 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.368+0000 7f2d55ffb640 1 -- 172.21.15.47:0/1414697260 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564b27243c70 con 0x564b27357a50 2024-07-24T22:11:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.368+0000 7f2d55ffb640 10 client.16389 handle_command_reply: tid=0 2024-07-24T22:11:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.368+0000 7f2d77b8f740 1 client.16389 shutdown 2024-07-24T22:11:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.368+0000 7f2d77b8f740 1 -- 172.21.15.47:0/1414697260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 msgr2=0x564b272e0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.368+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 0x564b272e0a80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009f40 tx=0x7f2d600a9fb0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.368+0000 7f2d77b8f740 1 -- 172.21.15.47:0/1414697260 shutdown_connections 2024-07-24T22:11:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.368+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564b27357a50 0x564b27359e40 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.368+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b272dd540 0x564b27355ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.368+0000 7f2d55ffb640 0 client.16389 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.368+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564b272d15b0 0x564b272e0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.368+0000 7f2d77b8f740 1 --2- 172.21.15.47:0/1414697260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564b272d0c90 0x564b272e0a80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.368+0000 7f2d77b8f740 1 -- 172.21.15.47:0/1414697260 >> 172.21.15.47:0/1414697260 conn(0x564b272ceac0 msgr2=0x564b272d4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d77b8f740 1 -- 172.21.15.47:0/1414697260 shutdown_connections 2024-07-24T22:11:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d77b8f740 1 -- 172.21.15.47:0/1414697260 wait complete. 2024-07-24T22:11:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d77b8f740 20 client.16389 trim_cache size 0 max 16384 2024-07-24T22:11:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:11:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:11:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:11:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:11:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d74d60640 1 -- 172.21.15.47:0/1453129473 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2d5c0b3d40 msgr2=0x7f2d5c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d74d60640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2d5c0b3d40 0x7f2d5c0b6200 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2d68021000 tx=0x7f2d6801e000 comp rx=0 tx=0).stop 2024-07-24T22:11:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d74d60640 1 -- 172.21.15.47:0/1453129473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d701015d0 msgr2=0x7f2d700fd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d74d60640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d701015d0 0x7f2d700fd530 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000d770 tx=0x7f2d6000dc30 comp rx=0 tx=0).stop 2024-07-24T22:11:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d74d60640 1 -- 172.21.15.47:0/1453129473 shutdown_connections 2024-07-24T22:11:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d74d60640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2d5c0b3d40 0x7f2d5c0b6200 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d74d60640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2d70107950 0x7f2d700fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d74d60640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d70106fd0 0x7f2d700fda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d74d60640 1 --2- 172.21.15.47:0/1453129473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d701015d0 0x7f2d700fd530 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d74d60640 1 -- 172.21.15.47:0/1453129473 >> 172.21.15.47:0/1453129473 conn(0x7f2d700fd030 msgr2=0x7f2d700fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:14.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d74d60640 1 -- 172.21.15.47:0/1453129473 shutdown_connections 2024-07-24T22:11:14.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:14.369+0000 7f2d74d60640 1 -- 172.21.15.47:0/1453129473 wait complete. 2024-07-24T22:11:14.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.889+0000 7fbdb221e640 1 -- 172.21.15.47:0/3136148098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdac1081a0 msgr2=0x7fbdac1085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.889+0000 7fbdb221e640 1 --2- 172.21.15.47:0/3136148098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdac1081a0 0x7fbdac1085e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009900 tx=0x7fbda002a410 comp rx=0 tx=0).stop 2024-07-24T22:11:14.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.890+0000 7fbdb221e640 1 -- 172.21.15.47:0/3136148098 shutdown_connections 2024-07-24T22:11:14.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.890+0000 7fbdb221e640 1 --2- 172.21.15.47:0/3136148098 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdac108b20 0x7fbdac10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.890+0000 7fbdb221e640 1 --2- 172.21.15.47:0/3136148098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdac1081a0 0x7fbdac1085e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.890+0000 7fbdb221e640 1 --2- 172.21.15.47:0/3136148098 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdac102790 0x7fbdac102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.890+0000 7fbdb221e640 1 -- 172.21.15.47:0/3136148098 >> 172.21.15.47:0/3136148098 conn(0x7fbdac0fe200 msgr2=0x7fbdac100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:14.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.890+0000 7fbdb221e640 1 -- 172.21.15.47:0/3136148098 shutdown_connections 2024-07-24T22:11:14.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.890+0000 7fbdb221e640 1 -- 172.21.15.47:0/3136148098 wait complete. 2024-07-24T22:11:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.890+0000 7fbdb221e640 1 Processor -- start 2024-07-24T22:11:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdb221e640 1 -- start start 2024-07-24T22:11:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdb221e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdac102790 0x7fbdac198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdb221e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdac1081a0 0x7fbdac199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdb221e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdac108b20 0x7fbdac19e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdb221e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac112730 con 0x7fbdac108b20 2024-07-24T22:11:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdb221e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1125b0 con 0x7fbdac1081a0 2024-07-24T22:11:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdb221e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1128b0 con 0x7fbdac102790 2024-07-24T22:11:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdabfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdac108b20 0x7fbdac19e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdab7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdac102790 0x7fbdac198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdabfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdac108b20 0x7fbdac19e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39582/0 (socket says 172.21.15.47:39582) 2024-07-24T22:11:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdab7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdac102790 0x7fbdac198c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:41286/0 (socket says 172.21.15.47:41286) 2024-07-24T22:11:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdabfff640 1 -- 172.21.15.47:0/4189623534 learned_addr learned my addr 172.21.15.47:0/4189623534 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdaaffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdac1081a0 0x7fbdac199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdabfff640 1 -- 172.21.15.47:0/4189623534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdac102790 msgr2=0x7fbdac198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdabfff640 1 --2- 172.21.15.47:0/4189623534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdac102790 0x7fbdac198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdabfff640 1 -- 172.21.15.47:0/4189623534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdac1081a0 msgr2=0x7fbdac199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdabfff640 1 --2- 172.21.15.47:0/4189623534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdac1081a0 0x7fbdac199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdabfff640 1 -- 172.21.15.47:0/4189623534 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdac19ecb0 con 0x7fbdac108b20 2024-07-24T22:11:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.891+0000 7fbdabfff640 1 --2- 172.21.15.47:0/4189623534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdac108b20 0x7fbdac19e4e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbda400eaa0 tx=0x7fbda400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.892+0000 7fbda8ff9640 1 -- 172.21.15.47:0/4189623534 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda400cdb0 con 0x7fbdac108b20 2024-07-24T22:11:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.892+0000 7fbda8ff9640 1 -- 172.21.15.47:0/4189623534 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbda4005020 con 0x7fbdac108b20 2024-07-24T22:11:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.892+0000 7fbda8ff9640 1 -- 172.21.15.47:0/4189623534 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda40116d0 con 0x7fbdac108b20 2024-07-24T22:11:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.892+0000 7fbdb221e640 1 -- 172.21.15.47:0/4189623534 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdac19efa0 con 0x7fbdac108b20 2024-07-24T22:11:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.892+0000 7fbdb221e640 1 -- 172.21.15.47:0/4189623534 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdac1a5660 con 0x7fbdac108b20 2024-07-24T22:11:14.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.894+0000 7fbda8ff9640 1 -- 172.21.15.47:0/4189623534 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fbda40051d0 con 0x7fbdac108b20 2024-07-24T22:11:14.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.894+0000 7fbdb45cf740 1 Processor -- start 2024-07-24T22:11:14.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.894+0000 7fbdb45cf740 1 -- start start 2024-07-24T22:11:14.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdb45cf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba76b0 0x55b51dba7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdb45cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba7fd0 0x55b51dbb7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdb45cf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dbb8370 0x55b51dbba760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdb45cf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b51db1e990 con 0x55b51dba76b0 2024-07-24T22:11:14.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdb45cf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b51db0de90 con 0x55b51dbb8370 2024-07-24T22:11:14.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdb45cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b51db11ed0 con 0x55b51dba7fd0 2024-07-24T22:11:14.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdaaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba76b0 0x55b51dba7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdaaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba76b0 0x55b51dba7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39590/0 (socket says 172.21.15.47:39590) 2024-07-24T22:11:14.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdaaffd640 1 -- 172.21.15.47:0/2430141030 learned_addr learned my addr 172.21.15.47:0/2430141030 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdab7fe640 1 --2- 172.21.15.47:0/2430141030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba7fd0 0x55b51dbb7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdaaffd640 1 -- 172.21.15.47:0/2430141030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba7fd0 msgr2=0x55b51dbb7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdaaffd640 1 --2- 172.21.15.47:0/2430141030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba7fd0 0x55b51dbb7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdaaffd640 1 -- 172.21.15.47:0/2430141030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dbb8370 msgr2=0x55b51dbba760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdaaffd640 1 --2- 172.21.15.47:0/2430141030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dbb8370 0x55b51dbba760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdaaffd640 1 -- 172.21.15.47:0/2430141030 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b51da97300 con 0x55b51dba76b0 2024-07-24T22:11:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdab7fe640 1 --2- 172.21.15.47:0/2430141030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba7fd0 0x55b51dbb7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:11:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbda8ff9640 1 --2- 172.21.15.47:0/4189623534 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbd940b3dc0 0x7fbd940b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdaaffd640 1 --2- 172.21.15.47:0/2430141030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba76b0 0x55b51dba7a90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbda002a930 tx=0x7fbda0032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4862ed278bf514c4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbdab7fe640 1 --2- 172.21.15.47:0/4189623534 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbd940b3dc0 0x7fbd940b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.895+0000 7fbda8ff9640 1 -- 172.21.15.47:0/4189623534 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fbda40e40e0 con 0x7fbdac108b20 2024-07-24T22:11:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.896+0000 7fbd91ffb640 1 -- 172.21.15.47:0/2430141030 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0035040 con 0x55b51dba76b0 2024-07-24T22:11:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.896+0000 7fbd91ffb640 1 -- 172.21.15.47:0/2430141030 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbda0004030 con 0x55b51dba76b0 2024-07-24T22:11:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.896+0000 7fbd91ffb640 1 -- 172.21.15.47:0/2430141030 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0005500 con 0x55b51dba76b0 2024-07-24T22:11:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.896+0000 7fbdb45cf740 1 -- 172.21.15.47:0/2430141030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba76b0 msgr2=0x55b51dba7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.896+0000 7fbdab7fe640 1 --2- 172.21.15.47:0/4189623534 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbd940b3dc0 0x7fbd940b6280 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55b51dbab8f0 tx=0x7fbd9c005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.896+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/2430141030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba76b0 0x55b51dba7a90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbda002a930 tx=0x7fbda0032c60 comp rx=0 tx=0).stop 2024-07-24T22:11:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.896+0000 7fbdb45cf740 1 -- 172.21.15.47:0/2430141030 shutdown_connections 2024-07-24T22:11:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.896+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/2430141030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dbb8370 0x55b51dbba760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.896+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/2430141030 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba7fd0 0x55b51dbb7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.896+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/2430141030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba76b0 0x55b51dba7a90 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.896+0000 7fbdb45cf740 1 -- 172.21.15.47:0/2430141030 >> 172.21.15.47:0/2430141030 conn(0x55b51dba54e0 msgr2=0x55b51dba6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.896+0000 7fbdb45cf740 1 -- 172.21.15.47:0/2430141030 shutdown_connections 2024-07-24T22:11:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.896+0000 7fbdb45cf740 1 -- 172.21.15.47:0/2430141030 wait complete. 2024-07-24T22:11:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.897+0000 7fbdb45cf740 1 -- start start 2024-07-24T22:11:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.897+0000 7fbdb45cf740 1 Processor -- start 2024-07-24T22:11:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.897+0000 7fbdb45cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba76b0 0x55b51dbb5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.897+0000 7fbdb45cf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dba7fd0 0x55b51dbb5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.897+0000 7fbdb45cf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 0x55b51dbb5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.897+0000 7fbdb45cf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b51d971700 con 0x55b51dbb8370 2024-07-24T22:11:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.897+0000 7fbdb45cf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b51dab05d0 con 0x55b51dba7fd0 2024-07-24T22:11:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.897+0000 7fbdb45cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b51dbbafc0 con 0x55b51dba76b0 2024-07-24T22:11:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.897+0000 7fbdb45cf740 10 client.0 _ll_register_callbacks cb 0x55b51dad0940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.897+0000 7fbdabfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 0x55b51dbb5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.897+0000 7fbdabfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 0x55b51dbb5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39602/0 (socket says 172.21.15.47:39602) 2024-07-24T22:11:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.897+0000 7fbdabfff640 1 -- 172.21.15.47:0/3475573601 learned_addr learned my addr 172.21.15.47:0/3475573601 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbdab7fe640 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba76b0 0x55b51dbb5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbdaaffd640 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dba7fd0 0x55b51dbb5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbdabfff640 1 -- 172.21.15.47:0/3475573601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba76b0 msgr2=0x55b51dbb5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbdabfff640 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba76b0 0x55b51dbb5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbdabfff640 1 -- 172.21.15.47:0/3475573601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dba7fd0 msgr2=0x55b51dbb5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbdabfff640 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dba7fd0 0x55b51dbb5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbdabfff640 1 -- 172.21.15.47:0/3475573601 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b51daa3660 con 0x55b51dbb8370 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbdab7fe640 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba76b0 0x55b51dbb5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbdaaffd640 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dba7fd0 0x55b51dbb5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbdabfff640 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 0x55b51dbb5d80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fbda400efd0 tx=0x7fbda40aaa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6619c584b3881a2 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbd8affd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbd8affd640 1 -- 172.21.15.47:0/3475573601 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda401f040 con 0x55b51dbb8370 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbd8affd640 1 -- 172.21.15.47:0/3475573601 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fbda40aa000 con 0x55b51dbb8370 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbdb45cf740 1 -- 172.21.15.47:0/3475573601 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbda0004030 con 0x55b51dbb8370 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbd8affd640 1 -- 172.21.15.47:0/3475573601 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbda40aa200 con 0x55b51dbb8370 2024-07-24T22:11:14.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbdb45cf740 10 client.16401 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:14.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbdb45cf740 1 -- 172.21.15.47:0/3475573601 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b51d86e650 con 0x55b51dbb8370 2024-07-24T22:11:14.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.898+0000 7fbd8affd640 1 -- 172.21.15.47:0/3475573601 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbda0004030 con 0x55b51dbb8370 2024-07-24T22:11:14.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.899+0000 7fbd8affd640 1 -- 172.21.15.47:0/3475573601 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbda400f040 con 0x55b51dbb8370 2024-07-24T22:11:14.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.899+0000 7fbdb45cf740 10 client.16401 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:14.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.899+0000 7fbdb45cf740 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:14.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.899+0000 7fbdb45cf740 20 client.16401 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:14.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.899+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b51dbc7eb0 0x55b51dbca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.899+0000 7fbdb45cf740 4 client.16401 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:11:14.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.899+0000 7fbdb45cf740 1 -- 172.21.15.47:0/3475573601 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b51db208e0 con 0x55b51dbc7eb0 2024-07-24T22:11:14.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.899+0000 7fbdab7fe640 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b51dbc7eb0 0x55b51dbca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.899+0000 7fbd8affd640 10 client.16401 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:14.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.899+0000 7fbdab7fe640 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b51dbc7eb0 0x55b51dbca2c0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7e6e837d197989c server_cookie=53e4aeaf457fa9e2 in_seq=0 out_seq=0 2024-07-24T22:11:14.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbd8affd640 1 -- 172.21.15.47:0/3475573601 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b51db208e0 con 0x55b51dbc7eb0 2024-07-24T22:11:14.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbd8affd640 10 client.16401 handle_command_reply: tid=0 2024-07-24T22:11:14.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbdb45cf740 1 client.16401 shutdown 2024-07-24T22:11:14.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbdb45cf740 1 -- 172.21.15.47:0/3475573601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 msgr2=0x55b51dbb5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 0x55b51dbb5d80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fbda400efd0 tx=0x7fbda40aaa10 comp rx=0 tx=0).stop 2024-07-24T22:11:14.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbdb45cf740 1 -- 172.21.15.47:0/3475573601 shutdown_connections 2024-07-24T22:11:14.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b51dbc7eb0 0x55b51dbca2c0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 0x55b51dbb5d80 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dba7fd0 0x55b51dbb5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbd8affd640 0 client.16401 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:14.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/3475573601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba76b0 0x55b51dbb5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbdb45cf740 1 -- 172.21.15.47:0/3475573601 >> 172.21.15.47:0/3475573601 conn(0x55b51dba54e0 msgr2=0x55b51dbab010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:14.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbdb45cf740 1 -- 172.21.15.47:0/3475573601 shutdown_connections 2024-07-24T22:11:14.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbdb45cf740 1 -- 172.21.15.47:0/3475573601 wait complete. 2024-07-24T22:11:14.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.900+0000 7fbdb45cf740 20 client.16401 trim_cache size 0 max 16384 2024-07-24T22:11:14.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdb45cf740 1 Processor -- start 2024-07-24T22:11:14.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdb45cf740 1 -- start start 2024-07-24T22:11:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdb45cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba76b0 0x55b51dbb2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdb45cf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba7fd0 0x55b51dba4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdb45cf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dbb8370 0x55b51dbaaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdb45cf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1a9e60 con 0x55b51dba7fd0 2024-07-24T22:11:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdb45cf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1ac6e0 con 0x55b51dbb8370 2024-07-24T22:11:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdb45cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1aa4d0 con 0x55b51dba76b0 2024-07-24T22:11:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdaaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba7fd0 0x55b51dba4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdaaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba7fd0 0x55b51dba4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39610/0 (socket says 172.21.15.47:39610) 2024-07-24T22:11:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdaaffd640 1 -- 172.21.15.47:0/2806588477 learned_addr learned my addr 172.21.15.47:0/2806588477 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdab7fe640 1 --2- 172.21.15.47:0/2806588477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba76b0 0x55b51dbb2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdaaffd640 1 -- 172.21.15.47:0/2806588477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba76b0 msgr2=0x55b51dbb2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdaaffd640 1 --2- 172.21.15.47:0/2806588477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba76b0 0x55b51dbb2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdaaffd640 1 -- 172.21.15.47:0/2806588477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dbb8370 msgr2=0x55b51dbaaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdaaffd640 1 --2- 172.21.15.47:0/2806588477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dbb8370 0x55b51dbaaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.919+0000 7fbdaaffd640 1 -- 172.21.15.47:0/2806588477 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b51dbc6a00 con 0x55b51dba7fd0 2024-07-24T22:11:14.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.920+0000 7fbdaaffd640 1 --2- 172.21.15.47:0/2806588477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba7fd0 0x55b51dba4d40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fbda0031440 tx=0x7fbda0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341123a8523440ea server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:14.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.920+0000 7fbd917fa640 1 -- 172.21.15.47:0/2806588477 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0004300 con 0x55b51dba7fd0 2024-07-24T22:11:14.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.920+0000 7fbd917fa640 1 -- 172.21.15.47:0/2806588477 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbda00044a0 con 0x55b51dba7fd0 2024-07-24T22:11:14.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.920+0000 7fbd917fa640 1 -- 172.21.15.47:0/2806588477 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda00035f0 con 0x55b51dba7fd0 2024-07-24T22:11:14.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.921+0000 7fbdb45cf740 1 -- 172.21.15.47:0/2806588477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba7fd0 msgr2=0x55b51dba4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.921+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/2806588477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba7fd0 0x55b51dba4d40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fbda0031440 tx=0x7fbda0005fd0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.921+0000 7fbdb45cf740 1 -- 172.21.15.47:0/2806588477 shutdown_connections 2024-07-24T22:11:14.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.921+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/2806588477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dbb8370 0x55b51dbaaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.921+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/2806588477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dba7fd0 0x55b51dba4d40 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.921+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/2806588477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba76b0 0x55b51dbb2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.921+0000 7fbdb45cf740 1 -- 172.21.15.47:0/2806588477 >> 172.21.15.47:0/2806588477 conn(0x55b51dba54e0 msgr2=0x55b51dbaa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.921+0000 7fbdb45cf740 1 -- 172.21.15.47:0/2806588477 shutdown_connections 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.921+0000 7fbdb45cf740 1 -- 172.21.15.47:0/2806588477 wait complete. 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.921+0000 7fbdb45cf740 1 -- start start 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.921+0000 7fbdb45cf740 1 Processor -- start 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdb45cf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dba76b0 0x55b51dbd0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdb45cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba7fd0 0x55b51dbc0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdb45cf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 0x55b51dbc07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdb45cf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1aaba0 con 0x55b51dbb8370 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdb45cf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1ac010 con 0x55b51dba76b0 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdb45cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1ab270 con 0x55b51dba7fd0 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdb45cf740 10 client.0 _ll_register_callbacks cb 0x7fbda40a6d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdabfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 0x55b51dbc07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdaaffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba7fd0 0x55b51dbc0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdaaffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba7fd0 0x55b51dbc0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:41318/0 (socket says 172.21.15.47:41318) 2024-07-24T22:11:14.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdabfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 0x55b51dbc07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39622/0 (socket says 172.21.15.47:39622) 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdaaffd640 1 -- 172.21.15.47:0/355701975 learned_addr learned my addr 172.21.15.47:0/355701975 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdab7fe640 1 --2- 172.21.15.47:0/355701975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dba76b0 0x55b51dbd0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdabfff640 1 -- 172.21.15.47:0/355701975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba7fd0 msgr2=0x55b51dbc0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdabfff640 1 --2- 172.21.15.47:0/355701975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba7fd0 0x55b51dbc0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdabfff640 1 -- 172.21.15.47:0/355701975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dba76b0 msgr2=0x55b51dbd0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdabfff640 1 --2- 172.21.15.47:0/355701975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dba76b0 0x55b51dbd0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdabfff640 1 -- 172.21.15.47:0/355701975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b51dba9110 con 0x55b51dbb8370 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.922+0000 7fbdaaffd640 1 --2- 172.21.15.47:0/355701975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba7fd0 0x55b51dbc0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.923+0000 7fbdabfff640 1 --2- 172.21.15.47:0/355701975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 0x55b51dbc07f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fbda40a6e20 tx=0x7fbda40b0950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd7bc7505cfccdd server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.923+0000 7fbd8affd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.923+0000 7fbd8affd640 1 -- 172.21.15.47:0/355701975 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda401f030 con 0x55b51dbb8370 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.923+0000 7fbdb45cf740 1 -- 172.21.15.47:0/355701975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbda00044a0 con 0x55b51dbb8370 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.923+0000 7fbd8affd640 1 -- 172.21.15.47:0/355701975 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fbda40a9dc0 con 0x55b51dbb8370 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.923+0000 7fbd8affd640 1 -- 172.21.15.47:0/355701975 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbda40aa6f0 con 0x55b51dbb8370 2024-07-24T22:11:14.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.923+0000 7fbdb45cf740 10 client.16407 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:14.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.923+0000 7fbdb45cf740 1 -- 172.21.15.47:0/355701975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b51dc32dc0 con 0x55b51dbb8370 2024-07-24T22:11:14.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.923+0000 7fbd8affd640 1 -- 172.21.15.47:0/355701975 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbda00044a0 con 0x55b51dbb8370 2024-07-24T22:11:14.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.923+0000 7fbd8affd640 1 -- 172.21.15.47:0/355701975 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbda4004c50 con 0x55b51dbb8370 2024-07-24T22:11:14.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.923+0000 7fbdb45cf740 10 client.16407 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:14.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.923+0000 7fbdb45cf740 10 client.16407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:14.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.923+0000 7fbdb45cf740 20 client.16407 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:14.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.924+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/355701975 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b51dc33460 0x55b51dc35880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:14.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.924+0000 7fbdb45cf740 4 client.16407 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:11:14.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.924+0000 7fbdb45cf740 1 -- 172.21.15.47:0/355701975 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b51db1c380 con 0x55b51dc33460 2024-07-24T22:11:14.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.924+0000 7fbdab7fe640 1 --2- 172.21.15.47:0/355701975 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b51dc33460 0x55b51dc35880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:14.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.924+0000 7fbdab7fe640 1 --2- 172.21.15.47:0/355701975 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b51dc33460 0x55b51dc35880 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fe29863cb7bed53 server_cookie=95ad2b3de1319eff in_seq=0 out_seq=0 2024-07-24T22:11:14.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.924+0000 7fbd8affd640 10 client.16407 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:14.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbd8affd640 1 -- 172.21.15.47:0/355701975 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b51db1c380 con 0x55b51dc33460 2024-07-24T22:11:14.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbd8affd640 10 client.16407 handle_command_reply: tid=0 2024-07-24T22:11:14.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbdb45cf740 1 client.16407 shutdown 2024-07-24T22:11:14.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbdb45cf740 1 -- 172.21.15.47:0/355701975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 msgr2=0x55b51dbc07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/355701975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 0x55b51dbc07f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fbda40a6e20 tx=0x7fbda40b0950 comp rx=0 tx=0).stop 2024-07-24T22:11:14.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbdb45cf740 1 -- 172.21.15.47:0/355701975 shutdown_connections 2024-07-24T22:11:14.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/355701975 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b51dc33460 0x55b51dc35880 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/355701975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b51dbb8370 0x55b51dbc07f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbd8affd640 0 client.16407 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:14.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/355701975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b51dba7fd0 0x55b51dbc0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbdb45cf740 1 --2- 172.21.15.47:0/355701975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b51dba76b0 0x55b51dbd0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbdb45cf740 1 -- 172.21.15.47:0/355701975 >> 172.21.15.47:0/355701975 conn(0x55b51dba54e0 msgr2=0x55b51dba69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:14.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbdb45cf740 1 -- 172.21.15.47:0/355701975 shutdown_connections 2024-07-24T22:11:14.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbdb45cf740 1 -- 172.21.15.47:0/355701975 wait complete. 2024-07-24T22:11:14.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.925+0000 7fbdb45cf740 20 client.16407 trim_cache size 0 max 16384 2024-07-24T22:11:14.932 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:11:14.932 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-07-24T22:11:14.932 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-07-24T22:11:14.932 INFO:teuthology.orchestra.run.smithi047.stdout: "48f99953-b583-4ff5-942b-0367dac46c16": { 2024-07-24T22:11:14.933 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-07-24T22:11:14.933 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "48f99953-b583-4ff5-942b-0367dac46c16", 2024-07-24T22:11:14.933 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-07-24T22:11:14.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:11:14.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:11:14.933 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:11:14.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.926+0000 7fbdb221e640 1 -- 172.21.15.47:0/4189623534 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbd940b3dc0 msgr2=0x7fbd940b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.926+0000 7fbdb221e640 1 --2- 172.21.15.47:0/4189623534 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbd940b3dc0 0x7fbd940b6280 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55b51dbab8f0 tx=0x7fbd9c005f90 comp rx=0 tx=0).stop 2024-07-24T22:11:14.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.926+0000 7fbdb221e640 1 -- 172.21.15.47:0/4189623534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdac108b20 msgr2=0x7fbdac19e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:14.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.926+0000 7fbdb221e640 1 --2- 172.21.15.47:0/4189623534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdac108b20 0x7fbdac19e4e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbda400eaa0 tx=0x7fbda400ef60 comp rx=0 tx=0).stop 2024-07-24T22:11:14.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.926+0000 7fbdb221e640 1 -- 172.21.15.47:0/4189623534 shutdown_connections 2024-07-24T22:11:14.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.926+0000 7fbdb221e640 1 --2- 172.21.15.47:0/4189623534 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbd940b3dc0 0x7fbd940b6280 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.926+0000 7fbdb221e640 1 --2- 172.21.15.47:0/4189623534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdac108b20 0x7fbdac19e4e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.926+0000 7fbdb221e640 1 --2- 172.21.15.47:0/4189623534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbdac1081a0 0x7fbdac199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.926+0000 7fbdb221e640 1 --2- 172.21.15.47:0/4189623534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdac102790 0x7fbdac198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:14.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.926+0000 7fbdb221e640 1 -- 172.21.15.47:0/4189623534 >> 172.21.15.47:0/4189623534 conn(0x7fbdac0fe200 msgr2=0x7fbdac1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:14.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.926+0000 7fbdb221e640 1 -- 172.21.15.47:0/4189623534 shutdown_connections 2024-07-24T22:11:14.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:14.926+0000 7fbdb221e640 1 -- 172.21.15.47:0/4189623534 wait complete. 2024-07-24T22:11:15.559 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:11:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:15 smithi047 ceph-mon[32551]: pgmap v487: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 21 KiB/s rd, 70 MiB/s wr, 74 op/s 2024-07-24T22:11:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:15 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:11:15.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:15 smithi183 ceph-mon[37007]: pgmap v487: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 21 KiB/s rd, 70 MiB/s wr, 74 op/s 2024-07-24T22:11:15.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:15 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:11:15.723 INFO:tasks.cephfs.filesystem:scrub status for tag:48f99953-b583-4ff5-942b-0367dac46c16 - {'path': '/', 'tag': '48f99953-b583-4ff5-942b-0367dac46c16', 'options': 'recursive,force'} 2024-07-24T22:11:15.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:15 smithi188 ceph-mon[37380]: pgmap v487: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 21 KiB/s rd, 70 MiB/s wr, 74 op/s 2024-07-24T22:11:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:15 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:11:15.837 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:11:17.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:17 smithi047 ceph-mon[32551]: pgmap v488: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 7.8 KiB/s rd, 62 MiB/s wr, 50 op/s 2024-07-24T22:11:17.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:11:17.439 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:11:17.439 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:11:17.439 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:11:17.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:17 smithi183 ceph-mon[37007]: pgmap v488: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 7.8 KiB/s rd, 62 MiB/s wr, 50 op/s 2024-07-24T22:11:17.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:11:17.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:11:17.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:11:17.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:11:17.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.729+0000 7f093160f640 1 -- 172.21.15.47:0/2941052554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f092c1081a0 msgr2=0x7f092c1085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:17.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.729+0000 7f093160f640 1 --2- 172.21.15.47:0/2941052554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f092c1081a0 0x7f092c1085e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0920009900 tx=0x7f092002a410 comp rx=0 tx=0).stop 2024-07-24T22:11:17.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.729+0000 7f093160f640 1 -- 172.21.15.47:0/2941052554 shutdown_connections 2024-07-24T22:11:17.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.729+0000 7f093160f640 1 --2- 172.21.15.47:0/2941052554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f092c108b20 0x7f092c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:17.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.729+0000 7f093160f640 1 --2- 172.21.15.47:0/2941052554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f092c1081a0 0x7f092c1085e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:17.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.729+0000 7f093160f640 1 --2- 172.21.15.47:0/2941052554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f092c102790 0x7f092c102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:17.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.729+0000 7f093160f640 1 -- 172.21.15.47:0/2941052554 >> 172.21.15.47:0/2941052554 conn(0x7f092c0fe200 msgr2=0x7f092c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:17.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.729+0000 7f093160f640 1 -- 172.21.15.47:0/2941052554 shutdown_connections 2024-07-24T22:11:17.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.729+0000 7f093160f640 1 -- 172.21.15.47:0/2941052554 wait complete. 2024-07-24T22:11:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.730+0000 7f093160f640 1 Processor -- start 2024-07-24T22:11:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.730+0000 7f093160f640 1 -- start start 2024-07-24T22:11:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.730+0000 7f093160f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f092c102790 0x7f092c198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.730+0000 7f093160f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f092c1081a0 0x7f092c1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.730+0000 7f093160f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f092c108b20 0x7f092c19e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f093160f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f092c112780 con 0x7f092c1081a0 2024-07-24T22:11:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f093160f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f092c112600 con 0x7f092c102790 2024-07-24T22:11:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f093160f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f092c112900 con 0x7f092c108b20 2024-07-24T22:11:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f092a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f092c1081a0 0x7f092c1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f092a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f092c1081a0 0x7f092c1991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39640/0 (socket says 172.21.15.47:39640) 2024-07-24T22:11:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f092a7fc640 1 -- 172.21.15.47:0/791257762 learned_addr learned my addr 172.21.15.47:0/791257762 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f092b7fe640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f092c108b20 0x7f092c19e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f092affd640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f092c102790 0x7f092c198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f092a7fc640 1 -- 172.21.15.47:0/791257762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f092c108b20 msgr2=0x7f092c19e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f092a7fc640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f092c108b20 0x7f092c19e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f092a7fc640 1 -- 172.21.15.47:0/791257762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f092c102790 msgr2=0x7f092c198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f092a7fc640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f092c102790 0x7f092c198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f092a7fc640 1 -- 172.21.15.47:0/791257762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092c19ed20 con 0x7f092c1081a0 2024-07-24T22:11:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f092affd640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f092c102790 0x7f092c198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:11:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f092a7fc640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f092c1081a0 0x7f092c1991b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0920005ab0 tx=0x7f0920003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f0913fff640 1 -- 172.21.15.47:0/791257762 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092003f070 con 0x7f092c1081a0 2024-07-24T22:11:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f093160f640 1 -- 172.21.15.47:0/791257762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f092c19efb0 con 0x7f092c1081a0 2024-07-24T22:11:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f0913fff640 1 -- 172.21.15.47:0/791257762 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0920031d60 con 0x7f092c1081a0 2024-07-24T22:11:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.731+0000 7f0913fff640 1 -- 172.21.15.47:0/791257762 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920035030 con 0x7f092c1081a0 2024-07-24T22:11:17.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.732+0000 7f093160f640 1 -- 172.21.15.47:0/791257762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f092c1a56d0 con 0x7f092c1081a0 2024-07-24T22:11:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.733+0000 7f093160f640 1 -- 172.21.15.47:0/791257762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f092c102b70 con 0x7f092c1081a0 2024-07-24T22:11:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.734+0000 7f0913fff640 1 -- 172.21.15.47:0/791257762 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f0920042070 con 0x7f092c1081a0 2024-07-24T22:11:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.735+0000 7f0913fff640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09140b3d40 0x7f09140b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.735+0000 7f092affd640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09140b3d40 0x7f09140b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.735+0000 7f0913fff640 1 -- 172.21.15.47:0/791257762 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f0920104e00 con 0x7f092c1081a0 2024-07-24T22:11:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.735+0000 7f092affd640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09140b3d40 0x7f09140b6200 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f091c005d00 tx=0x7f091c00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.738+0000 7f0913fff640 1 -- 172.21.15.47:0/791257762 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f09200cbac0 con 0x7f092c1081a0 2024-07-24T22:11:17.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:17 smithi188 ceph-mon[37380]: pgmap v488: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 7.8 KiB/s rd, 62 MiB/s wr, 50 op/s 2024-07-24T22:11:17.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:11:17.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:11:17.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:11:17.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:11:17.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.972+0000 7f093160f640 1 -- 172.21.15.47:0/791257762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f092c199da0 con 0x7f092c1081a0 2024-07-24T22:11:17.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.972+0000 7f0913fff640 1 -- 172.21.15.47:0/791257762 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f09200d0010 con 0x7f092c1081a0 2024-07-24T22:11:17.975 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:11:17.975 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:11:17.975 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:11:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.975+0000 7f093160f640 1 -- 172.21.15.47:0/791257762 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09140b3d40 msgr2=0x7f09140b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.975+0000 7f093160f640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09140b3d40 0x7f09140b6200 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f091c005d00 tx=0x7f091c00b410 comp rx=0 tx=0).stop 2024-07-24T22:11:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.975+0000 7f093160f640 1 -- 172.21.15.47:0/791257762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f092c1081a0 msgr2=0x7f092c1991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.975+0000 7f093160f640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f092c1081a0 0x7f092c1991b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0920005ab0 tx=0x7f0920003cd0 comp rx=0 tx=0).stop 2024-07-24T22:11:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.975+0000 7f093160f640 1 -- 172.21.15.47:0/791257762 shutdown_connections 2024-07-24T22:11:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.975+0000 7f093160f640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09140b3d40 0x7f09140b6200 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:17.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.975+0000 7f093160f640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f092c108b20 0x7f092c19e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:17.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.975+0000 7f093160f640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f092c1081a0 0x7f092c1991b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:17.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.975+0000 7f093160f640 1 --2- 172.21.15.47:0/791257762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f092c102790 0x7f092c198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:17.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.975+0000 7f093160f640 1 -- 172.21.15.47:0/791257762 >> 172.21.15.47:0/791257762 conn(0x7f092c0fe200 msgr2=0x7f092c1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:17.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.975+0000 7f093160f640 1 -- 172.21.15.47:0/791257762 shutdown_connections 2024-07-24T22:11:17.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:17.975+0000 7f093160f640 1 -- 172.21.15.47:0/791257762 wait complete. 2024-07-24T22:11:18.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:18 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/791257762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:11:18.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:18 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/791257762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:11:18.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:18 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/791257762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:11:18.837 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db --set-id e791e86c --release --await' 2024-07-24T22:11:18.837 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db --set-id e791e86c --release --await 2024-07-24T22:11:19.109 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:11:19.606 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:19 smithi047 ceph-mon[32551]: pgmap v489: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 7.9 KiB/s rd, 64 MiB/s wr, 48 op/s 2024-07-24T22:11:19.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:19 smithi183 ceph-mon[37007]: pgmap v489: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 7.9 KiB/s rd, 64 MiB/s wr, 48 op/s 2024-07-24T22:11:19.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:19 smithi188 ceph-mon[37380]: pgmap v489: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 7.9 KiB/s rd, 64 MiB/s wr, 48 op/s 2024-07-24T22:11:21.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.049+0000 7fc7f97f8640 1 -- 172.21.15.47:0/288673713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f4102790 msgr2=0x7fc7f4102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:21.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.049+0000 7fc7f97f8640 1 --2- 172.21.15.47:0/288673713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f4102790 0x7fc7f4102b70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009900 tx=0x7fc7e402a410 comp rx=0 tx=0).stop 2024-07-24T22:11:21.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.049+0000 7fc7f97f8640 1 -- 172.21.15.47:0/288673713 shutdown_connections 2024-07-24T22:11:21.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.049+0000 7fc7f97f8640 1 --2- 172.21.15.47:0/288673713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7f4108b20 0x7fc7f410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.049+0000 7fc7f97f8640 1 --2- 172.21.15.47:0/288673713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7f41081a0 0x7fc7f41085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.049+0000 7fc7f97f8640 1 --2- 172.21.15.47:0/288673713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f4102790 0x7fc7f4102b70 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.049+0000 7fc7f97f8640 1 -- 172.21.15.47:0/288673713 >> 172.21.15.47:0/288673713 conn(0x7fc7f40fe200 msgr2=0x7fc7f4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:21.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.049+0000 7fc7f97f8640 1 -- 172.21.15.47:0/288673713 shutdown_connections 2024-07-24T22:11:21.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.049+0000 7fc7f97f8640 1 -- 172.21.15.47:0/288673713 wait complete. 2024-07-24T22:11:21.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.050+0000 7fc7f97f8640 1 Processor -- start 2024-07-24T22:11:21.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.050+0000 7fc7f97f8640 1 -- start start 2024-07-24T22:11:21.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.050+0000 7fc7f97f8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7f4102790 0x7fc7f4198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.050+0000 7fc7f97f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7f41081a0 0x7fc7f4199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f97f8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f4108b20 0x7fc7f419e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f97f8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f41127f0 con 0x7fc7f4108b20 2024-07-24T22:11:21.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f97f8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f4112670 con 0x7fc7f4102790 2024-07-24T22:11:21.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f97f8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f4112970 con 0x7fc7f41081a0 2024-07-24T22:11:21.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f4108b20 0x7fc7f419e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f4108b20 0x7fc7f419e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39664/0 (socket says 172.21.15.47:39664) 2024-07-24T22:11:21.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f37fe640 1 -- 172.21.15.47:0/2882195887 learned_addr learned my addr 172.21.15.47:0/2882195887 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:21.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f27fc640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7f41081a0 0x7fc7f4199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f2ffd640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7f4102790 0x7fc7f4198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f37fe640 1 -- 172.21.15.47:0/2882195887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7f41081a0 msgr2=0x7fc7f4199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:21.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f37fe640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7f41081a0 0x7fc7f4199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f37fe640 1 -- 172.21.15.47:0/2882195887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7f4102790 msgr2=0x7fc7f4198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:21.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f37fe640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7f4102790 0x7fc7f4198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f37fe640 1 -- 172.21.15.47:0/2882195887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f419edb0 con 0x7fc7f4108b20 2024-07-24T22:11:21.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f2ffd640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7f4102790 0x7fc7f4198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:11:21.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f37fe640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f4108b20 0x7fc7f419e5e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00b970 tx=0x7fc7ec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:21.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7dbfff640 1 -- 172.21.15.47:0/2882195887 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec019070 con 0x7fc7f4108b20 2024-07-24T22:11:21.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7dbfff640 1 -- 172.21.15.47:0/2882195887 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7ec014440 con 0x7fc7f4108b20 2024-07-24T22:11:21.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7f97f8640 1 -- 172.21.15.47:0/2882195887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f419f0a0 con 0x7fc7f4108b20 2024-07-24T22:11:21.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.051+0000 7fc7dbfff640 1 -- 172.21.15.47:0/2882195887 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec0075d0 con 0x7fc7f4108b20 2024-07-24T22:11:21.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.052+0000 7fc7f97f8640 1 -- 172.21.15.47:0/2882195887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f41a5760 con 0x7fc7f4108b20 2024-07-24T22:11:21.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.054+0000 7fc7dbfff640 1 -- 172.21.15.47:0/2882195887 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fc7ec01c070 con 0x7fc7f4108b20 2024-07-24T22:11:21.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.055+0000 7fc7dbfff640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7dc0b3dc0 0x7fc7dc0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.055+0000 7fc7fbba9740 1 Processor -- start 2024-07-24T22:11:21.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.055+0000 7fc7f2ffd640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7dc0b3dc0 0x7fc7dc0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.055+0000 7fc7dbfff640 1 -- 172.21.15.47:0/2882195887 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fc7ec0e34a0 con 0x7fc7f4108b20 2024-07-24T22:11:21.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.055+0000 7fc7fbba9740 1 -- start start 2024-07-24T22:11:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.055+0000 7fc7fbba9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb0da30 0x55572eb0de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.055+0000 7fc7fbba9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb1e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.055+0000 7fc7fbba9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb1e6f0 0x55572eb20ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7fbba9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55572ea84dd0 con 0x55572eb0e350 2024-07-24T22:11:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7fbba9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55572ea742d0 con 0x55572eb0da30 2024-07-24T22:11:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7fbba9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55572ea78310 con 0x55572eb1e6f0 2024-07-24T22:11:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7f2ffd640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7dc0b3dc0 0x7fc7dc0b6280 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4000c00 tx=0x7fc7e4005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7f27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb1e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7f27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb1e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39678/0 (socket says 172.21.15.47:39678) 2024-07-24T22:11:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7f27fc640 1 -- 172.21.15.47:0/981319192 learned_addr learned my addr 172.21.15.47:0/981319192 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7f2ffd640 1 --2- 172.21.15.47:0/981319192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb0da30 0x55572eb0de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7f37fe640 1 --2- 172.21.15.47:0/981319192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb1e6f0 0x55572eb20ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7f27fc640 1 -- 172.21.15.47:0/981319192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb1e6f0 msgr2=0x55572eb20ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:21.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7f27fc640 1 --2- 172.21.15.47:0/981319192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb1e6f0 0x55572eb20ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7f27fc640 1 -- 172.21.15.47:0/981319192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb0da30 msgr2=0x55572eb0de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:21.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7f27fc640 1 --2- 172.21.15.47:0/981319192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb0da30 0x55572eb0de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7f27fc640 1 -- 172.21.15.47:0/981319192 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55572e7d4b00 con 0x55572eb0e350 2024-07-24T22:11:21.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7f37fe640 1 --2- 172.21.15.47:0/981319192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb1e6f0 0x55572eb20ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:11:21.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.056+0000 7fc7f27fc640 1 --2- 172.21.15.47:0/981319192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb1e1b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800bcb0 tx=0x7fc7e80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e6f847bbd30118 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:21.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.057+0000 7fc7d97fa640 1 -- 172.21.15.47:0/981319192 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8004030 con 0x55572eb0e350 2024-07-24T22:11:21.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.057+0000 7fc7d97fa640 1 -- 172.21.15.47:0/981319192 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7e80041d0 con 0x55572eb0e350 2024-07-24T22:11:21.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.057+0000 7fc7d97fa640 1 -- 172.21.15.47:0/981319192 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80117b0 con 0x55572eb0e350 2024-07-24T22:11:21.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.057+0000 7fc7fbba9740 1 -- 172.21.15.47:0/981319192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 msgr2=0x55572eb1e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:21.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.057+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/981319192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb1e1b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800bcb0 tx=0x7fc7e80107a0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.058+0000 7fc7fbba9740 1 -- 172.21.15.47:0/981319192 shutdown_connections 2024-07-24T22:11:21.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.058+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/981319192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb1e6f0 0x55572eb20ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.058+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/981319192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb1e1b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.058+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/981319192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb0da30 0x55572eb0de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.058+0000 7fc7fbba9740 1 -- 172.21.15.47:0/981319192 >> 172.21.15.47:0/981319192 conn(0x55572eb0b860 msgr2=0x55572eb0ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:21.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.058+0000 7fc7fbba9740 1 -- 172.21.15.47:0/981319192 shutdown_connections 2024-07-24T22:11:21.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.058+0000 7fc7fbba9740 1 -- 172.21.15.47:0/981319192 wait complete. 2024-07-24T22:11:21.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.058+0000 7fc7fbba9740 1 -- start start 2024-07-24T22:11:21.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.058+0000 7fc7fbba9740 1 Processor -- start 2024-07-24T22:11:21.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7fbba9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0da30 0x55572eb1b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7fbba9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb1bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7fbba9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb1c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7fbba9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55572e8d7bb0 con 0x55572eb0e350 2024-07-24T22:11:21.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7fbba9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55572ea16900 con 0x55572eb1e6f0 2024-07-24T22:11:21.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7fbba9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55572eb213a0 con 0x55572eb0da30 2024-07-24T22:11:21.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7f27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb1bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7fbba9740 10 client.0 _ll_register_callbacks cb 0x55572ea20c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:21.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7f27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb1bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39690/0 (socket says 172.21.15.47:39690) 2024-07-24T22:11:21.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7f27fc640 1 -- 172.21.15.47:0/1007820653 learned_addr learned my addr 172.21.15.47:0/1007820653 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:21.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7f2ffd640 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0da30 0x55572eb1b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7f37fe640 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb1c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7f27fc640 1 -- 172.21.15.47:0/1007820653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0da30 msgr2=0x55572eb1b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:21.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7f27fc640 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0da30 0x55572eb1b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7f27fc640 1 -- 172.21.15.47:0/1007820653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 msgr2=0x55572eb1c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:21.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7f27fc640 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb1c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7f27fc640 1 -- 172.21.15.47:0/1007820653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55572e84b960 con 0x55572eb0e350 2024-07-24T22:11:21.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7f2ffd640 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0da30 0x55572eb1b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:11:21.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7f37fe640 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb1c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:11:21.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7f27fc640 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb1bc50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8004170 tx=0x7fc7e800b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b841c59ceb254093 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:21.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.059+0000 7fc7d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:21.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7d6ff5640 1 -- 172.21.15.47:0/1007820653 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8004380 con 0x55572eb0e350 2024-07-24T22:11:21.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7d6ff5640 1 -- 172.21.15.47:0/1007820653 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fc7e8005040 con 0x55572eb0e350 2024-07-24T22:11:21.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1007820653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7e80041d0 con 0x55572eb0e350 2024-07-24T22:11:21.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7d6ff5640 1 -- 172.21.15.47:0/1007820653 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc7e8005240 con 0x55572eb0e350 2024-07-24T22:11:21.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7fbba9740 10 client.16425 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:21.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1007820653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55572eb2cfb0 con 0x55572eb0e350 2024-07-24T22:11:21.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7d6ff5640 1 -- 172.21.15.47:0/1007820653 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7e80041d0 con 0x55572eb0e350 2024-07-24T22:11:21.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7d6ff5640 1 -- 172.21.15.47:0/1007820653 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc7e8004a20 con 0x55572eb0e350 2024-07-24T22:11:21.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7fbba9740 10 client.16425 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:21.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7fbba9740 10 client.16425 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:11:21.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7fbba9740 20 client.16425 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:21.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55572eb2e3b0 0x55572eb307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7fbba9740 4 client.16425 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:11:21.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.060+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1007820653 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55572ea86d20 con 0x55572eb2e3b0 2024-07-24T22:11:21.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.061+0000 7fc7f2ffd640 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55572eb2e3b0 0x55572eb307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.061+0000 7fc7f2ffd640 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55572eb2e3b0 0x55572eb307a0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4593eddbcf7b61ea server_cookie=89236b9a444f40ba in_seq=0 out_seq=0 2024-07-24T22:11:21.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.061+0000 7fc7d6ff5640 10 client.16425 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:21.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7d6ff5640 1 -- 172.21.15.47:0/1007820653 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55572ea86d20 con 0x55572eb2e3b0 2024-07-24T22:11:21.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7d6ff5640 10 client.16425 handle_command_reply: tid=0 2024-07-24T22:11:21.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7fbba9740 1 client.16425 shutdown 2024-07-24T22:11:21.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1007820653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 msgr2=0x55572eb1bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:21.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb1bc50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8004170 tx=0x7fc7e800b970 comp rx=0 tx=0).stop 2024-07-24T22:11:21.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1007820653 shutdown_connections 2024-07-24T22:11:21.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55572eb2e3b0 0x55572eb307a0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7d6ff5640 0 client.16425 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:21.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb1c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb1bc50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1007820653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0da30 0x55572eb1b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1007820653 >> 172.21.15.47:0/1007820653 conn(0x55572eb0b860 msgr2=0x55572eb11390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:21.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1007820653 shutdown_connections 2024-07-24T22:11:21.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1007820653 wait complete. 2024-07-24T22:11:21.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.062+0000 7fc7fbba9740 20 client.16425 trim_cache size 0 max 16384 2024-07-24T22:11:21.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.080+0000 7fc7fbba9740 1 Processor -- start 2024-07-24T22:11:21.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.080+0000 7fc7fbba9740 1 -- start start 2024-07-24T22:11:21.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.080+0000 7fc7fbba9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0da30 0x55572eb1d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.080+0000 7fc7fbba9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb0c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.080+0000 7fc7fbba9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb19180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.080+0000 7fc7fbba9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f41a9fb0 con 0x55572eb0e350 2024-07-24T22:11:21.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.080+0000 7fc7fbba9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f41ac830 con 0x55572eb1e6f0 2024-07-24T22:11:21.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.080+0000 7fc7fbba9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f41aa620 con 0x55572eb0da30 2024-07-24T22:11:21.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7f27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb0c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7f27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb0c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39700/0 (socket says 172.21.15.47:39700) 2024-07-24T22:11:21.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7f27fc640 1 -- 172.21.15.47:0/1532579919 learned_addr learned my addr 172.21.15.47:0/1532579919 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:21.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7f2ffd640 1 --2- 172.21.15.47:0/1532579919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0da30 0x55572eb1d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7f37fe640 1 --2- 172.21.15.47:0/1532579919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb19180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7f27fc640 1 -- 172.21.15.47:0/1532579919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0da30 msgr2=0x55572eb1d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:21.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7f27fc640 1 --2- 172.21.15.47:0/1532579919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0da30 0x55572eb1d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7f27fc640 1 -- 172.21.15.47:0/1532579919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 msgr2=0x55572eb19180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:21.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7f27fc640 1 --2- 172.21.15.47:0/1532579919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb19180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7f27fc640 1 -- 172.21.15.47:0/1532579919 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55572eb30d30 con 0x55572eb0e350 2024-07-24T22:11:21.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7f37fe640 1 --2- 172.21.15.47:0/1532579919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb19180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:11:21.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7f27fc640 1 --2- 172.21.15.47:0/1532579919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb0c970 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800b4e0 tx=0x7fc7e80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4fa38f79ba855b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:21.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7d8ff9640 1 -- 172.21.15.47:0/1532579919 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8005070 con 0x55572eb0e350 2024-07-24T22:11:21.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7d8ff9640 1 -- 172.21.15.47:0/1532579919 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7e8011de0 con 0x55572eb0e350 2024-07-24T22:11:21.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.081+0000 7fc7d8ff9640 1 -- 172.21.15.47:0/1532579919 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80041a0 con 0x55572eb0e350 2024-07-24T22:11:21.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.082+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1532579919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 msgr2=0x55572eb0c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:21.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.082+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1532579919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb0c970 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800b4e0 tx=0x7fc7e80107a0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.082+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1532579919 shutdown_connections 2024-07-24T22:11:21.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.082+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1532579919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb19180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.082+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1532579919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0e350 0x55572eb0c970 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.082+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1532579919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0da30 0x55572eb1d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.082+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1532579919 >> 172.21.15.47:0/1532579919 conn(0x55572eb0b860 msgr2=0x55572eb0a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:21.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.082+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1532579919 shutdown_connections 2024-07-24T22:11:21.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.082+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1532579919 wait complete. 2024-07-24T22:11:21.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.082+0000 7fc7fbba9740 1 -- start start 2024-07-24T22:11:21.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.082+0000 7fc7fbba9740 1 Processor -- start 2024-07-24T22:11:21.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7fbba9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0da30 0x55572eb364d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7fbba9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0e350 0x55572eb26630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7fbba9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb26b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7fbba9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f41aacf0 con 0x55572eb0da30 2024-07-24T22:11:21.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7fbba9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f41ac160 con 0x55572eb1e6f0 2024-07-24T22:11:21.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7fbba9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f41ab3c0 con 0x55572eb0e350 2024-07-24T22:11:21.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7fbba9740 10 client.0 _ll_register_callbacks cb 0x7fc7e800bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:21.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7f2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0da30 0x55572eb364d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7f2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0da30 0x55572eb364d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39710/0 (socket says 172.21.15.47:39710) 2024-07-24T22:11:21.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7f2ffd640 1 -- 172.21.15.47:0/1519572991 learned_addr learned my addr 172.21.15.47:0/1519572991 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:21.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7f37fe640 1 --2- 172.21.15.47:0/1519572991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb26b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7f27fc640 1 --2- 172.21.15.47:0/1519572991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0e350 0x55572eb26630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7f2ffd640 1 -- 172.21.15.47:0/1519572991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0e350 msgr2=0x55572eb26630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:21.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7f2ffd640 1 --2- 172.21.15.47:0/1519572991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0e350 0x55572eb26630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7f2ffd640 1 -- 172.21.15.47:0/1519572991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 msgr2=0x55572eb26b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:21.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7f2ffd640 1 --2- 172.21.15.47:0/1519572991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb26b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7f2ffd640 1 -- 172.21.15.47:0/1519572991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55572eb272b0 con 0x55572eb0da30 2024-07-24T22:11:21.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7f2ffd640 1 --2- 172.21.15.47:0/1519572991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0da30 0x55572eb364d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4053fd0 tx=0x7fc7e402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b822f2791c542f9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:21.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:21.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7d6ff5640 1 -- 172.21.15.47:0/1519572991 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4035050 con 0x55572eb0da30 2024-07-24T22:11:21.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.083+0000 7fc7d6ff5640 1 -- 172.21.15.47:0/1519572991 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fc7e40048c0 con 0x55572eb0da30 2024-07-24T22:11:21.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.084+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1519572991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7e8011de0 con 0x55572eb0da30 2024-07-24T22:11:21.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.084+0000 7fc7d6ff5640 1 -- 172.21.15.47:0/1519572991 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc7e4063050 con 0x55572eb0da30 2024-07-24T22:11:21.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.084+0000 7fc7fbba9740 10 client.16431 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:21.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.084+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1519572991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55572eb99050 con 0x55572eb0da30 2024-07-24T22:11:21.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.084+0000 7fc7d6ff5640 1 -- 172.21.15.47:0/1519572991 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7e8011de0 con 0x55572eb0da30 2024-07-24T22:11:21.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.084+0000 7fc7d6ff5640 1 -- 172.21.15.47:0/1519572991 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc7e4003cc0 con 0x55572eb0da30 2024-07-24T22:11:21.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.084+0000 7fc7fbba9740 10 client.16431 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:21.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.084+0000 7fc7fbba9740 10 client.16431 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:11:21.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.084+0000 7fc7fbba9740 20 client.16431 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:21.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.084+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1519572991 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55572eb997b0 0x55572eb9bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:21.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.084+0000 7fc7fbba9740 4 client.16431 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e791e86c", "release": true, "await": true}] 2024-07-24T22:11:21.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.084+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1519572991 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e791e86c", "release": true, "await": true}) -- 0x55572ea827c0 con 0x55572eb997b0 2024-07-24T22:11:21.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.084+0000 7fc7f27fc640 1 --2- 172.21.15.47:0/1519572991 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55572eb997b0 0x55572eb9bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:21.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.085+0000 7fc7f27fc640 1 --2- 172.21.15.47:0/1519572991 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55572eb997b0 0x55572eb9bbd0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47e4a434c81fa504 server_cookie=3089e50b18118b44 in_seq=0 out_seq=0 2024-07-24T22:11:21.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.085+0000 7fc7d6ff5640 10 client.16431 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:21.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.088+0000 7fc7d6ff5640 1 -- 172.21.15.47:0/1519572991 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55572ea827c0 con 0x55572eb997b0 2024-07-24T22:11:21.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.088+0000 7fc7d6ff5640 10 client.16431 handle_command_reply: tid=0 2024-07-24T22:11:21.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.088+0000 7fc7fbba9740 1 client.16431 shutdown 2024-07-24T22:11:21.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.089+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1519572991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0da30 msgr2=0x55572eb364d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:21.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.089+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1519572991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0da30 0x55572eb364d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4053fd0 tx=0x7fc7e402a410 comp rx=0 tx=0).stop 2024-07-24T22:11:21.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.089+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1519572991 shutdown_connections 2024-07-24T22:11:21.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.089+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1519572991 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55572eb997b0 0x55572eb9bbd0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.089+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1519572991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55572eb1e6f0 0x55572eb26b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.089+0000 7fc7d6ff5640 0 client.16431 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:21.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.089+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1519572991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55572eb0e350 0x55572eb26630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.089+0000 7fc7fbba9740 1 --2- 172.21.15.47:0/1519572991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55572eb0da30 0x55572eb364d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.089+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1519572991 >> 172.21.15.47:0/1519572991 conn(0x55572eb0b860 msgr2=0x55572eb0a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:21.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.089+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1519572991 shutdown_connections 2024-07-24T22:11:21.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.089+0000 7fc7fbba9740 1 -- 172.21.15.47:0/1519572991 wait complete. 2024-07-24T22:11:21.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.089+0000 7fc7fbba9740 20 client.16431 trim_cache size 0 max 16384 2024-07-24T22:11:21.095 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:11:21.095 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:11:21.095 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:11:21.095 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 16, 2024-07-24T22:11:21.095 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:11:21.095 INFO:teuthology.orchestra.run.smithi047.stdout: "e791e86c": { 2024-07-24T22:11:21.095 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 16, 2024-07-24T22:11:21.095 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:11:21.095 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:11:21.096 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:11:21.096 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:11:21.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:11:21.096 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:11:21.096 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 150.0, 2024-07-24T22:11:21.096 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:11:21.096 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:11:21.096 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:11:21.096 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:11:21.096 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:11:21.096 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:11:21.096 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:11:21.096 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:11:21.097 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:11:21.097 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:11:21.097 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:11:21.097 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:11:21.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.090+0000 7fc7f97f8640 1 -- 172.21.15.47:0/2882195887 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7dc0b3dc0 msgr2=0x7fc7dc0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:21.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.090+0000 7fc7f97f8640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7dc0b3dc0 0x7fc7dc0b6280 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4000c00 tx=0x7fc7e4005a20 comp rx=0 tx=0).stop 2024-07-24T22:11:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.090+0000 7fc7f97f8640 1 -- 172.21.15.47:0/2882195887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f4108b20 msgr2=0x7fc7f419e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.090+0000 7fc7f97f8640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f4108b20 0x7fc7f419e5e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00b970 tx=0x7fc7ec00be30 comp rx=0 tx=0).stop 2024-07-24T22:11:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.090+0000 7fc7f97f8640 1 -- 172.21.15.47:0/2882195887 shutdown_connections 2024-07-24T22:11:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.090+0000 7fc7f97f8640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc7dc0b3dc0 0x7fc7dc0b6280 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.090+0000 7fc7f97f8640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7f4108b20 0x7fc7f419e5e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.090+0000 7fc7f97f8640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7f41081a0 0x7fc7f4199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.090+0000 7fc7f97f8640 1 --2- 172.21.15.47:0/2882195887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7f4102790 0x7fc7f4198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.090+0000 7fc7f97f8640 1 -- 172.21.15.47:0/2882195887 >> 172.21.15.47:0/2882195887 conn(0x7fc7f40fe200 msgr2=0x7fc7f40febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.091+0000 7fc7f97f8640 1 -- 172.21.15.47:0/2882195887 shutdown_connections 2024-07-24T22:11:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:21.091+0000 7fc7f97f8640 1 -- 172.21.15.47:0/2882195887 wait complete. 2024-07-24T22:11:21.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:21 smithi047 ceph-mon[32551]: pgmap v490: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 9.4 KiB/s rd, 64 MiB/s wr, 45 op/s 2024-07-24T22:11:21.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:21 smithi188 ceph-mon[37380]: pgmap v490: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 9.4 KiB/s rd, 64 MiB/s wr, 45 op/s 2024-07-24T22:11:21.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:21 smithi183 ceph-mon[37007]: pgmap v490: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 9.4 KiB/s rd, 64 MiB/s wr, 45 op/s 2024-07-24T22:11:22.043 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e791e86c', total seconds elapsed: 36.5 2024-07-24T22:11:23.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:23 smithi183 ceph-mon[37007]: pgmap v491: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 9.8 KiB/s rd, 60 MiB/s wr, 41 op/s 2024-07-24T22:11:23.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:23 smithi047 ceph-mon[32551]: pgmap v491: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 9.8 KiB/s rd, 60 MiB/s wr, 41 op/s 2024-07-24T22:11:23.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:23 smithi188 ceph-mon[37380]: pgmap v491: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 9.8 KiB/s rd, 60 MiB/s wr, 41 op/s 2024-07-24T22:11:25.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:25 smithi047 ceph-mon[32551]: pgmap v492: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 9.3 KiB/s rd, 102 MiB/s wr, 298 op/s 2024-07-24T22:11:25.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:25 smithi188 ceph-mon[37380]: pgmap v492: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 9.3 KiB/s rd, 102 MiB/s wr, 298 op/s 2024-07-24T22:11:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:25 smithi183 ceph-mon[37007]: pgmap v492: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 9.3 KiB/s rd, 102 MiB/s wr, 298 op/s 2024-07-24T22:11:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.619+0000 7fe915bd8640 1 -- 172.21.15.47:0/2367933198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91011ba90 msgr2=0x7fe91011de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.619+0000 7fe915bd8640 1 --2- 172.21.15.47:0/2367933198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91011ba90 0x7fe91011de80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe904009900 tx=0x7fe90402a410 comp rx=0 tx=0).stop 2024-07-24T22:11:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.620+0000 7fe915bd8640 1 -- 172.21.15.47:0/2367933198 shutdown_connections 2024-07-24T22:11:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.620+0000 7fe915bd8640 1 --2- 172.21.15.47:0/2367933198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe91011ba90 0x7fe91011de80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.620+0000 7fe915bd8640 1 --2- 172.21.15.47:0/2367933198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910109f20 0x7fe91010a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.620+0000 7fe915bd8640 1 --2- 172.21.15.47:0/2367933198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe910109b40 0x7fe910110ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.620+0000 7fe915bd8640 1 -- 172.21.15.47:0/2367933198 >> 172.21.15.47:0/2367933198 conn(0x7fe91006d760 msgr2=0x7fe91006db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.620+0000 7fe915bd8640 1 -- 172.21.15.47:0/2367933198 shutdown_connections 2024-07-24T22:11:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.620+0000 7fe915bd8640 1 -- 172.21.15.47:0/2367933198 wait complete. 2024-07-24T22:11:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.621+0000 7fe915bd8640 1 Processor -- start 2024-07-24T22:11:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.622+0000 7fe915bd8640 1 -- start start 2024-07-24T22:11:27.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.622+0000 7fe915bd8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe910109b40 0x7fe91011b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.622+0000 7fe915bd8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910109f20 0x7fe91011b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.622+0000 7fe915bd8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe91011ba90 0x7fe9101154a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.622+0000 7fe915bd8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe910111b70 con 0x7fe910109f20 2024-07-24T22:11:27.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.622+0000 7fe915bd8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe9101119f0 con 0x7fe91011ba90 2024-07-24T22:11:27.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.622+0000 7fe915bd8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe910111cf0 con 0x7fe910109b40 2024-07-24T22:11:27.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.623+0000 7fe90effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910109f20 0x7fe91011b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.623+0000 7fe90effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910109f20 0x7fe91011b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52034/0 (socket says 172.21.15.47:52034) 2024-07-24T22:11:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.623+0000 7fe90effd640 1 -- 172.21.15.47:0/1502050716 learned_addr learned my addr 172.21.15.47:0/1502050716 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.623+0000 7fe90f7fe640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe910109b40 0x7fe91011b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.623+0000 7fe90ffff640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe91011ba90 0x7fe9101154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.623+0000 7fe90effd640 1 -- 172.21.15.47:0/1502050716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe910109b40 msgr2=0x7fe91011b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.623+0000 7fe90effd640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe910109b40 0x7fe91011b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.624+0000 7fe90effd640 1 -- 172.21.15.47:0/1502050716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe91011ba90 msgr2=0x7fe9101154a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:27.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.624+0000 7fe90effd640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe91011ba90 0x7fe9101154a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.624+0000 7fe90effd640 1 -- 172.21.15.47:0/1502050716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe910115d60 con 0x7fe910109f20 2024-07-24T22:11:27.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.624+0000 7fe90effd640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910109f20 0x7fe91011b550 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe90800ba50 tx=0x7fe90800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:27.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.625+0000 7fe90cff9640 1 -- 172.21.15.47:0/1502050716 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908019070 con 0x7fe910109f20 2024-07-24T22:11:27.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.625+0000 7fe915bd8640 1 -- 172.21.15.47:0/1502050716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe910116050 con 0x7fe910109f20 2024-07-24T22:11:27.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.625+0000 7fe915bd8640 1 -- 172.21.15.47:0/1502050716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9101bcd50 con 0x7fe910109f20 2024-07-24T22:11:27.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.625+0000 7fe90cff9640 1 -- 172.21.15.47:0/1502050716 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe90800cbe0 con 0x7fe910109f20 2024-07-24T22:11:27.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.625+0000 7fe90cff9640 1 -- 172.21.15.47:0/1502050716 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080075d0 con 0x7fe910109f20 2024-07-24T22:11:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.633+0000 7fe918a05740 1 Processor -- start 2024-07-24T22:11:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.633+0000 7fe90cff9640 1 -- 172.21.15.47:0/1502050716 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe90801c070 con 0x7fe910109f20 2024-07-24T22:11:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.635+0000 7fe90cff9640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe8f80b3df0 0x7fe8f80b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.635+0000 7fe90cff9640 1 -- 172.21.15.47:0/1502050716 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fe9080e33c0 con 0x7fe910109f20 2024-07-24T22:11:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.635+0000 7fe918a05740 1 -- start start 2024-07-24T22:11:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.636+0000 7fe918a05740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94d8c0 0x55862f94dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.636+0000 7fe918a05740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f94e1e0 0x55862f959c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.636+0000 7fe918a05740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f95a170 0x55862f95c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.636+0000 7fe918a05740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55862f8c3280 con 0x55862f94d8c0 2024-07-24T22:11:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.636+0000 7fe918a05740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55862f8b2780 con 0x55862f95a170 2024-07-24T22:11:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.636+0000 7fe918a05740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55862f8b67c0 con 0x55862f94e1e0 2024-07-24T22:11:27.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.636+0000 7fe90ffff640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe8f80b3df0 0x7fe8f80b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.637+0000 7fe90f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94d8c0 0x55862f94dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.637+0000 7fe90f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94d8c0 0x55862f94dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52036/0 (socket says 172.21.15.47:52036) 2024-07-24T22:11:27.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.637+0000 7fe90f7fe640 1 -- 172.21.15.47:0/1219063554 learned_addr learned my addr 172.21.15.47:0/1219063554 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:27.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.637+0000 7fe90ffff640 1 --2- 172.21.15.47:0/1219063554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f95a170 0x55862f95c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.637+0000 7fe90f7fe640 1 -- 172.21.15.47:0/1219063554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f94e1e0 msgr2=0x55862f959c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:11:27.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.637+0000 7fe90f7fe640 1 --2- 172.21.15.47:0/1219063554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f94e1e0 0x55862f959c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.637+0000 7fe90f7fe640 1 -- 172.21.15.47:0/1219063554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f95a170 msgr2=0x55862f95c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:27.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.638+0000 7fe90f7fe640 1 --2- 172.21.15.47:0/1219063554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f95a170 0x55862f95c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.638+0000 7fe90f7fe640 1 -- 172.21.15.47:0/1219063554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55862f616790 con 0x55862f94d8c0 2024-07-24T22:11:27.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.638+0000 7fe90f7fe640 1 --2- 172.21.15.47:0/1219063554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94d8c0 0x55862f94dca0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe90000bcb0 tx=0x7fe90000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34f96ed6f3f9c36 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:27.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.638+0000 7fe90ffff640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe8f80b3df0 0x7fe8f80b62b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe90402aa00 tx=0x7fe904004320 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:27.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.639+0000 7fe8f5ffb640 1 -- 172.21.15.47:0/1219063554 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900015070 con 0x55862f94d8c0 2024-07-24T22:11:27.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.639+0000 7fe8f5ffb640 1 -- 172.21.15.47:0/1219063554 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe90001a910 con 0x55862f94d8c0 2024-07-24T22:11:27.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.639+0000 7fe8f5ffb640 1 -- 172.21.15.47:0/1219063554 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9000118b0 con 0x55862f94d8c0 2024-07-24T22:11:27.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.640+0000 7fe918a05740 1 -- 172.21.15.47:0/1219063554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94d8c0 msgr2=0x55862f94dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:27.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.640+0000 7fe918a05740 1 --2- 172.21.15.47:0/1219063554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94d8c0 0x55862f94dca0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe90000bcb0 tx=0x7fe90000f730 comp rx=0 tx=0).stop 2024-07-24T22:11:27.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.640+0000 7fe918a05740 1 -- 172.21.15.47:0/1219063554 shutdown_connections 2024-07-24T22:11:27.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.640+0000 7fe918a05740 1 --2- 172.21.15.47:0/1219063554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f95a170 0x55862f95c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.640+0000 7fe918a05740 1 --2- 172.21.15.47:0/1219063554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f94e1e0 0x55862f959c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.640+0000 7fe918a05740 1 --2- 172.21.15.47:0/1219063554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94d8c0 0x55862f94dca0 secure :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe90000bcb0 tx=0x7fe90000f730 comp rx=0 tx=0).stop 2024-07-24T22:11:27.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.640+0000 7fe918a05740 1 -- 172.21.15.47:0/1219063554 >> 172.21.15.47:0/1219063554 conn(0x55862f94b6f0 msgr2=0x55862f94c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:27.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.641+0000 7fe918a05740 1 -- 172.21.15.47:0/1219063554 shutdown_connections 2024-07-24T22:11:27.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.641+0000 7fe918a05740 1 -- 172.21.15.47:0/1219063554 wait complete. 2024-07-24T22:11:27.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.641+0000 7fe918a05740 1 -- start start 2024-07-24T22:11:27.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.642+0000 7fe918a05740 1 Processor -- start 2024-07-24T22:11:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.642+0000 7fe918a05740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94e1e0 0x55862f959b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.642+0000 7fe918a05740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f95a170 0x55862f956fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.642+0000 7fe918a05740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f9576a0 0x55862f966210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.642+0000 7fe918a05740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55862f7ecab0 con 0x55862f94e1e0 2024-07-24T22:11:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.642+0000 7fe918a05740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55862f83a9e0 con 0x55862f95a170 2024-07-24T22:11:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.642+0000 7fe918a05740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55862f95ce50 con 0x55862f9576a0 2024-07-24T22:11:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.642+0000 7fe918a05740 10 client.0 _ll_register_callbacks cb 0x55862f5c2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:27.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.643+0000 7fe90f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94e1e0 0x55862f959b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.643+0000 7fe90f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94e1e0 0x55862f959b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52042/0 (socket says 172.21.15.47:52042) 2024-07-24T22:11:27.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.643+0000 7fe90f7fe640 1 -- 172.21.15.47:0/3642012841 learned_addr learned my addr 172.21.15.47:0/3642012841 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:27.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.644+0000 7fe90ffff640 1 --2- 172.21.15.47:0/3642012841 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f9576a0 0x55862f966210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.644+0000 7fe90effd640 1 --2- 172.21.15.47:0/3642012841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f95a170 0x55862f956fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.644+0000 7fe90f7fe640 1 -- 172.21.15.47:0/3642012841 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f9576a0 msgr2=0x55862f966210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:27.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.644+0000 7fe90f7fe640 1 --2- 172.21.15.47:0/3642012841 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f9576a0 0x55862f966210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.644+0000 7fe90f7fe640 1 -- 172.21.15.47:0/3642012841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f95a170 msgr2=0x55862f956fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:27.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.644+0000 7fe90f7fe640 1 --2- 172.21.15.47:0/3642012841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f95a170 0x55862f956fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.644+0000 7fe90f7fe640 1 -- 172.21.15.47:0/3642012841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55862f68f620 con 0x55862f94e1e0 2024-07-24T22:11:27.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.645+0000 7fe90f7fe640 1 --2- 172.21.15.47:0/3642012841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94e1e0 0x55862f959b70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe900000c00 tx=0x7fe90000b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661f4e278a0c7eea server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:27.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.646+0000 7fe8eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:27.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.647+0000 7fe8eeffd640 1 -- 172.21.15.47:0/3642012841 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900028020 con 0x55862f94e1e0 2024-07-24T22:11:27.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.647+0000 7fe918a05740 1 -- 172.21.15.47:0/3642012841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55862f861ce0 con 0x55862f94e1e0 2024-07-24T22:11:27.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.647+0000 7fe8eeffd640 1 -- 172.21.15.47:0/3642012841 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fe900004220 con 0x55862f94e1e0 2024-07-24T22:11:27.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.647+0000 7fe8eeffd640 1 -- 172.21.15.47:0/3642012841 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe900015050 con 0x55862f94e1e0 2024-07-24T22:11:27.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.648+0000 7fe918a05740 10 client.16440 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:27.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.648+0000 7fe918a05740 1 -- 172.21.15.47:0/3642012841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55862f968d00 con 0x55862f94e1e0 2024-07-24T22:11:27.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.648+0000 7fe8eeffd640 1 -- 172.21.15.47:0/3642012841 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55862f861ce0 con 0x55862f94e1e0 2024-07-24T22:11:27.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.648+0000 7fe8eeffd640 1 -- 172.21.15.47:0/3642012841 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe900023070 con 0x55862f94e1e0 2024-07-24T22:11:27.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.649+0000 7fe918a05740 10 client.16440 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:27.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.649+0000 7fe918a05740 10 client.16440 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:27.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.649+0000 7fe918a05740 20 client.16440 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:27.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.649+0000 7fe918a05740 1 --2- 172.21.15.47:0/3642012841 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55862f96a430 0x55862f96c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.649+0000 7fe918a05740 4 client.16440 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:11:27.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.649+0000 7fe918a05740 1 -- 172.21.15.47:0/3642012841 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55862f8c51d0 con 0x55862f96a430 2024-07-24T22:11:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.650+0000 7fe90effd640 1 --2- 172.21.15.47:0/3642012841 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55862f96a430 0x55862f96c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.654+0000 7fe90effd640 1 --2- 172.21.15.47:0/3642012841 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55862f96a430 0x55862f96c870 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efca61d2e0930818 server_cookie=eb08499f2e15682e in_seq=0 out_seq=0 2024-07-24T22:11:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.654+0000 7fe8eeffd640 10 client.16440 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.661+0000 7fe8eeffd640 1 -- 172.21.15.47:0/3642012841 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55862f8c51d0 con 0x55862f96a430 2024-07-24T22:11:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.661+0000 7fe8eeffd640 10 client.16440 handle_command_reply: tid=0 2024-07-24T22:11:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.661+0000 7fe918a05740 1 client.16440 shutdown 2024-07-24T22:11:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.661+0000 7fe918a05740 1 -- 172.21.15.47:0/3642012841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94e1e0 msgr2=0x55862f959b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.661+0000 7fe918a05740 1 --2- 172.21.15.47:0/3642012841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94e1e0 0x55862f959b70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe900000c00 tx=0x7fe90000b9f0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.661+0000 7fe918a05740 1 -- 172.21.15.47:0/3642012841 shutdown_connections 2024-07-24T22:11:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.661+0000 7fe918a05740 1 --2- 172.21.15.47:0/3642012841 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55862f96a430 0x55862f96c870 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.661+0000 7fe918a05740 1 --2- 172.21.15.47:0/3642012841 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f9576a0 0x55862f966210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.661+0000 7fe918a05740 1 --2- 172.21.15.47:0/3642012841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f95a170 0x55862f956fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.661+0000 7fe918a05740 1 --2- 172.21.15.47:0/3642012841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f94e1e0 0x55862f959b70 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.661+0000 7fe918a05740 1 -- 172.21.15.47:0/3642012841 >> 172.21.15.47:0/3642012841 conn(0x55862f94b6f0 msgr2=0x55862f951290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.662+0000 7fe8eeffd640 0 client.16440 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.662+0000 7fe918a05740 1 -- 172.21.15.47:0/3642012841 shutdown_connections 2024-07-24T22:11:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.662+0000 7fe918a05740 1 -- 172.21.15.47:0/3642012841 wait complete. 2024-07-24T22:11:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.662+0000 7fe918a05740 20 client.16440 trim_cache size 0 max 16384 2024-07-24T22:11:27.713 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.710+0000 7fe918a05740 1 Processor -- start 2024-07-24T22:11:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.711+0000 7fe918a05740 1 -- start start 2024-07-24T22:11:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.711+0000 7fe918a05740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f94e1e0 0x55862f9522f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.711+0000 7fe918a05740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f9576a0 0x55862f966000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.711+0000 7fe918a05740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f95a170 0x55862f966540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.712+0000 7fe918a05740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc00c900 con 0x55862f95a170 2024-07-24T22:11:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.712+0000 7fe918a05740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc00f180 con 0x55862f9576a0 2024-07-24T22:11:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.712+0000 7fe918a05740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc00cf70 con 0x55862f94e1e0 2024-07-24T22:11:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.712+0000 7fe90f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f94e1e0 0x55862f9522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.712+0000 7fe90ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f95a170 0x55862f966540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.712+0000 7fe90f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f94e1e0 0x55862f9522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:42718/0 (socket says 172.21.15.47:42718) 2024-07-24T22:11:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.712+0000 7fe90f7fe640 1 -- 172.21.15.47:0/1922937084 learned_addr learned my addr 172.21.15.47:0/1922937084 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.713+0000 7fe90effd640 1 --2- 172.21.15.47:0/1922937084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f9576a0 0x55862f966000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.714+0000 7fe90ffff640 1 -- 172.21.15.47:0/1922937084 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f94e1e0 msgr2=0x55862f9522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.714+0000 7fe90ffff640 1 --2- 172.21.15.47:0/1922937084 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f94e1e0 0x55862f9522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.714+0000 7fe90ffff640 1 -- 172.21.15.47:0/1922937084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f9576a0 msgr2=0x55862f966000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.714+0000 7fe90ffff640 1 --2- 172.21.15.47:0/1922937084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f9576a0 0x55862f966000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.714+0000 7fe90ffff640 1 -- 172.21.15.47:0/1922937084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55862f94e010 con 0x55862f95a170 2024-07-24T22:11:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.718+0000 7fe90ffff640 1 --2- 172.21.15.47:0/1922937084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f95a170 0x55862f966540 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe904009230 tx=0x7fe904043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e28aaf8c753176 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:27.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.723+0000 7fe8f57fa640 1 -- 172.21.15.47:0/1922937084 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe904035050 con 0x55862f95a170 2024-07-24T22:11:27.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.724+0000 7fe8f57fa640 1 -- 172.21.15.47:0/1922937084 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9040054c0 con 0x55862f95a170 2024-07-24T22:11:27.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.725+0000 7fe8f57fa640 1 -- 172.21.15.47:0/1922937084 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9040039f0 con 0x55862f95a170 2024-07-24T22:11:27.729 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.726+0000 7fe918a05740 1 -- 172.21.15.47:0/1922937084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f95a170 msgr2=0x55862f966540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:27.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.726+0000 7fe918a05740 1 --2- 172.21.15.47:0/1922937084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f95a170 0x55862f966540 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe904009230 tx=0x7fe904043000 comp rx=0 tx=0).stop 2024-07-24T22:11:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.732+0000 7fe918a05740 1 -- 172.21.15.47:0/1922937084 shutdown_connections 2024-07-24T22:11:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.732+0000 7fe918a05740 1 --2- 172.21.15.47:0/1922937084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f95a170 0x55862f966540 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.732+0000 7fe918a05740 1 --2- 172.21.15.47:0/1922937084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f9576a0 0x55862f966000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.732+0000 7fe918a05740 1 --2- 172.21.15.47:0/1922937084 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f94e1e0 0x55862f9522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.732+0000 7fe918a05740 1 -- 172.21.15.47:0/1922937084 >> 172.21.15.47:0/1922937084 conn(0x55862f94b6f0 msgr2=0x55862f951be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.739+0000 7fe918a05740 1 -- 172.21.15.47:0/1922937084 shutdown_connections 2024-07-24T22:11:27.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.740+0000 7fe918a05740 1 -- 172.21.15.47:0/1922937084 wait complete. 2024-07-24T22:11:27.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.741+0000 7fe918a05740 1 -- start start 2024-07-24T22:11:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.742+0000 7fe918a05740 1 Processor -- start 2024-07-24T22:11:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.743+0000 7fe918a05740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f94e1e0 0x55862f962370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.743+0000 7fe918a05740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f9576a0 0x55862f9628b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.743+0000 7fe918a05740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f95a170 0x55862f95d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.743+0000 7fe918a05740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc00d640 con 0x55862f95a170 2024-07-24T22:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.743+0000 7fe918a05740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc00eab0 con 0x55862f94e1e0 2024-07-24T22:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.743+0000 7fe918a05740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc00dd10 con 0x55862f9576a0 2024-07-24T22:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.743+0000 7fe918a05740 10 client.0 _ll_register_callbacks cb 0x7fe90000bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.744+0000 7fe90ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f95a170 0x55862f95d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.744+0000 7fe90ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f95a170 0x55862f95d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52060/0 (socket says 172.21.15.47:52060) 2024-07-24T22:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.744+0000 7fe90ffff640 1 -- 172.21.15.47:0/1299096889 learned_addr learned my addr 172.21.15.47:0/1299096889 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.746+0000 7fe90f7fe640 1 --2- 172.21.15.47:0/1299096889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f94e1e0 0x55862f962370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.746+0000 7fe90ffff640 1 -- 172.21.15.47:0/1299096889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f9576a0 msgr2=0x55862f9628b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.746+0000 7fe90ffff640 1 --2- 172.21.15.47:0/1299096889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f9576a0 0x55862f9628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.746+0000 7fe90ffff640 1 -- 172.21.15.47:0/1299096889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f94e1e0 msgr2=0x55862f962370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.746+0000 7fe90ffff640 1 --2- 172.21.15.47:0/1299096889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f94e1e0 0x55862f962370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.746+0000 7fe90ffff640 1 -- 172.21.15.47:0/1299096889 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55862f95d960 con 0x55862f95a170 2024-07-24T22:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.747+0000 7fe90f7fe640 1 --2- 172.21.15.47:0/1299096889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f94e1e0 0x55862f962370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:11:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.747+0000 7fe90ffff640 1 --2- 172.21.15.47:0/1299096889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f95a170 0x55862f95d130 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe90402a450 tx=0x7fe904004d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1db2a7f3024d1d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.751+0000 7fe8eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.751+0000 7fe8eeffd640 1 -- 172.21.15.47:0/1299096889 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe904003980 con 0x55862f95a170 2024-07-24T22:11:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.751+0000 7fe918a05740 1 -- 172.21.15.47:0/1299096889 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9040054c0 con 0x55862f95a170 2024-07-24T22:11:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.751+0000 7fe8eeffd640 1 -- 172.21.15.47:0/1299096889 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fe904003b20 con 0x55862f95a170 2024-07-24T22:11:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.756+0000 7fe8eeffd640 1 -- 172.21.15.47:0/1299096889 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe904065050 con 0x55862f95a170 2024-07-24T22:11:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.756+0000 7fe918a05740 10 client.16446 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.756+0000 7fe918a05740 1 -- 172.21.15.47:0/1299096889 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55862f9d3c30 con 0x55862f95a170 2024-07-24T22:11:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.760+0000 7fe8eeffd640 1 -- 172.21.15.47:0/1299096889 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9040054c0 con 0x55862f95a170 2024-07-24T22:11:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.760+0000 7fe8eeffd640 1 -- 172.21.15.47:0/1299096889 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe904047050 con 0x55862f95a170 2024-07-24T22:11:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.760+0000 7fe918a05740 10 client.16446 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:27.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.760+0000 7fe918a05740 10 client.16446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:27.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.760+0000 7fe918a05740 20 client.16446 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:27.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.760+0000 7fe918a05740 1 --2- 172.21.15.47:0/1299096889 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55862f9d43e0 0x55862f9d6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:27.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.760+0000 7fe918a05740 4 client.16446 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:11:27.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.760+0000 7fe918a05740 1 -- 172.21.15.47:0/1299096889 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55862f8c0c70 con 0x55862f9d43e0 2024-07-24T22:11:27.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.766+0000 7fe90f7fe640 1 --2- 172.21.15.47:0/1299096889 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55862f9d43e0 0x55862f9d6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:27.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.776+0000 7fe8eeffd640 10 client.16446 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:27.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:27.776+0000 7fe90f7fe640 1 --2- 172.21.15.47:0/1299096889 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55862f9d43e0 0x55862f9d6800 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79b4cc27b2bd40a6 server_cookie=91afece3a315453e in_seq=0 out_seq=0 2024-07-24T22:11:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:27 smithi188 ceph-mon[37380]: pgmap v493: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 95 MiB/s wr, 390 op/s 2024-07-24T22:11:27.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:27 smithi183 ceph-mon[37007]: pgmap v493: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 95 MiB/s wr, 390 op/s 2024-07-24T22:11:27.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:27 smithi047 ceph-mon[32551]: pgmap v493: 97 pgs: 97 active+clean; 30 GiB data, 90 GiB used, 982 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 95 MiB/s wr, 390 op/s 2024-07-24T22:11:29.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:29 smithi188 ceph-mon[37380]: pgmap v494: 97 pgs: 97 active+clean; 30 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 3.7 KiB/s rd, 226 MiB/s wr, 1.14k op/s 2024-07-24T22:11:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:29 smithi183 ceph-mon[37007]: pgmap v494: 97 pgs: 97 active+clean; 30 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 3.7 KiB/s rd, 226 MiB/s wr, 1.14k op/s 2024-07-24T22:11:29.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:29 smithi047 ceph-mon[32551]: pgmap v494: 97 pgs: 97 active+clean; 30 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 3.7 KiB/s rd, 226 MiB/s wr, 1.14k op/s 2024-07-24T22:11:31.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:31 smithi183 ceph-mon[37007]: pgmap v495: 97 pgs: 97 active+clean; 31 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 352 MiB/s wr, 1.72k op/s 2024-07-24T22:11:31.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:31 smithi047 ceph-mon[32551]: pgmap v495: 97 pgs: 97 active+clean; 31 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 352 MiB/s wr, 1.72k op/s 2024-07-24T22:11:32.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:31 smithi188 ceph-mon[37380]: pgmap v495: 97 pgs: 97 active+clean; 31 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 352 MiB/s wr, 1.72k op/s 2024-07-24T22:11:32.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe8eeffd640 1 -- 172.21.15.47:0/1299096889 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55862f8c0c70 con 0x55862f9d43e0 2024-07-24T22:11:32.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe8eeffd640 10 client.16446 handle_command_reply: tid=0 2024-07-24T22:11:32.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe918a05740 1 client.16446 shutdown 2024-07-24T22:11:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe918a05740 1 -- 172.21.15.47:0/1299096889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f95a170 msgr2=0x55862f95d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe918a05740 1 --2- 172.21.15.47:0/1299096889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f95a170 0x55862f95d130 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe90402a450 tx=0x7fe904004d40 comp rx=0 tx=0).stop 2024-07-24T22:11:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe918a05740 1 -- 172.21.15.47:0/1299096889 shutdown_connections 2024-07-24T22:11:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe918a05740 1 --2- 172.21.15.47:0/1299096889 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55862f9d43e0 0x55862f9d6800 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe918a05740 1 --2- 172.21.15.47:0/1299096889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55862f95a170 0x55862f95d130 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe918a05740 1 --2- 172.21.15.47:0/1299096889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55862f9576a0 0x55862f9628b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe918a05740 1 --2- 172.21.15.47:0/1299096889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55862f94e1e0 0x55862f962370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe918a05740 1 -- 172.21.15.47:0/1299096889 >> 172.21.15.47:0/1299096889 conn(0x55862f94b6f0 msgr2=0x55862f956ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe8eeffd640 0 client.16446 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe918a05740 1 -- 172.21.15.47:0/1299096889 shutdown_connections 2024-07-24T22:11:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.055+0000 7fe918a05740 1 -- 172.21.15.47:0/1299096889 wait complete. 2024-07-24T22:11:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.056+0000 7fe918a05740 20 client.16446 trim_cache size 0 max 16384 2024-07-24T22:11:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:11:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:11:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:11:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:11:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.056+0000 7fe915bd8640 1 -- 172.21.15.47:0/1502050716 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe8f80b3df0 msgr2=0x7fe8f80b62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.056+0000 7fe915bd8640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe8f80b3df0 0x7fe8f80b62b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe90402aa00 tx=0x7fe904004320 comp rx=0 tx=0).stop 2024-07-24T22:11:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.056+0000 7fe915bd8640 1 -- 172.21.15.47:0/1502050716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910109f20 msgr2=0x7fe91011b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.056+0000 7fe915bd8640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910109f20 0x7fe91011b550 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe90800ba50 tx=0x7fe90800bf10 comp rx=0 tx=0).stop 2024-07-24T22:11:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.056+0000 7fe915bd8640 1 -- 172.21.15.47:0/1502050716 shutdown_connections 2024-07-24T22:11:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.056+0000 7fe915bd8640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe8f80b3df0 0x7fe8f80b62b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.056+0000 7fe915bd8640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe91011ba90 0x7fe9101154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.056+0000 7fe915bd8640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910109f20 0x7fe91011b550 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.056+0000 7fe915bd8640 1 --2- 172.21.15.47:0/1502050716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe910109b40 0x7fe91011b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:32.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.056+0000 7fe915bd8640 1 -- 172.21.15.47:0/1502050716 >> 172.21.15.47:0/1502050716 conn(0x7fe91006d760 msgr2=0x7fe910071160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.057+0000 7fe915bd8640 1 -- 172.21.15.47:0/1502050716 shutdown_connections 2024-07-24T22:11:32.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:32.057+0000 7fe915bd8640 1 -- 172.21.15.47:0/1502050716 wait complete. 2024-07-24T22:11:33.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:33 smithi183 ceph-mon[37007]: pgmap v496: 97 pgs: 97 active+clean; 32 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 408 MiB/s wr, 2.05k op/s 2024-07-24T22:11:33.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:33 smithi047 ceph-mon[32551]: pgmap v496: 97 pgs: 97 active+clean; 32 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 408 MiB/s wr, 2.05k op/s 2024-07-24T22:11:34.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:33 smithi188 ceph-mon[37380]: pgmap v496: 97 pgs: 97 active+clean; 32 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 408 MiB/s wr, 2.05k op/s 2024-07-24T22:11:35.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:35 smithi047 ceph-mon[32551]: pgmap v497: 97 pgs: 97 active+clean; 33 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 514 MiB/s wr, 2.78k op/s 2024-07-24T22:11:36.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:35 smithi188 ceph-mon[37380]: pgmap v497: 97 pgs: 97 active+clean; 33 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 514 MiB/s wr, 2.78k op/s 2024-07-24T22:11:36.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:35 smithi183 ceph-mon[37007]: pgmap v497: 97 pgs: 97 active+clean; 33 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 514 MiB/s wr, 2.78k op/s 2024-07-24T22:11:38.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:37 smithi188 ceph-mon[37380]: pgmap v498: 97 pgs: 97 active+clean; 33 GiB data, 99 GiB used, 973 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 494 MiB/s wr, 2.73k op/s 2024-07-24T22:11:38.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:37 smithi183 ceph-mon[37007]: pgmap v498: 97 pgs: 97 active+clean; 33 GiB data, 99 GiB used, 973 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 494 MiB/s wr, 2.73k op/s 2024-07-24T22:11:38.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:37 smithi047 ceph-mon[32551]: pgmap v498: 97 pgs: 97 active+clean; 33 GiB data, 99 GiB used, 973 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 494 MiB/s wr, 2.73k op/s 2024-07-24T22:11:39.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:39 smithi188 ceph-mon[37380]: pgmap v499: 97 pgs: 97 active+clean; 34 GiB data, 102 GiB used, 970 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 632 MiB/s wr, 3.25k op/s 2024-07-24T22:11:39.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:39 smithi183 ceph-mon[37007]: pgmap v499: 97 pgs: 97 active+clean; 34 GiB data, 102 GiB used, 970 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 632 MiB/s wr, 3.25k op/s 2024-07-24T22:11:39.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:39 smithi047 ceph-mon[32551]: pgmap v499: 97 pgs: 97 active+clean; 34 GiB data, 102 GiB used, 970 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 632 MiB/s wr, 3.25k op/s 2024-07-24T22:11:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:41 smithi183 ceph-mon[37007]: pgmap v500: 97 pgs: 97 active+clean; 34 GiB data, 106 GiB used, 967 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 622 MiB/s wr, 2.88k op/s 2024-07-24T22:11:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:41 smithi047 ceph-mon[32551]: pgmap v500: 97 pgs: 97 active+clean; 34 GiB data, 106 GiB used, 967 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 622 MiB/s wr, 2.88k op/s 2024-07-24T22:11:41.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:41 smithi188 ceph-mon[37380]: pgmap v500: 97 pgs: 97 active+clean; 34 GiB data, 106 GiB used, 967 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 622 MiB/s wr, 2.88k op/s 2024-07-24T22:11:43.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:43 smithi183 ceph-mon[37007]: pgmap v501: 97 pgs: 97 active+clean; 35 GiB data, 109 GiB used, 964 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 561 MiB/s wr, 2.55k op/s 2024-07-24T22:11:43.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:43 smithi047 ceph-mon[32551]: pgmap v501: 97 pgs: 97 active+clean; 35 GiB data, 109 GiB used, 964 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 561 MiB/s wr, 2.55k op/s 2024-07-24T22:11:43.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:43 smithi188 ceph-mon[37380]: pgmap v501: 97 pgs: 97 active+clean; 35 GiB data, 109 GiB used, 964 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 561 MiB/s wr, 2.55k op/s 2024-07-24T22:11:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.350+0000 7f6da83e8640 1 -- 172.21.15.47:0/2622024591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0109b40 msgr2=0x7f6da0110ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.350+0000 7f6da83e8640 1 --2- 172.21.15.47:0/2622024591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0109b40 0x7f6da0110ba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009900 tx=0x7f6d9c02a420 comp rx=0 tx=0).stop 2024-07-24T22:11:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.351+0000 7f6da83e8640 1 -- 172.21.15.47:0/2622024591 shutdown_connections 2024-07-24T22:11:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.351+0000 7f6da83e8640 1 --2- 172.21.15.47:0/2622024591 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6da011ba90 0x7f6da011de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.351+0000 7f6da83e8640 1 --2- 172.21.15.47:0/2622024591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da0109f20 0x7f6da010a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.351+0000 7f6da83e8640 1 --2- 172.21.15.47:0/2622024591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0109b40 0x7f6da0110ba0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.351+0000 7f6da83e8640 1 -- 172.21.15.47:0/2622024591 >> 172.21.15.47:0/2622024591 conn(0x7f6da006d5a0 msgr2=0x7f6da006d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.351+0000 7f6da83e8640 1 -- 172.21.15.47:0/2622024591 shutdown_connections 2024-07-24T22:11:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.351+0000 7f6da83e8640 1 -- 172.21.15.47:0/2622024591 wait complete. 2024-07-24T22:11:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.352+0000 7f6da83e8640 1 Processor -- start 2024-07-24T22:11:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.352+0000 7f6da83e8640 1 -- start start 2024-07-24T22:11:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.353+0000 7f6da83e8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6da0109b40 0x7f6da011b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.353+0000 7f6da83e8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0109f20 0x7f6da0115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.353+0000 7f6da83e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da011ba90 0x7f6da01157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.353+0000 7f6da83e8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6da0111b70 con 0x7f6da011ba90 2024-07-24T22:11:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.353+0000 7f6da83e8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01119f0 con 0x7f6da0109f20 2024-07-24T22:11:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.353+0000 7f6da83e8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6da0111cf0 con 0x7f6da0109b40 2024-07-24T22:11:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.354+0000 7f6da5983640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0109f20 0x7f6da0115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.354+0000 7f6da5983640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0109f20 0x7f6da0115280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:39026/0 (socket says 172.21.15.47:39026) 2024-07-24T22:11:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.354+0000 7f6da5983640 1 -- 172.21.15.47:0/2524455485 learned_addr learned my addr 172.21.15.47:0/2524455485 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.355+0000 7f6da6184640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6da0109b40 0x7f6da011b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.357+0000 7f6da5983640 1 -- 172.21.15.47:0/2524455485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6da0109b40 msgr2=0x7f6da011b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.357+0000 7f6da5983640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6da0109b40 0x7f6da011b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.357+0000 7f6da5983640 1 -- 172.21.15.47:0/2524455485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da011ba90 msgr2=0x7f6da01157c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T22:11:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.357+0000 7f6da6985640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da011ba90 0x7f6da01157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.357+0000 7f6da5983640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da011ba90 0x7f6da01157c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.357+0000 7f6da5983640 1 -- 172.21.15.47:0/2524455485 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da0115e30 con 0x7f6da0109f20 2024-07-24T22:11:45.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.359+0000 7f6da5983640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0109f20 0x7f6da0115280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800b9e0 tx=0x7f6d9800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.360+0000 7f6d977fe640 1 -- 172.21.15.47:0/2524455485 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98019070 con 0x7f6da0109f20 2024-07-24T22:11:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.360+0000 7f6d977fe640 1 -- 172.21.15.47:0/2524455485 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d98014440 con 0x7f6da0109f20 2024-07-24T22:11:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.360+0000 7f6d977fe640 1 -- 172.21.15.47:0/2524455485 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d980125a0 con 0x7f6da0109f20 2024-07-24T22:11:45.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.361+0000 7f6da83e8640 1 -- 172.21.15.47:0/2524455485 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da01bc7f0 con 0x7f6da0109f20 2024-07-24T22:11:45.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.361+0000 7f6da83e8640 1 -- 172.21.15.47:0/2524455485 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da01bcba0 con 0x7f6da0109f20 2024-07-24T22:11:45.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.367+0000 7f6dab211740 1 Processor -- start 2024-07-24T22:11:45.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.379+0000 7f6dab211740 1 -- start start 2024-07-24T22:11:45.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.383+0000 7f6d977fe640 1 -- 172.21.15.47:0/2524455485 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f6d9800cb20 con 0x7f6da0109f20 2024-07-24T22:11:45.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.383+0000 7f6dab211740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a594aa0 0x56029a594e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.383+0000 7f6dab211740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 0x56029a5a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.383+0000 7f6dab211740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5a1350 0x56029a5a3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.383+0000 7f6dab211740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56029a50a280 con 0x56029a594aa0 2024-07-24T22:11:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.383+0000 7f6dab211740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56029a4f9780 con 0x56029a5a1350 2024-07-24T22:11:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.383+0000 7f6dab211740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56029a4fd7c0 con 0x56029a5953c0 2024-07-24T22:11:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.385+0000 7f6d977fe640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6d8c0b3ef0 0x7f6d8c0b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.385+0000 7f6da6184640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 0x56029a5a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.385+0000 7f6da6184640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 0x56029a5a0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:39396/0 (socket says 172.21.15.47:39396) 2024-07-24T22:11:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.385+0000 7f6da6184640 1 -- 172.21.15.47:0/1469085291 learned_addr learned my addr 172.21.15.47:0/1469085291 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.385+0000 7f6da5983640 1 --2- 172.21.15.47:0/1469085291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5a1350 0x56029a5a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.385+0000 7f6da6985640 1 --2- 172.21.15.47:0/1469085291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a594aa0 0x56029a594e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.386+0000 7f6d977fe640 1 -- 172.21.15.47:0/2524455485 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f6d980e3370 con 0x7f6da0109f20 2024-07-24T22:11:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.386+0000 7f6da5983640 1 -- 172.21.15.47:0/1469085291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 msgr2=0x56029a5a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.386+0000 7f6da5983640 1 --2- 172.21.15.47:0/1469085291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 0x56029a5a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.386+0000 7f6da5983640 1 -- 172.21.15.47:0/1469085291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a594aa0 msgr2=0x56029a594e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.386+0000 7f6da5983640 1 --2- 172.21.15.47:0/1469085291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a594aa0 0x56029a594e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.386+0000 7f6da5983640 1 -- 172.21.15.47:0/1469085291 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56029a25d790 con 0x56029a5a1350 2024-07-24T22:11:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.387+0000 7f6da6985640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6d8c0b3ef0 0x7f6d8c0b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.388+0000 7f6da5983640 1 --2- 172.21.15.47:0/1469085291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5a1350 0x56029a5a3740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6d980e0bd0 tx=0x7f6d980777c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e771144444126731 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.390+0000 7f6d94bfe640 1 -- 172.21.15.47:0/1469085291 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d980aa6f0 con 0x56029a5a1350 2024-07-24T22:11:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.391+0000 7f6d94bfe640 1 -- 172.21.15.47:0/1469085291 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d98081e50 con 0x56029a5a1350 2024-07-24T22:11:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.392+0000 7f6dab211740 1 -- 172.21.15.47:0/1469085291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5a1350 msgr2=0x56029a5a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.392+0000 7f6dab211740 1 --2- 172.21.15.47:0/1469085291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5a1350 0x56029a5a3740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6d980e0bd0 tx=0x7f6d980777c0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.392+0000 7f6dab211740 1 -- 172.21.15.47:0/1469085291 shutdown_connections 2024-07-24T22:11:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.393+0000 7f6dab211740 1 --2- 172.21.15.47:0/1469085291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5a1350 0x56029a5a3740 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.393+0000 7f6dab211740 1 --2- 172.21.15.47:0/1469085291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 0x56029a5a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.393+0000 7f6dab211740 1 --2- 172.21.15.47:0/1469085291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a594aa0 0x56029a594e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.393+0000 7f6dab211740 1 -- 172.21.15.47:0/1469085291 >> 172.21.15.47:0/1469085291 conn(0x56029a5928d0 msgr2=0x56029a593a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.393+0000 7f6dab211740 1 -- 172.21.15.47:0/1469085291 shutdown_connections 2024-07-24T22:11:45.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.396+0000 7f6dab211740 1 -- 172.21.15.47:0/1469085291 wait complete. 2024-07-24T22:11:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.396+0000 7f6dab211740 1 -- start start 2024-07-24T22:11:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.397+0000 7f6dab211740 1 Processor -- start 2024-07-24T22:11:45.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.397+0000 7f6da6985640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6d8c0b3ef0 0x7f6d8c0b63b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6da010ab20 tx=0x7f6d90004730 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.398+0000 7f6dab211740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a594aa0 0x56029a5a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.398+0000 7f6dab211740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 0x56029a5a0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.398+0000 7f6dab211740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a5a0bc0 0x56029a5a1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.398+0000 7f6da6184640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a594aa0 0x56029a5a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.398+0000 7f6da6184640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a594aa0 0x56029a5a3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:39042/0 (socket says 172.21.15.47:39042) 2024-07-24T22:11:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.398+0000 7f6da5983640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 0x56029a5a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.398+0000 7f6da5983640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 0x56029a5a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:39406/0 (socket says 172.21.15.47:39406) 2024-07-24T22:11:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.398+0000 7f6da6184640 1 -- 172.21.15.47:0/881801871 learned_addr learned my addr 172.21.15.47:0/881801871 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.398+0000 7f6dab211740 1 -- 172.21.15.47:0/881801871 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56029a433ab0 con 0x56029a5a0bc0 2024-07-24T22:11:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.398+0000 7f6dab211740 1 -- 172.21.15.47:0/881801871 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56029a4819e0 con 0x56029a594aa0 2024-07-24T22:11:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.399+0000 7f6dab211740 1 -- 172.21.15.47:0/881801871 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56029a5a4020 con 0x56029a5953c0 2024-07-24T22:11:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.399+0000 7f6da6184640 1 -- 172.21.15.47:0/881801871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 msgr2=0x56029a5a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.399+0000 7f6da6184640 1 --2- 172.21.15.47:0/881801871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 0x56029a5a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.399+0000 7f6da6184640 1 -- 172.21.15.47:0/881801871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a5a0bc0 msgr2=0x56029a5a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.399+0000 7f6da6184640 1 --2- 172.21.15.47:0/881801871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a5a0bc0 0x56029a5a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.399+0000 7f6da6184640 1 -- 172.21.15.47:0/881801871 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56029a2d6620 con 0x56029a594aa0 2024-07-24T22:11:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.399+0000 7f6da6184640 1 --2- 172.21.15.47:0/881801871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a594aa0 0x56029a5a3240 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009850 tx=0x7f6d9c005000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f97f908265e1a7d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.400+0000 7f6d89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:11:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.400+0000 7f6d89ffb640 1 -- 172.21.15.47:0/881801871 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c035040 con 0x56029a594aa0 2024-07-24T22:11:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.400+0000 7f6d89ffb640 1 -- 172.21.15.47:0/881801871 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f6d9c0046c0 con 0x56029a594aa0 2024-07-24T22:11:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.400+0000 7f6dab211740 10 client.0 _ll_register_callbacks cb 0x56029a209a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.400+0000 7f6dab211740 1 -- 172.21.15.47:0/881801871 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56029a4a8ce0 con 0x56029a594aa0 2024-07-24T22:11:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.401+0000 7f6d89ffb640 1 -- 172.21.15.47:0/881801871 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6d9c005640 con 0x56029a594aa0 2024-07-24T22:11:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.401+0000 7f6dab211740 10 client.25811 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.401+0000 7f6dab211740 1 -- 172.21.15.47:0/881801871 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({fsmap=20}) -- 0x56029a5af8b0 con 0x56029a594aa0 2024-07-24T22:11:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.401+0000 7f6d89ffb640 1 -- 172.21.15.47:0/881801871 <== mon.2 v2:172.21.15.183:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6d9c0048c0 con 0x56029a594aa0 2024-07-24T22:11:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.402+0000 7f6dab211740 10 client.25811 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.402+0000 7f6dab211740 10 client.25811 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.402+0000 7f6dab211740 20 client.25811 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.402+0000 7f6dab211740 1 --2- 172.21.15.47:0/881801871 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56029a5b0d00 0x56029a5b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.402+0000 7f6dab211740 4 client.25811 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:11:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.402+0000 7f6dab211740 1 -- 172.21.15.47:0/881801871 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56029a4a8ce0 con 0x56029a5b0d00 2024-07-24T22:11:45.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.402+0000 7f6da5983640 1 --2- 172.21.15.47:0/881801871 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56029a5b0d00 0x56029a5b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.403+0000 7f6d89ffb640 10 client.25811 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:45.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.403+0000 7f6da5983640 1 --2- 172.21.15.47:0/881801871 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56029a5b0d00 0x56029a5b31c0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=120491bf0be73258 server_cookie=588103ba9a34e4ca in_seq=0 out_seq=0 2024-07-24T22:11:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.404+0000 7f6d89ffb640 1 -- 172.21.15.47:0/881801871 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56029a4a8ce0 con 0x56029a5b0d00 2024-07-24T22:11:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.404+0000 7f6d89ffb640 10 client.25811 handle_command_reply: tid=0 2024-07-24T22:11:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.404+0000 7f6dab211740 1 client.25811 shutdown 2024-07-24T22:11:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.404+0000 7f6dab211740 1 -- 172.21.15.47:0/881801871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a594aa0 msgr2=0x56029a5a3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.404+0000 7f6dab211740 1 --2- 172.21.15.47:0/881801871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a594aa0 0x56029a5a3240 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009850 tx=0x7f6d9c005000 comp rx=0 tx=0).stop 2024-07-24T22:11:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.404+0000 7f6dab211740 1 -- 172.21.15.47:0/881801871 shutdown_connections 2024-07-24T22:11:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.404+0000 7f6dab211740 1 --2- 172.21.15.47:0/881801871 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56029a5b0d00 0x56029a5b31c0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.404+0000 7f6dab211740 1 --2- 172.21.15.47:0/881801871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a5a0bc0 0x56029a5a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.404+0000 7f6dab211740 1 --2- 172.21.15.47:0/881801871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 0x56029a5a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.404+0000 7f6d89ffb640 0 client.25811 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:45.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.404+0000 7f6dab211740 1 --2- 172.21.15.47:0/881801871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a594aa0 0x56029a5a3240 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.404+0000 7f6dab211740 1 -- 172.21.15.47:0/881801871 >> 172.21.15.47:0/881801871 conn(0x56029a5928d0 msgr2=0x56029a598470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:45.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.405+0000 7f6dab211740 1 -- 172.21.15.47:0/881801871 shutdown_connections 2024-07-24T22:11:45.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.405+0000 7f6dab211740 1 -- 172.21.15.47:0/881801871 wait complete. 2024-07-24T22:11:45.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.405+0000 7f6dab211740 20 client.25811 trim_cache size 0 max 16384 2024-07-24T22:11:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.423+0000 7f6dab211740 1 Processor -- start 2024-07-24T22:11:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.423+0000 7f6dab211740 1 -- start start 2024-07-24T22:11:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.423+0000 7f6dab211740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a594aa0 0x56029a5a2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.423+0000 7f6dab211740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5953c0 0x56029a5a3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.423+0000 7f6dab211740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a5a0bc0 0x56029a59a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.424+0000 7f6dab211740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01c3680 con 0x56029a5a0bc0 2024-07-24T22:11:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.424+0000 7f6dab211740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01c5f00 con 0x56029a5953c0 2024-07-24T22:11:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.424+0000 7f6dab211740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01c3cf0 con 0x56029a594aa0 2024-07-24T22:11:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.424+0000 7f6da6985640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a5a0bc0 0x56029a59a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.424+0000 7f6da6985640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a5a0bc0 0x56029a59a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35440/0 (socket says 172.21.15.47:35440) 2024-07-24T22:11:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.424+0000 7f6da6985640 1 -- 172.21.15.47:0/200860181 learned_addr learned my addr 172.21.15.47:0/200860181 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.424+0000 7f6da5983640 1 --2- 172.21.15.47:0/200860181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5953c0 0x56029a5a3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.424+0000 7f6da6985640 1 -- 172.21.15.47:0/200860181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a594aa0 msgr2=0x56029a5a2cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-24T22:11:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.424+0000 7f6da6985640 1 --2- 172.21.15.47:0/200860181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a594aa0 0x56029a5a2cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.424+0000 7f6da6985640 1 -- 172.21.15.47:0/200860181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5953c0 msgr2=0x56029a5a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.424+0000 7f6da6985640 1 --2- 172.21.15.47:0/200860181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5953c0 0x56029a5a3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.424+0000 7f6da6985640 1 -- 172.21.15.47:0/200860181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56029a59b6c0 con 0x56029a5a0bc0 2024-07-24T22:11:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.425+0000 7f6da6985640 1 --2- 172.21.15.47:0/200860181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a5a0bc0 0x56029a59a300 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009b90 tx=0x7f6d90009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23670bd7f70e6fb server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.425+0000 7f6d8bfff640 1 -- 172.21.15.47:0/200860181 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d90005020 con 0x56029a5a0bc0 2024-07-24T22:11:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.425+0000 7f6d8bfff640 1 -- 172.21.15.47:0/200860181 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d90019030 con 0x56029a5a0bc0 2024-07-24T22:11:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.425+0000 7f6d8bfff640 1 -- 172.21.15.47:0/200860181 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d900206a0 con 0x56029a5a0bc0 2024-07-24T22:11:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.426+0000 7f6dab211740 1 -- 172.21.15.47:0/200860181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a5a0bc0 msgr2=0x56029a59a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.426+0000 7f6dab211740 1 --2- 172.21.15.47:0/200860181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a5a0bc0 0x56029a59a300 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009b90 tx=0x7f6d90009440 comp rx=0 tx=0).stop 2024-07-24T22:11:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.426+0000 7f6dab211740 1 -- 172.21.15.47:0/200860181 shutdown_connections 2024-07-24T22:11:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.426+0000 7f6dab211740 1 --2- 172.21.15.47:0/200860181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a5a0bc0 0x56029a59a300 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.426+0000 7f6dab211740 1 --2- 172.21.15.47:0/200860181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5953c0 0x56029a5a3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.426+0000 7f6dab211740 1 --2- 172.21.15.47:0/200860181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a594aa0 0x56029a5a2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.426+0000 7f6dab211740 1 -- 172.21.15.47:0/200860181 >> 172.21.15.47:0/200860181 conn(0x56029a5928d0 msgr2=0x56029a599bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.426+0000 7f6dab211740 1 -- 172.21.15.47:0/200860181 shutdown_connections 2024-07-24T22:11:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.426+0000 7f6dab211740 1 -- 172.21.15.47:0/200860181 wait complete. 2024-07-24T22:11:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.427+0000 7f6dab211740 1 -- start start 2024-07-24T22:11:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.427+0000 7f6dab211740 1 Processor -- start 2024-07-24T22:11:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.427+0000 7f6dab211740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a594aa0 0x56029a5a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.427+0000 7f6dab211740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 0x56029a5a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.427+0000 7f6dab211740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5a0bc0 0x56029a5a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.427+0000 7f6dab211740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01c43c0 con 0x56029a594aa0 2024-07-24T22:11:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.427+0000 7f6dab211740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01c5830 con 0x56029a5a0bc0 2024-07-24T22:11:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.427+0000 7f6dab211740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01c4a90 con 0x56029a5953c0 2024-07-24T22:11:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.427+0000 7f6dab211740 10 client.0 _ll_register_callbacks cb 0x7f6d9c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.428+0000 7f6da6985640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5a0bc0 0x56029a5a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.428+0000 7f6da6985640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5a0bc0 0x56029a5a4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:39062/0 (socket says 172.21.15.47:39062) 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.428+0000 7f6da6985640 1 -- 172.21.15.47:0/4204318802 learned_addr learned my addr 172.21.15.47:0/4204318802 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.428+0000 7f6da6184640 1 --2- 172.21.15.47:0/4204318802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a594aa0 0x56029a5a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.428+0000 7f6da6985640 1 -- 172.21.15.47:0/4204318802 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 msgr2=0x56029a5a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.428+0000 7f6da6985640 1 --2- 172.21.15.47:0/4204318802 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 0x56029a5a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.428+0000 7f6da6985640 1 -- 172.21.15.47:0/4204318802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a594aa0 msgr2=0x56029a5a9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.428+0000 7f6da6985640 1 --2- 172.21.15.47:0/4204318802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a594aa0 0x56029a5a9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.428+0000 7f6da6985640 1 -- 172.21.15.47:0/4204318802 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56029a5951f0 con 0x56029a5a0bc0 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.428+0000 7f6da6985640 1 --2- 172.21.15.47:0/4204318802 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5a0bc0 0x56029a5a4a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d900099d0 tx=0x7f6d900058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eba308190a48e611 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.428+0000 7f6d89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.428+0000 7f6d89ffb640 1 -- 172.21.15.47:0/4204318802 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d90004f60 con 0x56029a5a0bc0 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.429+0000 7f6d89ffb640 1 -- 172.21.15.47:0/4204318802 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f6d90005100 con 0x56029a5a0bc0 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.429+0000 7f6dab211740 1 -- 172.21.15.47:0/4204318802 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d90019030 con 0x56029a5a0bc0 2024-07-24T22:11:45.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.429+0000 7f6d89ffb640 1 -- 172.21.15.47:0/4204318802 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6d90005320 con 0x56029a5a0bc0 2024-07-24T22:11:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.429+0000 7f6dab211740 10 client.25817 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.429+0000 7f6dab211740 1 -- 172.21.15.47:0/4204318802 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56029a61ab30 con 0x56029a5a0bc0 2024-07-24T22:11:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.429+0000 7f6d89ffb640 1 -- 172.21.15.47:0/4204318802 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d90019030 con 0x56029a5a0bc0 2024-07-24T22:11:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.430+0000 7f6d89ffb640 1 -- 172.21.15.47:0/4204318802 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6d90020c60 con 0x56029a5a0bc0 2024-07-24T22:11:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.430+0000 7f6dab211740 10 client.25817 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.430+0000 7f6dab211740 10 client.25817 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.430+0000 7f6dab211740 20 client.25817 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.430+0000 7f6dab211740 1 --2- 172.21.15.47:0/4204318802 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56029a61b250 0x56029a61d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.430+0000 7f6dab211740 4 client.25817 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:11:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.430+0000 7f6dab211740 1 -- 172.21.15.47:0/4204318802 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56029a50c1d0 con 0x56029a61b250 2024-07-24T22:11:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.430+0000 7f6da6184640 1 --2- 172.21.15.47:0/4204318802 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56029a61b250 0x56029a61d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.431+0000 7f6da6184640 1 --2- 172.21.15.47:0/4204318802 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56029a61b250 0x56029a61d670 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f24cb77f4c5c52 server_cookie=636b0f7805de8ee9 in_seq=0 out_seq=0 2024-07-24T22:11:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:45.431+0000 7f6d89ffb640 10 client.25817 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:45.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:45 smithi183 ceph-mon[37007]: pgmap v502: 97 pgs: 97 active+clean; 36 GiB data, 112 GiB used, 960 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 635 MiB/s wr, 2.72k op/s 2024-07-24T22:11:45.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:45 smithi047 ceph-mon[32551]: pgmap v502: 97 pgs: 97 active+clean; 36 GiB data, 112 GiB used, 960 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 635 MiB/s wr, 2.72k op/s 2024-07-24T22:11:45.725 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:11:45.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:45 smithi188 ceph-mon[37380]: pgmap v502: 97 pgs: 97 active+clean; 36 GiB data, 112 GiB used, 960 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 635 MiB/s wr, 2.72k op/s 2024-07-24T22:11:46.298 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:11:47.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:47 smithi183 ceph-mon[37007]: pgmap v503: 97 pgs: 97 active+clean; 37 GiB data, 113 GiB used, 959 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 593 MiB/s wr, 2.23k op/s 2024-07-24T22:11:47.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:47 smithi047 ceph-mon[32551]: pgmap v503: 97 pgs: 97 active+clean; 37 GiB data, 113 GiB used, 959 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 593 MiB/s wr, 2.23k op/s 2024-07-24T22:11:47.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:47 smithi188 ceph-mon[37380]: pgmap v503: 97 pgs: 97 active+clean; 37 GiB data, 113 GiB used, 959 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 593 MiB/s wr, 2.23k op/s 2024-07-24T22:11:48.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:48 smithi188 ceph-mon[37380]: Health check failed: 2 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-07-24T22:11:48.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:48 smithi047 ceph-mon[32551]: Health check failed: 2 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-07-24T22:11:48.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:48 smithi183 ceph-mon[37007]: Health check failed: 2 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-07-24T22:11:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.628+0000 7f6d89ffb640 1 -- 172.21.15.47:0/4204318802 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56029a50c1d0 con 0x56029a61b250 2024-07-24T22:11:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.628+0000 7f6d89ffb640 10 client.25817 handle_command_reply: tid=0 2024-07-24T22:11:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.628+0000 7f6dab211740 1 client.25817 shutdown 2024-07-24T22:11:49.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.558+0000 7fa8c0736640 1 -- 172.21.15.47:0/3508800361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8b8101670 msgr2=0x7fa8b8101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:49.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.558+0000 7fa8c0736640 1 --2- 172.21.15.47:0/3508800361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8b8101670 0x7fa8b8101a50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009900 tx=0x7fa8b402a410 comp rx=0 tx=0).stop 2024-07-24T22:11:49.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.558+0000 7fa8c0736640 1 -- 172.21.15.47:0/3508800361 shutdown_connections 2024-07-24T22:11:49.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.558+0000 7fa8c0736640 1 --2- 172.21.15.47:0/3508800361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b8107a00 0x7fa8b810e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.558+0000 7fa8c0736640 1 --2- 172.21.15.47:0/3508800361 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8b8107080 0x7fa8b81074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.558+0000 7fa8c0736640 1 --2- 172.21.15.47:0/3508800361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8b8101670 0x7fa8b8101a50 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.558+0000 7fa8c0736640 1 -- 172.21.15.47:0/3508800361 >> 172.21.15.47:0/3508800361 conn(0x7fa8b80fd0e0 msgr2=0x7fa8b80ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.559+0000 7fa8c0736640 1 -- 172.21.15.47:0/3508800361 shutdown_connections 2024-07-24T22:11:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.559+0000 7fa8c0736640 1 -- 172.21.15.47:0/3508800361 wait complete. 2024-07-24T22:11:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.559+0000 7fa8c0736640 1 Processor -- start 2024-07-24T22:11:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.559+0000 7fa8c0736640 1 -- start start 2024-07-24T22:11:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8c0736640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8b8101670 0x7fa8b80fd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8c0736640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b8107080 0x7fa8b80fdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8c0736640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8b8107a00 0x7fa8b80fe060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8c0736640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b8111770 con 0x7fa8b8101670 2024-07-24T22:11:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8c0736640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b81115f0 con 0x7fa8b8107a00 2024-07-24T22:11:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8c0736640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b81118f0 con 0x7fa8b8107080 2024-07-24T22:11:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8be4d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8b8101670 0x7fa8b80fd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8be4d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8b8101670 0x7fa8b80fd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35468/0 (socket says 172.21.15.47:35468) 2024-07-24T22:11:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8be4d2640 1 -- 172.21.15.47:0/215505271 learned_addr learned my addr 172.21.15.47:0/215505271 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8be4d2640 1 -- 172.21.15.47:0/215505271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b8107080 msgr2=0x7fa8b80fdb20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:11:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8be4d2640 1 --2- 172.21.15.47:0/215505271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b8107080 0x7fa8b80fdb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8be4d2640 1 -- 172.21.15.47:0/215505271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8b8107a00 msgr2=0x7fa8b80fe060 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:11:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8be4d2640 1 --2- 172.21.15.47:0/215505271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8b8107a00 0x7fa8b80fe060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.560+0000 7fa8be4d2640 1 -- 172.21.15.47:0/215505271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b81a7260 con 0x7fa8b8101670 2024-07-24T22:11:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.561+0000 7fa8be4d2640 1 --2- 172.21.15.47:0/215505271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8b8101670 0x7fa8b80fd5e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa8b402aa00 tx=0x7fa8b4003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.561+0000 7fa8af7fe640 1 -- 172.21.15.47:0/215505271 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b403f070 con 0x7fa8b8101670 2024-07-24T22:11:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.561+0000 7fa8af7fe640 1 -- 172.21.15.47:0/215505271 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8b4031d60 con 0x7fa8b8101670 2024-07-24T22:11:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.561+0000 7fa8c0736640 1 -- 172.21.15.47:0/215505271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b81a74f0 con 0x7fa8b8101670 2024-07-24T22:11:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.561+0000 7fa8af7fe640 1 -- 172.21.15.47:0/215505271 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b403f070 con 0x7fa8b8101670 2024-07-24T22:11:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.561+0000 7fa8c0736640 1 -- 172.21.15.47:0/215505271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b81a79d0 con 0x7fa8b8101670 2024-07-24T22:11:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.566+0000 7fa8c2ae7740 1 Processor -- start 2024-07-24T22:11:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.566+0000 7fa8c2ae7740 1 -- start start 2024-07-24T22:11:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.566+0000 7fa8c2ae7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc7586b0 0x55fecc758a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.566+0000 7fa8c2ae7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc758fd0 0x55fecc764a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.566+0000 7fa8c2ae7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc764f60 0x55fecc767350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.566+0000 7fa8c2ae7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fecc6cf990 con 0x55fecc758fd0 2024-07-24T22:11:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.566+0000 7fa8c2ae7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fecc6bee90 con 0x55fecc764f60 2024-07-24T22:11:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.566+0000 7fa8c2ae7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55fecc6c2ed0 con 0x55fecc7586b0 2024-07-24T22:11:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.567+0000 7fa8becd3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc7586b0 0x55fecc758a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.567+0000 7fa8becd3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc7586b0 0x55fecc758a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:39460/0 (socket says 172.21.15.47:39460) 2024-07-24T22:11:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.567+0000 7fa8becd3640 1 -- 172.21.15.47:0/3133367673 learned_addr learned my addr 172.21.15.47:0/3133367673 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.567+0000 7fa8bdcd1640 1 --2- 172.21.15.47:0/3133367673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc764f60 0x55fecc767350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.567+0000 7fa8becd3640 1 -- 172.21.15.47:0/3133367673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc764f60 msgr2=0x55fecc767350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.567+0000 7fa8becd3640 1 --2- 172.21.15.47:0/3133367673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc764f60 0x55fecc767350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.567+0000 7fa8becd3640 1 -- 172.21.15.47:0/3133367673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc758fd0 msgr2=0x55fecc764a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-24T22:11:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.567+0000 7fa8becd3640 1 --2- 172.21.15.47:0/3133367673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc758fd0 0x55fecc764a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.567+0000 7fa8becd3640 1 -- 172.21.15.47:0/3133367673 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fecc648300 con 0x55fecc7586b0 2024-07-24T22:11:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.567+0000 7fa8af7fe640 1 -- 172.21.15.47:0/215505271 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fa8b4042070 con 0x7fa8b8101670 2024-07-24T22:11:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.567+0000 7fa8bdcd1640 1 --2- 172.21.15.47:0/3133367673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc764f60 0x55fecc767350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:11:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.567+0000 7fa8becd3640 1 --2- 172.21.15.47:0/3133367673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc7586b0 0x55fecc758a90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009cf0 tx=0x7fa8b000b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19bc26a6b82afd53 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.568+0000 7fa8acff9640 1 -- 172.21.15.47:0/3133367673 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000bd40 con 0x55fecc7586b0 2024-07-24T22:11:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.568+0000 7fa8acff9640 1 -- 172.21.15.47:0/3133367673 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8b0017070 con 0x55fecc7586b0 2024-07-24T22:11:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.568+0000 7fa8acff9640 1 -- 172.21.15.47:0/3133367673 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00115d0 con 0x55fecc7586b0 2024-07-24T22:11:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.569+0000 7fa8af7fe640 1 --2- 172.21.15.47:0/215505271 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa8a40b4140 0x7fa8a40b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.569+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/3133367673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc7586b0 msgr2=0x55fecc758a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.569+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/3133367673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc7586b0 0x55fecc758a90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009cf0 tx=0x7fa8b000b420 comp rx=0 tx=0).stop 2024-07-24T22:11:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.569+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/3133367673 shutdown_connections 2024-07-24T22:11:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.569+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/3133367673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc764f60 0x55fecc767350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.569+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/3133367673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc758fd0 0x55fecc764a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.569+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/3133367673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc7586b0 0x55fecc758a90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.569+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/3133367673 >> 172.21.15.47:0/3133367673 conn(0x55fecc7564e0 msgr2=0x55fecc757680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.569+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/3133367673 shutdown_connections 2024-07-24T22:11:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.569+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/3133367673 wait complete. 2024-07-24T22:11:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.570+0000 7fa8be4d2640 1 --2- 172.21.15.47:0/215505271 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa8a40b4140 0x7fa8a40b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.570+0000 7fa8c2ae7740 1 -- start start 2024-07-24T22:11:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.570+0000 7fa8c2ae7740 1 Processor -- start 2024-07-24T22:11:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.570+0000 7fa8af7fe640 1 -- 172.21.15.47:0/215505271 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa8b40316b0 con 0x7fa8b8101670 2024-07-24T22:11:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.570+0000 7fa8be4d2640 1 --2- 172.21.15.47:0/215505271 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa8a40b4140 0x7fa8a40b6600 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55fecc7573c0 tx=0x7fa8b408ff00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.570+0000 7fa8c2ae7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc761f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.570+0000 7fa8c2ae7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 0x55fecc762460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8c2ae7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc7629a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8c2ae7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fecc522700 con 0x55fecc7586b0 2024-07-24T22:11:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8c2ae7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fecc6615d0 con 0x55fecc758fd0 2024-07-24T22:11:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8c2ae7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55fecc767be0 con 0x55fecc764f60 2024-07-24T22:11:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8c2ae7740 10 client.0 _ll_register_callbacks cb 0x55fecc681940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8becd3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc7629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8becd3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc7629a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:39476/0 (socket says 172.21.15.47:39476) 2024-07-24T22:11:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8becd3640 1 -- 172.21.15.47:0/3915784528 learned_addr learned my addr 172.21.15.47:0/3915784528 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8becd3640 1 --2- 172.21.15.47:0/3915784528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc761f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8bdcd1640 1 --2- 172.21.15.47:0/3915784528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 0x55fecc762460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8becd3640 1 -- 172.21.15.47:0/3915784528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 msgr2=0x55fecc762460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8becd3640 1 --2- 172.21.15.47:0/3915784528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 0x55fecc762460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8becd3640 1 -- 172.21.15.47:0/3915784528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 msgr2=0x55fecc761f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8becd3640 1 --2- 172.21.15.47:0/3915784528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc761f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.571+0000 7fa8becd3640 1 -- 172.21.15.47:0/3915784528 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fecc654660 con 0x55fecc764f60 2024-07-24T22:11:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.572+0000 7fa8becd3640 1 --2- 172.21.15.47:0/3915784528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc7629a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0003f00 tx=0x7fa8b0013ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ed0acfe90d99482 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.572+0000 7fa8a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:11:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.572+0000 7fa8a1ffb640 1 -- 172.21.15.47:0/3915784528 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0004450 con 0x55fecc764f60 2024-07-24T22:11:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.572+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/3915784528 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8b0017070 con 0x55fecc764f60 2024-07-24T22:11:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.572+0000 7fa8a1ffb640 1 -- 172.21.15.47:0/3915784528 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa8b00045f0 con 0x55fecc764f60 2024-07-24T22:11:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.572+0000 7fa8a1ffb640 1 -- 172.21.15.47:0/3915784528 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa8b00129d0 con 0x55fecc764f60 2024-07-24T22:11:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.572+0000 7fa8c2ae7740 10 client.25864 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.572+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/3915784528 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fecc41f650 con 0x55fecc764f60 2024-07-24T22:11:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.572+0000 7fa8a1ffb640 1 -- 172.21.15.47:0/3915784528 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8b00047f0 con 0x55fecc764f60 2024-07-24T22:11:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.573+0000 7fa8a1ffb640 1 -- 172.21.15.47:0/3915784528 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa8b0027070 con 0x55fecc764f60 2024-07-24T22:11:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.573+0000 7fa8c2ae7740 10 client.25864 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.573+0000 7fa8c2ae7740 10 client.25864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.573+0000 7fa8c2ae7740 20 client.25864 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.573+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/3915784528 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fecc77d160 0x55fecc77f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.573+0000 7fa8c2ae7740 4 client.25864 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:11:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.573+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/3915784528 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa8b0017070 con 0x55fecc77d160 2024-07-24T22:11:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.574+0000 7fa8bdcd1640 1 --2- 172.21.15.47:0/3915784528 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fecc77d160 0x55fecc77f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.574+0000 7fa8a1ffb640 10 client.25864 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.574+0000 7fa8bdcd1640 1 --2- 172.21.15.47:0/3915784528 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fecc77d160 0x55fecc77f550 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a15a662de688717 server_cookie=7600eaae945ce33a in_seq=0 out_seq=0 2024-07-24T22:11:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.575+0000 7fa8a1ffb640 1 -- 172.21.15.47:0/3915784528 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa8b0017070 con 0x55fecc77d160 2024-07-24T22:11:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.575+0000 7fa8a1ffb640 10 client.25864 handle_command_reply: tid=0 2024-07-24T22:11:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.576+0000 7fa8c2ae7740 1 client.25864 shutdown 2024-07-24T22:11:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.576+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/3915784528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 msgr2=0x55fecc7629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.576+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/3915784528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc7629a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0003f00 tx=0x7fa8b0013ea0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.576+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/3915784528 shutdown_connections 2024-07-24T22:11:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.576+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/3915784528 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fecc77d160 0x55fecc77f550 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.576+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/3915784528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc7629a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.576+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/3915784528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 0x55fecc762460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.576+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/3915784528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc761f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.576+0000 7fa8a1ffb640 0 client.25864 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.576+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/3915784528 >> 172.21.15.47:0/3915784528 conn(0x55fecc7564e0 msgr2=0x55fecc75c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.576+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/3915784528 shutdown_connections 2024-07-24T22:11:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.576+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/3915784528 wait complete. 2024-07-24T22:11:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.576+0000 7fa8c2ae7740 20 client.25864 trim_cache size 0 max 16384 2024-07-24T22:11:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8c2ae7740 1 Processor -- start 2024-07-24T22:11:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8c2ae7740 1 -- start start 2024-07-24T22:11:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8c2ae7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc75c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8c2ae7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 0x55fecc784cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8c2ae7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc785200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8c2ae7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b81a9fd0 con 0x55fecc7586b0 2024-07-24T22:11:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8c2ae7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b81ac850 con 0x55fecc758fd0 2024-07-24T22:11:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8c2ae7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b81aa640 con 0x55fecc764f60 2024-07-24T22:11:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8becd3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc75c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8becd3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc75c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35488/0 (socket says 172.21.15.47:35488) 2024-07-24T22:11:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8becd3640 1 -- 172.21.15.47:0/1318785964 learned_addr learned my addr 172.21.15.47:0/1318785964 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8bdcd1640 1 --2- 172.21.15.47:0/1318785964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 0x55fecc784cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8becd3640 1 --2- 172.21.15.47:0/1318785964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc785200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8becd3640 1 -- 172.21.15.47:0/1318785964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 msgr2=0x55fecc785200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8becd3640 1 --2- 172.21.15.47:0/1318785964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc785200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8becd3640 1 -- 172.21.15.47:0/1318785964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 msgr2=0x55fecc784cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8becd3640 1 --2- 172.21.15.47:0/1318785964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 0x55fecc784cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.598+0000 7fa8becd3640 1 -- 172.21.15.47:0/1318785964 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fecc75cd40 con 0x55fecc7586b0 2024-07-24T22:11:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.599+0000 7fa8becd3640 1 --2- 172.21.15.47:0/1318785964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc75c800 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009cf0 tx=0x7fa8b000b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39e73b581061866 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.629+0000 7f6dab211740 1 -- 172.21.15.47:0/4204318802 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5a0bc0 msgr2=0x56029a5a4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.629+0000 7f6dab211740 1 --2- 172.21.15.47:0/4204318802 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5a0bc0 0x56029a5a4a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d900099d0 tx=0x7f6d900058d0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.643 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:11:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:11:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:11:49.643 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:11:49.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.599+0000 7fa8a3fff640 1 -- 172.21.15.47:0/1318785964 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00129b0 con 0x55fecc7586b0 2024-07-24T22:11:49.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.599+0000 7fa8a3fff640 1 -- 172.21.15.47:0/1318785964 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8b0017070 con 0x55fecc7586b0 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.599+0000 7fa8a3fff640 1 -- 172.21.15.47:0/1318785964 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b001ccb0 con 0x55fecc7586b0 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.599+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/1318785964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 msgr2=0x55fecc75c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.599+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/1318785964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc75c800 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009cf0 tx=0x7fa8b000b920 comp rx=0 tx=0).stop 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/1318785964 shutdown_connections 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/1318785964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc785200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/1318785964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 0x55fecc784cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/1318785964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc75c800 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/1318785964 >> 172.21.15.47:0/1318785964 conn(0x55fecc7564e0 msgr2=0x55fecc762710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/1318785964 shutdown_connections 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/1318785964 wait complete. 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 -- start start 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 Processor -- start 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc775a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 0x55fecc776000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc7711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b81aad10 con 0x55fecc7586b0 2024-07-24T22:11:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b81ac180 con 0x55fecc758fd0 2024-07-24T22:11:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b81ab3e0 con 0x55fecc764f60 2024-07-24T22:11:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.600+0000 7fa8c2ae7740 10 client.0 _ll_register_callbacks cb 0x7fa8b0009bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:11:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8becd3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc775a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8becd3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc775a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35494/0 (socket says 172.21.15.47:35494) 2024-07-24T22:11:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8becd3640 1 -- 172.21.15.47:0/161028976 learned_addr learned my addr 172.21.15.47:0/161028976 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8becd3640 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc7711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8bdcd1640 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 0x55fecc776000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8becd3640 1 -- 172.21.15.47:0/161028976 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 msgr2=0x55fecc7711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8becd3640 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc7711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8becd3640 1 -- 172.21.15.47:0/161028976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 msgr2=0x55fecc776000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:11:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8becd3640 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 0x55fecc776000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8becd3640 1 -- 172.21.15.47:0/161028976 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fecc771a20 con 0x55fecc7586b0 2024-07-24T22:11:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8bdcd1640 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 0x55fecc776000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:11:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8becd3640 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc775a80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0014040 tx=0x7fa8b0009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcf8eec14241f29 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:11:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8a1ffb640 1 -- 172.21.15.47:0/161028976 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0030610 con 0x55fecc7586b0 2024-07-24T22:11:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/161028976 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8b0017070 con 0x55fecc7586b0 2024-07-24T22:11:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8a1ffb640 1 -- 172.21.15.47:0/161028976 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa8b00307b0 con 0x55fecc7586b0 2024-07-24T22:11:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8a1ffb640 1 -- 172.21.15.47:0/161028976 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa8b00309b0 con 0x55fecc7586b0 2024-07-24T22:11:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8c2ae7740 10 client.16470 fetch_fsmap learned FSMap version 20 2024-07-24T22:11:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.601+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/161028976 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fecc7e7980 con 0x55fecc7586b0 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.602+0000 7fa8a1ffb640 1 -- 172.21.15.47:0/161028976 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8b0017070 con 0x55fecc7586b0 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.602+0000 7fa8a1ffb640 1 -- 172.21.15.47:0/161028976 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa8b0027040 con 0x55fecc7586b0 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.602+0000 7fa8c2ae7740 10 client.16470 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.602+0000 7fa8c2ae7740 10 client.16470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.602+0000 7fa8c2ae7740 20 client.16470 populate_metadata read hostname 'smithi047' 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.602+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fecc7e7fd0 0x55fecc7ea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.602+0000 7fa8c2ae7740 4 client.16470 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.602+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/161028976 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fecc6d18e0 con 0x55fecc7e7fd0 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.603+0000 7fa8bdcd1640 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fecc7e7fd0 0x55fecc7ea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.603+0000 7fa8a1ffb640 10 client.16470 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.603+0000 7fa8bdcd1640 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fecc7e7fd0 0x55fecc7ea3f0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb7e2d046385b206 server_cookie=a226e0b2443abcf8 in_seq=0 out_seq=0 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.603+0000 7fa8a1ffb640 1 -- 172.21.15.47:0/161028976 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fecc6d18e0 con 0x55fecc7e7fd0 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.603+0000 7fa8a1ffb640 10 client.16470 handle_command_reply: tid=0 2024-07-24T22:11:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.603+0000 7fa8c2ae7740 1 client.16470 shutdown 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.604+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/161028976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 msgr2=0x55fecc775a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.604+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc775a80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0014040 tx=0x7fa8b0009500 comp rx=0 tx=0).stop 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.604+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/161028976 shutdown_connections 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.604+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fecc7e7fd0 0x55fecc7ea3f0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.604+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fecc764f60 0x55fecc7711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.604+0000 7fa8a1ffb640 0 client.16470 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.604+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fecc758fd0 0x55fecc776000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.604+0000 7fa8c2ae7740 1 --2- 172.21.15.47:0/161028976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fecc7586b0 0x55fecc775a80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.604+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/161028976 >> 172.21.15.47:0/161028976 conn(0x55fecc7564e0 msgr2=0x55fecc7607a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.604+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/161028976 shutdown_connections 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.604+0000 7fa8c2ae7740 1 -- 172.21.15.47:0/161028976 wait complete. 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.604+0000 7fa8c2ae7740 20 client.16470 trim_cache size 0 max 16384 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.605+0000 7fa8c0736640 1 -- 172.21.15.47:0/215505271 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa8a40b4140 msgr2=0x7fa8a40b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.605+0000 7fa8c0736640 1 --2- 172.21.15.47:0/215505271 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa8a40b4140 0x7fa8a40b6600 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55fecc7573c0 tx=0x7fa8b408ff00 comp rx=0 tx=0).stop 2024-07-24T22:11:49.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.605+0000 7fa8c0736640 1 -- 172.21.15.47:0/215505271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8b8101670 msgr2=0x7fa8b80fd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.605+0000 7fa8c0736640 1 --2- 172.21.15.47:0/215505271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8b8101670 0x7fa8b80fd5e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa8b402aa00 tx=0x7fa8b4003de0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.605+0000 7fa8c0736640 1 -- 172.21.15.47:0/215505271 shutdown_connections 2024-07-24T22:11:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.605+0000 7fa8c0736640 1 --2- 172.21.15.47:0/215505271 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa8a40b4140 0x7fa8a40b6600 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.605+0000 7fa8c0736640 1 --2- 172.21.15.47:0/215505271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8b8107a00 0x7fa8b80fe060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.605+0000 7fa8c0736640 1 --2- 172.21.15.47:0/215505271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b8107080 0x7fa8b80fdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.605+0000 7fa8c0736640 1 --2- 172.21.15.47:0/215505271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8b8101670 0x7fa8b80fd5e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.605+0000 7fa8c0736640 1 -- 172.21.15.47:0/215505271 >> 172.21.15.47:0/215505271 conn(0x7fa8b80fd0e0 msgr2=0x7fa8b806af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.605+0000 7fa8c0736640 1 -- 172.21.15.47:0/215505271 shutdown_connections 2024-07-24T22:11:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:49.605+0000 7fa8c0736640 1 -- 172.21.15.47:0/215505271 wait complete. 2024-07-24T22:11:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.630+0000 7f6dab211740 1 -- 172.21.15.47:0/4204318802 shutdown_connections 2024-07-24T22:11:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.630+0000 7f6dab211740 1 --2- 172.21.15.47:0/4204318802 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56029a61b250 0x56029a61d670 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.630+0000 7f6dab211740 1 --2- 172.21.15.47:0/4204318802 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56029a5a0bc0 0x56029a5a4a00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.630+0000 7f6dab211740 1 --2- 172.21.15.47:0/4204318802 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56029a5953c0 0x56029a5a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.630+0000 7f6dab211740 1 --2- 172.21.15.47:0/4204318802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56029a594aa0 0x56029a5a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.630+0000 7f6dab211740 1 -- 172.21.15.47:0/4204318802 >> 172.21.15.47:0/4204318802 conn(0x56029a5928d0 msgr2=0x56029a591a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.630+0000 7f6d89ffb640 0 client.25817 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:11:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.631+0000 7f6dab211740 1 -- 172.21.15.47:0/4204318802 shutdown_connections 2024-07-24T22:11:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.631+0000 7f6dab211740 1 -- 172.21.15.47:0/4204318802 wait complete. 2024-07-24T22:11:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.631+0000 7f6dab211740 20 client.25817 trim_cache size 0 max 16384 2024-07-24T22:11:49.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:11:49.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:11:49.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:11:49.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:11:49.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.633+0000 7f6da83e8640 1 -- 172.21.15.47:0/2524455485 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6d8c0b3ef0 msgr2=0x7f6d8c0b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.633+0000 7f6da83e8640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6d8c0b3ef0 0x7f6d8c0b63b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6da010ab20 tx=0x7f6d90004730 comp rx=0 tx=0).stop 2024-07-24T22:11:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.633+0000 7f6da83e8640 1 -- 172.21.15.47:0/2524455485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0109f20 msgr2=0x7f6da0115280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.633+0000 7f6da83e8640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0109f20 0x7f6da0115280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800b9e0 tx=0x7f6d9800bea0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.633+0000 7f6da83e8640 1 -- 172.21.15.47:0/2524455485 shutdown_connections 2024-07-24T22:11:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.633+0000 7f6da83e8640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6d8c0b3ef0 0x7f6d8c0b63b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.633+0000 7f6da83e8640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da011ba90 0x7f6da01157c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.633+0000 7f6da83e8640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0109f20 0x7f6da0115280 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.633+0000 7f6da83e8640 1 --2- 172.21.15.47:0/2524455485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6da0109b40 0x7f6da011b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.633+0000 7f6da83e8640 1 -- 172.21.15.47:0/2524455485 >> 172.21.15.47:0/2524455485 conn(0x7f6da006d5a0 msgr2=0x7f6da0071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.633+0000 7f6da83e8640 1 -- 172.21.15.47:0/2524455485 shutdown_connections 2024-07-24T22:11:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:11:49.633+0000 7f6da83e8640 1 -- 172.21.15.47:0/2524455485 wait complete. 2024-07-24T22:11:49.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:49 smithi188 ceph-mon[37380]: pgmap v504: 97 pgs: 97 active+clean; 38 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 658 MiB/s wr, 2.56k op/s 2024-07-24T22:11:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:49 smithi183 ceph-mon[37007]: pgmap v504: 97 pgs: 97 active+clean; 38 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 658 MiB/s wr, 2.56k op/s 2024-07-24T22:11:49.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:49 smithi047 ceph-mon[32551]: pgmap v504: 97 pgs: 97 active+clean; 38 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 658 MiB/s wr, 2.56k op/s 2024-07-24T22:11:51.016 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:11:51.016 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:11:51.687 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:11:51.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:51 smithi183 ceph-mon[37007]: pgmap v505: 97 pgs: 97 active+clean; 38 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 567 MiB/s wr, 2.46k op/s 2024-07-24T22:11:51.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:51 smithi047 ceph-mon[32551]: pgmap v505: 97 pgs: 97 active+clean; 38 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 567 MiB/s wr, 2.46k op/s 2024-07-24T22:11:52.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:51 smithi188 ceph-mon[37380]: pgmap v505: 97 pgs: 97 active+clean; 38 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 567 MiB/s wr, 2.46k op/s 2024-07-24T22:11:53.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:53 smithi183 ceph-mon[37007]: pgmap v506: 97 pgs: 97 active+clean; 38 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 494 MiB/s wr, 2.32k op/s 2024-07-24T22:11:53.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:53 smithi047 ceph-mon[32551]: pgmap v506: 97 pgs: 97 active+clean; 38 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 494 MiB/s wr, 2.32k op/s 2024-07-24T22:11:54.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:53 smithi188 ceph-mon[37380]: pgmap v506: 97 pgs: 97 active+clean; 38 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 494 MiB/s wr, 2.32k op/s 2024-07-24T22:11:54.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.794+0000 7fc4d2a60640 1 -- 172.21.15.47:0/1535338663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc1081a0 msgr2=0x7fc4cc1085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:54.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.794+0000 7fc4d2a60640 1 --2- 172.21.15.47:0/1535338663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc1081a0 0x7fc4cc1085e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0009900 tx=0x7fc4c002a410 comp rx=0 tx=0).stop 2024-07-24T22:11:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.794+0000 7fc4d2a60640 1 -- 172.21.15.47:0/1535338663 shutdown_connections 2024-07-24T22:11:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.794+0000 7fc4d2a60640 1 --2- 172.21.15.47:0/1535338663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4cc108b20 0x7fc4cc10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.794+0000 7fc4d2a60640 1 --2- 172.21.15.47:0/1535338663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc1081a0 0x7fc4cc1085e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.794+0000 7fc4d2a60640 1 --2- 172.21.15.47:0/1535338663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4cc102790 0x7fc4cc102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.794+0000 7fc4d2a60640 1 -- 172.21.15.47:0/1535338663 >> 172.21.15.47:0/1535338663 conn(0x7fc4cc0fe200 msgr2=0x7fc4cc100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.794+0000 7fc4d2a60640 1 -- 172.21.15.47:0/1535338663 shutdown_connections 2024-07-24T22:11:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.794+0000 7fc4d2a60640 1 -- 172.21.15.47:0/1535338663 wait complete. 2024-07-24T22:11:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.795+0000 7fc4d2a60640 1 Processor -- start 2024-07-24T22:11:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.795+0000 7fc4d2a60640 1 -- start start 2024-07-24T22:11:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4d2a60640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4cc102790 0x7fc4cc19aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4d2a60640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc1081a0 0x7fc4cc19b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4d2a60640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4cc108b20 0x7fc4cc1a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4d2a60640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc112730 con 0x7fc4cc102790 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4d2a60640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc1125b0 con 0x7fc4cc1081a0 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4d2a60640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc1128b0 con 0x7fc4cc108b20 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4cbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4cc102790 0x7fc4cc19aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4cb7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc1081a0 0x7fc4cc19b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4d0ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4cc108b20 0x7fc4cc1a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4cbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4cc102790 0x7fc4cc19aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41580/0 (socket says 172.21.15.47:41580) 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4cbfff640 1 -- 172.21.15.47:0/3914751022 learned_addr learned my addr 172.21.15.47:0/3914751022 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4d0ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4cc108b20 0x7fc4cc1a07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:59936/0 (socket says 172.21.15.47:59936) 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4cb7fe640 1 -- 172.21.15.47:0/3914751022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4cc108b20 msgr2=0x7fc4cc1a07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4cb7fe640 1 --2- 172.21.15.47:0/3914751022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4cc108b20 0x7fc4cc1a07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4cb7fe640 1 -- 172.21.15.47:0/3914751022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4cc102790 msgr2=0x7fc4cc19aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4cb7fe640 1 --2- 172.21.15.47:0/3914751022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4cc102790 0x7fc4cc19aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4cb7fe640 1 -- 172.21.15.47:0/3914751022 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4cc1a0f70 con 0x7fc4cc1081a0 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.796+0000 7fc4d0ffd640 1 --2- 172.21.15.47:0/3914751022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4cc108b20 0x7fc4cc1a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.797+0000 7fc4cb7fe640 1 --2- 172.21.15.47:0/3914751022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc1081a0 0x7fc4cc19b400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0006010 tx=0x7fc4c0004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.797+0000 7fc4c97fa640 1 -- 172.21.15.47:0/3914751022 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c003f070 con 0x7fc4cc1081a0 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.797+0000 7fc4c97fa640 1 -- 172.21.15.47:0/3914751022 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4c0003ca0 con 0x7fc4cc1081a0 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.797+0000 7fc4c97fa640 1 -- 172.21.15.47:0/3914751022 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0035070 con 0x7fc4cc1081a0 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.797+0000 7fc4d2a60640 1 -- 172.21.15.47:0/3914751022 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4cc1a1200 con 0x7fc4cc1081a0 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.797+0000 7fc4d2a60640 1 -- 172.21.15.47:0/3914751022 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4cc1a7920 con 0x7fc4cc1081a0 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.798+0000 7fc4d2a60640 1 -- 172.21.15.47:0/3914751022 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4cc102b70 con 0x7fc4cc1081a0 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.800+0000 7fc4c97fa640 1 -- 172.21.15.47:0/3914751022 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fc4c003b460 con 0x7fc4cc1081a0 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.801+0000 7fc4c97fa640 1 --2- 172.21.15.47:0/3914751022 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc4b40b3dc0 0x7fc4b40b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.802+0000 7fc4cbfff640 1 --2- 172.21.15.47:0/3914751022 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc4b40b3dc0 0x7fc4b40b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.802+0000 7fc4c97fa640 1 -- 172.21.15.47:0/3914751022 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fc4c0104390 con 0x7fc4cc1081a0 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.802+0000 7fc4cbfff640 1 --2- 172.21.15.47:0/3914751022 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc4b40b3dc0 0x7fc4b40b6280 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0095f0 tx=0x7fc4bc005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:11:54.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:54.806+0000 7fc4c97fa640 1 -- 172.21.15.47:0/3914751022 <== mon.2 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fc4c00cb050 con 0x7fc4cc1081a0 2024-07-24T22:11:55.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.256+0000 7fc4d2a60640 1 -- 172.21.15.47:0/3914751022 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4cc19bff0 con 0x7fc4cc1081a0 2024-07-24T22:11:55.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.257+0000 7fc4c97fa640 1 -- 172.21.15.47:0/3914751022 <== mon.2 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7fc4c00cf5a0 con 0x7fc4cc1081a0 2024-07-24T22:11:55.259 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:11:55.259 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:11:55.259 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:11:55.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.259+0000 7fc4d2a60640 1 -- 172.21.15.47:0/3914751022 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc4b40b3dc0 msgr2=0x7fc4b40b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:55.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.259+0000 7fc4d2a60640 1 --2- 172.21.15.47:0/3914751022 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc4b40b3dc0 0x7fc4b40b6280 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0095f0 tx=0x7fc4bc005f90 comp rx=0 tx=0).stop 2024-07-24T22:11:55.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.259+0000 7fc4d2a60640 1 -- 172.21.15.47:0/3914751022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc1081a0 msgr2=0x7fc4cc19b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:11:55.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.259+0000 7fc4d2a60640 1 --2- 172.21.15.47:0/3914751022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc1081a0 0x7fc4cc19b400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0006010 tx=0x7fc4c0004060 comp rx=0 tx=0).stop 2024-07-24T22:11:55.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.259+0000 7fc4d2a60640 1 -- 172.21.15.47:0/3914751022 shutdown_connections 2024-07-24T22:11:55.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.259+0000 7fc4d2a60640 1 --2- 172.21.15.47:0/3914751022 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc4b40b3dc0 0x7fc4b40b6280 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:55.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.259+0000 7fc4d2a60640 1 --2- 172.21.15.47:0/3914751022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4cc108b20 0x7fc4cc1a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.259+0000 7fc4d2a60640 1 --2- 172.21.15.47:0/3914751022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4cc1081a0 0x7fc4cc19b400 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.259+0000 7fc4d2a60640 1 --2- 172.21.15.47:0/3914751022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4cc102790 0x7fc4cc19aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:11:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.259+0000 7fc4d2a60640 1 -- 172.21.15.47:0/3914751022 >> 172.21.15.47:0/3914751022 conn(0x7fc4cc0fe200 msgr2=0x7fc4cc105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:11:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.259+0000 7fc4d2a60640 1 -- 172.21.15.47:0/3914751022 shutdown_connections 2024-07-24T22:11:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:11:55.259+0000 7fc4d2a60640 1 -- 172.21.15.47:0/3914751022 wait complete. 2024-07-24T22:11:55.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:55 smithi047 ceph-mon[32551]: pgmap v507: 97 pgs: 97 active+clean; 38 GiB data, 116 GiB used, 957 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 543 MiB/s wr, 2.30k op/s 2024-07-24T22:11:55.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:55 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3914751022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:11:56.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:55 smithi188 ceph-mon[37380]: pgmap v507: 97 pgs: 97 active+clean; 38 GiB data, 116 GiB used, 957 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 543 MiB/s wr, 2.30k op/s 2024-07-24T22:11:56.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:55 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3914751022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:11:56.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:55 smithi183 ceph-mon[37007]: pgmap v507: 97 pgs: 97 active+clean; 38 GiB data, 116 GiB used, 957 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 543 MiB/s wr, 2.30k op/s 2024-07-24T22:11:56.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:55 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3914751022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:11:56.596 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:11:57.136 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:11:57.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:57 smithi047 ceph-mon[32551]: pgmap v508: 97 pgs: 97 active+clean; 38 GiB data, 115 GiB used, 957 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 437 MiB/s wr, 1.84k op/s 2024-07-24T22:11:58.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:57 smithi188 ceph-mon[37380]: pgmap v508: 97 pgs: 97 active+clean; 38 GiB data, 115 GiB used, 957 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 437 MiB/s wr, 1.84k op/s 2024-07-24T22:11:58.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:57 smithi183 ceph-mon[37007]: pgmap v508: 97 pgs: 97 active+clean; 38 GiB data, 115 GiB used, 957 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 437 MiB/s wr, 1.84k op/s 2024-07-24T22:11:59.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:11:59 smithi047 ceph-mon[32551]: pgmap v509: 97 pgs: 97 active+clean; 38 GiB data, 116 GiB used, 957 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 492 MiB/s wr, 1.73k op/s 2024-07-24T22:12:00.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:11:59 smithi183 ceph-mon[37007]: pgmap v509: 97 pgs: 97 active+clean; 38 GiB data, 116 GiB used, 957 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 492 MiB/s wr, 1.73k op/s 2024-07-24T22:12:00.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:11:59 smithi188 ceph-mon[37380]: pgmap v509: 97 pgs: 97 active+clean; 38 GiB data, 116 GiB used, 957 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 492 MiB/s wr, 1.73k op/s 2024-07-24T22:12:00.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.439+0000 7f772c746640 1 -- 172.21.15.47:0/2793985220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7724108160 msgr2=0x7f77241085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:00.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.439+0000 7f772c746640 1 --2- 172.21.15.47:0/2793985220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7724108160 0x7f77241085a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7714009900 tx=0x7f771402a410 comp rx=0 tx=0).stop 2024-07-24T22:12:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.439+0000 7f772c746640 1 -- 172.21.15.47:0/2793985220 shutdown_connections 2024-07-24T22:12:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.439+0000 7f772c746640 1 --2- 172.21.15.47:0/2793985220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7724108ae0 0x7f772410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.439+0000 7f772c746640 1 --2- 172.21.15.47:0/2793985220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7724108160 0x7f77241085a0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.439+0000 7f772c746640 1 --2- 172.21.15.47:0/2793985220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7724102750 0x7f7724102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.439+0000 7f772c746640 1 -- 172.21.15.47:0/2793985220 >> 172.21.15.47:0/2793985220 conn(0x7f77240fe200 msgr2=0x7f7724100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.440+0000 7f772c746640 1 -- 172.21.15.47:0/2793985220 shutdown_connections 2024-07-24T22:12:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.440+0000 7f772c746640 1 -- 172.21.15.47:0/2793985220 wait complete. 2024-07-24T22:12:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.440+0000 7f772c746640 1 Processor -- start 2024-07-24T22:12:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.440+0000 7f772c746640 1 -- start start 2024-07-24T22:12:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.441+0000 7f772c746640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7724102750 0x7f7724074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.441+0000 7f772c746640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7724108160 0x7f77240753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.441+0000 7f772c746640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7724108ae0 0x7f7724075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.441+0000 7f772c746640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7724112790 con 0x7f7724102750 2024-07-24T22:12:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.441+0000 7f772c746640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7724112610 con 0x7f7724108ae0 2024-07-24T22:12:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.441+0000 7f772c746640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7724112910 con 0x7f7724108160 2024-07-24T22:12:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.441+0000 7f7729ce1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7724108160 0x7f77240753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.441+0000 7f772ace3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7724108ae0 0x7f7724075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.441+0000 7f7729ce1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7724108160 0x7f77240753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:59954/0 (socket says 172.21.15.47:59954) 2024-07-24T22:12:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.441+0000 7f7729ce1640 1 -- 172.21.15.47:0/3887391170 learned_addr learned my addr 172.21.15.47:0/3887391170 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.441+0000 7f772a4e2640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7724102750 0x7f7724074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.442+0000 7f7729ce1640 1 -- 172.21.15.47:0/3887391170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7724108ae0 msgr2=0x7f7724075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.442+0000 7f7729ce1640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7724108ae0 0x7f7724075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.442+0000 7f7729ce1640 1 -- 172.21.15.47:0/3887391170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7724102750 msgr2=0x7f7724074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.442+0000 7f7729ce1640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7724102750 0x7f7724074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.442+0000 7f7729ce1640 1 -- 172.21.15.47:0/3887391170 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77241a70e0 con 0x7f7724108160 2024-07-24T22:12:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.442+0000 7f772a4e2640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7724102750 0x7f7724074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.442+0000 7f7729ce1640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7724108160 0x7f77240753d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7714005940 tx=0x7f77140042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.442+0000 7f771b7fe640 1 -- 172.21.15.47:0/3887391170 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771403f030 con 0x7f7724108160 2024-07-24T22:12:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.442+0000 7f772c746640 1 -- 172.21.15.47:0/3887391170 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77241a7370 con 0x7f7724108160 2024-07-24T22:12:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.442+0000 7f771b7fe640 1 -- 172.21.15.47:0/3887391170 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7714003cb0 con 0x7f7724108160 2024-07-24T22:12:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.442+0000 7f771b7fe640 1 -- 172.21.15.47:0/3887391170 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714035070 con 0x7f7724108160 2024-07-24T22:12:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.442+0000 7f772c746640 1 -- 172.21.15.47:0/3887391170 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77241a7920 con 0x7f7724108160 2024-07-24T22:12:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.445+0000 7f772eaf7740 1 Processor -- start 2024-07-24T22:12:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.445+0000 7f771b7fe640 1 -- 172.21.15.47:0/3887391170 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f7714042030 con 0x7f7724108160 2024-07-24T22:12:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.445+0000 7f772eaf7740 1 -- start start 2024-07-24T22:12:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772eaf7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e6264dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772eaf7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e6264dff0 0x556e62659a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772eaf7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e62659f80 0x556e6265c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772eaf7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556e625c49b0 con 0x556e6264d6d0 2024-07-24T22:12:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772eaf7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556e625b3eb0 con 0x556e62659f80 2024-07-24T22:12:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772eaf7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556e625b7ef0 con 0x556e6264dff0 2024-07-24T22:12:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772ace3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e6264dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772ace3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e6264dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41600/0 (socket says 172.21.15.47:41600) 2024-07-24T22:12:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772ace3640 1 -- 172.21.15.47:0/1979877326 learned_addr learned my addr 172.21.15.47:0/1979877326 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772a4e2640 1 --2- 172.21.15.47:0/1979877326 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e6264dff0 0x556e62659a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f7729ce1640 1 --2- 172.21.15.47:0/1979877326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e62659f80 0x556e6265c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772ace3640 1 -- 172.21.15.47:0/1979877326 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e6264dff0 msgr2=0x556e62659a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772ace3640 1 --2- 172.21.15.47:0/1979877326 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e6264dff0 0x556e62659a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772ace3640 1 -- 172.21.15.47:0/1979877326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e62659f80 msgr2=0x556e6265c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772ace3640 1 --2- 172.21.15.47:0/1979877326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e62659f80 0x556e6265c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f772ace3640 1 -- 172.21.15.47:0/1979877326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e6253d320 con 0x556e6264d6d0 2024-07-24T22:12:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.446+0000 7f7729ce1640 1 --2- 172.21.15.47:0/1979877326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e62659f80 0x556e6265c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:12:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.447+0000 7f772ace3640 1 --2- 172.21.15.47:0/1979877326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e6264dab0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f771c009fd0 tx=0x7f771c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d8bb6b868feb92 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.447+0000 7f771b7fe640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77100b3d40 0x7f77100b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.447+0000 7f772a4e2640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77100b3d40 0x7f77100b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.447+0000 7f771b7fe640 1 -- 172.21.15.47:0/3887391170 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f7714104840 con 0x7f7724108160 2024-07-24T22:12:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.447+0000 7f7718ff9640 1 -- 172.21.15.47:0/1979877326 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771c016070 con 0x556e6264d6d0 2024-07-24T22:12:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.447+0000 7f7718ff9640 1 -- 172.21.15.47:0/1979877326 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f771c012bc0 con 0x556e6264d6d0 2024-07-24T22:12:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.447+0000 7f7718ff9640 1 -- 172.21.15.47:0/1979877326 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771c01bc20 con 0x556e6264d6d0 2024-07-24T22:12:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.448+0000 7f772eaf7740 1 -- 172.21.15.47:0/1979877326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 msgr2=0x556e6264dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.448+0000 7f772a4e2640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77100b3d40 0x7f77100b6200 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x556e6264c3e0 tx=0x7f7720009110 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.448+0000 7f772eaf7740 1 --2- 172.21.15.47:0/1979877326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e6264dab0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f771c009fd0 tx=0x7f771c010800 comp rx=0 tx=0).stop 2024-07-24T22:12:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.448+0000 7f772eaf7740 1 -- 172.21.15.47:0/1979877326 shutdown_connections 2024-07-24T22:12:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.448+0000 7f772eaf7740 1 --2- 172.21.15.47:0/1979877326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e62659f80 0x556e6265c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.448+0000 7f772eaf7740 1 --2- 172.21.15.47:0/1979877326 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e6264dff0 0x556e62659a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.448+0000 7f772eaf7740 1 --2- 172.21.15.47:0/1979877326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e6264dab0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.448+0000 7f772eaf7740 1 -- 172.21.15.47:0/1979877326 >> 172.21.15.47:0/1979877326 conn(0x556e6264b500 msgr2=0x556e6264c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.448+0000 7f772eaf7740 1 -- 172.21.15.47:0/1979877326 shutdown_connections 2024-07-24T22:12:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.448+0000 7f772eaf7740 1 -- 172.21.15.47:0/1979877326 wait complete. 2024-07-24T22:12:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f772eaf7740 1 -- start start 2024-07-24T22:12:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f772eaf7740 1 Processor -- start 2024-07-24T22:12:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f772eaf7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e62656f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f772eaf7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e6264dff0 0x556e62657450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f772eaf7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e62659f80 0x556e62657990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f772a4e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e62656f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f772eaf7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556e62417700 con 0x556e6264d6d0 2024-07-24T22:12:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f7729ce1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e6264dff0 0x556e62657450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f772a4e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e62656f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41604/0 (socket says 172.21.15.47:41604) 2024-07-24T22:12:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f772eaf7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556e625565f0 con 0x556e62659f80 2024-07-24T22:12:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f7729ce1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e6264dff0 0x556e62657450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:59976/0 (socket says 172.21.15.47:59976) 2024-07-24T22:12:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f772a4e2640 1 -- 172.21.15.47:0/2711880187 learned_addr learned my addr 172.21.15.47:0/2711880187 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f772eaf7740 1 -- 172.21.15.47:0/2711880187 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556e6265cc00 con 0x556e6264dff0 2024-07-24T22:12:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.449+0000 7f772ace3640 1 --2- 172.21.15.47:0/2711880187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e62659f80 0x556e62657990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.450+0000 7f772eaf7740 10 client.0 _ll_register_callbacks cb 0x556e62576960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.450+0000 7f7729ce1640 1 -- 172.21.15.47:0/2711880187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e62659f80 msgr2=0x556e62657990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:00.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.450+0000 7f7729ce1640 1 --2- 172.21.15.47:0/2711880187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e62659f80 0x556e62657990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.450+0000 7f7729ce1640 1 -- 172.21.15.47:0/2711880187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 msgr2=0x556e62656f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:00.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.450+0000 7f7729ce1640 1 --2- 172.21.15.47:0/2711880187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e62656f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.450+0000 7f7729ce1640 1 -- 172.21.15.47:0/2711880187 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e62549680 con 0x556e6264dff0 2024-07-24T22:12:00.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.450+0000 7f7729ce1640 1 --2- 172.21.15.47:0/2711880187 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e6264dff0 0x556e62657450 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7714101f30 tx=0x7f77140044e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52903bd82c522fb9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:00.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.450+0000 7f770dffb640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:12:00.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.450+0000 7f770dffb640 1 -- 172.21.15.47:0/2711880187 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714049070 con 0x556e6264dff0 2024-07-24T22:12:00.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.450+0000 7f772eaf7740 1 -- 172.21.15.47:0/2711880187 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f771c012bc0 con 0x556e6264dff0 2024-07-24T22:12:00.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.450+0000 7f770dffb640 1 -- 172.21.15.47:0/2711880187 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f77140cb650 con 0x556e6264dff0 2024-07-24T22:12:00.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.451+0000 7f770dffb640 1 -- 172.21.15.47:0/2711880187 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f77140cb1c0 con 0x556e6264dff0 2024-07-24T22:12:00.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.451+0000 7f772eaf7740 10 client.25888 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:00.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.451+0000 7f772eaf7740 1 -- 172.21.15.47:0/2711880187 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556e62314650 con 0x556e6264dff0 2024-07-24T22:12:00.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.451+0000 7f770dffb640 1 -- 172.21.15.47:0/2711880187 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f771c012bc0 con 0x556e6264dff0 2024-07-24T22:12:00.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.451+0000 7f770dffb640 1 -- 172.21.15.47:0/2711880187 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f77140d4010 con 0x556e6264dff0 2024-07-24T22:12:00.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.452+0000 7f772eaf7740 10 client.25888 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:00.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.452+0000 7f772eaf7740 10 client.25888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:00.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.452+0000 7f772eaf7740 20 client.25888 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:00.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.452+0000 7f772eaf7740 1 --2- 172.21.15.47:0/2711880187 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556e62669a30 0x556e6266bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.452+0000 7f772eaf7740 4 client.25888 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:12:00.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.452+0000 7f772eaf7740 1 -- 172.21.15.47:0/2711880187 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e625c6900 con 0x556e62669a30 2024-07-24T22:12:00.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.452+0000 7f772a4e2640 1 --2- 172.21.15.47:0/2711880187 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556e62669a30 0x556e6266bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.452+0000 7f770dffb640 10 client.25888 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.452+0000 7f772a4e2640 1 --2- 172.21.15.47:0/2711880187 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556e62669a30 0x556e6266bea0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cacc5505ae95c499 server_cookie=f5fcd82f7dba9ab0 in_seq=0 out_seq=0 2024-07-24T22:12:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.453+0000 7f770dffb640 1 -- 172.21.15.47:0/2711880187 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e625c6900 con 0x556e62669a30 2024-07-24T22:12:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.453+0000 7f770dffb640 10 client.25888 handle_command_reply: tid=0 2024-07-24T22:12:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.453+0000 7f772eaf7740 1 client.25888 shutdown 2024-07-24T22:12:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.453+0000 7f772eaf7740 1 -- 172.21.15.47:0/2711880187 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e6264dff0 msgr2=0x556e62657450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.453+0000 7f772eaf7740 1 --2- 172.21.15.47:0/2711880187 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e6264dff0 0x556e62657450 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7714101f30 tx=0x7f77140044e0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.453+0000 7f772eaf7740 1 -- 172.21.15.47:0/2711880187 shutdown_connections 2024-07-24T22:12:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.453+0000 7f772eaf7740 1 --2- 172.21.15.47:0/2711880187 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556e62669a30 0x556e6266bea0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.453+0000 7f772eaf7740 1 --2- 172.21.15.47:0/2711880187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e62659f80 0x556e62657990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.454+0000 7f772eaf7740 1 --2- 172.21.15.47:0/2711880187 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e6264dff0 0x556e62657450 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.454+0000 7f772eaf7740 1 --2- 172.21.15.47:0/2711880187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e62656f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.454+0000 7f772eaf7740 1 -- 172.21.15.47:0/2711880187 >> 172.21.15.47:0/2711880187 conn(0x556e6264b500 msgr2=0x556e626510a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:00.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.454+0000 7f770dffb640 0 client.25888 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:00.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.454+0000 7f772eaf7740 1 -- 172.21.15.47:0/2711880187 shutdown_connections 2024-07-24T22:12:00.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.454+0000 7f772eaf7740 1 -- 172.21.15.47:0/2711880187 wait complete. 2024-07-24T22:12:00.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.454+0000 7f772eaf7740 20 client.25888 trim_cache size 0 max 16384 2024-07-24T22:12:00.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.469+0000 7f772eaf7740 1 Processor -- start 2024-07-24T22:12:00.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.469+0000 7f772eaf7740 1 -- start start 2024-07-24T22:12:00.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.469+0000 7f772eaf7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e62658c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.469+0000 7f772eaf7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e6264dff0 0x556e626717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.469+0000 7f772eaf7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e62659f80 0x556e62671cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.469+0000 7f772eaf7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77241a9ee0 con 0x556e6264d6d0 2024-07-24T22:12:00.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.469+0000 7f772eaf7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f77241ac760 con 0x556e6264dff0 2024-07-24T22:12:00.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.469+0000 7f772eaf7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f77241aa550 con 0x556e62659f80 2024-07-24T22:12:00.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f772a4e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e62658c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f7729ce1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e6264dff0 0x556e626717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f772a4e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e62658c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41612/0 (socket says 172.21.15.47:41612) 2024-07-24T22:12:00.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f772a4e2640 1 -- 172.21.15.47:0/3350820212 learned_addr learned my addr 172.21.15.47:0/3350820212 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:00.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f772ace3640 1 --2- 172.21.15.47:0/3350820212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e62659f80 0x556e62671cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f7729ce1640 1 -- 172.21.15.47:0/3350820212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e62659f80 msgr2=0x556e62671cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:00.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f7729ce1640 1 --2- 172.21.15.47:0/3350820212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e62659f80 0x556e62671cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f7729ce1640 1 -- 172.21.15.47:0/3350820212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 msgr2=0x556e62658c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:00.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f7729ce1640 1 --2- 172.21.15.47:0/3350820212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e62658c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f7729ce1640 1 -- 172.21.15.47:0/3350820212 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e6265cae0 con 0x556e6264dff0 2024-07-24T22:12:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f7729ce1640 1 --2- 172.21.15.47:0/3350820212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e6264dff0 0x556e626717b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7714003fd0 tx=0x7f77140d4520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64d65f4658ba0be9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f770ffff640 1 -- 172.21.15.47:0/3350820212 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714049070 con 0x556e6264dff0 2024-07-24T22:12:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f770ffff640 1 -- 172.21.15.47:0/3350820212 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77140caf00 con 0x556e6264dff0 2024-07-24T22:12:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.470+0000 7f770ffff640 1 -- 172.21.15.47:0/3350820212 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77141023c0 con 0x556e6264dff0 2024-07-24T22:12:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.471+0000 7f772eaf7740 1 -- 172.21.15.47:0/3350820212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e6264dff0 msgr2=0x556e626717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.471+0000 7f772eaf7740 1 --2- 172.21.15.47:0/3350820212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e6264dff0 0x556e626717b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7714003fd0 tx=0x7f77140d4520 comp rx=0 tx=0).stop 2024-07-24T22:12:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.471+0000 7f772eaf7740 1 -- 172.21.15.47:0/3350820212 shutdown_connections 2024-07-24T22:12:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.471+0000 7f772eaf7740 1 --2- 172.21.15.47:0/3350820212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e62659f80 0x556e62671cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.471+0000 7f772eaf7740 1 --2- 172.21.15.47:0/3350820212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e6264dff0 0x556e626717b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.471+0000 7f772eaf7740 1 --2- 172.21.15.47:0/3350820212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264d6d0 0x556e62658c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.471+0000 7f772eaf7740 1 -- 172.21.15.47:0/3350820212 >> 172.21.15.47:0/3350820212 conn(0x556e6264b500 msgr2=0x556e62658540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.471+0000 7f772eaf7740 1 -- 172.21.15.47:0/3350820212 shutdown_connections 2024-07-24T22:12:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.471+0000 7f772eaf7740 1 -- 172.21.15.47:0/3350820212 wait complete. 2024-07-24T22:12:00.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.471+0000 7f772eaf7740 1 -- start start 2024-07-24T22:12:00.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.471+0000 7f772eaf7740 1 Processor -- start 2024-07-24T22:12:00.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772eaf7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e6264d6d0 0x556e6265dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772eaf7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264dff0 0x556e6265e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772eaf7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e62659f80 0x556e6265e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772eaf7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77241aac20 con 0x556e6264dff0 2024-07-24T22:12:00.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f7729ce1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264dff0 0x556e6265e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772a4e2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e6264d6d0 0x556e6265dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f7729ce1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264dff0 0x556e6265e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41618/0 (socket says 172.21.15.47:41618) 2024-07-24T22:12:00.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f7729ce1640 1 -- 172.21.15.47:0/3996567937 learned_addr learned my addr 172.21.15.47:0/3996567937 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:00.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772eaf7740 1 -- 172.21.15.47:0/3996567937 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f77241ac090 con 0x556e6264d6d0 2024-07-24T22:12:00.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772eaf7740 1 -- 172.21.15.47:0/3996567937 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f77241ab2f0 con 0x556e62659f80 2024-07-24T22:12:00.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772ace3640 1 --2- 172.21.15.47:0/3996567937 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e62659f80 0x556e6265e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772eaf7740 10 client.0 _ll_register_callbacks cb 0x7f7714004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:00.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772a4e2640 1 -- 172.21.15.47:0/3996567937 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e62659f80 msgr2=0x556e6265e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:00.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772a4e2640 1 --2- 172.21.15.47:0/3996567937 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e62659f80 0x556e6265e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772a4e2640 1 -- 172.21.15.47:0/3996567937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264dff0 msgr2=0x556e6265e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:00.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772a4e2640 1 --2- 172.21.15.47:0/3996567937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264dff0 0x556e6265e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772a4e2640 1 -- 172.21.15.47:0/3996567937 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e626d3830 con 0x556e6264d6d0 2024-07-24T22:12:00.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f7729ce1640 1 --2- 172.21.15.47:0/3996567937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264dff0 0x556e6265e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:00.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f772a4e2640 1 --2- 172.21.15.47:0/3996567937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e6264d6d0 0x556e6265dde0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7720009cd0 tx=0x7f7720014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20d1432d11de16f8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:00.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.472+0000 7f770dffb640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:12:00.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f770dffb640 1 -- 172.21.15.47:0/3996567937 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720031070 con 0x556e6264d6d0 2024-07-24T22:12:00.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f770dffb640 1 -- 172.21.15.47:0/3996567937 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f77200238e0 con 0x556e6264d6d0 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f772eaf7740 1 -- 172.21.15.47:0/3996567937 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77140caf00 con 0x556e6264d6d0 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f770dffb640 1 -- 172.21.15.47:0/3996567937 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7720023b20 con 0x556e6264d6d0 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f772eaf7740 10 client.25847 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f772eaf7740 1 -- 172.21.15.47:0/3996567937 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556e626d4b30 con 0x556e6264d6d0 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f770dffb640 1 -- 172.21.15.47:0/3996567937 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77140caf00 con 0x556e6264d6d0 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f770dffb640 1 -- 172.21.15.47:0/3996567937 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7720020040 con 0x556e6264d6d0 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f772eaf7740 10 client.25847 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f772eaf7740 10 client.25847 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f772eaf7740 20 client.25847 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f772eaf7740 1 --2- 172.21.15.47:0/3996567937 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556e626d5330 0x556e626d7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f772eaf7740 4 client.25847 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.473+0000 7f772eaf7740 1 -- 172.21.15.47:0/3996567937 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e625c23a0 con 0x556e626d5330 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.474+0000 7f7729ce1640 1 --2- 172.21.15.47:0/3996567937 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556e626d5330 0x556e626d7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.474+0000 7f770dffb640 10 client.25847 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.474+0000 7f7729ce1640 1 --2- 172.21.15.47:0/3996567937 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556e626d5330 0x556e626d7750 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=715b0dd65c688006 server_cookie=c587ebf5a70f02c in_seq=0 out_seq=0 2024-07-24T22:12:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.474+0000 7f770dffb640 1 -- 172.21.15.47:0/3996567937 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556e625c23a0 con 0x556e626d5330 2024-07-24T22:12:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.474+0000 7f770dffb640 10 client.25847 handle_command_reply: tid=0 2024-07-24T22:12:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.475+0000 7f772eaf7740 1 client.25847 shutdown 2024-07-24T22:12:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.475+0000 7f772eaf7740 1 -- 172.21.15.47:0/3996567937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e6264d6d0 msgr2=0x556e6265dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.475+0000 7f772eaf7740 1 --2- 172.21.15.47:0/3996567937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e6264d6d0 0x556e6265dde0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7720009cd0 tx=0x7f7720014000 comp rx=0 tx=0).stop 2024-07-24T22:12:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.475+0000 7f772eaf7740 1 -- 172.21.15.47:0/3996567937 shutdown_connections 2024-07-24T22:12:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.475+0000 7f772eaf7740 1 --2- 172.21.15.47:0/3996567937 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556e626d5330 0x556e626d7750 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.475+0000 7f772eaf7740 1 --2- 172.21.15.47:0/3996567937 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556e62659f80 0x556e6265e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.475+0000 7f772eaf7740 1 --2- 172.21.15.47:0/3996567937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556e6264dff0 0x556e6265e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.475+0000 7f770dffb640 0 client.25847 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.475+0000 7f772eaf7740 1 --2- 172.21.15.47:0/3996567937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556e6264d6d0 0x556e6265dde0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.475+0000 7f772eaf7740 1 -- 172.21.15.47:0/3996567937 >> 172.21.15.47:0/3996567937 conn(0x556e6264b500 msgr2=0x556e62658d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:00.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.475+0000 7f772eaf7740 1 -- 172.21.15.47:0/3996567937 shutdown_connections 2024-07-24T22:12:00.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.475+0000 7f772eaf7740 1 -- 172.21.15.47:0/3996567937 wait complete. 2024-07-24T22:12:00.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.475+0000 7f772eaf7740 20 client.25847 trim_cache size 0 max 16384 2024-07-24T22:12:00.485 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:12:00.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.476+0000 7f772c746640 1 -- 172.21.15.47:0/3887391170 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77100b3d40 msgr2=0x7f77100b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:00.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.476+0000 7f772c746640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77100b3d40 0x7f77100b6200 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x556e6264c3e0 tx=0x7f7720009110 comp rx=0 tx=0).stop 2024-07-24T22:12:00.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.476+0000 7f772c746640 1 -- 172.21.15.47:0/3887391170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7724108160 msgr2=0x7f77240753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:00.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.476+0000 7f772c746640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7724108160 0x7f77240753d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7714005940 tx=0x7f77140042f0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.476+0000 7f772c746640 1 -- 172.21.15.47:0/3887391170 shutdown_connections 2024-07-24T22:12:00.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.476+0000 7f772c746640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f77100b3d40 0x7f77100b6200 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.476+0000 7f772c746640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7724108ae0 0x7f7724075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.476+0000 7f772c746640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7724108160 0x7f77240753d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.476+0000 7f772c746640 1 --2- 172.21.15.47:0/3887391170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7724102750 0x7f7724074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:00.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.476+0000 7f772c746640 1 -- 172.21.15.47:0/3887391170 >> 172.21.15.47:0/3887391170 conn(0x7f77240fe200 msgr2=0x7f77241005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:00.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.476+0000 7f772c746640 1 -- 172.21.15.47:0/3887391170 shutdown_connections 2024-07-24T22:12:00.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:00.476+0000 7f772c746640 1 -- 172.21.15.47:0/3887391170 wait complete. 2024-07-24T22:12:02.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:01 smithi183 ceph-mon[37007]: pgmap v510: 97 pgs: 97 active+clean; 39 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 519 MiB/s wr, 1.28k op/s 2024-07-24T22:12:02.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:01 smithi047 ceph-mon[32551]: pgmap v510: 97 pgs: 97 active+clean; 39 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 519 MiB/s wr, 1.28k op/s 2024-07-24T22:12:02.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:01 smithi188 ceph-mon[37380]: pgmap v510: 97 pgs: 97 active+clean; 39 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 519 MiB/s wr, 1.28k op/s 2024-07-24T22:12:02.574 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:12:02.574 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:12:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.856+0000 7f37b3e9a640 1 -- 172.21.15.47:0/2281365810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37ac1026a0 msgr2=0x7f37ac102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.856+0000 7f37b3e9a640 1 --2- 172.21.15.47:0/2281365810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37ac1026a0 0x7f37ac102a80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f37a8009900 tx=0x7f37a802a440 comp rx=0 tx=0).stop 2024-07-24T22:12:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.856+0000 7f37b3e9a640 1 -- 172.21.15.47:0/2281365810 shutdown_connections 2024-07-24T22:12:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.856+0000 7f37b3e9a640 1 --2- 172.21.15.47:0/2281365810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37ac108a20 0x7f37ac10f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.856+0000 7f37b3e9a640 1 --2- 172.21.15.47:0/2281365810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37ac1080a0 0x7f37ac1084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.856+0000 7f37b3e9a640 1 --2- 172.21.15.47:0/2281365810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37ac1026a0 0x7f37ac102a80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.856+0000 7f37b3e9a640 1 -- 172.21.15.47:0/2281365810 >> 172.21.15.47:0/2281365810 conn(0x7f37ac0fe0e0 msgr2=0x7f37ac100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.856+0000 7f37b3e9a640 1 -- 172.21.15.47:0/2281365810 shutdown_connections 2024-07-24T22:12:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.856+0000 7f37b3e9a640 1 -- 172.21.15.47:0/2281365810 wait complete. 2024-07-24T22:12:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.857+0000 7f37b3e9a640 1 Processor -- start 2024-07-24T22:12:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.857+0000 7f37b3e9a640 1 -- start start 2024-07-24T22:12:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.858+0000 7f37b3e9a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37ac1026a0 0x7f37ac10e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.858+0000 7f37b3e9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37ac1080a0 0x7f37ac10eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.858+0000 7f37b3e9a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37ac108a20 0x7f37ac1a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.858+0000 7f37b3e9a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac1127d0 con 0x7f37ac1080a0 2024-07-24T22:12:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.858+0000 7f37b3e9a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac112650 con 0x7f37ac1026a0 2024-07-24T22:12:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.858+0000 7f37b3e9a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac112950 con 0x7f37ac108a20 2024-07-24T22:12:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.858+0000 7f37b1435640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37ac1080a0 0x7f37ac10eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.858+0000 7f37b1435640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37ac1080a0 0x7f37ac10eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41636/0 (socket says 172.21.15.47:41636) 2024-07-24T22:12:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.858+0000 7f37b1435640 1 -- 172.21.15.47:0/1380761103 learned_addr learned my addr 172.21.15.47:0/1380761103 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.859+0000 7f37b1435640 1 -- 172.21.15.47:0/1380761103 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37ac108a20 msgr2=0x7f37ac1a1a40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:12:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.859+0000 7f37b1435640 1 --2- 172.21.15.47:0/1380761103 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37ac108a20 0x7f37ac1a1a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.859+0000 7f37b1435640 1 -- 172.21.15.47:0/1380761103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37ac1026a0 msgr2=0x7f37ac10e660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:12:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.859+0000 7f37b1435640 1 --2- 172.21.15.47:0/1380761103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37ac1026a0 0x7f37ac10e660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.859+0000 7f37b1435640 1 -- 172.21.15.47:0/1380761103 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ac1a2210 con 0x7f37ac1080a0 2024-07-24T22:12:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.859+0000 7f37b1435640 1 --2- 172.21.15.47:0/1380761103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37ac1080a0 0x7f37ac10eba0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f379c00b450 tx=0x7f379c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.860+0000 7f37a2ffd640 1 -- 172.21.15.47:0/1380761103 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c015020 con 0x7f37ac1080a0 2024-07-24T22:12:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.860+0000 7f37a2ffd640 1 -- 172.21.15.47:0/1380761103 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f379c011d40 con 0x7f37ac1080a0 2024-07-24T22:12:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.860+0000 7f37b3e9a640 1 -- 172.21.15.47:0/1380761103 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ac1a2500 con 0x7f37ac1080a0 2024-07-24T22:12:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.860+0000 7f37a2ffd640 1 -- 172.21.15.47:0/1380761103 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c00f340 con 0x7f37ac1080a0 2024-07-24T22:12:02.864 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.860+0000 7f37b3e9a640 1 -- 172.21.15.47:0/1380761103 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ac1abe80 con 0x7f37ac1080a0 2024-07-24T22:12:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.865+0000 7f37a2ffd640 1 -- 172.21.15.47:0/1380761103 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f379c018020 con 0x7f37ac1080a0 2024-07-24T22:12:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.866+0000 7f37a2ffd640 1 --2- 172.21.15.47:0/1380761103 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f37980b3e90 0x7f37980b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.867+0000 7f37a2ffd640 1 -- 172.21.15.47:0/1380761103 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f379c0e39e0 con 0x7f37ac1080a0 2024-07-24T22:12:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.867+0000 7f37b6bf0740 1 Processor -- start 2024-07-24T22:12:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.867+0000 7f37b1c36640 1 --2- 172.21.15.47:0/1380761103 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f37980b3e90 0x7f37980b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.867+0000 7f37b6bf0740 1 -- start start 2024-07-24T22:12:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.867+0000 7f37b6bf0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c254f48c0 0x559c254f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.868+0000 7f37b6bf0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c25500c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.868+0000 7f37b6bf0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c25501170 0x559c25503560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.868+0000 7f37b6bf0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559c2546a280 con 0x559c254f51e0 2024-07-24T22:12:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.868+0000 7f37b6bf0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x559c25459780 con 0x559c25501170 2024-07-24T22:12:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.868+0000 7f37b6bf0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559c2545d7c0 con 0x559c254f48c0 2024-07-24T22:12:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.868+0000 7f37b1c36640 1 --2- 172.21.15.47:0/1380761103 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f37980b3e90 0x7f37980b6350 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f37a802a960 tx=0x7f37a8000bc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.868+0000 7f37b1435640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c25500c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.868+0000 7f37b1435640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c25500c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41640/0 (socket says 172.21.15.47:41640) 2024-07-24T22:12:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.868+0000 7f37b1435640 1 -- 172.21.15.47:0/2786114629 learned_addr learned my addr 172.21.15.47:0/2786114629 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.868+0000 7f37b2437640 1 --2- 172.21.15.47:0/2786114629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c25501170 0x559c25503560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.869+0000 7f37b1435640 1 -- 172.21.15.47:0/2786114629 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c254f48c0 msgr2=0x559c254f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.869+0000 7f37b1435640 1 --2- 172.21.15.47:0/2786114629 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c254f48c0 0x559c254f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.869+0000 7f37b1435640 1 -- 172.21.15.47:0/2786114629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c25501170 msgr2=0x559c25503560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.869+0000 7f37b1435640 1 --2- 172.21.15.47:0/2786114629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c25501170 0x559c25503560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.869+0000 7f37b1435640 1 -- 172.21.15.47:0/2786114629 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c251bd790 con 0x559c254f51e0 2024-07-24T22:12:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.869+0000 7f37b1435640 1 --2- 172.21.15.47:0/2786114629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c25500c30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f379c0aa400 tx=0x7f379c0a9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d15b66e44d7e3a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.869+0000 7f3797fff640 1 -- 172.21.15.47:0/2786114629 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c0b3100 con 0x559c254f51e0 2024-07-24T22:12:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.870+0000 7f3797fff640 1 -- 172.21.15.47:0/2786114629 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f379c0aed00 con 0x559c254f51e0 2024-07-24T22:12:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.870+0000 7f3797fff640 1 -- 172.21.15.47:0/2786114629 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c0a9960 con 0x559c254f51e0 2024-07-24T22:12:02.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.871+0000 7f37b6bf0740 1 -- 172.21.15.47:0/2786114629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 msgr2=0x559c25500c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:02.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.871+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/2786114629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c25500c30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f379c0aa400 tx=0x7f379c0a9f70 comp rx=0 tx=0).stop 2024-07-24T22:12:02.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.871+0000 7f37b6bf0740 1 -- 172.21.15.47:0/2786114629 shutdown_connections 2024-07-24T22:12:02.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.871+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/2786114629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c25501170 0x559c25503560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.871+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/2786114629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c25500c30 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.871+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/2786114629 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c254f48c0 0x559c254f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.871+0000 7f37b6bf0740 1 -- 172.21.15.47:0/2786114629 >> 172.21.15.47:0/2786114629 conn(0x559c254f26f0 msgr2=0x559c254f3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:02.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.871+0000 7f37b6bf0740 1 -- 172.21.15.47:0/2786114629 shutdown_connections 2024-07-24T22:12:02.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.871+0000 7f37b6bf0740 1 -- 172.21.15.47:0/2786114629 wait complete. 2024-07-24T22:12:02.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.872+0000 7f37b6bf0740 1 -- start start 2024-07-24T22:12:02.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.872+0000 7f37b6bf0740 1 Processor -- start 2024-07-24T22:12:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.873+0000 7f37b6bf0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c254f48c0 0x559c255009f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.873+0000 7f37b6bf0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c254fded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.873+0000 7f37b6bf0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c25501170 0x559c254fe470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.874+0000 7f37b1435640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c254fded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.874+0000 7f37b1c36640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c254f48c0 0x559c255009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.874+0000 7f37b1435640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c254fded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41650/0 (socket says 172.21.15.47:41650) 2024-07-24T22:12:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.874+0000 7f37b1435640 1 -- 172.21.15.47:0/4022232347 learned_addr learned my addr 172.21.15.47:0/4022232347 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.874+0000 7f37b6bf0740 1 -- 172.21.15.47:0/4022232347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559c25393ab0 con 0x559c254f51e0 2024-07-24T22:12:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.874+0000 7f37b6bf0740 1 -- 172.21.15.47:0/4022232347 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x559c253e19e0 con 0x559c254f48c0 2024-07-24T22:12:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.874+0000 7f37b6bf0740 1 -- 172.21.15.47:0/4022232347 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559c25503df0 con 0x559c25501170 2024-07-24T22:12:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.874+0000 7f37b2437640 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c25501170 0x559c254fe470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.874+0000 7f37b6bf0740 10 client.0 _ll_register_callbacks cb 0x559c25169a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.875+0000 7f37b1435640 1 -- 172.21.15.47:0/4022232347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c25501170 msgr2=0x559c254fe470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.875+0000 7f37b1435640 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c25501170 0x559c254fe470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.875+0000 7f37b1435640 1 -- 172.21.15.47:0/4022232347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c254f48c0 msgr2=0x559c255009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.875+0000 7f37b1435640 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c254f48c0 0x559c255009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.875+0000 7f37b1435640 1 -- 172.21.15.47:0/4022232347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c25236620 con 0x559c254f51e0 2024-07-24T22:12:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.875+0000 7f37b2437640 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c25501170 0x559c254fe470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.875+0000 7f37b1c36640 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c254f48c0 0x559c255009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.875+0000 7f37b1435640 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c254fded0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f379c0e1730 tx=0x7f379c011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7531b6b8d0e13cef server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.875+0000 7f37957fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:12:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.876+0000 7f37957fa640 1 -- 172.21.15.47:0/4022232347 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c0aed00 con 0x559c254f51e0 2024-07-24T22:12:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.876+0000 7f37b6bf0740 1 -- 172.21.15.47:0/4022232347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559c25408ce0 con 0x559c254f51e0 2024-07-24T22:12:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.876+0000 7f37957fa640 1 -- 172.21.15.47:0/4022232347 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f379c0a9960 con 0x559c254f51e0 2024-07-24T22:12:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.876+0000 7f37957fa640 1 -- 172.21.15.47:0/4022232347 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f379c0b3100 con 0x559c254f51e0 2024-07-24T22:12:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.876+0000 7f37b6bf0740 10 client.16506 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.876+0000 7f37b6bf0740 1 -- 172.21.15.47:0/4022232347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559c2550f660 con 0x559c254f51e0 2024-07-24T22:12:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.877+0000 7f37957fa640 1 -- 172.21.15.47:0/4022232347 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559c25408ce0 con 0x559c254f51e0 2024-07-24T22:12:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.877+0000 7f37957fa640 1 -- 172.21.15.47:0/4022232347 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f379c0a93d0 con 0x559c254f51e0 2024-07-24T22:12:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.877+0000 7f37b6bf0740 10 client.16506 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.877+0000 7f37b6bf0740 10 client.16506 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.877+0000 7f37b6bf0740 20 client.16506 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.877+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559c255109b0 0x559c25512da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.877+0000 7f37b6bf0740 4 client.16506 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:12:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.877+0000 7f37b6bf0740 1 -- 172.21.15.47:0/4022232347 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c2546c1d0 con 0x559c255109b0 2024-07-24T22:12:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.878+0000 7f37b1c36640 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559c255109b0 0x559c25512da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.881+0000 7f37b1c36640 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559c255109b0 0x559c25512da0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d444b74c85ac8bd6 server_cookie=90c086fc5cbc9a83 in_seq=0 out_seq=0 2024-07-24T22:12:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.881+0000 7f37957fa640 10 client.16506 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:02.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.883+0000 7f37957fa640 1 -- 172.21.15.47:0/4022232347 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c2546c1d0 con 0x559c255109b0 2024-07-24T22:12:02.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.883+0000 7f37957fa640 10 client.16506 handle_command_reply: tid=0 2024-07-24T22:12:02.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.883+0000 7f37b6bf0740 1 client.16506 shutdown 2024-07-24T22:12:02.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.884+0000 7f37b6bf0740 1 -- 172.21.15.47:0/4022232347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 msgr2=0x559c254fded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:02.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.884+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c254fded0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f379c0e1730 tx=0x7f379c011b40 comp rx=0 tx=0).stop 2024-07-24T22:12:02.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.884+0000 7f37b6bf0740 1 -- 172.21.15.47:0/4022232347 shutdown_connections 2024-07-24T22:12:02.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.884+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559c255109b0 0x559c25512da0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.884+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c25501170 0x559c254fe470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.884+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c254fded0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.884+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/4022232347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c254f48c0 0x559c255009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.884+0000 7f37b6bf0740 1 -- 172.21.15.47:0/4022232347 >> 172.21.15.47:0/4022232347 conn(0x559c254f26f0 msgr2=0x559c254f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:02.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.884+0000 7f37957fa640 0 client.16506 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:02.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.884+0000 7f37b6bf0740 1 -- 172.21.15.47:0/4022232347 shutdown_connections 2024-07-24T22:12:02.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.884+0000 7f37b6bf0740 1 -- 172.21.15.47:0/4022232347 wait complete. 2024-07-24T22:12:02.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.885+0000 7f37b6bf0740 20 client.16506 trim_cache size 0 max 16384 2024-07-24T22:12:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.905+0000 7f37b6bf0740 1 Processor -- start 2024-07-24T22:12:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.906+0000 7f37b6bf0740 1 -- start start 2024-07-24T22:12:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.906+0000 7f37b6bf0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c254f48c0 0x559c2550d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.906+0000 7f37b6bf0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c254f51e0 0x559c254fd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.906+0000 7f37b6bf0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c25501170 0x559c255159e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.906+0000 7f37b6bf0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac1b2aa0 con 0x559c25501170 2024-07-24T22:12:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.906+0000 7f37b6bf0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac1b5320 con 0x559c254f48c0 2024-07-24T22:12:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.906+0000 7f37b6bf0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac1b3110 con 0x559c254f51e0 2024-07-24T22:12:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.906+0000 7f37b2437640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c25501170 0x559c255159e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.906+0000 7f37b2437640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c25501170 0x559c255159e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41664/0 (socket says 172.21.15.47:41664) 2024-07-24T22:12:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.906+0000 7f37b2437640 1 -- 172.21.15.47:0/925470588 learned_addr learned my addr 172.21.15.47:0/925470588 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.906+0000 7f37b1435640 1 --2- 172.21.15.47:0/925470588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c254f51e0 0x559c254fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.907+0000 7f37b2437640 1 -- 172.21.15.47:0/925470588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c254f51e0 msgr2=0x559c254fd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.907+0000 7f37b2437640 1 --2- 172.21.15.47:0/925470588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c254f51e0 0x559c254fd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.907+0000 7f37b2437640 1 -- 172.21.15.47:0/925470588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c254f48c0 msgr2=0x559c2550d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.907+0000 7f37b2437640 1 --2- 172.21.15.47:0/925470588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c254f48c0 0x559c2550d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.907+0000 7f37b2437640 1 -- 172.21.15.47:0/925470588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c254f5010 con 0x559c25501170 2024-07-24T22:12:02.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.907+0000 7f37b2437640 1 --2- 172.21.15.47:0/925470588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c25501170 0x559c255159e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f37a4007f10 tx=0x7f37a400f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2d1ed8c5d7cb8f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:02.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.907+0000 7f37977fe640 1 -- 172.21.15.47:0/925470588 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4017070 con 0x559c25501170 2024-07-24T22:12:02.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.907+0000 7f37977fe640 1 -- 172.21.15.47:0/925470588 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37a400fe60 con 0x559c25501170 2024-07-24T22:12:02.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.907+0000 7f37977fe640 1 -- 172.21.15.47:0/925470588 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a400d040 con 0x559c25501170 2024-07-24T22:12:02.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.909+0000 7f37b6bf0740 1 -- 172.21.15.47:0/925470588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c25501170 msgr2=0x559c255159e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:02.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.909+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/925470588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c25501170 0x559c255159e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f37a4007f10 tx=0x7f37a400f630 comp rx=0 tx=0).stop 2024-07-24T22:12:02.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.909+0000 7f37b6bf0740 1 -- 172.21.15.47:0/925470588 shutdown_connections 2024-07-24T22:12:02.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.909+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/925470588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c25501170 0x559c255159e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.909+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/925470588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c254f51e0 0x559c254fd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.909+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/925470588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c254f48c0 0x559c2550d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.909+0000 7f37b6bf0740 1 -- 172.21.15.47:0/925470588 >> 172.21.15.47:0/925470588 conn(0x559c254f26f0 msgr2=0x559c254f17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:02.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.909+0000 7f37b6bf0740 1 -- 172.21.15.47:0/925470588 shutdown_connections 2024-07-24T22:12:02.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.910+0000 7f37b6bf0740 1 -- 172.21.15.47:0/925470588 wait complete. 2024-07-24T22:12:02.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.910+0000 7f37b6bf0740 1 -- start start 2024-07-24T22:12:02.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.910+0000 7f37b6bf0740 1 Processor -- start 2024-07-24T22:12:02.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.911+0000 7f37b6bf0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c254f48c0 0x559c25513c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.911+0000 7f37b6bf0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c25514180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.911+0000 7f37b6bf0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c25501170 0x559c255782e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.911+0000 7f37b6bf0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac1b37e0 con 0x559c254f51e0 2024-07-24T22:12:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.911+0000 7f37b6bf0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac1b4c50 con 0x559c25501170 2024-07-24T22:12:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.911+0000 7f37b6bf0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac1b3eb0 con 0x559c254f48c0 2024-07-24T22:12:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.911+0000 7f37b6bf0740 10 client.0 _ll_register_callbacks cb 0x7f379c0b3050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.911+0000 7f37b1435640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c25514180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.912+0000 7f37b1435640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c25514180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41676/0 (socket says 172.21.15.47:41676) 2024-07-24T22:12:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.912+0000 7f37b1435640 1 -- 172.21.15.47:0/2779133590 learned_addr learned my addr 172.21.15.47:0/2779133590 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.912+0000 7f37b1435640 1 -- 172.21.15.47:0/2779133590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c254f48c0 msgr2=0x559c25513c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.912+0000 7f37b1435640 1 --2- 172.21.15.47:0/2779133590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c254f48c0 0x559c25513c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.912+0000 7f37b1435640 1 -- 172.21.15.47:0/2779133590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c25501170 msgr2=0x559c255782e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.912+0000 7f37b1435640 1 --2- 172.21.15.47:0/2779133590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c25501170 0x559c255782e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.912+0000 7f37b1435640 1 -- 172.21.15.47:0/2779133590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c25578820 con 0x559c254f51e0 2024-07-24T22:12:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.912+0000 7f37b1435640 1 --2- 172.21.15.47:0/2779133590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c25514180 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f379c0e3d00 tx=0x7f379c010440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4880941740f3e49d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.913+0000 7f37957fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:12:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.913+0000 7f37957fa640 1 -- 172.21.15.47:0/2779133590 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c010ed0 con 0x559c254f51e0 2024-07-24T22:12:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.913+0000 7f37957fa640 1 -- 172.21.15.47:0/2779133590 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f379c0a9960 con 0x559c254f51e0 2024-07-24T22:12:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.913+0000 7f37b6bf0740 1 -- 172.21.15.47:0/2779133590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37a400fe60 con 0x559c254f51e0 2024-07-24T22:12:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.914+0000 7f37957fa640 1 -- 172.21.15.47:0/2779133590 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f379c0b3100 con 0x559c254f51e0 2024-07-24T22:12:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.914+0000 7f37b6bf0740 10 client.16512 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.914+0000 7f37b6bf0740 1 -- 172.21.15.47:0/2779133590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559c25579a30 con 0x559c254f51e0 2024-07-24T22:12:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.914+0000 7f37957fa640 1 -- 172.21.15.47:0/2779133590 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37a400fe60 con 0x559c254f51e0 2024-07-24T22:12:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.914+0000 7f37957fa640 1 -- 172.21.15.47:0/2779133590 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f379c0aba30 con 0x559c254f51e0 2024-07-24T22:12:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.914+0000 7f37b6bf0740 10 client.16512 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.914+0000 7f37b6bf0740 10 client.16512 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.915+0000 7f37b6bf0740 20 client.16512 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.915+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/2779133590 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559c25579f10 0x559c2557c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.915+0000 7f37b6bf0740 4 client.16512 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:12:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.915+0000 7f37b6bf0740 1 -- 172.21.15.47:0/2779133590 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559c25467c70 con 0x559c25579f10 2024-07-24T22:12:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.916+0000 7f37b1c36640 1 --2- 172.21.15.47:0/2779133590 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559c25579f10 0x559c2557c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.918+0000 7f37b1c36640 1 --2- 172.21.15.47:0/2779133590 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559c25579f10 0x559c2557c330 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5510c8732d6e69be server_cookie=7c468af685821679 in_seq=0 out_seq=0 2024-07-24T22:12:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:02.918+0000 7f37957fa640 10 client.16512 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:02.995 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:12:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.453+0000 7f37957fa640 1 -- 172.21.15.47:0/2779133590 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559c25467c70 con 0x559c25579f10 2024-07-24T22:12:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.453+0000 7f37957fa640 10 client.16512 handle_command_reply: tid=0 2024-07-24T22:12:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.453+0000 7f37b6bf0740 1 client.16512 shutdown 2024-07-24T22:12:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.453+0000 7f37b6bf0740 1 -- 172.21.15.47:0/2779133590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 msgr2=0x559c25514180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.453+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/2779133590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c25514180 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f379c0e3d00 tx=0x7f379c010440 comp rx=0 tx=0).stop 2024-07-24T22:12:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.454+0000 7f37b6bf0740 1 -- 172.21.15.47:0/2779133590 shutdown_connections 2024-07-24T22:12:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.454+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/2779133590 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559c25579f10 0x559c2557c330 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.454+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/2779133590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c25501170 0x559c255782e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.454+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/2779133590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559c254f51e0 0x559c25514180 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.454+0000 7f37b6bf0740 1 --2- 172.21.15.47:0/2779133590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559c254f48c0 0x559c25513c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.454+0000 7f37b6bf0740 1 -- 172.21.15.47:0/2779133590 >> 172.21.15.47:0/2779133590 conn(0x559c254f26f0 msgr2=0x559c254f33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.454+0000 7f37957fa640 0 client.16512 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.454+0000 7f37b6bf0740 1 -- 172.21.15.47:0/2779133590 shutdown_connections 2024-07-24T22:12:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.454+0000 7f37b6bf0740 1 -- 172.21.15.47:0/2779133590 wait complete. 2024-07-24T22:12:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.455+0000 7f37b6bf0740 20 client.16512 trim_cache size 0 max 16384 2024-07-24T22:12:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:12:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:12:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:12:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:12:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.457+0000 7f37b3e9a640 1 -- 172.21.15.47:0/1380761103 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f37980b3e90 msgr2=0x7f37980b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.457+0000 7f37b3e9a640 1 --2- 172.21.15.47:0/1380761103 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f37980b3e90 0x7f37980b6350 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f37a802a960 tx=0x7f37a8000bc0 comp rx=0 tx=0).stop 2024-07-24T22:12:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.457+0000 7f37b3e9a640 1 -- 172.21.15.47:0/1380761103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37ac1080a0 msgr2=0x7f37ac10eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.457+0000 7f37b3e9a640 1 --2- 172.21.15.47:0/1380761103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37ac1080a0 0x7f37ac10eba0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f379c00b450 tx=0x7f379c00b910 comp rx=0 tx=0).stop 2024-07-24T22:12:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.458+0000 7f37b3e9a640 1 -- 172.21.15.47:0/1380761103 shutdown_connections 2024-07-24T22:12:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.459+0000 7f37b3e9a640 1 --2- 172.21.15.47:0/1380761103 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f37980b3e90 0x7f37980b6350 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.459+0000 7f37b3e9a640 1 --2- 172.21.15.47:0/1380761103 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37ac108a20 0x7f37ac1a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.459+0000 7f37b3e9a640 1 --2- 172.21.15.47:0/1380761103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37ac1080a0 0x7f37ac10eba0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.459+0000 7f37b3e9a640 1 --2- 172.21.15.47:0/1380761103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37ac1026a0 0x7f37ac10e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.459+0000 7f37b3e9a640 1 -- 172.21.15.47:0/1380761103 >> 172.21.15.47:0/1380761103 conn(0x7f37ac0fe0e0 msgr2=0x7f37ac104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.459+0000 7f37b3e9a640 1 -- 172.21.15.47:0/1380761103 shutdown_connections 2024-07-24T22:12:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:03.460+0000 7f37b3e9a640 1 -- 172.21.15.47:0/1380761103 wait complete. 2024-07-24T22:12:04.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:03 smithi183 ceph-mon[37007]: pgmap v511: 97 pgs: 97 active+clean; 39 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 519 MiB/s wr, 793 op/s 2024-07-24T22:12:04.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:03 smithi047 ceph-mon[32551]: pgmap v511: 97 pgs: 97 active+clean; 39 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 519 MiB/s wr, 793 op/s 2024-07-24T22:12:04.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:03 smithi188 ceph-mon[37380]: pgmap v511: 97 pgs: 97 active+clean; 39 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 519 MiB/s wr, 793 op/s 2024-07-24T22:12:05.268 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:04 smithi047 ceph-mon[32551]: pgmap v512: 97 pgs: 97 active+clean; 39 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 560 MiB/s wr, 713 op/s 2024-07-24T22:12:05.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:04 smithi188 ceph-mon[37380]: pgmap v512: 97 pgs: 97 active+clean; 39 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 560 MiB/s wr, 713 op/s 2024-07-24T22:12:05.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:04 smithi183 ceph-mon[37007]: pgmap v512: 97 pgs: 97 active+clean; 39 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 560 MiB/s wr, 713 op/s 2024-07-24T22:12:05.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.596+0000 7f448097f640 1 -- 172.21.15.47:0/3411879150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f447c1079e0 msgr2=0x7f447c10e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:05.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.596+0000 7f448097f640 1 --2- 172.21.15.47:0/3411879150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f447c1079e0 0x7f447c10e1e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4474009ca0 tx=0x7f447402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.596+0000 7f448097f640 1 -- 172.21.15.47:0/3411879150 shutdown_connections 2024-07-24T22:12:05.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.596+0000 7f448097f640 1 --2- 172.21.15.47:0/3411879150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f447c1079e0 0x7f447c10e1e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.596+0000 7f448097f640 1 --2- 172.21.15.47:0/3411879150 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f447c107060 0x7f447c1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.596+0000 7f448097f640 1 --2- 172.21.15.47:0/3411879150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f447c101650 0x7f447c101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.596+0000 7f448097f640 1 -- 172.21.15.47:0/3411879150 >> 172.21.15.47:0/3411879150 conn(0x7f447c0fd0a0 msgr2=0x7f447c0ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:05.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.596+0000 7f448097f640 1 -- 172.21.15.47:0/3411879150 shutdown_connections 2024-07-24T22:12:05.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.596+0000 7f448097f640 1 -- 172.21.15.47:0/3411879150 wait complete. 2024-07-24T22:12:05.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.597+0000 7f448097f640 1 Processor -- start 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.597+0000 7f448097f640 1 -- start start 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.597+0000 7f448097f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f447c101650 0x7f447c198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.597+0000 7f448097f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f447c107060 0x7f447c199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.597+0000 7f448097f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f447c1079e0 0x7f447c19e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.597+0000 7f448097f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f447c111610 con 0x7f447c1079e0 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.597+0000 7f448097f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f447c111490 con 0x7f447c107060 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.597+0000 7f448097f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f447c111790 con 0x7f447c101650 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f447a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f447c101650 0x7f447c198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f447ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f447c1079e0 0x7f447c19e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f447a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f447c101650 0x7f447c198c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:58958/0 (socket says 172.21.15.47:58958) 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f447ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f447c1079e0 0x7f447c19e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36260/0 (socket says 172.21.15.47:36260) 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f447a59c640 1 -- 172.21.15.47:0/578189596 learned_addr learned my addr 172.21.15.47:0/578189596 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f4473fff640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f447c107060 0x7f447c199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f447a59c640 1 -- 172.21.15.47:0/578189596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f447c107060 msgr2=0x7f447c199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:05.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f447a59c640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f447c107060 0x7f447c199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f447a59c640 1 -- 172.21.15.47:0/578189596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f447c1079e0 msgr2=0x7f447c19e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:05.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f447a59c640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f447c1079e0 0x7f447c19e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f447a59c640 1 -- 172.21.15.47:0/578189596 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447c19ecb0 con 0x7f447c101650 2024-07-24T22:12:05.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f447ad9d640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f447c1079e0 0x7f447c19e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:05.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f447a59c640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f447c101650 0x7f447c198c00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f446c00ea60 tx=0x7f446c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:05.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f44737fe640 1 -- 172.21.15.47:0/578189596 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c00cde0 con 0x7f447c101650 2024-07-24T22:12:05.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f44737fe640 1 -- 172.21.15.47:0/578189596 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f446c0035f0 con 0x7f447c101650 2024-07-24T22:12:05.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f448097f640 1 -- 172.21.15.47:0/578189596 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447c19efa0 con 0x7f447c101650 2024-07-24T22:12:05.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f44737fe640 1 -- 172.21.15.47:0/578189596 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c010690 con 0x7f447c101650 2024-07-24T22:12:05.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.598+0000 7f448097f640 1 -- 172.21.15.47:0/578189596 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447c1a5660 con 0x7f447c101650 2024-07-24T22:12:05.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.601+0000 7f44737fe640 1 -- 172.21.15.47:0/578189596 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f446c0037a0 con 0x7f447c101650 2024-07-24T22:12:05.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.601+0000 7f4482d30740 1 Processor -- start 2024-07-24T22:12:05.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.601+0000 7f4482d30740 1 -- start start 2024-07-24T22:12:05.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4482d30740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e65064cf20 0x55e65064d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4482d30740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064d840 0x55e650659290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4482d30740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6506597d0 0x55e65065bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4482d30740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e6505c49f0 con 0x55e6506597d0 2024-07-24T22:12:05.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4482d30740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e6505b3ef0 con 0x55e65064d840 2024-07-24T22:12:05.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4482d30740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e6505b7f30 con 0x55e65064cf20 2024-07-24T22:12:05.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4473fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6506597d0 0x55e65065bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f447a59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064d840 0x55e650659290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4473fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6506597d0 0x55e65065bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36268/0 (socket says 172.21.15.47:36268) 2024-07-24T22:12:05.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4473fff640 1 -- 172.21.15.47:0/1383439557 learned_addr learned my addr 172.21.15.47:0/1383439557 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:05.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f447ad9d640 1 --2- 172.21.15.47:0/1383439557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e65064cf20 0x55e65064d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4473fff640 1 -- 172.21.15.47:0/1383439557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e65064cf20 msgr2=0x55e65064d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4473fff640 1 --2- 172.21.15.47:0/1383439557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e65064cf20 0x55e65064d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4473fff640 1 -- 172.21.15.47:0/1383439557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064d840 msgr2=0x55e650659290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4473fff640 1 --2- 172.21.15.47:0/1383439557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064d840 0x55e650659290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4473fff640 1 -- 172.21.15.47:0/1383439557 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e650314930 con 0x55e6506597d0 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f44737fe640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44680b3d40 0x7f44680b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f4473fff640 1 --2- 172.21.15.47:0/1383439557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6506597d0 0x55e65065bbc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4464009bb0 tx=0x7f44640117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3306e2b6c601e58a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.602+0000 7f447ad9d640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44680b3d40 0x7f44680b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.603+0000 7f44737fe640 1 -- 172.21.15.47:0/578189596 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f446c0e43e0 con 0x7f447c101650 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.603+0000 7f4470ff9640 1 -- 172.21.15.47:0/1383439557 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464012450 con 0x55e6506597d0 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.603+0000 7f4470ff9640 1 -- 172.21.15.47:0/1383439557 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4464012aa0 con 0x55e6506597d0 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.603+0000 7f4470ff9640 1 -- 172.21.15.47:0/1383439557 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446400fa50 con 0x55e6506597d0 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.603+0000 7f4482d30740 1 -- 172.21.15.47:0/1383439557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6506597d0 msgr2=0x55e65065bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:05.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.603+0000 7f4482d30740 1 --2- 172.21.15.47:0/1383439557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6506597d0 0x55e65065bbc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4464009bb0 tx=0x7f44640117b0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.603+0000 7f447ad9d640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44680b3d40 0x7f44680b6200 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4474005fe0 tx=0x7f4474005ef0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.603+0000 7f4482d30740 1 -- 172.21.15.47:0/1383439557 shutdown_connections 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.603+0000 7f4482d30740 1 --2- 172.21.15.47:0/1383439557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6506597d0 0x55e65065bbc0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.603+0000 7f4482d30740 1 --2- 172.21.15.47:0/1383439557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064d840 0x55e650659290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.603+0000 7f4482d30740 1 --2- 172.21.15.47:0/1383439557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e65064cf20 0x55e65064d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.603+0000 7f4482d30740 1 -- 172.21.15.47:0/1383439557 >> 172.21.15.47:0/1383439557 conn(0x55e65064ad50 msgr2=0x55e65064bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.603+0000 7f4482d30740 1 -- 172.21.15.47:0/1383439557 shutdown_connections 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f4482d30740 1 -- 172.21.15.47:0/1383439557 wait complete. 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f4482d30740 1 -- start start 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f4482d30740 1 Processor -- start 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f4482d30740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064cf20 0x55e6506567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f4482d30740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064d840 0x55e650656ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f4482d30740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6506597d0 0x55e650657220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f4482d30740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e650417890 con 0x55e65064d840 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f4482d30740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e650556390 con 0x55e65064cf20 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f4482d30740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e65065c450 con 0x55e6506597d0 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f4482d30740 10 client.0 _ll_register_callbacks cb 0x55e650560500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f447a59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064cf20 0x55e6506567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f4473fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064d840 0x55e650656ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f447a59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064cf20 0x55e6506567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:58024/0 (socket says 172.21.15.47:58024) 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f4473fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064d840 0x55e650656ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36274/0 (socket says 172.21.15.47:36274) 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f447a59c640 1 -- 172.21.15.47:0/105582334 learned_addr learned my addr 172.21.15.47:0/105582334 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.604+0000 7f447ad9d640 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6506597d0 0x55e650657220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f447a59c640 1 -- 172.21.15.47:0/105582334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6506597d0 msgr2=0x55e650657220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f447a59c640 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6506597d0 0x55e650657220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f447a59c640 1 -- 172.21.15.47:0/105582334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064d840 msgr2=0x55e650656ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f447a59c640 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064d840 0x55e650656ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f447a59c640 1 -- 172.21.15.47:0/105582334 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e650550d60 con 0x55e65064cf20 2024-07-24T22:12:05.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f4473fff640 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064d840 0x55e650656ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f447ad9d640 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6506597d0 0x55e650657220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:12:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f447a59c640 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064cf20 0x55e6506567a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f446c009920 tx=0x7f446c0a6e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27ee07f6d8e21d02 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f4461ffb640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:12:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f4461ffb640 1 -- 172.21.15.47:0/105582334 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c0aa700 con 0x55e65064cf20 2024-07-24T22:12:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f4482d30740 1 -- 172.21.15.47:0/105582334 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4464012aa0 con 0x55e65064cf20 2024-07-24T22:12:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f4461ffb640 1 -- 172.21.15.47:0/105582334 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f446c0aa1f0 con 0x55e65064cf20 2024-07-24T22:12:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f4461ffb640 1 -- 172.21.15.47:0/105582334 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f446c0e1f60 con 0x55e65064cf20 2024-07-24T22:12:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f4482d30740 10 client.25862 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.605+0000 7f4482d30740 1 -- 172.21.15.47:0/105582334 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e65066c7b0 con 0x55e65064cf20 2024-07-24T22:12:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.606+0000 7f4461ffb640 1 -- 172.21.15.47:0/105582334 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4464012aa0 con 0x55e65064cf20 2024-07-24T22:12:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.606+0000 7f4461ffb640 1 -- 172.21.15.47:0/105582334 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f446c0a6900 con 0x55e65064cf20 2024-07-24T22:12:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.606+0000 7f4482d30740 10 client.25862 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.606+0000 7f4482d30740 10 client.25862 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.606+0000 7f4482d30740 20 client.25862 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.606+0000 7f4482d30740 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e65066dd10 0x55e650670160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.606+0000 7f4482d30740 4 client.25862 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:12:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.606+0000 7f4482d30740 1 -- 172.21.15.47:0/105582334 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6505c6940 con 0x55e65066dd10 2024-07-24T22:12:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.606+0000 7f4473fff640 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e65066dd10 0x55e650670160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.606+0000 7f4461ffb640 10 client.25862 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.606+0000 7f4473fff640 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e65066dd10 0x55e650670160 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a009592c0b57fc11 server_cookie=131155f7e20116e6 in_seq=0 out_seq=0 2024-07-24T22:12:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.607+0000 7f4461ffb640 1 -- 172.21.15.47:0/105582334 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6505c6940 con 0x55e65066dd10 2024-07-24T22:12:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.607+0000 7f4461ffb640 10 client.25862 handle_command_reply: tid=0 2024-07-24T22:12:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.607+0000 7f4482d30740 1 client.25862 shutdown 2024-07-24T22:12:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.607+0000 7f4482d30740 1 -- 172.21.15.47:0/105582334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064cf20 msgr2=0x55e6506567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.607+0000 7f4482d30740 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064cf20 0x55e6506567a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f446c009920 tx=0x7f446c0a6e50 comp rx=0 tx=0).stop 2024-07-24T22:12:05.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.607+0000 7f4482d30740 1 -- 172.21.15.47:0/105582334 shutdown_connections 2024-07-24T22:12:05.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.607+0000 7f4482d30740 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e65066dd10 0x55e650670160 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.607+0000 7f4482d30740 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6506597d0 0x55e650657220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.607+0000 7f4461ffb640 0 client.25862 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:05.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.607+0000 7f4482d30740 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064d840 0x55e650656ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.607+0000 7f4482d30740 1 --2- 172.21.15.47:0/105582334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064cf20 0x55e6506567a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.607+0000 7f4482d30740 1 -- 172.21.15.47:0/105582334 >> 172.21.15.47:0/105582334 conn(0x55e65064ad50 msgr2=0x55e6506508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:05.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.608+0000 7f4482d30740 1 -- 172.21.15.47:0/105582334 shutdown_connections 2024-07-24T22:12:05.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.608+0000 7f4482d30740 1 -- 172.21.15.47:0/105582334 wait complete. 2024-07-24T22:12:05.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.608+0000 7f4482d30740 20 client.25862 trim_cache size 0 max 16384 2024-07-24T22:12:05.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.627+0000 7f4482d30740 1 Processor -- start 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.627+0000 7f4482d30740 1 -- start start 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.627+0000 7f4482d30740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064cf20 0x55e650675a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.627+0000 7f4482d30740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064d840 0x55e650675f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.627+0000 7f4482d30740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6506597d0 0x55e6506539b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.627+0000 7f4482d30740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1a9f00 con 0x55e65064d840 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.627+0000 7f4482d30740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1ac780 con 0x55e65064cf20 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.627+0000 7f4482d30740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1aa570 con 0x55e6506597d0 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.627+0000 7f447ad9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6506597d0 0x55e6506539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.627+0000 7f447ad9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6506597d0 0x55e6506539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:58992/0 (socket says 172.21.15.47:58992) 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.627+0000 7f4473fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064d840 0x55e650675f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.627+0000 7f447ad9d640 1 -- 172.21.15.47:0/3650133177 learned_addr learned my addr 172.21.15.47:0/3650133177 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.628+0000 7f447a59c640 1 --2- 172.21.15.47:0/3650133177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064cf20 0x55e650675a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.628+0000 7f447ad9d640 1 -- 172.21.15.47:0/3650133177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064cf20 msgr2=0x55e650675a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.628+0000 7f447ad9d640 1 --2- 172.21.15.47:0/3650133177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064cf20 0x55e650675a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.628+0000 7f447ad9d640 1 -- 172.21.15.47:0/3650133177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064d840 msgr2=0x55e650675f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.628+0000 7f447ad9d640 1 --2- 172.21.15.47:0/3650133177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064d840 0x55e650675f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.628+0000 7f447ad9d640 1 -- 172.21.15.47:0/3650133177 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e65064ab80 con 0x55e6506597d0 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.628+0000 7f4473fff640 1 --2- 172.21.15.47:0/3650133177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064d840 0x55e650675f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.628+0000 7f447a59c640 1 --2- 172.21.15.47:0/3650133177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064cf20 0x55e650675a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.628+0000 7f447ad9d640 1 --2- 172.21.15.47:0/3650133177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6506597d0 0x55e6506539b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4474031550 tx=0x7f4474042000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d00eb5852b26ed59 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.628+0000 7f4463fff640 1 -- 172.21.15.47:0/3650133177 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447402f660 con 0x55e6506597d0 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.628+0000 7f4463fff640 1 -- 172.21.15.47:0/3650133177 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4474036040 con 0x55e6506597d0 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.628+0000 7f4463fff640 1 -- 172.21.15.47:0/3650133177 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474030b80 con 0x55e6506597d0 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.629+0000 7f4482d30740 1 -- 172.21.15.47:0/3650133177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6506597d0 msgr2=0x55e6506539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.629+0000 7f4482d30740 1 --2- 172.21.15.47:0/3650133177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6506597d0 0x55e6506539b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4474031550 tx=0x7f4474042000 comp rx=0 tx=0).stop 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.629+0000 7f4482d30740 1 -- 172.21.15.47:0/3650133177 shutdown_connections 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.629+0000 7f4482d30740 1 --2- 172.21.15.47:0/3650133177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6506597d0 0x55e6506539b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.629+0000 7f4482d30740 1 --2- 172.21.15.47:0/3650133177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064d840 0x55e650675f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.629+0000 7f4482d30740 1 --2- 172.21.15.47:0/3650133177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e65064cf20 0x55e650675a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.629+0000 7f4482d30740 1 -- 172.21.15.47:0/3650133177 >> 172.21.15.47:0/3650133177 conn(0x55e65064ad50 msgr2=0x55e650656f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.629+0000 7f4482d30740 1 -- 172.21.15.47:0/3650133177 shutdown_connections 2024-07-24T22:12:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.629+0000 7f4482d30740 1 -- 172.21.15.47:0/3650133177 wait complete. 2024-07-24T22:12:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f4482d30740 1 -- start start 2024-07-24T22:12:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f4482d30740 1 Processor -- start 2024-07-24T22:12:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f4482d30740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064cf20 0x55e6506660f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f4482d30740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e65064d840 0x55e6506625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f4482d30740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6506597d0 0x55e650662b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f4482d30740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1aac40 con 0x55e65064cf20 2024-07-24T22:12:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f4482d30740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1ac0b0 con 0x55e6506597d0 2024-07-24T22:12:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f4482d30740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1ab310 con 0x55e65064d840 2024-07-24T22:12:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f447a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064cf20 0x55e6506660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f4482d30740 10 client.0 _ll_register_callbacks cb 0x7f446c004560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f4473fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e65064d840 0x55e6506625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f447ad9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6506597d0 0x55e650662b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f447a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064cf20 0x55e6506660f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36284/0 (socket says 172.21.15.47:36284) 2024-07-24T22:12:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.630+0000 7f447a59c640 1 -- 172.21.15.47:0/4236186370 learned_addr learned my addr 172.21.15.47:0/4236186370 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f4473fff640 1 -- 172.21.15.47:0/4236186370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6506597d0 msgr2=0x55e650662b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f4473fff640 1 --2- 172.21.15.47:0/4236186370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6506597d0 0x55e650662b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f4473fff640 1 -- 172.21.15.47:0/4236186370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064cf20 msgr2=0x55e6506660f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f4473fff640 1 --2- 172.21.15.47:0/4236186370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064cf20 0x55e6506660f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f4473fff640 1 -- 172.21.15.47:0/4236186370 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e650657640 con 0x55e65064d840 2024-07-24T22:12:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f447ad9d640 1 --2- 172.21.15.47:0/4236186370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6506597d0 0x55e650662b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f447a59c640 1 --2- 172.21.15.47:0/4236186370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064cf20 0x55e6506660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f4473fff640 1 --2- 172.21.15.47:0/4236186370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e65064d840 0x55e6506625d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4464009b80 tx=0x7f44640097e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf187c4ce4b2ba2d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f4461ffb640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:12:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f4461ffb640 1 -- 172.21.15.47:0/4236186370 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464004220 con 0x55e65064d840 2024-07-24T22:12:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f4461ffb640 1 -- 172.21.15.47:0/4236186370 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f44640043c0 con 0x55e65064d840 2024-07-24T22:12:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f4482d30740 1 -- 172.21.15.47:0/4236186370 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4474036040 con 0x55e65064d840 2024-07-24T22:12:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f4461ffb640 1 -- 172.21.15.47:0/4236186370 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4464012450 con 0x55e65064d840 2024-07-24T22:12:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f4482d30740 10 client.25918 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.631+0000 7f4482d30740 1 -- 172.21.15.47:0/4236186370 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e6506d97c0 con 0x55e65064d840 2024-07-24T22:12:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.632+0000 7f4461ffb640 1 -- 172.21.15.47:0/4236186370 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4474036040 con 0x55e65064d840 2024-07-24T22:12:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.632+0000 7f4461ffb640 1 -- 172.21.15.47:0/4236186370 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4464005040 con 0x55e65064d840 2024-07-24T22:12:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.632+0000 7f4482d30740 10 client.25918 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.632+0000 7f4482d30740 10 client.25918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.632+0000 7f4482d30740 20 client.25918 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.632+0000 7f4482d30740 1 --2- 172.21.15.47:0/4236186370 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e65066dd10 0x55e6506dbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.632+0000 7f4482d30740 4 client.25918 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:12:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.632+0000 7f4482d30740 1 -- 172.21.15.47:0/4236186370 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e6505c23e0 con 0x55e65066dd10 2024-07-24T22:12:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.632+0000 7f447a59c640 1 --2- 172.21.15.47:0/4236186370 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e65066dd10 0x55e6506dbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.632+0000 7f447a59c640 1 --2- 172.21.15.47:0/4236186370 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e65066dd10 0x55e6506dbbe0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6d0d03cb2ee3159 server_cookie=280b2a7149f5d7e in_seq=0 out_seq=0 2024-07-24T22:12:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.632+0000 7f4461ffb640 10 client.25918 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.633+0000 7f4461ffb640 1 -- 172.21.15.47:0/4236186370 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e6505c23e0 con 0x55e65066dd10 2024-07-24T22:12:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.633+0000 7f4461ffb640 10 client.25918 handle_command_reply: tid=0 2024-07-24T22:12:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.633+0000 7f4482d30740 1 client.25918 shutdown 2024-07-24T22:12:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.633+0000 7f4482d30740 1 -- 172.21.15.47:0/4236186370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e65064d840 msgr2=0x55e6506625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.633+0000 7f4482d30740 1 --2- 172.21.15.47:0/4236186370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e65064d840 0x55e6506625d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4464009b80 tx=0x7f44640097e0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.634+0000 7f4482d30740 1 -- 172.21.15.47:0/4236186370 shutdown_connections 2024-07-24T22:12:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.634+0000 7f4482d30740 1 --2- 172.21.15.47:0/4236186370 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e65066dd10 0x55e6506dbbe0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.634+0000 7f4482d30740 1 --2- 172.21.15.47:0/4236186370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6506597d0 0x55e650662b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.634+0000 7f4482d30740 1 --2- 172.21.15.47:0/4236186370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e65064d840 0x55e6506625d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.634+0000 7f4482d30740 1 --2- 172.21.15.47:0/4236186370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e65064cf20 0x55e6506660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.634+0000 7f4482d30740 1 -- 172.21.15.47:0/4236186370 >> 172.21.15.47:0/4236186370 conn(0x55e65064ad50 msgr2=0x55e6506689f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:05.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.634+0000 7f4461ffb640 0 client.25918 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:05.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.634+0000 7f4482d30740 1 -- 172.21.15.47:0/4236186370 shutdown_connections 2024-07-24T22:12:05.719 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:12:05.719 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:12:05.719 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "e371ab39-1bc5-46d4-b746-5d8e829bea35", 2024-07-24T22:12:05.719 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:12:05.720 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:12:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.634+0000 7f4482d30740 1 -- 172.21.15.47:0/4236186370 wait complete. 2024-07-24T22:12:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.634+0000 7f4482d30740 20 client.25918 trim_cache size 0 max 16384 2024-07-24T22:12:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.635+0000 7f448097f640 1 -- 172.21.15.47:0/578189596 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44680b3d40 msgr2=0x7f44680b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.635+0000 7f448097f640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44680b3d40 0x7f44680b6200 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4474005fe0 tx=0x7f4474005ef0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.635+0000 7f448097f640 1 -- 172.21.15.47:0/578189596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f447c101650 msgr2=0x7f447c198c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.635+0000 7f448097f640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f447c101650 0x7f447c198c00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f446c00ea60 tx=0x7f446c00ef20 comp rx=0 tx=0).stop 2024-07-24T22:12:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.635+0000 7f448097f640 1 -- 172.21.15.47:0/578189596 shutdown_connections 2024-07-24T22:12:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.635+0000 7f448097f640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44680b3d40 0x7f44680b6200 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.635+0000 7f448097f640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f447c1079e0 0x7f447c19e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.635+0000 7f448097f640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f447c107060 0x7f447c199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.635+0000 7f448097f640 1 --2- 172.21.15.47:0/578189596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f447c101650 0x7f447c198c00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:05.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.635+0000 7f448097f640 1 -- 172.21.15.47:0/578189596 >> 172.21.15.47:0/578189596 conn(0x7f447c0fd0a0 msgr2=0x7f447c06b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:05.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.635+0000 7f448097f640 1 -- 172.21.15.47:0/578189596 shutdown_connections 2024-07-24T22:12:05.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:05.635+0000 7f448097f640 1 -- 172.21.15.47:0/578189596 wait complete. 2024-07-24T22:12:06.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:06 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:12:06.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:06 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:06.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:06 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:12:06.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:06 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:06.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:06 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:12:06.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:06 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:06.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:06 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:12:06.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:06 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:06.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:06 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:12:06.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:06 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:06.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:06 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:12:06.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:06 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:06.941 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:12:07.223 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:12:07.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:07 smithi183 ceph-mon[37007]: pgmap v513: 97 pgs: 97 active+clean; 39 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 460 MiB/s wr, 512 op/s 2024-07-24T22:12:07.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:07 smithi047 ceph-mon[32551]: pgmap v513: 97 pgs: 97 active+clean; 39 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 460 MiB/s wr, 512 op/s 2024-07-24T22:12:07.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:07 smithi188 ceph-mon[37380]: pgmap v513: 97 pgs: 97 active+clean; 39 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 460 MiB/s wr, 512 op/s 2024-07-24T22:12:09.622 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:09 smithi047 ceph-mon[32551]: pgmap v514: 97 pgs: 97 active+clean; 40 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 502 MiB/s wr, 608 op/s 2024-07-24T22:12:09.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:09 smithi188 ceph-mon[37380]: pgmap v514: 97 pgs: 97 active+clean; 40 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 502 MiB/s wr, 608 op/s 2024-07-24T22:12:09.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:09 smithi183 ceph-mon[37007]: pgmap v514: 97 pgs: 97 active+clean; 40 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 502 MiB/s wr, 608 op/s 2024-07-24T22:12:10.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.268+0000 7f30669d3640 1 -- 172.21.15.47:0/2276455485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f306010ef30 msgr2=0x7f3060115730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:10.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.268+0000 7f30669d3640 1 --2- 172.21.15.47:0/2276455485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f306010ef30 0x7f3060115730 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f305801acb0 tx=0x7f305803b920 comp rx=0 tx=0).stop 2024-07-24T22:12:10.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.270+0000 7f30669d3640 1 -- 172.21.15.47:0/2276455485 shutdown_connections 2024-07-24T22:12:10.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.270+0000 7f30669d3640 1 --2- 172.21.15.47:0/2276455485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f306010ef30 0x7f3060115730 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.270+0000 7f30669d3640 1 --2- 172.21.15.47:0/2276455485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f306010e5b0 0x7f306010e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.270+0000 7f30669d3640 1 --2- 172.21.15.47:0/2276455485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3060108bd0 0x7f3060108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.270+0000 7f30669d3640 1 -- 172.21.15.47:0/2276455485 >> 172.21.15.47:0/2276455485 conn(0x7f30600782a0 msgr2=0x7f306007a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:10.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.270+0000 7f30669d3640 1 -- 172.21.15.47:0/2276455485 shutdown_connections 2024-07-24T22:12:10.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.274+0000 7f30669d3640 1 -- 172.21.15.47:0/2276455485 wait complete. 2024-07-24T22:12:10.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.275+0000 7f30669d3640 1 Processor -- start 2024-07-24T22:12:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.279+0000 7f30669d3640 1 -- start start 2024-07-24T22:12:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.279+0000 7f30669d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3060108bd0 0x7f306007c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.280+0000 7f30669d3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f306010e5b0 0x7f306007ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.280+0000 7f30669d3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f306010ef30 0x7f30600835d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.280+0000 7f30669d3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f306006ee70 con 0x7f3060108bd0 2024-07-24T22:12:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.280+0000 7f30669d3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f306006ecf0 con 0x7f306010e5b0 2024-07-24T22:12:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.280+0000 7f30669d3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f306006eff0 con 0x7f306010ef30 2024-07-24T22:12:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.281+0000 7f30659d1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3060108bd0 0x7f306007c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.281+0000 7f30659d1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3060108bd0 0x7f306007c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36300/0 (socket says 172.21.15.47:36300) 2024-07-24T22:12:10.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.281+0000 7f30659d1640 1 -- 172.21.15.47:0/3237454991 learned_addr learned my addr 172.21.15.47:0/3237454991 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:10.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.284+0000 7f30651d0640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f306010e5b0 0x7f306007ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.285+0000 7f30661d2640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f306010ef30 0x7f30600835d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.288+0000 7f30651d0640 1 -- 172.21.15.47:0/3237454991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f306010ef30 msgr2=0x7f30600835d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:10.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.288+0000 7f30651d0640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f306010ef30 0x7f30600835d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.288+0000 7f30651d0640 1 -- 172.21.15.47:0/3237454991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3060108bd0 msgr2=0x7f306007c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:10.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.288+0000 7f30651d0640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3060108bd0 0x7f306007c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.288+0000 7f30651d0640 1 -- 172.21.15.47:0/3237454991 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30601115d0 con 0x7f306010e5b0 2024-07-24T22:12:10.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.289+0000 7f30651d0640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f306010e5b0 0x7f306007ccf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f305c009fd0 tx=0x7f305c00b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:10.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.290+0000 7f3056ffd640 1 -- 172.21.15.47:0/3237454991 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c015020 con 0x7f306010e5b0 2024-07-24T22:12:10.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.291+0000 7f3056ffd640 1 -- 172.21.15.47:0/3237454991 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f305c011ce0 con 0x7f306010e5b0 2024-07-24T22:12:10.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.291+0000 7f3056ffd640 1 -- 172.21.15.47:0/3237454991 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c010de0 con 0x7f306010e5b0 2024-07-24T22:12:10.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.294+0000 7f30669d3640 1 -- 172.21.15.47:0/3237454991 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30601118c0 con 0x7f306010e5b0 2024-07-24T22:12:10.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.294+0000 7f30669d3640 1 -- 172.21.15.47:0/3237454991 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3060111db0 con 0x7f306010e5b0 2024-07-24T22:12:10.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.305+0000 7f3056ffd640 1 -- 172.21.15.47:0/3237454991 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f305c018020 con 0x7f306010e5b0 2024-07-24T22:12:10.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.309+0000 7f3056ffd640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f304c0b3fc0 0x7f304c0b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.309+0000 7f3056ffd640 1 -- 172.21.15.47:0/3237454991 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f305c0118d0 con 0x7f306010e5b0 2024-07-24T22:12:10.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.310+0000 7f3069fe6740 1 Processor -- start 2024-07-24T22:12:10.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.311+0000 7f30659d1640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f304c0b3fc0 0x7f304c0b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.311+0000 7f3069fe6740 1 -- start start 2024-07-24T22:12:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.311+0000 7f3069fe6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0335830 0x5616e0335c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.312+0000 7f3069fe6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e0336150 0x5616e0341ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.312+0000 7f3069fe6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e03420e0 0x5616e03444d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.312+0000 7f3069fe6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5616e02ac990 con 0x5616e0335830 2024-07-24T22:12:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.312+0000 7f3069fe6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5616e029be90 con 0x5616e03420e0 2024-07-24T22:12:10.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.312+0000 7f3069fe6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5616e029fed0 con 0x5616e0336150 2024-07-24T22:12:10.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.312+0000 7f30659d1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0335830 0x5616e0335c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.312+0000 7f30659d1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0335830 0x5616e0335c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36310/0 (socket says 172.21.15.47:36310) 2024-07-24T22:12:10.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.312+0000 7f30659d1640 1 -- 172.21.15.47:0/3319590850 learned_addr learned my addr 172.21.15.47:0/3319590850 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:10.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.312+0000 7f30661d2640 1 --2- 172.21.15.47:0/3319590850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e03420e0 0x5616e03444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.313+0000 7f30659d1640 1 -- 172.21.15.47:0/3319590850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e0336150 msgr2=0x5616e0341ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:12:10.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.313+0000 7f30659d1640 1 --2- 172.21.15.47:0/3319590850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e0336150 0x5616e0341ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.313+0000 7f30659d1640 1 -- 172.21.15.47:0/3319590850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e03420e0 msgr2=0x5616e03444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:10.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.313+0000 7f30659d1640 1 --2- 172.21.15.47:0/3319590850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e03420e0 0x5616e03444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.313+0000 7f30659d1640 1 -- 172.21.15.47:0/3319590850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e0225300 con 0x5616e0335830 2024-07-24T22:12:10.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.313+0000 7f30659d1640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f304c0b3fc0 0x7f304c0b6480 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3050009fd0 tx=0x7f3050009f60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:10.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.314+0000 7f30659d1640 1 --2- 172.21.15.47:0/3319590850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0335830 0x5616e0335c10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3050017380 tx=0x7f305001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91cecd3578cc1312 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:10.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.316+0000 7f304bfff640 1 -- 172.21.15.47:0/3319590850 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305001e070 con 0x5616e0335830 2024-07-24T22:12:10.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.316+0000 7f304bfff640 1 -- 172.21.15.47:0/3319590850 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3050027070 con 0x5616e0335830 2024-07-24T22:12:10.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.318+0000 7f3069fe6740 1 -- 172.21.15.47:0/3319590850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0335830 msgr2=0x5616e0335c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:10.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.318+0000 7f3069fe6740 1 --2- 172.21.15.47:0/3319590850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0335830 0x5616e0335c10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3050017380 tx=0x7f305001c000 comp rx=0 tx=0).stop 2024-07-24T22:12:10.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.319+0000 7f3069fe6740 1 -- 172.21.15.47:0/3319590850 shutdown_connections 2024-07-24T22:12:10.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.319+0000 7f3069fe6740 1 --2- 172.21.15.47:0/3319590850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e03420e0 0x5616e03444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.319+0000 7f3069fe6740 1 --2- 172.21.15.47:0/3319590850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e0336150 0x5616e0341ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.319+0000 7f3069fe6740 1 --2- 172.21.15.47:0/3319590850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0335830 0x5616e0335c10 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.319+0000 7f3069fe6740 1 -- 172.21.15.47:0/3319590850 >> 172.21.15.47:0/3319590850 conn(0x5616e0333660 msgr2=0x5616e0334800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:10.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.319+0000 7f3069fe6740 1 -- 172.21.15.47:0/3319590850 shutdown_connections 2024-07-24T22:12:10.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.319+0000 7f3069fe6740 1 -- 172.21.15.47:0/3319590850 wait complete. 2024-07-24T22:12:10.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.320+0000 7f3069fe6740 1 -- start start 2024-07-24T22:12:10.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.320+0000 7f3069fe6740 1 Processor -- start 2024-07-24T22:12:10.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.321+0000 7f3069fe6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0335830 0x5616e0341b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.322+0000 7f3069fe6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0336150 0x5616e033eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.322+0000 7f3069fe6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e03420e0 0x5616e033f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.322+0000 7f3069fe6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5616e00ff700 con 0x5616e0335830 2024-07-24T22:12:10.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.322+0000 7f3069fe6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5616e023e5d0 con 0x5616e0336150 2024-07-24T22:12:10.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.322+0000 7f3069fe6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5616e0344d50 con 0x5616e03420e0 2024-07-24T22:12:10.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.322+0000 7f30651d0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0336150 0x5616e033eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.323+0000 7f30651d0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0336150 0x5616e033eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:58068/0 (socket says 172.21.15.47:58068) 2024-07-24T22:12:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.323+0000 7f30651d0640 1 -- 172.21.15.47:0/2606789596 learned_addr learned my addr 172.21.15.47:0/2606789596 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.323+0000 7f30661d2640 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e03420e0 0x5616e033f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.323+0000 7f3069fe6740 10 client.0 _ll_register_callbacks cb 0x5616e025e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.323+0000 7f30659d1640 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0335830 0x5616e0341b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.324+0000 7f30661d2640 1 -- 172.21.15.47:0/2606789596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0336150 msgr2=0x5616e033eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.324+0000 7f30661d2640 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0336150 0x5616e033eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.324+0000 7f30661d2640 1 -- 172.21.15.47:0/2606789596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0335830 msgr2=0x5616e0341b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:10.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.324+0000 7f30661d2640 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0335830 0x5616e0341b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.324+0000 7f30661d2640 1 -- 172.21.15.47:0/2606789596 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616e0231660 con 0x5616e03420e0 2024-07-24T22:12:10.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.324+0000 7f30659d1640 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0335830 0x5616e0341b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:10.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.325+0000 7f30661d2640 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e03420e0 0x5616e033f780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f305803be40 tx=0x7f3058003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f386269b8a8c8761 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:10.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.325+0000 7f30497fa640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:12:10.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.330+0000 7f30497fa640 1 -- 172.21.15.47:0/2606789596 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058045040 con 0x5616e03420e0 2024-07-24T22:12:10.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.330+0000 7f30497fa640 1 -- 172.21.15.47:0/2606789596 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f30580408d0 con 0x5616e03420e0 2024-07-24T22:12:10.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.330+0000 7f3069fe6740 1 -- 172.21.15.47:0/2606789596 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3050027070 con 0x5616e03420e0 2024-07-24T22:12:10.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.332+0000 7f30497fa640 1 -- 172.21.15.47:0/2606789596 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3058061050 con 0x5616e03420e0 2024-07-24T22:12:10.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.332+0000 7f3069fe6740 10 client.25921 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:10.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.332+0000 7f3069fe6740 1 -- 172.21.15.47:0/2606789596 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5616dfffc650 con 0x5616e03420e0 2024-07-24T22:12:10.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.333+0000 7f30497fa640 1 -- 172.21.15.47:0/2606789596 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3058058070 con 0x5616e03420e0 2024-07-24T22:12:10.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.333+0000 7f30497fa640 1 -- 172.21.15.47:0/2606789596 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3058041620 con 0x5616e03420e0 2024-07-24T22:12:10.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.333+0000 7f3069fe6740 10 client.25921 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:10.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.333+0000 7f3069fe6740 10 client.25921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:10.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.334+0000 7f3069fe6740 20 client.25921 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:10.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.334+0000 7f3069fe6740 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5616e0351c90 0x5616e03540b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.334+0000 7f3069fe6740 4 client.25921 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:12:10.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.334+0000 7f3069fe6740 1 -- 172.21.15.47:0/2606789596 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3050027070 con 0x5616e0351c90 2024-07-24T22:12:10.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.338+0000 7f30659d1640 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5616e0351c90 0x5616e03540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.342+0000 7f30659d1640 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5616e0351c90 0x5616e03540b0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f95ea52f83fefb2 server_cookie=5ec09756f11eabf0 in_seq=0 out_seq=0 2024-07-24T22:12:10.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.342+0000 7f30497fa640 10 client.25921 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.347+0000 7f30497fa640 1 -- 172.21.15.47:0/2606789596 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3050027070 con 0x5616e0351c90 2024-07-24T22:12:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.347+0000 7f30497fa640 10 client.25921 handle_command_reply: tid=0 2024-07-24T22:12:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.347+0000 7f3069fe6740 1 client.25921 shutdown 2024-07-24T22:12:10.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.348+0000 7f3069fe6740 1 -- 172.21.15.47:0/2606789596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e03420e0 msgr2=0x5616e033f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:10.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.348+0000 7f3069fe6740 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e03420e0 0x5616e033f780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f305803be40 tx=0x7f3058003ba0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.348+0000 7f3069fe6740 1 -- 172.21.15.47:0/2606789596 shutdown_connections 2024-07-24T22:12:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.348+0000 7f3069fe6740 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5616e0351c90 0x5616e03540b0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.348+0000 7f3069fe6740 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e03420e0 0x5616e033f780 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.348+0000 7f3069fe6740 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0336150 0x5616e033eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.348+0000 7f3069fe6740 1 --2- 172.21.15.47:0/2606789596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0335830 0x5616e0341b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.348+0000 7f3069fe6740 1 -- 172.21.15.47:0/2606789596 >> 172.21.15.47:0/2606789596 conn(0x5616e0333660 msgr2=0x5616e0339200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.348+0000 7f30497fa640 0 client.25921 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.348+0000 7f3069fe6740 1 -- 172.21.15.47:0/2606789596 shutdown_connections 2024-07-24T22:12:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.348+0000 7f3069fe6740 1 -- 172.21.15.47:0/2606789596 wait complete. 2024-07-24T22:12:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.348+0000 7f3069fe6740 20 client.25921 trim_cache size 0 max 16384 2024-07-24T22:12:10.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.388+0000 7f3069fe6740 1 Processor -- start 2024-07-24T22:12:10.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.388+0000 7f3069fe6740 1 -- start start 2024-07-24T22:12:10.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.388+0000 7f3069fe6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e0335830 0x5616e032e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.388+0000 7f3069fe6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0336150 0x5616e0340d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.388+0000 7f3069fe6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e03420e0 0x5616e0359940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.388+0000 7f3069fe6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f304400c970 con 0x5616e03420e0 2024-07-24T22:12:10.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.388+0000 7f3069fe6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f304400f1f0 con 0x5616e0336150 2024-07-24T22:12:10.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.388+0000 7f3069fe6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f304400cfe0 con 0x5616e0335830 2024-07-24T22:12:10.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.389+0000 7f30661d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e03420e0 0x5616e0359940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.389+0000 7f30661d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e03420e0 0x5616e0359940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36328/0 (socket says 172.21.15.47:36328) 2024-07-24T22:12:10.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.390+0000 7f30661d2640 1 -- 172.21.15.47:0/576775371 learned_addr learned my addr 172.21.15.47:0/576775371 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:10.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.390+0000 7f30659d1640 1 --2- 172.21.15.47:0/576775371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e0335830 0x5616e032e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.390+0000 7f30651d0640 1 --2- 172.21.15.47:0/576775371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0336150 0x5616e0340d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.390+0000 7f30661d2640 1 -- 172.21.15.47:0/576775371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e0335830 msgr2=0x5616e032e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:10.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.390+0000 7f30661d2640 1 --2- 172.21.15.47:0/576775371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e0335830 0x5616e032e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.390+0000 7f30661d2640 1 -- 172.21.15.47:0/576775371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0336150 msgr2=0x5616e0340d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.390+0000 7f30661d2640 1 --2- 172.21.15.47:0/576775371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0336150 0x5616e0340d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.390+0000 7f30661d2640 1 -- 172.21.15.47:0/576775371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e033df30 con 0x5616e03420e0 2024-07-24T22:12:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.391+0000 7f30661d2640 1 --2- 172.21.15.47:0/576775371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e03420e0 0x5616e0359940 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3058002230 tx=0x7f305803b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b6e66836c625e2 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.391+0000 7f304b7fe640 1 -- 172.21.15.47:0/576775371 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305806b070 con 0x5616e03420e0 2024-07-24T22:12:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.391+0000 7f304b7fe640 1 -- 172.21.15.47:0/576775371 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3058058040 con 0x5616e03420e0 2024-07-24T22:12:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.391+0000 7f304b7fe640 1 -- 172.21.15.47:0/576775371 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058045050 con 0x5616e03420e0 2024-07-24T22:12:10.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.392+0000 7f3069fe6740 1 -- 172.21.15.47:0/576775371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e03420e0 msgr2=0x5616e0359940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:10.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.392+0000 7f3069fe6740 1 --2- 172.21.15.47:0/576775371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e03420e0 0x5616e0359940 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3058002230 tx=0x7f305803b920 comp rx=0 tx=0).stop 2024-07-24T22:12:10.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.393+0000 7f3069fe6740 1 -- 172.21.15.47:0/576775371 shutdown_connections 2024-07-24T22:12:10.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.393+0000 7f3069fe6740 1 --2- 172.21.15.47:0/576775371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e03420e0 0x5616e0359940 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.393+0000 7f3069fe6740 1 --2- 172.21.15.47:0/576775371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0336150 0x5616e0340d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.393+0000 7f3069fe6740 1 --2- 172.21.15.47:0/576775371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e0335830 0x5616e032e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.393+0000 7f3069fe6740 1 -- 172.21.15.47:0/576775371 >> 172.21.15.47:0/576775371 conn(0x5616e0333660 msgr2=0x5616e0340600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:10.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.394+0000 7f3069fe6740 1 -- 172.21.15.47:0/576775371 shutdown_connections 2024-07-24T22:12:10.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.394+0000 7f3069fe6740 1 -- 172.21.15.47:0/576775371 wait complete. 2024-07-24T22:12:10.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.395+0000 7f3069fe6740 1 -- start start 2024-07-24T22:12:10.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.395+0000 7f3069fe6740 1 Processor -- start 2024-07-24T22:12:10.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.396+0000 7f3069fe6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0335830 0x5616e034a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.396+0000 7f3069fe6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0336150 0x5616e034a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.396+0000 7f3069fe6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e03420e0 0x5616e0347090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.397+0000 7f30651d0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0336150 0x5616e034a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.397+0000 7f30651d0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0336150 0x5616e034a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36330/0 (socket says 172.21.15.47:36330) 2024-07-24T22:12:10.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.397+0000 7f3069fe6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f304400d6b0 con 0x5616e0336150 2024-07-24T22:12:10.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.397+0000 7f3069fe6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f304400eb20 con 0x5616e0335830 2024-07-24T22:12:10.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.397+0000 7f3069fe6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f304400dd80 con 0x5616e03420e0 2024-07-24T22:12:10.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.397+0000 7f3069fe6740 10 client.0 _ll_register_callbacks cb 0x7f3058040710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:10.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.397+0000 7f30659d1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0335830 0x5616e034a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.397+0000 7f30659d1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0335830 0x5616e034a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:58094/0 (socket says 172.21.15.47:58094) 2024-07-24T22:12:10.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.397+0000 7f30659d1640 1 -- 172.21.15.47:0/988143804 learned_addr learned my addr 172.21.15.47:0/988143804 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:10.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.398+0000 7f30661d2640 1 --2- 172.21.15.47:0/988143804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e03420e0 0x5616e0347090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.400+0000 7f30651d0640 1 -- 172.21.15.47:0/988143804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e03420e0 msgr2=0x5616e0347090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:10.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.400+0000 7f30651d0640 1 --2- 172.21.15.47:0/988143804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e03420e0 0x5616e0347090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.400+0000 7f30651d0640 1 -- 172.21.15.47:0/988143804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0335830 msgr2=0x5616e034a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:10.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.400+0000 7f30651d0640 1 --2- 172.21.15.47:0/988143804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0335830 0x5616e034a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.400+0000 7f30651d0640 1 -- 172.21.15.47:0/988143804 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616e0335f80 con 0x5616e0336150 2024-07-24T22:12:10.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.400+0000 7f30659d1640 1 --2- 172.21.15.47:0/988143804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0335830 0x5616e034a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.400+0000 7f30651d0640 1 --2- 172.21.15.47:0/988143804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0336150 0x5616e034a600 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f305c000c00 tx=0x7f305c0aab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e17aaa7cf5703b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.400+0000 7f30497fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:12:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.401+0000 7f30497fa640 1 -- 172.21.15.47:0/988143804 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0e14a0 con 0x5616e0336150 2024-07-24T22:12:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.401+0000 7f3069fe6740 1 -- 172.21.15.47:0/988143804 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3058058040 con 0x5616e0336150 2024-07-24T22:12:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.401+0000 7f30497fa640 1 -- 172.21.15.47:0/988143804 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f305c0aa520 con 0x5616e0336150 2024-07-24T22:12:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.401+0000 7f30497fa640 1 -- 172.21.15.47:0/988143804 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f305c0ab2c0 con 0x5616e0336150 2024-07-24T22:12:10.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.402+0000 7f3069fe6740 10 client.16548 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:10.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.402+0000 7f3069fe6740 1 -- 172.21.15.47:0/988143804 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5616e03bce60 con 0x5616e0336150 2024-07-24T22:12:10.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.403+0000 7f30497fa640 1 -- 172.21.15.47:0/988143804 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3058058040 con 0x5616e0336150 2024-07-24T22:12:10.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.403+0000 7f30497fa640 1 -- 172.21.15.47:0/988143804 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f305c0a6d40 con 0x5616e0336150 2024-07-24T22:12:10.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.403+0000 7f3069fe6740 10 client.16548 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:10.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.403+0000 7f3069fe6740 10 client.16548 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:10.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.403+0000 7f3069fe6740 20 client.16548 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:10.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.403+0000 7f3069fe6740 1 --2- 172.21.15.47:0/988143804 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5616e03bd590 0x5616e03bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:10.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.403+0000 7f3069fe6740 4 client.16548 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:12:10.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.403+0000 7f3069fe6740 1 -- 172.21.15.47:0/988143804 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5616e02ae8e0 con 0x5616e03bd590 2024-07-24T22:12:10.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.404+0000 7f30659d1640 1 --2- 172.21.15.47:0/988143804 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5616e03bd590 0x5616e03bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:10.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.406+0000 7f30497fa640 10 client.16548 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:10.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.406+0000 7f30659d1640 1 --2- 172.21.15.47:0/988143804 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5616e03bd590 0x5616e03bf9b0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=871ba6cb345a6dcf server_cookie=d88198246654169f in_seq=0 out_seq=0 2024-07-24T22:12:10.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.407+0000 7f30497fa640 1 -- 172.21.15.47:0/988143804 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5616e02ae8e0 con 0x5616e03bd590 2024-07-24T22:12:10.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.407+0000 7f30497fa640 10 client.16548 handle_command_reply: tid=0 2024-07-24T22:12:10.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.407+0000 7f3069fe6740 1 client.16548 shutdown 2024-07-24T22:12:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.408+0000 7f3069fe6740 1 -- 172.21.15.47:0/988143804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0336150 msgr2=0x5616e034a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.408+0000 7f3069fe6740 1 --2- 172.21.15.47:0/988143804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0336150 0x5616e034a600 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f305c000c00 tx=0x7f305c0aab40 comp rx=0 tx=0).stop 2024-07-24T22:12:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.408+0000 7f3069fe6740 1 -- 172.21.15.47:0/988143804 shutdown_connections 2024-07-24T22:12:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.408+0000 7f3069fe6740 1 --2- 172.21.15.47:0/988143804 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5616e03bd590 0x5616e03bf9b0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.408+0000 7f3069fe6740 1 --2- 172.21.15.47:0/988143804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5616e03420e0 0x5616e0347090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.408+0000 7f3069fe6740 1 --2- 172.21.15.47:0/988143804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616e0336150 0x5616e034a600 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.408+0000 7f3069fe6740 1 --2- 172.21.15.47:0/988143804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5616e0335830 0x5616e034a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.408+0000 7f30497fa640 0 client.16548 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.408+0000 7f3069fe6740 1 -- 172.21.15.47:0/988143804 >> 172.21.15.47:0/988143804 conn(0x5616e0333660 msgr2=0x5616e0340e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:10.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.409+0000 7f3069fe6740 1 -- 172.21.15.47:0/988143804 shutdown_connections 2024-07-24T22:12:10.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.409+0000 7f3069fe6740 1 -- 172.21.15.47:0/988143804 wait complete. 2024-07-24T22:12:10.412 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:12:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:12:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:12:10.412 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:12:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.409+0000 7f3069fe6740 20 client.16548 trim_cache size 0 max 16384 2024-07-24T22:12:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.410+0000 7f30669d3640 1 -- 172.21.15.47:0/3237454991 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f304c0b3fc0 msgr2=0x7f304c0b6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.410+0000 7f30669d3640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f304c0b3fc0 0x7f304c0b6480 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3050009fd0 tx=0x7f3050009f60 comp rx=0 tx=0).stop 2024-07-24T22:12:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.411+0000 7f30669d3640 1 -- 172.21.15.47:0/3237454991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f306010e5b0 msgr2=0x7f306007ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.411+0000 7f30669d3640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f306010e5b0 0x7f306007ccf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f305c009fd0 tx=0x7f305c00b870 comp rx=0 tx=0).stop 2024-07-24T22:12:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.411+0000 7f30669d3640 1 -- 172.21.15.47:0/3237454991 shutdown_connections 2024-07-24T22:12:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.411+0000 7f30669d3640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f304c0b3fc0 0x7f304c0b6480 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.411+0000 7f30669d3640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f306010ef30 0x7f30600835d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.411+0000 7f30669d3640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f306010e5b0 0x7f306007ccf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.411+0000 7f30669d3640 1 --2- 172.21.15.47:0/3237454991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3060108bd0 0x7f306007c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:10.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.411+0000 7f30669d3640 1 -- 172.21.15.47:0/3237454991 >> 172.21.15.47:0/3237454991 conn(0x7f30600782a0 msgr2=0x7f306007a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:10.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.411+0000 7f30669d3640 1 -- 172.21.15.47:0/3237454991 shutdown_connections 2024-07-24T22:12:10.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:10.411+0000 7f30669d3640 1 -- 172.21.15.47:0/3237454991 wait complete. 2024-07-24T22:12:10.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:10 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:12:10.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:10 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:12:10.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:10 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:12:11.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:11 smithi047 ceph-mon[32551]: pgmap v515: 97 pgs: 97 active+clean; 40 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 446 MiB/s wr, 606 op/s 2024-07-24T22:12:11.848 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:12:11.848 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:12:11.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:11 smithi183 ceph-mon[37007]: pgmap v515: 97 pgs: 97 active+clean; 40 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 446 MiB/s wr, 606 op/s 2024-07-24T22:12:12.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:11 smithi188 ceph-mon[37380]: pgmap v515: 97 pgs: 97 active+clean; 40 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 446 MiB/s wr, 606 op/s 2024-07-24T22:12:12.520 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:12:13.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:13 smithi183 ceph-mon[37007]: pgmap v516: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 383 MiB/s wr, 608 op/s 2024-07-24T22:12:13.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:13 smithi047 ceph-mon[32551]: pgmap v516: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 383 MiB/s wr, 608 op/s 2024-07-24T22:12:14.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:13 smithi188 ceph-mon[37380]: pgmap v516: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 383 MiB/s wr, 608 op/s 2024-07-24T22:12:15.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.976+0000 7f92fb2ef640 1 -- 172.21.15.47:0/667506116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92f40757f0 msgr2=0x7f92f410e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:15.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.976+0000 7f92fb2ef640 1 --2- 172.21.15.47:0/667506116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92f40757f0 0x7f92f410e800 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009900 tx=0x7f92e402a410 comp rx=0 tx=0).stop 2024-07-24T22:12:15.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.976+0000 7f92fb2ef640 1 -- 172.21.15.47:0/667506116 shutdown_connections 2024-07-24T22:12:15.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.976+0000 7f92fb2ef640 1 --2- 172.21.15.47:0/667506116 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92f410ed40 0x7f92f4111130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:15.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.976+0000 7f92fb2ef640 1 --2- 172.21.15.47:0/667506116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92f40757f0 0x7f92f410e800 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:15.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.976+0000 7f92fb2ef640 1 --2- 172.21.15.47:0/667506116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f4074ed0 0x7f92f40752b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:15.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.976+0000 7f92fb2ef640 1 -- 172.21.15.47:0/667506116 >> 172.21.15.47:0/667506116 conn(0x7f92f40fe200 msgr2=0x7f92f4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:15.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.976+0000 7f92fb2ef640 1 -- 172.21.15.47:0/667506116 shutdown_connections 2024-07-24T22:12:15.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.976+0000 7f92fb2ef640 1 -- 172.21.15.47:0/667506116 wait complete. 2024-07-24T22:12:15.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.977+0000 7f92fb2ef640 1 Processor -- start 2024-07-24T22:12:15.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.977+0000 7f92fb2ef640 1 -- start start 2024-07-24T22:12:15.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.977+0000 7f92fb2ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92f4074ed0 0x7f92f419ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:15.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.977+0000 7f92fb2ef640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f40757f0 0x7f92f419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:15.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.977+0000 7f92fb2ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92f410ed40 0x7f92f41a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:15.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.977+0000 7f92fb2ef640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f92f4114920 con 0x7f92f410ed40 2024-07-24T22:12:15.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.977+0000 7f92fb2ef640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f92f41147a0 con 0x7f92f40757f0 2024-07-24T22:12:15.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.977+0000 7f92fb2ef640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f92f4114aa0 con 0x7f92f4074ed0 2024-07-24T22:12:15.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.977+0000 7f92f988c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92f410ed40 0x7f92f41a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:15.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.977+0000 7f92f888a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f40757f0 0x7f92f419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:15.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92f908b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92f4074ed0 0x7f92f419ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:15.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92f988c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92f410ed40 0x7f92f41a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49726/0 (socket says 172.21.15.47:49726) 2024-07-24T22:12:15.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92f888a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f40757f0 0x7f92f419b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:40742/0 (socket says 172.21.15.47:40742) 2024-07-24T22:12:15.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92f988c640 1 -- 172.21.15.47:0/2296322774 learned_addr learned my addr 172.21.15.47:0/2296322774 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:15.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92f988c640 1 -- 172.21.15.47:0/2296322774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92f4074ed0 msgr2=0x7f92f419ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:15.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92f988c640 1 --2- 172.21.15.47:0/2296322774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92f4074ed0 0x7f92f419ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:15.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92f988c640 1 -- 172.21.15.47:0/2296322774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f40757f0 msgr2=0x7f92f419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:15.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92f988c640 1 --2- 172.21.15.47:0/2296322774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f40757f0 0x7f92f419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:15.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92f988c640 1 -- 172.21.15.47:0/2296322774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f41a0f00 con 0x7f92f410ed40 2024-07-24T22:12:15.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92f888a640 1 --2- 172.21.15.47:0/2296322774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f40757f0 0x7f92f419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:15.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92f988c640 1 --2- 172.21.15.47:0/2296322774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92f410ed40 0x7f92f41a0730 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00eb40 tx=0x7f92ec00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:15.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92ea7fc640 1 -- 172.21.15.47:0/2296322774 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec004b20 con 0x7f92f410ed40 2024-07-24T22:12:15.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92fb2ef640 1 -- 172.21.15.47:0/2296322774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f41a11f0 con 0x7f92f410ed40 2024-07-24T22:12:15.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92ea7fc640 1 -- 172.21.15.47:0/2296322774 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92ec004cc0 con 0x7f92f410ed40 2024-07-24T22:12:15.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92ea7fc640 1 -- 172.21.15.47:0/2296322774 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec010720 con 0x7f92f410ed40 2024-07-24T22:12:15.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.978+0000 7f92fb2ef640 1 -- 172.21.15.47:0/2296322774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f41a78b0 con 0x7f92f410ed40 2024-07-24T22:12:15.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.980+0000 7f92fb2ef640 1 -- 172.21.15.47:0/2296322774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f40752b0 con 0x7f92f410ed40 2024-07-24T22:12:15.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.981+0000 7f92ea7fc640 1 -- 172.21.15.47:0/2296322774 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f92ec005020 con 0x7f92f410ed40 2024-07-24T22:12:15.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.982+0000 7f92ea7fc640 1 --2- 172.21.15.47:0/2296322774 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f92e00b3d40 0x7f92e00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:15.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.982+0000 7f92ea7fc640 1 -- 172.21.15.47:0/2296322774 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f92ec0e46d0 con 0x7f92f410ed40 2024-07-24T22:12:15.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.982+0000 7f92f908b640 1 --2- 172.21.15.47:0/2296322774 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f92e00b3d40 0x7f92e00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:15.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.983+0000 7f92f908b640 1 --2- 172.21.15.47:0/2296322774 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f92e00b3d40 0x7f92e00b6200 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f92f0005d00 tx=0x7f92f000b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:15.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:14.986+0000 7f92ea7fc640 1 -- 172.21.15.47:0/2296322774 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f92ec0ab9e0 con 0x7f92f410ed40 2024-07-24T22:12:15.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.386+0000 7f92fb2ef640 1 -- 172.21.15.47:0/2296322774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92f41a7c10 con 0x7f92f410ed40 2024-07-24T22:12:15.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.394+0000 7f92ea7fc640 1 -- 172.21.15.47:0/2296322774 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f92ec0ab2e0 con 0x7f92f410ed40 2024-07-24T22:12:15.404 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:12:15.404 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:12:15.405 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:12:15.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.399+0000 7f92fb2ef640 1 -- 172.21.15.47:0/2296322774 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f92e00b3d40 msgr2=0x7f92e00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:15.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.399+0000 7f92fb2ef640 1 --2- 172.21.15.47:0/2296322774 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f92e00b3d40 0x7f92e00b6200 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f92f0005d00 tx=0x7f92f000b410 comp rx=0 tx=0).stop 2024-07-24T22:12:15.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.399+0000 7f92fb2ef640 1 -- 172.21.15.47:0/2296322774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92f410ed40 msgr2=0x7f92f41a0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:15.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.399+0000 7f92fb2ef640 1 --2- 172.21.15.47:0/2296322774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92f410ed40 0x7f92f41a0730 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00eb40 tx=0x7f92ec00c2d0 comp rx=0 tx=0).stop 2024-07-24T22:12:15.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.400+0000 7f92fb2ef640 1 -- 172.21.15.47:0/2296322774 shutdown_connections 2024-07-24T22:12:15.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.400+0000 7f92fb2ef640 1 --2- 172.21.15.47:0/2296322774 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f92e00b3d40 0x7f92e00b6200 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:15.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.400+0000 7f92fb2ef640 1 --2- 172.21.15.47:0/2296322774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92f410ed40 0x7f92f41a0730 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:15.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.400+0000 7f92fb2ef640 1 --2- 172.21.15.47:0/2296322774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92f40757f0 0x7f92f419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:15.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.400+0000 7f92fb2ef640 1 --2- 172.21.15.47:0/2296322774 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f92f4074ed0 0x7f92f419ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:15.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.400+0000 7f92fb2ef640 1 -- 172.21.15.47:0/2296322774 >> 172.21.15.47:0/2296322774 conn(0x7f92f40fe200 msgr2=0x7f92f40fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:15.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.400+0000 7f92fb2ef640 1 -- 172.21.15.47:0/2296322774 shutdown_connections 2024-07-24T22:12:15.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:15.400+0000 7f92fb2ef640 1 -- 172.21.15.47:0/2296322774 wait complete. 2024-07-24T22:12:15.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:15 smithi183 ceph-mon[37007]: pgmap v517: 97 pgs: 97 active+clean; 42 GiB data, 126 GiB used, 947 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 487 MiB/s wr, 1.01k op/s 2024-07-24T22:12:15.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:15 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2296322774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:12:15.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:15 smithi047 ceph-mon[32551]: pgmap v517: 97 pgs: 97 active+clean; 42 GiB data, 126 GiB used, 947 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 487 MiB/s wr, 1.01k op/s 2024-07-24T22:12:15.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:15 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2296322774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:12:16.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:15 smithi188 ceph-mon[37380]: pgmap v517: 97 pgs: 97 active+clean; 42 GiB data, 126 GiB used, 947 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 487 MiB/s wr, 1.01k op/s 2024-07-24T22:12:16.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:15 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2296322774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:12:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.840+0000 7f4a1a9e3640 1 -- 172.21.15.47:0/3999387416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a14109db0 msgr2=0x7f4a1410a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.840+0000 7f4a1a9e3640 1 --2- 172.21.15.47:0/3999387416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a14109db0 0x7f4a1410a190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4a08010910 tx=0x7f4a0802e310 comp rx=0 tx=0).stop 2024-07-24T22:12:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.840+0000 7f4a1a9e3640 1 -- 172.21.15.47:0/3999387416 shutdown_connections 2024-07-24T22:12:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.840+0000 7f4a1a9e3640 1 --2- 172.21.15.47:0/3999387416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a1410f580 0x7f4a14115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.840+0000 7f4a1a9e3640 1 --2- 172.21.15.47:0/3999387416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a1410ec00 0x7f4a1410f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.840+0000 7f4a1a9e3640 1 --2- 172.21.15.47:0/3999387416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a14109db0 0x7f4a1410a190 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4a08010910 tx=0x7f4a0802e310 comp rx=0 tx=0).stop 2024-07-24T22:12:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.840+0000 7f4a1a9e3640 1 -- 172.21.15.47:0/3999387416 >> 172.21.15.47:0/3999387416 conn(0x7f4a1406db80 msgr2=0x7f4a1406df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.840+0000 7f4a1a9e3640 1 -- 172.21.15.47:0/3999387416 shutdown_connections 2024-07-24T22:12:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.840+0000 7f4a1a9e3640 1 -- 172.21.15.47:0/3999387416 wait complete. 2024-07-24T22:12:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.843+0000 7f4a1a9e3640 1 Processor -- start 2024-07-24T22:12:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.846+0000 7f4a1a9e3640 1 -- start start 2024-07-24T22:12:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.847+0000 7f4a1a9e3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a1410ec00 0x7f4a1419f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.847+0000 7f4a1a9e3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a1410f580 0x7f4a1419f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.847+0000 7f4a1a9e3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a141a4d30 0x7f4a141a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.847+0000 7f4a1a9e3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4a14118cc0 con 0x7f4a141a4d30 2024-07-24T22:12:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.847+0000 7f4a1a9e3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4a14118b40 con 0x7f4a1410ec00 2024-07-24T22:12:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.847+0000 7f4a1a9e3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4a14118e40 con 0x7f4a1410f580 2024-07-24T22:12:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.848+0000 7f4a137fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a1410f580 0x7f4a1419f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.849+0000 7f4a13fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a1410ec00 0x7f4a1419f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.849+0000 7f4a137fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a1410f580 0x7f4a1419f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51884/0 (socket says 172.21.15.47:51884) 2024-07-24T22:12:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.849+0000 7f4a137fe640 1 -- 172.21.15.47:0/1059543029 learned_addr learned my addr 172.21.15.47:0/1059543029 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.856+0000 7f4a137fe640 1 -- 172.21.15.47:0/1059543029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a1410ec00 msgr2=0x7f4a1419f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.856+0000 7f4a137fe640 1 --2- 172.21.15.47:0/1059543029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a1410ec00 0x7f4a1419f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.856+0000 7f4a137fe640 1 -- 172.21.15.47:0/1059543029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a141a4d30 msgr2=0x7f4a141a51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.856+0000 7f4a137fe640 1 --2- 172.21.15.47:0/1059543029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a141a4d30 0x7f4a141a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.856+0000 7f4a137fe640 1 -- 172.21.15.47:0/1059543029 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a141a5910 con 0x7f4a1410f580 2024-07-24T22:12:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.861+0000 7f4a137fe640 1 --2- 172.21.15.47:0/1059543029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a1410f580 0x7f4a1419f9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a040078c0 tx=0x7f4a04007d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.863+0000 7f4a117fa640 1 -- 172.21.15.47:0/1059543029 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400eb20 con 0x7f4a1410f580 2024-07-24T22:12:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.863+0000 7f4a1a9e3640 1 -- 172.21.15.47:0/1059543029 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a141abeb0 con 0x7f4a1410f580 2024-07-24T22:12:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.863+0000 7f4a1a9e3640 1 -- 172.21.15.47:0/1059543029 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a141ac260 con 0x7f4a1410f580 2024-07-24T22:12:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.869+0000 7f4a1d80e740 1 Processor -- start 2024-07-24T22:12:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.871+0000 7f4a117fa640 1 -- 172.21.15.47:0/1059543029 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a0400ecc0 con 0x7f4a1410f580 2024-07-24T22:12:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.873+0000 7f4a117fa640 1 -- 172.21.15.47:0/1059543029 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04013690 con 0x7f4a1410f580 2024-07-24T22:12:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.874+0000 7f4a1d80e740 1 -- start start 2024-07-24T22:12:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.874+0000 7f4a1d80e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc54fe8c0 0x564dc54feca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.874+0000 7f4a1d80e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54ff1e0 0x564dc550ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.874+0000 7f4a1d80e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc550b170 0x564dc550d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.874+0000 7f4a1d80e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564dc5474280 con 0x564dc54ff1e0 2024-07-24T22:12:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.874+0000 7f4a1d80e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564dc5463780 con 0x564dc550b170 2024-07-24T22:12:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.874+0000 7f4a1d80e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564dc54677c0 con 0x564dc54fe8c0 2024-07-24T22:12:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.875+0000 7f4a18f80640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc54fe8c0 0x564dc54feca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.875+0000 7f4a117fa640 1 -- 172.21.15.47:0/1059543029 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f4a04013970 con 0x7f4a1410f580 2024-07-24T22:12:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.877+0000 7f4a13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54ff1e0 0x564dc550ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.877+0000 7f4a13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54ff1e0 0x564dc550ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49748/0 (socket says 172.21.15.47:49748) 2024-07-24T22:12:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.877+0000 7f4a13fff640 1 -- 172.21.15.47:0/1918729170 learned_addr learned my addr 172.21.15.47:0/1918729170 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.877+0000 7f4a137fe640 1 --2- 172.21.15.47:0/1918729170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc550b170 0x564dc550d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.879+0000 7f4a117fa640 1 --2- 172.21.15.47:0/1059543029 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f49fc0b3d70 0x7f49fc0b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.879+0000 7f4a18f80640 1 -- 172.21.15.47:0/1918729170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc550b170 msgr2=0x564dc550d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.879+0000 7f4a18f80640 1 --2- 172.21.15.47:0/1918729170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc550b170 0x564dc550d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.879+0000 7f4a18f80640 1 -- 172.21.15.47:0/1918729170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54ff1e0 msgr2=0x564dc550ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.879+0000 7f4a18f80640 1 --2- 172.21.15.47:0/1918729170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54ff1e0 0x564dc550ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.879+0000 7f4a18f80640 1 -- 172.21.15.47:0/1918729170 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dc51c7790 con 0x564dc54fe8c0 2024-07-24T22:12:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.880+0000 7f4a18f80640 1 --2- 172.21.15.47:0/1059543029 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f49fc0b3d70 0x7f49fc0b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.880+0000 7f4a117fa640 1 -- 172.21.15.47:0/1059543029 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f4a040e47f0 con 0x7f4a1410f580 2024-07-24T22:12:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.880+0000 7f4a18f80640 1 --2- 172.21.15.47:0/1918729170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc54fe8c0 0x564dc54feca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009cc0 tx=0x7f4a0c00e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d98a7a053e7b85b9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.887+0000 7f49fa7fc640 1 -- 172.21.15.47:0/1918729170 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c011470 con 0x564dc54fe8c0 2024-07-24T22:12:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.887+0000 7f49fa7fc640 1 -- 172.21.15.47:0/1918729170 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a0c011ac0 con 0x564dc54fe8c0 2024-07-24T22:12:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.888+0000 7f4a1d80e740 1 -- 172.21.15.47:0/1918729170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc54fe8c0 msgr2=0x564dc54feca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.888+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/1918729170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc54fe8c0 0x564dc54feca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009cc0 tx=0x7f4a0c00e6c0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.892+0000 7f4a1d80e740 1 -- 172.21.15.47:0/1918729170 shutdown_connections 2024-07-24T22:12:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.892+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/1918729170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc550b170 0x564dc550d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.892+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/1918729170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54ff1e0 0x564dc550ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.892+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/1918729170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc54fe8c0 0x564dc54feca0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.892+0000 7f4a1d80e740 1 -- 172.21.15.47:0/1918729170 >> 172.21.15.47:0/1918729170 conn(0x564dc54fc6f0 msgr2=0x564dc54fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.895+0000 7f4a1d80e740 1 -- 172.21.15.47:0/1918729170 shutdown_connections 2024-07-24T22:12:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.895+0000 7f4a1d80e740 1 -- 172.21.15.47:0/1918729170 wait complete. 2024-07-24T22:12:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.896+0000 7f4a1d80e740 1 -- start start 2024-07-24T22:12:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.896+0000 7f4a1d80e740 1 Processor -- start 2024-07-24T22:12:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.898+0000 7f4a1d80e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54fe8c0 0x564dc550a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.898+0000 7f4a1d80e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 0x564dc5507d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.898+0000 7f4a1d80e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc550b170 0x564dc55082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.898+0000 7f4a1d80e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564dc539dab0 con 0x564dc54fe8c0 2024-07-24T22:12:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.898+0000 7f4a1d80e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564dc53eb9e0 con 0x564dc54ff1e0 2024-07-24T22:12:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.898+0000 7f4a1d80e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564dc550dea0 con 0x564dc550b170 2024-07-24T22:12:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.898+0000 7f4a1d80e740 10 client.0 _ll_register_callbacks cb 0x564dc5173a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.900+0000 7f4a13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54fe8c0 0x564dc550a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.900+0000 7f4a13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54fe8c0 0x564dc550a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49750/0 (socket says 172.21.15.47:49750) 2024-07-24T22:12:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.900+0000 7f4a13fff640 1 -- 172.21.15.47:0/315262331 learned_addr learned my addr 172.21.15.47:0/315262331 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.900+0000 7f4a18f80640 1 --2- 172.21.15.47:0/1059543029 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f49fc0b3d70 0x7f49fc0b6230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c01b650 tx=0x7f4a0c00e6c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.900+0000 7f4a18f80640 1 --2- 172.21.15.47:0/315262331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc550b170 0x564dc55082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.901+0000 7f4a137fe640 1 --2- 172.21.15.47:0/315262331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 0x564dc5507d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.902+0000 7f4a18f80640 1 -- 172.21.15.47:0/315262331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 msgr2=0x564dc5507d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.902+0000 7f4a18f80640 1 --2- 172.21.15.47:0/315262331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 0x564dc5507d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.902+0000 7f4a18f80640 1 -- 172.21.15.47:0/315262331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54fe8c0 msgr2=0x564dc550a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.902+0000 7f4a18f80640 1 --2- 172.21.15.47:0/315262331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54fe8c0 0x564dc550a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.902+0000 7f4a18f80640 1 -- 172.21.15.47:0/315262331 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dc5240620 con 0x564dc550b170 2024-07-24T22:12:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.902+0000 7f4a18f80640 1 --2- 172.21.15.47:0/315262331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc550b170 0x564dc55082d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009cc0 tx=0x7f4a0c0095e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=741e5d581a8cc2ca server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.909+0000 7f49f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:12:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.910+0000 7f49f37fe640 1 -- 172.21.15.47:0/315262331 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c034060 con 0x564dc550b170 2024-07-24T22:12:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.913+0000 7f4a1d80e740 1 -- 172.21.15.47:0/315262331 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564dc5412ce0 con 0x564dc550b170 2024-07-24T22:12:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.914+0000 7f49f37fe640 1 -- 172.21.15.47:0/315262331 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f4a0c025430 con 0x564dc550b170 2024-07-24T22:12:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.915+0000 7f49f37fe640 1 -- 172.21.15.47:0/315262331 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4a0c025630 con 0x564dc550b170 2024-07-24T22:12:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.915+0000 7f4a1d80e740 10 client.25945 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.915+0000 7f4a1d80e740 1 -- 172.21.15.47:0/315262331 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564dc5521fa0 con 0x564dc550b170 2024-07-24T22:12:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.916+0000 7f49f37fe640 1 -- 172.21.15.47:0/315262331 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564dc5412ce0 con 0x564dc550b170 2024-07-24T22:12:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.916+0000 7f49f37fe640 1 -- 172.21.15.47:0/315262331 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4a0c00f040 con 0x564dc550b170 2024-07-24T22:12:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.916+0000 7f4a1d80e740 10 client.25945 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.916+0000 7f4a1d80e740 10 client.25945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.916+0000 7f4a1d80e740 20 client.25945 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.916+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/315262331 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564dc5523820 0x564dc5525ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.916+0000 7f4a1d80e740 4 client.25945 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:12:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.916+0000 7f4a1d80e740 1 -- 172.21.15.47:0/315262331 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dc54761d0 con 0x564dc5523820 2024-07-24T22:12:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.918+0000 7f4a13fff640 1 --2- 172.21.15.47:0/315262331 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564dc5523820 0x564dc5525ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:16.924 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:12:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.927+0000 7f4a13fff640 1 --2- 172.21.15.47:0/315262331 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564dc5523820 0x564dc5525ca0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aa79249546827 server_cookie=51583cf02ab1c769 in_seq=0 out_seq=0 2024-07-24T22:12:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.928+0000 7f49f37fe640 10 client.25945 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.930+0000 7f49f37fe640 1 -- 172.21.15.47:0/315262331 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564dc54761d0 con 0x564dc5523820 2024-07-24T22:12:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.930+0000 7f49f37fe640 10 client.25945 handle_command_reply: tid=0 2024-07-24T22:12:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.930+0000 7f4a1d80e740 1 client.25945 shutdown 2024-07-24T22:12:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.930+0000 7f4a1d80e740 1 -- 172.21.15.47:0/315262331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc550b170 msgr2=0x564dc55082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.930+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/315262331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc550b170 0x564dc55082d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009cc0 tx=0x7f4a0c0095e0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.930+0000 7f4a1d80e740 1 -- 172.21.15.47:0/315262331 shutdown_connections 2024-07-24T22:12:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.930+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/315262331 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564dc5523820 0x564dc5525ca0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.930+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/315262331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc550b170 0x564dc55082d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.930+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/315262331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 0x564dc5507d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.930+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/315262331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54fe8c0 0x564dc550a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.930+0000 7f4a1d80e740 1 -- 172.21.15.47:0/315262331 >> 172.21.15.47:0/315262331 conn(0x564dc54fc6f0 msgr2=0x564dc5502290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.930+0000 7f49f37fe640 0 client.25945 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.931+0000 7f4a1d80e740 1 -- 172.21.15.47:0/315262331 shutdown_connections 2024-07-24T22:12:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.931+0000 7f4a1d80e740 1 -- 172.21.15.47:0/315262331 wait complete. 2024-07-24T22:12:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.931+0000 7f4a1d80e740 20 client.25945 trim_cache size 0 max 16384 2024-07-24T22:12:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.987+0000 7f4a1d80e740 1 Processor -- start 2024-07-24T22:12:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.988+0000 7f4a1d80e740 1 -- start start 2024-07-24T22:12:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.988+0000 7f4a1d80e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54fe8c0 0x564dc55065f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.989+0000 7f4a1d80e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 0x564dc5506b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.989+0000 7f4a1d80e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc550b170 0x564dc552b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.989+0000 7f4a1d80e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0000c930 con 0x564dc54fe8c0 2024-07-24T22:12:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.989+0000 7f4a1d80e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0000f1b0 con 0x564dc54ff1e0 2024-07-24T22:12:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.989+0000 7f4a1d80e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0000cfa0 con 0x564dc550b170 2024-07-24T22:12:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.989+0000 7f4a18f80640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc550b170 0x564dc552b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.989+0000 7f4a18f80640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc550b170 0x564dc552b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51910/0 (socket says 172.21.15.47:51910) 2024-07-24T22:12:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.989+0000 7f4a18f80640 1 -- 172.21.15.47:0/3559626557 learned_addr learned my addr 172.21.15.47:0/3559626557 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.989+0000 7f4a137fe640 1 --2- 172.21.15.47:0/3559626557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 0x564dc5506b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.990+0000 7f4a137fe640 1 -- 172.21.15.47:0/3559626557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc550b170 msgr2=0x564dc552b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.990+0000 7f4a137fe640 1 --2- 172.21.15.47:0/3559626557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc550b170 0x564dc552b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.990+0000 7f4a137fe640 1 -- 172.21.15.47:0/3559626557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54fe8c0 msgr2=0x564dc55065f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.990+0000 7f4a137fe640 1 --2- 172.21.15.47:0/3559626557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54fe8c0 0x564dc55065f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.990+0000 7f4a137fe640 1 -- 172.21.15.47:0/3559626557 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dc54ff5c0 con 0x564dc54ff1e0 2024-07-24T22:12:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.991+0000 7f4a137fe640 1 --2- 172.21.15.47:0/3559626557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 0x564dc5506b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4a040e1ee0 tx=0x7f4a040a8360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b1637c132f47fdf server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.997+0000 7f49f9ffb640 1 -- 172.21.15.47:0/3559626557 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a040abb50 con 0x564dc54ff1e0 2024-07-24T22:12:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:16.998+0000 7f49f9ffb640 1 -- 172.21.15.47:0/3559626557 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a040abef0 con 0x564dc54ff1e0 2024-07-24T22:12:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.001+0000 7f4a1d80e740 1 -- 172.21.15.47:0/3559626557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 msgr2=0x564dc5506b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.001+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/3559626557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 0x564dc5506b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4a040e1ee0 tx=0x7f4a040a8360 comp rx=0 tx=0).stop 2024-07-24T22:12:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.004+0000 7f4a1d80e740 1 -- 172.21.15.47:0/3559626557 shutdown_connections 2024-07-24T22:12:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.004+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/3559626557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc550b170 0x564dc552b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.004+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/3559626557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 0x564dc5506b30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.004+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/3559626557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc54fe8c0 0x564dc55065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.004+0000 7f4a1d80e740 1 -- 172.21.15.47:0/3559626557 >> 172.21.15.47:0/3559626557 conn(0x564dc54fc6f0 msgr2=0x564dc5507d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.004+0000 7f4a1d80e740 1 -- 172.21.15.47:0/3559626557 shutdown_connections 2024-07-24T22:12:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.005+0000 7f4a1d80e740 1 -- 172.21.15.47:0/3559626557 wait complete. 2024-07-24T22:12:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.006+0000 7f4a1d80e740 1 -- start start 2024-07-24T22:12:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.006+0000 7f4a1d80e740 1 Processor -- start 2024-07-24T22:12:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.007+0000 7f4a1d80e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc54fe8c0 0x564dc551bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.007+0000 7f4a1d80e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 0x564dc551bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.007+0000 7f4a1d80e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc550b170 0x564dc5516a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.007+0000 7f4a1d80e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0000d670 con 0x564dc550b170 2024-07-24T22:12:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.007+0000 7f4a1d80e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0000eae0 con 0x564dc54ff1e0 2024-07-24T22:12:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.007+0000 7f4a1d80e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0000dd40 con 0x564dc54fe8c0 2024-07-24T22:12:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.007+0000 7f4a1d80e740 10 client.0 _ll_register_callbacks cb 0x7f4a040ea400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.008+0000 7f4a13fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc54fe8c0 0x564dc551bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.008+0000 7f4a13fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc54fe8c0 0x564dc551bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51912/0 (socket says 172.21.15.47:51912) 2024-07-24T22:12:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.008+0000 7f4a13fff640 1 -- 172.21.15.47:0/347681852 learned_addr learned my addr 172.21.15.47:0/347681852 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.010+0000 7f4a18f80640 1 --2- 172.21.15.47:0/347681852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc550b170 0x564dc5516a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.013+0000 7f4a137fe640 1 --2- 172.21.15.47:0/347681852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 0x564dc551bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.014+0000 7f4a13fff640 1 -- 172.21.15.47:0/347681852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 msgr2=0x564dc551bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.014+0000 7f4a13fff640 1 --2- 172.21.15.47:0/347681852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 0x564dc551bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.014+0000 7f4a13fff640 1 -- 172.21.15.47:0/347681852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc550b170 msgr2=0x564dc5516a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.014+0000 7f4a13fff640 1 --2- 172.21.15.47:0/347681852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc550b170 0x564dc5516a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.014+0000 7f4a13fff640 1 -- 172.21.15.47:0/347681852 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dc5517050 con 0x564dc54fe8c0 2024-07-24T22:12:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.021+0000 7f4a13fff640 1 --2- 172.21.15.47:0/347681852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc54fe8c0 0x564dc551bab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4a08039040 tx=0x7f4a08005b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85041b378d42fd server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.022+0000 7f49f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:12:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.025+0000 7f49f37fe640 1 -- 172.21.15.47:0/347681852 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0803b040 con 0x564dc54fe8c0 2024-07-24T22:12:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.026+0000 7f4a1d80e740 1 -- 172.21.15.47:0/347681852 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a040abef0 con 0x564dc54fe8c0 2024-07-24T22:12:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.026+0000 7f49f37fe640 1 -- 172.21.15.47:0/347681852 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f4a08004040 con 0x564dc54fe8c0 2024-07-24T22:12:17.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.027+0000 7f49f37fe640 1 -- 172.21.15.47:0/347681852 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4a08052050 con 0x564dc54fe8c0 2024-07-24T22:12:17.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.028+0000 7f4a1d80e740 10 client.25951 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:17.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.028+0000 7f4a1d80e740 1 -- 172.21.15.47:0/347681852 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564dc558ce20 con 0x564dc54fe8c0 2024-07-24T22:12:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.030+0000 7f49f37fe640 1 -- 172.21.15.47:0/347681852 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a040abef0 con 0x564dc54fe8c0 2024-07-24T22:12:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.030+0000 7f49f37fe640 1 -- 172.21.15.47:0/347681852 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4a080047d0 con 0x564dc54fe8c0 2024-07-24T22:12:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.030+0000 7f4a1d80e740 10 client.25951 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.030+0000 7f4a1d80e740 10 client.25951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.030+0000 7f4a1d80e740 20 client.25951 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.030+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/347681852 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564dc558d5f0 0x564dc558fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.030+0000 7f4a1d80e740 4 client.25951 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:12:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.030+0000 7f4a1d80e740 1 -- 172.21.15.47:0/347681852 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564dc5471c70 con 0x564dc558d5f0 2024-07-24T22:12:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.033+0000 7f4a137fe640 1 --2- 172.21.15.47:0/347681852 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564dc558d5f0 0x564dc558fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.036+0000 7f4a137fe640 1 --2- 172.21.15.47:0/347681852 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564dc558d5f0 0x564dc558fa10 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a15113141e357271 server_cookie=cb3328d0eab02056 in_seq=0 out_seq=0 2024-07-24T22:12:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:17.036+0000 7f49f37fe640 10 client.25951 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:17.459 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:12:17.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:17 smithi047 ceph-mon[32551]: pgmap v518: 97 pgs: 97 active+clean; 42 GiB data, 128 GiB used, 945 GiB / 1.0 TiB avail; 939 KiB/s rd, 441 MiB/s wr, 1.01k op/s 2024-07-24T22:12:17.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:17 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:12:18.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:17 smithi188 ceph-mon[37380]: pgmap v518: 97 pgs: 97 active+clean; 42 GiB data, 128 GiB used, 945 GiB / 1.0 TiB avail; 939 KiB/s rd, 441 MiB/s wr, 1.01k op/s 2024-07-24T22:12:18.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:17 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:12:18.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:17 smithi183 ceph-mon[37007]: pgmap v518: 97 pgs: 97 active+clean; 42 GiB data, 128 GiB used, 945 GiB / 1.0 TiB avail; 939 KiB/s rd, 441 MiB/s wr, 1.01k op/s 2024-07-24T22:12:18.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:17 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:12:18.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:12:18.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:12:18.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:12:18.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:12:18.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:12:18.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:12:18.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:12:19.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:12:19.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:12:19.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:12:19.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:12:19.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:12:19.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:12:19.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:12:19.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:12:19.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:12:19.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:12:19.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:12:19.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:12:19.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:12:19.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:12:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.622+0000 7fb747f47640 1 -- 172.21.15.47:0/574000832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb740107060 msgr2=0x7fb7401074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.622+0000 7fb747f47640 1 --2- 172.21.15.47:0/574000832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb740107060 0x7fb7401074a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb730009900 tx=0x7fb73002a410 comp rx=0 tx=0).stop 2024-07-24T22:12:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.622+0000 7fb747f47640 1 -- 172.21.15.47:0/574000832 shutdown_connections 2024-07-24T22:12:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.622+0000 7fb747f47640 1 --2- 172.21.15.47:0/574000832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7401079e0 0x7fb74010e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.622+0000 7fb747f47640 1 --2- 172.21.15.47:0/574000832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb740107060 0x7fb7401074a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.622+0000 7fb747f47640 1 --2- 172.21.15.47:0/574000832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740101650 0x7fb740101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.622+0000 7fb747f47640 1 -- 172.21.15.47:0/574000832 >> 172.21.15.47:0/574000832 conn(0x7fb7400fd0c0 msgr2=0x7fb7400ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:19.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.622+0000 7fb747f47640 1 -- 172.21.15.47:0/574000832 shutdown_connections 2024-07-24T22:12:19.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.622+0000 7fb747f47640 1 -- 172.21.15.47:0/574000832 wait complete. 2024-07-24T22:12:19.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.623+0000 7fb747f47640 1 Processor -- start 2024-07-24T22:12:19.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.623+0000 7fb747f47640 1 -- start start 2024-07-24T22:12:19.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.623+0000 7fb747f47640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740101650 0x7fb740198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.623+0000 7fb747f47640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb740107060 0x7fb7401991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.623+0000 7fb747f47640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7401079e0 0x7fb74019e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.623+0000 7fb747f47640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb740111660 con 0x7fb740101650 2024-07-24T22:12:19.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.623+0000 7fb747f47640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401114e0 con 0x7fb7401079e0 2024-07-24T22:12:19.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.623+0000 7fb747f47640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401117e0 con 0x7fb740107060 2024-07-24T22:12:19.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.623+0000 7fb745ce3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740101650 0x7fb740198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.623+0000 7fb7454e2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb740107060 0x7fb7401991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.623+0000 7fb7454e2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb740107060 0x7fb7401991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51936/0 (socket says 172.21.15.47:51936) 2024-07-24T22:12:19.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.624+0000 7fb7454e2640 1 -- 172.21.15.47:0/2297689842 learned_addr learned my addr 172.21.15.47:0/2297689842 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:19.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.624+0000 7fb7464e4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7401079e0 0x7fb74019e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.624+0000 7fb745ce3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740101650 0x7fb740198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49768/0 (socket says 172.21.15.47:49768) 2024-07-24T22:12:19.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.624+0000 7fb7464e4640 1 -- 172.21.15.47:0/2297689842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb740107060 msgr2=0x7fb7401991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:19.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.624+0000 7fb7464e4640 1 --2- 172.21.15.47:0/2297689842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb740107060 0x7fb7401991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.624+0000 7fb7464e4640 1 -- 172.21.15.47:0/2297689842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740101650 msgr2=0x7fb740198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.624+0000 7fb7464e4640 1 --2- 172.21.15.47:0/2297689842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740101650 0x7fb740198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.624+0000 7fb7464e4640 1 -- 172.21.15.47:0/2297689842 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74019ed50 con 0x7fb7401079e0 2024-07-24T22:12:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.624+0000 7fb7454e2640 1 --2- 172.21.15.47:0/2297689842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb740107060 0x7fb7401991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.624+0000 7fb7464e4640 1 --2- 172.21.15.47:0/2297689842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7401079e0 0x7fb74019e580 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb738009fd0 tx=0x7fb73800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.624+0000 7fb736ffd640 1 -- 172.21.15.47:0/2297689842 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73800ce20 con 0x7fb7401079e0 2024-07-24T22:12:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.625+0000 7fb736ffd640 1 -- 172.21.15.47:0/2297689842 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb738005020 con 0x7fb7401079e0 2024-07-24T22:12:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.625+0000 7fb747f47640 1 -- 172.21.15.47:0/2297689842 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74019f040 con 0x7fb7401079e0 2024-07-24T22:12:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.625+0000 7fb736ffd640 1 -- 172.21.15.47:0/2297689842 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738010690 con 0x7fb7401079e0 2024-07-24T22:12:19.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.625+0000 7fb747f47640 1 -- 172.21.15.47:0/2297689842 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7400fd4a0 con 0x7fb7401079e0 2024-07-24T22:12:19.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.628+0000 7fb74a2f8740 1 Processor -- start 2024-07-24T22:12:19.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.629+0000 7fb736ffd640 1 -- 172.21.15.47:0/2297689842 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fb7380054d0 con 0x7fb7401079e0 2024-07-24T22:12:19.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.629+0000 7fb74a2f8740 1 -- start start 2024-07-24T22:12:19.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb74a2f8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5464256d0 0x55b546425ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb74a2f8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 0x55b546431a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb74a2f8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b546431f80 0x55b546434370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb74a2f8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b54639c9b0 con 0x55b5464256d0 2024-07-24T22:12:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb74a2f8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b54638beb0 con 0x55b546431f80 2024-07-24T22:12:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb74a2f8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b54638fef0 con 0x55b546425ff0 2024-07-24T22:12:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb745ce3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 0x55b546431a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb745ce3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 0x55b546431a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51950/0 (socket says 172.21.15.47:51950) 2024-07-24T22:12:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb7454e2640 1 --2- 172.21.15.47:0/3257172902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b546431f80 0x55b546434370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb745ce3640 1 -- 172.21.15.47:0/3257172902 learned_addr learned my addr 172.21.15.47:0/3257172902 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:19.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb7454e2640 1 --2- 172.21.15.47:0/3257172902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5464256d0 0x55b546425ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb745ce3640 1 -- 172.21.15.47:0/3257172902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b546431f80 msgr2=0x55b546434370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb745ce3640 1 --2- 172.21.15.47:0/3257172902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b546431f80 0x55b546434370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb745ce3640 1 -- 172.21.15.47:0/3257172902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5464256d0 msgr2=0x55b546425ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb745ce3640 1 --2- 172.21.15.47:0/3257172902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5464256d0 0x55b546425ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb745ce3640 1 -- 172.21.15.47:0/3257172902 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b546315320 con 0x55b546425ff0 2024-07-24T22:12:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.630+0000 7fb7454e2640 1 --2- 172.21.15.47:0/3257172902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5464256d0 0x55b546425ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:12:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.631+0000 7fb736ffd640 1 --2- 172.21.15.47:0/2297689842 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb72c0b3d40 0x7fb72c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.631+0000 7fb745ce3640 1 --2- 172.21.15.47:0/3257172902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 0x55b546431a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009cf0 tx=0x7fb73c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d221cd9e0a251bd server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:19.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.631+0000 7fb7454e2640 1 --2- 172.21.15.47:0/2297689842 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb72c0b3d40 0x7fb72c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.631+0000 7fb736ffd640 1 -- 172.21.15.47:0/2297689842 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb7380e4650 con 0x7fb7401079e0 2024-07-24T22:12:19.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.631+0000 7fb72bfff640 1 -- 172.21.15.47:0/3257172902 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c01e070 con 0x55b546425ff0 2024-07-24T22:12:19.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.631+0000 7fb72bfff640 1 -- 172.21.15.47:0/3257172902 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb73c019ae0 con 0x55b546425ff0 2024-07-24T22:12:19.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.631+0000 7fb72bfff640 1 -- 172.21.15.47:0/3257172902 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00e9e0 con 0x55b546425ff0 2024-07-24T22:12:19.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.632+0000 7fb7454e2640 1 --2- 172.21.15.47:0/2297689842 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb72c0b3d40 0x7fb72c0b6200 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb740105d10 tx=0x7fb730005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.632+0000 7fb74a2f8740 1 -- 172.21.15.47:0/3257172902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 msgr2=0x55b546431a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.632+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/3257172902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 0x55b546431a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009cf0 tx=0x7fb73c011810 comp rx=0 tx=0).stop 2024-07-24T22:12:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.632+0000 7fb74a2f8740 1 -- 172.21.15.47:0/3257172902 shutdown_connections 2024-07-24T22:12:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.632+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/3257172902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b546431f80 0x55b546434370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.632+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/3257172902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 0x55b546431a40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.632+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/3257172902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b5464256d0 0x55b546425ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.632+0000 7fb74a2f8740 1 -- 172.21.15.47:0/3257172902 >> 172.21.15.47:0/3257172902 conn(0x55b546423500 msgr2=0x55b5464246a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.632+0000 7fb74a2f8740 1 -- 172.21.15.47:0/3257172902 shutdown_connections 2024-07-24T22:12:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.633+0000 7fb74a2f8740 1 -- 172.21.15.47:0/3257172902 wait complete. 2024-07-24T22:12:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.633+0000 7fb74a2f8740 1 -- start start 2024-07-24T22:12:19.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.633+0000 7fb74a2f8740 1 Processor -- start 2024-07-24T22:12:19.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb74a2f8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b54642eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb74a2f8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 0x55b54642f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb74a2f8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546431f80 0x55b54642f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb74a2f8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b5461ef700 con 0x55b546431f80 2024-07-24T22:12:19.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb74a2f8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b54632e5f0 con 0x55b5464256d0 2024-07-24T22:12:19.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb74a2f8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b546434ca0 con 0x55b546425ff0 2024-07-24T22:12:19.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb74a2f8740 10 client.0 _ll_register_callbacks cb 0x55b54634e960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:19.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb7454e2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 0x55b54642f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb745ce3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b54642eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb7454e2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 0x55b54642f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51956/0 (socket says 172.21.15.47:51956) 2024-07-24T22:12:19.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb7454e2640 1 -- 172.21.15.47:0/3824259572 learned_addr learned my addr 172.21.15.47:0/3824259572 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:19.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb7454e2640 1 -- 172.21.15.47:0/3824259572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 msgr2=0x55b54642eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:19.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb7454e2640 1 --2- 172.21.15.47:0/3824259572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b54642eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb7454e2640 1 -- 172.21.15.47:0/3824259572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546431f80 msgr2=0x55b54642f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:19.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb7454e2640 1 --2- 172.21.15.47:0/3824259572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546431f80 0x55b54642f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.634+0000 7fb7454e2640 1 -- 172.21.15.47:0/3824259572 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b546321680 con 0x55b546425ff0 2024-07-24T22:12:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.635+0000 7fb7454e2640 1 --2- 172.21.15.47:0/3824259572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 0x55b54642f410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb730006010 tx=0x7fb730009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a688fd323d53791 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.635+0000 7fb7297fa640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:12:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.635+0000 7fb7297fa640 1 -- 172.21.15.47:0/3824259572 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7300318b0 con 0x55b546425ff0 2024-07-24T22:12:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.635+0000 7fb7297fa640 1 -- 172.21.15.47:0/3824259572 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb730031a50 con 0x55b546425ff0 2024-07-24T22:12:19.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.635+0000 7fb74a2f8740 1 -- 172.21.15.47:0/3824259572 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb73c019ae0 con 0x55b546425ff0 2024-07-24T22:12:19.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.635+0000 7fb7297fa640 1 -- 172.21.15.47:0/3824259572 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb730031c50 con 0x55b546425ff0 2024-07-24T22:12:19.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.635+0000 7fb74a2f8740 10 client.25963 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:19.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.635+0000 7fb74a2f8740 1 -- 172.21.15.47:0/3824259572 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b5460ec650 con 0x55b546425ff0 2024-07-24T22:12:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.636+0000 7fb7297fa640 1 -- 172.21.15.47:0/3824259572 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb73c019ae0 con 0x55b546425ff0 2024-07-24T22:12:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.636+0000 7fb7297fa640 1 -- 172.21.15.47:0/3824259572 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb730044030 con 0x55b546425ff0 2024-07-24T22:12:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.636+0000 7fb74a2f8740 10 client.25963 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.636+0000 7fb74a2f8740 10 client.25963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.636+0000 7fb74a2f8740 20 client.25963 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:19.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.636+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/3824259572 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b546441cf0 0x55b5464440e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.636+0000 7fb74a2f8740 4 client.25963 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:12:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.636+0000 7fb74a2f8740 1 -- 172.21.15.47:0/3824259572 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b54639e900 con 0x55b546441cf0 2024-07-24T22:12:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.636+0000 7fb745ce3640 1 --2- 172.21.15.47:0/3824259572 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b546441cf0 0x55b5464440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.637+0000 7fb7297fa640 10 client.25963 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.637+0000 7fb745ce3640 1 --2- 172.21.15.47:0/3824259572 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b546441cf0 0x55b5464440e0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac03f637c04973 server_cookie=2e8e995a6db256b7 in_seq=0 out_seq=0 2024-07-24T22:12:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb7297fa640 1 -- 172.21.15.47:0/3824259572 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b54639e900 con 0x55b546441cf0 2024-07-24T22:12:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb7297fa640 10 client.25963 handle_command_reply: tid=0 2024-07-24T22:12:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb74a2f8740 1 client.25963 shutdown 2024-07-24T22:12:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb74a2f8740 1 -- 172.21.15.47:0/3824259572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 msgr2=0x55b54642f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/3824259572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 0x55b54642f410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb730006010 tx=0x7fb730009560 comp rx=0 tx=0).stop 2024-07-24T22:12:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb74a2f8740 1 -- 172.21.15.47:0/3824259572 shutdown_connections 2024-07-24T22:12:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/3824259572 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b546441cf0 0x55b5464440e0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/3824259572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546431f80 0x55b54642f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/3824259572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546425ff0 0x55b54642f410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/3824259572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b54642eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb74a2f8740 1 -- 172.21.15.47:0/3824259572 >> 172.21.15.47:0/3824259572 conn(0x55b546423500 msgr2=0x55b5464290a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:19.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb7297fa640 0 client.25963 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:19.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb74a2f8740 1 -- 172.21.15.47:0/3824259572 shutdown_connections 2024-07-24T22:12:19.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb74a2f8740 1 -- 172.21.15.47:0/3824259572 wait complete. 2024-07-24T22:12:19.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.638+0000 7fb74a2f8740 20 client.25963 trim_cache size 0 max 16384 2024-07-24T22:12:19.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.671+0000 7fb74a2f8740 1 Processor -- start 2024-07-24T22:12:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.671+0000 7fb74a2f8740 1 -- start start 2024-07-24T22:12:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.671+0000 7fb74a2f8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b546430c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.671+0000 7fb74a2f8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546425ff0 0x55b5464497d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.671+0000 7fb74a2f8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546431f80 0x55b546449d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb74a2f8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401ae3c0 con 0x55b546425ff0 2024-07-24T22:12:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb74a2f8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401b0c40 con 0x55b5464256d0 2024-07-24T22:12:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb74a2f8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401aea30 con 0x55b546431f80 2024-07-24T22:12:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb745ce3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b546430c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb745ce3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b546430c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:40846/0 (socket says 172.21.15.47:40846) 2024-07-24T22:12:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb745ce3640 1 -- 172.21.15.47:0/708618262 learned_addr learned my addr 172.21.15.47:0/708618262 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb7454e2640 1 --2- 172.21.15.47:0/708618262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546425ff0 0x55b5464497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb7464e4640 1 --2- 172.21.15.47:0/708618262 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546431f80 0x55b546449d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb745ce3640 1 -- 172.21.15.47:0/708618262 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546431f80 msgr2=0x55b546449d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb745ce3640 1 --2- 172.21.15.47:0/708618262 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546431f80 0x55b546449d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb745ce3640 1 -- 172.21.15.47:0/708618262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546425ff0 msgr2=0x55b5464497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb745ce3640 1 --2- 172.21.15.47:0/708618262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546425ff0 0x55b5464497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb745ce3640 1 -- 172.21.15.47:0/708618262 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b54641ee90 con 0x55b5464256d0 2024-07-24T22:12:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb7464e4640 1 --2- 172.21.15.47:0/708618262 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546431f80 0x55b546449d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:12:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.672+0000 7fb745ce3640 1 --2- 172.21.15.47:0/708618262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b546430c10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0097e0 tx=0x7fb73c00e540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fafaba76d9ea6a9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.673+0000 7fb72b7fe640 1 -- 172.21.15.47:0/708618262 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c01e040 con 0x55b5464256d0 2024-07-24T22:12:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.673+0000 7fb72b7fe640 1 -- 172.21.15.47:0/708618262 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb73c01f040 con 0x55b5464256d0 2024-07-24T22:12:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.673+0000 7fb72b7fe640 1 -- 172.21.15.47:0/708618262 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00ee30 con 0x55b5464256d0 2024-07-24T22:12:19.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.673+0000 7fb74a2f8740 1 -- 172.21.15.47:0/708618262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 msgr2=0x55b546430c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:19.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.673+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/708618262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b546430c10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0097e0 tx=0x7fb73c00e540 comp rx=0 tx=0).stop 2024-07-24T22:12:19.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.674+0000 7fb74a2f8740 1 -- 172.21.15.47:0/708618262 shutdown_connections 2024-07-24T22:12:19.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.674+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/708618262 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546431f80 0x55b546449d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.674+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/708618262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546425ff0 0x55b5464497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.674+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/708618262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b546430c10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.674+0000 7fb74a2f8740 1 -- 172.21.15.47:0/708618262 >> 172.21.15.47:0/708618262 conn(0x55b546423500 msgr2=0x55b546430500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.674+0000 7fb74a2f8740 1 -- 172.21.15.47:0/708618262 shutdown_connections 2024-07-24T22:12:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.674+0000 7fb74a2f8740 1 -- 172.21.15.47:0/708618262 wait complete. 2024-07-24T22:12:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.674+0000 7fb74a2f8740 1 -- start start 2024-07-24T22:12:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.674+0000 7fb74a2f8740 1 Processor -- start 2024-07-24T22:12:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb74a2f8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b5464358a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb74a2f8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546425ff0 0x55b546435e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb74a2f8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546431f80 0x55b546439d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb74a2f8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401af100 con 0x55b546425ff0 2024-07-24T22:12:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb74a2f8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401b0570 con 0x55b5464256d0 2024-07-24T22:12:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb74a2f8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401af7d0 con 0x55b546431f80 2024-07-24T22:12:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb74a2f8740 10 client.0 _ll_register_callbacks cb 0x7fb730009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb7454e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546425ff0 0x55b546435e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb745ce3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b5464358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb745ce3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b5464358a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:40856/0 (socket says 172.21.15.47:40856) 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb7454e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546425ff0 0x55b546435e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49818/0 (socket says 172.21.15.47:49818) 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb745ce3640 1 -- 172.21.15.47:0/2494767287 learned_addr learned my addr 172.21.15.47:0/2494767287 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb7464e4640 1 --2- 172.21.15.47:0/2494767287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546431f80 0x55b546439d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb745ce3640 1 -- 172.21.15.47:0/2494767287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546431f80 msgr2=0x55b546439d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb745ce3640 1 --2- 172.21.15.47:0/2494767287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546431f80 0x55b546439d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb745ce3640 1 -- 172.21.15.47:0/2494767287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546425ff0 msgr2=0x55b546435e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb745ce3640 1 --2- 172.21.15.47:0/2494767287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546425ff0 0x55b546435e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.675+0000 7fb745ce3640 1 -- 172.21.15.47:0/2494767287 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b54643a4d0 con 0x55b5464256d0 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.676+0000 7fb745ce3640 1 --2- 172.21.15.47:0/2494767287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b5464358a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00e4d0 tx=0x7fb73c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42ca6fd665c020f7 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.676+0000 7fb7297fa640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.676+0000 7fb7297fa640 1 -- 172.21.15.47:0/2494767287 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c01e050 con 0x55b5464256d0 2024-07-24T22:12:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.676+0000 7fb7297fa640 1 -- 172.21.15.47:0/2494767287 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb73c005450 con 0x55b5464256d0 2024-07-24T22:12:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.676+0000 7fb74a2f8740 1 -- 172.21.15.47:0/2494767287 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb73c01f040 con 0x55b5464256d0 2024-07-24T22:12:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.676+0000 7fb7297fa640 1 -- 172.21.15.47:0/2494767287 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb73c005650 con 0x55b5464256d0 2024-07-24T22:12:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.676+0000 7fb74a2f8740 10 client.25922 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.676+0000 7fb74a2f8740 1 -- 172.21.15.47:0/2494767287 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b5464ac390 con 0x55b5464256d0 2024-07-24T22:12:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.677+0000 7fb7297fa640 1 -- 172.21.15.47:0/2494767287 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb73c01f040 con 0x55b5464256d0 2024-07-24T22:12:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.677+0000 7fb7297fa640 1 -- 172.21.15.47:0/2494767287 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb73c00e8d0 con 0x55b5464256d0 2024-07-24T22:12:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.677+0000 7fb74a2f8740 10 client.25922 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.677+0000 7fb74a2f8740 10 client.25922 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.677+0000 7fb74a2f8740 20 client.25922 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.677+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/2494767287 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b5464ac870 0x55b5464aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.677+0000 7fb74a2f8740 4 client.25922 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:12:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.677+0000 7fb74a2f8740 1 -- 172.21.15.47:0/2494767287 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b54639a3a0 con 0x55b5464ac870 2024-07-24T22:12:19.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.677+0000 7fb7454e2640 1 --2- 172.21.15.47:0/2494767287 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b5464ac870 0x55b5464aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.677+0000 7fb7297fa640 10 client.25922 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.677+0000 7fb7454e2640 1 --2- 172.21.15.47:0/2494767287 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b5464ac870 0x55b5464aec90 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7beba6856887770 server_cookie=597fba4f3b43ebe2 in_seq=0 out_seq=0 2024-07-24T22:12:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb7297fa640 1 -- 172.21.15.47:0/2494767287 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b54639a3a0 con 0x55b5464ac870 2024-07-24T22:12:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb7297fa640 10 client.25922 handle_command_reply: tid=0 2024-07-24T22:12:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb74a2f8740 1 client.25922 shutdown 2024-07-24T22:12:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb74a2f8740 1 -- 172.21.15.47:0/2494767287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 msgr2=0x55b5464358a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/2494767287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b5464358a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00e4d0 tx=0x7fb73c005fd0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb74a2f8740 1 -- 172.21.15.47:0/2494767287 shutdown_connections 2024-07-24T22:12:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/2494767287 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b5464ac870 0x55b5464aec90 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/2494767287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b546431f80 0x55b546439d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/2494767287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b546425ff0 0x55b546435e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb7297fa640 0 client.25922 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:19.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb74a2f8740 1 --2- 172.21.15.47:0/2494767287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b5464256d0 0x55b5464358a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb74a2f8740 1 -- 172.21.15.47:0/2494767287 >> 172.21.15.47:0/2494767287 conn(0x55b546423500 msgr2=0x55b546430d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:19.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb74a2f8740 1 -- 172.21.15.47:0/2494767287 shutdown_connections 2024-07-24T22:12:19.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb74a2f8740 1 -- 172.21.15.47:0/2494767287 wait complete. 2024-07-24T22:12:19.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.678+0000 7fb74a2f8740 20 client.25922 trim_cache size 0 max 16384 2024-07-24T22:12:19.685 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:12:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.679+0000 7fb747f47640 1 -- 172.21.15.47:0/2297689842 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb72c0b3d40 msgr2=0x7fb72c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.679+0000 7fb747f47640 1 --2- 172.21.15.47:0/2297689842 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb72c0b3d40 0x7fb72c0b6200 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb740105d10 tx=0x7fb730005a20 comp rx=0 tx=0).stop 2024-07-24T22:12:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.679+0000 7fb747f47640 1 -- 172.21.15.47:0/2297689842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7401079e0 msgr2=0x7fb74019e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.679+0000 7fb747f47640 1 --2- 172.21.15.47:0/2297689842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7401079e0 0x7fb74019e580 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb738009fd0 tx=0x7fb73800ef10 comp rx=0 tx=0).stop 2024-07-24T22:12:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.679+0000 7fb747f47640 1 -- 172.21.15.47:0/2297689842 shutdown_connections 2024-07-24T22:12:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.679+0000 7fb747f47640 1 --2- 172.21.15.47:0/2297689842 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb72c0b3d40 0x7fb72c0b6200 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.679+0000 7fb747f47640 1 --2- 172.21.15.47:0/2297689842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7401079e0 0x7fb74019e580 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.679+0000 7fb747f47640 1 --2- 172.21.15.47:0/2297689842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb740107060 0x7fb7401991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.679+0000 7fb747f47640 1 --2- 172.21.15.47:0/2297689842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740101650 0x7fb740198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:19.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.679+0000 7fb747f47640 1 -- 172.21.15.47:0/2297689842 >> 172.21.15.47:0/2297689842 conn(0x7fb7400fd0c0 msgr2=0x7fb740104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:19.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.680+0000 7fb747f47640 1 -- 172.21.15.47:0/2297689842 shutdown_connections 2024-07-24T22:12:19.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:19.680+0000 7fb747f47640 1 -- 172.21.15.47:0/2297689842 wait complete. 2024-07-24T22:12:20.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:19 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi047 to 177.1M 2024-07-24T22:12:20.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:19 smithi188 ceph-mon[37380]: Unable to set osd_memory_target on smithi047 to 185705676: error parsing value: Value '185705676' is below minimum 939524096 2024-07-24T22:12:20.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:19 smithi188 ceph-mon[37380]: pgmap v519: 97 pgs: 97 active+clean; 43 GiB data, 132 GiB used, 941 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 553 MiB/s wr, 1.80k op/s 2024-07-24T22:12:20.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:19 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi047 to 177.1M 2024-07-24T22:12:20.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:19 smithi183 ceph-mon[37007]: Unable to set osd_memory_target on smithi047 to 185705676: error parsing value: Value '185705676' is below minimum 939524096 2024-07-24T22:12:20.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:19 smithi183 ceph-mon[37007]: pgmap v519: 97 pgs: 97 active+clean; 43 GiB data, 132 GiB used, 941 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 553 MiB/s wr, 1.80k op/s 2024-07-24T22:12:20.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:19 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi047 to 177.1M 2024-07-24T22:12:20.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:19 smithi047 ceph-mon[32551]: Unable to set osd_memory_target on smithi047 to 185705676: error parsing value: Value '185705676' is below minimum 939524096 2024-07-24T22:12:20.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:19 smithi047 ceph-mon[32551]: pgmap v519: 97 pgs: 97 active+clean; 43 GiB data, 132 GiB used, 941 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 553 MiB/s wr, 1.80k op/s 2024-07-24T22:12:21.882 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:12:21.883 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:12:22.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:21 smithi188 ceph-mon[37380]: pgmap v520: 97 pgs: 97 active+clean; 43 GiB data, 133 GiB used, 940 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 557 MiB/s wr, 2.29k op/s 2024-07-24T22:12:22.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:21 smithi183 ceph-mon[37007]: pgmap v520: 97 pgs: 97 active+clean; 43 GiB data, 133 GiB used, 940 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 557 MiB/s wr, 2.29k op/s 2024-07-24T22:12:22.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:21 smithi047 ceph-mon[32551]: pgmap v520: 97 pgs: 97 active+clean; 43 GiB data, 133 GiB used, 940 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 557 MiB/s wr, 2.29k op/s 2024-07-24T22:12:22.439 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:12:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.634+0000 7f49f37fe640 1 -- 172.21.15.47:0/347681852 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564dc5471c70 con 0x564dc558d5f0 2024-07-24T22:12:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.634+0000 7f49f37fe640 10 client.25951 handle_command_reply: tid=0 2024-07-24T22:12:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.634+0000 7f4a1d80e740 1 client.25951 shutdown 2024-07-24T22:12:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.636+0000 7f4a1d80e740 1 -- 172.21.15.47:0/347681852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc54fe8c0 msgr2=0x564dc551bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.636+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/347681852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc54fe8c0 0x564dc551bab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4a08039040 tx=0x7f4a08005b20 comp rx=0 tx=0).stop 2024-07-24T22:12:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.637+0000 7f4a1d80e740 1 -- 172.21.15.47:0/347681852 shutdown_connections 2024-07-24T22:12:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.637+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/347681852 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564dc558d5f0 0x564dc558fa10 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.637+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/347681852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564dc550b170 0x564dc5516a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.637+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/347681852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564dc54ff1e0 0x564dc551bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.637+0000 7f4a1d80e740 1 --2- 172.21.15.47:0/347681852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564dc54fe8c0 0x564dc551bab0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.637+0000 7f4a1d80e740 1 -- 172.21.15.47:0/347681852 >> 172.21.15.47:0/347681852 conn(0x564dc54fc6f0 msgr2=0x564dc5506480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.637+0000 7f49f37fe640 0 client.25951 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.638+0000 7f4a1d80e740 1 -- 172.21.15.47:0/347681852 shutdown_connections 2024-07-24T22:12:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.639+0000 7f4a1d80e740 1 -- 172.21.15.47:0/347681852 wait complete. 2024-07-24T22:12:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.639+0000 7f4a1d80e740 20 client.25951 trim_cache size 0 max 16384 2024-07-24T22:12:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:12:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:12:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:12:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:12:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.640+0000 7f4a1a9e3640 1 -- 172.21.15.47:0/1059543029 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f49fc0b3d70 msgr2=0x7f49fc0b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.640+0000 7f4a1a9e3640 1 --2- 172.21.15.47:0/1059543029 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f49fc0b3d70 0x7f49fc0b6230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c01b650 tx=0x7f4a0c00e6c0 comp rx=0 tx=0).stop 2024-07-24T22:12:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.640+0000 7f4a1a9e3640 1 -- 172.21.15.47:0/1059543029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a1410f580 msgr2=0x7f4a1419f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.640+0000 7f4a1a9e3640 1 --2- 172.21.15.47:0/1059543029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a1410f580 0x7f4a1419f9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a040078c0 tx=0x7f4a04007d80 comp rx=0 tx=0).stop 2024-07-24T22:12:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.640+0000 7f4a1a9e3640 1 -- 172.21.15.47:0/1059543029 shutdown_connections 2024-07-24T22:12:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.640+0000 7f4a1a9e3640 1 --2- 172.21.15.47:0/1059543029 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f49fc0b3d70 0x7f49fc0b6230 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.640+0000 7f4a1a9e3640 1 --2- 172.21.15.47:0/1059543029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a141a4d30 0x7f4a141a51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.640+0000 7f4a1a9e3640 1 --2- 172.21.15.47:0/1059543029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a1410f580 0x7f4a1419f9a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.640+0000 7f4a1a9e3640 1 --2- 172.21.15.47:0/1059543029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a1410ec00 0x7f4a1419f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.640+0000 7f4a1a9e3640 1 -- 172.21.15.47:0/1059543029 >> 172.21.15.47:0/1059543029 conn(0x7f4a1406db80 msgr2=0x7f4a14073160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.640+0000 7f4a1a9e3640 1 -- 172.21.15.47:0/1059543029 shutdown_connections 2024-07-24T22:12:22.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:22.640+0000 7f4a1a9e3640 1 -- 172.21.15.47:0/1059543029 wait complete. 2024-07-24T22:12:24.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:23 smithi183 ceph-mon[37007]: pgmap v521: 97 pgs: 97 active+clean; 43 GiB data, 132 GiB used, 941 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 521 MiB/s wr, 2.46k op/s 2024-07-24T22:12:24.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:23 smithi047 ceph-mon[32551]: pgmap v521: 97 pgs: 97 active+clean; 43 GiB data, 132 GiB used, 941 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 521 MiB/s wr, 2.46k op/s 2024-07-24T22:12:24.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:23 smithi188 ceph-mon[37380]: pgmap v521: 97 pgs: 97 active+clean; 43 GiB data, 132 GiB used, 941 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 521 MiB/s wr, 2.46k op/s 2024-07-24T22:12:25.242 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:24 smithi047 ceph-mon[32551]: pgmap v522: 97 pgs: 97 active+clean; 43 GiB data, 132 GiB used, 941 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 540 MiB/s wr, 2.48k op/s 2024-07-24T22:12:25.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:24 smithi188 ceph-mon[37380]: pgmap v522: 97 pgs: 97 active+clean; 43 GiB data, 132 GiB used, 941 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 540 MiB/s wr, 2.48k op/s 2024-07-24T22:12:25.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:24 smithi183 ceph-mon[37007]: pgmap v522: 97 pgs: 97 active+clean; 43 GiB data, 132 GiB used, 941 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 540 MiB/s wr, 2.48k op/s 2024-07-24T22:12:25.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.586+0000 7f8f74256640 1 -- 172.21.15.47:0/4039912234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f6c1011c0 msgr2=0x7f8f6c1015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:25.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.586+0000 7f8f74256640 1 --2- 172.21.15.47:0/4039912234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f6c1011c0 0x7f8f6c1015a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800dc90 tx=0x7f8f680327b0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.586+0000 7f8f74256640 1 -- 172.21.15.47:0/4039912234 shutdown_connections 2024-07-24T22:12:25.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.586+0000 7f8f74256640 1 --2- 172.21.15.47:0/4039912234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f6c10ca80 0x7f8f6c10ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.586+0000 7f8f74256640 1 --2- 172.21.15.47:0/4039912234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f6c101bc0 0x7f8f6c10c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.586+0000 7f8f74256640 1 --2- 172.21.15.47:0/4039912234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f6c1011c0 0x7f8f6c1015a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.586+0000 7f8f74256640 1 -- 172.21.15.47:0/4039912234 >> 172.21.15.47:0/4039912234 conn(0x7f8f6c076890 msgr2=0x7f8f6c076ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:25.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.587+0000 7f8f74256640 1 -- 172.21.15.47:0/4039912234 shutdown_connections 2024-07-24T22:12:25.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.588+0000 7f8f74256640 1 -- 172.21.15.47:0/4039912234 wait complete. 2024-07-24T22:12:25.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.589+0000 7f8f74256640 1 Processor -- start 2024-07-24T22:12:25.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.589+0000 7f8f74256640 1 -- start start 2024-07-24T22:12:25.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.589+0000 7f8f74256640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f6c1011c0 0x7f8f6c196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.589+0000 7f8f74256640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f6c101bc0 0x7f8f6c196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.590+0000 7f8f717f1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f6c101bc0 0x7f8f6c196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.590+0000 7f8f717f1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f6c101bc0 0x7f8f6c196f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34576/0 (socket says 172.21.15.47:34576) 2024-07-24T22:12:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.590+0000 7f8f74256640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f6c10ca80 0x7f8f6c19c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.590+0000 7f8f717f1640 1 -- 172.21.15.47:0/1931807418 learned_addr learned my addr 172.21.15.47:0/1931807418 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.590+0000 7f8f74256640 1 -- 172.21.15.47:0/1931807418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c110650 con 0x7f8f6c101bc0 2024-07-24T22:12:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.590+0000 7f8f74256640 1 -- 172.21.15.47:0/1931807418 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c1104d0 con 0x7f8f6c10ca80 2024-07-24T22:12:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.590+0000 7f8f74256640 1 -- 172.21.15.47:0/1931807418 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c1107d0 con 0x7f8f6c1011c0 2024-07-24T22:12:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.590+0000 7f8f717f1640 1 -- 172.21.15.47:0/1931807418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f6c1011c0 msgr2=0x7f8f6c196a00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:12:25.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.590+0000 7f8f717f1640 1 --2- 172.21.15.47:0/1931807418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f6c1011c0 0x7f8f6c196a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.590+0000 7f8f717f1640 1 -- 172.21.15.47:0/1931807418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f6c10ca80 msgr2=0x7f8f6c19c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:25.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.590+0000 7f8f717f1640 1 --2- 172.21.15.47:0/1931807418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f6c10ca80 0x7f8f6c19c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.590+0000 7f8f717f1640 1 -- 172.21.15.47:0/1931807418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f6c19cab0 con 0x7f8f6c101bc0 2024-07-24T22:12:25.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.591+0000 7f8f717f1640 1 --2- 172.21.15.47:0/1931807418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f6c101bc0 0x7f8f6c196f40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00b470 tx=0x7f8f5c00b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:25.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.591+0000 7f8f62ffd640 1 -- 172.21.15.47:0/1931807418 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c015020 con 0x7f8f6c101bc0 2024-07-24T22:12:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.591+0000 7f8f74256640 1 -- 172.21.15.47:0/1931807418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f6c19cda0 con 0x7f8f6c101bc0 2024-07-24T22:12:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.591+0000 7f8f74256640 1 -- 172.21.15.47:0/1931807418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f6c1a3630 con 0x7f8f6c101bc0 2024-07-24T22:12:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.592+0000 7f8f62ffd640 1 -- 172.21.15.47:0/1931807418 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f5c011d40 con 0x7f8f6c101bc0 2024-07-24T22:12:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.593+0000 7f8f62ffd640 1 -- 172.21.15.47:0/1931807418 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c00f340 con 0x7f8f6c101bc0 2024-07-24T22:12:25.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.598+0000 7f8f62ffd640 1 -- 172.21.15.47:0/1931807418 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8f5c018020 con 0x7f8f6c101bc0 2024-07-24T22:12:25.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.598+0000 7f8f76607740 1 Processor -- start 2024-07-24T22:12:25.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.599+0000 7f8f76607740 1 -- start start 2024-07-24T22:12:25.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.599+0000 7f8f76607740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 0x55be07e48300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.599+0000 7f8f76607740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e48840 0x55be07e54290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.599+0000 7f8f76607740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e547d0 0x55be07e56bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.599+0000 7f8f76607740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55be07dbf9f0 con 0x55be07e47f20 2024-07-24T22:12:25.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.599+0000 7f8f76607740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55be07daeef0 con 0x55be07e48840 2024-07-24T22:12:25.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.599+0000 7f8f76607740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55be07db2f30 con 0x55be07e547d0 2024-07-24T22:12:25.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.600+0000 7f8f727f3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 0x55be07e48300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:25.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.600+0000 7f8f727f3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 0x55be07e48300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34590/0 (socket says 172.21.15.47:34590) 2024-07-24T22:12:25.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.600+0000 7f8f727f3640 1 -- 172.21.15.47:0/1235220627 learned_addr learned my addr 172.21.15.47:0/1235220627 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:25.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.600+0000 7f8f62ffd640 1 --2- 172.21.15.47:0/1931807418 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8f580b3e70 0x7f8f580b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.600+0000 7f8f727f3640 1 -- 172.21.15.47:0/1235220627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e547d0 msgr2=0x55be07e56bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:12:25.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.600+0000 7f8f727f3640 1 --2- 172.21.15.47:0/1235220627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e547d0 0x55be07e56bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.600+0000 7f8f727f3640 1 -- 172.21.15.47:0/1235220627 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e48840 msgr2=0x55be07e54290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:12:25.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.600+0000 7f8f727f3640 1 --2- 172.21.15.47:0/1235220627 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e48840 0x55be07e54290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.600+0000 7f8f727f3640 1 -- 172.21.15.47:0/1235220627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be07b0f930 con 0x55be07e47f20 2024-07-24T22:12:25.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.601+0000 7f8f62ffd640 1 -- 172.21.15.47:0/1931807418 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8f5c0e3830 con 0x7f8f6c101bc0 2024-07-24T22:12:25.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.601+0000 7f8f727f3640 1 --2- 172.21.15.47:0/1235220627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 0x55be07e48300 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009d20 tx=0x7f8f6400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d3c60c1992cd3d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:25.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.601+0000 7f8f727f3640 1 --2- 172.21.15.47:0/1931807418 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8f580b3e70 0x7f8f580b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:25.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.602+0000 7f8f727f3640 1 --2- 172.21.15.47:0/1931807418 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8f580b3e70 0x7f8f580b6330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8f6401b000 tx=0x7f8f6401e000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:25.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.602+0000 7f8f57fff640 1 -- 172.21.15.47:0/1235220627 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f64012d60 con 0x55be07e47f20 2024-07-24T22:12:25.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.602+0000 7f8f57fff640 1 -- 172.21.15.47:0/1235220627 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f64011c90 con 0x55be07e47f20 2024-07-24T22:12:25.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.602+0000 7f8f57fff640 1 -- 172.21.15.47:0/1235220627 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6401ea80 con 0x55be07e47f20 2024-07-24T22:12:25.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.603+0000 7f8f76607740 1 -- 172.21.15.47:0/1235220627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 msgr2=0x55be07e48300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:25.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.603+0000 7f8f76607740 1 --2- 172.21.15.47:0/1235220627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 0x55be07e48300 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009d20 tx=0x7f8f6400b420 comp rx=0 tx=0).stop 2024-07-24T22:12:25.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.603+0000 7f8f76607740 1 -- 172.21.15.47:0/1235220627 shutdown_connections 2024-07-24T22:12:25.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.603+0000 7f8f76607740 1 --2- 172.21.15.47:0/1235220627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e547d0 0x55be07e56bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.603+0000 7f8f76607740 1 --2- 172.21.15.47:0/1235220627 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e48840 0x55be07e54290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.603+0000 7f8f76607740 1 --2- 172.21.15.47:0/1235220627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 0x55be07e48300 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.603+0000 7f8f76607740 1 -- 172.21.15.47:0/1235220627 >> 172.21.15.47:0/1235220627 conn(0x55be07e45d50 msgr2=0x55be07e46ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:25.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.604+0000 7f8f76607740 1 -- 172.21.15.47:0/1235220627 shutdown_connections 2024-07-24T22:12:25.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.604+0000 7f8f76607740 1 -- 172.21.15.47:0/1235220627 wait complete. 2024-07-24T22:12:25.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.605+0000 7f8f76607740 1 -- start start 2024-07-24T22:12:25.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.605+0000 7f8f76607740 1 Processor -- start 2024-07-24T22:12:25.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.606+0000 7f8f76607740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e47f20 0x55be07e54240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.606+0000 7f8f76607740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e48840 0x55be07e51690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.607+0000 7f8f76607740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 0x55be07e51e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.607+0000 7f8f76607740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55be07c12890 con 0x55be07e547d0 2024-07-24T22:12:25.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.607+0000 7f8f76607740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55be07d51390 con 0x55be07e47f20 2024-07-24T22:12:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.607+0000 7f8f76607740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55be07e57450 con 0x55be07e48840 2024-07-24T22:12:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.607+0000 7f8f76607740 10 client.0 _ll_register_callbacks cb 0x55be07d5b500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.607+0000 7f8f727f3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 0x55be07e51e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.607+0000 7f8f727f3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 0x55be07e51e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34602/0 (socket says 172.21.15.47:34602) 2024-07-24T22:12:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.607+0000 7f8f727f3640 1 -- 172.21.15.47:0/575120711 learned_addr learned my addr 172.21.15.47:0/575120711 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.607+0000 7f8f727f3640 1 -- 172.21.15.47:0/575120711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e48840 msgr2=0x55be07e51690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.607+0000 7f8f727f3640 1 --2- 172.21.15.47:0/575120711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e48840 0x55be07e51690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.607+0000 7f8f727f3640 1 -- 172.21.15.47:0/575120711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e47f20 msgr2=0x55be07e54240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.607+0000 7f8f727f3640 1 --2- 172.21.15.47:0/575120711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e47f20 0x55be07e54240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.607+0000 7f8f727f3640 1 -- 172.21.15.47:0/575120711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be07d4bd60 con 0x55be07e547d0 2024-07-24T22:12:25.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.608+0000 7f8f727f3640 1 --2- 172.21.15.47:0/575120711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 0x55be07e51e20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8f64007190 tx=0x7f8f640071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e4e296761dce38 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:25.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.608+0000 7f8f557fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:12:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.608+0000 7f8f557fa640 1 -- 172.21.15.47:0/575120711 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6402c020 con 0x55be07e547d0 2024-07-24T22:12:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.608+0000 7f8f557fa640 1 -- 172.21.15.47:0/575120711 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8f6401e6e0 con 0x55be07e547d0 2024-07-24T22:12:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.608+0000 7f8f76607740 1 -- 172.21.15.47:0/575120711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f64011c90 con 0x55be07e547d0 2024-07-24T22:12:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.608+0000 7f8f557fa640 1 -- 172.21.15.47:0/575120711 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8f64037050 con 0x55be07e547d0 2024-07-24T22:12:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.609+0000 7f8f76607740 10 client.16590 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.609+0000 7f8f76607740 1 -- 172.21.15.47:0/575120711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55be07e63330 con 0x55be07e547d0 2024-07-24T22:12:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.609+0000 7f8f557fa640 1 -- 172.21.15.47:0/575120711 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f64011c90 con 0x55be07e547d0 2024-07-24T22:12:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.609+0000 7f8f557fa640 1 -- 172.21.15.47:0/575120711 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8f64011070 con 0x55be07e547d0 2024-07-24T22:12:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.609+0000 7f8f76607740 10 client.16590 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.609+0000 7f8f76607740 10 client.16590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.609+0000 7f8f76607740 20 client.16590 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.609+0000 7f8f76607740 1 --2- 172.21.15.47:0/575120711 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55be07e64680 0x55be07e66a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.609+0000 7f8f76607740 4 client.16590 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:12:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.609+0000 7f8f76607740 1 -- 172.21.15.47:0/575120711 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be07dc1940 con 0x55be07e64680 2024-07-24T22:12:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.611+0000 7f8f71ff2640 1 --2- 172.21.15.47:0/575120711 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55be07e64680 0x55be07e66a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:25.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.616+0000 7f8f557fa640 10 client.16590 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:25.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.616+0000 7f8f71ff2640 1 --2- 172.21.15.47:0/575120711 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55be07e64680 0x55be07e66a70 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f4b7bc20c276403 server_cookie=2851599048594047 in_seq=0 out_seq=0 2024-07-24T22:12:25.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.622+0000 7f8f557fa640 1 -- 172.21.15.47:0/575120711 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be07dc1940 con 0x55be07e64680 2024-07-24T22:12:25.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.622+0000 7f8f557fa640 10 client.16590 handle_command_reply: tid=0 2024-07-24T22:12:25.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.622+0000 7f8f76607740 1 client.16590 shutdown 2024-07-24T22:12:25.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.622+0000 7f8f76607740 1 -- 172.21.15.47:0/575120711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 msgr2=0x55be07e51e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:25.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.622+0000 7f8f76607740 1 --2- 172.21.15.47:0/575120711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 0x55be07e51e20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8f64007190 tx=0x7f8f640071c0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.623+0000 7f8f76607740 1 -- 172.21.15.47:0/575120711 shutdown_connections 2024-07-24T22:12:25.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.623+0000 7f8f76607740 1 --2- 172.21.15.47:0/575120711 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55be07e64680 0x55be07e66a70 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.623+0000 7f8f557fa640 0 client.16590 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:25.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.624+0000 7f8f76607740 1 --2- 172.21.15.47:0/575120711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 0x55be07e51e20 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.624+0000 7f8f76607740 1 --2- 172.21.15.47:0/575120711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e48840 0x55be07e51690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.624+0000 7f8f76607740 1 --2- 172.21.15.47:0/575120711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e47f20 0x55be07e54240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.624+0000 7f8f76607740 1 -- 172.21.15.47:0/575120711 >> 172.21.15.47:0/575120711 conn(0x55be07e45d50 msgr2=0x55be07e4b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:25.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.624+0000 7f8f76607740 1 -- 172.21.15.47:0/575120711 shutdown_connections 2024-07-24T22:12:25.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.624+0000 7f8f76607740 1 -- 172.21.15.47:0/575120711 wait complete. 2024-07-24T22:12:25.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.625+0000 7f8f76607740 20 client.16590 trim_cache size 0 max 16384 2024-07-24T22:12:25.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.651+0000 7f8f76607740 1 Processor -- start 2024-07-24T22:12:25.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.651+0000 7f8f76607740 1 -- start start 2024-07-24T22:12:25.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.652+0000 7f8f76607740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e47f20 0x55be07e6c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.652+0000 7f8f76607740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e48840 0x55be07e6c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.652+0000 7f8f76607740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 0x55be07e4e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.652+0000 7f8f76607740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5000c7e0 con 0x55be07e547d0 2024-07-24T22:12:25.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.652+0000 7f8f76607740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5000f060 con 0x55be07e47f20 2024-07-24T22:12:25.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.652+0000 7f8f76607740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5000ce50 con 0x55be07e48840 2024-07-24T22:12:25.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.652+0000 7f8f727f3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 0x55be07e4e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:25.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.652+0000 7f8f727f3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 0x55be07e4e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34618/0 (socket says 172.21.15.47:34618) 2024-07-24T22:12:25.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.652+0000 7f8f727f3640 1 -- 172.21.15.47:0/769153449 learned_addr learned my addr 172.21.15.47:0/769153449 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:25.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.653+0000 7f8f727f3640 1 -- 172.21.15.47:0/769153449 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e48840 msgr2=0x55be07e6c6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:12:25.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.653+0000 7f8f727f3640 1 --2- 172.21.15.47:0/769153449 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e48840 0x55be07e6c6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.653+0000 7f8f727f3640 1 -- 172.21.15.47:0/769153449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e47f20 msgr2=0x55be07e6c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:25.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.653+0000 7f8f727f3640 1 --2- 172.21.15.47:0/769153449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e47f20 0x55be07e6c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.653+0000 7f8f727f3640 1 -- 172.21.15.47:0/769153449 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be07e48670 con 0x55be07e547d0 2024-07-24T22:12:25.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.653+0000 7f8f727f3640 1 --2- 172.21.15.47:0/769153449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 0x55be07e4e8e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8f64007260 tx=0x7f8f640125d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ff8ac0f3e1a8b7 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:25.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.653+0000 7f8f577fe640 1 -- 172.21.15.47:0/769153449 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f64040070 con 0x55be07e547d0 2024-07-24T22:12:25.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.653+0000 7f8f577fe640 1 -- 172.21.15.47:0/769153449 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f640330e0 con 0x55be07e547d0 2024-07-24T22:12:25.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.653+0000 7f8f577fe640 1 -- 172.21.15.47:0/769153449 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6402c040 con 0x55be07e547d0 2024-07-24T22:12:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.654+0000 7f8f76607740 1 -- 172.21.15.47:0/769153449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 msgr2=0x55be07e4e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.654+0000 7f8f76607740 1 --2- 172.21.15.47:0/769153449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 0x55be07e4e8e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8f64007260 tx=0x7f8f640125d0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.654+0000 7f8f76607740 1 -- 172.21.15.47:0/769153449 shutdown_connections 2024-07-24T22:12:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.654+0000 7f8f76607740 1 --2- 172.21.15.47:0/769153449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e547d0 0x55be07e4e8e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.654+0000 7f8f76607740 1 --2- 172.21.15.47:0/769153449 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e48840 0x55be07e6c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.654+0000 7f8f76607740 1 --2- 172.21.15.47:0/769153449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e47f20 0x55be07e6c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.654+0000 7f8f76607740 1 -- 172.21.15.47:0/769153449 >> 172.21.15.47:0/769153449 conn(0x55be07e45d50 msgr2=0x55be07e4ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.655+0000 7f8f76607740 1 -- 172.21.15.47:0/769153449 shutdown_connections 2024-07-24T22:12:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.655+0000 7f8f76607740 1 -- 172.21.15.47:0/769153449 wait complete. 2024-07-24T22:12:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.655+0000 7f8f76607740 1 -- start start 2024-07-24T22:12:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.655+0000 7f8f76607740 1 Processor -- start 2024-07-24T22:12:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.656+0000 7f8f76607740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 0x55be07e4e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.656+0000 7f8f76607740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e48840 0x55be07e4ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.656+0000 7f8f71ff2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 0x55be07e4e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.656+0000 7f8f71ff2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 0x55be07e4e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34624/0 (socket says 172.21.15.47:34624) 2024-07-24T22:12:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.656+0000 7f8f71ff2640 1 -- 172.21.15.47:0/1774244268 learned_addr learned my addr 172.21.15.47:0/1774244268 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.656+0000 7f8f76607740 1 --2- 172.21.15.47:0/1774244268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e547d0 0x55be07e4f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.656+0000 7f8f76607740 1 -- 172.21.15.47:0/1774244268 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5000d520 con 0x55be07e47f20 2024-07-24T22:12:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.656+0000 7f8f76607740 1 -- 172.21.15.47:0/1774244268 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5000e990 con 0x55be07e547d0 2024-07-24T22:12:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.656+0000 7f8f76607740 1 -- 172.21.15.47:0/1774244268 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5000dbf0 con 0x55be07e48840 2024-07-24T22:12:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.657+0000 7f8f76607740 10 client.0 _ll_register_callbacks cb 0x7f8f64011af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.657+0000 7f8f71ff2640 1 -- 172.21.15.47:0/1774244268 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e48840 msgr2=0x55be07e4ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.657+0000 7f8f71ff2640 1 --2- 172.21.15.47:0/1774244268 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e48840 0x55be07e4ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.657+0000 7f8f71ff2640 1 -- 172.21.15.47:0/1774244268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e547d0 msgr2=0x55be07e4f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.657+0000 7f8f71ff2640 1 --2- 172.21.15.47:0/1774244268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e547d0 0x55be07e4f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.657+0000 7f8f71ff2640 1 -- 172.21.15.47:0/1774244268 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be07ece1b0 con 0x55be07e47f20 2024-07-24T22:12:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.657+0000 7f8f71ff2640 1 --2- 172.21.15.47:0/1774244268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 0x55be07e4e740 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x55be07e46c30 tx=0x7f8f6800ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2525b401082d431 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.657+0000 7f8f557fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:12:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.657+0000 7f8f76607740 1 -- 172.21.15.47:0/1774244268 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f640330e0 con 0x55be07e47f20 2024-07-24T22:12:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.658+0000 7f8f557fa640 1 -- 172.21.15.47:0/1774244268 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6800d400 con 0x55be07e47f20 2024-07-24T22:12:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.658+0000 7f8f557fa640 1 -- 172.21.15.47:0/1774244268 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8f68049070 con 0x55be07e47f20 2024-07-24T22:12:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.658+0000 7f8f557fa640 1 -- 172.21.15.47:0/1774244268 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8f6800b7e0 con 0x55be07e47f20 2024-07-24T22:12:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.658+0000 7f8f76607740 10 client.16596 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.658+0000 7f8f76607740 1 -- 172.21.15.47:0/1774244268 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({fsmap=20}) -- 0x55be07ecf440 con 0x55be07e47f20 2024-07-24T22:12:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.658+0000 7f8f557fa640 1 -- 172.21.15.47:0/1774244268 <== mon.0 v2:172.21.15.47:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8f68004040 con 0x55be07e47f20 2024-07-24T22:12:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.658+0000 7f8f76607740 10 client.16596 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.658+0000 7f8f76607740 10 client.16596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.658+0000 7f8f76607740 20 client.16596 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.658+0000 7f8f76607740 1 --2- 172.21.15.47:0/1774244268 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55be07e64680 0x55be07ed1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.659+0000 7f8f76607740 4 client.16596 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:12:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.659+0000 7f8f76607740 1 -- 172.21.15.47:0/1774244268 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f8f640330e0 con 0x55be07e64680 2024-07-24T22:12:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.660+0000 7f8f717f1640 1 --2- 172.21.15.47:0/1774244268 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55be07e64680 0x55be07ed1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.662+0000 7f8f557fa640 10 client.16596 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:25.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:25.662+0000 7f8f717f1640 1 --2- 172.21.15.47:0/1774244268 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55be07e64680 0x55be07ed1b30 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb404b326714578b server_cookie=5a4035d2f21beb2a in_seq=0 out_seq=0 2024-07-24T22:12:26.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.210+0000 7f8f557fa640 1 -- 172.21.15.47:0/1774244268 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f8f640330e0 con 0x55be07e64680 2024-07-24T22:12:26.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.210+0000 7f8f557fa640 10 client.16596 handle_command_reply: tid=0 2024-07-24T22:12:26.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.210+0000 7f8f76607740 1 client.16596 shutdown 2024-07-24T22:12:26.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.211+0000 7f8f76607740 1 -- 172.21.15.47:0/1774244268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 msgr2=0x55be07e4e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:26.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.211+0000 7f8f76607740 1 --2- 172.21.15.47:0/1774244268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 0x55be07e4e740 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x55be07e46c30 tx=0x7f8f6800ce80 comp rx=0 tx=0).stop 2024-07-24T22:12:26.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.212+0000 7f8f76607740 1 -- 172.21.15.47:0/1774244268 shutdown_connections 2024-07-24T22:12:26.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.212+0000 7f8f76607740 1 --2- 172.21.15.47:0/1774244268 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55be07e64680 0x55be07ed1b30 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:26.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.212+0000 7f8f76607740 1 --2- 172.21.15.47:0/1774244268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55be07e547d0 0x55be07e4f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:26.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.212+0000 7f8f76607740 1 --2- 172.21.15.47:0/1774244268 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55be07e48840 0x55be07e4ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:26.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.212+0000 7f8f76607740 1 --2- 172.21.15.47:0/1774244268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55be07e47f20 0x55be07e4e740 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:26.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.212+0000 7f8f76607740 1 -- 172.21.15.47:0/1774244268 >> 172.21.15.47:0/1774244268 conn(0x55be07e45d50 msgr2=0x55be07e50320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:26.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.213+0000 7f8f557fa640 0 client.16596 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:26.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.213+0000 7f8f76607740 1 -- 172.21.15.47:0/1774244268 shutdown_connections 2024-07-24T22:12:26.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.213+0000 7f8f76607740 1 -- 172.21.15.47:0/1774244268 wait complete. 2024-07-24T22:12:26.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.213+0000 7f8f76607740 20 client.16596 trim_cache size 0 max 16384 2024-07-24T22:12:26.218 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:12:26.218 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:12:26.218 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "8b3a7769-b4ea-41ee-bb6f-e6e82aa7069e", 2024-07-24T22:12:26.218 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:12:26.218 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:12:26.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.215+0000 7f8f74256640 1 -- 172.21.15.47:0/1931807418 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8f580b3e70 msgr2=0x7f8f580b6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:26.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.215+0000 7f8f74256640 1 --2- 172.21.15.47:0/1931807418 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8f580b3e70 0x7f8f580b6330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8f6401b000 tx=0x7f8f6401e000 comp rx=0 tx=0).stop 2024-07-24T22:12:26.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.215+0000 7f8f74256640 1 -- 172.21.15.47:0/1931807418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f6c101bc0 msgr2=0x7f8f6c196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:26.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.215+0000 7f8f74256640 1 --2- 172.21.15.47:0/1931807418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f6c101bc0 0x7f8f6c196f40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00b470 tx=0x7f8f5c00b930 comp rx=0 tx=0).stop 2024-07-24T22:12:26.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.215+0000 7f8f74256640 1 -- 172.21.15.47:0/1931807418 shutdown_connections 2024-07-24T22:12:26.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.215+0000 7f8f74256640 1 --2- 172.21.15.47:0/1931807418 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8f580b3e70 0x7f8f580b6330 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:26.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.215+0000 7f8f74256640 1 --2- 172.21.15.47:0/1931807418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f6c10ca80 0x7f8f6c19c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:26.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.215+0000 7f8f74256640 1 --2- 172.21.15.47:0/1931807418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f6c101bc0 0x7f8f6c196f40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:26.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.215+0000 7f8f74256640 1 --2- 172.21.15.47:0/1931807418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f6c1011c0 0x7f8f6c196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:26.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.215+0000 7f8f74256640 1 -- 172.21.15.47:0/1931807418 >> 172.21.15.47:0/1931807418 conn(0x7f8f6c076890 msgr2=0x7f8f6c0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:26.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.216+0000 7f8f74256640 1 -- 172.21.15.47:0/1931807418 shutdown_connections 2024-07-24T22:12:26.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:26.216+0000 7f8f74256640 1 -- 172.21.15.47:0/1931807418 wait complete. 2024-07-24T22:12:26.608 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:26 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:12:26.609 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:26 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:26.609 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:26 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:12:26.661 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:26 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:12:26.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:26 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:26.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:26 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:12:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:26 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:12:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:26 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:26.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:26 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:12:27.162 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:12:27.774 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:12:27.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:27 smithi188 ceph-mon[37380]: pgmap v523: 97 pgs: 97 active+clean; 43 GiB data, 131 GiB used, 941 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 401 MiB/s wr, 2.04k op/s 2024-07-24T22:12:27.901 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:27 smithi047 ceph-mon[32551]: pgmap v523: 97 pgs: 97 active+clean; 43 GiB data, 131 GiB used, 941 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 401 MiB/s wr, 2.04k op/s 2024-07-24T22:12:27.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:27 smithi183 ceph-mon[37007]: pgmap v523: 97 pgs: 97 active+clean; 43 GiB data, 131 GiB used, 941 GiB / 1.0 TiB avail; 1.2 MiB/s rd, 401 MiB/s wr, 2.04k op/s 2024-07-24T22:12:29.773 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:29 smithi047 ceph-mon[32551]: pgmap v524: 97 pgs: 97 active+clean; 43 GiB data, 132 GiB used, 941 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 493 MiB/s wr, 1.98k op/s 2024-07-24T22:12:30.038 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:29 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:30.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:29 smithi183 ceph-mon[37007]: pgmap v524: 97 pgs: 97 active+clean; 43 GiB data, 132 GiB used, 941 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 493 MiB/s wr, 1.98k op/s 2024-07-24T22:12:30.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:29 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:30.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:29 smithi188 ceph-mon[37380]: pgmap v524: 97 pgs: 97 active+clean; 43 GiB data, 132 GiB used, 941 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 493 MiB/s wr, 1.98k op/s 2024-07-24T22:12:30.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:29 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:30.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.687+0000 7f6b05473640 1 -- 172.21.15.47:0/1945449718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b00103f90 msgr2=0x7f6b0010d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:30.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.687+0000 7f6b05473640 1 --2- 172.21.15.47:0/1945449718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b00103f90 0x7f6b0010d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009900 tx=0x7f6af802a410 comp rx=0 tx=0).stop 2024-07-24T22:12:30.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.688+0000 7f6b05473640 1 -- 172.21.15.47:0/1945449718 shutdown_connections 2024-07-24T22:12:30.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.688+0000 7f6b05473640 1 --2- 172.21.15.47:0/1945449718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b00103f90 0x7f6b0010d990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.688+0000 7f6b05473640 1 --2- 172.21.15.47:0/1945449718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b001035f0 0x7f6b00103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.688+0000 7f6b05473640 1 --2- 172.21.15.47:0/1945449718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b001011c0 0x7f6b001015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.688+0000 7f6b05473640 1 -- 172.21.15.47:0/1945449718 >> 172.21.15.47:0/1945449718 conn(0x7f6b00076980 msgr2=0x7f6b00076d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:30.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.688+0000 7f6b05473640 1 -- 172.21.15.47:0/1945449718 shutdown_connections 2024-07-24T22:12:30.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.688+0000 7f6b05473640 1 -- 172.21.15.47:0/1945449718 wait complete. 2024-07-24T22:12:30.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.689+0000 7f6b05473640 1 Processor -- start 2024-07-24T22:12:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.690+0000 7f6b05473640 1 -- start start 2024-07-24T22:12:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.690+0000 7f6b05473640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b001011c0 0x7f6b00197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.690+0000 7f6b05473640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b001035f0 0x7f6b00197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.690+0000 7f6b05473640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b00103f90 0x7f6b0019c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.690+0000 7f6b05473640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6b00110e50 con 0x7f6b001011c0 2024-07-24T22:12:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.690+0000 7f6b05473640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6b00110cd0 con 0x7f6b00103f90 2024-07-24T22:12:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.690+0000 7f6b05473640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6b00110fd0 con 0x7f6b001035f0 2024-07-24T22:12:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.691+0000 7f6afeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b001011c0 0x7f6b00197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.691+0000 7f6afeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b001011c0 0x7f6b00197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34636/0 (socket says 172.21.15.47:34636) 2024-07-24T22:12:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.691+0000 7f6afeffd640 1 -- 172.21.15.47:0/1014505400 learned_addr learned my addr 172.21.15.47:0/1014505400 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.692+0000 7f6afeffd640 1 -- 172.21.15.47:0/1014505400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b001035f0 msgr2=0x7f6b00197680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T22:12:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.692+0000 7f6afeffd640 1 --2- 172.21.15.47:0/1014505400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b001035f0 0x7f6b00197680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.692+0000 7f6afeffd640 1 -- 172.21.15.47:0/1014505400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b00103f90 msgr2=0x7f6b0019c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:30.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.692+0000 7f6afeffd640 1 --2- 172.21.15.47:0/1014505400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b00103f90 0x7f6b0019c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.692+0000 7f6afeffd640 1 -- 172.21.15.47:0/1014505400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0019caf0 con 0x7f6b001011c0 2024-07-24T22:12:30.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.692+0000 7f6afeffd640 1 --2- 172.21.15.47:0/1014505400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b001011c0 0x7f6b00197140 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6af000ba50 tx=0x7f6af000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:30.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.695+0000 7f6afcff9640 1 -- 172.21.15.47:0/1014505400 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0019070 con 0x7f6b001011c0 2024-07-24T22:12:30.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.695+0000 7f6afcff9640 1 -- 172.21.15.47:0/1014505400 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6af000cbe0 con 0x7f6b001011c0 2024-07-24T22:12:30.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.695+0000 7f6afcff9640 1 -- 172.21.15.47:0/1014505400 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af00075d0 con 0x7f6b001011c0 2024-07-24T22:12:30.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.695+0000 7f6b05473640 1 -- 172.21.15.47:0/1014505400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0019cde0 con 0x7f6b001011c0 2024-07-24T22:12:30.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.695+0000 7f6b05473640 1 -- 172.21.15.47:0/1014505400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0019d4e0 con 0x7f6b001011c0 2024-07-24T22:12:30.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.711+0000 7f6b07824740 1 Processor -- start 2024-07-24T22:12:30.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.713+0000 7f6b07824740 1 -- start start 2024-07-24T22:12:30.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.714+0000 7f6b07824740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f6ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.714+0000 7f6b07824740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 0x559578f779f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.714+0000 7f6b07824740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f7a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.714+0000 7f6b07824740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559578ee2960 con 0x559578f77f30 2024-07-24T22:12:30.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.714+0000 7f6b07824740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x559578ed1e60 con 0x559578f6bfa0 2024-07-24T22:12:30.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.714+0000 7f6b07824740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559578ed5ea0 con 0x559578f6b680 2024-07-24T22:12:30.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.719+0000 7f6afcff9640 1 -- 172.21.15.47:0/1014505400 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f6af001c070 con 0x7f6b001011c0 2024-07-24T22:12:30.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.721+0000 7f6afcff9640 1 --2- 172.21.15.47:0/1014505400 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aec0b3e90 0x7f6aec0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.722+0000 7f6afcff9640 1 -- 172.21.15.47:0/1014505400 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f6af00e3340 con 0x7f6b001011c0 2024-07-24T22:12:30.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.723+0000 7f6afeffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 0x559578f779f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.723+0000 7f6af7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f7a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.723+0000 7f6aff7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f6ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.724+0000 7f6af7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f7a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34642/0 (socket says 172.21.15.47:34642) 2024-07-24T22:12:30.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.724+0000 7f6af7fff640 1 -- 172.21.15.47:0/3388901005 learned_addr learned my addr 172.21.15.47:0/3388901005 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:30.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.729+0000 7f6aff7fe640 1 --2- 172.21.15.47:0/1014505400 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aec0b3e90 0x7f6aec0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.730+0000 7f6af7fff640 1 -- 172.21.15.47:0/3388901005 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 msgr2=0x559578f6ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:30.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.730+0000 7f6af7fff640 1 --2- 172.21.15.47:0/3388901005 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f6ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.730+0000 7f6af7fff640 1 -- 172.21.15.47:0/3388901005 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 msgr2=0x559578f779f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:30.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.730+0000 7f6af7fff640 1 --2- 172.21.15.47:0/3388901005 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 0x559578f779f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.730+0000 7f6af7fff640 1 -- 172.21.15.47:0/3388901005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559578e5b2d0 con 0x559578f77f30 2024-07-24T22:12:30.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.732+0000 7f6af7fff640 1 --2- 172.21.15.47:0/3388901005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f7a320 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800ba50 tx=0x7f6ae800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9380a1cb7628e90 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.733+0000 7f6aff7fe640 1 --2- 172.21.15.47:0/1014505400 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aec0b3e90 0x7f6aec0b6350 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6af8005d70 tx=0x7f6af8005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.733+0000 7f6af57fa640 1 -- 172.21.15.47:0/3388901005 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8016070 con 0x559578f77f30 2024-07-24T22:12:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.734+0000 7f6af57fa640 1 -- 172.21.15.47:0/3388901005 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ae80054d0 con 0x559578f77f30 2024-07-24T22:12:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.736+0000 7f6b07824740 1 -- 172.21.15.47:0/3388901005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 msgr2=0x559578f7a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.736+0000 7f6b07824740 1 --2- 172.21.15.47:0/3388901005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f7a320 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800ba50 tx=0x7f6ae800be50 comp rx=0 tx=0).stop 2024-07-24T22:12:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.737+0000 7f6b07824740 1 -- 172.21.15.47:0/3388901005 shutdown_connections 2024-07-24T22:12:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.737+0000 7f6b07824740 1 --2- 172.21.15.47:0/3388901005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f7a320 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.737+0000 7f6b07824740 1 --2- 172.21.15.47:0/3388901005 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 0x559578f779f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.737+0000 7f6b07824740 1 --2- 172.21.15.47:0/3388901005 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f6ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.737+0000 7f6b07824740 1 -- 172.21.15.47:0/3388901005 >> 172.21.15.47:0/3388901005 conn(0x559578f694b0 msgr2=0x559578f6a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:30.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.744+0000 7f6b07824740 1 -- 172.21.15.47:0/3388901005 shutdown_connections 2024-07-24T22:12:30.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.744+0000 7f6b07824740 1 -- 172.21.15.47:0/3388901005 wait complete. 2024-07-24T22:12:30.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.745+0000 7f6b07824740 1 -- start start 2024-07-24T22:12:30.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.745+0000 7f6b07824740 1 Processor -- start 2024-07-24T22:12:30.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.746+0000 7f6b07824740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6b680 0x559578f77890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.746+0000 7f6b07824740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6bfa0 0x559578f74ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.746+0000 7f6b07824740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f75360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.746+0000 7f6b07824740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559578d35700 con 0x559578f77f30 2024-07-24T22:12:30.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.746+0000 7f6b07824740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x559578e745a0 con 0x559578f6b680 2024-07-24T22:12:30.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.746+0000 7f6b07824740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559578f7ac00 con 0x559578f6bfa0 2024-07-24T22:12:30.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.746+0000 7f6b07824740 10 client.0 _ll_register_callbacks cb 0x559578e94910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:30.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.749+0000 7f6aff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f75360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.749+0000 7f6aff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f75360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34654/0 (socket says 172.21.15.47:34654) 2024-07-24T22:12:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.749+0000 7f6aff7fe640 1 -- 172.21.15.47:0/1557471823 learned_addr learned my addr 172.21.15.47:0/1557471823 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:30.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.753+0000 7f6afeffd640 1 --2- 172.21.15.47:0/1557471823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6b680 0x559578f77890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.753+0000 7f6af7fff640 1 --2- 172.21.15.47:0/1557471823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6bfa0 0x559578f74ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.753+0000 7f6aff7fe640 1 -- 172.21.15.47:0/1557471823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6bfa0 msgr2=0x559578f74ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:30.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.753+0000 7f6aff7fe640 1 --2- 172.21.15.47:0/1557471823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6bfa0 0x559578f74ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.753+0000 7f6aff7fe640 1 -- 172.21.15.47:0/1557471823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6b680 msgr2=0x559578f77890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:30.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.753+0000 7f6aff7fe640 1 --2- 172.21.15.47:0/1557471823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6b680 0x559578f77890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.754+0000 7f6aff7fe640 1 -- 172.21.15.47:0/1557471823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559578e67630 con 0x559578f77f30 2024-07-24T22:12:30.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.764+0000 7f6aff7fe640 1 --2- 172.21.15.47:0/1557471823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f75360 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6af8031930 tx=0x7f6af8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a44686db936e6ce server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:30.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.766+0000 7f6ae67fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:12:30.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.766+0000 7f6ae67fc640 1 -- 172.21.15.47:0/1557471823 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8035020 con 0x559578f77f30 2024-07-24T22:12:30.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.766+0000 7f6ae67fc640 1 -- 172.21.15.47:0/1557471823 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f6af8005020 con 0x559578f77f30 2024-07-24T22:12:30.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.768+0000 7f6b07824740 1 -- 172.21.15.47:0/1557471823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ae80054d0 con 0x559578f77f30 2024-07-24T22:12:30.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.771+0000 7f6ae67fc640 1 -- 172.21.15.47:0/1557471823 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6af80046c0 con 0x559578f77f30 2024-07-24T22:12:30.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.773+0000 7f6b07824740 10 client.16605 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:30.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.773+0000 7f6b07824740 1 -- 172.21.15.47:0/1557471823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559578c32650 con 0x559578f77f30 2024-07-24T22:12:30.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.774+0000 7f6ae67fc640 1 -- 172.21.15.47:0/1557471823 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ae80054d0 con 0x559578f77f30 2024-07-24T22:12:30.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.774+0000 7f6ae67fc640 1 -- 172.21.15.47:0/1557471823 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6af8003b80 con 0x559578f77f30 2024-07-24T22:12:30.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.780+0000 7f6b07824740 10 client.16605 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:30.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.780+0000 7f6b07824740 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:30.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.780+0000 7f6b07824740 20 client.16605 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:30.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.780+0000 7f6b07824740 1 --2- 172.21.15.47:0/1557471823 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559578f87a50 0x559578f89ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.780+0000 7f6b07824740 4 client.16605 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:12:30.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.780+0000 7f6b07824740 1 -- 172.21.15.47:0/1557471823 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559578ee48b0 con 0x559578f87a50 2024-07-24T22:12:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.782+0000 7f6afeffd640 1 --2- 172.21.15.47:0/1557471823 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559578f87a50 0x559578f89ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.787+0000 7f6afeffd640 1 --2- 172.21.15.47:0/1557471823 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559578f87a50 0x559578f89ef0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49cd25c74fa312d2 server_cookie=840d679507e38311 in_seq=0 out_seq=0 2024-07-24T22:12:30.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.790+0000 7f6ae67fc640 10 client.16605 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:30.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.791+0000 7f6ae67fc640 1 -- 172.21.15.47:0/1557471823 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559578ee48b0 con 0x559578f87a50 2024-07-24T22:12:30.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.791+0000 7f6ae67fc640 10 client.16605 handle_command_reply: tid=0 2024-07-24T22:12:30.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.794+0000 7f6b07824740 1 client.16605 shutdown 2024-07-24T22:12:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.802+0000 7f6b07824740 1 -- 172.21.15.47:0/1557471823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 msgr2=0x559578f75360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.802+0000 7f6b07824740 1 --2- 172.21.15.47:0/1557471823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f75360 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6af8031930 tx=0x7f6af8009260 comp rx=0 tx=0).stop 2024-07-24T22:12:30.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.803+0000 7f6b07824740 1 -- 172.21.15.47:0/1557471823 shutdown_connections 2024-07-24T22:12:30.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.803+0000 7f6b07824740 1 --2- 172.21.15.47:0/1557471823 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559578f87a50 0x559578f89ef0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.803+0000 7f6b07824740 1 --2- 172.21.15.47:0/1557471823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f75360 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.803+0000 7f6b07824740 1 --2- 172.21.15.47:0/1557471823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6bfa0 0x559578f74ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.803+0000 7f6b07824740 1 --2- 172.21.15.47:0/1557471823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6b680 0x559578f77890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.803+0000 7f6b07824740 1 -- 172.21.15.47:0/1557471823 >> 172.21.15.47:0/1557471823 conn(0x559578f694b0 msgr2=0x559578f6f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.804+0000 7f6ae67fc640 0 client.16605 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.804+0000 7f6b07824740 1 -- 172.21.15.47:0/1557471823 shutdown_connections 2024-07-24T22:12:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.807+0000 7f6b07824740 1 -- 172.21.15.47:0/1557471823 wait complete. 2024-07-24T22:12:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.809+0000 7f6b07824740 20 client.16605 trim_cache size 0 max 16384 2024-07-24T22:12:30.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.895+0000 7f6b07824740 1 Processor -- start 2024-07-24T22:12:30.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.901+0000 7f6b07824740 1 -- start start 2024-07-24T22:12:30.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.903+0000 7f6b07824740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f83dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.905+0000 7f6b07824740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 0x559578f6a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.905+0000 7f6b07824740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f8f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.905+0000 7f6b07824740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae000c970 con 0x559578f77f30 2024-07-24T22:12:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.905+0000 7f6b07824740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae000f1f0 con 0x559578f6bfa0 2024-07-24T22:12:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.905+0000 7f6b07824740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae000cfe0 con 0x559578f6b680 2024-07-24T22:12:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.907+0000 7f6afeffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f83dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.912+0000 7f6aff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f8f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.912+0000 7f6aff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f8f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34670/0 (socket says 172.21.15.47:34670) 2024-07-24T22:12:30.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.912+0000 7f6aff7fe640 1 -- 172.21.15.47:0/1824446598 learned_addr learned my addr 172.21.15.47:0/1824446598 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:30.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.913+0000 7f6aff7fe640 1 -- 172.21.15.47:0/1824446598 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 msgr2=0x559578f83dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:30.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.913+0000 7f6aff7fe640 1 --2- 172.21.15.47:0/1824446598 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f83dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.913+0000 7f6aff7fe640 1 -- 172.21.15.47:0/1824446598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 msgr2=0x559578f6a940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:12:30.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.913+0000 7f6aff7fe640 1 --2- 172.21.15.47:0/1824446598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 0x559578f6a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.913+0000 7f6aff7fe640 1 -- 172.21.15.47:0/1824446598 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559578f77bf0 con 0x559578f77f30 2024-07-24T22:12:30.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.913+0000 7f6aff7fe640 1 --2- 172.21.15.47:0/1824446598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f8f7c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009230 tx=0x7f6af8031570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1837e99f1cb63f74 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:30.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.914+0000 7f6af4ff9640 1 -- 172.21.15.47:0/1824446598 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8065070 con 0x559578f77f30 2024-07-24T22:12:30.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.914+0000 7f6af4ff9640 1 -- 172.21.15.47:0/1824446598 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6af8051070 con 0x559578f77f30 2024-07-24T22:12:30.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.914+0000 7f6af4ff9640 1 -- 172.21.15.47:0/1824446598 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8035070 con 0x559578f77f30 2024-07-24T22:12:30.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.917+0000 7f6b07824740 1 -- 172.21.15.47:0/1824446598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 msgr2=0x559578f8f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:30.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.917+0000 7f6b07824740 1 --2- 172.21.15.47:0/1824446598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f8f7c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009230 tx=0x7f6af8031570 comp rx=0 tx=0).stop 2024-07-24T22:12:30.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.919+0000 7f6b07824740 1 -- 172.21.15.47:0/1824446598 shutdown_connections 2024-07-24T22:12:30.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.919+0000 7f6b07824740 1 --2- 172.21.15.47:0/1824446598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f8f7c0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.919+0000 7f6b07824740 1 --2- 172.21.15.47:0/1824446598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 0x559578f6a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.919+0000 7f6b07824740 1 --2- 172.21.15.47:0/1824446598 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f83dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.919+0000 7f6b07824740 1 -- 172.21.15.47:0/1824446598 >> 172.21.15.47:0/1824446598 conn(0x559578f694b0 msgr2=0x559578f6a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.926+0000 7f6b07824740 1 -- 172.21.15.47:0/1824446598 shutdown_connections 2024-07-24T22:12:30.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.931+0000 7f6b07824740 1 -- 172.21.15.47:0/1824446598 wait complete. 2024-07-24T22:12:30.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.932+0000 7f6b07824740 1 -- start start 2024-07-24T22:12:30.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.933+0000 7f6b07824740 1 Processor -- start 2024-07-24T22:12:30.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.934+0000 7f6b07824740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f7b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.934+0000 7f6b07824740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 0x559578f7b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.935+0000 7f6b07824740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f7bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.935+0000 7f6b07824740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae000d6b0 con 0x559578f77f30 2024-07-24T22:12:30.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.935+0000 7f6b07824740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae000eb20 con 0x559578f6bfa0 2024-07-24T22:12:30.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.935+0000 7f6b07824740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae000dd80 con 0x559578f6b680 2024-07-24T22:12:30.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.935+0000 7f6b07824740 10 client.0 _ll_register_callbacks cb 0x7f6af8031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:30.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.935+0000 7f6afeffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f7b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.935+0000 7f6afeffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f7b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:59146/0 (socket says 172.21.15.47:59146) 2024-07-24T22:12:30.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.935+0000 7f6afeffd640 1 -- 172.21.15.47:0/1625550602 learned_addr learned my addr 172.21.15.47:0/1625550602 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:30.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.937+0000 7f6af7fff640 1 --2- 172.21.15.47:0/1625550602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 0x559578f7b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.937+0000 7f6aff7fe640 1 --2- 172.21.15.47:0/1625550602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f7bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.938+0000 7f6afeffd640 1 -- 172.21.15.47:0/1625550602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 msgr2=0x559578f7b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:30.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.938+0000 7f6afeffd640 1 --2- 172.21.15.47:0/1625550602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 0x559578f7b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.938+0000 7f6afeffd640 1 -- 172.21.15.47:0/1625550602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 msgr2=0x559578f7bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:30.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.938+0000 7f6afeffd640 1 --2- 172.21.15.47:0/1625550602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f7bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.938+0000 7f6afeffd640 1 -- 172.21.15.47:0/1625550602 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559578f7f880 con 0x559578f6b680 2024-07-24T22:12:30.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.939+0000 7f6afeffd640 1 --2- 172.21.15.47:0/1625550602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f7b480 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6af00aa220 tx=0x7f6af00e5850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9518307e7a0574e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:30.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.939+0000 7f6ae67fc640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:12:30.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.940+0000 7f6ae67fc640 1 -- 172.21.15.47:0/1625550602 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af00e0d10 con 0x559578f6b680 2024-07-24T22:12:30.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.940+0000 7f6ae67fc640 1 -- 172.21.15.47:0/1625550602 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f6af00a62f0 con 0x559578f6b680 2024-07-24T22:12:30.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.941+0000 7f6b07824740 1 -- 172.21.15.47:0/1625550602 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6af8051070 con 0x559578f6b680 2024-07-24T22:12:30.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.942+0000 7f6ae67fc640 1 -- 172.21.15.47:0/1625550602 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6af00b2c80 con 0x559578f6b680 2024-07-24T22:12:30.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.942+0000 7f6b07824740 10 client.25978 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:30.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.942+0000 7f6b07824740 1 -- 172.21.15.47:0/1625550602 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559578ff2cb0 con 0x559578f6b680 2024-07-24T22:12:30.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.943+0000 7f6ae67fc640 1 -- 172.21.15.47:0/1625550602 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6af00b2e20 con 0x559578f6b680 2024-07-24T22:12:30.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.944+0000 7f6ae67fc640 1 -- 172.21.15.47:0/1625550602 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6af00bd070 con 0x559578f6b680 2024-07-24T22:12:30.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.945+0000 7f6b07824740 10 client.25978 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:30.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.945+0000 7f6b07824740 10 client.25978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:30.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.946+0000 7f6b07824740 20 client.25978 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:30.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.946+0000 7f6b07824740 1 --2- 172.21.15.47:0/1625550602 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559578ff33e0 0x559578ff5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:30.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.946+0000 7f6b07824740 4 client.25978 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:12:30.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.947+0000 7f6b07824740 1 -- 172.21.15.47:0/1625550602 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f6af8051070 con 0x559578ff33e0 2024-07-24T22:12:30.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.952+0000 7f6af7fff640 1 --2- 172.21.15.47:0/1625550602 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559578ff33e0 0x559578ff5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:30.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.953+0000 7f6af7fff640 1 --2- 172.21.15.47:0/1625550602 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559578ff33e0 0x559578ff5800 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a137493fe4795d69 server_cookie=52c25170dbd9b927 in_seq=0 out_seq=0 2024-07-24T22:12:30.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.953+0000 7f6ae67fc640 10 client.25978 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.956+0000 7f6ae67fc640 1 -- 172.21.15.47:0/1625550602 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f6af8051070 con 0x559578ff33e0 2024-07-24T22:12:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.956+0000 7f6ae67fc640 10 client.25978 handle_command_reply: tid=0 2024-07-24T22:12:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.956+0000 7f6b07824740 1 client.25978 shutdown 2024-07-24T22:12:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.956+0000 7f6b07824740 1 -- 172.21.15.47:0/1625550602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 msgr2=0x559578f7b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.956+0000 7f6b07824740 1 --2- 172.21.15.47:0/1625550602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f7b480 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6af00aa220 tx=0x7f6af00e5850 comp rx=0 tx=0).stop 2024-07-24T22:12:30.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.959+0000 7f6b07824740 1 -- 172.21.15.47:0/1625550602 shutdown_connections 2024-07-24T22:12:30.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.959+0000 7f6b07824740 1 --2- 172.21.15.47:0/1625550602 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x559578ff33e0 0x559578ff5800 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.959+0000 7f6b07824740 1 --2- 172.21.15.47:0/1625550602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559578f77f30 0x559578f7bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.959+0000 7f6ae67fc640 0 client.25978 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:30.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.959+0000 7f6b07824740 1 --2- 172.21.15.47:0/1625550602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559578f6bfa0 0x559578f7b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.959+0000 7f6b07824740 1 --2- 172.21.15.47:0/1625550602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559578f6b680 0x559578f7b480 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.959+0000 7f6b07824740 1 -- 172.21.15.47:0/1625550602 >> 172.21.15.47:0/1625550602 conn(0x559578f694b0 msgr2=0x559578f6aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:30.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.960+0000 7f6b07824740 1 -- 172.21.15.47:0/1625550602 shutdown_connections 2024-07-24T22:12:30.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.960+0000 7f6b07824740 1 -- 172.21.15.47:0/1625550602 wait complete. 2024-07-24T22:12:30.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.960+0000 7f6b07824740 20 client.25978 trim_cache size 0 max 16384 2024-07-24T22:12:30.964 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:12:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:12:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:12:30.964 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:12:30.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.962+0000 7f6b05473640 1 -- 172.21.15.47:0/1014505400 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aec0b3e90 msgr2=0x7f6aec0b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:30.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.962+0000 7f6b05473640 1 --2- 172.21.15.47:0/1014505400 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aec0b3e90 0x7f6aec0b6350 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6af8005d70 tx=0x7f6af8005fd0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.962+0000 7f6b05473640 1 -- 172.21.15.47:0/1014505400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b001011c0 msgr2=0x7f6b00197140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:30.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.962+0000 7f6b05473640 1 --2- 172.21.15.47:0/1014505400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b001011c0 0x7f6b00197140 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6af000ba50 tx=0x7f6af000bf10 comp rx=0 tx=0).stop 2024-07-24T22:12:30.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.962+0000 7f6b05473640 1 -- 172.21.15.47:0/1014505400 shutdown_connections 2024-07-24T22:12:30.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.962+0000 7f6b05473640 1 --2- 172.21.15.47:0/1014505400 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6aec0b3e90 0x7f6aec0b6350 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.962+0000 7f6b05473640 1 --2- 172.21.15.47:0/1014505400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b00103f90 0x7f6b0019c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.962+0000 7f6b05473640 1 --2- 172.21.15.47:0/1014505400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b001035f0 0x7f6b00197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.962+0000 7f6b05473640 1 --2- 172.21.15.47:0/1014505400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b001011c0 0x7f6b00197140 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:30.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.962+0000 7f6b05473640 1 -- 172.21.15.47:0/1014505400 >> 172.21.15.47:0/1014505400 conn(0x7f6b00076980 msgr2=0x7f6b00104760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:30.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.962+0000 7f6b05473640 1 -- 172.21.15.47:0/1014505400 shutdown_connections 2024-07-24T22:12:30.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:30.962+0000 7f6b05473640 1 -- 172.21.15.47:0/1014505400 wait complete. 2024-07-24T22:12:31.030 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:30 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:12:31.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:30 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:12:31.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:30 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:12:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:31 smithi183 ceph-mon[37007]: pgmap v525: 97 pgs: 97 active+clean; 44 GiB data, 133 GiB used, 940 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 465 MiB/s wr, 1.37k op/s 2024-07-24T22:12:32.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:31 smithi047 ceph-mon[32551]: pgmap v525: 97 pgs: 97 active+clean; 44 GiB data, 133 GiB used, 940 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 465 MiB/s wr, 1.37k op/s 2024-07-24T22:12:32.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:31 smithi188 ceph-mon[37380]: pgmap v525: 97 pgs: 97 active+clean; 44 GiB data, 133 GiB used, 940 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 465 MiB/s wr, 1.37k op/s 2024-07-24T22:12:32.585 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:12:32.585 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:12:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:12:33.939 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:33 smithi047 ceph-mon[32551]: pgmap v526: 97 pgs: 97 active+clean; 44 GiB data, 134 GiB used, 939 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 437 MiB/s wr, 949 op/s 2024-07-24T22:12:34.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:33 smithi183 ceph-mon[37007]: pgmap v526: 97 pgs: 97 active+clean; 44 GiB data, 134 GiB used, 939 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 437 MiB/s wr, 949 op/s 2024-07-24T22:12:34.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:33 smithi188 ceph-mon[37380]: pgmap v526: 97 pgs: 97 active+clean; 44 GiB data, 134 GiB used, 939 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 437 MiB/s wr, 949 op/s 2024-07-24T22:12:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.785+0000 7f3ce1ea9640 1 -- 172.21.15.47:0/1086893742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cdc1035d0 msgr2=0x7f3cdc1039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.785+0000 7f3ce1ea9640 1 --2- 172.21.15.47:0/1086893742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cdc1035d0 0x7f3cdc1039b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009900 tx=0x7f3ccc02a410 comp rx=0 tx=0).stop 2024-07-24T22:12:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.785+0000 7f3ce1ea9640 1 -- 172.21.15.47:0/1086893742 shutdown_connections 2024-07-24T22:12:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.785+0000 7f3ce1ea9640 1 --2- 172.21.15.47:0/1086893742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cdc10c9f0 0x7f3cdc10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.785+0000 7f3ce1ea9640 1 --2- 172.21.15.47:0/1086893742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cdc103ef0 0x7f3cdc10c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.785+0000 7f3ce1ea9640 1 --2- 172.21.15.47:0/1086893742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cdc1035d0 0x7f3cdc1039b0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.785+0000 7f3ce1ea9640 1 -- 172.21.15.47:0/1086893742 >> 172.21.15.47:0/1086893742 conn(0x7f3cdc0782e0 msgr2=0x7f3cdc0ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.785+0000 7f3ce1ea9640 1 -- 172.21.15.47:0/1086893742 shutdown_connections 2024-07-24T22:12:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.785+0000 7f3ce1ea9640 1 -- 172.21.15.47:0/1086893742 wait complete. 2024-07-24T22:12:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.786+0000 7f3ce1ea9640 1 Processor -- start 2024-07-24T22:12:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.786+0000 7f3ce1ea9640 1 -- start start 2024-07-24T22:12:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.786+0000 7f3ce1ea9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cdc1035d0 0x7f3cdc198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.786+0000 7f3ce1ea9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cdc103ef0 0x7f3cdc199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.786+0000 7f3ce1ea9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cdc10c9f0 0x7f3cdc19e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.786+0000 7f3ce1ea9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc112660 con 0x7f3cdc1035d0 2024-07-24T22:12:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3ce1ea9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc1124e0 con 0x7f3cdc103ef0 2024-07-24T22:12:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3ce1ea9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc1127e0 con 0x7f3cdc10c9f0 2024-07-24T22:12:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3cdaffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cdc103ef0 0x7f3cdc199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3cdbfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cdc10c9f0 0x7f3cdc19e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3cdaffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cdc103ef0 0x7f3cdc199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:55282/0 (socket says 172.21.15.47:55282) 2024-07-24T22:12:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3cdaffd640 1 -- 172.21.15.47:0/1249928653 learned_addr learned my addr 172.21.15.47:0/1249928653 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cdc1035d0 0x7f3cdc198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3cdbfff640 1 -- 172.21.15.47:0/1249928653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cdc103ef0 msgr2=0x7f3cdc199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3cdbfff640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cdc103ef0 0x7f3cdc199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3cdbfff640 1 -- 172.21.15.47:0/1249928653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cdc1035d0 msgr2=0x7f3cdc198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3cdbfff640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cdc1035d0 0x7f3cdc198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3cdbfff640 1 -- 172.21.15.47:0/1249928653 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc19eca0 con 0x7f3cdc10c9f0 2024-07-24T22:12:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3cdaffd640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cdc103ef0 0x7f3cdc199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.787+0000 7f3cdbfff640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cdc10c9f0 0x7f3cdc19e4d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009fd0 tx=0x7f3cd400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.788+0000 7f3cd8ff9640 1 -- 172.21.15.47:0/1249928653 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400ce20 con 0x7f3cdc10c9f0 2024-07-24T22:12:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.788+0000 7f3ce1ea9640 1 -- 172.21.15.47:0/1249928653 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cdc19ef90 con 0x7f3cdc10c9f0 2024-07-24T22:12:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.788+0000 7f3ce1ea9640 1 -- 172.21.15.47:0/1249928653 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cdc1a5650 con 0x7f3cdc10c9f0 2024-07-24T22:12:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.788+0000 7f3cd8ff9640 1 -- 172.21.15.47:0/1249928653 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cd4005020 con 0x7f3cdc10c9f0 2024-07-24T22:12:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.788+0000 7f3cd8ff9640 1 -- 172.21.15.47:0/1249928653 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4010690 con 0x7f3cdc10c9f0 2024-07-24T22:12:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.791+0000 7f3cd8ff9640 1 -- 172.21.15.47:0/1249928653 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f3cd4010830 con 0x7f3cdc10c9f0 2024-07-24T22:12:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.792+0000 7f3ce4c01740 1 Processor -- start 2024-07-24T22:12:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.792+0000 7f3ce4c01740 1 -- start start 2024-07-24T22:12:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.792+0000 7f3ce4c01740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x561597759ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.792+0000 7f3ce4c01740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159775a1e0 0x561597765c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.792+0000 7f3ce4c01740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597766170 0x561597768560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.792+0000 7f3ce4c01740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5615976cf280 con 0x56159775a1e0 2024-07-24T22:12:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.792+0000 7f3ce4c01740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5615976be780 con 0x5615977598c0 2024-07-24T22:12:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.792+0000 7f3ce4c01740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5615976c27c0 con 0x561597766170 2024-07-24T22:12:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.792+0000 7f3cdaffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x561597759ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.792+0000 7f3cdaffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x561597759ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:55288/0 (socket says 172.21.15.47:55288) 2024-07-24T22:12:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.792+0000 7f3cdaffd640 1 -- 172.21.15.47:0/3613403351 learned_addr learned my addr 172.21.15.47:0/3613403351 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.792+0000 7f3cdaffd640 1 --2- 172.21.15.47:0/3613403351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597766170 0x561597768560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cdaffd640 1 -- 172.21.15.47:0/3613403351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597766170 msgr2=0x561597768560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cdaffd640 1 --2- 172.21.15.47:0/3613403351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597766170 0x561597768560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cdaffd640 1 -- 172.21.15.47:0/3613403351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159775a1e0 msgr2=0x561597765c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/3613403351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159775a1e0 0x561597765c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cdaffd640 1 --2- 172.21.15.47:0/3613403351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159775a1e0 0x561597765c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cdaffd640 1 -- 172.21.15.47:0/3613403351 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561597422790 con 0x5615977598c0 2024-07-24T22:12:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/3613403351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159775a1e0 0x561597765c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:12:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cd8ff9640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3cc40b3dc0 0x7f3cc40b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cdaffd640 1 --2- 172.21.15.47:0/3613403351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x561597759ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0011c70 tx=0x7f3cd0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fce917996278346e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cc1ffb640 1 -- 172.21.15.47:0/3613403351 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000fc50 con 0x5615977598c0 2024-07-24T22:12:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cd8ff9640 1 -- 172.21.15.47:0/1249928653 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f3cd40e4550 con 0x7f3cdc10c9f0 2024-07-24T22:12:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cc1ffb640 1 -- 172.21.15.47:0/3613403351 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cd000fdf0 con 0x5615977598c0 2024-07-24T22:12:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cc1ffb640 1 -- 172.21.15.47:0/3613403351 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0004da0 con 0x5615977598c0 2024-07-24T22:12:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.793+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3cc40b3dc0 0x7f3cc40b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.794+0000 7f3ce4c01740 1 -- 172.21.15.47:0/3613403351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 msgr2=0x561597759ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.794+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/3613403351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x561597759ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0011c70 tx=0x7f3cd0004730 comp rx=0 tx=0).stop 2024-07-24T22:12:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.794+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3cc40b3dc0 0x7f3cc40b6280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc031440 tx=0x7f3ccc005b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.795+0000 7f3ce4c01740 1 -- 172.21.15.47:0/3613403351 shutdown_connections 2024-07-24T22:12:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.795+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/3613403351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597766170 0x561597768560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.795+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/3613403351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159775a1e0 0x561597765c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.795+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/3613403351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x561597759ca0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.795+0000 7f3ce4c01740 1 -- 172.21.15.47:0/3613403351 >> 172.21.15.47:0/3613403351 conn(0x5615977576f0 msgr2=0x561597758890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.795+0000 7f3ce4c01740 1 -- 172.21.15.47:0/3613403351 shutdown_connections 2024-07-24T22:12:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.795+0000 7f3ce4c01740 1 -- 172.21.15.47:0/3613403351 wait complete. 2024-07-24T22:12:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.795+0000 7f3ce4c01740 1 -- start start 2024-07-24T22:12:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.796+0000 7f3ce4c01740 1 Processor -- start 2024-07-24T22:12:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.796+0000 7f3ce4c01740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x561597765850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.796+0000 7f3ce4c01740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159775a1e0 0x561597762d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.796+0000 7f3ce4c01740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597766170 0x561597763270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.796+0000 7f3cdaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159775a1e0 0x561597762d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3cdb7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x561597765850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3cdaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159775a1e0 0x561597762d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36880/0 (socket says 172.21.15.47:36880) 2024-07-24T22:12:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3cdb7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x561597765850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:55300/0 (socket says 172.21.15.47:55300) 2024-07-24T22:12:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3cdbfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597766170 0x561597763270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3cdbfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597766170 0x561597763270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:38152/0 (socket says 172.21.15.47:38152) 2024-07-24T22:12:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3cdaffd640 1 -- 172.21.15.47:0/794232056 learned_addr learned my addr 172.21.15.47:0/794232056 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3ce4c01740 1 -- 172.21.15.47:0/794232056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5615975f8ab0 con 0x56159775a1e0 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3ce4c01740 1 -- 172.21.15.47:0/794232056 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5615976469e0 con 0x5615977598c0 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3ce4c01740 1 -- 172.21.15.47:0/794232056 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561597768e50 con 0x561597766170 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3ce4c01740 10 client.0 _ll_register_callbacks cb 0x5615973cea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3cdaffd640 1 -- 172.21.15.47:0/794232056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597766170 msgr2=0x561597763270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3cdaffd640 1 --2- 172.21.15.47:0/794232056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597766170 0x561597763270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3cdaffd640 1 -- 172.21.15.47:0/794232056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 msgr2=0x561597765850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3cdaffd640 1 --2- 172.21.15.47:0/794232056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x561597765850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3cdaffd640 1 -- 172.21.15.47:0/794232056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56159749b620 con 0x56159775a1e0 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/794232056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x561597765850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.797+0000 7f3cdaffd640 1 --2- 172.21.15.47:0/794232056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159775a1e0 0x561597762d30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009dd0 tx=0x7f3cd0004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8062f5e1c0a393f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.798+0000 7f3cbaffd640 10 client.16620 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.798+0000 7f3ce4c01740 1 -- 172.21.15.47:0/794232056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56159766dce0 con 0x56159775a1e0 2024-07-24T22:12:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.798+0000 7f3cbaffd640 1 -- 172.21.15.47:0/794232056 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0004d00 con 0x56159775a1e0 2024-07-24T22:12:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.798+0000 7f3cbaffd640 1 -- 172.21.15.47:0/794232056 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f3cd0019040 con 0x56159775a1e0 2024-07-24T22:12:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.798+0000 7f3cbaffd640 1 -- 172.21.15.47:0/794232056 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3cd0035050 con 0x56159775a1e0 2024-07-24T22:12:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.798+0000 7f3ce4c01740 10 client.16620 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.798+0000 7f3ce4c01740 1 -- 172.21.15.47:0/794232056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({fsmap=20}) -- 0x5615977787e0 con 0x56159775a1e0 2024-07-24T22:12:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.799+0000 7f3cbaffd640 1 -- 172.21.15.47:0/794232056 <== mon.0 v2:172.21.15.47:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3cd0030030 con 0x56159775a1e0 2024-07-24T22:12:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.799+0000 7f3ce4c01740 10 client.16620 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.799+0000 7f3ce4c01740 10 client.16620 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.799+0000 7f3ce4c01740 20 client.16620 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.799+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/794232056 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561597779b90 0x56159777bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.799+0000 7f3ce4c01740 4 client.16620 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:12:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.799+0000 7f3ce4c01740 1 -- 172.21.15.47:0/794232056 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56159766dce0 con 0x561597779b90 2024-07-24T22:12:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.799+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/794232056 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561597779b90 0x56159777bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.800+0000 7f3cbaffd640 10 client.16620 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.800+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/794232056 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561597779b90 0x56159777bf80 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7daee9be562dd5bb server_cookie=d2dcd233f368449 in_seq=0 out_seq=0 2024-07-24T22:12:35.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.800+0000 7f3cbaffd640 1 -- 172.21.15.47:0/794232056 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56159766dce0 con 0x561597779b90 2024-07-24T22:12:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.800+0000 7f3cbaffd640 10 client.16620 handle_command_reply: tid=0 2024-07-24T22:12:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.800+0000 7f3ce4c01740 1 client.16620 shutdown 2024-07-24T22:12:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.801+0000 7f3ce4c01740 1 -- 172.21.15.47:0/794232056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159775a1e0 msgr2=0x561597762d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.801+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/794232056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159775a1e0 0x561597762d30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009dd0 tx=0x7f3cd0004a20 comp rx=0 tx=0).stop 2024-07-24T22:12:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.801+0000 7f3ce4c01740 1 -- 172.21.15.47:0/794232056 shutdown_connections 2024-07-24T22:12:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.801+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/794232056 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561597779b90 0x56159777bf80 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.801+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/794232056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597766170 0x561597763270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.801+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/794232056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159775a1e0 0x561597762d30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.801+0000 7f3cbaffd640 0 client.16620 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.801+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/794232056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x561597765850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.801+0000 7f3ce4c01740 1 -- 172.21.15.47:0/794232056 >> 172.21.15.47:0/794232056 conn(0x5615977576f0 msgr2=0x56159775d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.801+0000 7f3ce4c01740 1 -- 172.21.15.47:0/794232056 shutdown_connections 2024-07-24T22:12:35.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.801+0000 7f3ce4c01740 1 -- 172.21.15.47:0/794232056 wait complete. 2024-07-24T22:12:35.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.801+0000 7f3ce4c01740 20 client.16620 trim_cache size 0 max 16384 2024-07-24T22:12:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3ce4c01740 1 Processor -- start 2024-07-24T22:12:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3ce4c01740 1 -- start start 2024-07-24T22:12:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3ce4c01740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x5615977816a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3ce4c01740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561597766170 0x561597781be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3ce4c01740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597763440 0x561597758590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3ce4c01740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc800c7f0 con 0x561597766170 2024-07-24T22:12:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3ce4c01740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc800f070 con 0x5615977598c0 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3ce4c01740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc800ce60 con 0x561597763440 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3cdb7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x5615977816a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3cdb7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x5615977816a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:55302/0 (socket says 172.21.15.47:55302) 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3cdb7fe640 1 -- 172.21.15.47:0/3316578349 learned_addr learned my addr 172.21.15.47:0/3316578349 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3cdbfff640 1 --2- 172.21.15.47:0/3316578349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597763440 0x561597758590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3cdaffd640 1 --2- 172.21.15.47:0/3316578349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561597766170 0x561597781be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3cdb7fe640 1 -- 172.21.15.47:0/3316578349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597763440 msgr2=0x561597758590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/3316578349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597763440 0x561597758590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3cdb7fe640 1 -- 172.21.15.47:0/3316578349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561597766170 msgr2=0x561597781be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/3316578349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561597766170 0x561597781be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3cdb7fe640 1 -- 172.21.15.47:0/3316578349 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561597763c30 con 0x5615977598c0 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.819+0000 7f3cdaffd640 1 --2- 172.21.15.47:0/3316578349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561597766170 0x561597781be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.820+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/3316578349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x5615977816a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009900 tx=0x7f3ccc040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=debb2043239d52f8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.820+0000 7f3cc17fa640 1 -- 172.21.15.47:0/3316578349 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc055070 con 0x5615977598c0 2024-07-24T22:12:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.820+0000 7f3cc17fa640 1 -- 172.21.15.47:0/3316578349 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ccc0318a0 con 0x5615977598c0 2024-07-24T22:12:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.820+0000 7f3cc17fa640 1 -- 172.21.15.47:0/3316578349 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc035040 con 0x5615977598c0 2024-07-24T22:12:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.821+0000 7f3ce4c01740 1 -- 172.21.15.47:0/3316578349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 msgr2=0x5615977816a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.821+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/3316578349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x5615977816a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009900 tx=0x7f3ccc040000 comp rx=0 tx=0).stop 2024-07-24T22:12:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.821+0000 7f3ce4c01740 1 -- 172.21.15.47:0/3316578349 shutdown_connections 2024-07-24T22:12:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.821+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/3316578349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561597763440 0x561597758590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.821+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/3316578349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561597766170 0x561597781be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.821+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/3316578349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5615977598c0 0x5615977816a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.821+0000 7f3ce4c01740 1 -- 172.21.15.47:0/3316578349 >> 172.21.15.47:0/3316578349 conn(0x5615977576f0 msgr2=0x561597762d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.821+0000 7f3ce4c01740 1 -- 172.21.15.47:0/3316578349 shutdown_connections 2024-07-24T22:12:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.821+0000 7f3ce4c01740 1 -- 172.21.15.47:0/3316578349 wait complete. 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.821+0000 7f3ce4c01740 1 -- start start 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.822+0000 7f3ce4c01740 1 Processor -- start 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.822+0000 7f3ce4c01740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5615977598c0 0x56159776b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.822+0000 7f3ce4c01740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561597766170 0x56159776b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.822+0000 7f3ce4c01740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159776bdb0 0x5615977e2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.822+0000 7f3ce4c01740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc800d530 con 0x56159776bdb0 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.822+0000 7f3ce4c01740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc800e9a0 con 0x561597766170 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.822+0000 7f3ce4c01740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc800dc00 con 0x5615977598c0 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.822+0000 7f3ce4c01740 10 client.0 _ll_register_callbacks cb 0x7f3cd0009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.822+0000 7f3cdb7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5615977598c0 0x56159776b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.822+0000 7f3cdb7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5615977598c0 0x56159776b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:38172/0 (socket says 172.21.15.47:38172) 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.822+0000 7f3cdb7fe640 1 -- 172.21.15.47:0/1534163161 learned_addr learned my addr 172.21.15.47:0/1534163161 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.822+0000 7f3cdbfff640 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159776bdb0 0x5615977e2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.822+0000 7f3cdaffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561597766170 0x56159776b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.823+0000 7f3cdb7fe640 1 -- 172.21.15.47:0/1534163161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561597766170 msgr2=0x56159776b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.823+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561597766170 0x56159776b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.823+0000 7f3cdb7fe640 1 -- 172.21.15.47:0/1534163161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159776bdb0 msgr2=0x5615977e2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.823+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159776bdb0 0x5615977e2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.823+0000 7f3cdb7fe640 1 -- 172.21.15.47:0/1534163161 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615977e2de0 con 0x5615977598c0 2024-07-24T22:12:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.823+0000 7f3cdbfff640 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159776bdb0 0x5615977e2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.823+0000 7f3cdaffd640 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561597766170 0x56159776b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.823+0000 7f3cdb7fe640 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5615977598c0 0x56159776b2e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc02a930 tx=0x7f3ccc005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=578160f90006d355 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.823+0000 7f3cbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:12:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.823+0000 7f3cbaffd640 1 -- 172.21.15.47:0/1534163161 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc055070 con 0x5615977598c0 2024-07-24T22:12:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.823+0000 7f3cbaffd640 1 -- 172.21.15.47:0/1534163161 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f3ccc005250 con 0x5615977598c0 2024-07-24T22:12:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.823+0000 7f3ce4c01740 1 -- 172.21.15.47:0/1534163161 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ccc0318a0 con 0x5615977598c0 2024-07-24T22:12:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.824+0000 7f3cbaffd640 1 -- 172.21.15.47:0/1534163161 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3ccc035070 con 0x5615977598c0 2024-07-24T22:12:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.824+0000 7f3ce4c01740 10 client.25996 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.824+0000 7f3ce4c01740 1 -- 172.21.15.47:0/1534163161 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5615977743b0 con 0x5615977598c0 2024-07-24T22:12:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.824+0000 7f3cbaffd640 1 -- 172.21.15.47:0/1534163161 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ccc0318a0 con 0x5615977598c0 2024-07-24T22:12:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.824+0000 7f3cbaffd640 1 -- 172.21.15.47:0/1534163161 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3ccc062020 con 0x5615977598c0 2024-07-24T22:12:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.824+0000 7f3ce4c01740 10 client.25996 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.824+0000 7f3ce4c01740 10 client.25996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.824+0000 7f3ce4c01740 20 client.25996 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.824+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561597774be0 0x561597777000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.824+0000 7f3ce4c01740 4 client.25996 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:12:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.824+0000 7f3ce4c01740 1 -- 172.21.15.47:0/1534163161 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5615976d11d0 con 0x561597774be0 2024-07-24T22:12:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.824+0000 7f3cdaffd640 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561597774be0 0x561597777000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.825+0000 7f3cdaffd640 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561597774be0 0x561597777000 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8ce3f3555fa2541 server_cookie=e7b77fe7e18270e2 in_seq=0 out_seq=0 2024-07-24T22:12:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:35.825+0000 7f3cbaffd640 10 client.25996 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:36.108 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:35 smithi047 ceph-mon[32551]: pgmap v527: 97 pgs: 97 active+clean; 45 GiB data, 137 GiB used, 936 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 544 MiB/s wr, 1.04k op/s 2024-07-24T22:12:36.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:35 smithi183 ceph-mon[37007]: pgmap v527: 97 pgs: 97 active+clean; 45 GiB data, 137 GiB used, 936 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 544 MiB/s wr, 1.04k op/s 2024-07-24T22:12:36.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:35 smithi188 ceph-mon[37380]: pgmap v527: 97 pgs: 97 active+clean; 45 GiB data, 137 GiB used, 936 GiB / 1.0 TiB avail; 3.8 MiB/s rd, 544 MiB/s wr, 1.04k op/s 2024-07-24T22:12:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.547+0000 7f81294c5640 1 -- 172.21.15.47:0/1979298654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8124101670 msgr2=0x7f8124101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.547+0000 7f81294c5640 1 --2- 172.21.15.47:0/1979298654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8124101670 0x7f8124101a50 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8114009860 tx=0x7f811402a340 comp rx=0 tx=0).stop 2024-07-24T22:12:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.547+0000 7f81294c5640 1 -- 172.21.15.47:0/1979298654 shutdown_connections 2024-07-24T22:12:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.547+0000 7f81294c5640 1 --2- 172.21.15.47:0/1979298654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8124107a00 0x7f812410e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.547+0000 7f81294c5640 1 --2- 172.21.15.47:0/1979298654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8124107080 0x7f81241074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.547+0000 7f81294c5640 1 --2- 172.21.15.47:0/1979298654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8124101670 0x7f8124101a50 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.547+0000 7f81294c5640 1 -- 172.21.15.47:0/1979298654 >> 172.21.15.47:0/1979298654 conn(0x7f81240fd0e0 msgr2=0x7f81240ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:36.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.547+0000 7f81294c5640 1 -- 172.21.15.47:0/1979298654 shutdown_connections 2024-07-24T22:12:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.547+0000 7f81294c5640 1 -- 172.21.15.47:0/1979298654 wait complete. 2024-07-24T22:12:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.548+0000 7f81294c5640 1 Processor -- start 2024-07-24T22:12:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.548+0000 7f81294c5640 1 -- start start 2024-07-24T22:12:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.548+0000 7f81294c5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8124101670 0x7f812410ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.548+0000 7f81294c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8124107080 0x7f812410f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.548+0000 7f81294c5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8124107a00 0x7f812410f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.548+0000 7f81294c5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f81241127e0 con 0x7f8124101670 2024-07-24T22:12:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.548+0000 7f81294c5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8124112660 con 0x7f8124107a00 2024-07-24T22:12:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.548+0000 7f81294c5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8124112960 con 0x7f8124107080 2024-07-24T22:12:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.549+0000 7f8122ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8124101670 0x7f812410ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.549+0000 7f8122ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8124101670 0x7f812410ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36934/0 (socket says 172.21.15.47:36934) 2024-07-24T22:12:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.549+0000 7f8122ffd640 1 -- 172.21.15.47:0/4003354154 learned_addr learned my addr 172.21.15.47:0/4003354154 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:36.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.549+0000 7f81237fe640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8124107a00 0x7f812410f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:36.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.549+0000 7f811bfff640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8124107080 0x7f812410f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:36.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.549+0000 7f811bfff640 1 -- 172.21.15.47:0/4003354154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8124107a00 msgr2=0x7f812410f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.549+0000 7f811bfff640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8124107a00 0x7f812410f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.549+0000 7f811bfff640 1 -- 172.21.15.47:0/4003354154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8124101670 msgr2=0x7f812410ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.549+0000 7f811bfff640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8124101670 0x7f812410ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.549+0000 7f811bfff640 1 -- 172.21.15.47:0/4003354154 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81241a7090 con 0x7f8124107080 2024-07-24T22:12:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.549+0000 7f8122ffd640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8124101670 0x7f812410ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.550+0000 7f811bfff640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8124107080 0x7f812410f250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f810c00e790 tx=0x7f810c00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.550+0000 7f8120ff9640 1 -- 172.21.15.47:0/4003354154 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c00eea0 con 0x7f8124107080 2024-07-24T22:12:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.550+0000 7f81294c5640 1 -- 172.21.15.47:0/4003354154 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81241a7380 con 0x7f8124107080 2024-07-24T22:12:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.550+0000 7f8120ff9640 1 -- 172.21.15.47:0/4003354154 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f810c00ccc0 con 0x7f8124107080 2024-07-24T22:12:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.550+0000 7f81294c5640 1 -- 172.21.15.47:0/4003354154 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81241a7910 con 0x7f8124107080 2024-07-24T22:12:36.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.550+0000 7f8120ff9640 1 -- 172.21.15.47:0/4003354154 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c018680 con 0x7f8124107080 2024-07-24T22:12:36.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.552+0000 7f81294c5640 1 -- 172.21.15.47:0/4003354154 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8124101a50 con 0x7f8124107080 2024-07-24T22:12:36.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.554+0000 7f8120ff9640 1 -- 172.21.15.47:0/4003354154 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f810c010430 con 0x7f8124107080 2024-07-24T22:12:36.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.555+0000 7f8120ff9640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81100b3dc0 0x7f81100b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:36.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.555+0000 7f8122ffd640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81100b3dc0 0x7f81100b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:36.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.555+0000 7f8120ff9640 1 -- 172.21.15.47:0/4003354154 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f810c0e41e0 con 0x7f8124107080 2024-07-24T22:12:36.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.556+0000 7f8122ffd640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81100b3dc0 0x7f81100b6280 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f81140095f0 tx=0x7f8114030340 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:36.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.562+0000 7f8120ff9640 1 -- 172.21.15.47:0/4003354154 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f810c0ab4f0 con 0x7f8124107080 2024-07-24T22:12:36.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.942+0000 7f81294c5640 1 -- 172.21.15.47:0/4003354154 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f812402e000 con 0x7f8124107080 2024-07-24T22:12:36.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.974+0000 7f8120ff9640 1 -- 172.21.15.47:0/4003354154 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f810c0aadf0 con 0x7f8124107080 2024-07-24T22:12:36.978 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:12:36.978 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:12:36.979 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:12:36.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.983+0000 7f81294c5640 1 -- 172.21.15.47:0/4003354154 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81100b3dc0 msgr2=0x7f81100b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:36.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.983+0000 7f81294c5640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81100b3dc0 0x7f81100b6280 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f81140095f0 tx=0x7f8114030340 comp rx=0 tx=0).stop 2024-07-24T22:12:36.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.983+0000 7f81294c5640 1 -- 172.21.15.47:0/4003354154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8124107080 msgr2=0x7f812410f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:36.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.983+0000 7f81294c5640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8124107080 0x7f812410f250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f810c00e790 tx=0x7f810c00ec50 comp rx=0 tx=0).stop 2024-07-24T22:12:36.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.983+0000 7f81294c5640 1 -- 172.21.15.47:0/4003354154 shutdown_connections 2024-07-24T22:12:36.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.983+0000 7f81294c5640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81100b3dc0 0x7f81100b6280 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:36.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.983+0000 7f81294c5640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8124107a00 0x7f812410f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.983+0000 7f81294c5640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8124107080 0x7f812410f250 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.983+0000 7f81294c5640 1 --2- 172.21.15.47:0/4003354154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8124101670 0x7f812410ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.983+0000 7f81294c5640 1 -- 172.21.15.47:0/4003354154 >> 172.21.15.47:0/4003354154 conn(0x7f81240fd0e0 msgr2=0x7f81240ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.986+0000 7f81294c5640 1 -- 172.21.15.47:0/4003354154 shutdown_connections 2024-07-24T22:12:36.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:36.987+0000 7f81294c5640 1 -- 172.21.15.47:0/4003354154 wait complete. 2024-07-24T22:12:37.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:36 smithi188 ceph-mon[37380]: pgmap v528: 97 pgs: 97 active+clean; 46 GiB data, 139 GiB used, 934 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 533 MiB/s wr, 1.04k op/s 2024-07-24T22:12:37.405 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:36 smithi047 ceph-mon[32551]: pgmap v528: 97 pgs: 97 active+clean; 46 GiB data, 139 GiB used, 934 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 533 MiB/s wr, 1.04k op/s 2024-07-24T22:12:37.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:36 smithi183 ceph-mon[37007]: pgmap v528: 97 pgs: 97 active+clean; 46 GiB data, 139 GiB used, 934 GiB / 1.0 TiB avail; 3.5 MiB/s rd, 533 MiB/s wr, 1.04k op/s 2024-07-24T22:12:37.956 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:12:38.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:37 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/4003354154' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:12:38.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:37 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/4003354154' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:12:38.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:37 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/4003354154' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:12:38.940 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:12:39.308 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:39 smithi047 ceph-mon[32551]: pgmap v529: 97 pgs: 97 active+clean; 47 GiB data, 144 GiB used, 929 GiB / 1.0 TiB avail; 4.2 MiB/s rd, 625 MiB/s wr, 1.35k op/s 2024-07-24T22:12:39.413 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:39 smithi183 ceph-mon[37007]: pgmap v529: 97 pgs: 97 active+clean; 47 GiB data, 144 GiB used, 929 GiB / 1.0 TiB avail; 4.2 MiB/s rd, 625 MiB/s wr, 1.35k op/s 2024-07-24T22:12:39.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:39 smithi188 ceph-mon[37380]: pgmap v529: 97 pgs: 97 active+clean; 47 GiB data, 144 GiB used, 929 GiB / 1.0 TiB avail; 4.2 MiB/s rd, 625 MiB/s wr, 1.35k op/s 2024-07-24T22:12:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.625+0000 7f3cbaffd640 1 -- 172.21.15.47:0/1534163161 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5615976d11d0 con 0x561597774be0 2024-07-24T22:12:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.625+0000 7f3cbaffd640 10 client.25996 handle_command_reply: tid=0 2024-07-24T22:12:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.625+0000 7f3ce4c01740 1 client.25996 shutdown 2024-07-24T22:12:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.625+0000 7f3ce4c01740 1 -- 172.21.15.47:0/1534163161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5615977598c0 msgr2=0x56159776b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.625+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5615977598c0 0x56159776b2e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc02a930 tx=0x7f3ccc005770 comp rx=0 tx=0).stop 2024-07-24T22:12:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.626+0000 7f3ce4c01740 1 -- 172.21.15.47:0/1534163161 shutdown_connections 2024-07-24T22:12:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.626+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561597774be0 0x561597777000 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.626+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56159776bdb0 0x5615977e2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.626+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561597766170 0x56159776b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.626+0000 7f3ce4c01740 1 --2- 172.21.15.47:0/1534163161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5615977598c0 0x56159776b2e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.626+0000 7f3ce4c01740 1 -- 172.21.15.47:0/1534163161 >> 172.21.15.47:0/1534163161 conn(0x5615977576f0 msgr2=0x5615977584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.626+0000 7f3cbaffd640 0 client.25996 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.627+0000 7f3ce4c01740 1 -- 172.21.15.47:0/1534163161 shutdown_connections 2024-07-24T22:12:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.627+0000 7f3ce4c01740 1 -- 172.21.15.47:0/1534163161 wait complete. 2024-07-24T22:12:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.627+0000 7f3ce4c01740 20 client.25996 trim_cache size 0 max 16384 2024-07-24T22:12:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:12:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:12:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:12:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:12:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.628+0000 7f3ce1ea9640 1 -- 172.21.15.47:0/1249928653 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3cc40b3dc0 msgr2=0x7f3cc40b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.628+0000 7f3ce1ea9640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3cc40b3dc0 0x7f3cc40b6280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc031440 tx=0x7f3ccc005b50 comp rx=0 tx=0).stop 2024-07-24T22:12:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.628+0000 7f3ce1ea9640 1 -- 172.21.15.47:0/1249928653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cdc10c9f0 msgr2=0x7f3cdc19e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.628+0000 7f3ce1ea9640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cdc10c9f0 0x7f3cdc19e4d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009fd0 tx=0x7f3cd400ef10 comp rx=0 tx=0).stop 2024-07-24T22:12:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.629+0000 7f3ce1ea9640 1 -- 172.21.15.47:0/1249928653 shutdown_connections 2024-07-24T22:12:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.629+0000 7f3ce1ea9640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3cc40b3dc0 0x7f3cc40b6280 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.629+0000 7f3ce1ea9640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cdc10c9f0 0x7f3cdc19e4d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.629+0000 7f3ce1ea9640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cdc103ef0 0x7f3cdc199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.629+0000 7f3ce1ea9640 1 --2- 172.21.15.47:0/1249928653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cdc1035d0 0x7f3cdc198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.629+0000 7f3ce1ea9640 1 -- 172.21.15.47:0/1249928653 >> 172.21.15.47:0/1249928653 conn(0x7f3cdc0782e0 msgr2=0x7f3cdc0ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.630+0000 7f3ce1ea9640 1 -- 172.21.15.47:0/1249928653 shutdown_connections 2024-07-24T22:12:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:39.630+0000 7f3ce1ea9640 1 -- 172.21.15.47:0/1249928653 wait complete. 2024-07-24T22:12:41.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.404+0000 7fe35d466640 1 -- 172.21.15.47:0/3632224998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe35810caa0 msgr2=0x7fe35810ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:41.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.404+0000 7fe35d466640 1 --2- 172.21.15.47:0/3632224998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe35810caa0 0x7fe35810ef10 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe350009cc0 tx=0x7fe35002ecf0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.404+0000 7fe35d466640 1 -- 172.21.15.47:0/3632224998 shutdown_connections 2024-07-24T22:12:41.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.404+0000 7fe35d466640 1 --2- 172.21.15.47:0/3632224998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe35810caa0 0x7fe35810ef10 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.404+0000 7fe35d466640 1 --2- 172.21.15.47:0/3632224998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe358103ef0 0x7fe35810c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.404+0000 7fe35d466640 1 --2- 172.21.15.47:0/3632224998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3581034f0 0x7fe3581038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.404+0000 7fe35d466640 1 -- 172.21.15.47:0/3632224998 >> 172.21.15.47:0/3632224998 conn(0x7fe3580fd0c0 msgr2=0x7fe3580ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:41.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.404+0000 7fe35d466640 1 -- 172.21.15.47:0/3632224998 shutdown_connections 2024-07-24T22:12:41.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.404+0000 7fe35d466640 1 -- 172.21.15.47:0/3632224998 wait complete. 2024-07-24T22:12:41.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.405+0000 7fe35d466640 1 Processor -- start 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.405+0000 7fe35d466640 1 -- start start 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe35d466640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3581034f0 0x7fe358196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe35d466640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe358103ef0 0x7fe358196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe35d466640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe35810caa0 0x7fe35819c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe35d466640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe358110500 con 0x7fe3581034f0 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe35d466640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe358110380 con 0x7fe358103ef0 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe35d466640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe358110680 con 0x7fe35810caa0 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe356ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3581034f0 0x7fe358196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe3577fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe35810caa0 0x7fe35819c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe356ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3581034f0 0x7fe358196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36954/0 (socket says 172.21.15.47:36954) 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe356ffd640 1 -- 172.21.15.47:0/3456174507 learned_addr learned my addr 172.21.15.47:0/3456174507 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe3577fe640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe35810caa0 0x7fe35819c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:38198/0 (socket says 172.21.15.47:38198) 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe3567fc640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe358103ef0 0x7fe358196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe3577fe640 1 -- 172.21.15.47:0/3456174507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe358103ef0 msgr2=0x7fe358196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:41.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe3577fe640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe358103ef0 0x7fe358196ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe3577fe640 1 -- 172.21.15.47:0/3456174507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3581034f0 msgr2=0x7fe358196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:41.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe3577fe640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3581034f0 0x7fe358196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe3577fe640 1 -- 172.21.15.47:0/3456174507 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35819ca40 con 0x7fe35810caa0 2024-07-24T22:12:41.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.406+0000 7fe356ffd640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3581034f0 0x7fe358196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:41.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.407+0000 7fe3577fe640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe35810caa0 0x7fe35819c270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe35002f2e0 tx=0x7fe350003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:41.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.420+0000 7fe33ffff640 1 -- 172.21.15.47:0/3456174507 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35003c040 con 0x7fe35810caa0 2024-07-24T22:12:41.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.420+0000 7fe33ffff640 1 -- 172.21.15.47:0/3456174507 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe350035e50 con 0x7fe35810caa0 2024-07-24T22:12:41.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.420+0000 7fe33ffff640 1 -- 172.21.15.47:0/3456174507 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe350037970 con 0x7fe35810caa0 2024-07-24T22:12:41.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.420+0000 7fe35d466640 1 -- 172.21.15.47:0/3456174507 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe35819ccd0 con 0x7fe35810caa0 2024-07-24T22:12:41.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.421+0000 7fe35d466640 1 -- 172.21.15.47:0/3456174507 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3581a33f0 con 0x7fe35810caa0 2024-07-24T22:12:41.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.423+0000 7fe33ffff640 1 -- 172.21.15.47:0/3456174507 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe350049020 con 0x7fe35810caa0 2024-07-24T22:12:41.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe35f817740 1 Processor -- start 2024-07-24T22:12:41.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe35f817740 1 -- start start 2024-07-24T22:12:41.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe35f817740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0aa6d0 0x55b8db0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe35f817740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe35f817740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0b9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe35f817740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b8db0219b0 con 0x55b8db0aa6d0 2024-07-24T22:12:41.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe35f817740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b8db010eb0 con 0x55b8db0aaff0 2024-07-24T22:12:41.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe35f817740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b8db014ef0 con 0x55b8db0b6f80 2024-07-24T22:12:41.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe356ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe3567fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0aa6d0 0x55b8db0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe3567fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0aa6d0 0x55b8db0aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36962/0 (socket says 172.21.15.47:36962) 2024-07-24T22:12:41.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe356ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0b6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:55352/0 (socket says 172.21.15.47:55352) 2024-07-24T22:12:41.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe3567fc640 1 -- 172.21.15.47:0/2403705198 learned_addr learned my addr 172.21.15.47:0/2403705198 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:41.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.424+0000 7fe3567fc640 1 --2- 172.21.15.47:0/2403705198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0b9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.425+0000 7fe356ffd640 1 -- 172.21.15.47:0/2403705198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 msgr2=0x55b8db0b9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:41.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.425+0000 7fe33ffff640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe3400b3dc0 0x7fe3400b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.425+0000 7fe356ffd640 1 --2- 172.21.15.47:0/2403705198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0b9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.425+0000 7fe356ffd640 1 -- 172.21.15.47:0/2403705198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0aa6d0 msgr2=0x55b8db0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:41.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.425+0000 7fe356ffd640 1 --2- 172.21.15.47:0/2403705198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0aa6d0 0x55b8db0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.425+0000 7fe356ffd640 1 -- 172.21.15.47:0/2403705198 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8daf9a320 con 0x55b8db0aaff0 2024-07-24T22:12:41.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.425+0000 7fe3577fe640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe3400b3dc0 0x7fe3400b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.425+0000 7fe356ffd640 1 --2- 172.21.15.47:0/2403705198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0b6a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe3480058c0 tx=0x7fe3480109e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90d45a3b0790a628 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:41.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.425+0000 7fe33d7fa640 1 -- 172.21.15.47:0/2403705198 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3480117c0 con 0x55b8db0aaff0 2024-07-24T22:12:41.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.425+0000 7fe33ffff640 1 -- 172.21.15.47:0/3456174507 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fe350108630 con 0x7fe35810caa0 2024-07-24T22:12:41.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.425+0000 7fe33d7fa640 1 -- 172.21.15.47:0/2403705198 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe348011e10 con 0x55b8db0aaff0 2024-07-24T22:12:41.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.425+0000 7fe33d7fa640 1 -- 172.21.15.47:0/2403705198 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34800ee60 con 0x55b8db0aaff0 2024-07-24T22:12:41.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.426+0000 7fe35f817740 1 -- 172.21.15.47:0/2403705198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 msgr2=0x55b8db0b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:41.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.426+0000 7fe35f817740 1 --2- 172.21.15.47:0/2403705198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0b6a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe3480058c0 tx=0x7fe3480109e0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.426+0000 7fe3577fe640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe3400b3dc0 0x7fe3400b6280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe3500f2010 tx=0x7fe3500cbac0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:41.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.426+0000 7fe35f817740 1 -- 172.21.15.47:0/2403705198 shutdown_connections 2024-07-24T22:12:41.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.426+0000 7fe35f817740 1 --2- 172.21.15.47:0/2403705198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0b9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.426+0000 7fe35f817740 1 --2- 172.21.15.47:0/2403705198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0b6a40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.426+0000 7fe35f817740 1 --2- 172.21.15.47:0/2403705198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0aa6d0 0x55b8db0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.426+0000 7fe35f817740 1 -- 172.21.15.47:0/2403705198 >> 172.21.15.47:0/2403705198 conn(0x55b8db0a8500 msgr2=0x55b8db0a96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:41.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.426+0000 7fe35f817740 1 -- 172.21.15.47:0/2403705198 shutdown_connections 2024-07-24T22:12:41.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.426+0000 7fe35f817740 1 -- 172.21.15.47:0/2403705198 wait complete. 2024-07-24T22:12:41.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe35f817740 1 -- start start 2024-07-24T22:12:41.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe35f817740 1 Processor -- start 2024-07-24T22:12:41.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe35f817740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0aa6d0 0x55b8db0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe35f817740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe35f817740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe35f817740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b8dae74700 con 0x55b8db0aa6d0 2024-07-24T22:12:41.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe35f817740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b8dafb35f0 con 0x55b8db0aaff0 2024-07-24T22:12:41.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe35f817740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b8db0b9c00 con 0x55b8db0b6f80 2024-07-24T22:12:41.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe35f817740 10 client.0 _ll_register_callbacks cb 0x55b8dafd3960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:41.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe356ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe356ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0b4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:55360/0 (socket says 172.21.15.47:55360) 2024-07-24T22:12:41.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe356ffd640 1 -- 172.21.15.47:0/2759532798 learned_addr learned my addr 172.21.15.47:0/2759532798 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:41.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe3567fc640 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0aa6d0 0x55b8db0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.427+0000 7fe3567fc640 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.428+0000 7fe356ffd640 1 -- 172.21.15.47:0/2759532798 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 msgr2=0x55b8db0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:41.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.428+0000 7fe356ffd640 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.428+0000 7fe356ffd640 1 -- 172.21.15.47:0/2759532798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0aa6d0 msgr2=0x55b8db0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:41.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.428+0000 7fe356ffd640 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0aa6d0 0x55b8db0b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.428+0000 7fe356ffd640 1 -- 172.21.15.47:0/2759532798 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8dafa6680 con 0x55b8db0aaff0 2024-07-24T22:12:41.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.428+0000 7fe3567fc640 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:12:41.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.428+0000 7fe356ffd640 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0b4440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe348006010 tx=0x7fe34800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=decef11c4d35f7e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:41.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.428+0000 7fe33aff5640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:12:41.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.428+0000 7fe33aff5640 1 -- 172.21.15.47:0/2759532798 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34800e430 con 0x55b8db0aaff0 2024-07-24T22:12:41.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.428+0000 7fe33aff5640 1 -- 172.21.15.47:0/2759532798 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fe34800e5d0 con 0x55b8db0aaff0 2024-07-24T22:12:41.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.428+0000 7fe35f817740 1 -- 172.21.15.47:0/2759532798 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe348011e10 con 0x55b8db0aaff0 2024-07-24T22:12:41.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.429+0000 7fe33aff5640 1 -- 172.21.15.47:0/2759532798 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe34800e7d0 con 0x55b8db0aaff0 2024-07-24T22:12:41.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.429+0000 7fe35f817740 10 client.25967 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:41.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.429+0000 7fe35f817740 1 -- 172.21.15.47:0/2759532798 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b8dad71650 con 0x55b8db0aaff0 2024-07-24T22:12:41.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.429+0000 7fe33aff5640 1 -- 172.21.15.47:0/2759532798 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe348011e10 con 0x55b8db0aaff0 2024-07-24T22:12:41.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.429+0000 7fe33aff5640 1 -- 172.21.15.47:0/2759532798 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe3480119a0 con 0x55b8db0aaff0 2024-07-24T22:12:41.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.429+0000 7fe35f817740 10 client.25967 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:41.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.429+0000 7fe35f817740 10 client.25967 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:41.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.429+0000 7fe35f817740 20 client.25967 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:41.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.429+0000 7fe35f817740 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b8db0c6a00 0x55b8db0c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.429+0000 7fe35f817740 4 client.25967 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:12:41.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.429+0000 7fe35f817740 1 -- 172.21.15.47:0/2759532798 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8db023900 con 0x55b8db0c6a00 2024-07-24T22:12:41.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.429+0000 7fe3567fc640 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b8db0c6a00 0x55b8db0c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.430+0000 7fe3567fc640 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b8db0c6a00 0x55b8db0c8df0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3be1d77ee08f086f server_cookie=a65ba37ffb2a7ad5 in_seq=0 out_seq=0 2024-07-24T22:12:41.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.430+0000 7fe33aff5640 10 client.25967 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:41.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.431+0000 7fe33aff5640 1 -- 172.21.15.47:0/2759532798 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8db023900 con 0x55b8db0c6a00 2024-07-24T22:12:41.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.431+0000 7fe33aff5640 10 client.25967 handle_command_reply: tid=0 2024-07-24T22:12:41.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.431+0000 7fe35f817740 1 client.25967 shutdown 2024-07-24T22:12:41.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.432+0000 7fe35f817740 1 -- 172.21.15.47:0/2759532798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 msgr2=0x55b8db0b4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:41.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.432+0000 7fe35f817740 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0b4440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe348006010 tx=0x7fe34800ee80 comp rx=0 tx=0).stop 2024-07-24T22:12:41.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.432+0000 7fe35f817740 1 -- 172.21.15.47:0/2759532798 shutdown_connections 2024-07-24T22:12:41.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.432+0000 7fe35f817740 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b8db0c6a00 0x55b8db0c8df0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.432+0000 7fe35f817740 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.432+0000 7fe35f817740 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0b4440 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.432+0000 7fe33aff5640 0 client.25967 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:41.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.432+0000 7fe35f817740 1 --2- 172.21.15.47:0/2759532798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0aa6d0 0x55b8db0b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.432+0000 7fe35f817740 1 -- 172.21.15.47:0/2759532798 >> 172.21.15.47:0/2759532798 conn(0x55b8db0a8500 msgr2=0x55b8db0ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:41.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.432+0000 7fe35f817740 1 -- 172.21.15.47:0/2759532798 shutdown_connections 2024-07-24T22:12:41.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.432+0000 7fe35f817740 1 -- 172.21.15.47:0/2759532798 wait complete. 2024-07-24T22:12:41.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.432+0000 7fe35f817740 20 client.25967 trim_cache size 0 max 16384 2024-07-24T22:12:41.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.462+0000 7fe35f817740 1 Processor -- start 2024-07-24T22:12:41.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.462+0000 7fe35f817740 1 -- start start 2024-07-24T22:12:41.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe35f817740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aa6d0 0x55b8db0ae820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe35f817740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0aaff0 0x55b8db0b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe35f817740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0b6f80 0x55b8db0ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe35f817740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe3581a9de0 con 0x55b8db0b6f80 2024-07-24T22:12:41.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe35f817740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe3581ac660 con 0x55b8db0aa6d0 2024-07-24T22:12:41.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe35f817740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe3581aa450 con 0x55b8db0aaff0 2024-07-24T22:12:41.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe3567fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aa6d0 0x55b8db0ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe3567fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aa6d0 0x55b8db0ae820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:55366/0 (socket says 172.21.15.47:55366) 2024-07-24T22:12:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe3567fc640 1 -- 172.21.15.47:0/4119153365 learned_addr learned my addr 172.21.15.47:0/4119153365 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe356ffd640 1 --2- 172.21.15.47:0/4119153365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0aaff0 0x55b8db0b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe3567fc640 1 --2- 172.21.15.47:0/4119153365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0b6f80 0x55b8db0ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe3567fc640 1 -- 172.21.15.47:0/4119153365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0aaff0 msgr2=0x55b8db0b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe3567fc640 1 --2- 172.21.15.47:0/4119153365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0aaff0 0x55b8db0b5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe3567fc640 1 -- 172.21.15.47:0/4119153365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0b6f80 msgr2=0x55b8db0ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe3567fc640 1 --2- 172.21.15.47:0/4119153365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0b6f80 0x55b8db0ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.463+0000 7fe3567fc640 1 -- 172.21.15.47:0/4119153365 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8db0c9160 con 0x55b8db0aa6d0 2024-07-24T22:12:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.464+0000 7fe3567fc640 1 --2- 172.21.15.47:0/4119153365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aa6d0 0x55b8db0ae820 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0113a0 tx=0x7fe34c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4202fab11b265479 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.464+0000 7fe33cff9640 1 -- 172.21.15.47:0/4119153365 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c01b040 con 0x55b8db0aa6d0 2024-07-24T22:12:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.464+0000 7fe33cff9640 1 -- 172.21.15.47:0/4119153365 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe34c026040 con 0x55b8db0aa6d0 2024-07-24T22:12:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.464+0000 7fe33cff9640 1 -- 172.21.15.47:0/4119153365 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c004a00 con 0x55b8db0aa6d0 2024-07-24T22:12:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.465+0000 7fe35f817740 1 -- 172.21.15.47:0/4119153365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aa6d0 msgr2=0x55b8db0ae820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.465+0000 7fe35f817740 1 --2- 172.21.15.47:0/4119153365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aa6d0 0x55b8db0ae820 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0113a0 tx=0x7fe34c0046c0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.465+0000 7fe35f817740 1 -- 172.21.15.47:0/4119153365 shutdown_connections 2024-07-24T22:12:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.465+0000 7fe35f817740 1 --2- 172.21.15.47:0/4119153365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0b6f80 0x55b8db0ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.465+0000 7fe35f817740 1 --2- 172.21.15.47:0/4119153365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0aaff0 0x55b8db0b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.465+0000 7fe35f817740 1 --2- 172.21.15.47:0/4119153365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aa6d0 0x55b8db0ae820 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.465+0000 7fe35f817740 1 -- 172.21.15.47:0/4119153365 >> 172.21.15.47:0/4119153365 conn(0x55b8db0a8500 msgr2=0x55b8db0b5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.465+0000 7fe35f817740 1 -- 172.21.15.47:0/4119153365 shutdown_connections 2024-07-24T22:12:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.465+0000 7fe35f817740 1 -- 172.21.15.47:0/4119153365 wait complete. 2024-07-24T22:12:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe35f817740 1 -- start start 2024-07-24T22:12:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe35f817740 1 Processor -- start 2024-07-24T22:12:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe35f817740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0bae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe35f817740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0bb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe35f817740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0bb8d0 0x55b8db130410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe35f817740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe3581aab20 con 0x55b8db0bb8d0 2024-07-24T22:12:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe35f817740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe3581abf90 con 0x55b8db0aaff0 2024-07-24T22:12:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe35f817740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe3581ab1f0 con 0x55b8db0b6f80 2024-07-24T22:12:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe35f817740 10 client.0 _ll_register_callbacks cb 0x7fe34c00b830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe3567fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0bae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe3567fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0bae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:55378/0 (socket says 172.21.15.47:55378) 2024-07-24T22:12:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe3567fc640 1 -- 172.21.15.47:0/2619762040 learned_addr learned my addr 172.21.15.47:0/2619762040 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:41.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe356ffd640 1 --2- 172.21.15.47:0/2619762040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0bb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.466+0000 7fe3567fc640 1 --2- 172.21.15.47:0/2619762040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0bb8d0 0x55b8db130410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.467+0000 7fe356ffd640 1 -- 172.21.15.47:0/2619762040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 msgr2=0x55b8db0bae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:41.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.467+0000 7fe356ffd640 1 --2- 172.21.15.47:0/2619762040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0bae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.467+0000 7fe356ffd640 1 -- 172.21.15.47:0/2619762040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0bb8d0 msgr2=0x55b8db130410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:41.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.467+0000 7fe356ffd640 1 --2- 172.21.15.47:0/2619762040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0bb8d0 0x55b8db130410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.467+0000 7fe356ffd640 1 -- 172.21.15.47:0/2619762040 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8db130a50 con 0x55b8db0b6f80 2024-07-24T22:12:41.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.467+0000 7fe356ffd640 1 --2- 172.21.15.47:0/2619762040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0bb390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe348011d40 tx=0x7fe3480058f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=687285454b4e8853 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:41.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.467+0000 7fe33aff5640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:12:41.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.467+0000 7fe33aff5640 1 -- 172.21.15.47:0/2619762040 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34800e430 con 0x55b8db0b6f80 2024-07-24T22:12:41.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.467+0000 7fe33aff5640 1 -- 172.21.15.47:0/2619762040 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fe34800e5d0 con 0x55b8db0b6f80 2024-07-24T22:12:41.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.467+0000 7fe35f817740 1 -- 172.21.15.47:0/2619762040 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe34c026040 con 0x55b8db0b6f80 2024-07-24T22:12:41.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.468+0000 7fe33aff5640 1 -- 172.21.15.47:0/2619762040 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe348047050 con 0x55b8db0b6f80 2024-07-24T22:12:41.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.468+0000 7fe35f817740 10 client.26020 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:41.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.468+0000 7fe35f817740 1 -- 172.21.15.47:0/2619762040 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b8db131d50 con 0x55b8db0b6f80 2024-07-24T22:12:41.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.468+0000 7fe33aff5640 1 -- 172.21.15.47:0/2619762040 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe34c026040 con 0x55b8db0b6f80 2024-07-24T22:12:41.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.468+0000 7fe33aff5640 1 -- 172.21.15.47:0/2619762040 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe348003780 con 0x55b8db0b6f80 2024-07-24T22:12:41.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.468+0000 7fe35f817740 10 client.26020 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:41.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.468+0000 7fe35f817740 10 client.26020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:41.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.468+0000 7fe35f817740 20 client.26020 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:41.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.468+0000 7fe35f817740 1 --2- 172.21.15.47:0/2619762040 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b8db1324c0 0x55b8db1348e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.468+0000 7fe35f817740 4 client.26020 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:12:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.468+0000 7fe35f817740 1 -- 172.21.15.47:0/2619762040 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b8db01f3a0 con 0x55b8db1324c0 2024-07-24T22:12:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.469+0000 7fe3567fc640 1 --2- 172.21.15.47:0/2619762040 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b8db1324c0 0x55b8db1348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.469+0000 7fe3567fc640 1 --2- 172.21.15.47:0/2619762040 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b8db1324c0 0x55b8db1348e0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d98ee44a82238caf server_cookie=b699bd2b7440b991 in_seq=0 out_seq=0 2024-07-24T22:12:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.469+0000 7fe33aff5640 10 client.26020 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe33aff5640 1 -- 172.21.15.47:0/2619762040 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b8db01f3a0 con 0x55b8db1324c0 2024-07-24T22:12:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe33aff5640 10 client.26020 handle_command_reply: tid=0 2024-07-24T22:12:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe35f817740 1 client.26020 shutdown 2024-07-24T22:12:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe35f817740 1 -- 172.21.15.47:0/2619762040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 msgr2=0x55b8db0bb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe35f817740 1 --2- 172.21.15.47:0/2619762040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0bb390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe348011d40 tx=0x7fe3480058f0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe35f817740 1 -- 172.21.15.47:0/2619762040 shutdown_connections 2024-07-24T22:12:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe35f817740 1 --2- 172.21.15.47:0/2619762040 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b8db1324c0 0x55b8db1348e0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe35f817740 1 --2- 172.21.15.47:0/2619762040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b8db0bb8d0 0x55b8db130410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe35f817740 1 --2- 172.21.15.47:0/2619762040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b8db0b6f80 0x55b8db0bb390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe35f817740 1 --2- 172.21.15.47:0/2619762040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8db0aaff0 0x55b8db0bae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe33aff5640 0 client.26020 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:41.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe35f817740 1 -- 172.21.15.47:0/2619762040 >> 172.21.15.47:0/2619762040 conn(0x55b8db0a8500 msgr2=0x55b8db0b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:41.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe35f817740 1 -- 172.21.15.47:0/2619762040 shutdown_connections 2024-07-24T22:12:41.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe35f817740 1 -- 172.21.15.47:0/2619762040 wait complete. 2024-07-24T22:12:41.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.470+0000 7fe35f817740 20 client.26020 trim_cache size 0 max 16384 2024-07-24T22:12:41.476 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:12:41.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.471+0000 7fe35d466640 1 -- 172.21.15.47:0/3456174507 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe3400b3dc0 msgr2=0x7fe3400b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:41.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.471+0000 7fe35d466640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe3400b3dc0 0x7fe3400b6280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe3500f2010 tx=0x7fe3500cbac0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.471+0000 7fe35d466640 1 -- 172.21.15.47:0/3456174507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe35810caa0 msgr2=0x7fe35819c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:41.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.471+0000 7fe35d466640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe35810caa0 0x7fe35819c270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe35002f2e0 tx=0x7fe350003f90 comp rx=0 tx=0).stop 2024-07-24T22:12:41.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.471+0000 7fe35d466640 1 -- 172.21.15.47:0/3456174507 shutdown_connections 2024-07-24T22:12:41.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.471+0000 7fe35d466640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe3400b3dc0 0x7fe3400b6280 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.471+0000 7fe35d466640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe35810caa0 0x7fe35819c270 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.471+0000 7fe35d466640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe358103ef0 0x7fe358196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.471+0000 7fe35d466640 1 --2- 172.21.15.47:0/3456174507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3581034f0 0x7fe358196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:41.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.471+0000 7fe35d466640 1 -- 172.21.15.47:0/3456174507 >> 172.21.15.47:0/3456174507 conn(0x7fe3580fd0c0 msgr2=0x7fe3580fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:41.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.471+0000 7fe35d466640 1 -- 172.21.15.47:0/3456174507 shutdown_connections 2024-07-24T22:12:41.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:41.471+0000 7fe35d466640 1 -- 172.21.15.47:0/3456174507 wait complete. 2024-07-24T22:12:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:41 smithi183 ceph-mon[37007]: pgmap v530: 97 pgs: 97 active+clean; 49 GiB data, 148 GiB used, 925 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 642 MiB/s wr, 1.65k op/s 2024-07-24T22:12:41.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:41 smithi047 ceph-mon[32551]: pgmap v530: 97 pgs: 97 active+clean; 49 GiB data, 148 GiB used, 925 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 642 MiB/s wr, 1.65k op/s 2024-07-24T22:12:41.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:41 smithi188 ceph-mon[37380]: pgmap v530: 97 pgs: 97 active+clean; 49 GiB data, 148 GiB used, 925 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 642 MiB/s wr, 1.65k op/s 2024-07-24T22:12:43.267 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:12:43.267 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:12:43.548 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:12:43.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:43 smithi047 ceph-mon[32551]: pgmap v531: 97 pgs: 97 active+clean; 49 GiB data, 150 GiB used, 923 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 608 MiB/s wr, 1.50k op/s 2024-07-24T22:12:43.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:43 smithi188 ceph-mon[37380]: pgmap v531: 97 pgs: 97 active+clean; 49 GiB data, 150 GiB used, 923 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 608 MiB/s wr, 1.50k op/s 2024-07-24T22:12:43.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:43 smithi183 ceph-mon[37007]: pgmap v531: 97 pgs: 97 active+clean; 49 GiB data, 150 GiB used, 923 GiB / 1.0 TiB avail; 3.7 MiB/s rd, 608 MiB/s wr, 1.50k op/s 2024-07-24T22:12:45.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:45 smithi047 ceph-mon[32551]: pgmap v532: 97 pgs: 97 active+clean; 49 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 659 MiB/s wr, 1.48k op/s 2024-07-24T22:12:45.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:45 smithi188 ceph-mon[37380]: pgmap v532: 97 pgs: 97 active+clean; 49 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 659 MiB/s wr, 1.48k op/s 2024-07-24T22:12:45.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:45 smithi183 ceph-mon[37007]: pgmap v532: 97 pgs: 97 active+clean; 49 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 659 MiB/s wr, 1.48k op/s 2024-07-24T22:12:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.058+0000 7f5de82da640 1 -- 172.21.15.47:0/1906627963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de0108b40 msgr2=0x7f5de010f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.058+0000 7f5de82da640 1 --2- 172.21.15.47:0/1906627963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de0108b40 0x7f5de010f340 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009ca0 tx=0x7f5dd802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.058+0000 7f5de82da640 1 -- 172.21.15.47:0/1906627963 shutdown_connections 2024-07-24T22:12:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.058+0000 7f5de82da640 1 --2- 172.21.15.47:0/1906627963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de0108b40 0x7f5de010f340 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.058+0000 7f5de82da640 1 --2- 172.21.15.47:0/1906627963 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5de01081c0 0x7f5de0108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.058+0000 7f5de82da640 1 --2- 172.21.15.47:0/1906627963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5de01027b0 0x7f5de0102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.058+0000 7f5de82da640 1 -- 172.21.15.47:0/1906627963 >> 172.21.15.47:0/1906627963 conn(0x7f5de00fe200 msgr2=0x7f5de0100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.058+0000 7f5de82da640 1 -- 172.21.15.47:0/1906627963 shutdown_connections 2024-07-24T22:12:46.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.058+0000 7f5de82da640 1 -- 172.21.15.47:0/1906627963 wait complete. 2024-07-24T22:12:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.059+0000 7f5de82da640 1 Processor -- start 2024-07-24T22:12:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.059+0000 7f5de82da640 1 -- start start 2024-07-24T22:12:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.059+0000 7f5de82da640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5de01027b0 0x7f5de0074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.059+0000 7f5de82da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de01081c0 0x7f5de00753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.059+0000 7f5de82da640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5de0108b40 0x7f5de0075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.059+0000 7f5de82da640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5de01127b0 con 0x7f5de01081c0 2024-07-24T22:12:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.059+0000 7f5de82da640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5de0112630 con 0x7f5de0108b40 2024-07-24T22:12:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.059+0000 7f5de82da640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5de0112930 con 0x7f5de01027b0 2024-07-24T22:12:46.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.059+0000 7f5de5875640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de01081c0 0x7f5de00753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5de5875640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de01081c0 0x7f5de00753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51168/0 (socket says 172.21.15.47:51168) 2024-07-24T22:12:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5de5875640 1 -- 172.21.15.47:0/346948040 learned_addr learned my addr 172.21.15.47:0/346948040 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5de6076640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5de01027b0 0x7f5de0074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5de6877640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5de0108b40 0x7f5de0075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5de5875640 1 -- 172.21.15.47:0/346948040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5de01027b0 msgr2=0x7f5de0074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5de5875640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5de01027b0 0x7f5de0074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5de5875640 1 -- 172.21.15.47:0/346948040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5de0108b40 msgr2=0x7f5de0075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5de5875640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5de0108b40 0x7f5de0075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5de5875640 1 -- 172.21.15.47:0/346948040 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de01a6fc0 con 0x7f5de01081c0 2024-07-24T22:12:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5de5875640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de01081c0 0x7f5de00753d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000c920 tx=0x7f5dd000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5dd77fe640 1 -- 172.21.15.47:0/346948040 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0007c70 con 0x7f5de01081c0 2024-07-24T22:12:46.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5de82da640 1 -- 172.21.15.47:0/346948040 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de01a72b0 con 0x7f5de01081c0 2024-07-24T22:12:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5dd77fe640 1 -- 172.21.15.47:0/346948040 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dd0007e10 con 0x7f5de01081c0 2024-07-24T22:12:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5dd77fe640 1 -- 172.21.15.47:0/346948040 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0018820 con 0x7f5de01081c0 2024-07-24T22:12:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.060+0000 7f5de82da640 1 -- 172.21.15.47:0/346948040 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de01a7840 con 0x7f5de01081c0 2024-07-24T22:12:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.063+0000 7f5dea68b740 1 Processor -- start 2024-07-24T22:12:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.063+0000 7f5dd77fe640 1 -- 172.21.15.47:0/346948040 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f5dd000f450 con 0x7f5de01081c0 2024-07-24T22:12:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.063+0000 7f5dea68b740 1 -- start start 2024-07-24T22:12:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.063+0000 7f5dea68b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 0x56491ad26310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.063+0000 7f5dea68b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad26850 0x56491ad322a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.063+0000 7f5dea68b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad327e0 0x56491ad34bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.063+0000 7f5dea68b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56491ac9d9f0 con 0x56491ad25f30 2024-07-24T22:12:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.063+0000 7f5dea68b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56491ac8cef0 con 0x56491ad26850 2024-07-24T22:12:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.063+0000 7f5dea68b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56491ac90f30 con 0x56491ad327e0 2024-07-24T22:12:46.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.063+0000 7f5de6877640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 0x56491ad26310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5de6877640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 0x56491ad26310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51172/0 (socket says 172.21.15.47:51172) 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5de6877640 1 -- 172.21.15.47:0/4212944175 learned_addr learned my addr 172.21.15.47:0/4212944175 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5de6076640 1 --2- 172.21.15.47:0/4212944175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad26850 0x56491ad322a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5de5875640 1 --2- 172.21.15.47:0/4212944175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad327e0 0x56491ad34bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5de6877640 1 -- 172.21.15.47:0/4212944175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad327e0 msgr2=0x56491ad34bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5de6877640 1 --2- 172.21.15.47:0/4212944175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad327e0 0x56491ad34bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5de6877640 1 -- 172.21.15.47:0/4212944175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad26850 msgr2=0x56491ad322a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5de6877640 1 --2- 172.21.15.47:0/4212944175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad26850 0x56491ad322a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5de6877640 1 -- 172.21.15.47:0/4212944175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56491a9ed930 con 0x56491ad25f30 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5de6076640 1 --2- 172.21.15.47:0/4212944175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad26850 0x56491ad322a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5dd77fe640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5dcc0b3d40 0x7f5dcc0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5de6877640 1 --2- 172.21.15.47:0/4212944175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 0x56491ad26310 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009ca0 tx=0x7f5dd802f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ad7e1c35b01730 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5dd77fe640 1 -- 172.21.15.47:0/346948040 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f5dd00e40c0 con 0x7f5de01081c0 2024-07-24T22:12:46.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5de6076640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5dcc0b3d40 0x7f5dcc0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.064+0000 7f5dd4de4640 1 -- 172.21.15.47:0/4212944175 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8031d70 con 0x56491ad25f30 2024-07-24T22:12:46.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.065+0000 7f5dd4de4640 1 -- 172.21.15.47:0/4212944175 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dd8036040 con 0x56491ad25f30 2024-07-24T22:12:46.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.065+0000 7f5dd4de4640 1 -- 172.21.15.47:0/4212944175 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8004330 con 0x56491ad25f30 2024-07-24T22:12:46.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.065+0000 7f5dea68b740 1 -- 172.21.15.47:0/4212944175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 msgr2=0x56491ad26310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:46.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.065+0000 7f5de6076640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5dcc0b3d40 0x7f5dcc0b6200 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x56491ad24c40 tx=0x7f5ddc005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:46.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.065+0000 7f5dea68b740 1 --2- 172.21.15.47:0/4212944175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 0x56491ad26310 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009ca0 tx=0x7f5dd802f3f0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.065+0000 7f5dea68b740 1 -- 172.21.15.47:0/4212944175 shutdown_connections 2024-07-24T22:12:46.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.065+0000 7f5dea68b740 1 --2- 172.21.15.47:0/4212944175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad327e0 0x56491ad34bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.065+0000 7f5dea68b740 1 --2- 172.21.15.47:0/4212944175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad26850 0x56491ad322a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.065+0000 7f5dea68b740 1 --2- 172.21.15.47:0/4212944175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 0x56491ad26310 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.065+0000 7f5dea68b740 1 -- 172.21.15.47:0/4212944175 >> 172.21.15.47:0/4212944175 conn(0x56491ad23d60 msgr2=0x56491ad24f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:46.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.065+0000 7f5dea68b740 1 -- 172.21.15.47:0/4212944175 shutdown_connections 2024-07-24T22:12:46.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.065+0000 7f5dea68b740 1 -- 172.21.15.47:0/4212944175 wait complete. 2024-07-24T22:12:46.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5dea68b740 1 -- start start 2024-07-24T22:12:46.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5dea68b740 1 Processor -- start 2024-07-24T22:12:46.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5dea68b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad25f30 0x56491ad2f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5dea68b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 0x56491ad2fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5dea68b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad327e0 0x56491ad30200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5dea68b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56491aaf0890 con 0x56491ad327e0 2024-07-24T22:12:46.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5dea68b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56491ac2f390 con 0x56491ad25f30 2024-07-24T22:12:46.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5dea68b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56491ad35400 con 0x56491ad26850 2024-07-24T22:12:46.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5dea68b740 10 client.0 _ll_register_callbacks cb 0x56491ac39500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:46.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5de6877640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad327e0 0x56491ad30200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5de6076640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad25f30 0x56491ad2f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5de5875640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 0x56491ad2fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5de6877640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad327e0 0x56491ad30200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51182/0 (socket says 172.21.15.47:51182) 2024-07-24T22:12:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5de6877640 1 -- 172.21.15.47:0/1907263293 learned_addr learned my addr 172.21.15.47:0/1907263293 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.066+0000 7f5de6076640 1 --2- 172.21.15.47:0/1907263293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad25f30 0x56491ad2f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:58770/0 (socket says 172.21.15.47:58770) 2024-07-24T22:12:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5de5875640 1 -- 172.21.15.47:0/1907263293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad25f30 msgr2=0x56491ad2f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5de5875640 1 --2- 172.21.15.47:0/1907263293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad25f30 0x56491ad2f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5de5875640 1 -- 172.21.15.47:0/1907263293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad327e0 msgr2=0x56491ad30200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5de5875640 1 --2- 172.21.15.47:0/1907263293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad327e0 0x56491ad30200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5de5875640 1 -- 172.21.15.47:0/1907263293 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56491ac29d60 con 0x56491ad26850 2024-07-24T22:12:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5de6877640 1 --2- 172.21.15.47:0/1907263293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad327e0 0x56491ad30200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5de5875640 1 --2- 172.21.15.47:0/1907263293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 0x56491ad2fcc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00e18b0 tx=0x7f5dd000fcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44a916c9df8affc5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5dc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:12:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5dc9ffb640 1 -- 172.21.15.47:0/1907263293 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00aa880 con 0x56491ad26850 2024-07-24T22:12:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5dea68b740 1 -- 172.21.15.47:0/1907263293 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dd8036040 con 0x56491ad26850 2024-07-24T22:12:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5dc9ffb640 1 -- 172.21.15.47:0/1907263293 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f5dd00b3990 con 0x56491ad26850 2024-07-24T22:12:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5dc9ffb640 1 -- 172.21.15.47:0/1907263293 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5dd00ab470 con 0x56491ad26850 2024-07-24T22:12:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5dea68b740 10 client.26029 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5dea68b740 1 -- 172.21.15.47:0/1907263293 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56491ad41320 con 0x56491ad26850 2024-07-24T22:12:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5dc9ffb640 1 -- 172.21.15.47:0/1907263293 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dd8036040 con 0x56491ad26850 2024-07-24T22:12:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5dc9ffb640 1 -- 172.21.15.47:0/1907263293 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5dd00a66e0 con 0x56491ad26850 2024-07-24T22:12:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5dea68b740 10 client.26029 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.067+0000 7f5dea68b740 10 client.26029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:46.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.068+0000 7f5dea68b740 20 client.26029 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:46.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.068+0000 7f5dea68b740 1 --2- 172.21.15.47:0/1907263293 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56491ad42830 0x56491ad44c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.068+0000 7f5dea68b740 4 client.26029 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:12:46.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.068+0000 7f5dea68b740 1 -- 172.21.15.47:0/1907263293 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56491ac9f940 con 0x56491ad42830 2024-07-24T22:12:46.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.068+0000 7f5de6076640 1 --2- 172.21.15.47:0/1907263293 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56491ad42830 0x56491ad44c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.068+0000 7f5de6076640 1 --2- 172.21.15.47:0/1907263293 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56491ad42830 0x56491ad44c20 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d514434af664d0d server_cookie=ea5b1b815d6cfa76 in_seq=0 out_seq=0 2024-07-24T22:12:46.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.068+0000 7f5dc9ffb640 10 client.26029 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:46.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dc9ffb640 1 -- 172.21.15.47:0/1907263293 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56491ac9f940 con 0x56491ad42830 2024-07-24T22:12:46.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dc9ffb640 10 client.26029 handle_command_reply: tid=0 2024-07-24T22:12:46.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dea68b740 1 client.26029 shutdown 2024-07-24T22:12:46.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dea68b740 1 -- 172.21.15.47:0/1907263293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 msgr2=0x56491ad2fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:46.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dea68b740 1 --2- 172.21.15.47:0/1907263293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 0x56491ad2fcc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00e18b0 tx=0x7f5dd000fcc0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dea68b740 1 -- 172.21.15.47:0/1907263293 shutdown_connections 2024-07-24T22:12:46.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dea68b740 1 --2- 172.21.15.47:0/1907263293 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56491ad42830 0x56491ad44c20 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dc9ffb640 0 client.26029 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dea68b740 1 --2- 172.21.15.47:0/1907263293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad327e0 0x56491ad30200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dea68b740 1 --2- 172.21.15.47:0/1907263293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 0x56491ad2fcc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dea68b740 1 --2- 172.21.15.47:0/1907263293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad25f30 0x56491ad2f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dea68b740 1 -- 172.21.15.47:0/1907263293 >> 172.21.15.47:0/1907263293 conn(0x56491ad23d60 msgr2=0x56491ad29900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dea68b740 1 -- 172.21.15.47:0/1907263293 shutdown_connections 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dea68b740 1 -- 172.21.15.47:0/1907263293 wait complete. 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.069+0000 7f5dea68b740 20 client.26029 trim_cache size 0 max 16384 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.088+0000 7f5dea68b740 1 Processor -- start 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.088+0000 7f5dea68b740 1 -- start start 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.088+0000 7f5dea68b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 0x56491ad22d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.088+0000 7f5dea68b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 0x56491ad4a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.088+0000 7f5dea68b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad327e0 0x56491ad4a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.088+0000 7f5dea68b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5de01ae250 con 0x56491ad25f30 2024-07-24T22:12:46.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.088+0000 7f5dea68b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5de01b0ad0 con 0x56491ad327e0 2024-07-24T22:12:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.088+0000 7f5dea68b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5de01ae8c0 con 0x56491ad26850 2024-07-24T22:12:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.088+0000 7f5de6076640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 0x56491ad22d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.088+0000 7f5de6076640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 0x56491ad22d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51192/0 (socket says 172.21.15.47:51192) 2024-07-24T22:12:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.088+0000 7f5de6076640 1 -- 172.21.15.47:0/1088375685 learned_addr learned my addr 172.21.15.47:0/1088375685 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.088+0000 7f5de6877640 1 --2- 172.21.15.47:0/1088375685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad327e0 0x56491ad4a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.088+0000 7f5de5875640 1 --2- 172.21.15.47:0/1088375685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 0x56491ad4a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.089+0000 7f5de6076640 1 -- 172.21.15.47:0/1088375685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 msgr2=0x56491ad4a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.089+0000 7f5de6076640 1 --2- 172.21.15.47:0/1088375685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 0x56491ad4a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.089+0000 7f5de6076640 1 -- 172.21.15.47:0/1088375685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad327e0 msgr2=0x56491ad4a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.089+0000 7f5de6076640 1 --2- 172.21.15.47:0/1088375685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad327e0 0x56491ad4a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.089+0000 7f5de6076640 1 -- 172.21.15.47:0/1088375685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56491ad258a0 con 0x56491ad25f30 2024-07-24T22:12:46.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.089+0000 7f5de6076640 1 --2- 172.21.15.47:0/1088375685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 0x56491ad22d10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0045a0 tx=0x7f5ddc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ec01c2291f1b16 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:46.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.089+0000 7f5dcbfff640 1 -- 172.21.15.47:0/1088375685 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc003c30 con 0x56491ad25f30 2024-07-24T22:12:46.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.089+0000 7f5dcbfff640 1 -- 172.21.15.47:0/1088375685 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ddc003dd0 con 0x56491ad25f30 2024-07-24T22:12:46.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.089+0000 7f5dcbfff640 1 -- 172.21.15.47:0/1088375685 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc004c60 con 0x56491ad25f30 2024-07-24T22:12:46.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.090+0000 7f5dea68b740 1 -- 172.21.15.47:0/1088375685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 msgr2=0x56491ad22d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:46.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.090+0000 7f5dea68b740 1 --2- 172.21.15.47:0/1088375685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 0x56491ad22d10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0045a0 tx=0x7f5ddc01b000 comp rx=0 tx=0).stop 2024-07-24T22:12:46.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.090+0000 7f5dea68b740 1 -- 172.21.15.47:0/1088375685 shutdown_connections 2024-07-24T22:12:46.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.090+0000 7f5dea68b740 1 --2- 172.21.15.47:0/1088375685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad327e0 0x56491ad4a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.090+0000 7f5dea68b740 1 --2- 172.21.15.47:0/1088375685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 0x56491ad4a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.090+0000 7f5dea68b740 1 --2- 172.21.15.47:0/1088375685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad25f30 0x56491ad22d10 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.090+0000 7f5dea68b740 1 -- 172.21.15.47:0/1088375685 >> 172.21.15.47:0/1088375685 conn(0x56491ad23d60 msgr2=0x56491ad22600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.090+0000 7f5dea68b740 1 -- 172.21.15.47:0/1088375685 shutdown_connections 2024-07-24T22:12:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.090+0000 7f5dea68b740 1 -- 172.21.15.47:0/1088375685 wait complete. 2024-07-24T22:12:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.090+0000 7f5dea68b740 1 -- start start 2024-07-24T22:12:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.090+0000 7f5dea68b740 1 Processor -- start 2024-07-24T22:12:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5dea68b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad25f30 0x56491ad3af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5dea68b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 0x56491ad36430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5dea68b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad327e0 0x56491ad36bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5dea68b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5de01aef90 con 0x56491ad327e0 2024-07-24T22:12:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5dea68b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5de01b0400 con 0x56491ad25f30 2024-07-24T22:12:46.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5dea68b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5de01af660 con 0x56491ad26850 2024-07-24T22:12:46.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5dea68b740 10 client.0 _ll_register_callbacks cb 0x7f5dd00a6c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:46.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5de6076640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad25f30 0x56491ad3af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5de6076640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad25f30 0x56491ad3af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:58784/0 (socket says 172.21.15.47:58784) 2024-07-24T22:12:46.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5de6076640 1 -- 172.21.15.47:0/2814912567 learned_addr learned my addr 172.21.15.47:0/2814912567 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:46.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5de6877640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad327e0 0x56491ad36bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5de5875640 1 --2- 172.21.15.47:0/2814912567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 0x56491ad36430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5de6076640 1 -- 172.21.15.47:0/2814912567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 msgr2=0x56491ad36430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:46.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5de6076640 1 --2- 172.21.15.47:0/2814912567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 0x56491ad36430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5de6076640 1 -- 172.21.15.47:0/2814912567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad327e0 msgr2=0x56491ad36bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:46.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5de6076640 1 --2- 172.21.15.47:0/2814912567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad327e0 0x56491ad36bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5de6076640 1 -- 172.21.15.47:0/2814912567 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56491adac480 con 0x56491ad25f30 2024-07-24T22:12:46.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.091+0000 7f5de6877640 1 --2- 172.21.15.47:0/2814912567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad327e0 0x56491ad36bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:46.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5de6076640 1 --2- 172.21.15.47:0/2814912567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad25f30 0x56491ad3af60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00a010 tx=0x7f5ddc003f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4624895078d53151 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:46.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:12:46.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dc9ffb640 1 -- 172.21.15.47:0/2814912567 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc039070 con 0x56491ad25f30 2024-07-24T22:12:46.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dea68b740 1 -- 172.21.15.47:0/2814912567 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ddc003dd0 con 0x56491ad25f30 2024-07-24T22:12:46.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dc9ffb640 1 -- 172.21.15.47:0/2814912567 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f5ddc02b420 con 0x56491ad25f30 2024-07-24T22:12:46.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dc9ffb640 1 -- 172.21.15.47:0/2814912567 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5ddc003c30 con 0x56491ad25f30 2024-07-24T22:12:46.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dea68b740 10 client.25991 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:46.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dea68b740 1 -- 172.21.15.47:0/2814912567 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56491adad770 con 0x56491ad25f30 2024-07-24T22:12:46.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dc9ffb640 1 -- 172.21.15.47:0/2814912567 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ddc003dd0 con 0x56491ad25f30 2024-07-24T22:12:46.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dc9ffb640 1 -- 172.21.15.47:0/2814912567 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5ddc035730 con 0x56491ad25f30 2024-07-24T22:12:46.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dea68b740 10 client.25991 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:46.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dea68b740 10 client.25991 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:46.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dea68b740 20 client.25991 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:46.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dea68b740 1 --2- 172.21.15.47:0/2814912567 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56491ad42830 0x56491adafe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:46.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dea68b740 4 client.25991 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:12:46.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.092+0000 7f5dea68b740 1 -- 172.21.15.47:0/2814912567 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56491ac9b3e0 con 0x56491ad42830 2024-07-24T22:12:46.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.093+0000 7f5de5875640 1 --2- 172.21.15.47:0/2814912567 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56491ad42830 0x56491adafe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:46.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.093+0000 7f5de5875640 1 --2- 172.21.15.47:0/2814912567 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56491ad42830 0x56491adafe80 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b50c43f79c5f8ff server_cookie=5c4ea8cbef1e9440 in_seq=0 out_seq=0 2024-07-24T22:12:46.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.093+0000 7f5dc9ffb640 10 client.25991 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:46.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.094+0000 7f5dc9ffb640 1 -- 172.21.15.47:0/2814912567 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56491ac9b3e0 con 0x56491ad42830 2024-07-24T22:12:46.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.094+0000 7f5dc9ffb640 10 client.25991 handle_command_reply: tid=0 2024-07-24T22:12:46.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.094+0000 7f5dea68b740 1 client.25991 shutdown 2024-07-24T22:12:46.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.094+0000 7f5dea68b740 1 -- 172.21.15.47:0/2814912567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad25f30 msgr2=0x56491ad3af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:46.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.094+0000 7f5dea68b740 1 --2- 172.21.15.47:0/2814912567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad25f30 0x56491ad3af60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00a010 tx=0x7f5ddc003f80 comp rx=0 tx=0).stop 2024-07-24T22:12:46.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.094+0000 7f5dea68b740 1 -- 172.21.15.47:0/2814912567 shutdown_connections 2024-07-24T22:12:46.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.094+0000 7f5dea68b740 1 --2- 172.21.15.47:0/2814912567 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56491ad42830 0x56491adafe80 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.094+0000 7f5dc9ffb640 0 client.25991 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:46.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.094+0000 7f5dea68b740 1 --2- 172.21.15.47:0/2814912567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491ad327e0 0x56491ad36bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.094+0000 7f5dea68b740 1 --2- 172.21.15.47:0/2814912567 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56491ad26850 0x56491ad36430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.094+0000 7f5dea68b740 1 --2- 172.21.15.47:0/2814912567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56491ad25f30 0x56491ad3af60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.094+0000 7f5dea68b740 1 -- 172.21.15.47:0/2814912567 >> 172.21.15.47:0/2814912567 conn(0x56491ad23d60 msgr2=0x56491ad29890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:46.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.095+0000 7f5dea68b740 1 -- 172.21.15.47:0/2814912567 shutdown_connections 2024-07-24T22:12:46.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.095+0000 7f5dea68b740 1 -- 172.21.15.47:0/2814912567 wait complete. 2024-07-24T22:12:46.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.095+0000 7f5dea68b740 20 client.25991 trim_cache size 0 max 16384 2024-07-24T22:12:46.119 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:12:46.119 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:12:46.119 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "a76ca40e-b0a6-4c2f-b350-8e77a4d3ef27", 2024-07-24T22:12:46.119 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:12:46.119 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:12:46.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.096+0000 7f5de82da640 1 -- 172.21.15.47:0/346948040 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5dcc0b3d40 msgr2=0x7f5dcc0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:46.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.096+0000 7f5de82da640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5dcc0b3d40 0x7f5dcc0b6200 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x56491ad24c40 tx=0x7f5ddc005f90 comp rx=0 tx=0).stop 2024-07-24T22:12:46.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.096+0000 7f5de82da640 1 -- 172.21.15.47:0/346948040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de01081c0 msgr2=0x7f5de00753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:46.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.096+0000 7f5de82da640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de01081c0 0x7f5de00753d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000c920 tx=0x7f5dd000cde0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.096+0000 7f5de82da640 1 -- 172.21.15.47:0/346948040 shutdown_connections 2024-07-24T22:12:46.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.096+0000 7f5de82da640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f5dcc0b3d40 0x7f5dcc0b6200 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.096+0000 7f5de82da640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5de0108b40 0x7f5de0075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.096+0000 7f5de82da640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5de01081c0 0x7f5de00753d0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.096+0000 7f5de82da640 1 --2- 172.21.15.47:0/346948040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5de01027b0 0x7f5de0074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:46.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.096+0000 7f5de82da640 1 -- 172.21.15.47:0/346948040 >> 172.21.15.47:0/346948040 conn(0x7f5de00fe200 msgr2=0x7f5de01016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:46.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.096+0000 7f5de82da640 1 -- 172.21.15.47:0/346948040 shutdown_connections 2024-07-24T22:12:46.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:46.096+0000 7f5de82da640 1 -- 172.21.15.47:0/346948040 wait complete. 2024-07-24T22:12:46.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:46 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:12:46.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:46 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:46.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:46 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:12:46.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:46 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:12:46.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:46 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:46.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:46 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:12:46.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:46 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:12:46.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:46 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:46.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:46 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:12:47.202 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:12:47.622 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:12:47.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:47 smithi047 ceph-mon[32551]: pgmap v533: 97 pgs: 97 active+clean; 49 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 559 MiB/s wr, 1.16k op/s 2024-07-24T22:12:47.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:47 smithi188 ceph-mon[37380]: pgmap v533: 97 pgs: 97 active+clean; 49 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 559 MiB/s wr, 1.16k op/s 2024-07-24T22:12:47.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:47 smithi183 ceph-mon[37007]: pgmap v533: 97 pgs: 97 active+clean; 49 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 559 MiB/s wr, 1.16k op/s 2024-07-24T22:12:48.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:48 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:48.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:48 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:48.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:48 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:12:49.700 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:49 smithi047 ceph-mon[32551]: pgmap v534: 97 pgs: 97 active+clean; 49 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 561 MiB/s wr, 1.10k op/s 2024-07-24T22:12:49.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:49 smithi188 ceph-mon[37380]: pgmap v534: 97 pgs: 97 active+clean; 49 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 561 MiB/s wr, 1.10k op/s 2024-07-24T22:12:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:49 smithi183 ceph-mon[37007]: pgmap v534: 97 pgs: 97 active+clean; 49 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 3.3 MiB/s rd, 561 MiB/s wr, 1.10k op/s 2024-07-24T22:12:50.595 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:50 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:12:50.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:50 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:12:50.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.810+0000 7efebc41a640 1 -- 172.21.15.47:0/1670504239 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeb4107a00 msgr2=0x7efeb410e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:50.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.810+0000 7efebc41a640 1 --2- 172.21.15.47:0/1670504239 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeb4107a00 0x7efeb410e200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efeac009ca0 tx=0x7efeac02a8b0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.811+0000 7efebc41a640 1 -- 172.21.15.47:0/1670504239 shutdown_connections 2024-07-24T22:12:50.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.811+0000 7efebc41a640 1 --2- 172.21.15.47:0/1670504239 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeb4107a00 0x7efeb410e200 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.811+0000 7efebc41a640 1 --2- 172.21.15.47:0/1670504239 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efeb4107080 0x7efeb41074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.811+0000 7efebc41a640 1 --2- 172.21.15.47:0/1670504239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeb4101670 0x7efeb4101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.811+0000 7efebc41a640 1 -- 172.21.15.47:0/1670504239 >> 172.21.15.47:0/1670504239 conn(0x7efeb40fd0c0 msgr2=0x7efeb40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:50.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.811+0000 7efebc41a640 1 -- 172.21.15.47:0/1670504239 shutdown_connections 2024-07-24T22:12:50.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.811+0000 7efebc41a640 1 -- 172.21.15.47:0/1670504239 wait complete. 2024-07-24T22:12:50.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.812+0000 7efebc41a640 1 Processor -- start 2024-07-24T22:12:50.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.812+0000 7efebc41a640 1 -- start start 2024-07-24T22:12:50.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.812+0000 7efebc41a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efeb4101670 0x7efeb4197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.812+0000 7efebc41a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeb4107080 0x7efeb4198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.812+0000 7efebc41a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeb4107a00 0x7efeb419d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.812+0000 7efebc41a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efeb41116e0 con 0x7efeb4107080 2024-07-24T22:12:50.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.812+0000 7efebc41a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efeb4111560 con 0x7efeb4107a00 2024-07-24T22:12:50.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.812+0000 7efebc41a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efeb4111860 con 0x7efeb4101670 2024-07-24T22:12:50.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.812+0000 7efeba1b6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efeb4101670 0x7efeb4197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.813+0000 7efeba1b6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efeb4101670 0x7efeb4197bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:54438/0 (socket says 172.21.15.47:54438) 2024-07-24T22:12:50.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.813+0000 7efeba1b6640 1 -- 172.21.15.47:0/2511859443 learned_addr learned my addr 172.21.15.47:0/2511859443 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:50.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.813+0000 7efeb99b5640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeb4107080 0x7efeb4198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.813+0000 7efeba9b7640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeb4107a00 0x7efeb419d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.813+0000 7efeba1b6640 1 -- 172.21.15.47:0/2511859443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeb4107a00 msgr2=0x7efeb419d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:50.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.813+0000 7efeba1b6640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeb4107a00 0x7efeb419d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.813+0000 7efeba1b6640 1 -- 172.21.15.47:0/2511859443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeb4107080 msgr2=0x7efeb4198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:50.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.813+0000 7efeba1b6640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeb4107080 0x7efeb4198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.813+0000 7efeba1b6640 1 -- 172.21.15.47:0/2511859443 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb419dca0 con 0x7efeb4101670 2024-07-24T22:12:50.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.813+0000 7efeba9b7640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeb4107a00 0x7efeb419d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:50.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.813+0000 7efeb99b5640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeb4107080 0x7efeb4198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:50.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.813+0000 7efeba1b6640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efeb4101670 0x7efeb4197bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efeb000b4a0 tx=0x7efeb000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:50.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.813+0000 7efeab7fe640 1 -- 172.21.15.47:0/2511859443 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0014070 con 0x7efeb4101670 2024-07-24T22:12:50.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.814+0000 7efeab7fe640 1 -- 172.21.15.47:0/2511859443 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb0010ac0 con 0x7efeb4101670 2024-07-24T22:12:50.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.814+0000 7efebc41a640 1 -- 172.21.15.47:0/2511859443 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb419df90 con 0x7efeb4101670 2024-07-24T22:12:50.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.814+0000 7efeab7fe640 1 -- 172.21.15.47:0/2511859443 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0017c30 con 0x7efeb4101670 2024-07-24T22:12:50.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.814+0000 7efebc41a640 1 -- 172.21.15.47:0/2511859443 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb406ac90 con 0x7efeb4101670 2024-07-24T22:12:50.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.816+0000 7efeab7fe640 1 -- 172.21.15.47:0/2511859443 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7efeb0017070 con 0x7efeb4101670 2024-07-24T22:12:50.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.817+0000 7efebe7cb740 1 Processor -- start 2024-07-24T22:12:50.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.817+0000 7efebe7cb740 1 -- start start 2024-07-24T22:12:50.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.817+0000 7efebe7cb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db3fec0 0x55956db402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.817+0000 7efebe7cb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db407e0 0x55956db4c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.817+0000 7efebe7cb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db4c770 0x55956db4eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efebe7cb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55956daae990 con 0x55956db407e0 2024-07-24T22:12:50.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efebe7cb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55956da9de90 con 0x55956db4c770 2024-07-24T22:12:50.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efebe7cb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55956daa1ed0 con 0x55956db3fec0 2024-07-24T22:12:50.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efeba1b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db407e0 0x55956db4c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efeb99b5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db4c770 0x55956db4eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efeba9b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db3fec0 0x55956db402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efeb99b5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db4c770 0x55956db4eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:58824/0 (socket says 172.21.15.47:58824) 2024-07-24T22:12:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efeb99b5640 1 -- 172.21.15.47:0/18469464 learned_addr learned my addr 172.21.15.47:0/18469464 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efeb99b5640 1 -- 172.21.15.47:0/18469464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db3fec0 msgr2=0x55956db402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efeb99b5640 1 --2- 172.21.15.47:0/18469464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db3fec0 0x55956db402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efeb99b5640 1 -- 172.21.15.47:0/18469464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db407e0 msgr2=0x55956db4c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efeb99b5640 1 --2- 172.21.15.47:0/18469464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db407e0 0x55956db4c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efeb99b5640 1 -- 172.21.15.47:0/18469464 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55956da27300 con 0x55956db4c770 2024-07-24T22:12:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.818+0000 7efeb99b5640 1 --2- 172.21.15.47:0/18469464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db4c770 0x55956db4eb60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efea40114f0 tx=0x7efea40119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d13bd54e19995d3 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.819+0000 7efeab7fe640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efea00b3dc0 0x7efea00b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.819+0000 7efea8de4640 1 -- 172.21.15.47:0/18469464 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea401e070 con 0x55956db4c770 2024-07-24T22:12:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.819+0000 7efeba9b7640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efea00b3dc0 0x7efea00b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.819+0000 7efea8de4640 1 -- 172.21.15.47:0/18469464 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efea40035f0 con 0x55956db4c770 2024-07-24T22:12:50.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.819+0000 7efea8de4640 1 -- 172.21.15.47:0/18469464 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea400f820 con 0x55956db4c770 2024-07-24T22:12:50.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.819+0000 7efeab7fe640 1 -- 172.21.15.47:0/2511859443 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7efeb00e3560 con 0x7efeb4101670 2024-07-24T22:12:50.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.820+0000 7efebe7cb740 1 -- 172.21.15.47:0/18469464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db4c770 msgr2=0x55956db4eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:50.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.820+0000 7efebe7cb740 1 --2- 172.21.15.47:0/18469464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db4c770 0x55956db4eb60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efea40114f0 tx=0x7efea40119b0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.820+0000 7efeba9b7640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efea00b3dc0 0x7efea00b6280 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efeac006010 tx=0x7efeac005d80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:50.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.820+0000 7efebe7cb740 1 -- 172.21.15.47:0/18469464 shutdown_connections 2024-07-24T22:12:50.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.820+0000 7efebe7cb740 1 --2- 172.21.15.47:0/18469464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db4c770 0x55956db4eb60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.820+0000 7efebe7cb740 1 --2- 172.21.15.47:0/18469464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db407e0 0x55956db4c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.820+0000 7efebe7cb740 1 --2- 172.21.15.47:0/18469464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db3fec0 0x55956db402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.820+0000 7efebe7cb740 1 -- 172.21.15.47:0/18469464 >> 172.21.15.47:0/18469464 conn(0x55956db3dcf0 msgr2=0x55956db3ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:50.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.820+0000 7efebe7cb740 1 -- 172.21.15.47:0/18469464 shutdown_connections 2024-07-24T22:12:50.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.820+0000 7efebe7cb740 1 -- 172.21.15.47:0/18469464 wait complete. 2024-07-24T22:12:50.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.821+0000 7efebe7cb740 1 -- start start 2024-07-24T22:12:50.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.821+0000 7efebe7cb740 1 Processor -- start 2024-07-24T22:12:50.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.821+0000 7efebe7cb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db3fec0 0x55956db49730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.821+0000 7efebe7cb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db407e0 0x55956db49c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.821+0000 7efebe7cb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db4c770 0x55956db4a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.821+0000 7efebe7cb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55956d901700 con 0x55956db3fec0 2024-07-24T22:12:50.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.821+0000 7efebe7cb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55956da405d0 con 0x55956db4c770 2024-07-24T22:12:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.821+0000 7efebe7cb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55956db4f3f0 con 0x55956db407e0 2024-07-24T22:12:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.821+0000 7efebe7cb740 10 client.0 _ll_register_callbacks cb 0x55956da60940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.821+0000 7efeb99b5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db407e0 0x55956db49c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.821+0000 7efeba9b7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db4c770 0x55956db4a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.821+0000 7efeb99b5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db407e0 0x55956db49c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:54454/0 (socket says 172.21.15.47:54454) 2024-07-24T22:12:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.821+0000 7efeb99b5640 1 -- 172.21.15.47:0/1541925607 learned_addr learned my addr 172.21.15.47:0/1541925607 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.822+0000 7efeba1b6640 1 --2- 172.21.15.47:0/1541925607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db3fec0 0x55956db49730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.822+0000 7efeb99b5640 1 -- 172.21.15.47:0/1541925607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db4c770 msgr2=0x55956db4a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.822+0000 7efeb99b5640 1 --2- 172.21.15.47:0/1541925607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db4c770 0x55956db4a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.822+0000 7efeb99b5640 1 -- 172.21.15.47:0/1541925607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db3fec0 msgr2=0x55956db49730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.822+0000 7efeb99b5640 1 --2- 172.21.15.47:0/1541925607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db3fec0 0x55956db49730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.822+0000 7efeb99b5640 1 -- 172.21.15.47:0/1541925607 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55956da33660 con 0x55956db407e0 2024-07-24T22:12:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.822+0000 7efeba1b6640 1 --2- 172.21.15.47:0/1541925607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db3fec0 0x55956db49730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:12:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.822+0000 7efeb99b5640 1 --2- 172.21.15.47:0/1541925607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db407e0 0x55956db49c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efea40058c0 tx=0x7efea40039d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a0299e0198270b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.822+0000 7efe9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:12:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.822+0000 7efe9dffb640 1 -- 172.21.15.47:0/1541925607 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4027020 con 0x55956db407e0 2024-07-24T22:12:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.822+0000 7efebe7cb740 1 -- 172.21.15.47:0/1541925607 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efea40035f0 con 0x55956db407e0 2024-07-24T22:12:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.822+0000 7efe9dffb640 1 -- 172.21.15.47:0/1541925607 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7efea4005250 con 0x55956db407e0 2024-07-24T22:12:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.823+0000 7efe9dffb640 1 -- 172.21.15.47:0/1541925607 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efea4032050 con 0x55956db407e0 2024-07-24T22:12:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.823+0000 7efebe7cb740 10 client.26047 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.823+0000 7efebe7cb740 1 -- 172.21.15.47:0/1541925607 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55956d7fe650 con 0x55956db407e0 2024-07-24T22:12:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.823+0000 7efe9dffb640 1 -- 172.21.15.47:0/1541925607 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efea40035f0 con 0x55956db407e0 2024-07-24T22:12:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.823+0000 7efe9dffb640 1 -- 172.21.15.47:0/1541925607 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7efea4004c90 con 0x55956db407e0 2024-07-24T22:12:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.823+0000 7efebe7cb740 10 client.26047 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.823+0000 7efebe7cb740 10 client.26047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.823+0000 7efebe7cb740 20 client.26047 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.823+0000 7efebe7cb740 1 --2- 172.21.15.47:0/1541925607 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55956db5c4a0 0x55956db5e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.823+0000 7efebe7cb740 4 client.26047 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:12:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.823+0000 7efebe7cb740 1 -- 172.21.15.47:0/1541925607 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55956dab08e0 con 0x55956db5c4a0 2024-07-24T22:12:50.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.824+0000 7efeba1b6640 1 --2- 172.21.15.47:0/1541925607 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55956db5c4a0 0x55956db5e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.824+0000 7efe9dffb640 10 client.26047 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:50.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.824+0000 7efeba1b6640 1 --2- 172.21.15.47:0/1541925607 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55956db5c4a0 0x55956db5e960 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d6e38152890ff9f server_cookie=918f253e5375344 in_seq=0 out_seq=0 2024-07-24T22:12:50.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.824+0000 7efe9dffb640 1 -- 172.21.15.47:0/1541925607 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55956dab08e0 con 0x55956db5c4a0 2024-07-24T22:12:50.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.824+0000 7efe9dffb640 10 client.26047 handle_command_reply: tid=0 2024-07-24T22:12:50.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.825+0000 7efebe7cb740 1 client.26047 shutdown 2024-07-24T22:12:50.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.825+0000 7efebe7cb740 1 -- 172.21.15.47:0/1541925607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db407e0 msgr2=0x55956db49c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:50.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.825+0000 7efebe7cb740 1 --2- 172.21.15.47:0/1541925607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db407e0 0x55956db49c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efea40058c0 tx=0x7efea40039d0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.825+0000 7efebe7cb740 1 -- 172.21.15.47:0/1541925607 shutdown_connections 2024-07-24T22:12:50.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.825+0000 7efebe7cb740 1 --2- 172.21.15.47:0/1541925607 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55956db5c4a0 0x55956db5e960 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.825+0000 7efebe7cb740 1 --2- 172.21.15.47:0/1541925607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db4c770 0x55956db4a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.825+0000 7efebe7cb740 1 --2- 172.21.15.47:0/1541925607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db407e0 0x55956db49c70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.825+0000 7efebe7cb740 1 --2- 172.21.15.47:0/1541925607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db3fec0 0x55956db49730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.825+0000 7efebe7cb740 1 -- 172.21.15.47:0/1541925607 >> 172.21.15.47:0/1541925607 conn(0x55956db3dcf0 msgr2=0x55956db43890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:50.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.825+0000 7efe9dffb640 0 client.26047 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:50.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.825+0000 7efebe7cb740 1 -- 172.21.15.47:0/1541925607 shutdown_connections 2024-07-24T22:12:50.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.825+0000 7efebe7cb740 1 -- 172.21.15.47:0/1541925607 wait complete. 2024-07-24T22:12:50.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.825+0000 7efebe7cb740 20 client.26047 trim_cache size 0 max 16384 2024-07-24T22:12:50.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.845+0000 7efebe7cb740 1 Processor -- start 2024-07-24T22:12:50.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.845+0000 7efebe7cb740 1 -- start start 2024-07-24T22:12:50.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.845+0000 7efebe7cb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db3fec0 0x55956db3f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.845+0000 7efebe7cb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db407e0 0x55956db4b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.845+0000 7efebe7cb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db4c770 0x55956db64270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.845+0000 7efebe7cb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efeb41aa000 con 0x55956db407e0 2024-07-24T22:12:50.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.845+0000 7efebe7cb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efeb41ac880 con 0x55956db3fec0 2024-07-24T22:12:50.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.845+0000 7efebe7cb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efeb41aa670 con 0x55956db4c770 2024-07-24T22:12:50.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.845+0000 7efeba1b6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db3fec0 0x55956db3f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.845+0000 7efeb99b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db407e0 0x55956db4b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.845+0000 7efeba1b6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db3fec0 0x55956db3f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:58834/0 (socket says 172.21.15.47:58834) 2024-07-24T22:12:50.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.845+0000 7efeba1b6640 1 -- 172.21.15.47:0/4176777476 learned_addr learned my addr 172.21.15.47:0/4176777476 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:50.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.846+0000 7efeba1b6640 1 -- 172.21.15.47:0/4176777476 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db4c770 msgr2=0x55956db64270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:12:50.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.846+0000 7efeba1b6640 1 --2- 172.21.15.47:0/4176777476 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db4c770 0x55956db64270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.846+0000 7efeba1b6640 1 -- 172.21.15.47:0/4176777476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db407e0 msgr2=0x55956db4b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:50.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.846+0000 7efeba1b6640 1 --2- 172.21.15.47:0/4176777476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db407e0 0x55956db4b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.846+0000 7efeba1b6640 1 -- 172.21.15.47:0/4176777476 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55956db48690 con 0x55956db3fec0 2024-07-24T22:12:50.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.846+0000 7efeba1b6640 1 --2- 172.21.15.47:0/4176777476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db3fec0 0x55956db3f330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efeb00aa260 tx=0x7efeb000bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5e7168eb55a280e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:50.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.846+0000 7efe9ffff640 1 -- 172.21.15.47:0/4176777476 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb001e070 con 0x55956db3fec0 2024-07-24T22:12:50.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.846+0000 7efe9ffff640 1 -- 172.21.15.47:0/4176777476 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb00a9de0 con 0x55956db3fec0 2024-07-24T22:12:50.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.846+0000 7efe9ffff640 1 -- 172.21.15.47:0/4176777476 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb00a6560 con 0x55956db3fec0 2024-07-24T22:12:50.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.847+0000 7efebe7cb740 1 -- 172.21.15.47:0/4176777476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db3fec0 msgr2=0x55956db3f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:50.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.847+0000 7efebe7cb740 1 --2- 172.21.15.47:0/4176777476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db3fec0 0x55956db3f330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efeb00aa260 tx=0x7efeb000bf90 comp rx=0 tx=0).stop 2024-07-24T22:12:50.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.847+0000 7efebe7cb740 1 -- 172.21.15.47:0/4176777476 shutdown_connections 2024-07-24T22:12:50.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.847+0000 7efebe7cb740 1 --2- 172.21.15.47:0/4176777476 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db4c770 0x55956db64270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.847+0000 7efebe7cb740 1 --2- 172.21.15.47:0/4176777476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db407e0 0x55956db4b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.847+0000 7efebe7cb740 1 --2- 172.21.15.47:0/4176777476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db3fec0 0x55956db3f330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.847+0000 7efebe7cb740 1 -- 172.21.15.47:0/4176777476 >> 172.21.15.47:0/4176777476 conn(0x55956db3dcf0 msgr2=0x55956db4ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:50.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.848+0000 7efebe7cb740 1 -- 172.21.15.47:0/4176777476 shutdown_connections 2024-07-24T22:12:50.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.848+0000 7efebe7cb740 1 -- 172.21.15.47:0/4176777476 wait complete. 2024-07-24T22:12:50.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.848+0000 7efebe7cb740 1 -- start start 2024-07-24T22:12:50.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.848+0000 7efebe7cb740 1 Processor -- start 2024-07-24T22:12:50.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efebe7cb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db3fec0 0x55956db54a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efebe7cb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db407e0 0x55956db4ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efebe7cb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db4c770 0x55956db50490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efeb99b5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db407e0 0x55956db4ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efeba1b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db3fec0 0x55956db54a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efeba1b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db3fec0 0x55956db54a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51262/0 (socket says 172.21.15.47:51262) 2024-07-24T22:12:50.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efeb99b5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db407e0 0x55956db4ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:58850/0 (socket says 172.21.15.47:58850) 2024-07-24T22:12:50.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efeba1b6640 1 -- 172.21.15.47:0/3103318069 learned_addr learned my addr 172.21.15.47:0/3103318069 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:50.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efebe7cb740 1 -- 172.21.15.47:0/3103318069 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efeb41aad40 con 0x55956db3fec0 2024-07-24T22:12:50.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efebe7cb740 1 -- 172.21.15.47:0/3103318069 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efeb41ac1b0 con 0x55956db407e0 2024-07-24T22:12:50.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efebe7cb740 1 -- 172.21.15.47:0/3103318069 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efeb41ab410 con 0x55956db4c770 2024-07-24T22:12:50.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efeba9b7640 1 --2- 172.21.15.47:0/3103318069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db4c770 0x55956db50490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efeb99b5640 1 -- 172.21.15.47:0/3103318069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db4c770 msgr2=0x55956db50490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:50.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efeb99b5640 1 --2- 172.21.15.47:0/3103318069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db4c770 0x55956db50490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.849+0000 7efeb99b5640 1 -- 172.21.15.47:0/3103318069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db3fec0 msgr2=0x55956db54a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:50.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.850+0000 7efeb99b5640 1 --2- 172.21.15.47:0/3103318069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db3fec0 0x55956db54a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.850+0000 7efeb99b5640 1 -- 172.21.15.47:0/3103318069 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55956db50a20 con 0x55956db407e0 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.850+0000 7efeba1b6640 1 --2- 172.21.15.47:0/3103318069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db3fec0 0x55956db54a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.850+0000 7efebe7cb740 10 client.0 _ll_register_callbacks cb 0x7efea401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.850+0000 7efeb99b5640 1 --2- 172.21.15.47:0/3103318069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db407e0 0x55956db4ff50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efea4009730 tx=0x7efea4005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb51c5dcdde70c66 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.850+0000 7efebe7cb740 1 -- 172.21.15.47:0/3103318069 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeb00a9de0 con 0x55956db407e0 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.850+0000 7efe9dffb640 10 client.26009 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.850+0000 7efe9dffb640 1 -- 172.21.15.47:0/3103318069 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea403b060 con 0x55956db407e0 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.850+0000 7efe9dffb640 1 -- 172.21.15.47:0/3103318069 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7efea4003c40 con 0x55956db407e0 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.850+0000 7efe9dffb640 1 -- 172.21.15.47:0/3103318069 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efea4027050 con 0x55956db407e0 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.850+0000 7efebe7cb740 10 client.26009 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.850+0000 7efebe7cb740 1 -- 172.21.15.47:0/3103318069 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({fsmap=20}) -- 0x55956dbc6d40 con 0x55956db407e0 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.851+0000 7efe9dffb640 1 -- 172.21.15.47:0/3103318069 <== mon.2 v2:172.21.15.183:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7efea4005250 con 0x55956db407e0 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.851+0000 7efebe7cb740 10 client.26009 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.851+0000 7efebe7cb740 10 client.26009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.851+0000 7efebe7cb740 20 client.26009 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.851+0000 7efebe7cb740 1 --2- 172.21.15.47:0/3103318069 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55956dbc7320 0x55956dbc97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.851+0000 7efebe7cb740 4 client.26009 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.851+0000 7efebe7cb740 1 -- 172.21.15.47:0/3103318069 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55956daac380 con 0x55956dbc7320 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.851+0000 7efeba1b6640 1 --2- 172.21.15.47:0/3103318069 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55956dbc7320 0x55956dbc97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.852+0000 7efeba1b6640 1 --2- 172.21.15.47:0/3103318069 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55956dbc7320 0x55956dbc97e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1784d2c944426486 server_cookie=6a3d735027c6fa58 in_seq=0 out_seq=0 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.852+0000 7efe9dffb640 10 client.26009 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.852+0000 7efe9dffb640 1 -- 172.21.15.47:0/3103318069 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55956daac380 con 0x55956dbc7320 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.852+0000 7efe9dffb640 10 client.26009 handle_command_reply: tid=0 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.852+0000 7efebe7cb740 1 client.26009 shutdown 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.852+0000 7efebe7cb740 1 -- 172.21.15.47:0/3103318069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db407e0 msgr2=0x55956db4ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.852+0000 7efebe7cb740 1 --2- 172.21.15.47:0/3103318069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db407e0 0x55956db4ff50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efea4009730 tx=0x7efea4005f10 comp rx=0 tx=0).stop 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.852+0000 7efebe7cb740 1 -- 172.21.15.47:0/3103318069 shutdown_connections 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.852+0000 7efebe7cb740 1 --2- 172.21.15.47:0/3103318069 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55956dbc7320 0x55956dbc97e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.852+0000 7efebe7cb740 1 --2- 172.21.15.47:0/3103318069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55956db4c770 0x55956db50490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.852+0000 7efe9dffb640 0 client.26009 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:50.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.852+0000 7efebe7cb740 1 --2- 172.21.15.47:0/3103318069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55956db407e0 0x55956db4ff50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.852+0000 7efebe7cb740 1 --2- 172.21.15.47:0/3103318069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55956db3fec0 0x55956db54a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.853+0000 7efebe7cb740 1 -- 172.21.15.47:0/3103318069 >> 172.21.15.47:0/3103318069 conn(0x55956db3dcf0 msgr2=0x55956db4b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:50.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.853+0000 7efebe7cb740 1 -- 172.21.15.47:0/3103318069 shutdown_connections 2024-07-24T22:12:50.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.853+0000 7efebe7cb740 1 -- 172.21.15.47:0/3103318069 wait complete. 2024-07-24T22:12:50.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.853+0000 7efebe7cb740 20 client.26009 trim_cache size 0 max 16384 2024-07-24T22:12:50.866 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:12:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:12:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:12:50.867 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:12:50.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.854+0000 7efebc41a640 1 -- 172.21.15.47:0/2511859443 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efea00b3dc0 msgr2=0x7efea00b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:50.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.854+0000 7efebc41a640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efea00b3dc0 0x7efea00b6280 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efeac006010 tx=0x7efeac005d80 comp rx=0 tx=0).stop 2024-07-24T22:12:50.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.854+0000 7efebc41a640 1 -- 172.21.15.47:0/2511859443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efeb4101670 msgr2=0x7efeb4197bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:50.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.854+0000 7efebc41a640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efeb4101670 0x7efeb4197bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efeb000b4a0 tx=0x7efeb000b960 comp rx=0 tx=0).stop 2024-07-24T22:12:50.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.854+0000 7efebc41a640 1 -- 172.21.15.47:0/2511859443 shutdown_connections 2024-07-24T22:12:50.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.854+0000 7efebc41a640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efea00b3dc0 0x7efea00b6280 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.854+0000 7efebc41a640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeb4107a00 0x7efeb419d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.854+0000 7efebc41a640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efeb4107080 0x7efeb4198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.854+0000 7efebc41a640 1 --2- 172.21.15.47:0/2511859443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efeb4101670 0x7efeb4197bf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:50.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.854+0000 7efebc41a640 1 -- 172.21.15.47:0/2511859443 >> 172.21.15.47:0/2511859443 conn(0x7efeb40fd0c0 msgr2=0x7efeb40ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:50.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.854+0000 7efebc41a640 1 -- 172.21.15.47:0/2511859443 shutdown_connections 2024-07-24T22:12:50.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:50.854+0000 7efebc41a640 1 -- 172.21.15.47:0/2511859443 wait complete. 2024-07-24T22:12:50.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:50 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:12:51.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:51 smithi047 ceph-mon[32551]: pgmap v535: 97 pgs: 97 active+clean; 49 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 511 MiB/s wr, 826 op/s 2024-07-24T22:12:51.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:51 smithi183 ceph-mon[37007]: pgmap v535: 97 pgs: 97 active+clean; 49 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 511 MiB/s wr, 826 op/s 2024-07-24T22:12:52.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:51 smithi188 ceph-mon[37380]: pgmap v535: 97 pgs: 97 active+clean; 49 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 511 MiB/s wr, 826 op/s 2024-07-24T22:12:52.133 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:12:52.164 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:12:52.536 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:12:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.761+0000 7f8027713640 1 -- 172.21.15.47:0/809694053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8020101390 msgr2=0x7f8020101770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.761+0000 7f8027713640 1 --2- 172.21.15.47:0/809694053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8020101390 0x7f8020101770 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f801c009900 tx=0x7f801c02a410 comp rx=0 tx=0).stop 2024-07-24T22:12:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.761+0000 7f8027713640 1 -- 172.21.15.47:0/809694053 shutdown_connections 2024-07-24T22:12:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.761+0000 7f8027713640 1 --2- 172.21.15.47:0/809694053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80201067c0 0x7f8020106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.761+0000 7f8027713640 1 --2- 172.21.15.47:0/809694053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8020101cb0 0x7f8020106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.761+0000 7f8027713640 1 --2- 172.21.15.47:0/809694053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8020101390 0x7f8020101770 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.761+0000 7f8027713640 1 -- 172.21.15.47:0/809694053 >> 172.21.15.47:0/809694053 conn(0x7f80200fd010 msgr2=0x7f80200ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.761+0000 7f8027713640 1 -- 172.21.15.47:0/809694053 shutdown_connections 2024-07-24T22:12:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.761+0000 7f8027713640 1 -- 172.21.15.47:0/809694053 wait complete. 2024-07-24T22:12:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.762+0000 7f8027713640 1 Processor -- start 2024-07-24T22:12:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.762+0000 7f8027713640 1 -- start start 2024-07-24T22:12:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.762+0000 7f8027713640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8020101390 0x7f802019f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.762+0000 7f8027713640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8020101cb0 0x7f802019f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.762+0000 7f8027713640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80201067c0 0x7f80201a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.762+0000 7f8027713640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8020118c80 con 0x7f8020101390 2024-07-24T22:12:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.762+0000 7f8027713640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8020118b00 con 0x7f80201067c0 2024-07-24T22:12:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.762+0000 7f8027713640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8020118e00 con 0x7f8020101cb0 2024-07-24T22:12:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f8024cae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8020101cb0 0x7f802019f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f80254af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8020101390 0x7f802019f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f8024cae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8020101cb0 0x7f802019f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:54486/0 (socket says 172.21.15.47:54486) 2024-07-24T22:12:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f80254af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8020101390 0x7f802019f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51290/0 (socket says 172.21.15.47:51290) 2024-07-24T22:12:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f8024cae640 1 -- 172.21.15.47:0/2711918328 learned_addr learned my addr 172.21.15.47:0/2711918328 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f8025cb0640 1 --2- 172.21.15.47:0/2711918328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80201067c0 0x7f80201a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f8024cae640 1 -- 172.21.15.47:0/2711918328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80201067c0 msgr2=0x7f80201a4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f8024cae640 1 --2- 172.21.15.47:0/2711918328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80201067c0 0x7f80201a4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f8024cae640 1 -- 172.21.15.47:0/2711918328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8020101390 msgr2=0x7f802019f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f8024cae640 1 --2- 172.21.15.47:0/2711918328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8020101390 0x7f802019f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f8024cae640 1 -- 172.21.15.47:0/2711918328 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80201a52e0 con 0x7f8020101cb0 2024-07-24T22:12:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f8024cae640 1 --2- 172.21.15.47:0/2711918328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8020101cb0 0x7f802019f780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f801000e9c0 tx=0x7f801000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f80167fc640 1 -- 172.21.15.47:0/2711918328 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801000ccc0 con 0x7f8020101cb0 2024-07-24T22:12:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f8027713640 1 -- 172.21.15.47:0/2711918328 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80201a55d0 con 0x7f8020101cb0 2024-07-24T22:12:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f80167fc640 1 -- 172.21.15.47:0/2711918328 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80100035f0 con 0x7f8020101cb0 2024-07-24T22:12:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f80167fc640 1 -- 172.21.15.47:0/2711918328 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801000ce60 con 0x7f8020101cb0 2024-07-24T22:12:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.763+0000 7f8027713640 1 -- 172.21.15.47:0/2711918328 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80201abc90 con 0x7f8020101cb0 2024-07-24T22:12:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.766+0000 7f802a46f740 1 Processor -- start 2024-07-24T22:12:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.766+0000 7f80167fc640 1 -- 172.21.15.47:0/2711918328 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8010010670 con 0x7f8020101cb0 2024-07-24T22:12:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.766+0000 7f802a46f740 1 -- start start 2024-07-24T22:12:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.766+0000 7f802a46f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.766+0000 7f802a46f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2dcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.766+0000 7f802a46f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2dd170 0x55e6bf2df560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.766+0000 7f802a46f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e6bf246280 con 0x55e6bf2dd170 2024-07-24T22:12:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.766+0000 7f802a46f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e6bf235780 con 0x55e6bf2d08c0 2024-07-24T22:12:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.766+0000 7f802a46f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e6bf2397c0 con 0x55e6bf2d11e0 2024-07-24T22:12:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f8024cae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2dd170 0x55e6bf2df560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f8025cb0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f8025cb0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2d0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:58888/0 (socket says 172.21.15.47:58888) 2024-07-24T22:12:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f8025cb0640 1 -- 172.21.15.47:0/1605492191 learned_addr learned my addr 172.21.15.47:0/1605492191 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f80254af640 1 --2- 172.21.15.47:0/1605492191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2dcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f8025cb0640 1 -- 172.21.15.47:0/1605492191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2d11e0 msgr2=0x55e6bf2dcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f8025cb0640 1 --2- 172.21.15.47:0/1605492191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2dcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f8025cb0640 1 -- 172.21.15.47:0/1605492191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2dd170 msgr2=0x55e6bf2df560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f8025cb0640 1 --2- 172.21.15.47:0/1605492191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2dd170 0x55e6bf2df560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f8025cb0640 1 -- 172.21.15.47:0/1605492191 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6bef99790 con 0x55e6bf2d08c0 2024-07-24T22:12:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f8024cae640 1 --2- 172.21.15.47:0/1605492191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2dd170 0x55e6bf2df560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f80167fc640 1 --2- 172.21.15.47:0/2711918328 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f800c0b3d40 0x7f800c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f8025cb0640 1 --2- 172.21.15.47:0/1605492191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2d0ca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8018009f50 tx=0x7f80180118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc079c82bf4e1b86 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f80254af640 1 --2- 172.21.15.47:0/2711918328 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f800c0b3d40 0x7f800c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f800b7fe640 1 -- 172.21.15.47:0/1605492191 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018004d20 con 0x55e6bf2d08c0 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.767+0000 7f80167fc640 1 -- 172.21.15.47:0/2711918328 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f80100e42c0 con 0x7f8020101cb0 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.768+0000 7f800b7fe640 1 -- 172.21.15.47:0/1605492191 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8018004050 con 0x55e6bf2d08c0 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.768+0000 7f800b7fe640 1 -- 172.21.15.47:0/1605492191 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018005280 con 0x55e6bf2d08c0 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.768+0000 7f802a46f740 1 -- 172.21.15.47:0/1605492191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d08c0 msgr2=0x55e6bf2d0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.768+0000 7f80254af640 1 --2- 172.21.15.47:0/2711918328 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f800c0b3d40 0x7f800c0b6200 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f801c031440 tx=0x7f801c005890 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.768+0000 7f802a46f740 1 --2- 172.21.15.47:0/1605492191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2d0ca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8018009f50 tx=0x7f80180118d0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.768+0000 7f802a46f740 1 -- 172.21.15.47:0/1605492191 shutdown_connections 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.768+0000 7f802a46f740 1 --2- 172.21.15.47:0/1605492191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2dd170 0x55e6bf2df560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.768+0000 7f802a46f740 1 --2- 172.21.15.47:0/1605492191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2dcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.768+0000 7f802a46f740 1 --2- 172.21.15.47:0/1605492191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2d0ca0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.768+0000 7f802a46f740 1 -- 172.21.15.47:0/1605492191 >> 172.21.15.47:0/1605492191 conn(0x55e6bf2ce6f0 msgr2=0x55e6bf2cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.768+0000 7f802a46f740 1 -- 172.21.15.47:0/1605492191 shutdown_connections 2024-07-24T22:12:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.768+0000 7f802a46f740 1 -- 172.21.15.47:0/1605492191 wait complete. 2024-07-24T22:12:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.769+0000 7f802a46f740 1 -- start start 2024-07-24T22:12:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.769+0000 7f802a46f740 1 Processor -- start 2024-07-24T22:12:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.769+0000 7f802a46f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2dc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.769+0000 7f802a46f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2d9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.769+0000 7f802a46f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2dd170 0x55e6bf2da310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.769+0000 7f802a46f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e6bf16fab0 con 0x55e6bf2d11e0 2024-07-24T22:12:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.769+0000 7f802a46f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e6bf1bd9e0 con 0x55e6bf2d08c0 2024-07-24T22:12:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.769+0000 7f802a46f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e6bf2dfe50 con 0x55e6bf2dd170 2024-07-24T22:12:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.769+0000 7f802a46f740 10 client.0 _ll_register_callbacks cb 0x55e6bef45a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.769+0000 7f8024cae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2d9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.769+0000 7f8024cae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2d9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51312/0 (socket says 172.21.15.47:51312) 2024-07-24T22:12:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.769+0000 7f80254af640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2dc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.770+0000 7f8024cae640 1 -- 172.21.15.47:0/4284979047 learned_addr learned my addr 172.21.15.47:0/4284979047 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.770+0000 7f8025cb0640 1 --2- 172.21.15.47:0/4284979047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2dd170 0x55e6bf2da310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.770+0000 7f80254af640 1 -- 172.21.15.47:0/4284979047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2dd170 msgr2=0x55e6bf2da310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.770+0000 7f80254af640 1 --2- 172.21.15.47:0/4284979047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2dd170 0x55e6bf2da310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.770+0000 7f80254af640 1 -- 172.21.15.47:0/4284979047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d11e0 msgr2=0x55e6bf2d9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.770+0000 7f80254af640 1 --2- 172.21.15.47:0/4284979047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2d9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.770+0000 7f80254af640 1 -- 172.21.15.47:0/4284979047 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6bf012620 con 0x55e6bf2d08c0 2024-07-24T22:12:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.770+0000 7f8025cb0640 1 --2- 172.21.15.47:0/4284979047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2dd170 0x55e6bf2da310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.770+0000 7f80254af640 1 --2- 172.21.15.47:0/4284979047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2dc8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f801c009230 tx=0x7f801c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f9f8ef70a49c533 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.770+0000 7f8008ff9640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:12:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.770+0000 7f8008ff9640 1 -- 172.21.15.47:0/4284979047 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c04c030 con 0x55e6bf2d08c0 2024-07-24T22:12:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.770+0000 7f8008ff9640 1 -- 172.21.15.47:0/4284979047 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f801c004040 con 0x55e6bf2d08c0 2024-07-24T22:12:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.770+0000 7f802a46f740 1 -- 172.21.15.47:0/4284979047 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e6bf1e4ce0 con 0x55e6bf2d08c0 2024-07-24T22:12:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.771+0000 7f8008ff9640 1 -- 172.21.15.47:0/4284979047 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f801c035040 con 0x55e6bf2d08c0 2024-07-24T22:12:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.771+0000 7f802a46f740 10 client.26021 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.771+0000 7f802a46f740 1 -- 172.21.15.47:0/4284979047 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e6bf2eb620 con 0x55e6bf2d08c0 2024-07-24T22:12:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.771+0000 7f8008ff9640 1 -- 172.21.15.47:0/4284979047 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e6bf1e4ce0 con 0x55e6bf2d08c0 2024-07-24T22:12:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.771+0000 7f8008ff9640 1 -- 172.21.15.47:0/4284979047 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f801c05a480 con 0x55e6bf2d08c0 2024-07-24T22:12:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.771+0000 7f802a46f740 10 client.26021 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.771+0000 7f802a46f740 10 client.26021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.771+0000 7f802a46f740 20 client.26021 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.771+0000 7f802a46f740 1 --2- 172.21.15.47:0/4284979047 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e6bf2ecb00 0x55e6bf2eeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.771+0000 7f802a46f740 4 client.26021 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:12:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.771+0000 7f802a46f740 1 -- 172.21.15.47:0/4284979047 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6bf2481d0 con 0x55e6bf2ecb00 2024-07-24T22:12:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.771+0000 7f8024cae640 1 --2- 172.21.15.47:0/4284979047 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e6bf2ecb00 0x55e6bf2eeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.772+0000 7f8008ff9640 10 client.26021 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.772+0000 7f8024cae640 1 --2- 172.21.15.47:0/4284979047 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e6bf2ecb00 0x55e6bf2eeef0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60e927c452c0764e server_cookie=47d238bc55cdea9c in_seq=0 out_seq=0 2024-07-24T22:12:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.773+0000 7f8008ff9640 1 -- 172.21.15.47:0/4284979047 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6bf2481d0 con 0x55e6bf2ecb00 2024-07-24T22:12:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.773+0000 7f8008ff9640 10 client.26021 handle_command_reply: tid=0 2024-07-24T22:12:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.773+0000 7f802a46f740 1 client.26021 shutdown 2024-07-24T22:12:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.773+0000 7f802a46f740 1 -- 172.21.15.47:0/4284979047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d08c0 msgr2=0x55e6bf2dc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.773+0000 7f802a46f740 1 --2- 172.21.15.47:0/4284979047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2dc8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f801c009230 tx=0x7f801c009260 comp rx=0 tx=0).stop 2024-07-24T22:12:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.773+0000 7f802a46f740 1 -- 172.21.15.47:0/4284979047 shutdown_connections 2024-07-24T22:12:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.773+0000 7f802a46f740 1 --2- 172.21.15.47:0/4284979047 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e6bf2ecb00 0x55e6bf2eeef0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.773+0000 7f802a46f740 1 --2- 172.21.15.47:0/4284979047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2dd170 0x55e6bf2da310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.773+0000 7f8008ff9640 0 client.26021 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.773+0000 7f802a46f740 1 --2- 172.21.15.47:0/4284979047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2d9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.773+0000 7f802a46f740 1 --2- 172.21.15.47:0/4284979047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2dc8f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.773+0000 7f802a46f740 1 -- 172.21.15.47:0/4284979047 >> 172.21.15.47:0/4284979047 conn(0x55e6bf2ce6f0 msgr2=0x55e6bf2d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.774+0000 7f802a46f740 1 -- 172.21.15.47:0/4284979047 shutdown_connections 2024-07-24T22:12:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.774+0000 7f802a46f740 1 -- 172.21.15.47:0/4284979047 wait complete. 2024-07-24T22:12:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.774+0000 7f802a46f740 20 client.26021 trim_cache size 0 max 16384 2024-07-24T22:12:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.790+0000 7f802a46f740 1 Processor -- start 2024-07-24T22:12:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.790+0000 7f802a46f740 1 -- start start 2024-07-24T22:12:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.790+0000 7f802a46f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.790+0000 7f802a46f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2da2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.790+0000 7f802a46f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2dd170 0x55e6bf2dc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.790+0000 7f802a46f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f80201b27d0 con 0x55e6bf2d08c0 2024-07-24T22:12:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.790+0000 7f802a46f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f80201b5050 con 0x55e6bf2d11e0 2024-07-24T22:12:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.790+0000 7f80254af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.790+0000 7f802a46f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f80201b2e40 con 0x55e6bf2dd170 2024-07-24T22:12:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.790+0000 7f8025cb0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2dd170 0x55e6bf2dc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.790+0000 7f80254af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2e8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51318/0 (socket says 172.21.15.47:51318) 2024-07-24T22:12:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.790+0000 7f80254af640 1 -- 172.21.15.47:0/2449388624 learned_addr learned my addr 172.21.15.47:0/2449388624 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.790+0000 7f8024cae640 1 --2- 172.21.15.47:0/2449388624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2da2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.791+0000 7f8024cae640 1 -- 172.21.15.47:0/2449388624 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2dd170 msgr2=0x55e6bf2dc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.791+0000 7f8024cae640 1 --2- 172.21.15.47:0/2449388624 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2dd170 0x55e6bf2dc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.791+0000 7f8024cae640 1 -- 172.21.15.47:0/2449388624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 msgr2=0x55e6bf2e8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.791+0000 7f8024cae640 1 --2- 172.21.15.47:0/2449388624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2e8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.791+0000 7f8024cae640 1 -- 172.21.15.47:0/2449388624 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6bf2d8d10 con 0x55e6bf2d11e0 2024-07-24T22:12:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.791+0000 7f80254af640 1 --2- 172.21.15.47:0/2449388624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2e8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.791+0000 7f8024cae640 1 --2- 172.21.15.47:0/2449388624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2da2b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f80100aae60 tx=0x7f80100e7e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbe54d5226dd65de server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.791+0000 7f800affd640 1 -- 172.21.15.47:0/2449388624 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80100aa820 con 0x55e6bf2d11e0 2024-07-24T22:12:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.791+0000 7f800affd640 1 -- 172.21.15.47:0/2449388624 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80100aa9e0 con 0x55e6bf2d11e0 2024-07-24T22:12:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.791+0000 7f800affd640 1 -- 172.21.15.47:0/2449388624 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80100aa640 con 0x55e6bf2d11e0 2024-07-24T22:12:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.792+0000 7f802a46f740 1 -- 172.21.15.47:0/2449388624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d11e0 msgr2=0x55e6bf2da2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.792+0000 7f802a46f740 1 --2- 172.21.15.47:0/2449388624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2da2b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f80100aae60 tx=0x7f80100e7e10 comp rx=0 tx=0).stop 2024-07-24T22:12:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.792+0000 7f802a46f740 1 -- 172.21.15.47:0/2449388624 shutdown_connections 2024-07-24T22:12:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.792+0000 7f802a46f740 1 --2- 172.21.15.47:0/2449388624 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2dd170 0x55e6bf2dc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.792+0000 7f802a46f740 1 --2- 172.21.15.47:0/2449388624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2da2b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.792+0000 7f802a46f740 1 --2- 172.21.15.47:0/2449388624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2e8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.792+0000 7f802a46f740 1 -- 172.21.15.47:0/2449388624 >> 172.21.15.47:0/2449388624 conn(0x55e6bf2ce6f0 msgr2=0x55e6bf2d5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.792+0000 7f802a46f740 1 -- 172.21.15.47:0/2449388624 shutdown_connections 2024-07-24T22:12:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.792+0000 7f802a46f740 1 -- 172.21.15.47:0/2449388624 wait complete. 2024-07-24T22:12:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.792+0000 7f802a46f740 1 -- start start 2024-07-24T22:12:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.793+0000 7f802a46f740 1 Processor -- start 2024-07-24T22:12:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.793+0000 7f802a46f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2e5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.793+0000 7f802a46f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2e55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.793+0000 7f802a46f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2dd170 0x55e6bf34f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.793+0000 7f802a46f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f80201b3510 con 0x55e6bf2d08c0 2024-07-24T22:12:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.793+0000 7f802a46f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f80201b4980 con 0x55e6bf2dd170 2024-07-24T22:12:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.793+0000 7f802a46f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f80201b3be0 con 0x55e6bf2d11e0 2024-07-24T22:12:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.793+0000 7f802a46f740 10 client.0 _ll_register_callbacks cb 0x7f8010005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:12:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.793+0000 7f80254af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2e5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.793+0000 7f80254af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2e5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51334/0 (socket says 172.21.15.47:51334) 2024-07-24T22:12:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.793+0000 7f8025cb0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2dd170 0x55e6bf34f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.793+0000 7f80254af640 1 -- 172.21.15.47:0/1948107946 learned_addr learned my addr 172.21.15.47:0/1948107946 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.793+0000 7f8024cae640 1 --2- 172.21.15.47:0/1948107946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2e55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.794+0000 7f8025cb0640 1 -- 172.21.15.47:0/1948107946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2d11e0 msgr2=0x55e6bf2e55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.794+0000 7f8025cb0640 1 --2- 172.21.15.47:0/1948107946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2e55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.794+0000 7f8025cb0640 1 -- 172.21.15.47:0/1948107946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 msgr2=0x55e6bf2e5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:12:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.794+0000 7f8025cb0640 1 --2- 172.21.15.47:0/1948107946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2e5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.794+0000 7f8025cb0640 1 -- 172.21.15.47:0/1948107946 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6bf2d1010 con 0x55e6bf2dd170 2024-07-24T22:12:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.794+0000 7f80254af640 1 --2- 172.21.15.47:0/1948107946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2e5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.794+0000 7f8025cb0640 1 --2- 172.21.15.47:0/1948107946 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2dd170 0x55e6bf34f790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8018000f80 tx=0x7f80180045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75ed8a40246a77b5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.794+0000 7f8008ff9640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:12:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.794+0000 7f8008ff9640 1 -- 172.21.15.47:0/1948107946 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018004850 con 0x55e6bf2dd170 2024-07-24T22:12:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.794+0000 7f8008ff9640 1 -- 172.21.15.47:0/1948107946 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f80180049f0 con 0x55e6bf2dd170 2024-07-24T22:12:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.794+0000 7f802a46f740 1 -- 172.21.15.47:0/1948107946 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80100aa9e0 con 0x55e6bf2dd170 2024-07-24T22:12:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.795+0000 7f8008ff9640 1 -- 172.21.15.47:0/1948107946 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8018004c30 con 0x55e6bf2dd170 2024-07-24T22:12:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.795+0000 7f802a46f740 10 client.26027 fetch_fsmap learned FSMap version 20 2024-07-24T22:12:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.795+0000 7f802a46f740 1 -- 172.21.15.47:0/1948107946 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e6bf357160 con 0x55e6bf2dd170 2024-07-24T22:12:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.795+0000 7f8008ff9640 1 -- 172.21.15.47:0/1948107946 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80100aa9e0 con 0x55e6bf2dd170 2024-07-24T22:12:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.795+0000 7f8008ff9640 1 -- 172.21.15.47:0/1948107946 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f801800f480 con 0x55e6bf2dd170 2024-07-24T22:12:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.795+0000 7f802a46f740 10 client.26027 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:12:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.795+0000 7f802a46f740 10 client.26027 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:12:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.795+0000 7f802a46f740 20 client.26027 populate_metadata read hostname 'smithi047' 2024-07-24T22:12:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.795+0000 7f802a46f740 1 --2- 172.21.15.47:0/1948107946 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e6bf3576c0 0x55e6bf359ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.795+0000 7f802a46f740 4 client.26027 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:12:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.795+0000 7f802a46f740 1 -- 172.21.15.47:0/1948107946 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e6bf2dcc80 con 0x55e6bf3576c0 2024-07-24T22:12:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.795+0000 7f80254af640 1 --2- 172.21.15.47:0/1948107946 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e6bf3576c0 0x55e6bf359ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.796+0000 7f8008ff9640 10 client.26027 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:52.796+0000 7f80254af640 1 --2- 172.21.15.47:0/1948107946 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e6bf3576c0 0x55e6bf359ae0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d80ef0b71982a802 server_cookie=65687b2347383161 in_seq=0 out_seq=0 2024-07-24T22:12:53.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:53 smithi047 ceph-mon[32551]: pgmap v536: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 406 MiB/s wr, 523 op/s 2024-07-24T22:12:53.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:53 smithi183 ceph-mon[37007]: pgmap v536: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 406 MiB/s wr, 523 op/s 2024-07-24T22:12:54.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:53 smithi188 ceph-mon[37380]: pgmap v536: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 406 MiB/s wr, 523 op/s 2024-07-24T22:12:55.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.576+0000 7fb8899f7640 1 -- 172.21.15.47:0/1113309733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb88410cae0 msgr2=0x7fb88410ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:55.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.576+0000 7fb8899f7640 1 --2- 172.21.15.47:0/1113309733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb88410cae0 0x7fb88410ef40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009ca0 tx=0x7fb87c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:12:55.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.576+0000 7fb8899f7640 1 -- 172.21.15.47:0/1113309733 shutdown_connections 2024-07-24T22:12:55.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.576+0000 7fb8899f7640 1 --2- 172.21.15.47:0/1113309733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb88410cae0 0x7fb88410ef40 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:55.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.576+0000 7fb8899f7640 1 --2- 172.21.15.47:0/1113309733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb884103fa0 0x7fb88410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:55.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.576+0000 7fb8899f7640 1 --2- 172.21.15.47:0/1113309733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb884103680 0x7fb884103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:55.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.576+0000 7fb8899f7640 1 -- 172.21.15.47:0/1113309733 >> 172.21.15.47:0/1113309733 conn(0x7fb8840fd0e0 msgr2=0x7fb8840ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.576+0000 7fb8899f7640 1 -- 172.21.15.47:0/1113309733 shutdown_connections 2024-07-24T22:12:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.576+0000 7fb8899f7640 1 -- 172.21.15.47:0/1113309733 wait complete. 2024-07-24T22:12:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.577+0000 7fb8899f7640 1 Processor -- start 2024-07-24T22:12:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.577+0000 7fb8899f7640 1 -- start start 2024-07-24T22:12:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.577+0000 7fb8899f7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb884103680 0x7fb884198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.577+0000 7fb8899f7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb884103fa0 0x7fb884199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.577+0000 7fb8899f7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88410cae0 0x7fb88419e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.577+0000 7fb8899f7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb884112730 con 0x7fb884103fa0 2024-07-24T22:12:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.577+0000 7fb8899f7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841125b0 con 0x7fb88410cae0 2024-07-24T22:12:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.577+0000 7fb8899f7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841128b0 con 0x7fb884103680 2024-07-24T22:12:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.577+0000 7fb87bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb884103fa0 0x7fb884199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb882ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb884103680 0x7fb884198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb882ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb884103680 0x7fb884198c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51984/0 (socket says 172.21.15.47:51984) 2024-07-24T22:12:55.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb87bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb884103fa0 0x7fb884199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47144/0 (socket says 172.21.15.47:47144) 2024-07-24T22:12:55.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb882ffd640 1 -- 172.21.15.47:0/4236339895 learned_addr learned my addr 172.21.15.47:0/4236339895 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:12:55.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb8837fe640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88410cae0 0x7fb88419e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:55.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb882ffd640 1 -- 172.21.15.47:0/4236339895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88410cae0 msgr2=0x7fb88419e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:55.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb882ffd640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88410cae0 0x7fb88419e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:55.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb882ffd640 1 -- 172.21.15.47:0/4236339895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb884103fa0 msgr2=0x7fb884199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:55.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb882ffd640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb884103fa0 0x7fb884199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:55.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb882ffd640 1 -- 172.21.15.47:0/4236339895 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88419ecb0 con 0x7fb884103680 2024-07-24T22:12:55.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb87bfff640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb884103fa0 0x7fb884199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:12:55.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb882ffd640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb884103680 0x7fb884198c00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb87400d950 tx=0x7fb87400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:55.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb8889f5640 1 -- 172.21.15.47:0/4236339895 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb874017070 con 0x7fb884103680 2024-07-24T22:12:55.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb8889f5640 1 -- 172.21.15.47:0/4236339895 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb874009c30 con 0x7fb884103680 2024-07-24T22:12:55.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb8899f7640 1 -- 172.21.15.47:0/4236339895 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88419efa0 con 0x7fb884103680 2024-07-24T22:12:55.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb8889f5640 1 -- 172.21.15.47:0/4236339895 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87400f620 con 0x7fb884103680 2024-07-24T22:12:55.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.578+0000 7fb8899f7640 1 -- 172.21.15.47:0/4236339895 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8841a5660 con 0x7fb884103680 2024-07-24T22:12:55.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.579+0000 7fb8899f7640 1 -- 172.21.15.47:0/4236339895 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb884103a60 con 0x7fb884103680 2024-07-24T22:12:55.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.581+0000 7fb8889f5640 1 -- 172.21.15.47:0/4236339895 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fb874010460 con 0x7fb884103680 2024-07-24T22:12:55.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.582+0000 7fb8889f5640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb8700b3d40 0x7fb8700b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:12:55.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.583+0000 7fb87bfff640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb8700b3d40 0x7fb8700b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:12:55.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.583+0000 7fb8889f5640 1 -- 172.21.15.47:0/4236339895 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fb8740e3b80 con 0x7fb884103680 2024-07-24T22:12:55.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.583+0000 7fb87bfff640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb8700b3d40 0x7fb8700b6200 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb8840ff9f0 tx=0x7fb86c005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:12:55.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.585+0000 7fb8889f5640 1 -- 172.21.15.47:0/4236339895 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fb874009de0 con 0x7fb884103680 2024-07-24T22:12:55.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:55 smithi183 ceph-mon[37007]: pgmap v537: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 458 MiB/s wr, 638 op/s 2024-07-24T22:12:55.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:55 smithi047 ceph-mon[32551]: pgmap v537: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 458 MiB/s wr, 638 op/s 2024-07-24T22:12:55.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.963+0000 7fb8899f7640 1 -- 172.21.15.47:0/4236339895 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb88402e000 con 0x7fb884103680 2024-07-24T22:12:55.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.964+0000 7fb8889f5640 1 -- 172.21.15.47:0/4236339895 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7fb8740b3160 con 0x7fb884103680 2024-07-24T22:12:55.967 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:12:55.967 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:12:55.967 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:12:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.967+0000 7fb8899f7640 1 -- 172.21.15.47:0/4236339895 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb8700b3d40 msgr2=0x7fb8700b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.967+0000 7fb8899f7640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb8700b3d40 0x7fb8700b6200 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb8840ff9f0 tx=0x7fb86c005f90 comp rx=0 tx=0).stop 2024-07-24T22:12:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.967+0000 7fb8899f7640 1 -- 172.21.15.47:0/4236339895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb884103680 msgr2=0x7fb884198c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.967+0000 7fb8899f7640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb884103680 0x7fb884198c00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb87400d950 tx=0x7fb87400de10 comp rx=0 tx=0).stop 2024-07-24T22:12:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.967+0000 7fb8899f7640 1 -- 172.21.15.47:0/4236339895 shutdown_connections 2024-07-24T22:12:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.967+0000 7fb8899f7640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb8700b3d40 0x7fb8700b6200 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.967+0000 7fb8899f7640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88410cae0 0x7fb88419e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.967+0000 7fb8899f7640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb884103fa0 0x7fb884199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.967+0000 7fb8899f7640 1 --2- 172.21.15.47:0/4236339895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb884103680 0x7fb884198c00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.967+0000 7fb8899f7640 1 -- 172.21.15.47:0/4236339895 >> 172.21.15.47:0/4236339895 conn(0x7fb8840fd0e0 msgr2=0x7fb8840fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.967+0000 7fb8899f7640 1 -- 172.21.15.47:0/4236339895 shutdown_connections 2024-07-24T22:12:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:12:55.967+0000 7fb8899f7640 1 -- 172.21.15.47:0/4236339895 wait complete. 2024-07-24T22:12:56.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:55 smithi188 ceph-mon[37380]: pgmap v537: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 458 MiB/s wr, 638 op/s 2024-07-24T22:12:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.387+0000 7f8008ff9640 1 -- 172.21.15.47:0/1948107946 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e6bf2dcc80 con 0x55e6bf3576c0 2024-07-24T22:12:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.387+0000 7f8008ff9640 10 client.26027 handle_command_reply: tid=0 2024-07-24T22:12:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.387+0000 7f802a46f740 1 client.26027 shutdown 2024-07-24T22:12:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.388+0000 7f802a46f740 1 -- 172.21.15.47:0/1948107946 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2dd170 msgr2=0x55e6bf34f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.388+0000 7f802a46f740 1 --2- 172.21.15.47:0/1948107946 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2dd170 0x55e6bf34f790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8018000f80 tx=0x7f80180045e0 comp rx=0 tx=0).stop 2024-07-24T22:12:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.388+0000 7f802a46f740 1 -- 172.21.15.47:0/1948107946 shutdown_connections 2024-07-24T22:12:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.388+0000 7f802a46f740 1 --2- 172.21.15.47:0/1948107946 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e6bf3576c0 0x55e6bf359ae0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.388+0000 7f802a46f740 1 --2- 172.21.15.47:0/1948107946 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e6bf2dd170 0x55e6bf34f790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.388+0000 7f802a46f740 1 --2- 172.21.15.47:0/1948107946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e6bf2d11e0 0x55e6bf2e55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.388+0000 7f802a46f740 1 --2- 172.21.15.47:0/1948107946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6bf2d08c0 0x55e6bf2e5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.388+0000 7f802a46f740 1 -- 172.21.15.47:0/1948107946 >> 172.21.15.47:0/1948107946 conn(0x55e6bf2ce6f0 msgr2=0x55e6bf2d5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.388+0000 7f8008ff9640 0 client.26027 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:12:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.389+0000 7f802a46f740 1 -- 172.21.15.47:0/1948107946 shutdown_connections 2024-07-24T22:12:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.389+0000 7f802a46f740 1 -- 172.21.15.47:0/1948107946 wait complete. 2024-07-24T22:12:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.390+0000 7f802a46f740 20 client.26027 trim_cache size 0 max 16384 2024-07-24T22:12:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:12:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:12:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:12:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:12:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.395+0000 7f8027713640 1 -- 172.21.15.47:0/2711918328 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f800c0b3d40 msgr2=0x7f800c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.395+0000 7f8027713640 1 --2- 172.21.15.47:0/2711918328 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f800c0b3d40 0x7f800c0b6200 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f801c031440 tx=0x7f801c005890 comp rx=0 tx=0).stop 2024-07-24T22:12:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.395+0000 7f8027713640 1 -- 172.21.15.47:0/2711918328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8020101cb0 msgr2=0x7f802019f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:12:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.395+0000 7f8027713640 1 --2- 172.21.15.47:0/2711918328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8020101cb0 0x7f802019f780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f801000e9c0 tx=0x7f801000ee80 comp rx=0 tx=0).stop 2024-07-24T22:12:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.396+0000 7f8027713640 1 -- 172.21.15.47:0/2711918328 shutdown_connections 2024-07-24T22:12:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.396+0000 7f8027713640 1 --2- 172.21.15.47:0/2711918328 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f800c0b3d40 0x7f800c0b6200 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.396+0000 7f8027713640 1 --2- 172.21.15.47:0/2711918328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80201067c0 0x7f80201a4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.396+0000 7f8027713640 1 --2- 172.21.15.47:0/2711918328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8020101cb0 0x7f802019f780 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.396+0000 7f8027713640 1 --2- 172.21.15.47:0/2711918328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8020101390 0x7f802019f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:12:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.396+0000 7f8027713640 1 -- 172.21.15.47:0/2711918328 >> 172.21.15.47:0/2711918328 conn(0x7f80200fd010 msgr2=0x7f8020104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:12:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.398+0000 7f8027713640 1 -- 172.21.15.47:0/2711918328 shutdown_connections 2024-07-24T22:12:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:12:56.398+0000 7f8027713640 1 -- 172.21.15.47:0/2711918328 wait complete. 2024-07-24T22:12:56.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:56 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/4236339895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:12:57.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:56 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/4236339895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:12:57.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:56 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/4236339895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:12:57.166 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:12:57.579 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:12:58.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:57 smithi047 ceph-mon[32551]: pgmap v538: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 394 MiB/s wr, 508 op/s 2024-07-24T22:12:58.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:57 smithi183 ceph-mon[37007]: pgmap v538: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 394 MiB/s wr, 508 op/s 2024-07-24T22:12:58.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:57 smithi188 ceph-mon[37380]: pgmap v538: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 922 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 394 MiB/s wr, 508 op/s 2024-07-24T22:13:00.122 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:12:59 smithi047 ceph-mon[32551]: pgmap v539: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 921 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 426 MiB/s wr, 505 op/s 2024-07-24T22:13:00.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:12:59 smithi183 ceph-mon[37007]: pgmap v539: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 921 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 426 MiB/s wr, 505 op/s 2024-07-24T22:13:00.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:12:59 smithi188 ceph-mon[37380]: pgmap v539: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 921 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 426 MiB/s wr, 505 op/s 2024-07-24T22:13:00.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.559+0000 7f1e75e7a640 1 -- 172.21.15.47:0/3747089040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70107a00 msgr2=0x7f1e7010e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:00.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.559+0000 7f1e75e7a640 1 --2- 172.21.15.47:0/3747089040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70107a00 0x7f1e7010e200 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009ca0 tx=0x7f1e6802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.559+0000 7f1e75e7a640 1 -- 172.21.15.47:0/3747089040 shutdown_connections 2024-07-24T22:13:00.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.559+0000 7f1e75e7a640 1 --2- 172.21.15.47:0/3747089040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70107a00 0x7f1e7010e200 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.559+0000 7f1e75e7a640 1 --2- 172.21.15.47:0/3747089040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e70107080 0x7f1e701074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.559+0000 7f1e75e7a640 1 --2- 172.21.15.47:0/3747089040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e70101670 0x7f1e70101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.559+0000 7f1e75e7a640 1 -- 172.21.15.47:0/3747089040 >> 172.21.15.47:0/3747089040 conn(0x7f1e700fd0e0 msgr2=0x7f1e700ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:00.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.559+0000 7f1e75e7a640 1 -- 172.21.15.47:0/3747089040 shutdown_connections 2024-07-24T22:13:00.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.559+0000 7f1e75e7a640 1 -- 172.21.15.47:0/3747089040 wait complete. 2024-07-24T22:13:00.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.560+0000 7f1e75e7a640 1 Processor -- start 2024-07-24T22:13:00.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.560+0000 7f1e75e7a640 1 -- start start 2024-07-24T22:13:00.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e75e7a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70101670 0x7f1e70198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e75e7a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e70107080 0x7f1e70199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e75e7a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e70107a00 0x7f1e7019e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e75e7a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701127e0 con 0x7f1e70101670 2024-07-24T22:13:00.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e75e7a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1e70112660 con 0x7f1e70107a00 2024-07-24T22:13:00.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e75e7a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1e70112960 con 0x7f1e70107080 2024-07-24T22:13:00.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70101670 0x7f1e70198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e6effd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e70107080 0x7f1e70199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70101670 0x7f1e70198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47156/0 (socket says 172.21.15.47:47156) 2024-07-24T22:13:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e6effd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e70107080 0x7f1e70199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51988/0 (socket says 172.21.15.47:51988) 2024-07-24T22:13:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/2257046556 learned_addr learned my addr 172.21.15.47:0/2257046556 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/2257046556 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e70107080 msgr2=0x7f1e70199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e6f7fe640 1 --2- 172.21.15.47:0/2257046556 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e70107080 0x7f1e70199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/2257046556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e70107a00 msgr2=0x7f1e7019e4b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:13:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e6f7fe640 1 --2- 172.21.15.47:0/2257046556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e70107a00 0x7f1e7019e4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/2257046556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7019ec80 con 0x7f1e70101670 2024-07-24T22:13:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.561+0000 7f1e6f7fe640 1 --2- 172.21.15.47:0/2257046556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70101670 0x7f1e70198bd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000d950 tx=0x7f1e6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.562+0000 7f1e6cff9640 1 -- 172.21.15.47:0/2257046556 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60017070 con 0x7f1e70101670 2024-07-24T22:13:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.562+0000 7f1e75e7a640 1 -- 172.21.15.47:0/2257046556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e7019ef70 con 0x7f1e70101670 2024-07-24T22:13:00.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.562+0000 7f1e6cff9640 1 -- 172.21.15.47:0/2257046556 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e60009c30 con 0x7f1e70101670 2024-07-24T22:13:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.562+0000 7f1e6cff9640 1 -- 172.21.15.47:0/2257046556 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6000f620 con 0x7f1e70101670 2024-07-24T22:13:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.562+0000 7f1e75e7a640 1 -- 172.21.15.47:0/2257046556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e701a5630 con 0x7f1e70101670 2024-07-24T22:13:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.564+0000 7f1e6cff9640 1 -- 172.21.15.47:0/2257046556 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f1e60010460 con 0x7f1e70101670 2024-07-24T22:13:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.565+0000 7f1e7822b740 1 Processor -- start 2024-07-24T22:13:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.565+0000 7f1e7822b740 1 -- start start 2024-07-24T22:13:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.565+0000 7f1e7822b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b08c6d0 0x55809b08cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.565+0000 7f1e7822b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b09ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.565+0000 7f1e7822b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b09d390 0x55809b09f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.565+0000 7f1e7822b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55809b0039b0 con 0x55809b08cff0 2024-07-24T22:13:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.565+0000 7f1e7822b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55809aff2eb0 con 0x55809b09d390 2024-07-24T22:13:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.565+0000 7f1e7822b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55809aff6ef0 con 0x55809b08c6d0 2024-07-24T22:13:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.565+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b09ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.565+0000 7f1e6ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b08c6d0 0x55809b08cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.565+0000 7f1e6ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b08c6d0 0x55809b08cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:51990/0 (socket says 172.21.15.47:51990) 2024-07-24T22:13:00.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.565+0000 7f1e6ffff640 1 -- 172.21.15.47:0/138800084 learned_addr learned my addr 172.21.15.47:0/138800084 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:00.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.566+0000 7f1e6effd640 1 --2- 172.21.15.47:0/138800084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b09d390 0x55809b09f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.566+0000 7f1e6cff9640 1 --2- 172.21.15.47:0/2257046556 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1e580b3d40 0x7f1e580b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.566+0000 7f1e6ffff640 1 -- 172.21.15.47:0/138800084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b09d390 msgr2=0x55809b09f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:00.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.566+0000 7f1e6ffff640 1 --2- 172.21.15.47:0/138800084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b09d390 0x55809b09f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.566+0000 7f1e6ffff640 1 -- 172.21.15.47:0/138800084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 msgr2=0x55809b09ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:00.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.566+0000 7f1e6ffff640 1 --2- 172.21.15.47:0/138800084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b09ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.566+0000 7f1e6ffff640 1 -- 172.21.15.47:0/138800084 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55809af7c320 con 0x55809b08c6d0 2024-07-24T22:13:00.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.566+0000 7f1e6effd640 1 --2- 172.21.15.47:0/138800084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b09d390 0x55809b09f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:00.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.566+0000 7f1e6ffff640 1 --2- 172.21.15.47:0/2257046556 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1e580b3d40 0x7f1e580b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.566+0000 7f1e6cff9640 1 -- 172.21.15.47:0/2257046556 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f1e600e3ca0 con 0x7f1e70101670 2024-07-24T22:13:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.567+0000 7f1e6ffff640 1 --2- 172.21.15.47:0/138800084 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b08c6d0 0x55809b08cab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1e680097b0 tx=0x7f1e680098d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4d16d24ef66425c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.568+0000 7f1e55ffb640 1 -- 172.21.15.47:0/138800084 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6804d070 con 0x55809b08c6d0 2024-07-24T22:13:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.568+0000 7f1e55ffb640 1 -- 172.21.15.47:0/138800084 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e68036040 con 0x55809b08c6d0 2024-07-24T22:13:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.568+0000 7f1e55ffb640 1 -- 172.21.15.47:0/138800084 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6802f960 con 0x55809b08c6d0 2024-07-24T22:13:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.568+0000 7f1e6ffff640 1 --2- 172.21.15.47:0/2257046556 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1e580b3d40 0x7f1e580b6200 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1e6804a000 tx=0x7f1e68047000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.569+0000 7f1e7822b740 1 -- 172.21.15.47:0/138800084 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b08c6d0 msgr2=0x55809b08cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.569+0000 7f1e7822b740 1 --2- 172.21.15.47:0/138800084 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b08c6d0 0x55809b08cab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1e680097b0 tx=0x7f1e680098d0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.569+0000 7f1e7822b740 1 -- 172.21.15.47:0/138800084 shutdown_connections 2024-07-24T22:13:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.569+0000 7f1e7822b740 1 --2- 172.21.15.47:0/138800084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b09d390 0x55809b09f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.569+0000 7f1e7822b740 1 --2- 172.21.15.47:0/138800084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b09ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.569+0000 7f1e7822b740 1 --2- 172.21.15.47:0/138800084 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b08c6d0 0x55809b08cab0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.569+0000 7f1e7822b740 1 -- 172.21.15.47:0/138800084 >> 172.21.15.47:0/138800084 conn(0x55809b08a500 msgr2=0x55809b08b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.569+0000 7f1e7822b740 1 -- 172.21.15.47:0/138800084 shutdown_connections 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.569+0000 7f1e7822b740 1 -- 172.21.15.47:0/138800084 wait complete. 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.569+0000 7f1e7822b740 1 -- start start 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.570+0000 7f1e7822b740 1 Processor -- start 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.570+0000 7f1e7822b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b09a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.570+0000 7f1e7822b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b08cff0 0x55809b09a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.570+0000 7f1e7822b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b09d390 0x55809b09ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.570+0000 7f1e7822b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55809ae56700 con 0x55809b09d390 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.570+0000 7f1e7822b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55809af955f0 con 0x55809b08c6d0 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.570+0000 7f1e7822b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55809b09fec0 con 0x55809b08cff0 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.570+0000 7f1e7822b740 10 client.0 _ll_register_callbacks cb 0x55809afb5960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.570+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b09a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.570+0000 7f1e6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b09d390 0x55809b09ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.571+0000 7f1e6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b09d390 0x55809b09ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47178/0 (socket says 172.21.15.47:47178) 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.571+0000 7f1e6ffff640 1 -- 172.21.15.47:0/1889483104 learned_addr learned my addr 172.21.15.47:0/1889483104 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.570+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b09a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:37890/0 (socket says 172.21.15.47:37890) 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.571+0000 7f1e6effd640 1 --2- 172.21.15.47:0/1889483104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b08cff0 0x55809b09a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.571+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/1889483104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b08cff0 msgr2=0x55809b09a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.571+0000 7f1e6f7fe640 1 --2- 172.21.15.47:0/1889483104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b08cff0 0x55809b09a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.571+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/1889483104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b09d390 msgr2=0x55809b09ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.571+0000 7f1e6f7fe640 1 --2- 172.21.15.47:0/1889483104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b09d390 0x55809b09ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.571+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/1889483104 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55809af88680 con 0x55809b08c6d0 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.571+0000 7f1e6ffff640 1 --2- 172.21.15.47:0/1889483104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b09d390 0x55809b09ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.571+0000 7f1e6f7fe640 1 --2- 172.21.15.47:0/1889483104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b09a380 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e600e1390 tx=0x7f1e60005f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84454a88312d7688 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.571+0000 7f1e4effd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.571+0000 7f1e4effd640 1 -- 172.21.15.47:0/1889483104 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60020030 con 0x55809b08c6d0 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.572+0000 7f1e4effd640 1 -- 172.21.15.47:0/1889483104 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f1e600cd0f0 con 0x55809b08c6d0 2024-07-24T22:13:00.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.572+0000 7f1e7822b740 1 -- 172.21.15.47:0/1889483104 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e68036040 con 0x55809b08c6d0 2024-07-24T22:13:00.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.572+0000 7f1e4effd640 1 -- 172.21.15.47:0/1889483104 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1e600a9fc0 con 0x55809b08c6d0 2024-07-24T22:13:00.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.572+0000 7f1e7822b740 10 client.26039 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:00.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.572+0000 7f1e7822b740 1 -- 172.21.15.47:0/1889483104 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55809ad53650 con 0x55809b08c6d0 2024-07-24T22:13:00.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.572+0000 7f1e4effd640 1 -- 172.21.15.47:0/1889483104 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e68036040 con 0x55809b08c6d0 2024-07-24T22:13:00.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.573+0000 7f1e4effd640 1 -- 172.21.15.47:0/1889483104 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1e600e9060 con 0x55809b08c6d0 2024-07-24T22:13:00.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.573+0000 7f1e7822b740 10 client.26039 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:00.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.573+0000 7f1e7822b740 10 client.26039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:00.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.573+0000 7f1e7822b740 20 client.26039 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:00.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.573+0000 7f1e7822b740 1 --2- 172.21.15.47:0/1889483104 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55809b0ace40 0x55809b0af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.573+0000 7f1e7822b740 4 client.26039 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.573+0000 7f1e7822b740 1 -- 172.21.15.47:0/1889483104 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55809b005900 con 0x55809b0ace40 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.573+0000 7f1e6effd640 1 --2- 172.21.15.47:0/1889483104 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55809b0ace40 0x55809b0af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.574+0000 7f1e4effd640 10 client.26039 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.574+0000 7f1e6effd640 1 --2- 172.21.15.47:0/1889483104 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55809b0ace40 0x55809b0af270 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0158e57ee14ef3f server_cookie=2d4abc5755fbe98d in_seq=0 out_seq=0 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e4effd640 1 -- 172.21.15.47:0/1889483104 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55809b005900 con 0x55809b0ace40 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e4effd640 10 client.26039 handle_command_reply: tid=0 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e7822b740 1 client.26039 shutdown 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e7822b740 1 -- 172.21.15.47:0/1889483104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 msgr2=0x55809b09a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e7822b740 1 --2- 172.21.15.47:0/1889483104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b09a380 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e600e1390 tx=0x7f1e60005f70 comp rx=0 tx=0).stop 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e7822b740 1 -- 172.21.15.47:0/1889483104 shutdown_connections 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e7822b740 1 --2- 172.21.15.47:0/1889483104 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55809b0ace40 0x55809b0af270 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e7822b740 1 --2- 172.21.15.47:0/1889483104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b09d390 0x55809b09ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e7822b740 1 --2- 172.21.15.47:0/1889483104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b08cff0 0x55809b09a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e4effd640 0 client.26039 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:00.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e7822b740 1 --2- 172.21.15.47:0/1889483104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b09a380 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e7822b740 1 -- 172.21.15.47:0/1889483104 >> 172.21.15.47:0/1889483104 conn(0x55809b08a500 msgr2=0x55809b090030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:00.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e7822b740 1 -- 172.21.15.47:0/1889483104 shutdown_connections 2024-07-24T22:13:00.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e7822b740 1 -- 172.21.15.47:0/1889483104 wait complete. 2024-07-24T22:13:00.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.576+0000 7f1e7822b740 20 client.26039 trim_cache size 0 max 16384 2024-07-24T22:13:00.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e7822b740 1 Processor -- start 2024-07-24T22:13:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e7822b740 1 -- start start 2024-07-24T22:13:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e7822b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b097e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e7822b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b08f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e7822b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b09d390 0x55809b08fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e7822b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701a9f00 con 0x55809b08cff0 2024-07-24T22:13:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e7822b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701ac780 con 0x55809b08c6d0 2024-07-24T22:13:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e7822b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701aa570 con 0x55809b09d390 2024-07-24T22:13:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b097e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e6effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b08f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b097e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:37892/0 (socket says 172.21.15.47:37892) 2024-07-24T22:13:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e6effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b08f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47194/0 (socket says 172.21.15.47:47194) 2024-07-24T22:13:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/555010719 learned_addr learned my addr 172.21.15.47:0/555010719 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.591+0000 7f1e6ffff640 1 --2- 172.21.15.47:0/555010719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b09d390 0x55809b08fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.592+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/555010719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b09d390 msgr2=0x55809b08fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.592+0000 7f1e6f7fe640 1 --2- 172.21.15.47:0/555010719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b09d390 0x55809b08fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.592+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/555010719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 msgr2=0x55809b08f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.592+0000 7f1e6f7fe640 1 --2- 172.21.15.47:0/555010719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b08f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.592+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/555010719 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55809b09ca20 con 0x55809b08c6d0 2024-07-24T22:13:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.592+0000 7f1e6f7fe640 1 --2- 172.21.15.47:0/555010719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b097e20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1e600aa7e0 tx=0x7f1e60009f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35d8459d3c24728f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.592+0000 7f1e557fa640 1 -- 172.21.15.47:0/555010719 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e600c3030 con 0x55809b08c6d0 2024-07-24T22:13:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.592+0000 7f1e557fa640 1 -- 172.21.15.47:0/555010719 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e600707b0 con 0x55809b08c6d0 2024-07-24T22:13:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.592+0000 7f1e557fa640 1 -- 172.21.15.47:0/555010719 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60020070 con 0x55809b08c6d0 2024-07-24T22:13:00.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.593+0000 7f1e7822b740 1 -- 172.21.15.47:0/555010719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 msgr2=0x55809b097e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:00.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.593+0000 7f1e7822b740 1 --2- 172.21.15.47:0/555010719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b097e20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1e600aa7e0 tx=0x7f1e60009f50 comp rx=0 tx=0).stop 2024-07-24T22:13:00.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.593+0000 7f1e7822b740 1 -- 172.21.15.47:0/555010719 shutdown_connections 2024-07-24T22:13:00.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.593+0000 7f1e7822b740 1 --2- 172.21.15.47:0/555010719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b09d390 0x55809b08fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.593+0000 7f1e7822b740 1 --2- 172.21.15.47:0/555010719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b08f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.593+0000 7f1e7822b740 1 --2- 172.21.15.47:0/555010719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b097e20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.593+0000 7f1e7822b740 1 -- 172.21.15.47:0/555010719 >> 172.21.15.47:0/555010719 conn(0x55809b08a500 msgr2=0x55809b09c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:00.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.593+0000 7f1e7822b740 1 -- 172.21.15.47:0/555010719 shutdown_connections 2024-07-24T22:13:00.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.593+0000 7f1e7822b740 1 -- 172.21.15.47:0/555010719 wait complete. 2024-07-24T22:13:00.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.594+0000 7f1e7822b740 1 -- start start 2024-07-24T22:13:00.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.594+0000 7f1e7822b740 1 Processor -- start 2024-07-24T22:13:00.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.594+0000 7f1e7822b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b0a5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.594+0000 7f1e7822b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b0b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.594+0000 7f1e7822b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b09d390 0x55809b0b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.594+0000 7f1e7822b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701aac40 con 0x55809b08cff0 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.594+0000 7f1e7822b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701ac0b0 con 0x55809b08c6d0 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.594+0000 7f1e7822b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701ab310 con 0x55809b09d390 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.594+0000 7f1e7822b740 10 client.0 _ll_register_callbacks cb 0x7f1e6000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.594+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b0a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.594+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b0a5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:37894/0 (socket says 172.21.15.47:37894) 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.594+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/2901774722 learned_addr learned my addr 172.21.15.47:0/2901774722 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e6effd640 1 --2- 172.21.15.47:0/2901774722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b0b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/2901774722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b09d390 msgr2=0x55809b0b4c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e6f7fe640 1 --2- 172.21.15.47:0/2901774722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b09d390 0x55809b0b4c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/2901774722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 msgr2=0x55809b0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e6f7fe640 1 --2- 172.21.15.47:0/2901774722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b0b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e6f7fe640 1 -- 172.21.15.47:0/2901774722 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55809b116b10 con 0x55809b08c6d0 2024-07-24T22:13:00.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e6effd640 1 --2- 172.21.15.47:0/2901774722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b0b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:13:00.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e6f7fe640 1 --2- 172.21.15.47:0/2901774722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b0a5860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1e600a68d0 tx=0x7f1e600aefb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c817a4ddf039307 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:00.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e4effd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:13:00.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e4effd640 1 -- 172.21.15.47:0/2901774722 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60020070 con 0x55809b08c6d0 2024-07-24T22:13:00.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e4effd640 1 -- 172.21.15.47:0/2901774722 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f1e600e1ae0 con 0x55809b08c6d0 2024-07-24T22:13:00.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e7822b740 1 -- 172.21.15.47:0/2901774722 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55809b0013a0 con 0x55809b08c6d0 2024-07-24T22:13:00.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e4effd640 1 -- 172.21.15.47:0/2901774722 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1e600e1820 con 0x55809b08c6d0 2024-07-24T22:13:00.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e7822b740 10 client.26045 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:00.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.595+0000 7f1e7822b740 1 -- 172.21.15.47:0/2901774722 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55809b117c60 con 0x55809b08c6d0 2024-07-24T22:13:00.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.596+0000 7f1e4effd640 1 -- 172.21.15.47:0/2901774722 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55809b0013a0 con 0x55809b08c6d0 2024-07-24T22:13:00.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.596+0000 7f1e4effd640 1 -- 172.21.15.47:0/2901774722 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1e600e1ce0 con 0x55809b08c6d0 2024-07-24T22:13:00.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.596+0000 7f1e7822b740 10 client.26045 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:00.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.596+0000 7f1e7822b740 10 client.26045 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:00.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.596+0000 7f1e7822b740 20 client.26045 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:00.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.596+0000 7f1e7822b740 1 --2- 172.21.15.47:0/2901774722 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55809b118080 0x55809b11a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:00.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.596+0000 7f1e7822b740 4 client.26045 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:13:00.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.596+0000 7f1e7822b740 1 -- 172.21.15.47:0/2901774722 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55809affeae0 con 0x55809b118080 2024-07-24T22:13:00.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.596+0000 7f1e6effd640 1 --2- 172.21.15.47:0/2901774722 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55809b118080 0x55809b11a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:00.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e4effd640 10 client.26045 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:00.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e6effd640 1 --2- 172.21.15.47:0/2901774722 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55809b118080 0x55809b11a4a0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8b6ce4fd06e1252 server_cookie=5061a84735585292 in_seq=0 out_seq=0 2024-07-24T22:13:00.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e4effd640 1 -- 172.21.15.47:0/2901774722 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55809affeae0 con 0x55809b118080 2024-07-24T22:13:00.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e4effd640 10 client.26045 handle_command_reply: tid=0 2024-07-24T22:13:00.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e7822b740 1 client.26045 shutdown 2024-07-24T22:13:00.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e7822b740 1 -- 172.21.15.47:0/2901774722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 msgr2=0x55809b0a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:00.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e7822b740 1 --2- 172.21.15.47:0/2901774722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b0a5860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1e600a68d0 tx=0x7f1e600aefb0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e7822b740 1 -- 172.21.15.47:0/2901774722 shutdown_connections 2024-07-24T22:13:00.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e7822b740 1 --2- 172.21.15.47:0/2901774722 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55809b118080 0x55809b11a4a0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e7822b740 1 --2- 172.21.15.47:0/2901774722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55809b09d390 0x55809b0b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e7822b740 1 --2- 172.21.15.47:0/2901774722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55809b08cff0 0x55809b0b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e7822b740 1 --2- 172.21.15.47:0/2901774722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55809b08c6d0 0x55809b0a5860 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e7822b740 1 -- 172.21.15.47:0/2901774722 >> 172.21.15.47:0/2901774722 conn(0x55809b08a500 msgr2=0x55809b088dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:00.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e4effd640 0 client.26045 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:00.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e7822b740 1 -- 172.21.15.47:0/2901774722 shutdown_connections 2024-07-24T22:13:00.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e7822b740 1 -- 172.21.15.47:0/2901774722 wait complete. 2024-07-24T22:13:00.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.597+0000 7f1e7822b740 20 client.26045 trim_cache size 0 max 16384 2024-07-24T22:13:00.604 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:13:00.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.598+0000 7f1e75e7a640 1 -- 172.21.15.47:0/2257046556 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1e580b3d40 msgr2=0x7f1e580b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:00.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.598+0000 7f1e75e7a640 1 --2- 172.21.15.47:0/2257046556 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1e580b3d40 0x7f1e580b6200 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1e6804a000 tx=0x7f1e68047000 comp rx=0 tx=0).stop 2024-07-24T22:13:00.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.598+0000 7f1e75e7a640 1 -- 172.21.15.47:0/2257046556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70101670 msgr2=0x7f1e70198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:00.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.598+0000 7f1e75e7a640 1 --2- 172.21.15.47:0/2257046556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70101670 0x7f1e70198bd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000d950 tx=0x7f1e6000de10 comp rx=0 tx=0).stop 2024-07-24T22:13:00.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.598+0000 7f1e75e7a640 1 -- 172.21.15.47:0/2257046556 shutdown_connections 2024-07-24T22:13:00.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.598+0000 7f1e75e7a640 1 --2- 172.21.15.47:0/2257046556 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1e580b3d40 0x7f1e580b6200 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.598+0000 7f1e75e7a640 1 --2- 172.21.15.47:0/2257046556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e70107a00 0x7f1e7019e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.598+0000 7f1e75e7a640 1 --2- 172.21.15.47:0/2257046556 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e70107080 0x7f1e70199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.598+0000 7f1e75e7a640 1 --2- 172.21.15.47:0/2257046556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70101670 0x7f1e70198bd0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:00.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.598+0000 7f1e75e7a640 1 -- 172.21.15.47:0/2257046556 >> 172.21.15.47:0/2257046556 conn(0x7f1e700fd0e0 msgr2=0x7f1e70103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:00.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.599+0000 7f1e75e7a640 1 -- 172.21.15.47:0/2257046556 shutdown_connections 2024-07-24T22:13:00.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:00.599+0000 7f1e75e7a640 1 -- 172.21.15.47:0/2257046556 wait complete. 2024-07-24T22:13:02.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:01 smithi047 ceph-mon[32551]: pgmap v540: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 480 MiB/s wr, 516 op/s 2024-07-24T22:13:02.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:01 smithi188 ceph-mon[37380]: pgmap v540: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 480 MiB/s wr, 516 op/s 2024-07-24T22:13:02.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:01 smithi183 ceph-mon[37007]: pgmap v540: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 480 MiB/s wr, 516 op/s 2024-07-24T22:13:02.522 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:13:02.523 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:13:02.826 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:13:04.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:03 smithi047 ceph-mon[32551]: pgmap v541: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 470 MiB/s wr, 508 op/s 2024-07-24T22:13:04.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:03 smithi188 ceph-mon[37380]: pgmap v541: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 470 MiB/s wr, 508 op/s 2024-07-24T22:13:04.411 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:03 smithi183 ceph-mon[37007]: pgmap v541: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 470 MiB/s wr, 508 op/s 2024-07-24T22:13:04.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.883+0000 7fa772bde640 1 -- 172.21.15.47:0/449698630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c1070a0 msgr2=0x7fa76c1074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:04.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.883+0000 7fa772bde640 1 --2- 172.21.15.47:0/449698630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c1070a0 0x7fa76c1074e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa758009900 tx=0x7fa75802a410 comp rx=0 tx=0).stop 2024-07-24T22:13:04.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.883+0000 7fa772bde640 1 -- 172.21.15.47:0/449698630 shutdown_connections 2024-07-24T22:13:04.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.883+0000 7fa772bde640 1 --2- 172.21.15.47:0/449698630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa76c107a20 0x7fa76c10e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.883+0000 7fa772bde640 1 --2- 172.21.15.47:0/449698630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c1070a0 0x7fa76c1074e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.883+0000 7fa772bde640 1 --2- 172.21.15.47:0/449698630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa76c101690 0x7fa76c101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.883+0000 7fa772bde640 1 -- 172.21.15.47:0/449698630 >> 172.21.15.47:0/449698630 conn(0x7fa76c0fd100 msgr2=0x7fa76c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:04.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.883+0000 7fa772bde640 1 -- 172.21.15.47:0/449698630 shutdown_connections 2024-07-24T22:13:04.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.883+0000 7fa772bde640 1 -- 172.21.15.47:0/449698630 wait complete. 2024-07-24T22:13:04.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.884+0000 7fa772bde640 1 Processor -- start 2024-07-24T22:13:04.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.884+0000 7fa772bde640 1 -- start start 2024-07-24T22:13:04.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.884+0000 7fa772bde640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa76c101690 0x7fa76c0fd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.884+0000 7fa772bde640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa76c1070a0 0x7fa76c0fdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.884+0000 7fa772bde640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c107a20 0x7fa76c0fe080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.884+0000 7fa772bde640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c111630 con 0x7fa76c107a20 2024-07-24T22:13:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.884+0000 7fa772bde640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1114b0 con 0x7fa76c101690 2024-07-24T22:13:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.884+0000 7fa772bde640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1117b0 con 0x7fa76c1070a0 2024-07-24T22:13:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.884+0000 7fa77117b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c107a20 0x7fa76c0fe080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.884+0000 7fa77117b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c107a20 0x7fa76c0fe080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59424/0 (socket says 172.21.15.47:59424) 2024-07-24T22:13:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.884+0000 7fa77117b640 1 -- 172.21.15.47:0/3127186560 learned_addr learned my addr 172.21.15.47:0/3127186560 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.884+0000 7fa77097a640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa76c101690 0x7fa76c0fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.884+0000 7fa76bfff640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa76c1070a0 0x7fa76c0fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.885+0000 7fa77117b640 1 -- 172.21.15.47:0/3127186560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa76c1070a0 msgr2=0x7fa76c0fdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.885+0000 7fa77117b640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa76c1070a0 0x7fa76c0fdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.885+0000 7fa77117b640 1 -- 172.21.15.47:0/3127186560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa76c101690 msgr2=0x7fa76c0fd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:04.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.885+0000 7fa77117b640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa76c101690 0x7fa76c0fd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.885+0000 7fa77117b640 1 -- 172.21.15.47:0/3127186560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c1a7090 con 0x7fa76c107a20 2024-07-24T22:13:04.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.885+0000 7fa77117b640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c107a20 0x7fa76c0fe080 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa76400eaa0 tx=0x7fa76400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:04.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.885+0000 7fa769ffb640 1 -- 172.21.15.47:0/3127186560 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76400cdb0 con 0x7fa76c107a20 2024-07-24T22:13:04.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.885+0000 7fa769ffb640 1 -- 172.21.15.47:0/3127186560 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa764005020 con 0x7fa76c107a20 2024-07-24T22:13:04.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.885+0000 7fa772bde640 1 -- 172.21.15.47:0/3127186560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76c1a7380 con 0x7fa76c107a20 2024-07-24T22:13:04.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.885+0000 7fa769ffb640 1 -- 172.21.15.47:0/3127186560 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7640116d0 con 0x7fa76c107a20 2024-07-24T22:13:04.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.885+0000 7fa772bde640 1 -- 172.21.15.47:0/3127186560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76c1a78e0 con 0x7fa76c107a20 2024-07-24T22:13:04.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.888+0000 7fa769ffb640 1 -- 172.21.15.47:0/3127186560 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fa7640051d0 con 0x7fa76c107a20 2024-07-24T22:13:04.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.888+0000 7fa774f8f740 1 Processor -- start 2024-07-24T22:13:04.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.888+0000 7fa774f8f740 1 -- start start 2024-07-24T22:13:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.888+0000 7fa774f8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 0x5631f7705310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.888+0000 7fa774f8f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f77112a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.888+0000 7fa774f8f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 0x5631f7713bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.888+0000 7fa774f8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5631f767c9f0 con 0x5631f7704f30 2024-07-24T22:13:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.888+0000 7fa774f8f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5631f766bef0 con 0x5631f77117e0 2024-07-24T22:13:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.888+0000 7fa774f8f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5631f766ff30 con 0x5631f7705850 2024-07-24T22:13:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.888+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 0x5631f7705310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.888+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 0x5631f7705310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59440/0 (socket says 172.21.15.47:59440) 2024-07-24T22:13:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.888+0000 7fa76bfff640 1 -- 172.21.15.47:0/1186795683 learned_addr learned my addr 172.21.15.47:0/1186795683 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa77097a640 1 --2- 172.21.15.47:0/1186795683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f77112a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa769ffb640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa75c0b3dc0 0x7fa75c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa76bfff640 1 --2- 172.21.15.47:0/1186795683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 0x5631f7713bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa76bfff640 1 -- 172.21.15.47:0/1186795683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 msgr2=0x5631f77112a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:04.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa76bfff640 1 --2- 172.21.15.47:0/1186795683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f77112a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa77117b640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa75c0b3dc0 0x7fa75c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa76bfff640 1 -- 172.21.15.47:0/1186795683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 msgr2=0x5631f7713bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:04.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa76bfff640 1 --2- 172.21.15.47:0/1186795683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 0x5631f7713bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa76bfff640 1 -- 172.21.15.47:0/1186795683 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631f73cc930 con 0x5631f7704f30 2024-07-24T22:13:04.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa769ffb640 1 -- 172.21.15.47:0/3127186560 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa7640e4080 con 0x7fa76c107a20 2024-07-24T22:13:04.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa76bfff640 1 --2- 172.21.15.47:0/1186795683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 0x5631f7705310 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa758005c40 tx=0x7fa758005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd7b02b13819e94 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:04.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa77117b640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa75c0b3dc0 0x7fa75c0b6280 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa7640aacd0 tx=0x7fa7640af040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:04.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa756ffd640 1 -- 172.21.15.47:0/1186795683 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758035070 con 0x5631f7704f30 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa756ffd640 1 -- 172.21.15.47:0/1186795683 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa758045070 con 0x5631f7704f30 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.889+0000 7fa756ffd640 1 -- 172.21.15.47:0/1186795683 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580052a0 con 0x5631f7704f30 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.890+0000 7fa774f8f740 1 -- 172.21.15.47:0/1186795683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 msgr2=0x5631f7705310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.890+0000 7fa774f8f740 1 --2- 172.21.15.47:0/1186795683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 0x5631f7705310 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa758005c40 tx=0x7fa758005db0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.890+0000 7fa774f8f740 1 -- 172.21.15.47:0/1186795683 shutdown_connections 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.890+0000 7fa774f8f740 1 --2- 172.21.15.47:0/1186795683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 0x5631f7713bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.890+0000 7fa774f8f740 1 --2- 172.21.15.47:0/1186795683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f77112a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.890+0000 7fa774f8f740 1 --2- 172.21.15.47:0/1186795683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 0x5631f7705310 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.890+0000 7fa774f8f740 1 -- 172.21.15.47:0/1186795683 >> 172.21.15.47:0/1186795683 conn(0x5631f7702d60 msgr2=0x5631f7703f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.890+0000 7fa774f8f740 1 -- 172.21.15.47:0/1186795683 shutdown_connections 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.890+0000 7fa774f8f740 1 -- 172.21.15.47:0/1186795683 wait complete. 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.890+0000 7fa774f8f740 1 -- start start 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa774f8f740 1 Processor -- start 2024-07-24T22:13:04.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa774f8f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f7704f30 0x5631f770e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa774f8f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f770ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa774f8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f77117e0 0x5631f770f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa774f8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5631f74cf890 con 0x5631f77117e0 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa774f8f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5631f760e390 con 0x5631f7704f30 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa774f8f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5631f7714400 con 0x5631f7705850 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa774f8f740 10 client.0 _ll_register_callbacks cb 0x5631f7618500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f77117e0 0x5631f770f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa77097a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f770ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f77117e0 0x5631f770f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59450/0 (socket says 172.21.15.47:59450) 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa76bfff640 1 -- 172.21.15.47:0/260341537 learned_addr learned my addr 172.21.15.47:0/260341537 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa76bfff640 1 --2- 172.21.15.47:0/260341537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f7704f30 0x5631f770e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa77097a640 1 -- 172.21.15.47:0/260341537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f7704f30 msgr2=0x5631f770e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa77097a640 1 --2- 172.21.15.47:0/260341537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f7704f30 0x5631f770e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.891+0000 7fa77097a640 1 -- 172.21.15.47:0/260341537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f77117e0 msgr2=0x5631f770f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.892+0000 7fa77097a640 1 --2- 172.21.15.47:0/260341537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f77117e0 0x5631f770f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.892+0000 7fa77097a640 1 -- 172.21.15.47:0/260341537 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631f7608d60 con 0x5631f7705850 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.892+0000 7fa76bfff640 1 --2- 172.21.15.47:0/260341537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f77117e0 0x5631f770f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.892+0000 7fa77097a640 1 --2- 172.21.15.47:0/260341537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f770ecd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa7600126d0 tx=0x7fa760012b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=898e21f47e7846d1 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.892+0000 7fa74bfff640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.892+0000 7fa74bfff640 1 -- 172.21.15.47:0/260341537 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76000f8c0 con 0x5631f7705850 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.892+0000 7fa74bfff640 1 -- 172.21.15.47:0/260341537 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa76000fa60 con 0x5631f7705850 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.892+0000 7fa774f8f740 1 -- 172.21.15.47:0/260341537 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa758045070 con 0x5631f7705850 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.892+0000 7fa74bfff640 1 -- 172.21.15.47:0/260341537 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa76000fc60 con 0x5631f7705850 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.892+0000 7fa774f8f740 10 client.26098 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.892+0000 7fa774f8f740 1 -- 172.21.15.47:0/260341537 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5631f77203c0 con 0x5631f7705850 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.892+0000 7fa74bfff640 1 -- 172.21.15.47:0/260341537 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa758045070 con 0x5631f7705850 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.893+0000 7fa74bfff640 1 -- 172.21.15.47:0/260341537 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa76001c420 con 0x5631f7705850 2024-07-24T22:13:04.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.893+0000 7fa774f8f740 10 client.26098 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:04.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.893+0000 7fa774f8f740 10 client.26098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:04.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.893+0000 7fa774f8f740 20 client.26098 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:04.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.893+0000 7fa774f8f740 1 --2- 172.21.15.47:0/260341537 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5631f7721970 0x5631f7723d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.893+0000 7fa774f8f740 4 client.26098 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:13:04.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.893+0000 7fa774f8f740 1 -- 172.21.15.47:0/260341537 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631f767e940 con 0x5631f7721970 2024-07-24T22:13:04.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.893+0000 7fa76bfff640 1 --2- 172.21.15.47:0/260341537 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5631f7721970 0x5631f7723d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.893+0000 7fa76bfff640 1 --2- 172.21.15.47:0/260341537 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5631f7721970 0x5631f7723d90 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d03d7f74aa02db44 server_cookie=68c4483f39b6d2eb in_seq=0 out_seq=0 2024-07-24T22:13:04.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.893+0000 7fa74bfff640 10 client.26098 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:04.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa74bfff640 1 -- 172.21.15.47:0/260341537 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631f767e940 con 0x5631f7721970 2024-07-24T22:13:04.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa74bfff640 10 client.26098 handle_command_reply: tid=0 2024-07-24T22:13:04.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa774f8f740 1 client.26098 shutdown 2024-07-24T22:13:04.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa774f8f740 1 -- 172.21.15.47:0/260341537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 msgr2=0x5631f770ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:04.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa774f8f740 1 --2- 172.21.15.47:0/260341537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f770ecd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa7600126d0 tx=0x7fa760012b90 comp rx=0 tx=0).stop 2024-07-24T22:13:04.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa774f8f740 1 -- 172.21.15.47:0/260341537 shutdown_connections 2024-07-24T22:13:04.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa774f8f740 1 --2- 172.21.15.47:0/260341537 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5631f7721970 0x5631f7723d90 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa774f8f740 1 --2- 172.21.15.47:0/260341537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f77117e0 0x5631f770f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa74bfff640 0 client.26098 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:04.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa774f8f740 1 --2- 172.21.15.47:0/260341537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f770ecd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa774f8f740 1 --2- 172.21.15.47:0/260341537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f7704f30 0x5631f770e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa774f8f740 1 -- 172.21.15.47:0/260341537 >> 172.21.15.47:0/260341537 conn(0x5631f7702d60 msgr2=0x5631f7708900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:04.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa774f8f740 1 -- 172.21.15.47:0/260341537 shutdown_connections 2024-07-24T22:13:04.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa774f8f740 1 -- 172.21.15.47:0/260341537 wait complete. 2024-07-24T22:13:04.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.894+0000 7fa774f8f740 20 client.26098 trim_cache size 0 max 16384 2024-07-24T22:13:04.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.915+0000 7fa774f8f740 1 Processor -- start 2024-07-24T22:13:04.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.915+0000 7fa774f8f740 1 -- start start 2024-07-24T22:13:04.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.915+0000 7fa774f8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 0x5631f7710890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.915+0000 7fa774f8f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f7729660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.915+0000 7fa774f8f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 0x5631f7729ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.915+0000 7fa774f8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1ae300 con 0x5631f7704f30 2024-07-24T22:13:04.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.915+0000 7fa774f8f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1b0b80 con 0x5631f77117e0 2024-07-24T22:13:04.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.915+0000 7fa774f8f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1ae970 con 0x5631f7705850 2024-07-24T22:13:04.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 0x5631f7710890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 0x5631f7710890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59456/0 (socket says 172.21.15.47:59456) 2024-07-24T22:13:04.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa76bfff640 1 -- 172.21.15.47:0/3605236789 learned_addr learned my addr 172.21.15.47:0/3605236789 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:04.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa76bfff640 1 --2- 172.21.15.47:0/3605236789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 0x5631f7729ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa77097a640 1 --2- 172.21.15.47:0/3605236789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f7729660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa76bfff640 1 -- 172.21.15.47:0/3605236789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 msgr2=0x5631f7729660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa76bfff640 1 --2- 172.21.15.47:0/3605236789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f7729660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa76bfff640 1 -- 172.21.15.47:0/3605236789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 msgr2=0x5631f7729ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa76bfff640 1 --2- 172.21.15.47:0/3605236789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 0x5631f7729ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa76bfff640 1 -- 172.21.15.47:0/3605236789 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631f7713f40 con 0x5631f7704f30 2024-07-24T22:13:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa77097a640 1 --2- 172.21.15.47:0/3605236789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f7729660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa76bfff640 1 --2- 172.21.15.47:0/3605236789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 0x5631f7710890 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa758009900 tx=0x7fa758032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc619dd4e80973e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa7567fc640 1 -- 172.21.15.47:0/3605236789 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758035070 con 0x5631f7704f30 2024-07-24T22:13:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa7567fc640 1 -- 172.21.15.47:0/3605236789 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa758045070 con 0x5631f7704f30 2024-07-24T22:13:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.916+0000 7fa7567fc640 1 -- 172.21.15.47:0/3605236789 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758004bf0 con 0x5631f7704f30 2024-07-24T22:13:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.917+0000 7fa774f8f740 1 -- 172.21.15.47:0/3605236789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 msgr2=0x5631f7710890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.917+0000 7fa774f8f740 1 --2- 172.21.15.47:0/3605236789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 0x5631f7710890 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa758009900 tx=0x7fa758032d50 comp rx=0 tx=0).stop 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.917+0000 7fa774f8f740 1 -- 172.21.15.47:0/3605236789 shutdown_connections 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.917+0000 7fa774f8f740 1 --2- 172.21.15.47:0/3605236789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 0x5631f7729ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.917+0000 7fa774f8f740 1 --2- 172.21.15.47:0/3605236789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7705850 0x5631f7729660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.917+0000 7fa774f8f740 1 --2- 172.21.15.47:0/3605236789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7704f30 0x5631f7710890 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.917+0000 7fa774f8f740 1 -- 172.21.15.47:0/3605236789 >> 172.21.15.47:0/3605236789 conn(0x5631f7702d60 msgr2=0x5631f7708890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.917+0000 7fa774f8f740 1 -- 172.21.15.47:0/3605236789 shutdown_connections 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.917+0000 7fa774f8f740 1 -- 172.21.15.47:0/3605236789 wait complete. 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.917+0000 7fa774f8f740 1 -- start start 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.918+0000 7fa774f8f740 1 Processor -- start 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.918+0000 7fa774f8f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7704f30 0x5631f77154e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.918+0000 7fa774f8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7705850 0x5631f7715a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.918+0000 7fa774f8f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 0x5631f7715f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.918+0000 7fa774f8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1af040 con 0x5631f7705850 2024-07-24T22:13:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.918+0000 7fa774f8f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1b04b0 con 0x5631f77117e0 2024-07-24T22:13:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.918+0000 7fa774f8f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1af710 con 0x5631f7704f30 2024-07-24T22:13:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.918+0000 7fa774f8f740 10 client.0 _ll_register_callbacks cb 0x7fa760009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.918+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7704f30 0x5631f77154e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.918+0000 7fa77097a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7705850 0x5631f7715a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.918+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7704f30 0x5631f77154e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:43366/0 (socket says 172.21.15.47:43366) 2024-07-24T22:13:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.918+0000 7fa76bfff640 1 -- 172.21.15.47:0/970763271 learned_addr learned my addr 172.21.15.47:0/970763271 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.918+0000 7fa76bfff640 1 --2- 172.21.15.47:0/970763271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 0x5631f7715f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa77097a640 1 -- 172.21.15.47:0/970763271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7704f30 msgr2=0x5631f77154e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa77097a640 1 --2- 172.21.15.47:0/970763271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7704f30 0x5631f77154e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa77097a640 1 -- 172.21.15.47:0/970763271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 msgr2=0x5631f7715f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa77097a640 1 --2- 172.21.15.47:0/970763271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 0x5631f7715f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa77097a640 1 -- 172.21.15.47:0/970763271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631f778b660 con 0x5631f7705850 2024-07-24T22:13:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa77097a640 1 --2- 172.21.15.47:0/970763271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7705850 0x5631f7715a20 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa76001c890 tx=0x7fa760009d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e62ef0a690fc03 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa74bfff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa74bfff640 1 -- 172.21.15.47:0/970763271 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76001c630 con 0x5631f7705850 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa74bfff640 1 -- 172.21.15.47:0/970763271 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa76000f790 con 0x5631f7705850 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa774f8f740 1 -- 172.21.15.47:0/970763271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa758045070 con 0x5631f7705850 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa74bfff640 1 -- 172.21.15.47:0/970763271 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa76000f9b0 con 0x5631f7705850 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa774f8f740 10 client.16737 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa774f8f740 1 -- 172.21.15.47:0/970763271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5631f778c980 con 0x5631f7705850 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa74bfff640 1 -- 172.21.15.47:0/970763271 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa758045070 con 0x5631f7705850 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.919+0000 7fa74bfff640 1 -- 172.21.15.47:0/970763271 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa760003b40 con 0x5631f7705850 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.920+0000 7fa774f8f740 10 client.16737 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.920+0000 7fa774f8f740 10 client.16737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.920+0000 7fa774f8f740 20 client.16737 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.920+0000 7fa774f8f740 1 --2- 172.21.15.47:0/970763271 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5631f7721970 0x5631f778f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.920+0000 7fa774f8f740 4 client.16737 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.920+0000 7fa774f8f740 1 -- 172.21.15.47:0/970763271 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5631f767a3e0 con 0x5631f7721970 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.920+0000 7fa76bfff640 1 --2- 172.21.15.47:0/970763271 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5631f7721970 0x5631f778f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.920+0000 7fa76bfff640 1 --2- 172.21.15.47:0/970763271 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5631f7721970 0x5631f778f110 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=250f9015ad3b5007 server_cookie=b4e94dca2e41e2cc in_seq=0 out_seq=0 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.920+0000 7fa74bfff640 10 client.16737 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.921+0000 7fa74bfff640 1 -- 172.21.15.47:0/970763271 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5631f767a3e0 con 0x5631f7721970 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.921+0000 7fa74bfff640 10 client.16737 handle_command_reply: tid=0 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.921+0000 7fa774f8f740 1 client.16737 shutdown 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.921+0000 7fa774f8f740 1 -- 172.21.15.47:0/970763271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7705850 msgr2=0x5631f7715a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.921+0000 7fa774f8f740 1 --2- 172.21.15.47:0/970763271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7705850 0x5631f7715a20 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa76001c890 tx=0x7fa760009d80 comp rx=0 tx=0).stop 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa774f8f740 1 -- 172.21.15.47:0/970763271 shutdown_connections 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa774f8f740 1 --2- 172.21.15.47:0/970763271 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5631f7721970 0x5631f778f110 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa74bfff640 0 client.16737 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa774f8f740 1 --2- 172.21.15.47:0/970763271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631f77117e0 0x5631f7715f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa774f8f740 1 --2- 172.21.15.47:0/970763271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631f7705850 0x5631f7715a20 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa774f8f740 1 --2- 172.21.15.47:0/970763271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631f7704f30 0x5631f77154e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa774f8f740 1 -- 172.21.15.47:0/970763271 >> 172.21.15.47:0/970763271 conn(0x5631f7702d60 msgr2=0x5631f771c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:04.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa774f8f740 1 -- 172.21.15.47:0/970763271 shutdown_connections 2024-07-24T22:13:04.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa774f8f740 1 -- 172.21.15.47:0/970763271 wait complete. 2024-07-24T22:13:04.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa774f8f740 20 client.16737 trim_cache size 0 max 16384 2024-07-24T22:13:04.942 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:13:04.942 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:13:04.942 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "fe970fc7-b6d0-4f86-92da-7a6fe0e1cc11", 2024-07-24T22:13:04.946 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:13:04.946 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:13:04.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa772bde640 1 -- 172.21.15.47:0/3127186560 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa75c0b3dc0 msgr2=0x7fa75c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:04.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa772bde640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa75c0b3dc0 0x7fa75c0b6280 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa7640aacd0 tx=0x7fa7640af040 comp rx=0 tx=0).stop 2024-07-24T22:13:04.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa772bde640 1 -- 172.21.15.47:0/3127186560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c107a20 msgr2=0x7fa76c0fe080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:04.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.922+0000 7fa772bde640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c107a20 0x7fa76c0fe080 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa76400eaa0 tx=0x7fa76400ef60 comp rx=0 tx=0).stop 2024-07-24T22:13:04.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.923+0000 7fa772bde640 1 -- 172.21.15.47:0/3127186560 shutdown_connections 2024-07-24T22:13:04.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.923+0000 7fa772bde640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa75c0b3dc0 0x7fa75c0b6280 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.923+0000 7fa772bde640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c107a20 0x7fa76c0fe080 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.923+0000 7fa772bde640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa76c1070a0 0x7fa76c0fdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.923+0000 7fa772bde640 1 --2- 172.21.15.47:0/3127186560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa76c101690 0x7fa76c0fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:04.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.923+0000 7fa772bde640 1 -- 172.21.15.47:0/3127186560 >> 172.21.15.47:0/3127186560 conn(0x7fa76c0fd100 msgr2=0x7fa76c06b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:04.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.923+0000 7fa772bde640 1 -- 172.21.15.47:0/3127186560 shutdown_connections 2024-07-24T22:13:04.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:04.923+0000 7fa772bde640 1 -- 172.21.15.47:0/3127186560 wait complete. 2024-07-24T22:13:05.101 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:04 smithi047 ceph-mon[32551]: pgmap v542: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 529 MiB/s wr, 544 op/s 2024-07-24T22:13:05.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:04 smithi188 ceph-mon[37380]: pgmap v542: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 529 MiB/s wr, 544 op/s 2024-07-24T22:13:05.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:04 smithi183 ceph-mon[37007]: pgmap v542: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 529 MiB/s wr, 544 op/s 2024-07-24T22:13:05.866 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:13:06.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:05 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:13:06.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:05 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:13:06.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:05 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:13:06.257 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:13:06.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:05 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:13:06.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:05 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:13:06.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:05 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:13:06.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:05 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:13:06.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:05 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:13:06.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:05 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:13:07.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:06 smithi188 ceph-mon[37380]: pgmap v543: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 449 MiB/s wr, 464 op/s 2024-07-24T22:13:07.414 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:06 smithi183 ceph-mon[37007]: pgmap v543: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 449 MiB/s wr, 464 op/s 2024-07-24T22:13:07.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:06 smithi047 ceph-mon[32551]: pgmap v543: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 449 MiB/s wr, 464 op/s 2024-07-24T22:13:08.069 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:07 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:13:08.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.190+0000 7f8e25111640 1 -- 172.21.15.47:0/2790634926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e20103660 msgr2=0x7f8e20103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:08.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.190+0000 7f8e25111640 1 --2- 172.21.15.47:0/2790634926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e20103660 0x7f8e20103a40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009900 tx=0x7f8e1002a410 comp rx=0 tx=0).stop 2024-07-24T22:13:08.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.190+0000 7f8e25111640 1 -- 172.21.15.47:0/2790634926 shutdown_connections 2024-07-24T22:13:08.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.190+0000 7f8e25111640 1 --2- 172.21.15.47:0/2790634926 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e2010cac0 0x7f8e2010ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.190+0000 7f8e25111640 1 --2- 172.21.15.47:0/2790634926 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e20103f80 0x7f8e2010c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.190+0000 7f8e25111640 1 --2- 172.21.15.47:0/2790634926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e20103660 0x7f8e20103a40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.190+0000 7f8e25111640 1 -- 172.21.15.47:0/2790634926 >> 172.21.15.47:0/2790634926 conn(0x7f8e200fd0c0 msgr2=0x7f8e200ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:08.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.190+0000 7f8e25111640 1 -- 172.21.15.47:0/2790634926 shutdown_connections 2024-07-24T22:13:08.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.190+0000 7f8e25111640 1 -- 172.21.15.47:0/2790634926 wait complete. 2024-07-24T22:13:08.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.191+0000 7f8e25111640 1 Processor -- start 2024-07-24T22:13:08.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.191+0000 7f8e25111640 1 -- start start 2024-07-24T22:13:08.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.192+0000 7f8e25111640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e20103660 0x7f8e2010c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.192+0000 7f8e25111640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e20103f80 0x7f8e201095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.192+0000 7f8e25111640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e2010cac0 0x7f8e20109d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.192+0000 7f8e25111640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20102d20 con 0x7f8e2010cac0 2024-07-24T22:13:08.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.192+0000 7f8e25111640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20102ba0 con 0x7f8e20103f80 2024-07-24T22:13:08.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.192+0000 7f8e25111640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20102ea0 con 0x7f8e20103660 2024-07-24T22:13:08.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.192+0000 7f8e1f59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e2010cac0 0x7f8e20109d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.192+0000 7f8e1f59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e2010cac0 0x7f8e20109d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59476/0 (socket says 172.21.15.47:59476) 2024-07-24T22:13:08.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.192+0000 7f8e1f59e640 1 -- 172.21.15.47:0/183392553 learned_addr learned my addr 172.21.15.47:0/183392553 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:08.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.192+0000 7f8e1e59c640 1 --2- 172.21.15.47:0/183392553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e20103f80 0x7f8e201095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.192+0000 7f8e1f59e640 1 -- 172.21.15.47:0/183392553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e20103660 msgr2=0x7f8e2010c390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:13:08.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.192+0000 7f8e1f59e640 1 --2- 172.21.15.47:0/183392553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e20103660 0x7f8e2010c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.193+0000 7f8e1f59e640 1 -- 172.21.15.47:0/183392553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e20103f80 msgr2=0x7f8e201095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:08.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.193+0000 7f8e1f59e640 1 --2- 172.21.15.47:0/183392553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e20103f80 0x7f8e201095e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.193+0000 7f8e1f59e640 1 -- 172.21.15.47:0/183392553 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e201ab670 con 0x7f8e2010cac0 2024-07-24T22:13:08.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.193+0000 7f8e1f59e640 1 --2- 172.21.15.47:0/183392553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e2010cac0 0x7f8e20109d10 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800b9a0 tx=0x7f8e1800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:08.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.193+0000 7f8e07fff640 1 -- 172.21.15.47:0/183392553 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18019070 con 0x7f8e2010cac0 2024-07-24T22:13:08.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.193+0000 7f8e25111640 1 -- 172.21.15.47:0/183392553 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e201ab960 con 0x7f8e2010cac0 2024-07-24T22:13:08.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.193+0000 7f8e07fff640 1 -- 172.21.15.47:0/183392553 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e1800cba0 con 0x7f8e2010cac0 2024-07-24T22:13:08.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.193+0000 7f8e07fff640 1 -- 172.21.15.47:0/183392553 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1801d610 con 0x7f8e2010cac0 2024-07-24T22:13:08.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.193+0000 7f8e25111640 1 -- 172.21.15.47:0/183392553 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e201abef0 con 0x7f8e2010cac0 2024-07-24T22:13:08.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.197+0000 7f8e274c2740 1 Processor -- start 2024-07-24T22:13:08.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.198+0000 7f8e07fff640 1 -- 172.21.15.47:0/183392553 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8e1801c070 con 0x7f8e2010cac0 2024-07-24T22:13:08.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.199+0000 7f8e274c2740 1 -- start start 2024-07-24T22:13:08.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.199+0000 7f8e274c2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e439680 0x56137e439a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.199+0000 7f8e274c2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439fa0 0x56137e4459f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.199+0000 7f8e274c2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e445f30 0x56137e448320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.199+0000 7f8e274c2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56137e3b0960 con 0x56137e439fa0 2024-07-24T22:13:08.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.199+0000 7f8e274c2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56137e39fe60 con 0x56137e439680 2024-07-24T22:13:08.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.199+0000 7f8e274c2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56137e3a3ea0 con 0x56137e445f30 2024-07-24T22:13:08.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.199+0000 7f8e1ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439fa0 0x56137e4459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.199+0000 7f8e1ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439fa0 0x56137e4459f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59482/0 (socket says 172.21.15.47:59482) 2024-07-24T22:13:08.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.199+0000 7f8e1ed9d640 1 -- 172.21.15.47:0/2498013517 learned_addr learned my addr 172.21.15.47:0/2498013517 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:08.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.200+0000 7f8e1ed9d640 1 -- 172.21.15.47:0/2498013517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e445f30 msgr2=0x56137e448320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:08.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.200+0000 7f8e1ed9d640 1 --2- 172.21.15.47:0/2498013517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e445f30 0x56137e448320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.200+0000 7f8e1ed9d640 1 -- 172.21.15.47:0/2498013517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e439680 msgr2=0x56137e439a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:13:08.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.200+0000 7f8e1ed9d640 1 --2- 172.21.15.47:0/2498013517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e439680 0x56137e439a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.200+0000 7f8e1ed9d640 1 -- 172.21.15.47:0/2498013517 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56137e3292d0 con 0x56137e439fa0 2024-07-24T22:13:08.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.201+0000 7f8e07fff640 1 --2- 172.21.15.47:0/183392553 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8e080b3d40 0x7f8e080b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.201+0000 7f8e1ed9d640 1 --2- 172.21.15.47:0/2498013517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439fa0 0x56137e4459f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8e1002a930 tx=0x7f8e10032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2065e32700b142ce server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:08.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.201+0000 7f8e07fff640 1 -- 172.21.15.47:0/183392553 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8e180e3360 con 0x7f8e2010cac0 2024-07-24T22:13:08.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.201+0000 7f8e1e59c640 1 --2- 172.21.15.47:0/183392553 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8e080b3d40 0x7f8e080b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.201+0000 7f8e057fa640 1 -- 172.21.15.47:0/2498013517 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10040070 con 0x56137e439fa0 2024-07-24T22:13:08.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.202+0000 7f8e057fa640 1 -- 172.21.15.47:0/2498013517 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e10032e40 con 0x56137e439fa0 2024-07-24T22:13:08.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.202+0000 7f8e057fa640 1 -- 172.21.15.47:0/2498013517 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10035040 con 0x56137e439fa0 2024-07-24T22:13:08.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.203+0000 7f8e1e59c640 1 --2- 172.21.15.47:0/183392553 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8e080b3d40 0x7f8e080b6200 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8e14006fd0 tx=0x7f8e14008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.203+0000 7f8e274c2740 1 -- 172.21.15.47:0/2498013517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439fa0 msgr2=0x56137e4459f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.203+0000 7f8e274c2740 1 --2- 172.21.15.47:0/2498013517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439fa0 0x56137e4459f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8e1002a930 tx=0x7f8e10032c50 comp rx=0 tx=0).stop 2024-07-24T22:13:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.203+0000 7f8e274c2740 1 -- 172.21.15.47:0/2498013517 shutdown_connections 2024-07-24T22:13:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.203+0000 7f8e274c2740 1 --2- 172.21.15.47:0/2498013517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e445f30 0x56137e448320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.203+0000 7f8e274c2740 1 --2- 172.21.15.47:0/2498013517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439fa0 0x56137e4459f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.203+0000 7f8e274c2740 1 --2- 172.21.15.47:0/2498013517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e439680 0x56137e439a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.203+0000 7f8e274c2740 1 -- 172.21.15.47:0/2498013517 >> 172.21.15.47:0/2498013517 conn(0x56137e4374b0 msgr2=0x56137e438650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.203+0000 7f8e274c2740 1 -- 172.21.15.47:0/2498013517 shutdown_connections 2024-07-24T22:13:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.203+0000 7f8e274c2740 1 -- 172.21.15.47:0/2498013517 wait complete. 2024-07-24T22:13:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.204+0000 7f8e274c2740 1 -- start start 2024-07-24T22:13:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.204+0000 7f8e274c2740 1 Processor -- start 2024-07-24T22:13:08.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.204+0000 7f8e274c2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 0x56137e4459c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.204+0000 7f8e274c2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439fa0 0x56137e442e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.204+0000 7f8e274c2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e445f30 0x56137e4435c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.205+0000 7f8e1ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 0x56137e4459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.205+0000 7f8e274c2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56137e203700 con 0x56137e439680 2024-07-24T22:13:08.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.205+0000 7f8e1ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 0x56137e4459c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59488/0 (socket says 172.21.15.47:59488) 2024-07-24T22:13:08.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.205+0000 7f8e274c2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56137e3425a0 con 0x56137e445f30 2024-07-24T22:13:08.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.205+0000 7f8e1ed9d640 1 -- 172.21.15.47:0/1775327272 learned_addr learned my addr 172.21.15.47:0/1775327272 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:08.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.205+0000 7f8e274c2740 1 -- 172.21.15.47:0/1775327272 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56137e448ba0 con 0x56137e439fa0 2024-07-24T22:13:08.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.205+0000 7f8e274c2740 10 client.0 _ll_register_callbacks cb 0x56137e362910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:08.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.205+0000 7f8e1e59c640 1 --2- 172.21.15.47:0/1775327272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439fa0 0x56137e442e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.205+0000 7f8e1ed9d640 1 -- 172.21.15.47:0/1775327272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439fa0 msgr2=0x56137e442e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:08.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.205+0000 7f8e1ed9d640 1 --2- 172.21.15.47:0/1775327272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439fa0 0x56137e442e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.205+0000 7f8e1ed9d640 1 -- 172.21.15.47:0/1775327272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e445f30 msgr2=0x56137e4435c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:08.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.205+0000 7f8e1ed9d640 1 --2- 172.21.15.47:0/1775327272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e445f30 0x56137e4435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.205+0000 7f8e1ed9d640 1 -- 172.21.15.47:0/1775327272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56137e335630 con 0x56137e439680 2024-07-24T22:13:08.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.206+0000 7f8e1ed9d640 1 --2- 172.21.15.47:0/1775327272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 0x56137e4459c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8e100092a0 tx=0x7f8e100316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521a2fd6a20df251 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:08.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.206+0000 7f8e02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:08.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.206+0000 7f8e02ff5640 1 -- 172.21.15.47:0/1775327272 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10035040 con 0x56137e439680 2024-07-24T22:13:08.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.206+0000 7f8e02ff5640 1 -- 172.21.15.47:0/1775327272 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8e10004240 con 0x56137e439680 2024-07-24T22:13:08.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.206+0000 7f8e274c2740 1 -- 172.21.15.47:0/1775327272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56137e3b28b0 con 0x56137e439680 2024-07-24T22:13:08.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.206+0000 7f8e02ff5640 1 -- 172.21.15.47:0/1775327272 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8e10040040 con 0x56137e439680 2024-07-24T22:13:08.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.206+0000 7f8e274c2740 10 client.16749 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:08.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.206+0000 7f8e274c2740 1 -- 172.21.15.47:0/1775327272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56137e100650 con 0x56137e439680 2024-07-24T22:13:08.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.207+0000 7f8e02ff5640 1 -- 172.21.15.47:0/1775327272 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e10003e50 con 0x56137e439680 2024-07-24T22:13:08.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.208+0000 7f8e02ff5640 1 -- 172.21.15.47:0/1775327272 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8e10057a40 con 0x56137e439680 2024-07-24T22:13:08.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.208+0000 7f8e274c2740 10 client.16749 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:08.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.208+0000 7f8e274c2740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:08.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.208+0000 7f8e274c2740 20 client.16749 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:08.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.208+0000 7f8e274c2740 1 --2- 172.21.15.47:0/1775327272 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56137e455a80 0x56137e457f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.208+0000 7f8e274c2740 4 client.16749 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:13:08.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.208+0000 7f8e274c2740 1 -- 172.21.15.47:0/1775327272 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56137e3b28b0 con 0x56137e455a80 2024-07-24T22:13:08.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.208+0000 7f8e1e59c640 1 --2- 172.21.15.47:0/1775327272 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56137e455a80 0x56137e457f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.211+0000 7f8e02ff5640 10 client.16749 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:08.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.211+0000 7f8e1e59c640 1 --2- 172.21.15.47:0/1775327272 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56137e455a80 0x56137e457f40 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6edeeebca09d31f5 server_cookie=728d7bdf834aeada in_seq=0 out_seq=0 2024-07-24T22:13:08.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.212+0000 7f8e02ff5640 1 -- 172.21.15.47:0/1775327272 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56137e3b28b0 con 0x56137e455a80 2024-07-24T22:13:08.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.212+0000 7f8e02ff5640 10 client.16749 handle_command_reply: tid=0 2024-07-24T22:13:08.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.212+0000 7f8e274c2740 1 client.16749 shutdown 2024-07-24T22:13:08.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.213+0000 7f8e274c2740 1 -- 172.21.15.47:0/1775327272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 msgr2=0x56137e4459c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:08.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.213+0000 7f8e274c2740 1 --2- 172.21.15.47:0/1775327272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 0x56137e4459c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8e100092a0 tx=0x7f8e100316d0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.213+0000 7f8e274c2740 1 -- 172.21.15.47:0/1775327272 shutdown_connections 2024-07-24T22:13:08.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.213+0000 7f8e274c2740 1 --2- 172.21.15.47:0/1775327272 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56137e455a80 0x56137e457f40 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.213+0000 7f8e274c2740 1 --2- 172.21.15.47:0/1775327272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e445f30 0x56137e4435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.213+0000 7f8e274c2740 1 --2- 172.21.15.47:0/1775327272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439fa0 0x56137e442e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.213+0000 7f8e274c2740 1 --2- 172.21.15.47:0/1775327272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 0x56137e4459c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.213+0000 7f8e274c2740 1 -- 172.21.15.47:0/1775327272 >> 172.21.15.47:0/1775327272 conn(0x56137e4374b0 msgr2=0x56137e43d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:08.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.213+0000 7f8e02ff5640 0 client.16749 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:08.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.213+0000 7f8e274c2740 1 -- 172.21.15.47:0/1775327272 shutdown_connections 2024-07-24T22:13:08.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.213+0000 7f8e274c2740 1 -- 172.21.15.47:0/1775327272 wait complete. 2024-07-24T22:13:08.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.213+0000 7f8e274c2740 20 client.16749 trim_cache size 0 max 16384 2024-07-24T22:13:08.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.238+0000 7f8e274c2740 1 Processor -- start 2024-07-24T22:13:08.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.238+0000 7f8e274c2740 1 -- start start 2024-07-24T22:13:08.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.238+0000 7f8e274c2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439680 0x56137e43d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.238+0000 7f8e274c2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e439fa0 0x56137e441690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.238+0000 7f8e274c2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e445f30 0x56137e441bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.238+0000 7f8e274c2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c00c800 con 0x56137e445f30 2024-07-24T22:13:08.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.238+0000 7f8e274c2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c00f080 con 0x56137e439fa0 2024-07-24T22:13:08.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.238+0000 7f8e274c2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c00ce70 con 0x56137e439680 2024-07-24T22:13:08.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.238+0000 7f8e1f59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e445f30 0x56137e441bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.238+0000 7f8e1f59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e445f30 0x56137e441bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59494/0 (socket says 172.21.15.47:59494) 2024-07-24T22:13:08.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.239+0000 7f8e1f59e640 1 -- 172.21.15.47:0/3876500410 learned_addr learned my addr 172.21.15.47:0/3876500410 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:08.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.239+0000 7f8e1e59c640 1 --2- 172.21.15.47:0/3876500410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e439fa0 0x56137e441690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.239+0000 7f8e1ed9d640 1 --2- 172.21.15.47:0/3876500410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439680 0x56137e43d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.239+0000 7f8e1f59e640 1 -- 172.21.15.47:0/3876500410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439680 msgr2=0x56137e43d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:08.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.239+0000 7f8e1f59e640 1 --2- 172.21.15.47:0/3876500410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439680 0x56137e43d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.239+0000 7f8e1f59e640 1 -- 172.21.15.47:0/3876500410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e439fa0 msgr2=0x56137e441690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:08.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.239+0000 7f8e1f59e640 1 --2- 172.21.15.47:0/3876500410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e439fa0 0x56137e441690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.239+0000 7f8e1f59e640 1 -- 172.21.15.47:0/3876500410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56137e4431a0 con 0x56137e445f30 2024-07-24T22:13:08.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.239+0000 7f8e1f59e640 1 --2- 172.21.15.47:0/3876500410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e445f30 0x56137e441bd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8e180a72f0 tx=0x7f8e180a5f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2d90f13458907a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:08.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.239+0000 7f8e04ff9640 1 -- 172.21.15.47:0/3876500410 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e180aa080 con 0x56137e445f30 2024-07-24T22:13:08.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.239+0000 7f8e04ff9640 1 -- 172.21.15.47:0/3876500410 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e180ae680 con 0x56137e445f30 2024-07-24T22:13:08.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.239+0000 7f8e04ff9640 1 -- 172.21.15.47:0/3876500410 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e180b2f00 con 0x56137e445f30 2024-07-24T22:13:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.240+0000 7f8e274c2740 1 -- 172.21.15.47:0/3876500410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e445f30 msgr2=0x56137e441bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.240+0000 7f8e274c2740 1 --2- 172.21.15.47:0/3876500410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e445f30 0x56137e441bd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8e180a72f0 tx=0x7f8e180a5f40 comp rx=0 tx=0).stop 2024-07-24T22:13:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.240+0000 7f8e274c2740 1 -- 172.21.15.47:0/3876500410 shutdown_connections 2024-07-24T22:13:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.240+0000 7f8e274c2740 1 --2- 172.21.15.47:0/3876500410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e445f30 0x56137e441bd0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.240+0000 7f8e274c2740 1 --2- 172.21.15.47:0/3876500410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e439fa0 0x56137e441690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.240+0000 7f8e274c2740 1 --2- 172.21.15.47:0/3876500410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439680 0x56137e43d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.240+0000 7f8e274c2740 1 -- 172.21.15.47:0/3876500410 >> 172.21.15.47:0/3876500410 conn(0x56137e4374b0 msgr2=0x56137e43e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.240+0000 7f8e274c2740 1 -- 172.21.15.47:0/3876500410 shutdown_connections 2024-07-24T22:13:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.240+0000 7f8e274c2740 1 -- 172.21.15.47:0/3876500410 wait complete. 2024-07-24T22:13:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.240+0000 7f8e274c2740 1 -- start start 2024-07-24T22:13:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e274c2740 1 Processor -- start 2024-07-24T22:13:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e274c2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 0x56137e449450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e274c2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439fa0 0x56137e449990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e274c2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e445f30 0x56137e4be810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e274c2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c00d540 con 0x56137e439680 2024-07-24T22:13:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e274c2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c00e9b0 con 0x56137e445f30 2024-07-24T22:13:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e274c2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c00dc10 con 0x56137e439fa0 2024-07-24T22:13:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e274c2740 10 client.0 _ll_register_callbacks cb 0x7f8e10032b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e1ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 0x56137e449450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e1ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 0x56137e449450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59510/0 (socket says 172.21.15.47:59510) 2024-07-24T22:13:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e1ed9d640 1 -- 172.21.15.47:0/3765819757 learned_addr learned my addr 172.21.15.47:0/3765819757 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e1f59e640 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e445f30 0x56137e4be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e1e59c640 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439fa0 0x56137e449990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e1ed9d640 1 -- 172.21.15.47:0/3765819757 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439fa0 msgr2=0x56137e449990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e1ed9d640 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439fa0 0x56137e449990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e1ed9d640 1 -- 172.21.15.47:0/3765819757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e445f30 msgr2=0x56137e4be810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e1ed9d640 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e445f30 0x56137e4be810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e1ed9d640 1 -- 172.21.15.47:0/3765819757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56137e443930 con 0x56137e439680 2024-07-24T22:13:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.241+0000 7f8e1f59e640 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e445f30 0x56137e4be810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e1ed9d640 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 0x56137e449450 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8e10057e40 tx=0x7f8e10031d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611116b44d9057d7 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e02ff5640 1 -- 172.21.15.47:0/3765819757 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10035040 con 0x56137e439680 2024-07-24T22:13:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e02ff5640 1 -- 172.21.15.47:0/3765819757 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7f8e10045b00 con 0x56137e439680 2024-07-24T22:13:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e274c2740 1 -- 172.21.15.47:0/3765819757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e180ae680 con 0x56137e439680 2024-07-24T22:13:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e02ff5640 1 -- 172.21.15.47:0/3765819757 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8e10065050 con 0x56137e439680 2024-07-24T22:13:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e274c2740 10 client.16755 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e274c2740 1 -- 172.21.15.47:0/3765819757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56137e4bff10 con 0x56137e439680 2024-07-24T22:13:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e02ff5640 1 -- 172.21.15.47:0/3765819757 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e180ae680 con 0x56137e439680 2024-07-24T22:13:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e02ff5640 1 -- 172.21.15.47:0/3765819757 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8e100046c0 con 0x56137e439680 2024-07-24T22:13:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e274c2740 10 client.16755 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e274c2740 10 client.16755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e274c2740 20 client.16755 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:08.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e274c2740 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56137e4c0680 0x56137e4c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:08.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e274c2740 4 client.16755 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:13:08.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.242+0000 7f8e274c2740 1 -- 172.21.15.47:0/3765819757 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56137e3ae350 con 0x56137e4c0680 2024-07-24T22:13:08.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e1e59c640 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56137e4c0680 0x56137e4c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:08.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e1e59c640 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56137e4c0680 0x56137e4c2aa0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc383a2d2e09ee81 server_cookie=8e46586f1f98ba91 in_seq=0 out_seq=0 2024-07-24T22:13:08.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e02ff5640 10 client.16755 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:08.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e02ff5640 1 -- 172.21.15.47:0/3765819757 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56137e3ae350 con 0x56137e4c0680 2024-07-24T22:13:08.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e02ff5640 10 client.16755 handle_command_reply: tid=0 2024-07-24T22:13:08.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e274c2740 1 client.16755 shutdown 2024-07-24T22:13:08.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e274c2740 1 -- 172.21.15.47:0/3765819757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 msgr2=0x56137e449450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:08.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e274c2740 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 0x56137e449450 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8e10057e40 tx=0x7f8e10031d40 comp rx=0 tx=0).stop 2024-07-24T22:13:08.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e274c2740 1 -- 172.21.15.47:0/3765819757 shutdown_connections 2024-07-24T22:13:08.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e274c2740 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56137e4c0680 0x56137e4c2aa0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e274c2740 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56137e445f30 0x56137e4be810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e274c2740 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56137e439fa0 0x56137e449990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e274c2740 1 --2- 172.21.15.47:0/3765819757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56137e439680 0x56137e449450 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e274c2740 1 -- 172.21.15.47:0/3765819757 >> 172.21.15.47:0/3765819757 conn(0x56137e4374b0 msgr2=0x56137e441650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:08.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e02ff5640 0 client.16755 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:08.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.243+0000 7f8e274c2740 1 -- 172.21.15.47:0/3765819757 shutdown_connections 2024-07-24T22:13:08.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e274c2740 1 -- 172.21.15.47:0/3765819757 wait complete. 2024-07-24T22:13:08.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e274c2740 20 client.16755 trim_cache size 0 max 16384 2024-07-24T22:13:08.252 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:13:08.253 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-07-24T22:13:08.253 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-07-24T22:13:08.253 INFO:teuthology.orchestra.run.smithi047.stdout: "fe970fc7-b6d0-4f86-92da-7a6fe0e1cc11": { 2024-07-24T22:13:08.253 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-07-24T22:13:08.253 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "fe970fc7-b6d0-4f86-92da-7a6fe0e1cc11", 2024-07-24T22:13:08.253 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-07-24T22:13:08.253 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:13:08.253 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:13:08.253 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:13:08.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e25111640 1 -- 172.21.15.47:0/183392553 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8e080b3d40 msgr2=0x7f8e080b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:08.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e25111640 1 --2- 172.21.15.47:0/183392553 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8e080b3d40 0x7f8e080b6200 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8e14006fd0 tx=0x7f8e14008040 comp rx=0 tx=0).stop 2024-07-24T22:13:08.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e25111640 1 -- 172.21.15.47:0/183392553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e2010cac0 msgr2=0x7f8e20109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:08.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e25111640 1 --2- 172.21.15.47:0/183392553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e2010cac0 0x7f8e20109d10 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800b9a0 tx=0x7f8e1800be60 comp rx=0 tx=0).stop 2024-07-24T22:13:08.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e25111640 1 -- 172.21.15.47:0/183392553 shutdown_connections 2024-07-24T22:13:08.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e25111640 1 --2- 172.21.15.47:0/183392553 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8e080b3d40 0x7f8e080b6200 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e25111640 1 --2- 172.21.15.47:0/183392553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e2010cac0 0x7f8e20109d10 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e25111640 1 --2- 172.21.15.47:0/183392553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e20103f80 0x7f8e201095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e25111640 1 --2- 172.21.15.47:0/183392553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e20103660 0x7f8e2010c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:08.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e25111640 1 -- 172.21.15.47:0/183392553 >> 172.21.15.47:0/183392553 conn(0x7f8e200fd0c0 msgr2=0x7f8e200fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:08.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e25111640 1 -- 172.21.15.47:0/183392553 shutdown_connections 2024-07-24T22:13:08.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:08.244+0000 7f8e25111640 1 -- 172.21.15.47:0/183392553 wait complete. 2024-07-24T22:13:08.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:07 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:13:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:07 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:13:09.026 INFO:tasks.cephfs.filesystem:scrub status for tag:fe970fc7-b6d0-4f86-92da-7a6fe0e1cc11 - {'path': '/', 'tag': 'fe970fc7-b6d0-4f86-92da-7a6fe0e1cc11', 'options': 'recursive,force'} 2024-07-24T22:13:09.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:09 smithi183 ceph-mon[37007]: pgmap v544: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 468 MiB/s wr, 677 op/s 2024-07-24T22:13:09.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:09 smithi047 ceph-mon[32551]: pgmap v544: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 468 MiB/s wr, 677 op/s 2024-07-24T22:13:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.524+0000 7fa0f068d640 1 -- 172.21.15.47:0/1193745598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e8074eb0 msgr2=0x7fa0e8075290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.524+0000 7fa0f068d640 1 --2- 172.21.15.47:0/1193745598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e8074eb0 0x7fa0e8075290 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009900 tx=0x7fa0e402a410 comp rx=0 tx=0).stop 2024-07-24T22:13:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.524+0000 7fa0f068d640 1 -- 172.21.15.47:0/1193745598 shutdown_connections 2024-07-24T22:13:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.524+0000 7fa0f068d640 1 --2- 172.21.15.47:0/1193745598 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0e810ed40 0x7fa0e8111130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.524+0000 7fa0f068d640 1 --2- 172.21.15.47:0/1193745598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0e80757d0 0x7fa0e810e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.524+0000 7fa0f068d640 1 --2- 172.21.15.47:0/1193745598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e8074eb0 0x7fa0e8075290 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.524+0000 7fa0f068d640 1 -- 172.21.15.47:0/1193745598 >> 172.21.15.47:0/1193745598 conn(0x7fa0e80fe180 msgr2=0x7fa0e81005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.524+0000 7fa0f068d640 1 -- 172.21.15.47:0/1193745598 shutdown_connections 2024-07-24T22:13:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.524+0000 7fa0f068d640 1 -- 172.21.15.47:0/1193745598 wait complete. 2024-07-24T22:13:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.524+0000 7fa0f068d640 1 Processor -- start 2024-07-24T22:13:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.524+0000 7fa0f068d640 1 -- start start 2024-07-24T22:13:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0f068d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e8074eb0 0x7fa0e819ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0f068d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0e80757d0 0x7fa0e819b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0f068d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0e810ed40 0x7fa0e81a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0f068d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e8114920 con 0x7fa0e8074eb0 2024-07-24T22:13:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0f068d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e81147a0 con 0x7fa0e810ed40 2024-07-24T22:13:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0f068d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e8114aa0 con 0x7fa0e80757d0 2024-07-24T22:13:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0ee429640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e8074eb0 0x7fa0e819ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0ee429640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e8074eb0 0x7fa0e819ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59536/0 (socket says 172.21.15.47:59536) 2024-07-24T22:13:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0ee429640 1 -- 172.21.15.47:0/1325465786 learned_addr learned my addr 172.21.15.47:0/1325465786 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0eec2a640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0e810ed40 0x7fa0e81a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0edc28640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0e80757d0 0x7fa0e819b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0ee429640 1 -- 172.21.15.47:0/1325465786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0e80757d0 msgr2=0x7fa0e819b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0ee429640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0e80757d0 0x7fa0e819b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0ee429640 1 -- 172.21.15.47:0/1325465786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0e810ed40 msgr2=0x7fa0e81a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0ee429640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0e810ed40 0x7fa0e81a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0ee429640 1 -- 172.21.15.47:0/1325465786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e81a0ee0 con 0x7fa0e8074eb0 2024-07-24T22:13:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0ee429640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e8074eb0 0x7fa0e819ae40 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4005940 tx=0x7fa0e40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.525+0000 7fa0df7fe640 1 -- 172.21.15.47:0/1325465786 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e403f030 con 0x7fa0e8074eb0 2024-07-24T22:13:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.526+0000 7fa0f068d640 1 -- 172.21.15.47:0/1325465786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e81a1170 con 0x7fa0e8074eb0 2024-07-24T22:13:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.526+0000 7fa0df7fe640 1 -- 172.21.15.47:0/1325465786 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0e40044c0 con 0x7fa0e8074eb0 2024-07-24T22:13:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.526+0000 7fa0df7fe640 1 -- 172.21.15.47:0/1325465786 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4035070 con 0x7fa0e8074eb0 2024-07-24T22:13:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.526+0000 7fa0f068d640 1 -- 172.21.15.47:0/1325465786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e81a7890 con 0x7fa0e8074eb0 2024-07-24T22:13:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.528+0000 7fa0f33e5740 1 Processor -- start 2024-07-24T22:13:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.528+0000 7fa0f33e5740 1 -- start start 2024-07-24T22:13:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0f33e5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561125084c90 0x561125085070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0f33e5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611250855b0 0x561125091000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0f33e5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125091540 0x561125093930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0f33e5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561124ffa280 con 0x561125091540 2024-07-24T22:13:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0f33e5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x561124fe9780 con 0x5611250855b0 2024-07-24T22:13:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0f33e5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561124fed7c0 con 0x561125084c90 2024-07-24T22:13:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0df7fe640 1 -- 172.21.15.47:0/1325465786 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fa0e4042030 con 0x7fa0e8074eb0 2024-07-24T22:13:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0edc28640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125091540 0x561125093930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0edc28640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125091540 0x561125093930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59552/0 (socket says 172.21.15.47:59552) 2024-07-24T22:13:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0edc28640 1 -- 172.21.15.47:0/2689413012 learned_addr learned my addr 172.21.15.47:0/2689413012 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0eec2a640 1 --2- 172.21.15.47:0/2689413012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561125084c90 0x561125085070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0ee429640 1 --2- 172.21.15.47:0/2689413012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611250855b0 0x561125091000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0edc28640 1 -- 172.21.15.47:0/2689413012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561125084c90 msgr2=0x561125085070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0edc28640 1 --2- 172.21.15.47:0/2689413012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561125084c90 0x561125085070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0edc28640 1 -- 172.21.15.47:0/2689413012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611250855b0 msgr2=0x561125091000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0edc28640 1 --2- 172.21.15.47:0/2689413012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611250855b0 0x561125091000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0edc28640 1 -- 172.21.15.47:0/2689413012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561124d4d790 con 0x561125091540 2024-07-24T22:13:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0ee429640 1 --2- 172.21.15.47:0/2689413012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611250855b0 0x561125091000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:13:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.529+0000 7fa0edc28640 1 --2- 172.21.15.47:0/2689413012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125091540 0x561125093930 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009c90 tx=0x7fa0d8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4246e43e6f4afe80 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.530+0000 7fa0dcff9640 1 -- 172.21.15.47:0/2689413012 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d801e070 con 0x561125091540 2024-07-24T22:13:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.530+0000 7fa0dcff9640 1 -- 172.21.15.47:0/2689413012 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0d8019ae0 con 0x561125091540 2024-07-24T22:13:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.530+0000 7fa0dcff9640 1 -- 172.21.15.47:0/2689413012 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d800e9e0 con 0x561125091540 2024-07-24T22:13:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.530+0000 7fa0df7fe640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0d40b3d40 0x7fa0d40b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.530+0000 7fa0eec2a640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0d40b3d40 0x7fa0d40b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.530+0000 7fa0df7fe640 1 -- 172.21.15.47:0/1325465786 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa0e4103fb0 con 0x7fa0e8074eb0 2024-07-24T22:13:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.530+0000 7fa0f33e5740 1 -- 172.21.15.47:0/2689413012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125091540 msgr2=0x561125093930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.530+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/2689413012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125091540 0x561125093930 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009c90 tx=0x7fa0d8011810 comp rx=0 tx=0).stop 2024-07-24T22:13:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.530+0000 7fa0f33e5740 1 -- 172.21.15.47:0/2689413012 shutdown_connections 2024-07-24T22:13:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.530+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/2689413012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125091540 0x561125093930 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.530+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/2689413012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611250855b0 0x561125091000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.530+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/2689413012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561125084c90 0x561125085070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.530+0000 7fa0f33e5740 1 -- 172.21.15.47:0/2689413012 >> 172.21.15.47:0/2689413012 conn(0x561125082ac0 msgr2=0x561125083c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0eec2a640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0d40b3d40 0x7fa0d40b6200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa0e806bb20 tx=0x7fa0e0009500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0f33e5740 1 -- 172.21.15.47:0/2689413012 shutdown_connections 2024-07-24T22:13:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0f33e5740 1 -- 172.21.15.47:0/2689413012 wait complete. 2024-07-24T22:13:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0f33e5740 1 -- start start 2024-07-24T22:13:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0f33e5740 1 Processor -- start 2024-07-24T22:13:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0f33e5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125084c90 0x561125090c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0f33e5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611250855b0 0x56112508e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0f33e5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561125091540 0x56112508e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0f33e5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561124f23ab0 con 0x5611250855b0 2024-07-24T22:13:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0f33e5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x561124f719e0 con 0x561125084c90 2024-07-24T22:13:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0f33e5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561125094220 con 0x561125091540 2024-07-24T22:13:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0f33e5740 10 client.0 _ll_register_callbacks cb 0x561124cf9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0edc28640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611250855b0 0x56112508e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0edc28640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611250855b0 0x56112508e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59556/0 (socket says 172.21.15.47:59556) 2024-07-24T22:13:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0edc28640 1 -- 172.21.15.47:0/1963106780 learned_addr learned my addr 172.21.15.47:0/1963106780 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.531+0000 7fa0ee429640 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125084c90 0x561125090c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0eec2a640 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561125091540 0x56112508e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0edc28640 1 -- 172.21.15.47:0/1963106780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561125091540 msgr2=0x56112508e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0edc28640 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561125091540 0x56112508e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0edc28640 1 -- 172.21.15.47:0/1963106780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125084c90 msgr2=0x561125090c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0edc28640 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125084c90 0x561125090c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0edc28640 1 -- 172.21.15.47:0/1963106780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561124dc6620 con 0x5611250855b0 2024-07-24T22:13:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0eec2a640 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561125091540 0x56112508e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:13:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0edc28640 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611250855b0 0x56112508e110 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8005640 tx=0x7fa0d8005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc3e082b68510c6 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0d1ffb640 1 -- 172.21.15.47:0/1963106780 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d801e050 con 0x5611250855b0 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0d1ffb640 1 -- 172.21.15.47:0/1963106780 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa0d8004230 con 0x5611250855b0 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0f33e5740 1 -- 172.21.15.47:0/1963106780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561124f98ce0 con 0x5611250855b0 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0d1ffb640 1 -- 172.21.15.47:0/1963106780 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa0d8032050 con 0x5611250855b0 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0f33e5740 10 client.16767 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0f33e5740 1 -- 172.21.15.47:0/1963106780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56112509f8c0 con 0x5611250855b0 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0d1ffb640 1 -- 172.21.15.47:0/1963106780 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561124f98ce0 con 0x5611250855b0 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.532+0000 7fa0d1ffb640 1 -- 172.21.15.47:0/1963106780 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa0d802d030 con 0x5611250855b0 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.533+0000 7fa0f33e5740 10 client.16767 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.533+0000 7fa0f33e5740 10 client.16767 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.533+0000 7fa0f33e5740 20 client.16767 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.533+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5611250a0cc0 0x5611250a30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.533+0000 7fa0f33e5740 4 client.16767 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:13:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.533+0000 7fa0f33e5740 1 -- 172.21.15.47:0/1963106780 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561124ffc1d0 con 0x5611250a0cc0 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.533+0000 7fa0ee429640 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5611250a0cc0 0x5611250a30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.533+0000 7fa0ee429640 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5611250a0cc0 0x5611250a30b0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da6e53621892f285 server_cookie=32685215f429b35d in_seq=0 out_seq=0 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.533+0000 7fa0d1ffb640 10 client.16767 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0d1ffb640 1 -- 172.21.15.47:0/1963106780 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561124ffc1d0 con 0x5611250a0cc0 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0d1ffb640 10 client.16767 handle_command_reply: tid=0 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0f33e5740 1 client.16767 shutdown 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0f33e5740 1 -- 172.21.15.47:0/1963106780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611250855b0 msgr2=0x56112508e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611250855b0 0x56112508e110 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8005640 tx=0x7fa0d8005670 comp rx=0 tx=0).stop 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0f33e5740 1 -- 172.21.15.47:0/1963106780 shutdown_connections 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5611250a0cc0 0x5611250a30b0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561125091540 0x56112508e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611250855b0 0x56112508e110 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0d1ffb640 0 client.16767 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/1963106780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125084c90 0x561125090c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0f33e5740 1 -- 172.21.15.47:0/1963106780 >> 172.21.15.47:0/1963106780 conn(0x561125082ac0 msgr2=0x561125081ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0f33e5740 1 -- 172.21.15.47:0/1963106780 shutdown_connections 2024-07-24T22:13:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0f33e5740 1 -- 172.21.15.47:0/1963106780 wait complete. 2024-07-24T22:13:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.534+0000 7fa0f33e5740 20 client.16767 trim_cache size 0 max 16384 2024-07-24T22:13:09.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:09 smithi188 ceph-mon[37380]: pgmap v544: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 468 MiB/s wr, 677 op/s 2024-07-24T22:13:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.553+0000 7fa0f33e5740 1 Processor -- start 2024-07-24T22:13:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.553+0000 7fa0f33e5740 1 -- start start 2024-07-24T22:13:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0f33e5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 0x56112508d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0f33e5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611250855b0 0x5611250a8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0f33e5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125091540 0x5611250a8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0f33e5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e81ae290 con 0x561125084c90 2024-07-24T22:13:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0f33e5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e81b0b10 con 0x561125091540 2024-07-24T22:13:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0f33e5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e81ae900 con 0x5611250855b0 2024-07-24T22:13:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0ee429640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 0x56112508d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0ee429640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 0x56112508d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59572/0 (socket says 172.21.15.47:59572) 2024-07-24T22:13:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0ee429640 1 -- 172.21.15.47:0/1847189363 learned_addr learned my addr 172.21.15.47:0/1847189363 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0eec2a640 1 --2- 172.21.15.47:0/1847189363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125091540 0x5611250a8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0edc28640 1 --2- 172.21.15.47:0/1847189363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611250855b0 0x5611250a8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0ee429640 1 -- 172.21.15.47:0/1847189363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611250855b0 msgr2=0x5611250a8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0ee429640 1 --2- 172.21.15.47:0/1847189363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611250855b0 0x5611250a8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0ee429640 1 -- 172.21.15.47:0/1847189363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125091540 msgr2=0x5611250a8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0ee429640 1 --2- 172.21.15.47:0/1847189363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125091540 0x5611250a8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0ee429640 1 -- 172.21.15.47:0/1847189363 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561125093db0 con 0x561125084c90 2024-07-24T22:13:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0ee429640 1 --2- 172.21.15.47:0/1847189363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 0x56112508d850 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40c7ee0 tx=0x7fa0e41064c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf782099716b5e2c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0d3fff640 1 -- 172.21.15.47:0/1847189363 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4049040 con 0x561125084c90 2024-07-24T22:13:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.554+0000 7fa0d3fff640 1 -- 172.21.15.47:0/1847189363 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0e4101e50 con 0x561125084c90 2024-07-24T22:13:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.555+0000 7fa0d3fff640 1 -- 172.21.15.47:0/1847189363 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e41060b0 con 0x561125084c90 2024-07-24T22:13:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.555+0000 7fa0f33e5740 1 -- 172.21.15.47:0/1847189363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 msgr2=0x56112508d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.555+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/1847189363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 0x56112508d850 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40c7ee0 tx=0x7fa0e41064c0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.555+0000 7fa0f33e5740 1 -- 172.21.15.47:0/1847189363 shutdown_connections 2024-07-24T22:13:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.555+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/1847189363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125091540 0x5611250a8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.555+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/1847189363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611250855b0 0x5611250a8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.555+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/1847189363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 0x56112508d850 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.555+0000 7fa0f33e5740 1 -- 172.21.15.47:0/1847189363 >> 172.21.15.47:0/1847189363 conn(0x561125082ac0 msgr2=0x56112508fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.555+0000 7fa0f33e5740 1 -- 172.21.15.47:0/1847189363 shutdown_connections 2024-07-24T22:13:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.555+0000 7fa0f33e5740 1 -- 172.21.15.47:0/1847189363 wait complete. 2024-07-24T22:13:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0f33e5740 1 -- start start 2024-07-24T22:13:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0f33e5740 1 Processor -- start 2024-07-24T22:13:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0f33e5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 0x561125099b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0f33e5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611250855b0 0x561125096480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0f33e5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125091540 0x561125096a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0f33e5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e81aefd0 con 0x561125084c90 2024-07-24T22:13:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0f33e5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e81b0440 con 0x561125091540 2024-07-24T22:13:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0f33e5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e81af6a0 con 0x5611250855b0 2024-07-24T22:13:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0f33e5740 10 client.0 _ll_register_callbacks cb 0x7fa0d801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0ee429640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 0x561125099b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0edc28640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611250855b0 0x561125096480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0ee429640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 0x561125099b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59584/0 (socket says 172.21.15.47:59584) 2024-07-24T22:13:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0ee429640 1 -- 172.21.15.47:0/62809329 learned_addr learned my addr 172.21.15.47:0/62809329 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.556+0000 7fa0eec2a640 1 --2- 172.21.15.47:0/62809329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125091540 0x561125096a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0ee429640 1 -- 172.21.15.47:0/62809329 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611250855b0 msgr2=0x561125096480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0ee429640 1 --2- 172.21.15.47:0/62809329 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611250855b0 0x561125096480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0ee429640 1 -- 172.21.15.47:0/62809329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125091540 msgr2=0x561125096a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0ee429640 1 --2- 172.21.15.47:0/62809329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125091540 0x561125096a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0ee429640 1 -- 172.21.15.47:0/62809329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561125097230 con 0x561125084c90 2024-07-24T22:13:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0edc28640 1 --2- 172.21.15.47:0/62809329 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611250855b0 0x561125096480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0ee429640 1 --2- 172.21.15.47:0/62809329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 0x561125099b80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4101d00 tx=0x7fa0e4104360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c4d8340389c826 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0d1ffb640 1 -- 172.21.15.47:0/62809329 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4049070 con 0x561125084c90 2024-07-24T22:13:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0d1ffb640 1 -- 172.21.15.47:0/62809329 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8521+0+0 (secure 0 0 0) 0x7fa0e40caed0 con 0x561125084c90 2024-07-24T22:13:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0f33e5740 1 -- 172.21.15.47:0/62809329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0e4101e50 con 0x561125084c90 2024-07-24T22:13:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0d1ffb640 1 -- 172.21.15.47:0/62809329 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa0e40cb0d0 con 0x561125084c90 2024-07-24T22:13:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0f33e5740 10 client.16773 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0f33e5740 1 -- 172.21.15.47:0/62809329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56112510a910 con 0x561125084c90 2024-07-24T22:13:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0d1ffb640 1 -- 172.21.15.47:0/62809329 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0e4101e50 con 0x561125084c90 2024-07-24T22:13:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.557+0000 7fa0d1ffb640 1 -- 172.21.15.47:0/62809329 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa0e4106040 con 0x561125084c90 2024-07-24T22:13:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.558+0000 7fa0f33e5740 10 client.16773 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.558+0000 7fa0f33e5740 10 client.16773 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.558+0000 7fa0f33e5740 20 client.16773 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.558+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/62809329 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56112510b090 0x56112510d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.558+0000 7fa0f33e5740 4 client.16773 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:13:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.558+0000 7fa0f33e5740 1 -- 172.21.15.47:0/62809329 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561124ff7c70 con 0x56112510b090 2024-07-24T22:13:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.558+0000 7fa0edc28640 1 --2- 172.21.15.47:0/62809329 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56112510b090 0x56112510d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.558+0000 7fa0edc28640 1 --2- 172.21.15.47:0/62809329 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56112510b090 0x56112510d4b0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ac135f9da7bd86 server_cookie=c61c9c40e83dc97e in_seq=0 out_seq=0 2024-07-24T22:13:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.558+0000 7fa0d1ffb640 10 client.16773 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.579+0000 7fa0d1ffb640 1 -- 172.21.15.47:0/62809329 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561124ff7c70 con 0x56112510b090 2024-07-24T22:13:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.579+0000 7fa0d1ffb640 10 client.16773 handle_command_reply: tid=0 2024-07-24T22:13:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.579+0000 7fa0f33e5740 1 client.16773 shutdown 2024-07-24T22:13:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.579+0000 7fa0f33e5740 1 -- 172.21.15.47:0/62809329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 msgr2=0x561125099b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.579+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/62809329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 0x561125099b80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4101d00 tx=0x7fa0e4104360 comp rx=0 tx=0).stop 2024-07-24T22:13:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.579+0000 7fa0f33e5740 1 -- 172.21.15.47:0/62809329 shutdown_connections 2024-07-24T22:13:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.579+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/62809329 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56112510b090 0x56112510d4b0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.579+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/62809329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561125091540 0x561125096a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.579+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/62809329 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611250855b0 0x561125096480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.579+0000 7fa0d1ffb640 0 client.16773 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.579+0000 7fa0f33e5740 1 --2- 172.21.15.47:0/62809329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561125084c90 0x561125099b80 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.579+0000 7fa0f33e5740 1 -- 172.21.15.47:0/62809329 >> 172.21.15.47:0/62809329 conn(0x561125082ac0 msgr2=0x56112508f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.579+0000 7fa0f33e5740 1 -- 172.21.15.47:0/62809329 shutdown_connections 2024-07-24T22:13:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f33e5740 1 -- 172.21.15.47:0/62809329 wait complete. 2024-07-24T22:13:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f33e5740 20 client.16773 trim_cache size 0 max 16384 2024-07-24T22:13:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:13:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:13:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:13:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:13:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f068d640 1 -- 172.21.15.47:0/1325465786 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0d40b3d40 msgr2=0x7fa0d40b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f068d640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0d40b3d40 0x7fa0d40b6200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa0e806bb20 tx=0x7fa0e0009500 comp rx=0 tx=0).stop 2024-07-24T22:13:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f068d640 1 -- 172.21.15.47:0/1325465786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e8074eb0 msgr2=0x7fa0e819ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f068d640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e8074eb0 0x7fa0e819ae40 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4005940 tx=0x7fa0e40040c0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f068d640 1 -- 172.21.15.47:0/1325465786 shutdown_connections 2024-07-24T22:13:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f068d640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0d40b3d40 0x7fa0d40b6200 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f068d640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0e810ed40 0x7fa0e81a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f068d640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0e80757d0 0x7fa0e819b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f068d640 1 --2- 172.21.15.47:0/1325465786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0e8074eb0 0x7fa0e819ae40 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f068d640 1 -- 172.21.15.47:0/1325465786 >> 172.21.15.47:0/1325465786 conn(0x7fa0e80fe180 msgr2=0x7fa0e8110f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f068d640 1 -- 172.21.15.47:0/1325465786 shutdown_connections 2024-07-24T22:13:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:09.580+0000 7fa0f068d640 1 -- 172.21.15.47:0/1325465786 wait complete. 2024-07-24T22:13:11.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:11 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:13:11.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:11 smithi047 ceph-mon[32551]: osdmap e86: 12 total, 12 up, 12 in 2024-07-24T22:13:11.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:11 smithi047 ceph-mon[32551]: pgmap v546: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 807 KiB/s rd, 418 MiB/s wr, 1.11k op/s 2024-07-24T22:13:11.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:11 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:13:11.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:11 smithi188 ceph-mon[37380]: osdmap e86: 12 total, 12 up, 12 in 2024-07-24T22:13:11.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:11 smithi188 ceph-mon[37380]: pgmap v546: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 807 KiB/s rd, 418 MiB/s wr, 1.11k op/s 2024-07-24T22:13:11.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:11 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:13:11.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:11 smithi183 ceph-mon[37007]: osdmap e86: 12 total, 12 up, 12 in 2024-07-24T22:13:11.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:11 smithi183 ceph-mon[37007]: pgmap v546: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 807 KiB/s rd, 418 MiB/s wr, 1.11k op/s 2024-07-24T22:13:13.473 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-24T22:13:13.473 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-07-24T22:13:13.474 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:13:13.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:13 smithi183 ceph-mon[37007]: pgmap v547: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 807 KiB/s rd, 368 MiB/s wr, 1.15k op/s 2024-07-24T22:13:13.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:13 smithi047 ceph-mon[32551]: pgmap v547: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 807 KiB/s rd, 368 MiB/s wr, 1.15k op/s 2024-07-24T22:13:13.757 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:13:13.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:13 smithi188 ceph-mon[37380]: pgmap v547: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 807 KiB/s rd, 368 MiB/s wr, 1.15k op/s 2024-07-24T22:13:15.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:15 smithi047 ceph-mon[32551]: pgmap v548: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 921 GiB / 1.0 TiB avail; 571 KiB/s rd, 247 MiB/s wr, 1.06k op/s 2024-07-24T22:13:15.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:15 smithi183 ceph-mon[37007]: pgmap v548: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 921 GiB / 1.0 TiB avail; 571 KiB/s rd, 247 MiB/s wr, 1.06k op/s 2024-07-24T22:13:15.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.791+0000 7fada58ea640 1 -- 172.21.15.47:0/3628894250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada01010e0 msgr2=0x7fada01014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:15.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.791+0000 7fada58ea640 1 --2- 172.21.15.47:0/3628894250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada01010e0 0x7fada01014c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fad88009860 tx=0x7fad8802a3f0 comp rx=0 tx=0).stop 2024-07-24T22:13:15.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.791+0000 7fada58ea640 1 -- 172.21.15.47:0/3628894250 shutdown_connections 2024-07-24T22:13:15.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.791+0000 7fada58ea640 1 --2- 172.21.15.47:0/3628894250 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fada010ec90 0x7fada0111080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:15.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.791+0000 7fada58ea640 1 --2- 172.21.15.47:0/3628894250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fada0101a00 0x7fada010e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:15.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.791+0000 7fada58ea640 1 --2- 172.21.15.47:0/3628894250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada01010e0 0x7fada01014c0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:15.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.791+0000 7fada58ea640 1 -- 172.21.15.47:0/3628894250 >> 172.21.15.47:0/3628894250 conn(0x7fada00fcf90 msgr2=0x7fada00ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:15.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.792+0000 7fada58ea640 1 -- 172.21.15.47:0/3628894250 shutdown_connections 2024-07-24T22:13:15.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.792+0000 7fada58ea640 1 -- 172.21.15.47:0/3628894250 wait complete. 2024-07-24T22:13:15.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.793+0000 7fada58ea640 1 Processor -- start 2024-07-24T22:13:15.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.793+0000 7fada58ea640 1 -- start start 2024-07-24T22:13:15.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.794+0000 7fada58ea640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fada01010e0 0x7fada010e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:15.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.794+0000 7fada58ea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fada0101a00 0x7fada010b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:15.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.794+0000 7fada58ea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada010ec90 0x7fada010bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:15.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.794+0000 7fada58ea640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fada01147e0 con 0x7fada010ec90 2024-07-24T22:13:15.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.794+0000 7fada58ea640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fada0114660 con 0x7fada01010e0 2024-07-24T22:13:15.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.794+0000 7fada58ea640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fada0114960 con 0x7fada0101a00 2024-07-24T22:13:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:15 smithi188 ceph-mon[37380]: pgmap v548: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 921 GiB / 1.0 TiB avail; 571 KiB/s rd, 247 MiB/s wr, 1.06k op/s 2024-07-24T22:13:15.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.796+0000 7fad9f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada010ec90 0x7fada010bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:15.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.796+0000 7fad9f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada010ec90 0x7fada010bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39994/0 (socket says 172.21.15.47:39994) 2024-07-24T22:13:15.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.796+0000 7fad9f7fe640 1 -- 172.21.15.47:0/1918279081 learned_addr learned my addr 172.21.15.47:0/1918279081 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:15.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.797+0000 7fad9f7fe640 1 -- 172.21.15.47:0/1918279081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fada0101a00 msgr2=0x7fada010b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:15.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.797+0000 7fad9f7fe640 1 --2- 172.21.15.47:0/1918279081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fada0101a00 0x7fada010b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:15.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.797+0000 7fad9f7fe640 1 -- 172.21.15.47:0/1918279081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fada01010e0 msgr2=0x7fada010e380 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:13:15.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.797+0000 7fad9f7fe640 1 --2- 172.21.15.47:0/1918279081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fada01010e0 0x7fada010e380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:15.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.797+0000 7fad9f7fe640 1 -- 172.21.15.47:0/1918279081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada010c290 con 0x7fada010ec90 2024-07-24T22:13:15.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.798+0000 7fad9f7fe640 1 --2- 172.21.15.47:0/1918279081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada010ec90 0x7fada010bb10 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fad9800cad0 tx=0x7fad9800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:15.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.799+0000 7fada48e8640 1 -- 172.21.15.47:0/1918279081 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9800ae20 con 0x7fada010ec90 2024-07-24T22:13:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.799+0000 7fada58ea640 1 -- 172.21.15.47:0/1918279081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada006c560 con 0x7fada010ec90 2024-07-24T22:13:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.799+0000 7fada58ea640 1 -- 172.21.15.47:0/1918279081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada006ca40 con 0x7fada010ec90 2024-07-24T22:13:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.799+0000 7fada48e8640 1 -- 172.21.15.47:0/1918279081 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad98003e40 con 0x7fada010ec90 2024-07-24T22:13:15.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.799+0000 7fada48e8640 1 -- 172.21.15.47:0/1918279081 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9800f6b0 con 0x7fada010ec90 2024-07-24T22:13:15.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.805+0000 7fada58ea640 1 -- 172.21.15.47:0/1918279081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad840052c0 con 0x7fada010ec90 2024-07-24T22:13:15.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.806+0000 7fada48e8640 1 -- 172.21.15.47:0/1918279081 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fad98003990 con 0x7fada010ec90 2024-07-24T22:13:15.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.808+0000 7fada48e8640 1 --2- 172.21.15.47:0/1918279081 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fad800b3f30 0x7fad800b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:15.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.808+0000 7fada48e8640 1 -- 172.21.15.47:0/1918279081 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8609+0+0 (secure 0 0 0) 0x7fad980e3f50 con 0x7fada010ec90 2024-07-24T22:13:15.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.810+0000 7fad9effd640 1 --2- 172.21.15.47:0/1918279081 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fad800b3f30 0x7fad800b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.818+0000 7fad9effd640 1 --2- 172.21.15.47:0/1918279081 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fad800b3f30 0x7fad800b63f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fad88005b60 tx=0x7fad88030aa0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:15.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:15.824+0000 7fada48e8640 1 -- 172.21.15.47:0/1918279081 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fad98014070 con 0x7fada010ec90 2024-07-24T22:13:16.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.423+0000 7fada58ea640 1 -- 172.21.15.47:0/1918279081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad84005880 con 0x7fada010ec90 2024-07-24T22:13:16.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.425+0000 7fada48e8640 1 -- 172.21.15.47:0/1918279081 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7fad980ab1a0 con 0x7fada010ec90 2024-07-24T22:13:16.429 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:13:16.429 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:13:16.429 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:13:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.431+0000 7fada58ea640 1 -- 172.21.15.47:0/1918279081 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fad800b3f30 msgr2=0x7fad800b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.431+0000 7fada58ea640 1 --2- 172.21.15.47:0/1918279081 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fad800b3f30 0x7fad800b63f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fad88005b60 tx=0x7fad88030aa0 comp rx=0 tx=0).stop 2024-07-24T22:13:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.431+0000 7fada58ea640 1 -- 172.21.15.47:0/1918279081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada010ec90 msgr2=0x7fada010bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.431+0000 7fada58ea640 1 --2- 172.21.15.47:0/1918279081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada010ec90 0x7fada010bb10 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fad9800cad0 tx=0x7fad9800cf90 comp rx=0 tx=0).stop 2024-07-24T22:13:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.432+0000 7fada58ea640 1 -- 172.21.15.47:0/1918279081 shutdown_connections 2024-07-24T22:13:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.432+0000 7fada58ea640 1 --2- 172.21.15.47:0/1918279081 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fad800b3f30 0x7fad800b63f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.432+0000 7fada58ea640 1 --2- 172.21.15.47:0/1918279081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fada010ec90 0x7fada010bb10 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.432+0000 7fada58ea640 1 --2- 172.21.15.47:0/1918279081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fada0101a00 0x7fada010b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.432+0000 7fada58ea640 1 --2- 172.21.15.47:0/1918279081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fada01010e0 0x7fada010e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.432+0000 7fada58ea640 1 -- 172.21.15.47:0/1918279081 >> 172.21.15.47:0/1918279081 conn(0x7fada00fcf90 msgr2=0x7fada010f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.433+0000 7fada58ea640 1 -- 172.21.15.47:0/1918279081 shutdown_connections 2024-07-24T22:13:16.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:16.433+0000 7fada58ea640 1 -- 172.21.15.47:0/1918279081 wait complete. 2024-07-24T22:13:17.400 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-07-24T22:13:17.401 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-07-24T22:13:17.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:17 smithi047 ceph-mon[32551]: pgmap v549: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 921 GiB / 1.0 TiB avail; 150 KiB/s rd, 197 MiB/s wr, 932 op/s 2024-07-24T22:13:17.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:17 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1918279081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:13:17.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:17 smithi188 ceph-mon[37380]: pgmap v549: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 921 GiB / 1.0 TiB avail; 150 KiB/s rd, 197 MiB/s wr, 932 op/s 2024-07-24T22:13:17.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:17 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1918279081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:13:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:13:17.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:17 smithi183 ceph-mon[37007]: pgmap v549: 97 pgs: 97 active+clean; 50 GiB data, 151 GiB used, 921 GiB / 1.0 TiB avail; 150 KiB/s rd, 197 MiB/s wr, 932 op/s 2024-07-24T22:13:17.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:17 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1918279081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:13:18.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:18 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:13:18.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:18 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:13:18.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:18 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:13:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: pgmap v550: 97 pgs: 97 active+clean; 50 GiB data, 153 GiB used, 920 GiB / 1.0 TiB avail; 34 KiB/s rd, 180 MiB/s wr, 924 op/s 2024-07-24T22:13:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi188 to 176.2M 2024-07-24T22:13:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: Adjusting osd_memory_target on smithi183 to 176.2M 2024-07-24T22:13:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: Unable to set osd_memory_target on smithi188 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-24T22:13:19.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: Unable to set osd_memory_target on smithi183 to 184768819: error parsing value: Value '184768819' is below minimum 939524096 2024-07-24T22:13:19.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:13:19.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:13:19.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:13:19.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:19 smithi047 ceph-mon[32551]: osdmap e87: 12 total, 12 up, 12 in 2024-07-24T22:13:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: pgmap v550: 97 pgs: 97 active+clean; 50 GiB data, 153 GiB used, 920 GiB / 1.0 TiB avail; 34 KiB/s rd, 180 MiB/s wr, 924 op/s 2024-07-24T22:13:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi188 to 176.2M 2024-07-24T22:13:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: Adjusting osd_memory_target on smithi183 to 176.2M 2024-07-24T22:13:19.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: Unable to set osd_memory_target on smithi188 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-24T22:13:19.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: Unable to set osd_memory_target on smithi183 to 184768819: error parsing value: Value '184768819' is below minimum 939524096 2024-07-24T22:13:19.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:13:19.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:13:19.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:13:19.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:19 smithi188 ceph-mon[37380]: osdmap e87: 12 total, 12 up, 12 in 2024-07-24T22:13:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: pgmap v550: 97 pgs: 97 active+clean; 50 GiB data, 153 GiB used, 920 GiB / 1.0 TiB avail; 34 KiB/s rd, 180 MiB/s wr, 924 op/s 2024-07-24T22:13:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-24T22:13:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi188 to 176.2M 2024-07-24T22:13:19.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: Adjusting osd_memory_target on smithi183 to 176.2M 2024-07-24T22:13:19.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: Unable to set osd_memory_target on smithi188 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-07-24T22:13:19.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: Unable to set osd_memory_target on smithi183 to 184768819: error parsing value: Value '184768819' is below minimum 939524096 2024-07-24T22:13:19.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:13:19.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:13:19.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:13:19.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:19 smithi183 ceph-mon[37007]: osdmap e87: 12 total, 12 up, 12 in 2024-07-24T22:13:19.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.950+0000 7f0176dd7640 1 -- 172.21.15.47:0/3184323321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0170106810 msgr2=0x7f0170106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:19.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.950+0000 7f0176dd7640 1 --2- 172.21.15.47:0/3184323321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0170106810 0x7f0170106c50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f0160009900 tx=0x7f016002a410 comp rx=0 tx=0).stop 2024-07-24T22:13:19.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.950+0000 7f0176dd7640 1 -- 172.21.15.47:0/3184323321 shutdown_connections 2024-07-24T22:13:19.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.950+0000 7f0176dd7640 1 --2- 172.21.15.47:0/3184323321 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0170107190 0x7f017010d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.950+0000 7f0176dd7640 1 --2- 172.21.15.47:0/3184323321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0170106810 0x7f0170106c50 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.950+0000 7f0176dd7640 1 --2- 172.21.15.47:0/3184323321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01701011e0 0x7f01701015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.950+0000 7f0176dd7640 1 -- 172.21.15.47:0/3184323321 >> 172.21.15.47:0/3184323321 conn(0x7f0170076940 msgr2=0x7f0170076d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:19.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.951+0000 7f0176dd7640 1 -- 172.21.15.47:0/3184323321 shutdown_connections 2024-07-24T22:13:19.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.951+0000 7f0176dd7640 1 -- 172.21.15.47:0/3184323321 wait complete. 2024-07-24T22:13:19.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.951+0000 7f0176dd7640 1 Processor -- start 2024-07-24T22:13:19.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.951+0000 7f0176dd7640 1 -- start start 2024-07-24T22:13:19.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.951+0000 7f0176dd7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01701011e0 0x7f0170198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.951+0000 7f0176dd7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0170106810 0x7f01701991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.951+0000 7f0176dd7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0170107190 0x7f017019e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.951+0000 7f0176dd7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01701116d0 con 0x7f0170106810 2024-07-24T22:13:19.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.951+0000 7f0176dd7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0170111550 con 0x7f0170107190 2024-07-24T22:13:19.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.951+0000 7f0176dd7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0170111850 con 0x7f01701011e0 2024-07-24T22:13:19.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0167fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0170106810 0x7f01701991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0167fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0170106810 0x7f01701991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40014/0 (socket says 172.21.15.47:40014) 2024-07-24T22:13:19.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0167fff640 1 -- 172.21.15.47:0/1391839911 learned_addr learned my addr 172.21.15.47:0/1391839911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:19.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0174b73640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01701011e0 0x7f0170198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0175374640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0170107190 0x7f017019e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0167fff640 1 -- 172.21.15.47:0/1391839911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01701011e0 msgr2=0x7f0170198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:19.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0167fff640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01701011e0 0x7f0170198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0167fff640 1 -- 172.21.15.47:0/1391839911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0170107190 msgr2=0x7f017019e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:19.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0167fff640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0170107190 0x7f017019e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0167fff640 1 -- 172.21.15.47:0/1391839911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017019ed30 con 0x7f0170106810 2024-07-24T22:13:19.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0167fff640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0170106810 0x7f01701991c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0160005940 tx=0x7f0160004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:19.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0165ffb640 1 -- 172.21.15.47:0/1391839911 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016003f030 con 0x7f0170106810 2024-07-24T22:13:19.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0165ffb640 1 -- 172.21.15.47:0/1391839911 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0160003aa0 con 0x7f0170106810 2024-07-24T22:13:19.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0176dd7640 1 -- 172.21.15.47:0/1391839911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017019efc0 con 0x7f0170106810 2024-07-24T22:13:19.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.952+0000 7f0165ffb640 1 -- 172.21.15.47:0/1391839911 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160035070 con 0x7f0170106810 2024-07-24T22:13:19.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.953+0000 7f0176dd7640 1 -- 172.21.15.47:0/1391839911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01701a56e0 con 0x7f0170106810 2024-07-24T22:13:19.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.955+0000 7f0179188740 1 Processor -- start 2024-07-24T22:13:19.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.955+0000 7f0179188740 1 -- start start 2024-07-24T22:13:19.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.956+0000 7f0165ffb640 1 -- 172.21.15.47:0/1391839911 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f0160042030 con 0x7f0170106810 2024-07-24T22:13:19.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.956+0000 7f0179188740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d795525260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.956+0000 7f0179188740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955257a0 0x55d795525bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.956+0000 7f0179188740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955315d0 0x55d7955339c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.956+0000 7f0179188740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d79549b6a0 con 0x55d7955257a0 2024-07-24T22:13:19.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.956+0000 7f0179188740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d79548aba0 con 0x55d7955315d0 2024-07-24T22:13:19.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.956+0000 7f0179188740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d79548ebe0 con 0x55d795526d00 2024-07-24T22:13:19.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.956+0000 7f0175374640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d795525260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.956+0000 7f0175374640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d795525260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:37752/0 (socket says 172.21.15.47:37752) 2024-07-24T22:13:19.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.956+0000 7f0175374640 1 -- 172.21.15.47:0/2589469569 learned_addr learned my addr 172.21.15.47:0/2589469569 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:19.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.956+0000 7f0167fff640 1 --2- 172.21.15.47:0/2589469569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955315d0 0x55d7955339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.956+0000 7f0175374640 1 -- 172.21.15.47:0/2589469569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955315d0 msgr2=0x55d7955339c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:19.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0174b73640 1 --2- 172.21.15.47:0/2589469569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955257a0 0x55d795525bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0175374640 1 --2- 172.21.15.47:0/2589469569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955315d0 0x55d7955339c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0175374640 1 -- 172.21.15.47:0/2589469569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955257a0 msgr2=0x55d795525bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:19.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0175374640 1 --2- 172.21.15.47:0/2589469569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955257a0 0x55d795525bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0175374640 1 -- 172.21.15.47:0/2589469569 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d795422d60 con 0x55d795526d00 2024-07-24T22:13:19.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0167fff640 1 --2- 172.21.15.47:0/2589469569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955315d0 0x55d7955339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:19.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0174b73640 1 --2- 172.21.15.47:0/2589469569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955257a0 0x55d795525bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0165ffb640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f01580b3d40 0x7f01580b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0175374640 1 --2- 172.21.15.47:0/2589469569 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d795525260 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0168010370 tx=0x7f0168010830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6004ed9ec706760d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0174b73640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f01580b3d40 0x7f01580b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0165ffb640 1 -- 172.21.15.47:0/1391839911 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f0160104660 con 0x7f0170106810 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0156ffd640 1 -- 172.21.15.47:0/2589469569 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168016070 con 0x55d795526d00 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0156ffd640 1 -- 172.21.15.47:0/2589469569 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0168004d20 con 0x55d795526d00 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.957+0000 7f0156ffd640 1 -- 172.21.15.47:0/2589469569 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168005350 con 0x55d795526d00 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.958+0000 7f0179188740 1 -- 172.21.15.47:0/2589469569 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 msgr2=0x55d795525260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.958+0000 7f0174b73640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f01580b3d40 0x7f01580b6200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55d7955283e0 tx=0x7f016c005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.958+0000 7f0179188740 1 --2- 172.21.15.47:0/2589469569 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d795525260 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0168010370 tx=0x7f0168010830 comp rx=0 tx=0).stop 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.958+0000 7f0179188740 1 -- 172.21.15.47:0/2589469569 shutdown_connections 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.958+0000 7f0179188740 1 --2- 172.21.15.47:0/2589469569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955315d0 0x55d7955339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.958+0000 7f0179188740 1 --2- 172.21.15.47:0/2589469569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955257a0 0x55d795525bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.958+0000 7f0179188740 1 --2- 172.21.15.47:0/2589469569 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d795525260 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.958+0000 7f0179188740 1 -- 172.21.15.47:0/2589469569 >> 172.21.15.47:0/2589469569 conn(0x55d7954ef750 msgr2=0x55d795523090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.958+0000 7f0179188740 1 -- 172.21.15.47:0/2589469569 shutdown_connections 2024-07-24T22:13:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.958+0000 7f0179188740 1 -- 172.21.15.47:0/2589469569 wait complete. 2024-07-24T22:13:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.958+0000 7f0179188740 1 -- start start 2024-07-24T22:13:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0179188740 1 Processor -- start 2024-07-24T22:13:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0179188740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955257a0 0x55d79552e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0179188740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d79552eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0179188740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955315d0 0x55d79552eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0179188740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d7952ee7a0 con 0x55d7955257a0 2024-07-24T22:13:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0179188740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d79542d020 con 0x55d7955315d0 2024-07-24T22:13:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0179188740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d795534490 con 0x55d795526d00 2024-07-24T22:13:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0179188740 10 client.0 _ll_register_callbacks cb 0x55d795198090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0174b73640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955257a0 0x55d79552e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0167fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d79552eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0175374640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955315d0 0x55d79552eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0175374640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955315d0 0x55d79552eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:38748/0 (socket says 172.21.15.47:38748) 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0175374640 1 -- 172.21.15.47:0/3574269632 learned_addr learned my addr 172.21.15.47:0/3574269632 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.959+0000 7f0167fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d79552eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:37764/0 (socket says 172.21.15.47:37764) 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.960+0000 7f0175374640 1 -- 172.21.15.47:0/3574269632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 msgr2=0x55d79552eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.960+0000 7f0175374640 1 --2- 172.21.15.47:0/3574269632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d79552eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.960+0000 7f0175374640 1 -- 172.21.15.47:0/3574269632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955257a0 msgr2=0x55d79552e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.960+0000 7f0175374640 1 --2- 172.21.15.47:0/3574269632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955257a0 0x55d79552e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.960+0000 7f0175374640 1 -- 172.21.15.47:0/3574269632 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7954310d0 con 0x55d7955315d0 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.960+0000 7f0167fff640 1 --2- 172.21.15.47:0/3574269632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d79552eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.960+0000 7f0175374640 1 --2- 172.21.15.47:0/3574269632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955315d0 0x55d79552eff0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0168006010 tx=0x7f016801f830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9728eaffa24be69 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.960+0000 7f014ffff640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:13:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.960+0000 7f014ffff640 1 -- 172.21.15.47:0/3574269632 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016802c070 con 0x55d7955315d0 2024-07-24T22:13:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.960+0000 7f014ffff640 1 -- 172.21.15.47:0/3574269632 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f016801f1d0 con 0x55d7955315d0 2024-07-24T22:13:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.961+0000 7f0179188740 1 -- 172.21.15.47:0/3574269632 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0168004d20 con 0x55d7955315d0 2024-07-24T22:13:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.961+0000 7f014ffff640 1 -- 172.21.15.47:0/3574269632 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0168038050 con 0x55d7955315d0 2024-07-24T22:13:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.961+0000 7f0179188740 10 client.26102 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.961+0000 7f0179188740 1 -- 172.21.15.47:0/3574269632 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d7951fab90 con 0x55d7955315d0 2024-07-24T22:13:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.961+0000 7f014ffff640 1 -- 172.21.15.47:0/3574269632 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0168004d20 con 0x55d7955315d0 2024-07-24T22:13:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.961+0000 7f014ffff640 1 -- 172.21.15.47:0/3574269632 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f016800f040 con 0x55d7955315d0 2024-07-24T22:13:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.961+0000 7f0179188740 10 client.26102 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.961+0000 7f0179188740 10 client.26102 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:13:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.961+0000 7f0179188740 20 client.26102 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.961+0000 7f0179188740 1 --2- 172.21.15.47:0/3574269632 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d795541500 0x55d7955438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.961+0000 7f0179188740 4 client.26102 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:13:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.961+0000 7f0179188740 1 -- 172.21.15.47:0/3574269632 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d79549d5f0 con 0x55d795541500 2024-07-24T22:13:19.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.962+0000 7f0174b73640 1 --2- 172.21.15.47:0/3574269632 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d795541500 0x55d7955438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.962+0000 7f0174b73640 1 --2- 172.21.15.47:0/3574269632 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d795541500 0x55d7955438f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c243b3d2ccafd64 server_cookie=72fb3cf5ccd33f4c in_seq=0 out_seq=0 2024-07-24T22:13:19.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.962+0000 7f014ffff640 10 client.26102 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:19.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f014ffff640 1 -- 172.21.15.47:0/3574269632 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d79549d5f0 con 0x55d795541500 2024-07-24T22:13:19.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f014ffff640 10 client.26102 handle_command_reply: tid=0 2024-07-24T22:13:19.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f0179188740 1 client.26102 shutdown 2024-07-24T22:13:19.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f0179188740 1 -- 172.21.15.47:0/3574269632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955315d0 msgr2=0x55d79552eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:19.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f0179188740 1 --2- 172.21.15.47:0/3574269632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955315d0 0x55d79552eff0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0168006010 tx=0x7f016801f830 comp rx=0 tx=0).stop 2024-07-24T22:13:19.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f0179188740 1 -- 172.21.15.47:0/3574269632 shutdown_connections 2024-07-24T22:13:19.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f0179188740 1 --2- 172.21.15.47:0/3574269632 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d795541500 0x55d7955438f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f0179188740 1 --2- 172.21.15.47:0/3574269632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955315d0 0x55d79552eff0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f0179188740 1 --2- 172.21.15.47:0/3574269632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d79552eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f014ffff640 0 client.26102 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:19.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f0179188740 1 --2- 172.21.15.47:0/3574269632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955257a0 0x55d79552e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f0179188740 1 -- 172.21.15.47:0/3574269632 >> 172.21.15.47:0/3574269632 conn(0x55d7954ef750 msgr2=0x55d795528c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:19.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f0179188740 1 -- 172.21.15.47:0/3574269632 shutdown_connections 2024-07-24T22:13:19.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f0179188740 1 -- 172.21.15.47:0/3574269632 wait complete. 2024-07-24T22:13:19.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.963+0000 7f0179188740 20 client.26102 trim_cache size 0 max 16384 2024-07-24T22:13:19.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0179188740 1 Processor -- start 2024-07-24T22:13:19.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0179188740 1 -- start start 2024-07-24T22:13:19.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0179188740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d7955257a0 0x55d795524fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0179188740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d795526d00 0x55d795528b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0179188740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 0x55d7955490b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0179188740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01701a9ff0 con 0x55d7955315d0 2024-07-24T22:13:19.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0179188740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f01701ac850 con 0x55d795526d00 2024-07-24T22:13:19.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0179188740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f01701aa640 con 0x55d7955257a0 2024-07-24T22:13:19.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0175374640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 0x55d7955490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0174b73640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d7955257a0 0x55d795524fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0175374640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 0x55d7955490b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40030/0 (socket says 172.21.15.47:40030) 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0175374640 1 -- 172.21.15.47:0/1213764237 learned_addr learned my addr 172.21.15.47:0/1213764237 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0167fff640 1 --2- 172.21.15.47:0/1213764237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d795526d00 0x55d795528b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0175374640 1 -- 172.21.15.47:0/1213764237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d7955257a0 msgr2=0x55d795524fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0175374640 1 --2- 172.21.15.47:0/1213764237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d7955257a0 0x55d795524fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0175374640 1 -- 172.21.15.47:0/1213764237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d795526d00 msgr2=0x55d795528b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0175374640 1 --2- 172.21.15.47:0/1213764237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d795526d00 0x55d795528b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0175374640 1 -- 172.21.15.47:0/1213764237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79551e9c0 con 0x55d7955315d0 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0174b73640 1 --2- 172.21.15.47:0/1213764237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d7955257a0 0x55d795524fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.982+0000 7f0167fff640 1 --2- 172.21.15.47:0/1213764237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d795526d00 0x55d795528b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.983+0000 7f0175374640 1 --2- 172.21.15.47:0/1213764237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 0x55d7955490b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0168012510 tx=0x7f0168012880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e053a31fa7ee80 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.983+0000 7f01567fc640 1 -- 172.21.15.47:0/1213764237 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016802c030 con 0x55d7955315d0 2024-07-24T22:13:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.983+0000 7f01567fc640 1 -- 172.21.15.47:0/1213764237 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0168012d60 con 0x55d7955315d0 2024-07-24T22:13:19.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.983+0000 7f01567fc640 1 -- 172.21.15.47:0/1213764237 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168016030 con 0x55d7955315d0 2024-07-24T22:13:19.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.983+0000 7f0179188740 1 -- 172.21.15.47:0/1213764237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 msgr2=0x55d7955490b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:19.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.983+0000 7f0179188740 1 --2- 172.21.15.47:0/1213764237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 0x55d7955490b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0168012510 tx=0x7f0168012880 comp rx=0 tx=0).stop 2024-07-24T22:13:19.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.983+0000 7f0179188740 1 -- 172.21.15.47:0/1213764237 shutdown_connections 2024-07-24T22:13:19.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 --2- 172.21.15.47:0/1213764237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 0x55d7955490b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 --2- 172.21.15.47:0/1213764237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d795526d00 0x55d795528b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 --2- 172.21.15.47:0/1213764237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d7955257a0 0x55d795524fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 -- 172.21.15.47:0/1213764237 >> 172.21.15.47:0/1213764237 conn(0x55d7954ef750 msgr2=0x55d795528410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:19.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 -- 172.21.15.47:0/1213764237 shutdown_connections 2024-07-24T22:13:19.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 -- 172.21.15.47:0/1213764237 wait complete. 2024-07-24T22:13:19.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 -- start start 2024-07-24T22:13:19.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 Processor -- start 2024-07-24T22:13:19.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955257a0 0x55d795539f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d795548c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 0x55d795549300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01701aad10 con 0x55d7955315d0 2024-07-24T22:13:19.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f01701ac180 con 0x55d7955257a0 2024-07-24T22:13:19.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.984+0000 7f0179188740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f01701ab3e0 con 0x55d795526d00 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0179188740 10 client.0 _ll_register_callbacks cb 0x7f0168009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0175374640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 0x55d795549300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0175374640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 0x55d795549300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40042/0 (socket says 172.21.15.47:40042) 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0175374640 1 -- 172.21.15.47:0/3340925827 learned_addr learned my addr 172.21.15.47:0/3340925827 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0174b73640 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955257a0 0x55d795539f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0167fff640 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d795548c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0175374640 1 -- 172.21.15.47:0/3340925827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 msgr2=0x55d795548c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0175374640 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d795548c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0175374640 1 -- 172.21.15.47:0/3340925827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955257a0 msgr2=0x55d795539f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0175374640 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955257a0 0x55d795539f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0175374640 1 -- 172.21.15.47:0/3340925827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d795538b70 con 0x55d7955315d0 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0174b73640 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955257a0 0x55d795539f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0175374640 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 0x55d795549300 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0168005f40 tx=0x7f0168009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8719ed2351d9cb3d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:19.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f014ffff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f014ffff640 1 -- 172.21.15.47:0/3340925827 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168016040 con 0x55d7955315d0 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f014ffff640 1 -- 172.21.15.47:0/3340925827 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f0168028850 con 0x55d7955315d0 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.985+0000 7f0179188740 1 -- 172.21.15.47:0/3340925827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0168012d60 con 0x55d7955315d0 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.986+0000 7f014ffff640 1 -- 172.21.15.47:0/3340925827 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f016804a050 con 0x55d7955315d0 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.986+0000 7f0179188740 10 client.16794 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.986+0000 7f0179188740 1 -- 172.21.15.47:0/3340925827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d7955ac260 con 0x55d7955315d0 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.986+0000 7f014ffff640 1 -- 172.21.15.47:0/3340925827 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0168012d60 con 0x55d7955315d0 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.986+0000 7f014ffff640 1 -- 172.21.15.47:0/3340925827 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f016801f5d0 con 0x55d7955315d0 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.986+0000 7f0179188740 10 client.16794 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.986+0000 7f0179188740 10 client.16794 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.986+0000 7f0179188740 20 client.16794 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.986+0000 7f0179188740 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d7955ac910 0x55d7955aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.986+0000 7f0179188740 4 client.16794 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-07-24T22:13:19.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.986+0000 7f0179188740 1 -- 172.21.15.47:0/3340925827 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55d795499090 con 0x55d7955ac910 2024-07-24T22:13:19.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.986+0000 7f0174b73640 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d7955ac910 0x55d7955aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:19.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.987+0000 7f0174b73640 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d7955ac910 0x55d7955aed30 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5afc047243214486 server_cookie=26fd3b19da71cd29 in_seq=0 out_seq=0 2024-07-24T22:13:19.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:19.987+0000 7f014ffff640 10 client.16794 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:21.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:21 smithi188 ceph-mon[37380]: pgmap v552: 97 pgs: 97 active+clean; 50 GiB data, 154 GiB used, 919 GiB / 1.0 TiB avail; 31 KiB/s rd, 203 MiB/s wr, 1.19k op/s 2024-07-24T22:13:21.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:21 smithi183 ceph-mon[37007]: pgmap v552: 97 pgs: 97 active+clean; 50 GiB data, 154 GiB used, 919 GiB / 1.0 TiB avail; 31 KiB/s rd, 203 MiB/s wr, 1.19k op/s 2024-07-24T22:13:21.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:21 smithi047 ceph-mon[32551]: pgmap v552: 97 pgs: 97 active+clean; 50 GiB data, 154 GiB used, 919 GiB / 1.0 TiB avail; 31 KiB/s rd, 203 MiB/s wr, 1.19k op/s 2024-07-24T22:13:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.683+0000 7f6953c47640 1 -- 172.21.15.47:0/3400658851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f694c107950 msgr2=0x7f694c10e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.683+0000 7f6953c47640 1 --2- 172.21.15.47:0/3400658851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f694c107950 0x7f694c10e150 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6944009ca0 tx=0x7f694402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.683+0000 7f6953c47640 1 -- 172.21.15.47:0/3400658851 shutdown_connections 2024-07-24T22:13:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.683+0000 7f6953c47640 1 --2- 172.21.15.47:0/3400658851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f694c107950 0x7f694c10e150 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.683+0000 7f6953c47640 1 --2- 172.21.15.47:0/3400658851 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f694c106fd0 0x7f694c107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.683+0000 7f6953c47640 1 --2- 172.21.15.47:0/3400658851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f694c1015d0 0x7f694c1019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.683+0000 7f6953c47640 1 -- 172.21.15.47:0/3400658851 >> 172.21.15.47:0/3400658851 conn(0x7f694c0fd030 msgr2=0x7f694c0ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.683+0000 7f6953c47640 1 -- 172.21.15.47:0/3400658851 shutdown_connections 2024-07-24T22:13:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.683+0000 7f6953c47640 1 -- 172.21.15.47:0/3400658851 wait complete. 2024-07-24T22:13:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.684+0000 7f6953c47640 1 Processor -- start 2024-07-24T22:13:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.684+0000 7f6953c47640 1 -- start start 2024-07-24T22:13:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.684+0000 7f6953c47640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f694c1015d0 0x7f694c19adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.684+0000 7f6953c47640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f694c106fd0 0x7f694c19b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.684+0000 7f6953c47640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f694c107950 0x7f694c1a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.684+0000 7f6953c47640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f694c114920 con 0x7f694c107950 2024-07-24T22:13:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.684+0000 7f6953c47640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f694c1147a0 con 0x7f694c1015d0 2024-07-24T22:13:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.684+0000 7f6953c47640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f694c114aa0 con 0x7f694c106fd0 2024-07-24T22:13:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f69521e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f694c107950 0x7f694c1a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f69521e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f694c107950 0x7f694c1a0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40060/0 (socket says 172.21.15.47:40060) 2024-07-24T22:13:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f69521e4640 1 -- 172.21.15.47:0/1219925298 learned_addr learned my addr 172.21.15.47:0/1219925298 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f69519e3640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f694c1015d0 0x7f694c19adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f69511e2640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f694c106fd0 0x7f694c19b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f69521e4640 1 -- 172.21.15.47:0/1219925298 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f694c106fd0 msgr2=0x7f694c19b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f69521e4640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f694c106fd0 0x7f694c19b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f69521e4640 1 -- 172.21.15.47:0/1219925298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f694c1015d0 msgr2=0x7f694c19adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f69521e4640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f694c1015d0 0x7f694c19adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f69521e4640 1 -- 172.21.15.47:0/1219925298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694c1a0e60 con 0x7f694c107950 2024-07-24T22:13:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f69519e3640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f694c1015d0 0x7f694c19adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f69521e4640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f694c107950 0x7f694c1a0690 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f69440098d0 tx=0x7f69440317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f6942ffd640 1 -- 172.21.15.47:0/1219925298 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944003b70 con 0x7f694c107950 2024-07-24T22:13:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f6953c47640 1 -- 172.21.15.47:0/1219925298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f694c1a10f0 con 0x7f694c107950 2024-07-24T22:13:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f6942ffd640 1 -- 172.21.15.47:0/1219925298 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6944003d10 con 0x7f694c107950 2024-07-24T22:13:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f6942ffd640 1 -- 172.21.15.47:0/1219925298 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694402fa20 con 0x7f694c107950 2024-07-24T22:13:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.685+0000 7f6953c47640 1 -- 172.21.15.47:0/1219925298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f694c1a7890 con 0x7f694c107950 2024-07-24T22:13:22.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.688+0000 7f6942ffd640 1 -- 172.21.15.47:0/1219925298 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f694402fc20 con 0x7f694c107950 2024-07-24T22:13:22.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.688+0000 7f6956995740 1 Processor -- start 2024-07-24T22:13:22.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f6956995740 1 -- start start 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f6956995740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 0x5582ad555ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f6956995740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad5561e0 0x5582ad561c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f6956995740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 0x5582ad564560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f6956995740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5582ad4cb280 con 0x5582ad562170 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f6956995740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5582ad4ba780 con 0x5582ad5558c0 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f6956995740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5582ad4be7c0 con 0x5582ad5561e0 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f69511e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 0x5582ad564560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f69511e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 0x5582ad564560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40064/0 (socket says 172.21.15.47:40064) 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f69511e2640 1 -- 172.21.15.47:0/2656796595 learned_addr learned my addr 172.21.15.47:0/2656796595 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f69511e2640 1 --2- 172.21.15.47:0/2656796595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 0x5582ad555ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f69519e3640 1 --2- 172.21.15.47:0/2656796595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad5561e0 0x5582ad561c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f69511e2640 1 -- 172.21.15.47:0/2656796595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad5561e0 msgr2=0x5582ad561c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f69511e2640 1 --2- 172.21.15.47:0/2656796595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad5561e0 0x5582ad561c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f69511e2640 1 -- 172.21.15.47:0/2656796595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 msgr2=0x5582ad555ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:22.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f69511e2640 1 --2- 172.21.15.47:0/2656796595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 0x5582ad555ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.689+0000 7f69511e2640 1 -- 172.21.15.47:0/2656796595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582ad21e790 con 0x5582ad562170 2024-07-24T22:13:22.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.690+0000 7f6942ffd640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69380b3d30 0x7f69380b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.690+0000 7f69511e2640 1 --2- 172.21.15.47:0/2656796595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 0x5582ad564560 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f693c016530 tx=0x7f693c00a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330a2729f2fa87cb server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:22.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.690+0000 7f69519e3640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69380b3d30 0x7f69380b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.690+0000 7f6942ffd640 1 -- 172.21.15.47:0/1219925298 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f6944105430 con 0x7f694c107950 2024-07-24T22:13:22.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.690+0000 7f6937fff640 1 -- 172.21.15.47:0/2656796595 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c018430 con 0x5582ad562170 2024-07-24T22:13:22.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.690+0000 7f6937fff640 1 -- 172.21.15.47:0/2656796595 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f693c018a80 con 0x5582ad562170 2024-07-24T22:13:22.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.690+0000 7f6937fff640 1 -- 172.21.15.47:0/2656796595 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c014890 con 0x5582ad562170 2024-07-24T22:13:22.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.691+0000 7f6956995740 1 -- 172.21.15.47:0/2656796595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 msgr2=0x5582ad564560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:22.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.691+0000 7f69519e3640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69380b3d30 0x7f69380b61f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5582ad558a40 tx=0x7f6948005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.691+0000 7f6956995740 1 --2- 172.21.15.47:0/2656796595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 0x5582ad564560 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f693c016530 tx=0x7f693c00a2b0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.691+0000 7f6956995740 1 -- 172.21.15.47:0/2656796595 shutdown_connections 2024-07-24T22:13:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.691+0000 7f6956995740 1 --2- 172.21.15.47:0/2656796595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 0x5582ad564560 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.691+0000 7f6956995740 1 --2- 172.21.15.47:0/2656796595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad5561e0 0x5582ad561c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.691+0000 7f6956995740 1 --2- 172.21.15.47:0/2656796595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 0x5582ad555ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.691+0000 7f6956995740 1 -- 172.21.15.47:0/2656796595 >> 172.21.15.47:0/2656796595 conn(0x5582ad5536f0 msgr2=0x5582ad554890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.691+0000 7f6956995740 1 -- 172.21.15.47:0/2656796595 shutdown_connections 2024-07-24T22:13:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.691+0000 7f6956995740 1 -- 172.21.15.47:0/2656796595 wait complete. 2024-07-24T22:13:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.691+0000 7f6956995740 1 -- start start 2024-07-24T22:13:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.691+0000 7f6956995740 1 Processor -- start 2024-07-24T22:13:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f6956995740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 0x5582ad5618b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f6956995740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 0x5582ad55ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f6956995740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad562170 0x5582ad55f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f6956995740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5582ad3f4ab0 con 0x5582ad5561e0 2024-07-24T22:13:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f6956995740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5582ad4429e0 con 0x5582ad5558c0 2024-07-24T22:13:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f6956995740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5582ad564d90 con 0x5582ad562170 2024-07-24T22:13:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f6956995740 10 client.0 _ll_register_callbacks cb 0x5582ad1caa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f69511e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 0x5582ad55ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f69511e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 0x5582ad55ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40072/0 (socket says 172.21.15.47:40072) 2024-07-24T22:13:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f69511e2640 1 -- 172.21.15.47:0/3946135157 learned_addr learned my addr 172.21.15.47:0/3946135157 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f69519e3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 0x5582ad5618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f69521e4640 1 --2- 172.21.15.47:0/3946135157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad562170 0x5582ad55f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f69511e2640 1 -- 172.21.15.47:0/3946135157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad562170 msgr2=0x5582ad55f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f69511e2640 1 --2- 172.21.15.47:0/3946135157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad562170 0x5582ad55f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f69511e2640 1 -- 172.21.15.47:0/3946135157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 msgr2=0x5582ad5618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f69511e2640 1 --2- 172.21.15.47:0/3946135157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 0x5582ad5618b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f69511e2640 1 -- 172.21.15.47:0/3946135157 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582ad297620 con 0x5582ad5561e0 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.692+0000 7f69519e3640 1 --2- 172.21.15.47:0/3946135157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 0x5582ad5618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.693+0000 7f69511e2640 1 --2- 172.21.15.47:0/3946135157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 0x5582ad55ed90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f693c004700 tx=0x7f693c014d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce3db5c331e7fff server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.693+0000 7f69357fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.693+0000 7f69357fa640 1 -- 172.21.15.47:0/3946135157 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c018840 con 0x5582ad5561e0 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.693+0000 7f69357fa640 1 -- 172.21.15.47:0/3946135157 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f693c0189e0 con 0x5582ad5561e0 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.693+0000 7f6956995740 1 -- 172.21.15.47:0/3946135157 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5582ad469ce0 con 0x5582ad5561e0 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.693+0000 7f69357fa640 1 -- 172.21.15.47:0/3946135157 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f693c018be0 con 0x5582ad5561e0 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.693+0000 7f6956995740 10 client.16806 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.693+0000 7f6956995740 1 -- 172.21.15.47:0/3946135157 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5582ad570510 con 0x5582ad5561e0 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.693+0000 7f69357fa640 1 -- 172.21.15.47:0/3946135157 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5582ad469ce0 con 0x5582ad5561e0 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.693+0000 7f69357fa640 1 -- 172.21.15.47:0/3946135157 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f693c021070 con 0x5582ad5561e0 2024-07-24T22:13:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.694+0000 7f6956995740 10 client.16806 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.694+0000 7f6956995740 10 client.16806 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.694+0000 7f6956995740 20 client.16806 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.694+0000 7f6956995740 1 --2- 172.21.15.47:0/3946135157 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582ad571910 0x5582ad573d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.694+0000 7f6956995740 4 client.16806 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:13:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.694+0000 7f6956995740 1 -- 172.21.15.47:0/3946135157 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582ad4cd1d0 con 0x5582ad571910 2024-07-24T22:13:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.694+0000 7f69519e3640 1 --2- 172.21.15.47:0/3946135157 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582ad571910 0x5582ad573d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.694+0000 7f69519e3640 1 --2- 172.21.15.47:0/3946135157 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582ad571910 0x5582ad573d00 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f86d72efd17922a server_cookie=72566a47455f0cb2 in_seq=0 out_seq=0 2024-07-24T22:13:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.694+0000 7f69357fa640 10 client.16806 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.695+0000 7f69357fa640 1 -- 172.21.15.47:0/3946135157 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582ad4cd1d0 con 0x5582ad571910 2024-07-24T22:13:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.695+0000 7f69357fa640 10 client.16806 handle_command_reply: tid=0 2024-07-24T22:13:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.695+0000 7f6956995740 1 client.16806 shutdown 2024-07-24T22:13:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.695+0000 7f6956995740 1 -- 172.21.15.47:0/3946135157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 msgr2=0x5582ad55ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.695+0000 7f6956995740 1 --2- 172.21.15.47:0/3946135157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 0x5582ad55ed90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f693c004700 tx=0x7f693c014d20 comp rx=0 tx=0).stop 2024-07-24T22:13:22.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.695+0000 7f6956995740 1 -- 172.21.15.47:0/3946135157 shutdown_connections 2024-07-24T22:13:22.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.695+0000 7f6956995740 1 --2- 172.21.15.47:0/3946135157 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582ad571910 0x5582ad573d00 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.695+0000 7f6956995740 1 --2- 172.21.15.47:0/3946135157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad562170 0x5582ad55f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.695+0000 7f6956995740 1 --2- 172.21.15.47:0/3946135157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 0x5582ad55ed90 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.695+0000 7f69357fa640 0 client.16806 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:22.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.695+0000 7f6956995740 1 --2- 172.21.15.47:0/3946135157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 0x5582ad5618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.695+0000 7f6956995740 1 -- 172.21.15.47:0/3946135157 >> 172.21.15.47:0/3946135157 conn(0x5582ad5536f0 msgr2=0x5582ad559290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:22.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.695+0000 7f6956995740 1 -- 172.21.15.47:0/3946135157 shutdown_connections 2024-07-24T22:13:22.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.696+0000 7f6956995740 1 -- 172.21.15.47:0/3946135157 wait complete. 2024-07-24T22:13:22.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.696+0000 7f6956995740 20 client.16806 trim_cache size 0 max 16384 2024-07-24T22:13:22.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.711+0000 7f6956995740 1 Processor -- start 2024-07-24T22:13:22.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.711+0000 7f6956995740 1 -- start start 2024-07-24T22:13:22.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.711+0000 7f6956995740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 0x5582ad554740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.711+0000 7f6956995740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 0x5582ad554c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.711+0000 7f6956995740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad562170 0x5582ad5792a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.711+0000 7f6956995740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f694c1ae3a0 con 0x5582ad5561e0 2024-07-24T22:13:22.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.711+0000 7f6956995740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f694c1b0c00 con 0x5582ad5558c0 2024-07-24T22:13:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.711+0000 7f6956995740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f694c1ae9f0 con 0x5582ad562170 2024-07-24T22:13:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.711+0000 7f69511e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 0x5582ad554c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.711+0000 7f69511e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 0x5582ad554c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40080/0 (socket says 172.21.15.47:40080) 2024-07-24T22:13:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.711+0000 7f69511e2640 1 -- 172.21.15.47:0/613937050 learned_addr learned my addr 172.21.15.47:0/613937050 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.711+0000 7f69519e3640 1 --2- 172.21.15.47:0/613937050 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 0x5582ad554740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.712+0000 7f69521e4640 1 --2- 172.21.15.47:0/613937050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad562170 0x5582ad5792a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.712+0000 7f69511e2640 1 -- 172.21.15.47:0/613937050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad562170 msgr2=0x5582ad5792a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.712+0000 7f69511e2640 1 --2- 172.21.15.47:0/613937050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad562170 0x5582ad5792a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.712+0000 7f69511e2640 1 -- 172.21.15.47:0/613937050 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 msgr2=0x5582ad554740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.712+0000 7f69511e2640 1 --2- 172.21.15.47:0/613937050 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 0x5582ad554740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.712+0000 7f69511e2640 1 -- 172.21.15.47:0/613937050 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582ad574070 con 0x5582ad5561e0 2024-07-24T22:13:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.712+0000 7f69521e4640 1 --2- 172.21.15.47:0/613937050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad562170 0x5582ad5792a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.712+0000 7f69511e2640 1 --2- 172.21.15.47:0/613937050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 0x5582ad554c80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f693c007ef0 tx=0x7f693c016f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6571ac967e322e7 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.712+0000 7f69377fe640 1 -- 172.21.15.47:0/613937050 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c018d80 con 0x5582ad5561e0 2024-07-24T22:13:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.712+0000 7f69377fe640 1 -- 172.21.15.47:0/613937050 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f693c027070 con 0x5582ad5561e0 2024-07-24T22:13:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.712+0000 7f69377fe640 1 -- 172.21.15.47:0/613937050 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c0059c0 con 0x5582ad5561e0 2024-07-24T22:13:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.713+0000 7f6956995740 1 -- 172.21.15.47:0/613937050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 msgr2=0x5582ad554c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.713+0000 7f6956995740 1 --2- 172.21.15.47:0/613937050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 0x5582ad554c80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f693c007ef0 tx=0x7f693c016f70 comp rx=0 tx=0).stop 2024-07-24T22:13:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.713+0000 7f6956995740 1 -- 172.21.15.47:0/613937050 shutdown_connections 2024-07-24T22:13:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.713+0000 7f6956995740 1 --2- 172.21.15.47:0/613937050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad562170 0x5582ad5792a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.713+0000 7f6956995740 1 --2- 172.21.15.47:0/613937050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad5561e0 0x5582ad554c80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.713+0000 7f6956995740 1 --2- 172.21.15.47:0/613937050 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5558c0 0x5582ad554740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.713+0000 7f6956995740 1 -- 172.21.15.47:0/613937050 >> 172.21.15.47:0/613937050 conn(0x5582ad5536f0 msgr2=0x5582ad55ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.713+0000 7f6956995740 1 -- 172.21.15.47:0/613937050 shutdown_connections 2024-07-24T22:13:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.713+0000 7f6956995740 1 -- 172.21.15.47:0/613937050 wait complete. 2024-07-24T22:13:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.713+0000 7f6956995740 1 -- start start 2024-07-24T22:13:22.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.713+0000 7f6956995740 1 Processor -- start 2024-07-24T22:13:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f6956995740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad5558c0 0x5582ad567080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f6956995740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5561e0 0x5582ad5675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f6956995740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 0x5582ad567b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f6956995740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f694c1af0c0 con 0x5582ad562170 2024-07-24T22:13:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f6956995740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f694c1b0530 con 0x5582ad5561e0 2024-07-24T22:13:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f6956995740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f694c1af790 con 0x5582ad5558c0 2024-07-24T22:13:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f6956995740 10 client.0 _ll_register_callbacks cb 0x7f693c00ac00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69521e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 0x5582ad567b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69521e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 0x5582ad567b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40092/0 (socket says 172.21.15.47:40092) 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69521e4640 1 -- 172.21.15.47:0/1395540191 learned_addr learned my addr 172.21.15.47:0/1395540191 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69519e3640 1 --2- 172.21.15.47:0/1395540191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad5558c0 0x5582ad567080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69511e2640 1 --2- 172.21.15.47:0/1395540191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5561e0 0x5582ad5675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69521e4640 1 -- 172.21.15.47:0/1395540191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad5558c0 msgr2=0x5582ad567080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69521e4640 1 --2- 172.21.15.47:0/1395540191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad5558c0 0x5582ad567080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69521e4640 1 -- 172.21.15.47:0/1395540191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5561e0 msgr2=0x5582ad5675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69521e4640 1 --2- 172.21.15.47:0/1395540191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5561e0 0x5582ad5675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69521e4640 1 -- 172.21.15.47:0/1395540191 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582ad5da4c0 con 0x5582ad562170 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69521e4640 1 --2- 172.21.15.47:0/1395540191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 0x5582ad567b00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f69440cc0b0 tx=0x7f69440cbff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec61c4c45bf732e8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69357fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69357fa640 1 -- 172.21.15.47:0/1395540191 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69440e5070 con 0x5582ad562170 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69357fa640 1 -- 172.21.15.47:0/1395540191 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f69440cc590 con 0x5582ad562170 2024-07-24T22:13:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f6956995740 1 -- 172.21.15.47:0/1395540191 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f693c027070 con 0x5582ad562170 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f69357fa640 1 -- 172.21.15.47:0/1395540191 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f69440cc820 con 0x5582ad562170 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.714+0000 7f6956995740 10 client.16812 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.715+0000 7f6956995740 1 -- 172.21.15.47:0/1395540191 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5582ad5db830 con 0x5582ad562170 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.715+0000 7f69357fa640 1 -- 172.21.15.47:0/1395540191 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f693c027070 con 0x5582ad562170 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.715+0000 7f69357fa640 1 -- 172.21.15.47:0/1395540191 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f69440d4d40 con 0x5582ad562170 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.715+0000 7f6956995740 10 client.16812 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.715+0000 7f6956995740 10 client.16812 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.715+0000 7f6956995740 20 client.16812 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.715+0000 7f6956995740 1 --2- 172.21.15.47:0/1395540191 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582ad5dbf80 0x5582ad5de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.715+0000 7f6956995740 4 client.16812 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.715+0000 7f6956995740 1 -- 172.21.15.47:0/1395540191 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5582ad4c8c70 con 0x5582ad5dbf80 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.715+0000 7f69519e3640 1 --2- 172.21.15.47:0/1395540191 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582ad5dbf80 0x5582ad5de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.716+0000 7f69519e3640 1 --2- 172.21.15.47:0/1395540191 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582ad5dbf80 0x5582ad5de3a0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=936ea235bafee862 server_cookie=bf4b263ac04c92d in_seq=0 out_seq=0 2024-07-24T22:13:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.716+0000 7f69357fa640 10 client.16812 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.901+0000 7f69357fa640 1 -- 172.21.15.47:0/1395540191 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5582ad4c8c70 con 0x5582ad5dbf80 2024-07-24T22:13:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.901+0000 7f69357fa640 10 client.16812 handle_command_reply: tid=0 2024-07-24T22:13:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.901+0000 7f6956995740 1 client.16812 shutdown 2024-07-24T22:13:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.902+0000 7f6956995740 1 -- 172.21.15.47:0/1395540191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 msgr2=0x5582ad567b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.902+0000 7f6956995740 1 --2- 172.21.15.47:0/1395540191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 0x5582ad567b00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f69440cc0b0 tx=0x7f69440cbff0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.902+0000 7f6956995740 1 -- 172.21.15.47:0/1395540191 shutdown_connections 2024-07-24T22:13:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.902+0000 7f6956995740 1 --2- 172.21.15.47:0/1395540191 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582ad5dbf80 0x5582ad5de3a0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.902+0000 7f6956995740 1 --2- 172.21.15.47:0/1395540191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582ad562170 0x5582ad567b00 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.902+0000 7f6956995740 1 --2- 172.21.15.47:0/1395540191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582ad5561e0 0x5582ad5675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.902+0000 7f69357fa640 0 client.16812 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.902+0000 7f6956995740 1 --2- 172.21.15.47:0/1395540191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582ad5558c0 0x5582ad567080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.902+0000 7f6956995740 1 -- 172.21.15.47:0/1395540191 >> 172.21.15.47:0/1395540191 conn(0x5582ad5536f0 msgr2=0x5582ad554740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.902+0000 7f6956995740 1 -- 172.21.15.47:0/1395540191 shutdown_connections 2024-07-24T22:13:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.902+0000 7f6956995740 1 -- 172.21.15.47:0/1395540191 wait complete. 2024-07-24T22:13:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.902+0000 7f6956995740 20 client.16812 trim_cache size 0 max 16384 2024-07-24T22:13:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:13:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:13:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:13:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:13:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.903+0000 7f6953c47640 1 -- 172.21.15.47:0/1219925298 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69380b3d30 msgr2=0x7f69380b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.903+0000 7f6953c47640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69380b3d30 0x7f69380b61f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5582ad558a40 tx=0x7f6948005f90 comp rx=0 tx=0).stop 2024-07-24T22:13:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.903+0000 7f6953c47640 1 -- 172.21.15.47:0/1219925298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f694c107950 msgr2=0x7f694c1a0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.903+0000 7f6953c47640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f694c107950 0x7f694c1a0690 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f69440098d0 tx=0x7f69440317b0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.903+0000 7f6953c47640 1 -- 172.21.15.47:0/1219925298 shutdown_connections 2024-07-24T22:13:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.903+0000 7f6953c47640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f69380b3d30 0x7f69380b61f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.903+0000 7f6953c47640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f694c107950 0x7f694c1a0690 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.903+0000 7f6953c47640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f694c106fd0 0x7f694c19b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.903+0000 7f6953c47640 1 --2- 172.21.15.47:0/1219925298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f694c1015d0 0x7f694c19adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.903+0000 7f6953c47640 1 -- 172.21.15.47:0/1219925298 >> 172.21.15.47:0/1219925298 conn(0x7f694c0fd030 msgr2=0x7f694c0ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.903+0000 7f6953c47640 1 -- 172.21.15.47:0/1219925298 shutdown_connections 2024-07-24T22:13:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:22.903+0000 7f6953c47640 1 -- 172.21.15.47:0/1219925298 wait complete. 2024-07-24T22:13:23.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:23 smithi188 ceph-mon[37380]: pgmap v553: 97 pgs: 97 active+clean; 50 GiB data, 154 GiB used, 919 GiB / 1.0 TiB avail; 31 KiB/s rd, 227 MiB/s wr, 1.44k op/s 2024-07-24T22:13:23.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:23 smithi183 ceph-mon[37007]: pgmap v553: 97 pgs: 97 active+clean; 50 GiB data, 154 GiB used, 919 GiB / 1.0 TiB avail; 31 KiB/s rd, 227 MiB/s wr, 1.44k op/s 2024-07-24T22:13:23.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:23 smithi047 ceph-mon[32551]: pgmap v553: 97 pgs: 97 active+clean; 50 GiB data, 154 GiB used, 919 GiB / 1.0 TiB avail; 31 KiB/s rd, 227 MiB/s wr, 1.44k op/s 2024-07-24T22:13:25.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f014ffff640 1 -- 172.21.15.47:0/3340925827 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d795499090 con 0x55d7955ac910 2024-07-24T22:13:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f014ffff640 10 client.16794 handle_command_reply: tid=0 2024-07-24T22:13:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f0179188740 1 client.16794 shutdown 2024-07-24T22:13:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f0179188740 1 -- 172.21.15.47:0/3340925827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 msgr2=0x55d795549300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f0179188740 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 0x55d795549300 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0168005f40 tx=0x7f0168009640 comp rx=0 tx=0).stop 2024-07-24T22:13:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f0179188740 1 -- 172.21.15.47:0/3340925827 shutdown_connections 2024-07-24T22:13:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f0179188740 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d7955ac910 0x55d7955aed30 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f0179188740 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d7955315d0 0x55d795549300 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f0179188740 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d795526d00 0x55d795548c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f014ffff640 0 client.16794 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f0179188740 1 --2- 172.21.15.47:0/3340925827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d7955257a0 0x55d795539f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f0179188740 1 -- 172.21.15.47:0/3340925827 >> 172.21.15.47:0/3340925827 conn(0x55d7954ef750 msgr2=0x55d795527a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:25.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f0179188740 1 -- 172.21.15.47:0/3340925827 shutdown_connections 2024-07-24T22:13:25.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f0179188740 1 -- 172.21.15.47:0/3340925827 wait complete. 2024-07-24T22:13:25.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.343+0000 7f0179188740 20 client.16794 trim_cache size 0 max 16384 2024-07-24T22:13:25.347 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:13:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:13:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:13:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 18, 2024-07-24T22:13:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:13:25.347 INFO:teuthology.orchestra.run.smithi047.stdout: "ca65092d": { 2024-07-24T22:13:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 18, 2024-07-24T22:13:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:13:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:13:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:13:25.348 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:13:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:13:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:13:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 150.0, 2024-07-24T22:13:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:13:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:13:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:13:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:13:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:13:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:13:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:13:25.349 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:13:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:13:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:13:25.350 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:13:25.350 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:13:25.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.344+0000 7f0176dd7640 1 -- 172.21.15.47:0/1391839911 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f01580b3d40 msgr2=0x7f01580b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:25.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.344+0000 7f0176dd7640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f01580b3d40 0x7f01580b6200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55d7955283e0 tx=0x7f016c005f90 comp rx=0 tx=0).stop 2024-07-24T22:13:25.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.344+0000 7f0176dd7640 1 -- 172.21.15.47:0/1391839911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0170106810 msgr2=0x7f01701991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:25.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.344+0000 7f0176dd7640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0170106810 0x7f01701991c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0160005940 tx=0x7f0160004270 comp rx=0 tx=0).stop 2024-07-24T22:13:25.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.344+0000 7f0176dd7640 1 -- 172.21.15.47:0/1391839911 shutdown_connections 2024-07-24T22:13:25.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.344+0000 7f0176dd7640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f01580b3d40 0x7f01580b6200 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:25.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.344+0000 7f0176dd7640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0170107190 0x7f017019e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:25.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.344+0000 7f0176dd7640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0170106810 0x7f01701991c0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:25.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.344+0000 7f0176dd7640 1 --2- 172.21.15.47:0/1391839911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01701011e0 0x7f0170198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:25.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.344+0000 7f0176dd7640 1 -- 172.21.15.47:0/1391839911 >> 172.21.15.47:0/1391839911 conn(0x7f0170076940 msgr2=0x7f017010e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:25.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.344+0000 7f0176dd7640 1 -- 172.21.15.47:0/1391839911 shutdown_connections 2024-07-24T22:13:25.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:25.344+0000 7f0176dd7640 1 -- 172.21.15.47:0/1391839911 wait complete. 2024-07-24T22:13:25.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:25 smithi047 ceph-mon[32551]: pgmap v554: 97 pgs: 97 active+clean; 50 GiB data, 153 GiB used, 920 GiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 1.71k op/s 2024-07-24T22:13:25.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:25 smithi188 ceph-mon[37380]: pgmap v554: 97 pgs: 97 active+clean; 50 GiB data, 153 GiB used, 920 GiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 1.71k op/s 2024-07-24T22:13:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:25 smithi183 ceph-mon[37007]: pgmap v554: 97 pgs: 97 active+clean; 50 GiB data, 153 GiB used, 920 GiB / 1.0 TiB avail; 11 KiB/s rd, 254 MiB/s wr, 1.71k op/s 2024-07-24T22:13:26.087 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ca65092d', quiesce took 12.6 seconds. Will release after: 17.4 2024-07-24T22:13:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:27 smithi188 ceph-mon[37380]: pgmap v555: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 920 GiB / 1.0 TiB avail; 11 KiB/s rd, 258 MiB/s wr, 1.77k op/s 2024-07-24T22:13:27.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:27 smithi183 ceph-mon[37007]: pgmap v555: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 920 GiB / 1.0 TiB avail; 11 KiB/s rd, 258 MiB/s wr, 1.77k op/s 2024-07-24T22:13:27.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:27 smithi047 ceph-mon[32551]: pgmap v555: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 920 GiB / 1.0 TiB avail; 11 KiB/s rd, 258 MiB/s wr, 1.77k op/s 2024-07-24T22:13:29.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:29 smithi188 ceph-mon[37380]: pgmap v556: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 22 KiB/s rd, 210 MiB/s wr, 1.51k op/s 2024-07-24T22:13:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:29 smithi183 ceph-mon[37007]: pgmap v556: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 22 KiB/s rd, 210 MiB/s wr, 1.51k op/s 2024-07-24T22:13:29.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:29 smithi047 ceph-mon[32551]: pgmap v556: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 22 KiB/s rd, 210 MiB/s wr, 1.51k op/s 2024-07-24T22:13:31.714 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:31 smithi183 ceph-mon[37007]: pgmap v557: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 19 KiB/s rd, 128 MiB/s wr, 968 op/s 2024-07-24T22:13:31.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:31 smithi188 ceph-mon[37380]: pgmap v557: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 19 KiB/s rd, 128 MiB/s wr, 968 op/s 2024-07-24T22:13:31.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:31 smithi047 ceph-mon[32551]: pgmap v557: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 19 KiB/s rd, 128 MiB/s wr, 968 op/s 2024-07-24T22:13:33.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:33 smithi188 ceph-mon[37380]: pgmap v558: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 23 KiB/s rd, 85 MiB/s wr, 662 op/s 2024-07-24T22:13:33.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:33 smithi183 ceph-mon[37007]: pgmap v558: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 23 KiB/s rd, 85 MiB/s wr, 662 op/s 2024-07-24T22:13:33.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:33 smithi047 ceph-mon[32551]: pgmap v558: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 23 KiB/s rd, 85 MiB/s wr, 662 op/s 2024-07-24T22:13:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:35 smithi188 ceph-mon[37380]: pgmap v559: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 23 KiB/s rd, 45 MiB/s wr, 384 op/s 2024-07-24T22:13:35.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:35 smithi183 ceph-mon[37007]: pgmap v559: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 23 KiB/s rd, 45 MiB/s wr, 384 op/s 2024-07-24T22:13:35.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:35 smithi047 ceph-mon[32551]: pgmap v559: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 23 KiB/s rd, 45 MiB/s wr, 384 op/s 2024-07-24T22:13:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.011+0000 7faea9104640 1 -- 172.21.15.47:0/395646681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faea41015d0 msgr2=0x7faea41019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.011+0000 7faea9104640 1 --2- 172.21.15.47:0/395646681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faea41015d0 0x7faea41019b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fae94009900 tx=0x7fae9402a410 comp rx=0 tx=0).stop 2024-07-24T22:13:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.011+0000 7faea9104640 1 -- 172.21.15.47:0/395646681 shutdown_connections 2024-07-24T22:13:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.011+0000 7faea9104640 1 --2- 172.21.15.47:0/395646681 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faea4107950 0x7faea410e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.011+0000 7faea9104640 1 --2- 172.21.15.47:0/395646681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faea4106fd0 0x7faea4107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.011+0000 7faea9104640 1 --2- 172.21.15.47:0/395646681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faea41015d0 0x7faea41019b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.011+0000 7faea9104640 1 -- 172.21.15.47:0/395646681 >> 172.21.15.47:0/395646681 conn(0x7faea40fd030 msgr2=0x7faea40ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.011+0000 7faea9104640 1 -- 172.21.15.47:0/395646681 shutdown_connections 2024-07-24T22:13:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.011+0000 7faea9104640 1 -- 172.21.15.47:0/395646681 wait complete. 2024-07-24T22:13:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.012+0000 7faea9104640 1 Processor -- start 2024-07-24T22:13:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.012+0000 7faea9104640 1 -- start start 2024-07-24T22:13:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7faea9104640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faea41015d0 0x7faea4198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7faea9104640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faea4106fd0 0x7faea4199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7faea9104640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faea4107950 0x7faea419e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7faea9104640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faea4112730 con 0x7faea4106fd0 2024-07-24T22:13:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7faea9104640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faea41125b0 con 0x7faea4107950 2024-07-24T22:13:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7faea9104640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faea41128b0 con 0x7faea41015d0 2024-07-24T22:13:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7fae9a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faea4106fd0 0x7faea4199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7fae9a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faea4106fd0 0x7faea4199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33352/0 (socket says 172.21.15.47:33352) 2024-07-24T22:13:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7fae9a59c640 1 -- 172.21.15.47:0/2778684980 learned_addr learned my addr 172.21.15.47:0/2778684980 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7faea2d9d640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faea41015d0 0x7faea4198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7faea359e640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faea4107950 0x7faea419e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7fae9a59c640 1 -- 172.21.15.47:0/2778684980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faea41015d0 msgr2=0x7faea4198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7fae9a59c640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faea41015d0 0x7faea4198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7fae9a59c640 1 -- 172.21.15.47:0/2778684980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faea4107950 msgr2=0x7faea419e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7fae9a59c640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faea4107950 0x7faea419e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7fae9a59c640 1 -- 172.21.15.47:0/2778684980 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea419eb70 con 0x7faea4106fd0 2024-07-24T22:13:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.013+0000 7fae9a59c640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faea4106fd0 0x7faea4199010 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00c920 tx=0x7fae8c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.014+0000 7faea0d99640 1 -- 172.21.15.47:0/2778684980 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c007c70 con 0x7faea4106fd0 2024-07-24T22:13:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.014+0000 7faea0d99640 1 -- 172.21.15.47:0/2778684980 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae8c007e10 con 0x7faea4106fd0 2024-07-24T22:13:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.014+0000 7faea9104640 1 -- 172.21.15.47:0/2778684980 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea419ee60 con 0x7faea4106fd0 2024-07-24T22:13:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.014+0000 7faea0d99640 1 -- 172.21.15.47:0/2778684980 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c018820 con 0x7faea4106fd0 2024-07-24T22:13:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.014+0000 7faea9104640 1 -- 172.21.15.47:0/2778684980 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea41a5520 con 0x7faea4106fd0 2024-07-24T22:13:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.016+0000 7faeabe58740 1 Processor -- start 2024-07-24T22:13:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.016+0000 7faeabe58740 1 -- start start 2024-07-24T22:13:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.016+0000 7faea0d99640 1 -- 172.21.15.47:0/2778684980 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fae8c00f450 con 0x7faea4106fd0 2024-07-24T22:13:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7faeabe58740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977c8c0 0x55b6c977cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7faeabe58740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977d1e0 0x55b6c9788c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7faeabe58740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c978b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7faeabe58740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b6c96f2280 con 0x55b6c9789170 2024-07-24T22:13:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7faeabe58740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b6c96e1780 con 0x55b6c977d1e0 2024-07-24T22:13:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7faeabe58740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b6c96e57c0 con 0x55b6c977c8c0 2024-07-24T22:13:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7fae9a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c978b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7fae9a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c978b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33364/0 (socket says 172.21.15.47:33364) 2024-07-24T22:13:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7fae9a59c640 1 -- 172.21.15.47:0/394751539 learned_addr learned my addr 172.21.15.47:0/394751539 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7faea2d9d640 1 --2- 172.21.15.47:0/394751539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977d1e0 0x55b6c9788c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7faea359e640 1 --2- 172.21.15.47:0/394751539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977c8c0 0x55b6c977cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7fae9a59c640 1 -- 172.21.15.47:0/394751539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977c8c0 msgr2=0x55b6c977cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7fae9a59c640 1 --2- 172.21.15.47:0/394751539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977c8c0 0x55b6c977cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7fae9a59c640 1 -- 172.21.15.47:0/394751539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977d1e0 msgr2=0x55b6c9788c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7fae9a59c640 1 --2- 172.21.15.47:0/394751539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977d1e0 0x55b6c9788c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7fae9a59c640 1 -- 172.21.15.47:0/394751539 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6c9445790 con 0x55b6c9789170 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.017+0000 7fae9a59c640 1 --2- 172.21.15.47:0/394751539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c978b560 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0e1820 tx=0x7fae8c0ec540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31709ca6eab77349 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.018+0000 7faea0d99640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fae900b3d40 0x7fae900b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.018+0000 7fae9959a640 1 -- 172.21.15.47:0/394751539 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0f7070 con 0x55b6c9789170 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.018+0000 7faea359e640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fae900b3d40 0x7fae900b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.018+0000 7fae9959a640 1 -- 172.21.15.47:0/394751539 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae8c0aa880 con 0x55b6c9789170 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.018+0000 7fae9959a640 1 -- 172.21.15.47:0/394751539 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0a0800 con 0x55b6c9789170 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.018+0000 7faea0d99640 1 -- 172.21.15.47:0/2778684980 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7fae8c0e40f0 con 0x7faea4106fd0 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 -- 172.21.15.47:0/394751539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 msgr2=0x55b6c978b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faea359e640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fae900b3d40 0x7fae900b6200 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fae9c007ed0 tx=0x7fae9c007680 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 --2- 172.21.15.47:0/394751539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c978b560 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0e1820 tx=0x7fae8c0ec540 comp rx=0 tx=0).stop 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 -- 172.21.15.47:0/394751539 shutdown_connections 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 --2- 172.21.15.47:0/394751539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c978b560 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 --2- 172.21.15.47:0/394751539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977d1e0 0x55b6c9788c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 --2- 172.21.15.47:0/394751539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977c8c0 0x55b6c977cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 -- 172.21.15.47:0/394751539 >> 172.21.15.47:0/394751539 conn(0x55b6c977a6f0 msgr2=0x55b6c977b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 -- 172.21.15.47:0/394751539 shutdown_connections 2024-07-24T22:13:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 -- 172.21.15.47:0/394751539 wait complete. 2024-07-24T22:13:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 -- start start 2024-07-24T22:13:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 Processor -- start 2024-07-24T22:13:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977c8c0 0x55b6c9788800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977d1e0 0x55b6c9785ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c9786220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b6c961bab0 con 0x55b6c9789170 2024-07-24T22:13:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b6c96699e0 con 0x55b6c977c8c0 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.019+0000 7faeabe58740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b6c978be50 con 0x55b6c977d1e0 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7faeabe58740 10 client.0 _ll_register_callbacks cb 0x55b6c93f1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7faea359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c9786220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7faea359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c9786220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33374/0 (socket says 172.21.15.47:33374) 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7faea359e640 1 -- 172.21.15.47:0/1124944220 learned_addr learned my addr 172.21.15.47:0/1124944220 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7faea2d9d640 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977c8c0 0x55b6c9788800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7fae9a59c640 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977d1e0 0x55b6c9785ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7faea359e640 1 -- 172.21.15.47:0/1124944220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977d1e0 msgr2=0x55b6c9785ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7faea359e640 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977d1e0 0x55b6c9785ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7faea359e640 1 -- 172.21.15.47:0/1124944220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977c8c0 msgr2=0x55b6c9788800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7faea359e640 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977c8c0 0x55b6c9788800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7faea359e640 1 -- 172.21.15.47:0/1124944220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6c94be620 con 0x55b6c9789170 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7faea2d9d640 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977c8c0 0x55b6c9788800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7fae9a59c640 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977d1e0 0x55b6c9785ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7faea359e640 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c9786220 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00edc0 tx=0x7fae9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df39bba691ba28bd server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7fae8a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7fae8a7fc640 1 -- 172.21.15.47:0/1124944220 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c01cd30 con 0x55b6c9789170 2024-07-24T22:13:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7fae8a7fc640 1 -- 172.21.15.47:0/1124944220 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7fae9c01d410 con 0x55b6c9789170 2024-07-24T22:13:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.020+0000 7faeabe58740 1 -- 172.21.15.47:0/1124944220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b6c9690ce0 con 0x55b6c9789170 2024-07-24T22:13:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.021+0000 7fae8a7fc640 1 -- 172.21.15.47:0/1124944220 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fae9c01d610 con 0x55b6c9789170 2024-07-24T22:13:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.021+0000 7faeabe58740 10 client.16824 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.021+0000 7faeabe58740 1 -- 172.21.15.47:0/1124944220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b6c97975c0 con 0x55b6c9789170 2024-07-24T22:13:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.021+0000 7fae8a7fc640 1 -- 172.21.15.47:0/1124944220 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b6c9690ce0 con 0x55b6c9789170 2024-07-24T22:13:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.021+0000 7fae8a7fc640 1 -- 172.21.15.47:0/1124944220 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fae9c0288c0 con 0x55b6c9789170 2024-07-24T22:13:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.021+0000 7faeabe58740 10 client.16824 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.021+0000 7faeabe58740 10 client.16824 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.021+0000 7faeabe58740 20 client.16824 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.021+0000 7faeabe58740 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b6c9798ad0 0x55b6c979aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.021+0000 7faeabe58740 4 client.16824 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:13:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.021+0000 7faeabe58740 1 -- 172.21.15.47:0/1124944220 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6c96f41d0 con 0x55b6c9798ad0 2024-07-24T22:13:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.021+0000 7faea2d9d640 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b6c9798ad0 0x55b6c979aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.022+0000 7fae8a7fc640 10 client.16824 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.022+0000 7faea2d9d640 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b6c9798ad0 0x55b6c979aec0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7084893658be232 server_cookie=fdc44673cacd8ff8 in_seq=0 out_seq=0 2024-07-24T22:13:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.022+0000 7fae8a7fc640 1 -- 172.21.15.47:0/1124944220 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6c96f41d0 con 0x55b6c9798ad0 2024-07-24T22:13:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.022+0000 7fae8a7fc640 10 client.16824 handle_command_reply: tid=0 2024-07-24T22:13:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.022+0000 7faeabe58740 1 client.16824 shutdown 2024-07-24T22:13:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.023+0000 7faeabe58740 1 -- 172.21.15.47:0/1124944220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 msgr2=0x55b6c9786220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.023+0000 7faeabe58740 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c9786220 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00edc0 tx=0x7fae9c004a40 comp rx=0 tx=0).stop 2024-07-24T22:13:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.023+0000 7faeabe58740 1 -- 172.21.15.47:0/1124944220 shutdown_connections 2024-07-24T22:13:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.023+0000 7faeabe58740 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b6c9798ad0 0x55b6c979aec0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.023+0000 7faeabe58740 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c9786220 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.023+0000 7faeabe58740 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977d1e0 0x55b6c9785ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.023+0000 7faeabe58740 1 --2- 172.21.15.47:0/1124944220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977c8c0 0x55b6c9788800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.023+0000 7fae8a7fc640 0 client.16824 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.023+0000 7faeabe58740 1 -- 172.21.15.47:0/1124944220 >> 172.21.15.47:0/1124944220 conn(0x55b6c977a6f0 msgr2=0x55b6c9780220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.023+0000 7faeabe58740 1 -- 172.21.15.47:0/1124944220 shutdown_connections 2024-07-24T22:13:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.023+0000 7faeabe58740 1 -- 172.21.15.47:0/1124944220 wait complete. 2024-07-24T22:13:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.023+0000 7faeabe58740 20 client.16824 trim_cache size 0 max 16384 2024-07-24T22:13:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.038+0000 7faeabe58740 1 Processor -- start 2024-07-24T22:13:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.038+0000 7faeabe58740 1 -- start start 2024-07-24T22:13:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faeabe58740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c977c8c0 0x55b6c97a0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faeabe58740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977d1e0 0x55b6c97a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faeabe58740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c9789170 0x55b6c9791100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faeabe58740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faea41ac0d0 con 0x55b6c977c8c0 2024-07-24T22:13:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faeabe58740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faea41ae930 con 0x55b6c9789170 2024-07-24T22:13:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faeabe58740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faea41ac720 con 0x55b6c977d1e0 2024-07-24T22:13:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faea2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c977c8c0 0x55b6c97a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faea2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c977c8c0 0x55b6c97a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33376/0 (socket says 172.21.15.47:33376) 2024-07-24T22:13:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faea2d9d640 1 -- 172.21.15.47:0/2681105676 learned_addr learned my addr 172.21.15.47:0/2681105676 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faea359e640 1 --2- 172.21.15.47:0/2681105676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c9789170 0x55b6c9791100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faea2d9d640 1 -- 172.21.15.47:0/2681105676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977d1e0 msgr2=0x55b6c97a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faea2d9d640 1 --2- 172.21.15.47:0/2681105676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977d1e0 0x55b6c97a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faea2d9d640 1 -- 172.21.15.47:0/2681105676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c9789170 msgr2=0x55b6c9791100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faea2d9d640 1 --2- 172.21.15.47:0/2681105676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c9789170 0x55b6c9791100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faea2d9d640 1 -- 172.21.15.47:0/2681105676 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6c977d010 con 0x55b6c977c8c0 2024-07-24T22:13:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faea359e640 1 --2- 172.21.15.47:0/2681105676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c9789170 0x55b6c9791100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7faea2d9d640 1 --2- 172.21.15.47:0/2681105676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c977c8c0 0x55b6c97a0780 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fae94009900 tx=0x7fae94009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622a3a2e7bfc49e1 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7fae98d99640 1 -- 172.21.15.47:0/2681105676 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94049070 con 0x55b6c977c8c0 2024-07-24T22:13:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7fae98d99640 1 -- 172.21.15.47:0/2681105676 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae94004240 con 0x55b6c977c8c0 2024-07-24T22:13:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.039+0000 7fae98d99640 1 -- 172.21.15.47:0/2681105676 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94035040 con 0x55b6c977c8c0 2024-07-24T22:13:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.040+0000 7faeabe58740 1 -- 172.21.15.47:0/2681105676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c977c8c0 msgr2=0x55b6c97a0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.040+0000 7faeabe58740 1 --2- 172.21.15.47:0/2681105676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c977c8c0 0x55b6c97a0780 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fae94009900 tx=0x7fae94009260 comp rx=0 tx=0).stop 2024-07-24T22:13:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.040+0000 7faeabe58740 1 -- 172.21.15.47:0/2681105676 shutdown_connections 2024-07-24T22:13:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.040+0000 7faeabe58740 1 --2- 172.21.15.47:0/2681105676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c9789170 0x55b6c9791100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.040+0000 7faeabe58740 1 --2- 172.21.15.47:0/2681105676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977d1e0 0x55b6c97a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.040+0000 7faeabe58740 1 --2- 172.21.15.47:0/2681105676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c977c8c0 0x55b6c97a0780 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.040+0000 7faeabe58740 1 -- 172.21.15.47:0/2681105676 >> 172.21.15.47:0/2681105676 conn(0x55b6c977a6f0 msgr2=0x55b6c9784540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.040+0000 7faeabe58740 1 -- 172.21.15.47:0/2681105676 shutdown_connections 2024-07-24T22:13:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.040+0000 7faeabe58740 1 -- 172.21.15.47:0/2681105676 wait complete. 2024-07-24T22:13:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.040+0000 7faeabe58740 1 -- start start 2024-07-24T22:13:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faeabe58740 1 Processor -- start 2024-07-24T22:13:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faeabe58740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977c8c0 0x55b6c978f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faeabe58740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977d1e0 0x55b6c978fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faeabe58740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c97901b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faeabe58740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faea41acdf0 con 0x55b6c9789170 2024-07-24T22:13:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faeabe58740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faea41ae260 con 0x55b6c977d1e0 2024-07-24T22:13:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faeabe58740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faea41ad4c0 con 0x55b6c977c8c0 2024-07-24T22:13:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faeabe58740 10 client.0 _ll_register_callbacks cb 0x7fae9c007b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faea359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c97901b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faea359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c97901b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33382/0 (socket says 172.21.15.47:33382) 2024-07-24T22:13:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faea359e640 1 -- 172.21.15.47:0/4050361174 learned_addr learned my addr 172.21.15.47:0/4050361174 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faea2d9d640 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977c8c0 0x55b6c978f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7fae9a59c640 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977d1e0 0x55b6c978fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faea359e640 1 -- 172.21.15.47:0/4050361174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977c8c0 msgr2=0x55b6c978f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faea359e640 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977c8c0 0x55b6c978f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faea359e640 1 -- 172.21.15.47:0/4050361174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977d1e0 msgr2=0x55b6c978fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faea359e640 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977d1e0 0x55b6c978fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faea359e640 1 -- 172.21.15.47:0/4050361174 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6c979b230 con 0x55b6c9789170 2024-07-24T22:13:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faea2d9d640 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977c8c0 0x55b6c978f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:13:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7faea359e640 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c97901b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00edc0 tx=0x7fae9c02f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8347797305d14672 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.041+0000 7fae8a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7fae8a7fc640 1 -- 172.21.15.47:0/4050361174 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c03f060 con 0x55b6c9789170 2024-07-24T22:13:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7faeabe58740 1 -- 172.21.15.47:0/4050361174 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae94004240 con 0x55b6c9789170 2024-07-24T22:13:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7fae8a7fc640 1 -- 172.21.15.47:0/4050361174 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7fae9c004ab0 con 0x55b6c9789170 2024-07-24T22:13:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7fae8a7fc640 1 -- 172.21.15.47:0/4050361174 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fae9c034040 con 0x55b6c9789170 2024-07-24T22:13:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7faeabe58740 10 client.16830 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7faeabe58740 1 -- 172.21.15.47:0/4050361174 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b6c9802b10 con 0x55b6c9789170 2024-07-24T22:13:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7fae8a7fc640 1 -- 172.21.15.47:0/4050361174 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae94004240 con 0x55b6c9789170 2024-07-24T22:13:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7fae8a7fc640 1 -- 172.21.15.47:0/4050361174 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fae9c01d7b0 con 0x55b6c9789170 2024-07-24T22:13:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7faeabe58740 10 client.16830 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7faeabe58740 10 client.16830 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7faeabe58740 20 client.16830 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7faeabe58740 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b6c9803230 0x55b6c9805620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7faeabe58740 4 client.16830 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:13:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.042+0000 7faeabe58740 1 -- 172.21.15.47:0/4050361174 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b6c96efc70 con 0x55b6c9803230 2024-07-24T22:13:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.043+0000 7faea2d9d640 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b6c9803230 0x55b6c9805620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.043+0000 7faea2d9d640 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b6c9803230 0x55b6c9805620 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24b823b1d77ecec5 server_cookie=2b5339239c4c5e80 in_seq=0 out_seq=0 2024-07-24T22:13:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.043+0000 7fae8a7fc640 10 client.16830 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7fae8a7fc640 1 -- 172.21.15.47:0/4050361174 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b6c96efc70 con 0x55b6c9803230 2024-07-24T22:13:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7fae8a7fc640 10 client.16830 handle_command_reply: tid=0 2024-07-24T22:13:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7faeabe58740 1 client.16830 shutdown 2024-07-24T22:13:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7faeabe58740 1 -- 172.21.15.47:0/4050361174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 msgr2=0x55b6c97901b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7faeabe58740 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c97901b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00edc0 tx=0x7fae9c02f5c0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7faeabe58740 1 -- 172.21.15.47:0/4050361174 shutdown_connections 2024-07-24T22:13:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7faeabe58740 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b6c9803230 0x55b6c9805620 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7faeabe58740 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6c9789170 0x55b6c97901b0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7faeabe58740 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6c977d1e0 0x55b6c978fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7fae8a7fc640 0 client.16830 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7faeabe58740 1 --2- 172.21.15.47:0/4050361174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b6c977c8c0 0x55b6c978f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7faeabe58740 1 -- 172.21.15.47:0/4050361174 >> 172.21.15.47:0/4050361174 conn(0x55b6c977a6f0 msgr2=0x55b6c9778f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7faeabe58740 1 -- 172.21.15.47:0/4050361174 shutdown_connections 2024-07-24T22:13:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7faeabe58740 1 -- 172.21.15.47:0/4050361174 wait complete. 2024-07-24T22:13:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.056+0000 7faeabe58740 20 client.16830 trim_cache size 0 max 16384 2024-07-24T22:13:36.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:13:36.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:13:36.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:13:36.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:13:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.057+0000 7faea9104640 1 -- 172.21.15.47:0/2778684980 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fae900b3d40 msgr2=0x7fae900b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.057+0000 7faea9104640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fae900b3d40 0x7fae900b6200 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fae9c007ed0 tx=0x7fae9c007680 comp rx=0 tx=0).stop 2024-07-24T22:13:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.057+0000 7faea9104640 1 -- 172.21.15.47:0/2778684980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faea4106fd0 msgr2=0x7faea4199010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.057+0000 7faea9104640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faea4106fd0 0x7faea4199010 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00c920 tx=0x7fae8c00cde0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.057+0000 7faea9104640 1 -- 172.21.15.47:0/2778684980 shutdown_connections 2024-07-24T22:13:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.057+0000 7faea9104640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fae900b3d40 0x7fae900b6200 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.057+0000 7faea9104640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faea4107950 0x7faea419e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.057+0000 7faea9104640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faea4106fd0 0x7faea4199010 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.057+0000 7faea9104640 1 --2- 172.21.15.47:0/2778684980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faea41015d0 0x7faea4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.057+0000 7faea9104640 1 -- 172.21.15.47:0/2778684980 >> 172.21.15.47:0/2778684980 conn(0x7faea40fd030 msgr2=0x7faea40fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.057+0000 7faea9104640 1 -- 172.21.15.47:0/2778684980 shutdown_connections 2024-07-24T22:13:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:36.057+0000 7faea9104640 1 -- 172.21.15.47:0/2778684980 wait complete. 2024-07-24T22:13:37.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:37 smithi188 ceph-mon[37380]: pgmap v560: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 117 op/s 2024-07-24T22:13:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:37 smithi183 ceph-mon[37007]: pgmap v560: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 117 op/s 2024-07-24T22:13:37.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:37 smithi047 ceph-mon[32551]: pgmap v560: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 117 op/s 2024-07-24T22:13:39.027 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:13:39.309 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:13:39.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:39 smithi047 ceph-mon[32551]: pgmap v561: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 53 op/s 2024-07-24T22:13:39.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:39 smithi188 ceph-mon[37380]: pgmap v561: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 53 op/s 2024-07-24T22:13:39.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:39 smithi183 ceph-mon[37007]: pgmap v561: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 53 op/s 2024-07-24T22:13:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.094+0000 7f445061d640 1 -- 172.21.15.47:0/707174615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f444810cb40 msgr2=0x7f444810ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.094+0000 7f445061d640 1 --2- 172.21.15.47:0/707174615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f444810cb40 0x7f444810ef50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4440009ca0 tx=0x7f444002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.095+0000 7f445061d640 1 -- 172.21.15.47:0/707174615 shutdown_connections 2024-07-24T22:13:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.095+0000 7f445061d640 1 --2- 172.21.15.47:0/707174615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f444810cb40 0x7f444810ef50 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.095+0000 7f445061d640 1 --2- 172.21.15.47:0/707174615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4448103f90 0x7f444810c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.095+0000 7f445061d640 1 --2- 172.21.15.47:0/707174615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4448103590 0x7f4448103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.095+0000 7f445061d640 1 -- 172.21.15.47:0/707174615 >> 172.21.15.47:0/707174615 conn(0x7f44480fd100 msgr2=0x7f44480ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.095+0000 7f445061d640 1 -- 172.21.15.47:0/707174615 shutdown_connections 2024-07-24T22:13:41.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.095+0000 7f445061d640 1 -- 172.21.15.47:0/707174615 wait complete. 2024-07-24T22:13:41.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.095+0000 7f445061d640 1 Processor -- start 2024-07-24T22:13:41.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.095+0000 7f445061d640 1 -- start start 2024-07-24T22:13:41.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.095+0000 7f445061d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4448103590 0x7f4448198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.095+0000 7f445061d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4448103f90 0x7f4448199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f445061d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f444810cb40 0x7f444819e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f445061d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44481127b0 con 0x7f4448103590 2024-07-24T22:13:41.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f445061d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4448112630 con 0x7f444810cb40 2024-07-24T22:13:41.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f445061d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4448112930 con 0x7f4448103f90 2024-07-24T22:13:41.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f444e3b9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4448103590 0x7f4448198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f444e3b9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4448103590 0x7f4448198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33386/0 (socket says 172.21.15.47:33386) 2024-07-24T22:13:41.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f444e3b9640 1 -- 172.21.15.47:0/1129547028 learned_addr learned my addr 172.21.15.47:0/1129547028 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f444dbb8640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4448103f90 0x7f4448199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f444ebba640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f444810cb40 0x7f444819e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f444e3b9640 1 -- 172.21.15.47:0/1129547028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4448103f90 msgr2=0x7f4448199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f444e3b9640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4448103f90 0x7f4448199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f444e3b9640 1 -- 172.21.15.47:0/1129547028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f444810cb40 msgr2=0x7f444819e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f444e3b9640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f444810cb40 0x7f444819e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f444e3b9640 1 -- 172.21.15.47:0/1129547028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444819edd0 con 0x7f4448103590 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f444e3b9640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4448103590 0x7f4448198d20 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f444400b4a0 tx=0x7f444400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f443f7fe640 1 -- 172.21.15.47:0/1129547028 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444014070 con 0x7f4448103590 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f445061d640 1 -- 172.21.15.47:0/1129547028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444819f0c0 con 0x7f4448103590 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f443f7fe640 1 -- 172.21.15.47:0/1129547028 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4444010ac0 con 0x7f4448103590 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f443f7fe640 1 -- 172.21.15.47:0/1129547028 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444017c30 con 0x7f4448103590 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.096+0000 7f445061d640 1 -- 172.21.15.47:0/1129547028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44481a5780 con 0x7f4448103590 2024-07-24T22:13:41.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.099+0000 7f44529ce740 1 Processor -- start 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.099+0000 7f443f7fe640 1 -- 172.21.15.47:0/1129547028 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f4444017070 con 0x7f4448103590 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.099+0000 7f44529ce740 1 -- start start 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f44529ce740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641dead3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f44529ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deadfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f44529ce740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 0x5641deae2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f44529ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5641dea4a990 con 0x5641dead3fd0 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f44529ce740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5641dea39e90 con 0x5641deadff60 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f44529ce740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5641dea3ded0 con 0x5641dead36b0 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f444e3b9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deadfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f444e3b9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deadfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33396/0 (socket says 172.21.15.47:33396) 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f444e3b9640 1 -- 172.21.15.47:0/3936516840 learned_addr learned my addr 172.21.15.47:0/3936516840 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f444dbb8640 1 --2- 172.21.15.47:0/3936516840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 0x5641deae2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f444ebba640 1 --2- 172.21.15.47:0/3936516840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641dead3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f444e3b9640 1 -- 172.21.15.47:0/3936516840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 msgr2=0x5641dead3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f444e3b9640 1 --2- 172.21.15.47:0/3936516840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641dead3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f444e3b9640 1 -- 172.21.15.47:0/3936516840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 msgr2=0x5641deae2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f444e3b9640 1 --2- 172.21.15.47:0/3936516840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 0x5641deae2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f444e3b9640 1 -- 172.21.15.47:0/3936516840 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641de9c3300 con 0x5641dead3fd0 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.100+0000 7f443f7fe640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44340b3d40 0x7f44340b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.101+0000 7f444ebba640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44340b3d40 0x7f44340b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.101+0000 7f444e3b9640 1 --2- 172.21.15.47:0/3936516840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deadfa20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f44440e0b40 tx=0x7f44440e9a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7b130ed656ed73 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.101+0000 7f443f7fe640 1 -- 172.21.15.47:0/1129547028 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f44440e33a0 con 0x7f4448103590 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.101+0000 7f443cff9640 1 -- 172.21.15.47:0/3936516840 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44440a5f50 con 0x5641dead3fd0 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.101+0000 7f443cff9640 1 -- 172.21.15.47:0/3936516840 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4444017360 con 0x5641dead3fd0 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.101+0000 7f443cff9640 1 -- 172.21.15.47:0/3936516840 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44440a9800 con 0x5641dead3fd0 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 -- 172.21.15.47:0/3936516840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 msgr2=0x5641deadfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f444ebba640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44340b3d40 0x7f44340b6200 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4440006010 tx=0x7f44400093f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 --2- 172.21.15.47:0/3936516840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deadfa20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f44440e0b40 tx=0x7f44440e9a10 comp rx=0 tx=0).stop 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 -- 172.21.15.47:0/3936516840 shutdown_connections 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 --2- 172.21.15.47:0/3936516840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 0x5641deae2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 --2- 172.21.15.47:0/3936516840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deadfa20 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 --2- 172.21.15.47:0/3936516840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641dead3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 -- 172.21.15.47:0/3936516840 >> 172.21.15.47:0/3936516840 conn(0x5641dead14e0 msgr2=0x5641dead2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 -- 172.21.15.47:0/3936516840 shutdown_connections 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 -- 172.21.15.47:0/3936516840 wait complete. 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 -- start start 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 Processor -- start 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641dead36b0 0x5641deadf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead3fd0 0x5641deadce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641deadff60 0x5641deadd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5641de89d700 con 0x5641deadff60 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5641de9dc5d0 con 0x5641dead36b0 2024-07-24T22:13:41.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5641deae2b80 con 0x5641dead3fd0 2024-07-24T22:13:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.102+0000 7f44529ce740 10 client.0 _ll_register_callbacks cb 0x5641de9fc940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f444ebba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641deadff60 0x5641deadd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f444e3b9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641dead36b0 0x5641deadf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f444ebba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641deadff60 0x5641deadd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33402/0 (socket says 172.21.15.47:33402) 2024-07-24T22:13:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f444ebba640 1 -- 172.21.15.47:0/4037901121 learned_addr learned my addr 172.21.15.47:0/4037901121 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f444dbb8640 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead3fd0 0x5641deadce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f444ebba640 1 -- 172.21.15.47:0/4037901121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead3fd0 msgr2=0x5641deadce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f444ebba640 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead3fd0 0x5641deadce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f444ebba640 1 -- 172.21.15.47:0/4037901121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641dead36b0 msgr2=0x5641deadf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f444ebba640 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641dead36b0 0x5641deadf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f444ebba640 1 -- 172.21.15.47:0/4037901121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641de9cf660 con 0x5641deadff60 2024-07-24T22:13:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f444e3b9640 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641dead36b0 0x5641deadf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f444dbb8640 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead3fd0 0x5641deadce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f444ebba640 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641deadff60 0x5641deadd5f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f44400316d0 tx=0x7f44400095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0fa5ee3e728512 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f4431ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f4431ffb640 1 -- 172.21.15.47:0/4037901121 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444004e070 con 0x5641deadff60 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f44529ce740 1 -- 172.21.15.47:0/4037901121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5641dea4c8e0 con 0x5641deadff60 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f4431ffb640 1 -- 172.21.15.47:0/4037901121 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f44400045c0 con 0x5641deadff60 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f4431ffb640 1 -- 172.21.15.47:0/4037901121 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4440031910 con 0x5641deadff60 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.103+0000 7f44529ce740 10 client.16842 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.104+0000 7f44529ce740 1 -- 172.21.15.47:0/4037901121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5641de79a650 con 0x5641deadff60 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.104+0000 7f4431ffb640 1 -- 172.21.15.47:0/4037901121 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5641dea4c8e0 con 0x5641deadff60 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.104+0000 7f4431ffb640 1 -- 172.21.15.47:0/4037901121 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4440043040 con 0x5641deadff60 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.104+0000 7f44529ce740 10 client.16842 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.104+0000 7f44529ce740 10 client.16842 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.104+0000 7f44529ce740 20 client.16842 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:41.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.104+0000 7f44529ce740 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5641deaef9f0 0x5641deaf1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.104+0000 7f44529ce740 4 client.16842 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.104+0000 7f44529ce740 1 -- 172.21.15.47:0/4037901121 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641dea48380 con 0x5641deaef9f0 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.104+0000 7f444e3b9640 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5641deaef9f0 0x5641deaf1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.105+0000 7f4431ffb640 10 client.16842 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.105+0000 7f444e3b9640 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5641deaef9f0 0x5641deaf1e10 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cdeea4dea581100 server_cookie=372da65bcf53e67e in_seq=0 out_seq=0 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.105+0000 7f4431ffb640 1 -- 172.21.15.47:0/4037901121 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5641dea48380 con 0x5641deaef9f0 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.105+0000 7f4431ffb640 10 client.16842 handle_command_reply: tid=0 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.105+0000 7f44529ce740 1 client.16842 shutdown 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.106+0000 7f44529ce740 1 -- 172.21.15.47:0/4037901121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641deadff60 msgr2=0x5641deadd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.106+0000 7f44529ce740 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641deadff60 0x5641deadd5f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f44400316d0 tx=0x7f44400095c0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.106+0000 7f44529ce740 1 -- 172.21.15.47:0/4037901121 shutdown_connections 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.106+0000 7f44529ce740 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5641deaef9f0 0x5641deaf1e10 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.106+0000 7f44529ce740 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641deadff60 0x5641deadd5f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.106+0000 7f44529ce740 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead3fd0 0x5641deadce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.106+0000 7f44529ce740 1 --2- 172.21.15.47:0/4037901121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641dead36b0 0x5641deadf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.106+0000 7f4431ffb640 0 client.16842 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.106+0000 7f44529ce740 1 -- 172.21.15.47:0/4037901121 >> 172.21.15.47:0/4037901121 conn(0x5641dead14e0 msgr2=0x5641dead7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.106+0000 7f44529ce740 1 -- 172.21.15.47:0/4037901121 shutdown_connections 2024-07-24T22:13:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.106+0000 7f44529ce740 1 -- 172.21.15.47:0/4037901121 wait complete. 2024-07-24T22:13:41.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.106+0000 7f44529ce740 20 client.16842 trim_cache size 0 max 16384 2024-07-24T22:13:41.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.124+0000 7f44529ce740 1 Processor -- start 2024-07-24T22:13:41.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.124+0000 7f44529ce740 1 -- start start 2024-07-24T22:13:41.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.124+0000 7f44529ce740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641dead7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.124+0000 7f44529ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deadeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.124+0000 7f44529ce740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 0x5641deaf7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.124+0000 7f44529ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44481ac220 con 0x5641dead3fd0 2024-07-24T22:13:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.124+0000 7f44529ce740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f44481aea80 con 0x5641deadff60 2024-07-24T22:13:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.124+0000 7f44529ce740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f44481ac870 con 0x5641dead36b0 2024-07-24T22:13:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f444dbb8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deadeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f444dbb8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deadeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33414/0 (socket says 172.21.15.47:33414) 2024-07-24T22:13:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f444dbb8640 1 -- 172.21.15.47:0/1827506151 learned_addr learned my addr 172.21.15.47:0/1827506151 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f444ebba640 1 --2- 172.21.15.47:0/1827506151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 0x5641deaf7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f444dbb8640 1 -- 172.21.15.47:0/1827506151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 msgr2=0x5641dead7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f444e3b9640 1 --2- 172.21.15.47:0/1827506151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641dead7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f444dbb8640 1 --2- 172.21.15.47:0/1827506151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641dead7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f444dbb8640 1 -- 172.21.15.47:0/1827506151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 msgr2=0x5641deaf7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f444dbb8640 1 --2- 172.21.15.47:0/1827506151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 0x5641deaf7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f444dbb8640 1 -- 172.21.15.47:0/1827506151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641deadfd60 con 0x5641dead3fd0 2024-07-24T22:13:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f444e3b9640 1 --2- 172.21.15.47:0/1827506151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641dead7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:13:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f444dbb8640 1 --2- 172.21.15.47:0/1827506151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deadeb80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f443800bcf0 tx=0x7f4438012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7606d6721db81443 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f4433fff640 1 -- 172.21.15.47:0/1827506151 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4438020070 con 0x5641dead3fd0 2024-07-24T22:13:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f4433fff640 1 -- 172.21.15.47:0/1827506151 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f443800bde0 con 0x5641dead3fd0 2024-07-24T22:13:41.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.125+0000 7f4433fff640 1 -- 172.21.15.47:0/1827506151 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4438010750 con 0x5641dead3fd0 2024-07-24T22:13:41.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.126+0000 7f44529ce740 1 -- 172.21.15.47:0/1827506151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 msgr2=0x5641deadeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.126+0000 7f44529ce740 1 --2- 172.21.15.47:0/1827506151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deadeb80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f443800bcf0 tx=0x7f4438012820 comp rx=0 tx=0).stop 2024-07-24T22:13:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.126+0000 7f44529ce740 1 -- 172.21.15.47:0/1827506151 shutdown_connections 2024-07-24T22:13:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.126+0000 7f44529ce740 1 --2- 172.21.15.47:0/1827506151 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 0x5641deaf7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.126+0000 7f44529ce740 1 --2- 172.21.15.47:0/1827506151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deadeb80 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.126+0000 7f44529ce740 1 --2- 172.21.15.47:0/1827506151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641dead7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.126+0000 7f44529ce740 1 -- 172.21.15.47:0/1827506151 >> 172.21.15.47:0/1827506151 conn(0x5641dead14e0 msgr2=0x5641deade470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.126+0000 7f44529ce740 1 -- 172.21.15.47:0/1827506151 shutdown_connections 2024-07-24T22:13:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.126+0000 7f44529ce740 1 -- 172.21.15.47:0/1827506151 wait complete. 2024-07-24T22:13:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.126+0000 7f44529ce740 1 -- start start 2024-07-24T22:13:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.126+0000 7f44529ce740 1 Processor -- start 2024-07-24T22:13:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f44529ce740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641deada010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f44529ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deada550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f44529ce740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 0x5641deadaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f44529ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44481acf40 con 0x5641dead3fd0 2024-07-24T22:13:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f44529ce740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f44481ae3b0 con 0x5641deadff60 2024-07-24T22:13:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f44529ce740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f44481ad610 con 0x5641dead36b0 2024-07-24T22:13:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f44529ce740 10 client.0 _ll_register_callbacks cb 0x7f4440009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f444dbb8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deada550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f444dbb8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deada550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33430/0 (socket says 172.21.15.47:33430) 2024-07-24T22:13:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f444dbb8640 1 -- 172.21.15.47:0/990603146 learned_addr learned my addr 172.21.15.47:0/990603146 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f444ebba640 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 0x5641deadaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f444e3b9640 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641deada010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f444dbb8640 1 -- 172.21.15.47:0/990603146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 msgr2=0x5641deada010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f444dbb8640 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641deada010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f444dbb8640 1 -- 172.21.15.47:0/990603146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 msgr2=0x5641deadaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:41.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f444dbb8640 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 0x5641deadaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f444dbb8640 1 -- 172.21.15.47:0/990603146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641deb62080 con 0x5641dead3fd0 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f444e3b9640 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641deada010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f444dbb8640 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deada550 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4438000c00 tx=0x7f443800bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668990f888f4c2c1 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.127+0000 7f4431ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f4431ffb640 1 -- 172.21.15.47:0/990603146 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4438020040 con 0x5641dead3fd0 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f44529ce740 1 -- 172.21.15.47:0/990603146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f443800bde0 con 0x5641dead3fd0 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f4431ffb640 1 -- 172.21.15.47:0/990603146 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f4438005530 con 0x5641dead3fd0 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f4431ffb640 1 -- 172.21.15.47:0/990603146 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4438033050 con 0x5641dead3fd0 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f44529ce740 10 client.16848 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f44529ce740 1 -- 172.21.15.47:0/990603146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5641deb63300 con 0x5641dead3fd0 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f4431ffb640 1 -- 172.21.15.47:0/990603146 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f443800bde0 con 0x5641dead3fd0 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f4431ffb640 1 -- 172.21.15.47:0/990603146 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f443802e030 con 0x5641dead3fd0 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f44529ce740 10 client.16848 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f44529ce740 10 client.16848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f44529ce740 20 client.16848 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:41.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f44529ce740 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5641deb63970 0x5641deb65d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f44529ce740 4 client.16848 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.128+0000 7f44529ce740 1 -- 172.21.15.47:0/990603146 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5641dea45ac0 con 0x5641deb63970 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f444e3b9640 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5641deb63970 0x5641deb65d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f444e3b9640 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5641deb63970 0x5641deb65d90 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95e01a960064d6a3 server_cookie=e7a4eb5ada1f1767 in_seq=0 out_seq=0 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f4431ffb640 10 client.16848 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f4431ffb640 1 -- 172.21.15.47:0/990603146 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f444408c050 con 0x5641deb63970 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f4431ffb640 10 client.16848 handle_command_reply: tid=0 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f44529ce740 1 client.16848 shutdown 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f44529ce740 1 -- 172.21.15.47:0/990603146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 msgr2=0x5641deada550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f44529ce740 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deada550 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4438000c00 tx=0x7f443800bac0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f44529ce740 1 -- 172.21.15.47:0/990603146 shutdown_connections 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f44529ce740 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5641deb63970 0x5641deb65d90 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f4431ffb640 0 client.16848 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f44529ce740 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641deadff60 0x5641deadaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f44529ce740 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641dead3fd0 0x5641deada550 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f44529ce740 1 --2- 172.21.15.47:0/990603146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5641dead36b0 0x5641deada010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.129+0000 7f44529ce740 1 -- 172.21.15.47:0/990603146 >> 172.21.15.47:0/990603146 conn(0x5641dead14e0 msgr2=0x5641deadec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:41.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.130+0000 7f44529ce740 1 -- 172.21.15.47:0/990603146 shutdown_connections 2024-07-24T22:13:41.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.130+0000 7f44529ce740 1 -- 172.21.15.47:0/990603146 wait complete. 2024-07-24T22:13:41.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.130+0000 7f44529ce740 20 client.16848 trim_cache size 0 max 16384 2024-07-24T22:13:41.137 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:13:41.137 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:13:41.137 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:13:41.137 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:13:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.130+0000 7f445061d640 1 -- 172.21.15.47:0/1129547028 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44340b3d40 msgr2=0x7f44340b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.130+0000 7f445061d640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44340b3d40 0x7f44340b6200 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4440006010 tx=0x7f44400093f0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.130+0000 7f445061d640 1 -- 172.21.15.47:0/1129547028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4448103590 msgr2=0x7f4448198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.130+0000 7f445061d640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4448103590 0x7f4448198d20 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f444400b4a0 tx=0x7f444400b960 comp rx=0 tx=0).stop 2024-07-24T22:13:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.130+0000 7f445061d640 1 -- 172.21.15.47:0/1129547028 shutdown_connections 2024-07-24T22:13:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.130+0000 7f445061d640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f44340b3d40 0x7f44340b6200 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.130+0000 7f445061d640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f444810cb40 0x7f444819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.130+0000 7f445061d640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4448103f90 0x7f4448199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.130+0000 7f445061d640 1 --2- 172.21.15.47:0/1129547028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4448103590 0x7f4448198d20 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:41.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.130+0000 7f445061d640 1 -- 172.21.15.47:0/1129547028 >> 172.21.15.47:0/1129547028 conn(0x7f44480fd100 msgr2=0x7f444810ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:41.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.131+0000 7f445061d640 1 -- 172.21.15.47:0/1129547028 shutdown_connections 2024-07-24T22:13:41.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:41.131+0000 7f445061d640 1 -- 172.21.15.47:0/1129547028 wait complete. 2024-07-24T22:13:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:41 smithi047 ceph-mon[32551]: pgmap v562: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 8.7 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-07-24T22:13:41.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:41 smithi188 ceph-mon[37380]: pgmap v562: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 8.7 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-07-24T22:13:41.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:41 smithi183 ceph-mon[37007]: pgmap v562: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 8.7 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-07-24T22:13:41.922 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:13:41.923 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:13:42.193 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:13:43.488 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:13:43.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:43 smithi047 ceph-mon[32551]: pgmap v563: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 9.1 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-07-24T22:13:43.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:43 smithi188 ceph-mon[37380]: pgmap v563: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 9.1 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-07-24T22:13:43.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:43 smithi183 ceph-mon[37007]: pgmap v563: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 9.1 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-07-24T22:13:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.003+0000 7f2040502640 1 -- 172.21.15.47:0/3134767235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2038103ef0 msgr2=0x7f203810c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.003+0000 7f2040502640 1 --2- 172.21.15.47:0/3134767235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2038103ef0 0x7f203810c4d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2028009900 tx=0x7f202802a410 comp rx=0 tx=0).stop 2024-07-24T22:13:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.003+0000 7f2040502640 1 -- 172.21.15.47:0/3134767235 shutdown_connections 2024-07-24T22:13:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.003+0000 7f2040502640 1 --2- 172.21.15.47:0/3134767235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f203810caa0 0x7f203810ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.003+0000 7f2040502640 1 --2- 172.21.15.47:0/3134767235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2038103ef0 0x7f203810c4d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.003+0000 7f2040502640 1 --2- 172.21.15.47:0/3134767235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20381034f0 0x7f20381038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.004+0000 7f2040502640 1 -- 172.21.15.47:0/3134767235 >> 172.21.15.47:0/3134767235 conn(0x7f20380fd0c0 msgr2=0x7f20380ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.004+0000 7f2040502640 1 -- 172.21.15.47:0/3134767235 shutdown_connections 2024-07-24T22:13:44.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.004+0000 7f2040502640 1 -- 172.21.15.47:0/3134767235 wait complete. 2024-07-24T22:13:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.004+0000 7f2040502640 1 Processor -- start 2024-07-24T22:13:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.004+0000 7f2040502640 1 -- start start 2024-07-24T22:13:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f2040502640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20381034f0 0x7f2038198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f2040502640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2038103ef0 0x7f20381992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f2040502640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f203810caa0 0x7f203819e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f2040502640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2038112830 con 0x7f2038103ef0 2024-07-24T22:13:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f2040502640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f20381126b0 con 0x7f203810caa0 2024-07-24T22:13:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f2040502640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f20381129b0 con 0x7f20381034f0 2024-07-24T22:13:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f203da9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2038103ef0 0x7f20381992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f203da9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2038103ef0 0x7f20381992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33454/0 (socket says 172.21.15.47:33454) 2024-07-24T22:13:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f203da9d640 1 -- 172.21.15.47:0/637695047 learned_addr learned my addr 172.21.15.47:0/637695047 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f203e29e640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20381034f0 0x7f2038198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:44.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f203ea9f640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f203810caa0 0x7f203819e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f203da9d640 1 -- 172.21.15.47:0/637695047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20381034f0 msgr2=0x7f2038198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f203da9d640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20381034f0 0x7f2038198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f203da9d640 1 -- 172.21.15.47:0/637695047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f203810caa0 msgr2=0x7f203819e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f203da9d640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f203810caa0 0x7f203819e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f203da9d640 1 -- 172.21.15.47:0/637695047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203819ee50 con 0x7f2038103ef0 2024-07-24T22:13:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f203ea9f640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f203810caa0 0x7f203819e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:13:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.005+0000 7f203da9d640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2038103ef0 0x7f20381992e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f2028005ab0 tx=0x7f2028003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.006+0000 7f202f7fe640 1 -- 172.21.15.47:0/637695047 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202803f070 con 0x7f2038103ef0 2024-07-24T22:13:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.006+0000 7f2040502640 1 -- 172.21.15.47:0/637695047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203819f0e0 con 0x7f2038103ef0 2024-07-24T22:13:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.006+0000 7f202f7fe640 1 -- 172.21.15.47:0/637695047 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2028031d60 con 0x7f2038103ef0 2024-07-24T22:13:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.006+0000 7f202f7fe640 1 -- 172.21.15.47:0/637695047 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028035030 con 0x7f2038103ef0 2024-07-24T22:13:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.006+0000 7f2040502640 1 -- 172.21.15.47:0/637695047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20381a5800 con 0x7f2038103ef0 2024-07-24T22:13:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.007+0000 7f2040502640 1 -- 172.21.15.47:0/637695047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2038103950 con 0x7f2038103ef0 2024-07-24T22:13:44.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.009+0000 7f202f7fe640 1 -- 172.21.15.47:0/637695047 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f2028042070 con 0x7f2038103ef0 2024-07-24T22:13:44.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.010+0000 7f202f7fe640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f20240b3d40 0x7f20240b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:44.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.010+0000 7f203e29e640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f20240b3d40 0x7f20240b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:44.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.010+0000 7f202f7fe640 1 -- 172.21.15.47:0/637695047 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f2028105140 con 0x7f2038103ef0 2024-07-24T22:13:44.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.010+0000 7f203e29e640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f20240b3d40 0x7f20240b6200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2034009890 tx=0x7f2034008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:44.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.013+0000 7f202f7fe640 1 -- 172.21.15.47:0/637695047 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f20280cc3c0 con 0x7f2038103ef0 2024-07-24T22:13:44.062 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:13:44.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.254+0000 7f2040502640 1 -- 172.21.15.47:0/637695047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2038107af0 con 0x7f2038103ef0 2024-07-24T22:13:44.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.255+0000 7f202f7fe640 1 -- 172.21.15.47:0/637695047 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f20280cbcc0 con 0x7f2038103ef0 2024-07-24T22:13:44.257 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:13:44.258 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:13:44.258 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:13:44.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.257+0000 7f2040502640 1 -- 172.21.15.47:0/637695047 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f20240b3d40 msgr2=0x7f20240b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:44.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.257+0000 7f2040502640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f20240b3d40 0x7f20240b6200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2034009890 tx=0x7f2034008040 comp rx=0 tx=0).stop 2024-07-24T22:13:44.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.257+0000 7f2040502640 1 -- 172.21.15.47:0/637695047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2038103ef0 msgr2=0x7f20381992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:44.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.257+0000 7f2040502640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2038103ef0 0x7f20381992e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f2028005ab0 tx=0x7f2028003d50 comp rx=0 tx=0).stop 2024-07-24T22:13:44.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.257+0000 7f2040502640 1 -- 172.21.15.47:0/637695047 shutdown_connections 2024-07-24T22:13:44.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.257+0000 7f2040502640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f20240b3d40 0x7f20240b6200 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:44.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.257+0000 7f2040502640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f203810caa0 0x7f203819e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:44.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.257+0000 7f2040502640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2038103ef0 0x7f20381992e0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:44.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.257+0000 7f2040502640 1 --2- 172.21.15.47:0/637695047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20381034f0 0x7f2038198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:44.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.257+0000 7f2040502640 1 -- 172.21.15.47:0/637695047 >> 172.21.15.47:0/637695047 conn(0x7f20380fd0c0 msgr2=0x7f20380fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:44.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.258+0000 7f2040502640 1 -- 172.21.15.47:0/637695047 shutdown_connections 2024-07-24T22:13:44.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:44.258+0000 7f2040502640 1 -- 172.21.15.47:0/637695047 wait complete. 2024-07-24T22:13:44.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:44 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/637695047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:13:44.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:44 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/637695047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:13:44.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:44 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/637695047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:13:45.120 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:13:45.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:45 smithi188 ceph-mon[37380]: pgmap v564: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.8 KiB/s rd, 6.7 KiB/s wr, 4 op/s 2024-07-24T22:13:45.914 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:45 smithi183 ceph-mon[37007]: pgmap v564: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.8 KiB/s rd, 6.7 KiB/s wr, 4 op/s 2024-07-24T22:13:45.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:45 smithi047 ceph-mon[32551]: pgmap v564: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.8 KiB/s rd, 6.7 KiB/s wr, 4 op/s 2024-07-24T22:13:46.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.538+0000 7f08cc013640 1 -- 172.21.15.47:0/3549393747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4108b20 msgr2=0x7f08c410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:46.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.538+0000 7f08cc013640 1 --2- 172.21.15.47:0/3549393747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4108b20 0x7f08c410f320 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009ca0 tx=0x7f08bc02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:13:46.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.538+0000 7f08cc013640 1 -- 172.21.15.47:0/3549393747 shutdown_connections 2024-07-24T22:13:46.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.538+0000 7f08cc013640 1 --2- 172.21.15.47:0/3549393747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4108b20 0x7f08c410f320 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:46.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.538+0000 7f08cc013640 1 --2- 172.21.15.47:0/3549393747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08c41081a0 0x7f08c41085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:46.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.538+0000 7f08cc013640 1 --2- 172.21.15.47:0/3549393747 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08c4102790 0x7f08c4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:46.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.538+0000 7f08cc013640 1 -- 172.21.15.47:0/3549393747 >> 172.21.15.47:0/3549393747 conn(0x7f08c40fe200 msgr2=0x7f08c4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:46.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.538+0000 7f08cc013640 1 -- 172.21.15.47:0/3549393747 shutdown_connections 2024-07-24T22:13:46.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.538+0000 7f08cc013640 1 -- 172.21.15.47:0/3549393747 wait complete. 2024-07-24T22:13:46.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.539+0000 7f08cc013640 1 Processor -- start 2024-07-24T22:13:46.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.539+0000 7f08cc013640 1 -- start start 2024-07-24T22:13:46.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.539+0000 7f08cc013640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08c4102790 0x7f08c4198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:46.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.539+0000 7f08cc013640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08c41081a0 0x7f08c41991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.539+0000 7f08cc013640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4108b20 0x7f08c419e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.539+0000 7f08cc013640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f08c4112740 con 0x7f08c4108b20 2024-07-24T22:13:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.539+0000 7f08cc013640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f08c41125c0 con 0x7f08c4102790 2024-07-24T22:13:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.539+0000 7f08cc013640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f08c41128c0 con 0x7f08c41081a0 2024-07-24T22:13:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.539+0000 7f08ca5b0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4108b20 0x7f08c419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.539+0000 7f08ca5b0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4108b20 0x7f08c419e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33528/0 (socket says 172.21.15.47:33528) 2024-07-24T22:13:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.539+0000 7f08ca5b0640 1 -- 172.21.15.47:0/1187434120 learned_addr learned my addr 172.21.15.47:0/1187434120 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:46.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.539+0000 7f08c95ae640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08c41081a0 0x7f08c41991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.539+0000 7f08c9daf640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08c4102790 0x7f08c4198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.540+0000 7f08ca5b0640 1 -- 172.21.15.47:0/1187434120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08c41081a0 msgr2=0x7f08c41991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.540+0000 7f08ca5b0640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08c41081a0 0x7f08c41991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.540+0000 7f08ca5b0640 1 -- 172.21.15.47:0/1187434120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08c4102790 msgr2=0x7f08c4198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.540+0000 7f08ca5b0640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08c4102790 0x7f08c4198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.540+0000 7f08ca5b0640 1 -- 172.21.15.47:0/1187434120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c419ed40 con 0x7f08c4108b20 2024-07-24T22:13:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.540+0000 7f08ca5b0640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4108b20 0x7f08c419e570 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f08bc005cc0 tx=0x7f08bc02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.540+0000 7f08baffd640 1 -- 172.21.15.47:0/1187434120 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc003bf0 con 0x7f08c4108b20 2024-07-24T22:13:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.540+0000 7f08baffd640 1 -- 172.21.15.47:0/1187434120 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08bc003d90 con 0x7f08c4108b20 2024-07-24T22:13:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.540+0000 7f08baffd640 1 -- 172.21.15.47:0/1187434120 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc02fbc0 con 0x7f08c4108b20 2024-07-24T22:13:46.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.540+0000 7f08cc013640 1 -- 172.21.15.47:0/1187434120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c419efd0 con 0x7f08c4108b20 2024-07-24T22:13:46.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.540+0000 7f08cc013640 1 -- 172.21.15.47:0/1187434120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c4074d70 con 0x7f08c4108b20 2024-07-24T22:13:46.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.541+0000 7f08cc013640 1 -- 172.21.15.47:0/1187434120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c4102b70 con 0x7f08c4108b20 2024-07-24T22:13:46.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.543+0000 7f08baffd640 1 -- 172.21.15.47:0/1187434120 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f08bc02fd60 con 0x7f08c4108b20 2024-07-24T22:13:46.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.543+0000 7f08baffd640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08b00b3dc0 0x7f08b00b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:46.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.544+0000 7f08c9daf640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08b00b3dc0 0x7f08b00b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:46.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.544+0000 7f08baffd640 1 -- 172.21.15.47:0/1187434120 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f08bc1055b0 con 0x7f08c4108b20 2024-07-24T22:13:46.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.544+0000 7f08c9daf640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08b00b3dc0 0x7f08b00b6280 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f08c00058c0 tx=0x7f08c000a250 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:46.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.548+0000 7f08baffd640 1 -- 172.21.15.47:0/1187434120 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f08bc0cc940 con 0x7f08c4108b20 2024-07-24T22:13:46.585 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:13:46.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.796+0000 7f08cc013640 1 -- 172.21.15.47:0/1187434120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08c410a930 con 0x7f08c4108b20 2024-07-24T22:13:46.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.797+0000 7f08baffd640 1 -- 172.21.15.47:0/1187434120 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f08bc0cc240 con 0x7f08c4108b20 2024-07-24T22:13:46.800 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:13:46.800 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:13:46.800 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:13:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.799+0000 7f08cc013640 1 -- 172.21.15.47:0/1187434120 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08b00b3dc0 msgr2=0x7f08b00b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.799+0000 7f08cc013640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08b00b3dc0 0x7f08b00b6280 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f08c00058c0 tx=0x7f08c000a250 comp rx=0 tx=0).stop 2024-07-24T22:13:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.799+0000 7f08cc013640 1 -- 172.21.15.47:0/1187434120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4108b20 msgr2=0x7f08c419e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:46.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.799+0000 7f08cc013640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4108b20 0x7f08c419e570 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f08bc005cc0 tx=0x7f08bc02f380 comp rx=0 tx=0).stop 2024-07-24T22:13:46.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.799+0000 7f08cc013640 1 -- 172.21.15.47:0/1187434120 shutdown_connections 2024-07-24T22:13:46.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.799+0000 7f08cc013640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f08b00b3dc0 0x7f08b00b6280 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:46.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.799+0000 7f08cc013640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08c4108b20 0x7f08c419e570 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:46.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.799+0000 7f08cc013640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08c41081a0 0x7f08c41991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:46.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.799+0000 7f08cc013640 1 --2- 172.21.15.47:0/1187434120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08c4102790 0x7f08c4198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:46.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.799+0000 7f08cc013640 1 -- 172.21.15.47:0/1187434120 >> 172.21.15.47:0/1187434120 conn(0x7f08c40fe200 msgr2=0x7f08c41005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:46.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.800+0000 7f08cc013640 1 -- 172.21.15.47:0/1187434120 shutdown_connections 2024-07-24T22:13:46.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:46.800+0000 7f08cc013640 1 -- 172.21.15.47:0/1187434120 wait complete. 2024-07-24T22:13:47.582 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db --set-id ca65092d --release --await' 2024-07-24T22:13:47.582 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db --set-id ca65092d --release --await 2024-07-24T22:13:47.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:47 smithi188 ceph-mon[37380]: pgmap v565: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.8 KiB/s rd, 6.7 KiB/s wr, 4 op/s 2024-07-24T22:13:47.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:47 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1187434120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:13:47.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:47 smithi047 ceph-mon[32551]: pgmap v565: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.8 KiB/s rd, 6.7 KiB/s wr, 4 op/s 2024-07-24T22:13:47.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:47 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1187434120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:13:47.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:47 smithi183 ceph-mon[37007]: pgmap v565: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.8 KiB/s rd, 6.7 KiB/s wr, 4 op/s 2024-07-24T22:13:47.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:47 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1187434120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:13:48.606 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:13:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.150+0000 7f2a24b90640 1 -- 172.21.15.47:0/4159633780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a2010cc10 msgr2=0x7f2a2010f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.150+0000 7f2a24b90640 1 --2- 172.21.15.47:0/4159633780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a2010cc10 0x7f2a2010f000 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009ca0 tx=0x7f2a1802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.151+0000 7f2a24b90640 1 -- 172.21.15.47:0/4159633780 shutdown_connections 2024-07-24T22:13:49.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.151+0000 7f2a24b90640 1 --2- 172.21.15.47:0/4159633780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a2010cc10 0x7f2a2010f000 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.151+0000 7f2a24b90640 1 --2- 172.21.15.47:0/4159633780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a2010a2e0 0x7f2a2010c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.151+0000 7f2a24b90640 1 --2- 172.21.15.47:0/4159633780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a201011e0 0x7f2a201015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.151+0000 7f2a24b90640 1 -- 172.21.15.47:0/4159633780 >> 172.21.15.47:0/4159633780 conn(0x7f2a20076730 msgr2=0x7f2a20076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.151+0000 7f2a24b90640 1 -- 172.21.15.47:0/4159633780 shutdown_connections 2024-07-24T22:13:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.151+0000 7f2a24b90640 1 -- 172.21.15.47:0/4159633780 wait complete. 2024-07-24T22:13:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.151+0000 7f2a24b90640 1 Processor -- start 2024-07-24T22:13:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.151+0000 7f2a24b90640 1 -- start start 2024-07-24T22:13:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a24b90640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a201011e0 0x7f2a20198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a24b90640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a2010a2e0 0x7f2a20199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a24b90640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a2010cc10 0x7f2a2019e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a24b90640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2a20112740 con 0x7f2a2010a2e0 2024-07-24T22:13:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a24b90640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201125c0 con 0x7f2a201011e0 2024-07-24T22:13:49.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a24b90640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201128c0 con 0x7f2a2010cc10 2024-07-24T22:13:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a17fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a2010a2e0 0x7f2a20199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a17fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a2010a2e0 0x7f2a20199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33544/0 (socket says 172.21.15.47:33544) 2024-07-24T22:13:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a17fff640 1 -- 172.21.15.47:0/1043397721 learned_addr learned my addr 172.21.15.47:0/1043397721 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a201011e0 0x7f2a20198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a1ed9d640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a2010cc10 0x7f2a2019e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a17fff640 1 -- 172.21.15.47:0/1043397721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a2010cc10 msgr2=0x7f2a2019e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a17fff640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a2010cc10 0x7f2a2019e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a17fff640 1 -- 172.21.15.47:0/1043397721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a201011e0 msgr2=0x7f2a20198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a17fff640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a201011e0 0x7f2a20198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a17fff640 1 -- 172.21.15.47:0/1043397721 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a2019ed80 con 0x7f2a2010a2e0 2024-07-24T22:13:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a1ed9d640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a2010cc10 0x7f2a2019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:13:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a17fff640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a2010a2e0 0x7f2a20199220 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800d770 tx=0x7f2a0800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a177fe640 1 -- 172.21.15.47:0/1043397721 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a08017070 con 0x7f2a2010a2e0 2024-07-24T22:13:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a177fe640 1 -- 172.21.15.47:0/1043397721 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a08009c30 con 0x7f2a2010a2e0 2024-07-24T22:13:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a24b90640 1 -- 172.21.15.47:0/1043397721 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a2019f070 con 0x7f2a2010a2e0 2024-07-24T22:13:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a177fe640 1 -- 172.21.15.47:0/1043397721 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800f620 con 0x7f2a2010a2e0 2024-07-24T22:13:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.152+0000 7f2a24b90640 1 -- 172.21.15.47:0/1043397721 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a201a5730 con 0x7f2a2010a2e0 2024-07-24T22:13:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.155+0000 7f2a279c3740 1 Processor -- start 2024-07-24T22:13:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.155+0000 7f2a177fe640 1 -- 172.21.15.47:0/1043397721 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f2a0801a070 con 0x7f2a2010a2e0 2024-07-24T22:13:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.155+0000 7f2a279c3740 1 -- start start 2024-07-24T22:13:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.155+0000 7f2a279c3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177aabca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.155+0000 7f2a279c3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 0x55c177abc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.155+0000 7f2a279c3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177abe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.155+0000 7f2a279c3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c177a21280 con 0x55c177aab8c0 2024-07-24T22:13:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.155+0000 7f2a279c3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c177a10780 con 0x55c177abc580 2024-07-24T22:13:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.155+0000 7f2a279c3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c177a147c0 con 0x55c177aac1e0 2024-07-24T22:13:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.155+0000 7f2a1ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177aabca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.155+0000 7f2a1ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177aabca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33548/0 (socket says 172.21.15.47:33548) 2024-07-24T22:13:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a1ed9d640 1 -- 172.21.15.47:0/2667565962 learned_addr learned my addr 172.21.15.47:0/2667565962 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/2667565962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 0x55c177abc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a17fff640 1 --2- 172.21.15.47:0/2667565962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177abe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a1ed9d640 1 -- 172.21.15.47:0/2667565962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 msgr2=0x55c177abc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a1ed9d640 1 --2- 172.21.15.47:0/2667565962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 0x55c177abc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a1ed9d640 1 -- 172.21.15.47:0/2667565962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 msgr2=0x55c177abe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a1ed9d640 1 --2- 172.21.15.47:0/2667565962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177abe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a1ed9d640 1 -- 172.21.15.47:0/2667565962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c177774790 con 0x55c177aab8c0 2024-07-24T22:13:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a177fe640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2a0c0b3d40 0x7f2a0c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2a0c0b3d40 0x7f2a0c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a177fe640 1 -- 172.21.15.47:0/1043397721 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f2a080e3b00 con 0x7f2a2010a2e0 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a1ed9d640 1 --2- 172.21.15.47:0/2667565962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177aabca0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2a180098b0 tx=0x7f2a180098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb453217cadf225 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a14ff9640 1 -- 172.21.15.47:0/2667565962 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18031d70 con 0x55c177aab8c0 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a14ff9640 1 -- 172.21.15.47:0/2667565962 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a18036070 con 0x55c177aab8c0 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.156+0000 7f2a14ff9640 1 -- 172.21.15.47:0/2667565962 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a180042b0 con 0x55c177aab8c0 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.157+0000 7f2a279c3740 1 -- 172.21.15.47:0/2667565962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 msgr2=0x55c177aabca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.157+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2a0c0b3d40 0x7f2a0c0b6200 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55c177aafb00 tx=0x7f2a1000a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.157+0000 7f2a279c3740 1 --2- 172.21.15.47:0/2667565962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177aabca0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2a180098b0 tx=0x7f2a180098e0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.157+0000 7f2a279c3740 1 -- 172.21.15.47:0/2667565962 shutdown_connections 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.157+0000 7f2a279c3740 1 --2- 172.21.15.47:0/2667565962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177abe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.157+0000 7f2a279c3740 1 --2- 172.21.15.47:0/2667565962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 0x55c177abc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.157+0000 7f2a279c3740 1 --2- 172.21.15.47:0/2667565962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177aabca0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.157+0000 7f2a279c3740 1 -- 172.21.15.47:0/2667565962 >> 172.21.15.47:0/2667565962 conn(0x55c177aa96f0 msgr2=0x55c177aaa890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.157+0000 7f2a279c3740 1 -- 172.21.15.47:0/2667565962 shutdown_connections 2024-07-24T22:13:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.157+0000 7f2a279c3740 1 -- 172.21.15.47:0/2667565962 wait complete. 2024-07-24T22:13:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a279c3740 1 -- start start 2024-07-24T22:13:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a279c3740 1 Processor -- start 2024-07-24T22:13:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a279c3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aab8c0 0x55c177abbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a279c3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aac1e0 0x55c177ab91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a279c3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177ab96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a279c3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c17794aab0 con 0x55c177aac1e0 2024-07-24T22:13:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a279c3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c1779989e0 con 0x55c177abc580 2024-07-24T22:13:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a279c3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c177abf200 con 0x55c177aab8c0 2024-07-24T22:13:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a279c3740 10 client.0 _ll_register_callbacks cb 0x55c177720a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a17fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aac1e0 0x55c177ab91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a17fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aac1e0 0x55c177ab91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33550/0 (socket says 172.21.15.47:33550) 2024-07-24T22:13:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a17fff640 1 -- 172.21.15.47:0/1990068376 learned_addr learned my addr 172.21.15.47:0/1990068376 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a1ed9d640 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177ab96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aab8c0 0x55c177abbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a17fff640 1 -- 172.21.15.47:0/1990068376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aab8c0 msgr2=0x55c177abbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a17fff640 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aab8c0 0x55c177abbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a17fff640 1 -- 172.21.15.47:0/1990068376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 msgr2=0x55c177ab96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a17fff640 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177ab96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a17fff640 1 -- 172.21.15.47:0/1990068376 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1777ed620 con 0x55c177aac1e0 2024-07-24T22:13:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aab8c0 0x55c177abbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.158+0000 7f2a1ed9d640 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177ab96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a17fff640 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aac1e0 0x55c177ab91b0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2a080a7950 tx=0x7f2a080a65a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f528cdefbf3124fc server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a05ffb640 1 -- 172.21.15.47:0/1990068376 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a08021070 con 0x55c177aac1e0 2024-07-24T22:13:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a05ffb640 1 -- 172.21.15.47:0/1990068376 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f2a080a4e00 con 0x55c177aac1e0 2024-07-24T22:13:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a279c3740 1 -- 172.21.15.47:0/1990068376 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c1779bfce0 con 0x55c177aac1e0 2024-07-24T22:13:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a05ffb640 1 -- 172.21.15.47:0/1990068376 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2a080a9e50 con 0x55c177aac1e0 2024-07-24T22:13:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a279c3740 10 client.16872 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a279c3740 1 -- 172.21.15.47:0/1990068376 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c177aca9f0 con 0x55c177aac1e0 2024-07-24T22:13:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a05ffb640 1 -- 172.21.15.47:0/1990068376 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c1779bfce0 con 0x55c177aac1e0 2024-07-24T22:13:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a05ffb640 1 -- 172.21.15.47:0/1990068376 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2a080cbbe0 con 0x55c177aac1e0 2024-07-24T22:13:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a279c3740 10 client.16872 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a279c3740 10 client.16872 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a279c3740 20 client.16872 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a279c3740 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c177acbeb0 0x55c177ace2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a279c3740 4 client.16872 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:13:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.159+0000 7f2a279c3740 1 -- 172.21.15.47:0/1990068376 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c177a231d0 con 0x55c177acbeb0 2024-07-24T22:13:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.160+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c177acbeb0 0x55c177ace2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.160+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c177acbeb0 0x55c177ace2a0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3468d6994c1f4dee server_cookie=59981b7d3c0a8d47 in_seq=0 out_seq=0 2024-07-24T22:13:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.160+0000 7f2a05ffb640 10 client.16872 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a05ffb640 1 -- 172.21.15.47:0/1990068376 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c177a231d0 con 0x55c177acbeb0 2024-07-24T22:13:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a05ffb640 10 client.16872 handle_command_reply: tid=0 2024-07-24T22:13:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a279c3740 1 client.16872 shutdown 2024-07-24T22:13:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a279c3740 1 -- 172.21.15.47:0/1990068376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aac1e0 msgr2=0x55c177ab91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a279c3740 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aac1e0 0x55c177ab91b0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2a080a7950 tx=0x7f2a080a65a0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a279c3740 1 -- 172.21.15.47:0/1990068376 shutdown_connections 2024-07-24T22:13:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a279c3740 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c177acbeb0 0x55c177ace2a0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a279c3740 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177ab96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a279c3740 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aac1e0 0x55c177ab91b0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a279c3740 1 --2- 172.21.15.47:0/1990068376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aab8c0 0x55c177abbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a05ffb640 0 client.16872 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a279c3740 1 -- 172.21.15.47:0/1990068376 >> 172.21.15.47:0/1990068376 conn(0x55c177aa96f0 msgr2=0x55c177aaf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a279c3740 1 -- 172.21.15.47:0/1990068376 shutdown_connections 2024-07-24T22:13:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a279c3740 1 -- 172.21.15.47:0/1990068376 wait complete. 2024-07-24T22:13:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.161+0000 7f2a279c3740 20 client.16872 trim_cache size 0 max 16384 2024-07-24T22:13:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.176+0000 7f2a279c3740 1 Processor -- start 2024-07-24T22:13:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.176+0000 7f2a279c3740 1 -- start start 2024-07-24T22:13:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a279c3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177ab8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a279c3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 0x55c177abade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a279c3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177aa7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a279c3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201a9f10 con 0x55c177aab8c0 2024-07-24T22:13:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a279c3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201ac750 con 0x55c177abc580 2024-07-24T22:13:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a279c3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201aa560 con 0x55c177aac1e0 2024-07-24T22:13:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177ab8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177ab8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33552/0 (socket says 172.21.15.47:33552) 2024-07-24T22:13:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a1e59c640 1 -- 172.21.15.47:0/1039598390 learned_addr learned my addr 172.21.15.47:0/1039598390 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a1e59c640 1 -- 172.21.15.47:0/1039598390 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 msgr2=0x55c177abade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/1039598390 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 0x55c177abade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a1e59c640 1 -- 172.21.15.47:0/1039598390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 msgr2=0x55c177aa7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/1039598390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177aa7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a1e59c640 1 -- 172.21.15.47:0/1039598390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c177aac010 con 0x55c177aab8c0 2024-07-24T22:13:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/1039598390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177ab8a40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2a100058c0 tx=0x7f2a10019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bff7231cf50f72 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a07fff640 1 -- 172.21.15.47:0/1039598390 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1002c070 con 0x55c177aab8c0 2024-07-24T22:13:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a07fff640 1 -- 172.21.15.47:0/1039598390 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a1001bdc0 con 0x55c177aab8c0 2024-07-24T22:13:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.177+0000 7f2a07fff640 1 -- 172.21.15.47:0/1039598390 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a100307c0 con 0x55c177aab8c0 2024-07-24T22:13:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.178+0000 7f2a279c3740 1 -- 172.21.15.47:0/1039598390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 msgr2=0x55c177ab8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.178+0000 7f2a279c3740 1 --2- 172.21.15.47:0/1039598390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177ab8a40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2a100058c0 tx=0x7f2a10019000 comp rx=0 tx=0).stop 2024-07-24T22:13:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.178+0000 7f2a279c3740 1 -- 172.21.15.47:0/1039598390 shutdown_connections 2024-07-24T22:13:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.178+0000 7f2a279c3740 1 --2- 172.21.15.47:0/1039598390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177aa7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.178+0000 7f2a279c3740 1 --2- 172.21.15.47:0/1039598390 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 0x55c177abade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.178+0000 7f2a279c3740 1 --2- 172.21.15.47:0/1039598390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177ab8a40 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.178+0000 7f2a279c3740 1 -- 172.21.15.47:0/1039598390 >> 172.21.15.47:0/1039598390 conn(0x55c177aa96f0 msgr2=0x55c177aba6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.178+0000 7f2a279c3740 1 -- 172.21.15.47:0/1039598390 shutdown_connections 2024-07-24T22:13:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.178+0000 7f2a279c3740 1 -- 172.21.15.47:0/1039598390 wait complete. 2024-07-24T22:13:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.178+0000 7f2a279c3740 1 -- start start 2024-07-24T22:13:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.178+0000 7f2a279c3740 1 Processor -- start 2024-07-24T22:13:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a279c3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177ad4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a279c3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 0x55c177ac44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a279c3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177ac4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a279c3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201aac10 con 0x55c177aab8c0 2024-07-24T22:13:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a279c3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201ac080 con 0x55c177abc580 2024-07-24T22:13:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a279c3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201ab2e0 con 0x55c177aac1e0 2024-07-24T22:13:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a279c3740 10 client.0 _ll_register_callbacks cb 0x7f2a08010f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177ad4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177ad4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33558/0 (socket says 172.21.15.47:33558) 2024-07-24T22:13:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a1e59c640 1 -- 172.21.15.47:0/2400305333 learned_addr learned my addr 172.21.15.47:0/2400305333 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a1ed9d640 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177ac4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a17fff640 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 0x55c177ac44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a1e59c640 1 -- 172.21.15.47:0/2400305333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 msgr2=0x55c177ac44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 0x55c177ac44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a1e59c640 1 -- 172.21.15.47:0/2400305333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 msgr2=0x55c177ac4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177ac4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a1e59c640 1 -- 172.21.15.47:0/2400305333 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c177ad2ca0 con 0x55c177aab8c0 2024-07-24T22:13:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a1ed9d640 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177ac4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a1e59c640 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177ad4410 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2a100052c0 tx=0x7f2a100052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a921791184a3ae3c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a05ffb640 1 -- 172.21.15.47:0/2400305333 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1002c070 con 0x55c177aab8c0 2024-07-24T22:13:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a05ffb640 1 -- 172.21.15.47:0/2400305333 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f2a100048c0 con 0x55c177aab8c0 2024-07-24T22:13:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.179+0000 7f2a279c3740 1 -- 172.21.15.47:0/2400305333 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a1001bdc0 con 0x55c177aab8c0 2024-07-24T22:13:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.180+0000 7f2a05ffb640 1 -- 172.21.15.47:0/2400305333 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2a10004ac0 con 0x55c177aab8c0 2024-07-24T22:13:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.180+0000 7f2a279c3740 10 client.16878 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.180+0000 7f2a279c3740 1 -- 172.21.15.47:0/2400305333 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c177b35f60 con 0x55c177aab8c0 2024-07-24T22:13:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.180+0000 7f2a05ffb640 1 -- 172.21.15.47:0/2400305333 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a1001bdc0 con 0x55c177aab8c0 2024-07-24T22:13:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.180+0000 7f2a05ffb640 1 -- 172.21.15.47:0/2400305333 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2a10040070 con 0x55c177aab8c0 2024-07-24T22:13:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.180+0000 7f2a279c3740 10 client.16878 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.180+0000 7f2a279c3740 10 client.16878 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.180+0000 7f2a279c3740 20 client.16878 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.180+0000 7f2a279c3740 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c177b36570 0x55c177b38990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.180+0000 7f2a279c3740 4 client.16878 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:13:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.180+0000 7f2a279c3740 1 -- 172.21.15.47:0/2400305333 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c177a1ec70 con 0x55c177b36570 2024-07-24T22:13:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.180+0000 7f2a17fff640 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c177b36570 0x55c177b38990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.181+0000 7f2a05ffb640 10 client.16878 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.181+0000 7f2a17fff640 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c177b36570 0x55c177b38990 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdb46cf029ea6565 server_cookie=60401e2421f6cd61 in_seq=0 out_seq=0 2024-07-24T22:13:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a05ffb640 1 -- 172.21.15.47:0/2400305333 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c177a1ec70 con 0x55c177b36570 2024-07-24T22:13:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a05ffb640 10 client.16878 handle_command_reply: tid=0 2024-07-24T22:13:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a279c3740 1 client.16878 shutdown 2024-07-24T22:13:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a279c3740 1 -- 172.21.15.47:0/2400305333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 msgr2=0x55c177ad4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a279c3740 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177ad4410 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2a100052c0 tx=0x7f2a100052f0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a279c3740 1 -- 172.21.15.47:0/2400305333 shutdown_connections 2024-07-24T22:13:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a279c3740 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c177b36570 0x55c177b38990 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a279c3740 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c177abc580 0x55c177ac4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a279c3740 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c177aac1e0 0x55c177ac44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a05ffb640 0 client.16878 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a279c3740 1 --2- 172.21.15.47:0/2400305333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c177aab8c0 0x55c177ad4410 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a279c3740 1 -- 172.21.15.47:0/2400305333 >> 172.21.15.47:0/2400305333 conn(0x55c177aa96f0 msgr2=0x55c177aaf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a279c3740 1 -- 172.21.15.47:0/2400305333 shutdown_connections 2024-07-24T22:13:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.189+0000 7f2a279c3740 1 -- 172.21.15.47:0/2400305333 wait complete. 2024-07-24T22:13:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.190+0000 7f2a279c3740 20 client.16878 trim_cache size 0 max 16384 2024-07-24T22:13:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:13:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:13:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:13:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:13:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.190+0000 7f2a24b90640 1 -- 172.21.15.47:0/1043397721 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2a0c0b3d40 msgr2=0x7f2a0c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.190+0000 7f2a24b90640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2a0c0b3d40 0x7f2a0c0b6200 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55c177aafb00 tx=0x7f2a1000a2d0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.190+0000 7f2a24b90640 1 -- 172.21.15.47:0/1043397721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a2010a2e0 msgr2=0x7f2a20199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.190+0000 7f2a24b90640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a2010a2e0 0x7f2a20199220 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800d770 tx=0x7f2a0800dc30 comp rx=0 tx=0).stop 2024-07-24T22:13:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.190+0000 7f2a24b90640 1 -- 172.21.15.47:0/1043397721 shutdown_connections 2024-07-24T22:13:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.190+0000 7f2a24b90640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f2a0c0b3d40 0x7f2a0c0b6200 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.190+0000 7f2a24b90640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a2010cc10 0x7f2a2019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.190+0000 7f2a24b90640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a2010a2e0 0x7f2a20199220 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.190+0000 7f2a24b90640 1 --2- 172.21.15.47:0/1043397721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a201011e0 0x7f2a20198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.190+0000 7f2a24b90640 1 -- 172.21.15.47:0/1043397721 >> 172.21.15.47:0/1043397721 conn(0x7f2a20076730 msgr2=0x7f2a200fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.190+0000 7f2a24b90640 1 -- 172.21.15.47:0/1043397721 shutdown_connections 2024-07-24T22:13:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:13:49.190+0000 7f2a24b90640 1 -- 172.21.15.47:0/1043397721 wait complete. 2024-07-24T22:13:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.289+0000 7faa0a9ef640 1 -- 172.21.15.47:0/3991525493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa04101690 msgr2=0x7faa04101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.289+0000 7faa0a9ef640 1 --2- 172.21.15.47:0/3991525493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa04101690 0x7faa04101a70 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009900 tx=0x7fa9f402a410 comp rx=0 tx=0).stop 2024-07-24T22:13:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.289+0000 7faa0a9ef640 1 -- 172.21.15.47:0/3991525493 shutdown_connections 2024-07-24T22:13:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.289+0000 7faa0a9ef640 1 --2- 172.21.15.47:0/3991525493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa04107a20 0x7faa0410e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.289+0000 7faa0a9ef640 1 --2- 172.21.15.47:0/3991525493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa041070a0 0x7faa041074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.289+0000 7faa0a9ef640 1 --2- 172.21.15.47:0/3991525493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa04101690 0x7faa04101a70 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.289+0000 7faa0a9ef640 1 -- 172.21.15.47:0/3991525493 >> 172.21.15.47:0/3991525493 conn(0x7faa040fd100 msgr2=0x7faa040ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.289+0000 7faa0a9ef640 1 -- 172.21.15.47:0/3991525493 shutdown_connections 2024-07-24T22:13:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.289+0000 7faa0a9ef640 1 -- 172.21.15.47:0/3991525493 wait complete. 2024-07-24T22:13:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.290+0000 7faa0a9ef640 1 Processor -- start 2024-07-24T22:13:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.290+0000 7faa0a9ef640 1 -- start start 2024-07-24T22:13:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa0a9ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa04101690 0x7faa0419adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa0a9ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa041070a0 0x7faa0419b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa0a9ef640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa04107a20 0x7faa041a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa0a9ef640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa04111630 con 0x7faa041070a0 2024-07-24T22:13:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa0a9ef640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faa041114b0 con 0x7faa04107a20 2024-07-24T22:13:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa0a9ef640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faa041117b0 con 0x7faa04101690 2024-07-24T22:13:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa037fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa041070a0 0x7faa0419b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa037fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa041070a0 0x7faa0419b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33566/0 (socket says 172.21.15.47:33566) 2024-07-24T22:13:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa037fe640 1 -- 172.21.15.47:0/211030413 learned_addr learned my addr 172.21.15.47:0/211030413 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa03fff640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa04101690 0x7faa0419adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa08f8c640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa04107a20 0x7faa041a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa037fe640 1 -- 172.21.15.47:0/211030413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa04101690 msgr2=0x7faa0419adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa037fe640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa04101690 0x7faa0419adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa037fe640 1 -- 172.21.15.47:0/211030413 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa04107a20 msgr2=0x7faa041a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa037fe640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa04107a20 0x7faa041a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa037fe640 1 -- 172.21.15.47:0/211030413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa041a0e70 con 0x7faa041070a0 2024-07-24T22:13:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa037fe640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa041070a0 0x7faa0419b300 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00cce0 tx=0x7fa9fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.291+0000 7faa017fa640 1 -- 172.21.15.47:0/211030413 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc00f650 con 0x7faa041070a0 2024-07-24T22:13:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.292+0000 7faa017fa640 1 -- 172.21.15.47:0/211030413 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9fc00fca0 con 0x7faa041070a0 2024-07-24T22:13:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.292+0000 7faa0a9ef640 1 -- 172.21.15.47:0/211030413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa041a1160 con 0x7faa041070a0 2024-07-24T22:13:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.292+0000 7faa017fa640 1 -- 172.21.15.47:0/211030413 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc018b40 con 0x7faa041070a0 2024-07-24T22:13:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.292+0000 7faa0a9ef640 1 -- 172.21.15.47:0/211030413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa041a7820 con 0x7faa041070a0 2024-07-24T22:13:49.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.294+0000 7faa017fa640 1 -- 172.21.15.47:0/211030413 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fa9fc018d00 con 0x7faa041070a0 2024-07-24T22:13:49.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.294+0000 7faa0cda0740 1 Processor -- start 2024-07-24T22:13:49.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.294+0000 7faa0cda0740 1 -- start start 2024-07-24T22:13:49.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.294+0000 7faa0cda0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd50ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.294+0000 7faa0cda0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd50ff0 0x56406dd5ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.294+0000 7faa0cda0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd5cf80 0x56406dd5f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa0cda0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56406dcc79b0 con 0x56406dd506d0 2024-07-24T22:13:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa0cda0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56406dcb6eb0 con 0x56406dd50ff0 2024-07-24T22:13:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa0cda0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56406dcbaef0 con 0x56406dd5cf80 2024-07-24T22:13:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa08f8c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd50ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa08f8c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd50ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33572/0 (socket says 172.21.15.47:33572) 2024-07-24T22:13:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa08f8c640 1 -- 172.21.15.47:0/728798852 learned_addr learned my addr 172.21.15.47:0/728798852 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa03fff640 1 --2- 172.21.15.47:0/728798852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd50ff0 0x56406dd5ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa037fe640 1 --2- 172.21.15.47:0/728798852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd5cf80 0x56406dd5f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa017fa640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa9f00b3d40 0x7fa9f00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa03fff640 1 -- 172.21.15.47:0/728798852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd5cf80 msgr2=0x56406dd5f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa03fff640 1 --2- 172.21.15.47:0/728798852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd5cf80 0x56406dd5f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa03fff640 1 -- 172.21.15.47:0/728798852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 msgr2=0x56406dd50ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa03fff640 1 --2- 172.21.15.47:0/728798852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd50ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa03fff640 1 -- 172.21.15.47:0/728798852 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56406dc40320 con 0x56406dd50ff0 2024-07-24T22:13:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa08f8c640 1 --2- 172.21.15.47:0/728798852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd50ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa017fa640 1 -- 172.21.15.47:0/211030413 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7fa9fc0e44a0 con 0x7faa041070a0 2024-07-24T22:13:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.295+0000 7faa08f8c640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa9f00b3d40 0x7fa9f00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.296+0000 7faa03fff640 1 --2- 172.21.15.47:0/728798852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd50ff0 0x56406dd5ca40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009230 tx=0x7fa9f4032e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9396fa456bb84b86 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.296+0000 7fa9fa7fc640 1 -- 172.21.15.47:0/728798852 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4040070 con 0x56406dd50ff0 2024-07-24T22:13:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.296+0000 7faa08f8c640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa9f00b3d40 0x7fa9f00b6200 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00ba00 tx=0x7fa9ec0046c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.296+0000 7fa9fa7fc640 1 -- 172.21.15.47:0/728798852 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9f40316a0 con 0x56406dd50ff0 2024-07-24T22:13:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.296+0000 7fa9fa7fc640 1 -- 172.21.15.47:0/728798852 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4035040 con 0x56406dd50ff0 2024-07-24T22:13:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.297+0000 7faa0cda0740 1 -- 172.21.15.47:0/728798852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd50ff0 msgr2=0x56406dd5ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.297+0000 7faa0cda0740 1 --2- 172.21.15.47:0/728798852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd50ff0 0x56406dd5ca40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009230 tx=0x7fa9f4032e60 comp rx=0 tx=0).stop 2024-07-24T22:13:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.297+0000 7faa0cda0740 1 -- 172.21.15.47:0/728798852 shutdown_connections 2024-07-24T22:13:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.297+0000 7faa0cda0740 1 --2- 172.21.15.47:0/728798852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd5cf80 0x56406dd5f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.297+0000 7faa0cda0740 1 --2- 172.21.15.47:0/728798852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd50ff0 0x56406dd5ca40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.297+0000 7faa0cda0740 1 --2- 172.21.15.47:0/728798852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd50ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.297+0000 7faa0cda0740 1 -- 172.21.15.47:0/728798852 >> 172.21.15.47:0/728798852 conn(0x56406dd4e500 msgr2=0x56406dd4f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.297+0000 7faa0cda0740 1 -- 172.21.15.47:0/728798852 shutdown_connections 2024-07-24T22:13:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.297+0000 7faa0cda0740 1 -- 172.21.15.47:0/728798852 wait complete. 2024-07-24T22:13:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.297+0000 7faa0cda0740 1 -- start start 2024-07-24T22:13:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.297+0000 7faa0cda0740 1 Processor -- start 2024-07-24T22:13:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.297+0000 7faa0cda0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd59f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa0cda0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd50ff0 0x56406dd5a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa0cda0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd5cf80 0x56406dd5a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa0cda0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56406db1a700 con 0x56406dd506d0 2024-07-24T22:13:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa0cda0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56406dc595f0 con 0x56406dd50ff0 2024-07-24T22:13:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa0cda0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56406dd5fba0 con 0x56406dd5cf80 2024-07-24T22:13:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa0cda0740 10 client.0 _ll_register_callbacks cb 0x56406dc79960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa03fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd59f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa03fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd59f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33580/0 (socket says 172.21.15.47:33580) 2024-07-24T22:13:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa03fff640 1 -- 172.21.15.47:0/1246361805 learned_addr learned my addr 172.21.15.47:0/1246361805 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa08f8c640 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd5cf80 0x56406dd5a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa037fe640 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd50ff0 0x56406dd5a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa03fff640 1 -- 172.21.15.47:0/1246361805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd5cf80 msgr2=0x56406dd5a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa03fff640 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd5cf80 0x56406dd5a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa03fff640 1 -- 172.21.15.47:0/1246361805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd50ff0 msgr2=0x56406dd5a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa03fff640 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd50ff0 0x56406dd5a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa03fff640 1 -- 172.21.15.47:0/1246361805 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56406dc4c680 con 0x56406dd506d0 2024-07-24T22:13:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa037fe640 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd50ff0 0x56406dd5a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:13:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa08f8c640 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd5cf80 0x56406dd5a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:13:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa03fff640 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd59f10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4006010 tx=0x7fa9f402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc176d327ba9c9ef server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7fa9e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7fa9e37fe640 1 -- 172.21.15.47:0/1246361805 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f404d060 con 0x56406dd506d0 2024-07-24T22:13:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7fa9e37fe640 1 -- 172.21.15.47:0/1246361805 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7fa9f4031d10 con 0x56406dd506d0 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.298+0000 7faa0cda0740 1 -- 172.21.15.47:0/1246361805 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9f40316a0 con 0x56406dd506d0 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.299+0000 7fa9e37fe640 1 -- 172.21.15.47:0/1246361805 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa9f4040070 con 0x56406dd506d0 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.299+0000 7faa0cda0740 10 client.16890 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.299+0000 7faa0cda0740 1 -- 172.21.15.47:0/1246361805 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56406da17650 con 0x56406dd506d0 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.299+0000 7fa9e37fe640 1 -- 172.21.15.47:0/1246361805 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9f40316a0 con 0x56406dd506d0 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.299+0000 7fa9e37fe640 1 -- 172.21.15.47:0/1246361805 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa9f4003c00 con 0x56406dd506d0 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.299+0000 7faa0cda0740 10 client.16890 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.299+0000 7faa0cda0740 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.299+0000 7faa0cda0740 20 client.16890 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.299+0000 7faa0cda0740 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56406dd6c8b0 0x56406dd6eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.299+0000 7faa0cda0740 4 client.16890 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.299+0000 7faa0cda0740 1 -- 172.21.15.47:0/1246361805 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56406dcc9900 con 0x56406dd6c8b0 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.299+0000 7faa037fe640 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56406dd6c8b0 0x56406dd6eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.300+0000 7faa037fe640 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56406dd6c8b0 0x56406dd6eca0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca034ff596e31d2b server_cookie=30db20e2c12c6008 in_seq=0 out_seq=0 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.300+0000 7fa9e37fe640 10 client.16890 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.300+0000 7fa9e37fe640 1 -- 172.21.15.47:0/1246361805 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56406dcc9900 con 0x56406dd6c8b0 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.300+0000 7fa9e37fe640 10 client.16890 handle_command_reply: tid=0 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.300+0000 7faa0cda0740 1 client.16890 shutdown 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.301+0000 7faa0cda0740 1 -- 172.21.15.47:0/1246361805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 msgr2=0x56406dd59f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.301+0000 7faa0cda0740 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd59f10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4006010 tx=0x7fa9f402a410 comp rx=0 tx=0).stop 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.301+0000 7faa0cda0740 1 -- 172.21.15.47:0/1246361805 shutdown_connections 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.301+0000 7faa0cda0740 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56406dd6c8b0 0x56406dd6eca0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.301+0000 7faa0cda0740 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd5cf80 0x56406dd5a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.301+0000 7faa0cda0740 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd50ff0 0x56406dd5a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.301+0000 7faa0cda0740 1 --2- 172.21.15.47:0/1246361805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd59f10 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.301+0000 7faa0cda0740 1 -- 172.21.15.47:0/1246361805 >> 172.21.15.47:0/1246361805 conn(0x56406dd4e500 msgr2=0x56406dd540a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.301+0000 7fa9e37fe640 0 client.16890 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.301+0000 7faa0cda0740 1 -- 172.21.15.47:0/1246361805 shutdown_connections 2024-07-24T22:13:49.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.301+0000 7faa0cda0740 1 -- 172.21.15.47:0/1246361805 wait complete. 2024-07-24T22:13:49.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.301+0000 7faa0cda0740 20 client.16890 trim_cache size 0 max 16384 2024-07-24T22:13:49.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.314+0000 7faa0cda0740 1 Processor -- start 2024-07-24T22:13:49.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa0cda0740 1 -- start start 2024-07-24T22:13:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa0cda0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd57120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa0cda0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd50ff0 0x56406dd57660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa0cda0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd5cf80 0x56406dd67e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa0cda0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa041ae330 con 0x56406dd506d0 2024-07-24T22:13:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa0cda0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faa041b0b90 con 0x56406dd5cf80 2024-07-24T22:13:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa0cda0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faa041ae980 con 0x56406dd50ff0 2024-07-24T22:13:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa03fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd57120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa03fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd57120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33584/0 (socket says 172.21.15.47:33584) 2024-07-24T22:13:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa03fff640 1 -- 172.21.15.47:0/3565109911 learned_addr learned my addr 172.21.15.47:0/3565109911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa037fe640 1 --2- 172.21.15.47:0/3565109911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd50ff0 0x56406dd57660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa03fff640 1 -- 172.21.15.47:0/3565109911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd50ff0 msgr2=0x56406dd57660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa08f8c640 1 --2- 172.21.15.47:0/3565109911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd5cf80 0x56406dd67e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa03fff640 1 --2- 172.21.15.47:0/3565109911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd50ff0 0x56406dd57660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa03fff640 1 -- 172.21.15.47:0/3565109911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd5cf80 msgr2=0x56406dd67e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa03fff640 1 --2- 172.21.15.47:0/3565109911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd5cf80 0x56406dd67e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa03fff640 1 -- 172.21.15.47:0/3565109911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56406dd5f6b0 con 0x56406dd506d0 2024-07-24T22:13:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa08f8c640 1 --2- 172.21.15.47:0/3565109911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd5cf80 0x56406dd67e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:13:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.315+0000 7faa03fff640 1 --2- 172.21.15.47:0/3565109911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd57120 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa9f402ab40 tx=0x7fa9f402ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f447bfc3d3e2875d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.316+0000 7fa9f9ffb640 1 -- 172.21.15.47:0/3565109911 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f404d070 con 0x56406dd506d0 2024-07-24T22:13:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.316+0000 7fa9f9ffb640 1 -- 172.21.15.47:0/3565109911 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9f40314a0 con 0x56406dd506d0 2024-07-24T22:13:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.316+0000 7fa9f9ffb640 1 -- 172.21.15.47:0/3565109911 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4035040 con 0x56406dd506d0 2024-07-24T22:13:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.316+0000 7faa0cda0740 1 -- 172.21.15.47:0/3565109911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 msgr2=0x56406dd57120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.316+0000 7faa0cda0740 1 --2- 172.21.15.47:0/3565109911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd57120 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa9f402ab40 tx=0x7fa9f402ab70 comp rx=0 tx=0).stop 2024-07-24T22:13:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.316+0000 7faa0cda0740 1 -- 172.21.15.47:0/3565109911 shutdown_connections 2024-07-24T22:13:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.316+0000 7faa0cda0740 1 --2- 172.21.15.47:0/3565109911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd5cf80 0x56406dd67e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.316+0000 7faa0cda0740 1 --2- 172.21.15.47:0/3565109911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd50ff0 0x56406dd57660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.316+0000 7faa0cda0740 1 --2- 172.21.15.47:0/3565109911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd57120 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.316+0000 7faa0cda0740 1 -- 172.21.15.47:0/3565109911 >> 172.21.15.47:0/3565109911 conn(0x56406dd4e500 msgr2=0x56406dd551c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.316+0000 7faa0cda0740 1 -- 172.21.15.47:0/3565109911 shutdown_connections 2024-07-24T22:13:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.316+0000 7faa0cda0740 1 -- 172.21.15.47:0/3565109911 wait complete. 2024-07-24T22:13:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa0cda0740 1 -- start start 2024-07-24T22:13:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa0cda0740 1 Processor -- start 2024-07-24T22:13:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa0cda0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd6f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa0cda0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd50ff0 0x56406dd6f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa0cda0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd5cf80 0x56406ddcf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa0cda0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa041af050 con 0x56406dd506d0 2024-07-24T22:13:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa0cda0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faa041b04c0 con 0x56406dd5cf80 2024-07-24T22:13:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa0cda0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faa041af720 con 0x56406dd50ff0 2024-07-24T22:13:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa0cda0740 10 client.0 _ll_register_callbacks cb 0x7fa9ec004160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa03fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd6f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa03fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd6f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33596/0 (socket says 172.21.15.47:33596) 2024-07-24T22:13:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa03fff640 1 -- 172.21.15.47:0/1348150293 learned_addr learned my addr 172.21.15.47:0/1348150293 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa037fe640 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd50ff0 0x56406dd6f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.317+0000 7faa08f8c640 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd5cf80 0x56406ddcf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7faa03fff640 1 -- 172.21.15.47:0/1348150293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd50ff0 msgr2=0x56406dd6f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7faa03fff640 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd50ff0 0x56406dd6f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7faa03fff640 1 -- 172.21.15.47:0/1348150293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd5cf80 msgr2=0x56406ddcf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:49.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7faa03fff640 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd5cf80 0x56406ddcf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7faa03fff640 1 -- 172.21.15.47:0/1348150293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56406ddcf930 con 0x56406dd506d0 2024-07-24T22:13:49.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7faa08f8c640 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd5cf80 0x56406ddcf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:49.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7faa03fff640 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd6f210 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009850 tx=0x7fa9f403c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9533421a5d51c7 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:49.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7fa9e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:49.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7fa9e37fe640 1 -- 172.21.15.47:0/1348150293 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4062060 con 0x56406dd506d0 2024-07-24T22:13:49.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7fa9e37fe640 1 -- 172.21.15.47:0/1348150293 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7fa9f403cc00 con 0x56406dd506d0 2024-07-24T22:13:49.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7faa0cda0740 1 -- 172.21.15.47:0/1348150293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9f40314a0 con 0x56406dd506d0 2024-07-24T22:13:49.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7fa9e37fe640 1 -- 172.21.15.47:0/1348150293 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa9f404d030 con 0x56406dd506d0 2024-07-24T22:13:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7faa0cda0740 10 client.16896 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7faa0cda0740 1 -- 172.21.15.47:0/1348150293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56406ddd6d30 con 0x56406dd506d0 2024-07-24T22:13:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.318+0000 7fa9e37fe640 1 -- 172.21.15.47:0/1348150293 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9f40314a0 con 0x56406dd506d0 2024-07-24T22:13:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.319+0000 7fa9e37fe640 1 -- 172.21.15.47:0/1348150293 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa9f4003990 con 0x56406dd506d0 2024-07-24T22:13:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.319+0000 7faa0cda0740 10 client.16896 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.319+0000 7faa0cda0740 10 client.16896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.319+0000 7faa0cda0740 20 client.16896 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.319+0000 7faa0cda0740 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56406ddd7360 0x56406ddd9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.319+0000 7faa0cda0740 4 client.16896 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:13:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.319+0000 7faa0cda0740 1 -- 172.21.15.47:0/1348150293 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56406dcc53a0 con 0x56406ddd7360 2024-07-24T22:13:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.319+0000 7faa037fe640 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56406ddd7360 0x56406ddd9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.319+0000 7faa037fe640 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56406ddd7360 0x56406ddd9780 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=644d7be524cdae53 server_cookie=cbbe852ae33ae0e9 in_seq=0 out_seq=0 2024-07-24T22:13:49.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.319+0000 7fa9e37fe640 10 client.16896 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.319+0000 7fa9e37fe640 1 -- 172.21.15.47:0/1348150293 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56406dcc53a0 con 0x56406ddd7360 2024-07-24T22:13:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.319+0000 7fa9e37fe640 10 client.16896 handle_command_reply: tid=0 2024-07-24T22:13:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.319+0000 7faa0cda0740 1 client.16896 shutdown 2024-07-24T22:13:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0cda0740 1 -- 172.21.15.47:0/1348150293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 msgr2=0x56406dd6f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0cda0740 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd6f210 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009850 tx=0x7fa9f403c910 comp rx=0 tx=0).stop 2024-07-24T22:13:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0cda0740 1 -- 172.21.15.47:0/1348150293 shutdown_connections 2024-07-24T22:13:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0cda0740 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56406ddd7360 0x56406ddd9780 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0cda0740 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56406dd5cf80 0x56406ddcf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0cda0740 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56406dd50ff0 0x56406dd6f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7fa9e37fe640 0 client.16896 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0cda0740 1 --2- 172.21.15.47:0/1348150293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56406dd506d0 0x56406dd6f210 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0cda0740 1 -- 172.21.15.47:0/1348150293 >> 172.21.15.47:0/1348150293 conn(0x56406dd4e500 msgr2=0x56406dd53810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:49.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0cda0740 1 -- 172.21.15.47:0/1348150293 shutdown_connections 2024-07-24T22:13:49.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0cda0740 1 -- 172.21.15.47:0/1348150293 wait complete. 2024-07-24T22:13:49.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0cda0740 20 client.16896 trim_cache size 0 max 16384 2024-07-24T22:13:49.328 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:13:49.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0a9ef640 1 -- 172.21.15.47:0/211030413 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa9f00b3d40 msgr2=0x7fa9f00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0a9ef640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa9f00b3d40 0x7fa9f00b6200 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00ba00 tx=0x7fa9ec0046c0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0a9ef640 1 -- 172.21.15.47:0/211030413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa041070a0 msgr2=0x7faa0419b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.320+0000 7faa0a9ef640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa041070a0 0x7faa0419b300 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00cce0 tx=0x7fa9fc00a620 comp rx=0 tx=0).stop 2024-07-24T22:13:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.321+0000 7faa0a9ef640 1 -- 172.21.15.47:0/211030413 shutdown_connections 2024-07-24T22:13:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.321+0000 7faa0a9ef640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa9f00b3d40 0x7fa9f00b6200 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.321+0000 7faa0a9ef640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa04107a20 0x7faa041a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.321+0000 7faa0a9ef640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa041070a0 0x7faa0419b300 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.321+0000 7faa0a9ef640 1 --2- 172.21.15.47:0/211030413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa04101690 0x7faa0419adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.321+0000 7faa0a9ef640 1 -- 172.21.15.47:0/211030413 >> 172.21.15.47:0/211030413 conn(0x7faa040fd100 msgr2=0x7faa0406aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.321+0000 7faa0a9ef640 1 -- 172.21.15.47:0/211030413 shutdown_connections 2024-07-24T22:13:49.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:49.321+0000 7faa0a9ef640 1 -- 172.21.15.47:0/211030413 wait complete. 2024-07-24T22:13:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:49 smithi188 ceph-mon[37380]: pgmap v566: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.9 KiB/s rd, 7.3 KiB/s wr, 5 op/s 2024-07-24T22:13:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:49 smithi183 ceph-mon[37007]: pgmap v566: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.9 KiB/s rd, 7.3 KiB/s wr, 5 op/s 2024-07-24T22:13:49.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:49 smithi047 ceph-mon[32551]: pgmap v566: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.9 KiB/s rd, 7.3 KiB/s wr, 5 op/s 2024-07-24T22:13:51.103 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:13:51.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:13:51.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.503+0000 7f152ca5d640 1 -- 172.21.15.47:0/971199565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1528108950 msgr2=0x7f152810f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:51.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.503+0000 7f152ca5d640 1 --2- 172.21.15.47:0/971199565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1528108950 0x7f152810f150 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1520009900 tx=0x7f152002a410 comp rx=0 tx=0).stop 2024-07-24T22:13:51.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.503+0000 7f152ca5d640 1 -- 172.21.15.47:0/971199565 shutdown_connections 2024-07-24T22:13:51.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.503+0000 7f152ca5d640 1 --2- 172.21.15.47:0/971199565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1528108950 0x7f152810f150 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.503+0000 7f152ca5d640 1 --2- 172.21.15.47:0/971199565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1528107fd0 0x7f1528108410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.503+0000 7f152ca5d640 1 --2- 172.21.15.47:0/971199565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15281025c0 0x7f15281029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.503+0000 7f152ca5d640 1 -- 172.21.15.47:0/971199565 >> 172.21.15.47:0/971199565 conn(0x7f15280fe050 msgr2=0x7f1528100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:51.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.503+0000 7f152ca5d640 1 -- 172.21.15.47:0/971199565 shutdown_connections 2024-07-24T22:13:51.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.503+0000 7f152ca5d640 1 -- 172.21.15.47:0/971199565 wait complete. 2024-07-24T22:13:51.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.503+0000 7f152ca5d640 1 Processor -- start 2024-07-24T22:13:51.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f152ca5d640 1 -- start start 2024-07-24T22:13:51.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f152ca5d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15281025c0 0x7f1528198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f152ca5d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1528107fd0 0x7f1528198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f152ca5d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1528108950 0x7f152819e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f152ca5d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1528112580 con 0x7f15281025c0 2024-07-24T22:13:51.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f152ca5d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1528112400 con 0x7f1528107fd0 2024-07-24T22:13:51.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f152ca5d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1528112700 con 0x7f1528108950 2024-07-24T22:13:51.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f1526d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15281025c0 0x7f1528198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f1526d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15281025c0 0x7f1528198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33620/0 (socket says 172.21.15.47:33620) 2024-07-24T22:13:51.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f1526d9d640 1 -- 172.21.15.47:0/1013388501 learned_addr learned my addr 172.21.15.47:0/1013388501 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:51.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f152759e640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1528108950 0x7f152819e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f152659c640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1528107fd0 0x7f1528198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f1526d9d640 1 -- 172.21.15.47:0/1013388501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1528108950 msgr2=0x7f152819e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:51.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f1526d9d640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1528108950 0x7f152819e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f1526d9d640 1 -- 172.21.15.47:0/1013388501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1528107fd0 msgr2=0x7f1528198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:51.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f1526d9d640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1528107fd0 0x7f1528198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f1526d9d640 1 -- 172.21.15.47:0/1013388501 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152819ea40 con 0x7f15281025c0 2024-07-24T22:13:51.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.504+0000 7f152659c640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1528107fd0 0x7f1528198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:51.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.505+0000 7f1526d9d640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15281025c0 0x7f1528198990 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f151800ea80 tx=0x7f151800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:51.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.505+0000 7f150ffff640 1 -- 172.21.15.47:0/1013388501 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151800ce40 con 0x7f15281025c0 2024-07-24T22:13:51.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.505+0000 7f152ca5d640 1 -- 172.21.15.47:0/1013388501 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152819ed30 con 0x7f15281025c0 2024-07-24T22:13:51.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.505+0000 7f150ffff640 1 -- 172.21.15.47:0/1013388501 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1518005020 con 0x7f15281025c0 2024-07-24T22:13:51.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.505+0000 7f150ffff640 1 -- 172.21.15.47:0/1013388501 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15180116d0 con 0x7f15281025c0 2024-07-24T22:13:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.505+0000 7f152ca5d640 1 -- 172.21.15.47:0/1013388501 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15281a53f0 con 0x7f15281025c0 2024-07-24T22:13:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.507+0000 7f150ffff640 1 -- 172.21.15.47:0/1013388501 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f15180054d0 con 0x7f15281025c0 2024-07-24T22:13:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.507+0000 7f152f60f740 1 Processor -- start 2024-07-24T22:13:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.507+0000 7f152f60f740 1 -- start start 2024-07-24T22:13:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152f60f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 0x5611fa230ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152f60f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa231530 0x5611fa241390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152f60f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa2418d0 0x5611fa243cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152f60f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5611fa1a7dd0 con 0x5611fa230c10 2024-07-24T22:13:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152f60f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5611fa1972d0 con 0x5611fa2418d0 2024-07-24T22:13:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152f60f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5611fa19b310 con 0x5611fa231530 2024-07-24T22:13:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 0x5611fa230ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 0x5611fa230ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33628/0 (socket says 172.21.15.47:33628) 2024-07-24T22:13:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152759e640 1 -- 172.21.15.47:0/3395604241 learned_addr learned my addr 172.21.15.47:0/3395604241 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f1526d9d640 1 --2- 172.21.15.47:0/3395604241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa231530 0x5611fa241390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152659c640 1 --2- 172.21.15.47:0/3395604241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa2418d0 0x5611fa243cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152759e640 1 -- 172.21.15.47:0/3395604241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa231530 msgr2=0x5611fa241390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152759e640 1 --2- 172.21.15.47:0/3395604241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa231530 0x5611fa241390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152759e640 1 -- 172.21.15.47:0/3395604241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa2418d0 msgr2=0x5611fa243cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152759e640 1 --2- 172.21.15.47:0/3395604241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa2418d0 0x5611fa243cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152759e640 1 -- 172.21.15.47:0/3395604241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611f9ef7b00 con 0x5611fa230c10 2024-07-24T22:13:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f152659c640 1 --2- 172.21.15.47:0/3395604241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa2418d0 0x5611fa243cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:13:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.508+0000 7f150ffff640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15100b3de0 0x7f15100b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.509+0000 7f152759e640 1 --2- 172.21.15.47:0/3395604241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 0x5611fa230ff0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1520009900 tx=0x7f1520032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4929f43e1e1da591 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.509+0000 7f1526d9d640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15100b3de0 0x7f15100b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.509+0000 7f150ffff640 1 -- 172.21.15.47:0/1013388501 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f15180e4320 con 0x7f15281025c0 2024-07-24T22:13:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.509+0000 7f150d7fa640 1 -- 172.21.15.47:0/3395604241 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520035040 con 0x5611fa230c10 2024-07-24T22:13:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.509+0000 7f150d7fa640 1 -- 172.21.15.47:0/3395604241 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15200316a0 con 0x5611fa230c10 2024-07-24T22:13:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.509+0000 7f150d7fa640 1 -- 172.21.15.47:0/3395604241 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15200046c0 con 0x5611fa230c10 2024-07-24T22:13:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.510+0000 7f152f60f740 1 -- 172.21.15.47:0/3395604241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 msgr2=0x5611fa230ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.510+0000 7f1526d9d640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15100b3de0 0x7f15100b62a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f15180e1af0 tx=0x7f15180e7980 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.510+0000 7f152f60f740 1 --2- 172.21.15.47:0/3395604241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 0x5611fa230ff0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1520009900 tx=0x7f1520032e70 comp rx=0 tx=0).stop 2024-07-24T22:13:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.510+0000 7f152f60f740 1 -- 172.21.15.47:0/3395604241 shutdown_connections 2024-07-24T22:13:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.510+0000 7f152f60f740 1 --2- 172.21.15.47:0/3395604241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa2418d0 0x5611fa243cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.510+0000 7f152f60f740 1 --2- 172.21.15.47:0/3395604241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa231530 0x5611fa241390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.510+0000 7f152f60f740 1 --2- 172.21.15.47:0/3395604241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 0x5611fa230ff0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.510+0000 7f152f60f740 1 -- 172.21.15.47:0/3395604241 >> 172.21.15.47:0/3395604241 conn(0x5611fa22ea40 msgr2=0x5611fa22fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.510+0000 7f152f60f740 1 -- 172.21.15.47:0/3395604241 shutdown_connections 2024-07-24T22:13:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.510+0000 7f152f60f740 1 -- 172.21.15.47:0/3395604241 wait complete. 2024-07-24T22:13:51.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.510+0000 7f152f60f740 1 -- start start 2024-07-24T22:13:51.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.510+0000 7f152f60f740 1 Processor -- start 2024-07-24T22:13:51.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152f60f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa230c10 0x5611fa23e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152f60f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa231530 0x5611fa23ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152f60f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa2418d0 0x5611fa23f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152f60f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5611f9ffabb0 con 0x5611fa2418d0 2024-07-24T22:13:51.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152f60f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5611fa139900 con 0x5611fa230c10 2024-07-24T22:13:51.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152f60f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5611fa244520 con 0x5611fa231530 2024-07-24T22:13:51.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152f60f740 10 client.0 _ll_register_callbacks cb 0x5611fa143c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:51.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa2418d0 0x5611fa23f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa2418d0 0x5611fa23f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33638/0 (socket says 172.21.15.47:33638) 2024-07-24T22:13:51.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152759e640 1 -- 172.21.15.47:0/597835830 learned_addr learned my addr 172.21.15.47:0/597835830 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:51.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152759e640 1 --2- 172.21.15.47:0/597835830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa230c10 0x5611fa23e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152659c640 1 --2- 172.21.15.47:0/597835830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa231530 0x5611fa23ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152759e640 1 -- 172.21.15.47:0/597835830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa231530 msgr2=0x5611fa23ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:51.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152759e640 1 --2- 172.21.15.47:0/597835830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa231530 0x5611fa23ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152759e640 1 -- 172.21.15.47:0/597835830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa230c10 msgr2=0x5611fa23e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:51.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.511+0000 7f152759e640 1 --2- 172.21.15.47:0/597835830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa230c10 0x5611fa23e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.512+0000 7f152759e640 1 -- 172.21.15.47:0/597835830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611f9f6e960 con 0x5611fa2418d0 2024-07-24T22:13:51.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.512+0000 7f152759e640 1 --2- 172.21.15.47:0/597835830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa2418d0 0x5611fa23f350 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f152002ac00 tx=0x7f1520005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2445dd83bc8cfb04 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:51.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.512+0000 7f150aff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:51.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.512+0000 7f150aff5640 1 -- 172.21.15.47:0/597835830 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520035070 con 0x5611fa2418d0 2024-07-24T22:13:51.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.512+0000 7f150aff5640 1 -- 172.21.15.47:0/597835830 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f1520004260 con 0x5611fa2418d0 2024-07-24T22:13:51.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.512+0000 7f152f60f740 1 -- 172.21.15.47:0/597835830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15200316a0 con 0x5611fa2418d0 2024-07-24T22:13:51.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.512+0000 7f150aff5640 1 -- 172.21.15.47:0/597835830 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1520057050 con 0x5611fa2418d0 2024-07-24T22:13:51.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.512+0000 7f152f60f740 10 client.16908 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:51.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.512+0000 7f152f60f740 1 -- 172.21.15.47:0/597835830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5611fa250080 con 0x5611fa2418d0 2024-07-24T22:13:51.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.512+0000 7f150aff5640 1 -- 172.21.15.47:0/597835830 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15200316a0 con 0x5611fa2418d0 2024-07-24T22:13:51.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.512+0000 7f150aff5640 1 -- 172.21.15.47:0/597835830 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f15200035f0 con 0x5611fa2418d0 2024-07-24T22:13:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.513+0000 7f152f60f740 10 client.16908 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.513+0000 7f152f60f740 10 client.16908 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:13:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.513+0000 7f152f60f740 20 client.16908 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.513+0000 7f152f60f740 1 --2- 172.21.15.47:0/597835830 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5611fa2513d0 0x5611fa2537c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.513+0000 7f152f60f740 4 client.16908 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:13:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.513+0000 7f152f60f740 1 -- 172.21.15.47:0/597835830 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611fa1a9d20 con 0x5611fa2513d0 2024-07-24T22:13:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.513+0000 7f152659c640 1 --2- 172.21.15.47:0/597835830 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5611fa2513d0 0x5611fa2537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.513+0000 7f152659c640 1 --2- 172.21.15.47:0/597835830 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5611fa2513d0 0x5611fa2537c0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51c7695c2e8fe313 server_cookie=c53e671272cb9da9 in_seq=0 out_seq=0 2024-07-24T22:13:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.513+0000 7f150aff5640 10 client.16908 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f150aff5640 1 -- 172.21.15.47:0/597835830 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611fa1a9d20 con 0x5611fa2513d0 2024-07-24T22:13:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f150aff5640 10 client.16908 handle_command_reply: tid=0 2024-07-24T22:13:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f152f60f740 1 client.16908 shutdown 2024-07-24T22:13:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f152f60f740 1 -- 172.21.15.47:0/597835830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa2418d0 msgr2=0x5611fa23f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f152f60f740 1 --2- 172.21.15.47:0/597835830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa2418d0 0x5611fa23f350 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f152002ac00 tx=0x7f1520005320 comp rx=0 tx=0).stop 2024-07-24T22:13:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f152f60f740 1 -- 172.21.15.47:0/597835830 shutdown_connections 2024-07-24T22:13:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f152f60f740 1 --2- 172.21.15.47:0/597835830 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5611fa2513d0 0x5611fa2537c0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f152f60f740 1 --2- 172.21.15.47:0/597835830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa2418d0 0x5611fa23f350 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f152f60f740 1 --2- 172.21.15.47:0/597835830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa231530 0x5611fa23ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f152f60f740 1 --2- 172.21.15.47:0/597835830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa230c10 0x5611fa23e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f150aff5640 0 client.16908 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f152f60f740 1 -- 172.21.15.47:0/597835830 >> 172.21.15.47:0/597835830 conn(0x5611fa22ea40 msgr2=0x5611fa2345b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f152f60f740 1 -- 172.21.15.47:0/597835830 shutdown_connections 2024-07-24T22:13:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.514+0000 7f152f60f740 1 -- 172.21.15.47:0/597835830 wait complete. 2024-07-24T22:13:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.515+0000 7f152f60f740 20 client.16908 trim_cache size 0 max 16384 2024-07-24T22:13:51.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.534+0000 7f152f60f740 1 Processor -- start 2024-07-24T22:13:51.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.534+0000 7f152f60f740 1 -- start start 2024-07-24T22:13:51.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:51 smithi047 ceph-mon[32551]: pgmap v567: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2024-07-24T22:13:51.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.534+0000 7f152f60f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 0x5611fa23c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.534+0000 7f152f60f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa231530 0x5611fa233ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.534+0000 7f152f60f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa2418d0 0x5611fa234220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.534+0000 7f152f60f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f15281a9cf0 con 0x5611fa230c10 2024-07-24T22:13:51.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.534+0000 7f152f60f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f15281ac550 con 0x5611fa231530 2024-07-24T22:13:51.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.534+0000 7f152f60f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f15281aa340 con 0x5611fa2418d0 2024-07-24T22:13:51.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.535+0000 7f152759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 0x5611fa23c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.535+0000 7f152759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 0x5611fa23c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33644/0 (socket says 172.21.15.47:33644) 2024-07-24T22:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.535+0000 7f152759e640 1 -- 172.21.15.47:0/2510104525 learned_addr learned my addr 172.21.15.47:0/2510104525 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.535+0000 7f152759e640 1 --2- 172.21.15.47:0/2510104525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa2418d0 0x5611fa234220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.535+0000 7f152659c640 1 --2- 172.21.15.47:0/2510104525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa231530 0x5611fa233ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.535+0000 7f152759e640 1 -- 172.21.15.47:0/2510104525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa2418d0 msgr2=0x5611fa234220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.535+0000 7f152759e640 1 --2- 172.21.15.47:0/2510104525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa2418d0 0x5611fa234220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.535+0000 7f152759e640 1 -- 172.21.15.47:0/2510104525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa231530 msgr2=0x5611fa233ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.535+0000 7f152759e640 1 --2- 172.21.15.47:0/2510104525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa231530 0x5611fa233ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.535+0000 7f152759e640 1 -- 172.21.15.47:0/2510104525 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611fa2424e0 con 0x5611fa230c10 2024-07-24T22:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.535+0000 7f152659c640 1 --2- 172.21.15.47:0/2510104525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa231530 0x5611fa233ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.535+0000 7f152759e640 1 --2- 172.21.15.47:0/2510104525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 0x5611fa23c360 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1520005e10 tx=0x7f152002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3541ca9e0fb42599 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.535+0000 7f150cff9640 1 -- 172.21.15.47:0/2510104525 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520035070 con 0x5611fa230c10 2024-07-24T22:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.536+0000 7f150cff9640 1 -- 172.21.15.47:0/2510104525 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15200035f0 con 0x5611fa230c10 2024-07-24T22:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.536+0000 7f150cff9640 1 -- 172.21.15.47:0/2510104525 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520003b80 con 0x5611fa230c10 2024-07-24T22:13:51.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.536+0000 7f152f60f740 1 -- 172.21.15.47:0/2510104525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 msgr2=0x5611fa23c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:51.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.536+0000 7f152f60f740 1 --2- 172.21.15.47:0/2510104525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 0x5611fa23c360 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1520005e10 tx=0x7f152002a410 comp rx=0 tx=0).stop 2024-07-24T22:13:51.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 -- 172.21.15.47:0/2510104525 shutdown_connections 2024-07-24T22:13:51.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 --2- 172.21.15.47:0/2510104525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa2418d0 0x5611fa234220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 --2- 172.21.15.47:0/2510104525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa231530 0x5611fa233ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 --2- 172.21.15.47:0/2510104525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa230c10 0x5611fa23c360 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 -- 172.21.15.47:0/2510104525 >> 172.21.15.47:0/2510104525 conn(0x5611fa22ea40 msgr2=0x5611fa240720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:51.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 -- 172.21.15.47:0/2510104525 shutdown_connections 2024-07-24T22:13:51.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 -- 172.21.15.47:0/2510104525 wait complete. 2024-07-24T22:13:51.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 -- start start 2024-07-24T22:13:51.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 Processor -- start 2024-07-24T22:13:51.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa230c10 0x5611fa249e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa231530 0x5611fa258830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa2418d0 0x5611fa258d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f15281aaa10 con 0x5611fa231530 2024-07-24T22:13:51.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f15281abe80 con 0x5611fa2418d0 2024-07-24T22:13:51.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f15281ab0e0 con 0x5611fa230c10 2024-07-24T22:13:51.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.537+0000 7f152f60f740 10 client.0 _ll_register_callbacks cb 0x7f1520005190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:51.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f152659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa231530 0x5611fa258830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f152659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa231530 0x5611fa258830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33658/0 (socket says 172.21.15.47:33658) 2024-07-24T22:13:51.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f152659c640 1 -- 172.21.15.47:0/3865003736 learned_addr learned my addr 172.21.15.47:0/3865003736 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:51.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f152759e640 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa2418d0 0x5611fa258d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f152759e640 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa230c10 0x5611fa249e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f152659c640 1 -- 172.21.15.47:0/3865003736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa230c10 msgr2=0x5611fa249e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:51.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f152659c640 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa230c10 0x5611fa249e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f152659c640 1 -- 172.21.15.47:0/3865003736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa2418d0 msgr2=0x5611fa258d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f152659c640 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa2418d0 0x5611fa258d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f152659c640 1 -- 172.21.15.47:0/3865003736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611fa259550 con 0x5611fa231530 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f152759e640 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa2418d0 0x5611fa258d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f152659c640 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa231530 0x5611fa258830 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1528107ba0 tx=0x7f151c011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a05d98b0426c31 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f150aff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f150aff5640 1 -- 172.21.15.47:0/3865003736 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c01a820 con 0x5611fa231530 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f150aff5640 1 -- 172.21.15.47:0/3865003736 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f151c01a9c0 con 0x5611fa231530 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.538+0000 7f152f60f740 1 -- 172.21.15.47:0/3865003736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15200035f0 con 0x5611fa231530 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.539+0000 7f150aff5640 1 -- 172.21.15.47:0/3865003736 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f151c01abc0 con 0x5611fa231530 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.539+0000 7f152f60f740 10 client.16914 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.539+0000 7f152f60f740 1 -- 172.21.15.47:0/3865003736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5611fa2bbea0 con 0x5611fa231530 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.539+0000 7f150aff5640 1 -- 172.21.15.47:0/3865003736 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f151c01e070 con 0x5611fa231530 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.539+0000 7f150aff5640 1 -- 172.21.15.47:0/3865003736 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f151c02a070 con 0x5611fa231530 2024-07-24T22:13:51.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.539+0000 7f152f60f740 10 client.16914 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:51.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.539+0000 7f152f60f740 10 client.16914 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:13:51.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.539+0000 7f152f60f740 20 client.16914 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:51.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.539+0000 7f152f60f740 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5611fa2bc650 0x5611fa2bea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:51.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.539+0000 7f152f60f740 4 client.16914 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ca65092d", "release": true, "await": true}] 2024-07-24T22:13:51.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.539+0000 7f152f60f740 1 -- 172.21.15.47:0/3865003736 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ca65092d", "release": true, "await": true}) -- 0x7f15200035f0 con 0x5611fa2bc650 2024-07-24T22:13:51.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.540+0000 7f152759e640 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5611fa2bc650 0x5611fa2bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:51.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.540+0000 7f150aff5640 10 client.16914 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:51.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.540+0000 7f152759e640 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5611fa2bc650 0x5611fa2bea70 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5c920bc77e6b3a5 server_cookie=75ff83cc5c4f7fe5 in_seq=0 out_seq=0 2024-07-24T22:13:51.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f150aff5640 1 -- 172.21.15.47:0/3865003736 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f15200035f0 con 0x5611fa2bc650 2024-07-24T22:13:51.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f150aff5640 10 client.16914 handle_command_reply: tid=0 2024-07-24T22:13:51.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f152f60f740 1 client.16914 shutdown 2024-07-24T22:13:51.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f152f60f740 1 -- 172.21.15.47:0/3865003736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa231530 msgr2=0x5611fa258830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:51.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f152f60f740 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa231530 0x5611fa258830 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1528107ba0 tx=0x7f151c011ae0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f152f60f740 1 -- 172.21.15.47:0/3865003736 shutdown_connections 2024-07-24T22:13:51.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f152f60f740 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5611fa2bc650 0x5611fa2bea70 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f152f60f740 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5611fa2418d0 0x5611fa258d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f150aff5640 0 client.16914 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:51.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f152f60f740 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611fa231530 0x5611fa258830 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f152f60f740 1 --2- 172.21.15.47:0/3865003736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5611fa230c10 0x5611fa249e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f152f60f740 1 -- 172.21.15.47:0/3865003736 >> 172.21.15.47:0/3865003736 conn(0x5611fa22ea40 msgr2=0x5611fa23e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:51.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f152f60f740 1 -- 172.21.15.47:0/3865003736 shutdown_connections 2024-07-24T22:13:51.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f152f60f740 1 -- 172.21.15.47:0/3865003736 wait complete. 2024-07-24T22:13:51.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.544+0000 7f152f60f740 20 client.16914 trim_cache size 0 max 16384 2024-07-24T22:13:51.549 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:13:51.549 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:13:51.549 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:13:51.549 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 20, 2024-07-24T22:13:51.549 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:13:51.549 INFO:teuthology.orchestra.run.smithi047.stdout: "ca65092d": { 2024-07-24T22:13:51.549 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 20, 2024-07-24T22:13:51.549 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:13:51.549 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:13:51.549 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:13:51.549 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:13:51.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:13:51.550 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:13:51.550 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 150.0, 2024-07-24T22:13:51.550 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:13:51.550 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:13:51.550 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:13:51.550 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:13:51.550 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:13:51.550 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:13:51.550 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:13:51.550 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:13:51.550 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:13:51.550 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:13:51.550 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:13:51.551 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:13:51.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.545+0000 7f152ca5d640 1 -- 172.21.15.47:0/1013388501 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15100b3de0 msgr2=0x7f15100b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:51.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.545+0000 7f152ca5d640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15100b3de0 0x7f15100b62a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f15180e1af0 tx=0x7f15180e7980 comp rx=0 tx=0).stop 2024-07-24T22:13:51.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.545+0000 7f152ca5d640 1 -- 172.21.15.47:0/1013388501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15281025c0 msgr2=0x7f1528198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:51.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.545+0000 7f152ca5d640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15281025c0 0x7f1528198990 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f151800ea80 tx=0x7f151800ef40 comp rx=0 tx=0).stop 2024-07-24T22:13:51.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.545+0000 7f152ca5d640 1 -- 172.21.15.47:0/1013388501 shutdown_connections 2024-07-24T22:13:51.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.545+0000 7f152ca5d640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f15100b3de0 0x7f15100b62a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.545+0000 7f152ca5d640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1528108950 0x7f152819e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.545+0000 7f152ca5d640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1528107fd0 0x7f1528198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.545+0000 7f152ca5d640 1 --2- 172.21.15.47:0/1013388501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15281025c0 0x7f1528198990 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:51.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.545+0000 7f152ca5d640 1 -- 172.21.15.47:0/1013388501 >> 172.21.15.47:0/1013388501 conn(0x7f15280fe050 msgr2=0x7f1528100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:51.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.545+0000 7f152ca5d640 1 -- 172.21.15.47:0/1013388501 shutdown_connections 2024-07-24T22:13:51.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:51.545+0000 7f152ca5d640 1 -- 172.21.15.47:0/1013388501 wait complete. 2024-07-24T22:13:51.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:51 smithi188 ceph-mon[37380]: pgmap v567: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2024-07-24T22:13:51.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:51 smithi183 ceph-mon[37007]: pgmap v567: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2024-07-24T22:13:52.238 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ca65092d', total seconds elapsed: 38.8 2024-07-24T22:13:52.238 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-07-24T22:13:52.238 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:13:52.300 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:13:53.530 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:13:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:53 smithi188 ceph-mon[37380]: pgmap v568: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.6 KiB/s wr, 4 op/s 2024-07-24T22:13:53.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:53 smithi047 ceph-mon[32551]: pgmap v568: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.6 KiB/s wr, 4 op/s 2024-07-24T22:13:53.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:53 smithi183 ceph-mon[37007]: pgmap v568: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.6 KiB/s wr, 4 op/s 2024-07-24T22:13:54.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.654+0000 7fa117492640 1 -- 172.21.15.47:0/455003003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa110101230 msgr2=0x7fa110101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:54.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.654+0000 7fa117492640 1 --2- 172.21.15.47:0/455003003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa110101230 0x7fa110101610 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009900 tx=0x7fa10c02a410 comp rx=0 tx=0).stop 2024-07-24T22:13:54.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.654+0000 7fa117492640 1 -- 172.21.15.47:0/455003003 shutdown_connections 2024-07-24T22:13:54.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.654+0000 7fa117492640 1 --2- 172.21.15.47:0/455003003 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa11010ede0 0x7fa1101111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.654+0000 7fa117492640 1 --2- 172.21.15.47:0/455003003 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa110101b50 0x7fa11010e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.654+0000 7fa117492640 1 --2- 172.21.15.47:0/455003003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa110101230 0x7fa110101610 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.654+0000 7fa117492640 1 -- 172.21.15.47:0/455003003 >> 172.21.15.47:0/455003003 conn(0x7fa1100fd100 msgr2=0x7fa1100ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:54.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.654+0000 7fa117492640 1 -- 172.21.15.47:0/455003003 shutdown_connections 2024-07-24T22:13:54.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.654+0000 7fa117492640 1 -- 172.21.15.47:0/455003003 wait complete. 2024-07-24T22:13:54.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa117492640 1 Processor -- start 2024-07-24T22:13:54.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa117492640 1 -- start start 2024-07-24T22:13:54.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa117492640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa110101230 0x7fa11019add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa117492640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa110101b50 0x7fa11019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa117492640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa11010ede0 0x7fa1101a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa117492640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa110114960 con 0x7fa110101230 2024-07-24T22:13:54.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa117492640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa1101147e0 con 0x7fa11010ede0 2024-07-24T22:13:54.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa117492640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa110114ae0 con 0x7fa110101b50 2024-07-24T22:13:54.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa11522e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa110101230 0x7fa11019add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa11522e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa110101230 0x7fa11019add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33680/0 (socket says 172.21.15.47:33680) 2024-07-24T22:13:54.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa11522e640 1 -- 172.21.15.47:0/4087726667 learned_addr learned my addr 172.21.15.47:0/4087726667 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:54.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa114a2d640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa110101b50 0x7fa11019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa115a2f640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa11010ede0 0x7fa1101a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa11522e640 1 -- 172.21.15.47:0/4087726667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa110101b50 msgr2=0x7fa11019b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:54.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa11522e640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa110101b50 0x7fa11019b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa11522e640 1 -- 172.21.15.47:0/4087726667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa11010ede0 msgr2=0x7fa1101a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:54.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa11522e640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa11010ede0 0x7fa1101a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa11522e640 1 -- 172.21.15.47:0/4087726667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1101a0e80 con 0x7fa110101230 2024-07-24T22:13:54.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa115a2f640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa11010ede0 0x7fa1101a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:13:54.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.655+0000 7fa114a2d640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa110101b50 0x7fa11019b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:54.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.656+0000 7fa11522e640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa110101230 0x7fa11019add0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa10c006010 tx=0x7fa10c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:54.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.656+0000 7fa1067fc640 1 -- 172.21.15.47:0/4087726667 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c03f030 con 0x7fa110101230 2024-07-24T22:13:54.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.656+0000 7fa1067fc640 1 -- 172.21.15.47:0/4087726667 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa10c003800 con 0x7fa110101230 2024-07-24T22:13:54.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.656+0000 7fa117492640 1 -- 172.21.15.47:0/4087726667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1101a1110 con 0x7fa110101230 2024-07-24T22:13:54.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.656+0000 7fa1067fc640 1 -- 172.21.15.47:0/4087726667 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c035070 con 0x7fa110101230 2024-07-24T22:13:54.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.656+0000 7fa117492640 1 -- 172.21.15.47:0/4087726667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1101a7830 con 0x7fa110101230 2024-07-24T22:13:54.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.659+0000 7fa1067fc640 1 -- 172.21.15.47:0/4087726667 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fa10c003cb0 con 0x7fa110101230 2024-07-24T22:13:54.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.659+0000 7fa119843740 1 Processor -- start 2024-07-24T22:13:54.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.659+0000 7fa119843740 1 -- start start 2024-07-24T22:13:54.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.659+0000 7fa119843740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd362300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.659+0000 7fa119843740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd362840 0x557dbd36e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.659+0000 7fa119843740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd36e7d0 0x557dbd370bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.659+0000 7fa119843740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557dbd2d99f0 con 0x557dbd361f20 2024-07-24T22:13:54.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.659+0000 7fa119843740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557dbd2c8ef0 con 0x557dbd36e7d0 2024-07-24T22:13:54.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.659+0000 7fa119843740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557dbd2ccf30 con 0x557dbd362840 2024-07-24T22:13:54.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.659+0000 7fa115a2f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd362300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.659+0000 7fa115a2f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd362300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33696/0 (socket says 172.21.15.47:33696) 2024-07-24T22:13:54.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.659+0000 7fa115a2f640 1 -- 172.21.15.47:0/2019370651 learned_addr learned my addr 172.21.15.47:0/2019370651 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:54.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa11522e640 1 --2- 172.21.15.47:0/2019370651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd362840 0x557dbd36e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa114a2d640 1 --2- 172.21.15.47:0/2019370651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd36e7d0 0x557dbd370bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa115a2f640 1 -- 172.21.15.47:0/2019370651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd362840 msgr2=0x557dbd36e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:54.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa115a2f640 1 --2- 172.21.15.47:0/2019370651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd362840 0x557dbd36e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa115a2f640 1 -- 172.21.15.47:0/2019370651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd36e7d0 msgr2=0x557dbd370bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:54.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa115a2f640 1 --2- 172.21.15.47:0/2019370651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd36e7d0 0x557dbd370bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa115a2f640 1 -- 172.21.15.47:0/2019370651 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dbd029930 con 0x557dbd361f20 2024-07-24T22:13:54.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa1067fc640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0fc0b3dc0 0x7fa0fc0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa115a2f640 1 --2- 172.21.15.47:0/2019370651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd362300 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa108008e50 tx=0x7fa10800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9fbc69ed9766bd server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:54.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa11522e640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0fc0b3dc0 0x7fa0fc0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa0fb7fe640 1 -- 172.21.15.47:0/2019370651 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108003b70 con 0x557dbd361f20 2024-07-24T22:13:54.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa0fb7fe640 1 -- 172.21.15.47:0/2019370651 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa108003d10 con 0x557dbd361f20 2024-07-24T22:13:54.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa0fb7fe640 1 -- 172.21.15.47:0/2019370651 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10800fa50 con 0x557dbd361f20 2024-07-24T22:13:54.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.660+0000 7fa1067fc640 1 -- 172.21.15.47:0/4087726667 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7fa10c104a70 con 0x7fa110101230 2024-07-24T22:13:54.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.661+0000 7fa119843740 1 -- 172.21.15.47:0/2019370651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 msgr2=0x557dbd362300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:54.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.661+0000 7fa119843740 1 --2- 172.21.15.47:0/2019370651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd362300 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa108008e50 tx=0x7fa10800d710 comp rx=0 tx=0).stop 2024-07-24T22:13:54.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.661+0000 7fa11522e640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0fc0b3dc0 0x7fa0fc0b6280 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa10c102240 tx=0x7fa10c1080c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:54.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.661+0000 7fa119843740 1 -- 172.21.15.47:0/2019370651 shutdown_connections 2024-07-24T22:13:54.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.661+0000 7fa119843740 1 --2- 172.21.15.47:0/2019370651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd36e7d0 0x557dbd370bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.661+0000 7fa119843740 1 --2- 172.21.15.47:0/2019370651 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd362840 0x557dbd36e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.661+0000 7fa119843740 1 --2- 172.21.15.47:0/2019370651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd362300 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.661+0000 7fa119843740 1 -- 172.21.15.47:0/2019370651 >> 172.21.15.47:0/2019370651 conn(0x557dbd35fd50 msgr2=0x557dbd360ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:54.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.661+0000 7fa119843740 1 -- 172.21.15.47:0/2019370651 shutdown_connections 2024-07-24T22:13:54.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.662+0000 7fa119843740 1 -- 172.21.15.47:0/2019370651 wait complete. 2024-07-24T22:13:54.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.662+0000 7fa119843740 1 -- start start 2024-07-24T22:13:54.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.662+0000 7fa119843740 1 Processor -- start 2024-07-24T22:13:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa119843740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd36b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa119843740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd362840 0x557dbd36bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa119843740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 0x557dbd36c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa119843740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557dbd12c890 con 0x557dbd361f20 2024-07-24T22:13:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa119843740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557dbd26b390 con 0x557dbd362840 2024-07-24T22:13:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa119843740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557dbd371450 con 0x557dbd36e7d0 2024-07-24T22:13:54.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa119843740 10 client.0 _ll_register_callbacks cb 0x557dbd275500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:54.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa115a2f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd36b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa115a2f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd36b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33712/0 (socket says 172.21.15.47:33712) 2024-07-24T22:13:54.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa115a2f640 1 -- 172.21.15.47:0/195016736 learned_addr learned my addr 172.21.15.47:0/195016736 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:54.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa115a2f640 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 0x557dbd36c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa114a2d640 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd362840 0x557dbd36bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa115a2f640 1 -- 172.21.15.47:0/195016736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 msgr2=0x557dbd36c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:54.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa115a2f640 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 0x557dbd36c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa115a2f640 1 -- 172.21.15.47:0/195016736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd362840 msgr2=0x557dbd36bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:54.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa115a2f640 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd362840 0x557dbd36bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa115a2f640 1 -- 172.21.15.47:0/195016736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dbd265d60 con 0x557dbd361f20 2024-07-24T22:13:54.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.663+0000 7fa114a2d640 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd362840 0x557dbd36bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:13:54.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa115a2f640 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd36b6f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa108000f80 tx=0x7fa10800f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bdb440c816c779 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:54.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa0f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:54.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa0f8ff9640 1 -- 172.21.15.47:0/195016736 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10800fe40 con 0x557dbd361f20 2024-07-24T22:13:54.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa0f8ff9640 1 -- 172.21.15.47:0/195016736 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7fa108003ec0 con 0x557dbd361f20 2024-07-24T22:13:54.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa119843740 1 -- 172.21.15.47:0/195016736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa108003d10 con 0x557dbd361f20 2024-07-24T22:13:54.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa0f8ff9640 1 -- 172.21.15.47:0/195016736 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa1080040c0 con 0x557dbd361f20 2024-07-24T22:13:54.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa119843740 10 client.16926 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:54.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa119843740 1 -- 172.21.15.47:0/195016736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557dbd37d2f0 con 0x557dbd361f20 2024-07-24T22:13:54.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa0f8ff9640 1 -- 172.21.15.47:0/195016736 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa108003d10 con 0x557dbd361f20 2024-07-24T22:13:54.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa0f8ff9640 1 -- 172.21.15.47:0/195016736 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa108017ab0 con 0x557dbd361f20 2024-07-24T22:13:54.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa119843740 10 client.16926 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:54.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa119843740 10 client.16926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:54.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa119843740 20 client.16926 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:54.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa119843740 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557dbd37eb10 0x557dbd380f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa119843740 4 client.16926 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:13:54.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.664+0000 7fa119843740 1 -- 172.21.15.47:0/195016736 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dbd2db940 con 0x557dbd37eb10 2024-07-24T22:13:54.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.665+0000 7fa114a2d640 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557dbd37eb10 0x557dbd380f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.665+0000 7fa114a2d640 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557dbd37eb10 0x557dbd380f30 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c52316f8f0e969ae server_cookie=e447c3f1b606f49a in_seq=0 out_seq=0 2024-07-24T22:13:54.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.665+0000 7fa0f8ff9640 10 client.16926 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:54.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa0f8ff9640 1 -- 172.21.15.47:0/195016736 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557dbd2db940 con 0x557dbd37eb10 2024-07-24T22:13:54.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa0f8ff9640 10 client.16926 handle_command_reply: tid=0 2024-07-24T22:13:54.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa119843740 1 client.16926 shutdown 2024-07-24T22:13:54.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa119843740 1 -- 172.21.15.47:0/195016736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 msgr2=0x557dbd36b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:54.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa119843740 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd36b6f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa108000f80 tx=0x7fa10800f6d0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa119843740 1 -- 172.21.15.47:0/195016736 shutdown_connections 2024-07-24T22:13:54.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa119843740 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557dbd37eb10 0x557dbd380f30 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa119843740 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 0x557dbd36c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa119843740 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd362840 0x557dbd36bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa119843740 1 --2- 172.21.15.47:0/195016736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd36b6f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa0f8ff9640 0 client.16926 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:54.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa119843740 1 -- 172.21.15.47:0/195016736 >> 172.21.15.47:0/195016736 conn(0x557dbd35fd50 msgr2=0x557dbd3658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:54.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa119843740 1 -- 172.21.15.47:0/195016736 shutdown_connections 2024-07-24T22:13:54.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa119843740 1 -- 172.21.15.47:0/195016736 wait complete. 2024-07-24T22:13:54.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.666+0000 7fa119843740 20 client.16926 trim_cache size 0 max 16384 2024-07-24T22:13:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.685+0000 7fa119843740 1 Processor -- start 2024-07-24T22:13:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.685+0000 7fa119843740 1 -- start start 2024-07-24T22:13:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa119843740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd361f20 0x557dbd36d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa119843740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd362840 0x557dbd386800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa119843740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 0x557dbd386d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa119843740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1101ae370 con 0x557dbd362840 2024-07-24T22:13:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa119843740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa1101b0bd0 con 0x557dbd361f20 2024-07-24T22:13:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa119843740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa1101ae9c0 con 0x557dbd36e7d0 2024-07-24T22:13:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa114a2d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd362840 0x557dbd386800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa114a2d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd362840 0x557dbd386800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33724/0 (socket says 172.21.15.47:33724) 2024-07-24T22:13:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa114a2d640 1 -- 172.21.15.47:0/2373123631 learned_addr learned my addr 172.21.15.47:0/2373123631 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa114a2d640 1 -- 172.21.15.47:0/2373123631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 msgr2=0x557dbd386d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa114a2d640 1 --2- 172.21.15.47:0/2373123631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 0x557dbd386d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa114a2d640 1 -- 172.21.15.47:0/2373123631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd361f20 msgr2=0x557dbd36d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa114a2d640 1 --2- 172.21.15.47:0/2373123631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd361f20 0x557dbd36d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa114a2d640 1 -- 172.21.15.47:0/2373123631 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dbd36a650 con 0x557dbd362840 2024-07-24T22:13:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.686+0000 7fa114a2d640 1 --2- 172.21.15.47:0/2373123631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd362840 0x557dbd386800 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa100005fc0 tx=0x7fa10000c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3377991a13eb479b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.687+0000 7fa0faffd640 1 -- 172.21.15.47:0/2373123631 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100004020 con 0x557dbd362840 2024-07-24T22:13:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.687+0000 7fa0faffd640 1 -- 172.21.15.47:0/2373123631 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1000041c0 con 0x557dbd362840 2024-07-24T22:13:54.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.687+0000 7fa0faffd640 1 -- 172.21.15.47:0/2373123631 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10001a590 con 0x557dbd362840 2024-07-24T22:13:54.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.687+0000 7fa119843740 1 -- 172.21.15.47:0/2373123631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd362840 msgr2=0x557dbd386800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:54.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.687+0000 7fa119843740 1 --2- 172.21.15.47:0/2373123631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd362840 0x557dbd386800 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa100005fc0 tx=0x7fa10000c410 comp rx=0 tx=0).stop 2024-07-24T22:13:54.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.687+0000 7fa119843740 1 -- 172.21.15.47:0/2373123631 shutdown_connections 2024-07-24T22:13:54.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.687+0000 7fa119843740 1 --2- 172.21.15.47:0/2373123631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 0x557dbd386d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.687+0000 7fa119843740 1 --2- 172.21.15.47:0/2373123631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd362840 0x557dbd386800 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.687+0000 7fa119843740 1 --2- 172.21.15.47:0/2373123631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd361f20 0x557dbd36d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.687+0000 7fa119843740 1 -- 172.21.15.47:0/2373123631 >> 172.21.15.47:0/2373123631 conn(0x557dbd35fd50 msgr2=0x557dbd36cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.687+0000 7fa119843740 1 -- 172.21.15.47:0/2373123631 shutdown_connections 2024-07-24T22:13:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.687+0000 7fa119843740 1 -- 172.21.15.47:0/2373123631 wait complete. 2024-07-24T22:13:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.688+0000 7fa119843740 1 -- start start 2024-07-24T22:13:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.688+0000 7fa119843740 1 Processor -- start 2024-07-24T22:13:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.688+0000 7fa119843740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd376ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.688+0000 7fa119843740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd362840 0x557dbd3723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.688+0000 7fa119843740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 0x557dbd372a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.688+0000 7fa119843740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1101af090 con 0x557dbd361f20 2024-07-24T22:13:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.688+0000 7fa119843740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa1101b0500 con 0x557dbd362840 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.688+0000 7fa119843740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa1101af760 con 0x557dbd36e7d0 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.688+0000 7fa119843740 10 client.0 _ll_register_callbacks cb 0x7fa108008ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.688+0000 7fa115a2f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd376ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.688+0000 7fa115a2f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd376ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33730/0 (socket says 172.21.15.47:33730) 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.688+0000 7fa115a2f640 1 -- 172.21.15.47:0/1119193077 learned_addr learned my addr 172.21.15.47:0/1119193077 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.688+0000 7fa114a2d640 1 --2- 172.21.15.47:0/1119193077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd362840 0x557dbd3723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa115a2f640 1 --2- 172.21.15.47:0/1119193077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 0x557dbd372a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa115a2f640 1 -- 172.21.15.47:0/1119193077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 msgr2=0x557dbd372a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa115a2f640 1 --2- 172.21.15.47:0/1119193077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 0x557dbd372a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa115a2f640 1 -- 172.21.15.47:0/1119193077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd362840 msgr2=0x557dbd3723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa115a2f640 1 --2- 172.21.15.47:0/1119193077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd362840 0x557dbd3723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa115a2f640 1 -- 172.21.15.47:0/1119193077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dbd362670 con 0x557dbd361f20 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa115a2f640 1 --2- 172.21.15.47:0/1119193077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd376ef0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa10800f740 tx=0x7fa108008700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ebaa7d825ee18f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:54.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa0f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa0f8ff9640 1 -- 172.21.15.47:0/1119193077 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108034040 con 0x557dbd361f20 2024-07-24T22:13:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa0f8ff9640 1 -- 172.21.15.47:0/1119193077 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7fa10802a5c0 con 0x557dbd361f20 2024-07-24T22:13:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa119843740 1 -- 172.21.15.47:0/1119193077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1000041c0 con 0x557dbd361f20 2024-07-24T22:13:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa0f8ff9640 1 -- 172.21.15.47:0/1119193077 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa10800db50 con 0x557dbd361f20 2024-07-24T22:13:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa119843740 10 client.16932 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa119843740 1 -- 172.21.15.47:0/1119193077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557dbd3e9810 con 0x557dbd361f20 2024-07-24T22:13:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.689+0000 7fa0f8ff9640 1 -- 172.21.15.47:0/1119193077 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1000041c0 con 0x557dbd361f20 2024-07-24T22:13:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.690+0000 7fa0f8ff9640 1 -- 172.21.15.47:0/1119193077 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa108040070 con 0x557dbd361f20 2024-07-24T22:13:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.690+0000 7fa119843740 10 client.16932 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.690+0000 7fa119843740 10 client.16932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.690+0000 7fa119843740 20 client.16932 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.690+0000 7fa119843740 1 --2- 172.21.15.47:0/1119193077 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557dbd3e9f10 0x557dbd3ec330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.690+0000 7fa119843740 4 client.16932 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:13:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.690+0000 7fa119843740 1 -- 172.21.15.47:0/1119193077 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557dbd2d73e0 con 0x557dbd3e9f10 2024-07-24T22:13:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.690+0000 7fa114a2d640 1 --2- 172.21.15.47:0/1119193077 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557dbd3e9f10 0x557dbd3ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.690+0000 7fa114a2d640 1 --2- 172.21.15.47:0/1119193077 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557dbd3e9f10 0x557dbd3ec330 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af234e9fb1731971 server_cookie=1a8d763690626c24 in_seq=0 out_seq=0 2024-07-24T22:13:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.690+0000 7fa0f8ff9640 10 client.16932 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:54.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa0f8ff9640 1 -- 172.21.15.47:0/1119193077 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557dbd2d73e0 con 0x557dbd3e9f10 2024-07-24T22:13:54.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa0f8ff9640 10 client.16932 handle_command_reply: tid=0 2024-07-24T22:13:54.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa119843740 1 client.16932 shutdown 2024-07-24T22:13:54.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa119843740 1 -- 172.21.15.47:0/1119193077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 msgr2=0x557dbd376ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:54.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa119843740 1 --2- 172.21.15.47:0/1119193077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd376ef0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa10800f740 tx=0x7fa108008700 comp rx=0 tx=0).stop 2024-07-24T22:13:54.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa119843740 1 -- 172.21.15.47:0/1119193077 shutdown_connections 2024-07-24T22:13:54.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa119843740 1 --2- 172.21.15.47:0/1119193077 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557dbd3e9f10 0x557dbd3ec330 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa119843740 1 --2- 172.21.15.47:0/1119193077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557dbd36e7d0 0x557dbd372a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa119843740 1 --2- 172.21.15.47:0/1119193077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557dbd362840 0x557dbd3723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa119843740 1 --2- 172.21.15.47:0/1119193077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbd361f20 0x557dbd376ef0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa119843740 1 -- 172.21.15.47:0/1119193077 >> 172.21.15.47:0/1119193077 conn(0x557dbd35fd50 msgr2=0x557dbd35ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:54.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa0f8ff9640 0 client.16932 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:54.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa119843740 1 -- 172.21.15.47:0/1119193077 shutdown_connections 2024-07-24T22:13:54.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa119843740 1 -- 172.21.15.47:0/1119193077 wait complete. 2024-07-24T22:13:54.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.692+0000 7fa119843740 20 client.16932 trim_cache size 0 max 16384 2024-07-24T22:13:54.699 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:13:54.699 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:13:54.699 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "6a8c6c0a-47e0-41e1-a213-3cbeb0e729c6", 2024-07-24T22:13:54.700 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:13:54.700 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:13:54.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.693+0000 7fa117492640 1 -- 172.21.15.47:0/4087726667 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0fc0b3dc0 msgr2=0x7fa0fc0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:54.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.693+0000 7fa117492640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0fc0b3dc0 0x7fa0fc0b6280 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa10c102240 tx=0x7fa10c1080c0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.693+0000 7fa117492640 1 -- 172.21.15.47:0/4087726667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa110101230 msgr2=0x7fa11019add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:54.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.693+0000 7fa117492640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa110101230 0x7fa11019add0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa10c006010 tx=0x7fa10c0042f0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.693+0000 7fa117492640 1 -- 172.21.15.47:0/4087726667 shutdown_connections 2024-07-24T22:13:54.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.693+0000 7fa117492640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fa0fc0b3dc0 0x7fa0fc0b6280 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.693+0000 7fa117492640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa11010ede0 0x7fa1101a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.693+0000 7fa117492640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa110101b50 0x7fa11019b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.693+0000 7fa117492640 1 --2- 172.21.15.47:0/4087726667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa110101230 0x7fa11019add0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:54.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.693+0000 7fa117492640 1 -- 172.21.15.47:0/4087726667 >> 172.21.15.47:0/4087726667 conn(0x7fa1100fd100 msgr2=0x7fa110110f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:54.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.693+0000 7fa117492640 1 -- 172.21.15.47:0/4087726667 shutdown_connections 2024-07-24T22:13:54.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:54.693+0000 7fa117492640 1 -- 172.21.15.47:0/4087726667 wait complete. 2024-07-24T22:13:55.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:55 smithi188 ceph-mon[37380]: pgmap v569: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.6 KiB/s rd, 2.9 KiB/s wr, 3 op/s 2024-07-24T22:13:55.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:55 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:13:55.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:55 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:13:55.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:55 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:13:55.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:55 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:13:55.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:55 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:13:55.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:55 smithi183 ceph-mon[37007]: pgmap v569: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.6 KiB/s rd, 2.9 KiB/s wr, 3 op/s 2024-07-24T22:13:55.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:55 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:13:55.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:55 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:13:55.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:55 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:13:55.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:55 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:13:55.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:55 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:13:55.934 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:55 smithi047 ceph-mon[32551]: pgmap v569: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.6 KiB/s rd, 2.9 KiB/s wr, 3 op/s 2024-07-24T22:13:55.934 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:55 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:13:55.934 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:55 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:13:55.934 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:55 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:13:55.934 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:55 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:13:55.935 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:55 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:13:55.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:13:56.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.332+0000 7fcf4f149640 1 -- 172.21.15.47:0/3617075387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf48107090 msgr2=0x7fcf481074d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:56.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.332+0000 7fcf4f149640 1 --2- 172.21.15.47:0/3617075387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf48107090 0x7fcf481074d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009ca0 tx=0x7fcf3802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:13:56.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.332+0000 7fcf4f149640 1 -- 172.21.15.47:0/3617075387 shutdown_connections 2024-07-24T22:13:56.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.332+0000 7fcf4f149640 1 --2- 172.21.15.47:0/3617075387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf48107a10 0x7fcf4810e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:56.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.332+0000 7fcf4f149640 1 --2- 172.21.15.47:0/3617075387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf48107090 0x7fcf481074d0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:56.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.332+0000 7fcf4f149640 1 --2- 172.21.15.47:0/3617075387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf48101680 0x7fcf48101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:56.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.332+0000 7fcf4f149640 1 -- 172.21.15.47:0/3617075387 >> 172.21.15.47:0/3617075387 conn(0x7fcf480fd0d0 msgr2=0x7fcf480ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:56.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.332+0000 7fcf4f149640 1 -- 172.21.15.47:0/3617075387 shutdown_connections 2024-07-24T22:13:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.332+0000 7fcf4f149640 1 -- 172.21.15.47:0/3617075387 wait complete. 2024-07-24T22:13:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.333+0000 7fcf4f149640 1 Processor -- start 2024-07-24T22:13:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.333+0000 7fcf4f149640 1 -- start start 2024-07-24T22:13:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.333+0000 7fcf4f149640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf48101680 0x7fcf48198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.333+0000 7fcf4f149640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf48107090 0x7fcf48199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.333+0000 7fcf4f149640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf48107a10 0x7fcf4819e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.333+0000 7fcf4f149640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcf481127f0 con 0x7fcf48107090 2024-07-24T22:13:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.333+0000 7fcf4f149640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48112670 con 0x7fcf48101680 2024-07-24T22:13:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.333+0000 7fcf4f149640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48112970 con 0x7fcf48107a10 2024-07-24T22:13:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.333+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf48107090 0x7fcf48199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.333+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf48107090 0x7fcf48199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34230/0 (socket says 172.21.15.47:34230) 2024-07-24T22:13:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.333+0000 7fcf47fff640 1 -- 172.21.15.47:0/1951251421 learned_addr learned my addr 172.21.15.47:0/1951251421 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.334+0000 7fcf4cee5640 1 --2- 172.21.15.47:0/1951251421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf48101680 0x7fcf48198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.334+0000 7fcf47fff640 1 -- 172.21.15.47:0/1951251421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf48107a10 msgr2=0x7fcf4819e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.334+0000 7fcf47fff640 1 --2- 172.21.15.47:0/1951251421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf48107a10 0x7fcf4819e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.334+0000 7fcf47fff640 1 -- 172.21.15.47:0/1951251421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf48101680 msgr2=0x7fcf48198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.334+0000 7fcf47fff640 1 --2- 172.21.15.47:0/1951251421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf48101680 0x7fcf48198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.334+0000 7fcf47fff640 1 -- 172.21.15.47:0/1951251421 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4819efe0 con 0x7fcf48107090 2024-07-24T22:13:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.334+0000 7fcf47fff640 1 --2- 172.21.15.47:0/1951251421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf48107090 0x7fcf48199470 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fcf38006010 tx=0x7fcf380319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.334+0000 7fcf45ffb640 1 -- 172.21.15.47:0/1951251421 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38003bf0 con 0x7fcf48107090 2024-07-24T22:13:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.334+0000 7fcf45ffb640 1 -- 172.21.15.47:0/1951251421 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf38003d90 con 0x7fcf48107090 2024-07-24T22:13:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.334+0000 7fcf45ffb640 1 -- 172.21.15.47:0/1951251421 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3802fc20 con 0x7fcf48107090 2024-07-24T22:13:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.334+0000 7fcf4f149640 1 -- 172.21.15.47:0/1951251421 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf4819f270 con 0x7fcf48107090 2024-07-24T22:13:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.334+0000 7fcf4f149640 1 -- 172.21.15.47:0/1951251421 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf481a5990 con 0x7fcf48107090 2024-07-24T22:13:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.336+0000 7fcf4f149640 1 -- 172.21.15.47:0/1951251421 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf48101a60 con 0x7fcf48107090 2024-07-24T22:13:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.337+0000 7fcf45ffb640 1 -- 172.21.15.47:0/1951251421 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fcf380046a0 con 0x7fcf48107090 2024-07-24T22:13:56.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.338+0000 7fcf45ffb640 1 --2- 172.21.15.47:0/1951251421 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcf340b3d40 0x7fcf340b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:56.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.338+0000 7fcf4cee5640 1 --2- 172.21.15.47:0/1951251421 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcf340b3d40 0x7fcf340b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:56.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.338+0000 7fcf45ffb640 1 -- 172.21.15.47:0/1951251421 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7fcf381055e0 con 0x7fcf48107090 2024-07-24T22:13:56.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.338+0000 7fcf4cee5640 1 --2- 172.21.15.47:0/1951251421 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcf340b3d40 0x7fcf340b6200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000bbe0 tx=0x7fcf3000b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:56.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.341+0000 7fcf45ffb640 1 -- 172.21.15.47:0/1951251421 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fcf380cc9d0 con 0x7fcf48107090 2024-07-24T22:13:56.438 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:13:56.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.586+0000 7fcf4f149640 1 -- 172.21.15.47:0/1951251421 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf4819a060 con 0x7fcf48107090 2024-07-24T22:13:56.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.587+0000 7fcf45ffb640 1 -- 172.21.15.47:0/1951251421 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7fcf4819a060 con 0x7fcf48107090 2024-07-24T22:13:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:13:56.589 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:13:56.590 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:13:56.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.589+0000 7fcf4f149640 1 -- 172.21.15.47:0/1951251421 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcf340b3d40 msgr2=0x7fcf340b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:56.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.589+0000 7fcf4f149640 1 --2- 172.21.15.47:0/1951251421 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcf340b3d40 0x7fcf340b6200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000bbe0 tx=0x7fcf3000b390 comp rx=0 tx=0).stop 2024-07-24T22:13:56.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.589+0000 7fcf4f149640 1 -- 172.21.15.47:0/1951251421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf48107090 msgr2=0x7fcf48199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:56.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.589+0000 7fcf4f149640 1 --2- 172.21.15.47:0/1951251421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf48107090 0x7fcf48199470 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fcf38006010 tx=0x7fcf380319f0 comp rx=0 tx=0).stop 2024-07-24T22:13:56.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.589+0000 7fcf4f149640 1 -- 172.21.15.47:0/1951251421 shutdown_connections 2024-07-24T22:13:56.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.589+0000 7fcf4f149640 1 --2- 172.21.15.47:0/1951251421 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcf340b3d40 0x7fcf340b6200 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:56.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.589+0000 7fcf4f149640 1 --2- 172.21.15.47:0/1951251421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf48107a10 0x7fcf4819e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:56.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.589+0000 7fcf4f149640 1 --2- 172.21.15.47:0/1951251421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf48107090 0x7fcf48199470 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:56.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.589+0000 7fcf4f149640 1 --2- 172.21.15.47:0/1951251421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf48101680 0x7fcf48198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:56.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.589+0000 7fcf4f149640 1 -- 172.21.15.47:0/1951251421 >> 172.21.15.47:0/1951251421 conn(0x7fcf480fd0d0 msgr2=0x7fcf480ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:56.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.589+0000 7fcf4f149640 1 -- 172.21.15.47:0/1951251421 shutdown_connections 2024-07-24T22:13:56.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:56.589+0000 7fcf4f149640 1 -- 172.21.15.47:0/1951251421 wait complete. 2024-07-24T22:13:57.411 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-07-24T22:13:57.411 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-07-24T22:13:57.650 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:57 smithi047 ceph-mon[32551]: pgmap v570: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.9 KiB/s wr, 4 op/s 2024-07-24T22:13:57.650 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:57 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1951251421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:13:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:57 smithi188 ceph-mon[37380]: pgmap v570: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.9 KiB/s wr, 4 op/s 2024-07-24T22:13:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:57 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1951251421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:13:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:57 smithi183 ceph-mon[37007]: pgmap v570: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.9 KiB/s wr, 4 op/s 2024-07-24T22:13:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:57 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1951251421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:13:58.327 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:13:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.483+0000 7ff7efb9f640 1 -- 172.21.15.47:0/2114706995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7e8108b20 msgr2=0x7ff7e810f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.483+0000 7ff7efb9f640 1 --2- 172.21.15.47:0/2114706995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7e8108b20 0x7ff7e810f320 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009900 tx=0x7ff7e002a410 comp rx=0 tx=0).stop 2024-07-24T22:13:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.483+0000 7ff7efb9f640 1 -- 172.21.15.47:0/2114706995 shutdown_connections 2024-07-24T22:13:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.483+0000 7ff7efb9f640 1 --2- 172.21.15.47:0/2114706995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7e8108b20 0x7ff7e810f320 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.483+0000 7ff7efb9f640 1 --2- 172.21.15.47:0/2114706995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7e81081a0 0x7ff7e81085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.483+0000 7ff7efb9f640 1 --2- 172.21.15.47:0/2114706995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e8102790 0x7ff7e8102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.483+0000 7ff7efb9f640 1 -- 172.21.15.47:0/2114706995 >> 172.21.15.47:0/2114706995 conn(0x7ff7e80fe200 msgr2=0x7ff7e8100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.483+0000 7ff7efb9f640 1 -- 172.21.15.47:0/2114706995 shutdown_connections 2024-07-24T22:13:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.483+0000 7ff7efb9f640 1 -- 172.21.15.47:0/2114706995 wait complete. 2024-07-24T22:13:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7efb9f640 1 Processor -- start 2024-07-24T22:13:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7efb9f640 1 -- start start 2024-07-24T22:13:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7efb9f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7e8102790 0x7ff7e8074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7efb9f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e81081a0 0x7ff7e80753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7efb9f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7e8108b20 0x7ff7e8075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7efb9f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e8112820 con 0x7ff7e8108b20 2024-07-24T22:13:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7efb9f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e81126a0 con 0x7ff7e81081a0 2024-07-24T22:13:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7efb9f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e81129a0 con 0x7ff7e8102790 2024-07-24T22:13:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7ee13c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7e8108b20 0x7ff7e8075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7ee13c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7e8108b20 0x7ff7e8075910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34246/0 (socket says 172.21.15.47:34246) 2024-07-24T22:13:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7ee13c640 1 -- 172.21.15.47:0/2584708367 learned_addr learned my addr 172.21.15.47:0/2584708367 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7ed93b640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7e8102790 0x7ff7e8074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e81081a0 0x7ff7e80753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7ee13c640 1 -- 172.21.15.47:0/2584708367 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7e8102790 msgr2=0x7ff7e8074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7ee13c640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7e8102790 0x7ff7e8074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7ee13c640 1 -- 172.21.15.47:0/2584708367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e81081a0 msgr2=0x7ff7e80753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7ee13c640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e81081a0 0x7ff7e80753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.484+0000 7ff7ee13c640 1 -- 172.21.15.47:0/2584708367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e81a7210 con 0x7ff7e8108b20 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.485+0000 7ff7ee13c640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7e8108b20 0x7ff7e8075910 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009a20 tx=0x7ff7e0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.485+0000 7ff7e6ffd640 1 -- 172.21.15.47:0/2584708367 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e003f030 con 0x7ff7e8108b20 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.485+0000 7ff7efb9f640 1 -- 172.21.15.47:0/2584708367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e81a74a0 con 0x7ff7e8108b20 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.485+0000 7ff7e6ffd640 1 -- 172.21.15.47:0/2584708367 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7e0003aa0 con 0x7ff7e8108b20 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.485+0000 7ff7e6ffd640 1 -- 172.21.15.47:0/2584708367 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0035070 con 0x7ff7e8108b20 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.485+0000 7ff7efb9f640 1 -- 172.21.15.47:0/2584708367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e81a7a00 con 0x7ff7e8108b20 2024-07-24T22:13:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.488+0000 7ff7f1f50740 1 Processor -- start 2024-07-24T22:13:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.488+0000 7ff7e6ffd640 1 -- 172.21.15.47:0/2584708367 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7ff7e0042030 con 0x7ff7e8108b20 2024-07-24T22:13:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.488+0000 7ff7f1f50740 1 -- start start 2024-07-24T22:13:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.488+0000 7ff7f1f50740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef6ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.488+0000 7ff7f1f50740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef77a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.488+0000 7ff7f1f50740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 0x55ec3ef7a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.488+0000 7ff7f1f50740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ec3eee2990 con 0x55ec3ef77f60 2024-07-24T22:13:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.488+0000 7ff7f1f50740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ec3eed1e90 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.488+0000 7ff7f1f50740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ec3eed5ed0 con 0x55ec3ef6bfd0 2024-07-24T22:13:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.488+0000 7ff7ed13a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 0x55ec3ef7a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.488+0000 7ff7ed13a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 0x55ec3ef7a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34256/0 (socket says 172.21.15.47:34256) 2024-07-24T22:13:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.488+0000 7ff7ed13a640 1 -- 172.21.15.47:0/3595699473 learned_addr learned my addr 172.21.15.47:0/3595699473 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/3595699473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef6ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7ed93b640 1 --2- 172.21.15.47:0/3595699473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef77a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7e6ffd640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff7d00b3d40 0x7ff7d00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7ed13a640 1 -- 172.21.15.47:0/3595699473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef6bfd0 msgr2=0x55ec3ef77a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:59.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/3595699473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef77a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7ed13a640 1 -- 172.21.15.47:0/3595699473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6b6b0 msgr2=0x55ec3ef6ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:59.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/3595699473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef6ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7ed13a640 1 -- 172.21.15.47:0/3595699473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec3ee5b300 con 0x55ec3ef77f60 2024-07-24T22:13:59.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7ee13c640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff7d00b3d40 0x7ff7d00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/3595699473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 0x55ec3ef7a350 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc016530 tx=0x7ff7dc00a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afb0df204b6a458 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:59.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7e6ffd640 1 -- 172.21.15.47:0/2584708367 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7ff7e0104860 con 0x7ff7e8108b20 2024-07-24T22:13:59.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7cffff640 1 -- 172.21.15.47:0/3595699473 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc018430 con 0x55ec3ef77f60 2024-07-24T22:13:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7cffff640 1 -- 172.21.15.47:0/3595699473 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7dc018a80 con 0x55ec3ef77f60 2024-07-24T22:13:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.489+0000 7ff7cffff640 1 -- 172.21.15.47:0/3595699473 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc017940 con 0x55ec3ef77f60 2024-07-24T22:13:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.490+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3595699473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 msgr2=0x55ec3ef7a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.490+0000 7ff7ee13c640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff7d00b3d40 0x7ff7d00b6200 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00c74c0 tx=0x7ff7e00978f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.490+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3595699473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 0x55ec3ef7a350 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc016530 tx=0x7ff7dc00a2b0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.490+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3595699473 shutdown_connections 2024-07-24T22:13:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.490+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3595699473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 0x55ec3ef7a350 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.490+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3595699473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef77a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.490+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3595699473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef6ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.490+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3595699473 >> 172.21.15.47:0/3595699473 conn(0x55ec3ef694e0 msgr2=0x55ec3ef6a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.490+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3595699473 shutdown_connections 2024-07-24T22:13:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.490+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3595699473 wait complete. 2024-07-24T22:13:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.490+0000 7ff7f1f50740 1 -- start start 2024-07-24T22:13:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.491+0000 7ff7f1f50740 1 Processor -- start 2024-07-24T22:13:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.491+0000 7ff7f1f50740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef74f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.491+0000 7ff7f1f50740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef75460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.491+0000 7ff7f1f50740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef77f60 0x55ec3ef759a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.491+0000 7ff7f1f50740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ec3ed35700 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.491+0000 7ff7f1f50740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ec3ee745d0 con 0x55ec3ef6bfd0 2024-07-24T22:13:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.491+0000 7ff7f1f50740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ec3ef7ab20 con 0x55ec3ef77f60 2024-07-24T22:13:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.491+0000 7ff7f1f50740 10 client.0 _ll_register_callbacks cb 0x55ec3ee94940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.491+0000 7ff7ed13a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef74f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.491+0000 7ff7ed13a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef74f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34270/0 (socket says 172.21.15.47:34270) 2024-07-24T22:13:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.491+0000 7ff7ed13a640 1 -- 172.21.15.47:0/3319709535 learned_addr learned my addr 172.21.15.47:0/3319709535 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.491+0000 7ff7ed93b640 1 --2- 172.21.15.47:0/3319709535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef75460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.491+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/3319709535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef77f60 0x55ec3ef759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7ed13a640 1 -- 172.21.15.47:0/3319709535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef77f60 msgr2=0x55ec3ef759a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/3319709535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef77f60 0x55ec3ef759a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7ed13a640 1 -- 172.21.15.47:0/3319709535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 msgr2=0x55ec3ef75460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/3319709535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef75460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7ed13a640 1 -- 172.21.15.47:0/3319709535 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec3ee67660 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/3319709535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef74f20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00a430 tx=0x7ff7dc017600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad9d096d8b8dda server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7cd7fa640 1 -- 172.21.15.47:0/3319709535 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc018840 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7cd7fa640 1 -- 172.21.15.47:0/3319709535 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7ff7dc0176e0 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3319709535 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7dc018a80 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7cd7fa640 1 -- 172.21.15.47:0/3319709535 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff7dc032050 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7f1f50740 10 client.16950 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3319709535 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ec3ec32650 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.492+0000 7ff7cd7fa640 1 -- 172.21.15.47:0/3319709535 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7dc018a80 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.493+0000 7ff7cd7fa640 1 -- 172.21.15.47:0/3319709535 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff7dc012050 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.493+0000 7ff7f1f50740 10 client.16950 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.493+0000 7ff7f1f50740 10 client.16950 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.493+0000 7ff7f1f50740 20 client.16950 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.493+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3319709535 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ec3ef87910 0x55ec3ef89d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.493+0000 7ff7f1f50740 4 client.16950 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:13:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.493+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3319709535 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec3eee48e0 con 0x55ec3ef87910 2024-07-24T22:13:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.493+0000 7ff7ed93b640 1 --2- 172.21.15.47:0/3319709535 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ec3ef87910 0x55ec3ef89d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.493+0000 7ff7ed93b640 1 --2- 172.21.15.47:0/3319709535 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ec3ef87910 0x55ec3ef89d00 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af23a0bd5b90301e server_cookie=42b75b601cc3d4c8 in_seq=0 out_seq=0 2024-07-24T22:13:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.493+0000 7ff7cd7fa640 10 client.16950 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7cd7fa640 1 -- 172.21.15.47:0/3319709535 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec3eee48e0 con 0x55ec3ef87910 2024-07-24T22:13:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7cd7fa640 10 client.16950 handle_command_reply: tid=0 2024-07-24T22:13:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7f1f50740 1 client.16950 shutdown 2024-07-24T22:13:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3319709535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 msgr2=0x55ec3ef74f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3319709535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef74f20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00a430 tx=0x7ff7dc017600 comp rx=0 tx=0).stop 2024-07-24T22:13:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3319709535 shutdown_connections 2024-07-24T22:13:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3319709535 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ec3ef87910 0x55ec3ef89d00 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3319709535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef77f60 0x55ec3ef759a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3319709535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef75460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7cd7fa640 0 client.16950 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3319709535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef74f20 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3319709535 >> 172.21.15.47:0/3319709535 conn(0x55ec3ef694e0 msgr2=0x55ec3ef6f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3319709535 shutdown_connections 2024-07-24T22:13:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3319709535 wait complete. 2024-07-24T22:13:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.494+0000 7ff7f1f50740 20 client.16950 trim_cache size 0 max 16384 2024-07-24T22:13:59.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7f1f50740 1 Processor -- start 2024-07-24T22:13:59.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7f1f50740 1 -- start start 2024-07-24T22:13:59.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7f1f50740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef6f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7f1f50740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef68440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7f1f50740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef77f60 0x55ec3ef8f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7f1f50740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e81ae4d0 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7f1f50740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e81b0d30 con 0x55ec3ef6bfd0 2024-07-24T22:13:59.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7f1f50740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e81aeb20 con 0x55ec3ef77f60 2024-07-24T22:13:59.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7ed13a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef6f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7ed13a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef6f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34286/0 (socket says 172.21.15.47:34286) 2024-07-24T22:13:59.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7ed13a640 1 -- 172.21.15.47:0/2644724287 learned_addr learned my addr 172.21.15.47:0/2644724287 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:59.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7ed93b640 1 --2- 172.21.15.47:0/2644724287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef68440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7ed13a640 1 -- 172.21.15.47:0/2644724287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef77f60 msgr2=0x55ec3ef8f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:59.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/2644724287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef77f60 0x55ec3ef8f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7ed13a640 1 -- 172.21.15.47:0/2644724287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 msgr2=0x55ec3ef68440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:59.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/2644724287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef68440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7ed13a640 1 -- 172.21.15.47:0/2644724287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec3ef6a1c0 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.514+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/2644724287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef6f800 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc006b50 tx=0x7ff7dc006ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37efc08c5ad64aca server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:59.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.515+0000 7ff7cf7fe640 1 -- 172.21.15.47:0/2644724287 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc03b020 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.515+0000 7ff7cf7fe640 1 -- 172.21.15.47:0/2644724287 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7dc029070 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.515+0000 7ff7cf7fe640 1 -- 172.21.15.47:0/2644724287 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0188a0 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.515+0000 7ff7f1f50740 1 -- 172.21.15.47:0/2644724287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 msgr2=0x55ec3ef6f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:59.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.515+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/2644724287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef6f800 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc006b50 tx=0x7ff7dc006ca0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.515+0000 7ff7f1f50740 1 -- 172.21.15.47:0/2644724287 shutdown_connections 2024-07-24T22:13:59.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.515+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/2644724287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef77f60 0x55ec3ef8f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.515+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/2644724287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef68440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.515+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/2644724287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef6f800 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.515+0000 7ff7f1f50740 1 -- 172.21.15.47:0/2644724287 >> 172.21.15.47:0/2644724287 conn(0x55ec3ef694e0 msgr2=0x55ec3ef67d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:59.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.516+0000 7ff7f1f50740 1 -- 172.21.15.47:0/2644724287 shutdown_connections 2024-07-24T22:13:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.516+0000 7ff7f1f50740 1 -- 172.21.15.47:0/2644724287 wait complete. 2024-07-24T22:13:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.516+0000 7ff7f1f50740 1 -- start start 2024-07-24T22:13:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.516+0000 7ff7f1f50740 1 Processor -- start 2024-07-24T22:13:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.516+0000 7ff7f1f50740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef7b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.516+0000 7ff7f1f50740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef7ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.516+0000 7ff7f1f50740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 0x55ec3eff0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.516+0000 7ff7f1f50740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e81af1f0 con 0x55ec3ef77f60 2024-07-24T22:13:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.516+0000 7ff7f1f50740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e81b0660 con 0x55ec3ef6bfd0 2024-07-24T22:13:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.516+0000 7ff7f1f50740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e81af8c0 con 0x55ec3ef6b6b0 2024-07-24T22:13:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.516+0000 7ff7f1f50740 10 client.0 _ll_register_callbacks cb 0x7ff7dc00ac60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:13:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7ed13a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 0x55ec3eff0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7ed13a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 0x55ec3eff0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34292/0 (socket says 172.21.15.47:34292) 2024-07-24T22:13:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7ed13a640 1 -- 172.21.15.47:0/3091541749 learned_addr learned my addr 172.21.15.47:0/3091541749 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:13:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7ed93b640 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef7ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef7b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7ed13a640 1 -- 172.21.15.47:0/3091541749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef6b6b0 msgr2=0x55ec3ef7b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef7b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7ed13a640 1 -- 172.21.15.47:0/3091541749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 msgr2=0x55ec3ef7ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:13:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef7ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7ed13a640 1 -- 172.21.15.47:0/3091541749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec3eff09e0 con 0x55ec3ef77f60 2024-07-24T22:13:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7ed93b640 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef7ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:13:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7ed13a640 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 0x55ec3eff0320 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00ab20 tx=0x7ff7dc038040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d75e806f9ec461 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:13:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:13:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7cd7fa640 1 -- 172.21.15.47:0/3091541749 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc03b070 con 0x55ec3ef77f60 2024-07-24T22:13:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7cd7fa640 1 -- 172.21.15.47:0/3091541749 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7ff7dc017140 con 0x55ec3ef77f60 2024-07-24T22:13:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3091541749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7dc029070 con 0x55ec3ef77f60 2024-07-24T22:13:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7cd7fa640 1 -- 172.21.15.47:0/3091541749 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff7dc018640 con 0x55ec3ef77f60 2024-07-24T22:13:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7f1f50740 10 client.16956 fetch_fsmap learned FSMap version 20 2024-07-24T22:13:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.517+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3091541749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ec3eff1cd0 con 0x55ec3ef77f60 2024-07-24T22:13:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.518+0000 7ff7cd7fa640 1 -- 172.21.15.47:0/3091541749 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7dc029070 con 0x55ec3ef77f60 2024-07-24T22:13:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.518+0000 7ff7cd7fa640 1 -- 172.21.15.47:0/3091541749 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff7dc012040 con 0x55ec3ef77f60 2024-07-24T22:13:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.518+0000 7ff7f1f50740 10 client.16956 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:13:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.518+0000 7ff7f1f50740 10 client.16956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:13:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.518+0000 7ff7f1f50740 20 client.16956 populate_metadata read hostname 'smithi047' 2024-07-24T22:13:59.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.518+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ec3eff21d0 0x55ec3eff45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:13:59.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.518+0000 7ff7f1f50740 4 client.16956 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:13:59.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.518+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3091541749 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ec3eee0380 con 0x55ec3eff21d0 2024-07-24T22:13:59.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.518+0000 7ff7ed93b640 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ec3eff21d0 0x55ec3eff45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:13:59.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7cd7fa640 10 client.16956 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:59.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7ed93b640 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ec3eff21d0 0x55ec3eff45f0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff9c8a54fe0d53e6 server_cookie=84498ed3e15bd6df in_seq=0 out_seq=0 2024-07-24T22:13:59.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7cd7fa640 1 -- 172.21.15.47:0/3091541749 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ec3eee0380 con 0x55ec3eff21d0 2024-07-24T22:13:59.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7cd7fa640 10 client.16956 handle_command_reply: tid=0 2024-07-24T22:13:59.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7f1f50740 1 client.16956 shutdown 2024-07-24T22:13:59.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3091541749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 msgr2=0x55ec3eff0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:59.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 0x55ec3eff0320 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00ab20 tx=0x7ff7dc038040 comp rx=0 tx=0).stop 2024-07-24T22:13:59.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3091541749 shutdown_connections 2024-07-24T22:13:59.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ec3eff21d0 0x55ec3eff45f0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ec3ef77f60 0x55ec3eff0320 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ec3ef6bfd0 0x55ec3ef7ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7cd7fa640 0 client.16956 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:13:59.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7f1f50740 1 --2- 172.21.15.47:0/3091541749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ec3ef6b6b0 0x55ec3ef7b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3091541749 >> 172.21.15.47:0/3091541749 conn(0x55ec3ef694e0 msgr2=0x55ec3ef68550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:59.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3091541749 shutdown_connections 2024-07-24T22:13:59.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7f1f50740 1 -- 172.21.15.47:0/3091541749 wait complete. 2024-07-24T22:13:59.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.519+0000 7ff7f1f50740 20 client.16956 trim_cache size 0 max 16384 2024-07-24T22:13:59.535 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:13:59.535 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:13:59.535 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:13:59.535 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:13:59.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.520+0000 7ff7efb9f640 1 -- 172.21.15.47:0/2584708367 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff7d00b3d40 msgr2=0x7ff7d00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:59.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.520+0000 7ff7efb9f640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff7d00b3d40 0x7ff7d00b6200 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00c74c0 tx=0x7ff7e00978f0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.520+0000 7ff7efb9f640 1 -- 172.21.15.47:0/2584708367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7e8108b20 msgr2=0x7ff7e8075910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:13:59.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.520+0000 7ff7efb9f640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7e8108b20 0x7ff7e8075910 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009a20 tx=0x7ff7e0004270 comp rx=0 tx=0).stop 2024-07-24T22:13:59.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.520+0000 7ff7efb9f640 1 -- 172.21.15.47:0/2584708367 shutdown_connections 2024-07-24T22:13:59.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.520+0000 7ff7efb9f640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff7d00b3d40 0x7ff7d00b6200 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.520+0000 7ff7efb9f640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7e8108b20 0x7ff7e8075910 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.520+0000 7ff7efb9f640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7e81081a0 0x7ff7e80753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.520+0000 7ff7efb9f640 1 --2- 172.21.15.47:0/2584708367 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7e8102790 0x7ff7e8074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:13:59.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.520+0000 7ff7efb9f640 1 -- 172.21.15.47:0/2584708367 >> 172.21.15.47:0/2584708367 conn(0x7ff7e80fe200 msgr2=0x7ff7e81005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:13:59.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.520+0000 7ff7efb9f640 1 -- 172.21.15.47:0/2584708367 shutdown_connections 2024-07-24T22:13:59.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:13:59.520+0000 7ff7efb9f640 1 -- 172.21.15.47:0/2584708367 wait complete. 2024-07-24T22:13:59.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:13:59 smithi047 ceph-mon[32551]: pgmap v571: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 5 op/s 2024-07-24T22:13:59.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:13:59 smithi188 ceph-mon[37380]: pgmap v571: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 5 op/s 2024-07-24T22:13:59.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:13:59 smithi183 ceph-mon[37007]: pgmap v571: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 5 op/s 2024-07-24T22:14:00.743 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:14:00.743 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:14:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.232+0000 7f50f7bfb640 1 -- 172.21.15.47:0/2841064515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0107060 msgr2=0x7f50f01074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.232+0000 7f50f7bfb640 1 --2- 172.21.15.47:0/2841064515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0107060 0x7f50f01074a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009900 tx=0x7f50e002a410 comp rx=0 tx=0).stop 2024-07-24T22:14:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.232+0000 7f50f7bfb640 1 -- 172.21.15.47:0/2841064515 shutdown_connections 2024-07-24T22:14:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.232+0000 7f50f7bfb640 1 --2- 172.21.15.47:0/2841064515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50f01079e0 0x7f50f010e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.232+0000 7f50f7bfb640 1 --2- 172.21.15.47:0/2841064515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0107060 0x7f50f01074a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.232+0000 7f50f7bfb640 1 --2- 172.21.15.47:0/2841064515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f0101650 0x7f50f0101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.232+0000 7f50f7bfb640 1 -- 172.21.15.47:0/2841064515 >> 172.21.15.47:0/2841064515 conn(0x7f50f00fd0c0 msgr2=0x7f50f00ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:01.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.232+0000 7f50f7bfb640 1 -- 172.21.15.47:0/2841064515 shutdown_connections 2024-07-24T22:14:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.232+0000 7f50f7bfb640 1 -- 172.21.15.47:0/2841064515 wait complete. 2024-07-24T22:14:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.233+0000 7f50f7bfb640 1 Processor -- start 2024-07-24T22:14:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.233+0000 7f50f7bfb640 1 -- start start 2024-07-24T22:14:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.233+0000 7f50f7bfb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0101650 0x7f50f0198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.233+0000 7f50f7bfb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f0107060 0x7f50f01991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.233+0000 7f50f7bfb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50f01079e0 0x7f50f019e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.233+0000 7f50f7bfb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50f01127a0 con 0x7f50f0101650 2024-07-24T22:14:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.233+0000 7f50f7bfb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f50f0112620 con 0x7f50f0107060 2024-07-24T22:14:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.233+0000 7f50f7bfb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f50f0112920 con 0x7f50f01079e0 2024-07-24T22:14:01.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.233+0000 7f50f5997640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0101650 0x7f50f0198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.233+0000 7f50f5997640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0101650 0x7f50f0198c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34310/0 (socket says 172.21.15.47:34310) 2024-07-24T22:14:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.233+0000 7f50f5997640 1 -- 172.21.15.47:0/2600666109 learned_addr learned my addr 172.21.15.47:0/2600666109 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.233+0000 7f50f5196640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f0107060 0x7f50f01991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.233+0000 7f50f6198640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50f01079e0 0x7f50f019e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.234+0000 7f50f5997640 1 -- 172.21.15.47:0/2600666109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50f01079e0 msgr2=0x7f50f019e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.234+0000 7f50f5997640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50f01079e0 0x7f50f019e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.234+0000 7f50f5997640 1 -- 172.21.15.47:0/2600666109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f0107060 msgr2=0x7f50f01991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.234+0000 7f50f5997640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f0107060 0x7f50f01991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.234+0000 7f50f5997640 1 -- 172.21.15.47:0/2600666109 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f019ed40 con 0x7f50f0101650 2024-07-24T22:14:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.234+0000 7f50f5997640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0101650 0x7f50f0198c90 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00d950 tx=0x7f50ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:01.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.234+0000 7f50e6ffd640 1 -- 172.21.15.47:0/2600666109 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec017070 con 0x7f50f0101650 2024-07-24T22:14:01.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.234+0000 7f50e6ffd640 1 -- 172.21.15.47:0/2600666109 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50ec009c30 con 0x7f50f0101650 2024-07-24T22:14:01.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.234+0000 7f50f7bfb640 1 -- 172.21.15.47:0/2600666109 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f019f030 con 0x7f50f0101650 2024-07-24T22:14:01.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.234+0000 7f50e6ffd640 1 -- 172.21.15.47:0/2600666109 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec00f620 con 0x7f50f0101650 2024-07-24T22:14:01.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.234+0000 7f50f7bfb640 1 -- 172.21.15.47:0/2600666109 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f01a5770 con 0x7f50f0101650 2024-07-24T22:14:01.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.237+0000 7f50e6ffd640 1 -- 172.21.15.47:0/2600666109 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f50ec010460 con 0x7f50f0101650 2024-07-24T22:14:01.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.237+0000 7f50f9fac740 1 Processor -- start 2024-07-24T22:14:01.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.237+0000 7f50f9fac740 1 -- start start 2024-07-24T22:14:01.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.237+0000 7f50f9fac740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 0x5582e6a71640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.237+0000 7f50f9fac740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a71b80 0x5582e6a71fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.237+0000 7f50f9fac740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a7d9b0 0x5582e6a7fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.237+0000 7f50f9fac740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5582e69e3670 con 0x5582e6a7d9b0 2024-07-24T22:14:01.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.237+0000 7f50f9fac740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5582e69d2b70 con 0x5582e6a730e0 2024-07-24T22:14:01.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.237+0000 7f50f9fac740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5582e69d6bb0 con 0x5582e6a71b80 2024-07-24T22:14:01.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.237+0000 7f50f5196640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a7d9b0 0x5582e6a7fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.237+0000 7f50f5196640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a7d9b0 0x5582e6a7fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34318/0 (socket says 172.21.15.47:34318) 2024-07-24T22:14:01.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.237+0000 7f50f5196640 1 -- 172.21.15.47:0/1638864080 learned_addr learned my addr 172.21.15.47:0/1638864080 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:01.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.238+0000 7f50f6198640 1 --2- 172.21.15.47:0/1638864080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 0x5582e6a71640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.238+0000 7f50e6ffd640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50dc0b3d40 0x7f50dc0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.238+0000 7f50f5196640 1 -- 172.21.15.47:0/1638864080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a71b80 msgr2=0x5582e6a71fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:01.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.238+0000 7f50f5196640 1 --2- 172.21.15.47:0/1638864080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a71b80 0x5582e6a71fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.238+0000 7f50f5196640 1 -- 172.21.15.47:0/1638864080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 msgr2=0x5582e6a71640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:01.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.238+0000 7f50f5196640 1 --2- 172.21.15.47:0/1638864080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 0x5582e6a71640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.238+0000 7f50f5196640 1 -- 172.21.15.47:0/1638864080 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582e696ad30 con 0x5582e6a7d9b0 2024-07-24T22:14:01.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.238+0000 7f50f6198640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50dc0b3d40 0x7f50dc0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.238+0000 7f50e6ffd640 1 -- 172.21.15.47:0/2600666109 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f50ec0e3bc0 con 0x7f50f0101650 2024-07-24T22:14:01.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.238+0000 7f50f5196640 1 --2- 172.21.15.47:0/1638864080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a7d9b0 0x5582e6a7fda0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009900 tx=0x7f50e0032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d56e311f1513f8b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:01.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.239+0000 7f50f6198640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50dc0b3d40 0x7f50dc0b6200 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009fd0 tx=0x7f50e8004b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:01.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.239+0000 7f50dbfff640 1 -- 172.21.15.47:0/1638864080 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0040070 con 0x5582e6a7d9b0 2024-07-24T22:14:01.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.239+0000 7f50dbfff640 1 -- 172.21.15.47:0/1638864080 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50e00316a0 con 0x5582e6a7d9b0 2024-07-24T22:14:01.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.239+0000 7f50dbfff640 1 -- 172.21.15.47:0/1638864080 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0035040 con 0x5582e6a7d9b0 2024-07-24T22:14:01.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.240+0000 7f50f9fac740 1 -- 172.21.15.47:0/1638864080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a7d9b0 msgr2=0x5582e6a7fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:01.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.240+0000 7f50f9fac740 1 --2- 172.21.15.47:0/1638864080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a7d9b0 0x5582e6a7fda0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009900 tx=0x7f50e0032e60 comp rx=0 tx=0).stop 2024-07-24T22:14:01.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.240+0000 7f50f9fac740 1 -- 172.21.15.47:0/1638864080 shutdown_connections 2024-07-24T22:14:01.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.240+0000 7f50f9fac740 1 --2- 172.21.15.47:0/1638864080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a7d9b0 0x5582e6a7fda0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.240+0000 7f50f9fac740 1 --2- 172.21.15.47:0/1638864080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a71b80 0x5582e6a71fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.240+0000 7f50f9fac740 1 --2- 172.21.15.47:0/1638864080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 0x5582e6a71640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.240+0000 7f50f9fac740 1 -- 172.21.15.47:0/1638864080 >> 172.21.15.47:0/1638864080 conn(0x5582e6a37720 msgr2=0x5582e6a6f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:01.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.240+0000 7f50f9fac740 1 -- 172.21.15.47:0/1638864080 shutdown_connections 2024-07-24T22:14:01.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.240+0000 7f50f9fac740 1 -- 172.21.15.47:0/1638864080 wait complete. 2024-07-24T22:14:01.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.241+0000 7f50f9fac740 1 -- start start 2024-07-24T22:14:01.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.241+0000 7f50f9fac740 1 Processor -- start 2024-07-24T22:14:01.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.241+0000 7f50f9fac740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 0x5582e6a7abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.241+0000 7f50f9fac740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 0x5582e6a7b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.241+0000 7f50f9fac740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a7b670 0x5582e6a89ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f9fac740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5582e68367a0 con 0x5582e6a71b80 2024-07-24T22:14:01.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f9fac740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5582e6974ff0 con 0x5582e6a730e0 2024-07-24T22:14:01.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f9fac740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5582e6a80810 con 0x5582e6a7b670 2024-07-24T22:14:01.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f9fac740 10 client.0 _ll_register_callbacks cb 0x5582e66e0090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:01.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f5997640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 0x5582e6a7abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f5997640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 0x5582e6a7abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34328/0 (socket says 172.21.15.47:34328) 2024-07-24T22:14:01.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f5997640 1 -- 172.21.15.47:0/4060050132 learned_addr learned my addr 172.21.15.47:0/4060050132 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:01.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f5196640 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 0x5582e6a7b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f6198640 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a7b670 0x5582e6a89ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f5997640 1 -- 172.21.15.47:0/4060050132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a7b670 msgr2=0x5582e6a89ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:01.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f5997640 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a7b670 0x5582e6a89ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f5997640 1 -- 172.21.15.47:0/4060050132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 msgr2=0x5582e6a7b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:01.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f5997640 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 0x5582e6a7b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f5997640 1 -- 172.21.15.47:0/4060050132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582e69790a0 con 0x5582e6a71b80 2024-07-24T22:14:01.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f6198640 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a7b670 0x5582e6a89ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:01.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50f5997640 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 0x5582e6a7abf0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0e1340 tx=0x7f50ec0aa2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cf573df395a08c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:01.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.242+0000 7f50d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:01.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.243+0000 7f50d97fa640 1 -- 172.21.15.47:0/4060050132 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec020070 con 0x5582e6a71b80 2024-07-24T22:14:01.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.243+0000 7f50d97fa640 1 -- 172.21.15.47:0/4060050132 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f50ec0cd2e0 con 0x5582e6a71b80 2024-07-24T22:14:01.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.243+0000 7f50f9fac740 1 -- 172.21.15.47:0/4060050132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50e00316a0 con 0x5582e6a71b80 2024-07-24T22:14:01.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.243+0000 7f50d97fa640 1 -- 172.21.15.47:0/4060050132 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f50ec0aa360 con 0x5582e6a71b80 2024-07-24T22:14:01.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.243+0000 7f50f9fac740 10 client.16968 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:01.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.243+0000 7f50f9fac740 1 -- 172.21.15.47:0/4060050132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5582e6742b90 con 0x5582e6a71b80 2024-07-24T22:14:01.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.243+0000 7f50d97fa640 1 -- 172.21.15.47:0/4060050132 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50ec009de0 con 0x5582e6a71b80 2024-07-24T22:14:01.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.243+0000 7f50d97fa640 1 -- 172.21.15.47:0/4060050132 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f50ec0a63c0 con 0x5582e6a71b80 2024-07-24T22:14:01.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.243+0000 7f50f9fac740 10 client.16968 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:01.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.244+0000 7f50f9fac740 10 client.16968 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:14:01.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.244+0000 7f50f9fac740 20 client.16968 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:01.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.244+0000 7f50f9fac740 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582e6a8e060 0x5582e6a90450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.244+0000 7f50f9fac740 4 client.16968 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:01.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.244+0000 7f50f9fac740 1 -- 172.21.15.47:0/4060050132 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f50e00316a0 con 0x5582e6a8e060 2024-07-24T22:14:01.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.244+0000 7f50f5196640 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582e6a8e060 0x5582e6a90450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.244+0000 7f50f5196640 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582e6a8e060 0x5582e6a90450 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=827267213fda03e3 server_cookie=adf88728f703cc7e in_seq=0 out_seq=0 2024-07-24T22:14:01.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.244+0000 7f50d97fa640 10 client.16968 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:01.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.245+0000 7f50d97fa640 1 -- 172.21.15.47:0/4060050132 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f50e00316a0 con 0x5582e6a8e060 2024-07-24T22:14:01.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.245+0000 7f50d97fa640 10 client.16968 handle_command_reply: tid=0 2024-07-24T22:14:01.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.245+0000 7f50f9fac740 1 client.16968 shutdown 2024-07-24T22:14:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.245+0000 7f50f9fac740 1 -- 172.21.15.47:0/4060050132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 msgr2=0x5582e6a7abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.245+0000 7f50f9fac740 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 0x5582e6a7abf0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0e1340 tx=0x7f50ec0aa2d0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.245+0000 7f50f9fac740 1 -- 172.21.15.47:0/4060050132 shutdown_connections 2024-07-24T22:14:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.246+0000 7f50f9fac740 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582e6a8e060 0x5582e6a90450 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.246+0000 7f50f9fac740 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a7b670 0x5582e6a89ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.246+0000 7f50f9fac740 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 0x5582e6a7b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.246+0000 7f50d97fa640 0 client.16968 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.246+0000 7f50f9fac740 1 --2- 172.21.15.47:0/4060050132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 0x5582e6a7abf0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.246+0000 7f50f9fac740 1 -- 172.21.15.47:0/4060050132 >> 172.21.15.47:0/4060050132 conn(0x5582e6a37720 msgr2=0x5582e6a6a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.246+0000 7f50f9fac740 1 -- 172.21.15.47:0/4060050132 shutdown_connections 2024-07-24T22:14:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.246+0000 7f50f9fac740 1 -- 172.21.15.47:0/4060050132 wait complete. 2024-07-24T22:14:01.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.246+0000 7f50f9fac740 20 client.16968 trim_cache size 0 max 16384 2024-07-24T22:14:01.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.265+0000 7f50f9fac740 1 Processor -- start 2024-07-24T22:14:01.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.265+0000 7f50f9fac740 1 -- start start 2024-07-24T22:14:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f9fac740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a71b80 0x5582e6a6f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f9fac740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a730e0 0x5582e6a89990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f9fac740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a7b670 0x5582e6a7c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f9fac740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50f01aa0e0 con 0x5582e6a730e0 2024-07-24T22:14:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f9fac740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f50f01ac940 con 0x5582e6a7b670 2024-07-24T22:14:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f9fac740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f50f01aa730 con 0x5582e6a71b80 2024-07-24T22:14:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f5196640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a730e0 0x5582e6a89990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f5196640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a730e0 0x5582e6a89990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34340/0 (socket says 172.21.15.47:34340) 2024-07-24T22:14:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f5196640 1 -- 172.21.15.47:0/1518224438 learned_addr learned my addr 172.21.15.47:0/1518224438 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f5997640 1 --2- 172.21.15.47:0/1518224438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a71b80 0x5582e6a6f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f6198640 1 --2- 172.21.15.47:0/1518224438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a7b670 0x5582e6a7c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f5196640 1 -- 172.21.15.47:0/1518224438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a71b80 msgr2=0x5582e6a6f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f5196640 1 --2- 172.21.15.47:0/1518224438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a71b80 0x5582e6a6f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f5196640 1 -- 172.21.15.47:0/1518224438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a7b670 msgr2=0x5582e6a7c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f5196640 1 --2- 172.21.15.47:0/1518224438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a7b670 0x5582e6a7c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.266+0000 7f50f5196640 1 -- 172.21.15.47:0/1518224438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582e6a90a80 con 0x5582e6a730e0 2024-07-24T22:14:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.267+0000 7f50f5997640 1 --2- 172.21.15.47:0/1518224438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a71b80 0x5582e6a6f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.267+0000 7f50f5196640 1 --2- 172.21.15.47:0/1518224438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a730e0 0x5582e6a89990 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009900 tx=0x7f50e00053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25766d906e82df9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.267+0000 7f50db7fe640 1 -- 172.21.15.47:0/1518224438 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0035040 con 0x5582e6a730e0 2024-07-24T22:14:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.267+0000 7f50db7fe640 1 -- 172.21.15.47:0/1518224438 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50e0031820 con 0x5582e6a730e0 2024-07-24T22:14:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.267+0000 7f50db7fe640 1 -- 172.21.15.47:0/1518224438 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0040040 con 0x5582e6a730e0 2024-07-24T22:14:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.268+0000 7f50f9fac740 1 -- 172.21.15.47:0/1518224438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a730e0 msgr2=0x5582e6a89990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.268+0000 7f50f9fac740 1 --2- 172.21.15.47:0/1518224438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a730e0 0x5582e6a89990 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009900 tx=0x7f50e00053a0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.268+0000 7f50f9fac740 1 -- 172.21.15.47:0/1518224438 shutdown_connections 2024-07-24T22:14:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.268+0000 7f50f9fac740 1 --2- 172.21.15.47:0/1518224438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a7b670 0x5582e6a7c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.268+0000 7f50f9fac740 1 --2- 172.21.15.47:0/1518224438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a730e0 0x5582e6a89990 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.268+0000 7f50f9fac740 1 --2- 172.21.15.47:0/1518224438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a71b80 0x5582e6a6f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.268+0000 7f50f9fac740 1 -- 172.21.15.47:0/1518224438 >> 172.21.15.47:0/1518224438 conn(0x5582e6a37720 msgr2=0x5582e6a7c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.268+0000 7f50f9fac740 1 -- 172.21.15.47:0/1518224438 shutdown_connections 2024-07-24T22:14:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.268+0000 7f50f9fac740 1 -- 172.21.15.47:0/1518224438 wait complete. 2024-07-24T22:14:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.268+0000 7f50f9fac740 1 -- start start 2024-07-24T22:14:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.268+0000 7f50f9fac740 1 Processor -- start 2024-07-24T22:14:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f9fac740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 0x5582e6a85b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f9fac740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 0x5582e6a86040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f9fac740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a7b670 0x5582e6a76e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f9fac740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50f01aae00 con 0x5582e6a71b80 2024-07-24T22:14:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f9fac740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f50f01ac270 con 0x5582e6a730e0 2024-07-24T22:14:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f9fac740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f50f01ab4d0 con 0x5582e6a7b670 2024-07-24T22:14:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f9fac740 10 client.0 _ll_register_callbacks cb 0x7f50ec00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f5997640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 0x5582e6a85b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f5997640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 0x5582e6a85b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34356/0 (socket says 172.21.15.47:34356) 2024-07-24T22:14:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f5997640 1 -- 172.21.15.47:0/703740498 learned_addr learned my addr 172.21.15.47:0/703740498 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f5196640 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 0x5582e6a86040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f6198640 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a7b670 0x5582e6a76e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f5997640 1 -- 172.21.15.47:0/703740498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a7b670 msgr2=0x5582e6a76e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f5997640 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a7b670 0x5582e6a76e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f5997640 1 -- 172.21.15.47:0/703740498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 msgr2=0x5582e6a86040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f5997640 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 0x5582e6a86040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f5997640 1 -- 172.21.15.47:0/703740498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582e6a774b0 con 0x5582e6a71b80 2024-07-24T22:14:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.269+0000 7f50f6198640 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a7b670 0x5582e6a76e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.270+0000 7f50f5997640 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 0x5582e6a85b00 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0e3f70 tx=0x7f50ec0a6db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d6e881371c8e95 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.270+0000 7f50d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.270+0000 7f50d97fa640 1 -- 172.21.15.47:0/703740498 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec020070 con 0x5582e6a71b80 2024-07-24T22:14:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.270+0000 7f50f9fac740 1 -- 172.21.15.47:0/703740498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50e0031820 con 0x5582e6a71b80 2024-07-24T22:14:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.270+0000 7f50d97fa640 1 -- 172.21.15.47:0/703740498 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f50ec0a9ab0 con 0x5582e6a71b80 2024-07-24T22:14:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.270+0000 7f50d97fa640 1 -- 172.21.15.47:0/703740498 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f50ec0aa620 con 0x5582e6a71b80 2024-07-24T22:14:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.270+0000 7f50f9fac740 10 client.16974 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:01.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.270+0000 7f50f9fac740 1 -- 172.21.15.47:0/703740498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5582e6a78790 con 0x5582e6a71b80 2024-07-24T22:14:01.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.270+0000 7f50d97fa640 1 -- 172.21.15.47:0/703740498 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50e0031820 con 0x5582e6a71b80 2024-07-24T22:14:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.270+0000 7f50d97fa640 1 -- 172.21.15.47:0/703740498 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f50ec0abad0 con 0x5582e6a71b80 2024-07-24T22:14:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.271+0000 7f50f9fac740 10 client.16974 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.271+0000 7f50f9fac740 10 client.16974 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:14:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.271+0000 7f50f9fac740 20 client.16974 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.271+0000 7f50f9fac740 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582e6af9c90 0x5582e6afc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.271+0000 7f50f9fac740 4 client.16974 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-07-24T22:14:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.271+0000 7f50f9fac740 1 -- 172.21.15.47:0/703740498 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5582e69e55c0 con 0x5582e6af9c90 2024-07-24T22:14:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.271+0000 7f50f5196640 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582e6af9c90 0x5582e6afc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.271+0000 7f50f5196640 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582e6af9c90 0x5582e6afc080 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cd4bc5351dddbec server_cookie=31226a36d04d8e99 in_seq=0 out_seq=0 2024-07-24T22:14:01.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.271+0000 7f50d97fa640 10 client.16974 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:01.285 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:14:01.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.281+0000 7f50d97fa640 1 -- 172.21.15.47:0/703740498 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5582e69e55c0 con 0x5582e6af9c90 2024-07-24T22:14:01.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.281+0000 7f50d97fa640 10 client.16974 handle_command_reply: tid=0 2024-07-24T22:14:01.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.281+0000 7f50f9fac740 1 client.16974 shutdown 2024-07-24T22:14:01.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.281+0000 7f50f9fac740 1 -- 172.21.15.47:0/703740498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 msgr2=0x5582e6a85b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:01.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f9fac740 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 0x5582e6a85b00 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0e3f70 tx=0x7f50ec0a6db0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f9fac740 1 -- 172.21.15.47:0/703740498 shutdown_connections 2024-07-24T22:14:01.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f9fac740 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582e6af9c90 0x5582e6afc080 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f9fac740 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582e6a7b670 0x5582e6a76e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f9fac740 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582e6a730e0 0x5582e6a86040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f9fac740 1 --2- 172.21.15.47:0/703740498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582e6a71b80 0x5582e6a85b00 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50d97fa640 0 client.16974 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:01.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f9fac740 1 -- 172.21.15.47:0/703740498 >> 172.21.15.47:0/703740498 conn(0x5582e6a37720 msgr2=0x5582e6a79c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:01.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f9fac740 1 -- 172.21.15.47:0/703740498 shutdown_connections 2024-07-24T22:14:01.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f9fac740 1 -- 172.21.15.47:0/703740498 wait complete. 2024-07-24T22:14:01.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f9fac740 20 client.16974 trim_cache size 0 max 16384 2024-07-24T22:14:01.287 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:14:01.287 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:14:01.288 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:14:01.288 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 22, 2024-07-24T22:14:01.288 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:14:01.288 INFO:teuthology.orchestra.run.smithi047.stdout: "52f39621": { 2024-07-24T22:14:01.288 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 22, 2024-07-24T22:14:01.288 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:14:01.288 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:14:01.288 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:14:01.288 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:14:01.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:14:01.289 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:14:01.289 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 150.0, 2024-07-24T22:14:01.289 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:14:01.289 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:14:01.289 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:14:01.290 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:14:01.290 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:14:01.290 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:14:01.290 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:01.290 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:01.291 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:01.291 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:01.291 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:01.291 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:14:01.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f7bfb640 1 -- 172.21.15.47:0/2600666109 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50dc0b3d40 msgr2=0x7f50dc0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:01.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f7bfb640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50dc0b3d40 0x7f50dc0b6200 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009fd0 tx=0x7f50e8004b50 comp rx=0 tx=0).stop 2024-07-24T22:14:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f7bfb640 1 -- 172.21.15.47:0/2600666109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0101650 msgr2=0x7f50f0198c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.282+0000 7f50f7bfb640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0101650 0x7f50f0198c90 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00d950 tx=0x7f50ec00de10 comp rx=0 tx=0).stop 2024-07-24T22:14:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.283+0000 7f50f7bfb640 1 -- 172.21.15.47:0/2600666109 shutdown_connections 2024-07-24T22:14:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.283+0000 7f50f7bfb640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50dc0b3d40 0x7f50dc0b6200 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.283+0000 7f50f7bfb640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50f01079e0 0x7f50f019e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.283+0000 7f50f7bfb640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f0107060 0x7f50f01991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.283+0000 7f50f7bfb640 1 --2- 172.21.15.47:0/2600666109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50f0101650 0x7f50f0198c90 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.283+0000 7f50f7bfb640 1 -- 172.21.15.47:0/2600666109 >> 172.21.15.47:0/2600666109 conn(0x7f50f00fd0c0 msgr2=0x7f50f00ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.283+0000 7f50f7bfb640 1 -- 172.21.15.47:0/2600666109 shutdown_connections 2024-07-24T22:14:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:01.283+0000 7f50f7bfb640 1 -- 172.21.15.47:0/2600666109 wait complete. 2024-07-24T22:14:01.791 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:01 smithi047 ceph-mon[32551]: pgmap v572: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-07-24T22:14:01.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:01 smithi188 ceph-mon[37380]: pgmap v572: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-07-24T22:14:01.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:01 smithi183 ceph-mon[37007]: pgmap v572: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-07-24T22:14:02.252 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '52f39621', quiesce took 10.0 seconds. Will release after: 20.0 2024-07-24T22:14:02.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.294+0000 7fcb589ed640 1 -- 172.21.15.47:0/2250400543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb54103670 msgr2=0x7fcb54103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.294+0000 7fcb589ed640 1 --2- 172.21.15.47:0/2250400543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb54103670 0x7fcb54103a50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009900 tx=0x7fcb4402a410 comp rx=0 tx=0).stop 2024-07-24T22:14:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.295+0000 7fcb589ed640 1 -- 172.21.15.47:0/2250400543 shutdown_connections 2024-07-24T22:14:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.295+0000 7fcb589ed640 1 --2- 172.21.15.47:0/2250400543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb5410cac0 0x7fcb5410ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.295+0000 7fcb589ed640 1 --2- 172.21.15.47:0/2250400543 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb54103f90 0x7fcb5410c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.295+0000 7fcb589ed640 1 --2- 172.21.15.47:0/2250400543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb54103670 0x7fcb54103a50 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.295+0000 7fcb589ed640 1 -- 172.21.15.47:0/2250400543 >> 172.21.15.47:0/2250400543 conn(0x7fcb540fd0c0 msgr2=0x7fcb540ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.295+0000 7fcb589ed640 1 -- 172.21.15.47:0/2250400543 shutdown_connections 2024-07-24T22:14:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.295+0000 7fcb589ed640 1 -- 172.21.15.47:0/2250400543 wait complete. 2024-07-24T22:14:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.295+0000 7fcb589ed640 1 Processor -- start 2024-07-24T22:14:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb589ed640 1 -- start start 2024-07-24T22:14:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb589ed640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb54103670 0x7fcb54101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb589ed640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb54103f90 0x7fcb54101850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb589ed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb5410cac0 0x7fcb54101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb589ed640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcb54112730 con 0x7fcb5410cac0 2024-07-24T22:14:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb589ed640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcb541125b0 con 0x7fcb54103670 2024-07-24T22:14:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb589ed640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcb541128b0 con 0x7fcb54103f90 2024-07-24T22:14:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb52d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb5410cac0 0x7fcb54101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb52d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb5410cac0 0x7fcb54101d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34366/0 (socket says 172.21.15.47:34366) 2024-07-24T22:14:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb52d9d640 1 -- 172.21.15.47:0/3793860195 learned_addr learned my addr 172.21.15.47:0/3793860195 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb51d9b640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb54103f90 0x7fcb54101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb5259c640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb54103670 0x7fcb54101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb52d9d640 1 -- 172.21.15.47:0/3793860195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb54103f90 msgr2=0x7fcb54101850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb52d9d640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb54103f90 0x7fcb54101850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb52d9d640 1 -- 172.21.15.47:0/3793860195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb54103670 msgr2=0x7fcb54101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb52d9d640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb54103670 0x7fcb54101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb52d9d640 1 -- 172.21.15.47:0/3793860195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb541a70e0 con 0x7fcb5410cac0 2024-07-24T22:14:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.296+0000 7fcb52d9d640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb5410cac0 0x7fcb54101d90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00cce0 tx=0x7fcb4c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.297+0000 7fcb437fe640 1 -- 172.21.15.47:0/3793860195 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00f450 con 0x7fcb5410cac0 2024-07-24T22:14:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.297+0000 7fcb437fe640 1 -- 172.21.15.47:0/3793860195 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb4c00faa0 con 0x7fcb5410cac0 2024-07-24T22:14:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.297+0000 7fcb589ed640 1 -- 172.21.15.47:0/3793860195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb541a73d0 con 0x7fcb5410cac0 2024-07-24T22:14:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.297+0000 7fcb437fe640 1 -- 172.21.15.47:0/3793860195 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c018b70 con 0x7fcb5410cac0 2024-07-24T22:14:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.297+0000 7fcb589ed640 1 -- 172.21.15.47:0/3793860195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb541a78d0 con 0x7fcb5410cac0 2024-07-24T22:14:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.299+0000 7fcb437fe640 1 -- 172.21.15.47:0/3793860195 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fcb4c018d10 con 0x7fcb5410cac0 2024-07-24T22:14:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.299+0000 7fcb5b823740 1 Processor -- start 2024-07-24T22:14:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.299+0000 7fcb5b823740 1 -- start start 2024-07-24T22:14:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5b823740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae8c90 0x55b337ae9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5b823740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 0x55b337af5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5b823740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337af5540 0x55b337af7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5b823740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b337a5e280 con 0x55b337ae95b0 2024-07-24T22:14:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5b823740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b337a4d780 con 0x55b337af5540 2024-07-24T22:14:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5b823740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b337a517c0 con 0x55b337ae8c90 2024-07-24T22:14:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 0x55b337af5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 0x55b337af5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34370/0 (socket says 172.21.15.47:34370) 2024-07-24T22:14:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5259c640 1 -- 172.21.15.47:0/1460522668 learned_addr learned my addr 172.21.15.47:0/1460522668 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb437fe640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcb3c0b3d40 0x7fcb3c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb51d9b640 1 --2- 172.21.15.47:0/1460522668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae8c90 0x55b337ae9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb52d9d640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcb3c0b3d40 0x7fcb3c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb51d9b640 1 --2- 172.21.15.47:0/1460522668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337af5540 0x55b337af7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5259c640 1 -- 172.21.15.47:0/1460522668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae8c90 msgr2=0x55b337ae9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5259c640 1 --2- 172.21.15.47:0/1460522668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae8c90 0x55b337ae9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5259c640 1 -- 172.21.15.47:0/1460522668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337af5540 msgr2=0x55b337af7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5259c640 1 --2- 172.21.15.47:0/1460522668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337af5540 0x55b337af7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5259c640 1 -- 172.21.15.47:0/1460522668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3377b1790 con 0x55b337ae95b0 2024-07-24T22:14:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb51d9b640 1 --2- 172.21.15.47:0/1460522668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae8c90 0x55b337ae9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb437fe640 1 -- 172.21.15.47:0/3793860195 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7fcb4c0e44b0 con 0x7fcb5410cac0 2024-07-24T22:14:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.300+0000 7fcb5259c640 1 --2- 172.21.15.47:0/1460522668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 0x55b337af5000 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fcb44000c00 tx=0x7fcb44032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacab1fd37aef892 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.301+0000 7fcb52d9d640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcb3c0b3d40 0x7fcb3c0b6200 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0ab020 tx=0x7fcb4c0a6fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.301+0000 7fcb40ff9640 1 -- 172.21.15.47:0/1460522668 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4403f070 con 0x55b337ae95b0 2024-07-24T22:14:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.301+0000 7fcb40ff9640 1 -- 172.21.15.47:0/1460522668 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb440316a0 con 0x55b337ae95b0 2024-07-24T22:14:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.301+0000 7fcb40ff9640 1 -- 172.21.15.47:0/1460522668 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44035070 con 0x55b337ae95b0 2024-07-24T22:14:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.301+0000 7fcb5b823740 1 -- 172.21.15.47:0/1460522668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 msgr2=0x55b337af5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.301+0000 7fcb5b823740 1 --2- 172.21.15.47:0/1460522668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 0x55b337af5000 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fcb44000c00 tx=0x7fcb44032ce0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.301+0000 7fcb5b823740 1 -- 172.21.15.47:0/1460522668 shutdown_connections 2024-07-24T22:14:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.301+0000 7fcb5b823740 1 --2- 172.21.15.47:0/1460522668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337af5540 0x55b337af7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.301+0000 7fcb5b823740 1 --2- 172.21.15.47:0/1460522668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 0x55b337af5000 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.301+0000 7fcb5b823740 1 --2- 172.21.15.47:0/1460522668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae8c90 0x55b337ae9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.301+0000 7fcb5b823740 1 -- 172.21.15.47:0/1460522668 >> 172.21.15.47:0/1460522668 conn(0x55b337ae6ac0 msgr2=0x55b337ae7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb5b823740 1 -- 172.21.15.47:0/1460522668 shutdown_connections 2024-07-24T22:14:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb5b823740 1 -- 172.21.15.47:0/1460522668 wait complete. 2024-07-24T22:14:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb5b823740 1 -- start start 2024-07-24T22:14:02.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb5b823740 1 Processor -- start 2024-07-24T22:14:02.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb5b823740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae8c90 0x55b337af4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb5b823740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae95b0 0x55b337af20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb5b823740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337af5540 0x55b337af25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb5b823740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b337987ab0 con 0x55b337ae8c90 2024-07-24T22:14:02.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb5b823740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b3379d59e0 con 0x55b337af5540 2024-07-24T22:14:02.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb5b823740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b337af81c0 con 0x55b337ae95b0 2024-07-24T22:14:02.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb5b823740 10 client.0 _ll_register_callbacks cb 0x55b33775da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:02.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb51d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae8c90 0x55b337af4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb51d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae8c90 0x55b337af4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34380/0 (socket says 172.21.15.47:34380) 2024-07-24T22:14:02.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb51d9b640 1 -- 172.21.15.47:0/2849370746 learned_addr learned my addr 172.21.15.47:0/2849370746 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:02.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.302+0000 7fcb5259c640 1 --2- 172.21.15.47:0/2849370746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae95b0 0x55b337af20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb51d9b640 1 --2- 172.21.15.47:0/2849370746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337af5540 0x55b337af25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb51d9b640 1 -- 172.21.15.47:0/2849370746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae95b0 msgr2=0x55b337af20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:02.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb51d9b640 1 --2- 172.21.15.47:0/2849370746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae95b0 0x55b337af20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb51d9b640 1 -- 172.21.15.47:0/2849370746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337af5540 msgr2=0x55b337af25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:02.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb51d9b640 1 --2- 172.21.15.47:0/2849370746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337af5540 0x55b337af25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb51d9b640 1 -- 172.21.15.47:0/2849370746 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b33782a620 con 0x55b337ae8c90 2024-07-24T22:14:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb51d9b640 1 --2- 172.21.15.47:0/2849370746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae8c90 0x55b337af4bc0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800be50 tx=0x7fcb480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551f62e7aab06b54 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb39ffb640 1 -- 172.21.15.47:0/2849370746 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48004020 con 0x55b337ae8c90 2024-07-24T22:14:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb39ffb640 1 -- 172.21.15.47:0/2849370746 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7fcb480041c0 con 0x55b337ae8c90 2024-07-24T22:14:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb5b823740 1 -- 172.21.15.47:0/2849370746 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b3379fcce0 con 0x55b337ae8c90 2024-07-24T22:14:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb39ffb640 1 -- 172.21.15.47:0/2849370746 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcb48024050 con 0x55b337ae8c90 2024-07-24T22:14:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb5b823740 10 client.16986 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb5b823740 1 -- 172.21.15.47:0/2849370746 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b337b03910 con 0x55b337ae8c90 2024-07-24T22:14:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.303+0000 7fcb39ffb640 1 -- 172.21.15.47:0/2849370746 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b3379fcce0 con 0x55b337ae8c90 2024-07-24T22:14:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.304+0000 7fcb39ffb640 1 -- 172.21.15.47:0/2849370746 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcb4801d060 con 0x55b337ae8c90 2024-07-24T22:14:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.304+0000 7fcb5b823740 10 client.16986 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.304+0000 7fcb5b823740 10 client.16986 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.304+0000 7fcb5b823740 20 client.16986 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.304+0000 7fcb5b823740 1 --2- 172.21.15.47:0/2849370746 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b337b04e20 0x55b337b07210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.304+0000 7fcb5b823740 4 client.16986 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.304+0000 7fcb5b823740 1 -- 172.21.15.47:0/2849370746 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b337a601d0 con 0x55b337b04e20 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.304+0000 7fcb5259c640 1 --2- 172.21.15.47:0/2849370746 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b337b04e20 0x55b337b07210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.304+0000 7fcb39ffb640 10 client.16986 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.304+0000 7fcb5259c640 1 --2- 172.21.15.47:0/2849370746 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b337b04e20 0x55b337b07210 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88dfafdd87a98678 server_cookie=98b1faaab6ba5e9a in_seq=0 out_seq=0 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.305+0000 7fcb39ffb640 1 -- 172.21.15.47:0/2849370746 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b337a601d0 con 0x55b337b04e20 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.305+0000 7fcb39ffb640 10 client.16986 handle_command_reply: tid=0 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.305+0000 7fcb5b823740 1 client.16986 shutdown 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.305+0000 7fcb5b823740 1 -- 172.21.15.47:0/2849370746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae8c90 msgr2=0x55b337af4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.305+0000 7fcb5b823740 1 --2- 172.21.15.47:0/2849370746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae8c90 0x55b337af4bc0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800be50 tx=0x7fcb480046c0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.305+0000 7fcb5b823740 1 -- 172.21.15.47:0/2849370746 shutdown_connections 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.305+0000 7fcb5b823740 1 --2- 172.21.15.47:0/2849370746 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b337b04e20 0x55b337b07210 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.305+0000 7fcb5b823740 1 --2- 172.21.15.47:0/2849370746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337af5540 0x55b337af25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.305+0000 7fcb5b823740 1 --2- 172.21.15.47:0/2849370746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae95b0 0x55b337af20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.305+0000 7fcb5b823740 1 --2- 172.21.15.47:0/2849370746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae8c90 0x55b337af4bc0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.305+0000 7fcb39ffb640 0 client.16986 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.305+0000 7fcb5b823740 1 -- 172.21.15.47:0/2849370746 >> 172.21.15.47:0/2849370746 conn(0x55b337ae6ac0 msgr2=0x55b337aec660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.305+0000 7fcb5b823740 1 -- 172.21.15.47:0/2849370746 shutdown_connections 2024-07-24T22:14:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.306+0000 7fcb5b823740 1 -- 172.21.15.47:0/2849370746 wait complete. 2024-07-24T22:14:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.306+0000 7fcb5b823740 20 client.16986 trim_cache size 0 max 16384 2024-07-24T22:14:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5b823740 1 Processor -- start 2024-07-24T22:14:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5b823740 1 -- start start 2024-07-24T22:14:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5b823740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337ae8c90 0x55b337ae8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5b823740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 0x55b337b0ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5b823740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337af5540 0x55b337b0cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5b823740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcb541ae3a0 con 0x55b337ae95b0 2024-07-24T22:14:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5b823740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcb541b0c00 con 0x55b337ae8c90 2024-07-24T22:14:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5b823740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcb541ae9f0 con 0x55b337af5540 2024-07-24T22:14:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 0x55b337b0ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 0x55b337b0ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34394/0 (socket says 172.21.15.47:34394) 2024-07-24T22:14:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5259c640 1 -- 172.21.15.47:0/60943366 learned_addr learned my addr 172.21.15.47:0/60943366 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb51d9b640 1 --2- 172.21.15.47:0/60943366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337af5540 0x55b337b0cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5259c640 1 -- 172.21.15.47:0/60943366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337af5540 msgr2=0x55b337b0cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5259c640 1 --2- 172.21.15.47:0/60943366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337af5540 0x55b337b0cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5259c640 1 -- 172.21.15.47:0/60943366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337ae8c90 msgr2=0x55b337ae8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5259c640 1 --2- 172.21.15.47:0/60943366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337ae8c90 0x55b337ae8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5259c640 1 -- 172.21.15.47:0/60943366 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b337b07580 con 0x55b337ae95b0 2024-07-24T22:14:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.321+0000 7fcb5259c640 1 --2- 172.21.15.47:0/60943366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 0x55b337b0ca90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x55b337aebe10 tx=0x7fcb44009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c544ac092c306d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.322+0000 7fcb3bfff640 1 -- 172.21.15.47:0/60943366 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44051070 con 0x55b337ae95b0 2024-07-24T22:14:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.322+0000 7fcb3bfff640 1 -- 172.21.15.47:0/60943366 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb44004240 con 0x55b337ae95b0 2024-07-24T22:14:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.322+0000 7fcb3bfff640 1 -- 172.21.15.47:0/60943366 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4403f070 con 0x55b337ae95b0 2024-07-24T22:14:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.322+0000 7fcb5b823740 1 -- 172.21.15.47:0/60943366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 msgr2=0x55b337b0ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.322+0000 7fcb5b823740 1 --2- 172.21.15.47:0/60943366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 0x55b337b0ca90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x55b337aebe10 tx=0x7fcb44009230 comp rx=0 tx=0).stop 2024-07-24T22:14:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.322+0000 7fcb5b823740 1 -- 172.21.15.47:0/60943366 shutdown_connections 2024-07-24T22:14:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.322+0000 7fcb5b823740 1 --2- 172.21.15.47:0/60943366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337af5540 0x55b337b0cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.322+0000 7fcb5b823740 1 --2- 172.21.15.47:0/60943366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337ae95b0 0x55b337b0ca90 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.322+0000 7fcb5b823740 1 --2- 172.21.15.47:0/60943366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337ae8c90 0x55b337ae8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.322+0000 7fcb5b823740 1 -- 172.21.15.47:0/60943366 >> 172.21.15.47:0/60943366 conn(0x55b337ae6ac0 msgr2=0x55b337ae7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.322+0000 7fcb5b823740 1 -- 172.21.15.47:0/60943366 shutdown_connections 2024-07-24T22:14:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.322+0000 7fcb5b823740 1 -- 172.21.15.47:0/60943366 wait complete. 2024-07-24T22:14:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.322+0000 7fcb5b823740 1 -- start start 2024-07-24T22:14:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb5b823740 1 Processor -- start 2024-07-24T22:14:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb5b823740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337ae8c90 0x55b337afda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb5b823740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae95b0 0x55b337af8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb5b823740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337af5540 0x55b337af8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb5b823740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcb541af0c0 con 0x55b337af5540 2024-07-24T22:14:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb5b823740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcb541b0530 con 0x55b337ae8c90 2024-07-24T22:14:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb5b823740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcb541af790 con 0x55b337ae95b0 2024-07-24T22:14:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb5b823740 10 client.0 _ll_register_callbacks cb 0x7fcb5406bd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb51d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337af5540 0x55b337af8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb5259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae95b0 0x55b337af8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb51d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337af5540 0x55b337af8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34408/0 (socket says 172.21.15.47:34408) 2024-07-24T22:14:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb51d9b640 1 -- 172.21.15.47:0/2034769943 learned_addr learned my addr 172.21.15.47:0/2034769943 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb51d9b640 1 --2- 172.21.15.47:0/2034769943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337ae8c90 0x55b337afda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb51d9b640 1 -- 172.21.15.47:0/2034769943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae95b0 msgr2=0x55b337af8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb51d9b640 1 --2- 172.21.15.47:0/2034769943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae95b0 0x55b337af8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb51d9b640 1 -- 172.21.15.47:0/2034769943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337ae8c90 msgr2=0x55b337afda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb51d9b640 1 --2- 172.21.15.47:0/2034769943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337ae8c90 0x55b337afda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb51d9b640 1 -- 172.21.15.47:0/2034769943 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b337af90c0 con 0x55b337af5540 2024-07-24T22:14:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb51d9b640 1 --2- 172.21.15.47:0/2034769943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337af5540 0x55b337af8980 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800bab0 tx=0x7fcb48005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28dc8a052a6121a8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.323+0000 7fcb39ffb640 1 -- 172.21.15.47:0/2034769943 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48005550 con 0x55b337af5540 2024-07-24T22:14:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb39ffb640 1 -- 172.21.15.47:0/2034769943 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7fcb48004730 con 0x55b337af5540 2024-07-24T22:14:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb5b823740 1 -- 172.21.15.47:0/2034769943 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb44004240 con 0x55b337af5540 2024-07-24T22:14:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb39ffb640 1 -- 172.21.15.47:0/2034769943 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcb48038050 con 0x55b337af5540 2024-07-24T22:14:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb5b823740 10 client.16992 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb5b823740 1 -- 172.21.15.47:0/2034769943 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b337b6ea30 con 0x55b337af5540 2024-07-24T22:14:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb39ffb640 1 -- 172.21.15.47:0/2034769943 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb44004240 con 0x55b337af5540 2024-07-24T22:14:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb39ffb640 1 -- 172.21.15.47:0/2034769943 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcb48011640 con 0x55b337af5540 2024-07-24T22:14:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb5b823740 10 client.16992 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb5b823740 10 client.16992 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb5b823740 20 client.16992 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb5b823740 1 --2- 172.21.15.47:0/2034769943 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b337b6f1e0 0x55b337b71600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb5b823740 4 client.16992 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:14:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb5b823740 1 -- 172.21.15.47:0/2034769943 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b337a5bc70 con 0x55b337b6f1e0 2024-07-24T22:14:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.324+0000 7fcb5259c640 1 --2- 172.21.15.47:0/2034769943 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b337b6f1e0 0x55b337b71600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.325+0000 7fcb5259c640 1 --2- 172.21.15.47:0/2034769943 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b337b6f1e0 0x55b337b71600 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c9624fab8549789 server_cookie=9968d48ffd158a87 in_seq=0 out_seq=0 2024-07-24T22:14:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:02.325+0000 7fcb39ffb640 10 client.16992 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:03.792 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:03 smithi047 ceph-mon[32551]: pgmap v573: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-07-24T22:14:03.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:03 smithi188 ceph-mon[37380]: pgmap v573: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-07-24T22:14:03.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.790+0000 7f18201ab640 1 -- 172.21.15.47:0/1404044951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1818107a20 msgr2=0x7f181810e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:03.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.790+0000 7f18201ab640 1 --2- 172.21.15.47:0/1404044951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1818107a20 0x7f181810e220 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1810009900 tx=0x7f181002a410 comp rx=0 tx=0).stop 2024-07-24T22:14:03.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.790+0000 7f18201ab640 1 -- 172.21.15.47:0/1404044951 shutdown_connections 2024-07-24T22:14:03.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.790+0000 7f18201ab640 1 --2- 172.21.15.47:0/1404044951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1818107a20 0x7f181810e220 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:03.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.790+0000 7f18201ab640 1 --2- 172.21.15.47:0/1404044951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18181070a0 0x7f18181074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:03.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.790+0000 7f18201ab640 1 --2- 172.21.15.47:0/1404044951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1818101690 0x7f1818101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:03.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.790+0000 7f18201ab640 1 -- 172.21.15.47:0/1404044951 >> 172.21.15.47:0/1404044951 conn(0x7f18180fd100 msgr2=0x7f18180ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:03.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.790+0000 7f18201ab640 1 -- 172.21.15.47:0/1404044951 shutdown_connections 2024-07-24T22:14:03.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.790+0000 7f18201ab640 1 -- 172.21.15.47:0/1404044951 wait complete. 2024-07-24T22:14:03.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.791+0000 7f18201ab640 1 Processor -- start 2024-07-24T22:14:03.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.791+0000 7f18201ab640 1 -- start start 2024-07-24T22:14:03.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.791+0000 7f18201ab640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1818101690 0x7f1818198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.791+0000 7f18201ab640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18181070a0 0x7f1818199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.791+0000 7f18201ab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1818107a20 0x7f181819e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.791+0000 7f18201ab640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f18181116a0 con 0x7f1818101690 2024-07-24T22:14:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.791+0000 7f18201ab640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1818111520 con 0x7f18181070a0 2024-07-24T22:14:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.791+0000 7f18201ab640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1818111820 con 0x7f1818107a20 2024-07-24T22:14:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.791+0000 7f181df47640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1818101690 0x7f1818198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.791+0000 7f181df47640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1818101690 0x7f1818198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34424/0 (socket says 172.21.15.47:34424) 2024-07-24T22:14:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.791+0000 7f181df47640 1 -- 172.21.15.47:0/2668430556 learned_addr learned my addr 172.21.15.47:0/2668430556 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f181e748640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1818107a20 0x7f181819e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f181d746640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18181070a0 0x7f1818199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f181df47640 1 -- 172.21.15.47:0/2668430556 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1818107a20 msgr2=0x7f181819e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f181df47640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1818107a20 0x7f181819e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f181df47640 1 -- 172.21.15.47:0/2668430556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18181070a0 msgr2=0x7f1818199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f181df47640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18181070a0 0x7f1818199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f181df47640 1 -- 172.21.15.47:0/2668430556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181819ed70 con 0x7f1818101690 2024-07-24T22:14:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f181d746640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18181070a0 0x7f1818199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f181df47640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1818101690 0x7f1818198cc0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f181400db80 tx=0x7f181400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f180effd640 1 -- 172.21.15.47:0/2668430556 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814017070 con 0x7f1818101690 2024-07-24T22:14:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f18201ab640 1 -- 172.21.15.47:0/2668430556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181819f060 con 0x7f1818101690 2024-07-24T22:14:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f180effd640 1 -- 172.21.15.47:0/2668430556 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1814003b70 con 0x7f1818101690 2024-07-24T22:14:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f180effd640 1 -- 172.21.15.47:0/2668430556 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18140106c0 con 0x7f1818101690 2024-07-24T22:14:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.792+0000 7f18201ab640 1 -- 172.21.15.47:0/2668430556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18181a58f0 con 0x7f1818101690 2024-07-24T22:14:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.793+0000 7f18201ab640 1 -- 172.21.15.47:0/2668430556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1818101a70 con 0x7f1818101690 2024-07-24T22:14:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.795+0000 7f180effd640 1 -- 172.21.15.47:0/2668430556 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f1814004020 con 0x7f1818101690 2024-07-24T22:14:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.796+0000 7f180effd640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f18040b3d40 0x7f18040b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.796+0000 7f181d746640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f18040b3d40 0x7f18040b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.796+0000 7f180effd640 1 -- 172.21.15.47:0/2668430556 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8565+0+0 (secure 0 0 0) 0x7f18140e4960 con 0x7f1818101690 2024-07-24T22:14:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.797+0000 7f181d746640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f18040b3d40 0x7f18040b6200 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1808006fd0 tx=0x7f1808008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:03.799+0000 7f180effd640 1 -- 172.21.15.47:0/2668430556 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f18140abc40 con 0x7f1818101690 2024-07-24T22:14:03.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:03 smithi183 ceph-mon[37007]: pgmap v573: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-07-24T22:14:04.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.033+0000 7f18201ab640 1 -- 172.21.15.47:0/2668430556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1818199df0 con 0x7f1818101690 2024-07-24T22:14:04.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.034+0000 7f180effd640 1 -- 172.21.15.47:0/2668430556 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f18140ab540 con 0x7f1818101690 2024-07-24T22:14:04.036 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:14:04.037 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:14:04.037 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:14:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.036+0000 7f18201ab640 1 -- 172.21.15.47:0/2668430556 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f18040b3d40 msgr2=0x7f18040b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.036+0000 7f18201ab640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f18040b3d40 0x7f18040b6200 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1808006fd0 tx=0x7f1808008040 comp rx=0 tx=0).stop 2024-07-24T22:14:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.036+0000 7f18201ab640 1 -- 172.21.15.47:0/2668430556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1818101690 msgr2=0x7f1818198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.036+0000 7f18201ab640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1818101690 0x7f1818198cc0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f181400db80 tx=0x7f181400b630 comp rx=0 tx=0).stop 2024-07-24T22:14:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.036+0000 7f18201ab640 1 -- 172.21.15.47:0/2668430556 shutdown_connections 2024-07-24T22:14:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.036+0000 7f18201ab640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f18040b3d40 0x7f18040b6200 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.036+0000 7f18201ab640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1818107a20 0x7f181819e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.036+0000 7f18201ab640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18181070a0 0x7f1818199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.036+0000 7f18201ab640 1 --2- 172.21.15.47:0/2668430556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1818101690 0x7f1818198cc0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.036+0000 7f18201ab640 1 -- 172.21.15.47:0/2668430556 >> 172.21.15.47:0/2668430556 conn(0x7f18180fd100 msgr2=0x7f181806b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.036+0000 7f18201ab640 1 -- 172.21.15.47:0/2668430556 shutdown_connections 2024-07-24T22:14:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:04.036+0000 7f18201ab640 1 -- 172.21.15.47:0/2668430556 wait complete. 2024-07-24T22:14:04.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:04 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2668430556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:14:04.733 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:14:04.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:04 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2668430556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:14:04.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:04 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2668430556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:14:05.043 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:14:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb39ffb640 1 -- 172.21.15.47:0/2034769943 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b337a5bc70 con 0x55b337b6f1e0 2024-07-24T22:14:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb39ffb640 10 client.16992 handle_command_reply: tid=0 2024-07-24T22:14:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb5b823740 1 client.16992 shutdown 2024-07-24T22:14:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb5b823740 1 -- 172.21.15.47:0/2034769943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337af5540 msgr2=0x55b337af8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb5b823740 1 --2- 172.21.15.47:0/2034769943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337af5540 0x55b337af8980 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800bab0 tx=0x7fcb48005c40 comp rx=0 tx=0).stop 2024-07-24T22:14:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb5b823740 1 -- 172.21.15.47:0/2034769943 shutdown_connections 2024-07-24T22:14:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb5b823740 1 --2- 172.21.15.47:0/2034769943 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b337b6f1e0 0x55b337b71600 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb5b823740 1 --2- 172.21.15.47:0/2034769943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b337af5540 0x55b337af8980 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb5b823740 1 --2- 172.21.15.47:0/2034769943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b337ae95b0 0x55b337af8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb5b823740 1 --2- 172.21.15.47:0/2034769943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b337ae8c90 0x55b337afda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb39ffb640 0 client.16992 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb5b823740 1 -- 172.21.15.47:0/2034769943 >> 172.21.15.47:0/2034769943 conn(0x55b337ae6ac0 msgr2=0x55b337ae5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb5b823740 1 -- 172.21.15.47:0/2034769943 shutdown_connections 2024-07-24T22:14:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb5b823740 1 -- 172.21.15.47:0/2034769943 wait complete. 2024-07-24T22:14:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.111+0000 7fcb5b823740 20 client.16992 trim_cache size 0 max 16384 2024-07-24T22:14:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:14:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:14:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:14:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:14:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.112+0000 7fcb589ed640 1 -- 172.21.15.47:0/3793860195 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcb3c0b3d40 msgr2=0x7fcb3c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.112+0000 7fcb589ed640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcb3c0b3d40 0x7fcb3c0b6200 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0ab020 tx=0x7fcb4c0a6fd0 comp rx=0 tx=0).stop 2024-07-24T22:14:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.112+0000 7fcb589ed640 1 -- 172.21.15.47:0/3793860195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb5410cac0 msgr2=0x7fcb54101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.112+0000 7fcb589ed640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb5410cac0 0x7fcb54101d90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00cce0 tx=0x7fcb4c00a620 comp rx=0 tx=0).stop 2024-07-24T22:14:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.112+0000 7fcb589ed640 1 -- 172.21.15.47:0/3793860195 shutdown_connections 2024-07-24T22:14:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.112+0000 7fcb589ed640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcb3c0b3d40 0x7fcb3c0b6200 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.112+0000 7fcb589ed640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb5410cac0 0x7fcb54101d90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.112+0000 7fcb589ed640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb54103f90 0x7fcb54101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.112+0000 7fcb589ed640 1 --2- 172.21.15.47:0/3793860195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb54103670 0x7fcb54101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.112+0000 7fcb589ed640 1 -- 172.21.15.47:0/3793860195 >> 172.21.15.47:0/3793860195 conn(0x7fcb540fd0c0 msgr2=0x7fcb5410ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.112+0000 7fcb589ed640 1 -- 172.21.15.47:0/3793860195 shutdown_connections 2024-07-24T22:14:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:05.112+0000 7fcb589ed640 1 -- 172.21.15.47:0/3793860195 wait complete. 2024-07-24T22:14:05.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:05 smithi047 ceph-mon[32551]: pgmap v574: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-07-24T22:14:05.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:05 smithi188 ceph-mon[37380]: pgmap v574: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-07-24T22:14:05.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:05 smithi183 ceph-mon[37007]: pgmap v574: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-07-24T22:14:06.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.773+0000 7f81db1b0640 1 -- 172.21.15.47:0/3604407437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4102790 msgr2=0x7f81d4102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:06.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.773+0000 7f81db1b0640 1 --2- 172.21.15.47:0/3604407437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4102790 0x7f81d4102b70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f81bc009900 tx=0x7f81bc02a410 comp rx=0 tx=0).stop 2024-07-24T22:14:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.773+0000 7f81db1b0640 1 -- 172.21.15.47:0/3604407437 shutdown_connections 2024-07-24T22:14:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.773+0000 7f81db1b0640 1 --2- 172.21.15.47:0/3604407437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81d4108b20 0x7f81d410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.773+0000 7f81db1b0640 1 --2- 172.21.15.47:0/3604407437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81d41081a0 0x7f81d41085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.773+0000 7f81db1b0640 1 --2- 172.21.15.47:0/3604407437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4102790 0x7f81d4102b70 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.773+0000 7f81db1b0640 1 -- 172.21.15.47:0/3604407437 >> 172.21.15.47:0/3604407437 conn(0x7f81d40fe200 msgr2=0x7f81d4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.773+0000 7f81db1b0640 1 -- 172.21.15.47:0/3604407437 shutdown_connections 2024-07-24T22:14:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.773+0000 7f81db1b0640 1 -- 172.21.15.47:0/3604407437 wait complete. 2024-07-24T22:14:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.774+0000 7f81db1b0640 1 Processor -- start 2024-07-24T22:14:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.774+0000 7f81db1b0640 1 -- start start 2024-07-24T22:14:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.774+0000 7f81db1b0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4102790 0x7f81d4074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.774+0000 7f81db1b0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81d41081a0 0x7f81d40753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.774+0000 7f81db1b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81d4108b20 0x7f81d4075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.774+0000 7f81db1b0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41127a0 con 0x7f81d4102790 2024-07-24T22:14:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.774+0000 7f81db1b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f81d4112620 con 0x7f81d4108b20 2024-07-24T22:14:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.774+0000 7f81db1b0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f81d4112920 con 0x7f81d41081a0 2024-07-24T22:14:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.774+0000 7f81d8f4c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4102790 0x7f81d4074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.774+0000 7f81d8f4c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4102790 0x7f81d4074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48172/0 (socket says 172.21.15.47:48172) 2024-07-24T22:14:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.774+0000 7f81d8f4c640 1 -- 172.21.15.47:0/4271337927 learned_addr learned my addr 172.21.15.47:0/4271337927 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.774+0000 7f81d3fff640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81d41081a0 0x7f81d40753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.774+0000 7f81d974d640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81d4108b20 0x7f81d4075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.775+0000 7f81d8f4c640 1 -- 172.21.15.47:0/4271337927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81d41081a0 msgr2=0x7f81d40753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.775+0000 7f81d8f4c640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81d41081a0 0x7f81d40753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.775+0000 7f81d8f4c640 1 -- 172.21.15.47:0/4271337927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81d4108b20 msgr2=0x7f81d4075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.775+0000 7f81d8f4c640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81d4108b20 0x7f81d4075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.775+0000 7f81d8f4c640 1 -- 172.21.15.47:0/4271337927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d41a7150 con 0x7f81d4102790 2024-07-24T22:14:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.775+0000 7f81d974d640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81d4108b20 0x7f81d4075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.775+0000 7f81d8f4c640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4102790 0x7f81d4074e90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f81bc005940 tx=0x7f81bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.775+0000 7f81d1ffb640 1 -- 172.21.15.47:0/4271337927 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc03f030 con 0x7f81d4102790 2024-07-24T22:14:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.775+0000 7f81d1ffb640 1 -- 172.21.15.47:0/4271337927 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81bc003cb0 con 0x7f81d4102790 2024-07-24T22:14:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.775+0000 7f81db1b0640 1 -- 172.21.15.47:0/4271337927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d41a73e0 con 0x7f81d4102790 2024-07-24T22:14:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.775+0000 7f81d1ffb640 1 -- 172.21.15.47:0/4271337927 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc035070 con 0x7f81d4102790 2024-07-24T22:14:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.775+0000 7f81db1b0640 1 -- 172.21.15.47:0/4271337927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d41a78c0 con 0x7f81d4102790 2024-07-24T22:14:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.778+0000 7f81d1ffb640 1 -- 172.21.15.47:0/4271337927 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f81bc042030 con 0x7f81d4102790 2024-07-24T22:14:06.781 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:06 smithi047 ceph-mon[32551]: osdmap e88: 12 total, 12 up, 12 in 2024-07-24T22:14:06.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.778+0000 7f81dd561740 1 Processor -- start 2024-07-24T22:14:06.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.778+0000 7f81dd561740 1 -- start start 2024-07-24T22:14:06.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.778+0000 7f81dd561740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 0x56493f401ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.778+0000 7f81dd561740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f401ff0 0x56493f40da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.778+0000 7f81dd561740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f40df80 0x56493f410370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.778+0000 7f81dd561740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56493f3789b0 con 0x56493f4016d0 2024-07-24T22:14:06.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.778+0000 7f81dd561740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56493f367eb0 con 0x56493f40df80 2024-07-24T22:14:06.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.778+0000 7f81dd561740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56493f36bef0 con 0x56493f401ff0 2024-07-24T22:14:06.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.778+0000 7f81d974d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 0x56493f401ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.778+0000 7f81d974d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 0x56493f401ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48176/0 (socket says 172.21.15.47:48176) 2024-07-24T22:14:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.778+0000 7f81d974d640 1 -- 172.21.15.47:0/1967890845 learned_addr learned my addr 172.21.15.47:0/1967890845 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.778+0000 7f81d3fff640 1 --2- 172.21.15.47:0/1967890845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f40df80 0x56493f410370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.779+0000 7f81d974d640 1 -- 172.21.15.47:0/1967890845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f401ff0 msgr2=0x56493f40da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.779+0000 7f81d974d640 1 --2- 172.21.15.47:0/1967890845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f401ff0 0x56493f40da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.779+0000 7f81d974d640 1 -- 172.21.15.47:0/1967890845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f40df80 msgr2=0x56493f410370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.779+0000 7f81d974d640 1 --2- 172.21.15.47:0/1967890845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f40df80 0x56493f410370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.779+0000 7f81d974d640 1 -- 172.21.15.47:0/1967890845 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56493f2f1320 con 0x56493f4016d0 2024-07-24T22:14:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.779+0000 7f81d1ffb640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81c00b3d40 0x7f81c00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.779+0000 7f81d974d640 1 --2- 172.21.15.47:0/1967890845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 0x56493f401ab0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009f70 tx=0x7f81cc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2026a2e89088b4fc server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.779+0000 7f81d8f4c640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81c00b3d40 0x7f81c00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.779+0000 7f81caffd640 1 -- 172.21.15.47:0/1967890845 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc016070 con 0x56493f4016d0 2024-07-24T22:14:06.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.779+0000 7f81caffd640 1 -- 172.21.15.47:0/1967890845 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81cc004d20 con 0x56493f4016d0 2024-07-24T22:14:06.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.779+0000 7f81caffd640 1 -- 172.21.15.47:0/1967890845 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0127c0 con 0x56493f4016d0 2024-07-24T22:14:06.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.779+0000 7f81d1ffb640 1 -- 172.21.15.47:0/4271337927 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8609+0+0 (secure 0 0 0) 0x7f81bc1048f0 con 0x7f81d4102790 2024-07-24T22:14:06.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.780+0000 7f81dd561740 1 -- 172.21.15.47:0/1967890845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 msgr2=0x56493f401ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:06.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.780+0000 7f81d8f4c640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81c00b3d40 0x7f81c00b6200 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x56493f4003e0 tx=0x7f81bc0cb290 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:06.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.780+0000 7f81dd561740 1 --2- 172.21.15.47:0/1967890845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 0x56493f401ab0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009f70 tx=0x7f81cc010800 comp rx=0 tx=0).stop 2024-07-24T22:14:06.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.780+0000 7f81dd561740 1 -- 172.21.15.47:0/1967890845 shutdown_connections 2024-07-24T22:14:06.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.780+0000 7f81dd561740 1 --2- 172.21.15.47:0/1967890845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f40df80 0x56493f410370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.780+0000 7f81dd561740 1 --2- 172.21.15.47:0/1967890845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f401ff0 0x56493f40da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.780+0000 7f81dd561740 1 --2- 172.21.15.47:0/1967890845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 0x56493f401ab0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.780+0000 7f81dd561740 1 -- 172.21.15.47:0/1967890845 >> 172.21.15.47:0/1967890845 conn(0x56493f3ff500 msgr2=0x56493f4006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:06.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.780+0000 7f81dd561740 1 -- 172.21.15.47:0/1967890845 shutdown_connections 2024-07-24T22:14:06.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.780+0000 7f81dd561740 1 -- 172.21.15.47:0/1967890845 wait complete. 2024-07-24T22:14:06.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.780+0000 7f81dd561740 1 -- start start 2024-07-24T22:14:06.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.780+0000 7f81dd561740 1 Processor -- start 2024-07-24T22:14:06.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81dd561740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 0x56493f40af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81dd561740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f401ff0 0x56493f40b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81dd561740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f40df80 0x56493f40b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81dd561740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56493f1cb700 con 0x56493f4016d0 2024-07-24T22:14:06.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81dd561740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56493f30a5f0 con 0x56493f401ff0 2024-07-24T22:14:06.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81dd561740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56493f410c00 con 0x56493f40df80 2024-07-24T22:14:06.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81dd561740 10 client.0 _ll_register_callbacks cb 0x56493f32a960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:06.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81d974d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 0x56493f40af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81d974d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 0x56493f40af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48178/0 (socket says 172.21.15.47:48178) 2024-07-24T22:14:06.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81d974d640 1 -- 172.21.15.47:0/960460477 learned_addr learned my addr 172.21.15.47:0/960460477 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81d3fff640 1 --2- 172.21.15.47:0/960460477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f401ff0 0x56493f40b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81d974d640 1 --2- 172.21.15.47:0/960460477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f40df80 0x56493f40b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81d974d640 1 -- 172.21.15.47:0/960460477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f40df80 msgr2=0x56493f40b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81d974d640 1 --2- 172.21.15.47:0/960460477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f40df80 0x56493f40b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81d974d640 1 -- 172.21.15.47:0/960460477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f401ff0 msgr2=0x56493f40b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:06.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.781+0000 7f81d974d640 1 --2- 172.21.15.47:0/960460477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f401ff0 0x56493f40b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.782+0000 7f81d974d640 1 -- 172.21.15.47:0/960460477 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56493f2fd680 con 0x56493f4016d0 2024-07-24T22:14:06.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.782+0000 7f81d974d640 1 --2- 172.21.15.47:0/960460477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 0x56493f40af00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f81cc005c40 tx=0x7f81cc005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4dc43f59ea9ae9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:06.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.782+0000 7f81b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:06.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.782+0000 7f81b3fff640 1 -- 172.21.15.47:0/960460477 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc016070 con 0x56493f4016d0 2024-07-24T22:14:06.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.782+0000 7f81b3fff640 1 -- 172.21.15.47:0/960460477 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8609+0+0 (secure 0 0 0) 0x7f81cc022040 con 0x56493f4016d0 2024-07-24T22:14:06.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.782+0000 7f81dd561740 1 -- 172.21.15.47:0/960460477 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81cc004d20 con 0x56493f4016d0 2024-07-24T22:14:06.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.782+0000 7f81b3fff640 1 -- 172.21.15.47:0/960460477 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f81cc0051e0 con 0x56493f4016d0 2024-07-24T22:14:06.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.782+0000 7f81dd561740 10 client.17010 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:06.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.782+0000 7f81dd561740 1 -- 172.21.15.47:0/960460477 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56493f0c8650 con 0x56493f4016d0 2024-07-24T22:14:06.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.782+0000 7f81b3fff640 1 -- 172.21.15.47:0/960460477 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81cc004d20 con 0x56493f4016d0 2024-07-24T22:14:06.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.783+0000 7f81b3fff640 1 -- 172.21.15.47:0/960460477 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f81cc00f040 con 0x56493f4016d0 2024-07-24T22:14:06.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.783+0000 7f81dd561740 10 client.17010 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:06.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.783+0000 7f81dd561740 10 client.17010 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:06.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.783+0000 7f81dd561740 20 client.17010 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:06.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.783+0000 7f81dd561740 1 --2- 172.21.15.47:0/960460477 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56493f41d8f0 0x56493f41fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.783+0000 7f81dd561740 4 client.17010 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:06.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.783+0000 7f81dd561740 1 -- 172.21.15.47:0/960460477 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56493f37a900 con 0x56493f41d8f0 2024-07-24T22:14:06.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.784+0000 7f81d3fff640 1 --2- 172.21.15.47:0/960460477 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56493f41d8f0 0x56493f41fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.784+0000 7f81d3fff640 1 --2- 172.21.15.47:0/960460477 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56493f41d8f0 0x56493f41fce0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df13d250205d7215 server_cookie=f20a8d785d7558be in_seq=0 out_seq=0 2024-07-24T22:14:06.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.784+0000 7f81b3fff640 10 client.17010 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:06.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81b3fff640 1 -- 172.21.15.47:0/960460477 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56493f37a900 con 0x56493f41d8f0 2024-07-24T22:14:06.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81b3fff640 10 client.17010 handle_command_reply: tid=0 2024-07-24T22:14:06.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81dd561740 1 client.17010 shutdown 2024-07-24T22:14:06.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81dd561740 1 -- 172.21.15.47:0/960460477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 msgr2=0x56493f40af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:06.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81dd561740 1 --2- 172.21.15.47:0/960460477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 0x56493f40af00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f81cc005c40 tx=0x7f81cc005bd0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81dd561740 1 -- 172.21.15.47:0/960460477 shutdown_connections 2024-07-24T22:14:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81dd561740 1 --2- 172.21.15.47:0/960460477 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56493f41d8f0 0x56493f41fce0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81dd561740 1 --2- 172.21.15.47:0/960460477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f40df80 0x56493f40b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81dd561740 1 --2- 172.21.15.47:0/960460477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f401ff0 0x56493f40b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81b3fff640 0 client.17010 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81dd561740 1 --2- 172.21.15.47:0/960460477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f4016d0 0x56493f40af00 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81dd561740 1 -- 172.21.15.47:0/960460477 >> 172.21.15.47:0/960460477 conn(0x56493f3ff500 msgr2=0x56493f4050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:06.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81dd561740 1 -- 172.21.15.47:0/960460477 shutdown_connections 2024-07-24T22:14:06.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81dd561740 1 -- 172.21.15.47:0/960460477 wait complete. 2024-07-24T22:14:06.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.785+0000 7f81dd561740 20 client.17010 trim_cache size 0 max 16384 2024-07-24T22:14:06.805 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:06 smithi188 ceph-mon[37380]: osdmap e88: 12 total, 12 up, 12 in 2024-07-24T22:14:06.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.799+0000 7f81dd561740 1 Processor -- start 2024-07-24T22:14:06.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.799+0000 7f81dd561740 1 -- start start 2024-07-24T22:14:06.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.799+0000 7f81dd561740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f4016d0 0x56493f400c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.799+0000 7f81dd561740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 0x56493f40cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.799+0000 7f81dd561740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f40df80 0x56493f425450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.799+0000 7f81dd561740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41ae4e0 con 0x56493f401ff0 2024-07-24T22:14:06.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.799+0000 7f81dd561740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41b0d40 con 0x56493f4016d0 2024-07-24T22:14:06.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.799+0000 7f81dd561740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41aeb30 con 0x56493f40df80 2024-07-24T22:14:06.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.799+0000 7f81d3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 0x56493f40cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.799+0000 7f81d3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 0x56493f40cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48192/0 (socket says 172.21.15.47:48192) 2024-07-24T22:14:06.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.799+0000 7f81d3fff640 1 -- 172.21.15.47:0/1911138149 learned_addr learned my addr 172.21.15.47:0/1911138149 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:06.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.800+0000 7f81d974d640 1 --2- 172.21.15.47:0/1911138149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f4016d0 0x56493f400c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.800+0000 7f81d3fff640 1 -- 172.21.15.47:0/1911138149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f40df80 msgr2=0x56493f425450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:06.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.800+0000 7f81d3fff640 1 --2- 172.21.15.47:0/1911138149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f40df80 0x56493f425450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.800+0000 7f81d3fff640 1 -- 172.21.15.47:0/1911138149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f4016d0 msgr2=0x56493f400c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:06.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.800+0000 7f81d3fff640 1 --2- 172.21.15.47:0/1911138149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f4016d0 0x56493f400c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.800+0000 7f81d3fff640 1 -- 172.21.15.47:0/1911138149 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56493f3fae90 con 0x56493f401ff0 2024-07-24T22:14:06.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.800+0000 7f81d974d640 1 --2- 172.21.15.47:0/1911138149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f4016d0 0x56493f400c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:06.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.800+0000 7f81d3fff640 1 --2- 172.21.15.47:0/1911138149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 0x56493f40cc40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x56493f4203c0 tx=0x7f81c4009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1726a0237545d5f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:06.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.800+0000 7f81ca7fc640 1 -- 172.21.15.47:0/1911138149 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c40159b0 con 0x56493f401ff0 2024-07-24T22:14:06.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.800+0000 7f81ca7fc640 1 -- 172.21.15.47:0/1911138149 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81c4025070 con 0x56493f401ff0 2024-07-24T22:14:06.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.800+0000 7f81ca7fc640 1 -- 172.21.15.47:0/1911138149 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c4014410 con 0x56493f401ff0 2024-07-24T22:14:06.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.801+0000 7f81dd561740 1 -- 172.21.15.47:0/1911138149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 msgr2=0x56493f40cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:06.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.801+0000 7f81dd561740 1 --2- 172.21.15.47:0/1911138149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 0x56493f40cc40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x56493f4203c0 tx=0x7f81c4009110 comp rx=0 tx=0).stop 2024-07-24T22:14:06.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.801+0000 7f81dd561740 1 -- 172.21.15.47:0/1911138149 shutdown_connections 2024-07-24T22:14:06.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.801+0000 7f81dd561740 1 --2- 172.21.15.47:0/1911138149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f40df80 0x56493f425450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.801+0000 7f81dd561740 1 --2- 172.21.15.47:0/1911138149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 0x56493f40cc40 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.801+0000 7f81dd561740 1 --2- 172.21.15.47:0/1911138149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f4016d0 0x56493f400c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.801+0000 7f81dd561740 1 -- 172.21.15.47:0/1911138149 >> 172.21.15.47:0/1911138149 conn(0x56493f3ff500 msgr2=0x56493f40c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:06.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.801+0000 7f81dd561740 1 -- 172.21.15.47:0/1911138149 shutdown_connections 2024-07-24T22:14:06.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.801+0000 7f81dd561740 1 -- 172.21.15.47:0/1911138149 wait complete. 2024-07-24T22:14:06.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.801+0000 7f81dd561740 1 -- start start 2024-07-24T22:14:06.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.801+0000 7f81dd561740 1 Processor -- start 2024-07-24T22:14:06.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81dd561740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f4016d0 0x56493f416610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81dd561740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 0x56493f411ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81dd561740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f40df80 0x56493f412110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81dd561740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41af200 con 0x56493f401ff0 2024-07-24T22:14:06.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81dd561740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41b0670 con 0x56493f40df80 2024-07-24T22:14:06.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81dd561740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41af8d0 con 0x56493f4016d0 2024-07-24T22:14:06.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81dd561740 10 client.0 _ll_register_callbacks cb 0x7f81c40093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:06.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81d3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 0x56493f411ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81d3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 0x56493f411ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48204/0 (socket says 172.21.15.47:48204) 2024-07-24T22:14:06.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81d3fff640 1 -- 172.21.15.47:0/2172169473 learned_addr learned my addr 172.21.15.47:0/2172169473 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:06.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81d974d640 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f4016d0 0x56493f416610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81d974d640 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f40df80 0x56493f412110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81d3fff640 1 -- 172.21.15.47:0/2172169473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f4016d0 msgr2=0x56493f416610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:06.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81d3fff640 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f4016d0 0x56493f416610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81d3fff640 1 -- 172.21.15.47:0/2172169473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f40df80 msgr2=0x56493f412110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:06.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81d3fff640 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f40df80 0x56493f412110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81d3fff640 1 -- 172.21.15.47:0/2172169473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56493f487420 con 0x56493f401ff0 2024-07-24T22:14:06.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81d974d640 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f4016d0 0x56493f416610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:06.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81d3fff640 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 0x56493f411ae0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f81c401faf0 tx=0x7f81c4006ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d13a61ff5cb703 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:06.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.802+0000 7f81b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:06.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81b3fff640 1 -- 172.21.15.47:0/2172169473 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c402d030 con 0x56493f401ff0 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81b3fff640 1 -- 172.21.15.47:0/2172169473 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8609+0+0 (secure 0 0 0) 0x7f81c401f7b0 con 0x56493f401ff0 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81dd561740 1 -- 172.21.15.47:0/2172169473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81c4025070 con 0x56493f401ff0 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81b3fff640 1 -- 172.21.15.47:0/2172169473 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f81c4037050 con 0x56493f401ff0 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81dd561740 10 client.17016 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81dd561740 1 -- 172.21.15.47:0/2172169473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56493f4884e0 con 0x56493f401ff0 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81b3fff640 1 -- 172.21.15.47:0/2172169473 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81c4025070 con 0x56493f401ff0 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81b3fff640 1 -- 172.21.15.47:0/2172169473 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f81c4006140 con 0x56493f401ff0 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81dd561740 10 client.17016 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81dd561740 10 client.17016 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81dd561740 20 client.17016 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81dd561740 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56493f488c30 0x56493f48b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81dd561740 4 client.17016 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.803+0000 7f81dd561740 1 -- 172.21.15.47:0/2172169473 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56493f406ad0 con 0x56493f488c30 2024-07-24T22:14:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81d974d640 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56493f488c30 0x56493f48b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:06.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81d974d640 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56493f488c30 0x56493f48b050 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c52062500daeb5d1 server_cookie=1df7d3dbfb0d31fc in_seq=0 out_seq=0 2024-07-24T22:14:06.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81b3fff640 10 client.17016 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:06.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81b3fff640 1 -- 172.21.15.47:0/2172169473 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56493f406ad0 con 0x56493f488c30 2024-07-24T22:14:06.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81b3fff640 10 client.17016 handle_command_reply: tid=0 2024-07-24T22:14:06.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81dd561740 1 client.17016 shutdown 2024-07-24T22:14:06.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81dd561740 1 -- 172.21.15.47:0/2172169473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 msgr2=0x56493f411ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:06.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81dd561740 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 0x56493f411ae0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f81c401faf0 tx=0x7f81c4006ea0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81dd561740 1 -- 172.21.15.47:0/2172169473 shutdown_connections 2024-07-24T22:14:06.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81dd561740 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56493f488c30 0x56493f48b050 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81dd561740 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56493f40df80 0x56493f412110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81dd561740 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56493f401ff0 0x56493f411ae0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81dd561740 1 --2- 172.21.15.47:0/2172169473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56493f4016d0 0x56493f416610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81b3fff640 0 client.17016 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:06.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.804+0000 7f81dd561740 1 -- 172.21.15.47:0/2172169473 >> 172.21.15.47:0/2172169473 conn(0x56493f3ff500 msgr2=0x56493f405030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:06.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81dd561740 1 -- 172.21.15.47:0/2172169473 shutdown_connections 2024-07-24T22:14:06.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81dd561740 1 -- 172.21.15.47:0/2172169473 wait complete. 2024-07-24T22:14:06.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81dd561740 20 client.17016 trim_cache size 0 max 16384 2024-07-24T22:14:06.819 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:14:06.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81db1b0640 1 -- 172.21.15.47:0/4271337927 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81c00b3d40 msgr2=0x7f81c00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:06.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81db1b0640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81c00b3d40 0x7f81c00b6200 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x56493f4003e0 tx=0x7f81bc0cb290 comp rx=0 tx=0).stop 2024-07-24T22:14:06.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81db1b0640 1 -- 172.21.15.47:0/4271337927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4102790 msgr2=0x7f81d4074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:06.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81db1b0640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4102790 0x7f81d4074e90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f81bc005940 tx=0x7f81bc0042f0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81db1b0640 1 -- 172.21.15.47:0/4271337927 shutdown_connections 2024-07-24T22:14:06.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81db1b0640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81c00b3d40 0x7f81c00b6200 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81db1b0640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81d4108b20 0x7f81d4075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81db1b0640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81d41081a0 0x7f81d40753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81db1b0640 1 --2- 172.21.15.47:0/4271337927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81d4102790 0x7f81d4074e90 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:06.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81db1b0640 1 -- 172.21.15.47:0/4271337927 >> 172.21.15.47:0/4271337927 conn(0x7f81d40fe200 msgr2=0x7f81d41005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:06.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81db1b0640 1 -- 172.21.15.47:0/4271337927 shutdown_connections 2024-07-24T22:14:06.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:06.805+0000 7f81db1b0640 1 -- 172.21.15.47:0/4271337927 wait complete. 2024-07-24T22:14:06.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:06 smithi183 ceph-mon[37007]: osdmap e88: 12 total, 12 up, 12 in 2024-07-24T22:14:07.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:07 smithi188 ceph-mon[37380]: pgmap v576: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 17 KiB/s rd, 54 KiB/s wr, 25 op/s 2024-07-24T22:14:07.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:07 smithi183 ceph-mon[37007]: pgmap v576: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 17 KiB/s rd, 54 KiB/s wr, 25 op/s 2024-07-24T22:14:07.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:07 smithi047 ceph-mon[32551]: pgmap v576: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 17 KiB/s rd, 54 KiB/s wr, 25 op/s 2024-07-24T22:14:08.584 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:14:08.584 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:14:08.865 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:14:09.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:09 smithi188 ceph-mon[37380]: pgmap v577: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 25 op/s 2024-07-24T22:14:09.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:09 smithi183 ceph-mon[37007]: pgmap v577: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 25 op/s 2024-07-24T22:14:09.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:09 smithi047 ceph-mon[32551]: pgmap v577: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 25 op/s 2024-07-24T22:14:10.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.717+0000 7fbb3aec8640 1 -- 172.21.15.47:0/1351299989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34108b20 msgr2=0x7fbb3410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:10.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.717+0000 7fbb3aec8640 1 --2- 172.21.15.47:0/1351299989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34108b20 0x7fbb3410f320 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009900 tx=0x7fbb2c02a410 comp rx=0 tx=0).stop 2024-07-24T22:14:10.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.717+0000 7fbb3aec8640 1 -- 172.21.15.47:0/1351299989 shutdown_connections 2024-07-24T22:14:10.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.717+0000 7fbb3aec8640 1 --2- 172.21.15.47:0/1351299989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34108b20 0x7fbb3410f320 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.717+0000 7fbb3aec8640 1 --2- 172.21.15.47:0/1351299989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb341081a0 0x7fbb341085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.717+0000 7fbb3aec8640 1 --2- 172.21.15.47:0/1351299989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb34102790 0x7fbb34102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.717+0000 7fbb3aec8640 1 -- 172.21.15.47:0/1351299989 >> 172.21.15.47:0/1351299989 conn(0x7fbb340fe200 msgr2=0x7fbb34100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:10.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.717+0000 7fbb3aec8640 1 -- 172.21.15.47:0/1351299989 shutdown_connections 2024-07-24T22:14:10.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.717+0000 7fbb3aec8640 1 -- 172.21.15.47:0/1351299989 wait complete. 2024-07-24T22:14:10.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.718+0000 7fbb3aec8640 1 Processor -- start 2024-07-24T22:14:10.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.718+0000 7fbb3aec8640 1 -- start start 2024-07-24T22:14:10.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb3aec8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34102790 0x7fbb34198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb3aec8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb341081a0 0x7fbb34199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb3aec8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb34108b20 0x7fbb3419e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb3aec8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb341127a0 con 0x7fbb34102790 2024-07-24T22:14:10.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb3aec8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34112620 con 0x7fbb341081a0 2024-07-24T22:14:10.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb3aec8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34112920 con 0x7fbb34108b20 2024-07-24T22:14:10.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb38c64640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34102790 0x7fbb34198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb38c64640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34102790 0x7fbb34198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48222/0 (socket says 172.21.15.47:48222) 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb38c64640 1 -- 172.21.15.47:0/127301143 learned_addr learned my addr 172.21.15.47:0/127301143 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb39465640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb34108b20 0x7fbb3419e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb33fff640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb341081a0 0x7fbb34199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb38c64640 1 -- 172.21.15.47:0/127301143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb34108b20 msgr2=0x7fbb3419e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb38c64640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb34108b20 0x7fbb3419e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb38c64640 1 -- 172.21.15.47:0/127301143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb341081a0 msgr2=0x7fbb34199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb38c64640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb341081a0 0x7fbb34199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb38c64640 1 -- 172.21.15.47:0/127301143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3419ed00 con 0x7fbb34102790 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb39465640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb34108b20 0x7fbb3419e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.719+0000 7fbb33fff640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb341081a0 0x7fbb34199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.720+0000 7fbb38c64640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34102790 0x7fbb34198c50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00d950 tx=0x7fbb1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.720+0000 7fbb31ffb640 1 -- 172.21.15.47:0/127301143 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c017070 con 0x7fbb34102790 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.720+0000 7fbb31ffb640 1 -- 172.21.15.47:0/127301143 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb1c009c30 con 0x7fbb34102790 2024-07-24T22:14:10.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.720+0000 7fbb3aec8640 1 -- 172.21.15.47:0/127301143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3419eff0 con 0x7fbb34102790 2024-07-24T22:14:10.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.720+0000 7fbb31ffb640 1 -- 172.21.15.47:0/127301143 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c00f620 con 0x7fbb34102790 2024-07-24T22:14:10.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.720+0000 7fbb3aec8640 1 -- 172.21.15.47:0/127301143 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb34074df0 con 0x7fbb34102790 2024-07-24T22:14:10.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.723+0000 7fbb31ffb640 1 -- 172.21.15.47:0/127301143 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fbb1c010460 con 0x7fbb34102790 2024-07-24T22:14:10.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.723+0000 7fbb3d279740 1 Processor -- start 2024-07-24T22:14:10.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.723+0000 7fbb3d279740 1 -- start start 2024-07-24T22:14:10.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.723+0000 7fbb3d279740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f81f30 0x560343f82310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.723+0000 7fbb3d279740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f82850 0x560343f8e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.723+0000 7fbb3d279740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f8e7e0 0x560343f90bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.723+0000 7fbb3d279740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560343ef99f0 con 0x560343f81f30 2024-07-24T22:14:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.723+0000 7fbb3d279740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560343ee8ef0 con 0x560343f82850 2024-07-24T22:14:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.723+0000 7fbb3d279740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x560343eecf30 con 0x560343f8e7e0 2024-07-24T22:14:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.723+0000 7fbb39465640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f81f30 0x560343f82310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.723+0000 7fbb39465640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f81f30 0x560343f82310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48234/0 (socket says 172.21.15.47:48234) 2024-07-24T22:14:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.723+0000 7fbb39465640 1 -- 172.21.15.47:0/1399293252 learned_addr learned my addr 172.21.15.47:0/1399293252 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.724+0000 7fbb38c64640 1 --2- 172.21.15.47:0/1399293252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f82850 0x560343f8e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.723+0000 7fbb33fff640 1 --2- 172.21.15.47:0/1399293252 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f8e7e0 0x560343f90bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.724+0000 7fbb39465640 1 -- 172.21.15.47:0/1399293252 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f8e7e0 msgr2=0x560343f90bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.724+0000 7fbb39465640 1 --2- 172.21.15.47:0/1399293252 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f8e7e0 0x560343f90bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.724+0000 7fbb39465640 1 -- 172.21.15.47:0/1399293252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f82850 msgr2=0x560343f8e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.724+0000 7fbb39465640 1 --2- 172.21.15.47:0/1399293252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f82850 0x560343f8e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.724+0000 7fbb39465640 1 -- 172.21.15.47:0/1399293252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560343c49930 con 0x560343f81f30 2024-07-24T22:14:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.724+0000 7fbb31ffb640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb200b3d40 0x7fbb200b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.724+0000 7fbb38c64640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb200b3d40 0x7fbb200b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.724+0000 7fbb39465640 1 --2- 172.21.15.47:0/1399293252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f81f30 0x560343f82310 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c02a930 tx=0x7fbb2c0315d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed362994c8f2c7e1 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:10.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.724+0000 7fbb31ffb640 1 -- 172.21.15.47:0/127301143 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8609+0+0 (secure 0 0 0) 0x7fbb1c0e3d00 con 0x7fbb34102790 2024-07-24T22:14:10.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.724+0000 7fbb2affd640 1 -- 172.21.15.47:0/1399293252 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c040070 con 0x560343f81f30 2024-07-24T22:14:10.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.724+0000 7fbb2affd640 1 -- 172.21.15.47:0/1399293252 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb2c005040 con 0x560343f81f30 2024-07-24T22:14:10.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.724+0000 7fbb2affd640 1 -- 172.21.15.47:0/1399293252 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c035040 con 0x560343f81f30 2024-07-24T22:14:10.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.725+0000 7fbb3d279740 1 -- 172.21.15.47:0/1399293252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f81f30 msgr2=0x560343f82310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:10.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.725+0000 7fbb3d279740 1 --2- 172.21.15.47:0/1399293252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f81f30 0x560343f82310 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c02a930 tx=0x7fbb2c0315d0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.725+0000 7fbb38c64640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb200b3d40 0x7fbb200b6200 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0e14a0 tx=0x7fbb1c0ec040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:10.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.725+0000 7fbb3d279740 1 -- 172.21.15.47:0/1399293252 shutdown_connections 2024-07-24T22:14:10.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.725+0000 7fbb3d279740 1 --2- 172.21.15.47:0/1399293252 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f8e7e0 0x560343f90bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.725+0000 7fbb3d279740 1 --2- 172.21.15.47:0/1399293252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f82850 0x560343f8e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.725+0000 7fbb3d279740 1 --2- 172.21.15.47:0/1399293252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f81f30 0x560343f82310 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.725+0000 7fbb3d279740 1 -- 172.21.15.47:0/1399293252 >> 172.21.15.47:0/1399293252 conn(0x560343f7fd60 msgr2=0x560343f80f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:10.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.725+0000 7fbb3d279740 1 -- 172.21.15.47:0/1399293252 shutdown_connections 2024-07-24T22:14:10.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.725+0000 7fbb3d279740 1 -- 172.21.15.47:0/1399293252 wait complete. 2024-07-24T22:14:10.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.725+0000 7fbb3d279740 1 -- start start 2024-07-24T22:14:10.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb3d279740 1 Processor -- start 2024-07-24T22:14:10.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb3d279740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f81f30 0x560343f8b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb3d279740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343f8bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb3d279740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f8e7e0 0x560343f8c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb3d279740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560343d4c890 con 0x560343f82850 2024-07-24T22:14:10.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb3d279740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560343e8b390 con 0x560343f8e7e0 2024-07-24T22:14:10.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb3d279740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x560343f91400 con 0x560343f81f30 2024-07-24T22:14:10.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb3d279740 10 client.0 _ll_register_callbacks cb 0x560343e95500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:10.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb33fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343f8bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb33fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343f8bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48240/0 (socket says 172.21.15.47:48240) 2024-07-24T22:14:10.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb33fff640 1 -- 172.21.15.47:0/2600897514 learned_addr learned my addr 172.21.15.47:0/2600897514 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:10.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb39465640 1 --2- 172.21.15.47:0/2600897514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f81f30 0x560343f8b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb39465640 1 --2- 172.21.15.47:0/2600897514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f8e7e0 0x560343f8c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb33fff640 1 -- 172.21.15.47:0/2600897514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f81f30 msgr2=0x560343f8b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:10.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb33fff640 1 --2- 172.21.15.47:0/2600897514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f81f30 0x560343f8b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb33fff640 1 -- 172.21.15.47:0/2600897514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f8e7e0 msgr2=0x560343f8c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:10.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb33fff640 1 --2- 172.21.15.47:0/2600897514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f8e7e0 0x560343f8c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.726+0000 7fbb33fff640 1 -- 172.21.15.47:0/2600897514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560343e85d60 con 0x560343f82850 2024-07-24T22:14:10.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.727+0000 7fbb33fff640 1 --2- 172.21.15.47:0/2600897514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343f8bcd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400ce90 tx=0x7fbb24007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad00b7356011fb2 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:10.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.727+0000 7fbb13fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:10.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.727+0000 7fbb13fff640 1 -- 172.21.15.47:0/2600897514 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24007e10 con 0x560343f82850 2024-07-24T22:14:10.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.727+0000 7fbb13fff640 1 -- 172.21.15.47:0/2600897514 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8609+0+0 (secure 0 0 0) 0x7fbb24016400 con 0x560343f82850 2024-07-24T22:14:10.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.727+0000 7fbb3d279740 1 -- 172.21.15.47:0/2600897514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb2c005040 con 0x560343f82850 2024-07-24T22:14:10.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.727+0000 7fbb13fff640 1 -- 172.21.15.47:0/2600897514 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbb24024050 con 0x560343f82850 2024-07-24T22:14:10.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.727+0000 7fbb3d279740 10 client.17028 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:10.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.727+0000 7fbb3d279740 1 -- 172.21.15.47:0/2600897514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560343f9d330 con 0x560343f82850 2024-07-24T22:14:10.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.727+0000 7fbb13fff640 1 -- 172.21.15.47:0/2600897514 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb2c005040 con 0x560343f82850 2024-07-24T22:14:10.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.727+0000 7fbb13fff640 1 -- 172.21.15.47:0/2600897514 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbb2400a540 con 0x560343f82850 2024-07-24T22:14:10.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.727+0000 7fbb3d279740 10 client.17028 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:10.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.727+0000 7fbb3d279740 10 client.17028 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:10.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.727+0000 7fbb3d279740 20 client.17028 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:10.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.728+0000 7fbb3d279740 1 --2- 172.21.15.47:0/2600897514 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560343f9e8e0 0x560343fa0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.728+0000 7fbb3d279740 4 client.17028 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:10.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.728+0000 7fbb3d279740 1 -- 172.21.15.47:0/2600897514 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560343efb940 con 0x560343f9e8e0 2024-07-24T22:14:10.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.728+0000 7fbb39465640 1 --2- 172.21.15.47:0/2600897514 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560343f9e8e0 0x560343fa0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.728+0000 7fbb13fff640 10 client.17028 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:10.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.728+0000 7fbb39465640 1 --2- 172.21.15.47:0/2600897514 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560343f9e8e0 0x560343fa0d00 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=612139a8941d9015 server_cookie=22af1b95a1bc2097 in_seq=0 out_seq=0 2024-07-24T22:14:10.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb13fff640 1 -- 172.21.15.47:0/2600897514 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560343efb940 con 0x560343f9e8e0 2024-07-24T22:14:10.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb13fff640 10 client.17028 handle_command_reply: tid=0 2024-07-24T22:14:10.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb3d279740 1 client.17028 shutdown 2024-07-24T22:14:10.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb3d279740 1 -- 172.21.15.47:0/2600897514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 msgr2=0x560343f8bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:10.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb3d279740 1 --2- 172.21.15.47:0/2600897514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343f8bcd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400ce90 tx=0x7fbb24007680 comp rx=0 tx=0).stop 2024-07-24T22:14:10.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb3d279740 1 -- 172.21.15.47:0/2600897514 shutdown_connections 2024-07-24T22:14:10.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb3d279740 1 --2- 172.21.15.47:0/2600897514 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560343f9e8e0 0x560343fa0d00 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb3d279740 1 --2- 172.21.15.47:0/2600897514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f8e7e0 0x560343f8c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb3d279740 1 --2- 172.21.15.47:0/2600897514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343f8bcd0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb3d279740 1 --2- 172.21.15.47:0/2600897514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f81f30 0x560343f8b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb3d279740 1 -- 172.21.15.47:0/2600897514 >> 172.21.15.47:0/2600897514 conn(0x560343f7fd60 msgr2=0x560343f85900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:10.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb13fff640 0 client.17028 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:10.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb3d279740 1 -- 172.21.15.47:0/2600897514 shutdown_connections 2024-07-24T22:14:10.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.729+0000 7fbb3d279740 1 -- 172.21.15.47:0/2600897514 wait complete. 2024-07-24T22:14:10.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.730+0000 7fbb3d279740 20 client.17028 trim_cache size 0 max 16384 2024-07-24T22:14:10.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.748+0000 7fbb3d279740 1 Processor -- start 2024-07-24T22:14:10.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.748+0000 7fbb3d279740 1 -- start start 2024-07-24T22:14:10.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.748+0000 7fbb3d279740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f81f30 0x560343fa65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.748+0000 7fbb3d279740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343fa6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.748+0000 7fbb3d279740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f8e7e0 0x560343f99510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.748+0000 7fbb3d279740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb341ae4b0 con 0x560343f82850 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.748+0000 7fbb3d279740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbb341b0d10 con 0x560343f81f30 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.748+0000 7fbb3d279740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbb341aeb00 con 0x560343f8e7e0 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.748+0000 7fbb33fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343fa6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.748+0000 7fbb33fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343fa6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48244/0 (socket says 172.21.15.47:48244) 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.748+0000 7fbb33fff640 1 -- 172.21.15.47:0/1038859034 learned_addr learned my addr 172.21.15.47:0/1038859034 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.748+0000 7fbb39465640 1 --2- 172.21.15.47:0/1038859034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f81f30 0x560343fa65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.749+0000 7fbb39465640 1 --2- 172.21.15.47:0/1038859034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f8e7e0 0x560343f99510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.749+0000 7fbb33fff640 1 -- 172.21.15.47:0/1038859034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f8e7e0 msgr2=0x560343f99510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.749+0000 7fbb33fff640 1 --2- 172.21.15.47:0/1038859034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f8e7e0 0x560343f99510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.749+0000 7fbb33fff640 1 -- 172.21.15.47:0/1038859034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f81f30 msgr2=0x560343fa65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.749+0000 7fbb33fff640 1 --2- 172.21.15.47:0/1038859034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f81f30 0x560343fa65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.749+0000 7fbb33fff640 1 -- 172.21.15.47:0/1038859034 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560343f82680 con 0x560343f82850 2024-07-24T22:14:10.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.749+0000 7fbb33fff640 1 --2- 172.21.15.47:0/1038859034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343fa6b10 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fbb24000f80 tx=0x7fbb2400adb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e36d5188af0aaf server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:10.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.749+0000 7fbb2a7fc640 1 -- 172.21.15.47:0/1038859034 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb240099c0 con 0x560343f82850 2024-07-24T22:14:10.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.749+0000 7fbb2a7fc640 1 -- 172.21.15.47:0/1038859034 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb2401b070 con 0x560343f82850 2024-07-24T22:14:10.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.749+0000 7fbb2a7fc640 1 -- 172.21.15.47:0/1038859034 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24020740 con 0x560343f82850 2024-07-24T22:14:10.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 -- 172.21.15.47:0/1038859034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 msgr2=0x560343fa6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:10.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 --2- 172.21.15.47:0/1038859034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343fa6b10 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fbb24000f80 tx=0x7fbb2400adb0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 -- 172.21.15.47:0/1038859034 shutdown_connections 2024-07-24T22:14:10.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 --2- 172.21.15.47:0/1038859034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f8e7e0 0x560343f99510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 --2- 172.21.15.47:0/1038859034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343fa6b10 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 --2- 172.21.15.47:0/1038859034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f81f30 0x560343fa65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 -- 172.21.15.47:0/1038859034 >> 172.21.15.47:0/1038859034 conn(0x560343f7fd60 msgr2=0x560343f85890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:10.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 -- 172.21.15.47:0/1038859034 shutdown_connections 2024-07-24T22:14:10.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 -- 172.21.15.47:0/1038859034 wait complete. 2024-07-24T22:14:10.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 -- start start 2024-07-24T22:14:10.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 Processor -- start 2024-07-24T22:14:10.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f81f30 0x560343f96bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343f92080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f8e7e0 0x560343f925c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb341af1d0 con 0x560343f82850 2024-07-24T22:14:10.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbb341b0640 con 0x560343f8e7e0 2024-07-24T22:14:10.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbb341af8a0 con 0x560343f81f30 2024-07-24T22:14:10.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.750+0000 7fbb3d279740 10 client.0 _ll_register_callbacks cb 0x7fbb2400caa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:10.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb33fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343f92080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb33fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343f92080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48260/0 (socket says 172.21.15.47:48260) 2024-07-24T22:14:10.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb33fff640 1 -- 172.21.15.47:0/2020822047 learned_addr learned my addr 172.21.15.47:0/2020822047 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:10.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb39465640 1 --2- 172.21.15.47:0/2020822047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f81f30 0x560343f96bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb39465640 1 --2- 172.21.15.47:0/2020822047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f8e7e0 0x560343f925c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb33fff640 1 -- 172.21.15.47:0/2020822047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f81f30 msgr2=0x560343f96bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:10.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb33fff640 1 --2- 172.21.15.47:0/2020822047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f81f30 0x560343f96bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb33fff640 1 -- 172.21.15.47:0/2020822047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f8e7e0 msgr2=0x560343f925c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:10.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb33fff640 1 --2- 172.21.15.47:0/2020822047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f8e7e0 0x560343f925c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb33fff640 1 -- 172.21.15.47:0/2020822047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560343f92cb0 con 0x560343f82850 2024-07-24T22:14:10.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb33fff640 1 --2- 172.21.15.47:0/2020822047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343f92080 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400ce30 tx=0x7fbb24009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3bad081ecdc7b5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:10.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb13fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:10.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb13fff640 1 -- 172.21.15.47:0/2020822047 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24034070 con 0x560343f82850 2024-07-24T22:14:10.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb13fff640 1 -- 172.21.15.47:0/2020822047 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8609+0+0 (secure 0 0 0) 0x7fbb2400a600 con 0x560343f82850 2024-07-24T22:14:10.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.751+0000 7fbb3d279740 1 -- 172.21.15.47:0/2020822047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb2401b070 con 0x560343f82850 2024-07-24T22:14:10.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.752+0000 7fbb13fff640 1 -- 172.21.15.47:0/2020822047 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbb240204c0 con 0x560343f82850 2024-07-24T22:14:10.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.752+0000 7fbb3d279740 10 client.17034 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:10.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.752+0000 7fbb3d279740 1 -- 172.21.15.47:0/2020822047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5603440094c0 con 0x560343f82850 2024-07-24T22:14:10.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.752+0000 7fbb13fff640 1 -- 172.21.15.47:0/2020822047 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb2401b070 con 0x560343f82850 2024-07-24T22:14:10.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.752+0000 7fbb13fff640 1 -- 172.21.15.47:0/2020822047 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbb24039460 con 0x560343f82850 2024-07-24T22:14:10.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.752+0000 7fbb3d279740 10 client.17034 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:10.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.752+0000 7fbb3d279740 10 client.17034 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:10.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.752+0000 7fbb3d279740 20 client.17034 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:10.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.752+0000 7fbb3d279740 1 --2- 172.21.15.47:0/2020822047 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560344009b80 0x56034400bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:10.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.752+0000 7fbb3d279740 4 client.17034 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.752+0000 7fbb3d279740 1 -- 172.21.15.47:0/2020822047 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560343ef73e0 con 0x560344009b80 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.752+0000 7fbb39465640 1 --2- 172.21.15.47:0/2020822047 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560344009b80 0x56034400bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.753+0000 7fbb39465640 1 --2- 172.21.15.47:0/2020822047 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560344009b80 0x56034400bfa0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f29d6a50aef2e5f server_cookie=4fc21a7061a48e6e in_seq=0 out_seq=0 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.753+0000 7fbb13fff640 10 client.17034 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb13fff640 1 -- 172.21.15.47:0/2020822047 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560343ef73e0 con 0x560344009b80 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb13fff640 10 client.17034 handle_command_reply: tid=0 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb3d279740 1 client.17034 shutdown 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb3d279740 1 -- 172.21.15.47:0/2020822047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 msgr2=0x560343f92080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb3d279740 1 --2- 172.21.15.47:0/2020822047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343f92080 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400ce30 tx=0x7fbb24009570 comp rx=0 tx=0).stop 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb3d279740 1 -- 172.21.15.47:0/2020822047 shutdown_connections 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb3d279740 1 --2- 172.21.15.47:0/2020822047 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560344009b80 0x56034400bfa0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb3d279740 1 --2- 172.21.15.47:0/2020822047 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560343f8e7e0 0x560343f925c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb3d279740 1 --2- 172.21.15.47:0/2020822047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560343f82850 0x560343f92080 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb3d279740 1 --2- 172.21.15.47:0/2020822047 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560343f81f30 0x560343f96bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb3d279740 1 -- 172.21.15.47:0/2020822047 >> 172.21.15.47:0/2020822047 conn(0x560343f7fd60 msgr2=0x560343f8cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:10.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb13fff640 0 client.17034 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:10.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb3d279740 1 -- 172.21.15.47:0/2020822047 shutdown_connections 2024-07-24T22:14:10.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb3d279740 1 -- 172.21.15.47:0/2020822047 wait complete. 2024-07-24T22:14:10.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.754+0000 7fbb3d279740 20 client.17034 trim_cache size 0 max 16384 2024-07-24T22:14:10.761 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:14:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:14:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "7656babb-ef1c-4006-8243-9065d2b661f9", 2024-07-24T22:14:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:14:10.762 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:14:10.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.755+0000 7fbb3aec8640 1 -- 172.21.15.47:0/127301143 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb200b3d40 msgr2=0x7fbb200b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:10.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.755+0000 7fbb3aec8640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb200b3d40 0x7fbb200b6200 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0e14a0 tx=0x7fbb1c0ec040 comp rx=0 tx=0).stop 2024-07-24T22:14:10.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.755+0000 7fbb3aec8640 1 -- 172.21.15.47:0/127301143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34102790 msgr2=0x7fbb34198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:10.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.755+0000 7fbb3aec8640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34102790 0x7fbb34198c50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00d950 tx=0x7fbb1c00de10 comp rx=0 tx=0).stop 2024-07-24T22:14:10.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.755+0000 7fbb3aec8640 1 -- 172.21.15.47:0/127301143 shutdown_connections 2024-07-24T22:14:10.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.755+0000 7fbb3aec8640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb200b3d40 0x7fbb200b6200 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.755+0000 7fbb3aec8640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb34108b20 0x7fbb3419e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.755+0000 7fbb3aec8640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb341081a0 0x7fbb34199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.755+0000 7fbb3aec8640 1 --2- 172.21.15.47:0/127301143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb34102790 0x7fbb34198c50 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:10.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.755+0000 7fbb3aec8640 1 -- 172.21.15.47:0/127301143 >> 172.21.15.47:0/127301143 conn(0x7fbb340fe200 msgr2=0x7fbb341005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:10.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.755+0000 7fbb3aec8640 1 -- 172.21.15.47:0/127301143 shutdown_connections 2024-07-24T22:14:10.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:10.755+0000 7fbb3aec8640 1 -- 172.21.15.47:0/127301143 wait complete. 2024-07-24T22:14:11.564 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:14:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:11 smithi188 ceph-mon[37380]: pgmap v578: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 14 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-07-24T22:14:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:11 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:14:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:11 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:14:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:11 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:14:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:11 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:14:11.835 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:14:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:11 smithi183 ceph-mon[37007]: pgmap v578: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 14 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-07-24T22:14:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:11 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:14:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:11 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:14:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:11 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:14:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:11 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:14:11.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:11 smithi047 ceph-mon[32551]: pgmap v578: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 14 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-07-24T22:14:11.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:11 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:14:11.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:11 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:14:11.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:11 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:14:11.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:11 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:14:13.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.581+0000 7f04a095e640 1 -- 172.21.15.47:0/297558963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f049c101690 msgr2=0x7f049c101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:13.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.581+0000 7f04a095e640 1 --2- 172.21.15.47:0/297558963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f049c101690 0x7f049c101a70 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0494009900 tx=0x7f049402a410 comp rx=0 tx=0).stop 2024-07-24T22:14:13.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.581+0000 7f04a095e640 1 -- 172.21.15.47:0/297558963 shutdown_connections 2024-07-24T22:14:13.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.581+0000 7f04a095e640 1 --2- 172.21.15.47:0/297558963 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f049c107a20 0x7f049c10e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.581+0000 7f04a095e640 1 --2- 172.21.15.47:0/297558963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f049c1070a0 0x7f049c1074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.581+0000 7f04a095e640 1 --2- 172.21.15.47:0/297558963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f049c101690 0x7f049c101a70 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.581+0000 7f04a095e640 1 -- 172.21.15.47:0/297558963 >> 172.21.15.47:0/297558963 conn(0x7f049c0fd100 msgr2=0x7f049c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:13.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.581+0000 7f04a095e640 1 -- 172.21.15.47:0/297558963 shutdown_connections 2024-07-24T22:14:13.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.581+0000 7f04a095e640 1 -- 172.21.15.47:0/297558963 wait complete. 2024-07-24T22:14:13.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.581+0000 7f04a095e640 1 Processor -- start 2024-07-24T22:14:13.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f04a095e640 1 -- start start 2024-07-24T22:14:13.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f04a095e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f049c101690 0x7f049c1999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f04a095e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f049c1070a0 0x7f049c199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f04a095e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f049c107a20 0x7f049c1a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f04a095e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f049c111630 con 0x7f049c107a20 2024-07-24T22:14:13.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f04a095e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1114b0 con 0x7f049c101690 2024-07-24T22:14:13.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f04a095e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1117b0 con 0x7f049c1070a0 2024-07-24T22:14:13.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f049ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f049c107a20 0x7f049c1a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f049ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f049c107a20 0x7f049c1a4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48270/0 (socket says 172.21.15.47:48270) 2024-07-24T22:14:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f049ad9d640 1 -- 172.21.15.47:0/326358765 learned_addr learned my addr 172.21.15.47:0/326358765 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f0499d9b640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f049c1070a0 0x7f049c199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f049a59c640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f049c101690 0x7f049c1999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f049ad9d640 1 -- 172.21.15.47:0/326358765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f049c1070a0 msgr2=0x7f049c199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f049ad9d640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f049c1070a0 0x7f049c199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f049ad9d640 1 -- 172.21.15.47:0/326358765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f049c101690 msgr2=0x7f049c1999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f049ad9d640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f049c101690 0x7f049c1999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f049ad9d640 1 -- 172.21.15.47:0/326358765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c1a4fa0 con 0x7f049c107a20 2024-07-24T22:14:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.582+0000 7f049ad9d640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f049c107a20 0x7f049c1a4a60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f048c00eaa0 tx=0x7f048c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.583+0000 7f04937fe640 1 -- 172.21.15.47:0/326358765 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c00cdb0 con 0x7f049c107a20 2024-07-24T22:14:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.583+0000 7f04937fe640 1 -- 172.21.15.47:0/326358765 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f048c005020 con 0x7f049c107a20 2024-07-24T22:14:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.583+0000 7f04a095e640 1 -- 172.21.15.47:0/326358765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049c1a5170 con 0x7f049c107a20 2024-07-24T22:14:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.583+0000 7f04937fe640 1 -- 172.21.15.47:0/326358765 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c0116d0 con 0x7f049c107a20 2024-07-24T22:14:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.583+0000 7f04a095e640 1 -- 172.21.15.47:0/326358765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049c1a5620 con 0x7f049c107a20 2024-07-24T22:14:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.585+0000 7f04a2d0f740 1 Processor -- start 2024-07-24T22:14:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.586+0000 7f04937fe640 1 -- 172.21.15.47:0/326358765 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f048c0051d0 con 0x7f049c107a20 2024-07-24T22:14:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.586+0000 7f04a2d0f740 1 -- start start 2024-07-24T22:14:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.586+0000 7f04a2d0f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1680 0x564fe8bb1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.586+0000 7f04a2d0f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1fa0 0x564fe8bc1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.586+0000 7f04a2d0f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 0x564fe8bc4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.586+0000 7f04a2d0f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564fe8b28960 con 0x564fe8bc2340 2024-07-24T22:14:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.586+0000 7f04a2d0f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564fe8b17e60 con 0x564fe8bb1680 2024-07-24T22:14:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.586+0000 7f04a2d0f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564fe8b1bea0 con 0x564fe8bb1fa0 2024-07-24T22:14:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.586+0000 7f0499d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 0x564fe8bc4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.586+0000 7f0499d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 0x564fe8bc4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48274/0 (socket says 172.21.15.47:48274) 2024-07-24T22:14:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.586+0000 7f0499d9b640 1 -- 172.21.15.47:0/3873793189 learned_addr learned my addr 172.21.15.47:0/3873793189 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.586+0000 7f049a59c640 1 --2- 172.21.15.47:0/3873793189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1fa0 0x564fe8bc1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.586+0000 7f0499d9b640 1 --2- 172.21.15.47:0/3873793189 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1680 0x564fe8bb1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.587+0000 7f0499d9b640 1 -- 172.21.15.47:0/3873793189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1fa0 msgr2=0x564fe8bc1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.587+0000 7f0499d9b640 1 --2- 172.21.15.47:0/3873793189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1fa0 0x564fe8bc1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.587+0000 7f0499d9b640 1 -- 172.21.15.47:0/3873793189 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1680 msgr2=0x564fe8bb1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.587+0000 7f0499d9b640 1 --2- 172.21.15.47:0/3873793189 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1680 0x564fe8bb1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.587+0000 7f0499d9b640 1 -- 172.21.15.47:0/3873793189 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe8aa12d0 con 0x564fe8bc2340 2024-07-24T22:14:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.587+0000 7f04937fe640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f04880b3dc0 0x7f04880b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.587+0000 7f049a59c640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f04880b3dc0 0x7f04880b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.587+0000 7f0499d9b640 1 --2- 172.21.15.47:0/3873793189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 0x564fe8bc4730 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f04840127f0 tx=0x7f048400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd8d3078aaa9861 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.587+0000 7f04937fe640 1 -- 172.21.15.47:0/326358765 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8609+0+0 (secure 0 0 0) 0x7f048c0e4140 con 0x7f049c107a20 2024-07-24T22:14:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.587+0000 7f0490ff9640 1 -- 172.21.15.47:0/3873793189 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484012e30 con 0x564fe8bc2340 2024-07-24T22:14:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.587+0000 7f0490ff9640 1 -- 172.21.15.47:0/3873793189 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0484010c20 con 0x564fe8bc2340 2024-07-24T22:14:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.587+0000 7f0490ff9640 1 -- 172.21.15.47:0/3873793189 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048401ea90 con 0x564fe8bc2340 2024-07-24T22:14:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.588+0000 7f04a2d0f740 1 -- 172.21.15.47:0/3873793189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 msgr2=0x564fe8bc4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.588+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/3873793189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 0x564fe8bc4730 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f04840127f0 tx=0x7f048400b7c0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.588+0000 7f049a59c640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f04880b3dc0 0x7f04880b6280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0494031440 tx=0x7f0494005c00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.588+0000 7f04a2d0f740 1 -- 172.21.15.47:0/3873793189 shutdown_connections 2024-07-24T22:14:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.588+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/3873793189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 0x564fe8bc4730 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.588+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/3873793189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1fa0 0x564fe8bc1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.588+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/3873793189 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1680 0x564fe8bb1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.588+0000 7f04a2d0f740 1 -- 172.21.15.47:0/3873793189 >> 172.21.15.47:0/3873793189 conn(0x564fe8baf4b0 msgr2=0x564fe8bb0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.588+0000 7f04a2d0f740 1 -- 172.21.15.47:0/3873793189 shutdown_connections 2024-07-24T22:14:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.588+0000 7f04a2d0f740 1 -- 172.21.15.47:0/3873793189 wait complete. 2024-07-24T22:14:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.588+0000 7f04a2d0f740 1 -- start start 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.588+0000 7f04a2d0f740 1 Processor -- start 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f04a2d0f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1680 0x564fe8bbf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f04a2d0f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1fa0 0x564fe8bbf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f04a2d0f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bc2340 0x564fe8bbfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f04a2d0f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564fe897b700 con 0x564fe8bb1680 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f04a2d0f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564fe8aba5a0 con 0x564fe8bb1fa0 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f04a2d0f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564fe8bc4ff0 con 0x564fe8bc2340 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f04a2d0f740 10 client.0 _ll_register_callbacks cb 0x564fe8ada910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f049a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1680 0x564fe8bbf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f049a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1680 0x564fe8bbf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48288/0 (socket says 172.21.15.47:48288) 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f049a59c640 1 -- 172.21.15.47:0/2914544218 learned_addr learned my addr 172.21.15.47:0/2914544218 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f049ad9d640 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bc2340 0x564fe8bbfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f0499d9b640 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1fa0 0x564fe8bbf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f049a59c640 1 -- 172.21.15.47:0/2914544218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bc2340 msgr2=0x564fe8bbfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:13.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f049a59c640 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bc2340 0x564fe8bbfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f049a59c640 1 -- 172.21.15.47:0/2914544218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1fa0 msgr2=0x564fe8bbf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:13.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f049a59c640 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1fa0 0x564fe8bbf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f049a59c640 1 -- 172.21.15.47:0/2914544218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe8aad630 con 0x564fe8bb1680 2024-07-24T22:14:13.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f0499d9b640 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1fa0 0x564fe8bbf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:13.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f049a59c640 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1680 0x564fe8bbf2d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0494033000 tx=0x7f0494009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e73a236597124eb server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:13.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.589+0000 7f0481ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:13.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f0481ffb640 1 -- 172.21.15.47:0/2914544218 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049404d070 con 0x564fe8bb1680 2024-07-24T22:14:13.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f0481ffb640 1 -- 172.21.15.47:0/2914544218 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8609+0+0 (secure 0 0 0) 0x7f0494005030 con 0x564fe8bb1680 2024-07-24T22:14:13.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f04a2d0f740 1 -- 172.21.15.47:0/2914544218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0484010c20 con 0x564fe8bb1680 2024-07-24T22:14:13.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f0481ffb640 1 -- 172.21.15.47:0/2914544218 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0494059050 con 0x564fe8bb1680 2024-07-24T22:14:13.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f04a2d0f740 10 client.17046 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:13.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f04a2d0f740 1 -- 172.21.15.47:0/2914544218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564fe8878650 con 0x564fe8bb1680 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f0481ffb640 1 -- 172.21.15.47:0/2914544218 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0484010c20 con 0x564fe8bb1680 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f0481ffb640 1 -- 172.21.15.47:0/2914544218 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f04940035f0 con 0x564fe8bb1680 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f04a2d0f740 10 client.17046 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f04a2d0f740 10 client.17046 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f04a2d0f740 20 client.17046 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564fe8bd1e10 0x564fe8bd42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f04a2d0f740 4 client.17046 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.590+0000 7f04a2d0f740 1 -- 172.21.15.47:0/2914544218 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fe8b2a8b0 con 0x564fe8bd1e10 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.591+0000 7f0499d9b640 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564fe8bd1e10 0x564fe8bd42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.591+0000 7f0499d9b640 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564fe8bd1e10 0x564fe8bd42a0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baa2069ddc3b904d server_cookie=996ae01609927145 in_seq=0 out_seq=0 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.591+0000 7f0481ffb640 10 client.17046 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f0481ffb640 1 -- 172.21.15.47:0/2914544218 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564fe8b2a8b0 con 0x564fe8bd1e10 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f0481ffb640 10 client.17046 handle_command_reply: tid=0 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f04a2d0f740 1 client.17046 shutdown 2024-07-24T22:14:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f04a2d0f740 1 -- 172.21.15.47:0/2914544218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1680 msgr2=0x564fe8bbf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1680 0x564fe8bbf2d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0494033000 tx=0x7f0494009260 comp rx=0 tx=0).stop 2024-07-24T22:14:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f04a2d0f740 1 -- 172.21.15.47:0/2914544218 shutdown_connections 2024-07-24T22:14:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564fe8bd1e10 0x564fe8bd42a0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bc2340 0x564fe8bbfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1fa0 0x564fe8bbf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/2914544218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1680 0x564fe8bbf2d0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f04a2d0f740 1 -- 172.21.15.47:0/2914544218 >> 172.21.15.47:0/2914544218 conn(0x564fe8baf4b0 msgr2=0x564fe8bb5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f0481ffb640 0 client.17046 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f04a2d0f740 1 -- 172.21.15.47:0/2914544218 shutdown_connections 2024-07-24T22:14:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f04a2d0f740 1 -- 172.21.15.47:0/2914544218 wait complete. 2024-07-24T22:14:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.592+0000 7f04a2d0f740 20 client.17046 trim_cache size 0 max 16384 2024-07-24T22:14:13.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.610+0000 7f04a2d0f740 1 Processor -- start 2024-07-24T22:14:13.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f04a2d0f740 1 -- start start 2024-07-24T22:14:13.613 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:13 smithi047 ceph-mon[32551]: pgmap v579: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2024-07-24T22:14:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f04a2d0f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1680 0x564fe8bbcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f04a2d0f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1fa0 0x564fe8bbf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f04a2d0f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 0x564fe8badd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f04a2d0f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1a9fd0 con 0x564fe8bc2340 2024-07-24T22:14:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f04a2d0f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1ac830 con 0x564fe8bb1680 2024-07-24T22:14:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f04a2d0f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1aa620 con 0x564fe8bb1fa0 2024-07-24T22:14:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f049ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 0x564fe8badd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f049ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 0x564fe8badd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48302/0 (socket says 172.21.15.47:48302) 2024-07-24T22:14:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f049ad9d640 1 -- 172.21.15.47:0/821091491 learned_addr learned my addr 172.21.15.47:0/821091491 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f0499d9b640 1 --2- 172.21.15.47:0/821091491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1fa0 0x564fe8bbf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f049a59c640 1 --2- 172.21.15.47:0/821091491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1680 0x564fe8bbcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f049ad9d640 1 -- 172.21.15.47:0/821091491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1fa0 msgr2=0x564fe8bbf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f049ad9d640 1 --2- 172.21.15.47:0/821091491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1fa0 0x564fe8bbf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f049ad9d640 1 -- 172.21.15.47:0/821091491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1680 msgr2=0x564fe8bbcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f049ad9d640 1 --2- 172.21.15.47:0/821091491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1680 0x564fe8bbcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.611+0000 7f049ad9d640 1 -- 172.21.15.47:0/821091491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe8bbd7d0 con 0x564fe8bc2340 2024-07-24T22:14:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.612+0000 7f049ad9d640 1 --2- 172.21.15.47:0/821091491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 0x564fe8badd00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f048c0aa860 tx=0x7f048c0aa510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ee5a08a2f95e46 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:13.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.612+0000 7f0483fff640 1 -- 172.21.15.47:0/821091491 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c01f040 con 0x564fe8bc2340 2024-07-24T22:14:13.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.612+0000 7f0483fff640 1 -- 172.21.15.47:0/821091491 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f048c0af0b0 con 0x564fe8bc2340 2024-07-24T22:14:13.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.612+0000 7f0483fff640 1 -- 172.21.15.47:0/821091491 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c0a6970 con 0x564fe8bc2340 2024-07-24T22:14:13.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 -- 172.21.15.47:0/821091491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 msgr2=0x564fe8badd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:13.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/821091491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 0x564fe8badd00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f048c0aa860 tx=0x7f048c0aa510 comp rx=0 tx=0).stop 2024-07-24T22:14:13.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 -- 172.21.15.47:0/821091491 shutdown_connections 2024-07-24T22:14:13.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/821091491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bc2340 0x564fe8badd00 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/821091491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1fa0 0x564fe8bbf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/821091491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bb1680 0x564fe8bbcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 -- 172.21.15.47:0/821091491 >> 172.21.15.47:0/821091491 conn(0x564fe8baf4b0 msgr2=0x564fe8bbf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 -- 172.21.15.47:0/821091491 shutdown_connections 2024-07-24T22:14:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 -- 172.21.15.47:0/821091491 wait complete. 2024-07-24T22:14:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 -- start start 2024-07-24T22:14:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 Processor -- start 2024-07-24T22:14:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1680 0x564fe8bca750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1fa0 0x564fe8bd9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bc2340 0x564fe8bd98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1aacf0 con 0x564fe8bb1fa0 2024-07-24T22:14:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1ac160 con 0x564fe8bc2340 2024-07-24T22:14:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.613+0000 7f04a2d0f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1ab3c0 con 0x564fe8bb1680 2024-07-24T22:14:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f04a2d0f740 10 client.0 _ll_register_callbacks cb 0x7f0494032b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f0499d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1fa0 0x564fe8bd9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f0499d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1fa0 0x564fe8bd9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48310/0 (socket says 172.21.15.47:48310) 2024-07-24T22:14:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f0499d9b640 1 -- 172.21.15.47:0/112961948 learned_addr learned my addr 172.21.15.47:0/112961948 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f049a59c640 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1680 0x564fe8bca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f049ad9d640 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bc2340 0x564fe8bd98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f0499d9b640 1 -- 172.21.15.47:0/112961948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1680 msgr2=0x564fe8bca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f0499d9b640 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1680 0x564fe8bca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f0499d9b640 1 -- 172.21.15.47:0/112961948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bc2340 msgr2=0x564fe8bd98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f0499d9b640 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bc2340 0x564fe8bd98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f0499d9b640 1 -- 172.21.15.47:0/112961948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe8bd9ee0 con 0x564fe8bb1fa0 2024-07-24T22:14:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f049ad9d640 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bc2340 0x564fe8bd98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f0499d9b640 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1fa0 0x564fe8bd9360 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x564fe8bb1630 tx=0x7f048401e670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa3190a9af95411 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f0481ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f0481ffb640 1 -- 172.21.15.47:0/112961948 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484012460 con 0x564fe8bb1fa0 2024-07-24T22:14:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f0481ffb640 1 -- 172.21.15.47:0/112961948 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8609+0+0 (secure 0 0 0) 0x7f04840052f0 con 0x564fe8bb1fa0 2024-07-24T22:14:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.614+0000 7f04a2d0f740 1 -- 172.21.15.47:0/112961948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f048c0af0b0 con 0x564fe8bb1fa0 2024-07-24T22:14:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.615+0000 7f0481ffb640 1 -- 172.21.15.47:0/112961948 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0484037050 con 0x564fe8bb1fa0 2024-07-24T22:14:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.615+0000 7f04a2d0f740 10 client.17052 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.615+0000 7f04a2d0f740 1 -- 172.21.15.47:0/112961948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564fe8c3c9f0 con 0x564fe8bb1fa0 2024-07-24T22:14:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.615+0000 7f0481ffb640 1 -- 172.21.15.47:0/112961948 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f048c0af0b0 con 0x564fe8bb1fa0 2024-07-24T22:14:13.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.615+0000 7f0481ffb640 1 -- 172.21.15.47:0/112961948 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f048401e6e0 con 0x564fe8bb1fa0 2024-07-24T22:14:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.615+0000 7f04a2d0f740 10 client.17052 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.615+0000 7f04a2d0f740 10 client.17052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.615+0000 7f04a2d0f740 20 client.17052 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.615+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564fe8c3d030 0x564fe8c3f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.615+0000 7f04a2d0f740 4 client.17052 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:14:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.615+0000 7f04a2d0f740 1 -- 172.21.15.47:0/112961948 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564fe8b26350 con 0x564fe8c3d030 2024-07-24T22:14:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.615+0000 7f049a59c640 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564fe8c3d030 0x564fe8c3f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f049a59c640 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564fe8c3d030 0x564fe8c3f450 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cde7047abc3b944 server_cookie=904fe5a5199e3044 in_seq=0 out_seq=0 2024-07-24T22:14:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f0481ffb640 10 client.17052 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f0481ffb640 1 -- 172.21.15.47:0/112961948 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564fe8b26350 con 0x564fe8c3d030 2024-07-24T22:14:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f0481ffb640 10 client.17052 handle_command_reply: tid=0 2024-07-24T22:14:13.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f04a2d0f740 1 client.17052 shutdown 2024-07-24T22:14:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f04a2d0f740 1 -- 172.21.15.47:0/112961948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1fa0 msgr2=0x564fe8bd9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1fa0 0x564fe8bd9360 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x564fe8bb1630 tx=0x7f048401e670 comp rx=0 tx=0).stop 2024-07-24T22:14:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f04a2d0f740 1 -- 172.21.15.47:0/112961948 shutdown_connections 2024-07-24T22:14:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564fe8c3d030 0x564fe8c3f450 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f0481ffb640 0 client.17052 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564fe8bc2340 0x564fe8bd98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564fe8bb1fa0 0x564fe8bd9360 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f04a2d0f740 1 --2- 172.21.15.47:0/112961948 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564fe8bb1680 0x564fe8bca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.616+0000 7f04a2d0f740 1 -- 172.21.15.47:0/112961948 >> 172.21.15.47:0/112961948 conn(0x564fe8baf4b0 msgr2=0x564fe8bbfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a2d0f740 1 -- 172.21.15.47:0/112961948 shutdown_connections 2024-07-24T22:14:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a2d0f740 1 -- 172.21.15.47:0/112961948 wait complete. 2024-07-24T22:14:13.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a2d0f740 20 client.17052 trim_cache size 0 max 16384 2024-07-24T22:14:13.626 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:14:13.626 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-07-24T22:14:13.626 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-07-24T22:14:13.626 INFO:teuthology.orchestra.run.smithi047.stdout: "7656babb-ef1c-4006-8243-9065d2b661f9": { 2024-07-24T22:14:13.626 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-07-24T22:14:13.626 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "7656babb-ef1c-4006-8243-9065d2b661f9", 2024-07-24T22:14:13.626 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-07-24T22:14:13.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:13.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:13.627 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:14:13.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a095e640 1 -- 172.21.15.47:0/326358765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f04880b3dc0 msgr2=0x7f04880b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:13.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a095e640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f04880b3dc0 0x7f04880b6280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0494031440 tx=0x7f0494005c00 comp rx=0 tx=0).stop 2024-07-24T22:14:13.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a095e640 1 -- 172.21.15.47:0/326358765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f049c107a20 msgr2=0x7f049c1a4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:13.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a095e640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f049c107a20 0x7f049c1a4a60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f048c00eaa0 tx=0x7f048c00ef60 comp rx=0 tx=0).stop 2024-07-24T22:14:13.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a095e640 1 -- 172.21.15.47:0/326358765 shutdown_connections 2024-07-24T22:14:13.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a095e640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f04880b3dc0 0x7f04880b6280 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a095e640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f049c107a20 0x7f049c1a4a60 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a095e640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f049c1070a0 0x7f049c199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a095e640 1 --2- 172.21.15.47:0/326358765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f049c101690 0x7f049c1999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:13.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a095e640 1 -- 172.21.15.47:0/326358765 >> 172.21.15.47:0/326358765 conn(0x7f049c0fd100 msgr2=0x7f049c0fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:13.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.617+0000 7f04a095e640 1 -- 172.21.15.47:0/326358765 shutdown_connections 2024-07-24T22:14:13.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:13.618+0000 7f04a095e640 1 -- 172.21.15.47:0/326358765 wait complete. 2024-07-24T22:14:13.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:13 smithi188 ceph-mon[37380]: pgmap v579: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2024-07-24T22:14:13.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:13 smithi183 ceph-mon[37007]: pgmap v579: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2024-07-24T22:14:14.422 INFO:tasks.cephfs.filesystem:scrub status for tag:7656babb-ef1c-4006-8243-9065d2b661f9 - {'path': '/', 'tag': '7656babb-ef1c-4006-8243-9065d2b661f9', 'options': 'recursive,force'} 2024-07-24T22:14:15.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:15 smithi183 ceph-mon[37007]: osdmap e89: 12 total, 12 up, 12 in 2024-07-24T22:14:15.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:15 smithi183 ceph-mon[37007]: pgmap v581: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-07-24T22:14:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:15 smithi047 ceph-mon[32551]: osdmap e89: 12 total, 12 up, 12 in 2024-07-24T22:14:15.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:15 smithi047 ceph-mon[32551]: pgmap v581: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-07-24T22:14:15.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:15 smithi188 ceph-mon[37380]: osdmap e89: 12 total, 12 up, 12 in 2024-07-24T22:14:15.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:15 smithi188 ceph-mon[37380]: pgmap v581: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-07-24T22:14:16.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:16 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:14:16.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:16 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:14:16.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:16 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:14:17.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:17 smithi047 ceph-mon[32551]: pgmap v582: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 6 op/s 2024-07-24T22:14:17.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:17 smithi188 ceph-mon[37380]: pgmap v582: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 6 op/s 2024-07-24T22:14:17.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:17 smithi183 ceph-mon[37007]: pgmap v582: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 6 op/s 2024-07-24T22:14:18.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.213+0000 7f17c3438640 1 -- 172.21.15.47:0/2046373840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17bc1011f0 msgr2=0x7f17bc1015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:18.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.213+0000 7f17c3438640 1 --2- 172.21.15.47:0/2046373840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17bc1011f0 0x7f17bc1015d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009ca0 tx=0x7f17b802a950 comp rx=0 tx=0).stop 2024-07-24T22:14:18.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.213+0000 7f17c3438640 1 -- 172.21.15.47:0/2046373840 shutdown_connections 2024-07-24T22:14:18.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.213+0000 7f17c3438640 1 --2- 172.21.15.47:0/2046373840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17bc10eda0 0x7f17bc111190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.213+0000 7f17c3438640 1 --2- 172.21.15.47:0/2046373840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17bc101b10 0x7f17bc10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.213+0000 7f17c3438640 1 --2- 172.21.15.47:0/2046373840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17bc1011f0 0x7f17bc1015d0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.213+0000 7f17c3438640 1 -- 172.21.15.47:0/2046373840 >> 172.21.15.47:0/2046373840 conn(0x7f17bc0782e0 msgr2=0x7f17bc0ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.214+0000 7f17c3438640 1 -- 172.21.15.47:0/2046373840 shutdown_connections 2024-07-24T22:14:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.214+0000 7f17c3438640 1 -- 172.21.15.47:0/2046373840 wait complete. 2024-07-24T22:14:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.214+0000 7f17c3438640 1 Processor -- start 2024-07-24T22:14:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.214+0000 7f17c3438640 1 -- start start 2024-07-24T22:14:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.214+0000 7f17c3438640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17bc1011f0 0x7f17bc19ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.214+0000 7f17c3438640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17bc101b10 0x7f17bc19b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.214+0000 7f17c3438640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17bc10eda0 0x7f17bc1a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.214+0000 7f17c3438640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc114860 con 0x7f17bc1011f0 2024-07-24T22:14:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c3438640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1146e0 con 0x7f17bc10eda0 2024-07-24T22:14:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c3438640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1149e0 con 0x7f17bc101b10 2024-07-24T22:14:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c11d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17bc1011f0 0x7f17bc19ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c11d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17bc1011f0 0x7f17bc19ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53206/0 (socket says 172.21.15.47:53206) 2024-07-24T22:14:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c11d4640 1 -- 172.21.15.47:0/2418523718 learned_addr learned my addr 172.21.15.47:0/2418523718 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c09d3640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17bc101b10 0x7f17bc19b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c19d5640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17bc10eda0 0x7f17bc1a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c11d4640 1 -- 172.21.15.47:0/2418523718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17bc101b10 msgr2=0x7f17bc19b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c11d4640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17bc101b10 0x7f17bc19b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c11d4640 1 -- 172.21.15.47:0/2418523718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17bc10eda0 msgr2=0x7f17bc1a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c11d4640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17bc10eda0 0x7f17bc1a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c11d4640 1 -- 172.21.15.47:0/2418523718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc1a0ea0 con 0x7f17bc1011f0 2024-07-24T22:14:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c09d3640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17bc101b10 0x7f17bc19b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c19d5640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17bc10eda0 0x7f17bc1a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c11d4640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17bc1011f0 0x7f17bc19ae00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f17b8005cc0 tx=0x7f17b802f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17ae7fc640 1 -- 172.21.15.47:0/2418523718 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8034040 con 0x7f17bc1011f0 2024-07-24T22:14:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17ae7fc640 1 -- 172.21.15.47:0/2418523718 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17b80308f0 con 0x7f17bc1011f0 2024-07-24T22:14:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c3438640 1 -- 172.21.15.47:0/2418523718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17bc1a1130 con 0x7f17bc1011f0 2024-07-24T22:14:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17ae7fc640 1 -- 172.21.15.47:0/2418523718 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b80047c0 con 0x7f17bc1011f0 2024-07-24T22:14:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.215+0000 7f17c3438640 1 -- 172.21.15.47:0/2418523718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17bc1a7850 con 0x7f17bc1011f0 2024-07-24T22:14:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.218+0000 7f17c618f740 1 Processor -- start 2024-07-24T22:14:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.218+0000 7f17c618f740 1 -- start start 2024-07-24T22:14:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.218+0000 7f17ae7fc640 1 -- 172.21.15.47:0/2418523718 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f17b8037020 con 0x7f17bc1011f0 2024-07-24T22:14:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.218+0000 7f17c618f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6b8c0 0x561c9ad6bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.218+0000 7f17c618f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 0x561c9ad77c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.218+0000 7f17c618f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad7a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.218+0000 7f17c618f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561c9ace1280 con 0x561c9ad78170 2024-07-24T22:14:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c618f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x561c9acd0780 con 0x561c9ad6c1e0 2024-07-24T22:14:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c618f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561c9acd47c0 con 0x561c9ad6b8c0 2024-07-24T22:14:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c09d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad7a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c09d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad7a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53208/0 (socket says 172.21.15.47:53208) 2024-07-24T22:14:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c09d3640 1 -- 172.21.15.47:0/3640132554 learned_addr learned my addr 172.21.15.47:0/3640132554 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c11d4640 1 --2- 172.21.15.47:0/3640132554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 0x561c9ad77c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c19d5640 1 --2- 172.21.15.47:0/3640132554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6b8c0 0x561c9ad6bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c09d3640 1 -- 172.21.15.47:0/3640132554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6b8c0 msgr2=0x561c9ad6bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c09d3640 1 --2- 172.21.15.47:0/3640132554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6b8c0 0x561c9ad6bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c09d3640 1 -- 172.21.15.47:0/3640132554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 msgr2=0x561c9ad77c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c09d3640 1 --2- 172.21.15.47:0/3640132554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 0x561c9ad77c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c09d3640 1 -- 172.21.15.47:0/3640132554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c9aa34790 con 0x561c9ad78170 2024-07-24T22:14:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c19d5640 1 --2- 172.21.15.47:0/3640132554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6b8c0 0x561c9ad6bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c09d3640 1 --2- 172.21.15.47:0/3640132554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad7a560 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f17b000bd30 tx=0x7f17b000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4521b8fcbd69fbff server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17ae7fc640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17a80b3d40 0x7f17a80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17a77fe640 1 -- 172.21.15.47:0/3640132554 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b0015070 con 0x561c9ad78170 2024-07-24T22:14:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17a77fe640 1 -- 172.21.15.47:0/3640132554 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17b000be20 con 0x561c9ad78170 2024-07-24T22:14:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17a77fe640 1 -- 172.21.15.47:0/3640132554 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b0011940 con 0x561c9ad78170 2024-07-24T22:14:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17c19d5640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17a80b3d40 0x7f17a80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.219+0000 7f17ae7fc640 1 -- 172.21.15.47:0/2418523718 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f17b8105080 con 0x7f17bc1011f0 2024-07-24T22:14:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.220+0000 7f17c19d5640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17a80b3d40 0x7f17a80b6200 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f17b4005fd0 tx=0x7f17b4005d80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.220+0000 7f17c618f740 1 -- 172.21.15.47:0/3640132554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 msgr2=0x561c9ad7a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.220+0000 7f17c618f740 1 --2- 172.21.15.47:0/3640132554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad7a560 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f17b000bd30 tx=0x7f17b000f730 comp rx=0 tx=0).stop 2024-07-24T22:14:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.220+0000 7f17c618f740 1 -- 172.21.15.47:0/3640132554 shutdown_connections 2024-07-24T22:14:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.220+0000 7f17c618f740 1 --2- 172.21.15.47:0/3640132554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad7a560 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.220+0000 7f17c618f740 1 --2- 172.21.15.47:0/3640132554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 0x561c9ad77c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.220+0000 7f17c618f740 1 --2- 172.21.15.47:0/3640132554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6b8c0 0x561c9ad6bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.220+0000 7f17c618f740 1 -- 172.21.15.47:0/3640132554 >> 172.21.15.47:0/3640132554 conn(0x561c9ad696f0 msgr2=0x561c9ad6a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.220+0000 7f17c618f740 1 -- 172.21.15.47:0/3640132554 shutdown_connections 2024-07-24T22:14:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.220+0000 7f17c618f740 1 -- 172.21.15.47:0/3640132554 wait complete. 2024-07-24T22:14:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.221+0000 7f17c618f740 1 -- start start 2024-07-24T22:14:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.221+0000 7f17c618f740 1 Processor -- start 2024-07-24T22:14:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.221+0000 7f17c618f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6b8c0 0x561c9ad77860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.221+0000 7f17c618f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6c1e0 0x561c9ad74d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.221+0000 7f17c618f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad75280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.221+0000 7f17c618f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561c9ac0aab0 con 0x561c9ad78170 2024-07-24T22:14:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.221+0000 7f17c618f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x561c9ac589e0 con 0x561c9ad6b8c0 2024-07-24T22:14:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.221+0000 7f17c618f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561c9ad7ae50 con 0x561c9ad6c1e0 2024-07-24T22:14:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.221+0000 7f17c618f740 10 client.0 _ll_register_callbacks cb 0x561c9a9e0a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.221+0000 7f17c19d5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad75280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.221+0000 7f17c19d5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad75280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53224/0 (socket says 172.21.15.47:53224) 2024-07-24T22:14:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.221+0000 7f17c19d5640 1 -- 172.21.15.47:0/4217055213 learned_addr learned my addr 172.21.15.47:0/4217055213 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17c09d3640 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6c1e0 0x561c9ad74d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17c11d4640 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6b8c0 0x561c9ad77860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17c19d5640 1 -- 172.21.15.47:0/4217055213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6c1e0 msgr2=0x561c9ad74d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17c19d5640 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6c1e0 0x561c9ad74d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17c19d5640 1 -- 172.21.15.47:0/4217055213 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6b8c0 msgr2=0x561c9ad77860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17c19d5640 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6b8c0 0x561c9ad77860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17c19d5640 1 -- 172.21.15.47:0/4217055213 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c9aaad620 con 0x561c9ad78170 2024-07-24T22:14:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17c09d3640 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6c1e0 0x561c9ad74d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17c19d5640 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad75280 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f17b400f9a0 tx=0x7f17b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2341eda8edac93ab server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17a4ff9640 1 -- 172.21.15.47:0/4217055213 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4015070 con 0x561c9ad78170 2024-07-24T22:14:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17c618f740 1 -- 172.21.15.47:0/4217055213 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561c9ac7fce0 con 0x561c9ad78170 2024-07-24T22:14:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17a4ff9640 1 -- 172.21.15.47:0/4217055213 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f17b401acc0 con 0x561c9ad78170 2024-07-24T22:14:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17a4ff9640 1 -- 172.21.15.47:0/4217055213 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f17b4026480 con 0x561c9ad78170 2024-07-24T22:14:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17c618f740 10 client.17064 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17c618f740 1 -- 172.21.15.47:0/4217055213 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561c9ad865b0 con 0x561c9ad78170 2024-07-24T22:14:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.222+0000 7f17a4ff9640 1 -- 172.21.15.47:0/4217055213 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561c9ac7fce0 con 0x561c9ad78170 2024-07-24T22:14:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.223+0000 7f17a4ff9640 1 -- 172.21.15.47:0/4217055213 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f17b401b780 con 0x561c9ad78170 2024-07-24T22:14:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.223+0000 7f17c618f740 10 client.17064 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.223+0000 7f17c618f740 10 client.17064 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.223+0000 7f17c618f740 20 client.17064 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.223+0000 7f17c618f740 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561c9ad87b10 0x561c9ad89f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.223+0000 7f17c618f740 4 client.17064 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.223+0000 7f17c618f740 1 -- 172.21.15.47:0/4217055213 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c9ace31d0 con 0x561c9ad87b10 2024-07-24T22:14:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.223+0000 7f17c11d4640 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561c9ad87b10 0x561c9ad89f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.223+0000 7f17a4ff9640 10 client.17064 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.223+0000 7f17c11d4640 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561c9ad87b10 0x561c9ad89f40 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=682b7071571a06c2 server_cookie=a85632dcc4f4018 in_seq=0 out_seq=0 2024-07-24T22:14:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.224+0000 7f17a4ff9640 1 -- 172.21.15.47:0/4217055213 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561c9ace31d0 con 0x561c9ad87b10 2024-07-24T22:14:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.224+0000 7f17a4ff9640 10 client.17064 handle_command_reply: tid=0 2024-07-24T22:14:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.224+0000 7f17c618f740 1 client.17064 shutdown 2024-07-24T22:14:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.224+0000 7f17c618f740 1 -- 172.21.15.47:0/4217055213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 msgr2=0x561c9ad75280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.224+0000 7f17c618f740 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad75280 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f17b400f9a0 tx=0x7f17b40046c0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.224+0000 7f17c618f740 1 -- 172.21.15.47:0/4217055213 shutdown_connections 2024-07-24T22:14:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.224+0000 7f17c618f740 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561c9ad87b10 0x561c9ad89f40 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.224+0000 7f17c618f740 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad75280 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.224+0000 7f17c618f740 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6c1e0 0x561c9ad74d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.224+0000 7f17c618f740 1 --2- 172.21.15.47:0/4217055213 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6b8c0 0x561c9ad77860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.224+0000 7f17a4ff9640 0 client.17064 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.224+0000 7f17c618f740 1 -- 172.21.15.47:0/4217055213 >> 172.21.15.47:0/4217055213 conn(0x561c9ad696f0 msgr2=0x561c9ad6f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.225+0000 7f17c618f740 1 -- 172.21.15.47:0/4217055213 shutdown_connections 2024-07-24T22:14:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.225+0000 7f17c618f740 1 -- 172.21.15.47:0/4217055213 wait complete. 2024-07-24T22:14:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.225+0000 7f17c618f740 20 client.17064 trim_cache size 0 max 16384 2024-07-24T22:14:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.240+0000 7f17c618f740 1 Processor -- start 2024-07-24T22:14:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.240+0000 7f17c618f740 1 -- start start 2024-07-24T22:14:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.240+0000 7f17c618f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6b8c0 0x561c9ad75420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.240+0000 7f17c618f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 0x561c9ad83fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.240+0000 7f17c618f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad8f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.240+0000 7f17c618f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1ae2b0 con 0x561c9ad78170 2024-07-24T22:14:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.240+0000 7f17c618f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1b0b10 con 0x561c9ad6c1e0 2024-07-24T22:14:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.240+0000 7f17c618f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1ae900 con 0x561c9ad6b8c0 2024-07-24T22:14:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.240+0000 7f17c19d5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad8f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.241+0000 7f17c19d5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad8f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53236/0 (socket says 172.21.15.47:53236) 2024-07-24T22:14:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.241+0000 7f17c19d5640 1 -- 172.21.15.47:0/4006872933 learned_addr learned my addr 172.21.15.47:0/4006872933 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.241+0000 7f17c11d4640 1 --2- 172.21.15.47:0/4006872933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6b8c0 0x561c9ad75420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.241+0000 7f17c19d5640 1 -- 172.21.15.47:0/4006872933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6b8c0 msgr2=0x561c9ad75420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.241+0000 7f17c19d5640 1 --2- 172.21.15.47:0/4006872933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6b8c0 0x561c9ad75420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.241+0000 7f17c09d3640 1 --2- 172.21.15.47:0/4006872933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 0x561c9ad83fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.241+0000 7f17c19d5640 1 -- 172.21.15.47:0/4006872933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 msgr2=0x561c9ad83fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.241+0000 7f17c19d5640 1 --2- 172.21.15.47:0/4006872933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 0x561c9ad83fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.241+0000 7f17c19d5640 1 -- 172.21.15.47:0/4006872933 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c9ad74ac0 con 0x561c9ad78170 2024-07-24T22:14:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.241+0000 7f17c19d5640 1 --2- 172.21.15.47:0/4006872933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad8f850 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f17b401bba0 tx=0x7f17b401a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939552bf12840b23 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.241+0000 7f17a6ffd640 1 -- 172.21.15.47:0/4006872933 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4032040 con 0x561c9ad78170 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.241+0000 7f17a6ffd640 1 -- 172.21.15.47:0/4006872933 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17b401b8d0 con 0x561c9ad78170 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.241+0000 7f17a6ffd640 1 -- 172.21.15.47:0/4006872933 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4026cd0 con 0x561c9ad78170 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.242+0000 7f17c618f740 1 -- 172.21.15.47:0/4006872933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 msgr2=0x561c9ad8f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.242+0000 7f17c618f740 1 --2- 172.21.15.47:0/4006872933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad8f850 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f17b401bba0 tx=0x7f17b401a800 comp rx=0 tx=0).stop 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.242+0000 7f17c618f740 1 -- 172.21.15.47:0/4006872933 shutdown_connections 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.242+0000 7f17c618f740 1 --2- 172.21.15.47:0/4006872933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad78170 0x561c9ad8f850 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.242+0000 7f17c618f740 1 --2- 172.21.15.47:0/4006872933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 0x561c9ad83fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.242+0000 7f17c618f740 1 --2- 172.21.15.47:0/4006872933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad6b8c0 0x561c9ad75420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.242+0000 7f17c618f740 1 -- 172.21.15.47:0/4006872933 >> 172.21.15.47:0/4006872933 conn(0x561c9ad696f0 msgr2=0x561c9ad74d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.242+0000 7f17c618f740 1 -- 172.21.15.47:0/4006872933 shutdown_connections 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.242+0000 7f17c618f740 1 -- 172.21.15.47:0/4006872933 wait complete. 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.242+0000 7f17c618f740 1 -- start start 2024-07-24T22:14:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.242+0000 7f17c618f740 1 Processor -- start 2024-07-24T22:14:18.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c618f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad6b8c0 0x561c9ad7b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c618f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 0x561c9ad7bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c618f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad78170 0x561c9adea8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c618f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1aefd0 con 0x561c9ad6b8c0 2024-07-24T22:14:18.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c618f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1b0440 con 0x561c9ad6c1e0 2024-07-24T22:14:18.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c618f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1af6a0 con 0x561c9ad78170 2024-07-24T22:14:18.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c618f740 10 client.0 _ll_register_callbacks cb 0x7f17b400c720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:18.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c11d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad6b8c0 0x561c9ad7b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c11d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad6b8c0 0x561c9ad7b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53248/0 (socket says 172.21.15.47:53248) 2024-07-24T22:14:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c11d4640 1 -- 172.21.15.47:0/2243984833 learned_addr learned my addr 172.21.15.47:0/2243984833 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c19d5640 1 --2- 172.21.15.47:0/2243984833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad78170 0x561c9adea8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c09d3640 1 --2- 172.21.15.47:0/2243984833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 0x561c9ad7bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c11d4640 1 -- 172.21.15.47:0/2243984833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad78170 msgr2=0x561c9adea8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c11d4640 1 --2- 172.21.15.47:0/2243984833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad78170 0x561c9adea8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c11d4640 1 -- 172.21.15.47:0/2243984833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 msgr2=0x561c9ad7bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c11d4640 1 --2- 172.21.15.47:0/2243984833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 0x561c9ad7bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.243+0000 7f17c11d4640 1 -- 172.21.15.47:0/2243984833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c9adeb000 con 0x561c9ad6b8c0 2024-07-24T22:14:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17c11d4640 1 --2- 172.21.15.47:0/2243984833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad6b8c0 0x561c9ad7b9c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f17b8102960 tx=0x7f17b802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3649e5e584dbb5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17a4ff9640 1 -- 172.21.15.47:0/2243984833 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b80cb880 con 0x561c9ad6b8c0 2024-07-24T22:14:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17a4ff9640 1 -- 172.21.15.47:0/2243984833 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f17b8102a20 con 0x561c9ad6b8c0 2024-07-24T22:14:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17c618f740 1 -- 172.21.15.47:0/2243984833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17b401b8d0 con 0x561c9ad6b8c0 2024-07-24T22:14:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17a4ff9640 1 -- 172.21.15.47:0/2243984833 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f17b80cc470 con 0x561c9ad6b8c0 2024-07-24T22:14:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17c618f740 10 client.17070 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17c618f740 1 -- 172.21.15.47:0/2243984833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561c9adf2440 con 0x561c9ad6b8c0 2024-07-24T22:14:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17a4ff9640 1 -- 172.21.15.47:0/2243984833 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17b401b8d0 con 0x561c9ad6b8c0 2024-07-24T22:14:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17a4ff9640 1 -- 172.21.15.47:0/2243984833 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f17b80cbfd0 con 0x561c9ad6b8c0 2024-07-24T22:14:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17c618f740 10 client.17070 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17c618f740 10 client.17070 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17c618f740 20 client.17070 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17c618f740 1 --2- 172.21.15.47:0/2243984833 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561c9adf2b40 0x561c9adf4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17c618f740 4 client.17070 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:14:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.244+0000 7f17c618f740 1 -- 172.21.15.47:0/2243984833 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561c9acdec70 con 0x561c9adf2b40 2024-07-24T22:14:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.245+0000 7f17c09d3640 1 --2- 172.21.15.47:0/2243984833 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561c9adf2b40 0x561c9adf4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.245+0000 7f17c09d3640 1 --2- 172.21.15.47:0/2243984833 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561c9adf2b40 0x561c9adf4f60 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=640acc0771887f88 server_cookie=f7891d41b79f0b20 in_seq=0 out_seq=0 2024-07-24T22:14:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.245+0000 7f17a4ff9640 10 client.17070 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17a4ff9640 1 -- 172.21.15.47:0/2243984833 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561c9acdec70 con 0x561c9adf2b40 2024-07-24T22:14:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17a4ff9640 10 client.17070 handle_command_reply: tid=0 2024-07-24T22:14:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17c618f740 1 client.17070 shutdown 2024-07-24T22:14:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17c618f740 1 -- 172.21.15.47:0/2243984833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad6b8c0 msgr2=0x561c9ad7b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17c618f740 1 --2- 172.21.15.47:0/2243984833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad6b8c0 0x561c9ad7b9c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f17b8102960 tx=0x7f17b802a950 comp rx=0 tx=0).stop 2024-07-24T22:14:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17c618f740 1 -- 172.21.15.47:0/2243984833 shutdown_connections 2024-07-24T22:14:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17c618f740 1 --2- 172.21.15.47:0/2243984833 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561c9adf2b40 0x561c9adf4f60 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17c618f740 1 --2- 172.21.15.47:0/2243984833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561c9ad78170 0x561c9adea8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17a4ff9640 0 client.17070 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17c618f740 1 --2- 172.21.15.47:0/2243984833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561c9ad6c1e0 0x561c9ad7bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17c618f740 1 --2- 172.21.15.47:0/2243984833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c9ad6b8c0 0x561c9ad7b9c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17c618f740 1 -- 172.21.15.47:0/2243984833 >> 172.21.15.47:0/2243984833 conn(0x561c9ad696f0 msgr2=0x561c9ad6fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17c618f740 1 -- 172.21.15.47:0/2243984833 shutdown_connections 2024-07-24T22:14:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17c618f740 1 -- 172.21.15.47:0/2243984833 wait complete. 2024-07-24T22:14:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.253+0000 7f17c618f740 20 client.17070 trim_cache size 0 max 16384 2024-07-24T22:14:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:14:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:14:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:14:18.259 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:14:18.259 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.254+0000 7f17c3438640 1 -- 172.21.15.47:0/2418523718 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17a80b3d40 msgr2=0x7f17a80b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.254+0000 7f17c3438640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17a80b3d40 0x7f17a80b6200 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f17b4005fd0 tx=0x7f17b4005d80 comp rx=0 tx=0).stop 2024-07-24T22:14:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.254+0000 7f17c3438640 1 -- 172.21.15.47:0/2418523718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17bc1011f0 msgr2=0x7f17bc19ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.254+0000 7f17c3438640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17bc1011f0 0x7f17bc19ae00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f17b8005cc0 tx=0x7f17b802f650 comp rx=0 tx=0).stop 2024-07-24T22:14:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.254+0000 7f17c3438640 1 -- 172.21.15.47:0/2418523718 shutdown_connections 2024-07-24T22:14:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.254+0000 7f17c3438640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17a80b3d40 0x7f17a80b6200 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.254+0000 7f17c3438640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17bc10eda0 0x7f17bc1a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.254+0000 7f17c3438640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17bc101b10 0x7f17bc19b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.254+0000 7f17c3438640 1 --2- 172.21.15.47:0/2418523718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17bc1011f0 0x7f17bc19ae00 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.254+0000 7f17c3438640 1 -- 172.21.15.47:0/2418523718 >> 172.21.15.47:0/2418523718 conn(0x7f17bc0782e0 msgr2=0x7f17bc0ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.254+0000 7f17c3438640 1 -- 172.21.15.47:0/2418523718 shutdown_connections 2024-07-24T22:14:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:18.254+0000 7f17c3438640 1 -- 172.21.15.47:0/2418523718 wait complete. 2024-07-24T22:14:19.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:19 smithi183 ceph-mon[37007]: pgmap v583: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 5 op/s 2024-07-24T22:14:19.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:19 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:14:19.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:19 smithi047 ceph-mon[32551]: pgmap v583: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 5 op/s 2024-07-24T22:14:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:19 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:14:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:19 smithi188 ceph-mon[37380]: pgmap v583: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.8 KiB/s rd, 102 B/s wr, 5 op/s 2024-07-24T22:14:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:19 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:14:20.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:14:20.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:14:20.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:14:20.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:14:20.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:14:20.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:14:20.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:14:20.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:14:20.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:14:21.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:21 smithi183 ceph-mon[37007]: pgmap v584: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.8 KiB/s rd, 204 B/s wr, 5 op/s 2024-07-24T22:14:21.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:21 smithi047 ceph-mon[32551]: pgmap v584: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.8 KiB/s rd, 204 B/s wr, 5 op/s 2024-07-24T22:14:21.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:21 smithi188 ceph-mon[37380]: pgmap v584: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.8 KiB/s rd, 204 B/s wr, 5 op/s 2024-07-24T22:14:22.253 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:14:22.533 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:14:23.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:23 smithi183 ceph-mon[37007]: pgmap v585: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.6 KiB/s rd, 409 B/s wr, 5 op/s 2024-07-24T22:14:23.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:23 smithi047 ceph-mon[32551]: pgmap v585: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.6 KiB/s rd, 409 B/s wr, 5 op/s 2024-07-24T22:14:23.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:23 smithi188 ceph-mon[37380]: pgmap v585: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.6 KiB/s rd, 409 B/s wr, 5 op/s 2024-07-24T22:14:24.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.273+0000 7f3c77d80640 1 -- 172.21.15.47:0/1513855063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c70103f30 msgr2=0x7f3c7010c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:24.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.273+0000 7f3c77d80640 1 --2- 172.21.15.47:0/1513855063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c70103f30 0x7f3c7010c510 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009900 tx=0x7f3c6002a410 comp rx=0 tx=0).stop 2024-07-24T22:14:24.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.273+0000 7f3c77d80640 1 -- 172.21.15.47:0/1513855063 shutdown_connections 2024-07-24T22:14:24.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.273+0000 7f3c77d80640 1 --2- 172.21.15.47:0/1513855063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c7010cae0 0x7f3c7010ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:24.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.273+0000 7f3c77d80640 1 --2- 172.21.15.47:0/1513855063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c70103f30 0x7f3c7010c510 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:24.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.273+0000 7f3c77d80640 1 --2- 172.21.15.47:0/1513855063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c70103530 0x7f3c70103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:24.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.273+0000 7f3c77d80640 1 -- 172.21.15.47:0/1513855063 >> 172.21.15.47:0/1513855063 conn(0x7f3c700fd0c0 msgr2=0x7f3c700ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.273+0000 7f3c77d80640 1 -- 172.21.15.47:0/1513855063 shutdown_connections 2024-07-24T22:14:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.273+0000 7f3c77d80640 1 -- 172.21.15.47:0/1513855063 wait complete. 2024-07-24T22:14:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c77d80640 1 Processor -- start 2024-07-24T22:14:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c77d80640 1 -- start start 2024-07-24T22:14:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c77d80640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c70103530 0x7f3c701013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c77d80640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c70103f30 0x7f3c701018f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c77d80640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c7010cae0 0x7f3c70101e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c77d80640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3c70112700 con 0x7f3c70103f30 2024-07-24T22:14:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c77d80640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3c70112580 con 0x7f3c7010cae0 2024-07-24T22:14:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c77d80640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3c70112880 con 0x7f3c70103530 2024-07-24T22:14:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c7531b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c70103f30 0x7f3c701018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c7531b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c70103f30 0x7f3c701018f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53280/0 (socket says 172.21.15.47:53280) 2024-07-24T22:14:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c7531b640 1 -- 172.21.15.47:0/1484772174 learned_addr learned my addr 172.21.15.47:0/1484772174 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c7631d640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c7010cae0 0x7f3c70101e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c75b1c640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c70103530 0x7f3c701013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c7531b640 1 -- 172.21.15.47:0/1484772174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c70103530 msgr2=0x7f3c701013b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c7531b640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c70103530 0x7f3c701013b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c7531b640 1 -- 172.21.15.47:0/1484772174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c7010cae0 msgr2=0x7f3c70101e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c7531b640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c7010cae0 0x7f3c70101e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.274+0000 7f3c7531b640 1 -- 172.21.15.47:0/1484772174 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c701a7010 con 0x7f3c70103f30 2024-07-24T22:14:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.275+0000 7f3c7531b640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c70103f30 0x7f3c701018f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f3c60006010 tx=0x7f3c600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.275+0000 7f3c66ffd640 1 -- 172.21.15.47:0/1484772174 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6003f030 con 0x7f3c70103f30 2024-07-24T22:14:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.275+0000 7f3c66ffd640 1 -- 172.21.15.47:0/1484772174 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c60003800 con 0x7f3c70103f30 2024-07-24T22:14:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.275+0000 7f3c77d80640 1 -- 172.21.15.47:0/1484772174 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c701a72a0 con 0x7f3c70103f30 2024-07-24T22:14:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.275+0000 7f3c66ffd640 1 -- 172.21.15.47:0/1484772174 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60035070 con 0x7f3c70103f30 2024-07-24T22:14:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.275+0000 7f3c77d80640 1 -- 172.21.15.47:0/1484772174 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c701a77d0 con 0x7f3c70103f30 2024-07-24T22:14:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.276+0000 7f3c77d80640 1 -- 172.21.15.47:0/1484772174 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c70103910 con 0x7f3c70103f30 2024-07-24T22:14:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.277+0000 7f3c66ffd640 1 -- 172.21.15.47:0/1484772174 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f3c60003cb0 con 0x7f3c70103f30 2024-07-24T22:14:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.278+0000 7f3c66ffd640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3c5c0b3dc0 0x7f3c5c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.278+0000 7f3c75b1c640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3c5c0b3dc0 0x7f3c5c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.278+0000 7f3c66ffd640 1 -- 172.21.15.47:0/1484772174 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f3c60104c20 con 0x7f3c70103f30 2024-07-24T22:14:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.279+0000 7f3c75b1c640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3c5c0b3dc0 0x7f3c5c0b6280 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0058c0 tx=0x7f3c6c005c60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.281+0000 7f3c66ffd640 1 -- 172.21.15.47:0/1484772174 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f3c600cbea0 con 0x7f3c70103f30 2024-07-24T22:14:24.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.516+0000 7f3c77d80640 1 -- 172.21.15.47:0/1484772174 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c701026b0 con 0x7f3c70103f30 2024-07-24T22:14:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.517+0000 7f3c66ffd640 1 -- 172.21.15.47:0/1484772174 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f3c600d4170 con 0x7f3c70103f30 2024-07-24T22:14:24.537 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:14:24.537 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:14:24.538 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:14:24.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.519+0000 7f3c77d80640 1 -- 172.21.15.47:0/1484772174 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3c5c0b3dc0 msgr2=0x7f3c5c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:24.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.519+0000 7f3c77d80640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3c5c0b3dc0 0x7f3c5c0b6280 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0058c0 tx=0x7f3c6c005c60 comp rx=0 tx=0).stop 2024-07-24T22:14:24.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.519+0000 7f3c77d80640 1 -- 172.21.15.47:0/1484772174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c70103f30 msgr2=0x7f3c701018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:24.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.519+0000 7f3c77d80640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c70103f30 0x7f3c701018f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f3c60006010 tx=0x7f3c600042f0 comp rx=0 tx=0).stop 2024-07-24T22:14:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.519+0000 7f3c77d80640 1 -- 172.21.15.47:0/1484772174 shutdown_connections 2024-07-24T22:14:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.519+0000 7f3c77d80640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3c5c0b3dc0 0x7f3c5c0b6280 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.519+0000 7f3c77d80640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c7010cae0 0x7f3c70101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.519+0000 7f3c77d80640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c70103f30 0x7f3c701018f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.519+0000 7f3c77d80640 1 --2- 172.21.15.47:0/1484772174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c70103530 0x7f3c701013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.519+0000 7f3c77d80640 1 -- 172.21.15.47:0/1484772174 >> 172.21.15.47:0/1484772174 conn(0x7f3c700fd0c0 msgr2=0x7f3c700fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.519+0000 7f3c77d80640 1 -- 172.21.15.47:0/1484772174 shutdown_connections 2024-07-24T22:14:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:24.520+0000 7f3c77d80640 1 -- 172.21.15.47:0/1484772174 wait complete. 2024-07-24T22:14:25.155 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db --set-id 52f39621 --release --await' 2024-07-24T22:14:25.155 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db --set-id 52f39621 --release --await 2024-07-24T22:14:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:14:25.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:25 smithi047 ceph-mon[32551]: pgmap v586: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.3 KiB/s rd, 403 B/s wr, 3 op/s 2024-07-24T22:14:25.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:25 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1484772174' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:14:25.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:25 smithi183 ceph-mon[37007]: pgmap v586: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.3 KiB/s rd, 403 B/s wr, 3 op/s 2024-07-24T22:14:25.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:25 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1484772174' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:14:25.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:25 smithi188 ceph-mon[37380]: pgmap v586: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 2.3 KiB/s rd, 403 B/s wr, 3 op/s 2024-07-24T22:14:25.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:25 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1484772174' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:14:27.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.140+0000 7f53ebda3640 1 -- 172.21.15.47:0/2427679106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e41070a0 msgr2=0x7f53e41074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:27.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.140+0000 7f53ebda3640 1 --2- 172.21.15.47:0/2427679106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e41070a0 0x7f53e41074e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009900 tx=0x7f53d402a410 comp rx=0 tx=0).stop 2024-07-24T22:14:27.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.140+0000 7f53ebda3640 1 -- 172.21.15.47:0/2427679106 shutdown_connections 2024-07-24T22:14:27.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.140+0000 7f53ebda3640 1 --2- 172.21.15.47:0/2427679106 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53e4107a20 0x7f53e410e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.140+0000 7f53ebda3640 1 --2- 172.21.15.47:0/2427679106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e41070a0 0x7f53e41074e0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.140+0000 7f53ebda3640 1 --2- 172.21.15.47:0/2427679106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53e4101690 0x7f53e4101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.140+0000 7f53ebda3640 1 -- 172.21.15.47:0/2427679106 >> 172.21.15.47:0/2427679106 conn(0x7f53e40fd100 msgr2=0x7f53e40ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:27.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.141+0000 7f53ebda3640 1 -- 172.21.15.47:0/2427679106 shutdown_connections 2024-07-24T22:14:27.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.141+0000 7f53ebda3640 1 -- 172.21.15.47:0/2427679106 wait complete. 2024-07-24T22:14:27.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.141+0000 7f53ebda3640 1 Processor -- start 2024-07-24T22:14:27.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.141+0000 7f53ebda3640 1 -- start start 2024-07-24T22:14:27.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.141+0000 7f53ebda3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53e4101690 0x7f53e40fd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.141+0000 7f53ebda3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e41070a0 0x7f53e40fdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.141+0000 7f53ebda3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53e4107a20 0x7f53e40fe080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53ebda3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f53e4111650 con 0x7f53e41070a0 2024-07-24T22:14:27.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53ebda3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41114d0 con 0x7f53e4101690 2024-07-24T22:14:27.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53ebda3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41117d0 con 0x7f53e4107a20 2024-07-24T22:14:27.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53e933e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e41070a0 0x7f53e40fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53e933e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e41070a0 0x7f53e40fdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38526/0 (socket says 172.21.15.47:38526) 2024-07-24T22:14:27.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53e933e640 1 -- 172.21.15.47:0/3358813848 learned_addr learned my addr 172.21.15.47:0/3358813848 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:27.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53e9b3f640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53e4101690 0x7f53e40fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53ea340640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53e4107a20 0x7f53e40fe080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53e933e640 1 -- 172.21.15.47:0/3358813848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53e4107a20 msgr2=0x7f53e40fe080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:27.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53e933e640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53e4107a20 0x7f53e40fe080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53e933e640 1 -- 172.21.15.47:0/3358813848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53e4101690 msgr2=0x7f53e40fd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:27.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53e933e640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53e4101690 0x7f53e40fd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53e933e640 1 -- 172.21.15.47:0/3358813848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e41a7020 con 0x7f53e41070a0 2024-07-24T22:14:27.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53e933e640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e41070a0 0x7f53e40fdb40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f53d4005940 tx=0x7f53d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:27.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53daffd640 1 -- 172.21.15.47:0/3358813848 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d403f030 con 0x7f53e41070a0 2024-07-24T22:14:27.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53ebda3640 1 -- 172.21.15.47:0/3358813848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e41a72b0 con 0x7f53e41070a0 2024-07-24T22:14:27.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53daffd640 1 -- 172.21.15.47:0/3358813848 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53d4003cb0 con 0x7f53e41070a0 2024-07-24T22:14:27.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53daffd640 1 -- 172.21.15.47:0/3358813848 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4035070 con 0x7f53e41070a0 2024-07-24T22:14:27.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.142+0000 7f53ebda3640 1 -- 172.21.15.47:0/3358813848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e41a77e0 con 0x7f53e41070a0 2024-07-24T22:14:27.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.145+0000 7f53ee154740 1 Processor -- start 2024-07-24T22:14:27.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.145+0000 7f53ee154740 1 -- start start 2024-07-24T22:14:27.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.145+0000 7f53daffd640 1 -- 172.21.15.47:0/3358813848 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f53d4042030 con 0x7f53e41070a0 2024-07-24T22:14:27.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.145+0000 7f53ee154740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab4ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53ee154740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 0x55a8cab5ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53ee154740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab5b2e0 0x55a8cab5d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53ee154740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a8caac5dd0 con 0x55a8cab4f350 2024-07-24T22:14:27.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53ee154740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a8caab52d0 con 0x55a8cab5b2e0 2024-07-24T22:14:27.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53ee154740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a8caab9310 con 0x55a8cab4ea30 2024-07-24T22:14:27.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53e9b3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 0x55a8cab5ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53e9b3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 0x55a8cab5ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38540/0 (socket says 172.21.15.47:38540) 2024-07-24T22:14:27.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53e9b3f640 1 -- 172.21.15.47:0/1862676942 learned_addr learned my addr 172.21.15.47:0/1862676942 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:27.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53ea340640 1 --2- 172.21.15.47:0/1862676942 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab4ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53e933e640 1 --2- 172.21.15.47:0/1862676942 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab5b2e0 0x55a8cab5d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53e9b3f640 1 -- 172.21.15.47:0/1862676942 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 msgr2=0x55a8cab4ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:27.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53e9b3f640 1 --2- 172.21.15.47:0/1862676942 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab4ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53e9b3f640 1 -- 172.21.15.47:0/1862676942 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab5b2e0 msgr2=0x55a8cab5d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:27.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53e9b3f640 1 --2- 172.21.15.47:0/1862676942 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab5b2e0 0x55a8cab5d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53e9b3f640 1 -- 172.21.15.47:0/1862676942 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ca815b00 con 0x55a8cab4f350 2024-07-24T22:14:27.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53daffd640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f53d00b3d40 0x7f53d00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53e9b3f640 1 --2- 172.21.15.47:0/1862676942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 0x55a8cab5ada0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f53e000cc60 tx=0x7f53e000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459eebbef2943039 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:27.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53ea340640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f53d00b3d40 0x7f53d00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.146+0000 7f53daffd640 1 -- 172.21.15.47:0/3358813848 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f53d41049b0 con 0x7f53e41070a0 2024-07-24T22:14:27.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.147+0000 7f53cffff640 1 -- 172.21.15.47:0/1862676942 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0014070 con 0x55a8cab4f350 2024-07-24T22:14:27.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.147+0000 7f53cffff640 1 -- 172.21.15.47:0/1862676942 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53e00047a0 con 0x55a8cab4f350 2024-07-24T22:14:27.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.147+0000 7f53cffff640 1 -- 172.21.15.47:0/1862676942 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0010690 con 0x55a8cab4f350 2024-07-24T22:14:27.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.147+0000 7f53ee154740 1 -- 172.21.15.47:0/1862676942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 msgr2=0x55a8cab5ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:27.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.147+0000 7f53ea340640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f53d00b3d40 0x7f53d00b6200 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f53e40ff6c0 tx=0x7f53dc009760 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:27.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.147+0000 7f53ee154740 1 --2- 172.21.15.47:0/1862676942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 0x55a8cab5ada0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f53e000cc60 tx=0x7f53e000e720 comp rx=0 tx=0).stop 2024-07-24T22:14:27.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.147+0000 7f53ee154740 1 -- 172.21.15.47:0/1862676942 shutdown_connections 2024-07-24T22:14:27.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.147+0000 7f53ee154740 1 --2- 172.21.15.47:0/1862676942 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab5b2e0 0x55a8cab5d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.147+0000 7f53ee154740 1 --2- 172.21.15.47:0/1862676942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 0x55a8cab5ada0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.147+0000 7f53ee154740 1 --2- 172.21.15.47:0/1862676942 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab4ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.147+0000 7f53ee154740 1 -- 172.21.15.47:0/1862676942 >> 172.21.15.47:0/1862676942 conn(0x55a8cab4c860 msgr2=0x55a8cab4da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:27.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.148+0000 7f53ee154740 1 -- 172.21.15.47:0/1862676942 shutdown_connections 2024-07-24T22:14:27.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.148+0000 7f53ee154740 1 -- 172.21.15.47:0/1862676942 wait complete. 2024-07-24T22:14:27.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.148+0000 7f53ee154740 1 -- start start 2024-07-24T22:14:27.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.148+0000 7f53ee154740 1 Processor -- start 2024-07-24T22:14:27.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.148+0000 7f53ee154740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4ea30 0x55a8cab58200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.148+0000 7f53ee154740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab4f350 0x55a8cab58740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.148+0000 7f53ee154740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab5b2e0 0x55a8cab58c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.148+0000 7f53ee154740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a8ca918bb0 con 0x55a8cab4ea30 2024-07-24T22:14:27.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.148+0000 7f53ee154740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a8caa57900 con 0x55a8cab4f350 2024-07-24T22:14:27.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.148+0000 7f53ee154740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a8cab5df60 con 0x55a8cab5b2e0 2024-07-24T22:14:27.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.148+0000 7f53ee154740 10 client.0 _ll_register_callbacks cb 0x55a8caa61c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:27.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.148+0000 7f53e9b3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4ea30 0x55a8cab58200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53e9b3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4ea30 0x55a8cab58200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38556/0 (socket says 172.21.15.47:38556) 2024-07-24T22:14:27.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53e9b3f640 1 -- 172.21.15.47:0/749720908 learned_addr learned my addr 172.21.15.47:0/749720908 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:27.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53e933e640 1 --2- 172.21.15.47:0/749720908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab4f350 0x55a8cab58740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53ea340640 1 --2- 172.21.15.47:0/749720908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab5b2e0 0x55a8cab58c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53e9b3f640 1 -- 172.21.15.47:0/749720908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab5b2e0 msgr2=0x55a8cab58c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:27.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53e9b3f640 1 --2- 172.21.15.47:0/749720908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab5b2e0 0x55a8cab58c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53e9b3f640 1 -- 172.21.15.47:0/749720908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab4f350 msgr2=0x55a8cab58740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53e9b3f640 1 --2- 172.21.15.47:0/749720908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab4f350 0x55a8cab58740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53e9b3f640 1 -- 172.21.15.47:0/749720908 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ca88c960 con 0x55a8cab4ea30 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53e9b3f640 1 --2- 172.21.15.47:0/749720908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4ea30 0x55a8cab58200 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f53e000c9d0 tx=0x7f53e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e00ca49b3c2a10 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53cd7fa640 1 -- 172.21.15.47:0/749720908 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0027060 con 0x55a8cab4ea30 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53ee154740 1 -- 172.21.15.47:0/749720908 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53e00047a0 con 0x55a8cab4ea30 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53cd7fa640 1 -- 172.21.15.47:0/749720908 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f53e0005210 con 0x55a8cab4ea30 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53cd7fa640 1 -- 172.21.15.47:0/749720908 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f53e0014070 con 0x55a8cab4ea30 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53ee154740 10 client.17088 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.149+0000 7f53ee154740 1 -- 172.21.15.47:0/749720908 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a8cab69aa0 con 0x55a8cab4ea30 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.150+0000 7f53cd7fa640 1 -- 172.21.15.47:0/749720908 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53e00047a0 con 0x55a8cab4ea30 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.150+0000 7f53cd7fa640 1 -- 172.21.15.47:0/749720908 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f53e0022410 con 0x55a8cab4ea30 2024-07-24T22:14:27.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.150+0000 7f53ee154740 10 client.17088 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:27.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.150+0000 7f53ee154740 10 client.17088 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:14:27.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.150+0000 7f53ee154740 20 client.17088 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:27.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.150+0000 7f53ee154740 1 --2- 172.21.15.47:0/749720908 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a8cab6ae50 0x55a8cab6d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.150+0000 7f53ee154740 4 client.17088 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:27.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.150+0000 7f53ee154740 1 -- 172.21.15.47:0/749720908 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8caac7d20 con 0x55a8cab6ae50 2024-07-24T22:14:27.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.150+0000 7f53e933e640 1 --2- 172.21.15.47:0/749720908 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a8cab6ae50 0x55a8cab6d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.151+0000 7f53e933e640 1 --2- 172.21.15.47:0/749720908 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a8cab6ae50 0x55a8cab6d240 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64d5ccd68da4405 server_cookie=ec0c65d713b63969 in_seq=0 out_seq=0 2024-07-24T22:14:27.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.151+0000 7f53cd7fa640 10 client.17088 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:27.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.151+0000 7f53cd7fa640 1 -- 172.21.15.47:0/749720908 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a8caac7d20 con 0x55a8cab6ae50 2024-07-24T22:14:27.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.151+0000 7f53cd7fa640 10 client.17088 handle_command_reply: tid=0 2024-07-24T22:14:27.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.151+0000 7f53ee154740 1 client.17088 shutdown 2024-07-24T22:14:27.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.151+0000 7f53ee154740 1 -- 172.21.15.47:0/749720908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4ea30 msgr2=0x55a8cab58200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:27.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.151+0000 7f53ee154740 1 --2- 172.21.15.47:0/749720908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4ea30 0x55a8cab58200 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f53e000c9d0 tx=0x7f53e00046c0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.152+0000 7f53ee154740 1 -- 172.21.15.47:0/749720908 shutdown_connections 2024-07-24T22:14:27.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.152+0000 7f53ee154740 1 --2- 172.21.15.47:0/749720908 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a8cab6ae50 0x55a8cab6d240 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.152+0000 7f53ee154740 1 --2- 172.21.15.47:0/749720908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab5b2e0 0x55a8cab58c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.152+0000 7f53ee154740 1 --2- 172.21.15.47:0/749720908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab4f350 0x55a8cab58740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.152+0000 7f53ee154740 1 --2- 172.21.15.47:0/749720908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4ea30 0x55a8cab58200 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.152+0000 7f53cd7fa640 0 client.17088 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:27.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.152+0000 7f53ee154740 1 -- 172.21.15.47:0/749720908 >> 172.21.15.47:0/749720908 conn(0x55a8cab4c860 msgr2=0x55a8cab52400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:27.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.152+0000 7f53ee154740 1 -- 172.21.15.47:0/749720908 shutdown_connections 2024-07-24T22:14:27.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.152+0000 7f53ee154740 1 -- 172.21.15.47:0/749720908 wait complete. 2024-07-24T22:14:27.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.152+0000 7f53ee154740 20 client.17088 trim_cache size 0 max 16384 2024-07-24T22:14:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.170+0000 7f53ee154740 1 Processor -- start 2024-07-24T22:14:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.170+0000 7f53ee154740 1 -- start start 2024-07-24T22:14:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.170+0000 7f53ee154740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab59ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.170+0000 7f53ee154740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 0x55a8cab72810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.170+0000 7f53ee154740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab5b2e0 0x55a8cab72d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.170+0000 7f53ee154740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41ae370 con 0x55a8cab4f350 2024-07-24T22:14:27.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.170+0000 7f53ee154740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41b0bd0 con 0x55a8cab5b2e0 2024-07-24T22:14:27.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.170+0000 7f53ee154740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41ae9c0 con 0x55a8cab4ea30 2024-07-24T22:14:27.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.170+0000 7f53e933e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 0x55a8cab72810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.170+0000 7f53e933e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 0x55a8cab72810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38568/0 (socket says 172.21.15.47:38568) 2024-07-24T22:14:27.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.170+0000 7f53e933e640 1 -- 172.21.15.47:0/908006936 learned_addr learned my addr 172.21.15.47:0/908006936 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:27.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.170+0000 7f53e9b3f640 1 --2- 172.21.15.47:0/908006936 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab59ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.170+0000 7f53ea340640 1 --2- 172.21.15.47:0/908006936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab5b2e0 0x55a8cab72d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.171+0000 7f53e933e640 1 -- 172.21.15.47:0/908006936 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 msgr2=0x55a8cab59ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:27.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.171+0000 7f53e933e640 1 --2- 172.21.15.47:0/908006936 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab59ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.171+0000 7f53e933e640 1 -- 172.21.15.47:0/908006936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab5b2e0 msgr2=0x55a8cab72d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:27.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.171+0000 7f53e933e640 1 --2- 172.21.15.47:0/908006936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab5b2e0 0x55a8cab72d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.171+0000 7f53e933e640 1 -- 172.21.15.47:0/908006936 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8cab48190 con 0x55a8cab4f350 2024-07-24T22:14:27.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.171+0000 7f53ea340640 1 --2- 172.21.15.47:0/908006936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab5b2e0 0x55a8cab72d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:27.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.171+0000 7f53e9b3f640 1 --2- 172.21.15.47:0/908006936 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab59ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:27.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.171+0000 7f53e933e640 1 --2- 172.21.15.47:0/908006936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 0x55a8cab72810 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f53d40c7610 tx=0x7f53d40ee040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b592939efdebd066 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:27.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.171+0000 7f53cf7fe640 1 -- 172.21.15.47:0/908006936 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4104e60 con 0x55a8cab4f350 2024-07-24T22:14:27.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.171+0000 7f53cf7fe640 1 -- 172.21.15.47:0/908006936 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53d40cb0a0 con 0x55a8cab4f350 2024-07-24T22:14:27.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.171+0000 7f53cf7fe640 1 -- 172.21.15.47:0/908006936 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4049040 con 0x55a8cab4f350 2024-07-24T22:14:27.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.172+0000 7f53ee154740 1 -- 172.21.15.47:0/908006936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 msgr2=0x55a8cab72810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:27.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.172+0000 7f53ee154740 1 --2- 172.21.15.47:0/908006936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 0x55a8cab72810 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f53d40c7610 tx=0x7f53d40ee040 comp rx=0 tx=0).stop 2024-07-24T22:14:27.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.172+0000 7f53ee154740 1 -- 172.21.15.47:0/908006936 shutdown_connections 2024-07-24T22:14:27.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.172+0000 7f53ee154740 1 --2- 172.21.15.47:0/908006936 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab5b2e0 0x55a8cab72d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.172+0000 7f53ee154740 1 --2- 172.21.15.47:0/908006936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab4f350 0x55a8cab72810 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.172+0000 7f53ee154740 1 --2- 172.21.15.47:0/908006936 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab59ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.172+0000 7f53ee154740 1 -- 172.21.15.47:0/908006936 >> 172.21.15.47:0/908006936 conn(0x55a8cab4c860 msgr2=0x55a8cab4b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:27.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.172+0000 7f53ee154740 1 -- 172.21.15.47:0/908006936 shutdown_connections 2024-07-24T22:14:27.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.172+0000 7f53ee154740 1 -- 172.21.15.47:0/908006936 wait complete. 2024-07-24T22:14:27.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.172+0000 7f53ee154740 1 -- start start 2024-07-24T22:14:27.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.172+0000 7f53ee154740 1 Processor -- start 2024-07-24T22:14:27.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ee154740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab638d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ee154740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab4f350 0x55a8cab54fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ee154740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab5b2e0 0x55a8cab55560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ee154740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41af090 con 0x55a8cab5b2e0 2024-07-24T22:14:27.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ee154740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41b0500 con 0x55a8cab4f350 2024-07-24T22:14:27.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ee154740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41af760 con 0x55a8cab4ea30 2024-07-24T22:14:27.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ee154740 10 client.0 _ll_register_callbacks cb 0x7f53e0004d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:27.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ea340640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab5b2e0 0x55a8cab55560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ea340640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab5b2e0 0x55a8cab55560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38576/0 (socket says 172.21.15.47:38576) 2024-07-24T22:14:27.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ea340640 1 -- 172.21.15.47:0/305732230 learned_addr learned my addr 172.21.15.47:0/305732230 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:27.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53e9b3f640 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53e933e640 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab4f350 0x55a8cab54fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ea340640 1 -- 172.21.15.47:0/305732230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 msgr2=0x55a8cab638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:27.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ea340640 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ea340640 1 -- 172.21.15.47:0/305732230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab4f350 msgr2=0x55a8cab54fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:27.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ea340640 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab4f350 0x55a8cab54fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ea340640 1 -- 172.21.15.47:0/305732230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8cab55d90 con 0x55a8cab5b2e0 2024-07-24T22:14:27.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53e9b3f640 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:27.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53ea340640 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab5b2e0 0x55a8cab55560 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f53dc01ca80 tx=0x7f53dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde976ebdd5aface server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:27.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.173+0000 7f53cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:27.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53cd7fa640 1 -- 172.21.15.47:0/305732230 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc02b060 con 0x55a8cab5b2e0 2024-07-24T22:14:27.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53cd7fa640 1 -- 172.21.15.47:0/305732230 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f53dc00cdc0 con 0x55a8cab5b2e0 2024-07-24T22:14:27.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53ee154740 1 -- 172.21.15.47:0/305732230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53d40cb0a0 con 0x55a8cab5b2e0 2024-07-24T22:14:27.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53cd7fa640 1 -- 172.21.15.47:0/305732230 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f53dc01b450 con 0x55a8cab5b2e0 2024-07-24T22:14:27.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53ee154740 10 client.17094 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:27.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53ee154740 1 -- 172.21.15.47:0/305732230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a8cabd58d0 con 0x55a8cab5b2e0 2024-07-24T22:14:27.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53cd7fa640 1 -- 172.21.15.47:0/305732230 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53d40cb0a0 con 0x55a8cab5b2e0 2024-07-24T22:14:27.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53cd7fa640 1 -- 172.21.15.47:0/305732230 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f53dc025070 con 0x55a8cab5b2e0 2024-07-24T22:14:27.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53ee154740 10 client.17094 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:27.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53ee154740 10 client.17094 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:14:27.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53ee154740 20 client.17094 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:27.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53ee154740 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a8cabd60b0 0x55a8cabd84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:27.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53ee154740 4 client.17094 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "52f39621", "release": true, "await": true}] 2024-07-24T22:14:27.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.174+0000 7f53ee154740 1 -- 172.21.15.47:0/305732230 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "set_id": "52f39621", "release": true, "await": true}) -- 0x55a8caac37c0 con 0x55a8cabd60b0 2024-07-24T22:14:27.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.175+0000 7f53e9b3f640 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a8cabd60b0 0x55a8cabd84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:27.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.175+0000 7f53e9b3f640 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a8cabd60b0 0x55a8cabd84d0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c09fb321e6d74241 server_cookie=5dee02c6f23a0978 in_seq=0 out_seq=0 2024-07-24T22:14:27.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.175+0000 7f53cd7fa640 10 client.17094 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:27.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.177+0000 7f53cd7fa640 1 -- 172.21.15.47:0/305732230 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a8caac37c0 con 0x55a8cabd60b0 2024-07-24T22:14:27.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.177+0000 7f53cd7fa640 10 client.17094 handle_command_reply: tid=0 2024-07-24T22:14:27.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.177+0000 7f53ee154740 1 client.17094 shutdown 2024-07-24T22:14:27.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.177+0000 7f53ee154740 1 -- 172.21.15.47:0/305732230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab5b2e0 msgr2=0x55a8cab55560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:27.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.177+0000 7f53ee154740 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab5b2e0 0x55a8cab55560 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f53dc01ca80 tx=0x7f53dc004a40 comp rx=0 tx=0).stop 2024-07-24T22:14:27.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ee154740 1 -- 172.21.15.47:0/305732230 shutdown_connections 2024-07-24T22:14:27.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ee154740 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a8cabd60b0 0x55a8cabd84d0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ee154740 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8cab5b2e0 0x55a8cab55560 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ee154740 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a8cab4f350 0x55a8cab54fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ee154740 1 --2- 172.21.15.47:0/305732230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a8cab4ea30 0x55a8cab638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53cd7fa640 0 client.17094 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:27.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ee154740 1 -- 172.21.15.47:0/305732230 >> 172.21.15.47:0/305732230 conn(0x55a8cab4c860 msgr2=0x55a8cab51b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:27.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ee154740 1 -- 172.21.15.47:0/305732230 shutdown_connections 2024-07-24T22:14:27.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ee154740 1 -- 172.21.15.47:0/305732230 wait complete. 2024-07-24T22:14:27.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ee154740 20 client.17094 trim_cache size 0 max 16384 2024-07-24T22:14:27.184 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:14:27.184 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:14:27.184 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:14:27.184 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 24, 2024-07-24T22:14:27.184 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:14:27.184 INFO:teuthology.orchestra.run.smithi047.stdout: "52f39621": { 2024-07-24T22:14:27.185 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 24, 2024-07-24T22:14:27.185 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:14:27.185 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:14:27.185 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:14:27.185 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:14:27.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:14:27.185 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:14:27.185 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 150.0, 2024-07-24T22:14:27.185 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:14:27.185 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:14:27.185 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:14:27.185 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:14:27.185 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:14:27.186 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:14:27.186 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:27.186 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:27.186 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:27.186 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:27.186 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:27.186 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:14:27.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ebda3640 1 -- 172.21.15.47:0/3358813848 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f53d00b3d40 msgr2=0x7f53d00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:27.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ebda3640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f53d00b3d40 0x7f53d00b6200 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f53e40ff6c0 tx=0x7f53dc009760 comp rx=0 tx=0).stop 2024-07-24T22:14:27.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ebda3640 1 -- 172.21.15.47:0/3358813848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e41070a0 msgr2=0x7f53e40fdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:27.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ebda3640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e41070a0 0x7f53e40fdb40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f53d4005940 tx=0x7f53d40042f0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ebda3640 1 -- 172.21.15.47:0/3358813848 shutdown_connections 2024-07-24T22:14:27.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ebda3640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f53d00b3d40 0x7f53d00b6200 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ebda3640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53e4107a20 0x7f53e40fe080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ebda3640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53e41070a0 0x7f53e40fdb40 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ebda3640 1 --2- 172.21.15.47:0/3358813848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53e4101690 0x7f53e40fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:27.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ebda3640 1 -- 172.21.15.47:0/3358813848 >> 172.21.15.47:0/3358813848 conn(0x7f53e40fd100 msgr2=0x7f53e406b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:27.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ebda3640 1 -- 172.21.15.47:0/3358813848 shutdown_connections 2024-07-24T22:14:27.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:27.178+0000 7f53ebda3640 1 -- 172.21.15.47:0/3358813848 wait complete. 2024-07-24T22:14:27.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:27 smithi183 ceph-mon[37007]: pgmap v587: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:14:27.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:27 smithi047 ceph-mon[32551]: pgmap v587: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:14:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:27 smithi188 ceph-mon[37380]: pgmap v587: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:14:27.849 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '52f39621', total seconds elapsed: 35.6 2024-07-24T22:14:29.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:29 smithi183 ceph-mon[37007]: pgmap v588: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:14:29.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:29 smithi047 ceph-mon[32551]: pgmap v588: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:14:29.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:29 smithi188 ceph-mon[37380]: pgmap v588: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:14:31.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.356+0000 7fd9a7811640 1 -- 172.21.15.47:0/987237276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9a01015d0 msgr2=0x7fd9a01019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:31.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.356+0000 7fd9a7811640 1 --2- 172.21.15.47:0/987237276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9a01015d0 0x7fd9a01019b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd99c009cc0 tx=0x7fd99c02cad0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.356+0000 7fd9a7811640 1 -- 172.21.15.47:0/987237276 shutdown_connections 2024-07-24T22:14:31.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.356+0000 7fd9a7811640 1 --2- 172.21.15.47:0/987237276 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9a0107950 0x7fd9a010e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.356+0000 7fd9a7811640 1 --2- 172.21.15.47:0/987237276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9a0106fd0 0x7fd9a0107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.356+0000 7fd9a7811640 1 --2- 172.21.15.47:0/987237276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9a01015d0 0x7fd9a01019b0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.356+0000 7fd9a7811640 1 -- 172.21.15.47:0/987237276 >> 172.21.15.47:0/987237276 conn(0x7fd9a00fd030 msgr2=0x7fd9a00ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:31.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.356+0000 7fd9a7811640 1 -- 172.21.15.47:0/987237276 shutdown_connections 2024-07-24T22:14:31.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.356+0000 7fd9a7811640 1 -- 172.21.15.47:0/987237276 wait complete. 2024-07-24T22:14:31.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.357+0000 7fd9a7811640 1 Processor -- start 2024-07-24T22:14:31.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.357+0000 7fd9a7811640 1 -- start start 2024-07-24T22:14:31.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.357+0000 7fd9a7811640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9a01015d0 0x7fd9a01969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.357+0000 7fd9a7811640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9a0106fd0 0x7fd9a0196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.357+0000 7fd9a7811640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9a0107950 0x7fd9a019c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.357+0000 7fd9a7811640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a0110510 con 0x7fd9a01015d0 2024-07-24T22:14:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.357+0000 7fd9a7811640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a0110390 con 0x7fd9a0106fd0 2024-07-24T22:14:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.357+0000 7fd9a7811640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a0110690 con 0x7fd9a0107950 2024-07-24T22:14:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.357+0000 7fd9a55ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9a01015d0 0x7fd9a01969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.357+0000 7fd9a55ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9a01015d0 0x7fd9a01969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38586/0 (socket says 172.21.15.47:38586) 2024-07-24T22:14:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.357+0000 7fd9a55ad640 1 -- 172.21.15.47:0/460590254 learned_addr learned my addr 172.21.15.47:0/460590254 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.357+0000 7fd9a4dac640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9a0106fd0 0x7fd9a0196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.357+0000 7fd9a5dae640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9a0107950 0x7fd9a019c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.358+0000 7fd9a55ad640 1 -- 172.21.15.47:0/460590254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9a0107950 msgr2=0x7fd9a019c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.358+0000 7fd9a55ad640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9a0107950 0x7fd9a019c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.358+0000 7fd9a55ad640 1 -- 172.21.15.47:0/460590254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9a0106fd0 msgr2=0x7fd9a0196f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.358+0000 7fd9a55ad640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9a0106fd0 0x7fd9a0196f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.358+0000 7fd9a55ad640 1 -- 172.21.15.47:0/460590254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a019ca90 con 0x7fd9a01015d0 2024-07-24T22:14:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.358+0000 7fd9a5dae640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9a0107950 0x7fd9a019c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.358+0000 7fd9a55ad640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9a01015d0 0x7fd9a01969f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd99c005e30 tx=0x7fd99c038b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.358+0000 7fd9967fc640 1 -- 172.21.15.47:0/460590254 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c046070 con 0x7fd9a01015d0 2024-07-24T22:14:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.358+0000 7fd9967fc640 1 -- 172.21.15.47:0/460590254 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd99c004700 con 0x7fd9a01015d0 2024-07-24T22:14:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.358+0000 7fd9a7811640 1 -- 172.21.15.47:0/460590254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a019cd20 con 0x7fd9a01015d0 2024-07-24T22:14:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.358+0000 7fd9967fc640 1 -- 172.21.15.47:0/460590254 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c02ee00 con 0x7fd9a01015d0 2024-07-24T22:14:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.358+0000 7fd9a7811640 1 -- 172.21.15.47:0/460590254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a01a3440 con 0x7fd9a01015d0 2024-07-24T22:14:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.361+0000 7fd9967fc640 1 -- 172.21.15.47:0/460590254 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fd99c02e630 con 0x7fd9a01015d0 2024-07-24T22:14:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.361+0000 7fd9aa56c740 1 Processor -- start 2024-07-24T22:14:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.361+0000 7fd9aa56c740 1 -- start start 2024-07-24T22:14:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.361+0000 7fd9aa56c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 0x55d34f45bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.361+0000 7fd9aa56c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f45c1e0 0x55d34f467c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.361+0000 7fd9aa56c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f468170 0x55d34f46a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.361+0000 7fd9aa56c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d34f3d1280 con 0x55d34f468170 2024-07-24T22:14:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.361+0000 7fd9aa56c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d34f3c0780 con 0x55d34f45c1e0 2024-07-24T22:14:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.361+0000 7fd9aa56c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d34f3c47c0 con 0x55d34f45b8c0 2024-07-24T22:14:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.361+0000 7fd9a4dac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f468170 0x55d34f46a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd9a4dac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f468170 0x55d34f46a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38592/0 (socket says 172.21.15.47:38592) 2024-07-24T22:14:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd9a4dac640 1 -- 172.21.15.47:0/297943131 learned_addr learned my addr 172.21.15.47:0/297943131 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd9a55ad640 1 --2- 172.21.15.47:0/297943131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f45c1e0 0x55d34f467c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd9a5dae640 1 --2- 172.21.15.47:0/297943131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 0x55d34f45bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd9a4dac640 1 -- 172.21.15.47:0/297943131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 msgr2=0x55d34f45bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd9a4dac640 1 --2- 172.21.15.47:0/297943131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 0x55d34f45bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd9a4dac640 1 -- 172.21.15.47:0/297943131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f45c1e0 msgr2=0x55d34f467c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd9a4dac640 1 --2- 172.21.15.47:0/297943131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f45c1e0 0x55d34f467c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd9a4dac640 1 -- 172.21.15.47:0/297943131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d34f124790 con 0x55d34f468170 2024-07-24T22:14:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd9967fc640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd98c0b3dc0 0x7fd98c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd9a5dae640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd98c0b3dc0 0x7fd98c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd9a4dac640 1 --2- 172.21.15.47:0/297943131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f468170 0x55d34f46a560 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd99000bd10 tx=0x7fd9900107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291ba12785747962 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd9967fc640 1 -- 172.21.15.47:0/460590254 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7fd99c1062a0 con 0x7fd9a01015d0 2024-07-24T22:14:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd98b7fe640 1 -- 172.21.15.47:0/297943131 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990005220 con 0x55d34f468170 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd98b7fe640 1 -- 172.21.15.47:0/297943131 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd990004c50 con 0x55d34f468170 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.362+0000 7fd98b7fe640 1 -- 172.21.15.47:0/297943131 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9900116a0 con 0x55d34f468170 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.363+0000 7fd9a5dae640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd98c0b3dc0 0x7fd98c0b6280 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd99800cc00 tx=0x7fd99800c5e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.363+0000 7fd9aa56c740 1 -- 172.21.15.47:0/297943131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f468170 msgr2=0x55d34f46a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.363+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/297943131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f468170 0x55d34f46a560 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd99000bd10 tx=0x7fd9900107a0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.363+0000 7fd9aa56c740 1 -- 172.21.15.47:0/297943131 shutdown_connections 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.363+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/297943131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f468170 0x55d34f46a560 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.363+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/297943131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f45c1e0 0x55d34f467c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.363+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/297943131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 0x55d34f45bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.363+0000 7fd9aa56c740 1 -- 172.21.15.47:0/297943131 >> 172.21.15.47:0/297943131 conn(0x55d34f4596f0 msgr2=0x55d34f45a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.363+0000 7fd9aa56c740 1 -- 172.21.15.47:0/297943131 shutdown_connections 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.363+0000 7fd9aa56c740 1 -- 172.21.15.47:0/297943131 wait complete. 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.364+0000 7fd9aa56c740 1 -- start start 2024-07-24T22:14:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.364+0000 7fd9aa56c740 1 Processor -- start 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.364+0000 7fd9aa56c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45b8c0 0x55d34f467800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.364+0000 7fd9aa56c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45c1e0 0x55d34f464ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.364+0000 7fd9aa56c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f468170 0x55d34f465220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.364+0000 7fd9aa56c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d34f2faab0 con 0x55d34f45b8c0 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.364+0000 7fd9aa56c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d34f3489e0 con 0x55d34f468170 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.364+0000 7fd9aa56c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d34f46ae50 con 0x55d34f45c1e0 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.364+0000 7fd9aa56c740 10 client.0 _ll_register_callbacks cb 0x55d34f0d0a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.364+0000 7fd9a55ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45b8c0 0x55d34f467800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.364+0000 7fd9a55ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45b8c0 0x55d34f467800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38604/0 (socket says 172.21.15.47:38604) 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.364+0000 7fd9a55ad640 1 -- 172.21.15.47:0/3687283944 learned_addr learned my addr 172.21.15.47:0/3687283944 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd9a4dac640 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45c1e0 0x55d34f464ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd9a55ad640 1 -- 172.21.15.47:0/3687283944 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45c1e0 msgr2=0x55d34f464ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd9a55ad640 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45c1e0 0x55d34f464ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd9a55ad640 1 -- 172.21.15.47:0/3687283944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f468170 msgr2=0x55d34f465220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd9a5dae640 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f468170 0x55d34f465220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd9a55ad640 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f468170 0x55d34f465220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd9a55ad640 1 -- 172.21.15.47:0/3687283944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d34f19d620 con 0x55d34f45b8c0 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd9a5dae640 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f468170 0x55d34f465220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd9a55ad640 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45b8c0 0x55d34f467800 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd99c1039c0 tx=0x7fd99c103f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6115142dd9a42d9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd988ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd988ff9640 1 -- 172.21.15.47:0/3687283944 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0c8ce0 con 0x55d34f45b8c0 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd988ff9640 1 -- 172.21.15.47:0/3687283944 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7fd99c004d50 con 0x55d34f45b8c0 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd9aa56c740 1 -- 172.21.15.47:0/3687283944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d34f36fce0 con 0x55d34f45b8c0 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd988ff9640 1 -- 172.21.15.47:0/3687283944 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd99c0cc590 con 0x55d34f45b8c0 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd9aa56c740 10 client.17106 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd9aa56c740 1 -- 172.21.15.47:0/3687283944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d34f476590 con 0x55d34f45b8c0 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.365+0000 7fd988ff9640 1 -- 172.21.15.47:0/3687283944 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d34f36fce0 con 0x55d34f45b8c0 2024-07-24T22:14:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.366+0000 7fd988ff9640 1 -- 172.21.15.47:0/3687283944 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd99c02e040 con 0x55d34f45b8c0 2024-07-24T22:14:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.366+0000 7fd9aa56c740 10 client.17106 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.366+0000 7fd9aa56c740 10 client.17106 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.366+0000 7fd9aa56c740 20 client.17106 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.366+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d34f477a90 0x55d34f479ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.366+0000 7fd9aa56c740 4 client.17106 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.366+0000 7fd9aa56c740 1 -- 172.21.15.47:0/3687283944 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d34f3d31d0 con 0x55d34f477a90 2024-07-24T22:14:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.366+0000 7fd9a4dac640 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d34f477a90 0x55d34f479ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd9a4dac640 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d34f477a90 0x55d34f479ea0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d6e05a94eb5cc86 server_cookie=2d47b39647a05d1a in_seq=0 out_seq=0 2024-07-24T22:14:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd988ff9640 10 client.17106 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:31.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd988ff9640 1 -- 172.21.15.47:0/3687283944 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d34f3d31d0 con 0x55d34f477a90 2024-07-24T22:14:31.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd988ff9640 10 client.17106 handle_command_reply: tid=0 2024-07-24T22:14:31.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd9aa56c740 1 client.17106 shutdown 2024-07-24T22:14:31.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd9aa56c740 1 -- 172.21.15.47:0/3687283944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45b8c0 msgr2=0x55d34f467800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:31.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45b8c0 0x55d34f467800 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd99c1039c0 tx=0x7fd99c103f00 comp rx=0 tx=0).stop 2024-07-24T22:14:31.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd9aa56c740 1 -- 172.21.15.47:0/3687283944 shutdown_connections 2024-07-24T22:14:31.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d34f477a90 0x55d34f479ea0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f468170 0x55d34f465220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45c1e0 0x55d34f464ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd988ff9640 0 client.17106 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:31.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/3687283944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45b8c0 0x55d34f467800 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.367+0000 7fd9aa56c740 1 -- 172.21.15.47:0/3687283944 >> 172.21.15.47:0/3687283944 conn(0x55d34f4596f0 msgr2=0x55d34f45f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:31.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.368+0000 7fd9aa56c740 1 -- 172.21.15.47:0/3687283944 shutdown_connections 2024-07-24T22:14:31.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.368+0000 7fd9aa56c740 1 -- 172.21.15.47:0/3687283944 wait complete. 2024-07-24T22:14:31.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.368+0000 7fd9aa56c740 20 client.17106 trim_cache size 0 max 16384 2024-07-24T22:14:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.385+0000 7fd9aa56c740 1 Processor -- start 2024-07-24T22:14:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.385+0000 7fd9aa56c740 1 -- start start 2024-07-24T22:14:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9aa56c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f4596f0 0x55d34f45ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9aa56c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 0x55d34f47f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9aa56c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f45c1e0 0x55d34f47fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9aa56c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a01a9f10 con 0x55d34f4596f0 2024-07-24T22:14:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9aa56c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a01ac770 con 0x55d34f45c1e0 2024-07-24T22:14:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9aa56c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a01aa560 con 0x55d34f45b8c0 2024-07-24T22:14:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9a55ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f4596f0 0x55d34f45ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9a55ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f4596f0 0x55d34f45ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38616/0 (socket says 172.21.15.47:38616) 2024-07-24T22:14:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9a55ad640 1 -- 172.21.15.47:0/947056833 learned_addr learned my addr 172.21.15.47:0/947056833 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9a4dac640 1 --2- 172.21.15.47:0/947056833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 0x55d34f47f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9a55ad640 1 -- 172.21.15.47:0/947056833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 msgr2=0x55d34f47f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9a55ad640 1 --2- 172.21.15.47:0/947056833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 0x55d34f47f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9a5dae640 1 --2- 172.21.15.47:0/947056833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f45c1e0 0x55d34f47fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9a55ad640 1 -- 172.21.15.47:0/947056833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f45c1e0 msgr2=0x55d34f47fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9a55ad640 1 --2- 172.21.15.47:0/947056833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f45c1e0 0x55d34f47fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9a55ad640 1 -- 172.21.15.47:0/947056833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d34f464ee0 con 0x55d34f4596f0 2024-07-24T22:14:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9a5dae640 1 --2- 172.21.15.47:0/947056833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f45c1e0 0x55d34f47fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.386+0000 7fd9a55ad640 1 --2- 172.21.15.47:0/947056833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f4596f0 0x55d34f45ae50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0c93c0 tx=0x7fd99c02cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ceec0f3a9ef3b0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.387+0000 7fd98affd640 1 -- 172.21.15.47:0/947056833 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0cc770 con 0x55d34f4596f0 2024-07-24T22:14:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.387+0000 7fd98affd640 1 -- 172.21.15.47:0/947056833 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd99c0cd520 con 0x55d34f4596f0 2024-07-24T22:14:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.387+0000 7fd98affd640 1 -- 172.21.15.47:0/947056833 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0ccbf0 con 0x55d34f4596f0 2024-07-24T22:14:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.387+0000 7fd9aa56c740 1 -- 172.21.15.47:0/947056833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f4596f0 msgr2=0x55d34f45ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.387+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/947056833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f4596f0 0x55d34f45ae50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0c93c0 tx=0x7fd99c02cad0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.387+0000 7fd9aa56c740 1 -- 172.21.15.47:0/947056833 shutdown_connections 2024-07-24T22:14:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.387+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/947056833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f45c1e0 0x55d34f47fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.387+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/947056833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 0x55d34f47f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.387+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/947056833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f4596f0 0x55d34f45ae50 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.387+0000 7fd9aa56c740 1 -- 172.21.15.47:0/947056833 >> 172.21.15.47:0/947056833 conn(0x55d34f467960 msgr2=0x55d34f45a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.387+0000 7fd9aa56c740 1 -- 172.21.15.47:0/947056833 shutdown_connections 2024-07-24T22:14:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.387+0000 7fd9aa56c740 1 -- 172.21.15.47:0/947056833 wait complete. 2024-07-24T22:14:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.388+0000 7fd9aa56c740 1 -- start start 2024-07-24T22:14:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.388+0000 7fd9aa56c740 1 Processor -- start 2024-07-24T22:14:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.388+0000 7fd9aa56c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f4596f0 0x55d34f470400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.388+0000 7fd9aa56c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 0x55d34f470980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.388+0000 7fd9aa56c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45c1e0 0x55d34f46ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.388+0000 7fd9aa56c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a01aac30 con 0x55d34f45c1e0 2024-07-24T22:14:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.388+0000 7fd9aa56c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a01ac0a0 con 0x55d34f4596f0 2024-07-24T22:14:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.388+0000 7fd9aa56c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a01ab300 con 0x55d34f45b8c0 2024-07-24T22:14:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.388+0000 7fd9aa56c740 10 client.0 _ll_register_callbacks cb 0x7fd99c02efa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd9a5dae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45c1e0 0x55d34f46ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd9a5dae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45c1e0 0x55d34f46ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38624/0 (socket says 172.21.15.47:38624) 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd9a5dae640 1 -- 172.21.15.47:0/1364779286 learned_addr learned my addr 172.21.15.47:0/1364779286 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd9a55ad640 1 --2- 172.21.15.47:0/1364779286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f4596f0 0x55d34f470400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd9a4dac640 1 --2- 172.21.15.47:0/1364779286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 0x55d34f470980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd9a5dae640 1 -- 172.21.15.47:0/1364779286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 msgr2=0x55d34f470980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd9a5dae640 1 --2- 172.21.15.47:0/1364779286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 0x55d34f470980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd9a5dae640 1 -- 172.21.15.47:0/1364779286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f4596f0 msgr2=0x55d34f470400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd9a5dae640 1 --2- 172.21.15.47:0/1364779286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f4596f0 0x55d34f470400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd9a5dae640 1 -- 172.21.15.47:0/1364779286 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d34f46c250 con 0x55d34f45c1e0 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd9a5dae640 1 --2- 172.21.15.47:0/1364779286 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45c1e0 0x55d34f46ba50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd9980124d0 tx=0x7fd998004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5f441873629756 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd988ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd988ff9640 1 -- 172.21.15.47:0/1364779286 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99801f830 con 0x55d34f45c1e0 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd988ff9640 1 -- 172.21.15.47:0/1364779286 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7fd99801f9d0 con 0x55d34f45c1e0 2024-07-24T22:14:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.389+0000 7fd9aa56c740 1 -- 172.21.15.47:0/1364779286 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd99c0cd520 con 0x55d34f45c1e0 2024-07-24T22:14:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.390+0000 7fd988ff9640 1 -- 172.21.15.47:0/1364779286 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd99801fbd0 con 0x55d34f45c1e0 2024-07-24T22:14:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.390+0000 7fd9aa56c740 10 client.17112 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.390+0000 7fd9aa56c740 1 -- 172.21.15.47:0/1364779286 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d34f4e23e0 con 0x55d34f45c1e0 2024-07-24T22:14:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.390+0000 7fd988ff9640 1 -- 172.21.15.47:0/1364779286 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd99c0cd520 con 0x55d34f45c1e0 2024-07-24T22:14:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.390+0000 7fd988ff9640 1 -- 172.21.15.47:0/1364779286 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd99800f040 con 0x55d34f45c1e0 2024-07-24T22:14:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.390+0000 7fd9aa56c740 10 client.17112 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.390+0000 7fd9aa56c740 10 client.17112 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.390+0000 7fd9aa56c740 20 client.17112 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.390+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/1364779286 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d34f468170 0x55d34f4e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.390+0000 7fd9aa56c740 4 client.17112 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:14:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.390+0000 7fd9aa56c740 1 -- 172.21.15.47:0/1364779286 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d34f3cec70 con 0x55d34f468170 2024-07-24T22:14:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.390+0000 7fd9a55ad640 1 --2- 172.21.15.47:0/1364779286 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d34f468170 0x55d34f4e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:31.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.391+0000 7fd988ff9640 10 client.17112 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:31.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.391+0000 7fd9a55ad640 1 --2- 172.21.15.47:0/1364779286 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d34f468170 0x55d34f4e4c00 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e268de9f1c63168 server_cookie=53d0d171158aba3c in_seq=0 out_seq=0 2024-07-24T22:14:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd988ff9640 1 -- 172.21.15.47:0/1364779286 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d34f3cec70 con 0x55d34f468170 2024-07-24T22:14:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd988ff9640 10 client.17112 handle_command_reply: tid=0 2024-07-24T22:14:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd9aa56c740 1 client.17112 shutdown 2024-07-24T22:14:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd9aa56c740 1 -- 172.21.15.47:0/1364779286 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45c1e0 msgr2=0x55d34f46ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/1364779286 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45c1e0 0x55d34f46ba50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd9980124d0 tx=0x7fd998004730 comp rx=0 tx=0).stop 2024-07-24T22:14:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd9aa56c740 1 -- 172.21.15.47:0/1364779286 shutdown_connections 2024-07-24T22:14:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/1364779286 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d34f468170 0x55d34f4e4c00 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/1364779286 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d34f45c1e0 0x55d34f46ba50 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/1364779286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d34f45b8c0 0x55d34f470980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd988ff9640 0 client.17112 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd9aa56c740 1 --2- 172.21.15.47:0/1364779286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d34f4596f0 0x55d34f470400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd9aa56c740 1 -- 172.21.15.47:0/1364779286 >> 172.21.15.47:0/1364779286 conn(0x55d34f467960 msgr2=0x55d34f457f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd9aa56c740 1 -- 172.21.15.47:0/1364779286 shutdown_connections 2024-07-24T22:14:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.397+0000 7fd9aa56c740 1 -- 172.21.15.47:0/1364779286 wait complete. 2024-07-24T22:14:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.398+0000 7fd9aa56c740 20 client.17112 trim_cache size 0 max 16384 2024-07-24T22:14:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:14:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:14:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:14:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:14:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.398+0000 7fd9a7811640 1 -- 172.21.15.47:0/460590254 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd98c0b3dc0 msgr2=0x7fd98c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.398+0000 7fd9a7811640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd98c0b3dc0 0x7fd98c0b6280 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd99800cc00 tx=0x7fd99800c5e0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.398+0000 7fd9a7811640 1 -- 172.21.15.47:0/460590254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9a01015d0 msgr2=0x7fd9a01969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.398+0000 7fd9a7811640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9a01015d0 0x7fd9a01969f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd99c005e30 tx=0x7fd99c038b30 comp rx=0 tx=0).stop 2024-07-24T22:14:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.398+0000 7fd9a7811640 1 -- 172.21.15.47:0/460590254 shutdown_connections 2024-07-24T22:14:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.398+0000 7fd9a7811640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd98c0b3dc0 0x7fd98c0b6280 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.398+0000 7fd9a7811640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9a0107950 0x7fd9a019c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.398+0000 7fd9a7811640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9a0106fd0 0x7fd9a0196f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.398+0000 7fd9a7811640 1 --2- 172.21.15.47:0/460590254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9a01015d0 0x7fd9a01969f0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.398+0000 7fd9a7811640 1 -- 172.21.15.47:0/460590254 >> 172.21.15.47:0/460590254 conn(0x7fd9a00fd030 msgr2=0x7fd9a00fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.398+0000 7fd9a7811640 1 -- 172.21.15.47:0/460590254 shutdown_connections 2024-07-24T22:14:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:31.398+0000 7fd9a7811640 1 -- 172.21.15.47:0/460590254 wait complete. 2024-07-24T22:14:31.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:31 smithi183 ceph-mon[37007]: pgmap v589: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:14:31.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:31 smithi047 ceph-mon[32551]: pgmap v589: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:14:31.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:31 smithi188 ceph-mon[37380]: pgmap v589: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:14:33.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:33 smithi183 ceph-mon[37007]: pgmap v590: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 3 op/s 2024-07-24T22:14:33.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:33 smithi047 ceph-mon[32551]: pgmap v590: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 3 op/s 2024-07-24T22:14:33.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:33 smithi188 ceph-mon[37380]: pgmap v590: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 3 op/s 2024-07-24T22:14:35.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:35 smithi183 ceph-mon[37007]: pgmap v591: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:14:35.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:35 smithi047 ceph-mon[32551]: pgmap v591: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:14:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:35 smithi188 ceph-mon[37380]: pgmap v591: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:14:37.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:37 smithi183 ceph-mon[37007]: pgmap v592: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:37.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:37 smithi047 ceph-mon[32551]: pgmap v592: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:37.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:37 smithi188 ceph-mon[37380]: pgmap v592: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:39.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:39 smithi183 ceph-mon[37007]: pgmap v593: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:39.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:39 smithi047 ceph-mon[32551]: pgmap v593: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:39.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:39 smithi188 ceph-mon[37380]: pgmap v593: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:41 smithi183 ceph-mon[37007]: pgmap v594: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:41 smithi047 ceph-mon[32551]: pgmap v594: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:41.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:41 smithi188 ceph-mon[37380]: pgmap v594: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:43.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:43 smithi183 ceph-mon[37007]: pgmap v595: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:43.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:43 smithi047 ceph-mon[32551]: pgmap v595: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:43.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:43 smithi188 ceph-mon[37380]: pgmap v595: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:44.424 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:14:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.505+0000 7fb21a7fa640 1 -- 172.21.15.47:0/4249277013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2141015e0 msgr2=0x7fb2141019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.505+0000 7fb21a7fa640 1 --2- 172.21.15.47:0/4249277013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2141015e0 0x7fb2141019c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb204009900 tx=0x7fb20402a410 comp rx=0 tx=0).stop 2024-07-24T22:14:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.505+0000 7fb21a7fa640 1 -- 172.21.15.47:0/4249277013 shutdown_connections 2024-07-24T22:14:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.505+0000 7fb21a7fa640 1 --2- 172.21.15.47:0/4249277013 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb214107910 0x7fb21410e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.505+0000 7fb21a7fa640 1 --2- 172.21.15.47:0/4249277013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb214106f90 0x7fb2141073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.505+0000 7fb21a7fa640 1 --2- 172.21.15.47:0/4249277013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2141015e0 0x7fb2141019c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.505+0000 7fb21a7fa640 1 -- 172.21.15.47:0/4249277013 >> 172.21.15.47:0/4249277013 conn(0x7fb2140782e0 msgr2=0x7fb2140ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.505+0000 7fb21a7fa640 1 -- 172.21.15.47:0/4249277013 shutdown_connections 2024-07-24T22:14:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.505+0000 7fb21a7fa640 1 -- 172.21.15.47:0/4249277013 wait complete. 2024-07-24T22:14:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.505+0000 7fb21a7fa640 1 Processor -- start 2024-07-24T22:14:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.505+0000 7fb21a7fa640 1 -- start start 2024-07-24T22:14:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.506+0000 7fb21a7fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2141015e0 0x7fb214198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.506+0000 7fb21a7fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb214106f90 0x7fb214199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.506+0000 7fb21a7fa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb214107910 0x7fb21419e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.506+0000 7fb21a7fa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb214111560 con 0x7fb214107910 2024-07-24T22:14:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.506+0000 7fb21a7fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141113e0 con 0x7fb2141015e0 2024-07-24T22:14:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.506+0000 7fb21a7fa640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141116e0 con 0x7fb214106f90 2024-07-24T22:14:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.506+0000 7fb218d97640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb214107910 0x7fb21419e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.506+0000 7fb218d97640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb214107910 0x7fb21419e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36860/0 (socket says 172.21.15.47:36860) 2024-07-24T22:14:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.506+0000 7fb218d97640 1 -- 172.21.15.47:0/985632335 learned_addr learned my addr 172.21.15.47:0/985632335 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.506+0000 7fb213fff640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2141015e0 0x7fb214198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.506+0000 7fb2137fe640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb214106f90 0x7fb214199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.507+0000 7fb218d97640 1 -- 172.21.15.47:0/985632335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb214106f90 msgr2=0x7fb214199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.507+0000 7fb218d97640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb214106f90 0x7fb214199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.507+0000 7fb218d97640 1 -- 172.21.15.47:0/985632335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2141015e0 msgr2=0x7fb214198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.507+0000 7fb218d97640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2141015e0 0x7fb214198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.507+0000 7fb218d97640 1 -- 172.21.15.47:0/985632335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21419eca0 con 0x7fb214107910 2024-07-24T22:14:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.507+0000 7fb218d97640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb214107910 0x7fb21419e4d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00e970 tx=0x7fb1fc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.507+0000 7fb2117fa640 1 -- 172.21.15.47:0/985632335 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00ccc0 con 0x7fb214107910 2024-07-24T22:14:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.507+0000 7fb21a7fa640 1 -- 172.21.15.47:0/985632335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21419ef90 con 0x7fb214107910 2024-07-24T22:14:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.507+0000 7fb2117fa640 1 -- 172.21.15.47:0/985632335 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1fc00ce60 con 0x7fb214107910 2024-07-24T22:14:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.507+0000 7fb2117fa640 1 -- 172.21.15.47:0/985632335 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc010430 con 0x7fb214107910 2024-07-24T22:14:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.507+0000 7fb21a7fa640 1 -- 172.21.15.47:0/985632335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2141a5650 con 0x7fb214107910 2024-07-24T22:14:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.510+0000 7fb21d62c740 1 Processor -- start 2024-07-24T22:14:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.510+0000 7fb2117fa640 1 -- 172.21.15.47:0/985632335 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fb1fc004f90 con 0x7fb214107910 2024-07-24T22:14:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.510+0000 7fb21d62c740 1 -- start start 2024-07-24T22:14:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.510+0000 7fb21d62c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f8092c90 0x55a9f8093070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.510+0000 7fb21d62c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 0x55a9f809f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.510+0000 7fb21d62c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f809f540 0x55a9f80a1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb21d62c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a9f8008280 con 0x55a9f80935b0 2024-07-24T22:14:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb21d62c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a9f7ff7780 con 0x55a9f809f540 2024-07-24T22:14:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb21d62c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a9f7ffb7c0 con 0x55a9f8092c90 2024-07-24T22:14:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb213fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 0x55a9f809f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb213fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 0x55a9f809f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36872/0 (socket says 172.21.15.47:36872) 2024-07-24T22:14:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb213fff640 1 -- 172.21.15.47:0/1935810370 learned_addr learned my addr 172.21.15.47:0/1935810370 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb2137fe640 1 --2- 172.21.15.47:0/1935810370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f8092c90 0x55a9f8093070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb213fff640 1 -- 172.21.15.47:0/1935810370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f8092c90 msgr2=0x55a9f8093070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb213fff640 1 --2- 172.21.15.47:0/1935810370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f8092c90 0x55a9f8093070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb213fff640 1 -- 172.21.15.47:0/1935810370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f809f540 msgr2=0x55a9f80a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb213fff640 1 --2- 172.21.15.47:0/1935810370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f809f540 0x55a9f80a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb213fff640 1 -- 172.21.15.47:0/1935810370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9f7d5b790 con 0x55a9f80935b0 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb2137fe640 1 --2- 172.21.15.47:0/1935810370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f8092c90 0x55a9f8093070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb2117fa640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb2000b3d40 0x7fb2000b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb213fff640 1 --2- 172.21.15.47:0/1935810370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 0x55a9f809f000 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb204009900 tx=0x7fb204032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e89bcefef812701 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb2137fe640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb2000b3d40 0x7fb2000b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb2117fa640 1 -- 172.21.15.47:0/985632335 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7fb1fc0e43f0 con 0x7fb214107910 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.511+0000 7fb20a7fc640 1 -- 172.21.15.47:0/1935810370 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204040070 con 0x55a9f80935b0 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.512+0000 7fb20a7fc640 1 -- 172.21.15.47:0/1935810370 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb204004030 con 0x55a9f80935b0 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.512+0000 7fb20a7fc640 1 -- 172.21.15.47:0/1935810370 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204035040 con 0x55a9f80935b0 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.512+0000 7fb21d62c740 1 -- 172.21.15.47:0/1935810370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 msgr2=0x55a9f809f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.512+0000 7fb2137fe640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb2000b3d40 0x7fb2000b6200 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb2141034a0 tx=0x7fb20c009c90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.512+0000 7fb21d62c740 1 --2- 172.21.15.47:0/1935810370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 0x55a9f809f000 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb204009900 tx=0x7fb204032b20 comp rx=0 tx=0).stop 2024-07-24T22:14:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.512+0000 7fb21d62c740 1 -- 172.21.15.47:0/1935810370 shutdown_connections 2024-07-24T22:14:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.512+0000 7fb21d62c740 1 --2- 172.21.15.47:0/1935810370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f809f540 0x55a9f80a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.512+0000 7fb21d62c740 1 --2- 172.21.15.47:0/1935810370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 0x55a9f809f000 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.512+0000 7fb21d62c740 1 --2- 172.21.15.47:0/1935810370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f8092c90 0x55a9f8093070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.512+0000 7fb21d62c740 1 -- 172.21.15.47:0/1935810370 >> 172.21.15.47:0/1935810370 conn(0x55a9f8090ac0 msgr2=0x55a9f8091c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.512+0000 7fb21d62c740 1 -- 172.21.15.47:0/1935810370 shutdown_connections 2024-07-24T22:14:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.513+0000 7fb21d62c740 1 -- 172.21.15.47:0/1935810370 wait complete. 2024-07-24T22:14:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.513+0000 7fb21d62c740 1 -- start start 2024-07-24T22:14:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.513+0000 7fb21d62c740 1 Processor -- start 2024-07-24T22:14:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.513+0000 7fb21d62c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f8092c90 0x55a9f809ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.513+0000 7fb21d62c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 0x55a9f809c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.513+0000 7fb21d62c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f809f540 0x55a9f809c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.513+0000 7fb21d62c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a9f7f31ab0 con 0x55a9f80935b0 2024-07-24T22:14:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.513+0000 7fb21d62c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a9f7f7f9e0 con 0x55a9f8092c90 2024-07-24T22:14:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.513+0000 7fb21d62c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a9f80a21c0 con 0x55a9f809f540 2024-07-24T22:14:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.513+0000 7fb21d62c740 10 client.0 _ll_register_callbacks cb 0x55a9f7d07a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb2137fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 0x55a9f809c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb2137fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 0x55a9f809c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36878/0 (socket says 172.21.15.47:36878) 2024-07-24T22:14:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb2137fe640 1 -- 172.21.15.47:0/3766389910 learned_addr learned my addr 172.21.15.47:0/3766389910 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb213fff640 1 --2- 172.21.15.47:0/3766389910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f8092c90 0x55a9f809ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb218d97640 1 --2- 172.21.15.47:0/3766389910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f809f540 0x55a9f809c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb2137fe640 1 -- 172.21.15.47:0/3766389910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f809f540 msgr2=0x55a9f809c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb2137fe640 1 --2- 172.21.15.47:0/3766389910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f809f540 0x55a9f809c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb2137fe640 1 -- 172.21.15.47:0/3766389910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f8092c90 msgr2=0x55a9f809ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb2137fe640 1 --2- 172.21.15.47:0/3766389910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f8092c90 0x55a9f809ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb2137fe640 1 -- 172.21.15.47:0/3766389910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9f7dd4620 con 0x55a9f80935b0 2024-07-24T22:14:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb2137fe640 1 --2- 172.21.15.47:0/3766389910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 0x55a9f809c140 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00fa70 tx=0x7fb20c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f116df74664c86 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb1f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb1f37fe640 1 -- 172.21.15.47:0/3766389910 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c02b060 con 0x55a9f80935b0 2024-07-24T22:14:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb1f37fe640 1 -- 172.21.15.47:0/3766389910 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7fb20c016070 con 0x55a9f80935b0 2024-07-24T22:14:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.514+0000 7fb21d62c740 1 -- 172.21.15.47:0/3766389910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a9f7fa6ce0 con 0x55a9f80935b0 2024-07-24T22:14:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.515+0000 7fb1f37fe640 1 -- 172.21.15.47:0/3766389910 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb20c01eb10 con 0x55a9f80935b0 2024-07-24T22:14:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.515+0000 7fb21d62c740 10 client.17124 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.515+0000 7fb21d62c740 1 -- 172.21.15.47:0/3766389910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a9f80ad8f0 con 0x55a9f80935b0 2024-07-24T22:14:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.515+0000 7fb1f37fe640 1 -- 172.21.15.47:0/3766389910 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a9f7fa6ce0 con 0x55a9f80935b0 2024-07-24T22:14:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.515+0000 7fb1f37fe640 1 -- 172.21.15.47:0/3766389910 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb20c026410 con 0x55a9f80935b0 2024-07-24T22:14:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.515+0000 7fb21d62c740 10 client.17124 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.515+0000 7fb21d62c740 10 client.17124 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.515+0000 7fb21d62c740 20 client.17124 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.515+0000 7fb21d62c740 1 --2- 172.21.15.47:0/3766389910 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9f80aee50 0x55a9f80b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.515+0000 7fb21d62c740 4 client.17124 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.515+0000 7fb21d62c740 1 -- 172.21.15.47:0/3766389910 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9f800a1d0 con 0x55a9f80aee50 2024-07-24T22:14:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.516+0000 7fb213fff640 1 --2- 172.21.15.47:0/3766389910 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9f80aee50 0x55a9f80b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.516+0000 7fb1f37fe640 10 client.17124 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.516+0000 7fb213fff640 1 --2- 172.21.15.47:0/3766389910 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9f80aee50 0x55a9f80b1240 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2652b25d656b5c2 server_cookie=3144b14a649514df in_seq=0 out_seq=0 2024-07-24T22:14:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb1f37fe640 1 -- 172.21.15.47:0/3766389910 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9f800a1d0 con 0x55a9f80aee50 2024-07-24T22:14:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb1f37fe640 10 client.17124 handle_command_reply: tid=0 2024-07-24T22:14:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb21d62c740 1 client.17124 shutdown 2024-07-24T22:14:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb21d62c740 1 -- 172.21.15.47:0/3766389910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 msgr2=0x55a9f809c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb21d62c740 1 --2- 172.21.15.47:0/3766389910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 0x55a9f809c140 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00fa70 tx=0x7fb20c009500 comp rx=0 tx=0).stop 2024-07-24T22:14:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb21d62c740 1 -- 172.21.15.47:0/3766389910 shutdown_connections 2024-07-24T22:14:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb21d62c740 1 --2- 172.21.15.47:0/3766389910 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9f80aee50 0x55a9f80b1240 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb21d62c740 1 --2- 172.21.15.47:0/3766389910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f809f540 0x55a9f809c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb21d62c740 1 --2- 172.21.15.47:0/3766389910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f80935b0 0x55a9f809c140 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb21d62c740 1 --2- 172.21.15.47:0/3766389910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f8092c90 0x55a9f809ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb21d62c740 1 -- 172.21.15.47:0/3766389910 >> 172.21.15.47:0/3766389910 conn(0x55a9f8090ac0 msgr2=0x55a9f8096660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb1f37fe640 0 client.17124 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb21d62c740 1 -- 172.21.15.47:0/3766389910 shutdown_connections 2024-07-24T22:14:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb21d62c740 1 -- 172.21.15.47:0/3766389910 wait complete. 2024-07-24T22:14:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.517+0000 7fb21d62c740 20 client.17124 trim_cache size 0 max 16384 2024-07-24T22:14:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb21d62c740 1 Processor -- start 2024-07-24T22:14:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb21d62c740 1 -- start start 2024-07-24T22:14:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb21d62c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f8092c90 0x55a9f80ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb21d62c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f80935b0 0x55a9f80b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb21d62c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f809f540 0x55a9f80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb21d62c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141ac1b0 con 0x55a9f8092c90 2024-07-24T22:14:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb21d62c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141aea10 con 0x55a9f80935b0 2024-07-24T22:14:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb21d62c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141ac800 con 0x55a9f809f540 2024-07-24T22:14:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb213fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f8092c90 0x55a9f80ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb213fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f8092c90 0x55a9f80ab2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36888/0 (socket says 172.21.15.47:36888) 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb213fff640 1 -- 172.21.15.47:0/3082177875 learned_addr learned my addr 172.21.15.47:0/3082177875 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb2137fe640 1 --2- 172.21.15.47:0/3082177875 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f80935b0 0x55a9f80b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb218d97640 1 --2- 172.21.15.47:0/3082177875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f809f540 0x55a9f80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb213fff640 1 -- 172.21.15.47:0/3082177875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f809f540 msgr2=0x55a9f80b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.533+0000 7fb213fff640 1 --2- 172.21.15.47:0/3082177875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f809f540 0x55a9f80b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.534+0000 7fb213fff640 1 -- 172.21.15.47:0/3082177875 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f80935b0 msgr2=0x55a9f80b6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.534+0000 7fb213fff640 1 --2- 172.21.15.47:0/3082177875 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f80935b0 0x55a9f80b6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.534+0000 7fb213fff640 1 -- 172.21.15.47:0/3082177875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9f808c380 con 0x55a9f8092c90 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.534+0000 7fb218d97640 1 --2- 172.21.15.47:0/3082177875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f809f540 0x55a9f80b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.534+0000 7fb213fff640 1 --2- 172.21.15.47:0/3082177875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f8092c90 0x55a9f80ab2e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fb204009900 tx=0x7fb204000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5c9195c5424891 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.534+0000 7fb209ffb640 1 -- 172.21.15.47:0/3082177875 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204035040 con 0x55a9f8092c90 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.534+0000 7fb209ffb640 1 -- 172.21.15.47:0/3082177875 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2040314a0 con 0x55a9f8092c90 2024-07-24T22:14:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.534+0000 7fb209ffb640 1 -- 172.21.15.47:0/3082177875 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204040040 con 0x55a9f8092c90 2024-07-24T22:14:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.535+0000 7fb21d62c740 1 -- 172.21.15.47:0/3082177875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f8092c90 msgr2=0x55a9f80ab2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.535+0000 7fb21d62c740 1 --2- 172.21.15.47:0/3082177875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f8092c90 0x55a9f80ab2e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fb204009900 tx=0x7fb204000bc0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.535+0000 7fb21d62c740 1 -- 172.21.15.47:0/3082177875 shutdown_connections 2024-07-24T22:14:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.535+0000 7fb21d62c740 1 --2- 172.21.15.47:0/3082177875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f809f540 0x55a9f80b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.535+0000 7fb21d62c740 1 --2- 172.21.15.47:0/3082177875 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f80935b0 0x55a9f80b6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.535+0000 7fb21d62c740 1 --2- 172.21.15.47:0/3082177875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f8092c90 0x55a9f80ab2e0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.535+0000 7fb21d62c740 1 -- 172.21.15.47:0/3082177875 >> 172.21.15.47:0/3082177875 conn(0x55a9f8090ac0 msgr2=0x55a9f809a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.535+0000 7fb21d62c740 1 -- 172.21.15.47:0/3082177875 shutdown_connections 2024-07-24T22:14:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.535+0000 7fb21d62c740 1 -- 172.21.15.47:0/3082177875 wait complete. 2024-07-24T22:14:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.535+0000 7fb21d62c740 1 -- start start 2024-07-24T22:14:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.535+0000 7fb21d62c740 1 Processor -- start 2024-07-24T22:14:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb21d62c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f8092c90 0x55a9f80a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb21d62c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f80935b0 0x55a9f80a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb21d62c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f809f540 0x55a9f8110c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb21d62c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141aced0 con 0x55a9f809f540 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb21d62c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141ae340 con 0x55a9f8092c90 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb21d62c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141ad5a0 con 0x55a9f80935b0 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb21d62c740 10 client.0 _ll_register_callbacks cb 0x7fb20c00f3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb218d97640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f809f540 0x55a9f8110c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb213fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f8092c90 0x55a9f80a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb213fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f8092c90 0x55a9f80a3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:57632/0 (socket says 172.21.15.47:57632) 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb213fff640 1 -- 172.21.15.47:0/2602949246 learned_addr learned my addr 172.21.15.47:0/2602949246 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb2137fe640 1 --2- 172.21.15.47:0/2602949246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f80935b0 0x55a9f80a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb213fff640 1 -- 172.21.15.47:0/2602949246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f80935b0 msgr2=0x55a9f80a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb213fff640 1 --2- 172.21.15.47:0/2602949246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f80935b0 0x55a9f80a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb213fff640 1 -- 172.21.15.47:0/2602949246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f809f540 msgr2=0x55a9f8110c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb213fff640 1 --2- 172.21.15.47:0/2602949246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f809f540 0x55a9f8110c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb213fff640 1 -- 172.21.15.47:0/2602949246 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9f8111390 con 0x55a9f8092c90 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb213fff640 1 --2- 172.21.15.47:0/2602949246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f8092c90 0x55a9f80a3e20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb2040043d0 tx=0x7fb2040095a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5f9a1fa580fd05b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.536+0000 7fb1f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb1f37fe640 1 -- 172.21.15.47:0/2602949246 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204040040 con 0x55a9f8092c90 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb1f37fe640 1 -- 172.21.15.47:0/2602949246 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7fb204004040 con 0x55a9f8092c90 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb21d62c740 1 -- 172.21.15.47:0/2602949246 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2040314a0 con 0x55a9f8092c90 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb1f37fe640 1 -- 172.21.15.47:0/2602949246 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb204065050 con 0x55a9f8092c90 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb21d62c740 10 client.26342 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb21d62c740 1 -- 172.21.15.47:0/2602949246 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a9f8118820 con 0x55a9f8092c90 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb1f37fe640 1 -- 172.21.15.47:0/2602949246 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2040314a0 con 0x55a9f8092c90 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb1f37fe640 1 -- 172.21.15.47:0/2602949246 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb204060030 con 0x55a9f8092c90 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb21d62c740 10 client.26342 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb21d62c740 10 client.26342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb21d62c740 20 client.26342 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb21d62c740 1 --2- 172.21.15.47:0/2602949246 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9f8118b60 0x55a9f811af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb21d62c740 4 client.26342 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:14:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.537+0000 7fb21d62c740 1 -- 172.21.15.47:0/2602949246 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a9f8005c70 con 0x55a9f8118b60 2024-07-24T22:14:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.538+0000 7fb2137fe640 1 --2- 172.21.15.47:0/2602949246 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9f8118b60 0x55a9f811af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.538+0000 7fb1f37fe640 10 client.26342 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.538+0000 7fb2137fe640 1 --2- 172.21.15.47:0/2602949246 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9f8118b60 0x55a9f811af50 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e57384547036d4 server_cookie=9c8bbab0c0eef649 in_seq=0 out_seq=0 2024-07-24T22:14:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb1f37fe640 1 -- 172.21.15.47:0/2602949246 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a9f8005c70 con 0x55a9f8118b60 2024-07-24T22:14:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb1f37fe640 10 client.26342 handle_command_reply: tid=0 2024-07-24T22:14:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb21d62c740 1 client.26342 shutdown 2024-07-24T22:14:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb21d62c740 1 -- 172.21.15.47:0/2602949246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f8092c90 msgr2=0x55a9f80a3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb21d62c740 1 --2- 172.21.15.47:0/2602949246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f8092c90 0x55a9f80a3e20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb2040043d0 tx=0x7fb2040095a0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb21d62c740 1 -- 172.21.15.47:0/2602949246 shutdown_connections 2024-07-24T22:14:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb21d62c740 1 --2- 172.21.15.47:0/2602949246 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9f8118b60 0x55a9f811af50 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb21d62c740 1 --2- 172.21.15.47:0/2602949246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9f809f540 0x55a9f8110c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb21d62c740 1 --2- 172.21.15.47:0/2602949246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9f80935b0 0x55a9f80a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb21d62c740 1 --2- 172.21.15.47:0/2602949246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9f8092c90 0x55a9f80a3e20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb1f37fe640 0 client.26342 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb21d62c740 1 -- 172.21.15.47:0/2602949246 >> 172.21.15.47:0/2602949246 conn(0x55a9f8090ac0 msgr2=0x55a9f809ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb21d62c740 1 -- 172.21.15.47:0/2602949246 shutdown_connections 2024-07-24T22:14:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb21d62c740 1 -- 172.21.15.47:0/2602949246 wait complete. 2024-07-24T22:14:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.544+0000 7fb21d62c740 20 client.26342 trim_cache size 0 max 16384 2024-07-24T22:14:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:14:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:14:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:14:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:14:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.545+0000 7fb21a7fa640 1 -- 172.21.15.47:0/985632335 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb2000b3d40 msgr2=0x7fb2000b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.545+0000 7fb21a7fa640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb2000b3d40 0x7fb2000b6200 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb2141034a0 tx=0x7fb20c009c90 comp rx=0 tx=0).stop 2024-07-24T22:14:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.545+0000 7fb21a7fa640 1 -- 172.21.15.47:0/985632335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb214107910 msgr2=0x7fb21419e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.545+0000 7fb21a7fa640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb214107910 0x7fb21419e4d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00e970 tx=0x7fb1fc00ed70 comp rx=0 tx=0).stop 2024-07-24T22:14:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.545+0000 7fb21a7fa640 1 -- 172.21.15.47:0/985632335 shutdown_connections 2024-07-24T22:14:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.545+0000 7fb21a7fa640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb2000b3d40 0x7fb2000b6200 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.545+0000 7fb21a7fa640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb214107910 0x7fb21419e4d0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.545+0000 7fb21a7fa640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb214106f90 0x7fb214199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.545+0000 7fb21a7fa640 1 --2- 172.21.15.47:0/985632335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2141015e0 0x7fb214198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.545+0000 7fb21a7fa640 1 -- 172.21.15.47:0/985632335 >> 172.21.15.47:0/985632335 conn(0x7fb2140782e0 msgr2=0x7fb214104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.545+0000 7fb21a7fa640 1 -- 172.21.15.47:0/985632335 shutdown_connections 2024-07-24T22:14:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:44.545+0000 7fb21a7fa640 1 -- 172.21.15.47:0/985632335 wait complete. 2024-07-24T22:14:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:14:45.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:45 smithi047 ceph-mon[32551]: pgmap v596: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:14:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:45 smithi183 ceph-mon[37007]: pgmap v596: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:14:45.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:45 smithi188 ceph-mon[37380]: pgmap v596: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:14:46.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.428+0000 7f8590937640 1 -- 172.21.15.47:0/171544175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f858c1081a0 msgr2=0x7f858c1085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:46.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.428+0000 7f8590937640 1 --2- 172.21.15.47:0/171544175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f858c1081a0 0x7f858c1085e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8580009900 tx=0x7f858002a410 comp rx=0 tx=0).stop 2024-07-24T22:14:46.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.429+0000 7f8590937640 1 -- 172.21.15.47:0/171544175 shutdown_connections 2024-07-24T22:14:46.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.429+0000 7f8590937640 1 --2- 172.21.15.47:0/171544175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f858c108b20 0x7f858c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.429+0000 7f8590937640 1 --2- 172.21.15.47:0/171544175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f858c1081a0 0x7f858c1085e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.429+0000 7f8590937640 1 --2- 172.21.15.47:0/171544175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f858c102790 0x7f858c102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.429+0000 7f8590937640 1 -- 172.21.15.47:0/171544175 >> 172.21.15.47:0/171544175 conn(0x7f858c0fe200 msgr2=0x7f858c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.429+0000 7f8590937640 1 -- 172.21.15.47:0/171544175 shutdown_connections 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.429+0000 7f8590937640 1 -- 172.21.15.47:0/171544175 wait complete. 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.429+0000 7f8590937640 1 Processor -- start 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.429+0000 7f8590937640 1 -- start start 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8590937640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f858c102790 0x7f858c074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8590937640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f858c1081a0 0x7f858c0753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8590937640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f858c108b20 0x7f858c075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8590937640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f858c1127b0 con 0x7f858c1081a0 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8590937640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f858c112630 con 0x7f858c102790 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8590937640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f858c112930 con 0x7f858c108b20 2024-07-24T22:14:46.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8589d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f858c1081a0 0x7f858c0753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f858a59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f858c102790 0x7f858c074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8589d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f858c1081a0 0x7f858c0753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49504/0 (socket says 172.21.15.47:49504) 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8589d9b640 1 -- 172.21.15.47:0/1763316572 learned_addr learned my addr 172.21.15.47:0/1763316572 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f858ad9d640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f858c108b20 0x7f858c075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8589d9b640 1 -- 172.21.15.47:0/1763316572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f858c108b20 msgr2=0x7f858c075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8589d9b640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f858c108b20 0x7f858c075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8589d9b640 1 -- 172.21.15.47:0/1763316572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f858c102790 msgr2=0x7f858c074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8589d9b640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f858c102790 0x7f858c074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f8589d9b640 1 -- 172.21.15.47:0/1763316572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c1a70a0 con 0x7f858c1081a0 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.430+0000 7f858a59c640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f858c102790 0x7f858c074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.431+0000 7f8589d9b640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f858c1081a0 0x7f858c0753d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8580006010 tx=0x7f85800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.431+0000 7f857b7fe640 1 -- 172.21.15.47:0/1763316572 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858003f030 con 0x7f858c1081a0 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.431+0000 7f857b7fe640 1 -- 172.21.15.47:0/1763316572 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8580003800 con 0x7f858c1081a0 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.431+0000 7f8590937640 1 -- 172.21.15.47:0/1763316572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858c1a7330 con 0x7f858c1081a0 2024-07-24T22:14:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.431+0000 7f857b7fe640 1 -- 172.21.15.47:0/1763316572 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580035070 con 0x7f858c1081a0 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.431+0000 7f8590937640 1 -- 172.21.15.47:0/1763316572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858c1a7890 con 0x7f858c1081a0 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.433+0000 7f8592ce8740 1 Processor -- start 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.433+0000 7f857b7fe640 1 -- 172.21.15.47:0/1763316572 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8580003cb0 con 0x7f858c1081a0 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.434+0000 7f8592ce8740 1 -- start start 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.434+0000 7f8592ce8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903eceea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.434+0000 7f8592ce8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecfa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.434+0000 7f8592ce8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecfd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.434+0000 7f8592ce8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55903ec65960 con 0x55903ecfaf30 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.434+0000 7f8592ce8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55903ec54e60 con 0x55903eceefa0 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.434+0000 7f8592ce8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55903ec58ea0 con 0x55903ecee680 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.434+0000 7f8589d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecfd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.434+0000 7f858a59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecfa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.434+0000 7f858a59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecfa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:60336/0 (socket says 172.21.15.47:60336) 2024-07-24T22:14:46.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.434+0000 7f858a59c640 1 -- 172.21.15.47:0/2916483024 learned_addr learned my addr 172.21.15.47:0/2916483024 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.434+0000 7f858ad9d640 1 --2- 172.21.15.47:0/2916483024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903eceea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.435+0000 7f858a59c640 1 -- 172.21.15.47:0/2916483024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 msgr2=0x55903eceea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.435+0000 7f858a59c640 1 --2- 172.21.15.47:0/2916483024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903eceea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.435+0000 7f857b7fe640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f85740b3d40 0x7f85740b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.435+0000 7f858a59c640 1 -- 172.21.15.47:0/2916483024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 msgr2=0x55903ecfd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.435+0000 7f858a59c640 1 --2- 172.21.15.47:0/2916483024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecfd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.435+0000 7f858a59c640 1 -- 172.21.15.47:0/2916483024 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55903ebde2d0 con 0x55903eceefa0 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.435+0000 7f858ad9d640 1 --2- 172.21.15.47:0/2916483024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903eceea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.435+0000 7f858ad9d640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f85740b3d40 0x7f85740b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.435+0000 7f857b7fe640 1 -- 172.21.15.47:0/1763316572 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f8580104900 con 0x7f858c1081a0 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.435+0000 7f858a59c640 1 --2- 172.21.15.47:0/2916483024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecfa9f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f857c009e70 tx=0x7f857c00e5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f16a8e724fb58e5e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.435+0000 7f8578ff9640 1 -- 172.21.15.47:0/2916483024 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c017070 con 0x55903eceefa0 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.435+0000 7f8578ff9640 1 -- 172.21.15.47:0/2916483024 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f857c013920 con 0x55903eceefa0 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.435+0000 7f8578ff9640 1 -- 172.21.15.47:0/2916483024 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c012850 con 0x55903eceefa0 2024-07-24T22:14:46.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.436+0000 7f8592ce8740 1 -- 172.21.15.47:0/2916483024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 msgr2=0x55903ecfa9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.436+0000 7f8592ce8740 1 --2- 172.21.15.47:0/2916483024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecfa9f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f857c009e70 tx=0x7f857c00e5a0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.436+0000 7f858ad9d640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f85740b3d40 0x7f85740b6200 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8584007310 tx=0x7f8584007520 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.436+0000 7f8592ce8740 1 -- 172.21.15.47:0/2916483024 shutdown_connections 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.436+0000 7f8592ce8740 1 --2- 172.21.15.47:0/2916483024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecfd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.436+0000 7f8592ce8740 1 --2- 172.21.15.47:0/2916483024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecfa9f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.436+0000 7f8592ce8740 1 --2- 172.21.15.47:0/2916483024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903eceea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.436+0000 7f8592ce8740 1 -- 172.21.15.47:0/2916483024 >> 172.21.15.47:0/2916483024 conn(0x55903ecec4b0 msgr2=0x55903eced650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.436+0000 7f8592ce8740 1 -- 172.21.15.47:0/2916483024 shutdown_connections 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.436+0000 7f8592ce8740 1 -- 172.21.15.47:0/2916483024 wait complete. 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.436+0000 7f8592ce8740 1 -- start start 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f8592ce8740 1 Processor -- start 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f8592ce8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903ecf7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f8592ce8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecf83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f8592ce8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecf88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f8592ce8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55903eab8700 con 0x55903ecfaf30 2024-07-24T22:14:46.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f8592ce8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55903ebf75a0 con 0x55903eceefa0 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f8592ce8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55903ecfdbb0 con 0x55903ecee680 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f8592ce8740 10 client.0 _ll_register_callbacks cb 0x55903ec17910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f858ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecf88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f858ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecf88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49522/0 (socket says 172.21.15.47:49522) 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f858ad9d640 1 -- 172.21.15.47:0/4137338918 learned_addr learned my addr 172.21.15.47:0/4137338918 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f8589d9b640 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecf83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f858a59c640 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903ecf7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f858ad9d640 1 -- 172.21.15.47:0/4137338918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 msgr2=0x55903ecf7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f858ad9d640 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903ecf7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f858ad9d640 1 -- 172.21.15.47:0/4137338918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 msgr2=0x55903ecf83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f858ad9d640 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecf83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f858ad9d640 1 -- 172.21.15.47:0/4137338918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55903ebea630 con 0x55903ecfaf30 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.437+0000 7f858a59c640 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903ecf7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:46.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f858ad9d640 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecf88f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f858400fe20 tx=0x7f8584004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89b82d650ea0dff server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8571ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8571ffb640 1 -- 172.21.15.47:0/4137338918 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8584022030 con 0x55903ecfaf30 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8571ffb640 1 -- 172.21.15.47:0/4137338918 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f8584003970 con 0x55903ecfaf30 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8592ce8740 1 -- 172.21.15.47:0/4137338918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f857c013920 con 0x55903ecfaf30 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8571ffb640 1 -- 172.21.15.47:0/4137338918 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f858402e050 con 0x55903ecfaf30 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8592ce8740 10 client.17142 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8592ce8740 1 -- 172.21.15.47:0/4137338918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55903e9b5650 con 0x55903ecfaf30 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8571ffb640 1 -- 172.21.15.47:0/4137338918 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f857c013920 con 0x55903ecfaf30 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8571ffb640 1 -- 172.21.15.47:0/4137338918 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f858401b050 con 0x55903ecfaf30 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8592ce8740 10 client.17142 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8592ce8740 10 client.17142 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8592ce8740 20 client.17142 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8592ce8740 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55903ed0aa40 0x55903ed0cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8592ce8740 4 client.17142 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.438+0000 7f8592ce8740 1 -- 172.21.15.47:0/4137338918 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55903ec678b0 con 0x55903ed0aa40 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.439+0000 7f858a59c640 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55903ed0aa40 0x55903ed0cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.439+0000 7f8571ffb640 10 client.17142 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.439+0000 7f858a59c640 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55903ed0aa40 0x55903ed0cec0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=893dbae7427e9417 server_cookie=e35f603e87d588ee in_seq=0 out_seq=0 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8571ffb640 1 -- 172.21.15.47:0/4137338918 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55903ec678b0 con 0x55903ed0aa40 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8571ffb640 10 client.17142 handle_command_reply: tid=0 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8592ce8740 1 client.17142 shutdown 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8592ce8740 1 -- 172.21.15.47:0/4137338918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 msgr2=0x55903ecf88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8592ce8740 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecf88f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f858400fe20 tx=0x7f8584004a40 comp rx=0 tx=0).stop 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8592ce8740 1 -- 172.21.15.47:0/4137338918 shutdown_connections 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8592ce8740 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55903ed0aa40 0x55903ed0cec0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8571ffb640 0 client.17142 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8592ce8740 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecf88f0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8592ce8740 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecf83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8592ce8740 1 --2- 172.21.15.47:0/4137338918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903ecf7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8592ce8740 1 -- 172.21.15.47:0/4137338918 >> 172.21.15.47:0/4137338918 conn(0x55903ecec4b0 msgr2=0x55903ecf2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:46.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8592ce8740 1 -- 172.21.15.47:0/4137338918 shutdown_connections 2024-07-24T22:14:46.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8592ce8740 1 -- 172.21.15.47:0/4137338918 wait complete. 2024-07-24T22:14:46.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.440+0000 7f8592ce8740 20 client.17142 trim_cache size 0 max 16384 2024-07-24T22:14:46.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.459+0000 7f8592ce8740 1 Processor -- start 2024-07-24T22:14:46.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.459+0000 7f8592ce8740 1 -- start start 2024-07-24T22:14:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.459+0000 7f8592ce8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecee680 0x55903ecf27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.459+0000 7f8592ce8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecf94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.459+0000 7f8592ce8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecfaf30 0x55903ed12790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.459+0000 7f8592ce8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f858c1ae410 con 0x55903ecee680 2024-07-24T22:14:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.459+0000 7f8592ce8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f858c1b0c70 con 0x55903eceefa0 2024-07-24T22:14:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.459+0000 7f8592ce8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f858c1aea60 con 0x55903ecfaf30 2024-07-24T22:14:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.460+0000 7f858a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecee680 0x55903ecf27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.460+0000 7f858a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecee680 0x55903ecf27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49524/0 (socket says 172.21.15.47:49524) 2024-07-24T22:14:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.460+0000 7f858a59c640 1 -- 172.21.15.47:0/3407982782 learned_addr learned my addr 172.21.15.47:0/3407982782 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.460+0000 7f8589d9b640 1 --2- 172.21.15.47:0/3407982782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecf94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.460+0000 7f858a59c640 1 -- 172.21.15.47:0/3407982782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecfaf30 msgr2=0x55903ed12790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.460+0000 7f858a59c640 1 --2- 172.21.15.47:0/3407982782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecfaf30 0x55903ed12790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.460+0000 7f858a59c640 1 -- 172.21.15.47:0/3407982782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 msgr2=0x55903ecf94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:46.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.460+0000 7f858a59c640 1 --2- 172.21.15.47:0/3407982782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecf94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.460+0000 7f858a59c640 1 -- 172.21.15.47:0/3407982782 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55903ecebe30 con 0x55903ecee680 2024-07-24T22:14:46.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.460+0000 7f858a59c640 1 --2- 172.21.15.47:0/3407982782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecee680 0x55903ecf27d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f857c026fd0 tx=0x7f857c015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef19288afd3fc30 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:46.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.460+0000 7f8573fff640 1 -- 172.21.15.47:0/3407982782 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c033020 con 0x55903ecee680 2024-07-24T22:14:46.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.460+0000 7f8573fff640 1 -- 172.21.15.47:0/3407982782 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f857c013cf0 con 0x55903ecee680 2024-07-24T22:14:46.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.460+0000 7f8573fff640 1 -- 172.21.15.47:0/3407982782 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c017040 con 0x55903ecee680 2024-07-24T22:14:46.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.461+0000 7f8592ce8740 1 -- 172.21.15.47:0/3407982782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecee680 msgr2=0x55903ecf27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:46.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.461+0000 7f8592ce8740 1 --2- 172.21.15.47:0/3407982782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecee680 0x55903ecf27d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f857c026fd0 tx=0x7f857c015040 comp rx=0 tx=0).stop 2024-07-24T22:14:46.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.461+0000 7f8592ce8740 1 -- 172.21.15.47:0/3407982782 shutdown_connections 2024-07-24T22:14:46.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.461+0000 7f8592ce8740 1 --2- 172.21.15.47:0/3407982782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecfaf30 0x55903ed12790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.461+0000 7f8592ce8740 1 --2- 172.21.15.47:0/3407982782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ecf94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.461+0000 7f8592ce8740 1 --2- 172.21.15.47:0/3407982782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecee680 0x55903ecf27d0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.461+0000 7f8592ce8740 1 -- 172.21.15.47:0/3407982782 >> 172.21.15.47:0/3407982782 conn(0x55903ecec4b0 msgr2=0x55903ecf8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:46.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.462+0000 7f8592ce8740 1 -- 172.21.15.47:0/3407982782 shutdown_connections 2024-07-24T22:14:46.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.462+0000 7f8592ce8740 1 -- 172.21.15.47:0/3407982782 wait complete. 2024-07-24T22:14:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.462+0000 7f8592ce8740 1 -- start start 2024-07-24T22:14:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.462+0000 7f8592ce8740 1 Processor -- start 2024-07-24T22:14:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.462+0000 7f8592ce8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903ed02e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.462+0000 7f8592ce8740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ed03380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.462+0000 7f8592ce8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecffe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.462+0000 7f8592ce8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f858c1af130 con 0x55903ecfaf30 2024-07-24T22:14:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.462+0000 7f8592ce8740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f858c1b05a0 con 0x55903eceefa0 2024-07-24T22:14:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.462+0000 7f8592ce8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f858c1af800 con 0x55903ecee680 2024-07-24T22:14:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.462+0000 7f8592ce8740 10 client.0 _ll_register_callbacks cb 0x7f8584007d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.462+0000 7f858ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f858ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecffe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49534/0 (socket says 172.21.15.47:49534) 2024-07-24T22:14:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f858ad9d640 1 -- 172.21.15.47:0/4259304274 learned_addr learned my addr 172.21.15.47:0/4259304274 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f858a59c640 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903ed02e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f8589d9b640 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ed03380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f858ad9d640 1 -- 172.21.15.47:0/4259304274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 msgr2=0x55903ed02e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f858ad9d640 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903ed02e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f858ad9d640 1 -- 172.21.15.47:0/4259304274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 msgr2=0x55903ed03380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f858ad9d640 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ed03380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f858ad9d640 1 -- 172.21.15.47:0/4259304274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55903ecf8d10 con 0x55903ecfaf30 2024-07-24T22:14:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f8589d9b640 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ed03380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f858ad9d640 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecffe10 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8584011d10 tx=0x7f858401e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f2ea671c2c36fa server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f8571ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f8571ffb640 1 -- 172.21.15.47:0/4259304274 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8584022070 con 0x55903ecfaf30 2024-07-24T22:14:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f8571ffb640 1 -- 172.21.15.47:0/4259304274 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f858401edd0 con 0x55903ecfaf30 2024-07-24T22:14:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f8592ce8740 1 -- 172.21.15.47:0/4259304274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f857c013cf0 con 0x55903ecfaf30 2024-07-24T22:14:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.463+0000 7f8571ffb640 1 -- 172.21.15.47:0/4259304274 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f858400ec10 con 0x55903ecfaf30 2024-07-24T22:14:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.464+0000 7f8592ce8740 10 client.17148 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.464+0000 7f8592ce8740 1 -- 172.21.15.47:0/4259304274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55903ecf3a40 con 0x55903ecfaf30 2024-07-24T22:14:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.464+0000 7f8571ffb640 1 -- 172.21.15.47:0/4259304274 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f857c013cf0 con 0x55903ecfaf30 2024-07-24T22:14:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.464+0000 7f8571ffb640 1 -- 172.21.15.47:0/4259304274 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f858401b070 con 0x55903ecfaf30 2024-07-24T22:14:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.464+0000 7f8592ce8740 10 client.17148 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.464+0000 7f8592ce8740 10 client.17148 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.464+0000 7f8592ce8740 20 client.17148 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.464+0000 7f8592ce8740 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55903ed0aa40 0x55903ed781d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.464+0000 7f8592ce8740 4 client.17148 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:14:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.464+0000 7f8592ce8740 1 -- 172.21.15.47:0/4259304274 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55903ec63350 con 0x55903ed0aa40 2024-07-24T22:14:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.464+0000 7f858a59c640 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55903ed0aa40 0x55903ed781d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f858a59c640 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55903ed0aa40 0x55903ed781d0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2d0eba719002a1 server_cookie=da667a22922265fc in_seq=0 out_seq=0 2024-07-24T22:14:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8571ffb640 10 client.17148 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:46.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8571ffb640 1 -- 172.21.15.47:0/4259304274 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55903ec63350 con 0x55903ed0aa40 2024-07-24T22:14:46.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8571ffb640 10 client.17148 handle_command_reply: tid=0 2024-07-24T22:14:46.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8592ce8740 1 client.17148 shutdown 2024-07-24T22:14:46.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8592ce8740 1 -- 172.21.15.47:0/4259304274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 msgr2=0x55903ecffe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:46.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8592ce8740 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecffe10 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8584011d10 tx=0x7f858401e8a0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8592ce8740 1 -- 172.21.15.47:0/4259304274 shutdown_connections 2024-07-24T22:14:46.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8592ce8740 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55903ed0aa40 0x55903ed781d0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8592ce8740 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55903ecfaf30 0x55903ecffe10 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8592ce8740 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55903eceefa0 0x55903ed03380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8571ffb640 0 client.17148 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8592ce8740 1 --2- 172.21.15.47:0/4259304274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55903ecee680 0x55903ed02e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8592ce8740 1 -- 172.21.15.47:0/4259304274 >> 172.21.15.47:0/4259304274 conn(0x55903ecec4b0 msgr2=0x55903ecead00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8592ce8740 1 -- 172.21.15.47:0/4259304274 shutdown_connections 2024-07-24T22:14:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.465+0000 7f8592ce8740 1 -- 172.21.15.47:0/4259304274 wait complete. 2024-07-24T22:14:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.466+0000 7f8592ce8740 20 client.17148 trim_cache size 0 max 16384 2024-07-24T22:14:46.473 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:14:46.473 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:14:46.474 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:14:46.474 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:14:46.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.466+0000 7f8590937640 1 -- 172.21.15.47:0/1763316572 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f85740b3d40 msgr2=0x7f85740b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:46.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.466+0000 7f8590937640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f85740b3d40 0x7f85740b6200 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8584007310 tx=0x7f8584007520 comp rx=0 tx=0).stop 2024-07-24T22:14:46.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.466+0000 7f8590937640 1 -- 172.21.15.47:0/1763316572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f858c1081a0 msgr2=0x7f858c0753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:46.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.466+0000 7f8590937640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f858c1081a0 0x7f858c0753d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8580006010 tx=0x7f85800042f0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.466+0000 7f8590937640 1 -- 172.21.15.47:0/1763316572 shutdown_connections 2024-07-24T22:14:46.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.466+0000 7f8590937640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f85740b3d40 0x7f85740b6200 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.466+0000 7f8590937640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f858c108b20 0x7f858c075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.466+0000 7f8590937640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f858c1081a0 0x7f858c0753d0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.466+0000 7f8590937640 1 --2- 172.21.15.47:0/1763316572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f858c102790 0x7f858c074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:46.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.466+0000 7f8590937640 1 -- 172.21.15.47:0/1763316572 >> 172.21.15.47:0/1763316572 conn(0x7f858c0fe200 msgr2=0x7f858c1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:46.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.466+0000 7f8590937640 1 -- 172.21.15.47:0/1763316572 shutdown_connections 2024-07-24T22:14:46.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:46.466+0000 7f8590937640 1 -- 172.21.15.47:0/1763316572 wait complete. 2024-07-24T22:14:47.179 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:14:47.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:14:47.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:47 smithi047 ceph-mon[32551]: pgmap v597: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:14:47.455 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:14:47.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:47 smithi183 ceph-mon[37007]: pgmap v597: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:14:47.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:47 smithi188 ceph-mon[37380]: pgmap v597: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:14:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.097+0000 7f0021ec7640 1 -- 172.21.15.47:0/2277764121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10ad10 msgr2=0x7f001c111510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.097+0000 7f0021ec7640 1 --2- 172.21.15.47:0/2277764121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10ad10 0x7f001c111510 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0014009ca0 tx=0x7f001402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:14:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.097+0000 7f0021ec7640 1 -- 172.21.15.47:0/2277764121 shutdown_connections 2024-07-24T22:14:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.097+0000 7f0021ec7640 1 --2- 172.21.15.47:0/2277764121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10ad10 0x7f001c111510 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.097+0000 7f0021ec7640 1 --2- 172.21.15.47:0/2277764121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f001c10a390 0x7f001c10a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.097+0000 7f0021ec7640 1 --2- 172.21.15.47:0/2277764121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f001c104980 0x7f001c104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.097+0000 7f0021ec7640 1 -- 172.21.15.47:0/2277764121 >> 172.21.15.47:0/2277764121 conn(0x7f001c1003b0 msgr2=0x7f001c1027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.097+0000 7f0021ec7640 1 -- 172.21.15.47:0/2277764121 shutdown_connections 2024-07-24T22:14:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.097+0000 7f0021ec7640 1 -- 172.21.15.47:0/2277764121 wait complete. 2024-07-24T22:14:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.098+0000 7f0021ec7640 1 Processor -- start 2024-07-24T22:14:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.098+0000 7f0021ec7640 1 -- start start 2024-07-24T22:14:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.098+0000 7f0021ec7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f001c104980 0x7f001c19ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.098+0000 7f0021ec7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10a390 0x7f001c19b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.098+0000 7f0021ec7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f001c10ad10 0x7f001c1a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.098+0000 7f0021ec7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f001c114990 con 0x7f001c10a390 2024-07-24T22:14:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.098+0000 7f0021ec7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f001c114810 con 0x7f001c104980 2024-07-24T22:14:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.098+0000 7f0021ec7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f001c114b10 con 0x7f001c10ad10 2024-07-24T22:14:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.098+0000 7f001affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10a390 0x7f001c19b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.098+0000 7f001affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10a390 0x7f001c19b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49556/0 (socket says 172.21.15.47:49556) 2024-07-24T22:14:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.098+0000 7f001affd640 1 -- 172.21.15.47:0/522384847 learned_addr learned my addr 172.21.15.47:0/522384847 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.099+0000 7f001b7fe640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f001c104980 0x7f001c19ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.099+0000 7f001bfff640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f001c10ad10 0x7f001c1a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.099+0000 7f001affd640 1 -- 172.21.15.47:0/522384847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f001c10ad10 msgr2=0x7f001c1a0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.099+0000 7f001affd640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f001c10ad10 0x7f001c1a0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.099+0000 7f001affd640 1 -- 172.21.15.47:0/522384847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f001c104980 msgr2=0x7f001c19ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.099+0000 7f001affd640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f001c104980 0x7f001c19ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.099+0000 7f001affd640 1 -- 172.21.15.47:0/522384847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c1a0ef0 con 0x7f001c10a390 2024-07-24T22:14:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.099+0000 7f001affd640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10a390 0x7f001c19b380 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f001000e9f0 tx=0x7f001000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:49.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.099+0000 7f0018ff9640 1 -- 172.21.15.47:0/522384847 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001000cd80 con 0x7f001c10a390 2024-07-24T22:14:49.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.099+0000 7f0018ff9640 1 -- 172.21.15.47:0/522384847 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00100108e0 con 0x7f001c10a390 2024-07-24T22:14:49.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.099+0000 7f0021ec7640 1 -- 172.21.15.47:0/522384847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001c1a11e0 con 0x7f001c10a390 2024-07-24T22:14:49.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.099+0000 7f0018ff9640 1 -- 172.21.15.47:0/522384847 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010018980 con 0x7f001c10a390 2024-07-24T22:14:49.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.099+0000 7f0021ec7640 1 -- 172.21.15.47:0/522384847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001c1a7a70 con 0x7f001c10a390 2024-07-24T22:14:49.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.100+0000 7f0021ec7640 1 -- 172.21.15.47:0/522384847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001c105c30 con 0x7f001c10a390 2024-07-24T22:14:49.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.102+0000 7f0018ff9640 1 -- 172.21.15.47:0/522384847 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f0010010430 con 0x7f001c10a390 2024-07-24T22:14:49.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.102+0000 7f0018ff9640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00040b3dc0 0x7f00040b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:49.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.103+0000 7f001b7fe640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00040b3dc0 0x7f00040b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:49.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.103+0000 7f0018ff9640 1 -- 172.21.15.47:0/522384847 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f00100e42e0 con 0x7f001c10a390 2024-07-24T22:14:49.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.103+0000 7f001b7fe640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00040b3dc0 0x7f00040b6280 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f000c005d00 tx=0x7f000c00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:49.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.107+0000 7f0018ff9640 1 -- 172.21.15.47:0/522384847 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f00100ab5c0 con 0x7f001c10a390 2024-07-24T22:14:49.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.342+0000 7f0021ec7640 1 -- 172.21.15.47:0/522384847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f001c104d60 con 0x7f001c10a390 2024-07-24T22:14:49.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.343+0000 7f0018ff9640 1 -- 172.21.15.47:0/522384847 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f00100aaec0 con 0x7f001c10a390 2024-07-24T22:14:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:14:49.348 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:14:49.349 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:14:49.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.345+0000 7f0021ec7640 1 -- 172.21.15.47:0/522384847 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00040b3dc0 msgr2=0x7f00040b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:49.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.345+0000 7f0021ec7640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00040b3dc0 0x7f00040b6280 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f000c005d00 tx=0x7f000c00b410 comp rx=0 tx=0).stop 2024-07-24T22:14:49.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.345+0000 7f0021ec7640 1 -- 172.21.15.47:0/522384847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10a390 msgr2=0x7f001c19b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:49.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.345+0000 7f0021ec7640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10a390 0x7f001c19b380 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f001000e9f0 tx=0x7f001000eeb0 comp rx=0 tx=0).stop 2024-07-24T22:14:49.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.345+0000 7f0021ec7640 1 -- 172.21.15.47:0/522384847 shutdown_connections 2024-07-24T22:14:49.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.345+0000 7f0021ec7640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00040b3dc0 0x7f00040b6280 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:49.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.345+0000 7f0021ec7640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f001c10ad10 0x7f001c1a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:49.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.345+0000 7f0021ec7640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10a390 0x7f001c19b380 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:49.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.345+0000 7f0021ec7640 1 --2- 172.21.15.47:0/522384847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f001c104980 0x7f001c19ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:49.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.345+0000 7f0021ec7640 1 -- 172.21.15.47:0/522384847 >> 172.21.15.47:0/522384847 conn(0x7f001c1003b0 msgr2=0x7f001c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:49.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.345+0000 7f0021ec7640 1 -- 172.21.15.47:0/522384847 shutdown_connections 2024-07-24T22:14:49.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:49.345+0000 7f0021ec7640 1 -- 172.21.15.47:0/522384847 wait complete. 2024-07-24T22:14:49.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:49 smithi183 ceph-mon[37007]: pgmap v598: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:49.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:49 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/522384847' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:14:49.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:49 smithi047 ceph-mon[32551]: pgmap v598: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:49.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:49 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/522384847' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:14:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:49 smithi188 ceph-mon[37380]: pgmap v598: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:49 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/522384847' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:14:50.016 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:14:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:14:51.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:51 smithi183 ceph-mon[37007]: pgmap v599: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:51.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:51 smithi047 ceph-mon[32551]: pgmap v599: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:51.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:51 smithi188 ceph-mon[37380]: pgmap v599: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:51.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.905+0000 7f83b5ea5640 1 -- 172.21.15.47:0/272797464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83b010cac0 msgr2=0x7f83b010ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:51.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.905+0000 7f83b5ea5640 1 --2- 172.21.15.47:0/272797464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83b010cac0 0x7f83b010ef20 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009900 tx=0x7f83a802a410 comp rx=0 tx=0).stop 2024-07-24T22:14:51.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.905+0000 7f83b5ea5640 1 -- 172.21.15.47:0/272797464 shutdown_connections 2024-07-24T22:14:51.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.905+0000 7f83b5ea5640 1 --2- 172.21.15.47:0/272797464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83b010cac0 0x7f83b010ef20 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.905+0000 7f83b5ea5640 1 --2- 172.21.15.47:0/272797464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83b0103f80 0x7f83b010c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.905+0000 7f83b5ea5640 1 --2- 172.21.15.47:0/272797464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83b0103660 0x7f83b0103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.905+0000 7f83b5ea5640 1 -- 172.21.15.47:0/272797464 >> 172.21.15.47:0/272797464 conn(0x7f83b00fd0c0 msgr2=0x7f83b00ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:51.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.906+0000 7f83b5ea5640 1 -- 172.21.15.47:0/272797464 shutdown_connections 2024-07-24T22:14:51.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.906+0000 7f83b5ea5640 1 -- 172.21.15.47:0/272797464 wait complete. 2024-07-24T22:14:51.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.906+0000 7f83b5ea5640 1 Processor -- start 2024-07-24T22:14:51.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.906+0000 7f83b5ea5640 1 -- start start 2024-07-24T22:14:51.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.906+0000 7f83b5ea5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83b0103660 0x7f83b0101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.906+0000 7f83b5ea5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83b0103f80 0x7f83b0101850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.906+0000 7f83b5ea5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83b010cac0 0x7f83b0101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83b5ea5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f83b0112720 con 0x7f83b0103f80 2024-07-24T22:14:51.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83b5ea5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01125a0 con 0x7f83b010cac0 2024-07-24T22:14:51.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83b5ea5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01128a0 con 0x7f83b0103660 2024-07-24T22:14:51.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83aeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83b0103f80 0x7f83b0101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83aeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83b0103f80 0x7f83b0101850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49576/0 (socket says 172.21.15.47:49576) 2024-07-24T22:14:51.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83aeffd640 1 -- 172.21.15.47:0/4035680289 learned_addr learned my addr 172.21.15.47:0/4035680289 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:51.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83af7fe640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83b0103660 0x7f83b0101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83affff640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83b010cac0 0x7f83b0101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83aeffd640 1 -- 172.21.15.47:0/4035680289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83b0103660 msgr2=0x7f83b0101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:51.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83aeffd640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83b0103660 0x7f83b0101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83aeffd640 1 -- 172.21.15.47:0/4035680289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83b010cac0 msgr2=0x7f83b0101d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:51.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83aeffd640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83b010cac0 0x7f83b0101d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83aeffd640 1 -- 172.21.15.47:0/4035680289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b01a7030 con 0x7f83b0103f80 2024-07-24T22:14:51.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83aeffd640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83b0103f80 0x7f83b0101850 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f83a400d6b0 tx=0x7f83a400db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:51.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83acff9640 1 -- 172.21.15.47:0/4035680289 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4017070 con 0x7f83b0103f80 2024-07-24T22:14:51.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83acff9640 1 -- 172.21.15.47:0/4035680289 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a4010460 con 0x7f83b0103f80 2024-07-24T22:14:51.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83b5ea5640 1 -- 172.21.15.47:0/4035680289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b01a7320 con 0x7f83b0103f80 2024-07-24T22:14:51.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83acff9640 1 -- 172.21.15.47:0/4035680289 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a400f620 con 0x7f83b0103f80 2024-07-24T22:14:51.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.907+0000 7f83b5ea5640 1 -- 172.21.15.47:0/4035680289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b01a7860 con 0x7f83b0103f80 2024-07-24T22:14:51.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.910+0000 7f83acff9640 1 -- 172.21.15.47:0/4035680289 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f83a401a070 con 0x7f83b0103f80 2024-07-24T22:14:51.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.910+0000 7f83b8256740 1 Processor -- start 2024-07-24T22:14:51.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.910+0000 7f83b8256740 1 -- start start 2024-07-24T22:14:51.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.910+0000 7f83b8256740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2bdcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.910+0000 7f83b8256740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.910+0000 7f83b8256740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2be8f80 0x55a9a2beb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.910+0000 7f83b8256740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a9a2b539b0 con 0x55a9a2bdcff0 2024-07-24T22:14:51.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.910+0000 7f83b8256740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a9a2b42eb0 con 0x55a9a2bdc6d0 2024-07-24T22:14:51.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.910+0000 7f83b8256740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a9a2b46ef0 con 0x55a9a2be8f80 2024-07-24T22:14:51.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.910+0000 7f83af7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.910+0000 7f83af7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49580/0 (socket says 172.21.15.47:49580) 2024-07-24T22:14:51.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.910+0000 7f83af7fe640 1 -- 172.21.15.47:0/3948970144 learned_addr learned my addr 172.21.15.47:0/3948970144 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:51.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f83affff640 1 --2- 172.21.15.47:0/3948970144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2bdcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f83aeffd640 1 --2- 172.21.15.47:0/3948970144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2be8f80 0x55a9a2beb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f83af7fe640 1 -- 172.21.15.47:0/3948970144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2be8f80 msgr2=0x55a9a2beb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:51.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f83af7fe640 1 --2- 172.21.15.47:0/3948970144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2be8f80 0x55a9a2beb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f83af7fe640 1 -- 172.21.15.47:0/3948970144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdc6d0 msgr2=0x55a9a2bdcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:51.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f83af7fe640 1 --2- 172.21.15.47:0/3948970144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2bdcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f83af7fe640 1 -- 172.21.15.47:0/3948970144 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9a2acc320 con 0x55a9a2bdcff0 2024-07-24T22:14:51.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f83aeffd640 1 --2- 172.21.15.47:0/3948970144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2be8f80 0x55a9a2beb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:51.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f83acff9640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f83980b3dc0 0x7f83980b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f83af7fe640 1 --2- 172.21.15.47:0/3948970144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be8a40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f83a00039f0 tx=0x7f83a0003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e36b6189b2a502 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:51.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f83affff640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f83980b3dc0 0x7f83980b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f83acff9640 1 -- 172.21.15.47:0/4035680289 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f83a40e3960 con 0x7f83b0103f80 2024-07-24T22:14:51.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f8395ffb640 1 -- 172.21.15.47:0/3948970144 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0004b20 con 0x55a9a2bdcff0 2024-07-24T22:14:51.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f8395ffb640 1 -- 172.21.15.47:0/3948970144 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a0004cc0 con 0x55a9a2bdcff0 2024-07-24T22:14:51.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.911+0000 7f8395ffb640 1 -- 172.21.15.47:0/3948970144 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a00126b0 con 0x55a9a2bdcff0 2024-07-24T22:14:51.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.912+0000 7f83b8256740 1 -- 172.21.15.47:0/3948970144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 msgr2=0x55a9a2be8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:51.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.912+0000 7f83b8256740 1 --2- 172.21.15.47:0/3948970144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be8a40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f83a00039f0 tx=0x7f83a0003eb0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.912+0000 7f83affff640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f83980b3dc0 0x7f83980b6280 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f83a8031440 tx=0x7f83a80058b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:51.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.912+0000 7f83b8256740 1 -- 172.21.15.47:0/3948970144 shutdown_connections 2024-07-24T22:14:51.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.912+0000 7f83b8256740 1 --2- 172.21.15.47:0/3948970144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2be8f80 0x55a9a2beb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.912+0000 7f83b8256740 1 --2- 172.21.15.47:0/3948970144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be8a40 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.912+0000 7f83b8256740 1 --2- 172.21.15.47:0/3948970144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2bdcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.912+0000 7f83b8256740 1 -- 172.21.15.47:0/3948970144 >> 172.21.15.47:0/3948970144 conn(0x55a9a2bda500 msgr2=0x55a9a2bdb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:51.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.912+0000 7f83b8256740 1 -- 172.21.15.47:0/3948970144 shutdown_connections 2024-07-24T22:14:51.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.912+0000 7f83b8256740 1 -- 172.21.15.47:0/3948970144 wait complete. 2024-07-24T22:14:51.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83b8256740 1 -- start start 2024-07-24T22:14:51.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83b8256740 1 Processor -- start 2024-07-24T22:14:51.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83b8256740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2be89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83b8256740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83b8256740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 0x55a9a2be65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83b8256740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a9a29a6700 con 0x55a9a2be8f80 2024-07-24T22:14:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83b8256740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a9a2ae55f0 con 0x55a9a2bdcff0 2024-07-24T22:14:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83b8256740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a9a2bebc00 con 0x55a9a2bdc6d0 2024-07-24T22:14:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83b8256740 10 client.0 _ll_register_callbacks cb 0x55a9a2b05960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83affff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 0x55a9a2be65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83aeffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83affff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 0x55a9a2be65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49586/0 (socket says 172.21.15.47:49586) 2024-07-24T22:14:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83affff640 1 -- 172.21.15.47:0/4237555341 learned_addr learned my addr 172.21.15.47:0/4237555341 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.913+0000 7f83af7fe640 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2be89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f83aeffd640 1 -- 172.21.15.47:0/4237555341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdc6d0 msgr2=0x55a9a2be89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f83aeffd640 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2be89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f83aeffd640 1 -- 172.21.15.47:0/4237555341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 msgr2=0x55a9a2be65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f83aeffd640 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 0x55a9a2be65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f83aeffd640 1 -- 172.21.15.47:0/4237555341 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9a2ad8680 con 0x55a9a2bdcff0 2024-07-24T22:14:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f83affff640 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 0x55a9a2be65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:14:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f83af7fe640 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2be89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:14:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f83aeffd640 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be5e20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f83a40e1080 tx=0x7f83a40a9d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2212b7a86d64b4cf server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f838effd640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:14:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f838effd640 1 -- 172.21.15.47:0/4237555341 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4021030 con 0x55a9a2bdcff0 2024-07-24T22:14:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f83b8256740 1 -- 172.21.15.47:0/4237555341 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83a0004cc0 con 0x55a9a2bdcff0 2024-07-24T22:14:51.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f838effd640 1 -- 172.21.15.47:0/4237555341 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f83a4010930 con 0x55a9a2bdcff0 2024-07-24T22:14:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f838effd640 1 -- 172.21.15.47:0/4237555341 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f83a40aa540 con 0x55a9a2bdcff0 2024-07-24T22:14:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f83b8256740 10 client.26375 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.914+0000 7f83b8256740 1 -- 172.21.15.47:0/4237555341 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a9a28a3650 con 0x55a9a2bdcff0 2024-07-24T22:14:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.915+0000 7f838effd640 1 -- 172.21.15.47:0/4237555341 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a0004cc0 con 0x55a9a2bdcff0 2024-07-24T22:14:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.915+0000 7f838effd640 1 -- 172.21.15.47:0/4237555341 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f83a40a5eb0 con 0x55a9a2bdcff0 2024-07-24T22:14:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.915+0000 7f83b8256740 10 client.26375 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.915+0000 7f83b8256740 10 client.26375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.915+0000 7f83b8256740 20 client.26375 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.915+0000 7f83b8256740 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9a2bf88c0 0x55a9a2bfad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.915+0000 7f83b8256740 4 client.26375 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.915+0000 7f83b8256740 1 -- 172.21.15.47:0/4237555341 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9a2b55900 con 0x55a9a2bf88c0 2024-07-24T22:14:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.915+0000 7f83af7fe640 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9a2bf88c0 0x55a9a2bfad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.916+0000 7f83af7fe640 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9a2bf88c0 0x55a9a2bfad00 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33267819f894bd48 server_cookie=232d688a67a20dd in_seq=0 out_seq=0 2024-07-24T22:14:51.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.916+0000 7f838effd640 10 client.26375 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:51.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f838effd640 1 -- 172.21.15.47:0/4237555341 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9a2b55900 con 0x55a9a2bf88c0 2024-07-24T22:14:51.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f838effd640 10 client.26375 handle_command_reply: tid=0 2024-07-24T22:14:51.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f83b8256740 1 client.26375 shutdown 2024-07-24T22:14:51.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f83b8256740 1 -- 172.21.15.47:0/4237555341 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdcff0 msgr2=0x55a9a2be5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:51.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f83b8256740 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be5e20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f83a40e1080 tx=0x7f83a40a9d70 comp rx=0 tx=0).stop 2024-07-24T22:14:51.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f83b8256740 1 -- 172.21.15.47:0/4237555341 shutdown_connections 2024-07-24T22:14:51.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f83b8256740 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9a2bf88c0 0x55a9a2bfad00 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f83b8256740 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 0x55a9a2be65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f838effd640 0 client.26375 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:51.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f83b8256740 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be5e20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f83b8256740 1 --2- 172.21.15.47:0/4237555341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2be89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f83b8256740 1 -- 172.21.15.47:0/4237555341 >> 172.21.15.47:0/4237555341 conn(0x55a9a2bda500 msgr2=0x55a9a2be00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:51.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f83b8256740 1 -- 172.21.15.47:0/4237555341 shutdown_connections 2024-07-24T22:14:51.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f83b8256740 1 -- 172.21.15.47:0/4237555341 wait complete. 2024-07-24T22:14:51.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.917+0000 7f83b8256740 20 client.26375 trim_cache size 0 max 16384 2024-07-24T22:14:51.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.931+0000 7f83b8256740 1 Processor -- start 2024-07-24T22:14:51.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.931+0000 7f83b8256740 1 -- start start 2024-07-24T22:14:51.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.931+0000 7f83b8256740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2be0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.931+0000 7f83b8256740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.931+0000 7f83b8256740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 0x55a9a2c005d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.931+0000 7f83b8256740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01ae3f0 con 0x55a9a2be8f80 2024-07-24T22:14:51.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.931+0000 7f83b8256740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01b0c50 con 0x55a9a2bdc6d0 2024-07-24T22:14:51.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.931+0000 7f83b8256740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01aea40 con 0x55a9a2bdcff0 2024-07-24T22:14:51.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.931+0000 7f83affff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 0x55a9a2c005d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83affff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 0x55a9a2c005d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49602/0 (socket says 172.21.15.47:49602) 2024-07-24T22:14:51.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83affff640 1 -- 172.21.15.47:0/3625650406 learned_addr learned my addr 172.21.15.47:0/3625650406 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:51.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83af7fe640 1 --2- 172.21.15.47:0/3625650406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2be0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83aeffd640 1 --2- 172.21.15.47:0/3625650406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83affff640 1 -- 172.21.15.47:0/3625650406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdcff0 msgr2=0x55a9a2be7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:51.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83affff640 1 --2- 172.21.15.47:0/3625650406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83affff640 1 -- 172.21.15.47:0/3625650406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdc6d0 msgr2=0x55a9a2be0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:51.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83affff640 1 --2- 172.21.15.47:0/3625650406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2be0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83affff640 1 -- 172.21.15.47:0/3625650406 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9a2bdb1e0 con 0x55a9a2be8f80 2024-07-24T22:14:51.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83af7fe640 1 --2- 172.21.15.47:0/3625650406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2be0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:14:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83affff640 1 --2- 172.21.15.47:0/3625650406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 0x55a9a2c005d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f83a8006010 tx=0x7f83a803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46155ed731b6bda2 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83957fa640 1 -- 172.21.15.47:0/3625650406 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8035050 con 0x55a9a2be8f80 2024-07-24T22:14:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83957fa640 1 -- 172.21.15.47:0/3625650406 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a804c070 con 0x55a9a2be8f80 2024-07-24T22:14:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.932+0000 7f83957fa640 1 -- 172.21.15.47:0/3625650406 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8004e10 con 0x55a9a2be8f80 2024-07-24T22:14:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.933+0000 7f83b8256740 1 -- 172.21.15.47:0/3625650406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 msgr2=0x55a9a2c005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.933+0000 7f83b8256740 1 --2- 172.21.15.47:0/3625650406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 0x55a9a2c005d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f83a8006010 tx=0x7f83a803d000 comp rx=0 tx=0).stop 2024-07-24T22:14:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.933+0000 7f83b8256740 1 -- 172.21.15.47:0/3625650406 shutdown_connections 2024-07-24T22:14:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.933+0000 7f83b8256740 1 --2- 172.21.15.47:0/3625650406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2be8f80 0x55a9a2c005d0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.933+0000 7f83b8256740 1 --2- 172.21.15.47:0/3625650406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdcff0 0x55a9a2be7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.933+0000 7f83b8256740 1 --2- 172.21.15.47:0/3625650406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2be0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.933+0000 7f83b8256740 1 -- 172.21.15.47:0/3625650406 >> 172.21.15.47:0/3625650406 conn(0x55a9a2bda500 msgr2=0x55a9a2be7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:51.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.933+0000 7f83b8256740 1 -- 172.21.15.47:0/3625650406 shutdown_connections 2024-07-24T22:14:51.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.933+0000 7f83b8256740 1 -- 172.21.15.47:0/3625650406 wait complete. 2024-07-24T22:14:51.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.933+0000 7f83b8256740 1 -- start start 2024-07-24T22:14:51.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83b8256740 1 Processor -- start 2024-07-24T22:14:51.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83b8256740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2bf1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83b8256740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 0x55a9a2becb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83b8256740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2be8f80 0x55a9a2bed160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83b8256740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01af110 con 0x55a9a2bdcff0 2024-07-24T22:14:51.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83b8256740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01b0580 con 0x55a9a2be8f80 2024-07-24T22:14:51.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83b8256740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01af7e0 con 0x55a9a2bdc6d0 2024-07-24T22:14:51.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83aeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 0x55a9a2becb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83aeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 0x55a9a2becb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49614/0 (socket says 172.21.15.47:49614) 2024-07-24T22:14:51.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83aeffd640 1 -- 172.21.15.47:0/3990246244 learned_addr learned my addr 172.21.15.47:0/3990246244 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:51.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83b8256740 10 client.0 _ll_register_callbacks cb 0x7f83a4005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:51.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83affff640 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2be8f80 0x55a9a2bed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83af7fe640 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2bf1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.934+0000 7f83aeffd640 1 -- 172.21.15.47:0/3990246244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdc6d0 msgr2=0x55a9a2bf1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:51.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f83aeffd640 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2bf1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f83aeffd640 1 -- 172.21.15.47:0/3990246244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2be8f80 msgr2=0x55a9a2bed160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:51.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f83aeffd640 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2be8f80 0x55a9a2bed160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f83aeffd640 1 -- 172.21.15.47:0/3990246244 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9a2bed990 con 0x55a9a2bdcff0 2024-07-24T22:14:51.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f83af7fe640 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2bf1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:51.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f83aeffd640 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 0x55a9a2becb50 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f83a40aa240 tx=0x7f83a4010b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20715151dd5edaa2 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:51.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f838effd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:51.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f838effd640 1 -- 172.21.15.47:0/3990246244 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a40c3070 con 0x55a9a2bdcff0 2024-07-24T22:14:51.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f838effd640 1 -- 172.21.15.47:0/3990246244 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f83a40a9560 con 0x55a9a2bdcff0 2024-07-24T22:14:51.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f83b8256740 1 -- 172.21.15.47:0/3990246244 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83a804c070 con 0x55a9a2bdcff0 2024-07-24T22:14:51.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f838effd640 1 -- 172.21.15.47:0/3990246244 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f83a4021030 con 0x55a9a2bdcff0 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f83b8256740 10 client.17172 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f83b8256740 1 -- 172.21.15.47:0/3990246244 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a9a2c636d0 con 0x55a9a2bdcff0 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f838effd640 1 -- 172.21.15.47:0/3990246244 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a804c070 con 0x55a9a2bdcff0 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.935+0000 7f838effd640 1 -- 172.21.15.47:0/3990246244 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f83a40bfbe0 con 0x55a9a2bdcff0 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.936+0000 7f83b8256740 10 client.17172 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.936+0000 7f83b8256740 10 client.17172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.936+0000 7f83b8256740 20 client.17172 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.936+0000 7f83b8256740 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9a2c63ed0 0x55a9a2c662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.936+0000 7f83b8256740 4 client.17172 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.936+0000 7f83b8256740 1 -- 172.21.15.47:0/3990246244 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a9a2b513a0 con 0x55a9a2c63ed0 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.936+0000 7f83af7fe640 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9a2c63ed0 0x55a9a2c662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.936+0000 7f83af7fe640 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9a2c63ed0 0x55a9a2c662f0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea8ddac2e3f6c819 server_cookie=34ac7c157d5b980b in_seq=0 out_seq=0 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.936+0000 7f838effd640 10 client.17172 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:51.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f838effd640 1 -- 172.21.15.47:0/3990246244 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a9a2b513a0 con 0x55a9a2c63ed0 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f838effd640 10 client.17172 handle_command_reply: tid=0 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f83b8256740 1 client.17172 shutdown 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f83b8256740 1 -- 172.21.15.47:0/3990246244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 msgr2=0x55a9a2becb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f83b8256740 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 0x55a9a2becb50 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f83a40aa240 tx=0x7f83a4010b60 comp rx=0 tx=0).stop 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f83b8256740 1 -- 172.21.15.47:0/3990246244 shutdown_connections 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f83b8256740 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a9a2c63ed0 0x55a9a2c662f0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f838effd640 0 client.17172 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f83b8256740 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a9a2be8f80 0x55a9a2bed160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f83b8256740 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9a2bdcff0 0x55a9a2becb50 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f83b8256740 1 --2- 172.21.15.47:0/3990246244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a9a2bdc6d0 0x55a9a2bf1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f83b8256740 1 -- 172.21.15.47:0/3990246244 >> 172.21.15.47:0/3990246244 conn(0x55a9a2bda500 msgr2=0x55a9a2be7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f83b8256740 1 -- 172.21.15.47:0/3990246244 shutdown_connections 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f83b8256740 1 -- 172.21.15.47:0/3990246244 wait complete. 2024-07-24T22:14:51.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.937+0000 7f83b8256740 20 client.17172 trim_cache size 0 max 16384 2024-07-24T22:14:51.951 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:14:51.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.938+0000 7f83b5ea5640 1 -- 172.21.15.47:0/4035680289 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f83980b3dc0 msgr2=0x7f83980b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:51.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.938+0000 7f83b5ea5640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f83980b3dc0 0x7f83980b6280 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f83a8031440 tx=0x7f83a80058b0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.938+0000 7f83b5ea5640 1 -- 172.21.15.47:0/4035680289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83b0103f80 msgr2=0x7f83b0101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:51.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.938+0000 7f83b5ea5640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83b0103f80 0x7f83b0101850 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f83a400d6b0 tx=0x7f83a400db70 comp rx=0 tx=0).stop 2024-07-24T22:14:51.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.938+0000 7f83b5ea5640 1 -- 172.21.15.47:0/4035680289 shutdown_connections 2024-07-24T22:14:51.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.938+0000 7f83b5ea5640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f83980b3dc0 0x7f83980b6280 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.938+0000 7f83b5ea5640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83b010cac0 0x7f83b0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.938+0000 7f83b5ea5640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83b0103f80 0x7f83b0101850 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.938+0000 7f83b5ea5640 1 --2- 172.21.15.47:0/4035680289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83b0103660 0x7f83b0101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:51.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.938+0000 7f83b5ea5640 1 -- 172.21.15.47:0/4035680289 >> 172.21.15.47:0/4035680289 conn(0x7f83b00fd0c0 msgr2=0x7f83b010ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:51.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.938+0000 7f83b5ea5640 1 -- 172.21.15.47:0/4035680289 shutdown_connections 2024-07-24T22:14:51.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:51.938+0000 7f83b5ea5640 1 -- 172.21.15.47:0/4035680289 wait complete. 2024-07-24T22:14:53.631 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:14:53.631 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:14:53.661 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:53 smithi047 ceph-mon[32551]: pgmap v600: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:53 smithi183 ceph-mon[37007]: pgmap v600: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:53 smithi188 ceph-mon[37380]: pgmap v600: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:53.910 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:14:55.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:55 smithi047 ceph-mon[32551]: pgmap v601: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:55.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.480+0000 7f51fa8ee640 1 -- 172.21.15.47:0/2558943599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f4108180 msgr2=0x7f51f41085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:55.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.480+0000 7f51fa8ee640 1 --2- 172.21.15.47:0/2558943599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f4108180 0x7f51f41085c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009900 tx=0x7f51e802a410 comp rx=0 tx=0).stop 2024-07-24T22:14:55.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.480+0000 7f51fa8ee640 1 -- 172.21.15.47:0/2558943599 shutdown_connections 2024-07-24T22:14:55.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.480+0000 7f51fa8ee640 1 --2- 172.21.15.47:0/2558943599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51f4108b00 0x7f51f410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.480+0000 7f51fa8ee640 1 --2- 172.21.15.47:0/2558943599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f4108180 0x7f51f41085c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.480+0000 7f51fa8ee640 1 --2- 172.21.15.47:0/2558943599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51f4102770 0x7f51f4102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.480+0000 7f51fa8ee640 1 -- 172.21.15.47:0/2558943599 >> 172.21.15.47:0/2558943599 conn(0x7f51f40fe1c0 msgr2=0x7f51f41005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:55.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.480+0000 7f51fa8ee640 1 -- 172.21.15.47:0/2558943599 shutdown_connections 2024-07-24T22:14:55.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.481+0000 7f51fa8ee640 1 -- 172.21.15.47:0/2558943599 wait complete. 2024-07-24T22:14:55.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.481+0000 7f51fa8ee640 1 Processor -- start 2024-07-24T22:14:55.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.481+0000 7f51fa8ee640 1 -- start start 2024-07-24T22:14:55.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.481+0000 7f51fa8ee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51f4102770 0x7f51f4198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.481+0000 7f51fa8ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f4108180 0x7f51f41991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.481+0000 7f51fa8ee640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51f4108b00 0x7f51f419e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.481+0000 7f51fa8ee640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51f4112720 con 0x7f51f4108180 2024-07-24T22:14:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.481+0000 7f51fa8ee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41125a0 con 0x7f51f4102770 2024-07-24T22:14:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51fa8ee640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41128a0 con 0x7f51f4108b00 2024-07-24T22:14:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f4108180 0x7f51f41991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f4108180 0x7f51f41991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58584/0 (socket says 172.21.15.47:58584) 2024-07-24T22:14:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f37fe640 1 -- 172.21.15.47:0/573878656 learned_addr learned my addr 172.21.15.47:0/573878656 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f3fff640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51f4102770 0x7f51f4198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f8e8b640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51f4108b00 0x7f51f419e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f37fe640 1 -- 172.21.15.47:0/573878656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51f4108b00 msgr2=0x7f51f419e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f37fe640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51f4108b00 0x7f51f419e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f37fe640 1 -- 172.21.15.47:0/573878656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51f4102770 msgr2=0x7f51f4198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f37fe640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51f4102770 0x7f51f4198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f37fe640 1 -- 172.21.15.47:0/573878656 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f419ed20 con 0x7f51f4108180 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f3fff640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51f4102770 0x7f51f4198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f37fe640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f4108180 0x7f51f41991b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f51e8005940 tx=0x7f51e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f17fa640 1 -- 172.21.15.47:0/573878656 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e803f030 con 0x7f51f4108180 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f17fa640 1 -- 172.21.15.47:0/573878656 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51e8003cb0 con 0x7f51f4108180 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51fa8ee640 1 -- 172.21.15.47:0/573878656 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f419efb0 con 0x7f51f4108180 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51f17fa640 1 -- 172.21.15.47:0/573878656 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8035070 con 0x7f51f4108180 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.482+0000 7f51fa8ee640 1 -- 172.21.15.47:0/573878656 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f41a56d0 con 0x7f51f4108180 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.485+0000 7f51fcc9f740 1 Processor -- start 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.485+0000 7f51f17fa640 1 -- 172.21.15.47:0/573878656 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f51e8042030 con 0x7f51f4108180 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.485+0000 7f51fcc9f740 1 -- start start 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.485+0000 7f51fcc9f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 0x55dba3556310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.485+0000 7f51fcc9f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3556850 0x55dba35666b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.485+0000 7f51fcc9f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3566bf0 0x55dba3568fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.485+0000 7f51fcc9f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dba34cd9f0 con 0x55dba3555f30 2024-07-24T22:14:55.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.485+0000 7f51fcc9f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55dba34bcef0 con 0x55dba3556850 2024-07-24T22:14:55.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.485+0000 7f51fcc9f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55dba34c0f30 con 0x55dba3566bf0 2024-07-24T22:14:55.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.485+0000 7f51f8e8b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 0x55dba3556310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.485+0000 7f51f8e8b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 0x55dba3556310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58594/0 (socket says 172.21.15.47:58594) 2024-07-24T22:14:55.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.485+0000 7f51f8e8b640 1 -- 172.21.15.47:0/2038297231 learned_addr learned my addr 172.21.15.47:0/2038297231 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:55.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.485+0000 7f51f3fff640 1 --2- 172.21.15.47:0/2038297231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3556850 0x55dba35666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.486+0000 7f51f8e8b640 1 -- 172.21.15.47:0/2038297231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3566bf0 msgr2=0x55dba3568fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:55.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.486+0000 7f51f8e8b640 1 --2- 172.21.15.47:0/2038297231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3566bf0 0x55dba3568fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.486+0000 7f51f8e8b640 1 -- 172.21.15.47:0/2038297231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3556850 msgr2=0x55dba35666b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:55.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.486+0000 7f51f8e8b640 1 --2- 172.21.15.47:0/2038297231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3556850 0x55dba35666b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.486+0000 7f51f8e8b640 1 -- 172.21.15.47:0/2038297231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba321d930 con 0x55dba3555f30 2024-07-24T22:14:55.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.486+0000 7f51f8e8b640 1 --2- 172.21.15.47:0/2038297231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 0x55dba3556310 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009ea0 tx=0x7f51ec009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3464b04aad3638 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:55.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.486+0000 7f51f17fa640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f51dc0b3dc0 0x7f51dc0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.486+0000 7f51da7fc640 1 -- 172.21.15.47:0/2038297231 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec016070 con 0x55dba3555f30 2024-07-24T22:14:55.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.486+0000 7f51f3fff640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f51dc0b3dc0 0x7f51dc0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.486+0000 7f51da7fc640 1 -- 172.21.15.47:0/2038297231 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51ec00ee80 con 0x55dba3555f30 2024-07-24T22:14:55.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.486+0000 7f51da7fc640 1 -- 172.21.15.47:0/2038297231 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec011670 con 0x55dba3555f30 2024-07-24T22:14:55.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.486+0000 7f51f17fa640 1 -- 172.21.15.47:0/573878656 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f51e8104930 con 0x7f51f4108180 2024-07-24T22:14:55.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.487+0000 7f51fcc9f740 1 -- 172.21.15.47:0/2038297231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 msgr2=0x55dba3556310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:55.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.487+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/2038297231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 0x55dba3556310 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009ea0 tx=0x7f51ec009f90 comp rx=0 tx=0).stop 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.487+0000 7f51f3fff640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f51dc0b3dc0 0x7f51dc0b6280 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55dba35590b0 tx=0x7f51e400c4f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.487+0000 7f51fcc9f740 1 -- 172.21.15.47:0/2038297231 shutdown_connections 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.487+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/2038297231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3566bf0 0x55dba3568fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.487+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/2038297231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3556850 0x55dba35666b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.487+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/2038297231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 0x55dba3556310 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.487+0000 7f51fcc9f740 1 -- 172.21.15.47:0/2038297231 >> 172.21.15.47:0/2038297231 conn(0x55dba3553d60 msgr2=0x55dba3554f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.487+0000 7f51fcc9f740 1 -- 172.21.15.47:0/2038297231 shutdown_connections 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.487+0000 7f51fcc9f740 1 -- 172.21.15.47:0/2038297231 wait complete. 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.487+0000 7f51fcc9f740 1 -- start start 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.487+0000 7f51fcc9f740 1 Processor -- start 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51fcc9f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 0x55dba3563b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51fcc9f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3556850 0x55dba35640c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51fcc9f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3566bf0 0x55dba3564600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51fcc9f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dba3320890 con 0x55dba3555f30 2024-07-24T22:14:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51fcc9f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55dba345f390 con 0x55dba3566bf0 2024-07-24T22:14:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51fcc9f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55dba35698a0 con 0x55dba3556850 2024-07-24T22:14:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51fcc9f740 10 client.0 _ll_register_callbacks cb 0x55dba3469500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51f3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 0x55dba3563b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51f3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 0x55dba3563b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58600/0 (socket says 172.21.15.47:58600) 2024-07-24T22:14:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51f3fff640 1 -- 172.21.15.47:0/3109101981 learned_addr learned my addr 172.21.15.47:0/3109101981 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:55.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51f8e8b640 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3566bf0 0x55dba3564600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51f37fe640 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3556850 0x55dba35640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51f3fff640 1 -- 172.21.15.47:0/3109101981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3556850 msgr2=0x55dba35640c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51f3fff640 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3556850 0x55dba35640c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51f3fff640 1 -- 172.21.15.47:0/3109101981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3566bf0 msgr2=0x55dba3564600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51f3fff640 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3566bf0 0x55dba3564600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51f3fff640 1 -- 172.21.15.47:0/3109101981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dba3459d60 con 0x55dba3555f30 2024-07-24T22:14:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51f37fe640 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3556850 0x55dba35640c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51f3fff640 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 0x55dba3563b80 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f51e401cdd0 tx=0x7f51e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ce8c390d799d8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:55.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51d37fe640 1 -- 172.21.15.47:0/3109101981 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e401a460 con 0x55dba3555f30 2024-07-24T22:14:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.488+0000 7f51d37fe640 1 -- 172.21.15.47:0/3109101981 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f51e401a600 con 0x55dba3555f30 2024-07-24T22:14:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.489+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3109101981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dba34cf940 con 0x55dba3555f30 2024-07-24T22:14:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.489+0000 7f51d37fe640 1 -- 172.21.15.47:0/3109101981 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f51e401a800 con 0x55dba3555f30 2024-07-24T22:14:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.489+0000 7f51fcc9f740 10 client.17184 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.489+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3109101981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dba3575850 con 0x55dba3555f30 2024-07-24T22:14:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.489+0000 7f51d37fe640 1 -- 172.21.15.47:0/3109101981 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55dba34cf940 con 0x55dba3555f30 2024-07-24T22:14:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.489+0000 7f51d37fe640 1 -- 172.21.15.47:0/3109101981 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f51e4023070 con 0x55dba3555f30 2024-07-24T22:14:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.489+0000 7f51fcc9f740 10 client.17184 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.489+0000 7f51fcc9f740 10 client.17184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.489+0000 7f51fcc9f740 20 client.17184 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.489+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dba3576d10 0x55dba3579160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.489+0000 7f51fcc9f740 4 client.17184 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:55.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.489+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3109101981 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dba34cb3e0 con 0x55dba3576d10 2024-07-24T22:14:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.489+0000 7f51f37fe640 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dba3576d10 0x55dba3579160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.490+0000 7f51d37fe640 10 client.17184 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.490+0000 7f51f37fe640 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dba3576d10 0x55dba3579160 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bec750c1241a699 server_cookie=5576bfdb78822636 in_seq=0 out_seq=0 2024-07-24T22:14:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51d37fe640 1 -- 172.21.15.47:0/3109101981 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dba34cb3e0 con 0x55dba3576d10 2024-07-24T22:14:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51d37fe640 10 client.17184 handle_command_reply: tid=0 2024-07-24T22:14:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51fcc9f740 1 client.17184 shutdown 2024-07-24T22:14:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3109101981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 msgr2=0x55dba3563b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 0x55dba3563b80 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f51e401cdd0 tx=0x7f51e40046c0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3109101981 shutdown_connections 2024-07-24T22:14:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dba3576d10 0x55dba3579160 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3566bf0 0x55dba3564600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3556850 0x55dba35640c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51d37fe640 0 client.17184 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:55.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/3109101981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3555f30 0x55dba3563b80 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3109101981 >> 172.21.15.47:0/3109101981 conn(0x55dba3553d60 msgr2=0x55dba3559900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:55.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3109101981 shutdown_connections 2024-07-24T22:14:55.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3109101981 wait complete. 2024-07-24T22:14:55.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.491+0000 7f51fcc9f740 20 client.17184 trim_cache size 0 max 16384 2024-07-24T22:14:55.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.510+0000 7f51fcc9f740 1 Processor -- start 2024-07-24T22:14:55.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.510+0000 7f51fcc9f740 1 -- start start 2024-07-24T22:14:55.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51fcc9f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3555f30 0x55dba3561680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51fcc9f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3556850 0x55dba3552600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51fcc9f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3566bf0 0x55dba3552b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51fcc9f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41a9fc0 con 0x55dba3556850 2024-07-24T22:14:55.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51fcc9f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41ac820 con 0x55dba3555f30 2024-07-24T22:14:55.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51fcc9f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41aa610 con 0x55dba3566bf0 2024-07-24T22:14:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51f37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3556850 0x55dba3552600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51f37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3556850 0x55dba3552600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58614/0 (socket says 172.21.15.47:58614) 2024-07-24T22:14:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51f37fe640 1 -- 172.21.15.47:0/1624874697 learned_addr learned my addr 172.21.15.47:0/1624874697 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51f8e8b640 1 --2- 172.21.15.47:0/1624874697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3566bf0 0x55dba3552b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51f3fff640 1 --2- 172.21.15.47:0/1624874697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3555f30 0x55dba3561680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51f37fe640 1 -- 172.21.15.47:0/1624874697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3566bf0 msgr2=0x55dba3552b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51f37fe640 1 --2- 172.21.15.47:0/1624874697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3566bf0 0x55dba3552b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51f37fe640 1 -- 172.21.15.47:0/1624874697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3555f30 msgr2=0x55dba3561680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51f37fe640 1 --2- 172.21.15.47:0/1624874697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3555f30 0x55dba3561680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51f37fe640 1 -- 172.21.15.47:0/1624874697 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba35677a0 con 0x55dba3556850 2024-07-24T22:14:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51f3fff640 1 --2- 172.21.15.47:0/1624874697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3555f30 0x55dba3561680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:55.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.511+0000 7f51f37fe640 1 --2- 172.21.15.47:0/1624874697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3556850 0x55dba3552600 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f51e80c7590 tx=0x7f51e803b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccef27ad1e7261b5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.512+0000 7f51d9ffb640 1 -- 172.21.15.47:0/1624874697 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8049040 con 0x55dba3556850 2024-07-24T22:14:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.512+0000 7f51d9ffb640 1 -- 172.21.15.47:0/1624874697 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51e80cbc10 con 0x55dba3556850 2024-07-24T22:14:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.512+0000 7f51d9ffb640 1 -- 172.21.15.47:0/1624874697 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e81022d0 con 0x55dba3556850 2024-07-24T22:14:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.512+0000 7f51fcc9f740 1 -- 172.21.15.47:0/1624874697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3556850 msgr2=0x55dba3552600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.512+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/1624874697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3556850 0x55dba3552600 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f51e80c7590 tx=0x7f51e803b6b0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.512+0000 7f51fcc9f740 1 -- 172.21.15.47:0/1624874697 shutdown_connections 2024-07-24T22:14:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.512+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/1624874697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3566bf0 0x55dba3552b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.512+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/1624874697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3556850 0x55dba3552600 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.512+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/1624874697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3555f30 0x55dba3561680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.512+0000 7f51fcc9f740 1 -- 172.21.15.47:0/1624874697 >> 172.21.15.47:0/1624874697 conn(0x55dba3553d60 msgr2=0x55dba3562400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.512+0000 7f51fcc9f740 1 -- 172.21.15.47:0/1624874697 shutdown_connections 2024-07-24T22:14:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.512+0000 7f51fcc9f740 1 -- 172.21.15.47:0/1624874697 wait complete. 2024-07-24T22:14:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.513+0000 7f51fcc9f740 1 -- start start 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.513+0000 7f51fcc9f740 1 Processor -- start 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.513+0000 7f51fcc9f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3555f30 0x55dba357f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.513+0000 7f51fcc9f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3556850 0x55dba356eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.513+0000 7f51fcc9f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3566bf0 0x55dba356f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.513+0000 7f51fcc9f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41aace0 con 0x55dba3566bf0 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.513+0000 7f51fcc9f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41ac150 con 0x55dba3555f30 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.513+0000 7f51fcc9f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f51f41ab3b0 con 0x55dba3556850 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.513+0000 7f51fcc9f740 10 client.0 _ll_register_callbacks cb 0x7f51e401ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.513+0000 7f51f8e8b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3566bf0 0x55dba356f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51f8e8b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3566bf0 0x55dba356f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58628/0 (socket says 172.21.15.47:58628) 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51f8e8b640 1 -- 172.21.15.47:0/3621572310 learned_addr learned my addr 172.21.15.47:0/3621572310 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51f3fff640 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3555f30 0x55dba357f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51f37fe640 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3556850 0x55dba356eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51f8e8b640 1 -- 172.21.15.47:0/3621572310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3556850 msgr2=0x55dba356eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51f8e8b640 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3556850 0x55dba356eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51f8e8b640 1 -- 172.21.15.47:0/3621572310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3555f30 msgr2=0x55dba357f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51f8e8b640 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3555f30 0x55dba357f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51f8e8b640 1 -- 172.21.15.47:0/3621572310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dba3557a60 con 0x55dba3566bf0 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51f37fe640 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3556850 0x55dba356eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51f8e8b640 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3566bf0 0x55dba356f1c0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f51ec017000 tx=0x7f51ec004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828352066cf11926 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51d37fe640 1 -- 172.21.15.47:0/3621572310 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec016040 con 0x55dba3566bf0 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3621572310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51e80cbc10 con 0x55dba3566bf0 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51d37fe640 1 -- 172.21.15.47:0/3621572310 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f51ec005590 con 0x55dba3566bf0 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51d37fe640 1 -- 172.21.15.47:0/3621572310 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f51ec032050 con 0x55dba3566bf0 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51fcc9f740 10 client.17190 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.514+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3621572310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dba35e1d60 con 0x55dba3566bf0 2024-07-24T22:14:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.515+0000 7f51d37fe640 1 -- 172.21.15.47:0/3621572310 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51e80cbc10 con 0x55dba3566bf0 2024-07-24T22:14:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.515+0000 7f51d37fe640 1 -- 172.21.15.47:0/3621572310 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f51ec00f040 con 0x55dba3566bf0 2024-07-24T22:14:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.515+0000 7f51fcc9f740 10 client.17190 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.515+0000 7f51fcc9f740 10 client.17190 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.515+0000 7f51fcc9f740 20 client.17190 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.515+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dba35e2220 0x55dba35e4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:55.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.515+0000 7f51fcc9f740 4 client.17190 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:14:55.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.515+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3621572310 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dba34c8b20 con 0x55dba35e2220 2024-07-24T22:14:55.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.515+0000 7f51f3fff640 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dba35e2220 0x55dba35e4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:55.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.516+0000 7f51f3fff640 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dba35e2220 0x55dba35e4640 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5ffd940c8247bca server_cookie=b27ba7d15ea17b54 in_seq=0 out_seq=0 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.516+0000 7f51d37fe640 10 client.17190 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.516+0000 7f51d37fe640 1 -- 172.21.15.47:0/3621572310 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dba34c8b20 con 0x55dba35e2220 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.516+0000 7f51d37fe640 10 client.17190 handle_command_reply: tid=0 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.517+0000 7f51fcc9f740 1 client.17190 shutdown 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.517+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3621572310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3566bf0 msgr2=0x55dba356f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.517+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3566bf0 0x55dba356f1c0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f51ec017000 tx=0x7f51ec004ea0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.517+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3621572310 shutdown_connections 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.517+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55dba35e2220 0x55dba35e4640 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.517+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dba3566bf0 0x55dba356f1c0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.517+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dba3556850 0x55dba356eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.517+0000 7f51d37fe640 0 client.17190 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.517+0000 7f51fcc9f740 1 --2- 172.21.15.47:0/3621572310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dba3555f30 0x55dba357f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.517+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3621572310 >> 172.21.15.47:0/3621572310 conn(0x55dba3553d60 msgr2=0x55dba35651b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:55.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.517+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3621572310 shutdown_connections 2024-07-24T22:14:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.517+0000 7f51fcc9f740 1 -- 172.21.15.47:0/3621572310 wait complete. 2024-07-24T22:14:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.517+0000 7f51fcc9f740 20 client.17190 trim_cache size 0 max 16384 2024-07-24T22:14:55.545 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:14:55.545 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:14:55.546 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "ff9e73f2-01f3-49f0-ab3c-64d87ebf6559", 2024-07-24T22:14:55.546 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:14:55.546 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:14:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.518+0000 7f51fa8ee640 1 -- 172.21.15.47:0/573878656 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f51dc0b3dc0 msgr2=0x7f51dc0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.518+0000 7f51fa8ee640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f51dc0b3dc0 0x7f51dc0b6280 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55dba35590b0 tx=0x7f51e400c4f0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.518+0000 7f51fa8ee640 1 -- 172.21.15.47:0/573878656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f4108180 msgr2=0x7f51f41991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:55.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.518+0000 7f51fa8ee640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f4108180 0x7f51f41991b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f51e8005940 tx=0x7f51e80042f0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.518+0000 7f51fa8ee640 1 -- 172.21.15.47:0/573878656 shutdown_connections 2024-07-24T22:14:55.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.518+0000 7f51fa8ee640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f51dc0b3dc0 0x7f51dc0b6280 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.518+0000 7f51fa8ee640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51f4108b00 0x7f51f419e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.518+0000 7f51fa8ee640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f4108180 0x7f51f41991b0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.518+0000 7f51fa8ee640 1 --2- 172.21.15.47:0/573878656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51f4102770 0x7f51f4198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:55.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.518+0000 7f51fa8ee640 1 -- 172.21.15.47:0/573878656 >> 172.21.15.47:0/573878656 conn(0x7f51f40fe1c0 msgr2=0x7f51f41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:55.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.518+0000 7f51fa8ee640 1 -- 172.21.15.47:0/573878656 shutdown_connections 2024-07-24T22:14:55.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:55.518+0000 7f51fa8ee640 1 -- 172.21.15.47:0/573878656 wait complete. 2024-07-24T22:14:55.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:55 smithi183 ceph-mon[37007]: pgmap v601: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:55.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:55 smithi188 ceph-mon[37380]: pgmap v601: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:56.214 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:14:56.527 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:14:56.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:56 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:14:56.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:56 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:14:56.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:56 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:14:56.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:56 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:14:56.683 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:56 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:14:56.683 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:56 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:14:56.683 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:56 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:14:56.683 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:56 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:14:56.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:56 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:14:56.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:56 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:14:56.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:56 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:14:56.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:56 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:14:57.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.639+0000 7f403f8fd640 1 -- 172.21.15.47:0/3869183592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4038108ac0 msgr2=0x7f403810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:57.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.639+0000 7f403f8fd640 1 --2- 172.21.15.47:0/3869183592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4038108ac0 0x7f403810f2c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f4030009ca0 tx=0x7f403002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.640+0000 7f403f8fd640 1 -- 172.21.15.47:0/3869183592 shutdown_connections 2024-07-24T22:14:57.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.640+0000 7f403f8fd640 1 --2- 172.21.15.47:0/3869183592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4038108ac0 0x7f403810f2c0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.640+0000 7f403f8fd640 1 --2- 172.21.15.47:0/3869183592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4038108140 0x7f4038108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.640+0000 7f403f8fd640 1 --2- 172.21.15.47:0/3869183592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4038102740 0x7f4038102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.640+0000 7f403f8fd640 1 -- 172.21.15.47:0/3869183592 >> 172.21.15.47:0/3869183592 conn(0x7f40380fe180 msgr2=0x7f40381005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:57.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.640+0000 7f403f8fd640 1 -- 172.21.15.47:0/3869183592 shutdown_connections 2024-07-24T22:14:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.640+0000 7f403f8fd640 1 -- 172.21.15.47:0/3869183592 wait complete. 2024-07-24T22:14:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.640+0000 7f403f8fd640 1 Processor -- start 2024-07-24T22:14:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.640+0000 7f403f8fd640 1 -- start start 2024-07-24T22:14:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.640+0000 7f403f8fd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4038102740 0x7f4038198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403f8fd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4038108140 0x7f4038199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403f8fd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4038108ac0 0x7f403819e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403f8fd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4038112760 con 0x7f4038102740 2024-07-24T22:14:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403f8fd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f40381125e0 con 0x7f4038108ac0 2024-07-24T22:14:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403f8fd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f40381128e0 con 0x7f4038108140 2024-07-24T22:14:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403d699640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4038102740 0x7f4038198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403d699640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4038102740 0x7f4038198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58654/0 (socket says 172.21.15.47:58654) 2024-07-24T22:14:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403d699640 1 -- 172.21.15.47:0/1773945822 learned_addr learned my addr 172.21.15.47:0/1773945822 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403de9a640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4038108ac0 0x7f403819e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403ce98640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4038108140 0x7f4038199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403d699640 1 -- 172.21.15.47:0/1773945822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4038108140 msgr2=0x7f4038199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403d699640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4038108140 0x7f4038199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403d699640 1 -- 172.21.15.47:0/1773945822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4038108ac0 msgr2=0x7f403819e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403d699640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4038108ac0 0x7f403819e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403d699640 1 -- 172.21.15.47:0/1773945822 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403819ece0 con 0x7f4038102740 2024-07-24T22:14:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403d699640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4038102740 0x7f4038198c40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f403400c890 tx=0x7f403400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f402e7fc640 1 -- 172.21.15.47:0/1773945822 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4034004220 con 0x7f4038102740 2024-07-24T22:14:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f402e7fc640 1 -- 172.21.15.47:0/1773945822 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40340043c0 con 0x7f4038102740 2024-07-24T22:14:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f402e7fc640 1 -- 172.21.15.47:0/1773945822 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4034004a00 con 0x7f4038102740 2024-07-24T22:14:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403f8fd640 1 -- 172.21.15.47:0/1773945822 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f403819efd0 con 0x7f4038102740 2024-07-24T22:14:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.641+0000 7f403f8fd640 1 -- 172.21.15.47:0/1773945822 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40381a5690 con 0x7f4038102740 2024-07-24T22:14:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.644+0000 7f4042650740 1 Processor -- start 2024-07-24T22:14:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.644+0000 7f402e7fc640 1 -- 172.21.15.47:0/1773945822 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f40340079b0 con 0x7f4038102740 2024-07-24T22:14:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.644+0000 7f4042650740 1 -- start start 2024-07-24T22:14:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.644+0000 7f4042650740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078121ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.644+0000 7f4042650740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781221e0 0x562078132040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.644+0000 7f4042650740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562078132580 0x562078134970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.644+0000 7f4042650740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562078097280 con 0x5620781218c0 2024-07-24T22:14:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.644+0000 7f4042650740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562078086780 con 0x5620781221e0 2024-07-24T22:14:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.644+0000 7f4042650740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56207808a7c0 con 0x562078132580 2024-07-24T22:14:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.644+0000 7f403de9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078121ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.644+0000 7f403de9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078121ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58656/0 (socket says 172.21.15.47:58656) 2024-07-24T22:14:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.644+0000 7f403de9a640 1 -- 172.21.15.47:0/1239992808 learned_addr learned my addr 172.21.15.47:0/1239992808 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f403d699640 1 --2- 172.21.15.47:0/1239992808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781221e0 0x562078132040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f403de9a640 1 -- 172.21.15.47:0/1239992808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562078132580 msgr2=0x562078134970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f403de9a640 1 --2- 172.21.15.47:0/1239992808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562078132580 0x562078134970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f403de9a640 1 -- 172.21.15.47:0/1239992808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781221e0 msgr2=0x562078132040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f403de9a640 1 --2- 172.21.15.47:0/1239992808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781221e0 0x562078132040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f403de9a640 1 -- 172.21.15.47:0/1239992808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562077dea790 con 0x5620781218c0 2024-07-24T22:14:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f403d699640 1 --2- 172.21.15.47:0/1239992808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781221e0 0x562078132040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f402e7fc640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40240b3d40 0x7f40240b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f403de9a640 1 --2- 172.21.15.47:0/1239992808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078121ca0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f403002f4c0 tx=0x7f4030031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e950312b7a71485 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f403d699640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40240b3d40 0x7f40240b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f40237fe640 1 -- 172.21.15.47:0/1239992808 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4030031450 con 0x5620781218c0 2024-07-24T22:14:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f402e7fc640 1 -- 172.21.15.47:0/1773945822 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f40340e3db0 con 0x7f4038102740 2024-07-24T22:14:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f40237fe640 1 -- 172.21.15.47:0/1239992808 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4030036030 con 0x5620781218c0 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.645+0000 7f40237fe640 1 -- 172.21.15.47:0/1239992808 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4030004460 con 0x5620781218c0 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.646+0000 7f4042650740 1 -- 172.21.15.47:0/1239992808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 msgr2=0x562078121ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.646+0000 7f403d699640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40240b3d40 0x7f40240b6200 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f40340e1580 tx=0x7f4034092040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.646+0000 7f4042650740 1 --2- 172.21.15.47:0/1239992808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078121ca0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f403002f4c0 tx=0x7f4030031af0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.646+0000 7f4042650740 1 -- 172.21.15.47:0/1239992808 shutdown_connections 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.646+0000 7f4042650740 1 --2- 172.21.15.47:0/1239992808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562078132580 0x562078134970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.646+0000 7f4042650740 1 --2- 172.21.15.47:0/1239992808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781221e0 0x562078132040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.646+0000 7f4042650740 1 --2- 172.21.15.47:0/1239992808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078121ca0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.646+0000 7f4042650740 1 -- 172.21.15.47:0/1239992808 >> 172.21.15.47:0/1239992808 conn(0x56207811f6f0 msgr2=0x562078120890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.646+0000 7f4042650740 1 -- 172.21.15.47:0/1239992808 shutdown_connections 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.646+0000 7f4042650740 1 -- 172.21.15.47:0/1239992808 wait complete. 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.647+0000 7f4042650740 1 -- start start 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.647+0000 7f4042650740 1 Processor -- start 2024-07-24T22:14:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.647+0000 7f4042650740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078131c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.647+0000 7f4042650740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781221e0 0x56207812f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.647+0000 7f4042650740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562078132580 0x56207812f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.647+0000 7f4042650740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562077fc0ab0 con 0x5620781218c0 2024-07-24T22:14:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.647+0000 7f4042650740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56207800e9e0 con 0x5620781221e0 2024-07-24T22:14:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.647+0000 7f4042650740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562078135080 con 0x562078132580 2024-07-24T22:14:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.647+0000 7f4042650740 10 client.0 _ll_register_callbacks cb 0x562077d96a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.647+0000 7f403de9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078131c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.647+0000 7f403de9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078131c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58660/0 (socket says 172.21.15.47:58660) 2024-07-24T22:14:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.647+0000 7f403de9a640 1 -- 172.21.15.47:0/3548310337 learned_addr learned my addr 172.21.15.47:0/3548310337 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.647+0000 7f403ce98640 1 --2- 172.21.15.47:0/3548310337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781221e0 0x56207812f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f403de9a640 1 -- 172.21.15.47:0/3548310337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562078132580 msgr2=0x56207812f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f403de9a640 1 --2- 172.21.15.47:0/3548310337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562078132580 0x56207812f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f403de9a640 1 -- 172.21.15.47:0/3548310337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781221e0 msgr2=0x56207812f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f403de9a640 1 --2- 172.21.15.47:0/3548310337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781221e0 0x56207812f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f403de9a640 1 -- 172.21.15.47:0/3548310337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562077e63620 con 0x5620781218c0 2024-07-24T22:14:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f403de9a640 1 --2- 172.21.15.47:0/3548310337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078131c60 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4030004140 tx=0x7f4030031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fbecf0f911ed5e8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f4020ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f4020ff9640 1 -- 172.21.15.47:0/3548310337 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40300041e0 con 0x5620781218c0 2024-07-24T22:14:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f4020ff9640 1 -- 172.21.15.47:0/3548310337 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f4030004380 con 0x5620781218c0 2024-07-24T22:14:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f4042650740 1 -- 172.21.15.47:0/3548310337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562078035ce0 con 0x5620781218c0 2024-07-24T22:14:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f4020ff9640 1 -- 172.21.15.47:0/3548310337 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f403005d050 con 0x5620781218c0 2024-07-24T22:14:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f4042650740 10 client.17202 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f4042650740 1 -- 172.21.15.47:0/3548310337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5620781407b0 con 0x5620781218c0 2024-07-24T22:14:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.648+0000 7f4020ff9640 1 -- 172.21.15.47:0/3548310337 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562078035ce0 con 0x5620781218c0 2024-07-24T22:14:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.649+0000 7f4020ff9640 1 -- 172.21.15.47:0/3548310337 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f403004e070 con 0x5620781218c0 2024-07-24T22:14:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.649+0000 7f4042650740 10 client.17202 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.649+0000 7f4042650740 10 client.17202 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.649+0000 7f4042650740 20 client.17202 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.649+0000 7f4042650740 1 --2- 172.21.15.47:0/3548310337 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562078141b00 0x562078143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.649+0000 7f4042650740 4 client.17202 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.649+0000 7f4042650740 1 -- 172.21.15.47:0/3548310337 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620780991d0 con 0x562078141b00 2024-07-24T22:14:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.649+0000 7f403ce98640 1 --2- 172.21.15.47:0/3548310337 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562078141b00 0x562078143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.649+0000 7f403ce98640 1 --2- 172.21.15.47:0/3548310337 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562078141b00 0x562078143ef0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=850da91ef38013fc server_cookie=301011a81daec729 in_seq=0 out_seq=0 2024-07-24T22:14:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.649+0000 7f4020ff9640 10 client.17202 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.650+0000 7f4020ff9640 1 -- 172.21.15.47:0/3548310337 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620780991d0 con 0x562078141b00 2024-07-24T22:14:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.650+0000 7f4020ff9640 10 client.17202 handle_command_reply: tid=0 2024-07-24T22:14:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.650+0000 7f4042650740 1 client.17202 shutdown 2024-07-24T22:14:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.650+0000 7f4042650740 1 -- 172.21.15.47:0/3548310337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 msgr2=0x562078131c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.650+0000 7f4042650740 1 --2- 172.21.15.47:0/3548310337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078131c60 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4030004140 tx=0x7f4030031680 comp rx=0 tx=0).stop 2024-07-24T22:14:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.650+0000 7f4042650740 1 -- 172.21.15.47:0/3548310337 shutdown_connections 2024-07-24T22:14:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.650+0000 7f4042650740 1 --2- 172.21.15.47:0/3548310337 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562078141b00 0x562078143ef0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.650+0000 7f4042650740 1 --2- 172.21.15.47:0/3548310337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562078132580 0x56207812f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.650+0000 7f4042650740 1 --2- 172.21.15.47:0/3548310337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781221e0 0x56207812f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.650+0000 7f4042650740 1 --2- 172.21.15.47:0/3548310337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078131c60 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.650+0000 7f4020ff9640 0 client.17202 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.650+0000 7f4042650740 1 -- 172.21.15.47:0/3548310337 >> 172.21.15.47:0/3548310337 conn(0x56207811f6f0 msgr2=0x562078125290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.651+0000 7f4042650740 1 -- 172.21.15.47:0/3548310337 shutdown_connections 2024-07-24T22:14:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.651+0000 7f4042650740 1 -- 172.21.15.47:0/3548310337 wait complete. 2024-07-24T22:14:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.651+0000 7f4042650740 20 client.17202 trim_cache size 0 max 16384 2024-07-24T22:14:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.666+0000 7f4042650740 1 Processor -- start 2024-07-24T22:14:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.666+0000 7f4042650740 1 -- start start 2024-07-24T22:14:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.666+0000 7f4042650740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078134200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f4042650740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620781221e0 0x562078134740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f4042650740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562078132580 0x562078124a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f4042650740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40381a9f30 con 0x5620781218c0 2024-07-24T22:14:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f4042650740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f40381ac790 con 0x562078132580 2024-07-24T22:14:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f4042650740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f40381aa580 con 0x5620781221e0 2024-07-24T22:14:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f403de9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078134200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f403de9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078134200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58668/0 (socket says 172.21.15.47:58668) 2024-07-24T22:14:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f403de9a640 1 -- 172.21.15.47:0/220701412 learned_addr learned my addr 172.21.15.47:0/220701412 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f403de9a640 1 -- 172.21.15.47:0/220701412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620781221e0 msgr2=0x562078134740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f403de9a640 1 --2- 172.21.15.47:0/220701412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620781221e0 0x562078134740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f403de9a640 1 -- 172.21.15.47:0/220701412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562078132580 msgr2=0x562078124a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f403de9a640 1 --2- 172.21.15.47:0/220701412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562078132580 0x562078124a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f403de9a640 1 -- 172.21.15.47:0/220701412 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562078120160 con 0x5620781218c0 2024-07-24T22:14:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f403de9a640 1 --2- 172.21.15.47:0/220701412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078134200 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f403002ade0 tx=0x7f403002f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cf1c0829378084 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f4022ffd640 1 -- 172.21.15.47:0/220701412 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4030040020 con 0x5620781218c0 2024-07-24T22:14:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f4022ffd640 1 -- 172.21.15.47:0/220701412 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4030054070 con 0x5620781218c0 2024-07-24T22:14:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.667+0000 7f4022ffd640 1 -- 172.21.15.47:0/220701412 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4030030ec0 con 0x5620781218c0 2024-07-24T22:14:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.668+0000 7f4042650740 1 -- 172.21.15.47:0/220701412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 msgr2=0x562078134200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.668+0000 7f4042650740 1 --2- 172.21.15.47:0/220701412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078134200 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f403002ade0 tx=0x7f403002f4c0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.668+0000 7f4042650740 1 -- 172.21.15.47:0/220701412 shutdown_connections 2024-07-24T22:14:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.668+0000 7f4042650740 1 --2- 172.21.15.47:0/220701412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562078132580 0x562078124a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.668+0000 7f4042650740 1 --2- 172.21.15.47:0/220701412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620781221e0 0x562078134740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.668+0000 7f4042650740 1 --2- 172.21.15.47:0/220701412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620781218c0 0x562078134200 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.668+0000 7f4042650740 1 -- 172.21.15.47:0/220701412 >> 172.21.15.47:0/220701412 conn(0x56207811f6f0 msgr2=0x56207812d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.668+0000 7f4042650740 1 -- 172.21.15.47:0/220701412 shutdown_connections 2024-07-24T22:14:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.668+0000 7f4042650740 1 -- 172.21.15.47:0/220701412 wait complete. 2024-07-24T22:14:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.668+0000 7f4042650740 1 -- start start 2024-07-24T22:14:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.668+0000 7f4042650740 1 Processor -- start 2024-07-24T22:14:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f4042650740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781218c0 0x562078149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f4042650740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620781221e0 0x56207813a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f4042650740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562078132580 0x56207813a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f4042650740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40381aac50 con 0x562078132580 2024-07-24T22:14:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f4042650740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f40381ac0c0 con 0x5620781218c0 2024-07-24T22:14:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f4042650740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f40381ab320 con 0x5620781221e0 2024-07-24T22:14:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f4042650740 10 client.0 _ll_register_callbacks cb 0x7f4030003d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f403de9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562078132580 0x56207813a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f403de9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562078132580 0x56207813a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58680/0 (socket says 172.21.15.47:58680) 2024-07-24T22:14:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f403de9a640 1 -- 172.21.15.47:0/4176177663 learned_addr learned my addr 172.21.15.47:0/4176177663 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f403ce98640 1 --2- 172.21.15.47:0/4176177663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620781221e0 0x56207813a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f403de9a640 1 --2- 172.21.15.47:0/4176177663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781218c0 0x562078149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f403de9a640 1 -- 172.21.15.47:0/4176177663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620781221e0 msgr2=0x56207813a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f403de9a640 1 --2- 172.21.15.47:0/4176177663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620781221e0 0x56207813a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f403de9a640 1 -- 172.21.15.47:0/4176177663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781218c0 msgr2=0x562078149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f403de9a640 1 --2- 172.21.15.47:0/4176177663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781218c0 0x562078149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f403de9a640 1 -- 172.21.15.47:0/4176177663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562078148650 con 0x562078132580 2024-07-24T22:14:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f403de9a640 1 --2- 172.21.15.47:0/4176177663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562078132580 0x56207813a870 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4030009860 tx=0x7f4030030690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd03cbb3946f5e3 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f4020ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f4020ff9640 1 -- 172.21.15.47:0/4176177663 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4030040030 con 0x562078132580 2024-07-24T22:14:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f4020ff9640 1 -- 172.21.15.47:0/4176177663 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f4030004140 con 0x562078132580 2024-07-24T22:14:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.669+0000 7f4042650740 1 -- 172.21.15.47:0/4176177663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4030054070 con 0x562078132580 2024-07-24T22:14:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.670+0000 7f4020ff9640 1 -- 172.21.15.47:0/4176177663 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4030004340 con 0x562078132580 2024-07-24T22:14:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.670+0000 7f4042650740 10 client.17208 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.670+0000 7f4042650740 1 -- 172.21.15.47:0/4176177663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5620781ab870 con 0x562078132580 2024-07-24T22:14:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.670+0000 7f4020ff9640 1 -- 172.21.15.47:0/4176177663 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4030054070 con 0x562078132580 2024-07-24T22:14:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.670+0000 7f4020ff9640 1 -- 172.21.15.47:0/4176177663 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f403006a020 con 0x562078132580 2024-07-24T22:14:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.670+0000 7f4042650740 10 client.17208 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.670+0000 7f4042650740 10 client.17208 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.670+0000 7f4042650740 20 client.17208 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.670+0000 7f4042650740 1 --2- 172.21.15.47:0/4176177663 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5620781abed0 0x5620781ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.670+0000 7f4042650740 4 client.17208 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:14:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.670+0000 7f4042650740 1 -- 172.21.15.47:0/4176177663 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562078094c70 con 0x5620781abed0 2024-07-24T22:14:57.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:57 smithi047 ceph-mon[32551]: pgmap v602: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.670+0000 7f403ce98640 1 --2- 172.21.15.47:0/4176177663 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5620781abed0 0x5620781ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.671+0000 7f4020ff9640 10 client.17208 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.671+0000 7f403ce98640 1 --2- 172.21.15.47:0/4176177663 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5620781abed0 0x5620781ae2c0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bb79a95f72ed609 server_cookie=c7ea7ba947129767 in_seq=0 out_seq=0 2024-07-24T22:14:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4020ff9640 1 -- 172.21.15.47:0/4176177663 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562078094c70 con 0x5620781abed0 2024-07-24T22:14:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4020ff9640 10 client.17208 handle_command_reply: tid=0 2024-07-24T22:14:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4042650740 1 client.17208 shutdown 2024-07-24T22:14:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4042650740 1 -- 172.21.15.47:0/4176177663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562078132580 msgr2=0x56207813a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4042650740 1 --2- 172.21.15.47:0/4176177663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562078132580 0x56207813a870 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4030009860 tx=0x7f4030030690 comp rx=0 tx=0).stop 2024-07-24T22:14:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4042650740 1 -- 172.21.15.47:0/4176177663 shutdown_connections 2024-07-24T22:14:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4042650740 1 --2- 172.21.15.47:0/4176177663 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5620781abed0 0x5620781ae2c0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4042650740 1 --2- 172.21.15.47:0/4176177663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562078132580 0x56207813a870 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4042650740 1 --2- 172.21.15.47:0/4176177663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620781221e0 0x56207813a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4020ff9640 0 client.17208 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4042650740 1 --2- 172.21.15.47:0/4176177663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5620781218c0 0x562078149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4042650740 1 -- 172.21.15.47:0/4176177663 >> 172.21.15.47:0/4176177663 conn(0x56207811f6f0 msgr2=0x562078134200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4042650740 1 -- 172.21.15.47:0/4176177663 shutdown_connections 2024-07-24T22:14:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.676+0000 7f4042650740 1 -- 172.21.15.47:0/4176177663 wait complete. 2024-07-24T22:14:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.677+0000 7f4042650740 20 client.17208 trim_cache size 0 max 16384 2024-07-24T22:14:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:14:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:14:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:14:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:14:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.677+0000 7f403f8fd640 1 -- 172.21.15.47:0/1773945822 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40240b3d40 msgr2=0x7f40240b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.677+0000 7f403f8fd640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40240b3d40 0x7f40240b6200 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f40340e1580 tx=0x7f4034092040 comp rx=0 tx=0).stop 2024-07-24T22:14:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.677+0000 7f403f8fd640 1 -- 172.21.15.47:0/1773945822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4038102740 msgr2=0x7f4038198c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.677+0000 7f403f8fd640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4038102740 0x7f4038198c40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f403400c890 tx=0x7f403400cd50 comp rx=0 tx=0).stop 2024-07-24T22:14:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.677+0000 7f403f8fd640 1 -- 172.21.15.47:0/1773945822 shutdown_connections 2024-07-24T22:14:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.677+0000 7f403f8fd640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40240b3d40 0x7f40240b6200 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.677+0000 7f403f8fd640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4038108ac0 0x7f403819e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.677+0000 7f403f8fd640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4038108140 0x7f4038199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.677+0000 7f403f8fd640 1 --2- 172.21.15.47:0/1773945822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4038102740 0x7f4038198c40 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.677+0000 7f403f8fd640 1 -- 172.21.15.47:0/1773945822 >> 172.21.15.47:0/1773945822 conn(0x7f40380fe180 msgr2=0x7f4038100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.677+0000 7f403f8fd640 1 -- 172.21.15.47:0/1773945822 shutdown_connections 2024-07-24T22:14:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:14:57.677+0000 7f403f8fd640 1 -- 172.21.15.47:0/1773945822 wait complete. 2024-07-24T22:14:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:57 smithi188 ceph-mon[37380]: pgmap v602: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:57.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:57 smithi183 ceph-mon[37007]: pgmap v602: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:14:58.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.200+0000 7fadee477640 1 -- 172.21.15.47:0/1584851779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade8108b20 msgr2=0x7fade810f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.200+0000 7fadee477640 1 --2- 172.21.15.47:0/1584851779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade8108b20 0x7fade810f320 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fade0009ca0 tx=0x7fade002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.200+0000 7fadee477640 1 -- 172.21.15.47:0/1584851779 shutdown_connections 2024-07-24T22:14:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.200+0000 7fadee477640 1 --2- 172.21.15.47:0/1584851779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade8108b20 0x7fade810f320 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.200+0000 7fadee477640 1 --2- 172.21.15.47:0/1584851779 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fade81081a0 0x7fade81085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.200+0000 7fadee477640 1 --2- 172.21.15.47:0/1584851779 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fade8102790 0x7fade8102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.200+0000 7fadee477640 1 -- 172.21.15.47:0/1584851779 >> 172.21.15.47:0/1584851779 conn(0x7fade80fe200 msgr2=0x7fade8100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.200+0000 7fadee477640 1 -- 172.21.15.47:0/1584851779 shutdown_connections 2024-07-24T22:14:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.200+0000 7fadee477640 1 -- 172.21.15.47:0/1584851779 wait complete. 2024-07-24T22:14:58.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.201+0000 7fadee477640 1 Processor -- start 2024-07-24T22:14:58.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.201+0000 7fadee477640 1 -- start start 2024-07-24T22:14:58.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.201+0000 7fadee477640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fade8102790 0x7fade8074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.201+0000 7fadee477640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade81081a0 0x7fade80753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.201+0000 7fadee477640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fade8108b20 0x7fade8075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.201+0000 7fadee477640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fade8112740 con 0x7fade81081a0 2024-07-24T22:14:58.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.201+0000 7fadee477640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fade81125c0 con 0x7fade8108b20 2024-07-24T22:14:58.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.201+0000 7fadee477640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fade81128c0 con 0x7fade8102790 2024-07-24T22:14:58.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.201+0000 7fade77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade81081a0 0x7fade80753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fade77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade81081a0 0x7fade80753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58702/0 (socket says 172.21.15.47:58702) 2024-07-24T22:14:58.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fade77fe640 1 -- 172.21.15.47:0/1794975563 learned_addr learned my addr 172.21.15.47:0/1794975563 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:58.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fadeca14640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fade8108b20 0x7fade8075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fade7fff640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fade8102790 0x7fade8074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fade77fe640 1 -- 172.21.15.47:0/1794975563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fade8102790 msgr2=0x7fade8074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:58.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fade77fe640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fade8102790 0x7fade8074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fade77fe640 1 -- 172.21.15.47:0/1794975563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fade8108b20 msgr2=0x7fade8075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:58.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fade77fe640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fade8108b20 0x7fade8075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fade77fe640 1 -- 172.21.15.47:0/1794975563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade81a7030 con 0x7fade81081a0 2024-07-24T22:14:58.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fade7fff640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fade8102790 0x7fade8074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:58.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fadeca14640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fade8108b20 0x7fade8075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:58.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fade77fe640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade81081a0 0x7fade80753d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7faddc00d950 tx=0x7faddc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:58.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fade57fa640 1 -- 172.21.15.47:0/1794975563 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc017030 con 0x7fade81081a0 2024-07-24T22:14:58.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fade57fa640 1 -- 172.21.15.47:0/1794975563 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faddc004020 con 0x7fade81081a0 2024-07-24T22:14:58.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.202+0000 7fadee477640 1 -- 172.21.15.47:0/1794975563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade81a7320 con 0x7fade81081a0 2024-07-24T22:14:58.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.203+0000 7fade57fa640 1 -- 172.21.15.47:0/1794975563 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc0047a0 con 0x7fade81081a0 2024-07-24T22:14:58.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.203+0000 7fadee477640 1 -- 172.21.15.47:0/1794975563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade81a78b0 con 0x7fade81081a0 2024-07-24T22:14:58.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.205+0000 7fadf0828740 1 Processor -- start 2024-07-24T22:14:58.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.205+0000 7fadf0828740 1 -- start start 2024-07-24T22:14:58.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.205+0000 7fadf0828740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f676b0 0x564e35f67a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.205+0000 7fadf0828740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f73a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.205+0000 7fadf0828740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f73f60 0x564e35f76350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.205+0000 7fadf0828740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e35ede990 con 0x564e35f67fd0 2024-07-24T22:14:58.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.205+0000 7fadf0828740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564e35ecde90 con 0x564e35f73f60 2024-07-24T22:14:58.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.205+0000 7fadf0828740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564e35ed1ed0 con 0x564e35f676b0 2024-07-24T22:14:58.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.205+0000 7fade57fa640 1 -- 172.21.15.47:0/1794975563 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7faddc009a30 con 0x7fade81081a0 2024-07-24T22:14:58.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.205+0000 7fade7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f73a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.205+0000 7fade7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f73a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58704/0 (socket says 172.21.15.47:58704) 2024-07-24T22:14:58.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fade7fff640 1 -- 172.21.15.47:0/1859265546 learned_addr learned my addr 172.21.15.47:0/1859265546 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:58.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fade77fe640 1 --2- 172.21.15.47:0/1859265546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f73f60 0x564e35f76350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fadeca14640 1 --2- 172.21.15.47:0/1859265546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f676b0 0x564e35f67a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fade7fff640 1 -- 172.21.15.47:0/1859265546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f676b0 msgr2=0x564e35f67a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fade7fff640 1 --2- 172.21.15.47:0/1859265546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f676b0 0x564e35f67a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fade7fff640 1 -- 172.21.15.47:0/1859265546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f73f60 msgr2=0x564e35f76350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fade7fff640 1 --2- 172.21.15.47:0/1859265546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f73f60 0x564e35f76350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fade7fff640 1 -- 172.21.15.47:0/1859265546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e35e57300 con 0x564e35f67fd0 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fade77fe640 1 --2- 172.21.15.47:0/1859265546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f73f60 0x564e35f76350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fade7fff640 1 --2- 172.21.15.47:0/1859265546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f73a20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fadd800bd40 tx=0x7fadd800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc898ed023e3e2e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fadce7fc640 1 -- 172.21.15.47:0/1859265546 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8015070 con 0x564e35f67fd0 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fadce7fc640 1 -- 172.21.15.47:0/1859265546 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd800be30 con 0x564e35f67fd0 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fade57fa640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fadd00b3dc0 0x7fadd00b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.206+0000 7fadce7fc640 1 -- 172.21.15.47:0/1859265546 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8011980 con 0x564e35f67fd0 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.207+0000 7fadeca14640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fadd00b3dc0 0x7fadd00b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.207+0000 7fade57fa640 1 -- 172.21.15.47:0/1794975563 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7faddc0e3b00 con 0x7fade81081a0 2024-07-24T22:14:58.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.207+0000 7fadf0828740 1 -- 172.21.15.47:0/1859265546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 msgr2=0x564e35f73a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:58.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.207+0000 7fadeca14640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fadd00b3dc0 0x7fadd00b6280 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fade0005fa0 tx=0x7fade0009360 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:58.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.207+0000 7fadf0828740 1 --2- 172.21.15.47:0/1859265546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f73a20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fadd800bd40 tx=0x7fadd800f730 comp rx=0 tx=0).stop 2024-07-24T22:14:58.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.207+0000 7fadf0828740 1 -- 172.21.15.47:0/1859265546 shutdown_connections 2024-07-24T22:14:58.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.207+0000 7fadf0828740 1 --2- 172.21.15.47:0/1859265546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f73f60 0x564e35f76350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.207+0000 7fadf0828740 1 --2- 172.21.15.47:0/1859265546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f73a20 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.207+0000 7fadf0828740 1 --2- 172.21.15.47:0/1859265546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f676b0 0x564e35f67a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.207+0000 7fadf0828740 1 -- 172.21.15.47:0/1859265546 >> 172.21.15.47:0/1859265546 conn(0x564e35f654e0 msgr2=0x564e35f66680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:58.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.207+0000 7fadf0828740 1 -- 172.21.15.47:0/1859265546 shutdown_connections 2024-07-24T22:14:58.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.207+0000 7fadf0828740 1 -- 172.21.15.47:0/1859265546 wait complete. 2024-07-24T22:14:58.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fadf0828740 1 -- start start 2024-07-24T22:14:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fadf0828740 1 Processor -- start 2024-07-24T22:14:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fadf0828740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 0x564e35f73a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fadf0828740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f70e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fadf0828740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f73f60 0x564e35f71600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fadf0828740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e35d31700 con 0x564e35f67fd0 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fadf0828740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564e35e705d0 con 0x564e35f676b0 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fadf0828740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564e35f76be0 con 0x564e35f73f60 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fadf0828740 10 client.0 _ll_register_callbacks cb 0x564e35e90940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fade77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f70e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fade77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f70e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58710/0 (socket says 172.21.15.47:58710) 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fade77fe640 1 -- 172.21.15.47:0/3001800842 learned_addr learned my addr 172.21.15.47:0/3001800842 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fade7fff640 1 --2- 172.21.15.47:0/3001800842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 0x564e35f73a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.208+0000 7fadeca14640 1 --2- 172.21.15.47:0/3001800842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f73f60 0x564e35f71600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fade77fe640 1 -- 172.21.15.47:0/3001800842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f73f60 msgr2=0x564e35f71600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fade77fe640 1 --2- 172.21.15.47:0/3001800842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f73f60 0x564e35f71600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fade77fe640 1 -- 172.21.15.47:0/3001800842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 msgr2=0x564e35f73a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fade77fe640 1 --2- 172.21.15.47:0/3001800842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 0x564e35f73a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fade77fe640 1 -- 172.21.15.47:0/3001800842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e35e63660 con 0x564e35f67fd0 2024-07-24T22:14:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fade77fe640 1 --2- 172.21.15.47:0/3001800842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f70e70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7faddc0aa3e0 tx=0x7faddc009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1871b01740fba0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fadc77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fadc77fe640 1 -- 172.21.15.47:0/3001800842 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc0aade0 con 0x564e35f67fd0 2024-07-24T22:14:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fadc77fe640 1 -- 172.21.15.47:0/3001800842 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7faddc0a4e00 con 0x564e35f67fd0 2024-07-24T22:14:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fadf0828740 1 -- 172.21.15.47:0/3001800842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadd800be30 con 0x564e35f67fd0 2024-07-24T22:14:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fadc77fe640 1 -- 172.21.15.47:0/3001800842 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7faddc0aa6e0 con 0x564e35f67fd0 2024-07-24T22:14:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fadf0828740 10 client.17220 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fadf0828740 1 -- 172.21.15.47:0/3001800842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564e35c2e650 con 0x564e35f67fd0 2024-07-24T22:14:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.209+0000 7fadc77fe640 1 -- 172.21.15.47:0/3001800842 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faddc0aece0 con 0x564e35f67fd0 2024-07-24T22:14:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.210+0000 7fadc77fe640 1 -- 172.21.15.47:0/3001800842 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7faddc0a6970 con 0x564e35f67fd0 2024-07-24T22:14:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.210+0000 7fadf0828740 10 client.17220 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.210+0000 7fadf0828740 10 client.17220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.210+0000 7fadf0828740 20 client.17220 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.210+0000 7fadf0828740 1 --2- 172.21.15.47:0/3001800842 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e35f83a80 0x564e35f85e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.210+0000 7fadf0828740 4 client.17220 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:14:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.210+0000 7fadf0828740 1 -- 172.21.15.47:0/3001800842 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fadd800be30 con 0x564e35f83a80 2024-07-24T22:14:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.210+0000 7fade7fff640 1 --2- 172.21.15.47:0/3001800842 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e35f83a80 0x564e35f85e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.211+0000 7fade7fff640 1 --2- 172.21.15.47:0/3001800842 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e35f83a80 0x564e35f85e70 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=820d56616b10ebfb server_cookie=c14c7a6e02c50490 in_seq=0 out_seq=0 2024-07-24T22:14:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.211+0000 7fadc77fe640 10 client.17220 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.211+0000 7fadc77fe640 1 -- 172.21.15.47:0/3001800842 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fadd800be30 con 0x564e35f83a80 2024-07-24T22:14:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.211+0000 7fadc77fe640 10 client.17220 handle_command_reply: tid=0 2024-07-24T22:14:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.212+0000 7fadf0828740 1 client.17220 shutdown 2024-07-24T22:14:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.212+0000 7fadf0828740 1 -- 172.21.15.47:0/3001800842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 msgr2=0x564e35f70e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.212+0000 7fadf0828740 1 --2- 172.21.15.47:0/3001800842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f70e70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7faddc0aa3e0 tx=0x7faddc009f50 comp rx=0 tx=0).stop 2024-07-24T22:14:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.212+0000 7fadf0828740 1 -- 172.21.15.47:0/3001800842 shutdown_connections 2024-07-24T22:14:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.212+0000 7fadf0828740 1 --2- 172.21.15.47:0/3001800842 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e35f83a80 0x564e35f85e70 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.212+0000 7fadf0828740 1 --2- 172.21.15.47:0/3001800842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f73f60 0x564e35f71600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.212+0000 7fadf0828740 1 --2- 172.21.15.47:0/3001800842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f70e70 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.212+0000 7fadc77fe640 0 client.17220 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:58.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.212+0000 7fadf0828740 1 --2- 172.21.15.47:0/3001800842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 0x564e35f73a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.212+0000 7fadf0828740 1 -- 172.21.15.47:0/3001800842 >> 172.21.15.47:0/3001800842 conn(0x564e35f654e0 msgr2=0x564e35f6b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:58.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.212+0000 7fadf0828740 1 -- 172.21.15.47:0/3001800842 shutdown_connections 2024-07-24T22:14:58.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.212+0000 7fadf0828740 1 -- 172.21.15.47:0/3001800842 wait complete. 2024-07-24T22:14:58.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.212+0000 7fadf0828740 20 client.17220 trim_cache size 0 max 16384 2024-07-24T22:14:58.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.230+0000 7fadf0828740 1 Processor -- start 2024-07-24T22:14:58.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.230+0000 7fadf0828740 1 -- start start 2024-07-24T22:14:58.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fadf0828740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 0x564e35f66cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fadf0828740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f6b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fadf0828740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f73f60 0x564e35f8b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fadf0828740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fade81ae430 con 0x564e35f67fd0 2024-07-24T22:14:58.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fadf0828740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fade81b0c90 con 0x564e35f676b0 2024-07-24T22:14:58.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fadf0828740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fade81aea80 con 0x564e35f73f60 2024-07-24T22:14:58.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fade77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f6b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fade77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f6b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58720/0 (socket says 172.21.15.47:58720) 2024-07-24T22:14:58.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fade77fe640 1 -- 172.21.15.47:0/1731424847 learned_addr learned my addr 172.21.15.47:0/1731424847 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:58.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fade77fe640 1 -- 172.21.15.47:0/1731424847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f73f60 msgr2=0x564e35f8b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:58.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fade77fe640 1 --2- 172.21.15.47:0/1731424847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f73f60 0x564e35f8b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fade77fe640 1 -- 172.21.15.47:0/1731424847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 msgr2=0x564e35f66cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:58.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fade7fff640 1 --2- 172.21.15.47:0/1731424847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 0x564e35f66cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fade77fe640 1 --2- 172.21.15.47:0/1731424847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 0x564e35f66cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fade77fe640 1 -- 172.21.15.47:0/1731424847 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e35f71970 con 0x564e35f67fd0 2024-07-24T22:14:58.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fade7fff640 1 --2- 172.21.15.47:0/1731424847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 0x564e35f66cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:14:58.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fade77fe640 1 --2- 172.21.15.47:0/1731424847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f6b800 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7faddc0e1820 tx=0x7faddc0aaae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1ee7d09b900979 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:58.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fadcdffb640 1 -- 172.21.15.47:0/1731424847 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc0aa4b0 con 0x564e35f67fd0 2024-07-24T22:14:58.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fadcdffb640 1 -- 172.21.15.47:0/1731424847 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faddc0aade0 con 0x564e35f67fd0 2024-07-24T22:14:58.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.231+0000 7fadcdffb640 1 -- 172.21.15.47:0/1731424847 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc0a6a40 con 0x564e35f67fd0 2024-07-24T22:14:58.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.232+0000 7fadf0828740 1 -- 172.21.15.47:0/1731424847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 msgr2=0x564e35f6b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:58.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.232+0000 7fadf0828740 1 --2- 172.21.15.47:0/1731424847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f6b800 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7faddc0e1820 tx=0x7faddc0aaae0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.232+0000 7fadf0828740 1 -- 172.21.15.47:0/1731424847 shutdown_connections 2024-07-24T22:14:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.232+0000 7fadf0828740 1 --2- 172.21.15.47:0/1731424847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f73f60 0x564e35f8b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.232+0000 7fadf0828740 1 --2- 172.21.15.47:0/1731424847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f67fd0 0x564e35f6b800 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.232+0000 7fadf0828740 1 --2- 172.21.15.47:0/1731424847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 0x564e35f66cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.232+0000 7fadf0828740 1 -- 172.21.15.47:0/1731424847 >> 172.21.15.47:0/1731424847 conn(0x564e35f654e0 msgr2=0x564e35f72ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.232+0000 7fadf0828740 1 -- 172.21.15.47:0/1731424847 shutdown_connections 2024-07-24T22:14:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.232+0000 7fadf0828740 1 -- 172.21.15.47:0/1731424847 wait complete. 2024-07-24T22:14:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.232+0000 7fadf0828740 1 -- start start 2024-07-24T22:14:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.233+0000 7fadf0828740 1 Processor -- start 2024-07-24T22:14:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.233+0000 7fadf0828740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 0x564e35f77dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.233+0000 7fadf0828740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f67fd0 0x564e35f78300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.233+0000 7fadf0828740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f73f60 0x564e35f78840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.233+0000 7fadf0828740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fade81af150 con 0x564e35f73f60 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.233+0000 7fadf0828740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fade81b05c0 con 0x564e35f676b0 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.233+0000 7fadf0828740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fade81af820 con 0x564e35f67fd0 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.233+0000 7fadf0828740 10 client.0 _ll_register_callbacks cb 0x7faddc0a6610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.233+0000 7fadeca14640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f73f60 0x564e35f78840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.233+0000 7fadeca14640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f73f60 0x564e35f78840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58726/0 (socket says 172.21.15.47:58726) 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.233+0000 7fadeca14640 1 -- 172.21.15.47:0/3903841565 learned_addr learned my addr 172.21.15.47:0/3903841565 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.233+0000 7fade7fff640 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 0x564e35f77dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.233+0000 7fade77fe640 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f67fd0 0x564e35f78300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadeca14640 1 -- 172.21.15.47:0/3903841565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f67fd0 msgr2=0x564e35f78300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadeca14640 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f67fd0 0x564e35f78300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadeca14640 1 -- 172.21.15.47:0/3903841565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 msgr2=0x564e35f77dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadeca14640 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 0x564e35f77dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadeca14640 1 -- 172.21.15.47:0/3903841565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e35fed790 con 0x564e35f73f60 2024-07-24T22:14:58.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fade77fe640 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f67fd0 0x564e35f78300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadeca14640 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f73f60 0x564e35f78840 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fade0009ca0 tx=0x7fade00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a000034ac1b2c458 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadc77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadc77fe640 1 -- 172.21.15.47:0/3903841565 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade002f860 con 0x564e35f73f60 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadc77fe640 1 -- 172.21.15.47:0/3903841565 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7fade002fa00 con 0x564e35f73f60 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadf0828740 1 -- 172.21.15.47:0/3903841565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faddc0aade0 con 0x564e35f73f60 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadc77fe640 1 -- 172.21.15.47:0/3903841565 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fade002fc00 con 0x564e35f73f60 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadf0828740 10 client.17226 fetch_fsmap learned FSMap version 20 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadf0828740 1 -- 172.21.15.47:0/3903841565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564e35feea10 con 0x564e35f73f60 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.234+0000 7fadc77fe640 1 -- 172.21.15.47:0/3903841565 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faddc0aade0 con 0x564e35f73f60 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.235+0000 7fadc77fe640 1 -- 172.21.15.47:0/3903841565 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fade0044040 con 0x564e35f73f60 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.235+0000 7fadf0828740 10 client.17226 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.235+0000 7fadf0828740 10 client.17226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.235+0000 7fadf0828740 20 client.17226 populate_metadata read hostname 'smithi047' 2024-07-24T22:14:58.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.235+0000 7fadf0828740 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e35fef240 0x564e35ff1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:14:58.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.235+0000 7fadf0828740 4 client.17226 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:14:58.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.235+0000 7fadf0828740 1 -- 172.21.15.47:0/3903841565 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564e35ee08e0 con 0x564e35fef240 2024-07-24T22:14:58.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.235+0000 7fade7fff640 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e35fef240 0x564e35ff1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:14:58.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.235+0000 7fade7fff640 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e35fef240 0x564e35ff1660 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56d1f551893afdb6 server_cookie=f65ccba8330de70d in_seq=0 out_seq=0 2024-07-24T22:14:58.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.235+0000 7fadc77fe640 10 client.17226 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:58.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadc77fe640 1 -- 172.21.15.47:0/3903841565 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564e35ee08e0 con 0x564e35fef240 2024-07-24T22:14:58.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadc77fe640 10 client.17226 handle_command_reply: tid=0 2024-07-24T22:14:58.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadf0828740 1 client.17226 shutdown 2024-07-24T22:14:58.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadf0828740 1 -- 172.21.15.47:0/3903841565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f73f60 msgr2=0x564e35f78840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:58.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadf0828740 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f73f60 0x564e35f78840 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fade0009ca0 tx=0x7fade00095c0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadf0828740 1 -- 172.21.15.47:0/3903841565 shutdown_connections 2024-07-24T22:14:58.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadf0828740 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x564e35fef240 0x564e35ff1660 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadf0828740 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e35f73f60 0x564e35f78840 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadf0828740 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564e35f67fd0 0x564e35f78300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadc77fe640 0 client.17226 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:14:58.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadf0828740 1 --2- 172.21.15.47:0/3903841565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564e35f676b0 0x564e35f77dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadf0828740 1 -- 172.21.15.47:0/3903841565 >> 172.21.15.47:0/3903841565 conn(0x564e35f654e0 msgr2=0x564e35f6f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:58.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadf0828740 1 -- 172.21.15.47:0/3903841565 shutdown_connections 2024-07-24T22:14:58.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadf0828740 1 -- 172.21.15.47:0/3903841565 wait complete. 2024-07-24T22:14:58.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.236+0000 7fadf0828740 20 client.17226 trim_cache size 0 max 16384 2024-07-24T22:14:58.243 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:14:58.243 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-07-24T22:14:58.243 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-07-24T22:14:58.244 INFO:teuthology.orchestra.run.smithi047.stdout: "ff9e73f2-01f3-49f0-ab3c-64d87ebf6559": { 2024-07-24T22:14:58.244 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-07-24T22:14:58.244 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "ff9e73f2-01f3-49f0-ab3c-64d87ebf6559", 2024-07-24T22:14:58.244 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-07-24T22:14:58.244 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:58.244 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:14:58.244 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:14:58.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.237+0000 7fadee477640 1 -- 172.21.15.47:0/1794975563 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fadd00b3dc0 msgr2=0x7fadd00b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:58.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.237+0000 7fadee477640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fadd00b3dc0 0x7fadd00b6280 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fade0005fa0 tx=0x7fade0009360 comp rx=0 tx=0).stop 2024-07-24T22:14:58.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.237+0000 7fadee477640 1 -- 172.21.15.47:0/1794975563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade81081a0 msgr2=0x7fade80753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:14:58.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.237+0000 7fadee477640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade81081a0 0x7fade80753d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7faddc00d950 tx=0x7faddc00de10 comp rx=0 tx=0).stop 2024-07-24T22:14:58.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.237+0000 7fadee477640 1 -- 172.21.15.47:0/1794975563 shutdown_connections 2024-07-24T22:14:58.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.237+0000 7fadee477640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fadd00b3dc0 0x7fadd00b6280 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.237+0000 7fadee477640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fade8108b20 0x7fade8075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.237+0000 7fadee477640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade81081a0 0x7fade80753d0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.237+0000 7fadee477640 1 --2- 172.21.15.47:0/1794975563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fade8102790 0x7fade8074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:14:58.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.237+0000 7fadee477640 1 -- 172.21.15.47:0/1794975563 >> 172.21.15.47:0/1794975563 conn(0x7fade80fe200 msgr2=0x7fade81005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:14:58.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.237+0000 7fadee477640 1 -- 172.21.15.47:0/1794975563 shutdown_connections 2024-07-24T22:14:58.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:14:58.237+0000 7fadee477640 1 -- 172.21.15.47:0/1794975563 wait complete. 2024-07-24T22:14:58.893 INFO:tasks.cephfs.filesystem:scrub status for tag:ff9e73f2-01f3-49f0-ab3c-64d87ebf6559 - {'path': '/', 'tag': 'ff9e73f2-01f3-49f0-ab3c-64d87ebf6559', 'options': 'recursive,force'} 2024-07-24T22:14:59.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:14:59 smithi047 ceph-mon[32551]: pgmap v603: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:14:59.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:14:59 smithi188 ceph-mon[37380]: pgmap v603: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:14:59.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:14:59 smithi183 ceph-mon[37007]: pgmap v603: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:15:00.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:00 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:15:00.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:00 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:15:00.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:00 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:15:01.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:01 smithi047 ceph-mon[32551]: pgmap v604: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-07-24T22:15:01.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:01 smithi188 ceph-mon[37380]: pgmap v604: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-07-24T22:15:01.813 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:01 smithi183 ceph-mon[37007]: pgmap v604: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 3.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-07-24T22:15:03.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:03 smithi047 ceph-mon[32551]: pgmap v605: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-07-24T22:15:03.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:03 smithi188 ceph-mon[37380]: pgmap v605: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-07-24T22:15:03.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:03 smithi183 ceph-mon[37007]: pgmap v605: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-07-24T22:15:05.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:05 smithi047 ceph-mon[32551]: pgmap v606: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-07-24T22:15:05.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:05 smithi188 ceph-mon[37380]: pgmap v606: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-07-24T22:15:05.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:05 smithi183 ceph-mon[37007]: pgmap v606: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-07-24T22:15:07.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:07 smithi047 ceph-mon[32551]: pgmap v607: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 21 op/s 2024-07-24T22:15:07.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:07 smithi188 ceph-mon[37380]: pgmap v607: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 21 op/s 2024-07-24T22:15:07.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:07 smithi183 ceph-mon[37007]: pgmap v607: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 21 op/s 2024-07-24T22:15:09.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:09 smithi047 ceph-mon[32551]: pgmap v608: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-07-24T22:15:09.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:09 smithi188 ceph-mon[37380]: pgmap v608: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-07-24T22:15:09.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:09 smithi183 ceph-mon[37007]: pgmap v608: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-07-24T22:15:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.790+0000 7f816bea9640 1 -- 172.21.15.47:0/3935602973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81641015a0 msgr2=0x7f8164101980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.790+0000 7f816bea9640 1 --2- 172.21.15.47:0/3935602973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81641015a0 0x7f8164101980 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f8160009900 tx=0x7f816002a410 comp rx=0 tx=0).stop 2024-07-24T22:15:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.791+0000 7f816bea9640 1 -- 172.21.15.47:0/3935602973 shutdown_connections 2024-07-24T22:15:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.791+0000 7f816bea9640 1 --2- 172.21.15.47:0/3935602973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8164107920 0x7f816410e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.791+0000 7f816bea9640 1 --2- 172.21.15.47:0/3935602973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8164106fa0 0x7f81641073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.791+0000 7f816bea9640 1 --2- 172.21.15.47:0/3935602973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81641015a0 0x7f8164101980 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.791+0000 7f816bea9640 1 -- 172.21.15.47:0/3935602973 >> 172.21.15.47:0/3935602973 conn(0x7f81640fd000 msgr2=0x7f81640ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.791+0000 7f816bea9640 1 -- 172.21.15.47:0/3935602973 shutdown_connections 2024-07-24T22:15:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.791+0000 7f816bea9640 1 -- 172.21.15.47:0/3935602973 wait complete. 2024-07-24T22:15:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.791+0000 7f816bea9640 1 Processor -- start 2024-07-24T22:15:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.791+0000 7f816bea9640 1 -- start start 2024-07-24T22:15:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f816bea9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81641015a0 0x7f816419add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f816bea9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8164106fa0 0x7f816419b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f816bea9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8164107920 0x7f81641a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f816bea9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f81641104e0 con 0x7f81641015a0 2024-07-24T22:15:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f816bea9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8164110360 con 0x7f8164106fa0 2024-07-24T22:15:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f816bea9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8164110660 con 0x7f8164107920 2024-07-24T22:15:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f8169c45640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81641015a0 0x7f816419add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f8169c45640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81641015a0 0x7f816419add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57114/0 (socket says 172.21.15.47:57114) 2024-07-24T22:15:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f8169c45640 1 -- 172.21.15.47:0/287198263 learned_addr learned my addr 172.21.15.47:0/287198263 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f8169444640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8164106fa0 0x7f816419b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f816a446640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8164107920 0x7f81641a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f8169c45640 1 -- 172.21.15.47:0/287198263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8164107920 msgr2=0x7f81641a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f8169c45640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8164107920 0x7f81641a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f8169c45640 1 -- 172.21.15.47:0/287198263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8164106fa0 msgr2=0x7f816419b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f8169c45640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8164106fa0 0x7f816419b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f8169c45640 1 -- 172.21.15.47:0/287198263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81641a0e70 con 0x7f81641015a0 2024-07-24T22:15:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.792+0000 7f8169c45640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81641015a0 0x7f816419add0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f8160005940 tx=0x7f81600040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.793+0000 7f815affd640 1 -- 172.21.15.47:0/287198263 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816003f030 con 0x7f81641015a0 2024-07-24T22:15:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.793+0000 7f815affd640 1 -- 172.21.15.47:0/287198263 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81600044c0 con 0x7f81641015a0 2024-07-24T22:15:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.793+0000 7f816bea9640 1 -- 172.21.15.47:0/287198263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81641a1100 con 0x7f81641015a0 2024-07-24T22:15:10.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.793+0000 7f815affd640 1 -- 172.21.15.47:0/287198263 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8160035070 con 0x7f81641015a0 2024-07-24T22:15:10.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.793+0000 7f816bea9640 1 -- 172.21.15.47:0/287198263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81641a7820 con 0x7f81641015a0 2024-07-24T22:15:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.795+0000 7f815affd640 1 -- 172.21.15.47:0/287198263 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8160042030 con 0x7f81641015a0 2024-07-24T22:15:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.795+0000 7f816ebfe740 1 Processor -- start 2024-07-24T22:15:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f816ebfe740 1 -- start start 2024-07-24T22:15:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f816ebfe740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d4d8c0 0x560796d4dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f816ebfe740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d59c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f816ebfe740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d5a170 0x560796d5c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f816ebfe740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560796cc3280 con 0x560796d4e1e0 2024-07-24T22:15:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f816ebfe740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560796cb2780 con 0x560796d5a170 2024-07-24T22:15:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f816ebfe740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x560796cb67c0 con 0x560796d4d8c0 2024-07-24T22:15:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f8169c45640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d59c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f8169c45640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d59c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57118/0 (socket says 172.21.15.47:57118) 2024-07-24T22:15:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f8169c45640 1 -- 172.21.15.47:0/308817276 learned_addr learned my addr 172.21.15.47:0/308817276 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f816a446640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d4d8c0 0x560796d4dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f815affd640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81500b3d40 0x7f81500b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f8169444640 1 --2- 172.21.15.47:0/308817276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d5a170 0x560796d5c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f816a446640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81500b3d40 0x7f81500b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.796+0000 7f815affd640 1 -- 172.21.15.47:0/287198263 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8609+0+0 (secure 0 0 0) 0x7f8160104380 con 0x7f81641015a0 2024-07-24T22:15:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.797+0000 7f8169c45640 1 -- 172.21.15.47:0/308817276 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d4d8c0 msgr2=0x560796d4dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.797+0000 7f8169c45640 1 --2- 172.21.15.47:0/308817276 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d4d8c0 0x560796d4dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.797+0000 7f8169c45640 1 -- 172.21.15.47:0/308817276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d5a170 msgr2=0x560796d5c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.797+0000 7f8169c45640 1 --2- 172.21.15.47:0/308817276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d5a170 0x560796d5c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.797+0000 7f8169c45640 1 -- 172.21.15.47:0/308817276 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560796a16790 con 0x560796d4e1e0 2024-07-24T22:15:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.797+0000 7f8169444640 1 --2- 172.21.15.47:0/308817276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d5a170 0x560796d5c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:15:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.797+0000 7f8169c45640 1 --2- 172.21.15.47:0/308817276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d59c30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f81601019e0 tx=0x7f816002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8aa49b5c528ac6 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.797+0000 7f816a446640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81500b3d40 0x7f81500b6200 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f815c00bfd0 tx=0x7f815c004ab0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.797+0000 7f814ffff640 1 -- 172.21.15.47:0/308817276 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8160049070 con 0x560796d4e1e0 2024-07-24T22:15:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.797+0000 7f814ffff640 1 -- 172.21.15.47:0/308817276 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81600caaf0 con 0x560796d4e1e0 2024-07-24T22:15:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.797+0000 7f814ffff640 1 -- 172.21.15.47:0/308817276 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81600cb240 con 0x560796d4e1e0 2024-07-24T22:15:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.798+0000 7f816ebfe740 1 -- 172.21.15.47:0/308817276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 msgr2=0x560796d59c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.798+0000 7f816ebfe740 1 --2- 172.21.15.47:0/308817276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d59c30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f81601019e0 tx=0x7f816002a410 comp rx=0 tx=0).stop 2024-07-24T22:15:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.798+0000 7f816ebfe740 1 -- 172.21.15.47:0/308817276 shutdown_connections 2024-07-24T22:15:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.798+0000 7f816ebfe740 1 --2- 172.21.15.47:0/308817276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d5a170 0x560796d5c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.798+0000 7f816ebfe740 1 --2- 172.21.15.47:0/308817276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d59c30 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.798+0000 7f816ebfe740 1 --2- 172.21.15.47:0/308817276 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d4d8c0 0x560796d4dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.798+0000 7f816ebfe740 1 -- 172.21.15.47:0/308817276 >> 172.21.15.47:0/308817276 conn(0x560796d4b6f0 msgr2=0x560796d4c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.798+0000 7f816ebfe740 1 -- 172.21.15.47:0/308817276 shutdown_connections 2024-07-24T22:15:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.798+0000 7f816ebfe740 1 -- 172.21.15.47:0/308817276 wait complete. 2024-07-24T22:15:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.798+0000 7f816ebfe740 1 -- start start 2024-07-24T22:15:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.798+0000 7f816ebfe740 1 Processor -- start 2024-07-24T22:15:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f816ebfe740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4d8c0 0x560796d59930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f816ebfe740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d56e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f816ebfe740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d5a170 0x560796d57350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f816ebfe740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560796becab0 con 0x560796d4e1e0 2024-07-24T22:15:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f816ebfe740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560796c3a9e0 con 0x560796d4d8c0 2024-07-24T22:15:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f816ebfe740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x560796cc3280 con 0x560796d5a170 2024-07-24T22:15:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f816ebfe740 10 client.0 _ll_register_callbacks cb 0x5607969c2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f8169444640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d56e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f8169c45640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4d8c0 0x560796d59930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f8169444640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d56e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57128/0 (socket says 172.21.15.47:57128) 2024-07-24T22:15:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f8169444640 1 -- 172.21.15.47:0/3335784901 learned_addr learned my addr 172.21.15.47:0/3335784901 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f816a446640 1 --2- 172.21.15.47:0/3335784901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d5a170 0x560796d57350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f8169444640 1 -- 172.21.15.47:0/3335784901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d5a170 msgr2=0x560796d57350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f8169444640 1 --2- 172.21.15.47:0/3335784901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d5a170 0x560796d57350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f8169444640 1 -- 172.21.15.47:0/3335784901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4d8c0 msgr2=0x560796d59930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f8169444640 1 --2- 172.21.15.47:0/3335784901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4d8c0 0x560796d59930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f8169444640 1 -- 172.21.15.47:0/3335784901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560796a8f620 con 0x560796d4e1e0 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f8169444640 1 --2- 172.21.15.47:0/3335784901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d56e10 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8154012740 tx=0x7f8154012b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd499479fe58ca2 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f814d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f814d7fa640 1 -- 172.21.15.47:0/3335784901 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154004030 con 0x560796d4e1e0 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f816ebfe740 1 -- 172.21.15.47:0/3335784901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560796c61ce0 con 0x560796d4e1e0 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.799+0000 7f814d7fa640 1 -- 172.21.15.47:0/3335784901 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8609+0+0 (secure 0 0 0) 0x7f81540041d0 con 0x560796d4e1e0 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.800+0000 7f814d7fa640 1 -- 172.21.15.47:0/3335784901 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f81540043d0 con 0x560796d4e1e0 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.800+0000 7f816ebfe740 10 client.17238 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.800+0000 7f816ebfe740 1 -- 172.21.15.47:0/3335784901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560796d68350 con 0x560796d4e1e0 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.800+0000 7f814d7fa640 1 -- 172.21.15.47:0/3335784901 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560796c61ce0 con 0x560796d4e1e0 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.800+0000 7f814d7fa640 1 -- 172.21.15.47:0/3335784901 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8154003c10 con 0x560796d4e1e0 2024-07-24T22:15:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.800+0000 7f816ebfe740 10 client.17238 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.800+0000 7f816ebfe740 10 client.17238 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.800+0000 7f816ebfe740 20 client.17238 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.800+0000 7f816ebfe740 1 --2- 172.21.15.47:0/3335784901 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560796d697c0 0x560796d6bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.800+0000 7f816ebfe740 4 client.17238 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:15:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.800+0000 7f816ebfe740 1 -- 172.21.15.47:0/3335784901 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560796cc51d0 con 0x560796d697c0 2024-07-24T22:15:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.800+0000 7f8169c45640 1 --2- 172.21.15.47:0/3335784901 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560796d697c0 0x560796d6bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.801+0000 7f8169c45640 1 --2- 172.21.15.47:0/3335784901 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560796d697c0 0x560796d6bbb0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b45a034c31d3503 server_cookie=a847cd44e2ce5ec0 in_seq=0 out_seq=0 2024-07-24T22:15:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.801+0000 7f814d7fa640 10 client.17238 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.801+0000 7f814d7fa640 1 -- 172.21.15.47:0/3335784901 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560796cc51d0 con 0x560796d697c0 2024-07-24T22:15:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.801+0000 7f814d7fa640 10 client.17238 handle_command_reply: tid=0 2024-07-24T22:15:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.801+0000 7f816ebfe740 1 client.17238 shutdown 2024-07-24T22:15:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.801+0000 7f816ebfe740 1 -- 172.21.15.47:0/3335784901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 msgr2=0x560796d56e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.801+0000 7f816ebfe740 1 --2- 172.21.15.47:0/3335784901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d56e10 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8154012740 tx=0x7f8154012b40 comp rx=0 tx=0).stop 2024-07-24T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.802+0000 7f816ebfe740 1 -- 172.21.15.47:0/3335784901 shutdown_connections 2024-07-24T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.802+0000 7f816ebfe740 1 --2- 172.21.15.47:0/3335784901 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560796d697c0 0x560796d6bbb0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.802+0000 7f816ebfe740 1 --2- 172.21.15.47:0/3335784901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d5a170 0x560796d57350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.802+0000 7f816ebfe740 1 --2- 172.21.15.47:0/3335784901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d56e10 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.802+0000 7f816ebfe740 1 --2- 172.21.15.47:0/3335784901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4d8c0 0x560796d59930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.802+0000 7f814d7fa640 0 client.17238 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.802+0000 7f816ebfe740 1 -- 172.21.15.47:0/3335784901 >> 172.21.15.47:0/3335784901 conn(0x560796d4b6f0 msgr2=0x560796d51290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.802+0000 7f816ebfe740 1 -- 172.21.15.47:0/3335784901 shutdown_connections 2024-07-24T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.802+0000 7f816ebfe740 1 -- 172.21.15.47:0/3335784901 wait complete. 2024-07-24T22:15:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.802+0000 7f816ebfe740 20 client.17238 trim_cache size 0 max 16384 2024-07-24T22:15:10.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.818+0000 7f816ebfe740 1 Processor -- start 2024-07-24T22:15:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.818+0000 7f816ebfe740 1 -- start start 2024-07-24T22:15:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f816ebfe740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4d8c0 0x560796d65bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f816ebfe740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d4ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f816ebfe740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d5a170 0x560796d714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f816ebfe740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f81641ae420 con 0x560796d4e1e0 2024-07-24T22:15:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f816ebfe740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f81641b0c80 con 0x560796d4d8c0 2024-07-24T22:15:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f816ebfe740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f81641aea70 con 0x560796d5a170 2024-07-24T22:15:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f8169444640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d4ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f8169444640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d4ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57142/0 (socket says 172.21.15.47:57142) 2024-07-24T22:15:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f8169444640 1 -- 172.21.15.47:0/2968297808 learned_addr learned my addr 172.21.15.47:0/2968297808 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f816a446640 1 --2- 172.21.15.47:0/2968297808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d5a170 0x560796d714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f8169c45640 1 --2- 172.21.15.47:0/2968297808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4d8c0 0x560796d65bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f8169444640 1 -- 172.21.15.47:0/2968297808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d5a170 msgr2=0x560796d714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f8169444640 1 --2- 172.21.15.47:0/2968297808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d5a170 0x560796d714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f8169444640 1 -- 172.21.15.47:0/2968297808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4d8c0 msgr2=0x560796d65bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f8169444640 1 --2- 172.21.15.47:0/2968297808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4d8c0 0x560796d65bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f8169444640 1 -- 172.21.15.47:0/2968297808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560796d6bf20 con 0x560796d4e1e0 2024-07-24T22:15:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f8169444640 1 --2- 172.21.15.47:0/2968297808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d4ce50 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f8154005840 tx=0x7f8154005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b03ff82bafc327 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.819+0000 7f814f7fe640 1 -- 172.21.15.47:0/2968297808 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154003fb0 con 0x560796d4e1e0 2024-07-24T22:15:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.820+0000 7f814f7fe640 1 -- 172.21.15.47:0/2968297808 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8154004150 con 0x560796d4e1e0 2024-07-24T22:15:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.820+0000 7f814f7fe640 1 -- 172.21.15.47:0/2968297808 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81540105a0 con 0x560796d4e1e0 2024-07-24T22:15:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.820+0000 7f816ebfe740 1 -- 172.21.15.47:0/2968297808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 msgr2=0x560796d4ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.820+0000 7f816ebfe740 1 --2- 172.21.15.47:0/2968297808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d4ce50 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f8154005840 tx=0x7f8154005870 comp rx=0 tx=0).stop 2024-07-24T22:15:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.820+0000 7f816ebfe740 1 -- 172.21.15.47:0/2968297808 shutdown_connections 2024-07-24T22:15:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.820+0000 7f816ebfe740 1 --2- 172.21.15.47:0/2968297808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d5a170 0x560796d714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.820+0000 7f816ebfe740 1 --2- 172.21.15.47:0/2968297808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d4e1e0 0x560796d4ce50 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.820+0000 7f816ebfe740 1 --2- 172.21.15.47:0/2968297808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4d8c0 0x560796d65bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.820+0000 7f816ebfe740 1 -- 172.21.15.47:0/2968297808 >> 172.21.15.47:0/2968297808 conn(0x560796d4b6f0 msgr2=0x560796d4c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.820+0000 7f816ebfe740 1 -- 172.21.15.47:0/2968297808 shutdown_connections 2024-07-24T22:15:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.820+0000 7f816ebfe740 1 -- 172.21.15.47:0/2968297808 wait complete. 2024-07-24T22:15:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f816ebfe740 1 -- start start 2024-07-24T22:15:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f816ebfe740 1 Processor -- start 2024-07-24T22:15:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f816ebfe740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d4d8c0 0x560796d5f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f816ebfe740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4e1e0 0x560796d5f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f816ebfe740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d5a170 0x560796dd2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f816ebfe740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f81641af140 con 0x560796d5a170 2024-07-24T22:15:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f816ebfe740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f81641b05b0 con 0x560796d4e1e0 2024-07-24T22:15:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f816ebfe740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f81641af810 con 0x560796d4d8c0 2024-07-24T22:15:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f816ebfe740 10 client.0 _ll_register_callbacks cb 0x7f8154009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f816a446640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d5a170 0x560796dd2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f8169c45640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d4d8c0 0x560796d5f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f816a446640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d5a170 0x560796dd2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57152/0 (socket says 172.21.15.47:57152) 2024-07-24T22:15:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f816a446640 1 -- 172.21.15.47:0/2685580873 learned_addr learned my addr 172.21.15.47:0/2685580873 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f8169444640 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4e1e0 0x560796d5f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.821+0000 7f816a446640 1 -- 172.21.15.47:0/2685580873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d4d8c0 msgr2=0x560796d5f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f816a446640 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d4d8c0 0x560796d5f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f816a446640 1 -- 172.21.15.47:0/2685580873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4e1e0 msgr2=0x560796d5f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f816a446640 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4e1e0 0x560796d5f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f816a446640 1 -- 172.21.15.47:0/2685580873 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560796dd2b10 con 0x560796d5a170 2024-07-24T22:15:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f8169c45640 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d4d8c0 0x560796d5f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:15:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f8169444640 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4e1e0 0x560796d5f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:15:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f816a446640 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d5a170 0x560796dd2470 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f815c01b9b0 tx=0x7f815c00d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b73a635dd98e4e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f814d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f814d7fa640 1 -- 172.21.15.47:0/2685580873 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c004b20 con 0x560796d5a170 2024-07-24T22:15:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f814d7fa640 1 -- 172.21.15.47:0/2685580873 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8609+0+0 (secure 0 0 0) 0x7f815c024040 con 0x560796d5a170 2024-07-24T22:15:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f816ebfe740 1 -- 172.21.15.47:0/2685580873 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8154004150 con 0x560796d5a170 2024-07-24T22:15:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f814d7fa640 1 -- 172.21.15.47:0/2685580873 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f815c036050 con 0x560796d5a170 2024-07-24T22:15:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f816ebfe740 10 client.17244 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f816ebfe740 1 -- 172.21.15.47:0/2685580873 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560796dd3eb0 con 0x560796d5a170 2024-07-24T22:15:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f814d7fa640 1 -- 172.21.15.47:0/2685580873 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8154004150 con 0x560796d5a170 2024-07-24T22:15:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f814d7fa640 1 -- 172.21.15.47:0/2685580873 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f815c0055c0 con 0x560796d5a170 2024-07-24T22:15:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f816ebfe740 10 client.17244 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.822+0000 7f816ebfe740 10 client.17244 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.823+0000 7f816ebfe740 20 client.17244 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.823+0000 7f816ebfe740 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560796dd46e0 0x560796dd6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.823+0000 7f816ebfe740 4 client.17244 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:15:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.823+0000 7f816ebfe740 1 -- 172.21.15.47:0/2685580873 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560796cc0c70 con 0x560796dd46e0 2024-07-24T22:15:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.823+0000 7f8169c45640 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560796dd46e0 0x560796dd6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.823+0000 7f814d7fa640 10 client.17244 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:10.823+0000 7f8169c45640 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560796dd46e0 0x560796dd6b00 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=190e9a5db7371487 server_cookie=c12062b7e5e3c621 in_seq=0 out_seq=0 2024-07-24T22:15:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f814d7fa640 1 -- 172.21.15.47:0/2685580873 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560796cc0c70 con 0x560796dd46e0 2024-07-24T22:15:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f814d7fa640 10 client.17244 handle_command_reply: tid=0 2024-07-24T22:15:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f816ebfe740 1 client.17244 shutdown 2024-07-24T22:15:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f816ebfe740 1 -- 172.21.15.47:0/2685580873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d5a170 msgr2=0x560796dd2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f816ebfe740 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d5a170 0x560796dd2470 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f815c01b9b0 tx=0x7f815c00d040 comp rx=0 tx=0).stop 2024-07-24T22:15:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f816ebfe740 1 -- 172.21.15.47:0/2685580873 shutdown_connections 2024-07-24T22:15:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f816ebfe740 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560796dd46e0 0x560796dd6b00 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f816ebfe740 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560796d5a170 0x560796dd2470 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f816ebfe740 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560796d4e1e0 0x560796d5f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f814d7fa640 0 client.17244 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f816ebfe740 1 --2- 172.21.15.47:0/2685580873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560796d4d8c0 0x560796d5f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:11.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f816ebfe740 1 -- 172.21.15.47:0/2685580873 >> 172.21.15.47:0/2685580873 conn(0x560796d4b6f0 msgr2=0x560796d580e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:11.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f816ebfe740 1 -- 172.21.15.47:0/2685580873 shutdown_connections 2024-07-24T22:15:11.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f816ebfe740 1 -- 172.21.15.47:0/2685580873 wait complete. 2024-07-24T22:15:11.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.012+0000 7f816ebfe740 20 client.17244 trim_cache size 0 max 16384 2024-07-24T22:15:11.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:15:11.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:15:11.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:15:11.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:15:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.013+0000 7f816bea9640 1 -- 172.21.15.47:0/287198263 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81500b3d40 msgr2=0x7f81500b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.013+0000 7f816bea9640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81500b3d40 0x7f81500b6200 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f815c00bfd0 tx=0x7f815c004ab0 comp rx=0 tx=0).stop 2024-07-24T22:15:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.013+0000 7f816bea9640 1 -- 172.21.15.47:0/287198263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81641015a0 msgr2=0x7f816419add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.013+0000 7f816bea9640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81641015a0 0x7f816419add0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f8160005940 tx=0x7f81600040c0 comp rx=0 tx=0).stop 2024-07-24T22:15:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.013+0000 7f816bea9640 1 -- 172.21.15.47:0/287198263 shutdown_connections 2024-07-24T22:15:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.013+0000 7f816bea9640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f81500b3d40 0x7f81500b6200 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.013+0000 7f816bea9640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8164107920 0x7f81641a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.013+0000 7f816bea9640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8164106fa0 0x7f816419b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.013+0000 7f816bea9640 1 --2- 172.21.15.47:0/287198263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81641015a0 0x7f816419add0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.013+0000 7f816bea9640 1 -- 172.21.15.47:0/287198263 >> 172.21.15.47:0/287198263 conn(0x7f81640fd000 msgr2=0x7f81640fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.014+0000 7f816bea9640 1 -- 172.21.15.47:0/287198263 shutdown_connections 2024-07-24T22:15:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:11.014+0000 7f816bea9640 1 -- 172.21.15.47:0/287198263 wait complete. 2024-07-24T22:15:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:11 smithi188 ceph-mon[37380]: pgmap v609: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-07-24T22:15:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:11 smithi188 ceph-mon[37380]: osdmap e90: 12 total, 12 up, 12 in 2024-07-24T22:15:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:11 smithi183 ceph-mon[37007]: pgmap v609: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-07-24T22:15:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:11 smithi183 ceph-mon[37007]: osdmap e90: 12 total, 12 up, 12 in 2024-07-24T22:15:11.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:11 smithi047 ceph-mon[32551]: pgmap v609: 97 pgs: 97 active+clean; 50 GiB data, 152 GiB used, 921 GiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-07-24T22:15:11.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:11 smithi047 ceph-mon[32551]: osdmap e90: 12 total, 12 up, 12 in 2024-07-24T22:15:13.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:13 smithi188 ceph-mon[37380]: pgmap v611: 97 pgs: 15 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 74 active+clean; 49 GiB data, 149 GiB used, 924 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:15:13.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:13 smithi183 ceph-mon[37007]: pgmap v611: 97 pgs: 15 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 74 active+clean; 49 GiB data, 149 GiB used, 924 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:15:13.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:13 smithi047 ceph-mon[32551]: pgmap v611: 97 pgs: 15 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 74 active+clean; 49 GiB data, 149 GiB used, 924 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:15:15.739 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:15 smithi047 ceph-mon[32551]: pgmap v612: 97 pgs: 21 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 66 active+clean; 44 GiB data, 139 GiB used, 934 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:15:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:15 smithi188 ceph-mon[37380]: pgmap v612: 97 pgs: 21 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 66 active+clean; 44 GiB data, 139 GiB used, 934 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:15:15.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:15 smithi183 ceph-mon[37007]: pgmap v612: 97 pgs: 21 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 66 active+clean; 44 GiB data, 139 GiB used, 934 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:15:17.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:17 smithi188 ceph-mon[37380]: pgmap v613: 97 pgs: 16 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 73 active+clean; 42 GiB data, 133 GiB used, 940 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 1023 B/s wr, 3 op/s 2024-07-24T22:15:17.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:17 smithi183 ceph-mon[37007]: pgmap v613: 97 pgs: 16 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 73 active+clean; 42 GiB data, 133 GiB used, 940 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 1023 B/s wr, 3 op/s 2024-07-24T22:15:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:17 smithi047 ceph-mon[32551]: pgmap v613: 97 pgs: 16 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 73 active+clean; 42 GiB data, 133 GiB used, 940 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 1023 B/s wr, 3 op/s 2024-07-24T22:15:19.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:19 smithi188 ceph-mon[37380]: pgmap v614: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 921 B/s wr, 2 op/s 2024-07-24T22:15:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:19 smithi188 ceph-mon[37380]: osdmap e91: 12 total, 12 up, 12 in 2024-07-24T22:15:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:19 smithi183 ceph-mon[37007]: pgmap v614: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 921 B/s wr, 2 op/s 2024-07-24T22:15:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:19 smithi183 ceph-mon[37007]: osdmap e91: 12 total, 12 up, 12 in 2024-07-24T22:15:19.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:19 smithi047 ceph-mon[32551]: pgmap v614: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 921 B/s wr, 2 op/s 2024-07-24T22:15:19.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:19 smithi047 ceph-mon[32551]: osdmap e91: 12 total, 12 up, 12 in 2024-07-24T22:15:20.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:15:20.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:15:20.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:15:20.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:15:20.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:15:20.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:15:20.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:15:20.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:15:20.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:15:20.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:15:20.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:15:20.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:15:22.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:21 smithi047 ceph-mon[32551]: pgmap v616: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 933 B/s wr, 2 op/s 2024-07-24T22:15:22.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:21 smithi188 ceph-mon[37380]: pgmap v616: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 933 B/s wr, 2 op/s 2024-07-24T22:15:22.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:21 smithi183 ceph-mon[37007]: pgmap v616: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 933 B/s wr, 2 op/s 2024-07-24T22:15:23.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:22 smithi188 ceph-mon[37380]: pgmap v617: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1023 B/s rd, 204 B/s wr, 2 op/s 2024-07-24T22:15:23.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:22 smithi183 ceph-mon[37007]: pgmap v617: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1023 B/s rd, 204 B/s wr, 2 op/s 2024-07-24T22:15:23.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:22 smithi047 ceph-mon[32551]: pgmap v617: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1023 B/s rd, 204 B/s wr, 2 op/s 2024-07-24T22:15:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.117+0000 7fd048606640 1 -- 172.21.15.47:0/2770813498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd040106f90 msgr2=0x7fd0401073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.117+0000 7fd048606640 1 --2- 172.21.15.47:0/2770813498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd040106f90 0x7fd0401073d0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fd030009900 tx=0x7fd03002a410 comp rx=0 tx=0).stop 2024-07-24T22:15:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.117+0000 7fd048606640 1 -- 172.21.15.47:0/2770813498 shutdown_connections 2024-07-24T22:15:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.117+0000 7fd048606640 1 --2- 172.21.15.47:0/2770813498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd040107910 0x7fd04010e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.117+0000 7fd048606640 1 --2- 172.21.15.47:0/2770813498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd040106f90 0x7fd0401073d0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.117+0000 7fd048606640 1 --2- 172.21.15.47:0/2770813498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0401015e0 0x7fd0401019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.117+0000 7fd048606640 1 -- 172.21.15.47:0/2770813498 >> 172.21.15.47:0/2770813498 conn(0x7fd0400782e0 msgr2=0x7fd0400ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.117+0000 7fd048606640 1 -- 172.21.15.47:0/2770813498 shutdown_connections 2024-07-24T22:15:24.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.117+0000 7fd048606640 1 -- 172.21.15.47:0/2770813498 wait complete. 2024-07-24T22:15:24.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.118+0000 7fd048606640 1 Processor -- start 2024-07-24T22:15:24.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.118+0000 7fd048606640 1 -- start start 2024-07-24T22:15:24.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.118+0000 7fd048606640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0401015e0 0x7fd04010ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.118+0000 7fd048606640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd040106f90 0x7fd04010f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.118+0000 7fd048606640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd040107910 0x7fd04010f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.118+0000 7fd048606640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd040112680 con 0x7fd040107910 2024-07-24T22:15:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.118+0000 7fd048606640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd040112500 con 0x7fd040106f90 2024-07-24T22:15:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.118+0000 7fd048606640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd040112800 con 0x7fd0401015e0 2024-07-24T22:15:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.118+0000 7fd046ba3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd040107910 0x7fd04010f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.118+0000 7fd046ba3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd040107910 0x7fd04010f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52044/0 (socket says 172.21.15.47:52044) 2024-07-24T22:15:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.118+0000 7fd046ba3640 1 -- 172.21.15.47:0/3408010410 learned_addr learned my addr 172.21.15.47:0/3408010410 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.119+0000 7fd045ba1640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd040106f90 0x7fd04010f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.119+0000 7fd0463a2640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0401015e0 0x7fd04010ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.119+0000 7fd046ba3640 1 -- 172.21.15.47:0/3408010410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0401015e0 msgr2=0x7fd04010ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.119+0000 7fd046ba3640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0401015e0 0x7fd04010ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.119+0000 7fd046ba3640 1 -- 172.21.15.47:0/3408010410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd040106f90 msgr2=0x7fd04010f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.119+0000 7fd046ba3640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd040106f90 0x7fd04010f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.119+0000 7fd046ba3640 1 -- 172.21.15.47:0/3408010410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0401a6fd0 con 0x7fd040107910 2024-07-24T22:15:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.119+0000 7fd046ba3640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd040107910 0x7fd04010f6a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fd03800eaa0 tx=0x7fd03800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.119+0000 7fd0377fe640 1 -- 172.21.15.47:0/3408010410 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03800cdb0 con 0x7fd040107910 2024-07-24T22:15:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.119+0000 7fd0377fe640 1 -- 172.21.15.47:0/3408010410 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd038005020 con 0x7fd040107910 2024-07-24T22:15:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.119+0000 7fd048606640 1 -- 172.21.15.47:0/3408010410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0401a72c0 con 0x7fd040107910 2024-07-24T22:15:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.119+0000 7fd0377fe640 1 -- 172.21.15.47:0/3408010410 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0380116d0 con 0x7fd040107910 2024-07-24T22:15:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.119+0000 7fd048606640 1 -- 172.21.15.47:0/3408010410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0401a7790 con 0x7fd040107910 2024-07-24T22:15:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.122+0000 7fd04b365740 1 Processor -- start 2024-07-24T22:15:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.122+0000 7fd0377fe640 1 -- 172.21.15.47:0/3408010410 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fd0380051d0 con 0x7fd040107910 2024-07-24T22:15:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd04b365740 1 -- start start 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd04b365740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 0x563838695ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd04b365740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386961e0 0x5638386a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd04b365740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 0x5638386a4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd04b365740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56383860b280 con 0x5638386958c0 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd04b365740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5638385fa780 con 0x5638386961e0 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd04b365740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5638385fe7c0 con 0x5638386a2170 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd045ba1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 0x563838695ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd045ba1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 0x563838695ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52054/0 (socket says 172.21.15.47:52054) 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd045ba1640 1 -- 172.21.15.47:0/1071781706 learned_addr learned my addr 172.21.15.47:0/1071781706 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd045ba1640 1 --2- 172.21.15.47:0/1071781706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 0x5638386a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd0463a2640 1 --2- 172.21.15.47:0/1071781706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386961e0 0x5638386a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd0377fe640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd02c0b3d40 0x7fd02c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd045ba1640 1 -- 172.21.15.47:0/1071781706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 msgr2=0x5638386a4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd045ba1640 1 --2- 172.21.15.47:0/1071781706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 0x5638386a4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd045ba1640 1 -- 172.21.15.47:0/1071781706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386961e0 msgr2=0x5638386a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd045ba1640 1 --2- 172.21.15.47:0/1071781706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386961e0 0x5638386a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.123+0000 7fd045ba1640 1 -- 172.21.15.47:0/1071781706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383835e790 con 0x5638386958c0 2024-07-24T22:15:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.124+0000 7fd046ba3640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd02c0b3d40 0x7fd02c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.124+0000 7fd045ba1640 1 --2- 172.21.15.47:0/1071781706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 0x563838695ca0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fd030009900 tx=0x7fd030005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4bedf9d2bc2528 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.124+0000 7fd0377fe640 1 -- 172.21.15.47:0/3408010410 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fd0380e41f0 con 0x7fd040107910 2024-07-24T22:15:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.124+0000 7fd034bfe640 1 -- 172.21.15.47:0/1071781706 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030044020 con 0x5638386958c0 2024-07-24T22:15:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.124+0000 7fd034bfe640 1 -- 172.21.15.47:0/1071781706 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0300317e0 con 0x5638386958c0 2024-07-24T22:15:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.124+0000 7fd034bfe640 1 -- 172.21.15.47:0/1071781706 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030035040 con 0x5638386958c0 2024-07-24T22:15:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.125+0000 7fd04b365740 1 -- 172.21.15.47:0/1071781706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 msgr2=0x563838695ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.125+0000 7fd046ba3640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd02c0b3d40 0x7fd02c0b6200 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd0380e1f10 tx=0x7fd038092040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.125+0000 7fd04b365740 1 --2- 172.21.15.47:0/1071781706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 0x563838695ca0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fd030009900 tx=0x7fd030005c00 comp rx=0 tx=0).stop 2024-07-24T22:15:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.125+0000 7fd04b365740 1 -- 172.21.15.47:0/1071781706 shutdown_connections 2024-07-24T22:15:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.125+0000 7fd04b365740 1 --2- 172.21.15.47:0/1071781706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 0x5638386a4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.125+0000 7fd04b365740 1 --2- 172.21.15.47:0/1071781706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386961e0 0x5638386a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.125+0000 7fd04b365740 1 --2- 172.21.15.47:0/1071781706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 0x563838695ca0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.125+0000 7fd04b365740 1 -- 172.21.15.47:0/1071781706 >> 172.21.15.47:0/1071781706 conn(0x5638386936f0 msgr2=0x563838694890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.125+0000 7fd04b365740 1 -- 172.21.15.47:0/1071781706 shutdown_connections 2024-07-24T22:15:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.125+0000 7fd04b365740 1 -- 172.21.15.47:0/1071781706 wait complete. 2024-07-24T22:15:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.125+0000 7fd04b365740 1 -- start start 2024-07-24T22:15:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.125+0000 7fd04b365740 1 Processor -- start 2024-07-24T22:15:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd04b365740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 0x5638386a1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd04b365740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386961e0 0x56383869ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd04b365740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 0x56383869f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd04b365740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563838534ab0 con 0x5638386958c0 2024-07-24T22:15:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd04b365740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5638385829e0 con 0x5638386961e0 2024-07-24T22:15:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd04b365740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5638386a4df0 con 0x5638386a2170 2024-07-24T22:15:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd04b365740 10 client.0 _ll_register_callbacks cb 0x56383830aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd045ba1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 0x5638386a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd045ba1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 0x5638386a1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52068/0 (socket says 172.21.15.47:52068) 2024-07-24T22:15:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd045ba1640 1 -- 172.21.15.47:0/3760760223 learned_addr learned my addr 172.21.15.47:0/3760760223 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd0463a2640 1 --2- 172.21.15.47:0/3760760223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386961e0 0x56383869ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd045ba1640 1 --2- 172.21.15.47:0/3760760223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 0x56383869f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd045ba1640 1 -- 172.21.15.47:0/3760760223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 msgr2=0x56383869f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd045ba1640 1 --2- 172.21.15.47:0/3760760223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 0x56383869f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd045ba1640 1 -- 172.21.15.47:0/3760760223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386961e0 msgr2=0x56383869ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd045ba1640 1 --2- 172.21.15.47:0/3760760223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386961e0 0x56383869ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd045ba1640 1 -- 172.21.15.47:0/3760760223 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638383d7620 con 0x5638386958c0 2024-07-24T22:15:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd045ba1640 1 --2- 172.21.15.47:0/3760760223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 0x5638386a1870 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd030005e90 tx=0x7fd030005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5dd5807763470d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd029ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd029ffb640 1 -- 172.21.15.47:0/3760760223 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030044030 con 0x5638386958c0 2024-07-24T22:15:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd029ffb640 1 -- 172.21.15.47:0/3760760223 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fd030004240 con 0x5638386958c0 2024-07-24T22:15:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.126+0000 7fd04b365740 1 -- 172.21.15.47:0/3760760223 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5638385a9ce0 con 0x5638386958c0 2024-07-24T22:15:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.127+0000 7fd029ffb640 1 -- 172.21.15.47:0/3760760223 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd030035040 con 0x5638386958c0 2024-07-24T22:15:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.127+0000 7fd04b365740 10 client.17256 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.127+0000 7fd04b365740 1 -- 172.21.15.47:0/3760760223 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5638386b0530 con 0x5638386958c0 2024-07-24T22:15:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.127+0000 7fd029ffb640 1 -- 172.21.15.47:0/3760760223 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5638385a9ce0 con 0x5638386958c0 2024-07-24T22:15:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.127+0000 7fd029ffb640 1 -- 172.21.15.47:0/3760760223 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd03004a4c0 con 0x5638386958c0 2024-07-24T22:15:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.127+0000 7fd04b365740 10 client.17256 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.127+0000 7fd04b365740 10 client.17256 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.127+0000 7fd04b365740 20 client.17256 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.127+0000 7fd04b365740 1 --2- 172.21.15.47:0/3760760223 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5638386b1880 0x5638386b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.127+0000 7fd04b365740 4 client.17256 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.127+0000 7fd04b365740 1 -- 172.21.15.47:0/3760760223 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56383860d1d0 con 0x5638386b1880 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.127+0000 7fd0463a2640 1 --2- 172.21.15.47:0/3760760223 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5638386b1880 0x5638386b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.128+0000 7fd0463a2640 1 --2- 172.21.15.47:0/3760760223 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5638386b1880 0x5638386b3c70 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45c640e21e83b57f server_cookie=4d7742ec6bb9b3ec in_seq=0 out_seq=0 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.128+0000 7fd029ffb640 10 client.17256 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd029ffb640 1 -- 172.21.15.47:0/3760760223 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56383860d1d0 con 0x5638386b1880 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd029ffb640 10 client.17256 handle_command_reply: tid=0 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd04b365740 1 client.17256 shutdown 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd04b365740 1 -- 172.21.15.47:0/3760760223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 msgr2=0x5638386a1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd04b365740 1 --2- 172.21.15.47:0/3760760223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 0x5638386a1870 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd030005e90 tx=0x7fd030005420 comp rx=0 tx=0).stop 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd04b365740 1 -- 172.21.15.47:0/3760760223 shutdown_connections 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd04b365740 1 --2- 172.21.15.47:0/3760760223 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5638386b1880 0x5638386b3c70 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd04b365740 1 --2- 172.21.15.47:0/3760760223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 0x56383869f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd04b365740 1 --2- 172.21.15.47:0/3760760223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386961e0 0x56383869ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd029ffb640 0 client.17256 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd04b365740 1 --2- 172.21.15.47:0/3760760223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386958c0 0x5638386a1870 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd04b365740 1 -- 172.21.15.47:0/3760760223 >> 172.21.15.47:0/3760760223 conn(0x5638386936f0 msgr2=0x563838699290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd04b365740 1 -- 172.21.15.47:0/3760760223 shutdown_connections 2024-07-24T22:15:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd04b365740 1 -- 172.21.15.47:0/3760760223 wait complete. 2024-07-24T22:15:24.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.129+0000 7fd04b365740 20 client.17256 trim_cache size 0 max 16384 2024-07-24T22:15:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd04b365740 1 Processor -- start 2024-07-24T22:15:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd04b365740 1 -- start start 2024-07-24T22:15:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd04b365740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386958c0 0x563838694800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd04b365740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 0x563838694d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd04b365740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386a2170 0x563838699b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd04b365740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0401ae290 con 0x5638386961e0 2024-07-24T22:15:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd04b365740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd0401b0af0 con 0x5638386a2170 2024-07-24T22:15:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd04b365740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd0401ae8e0 con 0x5638386958c0 2024-07-24T22:15:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd0463a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 0x563838694d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd0463a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 0x563838694d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52084/0 (socket says 172.21.15.47:52084) 2024-07-24T22:15:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd0463a2640 1 -- 172.21.15.47:0/4194760207 learned_addr learned my addr 172.21.15.47:0/4194760207 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd045ba1640 1 --2- 172.21.15.47:0/4194760207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386958c0 0x563838694800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd0463a2640 1 -- 172.21.15.47:0/4194760207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386958c0 msgr2=0x563838694800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd0463a2640 1 --2- 172.21.15.47:0/4194760207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386958c0 0x563838694800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd0463a2640 1 -- 172.21.15.47:0/4194760207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386a2170 msgr2=0x563838699b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd0463a2640 1 --2- 172.21.15.47:0/4194760207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386a2170 0x563838699b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd0463a2640 1 -- 172.21.15.47:0/4194760207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563838696010 con 0x5638386961e0 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd045ba1640 1 --2- 172.21.15.47:0/4194760207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386958c0 0x563838694800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd0463a2640 1 --2- 172.21.15.47:0/4194760207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 0x563838694d40 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fd03c000c00 tx=0x7fd03c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac3f4df02f34291 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.145+0000 7fd02bfff640 1 -- 172.21.15.47:0/4194760207 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c0140d0 con 0x5638386961e0 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.146+0000 7fd02bfff640 1 -- 172.21.15.47:0/4194760207 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd03c01f020 con 0x5638386961e0 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.146+0000 7fd02bfff640 1 -- 172.21.15.47:0/4194760207 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c003dc0 con 0x5638386961e0 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.146+0000 7fd04b365740 1 -- 172.21.15.47:0/4194760207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 msgr2=0x563838694d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.146+0000 7fd04b365740 1 --2- 172.21.15.47:0/4194760207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 0x563838694d40 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fd03c000c00 tx=0x7fd03c005f30 comp rx=0 tx=0).stop 2024-07-24T22:15:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.146+0000 7fd04b365740 1 -- 172.21.15.47:0/4194760207 shutdown_connections 2024-07-24T22:15:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.146+0000 7fd04b365740 1 --2- 172.21.15.47:0/4194760207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386a2170 0x563838699b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.146+0000 7fd04b365740 1 --2- 172.21.15.47:0/4194760207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 0x563838694d40 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.146+0000 7fd04b365740 1 --2- 172.21.15.47:0/4194760207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386958c0 0x563838694800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.146+0000 7fd04b365740 1 -- 172.21.15.47:0/4194760207 >> 172.21.15.47:0/4194760207 conn(0x5638386936f0 msgr2=0x56383869ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.146+0000 7fd04b365740 1 -- 172.21.15.47:0/4194760207 shutdown_connections 2024-07-24T22:15:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.146+0000 7fd04b365740 1 -- 172.21.15.47:0/4194760207 wait complete. 2024-07-24T22:15:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.146+0000 7fd04b365740 1 -- start start 2024-07-24T22:15:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd04b365740 1 Processor -- start 2024-07-24T22:15:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd04b365740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386958c0 0x5638386b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd04b365740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 0x5638386b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd04b365740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 0x5638386b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd04b365740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0401aefb0 con 0x5638386961e0 2024-07-24T22:15:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd04b365740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd0401b0420 con 0x5638386958c0 2024-07-24T22:15:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd04b365740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd0401af680 con 0x5638386a2170 2024-07-24T22:15:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd04b365740 10 client.0 _ll_register_callbacks cb 0x7fd030032e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd0463a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 0x5638386b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd0463a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 0x5638386b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52086/0 (socket says 172.21.15.47:52086) 2024-07-24T22:15:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd0463a2640 1 -- 172.21.15.47:0/3362128981 learned_addr learned my addr 172.21.15.47:0/3362128981 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd045ba1640 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386958c0 0x5638386b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd045ba1640 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 0x5638386b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd0463a2640 1 -- 172.21.15.47:0/3362128981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 msgr2=0x5638386b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd0463a2640 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 0x5638386b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd0463a2640 1 -- 172.21.15.47:0/3362128981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386958c0 msgr2=0x5638386b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd0463a2640 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386958c0 0x5638386b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd0463a2640 1 -- 172.21.15.47:0/3362128981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56383871a1a0 con 0x5638386961e0 2024-07-24T22:15:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd045ba1640 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 0x5638386b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:15:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd0463a2640 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 0x5638386b1c60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0039a0 tx=0x7fd03c003750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6521de6f109ec911 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd029ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.147+0000 7fd029ffb640 1 -- 172.21.15.47:0/3362128981 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c003d00 con 0x5638386961e0 2024-07-24T22:15:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd029ffb640 1 -- 172.21.15.47:0/3362128981 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fd03c003ea0 con 0x5638386961e0 2024-07-24T22:15:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd04b365740 1 -- 172.21.15.47:0/3362128981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd03c01f020 con 0x5638386961e0 2024-07-24T22:15:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd029ffb640 1 -- 172.21.15.47:0/3362128981 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd03c0040a0 con 0x5638386961e0 2024-07-24T22:15:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd04b365740 10 client.17262 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd04b365740 1 -- 172.21.15.47:0/3362128981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56383871b350 con 0x5638386961e0 2024-07-24T22:15:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd029ffb640 1 -- 172.21.15.47:0/3362128981 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd03c01f020 con 0x5638386961e0 2024-07-24T22:15:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd029ffb640 1 -- 172.21.15.47:0/3362128981 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd03c02b070 con 0x5638386961e0 2024-07-24T22:15:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd04b365740 10 client.17262 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd04b365740 10 client.17262 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd04b365740 20 client.17262 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd04b365740 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56383871b9f0 0x56383871de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd04b365740 4 client.17262 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:15:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd04b365740 1 -- 172.21.15.47:0/3362128981 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563838608c70 con 0x56383871b9f0 2024-07-24T22:15:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.148+0000 7fd045ba1640 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56383871b9f0 0x56383871de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.149+0000 7fd045ba1640 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56383871b9f0 0x56383871de10 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afffa82c32f7e270 server_cookie=4e1615785f603507 in_seq=0 out_seq=0 2024-07-24T22:15:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.149+0000 7fd029ffb640 10 client.17262 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.154+0000 7fd029ffb640 1 -- 172.21.15.47:0/3362128981 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563838608c70 con 0x56383871b9f0 2024-07-24T22:15:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.154+0000 7fd029ffb640 10 client.17262 handle_command_reply: tid=0 2024-07-24T22:15:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.154+0000 7fd04b365740 1 client.17262 shutdown 2024-07-24T22:15:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.154+0000 7fd04b365740 1 -- 172.21.15.47:0/3362128981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 msgr2=0x5638386b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.154+0000 7fd04b365740 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 0x5638386b1c60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0039a0 tx=0x7fd03c003750 comp rx=0 tx=0).stop 2024-07-24T22:15:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.154+0000 7fd04b365740 1 -- 172.21.15.47:0/3362128981 shutdown_connections 2024-07-24T22:15:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.154+0000 7fd04b365740 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56383871b9f0 0x56383871de10 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.154+0000 7fd04b365740 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5638386a2170 0x5638386b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.154+0000 7fd029ffb640 0 client.17262 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.154+0000 7fd04b365740 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638386961e0 0x5638386b1c60 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.154+0000 7fd04b365740 1 --2- 172.21.15.47:0/3362128981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5638386958c0 0x5638386b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.154+0000 7fd04b365740 1 -- 172.21.15.47:0/3362128981 >> 172.21.15.47:0/3362128981 conn(0x5638386936f0 msgr2=0x563838694800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd04b365740 1 -- 172.21.15.47:0/3362128981 shutdown_connections 2024-07-24T22:15:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd04b365740 1 -- 172.21.15.47:0/3362128981 wait complete. 2024-07-24T22:15:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd04b365740 20 client.17262 trim_cache size 0 max 16384 2024-07-24T22:15:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:15:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:15:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:15:24.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:15:24.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd048606640 1 -- 172.21.15.47:0/3408010410 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd02c0b3d40 msgr2=0x7fd02c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:24.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd048606640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd02c0b3d40 0x7fd02c0b6200 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd0380e1f10 tx=0x7fd038092040 comp rx=0 tx=0).stop 2024-07-24T22:15:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd048606640 1 -- 172.21.15.47:0/3408010410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd040107910 msgr2=0x7fd04010f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd048606640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd040107910 0x7fd04010f6a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fd03800eaa0 tx=0x7fd03800ef60 comp rx=0 tx=0).stop 2024-07-24T22:15:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd048606640 1 -- 172.21.15.47:0/3408010410 shutdown_connections 2024-07-24T22:15:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd048606640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd02c0b3d40 0x7fd02c0b6200 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd048606640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd040107910 0x7fd04010f6a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd048606640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd040106f90 0x7fd04010f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd048606640 1 --2- 172.21.15.47:0/3408010410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0401015e0 0x7fd04010ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd048606640 1 -- 172.21.15.47:0/3408010410 >> 172.21.15.47:0/3408010410 conn(0x7fd0400782e0 msgr2=0x7fd040069910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd048606640 1 -- 172.21.15.47:0/3408010410 shutdown_connections 2024-07-24T22:15:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:24.155+0000 7fd048606640 1 -- 172.21.15.47:0/3408010410 wait complete. 2024-07-24T22:15:25.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:25 smithi183 ceph-mon[37007]: pgmap v618: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1023 B/s rd, 102 B/s wr, 2 op/s 2024-07-24T22:15:25.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:25 smithi047 ceph-mon[32551]: pgmap v618: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1023 B/s rd, 102 B/s wr, 2 op/s 2024-07-24T22:15:25.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:25 smithi188 ceph-mon[37380]: pgmap v618: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1023 B/s rd, 102 B/s wr, 2 op/s 2024-07-24T22:15:27.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:27 smithi183 ceph-mon[37007]: pgmap v619: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:15:27.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:27 smithi047 ceph-mon[32551]: pgmap v619: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:15:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:27 smithi188 ceph-mon[37380]: pgmap v619: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:15:28.894 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:15:29.174 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:15:29.561 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:29 smithi047 ceph-mon[32551]: pgmap v620: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:15:29.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:29 smithi183 ceph-mon[37007]: pgmap v620: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:15:29.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:29 smithi188 ceph-mon[37380]: pgmap v620: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:15:30.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.979+0000 7fca9ec1c640 1 -- 172.21.15.47:0/1499366954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca98103f10 msgr2=0x7fca9810c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:30.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.979+0000 7fca9ec1c640 1 --2- 172.21.15.47:0/1499366954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca98103f10 0x7fca9810c4f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009900 tx=0x7fca8c02a410 comp rx=0 tx=0).stop 2024-07-24T22:15:30.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.979+0000 7fca9ec1c640 1 -- 172.21.15.47:0/1499366954 shutdown_connections 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.979+0000 7fca9ec1c640 1 --2- 172.21.15.47:0/1499366954 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca9810cac0 0x7fca9810ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.979+0000 7fca9ec1c640 1 --2- 172.21.15.47:0/1499366954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca98103f10 0x7fca9810c4f0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.979+0000 7fca9ec1c640 1 --2- 172.21.15.47:0/1499366954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca98103510 0x7fca981038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.979+0000 7fca9ec1c640 1 -- 172.21.15.47:0/1499366954 >> 172.21.15.47:0/1499366954 conn(0x7fca980fd0c0 msgr2=0x7fca980ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.979+0000 7fca9ec1c640 1 -- 172.21.15.47:0/1499366954 shutdown_connections 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.979+0000 7fca9ec1c640 1 -- 172.21.15.47:0/1499366954 wait complete. 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.980+0000 7fca9ec1c640 1 Processor -- start 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.980+0000 7fca9ec1c640 1 -- start start 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.980+0000 7fca9ec1c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca98103510 0x7fca98198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.980+0000 7fca9ec1c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca98103f10 0x7fca98199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.980+0000 7fca9ec1c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9810cac0 0x7fca9819e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.980+0000 7fca9ec1c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca98112710 con 0x7fca9810cac0 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.980+0000 7fca9ec1c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fca98112590 con 0x7fca98103f10 2024-07-24T22:15:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.980+0000 7fca9ec1c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fca98112890 con 0x7fca98103510 2024-07-24T22:15:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.980+0000 7fca9d1b9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9810cac0 0x7fca9819e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.980+0000 7fca9d1b9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9810cac0 0x7fca9819e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40004/0 (socket says 172.21.15.47:40004) 2024-07-24T22:15:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.980+0000 7fca9d1b9640 1 -- 172.21.15.47:0/2215506763 learned_addr learned my addr 172.21.15.47:0/2215506763 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.980+0000 7fca97fff640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca98103f10 0x7fca98199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.980+0000 7fca9c9b8640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca98103510 0x7fca98198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.981+0000 7fca9d1b9640 1 -- 172.21.15.47:0/2215506763 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca98103510 msgr2=0x7fca98198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.981+0000 7fca9d1b9640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca98103510 0x7fca98198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.981+0000 7fca9d1b9640 1 -- 172.21.15.47:0/2215506763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca98103f10 msgr2=0x7fca98199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.981+0000 7fca9d1b9640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca98103f10 0x7fca98199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.981+0000 7fca9d1b9640 1 -- 172.21.15.47:0/2215506763 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9819ec90 con 0x7fca9810cac0 2024-07-24T22:15:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.981+0000 7fca9d1b9640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9810cac0 0x7fca9819e4c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fca9000eaa0 tx=0x7fca9000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.981+0000 7fca95ffb640 1 -- 172.21.15.47:0/2215506763 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90004d20 con 0x7fca9810cac0 2024-07-24T22:15:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.981+0000 7fca95ffb640 1 -- 172.21.15.47:0/2215506763 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca90005020 con 0x7fca9810cac0 2024-07-24T22:15:30.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.981+0000 7fca9ec1c640 1 -- 172.21.15.47:0/2215506763 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9819ef80 con 0x7fca9810cac0 2024-07-24T22:15:30.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.981+0000 7fca95ffb640 1 -- 172.21.15.47:0/2215506763 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca900116b0 con 0x7fca9810cac0 2024-07-24T22:15:30.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.981+0000 7fca9ec1c640 1 -- 172.21.15.47:0/2215506763 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca981a5810 con 0x7fca9810cac0 2024-07-24T22:15:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.984+0000 7fca95ffb640 1 -- 172.21.15.47:0/2215506763 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fca900051d0 con 0x7fca9810cac0 2024-07-24T22:15:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.984+0000 7fcaa0fcd740 1 Processor -- start 2024-07-24T22:15:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.984+0000 7fcaa0fcd740 1 -- start start 2024-07-24T22:15:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.984+0000 7fcaa0fcd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d57a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.984+0000 7fcaa0fcd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d57fd0 0x55b053d63a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.984+0000 7fcaa0fcd740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d63f60 0x55b053d66350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.984+0000 7fcaa0fcd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b053cce990 con 0x55b053d57fd0 2024-07-24T22:15:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.984+0000 7fcaa0fcd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b053cbde90 con 0x55b053d576b0 2024-07-24T22:15:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.984+0000 7fcaa0fcd740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b053cc1ed0 con 0x55b053d63f60 2024-07-24T22:15:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.984+0000 7fca9c9b8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d57fd0 0x55b053d63a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.984+0000 7fca9c9b8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d57fd0 0x55b053d63a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40014/0 (socket says 172.21.15.47:40014) 2024-07-24T22:15:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.984+0000 7fca9c9b8640 1 -- 172.21.15.47:0/3896096955 learned_addr learned my addr 172.21.15.47:0/3896096955 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.984+0000 7fca97fff640 1 --2- 172.21.15.47:0/3896096955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d57a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca97fff640 1 --2- 172.21.15.47:0/3896096955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d63f60 0x55b053d66350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca9c9b8640 1 -- 172.21.15.47:0/3896096955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d63f60 msgr2=0x55b053d66350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca95ffb640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fca800b3dc0 0x7fca800b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca9c9b8640 1 --2- 172.21.15.47:0/3896096955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d63f60 0x55b053d66350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca9c9b8640 1 -- 172.21.15.47:0/3896096955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 msgr2=0x55b053d57a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca9c9b8640 1 --2- 172.21.15.47:0/3896096955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d57a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca9c9b8640 1 -- 172.21.15.47:0/3896096955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b053c47300 con 0x55b053d57fd0 2024-07-24T22:15:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca97fff640 1 --2- 172.21.15.47:0/3896096955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d63f60 0x55b053d66350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:15:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca9d1b9640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fca800b3dc0 0x7fca800b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca9c9b8640 1 --2- 172.21.15.47:0/3896096955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d57fd0 0x55b053d63a20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fca8800ad00 tx=0x7fca8800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e242d0c99ab3fc server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca95ffb640 1 -- 172.21.15.47:0/2215506763 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fca900e4150 con 0x7fca9810cac0 2024-07-24T22:15:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca7effd640 1 -- 172.21.15.47:0/3896096955 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8801d070 con 0x55b053d57fd0 2024-07-24T22:15:30.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca7effd640 1 -- 172.21.15.47:0/3896096955 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca88018af0 con 0x55b053d57fd0 2024-07-24T22:15:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.985+0000 7fca7effd640 1 -- 172.21.15.47:0/3896096955 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca88010b40 con 0x55b053d57fd0 2024-07-24T22:15:30.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.986+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/3896096955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d57fd0 msgr2=0x55b053d63a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:30.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.986+0000 7fca9d1b9640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fca800b3dc0 0x7fca800b6280 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fca900a6d50 tx=0x7fca90075020 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:30.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.986+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/3896096955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d57fd0 0x55b053d63a20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fca8800ad00 tx=0x7fca8800f790 comp rx=0 tx=0).stop 2024-07-24T22:15:30.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.986+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/3896096955 shutdown_connections 2024-07-24T22:15:30.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.986+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/3896096955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d63f60 0x55b053d66350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.986+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/3896096955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d57fd0 0x55b053d63a20 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.986+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/3896096955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d57a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.986+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/3896096955 >> 172.21.15.47:0/3896096955 conn(0x55b053d554e0 msgr2=0x55b053d56680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:30.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.986+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/3896096955 shutdown_connections 2024-07-24T22:15:30.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.986+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/3896096955 wait complete. 2024-07-24T22:15:30.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.986+0000 7fcaa0fcd740 1 -- start start 2024-07-24T22:15:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.986+0000 7fcaa0fcd740 1 Processor -- start 2024-07-24T22:15:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fcaa0fcd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d60ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fcaa0fcd740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 0x55b053d61430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fcaa0fcd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053d61970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fcaa0fcd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b053b21700 con 0x55b053d63f60 2024-07-24T22:15:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fcaa0fcd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b053c605d0 con 0x55b053d576b0 2024-07-24T22:15:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fcaa0fcd740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b053d66be0 con 0x55b053d57fd0 2024-07-24T22:15:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fcaa0fcd740 10 client.0 _ll_register_callbacks cb 0x55b053c80940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fca97fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053d61970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fca97fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053d61970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40016/0 (socket says 172.21.15.47:40016) 2024-07-24T22:15:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fca97fff640 1 -- 172.21.15.47:0/1447842785 learned_addr learned my addr 172.21.15.47:0/1447842785 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fca97fff640 1 --2- 172.21.15.47:0/1447842785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d60ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fca9c9b8640 1 --2- 172.21.15.47:0/1447842785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 0x55b053d61430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:30.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fca97fff640 1 -- 172.21.15.47:0/1447842785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 msgr2=0x55b053d61430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:30.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fca97fff640 1 --2- 172.21.15.47:0/1447842785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 0x55b053d61430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fca97fff640 1 -- 172.21.15.47:0/1447842785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 msgr2=0x55b053d60ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:30.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fca97fff640 1 --2- 172.21.15.47:0/1447842785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d60ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.987+0000 7fca97fff640 1 -- 172.21.15.47:0/1447842785 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b053c53660 con 0x55b053d63f60 2024-07-24T22:15:30.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.988+0000 7fca97fff640 1 --2- 172.21.15.47:0/1447842785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053d61970 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fca8c033000 tx=0x7fca8c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9568394b87fb55 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:30.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.988+0000 7fca77fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:30.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.988+0000 7fca77fff640 1 -- 172.21.15.47:0/1447842785 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c035040 con 0x55b053d63f60 2024-07-24T22:15:30.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.988+0000 7fca77fff640 1 -- 172.21.15.47:0/1447842785 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fca8c004260 con 0x55b053d63f60 2024-07-24T22:15:30.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.988+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1447842785 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca88018af0 con 0x55b053d63f60 2024-07-24T22:15:30.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.988+0000 7fca77fff640 1 -- 172.21.15.47:0/1447842785 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fca8c052050 con 0x55b053d63f60 2024-07-24T22:15:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.988+0000 7fcaa0fcd740 10 client.17274 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.988+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1447842785 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b053a1e650 con 0x55b053d63f60 2024-07-24T22:15:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.988+0000 7fca77fff640 1 -- 172.21.15.47:0/1447842785 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca88018af0 con 0x55b053d63f60 2024-07-24T22:15:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.988+0000 7fca77fff640 1 -- 172.21.15.47:0/1447842785 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fca8c03d450 con 0x55b053d63f60 2024-07-24T22:15:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.988+0000 7fcaa0fcd740 10 client.17274 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.988+0000 7fcaa0fcd740 10 client.17274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.989+0000 7fcaa0fcd740 20 client.17274 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.989+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1447842785 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b053d739f0 0x55b053d75e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.989+0000 7fcaa0fcd740 4 client.17274 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:15:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.989+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1447842785 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b053cd08e0 con 0x55b053d739f0 2024-07-24T22:15:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.989+0000 7fca9c9b8640 1 --2- 172.21.15.47:0/1447842785 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b053d739f0 0x55b053d75e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.989+0000 7fca9c9b8640 1 --2- 172.21.15.47:0/1447842785 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b053d739f0 0x55b053d75e30 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe24739e1db96b6 server_cookie=ccb89ff12739f125 in_seq=0 out_seq=0 2024-07-24T22:15:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.989+0000 7fca77fff640 10 client.17274 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:30.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.990+0000 7fca77fff640 1 -- 172.21.15.47:0/1447842785 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b053cd08e0 con 0x55b053d739f0 2024-07-24T22:15:30.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.990+0000 7fca77fff640 10 client.17274 handle_command_reply: tid=0 2024-07-24T22:15:30.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.990+0000 7fcaa0fcd740 1 client.17274 shutdown 2024-07-24T22:15:30.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.990+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1447842785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 msgr2=0x55b053d61970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:30.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.990+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1447842785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053d61970 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fca8c033000 tx=0x7fca8c02a410 comp rx=0 tx=0).stop 2024-07-24T22:15:30.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.991+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1447842785 shutdown_connections 2024-07-24T22:15:30.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.991+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1447842785 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b053d739f0 0x55b053d75e30 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.991+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1447842785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053d61970 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.991+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1447842785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 0x55b053d61430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.991+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1447842785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d60ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:30.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.991+0000 7fca77fff640 0 client.17274 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:30.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.991+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1447842785 >> 172.21.15.47:0/1447842785 conn(0x55b053d554e0 msgr2=0x55b053d5b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:30.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.991+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1447842785 shutdown_connections 2024-07-24T22:15:30.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.991+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1447842785 wait complete. 2024-07-24T22:15:30.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:30.991+0000 7fcaa0fcd740 20 client.17274 trim_cache size 0 max 16384 2024-07-24T22:15:31.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fcaa0fcd740 1 Processor -- start 2024-07-24T22:15:31.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fcaa0fcd740 1 -- start start 2024-07-24T22:15:31.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fcaa0fcd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d6c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:31.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fcaa0fcd740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 0x55b053d6c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:31.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fcaa0fcd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053d5a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:31.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fcaa0fcd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca981ac1e0 con 0x55b053d63f60 2024-07-24T22:15:31.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fcaa0fcd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fca981aea40 con 0x55b053d576b0 2024-07-24T22:15:31.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fcaa0fcd740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fca981ac830 con 0x55b053d57fd0 2024-07-24T22:15:31.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fca97fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053d5a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:31.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fca97fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053d5a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40020/0 (socket says 172.21.15.47:40020) 2024-07-24T22:15:31.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fca97fff640 1 -- 172.21.15.47:0/1532443022 learned_addr learned my addr 172.21.15.47:0/1532443022 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:31.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fca97fff640 1 --2- 172.21.15.47:0/1532443022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d6c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:31.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fca9c9b8640 1 --2- 172.21.15.47:0/1532443022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 0x55b053d6c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:31.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fca97fff640 1 -- 172.21.15.47:0/1532443022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 msgr2=0x55b053d6c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:31.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fca97fff640 1 --2- 172.21.15.47:0/1532443022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 0x55b053d6c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fca97fff640 1 -- 172.21.15.47:0/1532443022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 msgr2=0x55b053d6c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:31.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fca97fff640 1 --2- 172.21.15.47:0/1532443022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d6c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.010+0000 7fca97fff640 1 -- 172.21.15.47:0/1532443022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b053d50e70 con 0x55b053d63f60 2024-07-24T22:15:31.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.011+0000 7fca97fff640 1 --2- 172.21.15.47:0/1532443022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053d5a7f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fca8c032fd0 tx=0x7fca8c005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade273252463740 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:31.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.011+0000 7fca7e7fc640 1 -- 172.21.15.47:0/1532443022 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c035040 con 0x55b053d63f60 2024-07-24T22:15:31.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.011+0000 7fca7e7fc640 1 -- 172.21.15.47:0/1532443022 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca8c03d510 con 0x55b053d63f60 2024-07-24T22:15:31.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.011+0000 7fca7e7fc640 1 -- 172.21.15.47:0/1532443022 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c03dca0 con 0x55b053d63f60 2024-07-24T22:15:31.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.011+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1532443022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 msgr2=0x55b053d5a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:31.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.011+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1532443022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053d5a7f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fca8c032fd0 tx=0x7fca8c005db0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.011+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1532443022 shutdown_connections 2024-07-24T22:15:31.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.011+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1532443022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053d5a7f0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.011+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1532443022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 0x55b053d6c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.011+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1532443022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d6c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.011+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1532443022 >> 172.21.15.47:0/1532443022 conn(0x55b053d554e0 msgr2=0x55b053d62d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:31.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.012+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1532443022 shutdown_connections 2024-07-24T22:15:31.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.012+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1532443022 wait complete. 2024-07-24T22:15:31.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.012+0000 7fcaa0fcd740 1 -- start start 2024-07-24T22:15:31.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.012+0000 7fcaa0fcd740 1 Processor -- start 2024-07-24T22:15:31.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.012+0000 7fcaa0fcd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d7b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:31.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.012+0000 7fcaa0fcd740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 0x55b053d7bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:31.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.012+0000 7fcaa0fcd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053dd7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:31.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.012+0000 7fcaa0fcd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca981acf00 con 0x55b053d63f60 2024-07-24T22:15:31.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.012+0000 7fcaa0fcd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fca981ae370 con 0x55b053d576b0 2024-07-24T22:15:31.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.012+0000 7fcaa0fcd740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fca981ad5d0 con 0x55b053d57fd0 2024-07-24T22:15:31.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.012+0000 7fcaa0fcd740 10 client.0 _ll_register_callbacks cb 0x7fca8c0095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:31.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.012+0000 7fca97fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053dd7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:31.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca97fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053dd7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40036/0 (socket says 172.21.15.47:40036) 2024-07-24T22:15:31.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca97fff640 1 -- 172.21.15.47:0/1825808776 learned_addr learned my addr 172.21.15.47:0/1825808776 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:31.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca9c9b8640 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 0x55b053d7bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:31.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca97fff640 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d7b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca97fff640 1 -- 172.21.15.47:0/1825808776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 msgr2=0x55b053d7bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca97fff640 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 0x55b053d7bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca97fff640 1 -- 172.21.15.47:0/1825808776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 msgr2=0x55b053d7b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca97fff640 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d7b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca97fff640 1 -- 172.21.15.47:0/1825808776 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b053dd81d0 con 0x55b053d63f60 2024-07-24T22:15:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca9c9b8640 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 0x55b053d7bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:15:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca97fff640 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053dd7a90 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fca8c03d8f0 tx=0x7fca8c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6658df390fec62b4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca77fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca77fff640 1 -- 172.21.15.47:0/1825808776 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c05c020 con 0x55b053d63f60 2024-07-24T22:15:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fca77fff640 1 -- 172.21.15.47:0/1825808776 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fca8c005050 con 0x55b053d63f60 2024-07-24T22:15:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.013+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1825808776 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca8c03d510 con 0x55b053d63f60 2024-07-24T22:15:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.014+0000 7fca77fff640 1 -- 172.21.15.47:0/1825808776 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fca8c035040 con 0x55b053d63f60 2024-07-24T22:15:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.014+0000 7fcaa0fcd740 10 client.17280 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.014+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1825808776 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b053de28a0 con 0x55b053d63f60 2024-07-24T22:15:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.014+0000 7fca77fff640 1 -- 172.21.15.47:0/1825808776 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca8c03d510 con 0x55b053d63f60 2024-07-24T22:15:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.014+0000 7fca77fff640 1 -- 172.21.15.47:0/1825808776 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fca8c004a70 con 0x55b053d63f60 2024-07-24T22:15:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.014+0000 7fcaa0fcd740 10 client.17280 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.014+0000 7fcaa0fcd740 10 client.17280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.014+0000 7fcaa0fcd740 20 client.17280 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.014+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b053de2f10 0x55b053de5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.014+0000 7fcaa0fcd740 4 client.17280 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.014+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1825808776 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b053ccc380 con 0x55b053de2f10 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.014+0000 7fca9c9b8640 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b053de2f10 0x55b053de5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fca9c9b8640 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b053de2f10 0x55b053de5330 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e48d00923817060 server_cookie=7831be7432d8f21 in_seq=0 out_seq=0 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fca77fff640 10 client.17280 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fca77fff640 1 -- 172.21.15.47:0/1825808776 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b053ccc380 con 0x55b053de2f10 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fca77fff640 10 client.17280 handle_command_reply: tid=0 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fcaa0fcd740 1 client.17280 shutdown 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1825808776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 msgr2=0x55b053dd7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053dd7a90 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fca8c03d8f0 tx=0x7fca8c005c90 comp rx=0 tx=0).stop 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1825808776 shutdown_connections 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b053de2f10 0x55b053de5330 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b053d63f60 0x55b053dd7a90 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b053d57fd0 0x55b053d7bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fcaa0fcd740 1 --2- 172.21.15.47:0/1825808776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b053d576b0 0x55b053d7b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1825808776 >> 172.21.15.47:0/1825808776 conn(0x55b053d554e0 msgr2=0x55b053d60e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fca77fff640 0 client.17280 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1825808776 shutdown_connections 2024-07-24T22:15:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fcaa0fcd740 1 -- 172.21.15.47:0/1825808776 wait complete. 2024-07-24T22:15:31.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.015+0000 7fcaa0fcd740 20 client.17280 trim_cache size 0 max 16384 2024-07-24T22:15:31.024 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:15:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:15:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:15:31.024 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:15:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.016+0000 7fca9ec1c640 1 -- 172.21.15.47:0/2215506763 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fca800b3dc0 msgr2=0x7fca800b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.016+0000 7fca9ec1c640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fca800b3dc0 0x7fca800b6280 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fca900a6d50 tx=0x7fca90075020 comp rx=0 tx=0).stop 2024-07-24T22:15:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.016+0000 7fca9ec1c640 1 -- 172.21.15.47:0/2215506763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9810cac0 msgr2=0x7fca9819e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.016+0000 7fca9ec1c640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9810cac0 0x7fca9819e4c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fca9000eaa0 tx=0x7fca9000eea0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.016+0000 7fca9ec1c640 1 -- 172.21.15.47:0/2215506763 shutdown_connections 2024-07-24T22:15:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.016+0000 7fca9ec1c640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fca800b3dc0 0x7fca800b6280 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.016+0000 7fca9ec1c640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9810cac0 0x7fca9819e4c0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.016+0000 7fca9ec1c640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca98103f10 0x7fca98199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.016+0000 7fca9ec1c640 1 --2- 172.21.15.47:0/2215506763 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca98103510 0x7fca98198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.016+0000 7fca9ec1c640 1 -- 172.21.15.47:0/2215506763 >> 172.21.15.47:0/2215506763 conn(0x7fca980fd0c0 msgr2=0x7fca980fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.016+0000 7fca9ec1c640 1 -- 172.21.15.47:0/2215506763 shutdown_connections 2024-07-24T22:15:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:31.016+0000 7fca9ec1c640 1 -- 172.21.15.47:0/2215506763 wait complete. 2024-07-24T22:15:31.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:31 smithi183 ceph-mon[37007]: pgmap v621: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1010 B/s rd, 275 B/s wr, 2 op/s 2024-07-24T22:15:31.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:31 smithi047 ceph-mon[32551]: pgmap v621: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1010 B/s rd, 275 B/s wr, 2 op/s 2024-07-24T22:15:31.743 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:15:31.743 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:15:31.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:31 smithi188 ceph-mon[37380]: pgmap v621: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1010 B/s rd, 275 B/s wr, 2 op/s 2024-07-24T22:15:32.020 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:15:33.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:33 smithi183 ceph-mon[37007]: pgmap v622: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:33.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:33 smithi047 ceph-mon[32551]: pgmap v622: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:33.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:33 smithi188 ceph-mon[37380]: pgmap v622: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:34.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.976+0000 7f179726c640 1 -- 172.21.15.47:0/358404947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1790101270 msgr2=0x7f1790101650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:34.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.976+0000 7f179726c640 1 --2- 172.21.15.47:0/358404947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1790101270 0x7f1790101650 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f1780009ca0 tx=0x7f178002a950 comp rx=0 tx=0).stop 2024-07-24T22:15:34.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.976+0000 7f179726c640 1 -- 172.21.15.47:0/358404947 shutdown_connections 2024-07-24T22:15:34.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.976+0000 7f179726c640 1 --2- 172.21.15.47:0/358404947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f179010ee20 0x7f1790111210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:34.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.976+0000 7f179726c640 1 --2- 172.21.15.47:0/358404947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1790101b90 0x7f179010e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:34.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.976+0000 7f179726c640 1 --2- 172.21.15.47:0/358404947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1790101270 0x7f1790101650 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:34.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.976+0000 7f179726c640 1 -- 172.21.15.47:0/358404947 >> 172.21.15.47:0/358404947 conn(0x7f17900fd0c0 msgr2=0x7f17900ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:34.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.976+0000 7f179726c640 1 -- 172.21.15.47:0/358404947 shutdown_connections 2024-07-24T22:15:34.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.976+0000 7f179726c640 1 -- 172.21.15.47:0/358404947 wait complete. 2024-07-24T22:15:34.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.977+0000 7f179726c640 1 Processor -- start 2024-07-24T22:15:34.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.977+0000 7f179726c640 1 -- start start 2024-07-24T22:15:34.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f179726c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1790101270 0x7f179019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:34.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f179726c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1790101b90 0x7f179019b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:34.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f179726c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f179010ee20 0x7f17901a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:34.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f179726c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1790114940 con 0x7f1790101b90 2024-07-24T22:15:34.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f179726c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17901147c0 con 0x7f179010ee20 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f179726c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1790114ac0 con 0x7f1790101270 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f1794807640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1790101b90 0x7f179019b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f1794807640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1790101b90 0x7f179019b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40048/0 (socket says 172.21.15.47:40048) 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f1794807640 1 -- 172.21.15.47:0/3551467458 learned_addr learned my addr 172.21.15.47:0/3551467458 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f1795008640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1790101270 0x7f179019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f1795809640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f179010ee20 0x7f17901a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f1794807640 1 -- 172.21.15.47:0/3551467458 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1790101270 msgr2=0x7f179019ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f1794807640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1790101270 0x7f179019ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f1794807640 1 -- 172.21.15.47:0/3551467458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f179010ee20 msgr2=0x7f17901a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f1794807640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f179010ee20 0x7f17901a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f1794807640 1 -- 172.21.15.47:0/3551467458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17901a0f00 con 0x7f1790101b90 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.978+0000 7f1794807640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1790101b90 0x7f179019b390 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f178400d950 tx=0x7f178400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.979+0000 7f178e7fc640 1 -- 172.21.15.47:0/3551467458 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784017070 con 0x7f1790101b90 2024-07-24T22:15:34.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.979+0000 7f178e7fc640 1 -- 172.21.15.47:0/3551467458 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1784009c30 con 0x7f1790101b90 2024-07-24T22:15:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.979+0000 7f179726c640 1 -- 172.21.15.47:0/3551467458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17901a11f0 con 0x7f1790101b90 2024-07-24T22:15:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.979+0000 7f178e7fc640 1 -- 172.21.15.47:0/3551467458 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178400f620 con 0x7f1790101b90 2024-07-24T22:15:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.979+0000 7f179726c640 1 -- 172.21.15.47:0/3551467458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17901a78b0 con 0x7f1790101b90 2024-07-24T22:15:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.980+0000 7f179726c640 1 -- 172.21.15.47:0/3551467458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1790101650 con 0x7f1790101b90 2024-07-24T22:15:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.981+0000 7f178e7fc640 1 -- 172.21.15.47:0/3551467458 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f1784010460 con 0x7f1790101b90 2024-07-24T22:15:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.982+0000 7f178e7fc640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17780b3d40 0x7f17780b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.982+0000 7f178e7fc640 1 -- 172.21.15.47:0/3551467458 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f17840e3bb0 con 0x7f1790101b90 2024-07-24T22:15:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.982+0000 7f1795008640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17780b3d40 0x7f17780b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.982+0000 7f1795008640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17780b3d40 0x7f17780b6200 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f178002af40 tx=0x7f1780005d80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:33.985+0000 7f178e7fc640 1 -- 172.21.15.47:0/3551467458 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f1784009de0 con 0x7f1790101b90 2024-07-24T22:15:34.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.220+0000 7f179726c640 1 -- 172.21.15.47:0/3551467458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17901a7c20 con 0x7f1790101b90 2024-07-24T22:15:34.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.220+0000 7f178e7fc640 1 -- 172.21.15.47:0/3551467458 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f17840b3160 con 0x7f1790101b90 2024-07-24T22:15:34.223 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:15:34.223 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:15:34.223 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:15:34.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.222+0000 7f179726c640 1 -- 172.21.15.47:0/3551467458 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17780b3d40 msgr2=0x7f17780b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:34.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.222+0000 7f179726c640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17780b3d40 0x7f17780b6200 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f178002af40 tx=0x7f1780005d80 comp rx=0 tx=0).stop 2024-07-24T22:15:34.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.222+0000 7f179726c640 1 -- 172.21.15.47:0/3551467458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1790101b90 msgr2=0x7f179019b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:34.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.222+0000 7f179726c640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1790101b90 0x7f179019b390 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f178400d950 tx=0x7f178400de10 comp rx=0 tx=0).stop 2024-07-24T22:15:34.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.222+0000 7f179726c640 1 -- 172.21.15.47:0/3551467458 shutdown_connections 2024-07-24T22:15:34.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.222+0000 7f179726c640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f17780b3d40 0x7f17780b6200 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:34.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.222+0000 7f179726c640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f179010ee20 0x7f17901a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:34.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.222+0000 7f179726c640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1790101b90 0x7f179019b390 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:34.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.222+0000 7f179726c640 1 --2- 172.21.15.47:0/3551467458 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1790101270 0x7f179019ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:34.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.222+0000 7f179726c640 1 -- 172.21.15.47:0/3551467458 >> 172.21.15.47:0/3551467458 conn(0x7f17900fd0c0 msgr2=0x7f17900ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:34.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.223+0000 7f179726c640 1 -- 172.21.15.47:0/3551467458 shutdown_connections 2024-07-24T22:15:34.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:34.223+0000 7f179726c640 1 -- 172.21.15.47:0/3551467458 wait complete. 2024-07-24T22:15:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:34 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3551467458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:15:34.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:34 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3551467458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:15:34.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:34 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3551467458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:15:34.915 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:15:35.183 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:15:35.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:35 smithi047 ceph-mon[32551]: pgmap v623: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:35.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:35 smithi183 ceph-mon[37007]: pgmap v623: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:35.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:35 smithi188 ceph-mon[37380]: pgmap v623: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.779+0000 7f891292c640 1 -- 172.21.15.47:0/607563397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f890c101690 msgr2=0x7f890c101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.779+0000 7f891292c640 1 --2- 172.21.15.47:0/607563397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f890c101690 0x7f890c101a70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f88fc009900 tx=0x7f88fc02a410 comp rx=0 tx=0).stop 2024-07-24T22:15:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.779+0000 7f891292c640 1 -- 172.21.15.47:0/607563397 shutdown_connections 2024-07-24T22:15:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.779+0000 7f891292c640 1 --2- 172.21.15.47:0/607563397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f890c107a20 0x7f890c10e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.779+0000 7f891292c640 1 --2- 172.21.15.47:0/607563397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f890c1070a0 0x7f890c1074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.779+0000 7f891292c640 1 --2- 172.21.15.47:0/607563397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f890c101690 0x7f890c101a70 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.779+0000 7f891292c640 1 -- 172.21.15.47:0/607563397 >> 172.21.15.47:0/607563397 conn(0x7f890c0fd100 msgr2=0x7f890c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:36.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.779+0000 7f891292c640 1 -- 172.21.15.47:0/607563397 shutdown_connections 2024-07-24T22:15:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.780+0000 7f891292c640 1 -- 172.21.15.47:0/607563397 wait complete. 2024-07-24T22:15:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.780+0000 7f891292c640 1 Processor -- start 2024-07-24T22:15:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.780+0000 7f891292c640 1 -- start start 2024-07-24T22:15:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f891292c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f890c101690 0x7f890c1999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f891292c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f890c1070a0 0x7f890c199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f891292c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f890c107a20 0x7f890c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f891292c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f890c111630 con 0x7f890c107a20 2024-07-24T22:15:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f891292c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f890c1114b0 con 0x7f890c1070a0 2024-07-24T22:15:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f891292c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f890c1117b0 con 0x7f890c101690 2024-07-24T22:15:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f8910ec9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f890c107a20 0x7f890c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f8910ec9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f890c107a20 0x7f890c19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44462/0 (socket says 172.21.15.47:44462) 2024-07-24T22:15:36.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f8910ec9640 1 -- 172.21.15.47:0/1644155086 learned_addr learned my addr 172.21.15.47:0/1644155086 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f890bfff640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f890c101690 0x7f890c1999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f8910ec9640 1 -- 172.21.15.47:0/1644155086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f890c101690 msgr2=0x7f890c1999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f8910ec9640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f890c101690 0x7f890c1999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f890b7fe640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f890c1070a0 0x7f890c199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f8910ec9640 1 -- 172.21.15.47:0/1644155086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f890c1070a0 msgr2=0x7f890c199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f8910ec9640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f890c1070a0 0x7f890c199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f8910ec9640 1 -- 172.21.15.47:0/1644155086 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890c1a4dc0 con 0x7f890c107a20 2024-07-24T22:15:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f890b7fe640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f890c1070a0 0x7f890c199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:15:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.781+0000 7f8910ec9640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f890c107a20 0x7f890c19a480 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f890400cce0 tx=0x7f890400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.782+0000 7f89097fa640 1 -- 172.21.15.47:0/1644155086 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890400f450 con 0x7f890c107a20 2024-07-24T22:15:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.782+0000 7f89097fa640 1 -- 172.21.15.47:0/1644155086 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f890400faa0 con 0x7f890c107a20 2024-07-24T22:15:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.782+0000 7f891292c640 1 -- 172.21.15.47:0/1644155086 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f890c1a50b0 con 0x7f890c107a20 2024-07-24T22:15:36.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.782+0000 7f89097fa640 1 -- 172.21.15.47:0/1644155086 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904018b70 con 0x7f890c107a20 2024-07-24T22:15:36.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.782+0000 7f891292c640 1 -- 172.21.15.47:0/1644155086 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f890c1a55f0 con 0x7f890c107a20 2024-07-24T22:15:36.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.784+0000 7f89097fa640 1 -- 172.21.15.47:0/1644155086 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8904018d10 con 0x7f890c107a20 2024-07-24T22:15:36.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.784+0000 7f8914cdd740 1 Processor -- start 2024-07-24T22:15:36.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.784+0000 7f8914cdd740 1 -- start start 2024-07-24T22:15:36.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.784+0000 7f8914cdd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823ef6d0 0x55fd823efab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.784+0000 7f8914cdd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 0x55fd823fba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.784+0000 7f8914cdd740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823fbf80 0x55fd823fe370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.784+0000 7f8914cdd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fd823669b0 con 0x55fd823efff0 2024-07-24T22:15:36.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.784+0000 7f8914cdd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fd82355eb0 con 0x55fd823ef6d0 2024-07-24T22:15:36.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.784+0000 7f8914cdd740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55fd82359ef0 con 0x55fd823fbf80 2024-07-24T22:15:36.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f890bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 0x55fd823fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f890bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 0x55fd823fba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44470/0 (socket says 172.21.15.47:44470) 2024-07-24T22:15:36.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f890bfff640 1 -- 172.21.15.47:0/3063603221 learned_addr learned my addr 172.21.15.47:0/3063603221 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:36.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f890b7fe640 1 --2- 172.21.15.47:0/3063603221 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823ef6d0 0x55fd823efab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f890b7fe640 1 --2- 172.21.15.47:0/3063603221 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823fbf80 0x55fd823fe370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f890bfff640 1 -- 172.21.15.47:0/3063603221 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823fbf80 msgr2=0x55fd823fe370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:36.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f890bfff640 1 --2- 172.21.15.47:0/3063603221 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823fbf80 0x55fd823fe370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f890bfff640 1 -- 172.21.15.47:0/3063603221 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823ef6d0 msgr2=0x55fd823efab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:36.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f890bfff640 1 --2- 172.21.15.47:0/3063603221 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823ef6d0 0x55fd823efab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f890bfff640 1 -- 172.21.15.47:0/3063603221 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd822df320 con 0x55fd823efff0 2024-07-24T22:15:36.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f890b7fe640 1 --2- 172.21.15.47:0/3063603221 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823fbf80 0x55fd823fe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:15:36.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f890bfff640 1 --2- 172.21.15.47:0/3063603221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 0x55fd823fba40 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f88fc009900 tx=0x7f88fc032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396eb6bec1854e6c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:36.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f88f27fc640 1 -- 172.21.15.47:0/3063603221 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc040070 con 0x55fd823efff0 2024-07-24T22:15:36.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f88f27fc640 1 -- 172.21.15.47:0/3063603221 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88fc0316a0 con 0x55fd823efff0 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f89097fa640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88f40b3dc0 0x7f88f40b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.785+0000 7f88f27fc640 1 -- 172.21.15.47:0/3063603221 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc035040 con 0x55fd823efff0 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.786+0000 7f890b7fe640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88f40b3dc0 0x7f88f40b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.786+0000 7f89097fa640 1 -- 172.21.15.47:0/1644155086 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f89040e4430 con 0x7f890c107a20 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.786+0000 7f8914cdd740 1 -- 172.21.15.47:0/3063603221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 msgr2=0x55fd823fba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.786+0000 7f8914cdd740 1 --2- 172.21.15.47:0/3063603221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 0x55fd823fba40 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f88fc009900 tx=0x7f88fc032e60 comp rx=0 tx=0).stop 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.786+0000 7f890b7fe640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88f40b3dc0 0x7f88f40b6280 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f89000058c0 tx=0x7f890000b580 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.786+0000 7f8914cdd740 1 -- 172.21.15.47:0/3063603221 shutdown_connections 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.786+0000 7f8914cdd740 1 --2- 172.21.15.47:0/3063603221 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823fbf80 0x55fd823fe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.786+0000 7f8914cdd740 1 --2- 172.21.15.47:0/3063603221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 0x55fd823fba40 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.786+0000 7f8914cdd740 1 --2- 172.21.15.47:0/3063603221 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823ef6d0 0x55fd823efab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.786+0000 7f8914cdd740 1 -- 172.21.15.47:0/3063603221 >> 172.21.15.47:0/3063603221 conn(0x55fd823ed500 msgr2=0x55fd823ee6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.786+0000 7f8914cdd740 1 -- 172.21.15.47:0/3063603221 shutdown_connections 2024-07-24T22:15:36.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.786+0000 7f8914cdd740 1 -- 172.21.15.47:0/3063603221 wait complete. 2024-07-24T22:15:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.787+0000 7f8914cdd740 1 -- start start 2024-07-24T22:15:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.787+0000 7f8914cdd740 1 Processor -- start 2024-07-24T22:15:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.787+0000 7f8914cdd740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823ef6d0 0x55fd823f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.787+0000 7f8914cdd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823efff0 0x55fd823f9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.787+0000 7f8914cdd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 0x55fd823f9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.787+0000 7f8914cdd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fd821b9700 con 0x55fd823fbf80 2024-07-24T22:15:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.787+0000 7f8914cdd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fd822f85f0 con 0x55fd823efff0 2024-07-24T22:15:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.787+0000 7f8914cdd740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55fd823feba0 con 0x55fd823ef6d0 2024-07-24T22:15:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.787+0000 7f8914cdd740 10 client.0 _ll_register_callbacks cb 0x55fd82318960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.787+0000 7f8910ec9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 0x55fd823f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.787+0000 7f8910ec9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 0x55fd823f9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44472/0 (socket says 172.21.15.47:44472) 2024-07-24T22:15:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.787+0000 7f8910ec9640 1 -- 172.21.15.47:0/3419243509 learned_addr learned my addr 172.21.15.47:0/3419243509 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:36.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.787+0000 7f890b7fe640 1 --2- 172.21.15.47:0/3419243509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823efff0 0x55fd823f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f890bfff640 1 --2- 172.21.15.47:0/3419243509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823ef6d0 0x55fd823f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f8910ec9640 1 -- 172.21.15.47:0/3419243509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823ef6d0 msgr2=0x55fd823f8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f8910ec9640 1 --2- 172.21.15.47:0/3419243509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823ef6d0 0x55fd823f8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f8910ec9640 1 -- 172.21.15.47:0/3419243509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823efff0 msgr2=0x55fd823f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f8910ec9640 1 --2- 172.21.15.47:0/3419243509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823efff0 0x55fd823f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f8910ec9640 1 -- 172.21.15.47:0/3419243509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd822eb680 con 0x55fd823fbf80 2024-07-24T22:15:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f8910ec9640 1 --2- 172.21.15.47:0/3419243509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 0x55fd823f9970 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f89040aafa0 tx=0x7f89040aab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2003847e8dd1ac34 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f88eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f88eb7fe640 1 -- 172.21.15.47:0/3419243509 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89040af610 con 0x55fd823fbf80 2024-07-24T22:15:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f88eb7fe640 1 -- 172.21.15.47:0/3419243509 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f89040b3c30 con 0x55fd823fbf80 2024-07-24T22:15:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f8914cdd740 1 -- 172.21.15.47:0/3419243509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88fc0316a0 con 0x55fd823fbf80 2024-07-24T22:15:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f88eb7fe640 1 -- 172.21.15.47:0/3419243509 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f89040b40c0 con 0x55fd823fbf80 2024-07-24T22:15:36.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f8914cdd740 10 client.17298 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f8914cdd740 1 -- 172.21.15.47:0/3419243509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fd820b6650 con 0x55fd823fbf80 2024-07-24T22:15:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f88eb7fe640 1 -- 172.21.15.47:0/3419243509 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88fc0316a0 con 0x55fd823fbf80 2024-07-24T22:15:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f88eb7fe640 1 -- 172.21.15.47:0/3419243509 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f89040a6980 con 0x55fd823fbf80 2024-07-24T22:15:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f8914cdd740 10 client.17298 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.788+0000 7f8914cdd740 10 client.17298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.789+0000 7f8914cdd740 20 client.17298 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.789+0000 7f8914cdd740 1 --2- 172.21.15.47:0/3419243509 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fd8240ba00 0x55fd8240de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.789+0000 7f8914cdd740 4 client.17298 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:15:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.789+0000 7f8914cdd740 1 -- 172.21.15.47:0/3419243509 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd82368900 con 0x55fd8240ba00 2024-07-24T22:15:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.789+0000 7f890bfff640 1 --2- 172.21.15.47:0/3419243509 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fd8240ba00 0x55fd8240de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.789+0000 7f88eb7fe640 10 client.17298 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.789+0000 7f890bfff640 1 --2- 172.21.15.47:0/3419243509 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fd8240ba00 0x55fd8240de10 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0475ba0d8875615 server_cookie=7d0bcdbc2fb2b680 in_seq=0 out_seq=0 2024-07-24T22:15:36.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.790+0000 7f88eb7fe640 1 -- 172.21.15.47:0/3419243509 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd82368900 con 0x55fd8240ba00 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.790+0000 7f88eb7fe640 10 client.17298 handle_command_reply: tid=0 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.790+0000 7f8914cdd740 1 client.17298 shutdown 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.790+0000 7f8914cdd740 1 -- 172.21.15.47:0/3419243509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 msgr2=0x55fd823f9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.790+0000 7f8914cdd740 1 --2- 172.21.15.47:0/3419243509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 0x55fd823f9970 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f89040aafa0 tx=0x7f89040aab20 comp rx=0 tx=0).stop 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.790+0000 7f8914cdd740 1 -- 172.21.15.47:0/3419243509 shutdown_connections 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.790+0000 7f8914cdd740 1 --2- 172.21.15.47:0/3419243509 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fd8240ba00 0x55fd8240de10 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.790+0000 7f8914cdd740 1 --2- 172.21.15.47:0/3419243509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 0x55fd823f9970 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.790+0000 7f8914cdd740 1 --2- 172.21.15.47:0/3419243509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823efff0 0x55fd823f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.790+0000 7f88eb7fe640 0 client.17298 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.790+0000 7f8914cdd740 1 --2- 172.21.15.47:0/3419243509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823ef6d0 0x55fd823f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.790+0000 7f8914cdd740 1 -- 172.21.15.47:0/3419243509 >> 172.21.15.47:0/3419243509 conn(0x55fd823ed500 msgr2=0x55fd823f30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.791+0000 7f8914cdd740 1 -- 172.21.15.47:0/3419243509 shutdown_connections 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.791+0000 7f8914cdd740 1 -- 172.21.15.47:0/3419243509 wait complete. 2024-07-24T22:15:36.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.791+0000 7f8914cdd740 20 client.17298 trim_cache size 0 max 16384 2024-07-24T22:15:36.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f8914cdd740 1 Processor -- start 2024-07-24T22:15:36.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f8914cdd740 1 -- start start 2024-07-24T22:15:36.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f8914cdd740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823ef6d0 0x55fd823eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f8914cdd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823efff0 0x55fd823ec460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f8914cdd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 0x55fd824136e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f8914cdd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f890c1ac0b0 con 0x55fd823fbf80 2024-07-24T22:15:36.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f8914cdd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f890c1ae910 con 0x55fd823efff0 2024-07-24T22:15:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f8914cdd740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f890c1ac700 con 0x55fd823ef6d0 2024-07-24T22:15:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f8910ec9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 0x55fd824136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f8910ec9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 0x55fd824136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44476/0 (socket says 172.21.15.47:44476) 2024-07-24T22:15:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f8910ec9640 1 -- 172.21.15.47:0/2082119520 learned_addr learned my addr 172.21.15.47:0/2082119520 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f890bfff640 1 --2- 172.21.15.47:0/2082119520 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823ef6d0 0x55fd823eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f890b7fe640 1 --2- 172.21.15.47:0/2082119520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823efff0 0x55fd823ec460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.805+0000 7f8910ec9640 1 -- 172.21.15.47:0/2082119520 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823ef6d0 msgr2=0x55fd823eebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.806+0000 7f8910ec9640 1 --2- 172.21.15.47:0/2082119520 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823ef6d0 0x55fd823eebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.806+0000 7f8910ec9640 1 -- 172.21.15.47:0/2082119520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823efff0 msgr2=0x55fd823ec460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.806+0000 7f8910ec9640 1 --2- 172.21.15.47:0/2082119520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823efff0 0x55fd823ec460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.806+0000 7f8910ec9640 1 -- 172.21.15.47:0/2082119520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd823e8e20 con 0x55fd823fbf80 2024-07-24T22:15:36.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.806+0000 7f890b7fe640 1 --2- 172.21.15.47:0/2082119520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823efff0 0x55fd823ec460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:15:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.806+0000 7f8910ec9640 1 --2- 172.21.15.47:0/2082119520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 0x55fd824136e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f89040e2150 tx=0x7f890400ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55939277409cdb6c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.806+0000 7f88f1ffb640 1 -- 172.21.15.47:0/2082119520 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89040a9ce0 con 0x55fd823fbf80 2024-07-24T22:15:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.806+0000 7f88f1ffb640 1 -- 172.21.15.47:0/2082119520 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89040af610 con 0x55fd823fbf80 2024-07-24T22:15:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.806+0000 7f88f1ffb640 1 -- 172.21.15.47:0/2082119520 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890400f5f0 con 0x55fd823fbf80 2024-07-24T22:15:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.807+0000 7f8914cdd740 1 -- 172.21.15.47:0/2082119520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 msgr2=0x55fd824136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.807+0000 7f8914cdd740 1 --2- 172.21.15.47:0/2082119520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 0x55fd824136e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f89040e2150 tx=0x7f890400ff50 comp rx=0 tx=0).stop 2024-07-24T22:15:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.807+0000 7f8914cdd740 1 -- 172.21.15.47:0/2082119520 shutdown_connections 2024-07-24T22:15:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.807+0000 7f8914cdd740 1 --2- 172.21.15.47:0/2082119520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823fbf80 0x55fd824136e0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.807+0000 7f8914cdd740 1 --2- 172.21.15.47:0/2082119520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823efff0 0x55fd823ec460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.807+0000 7f8914cdd740 1 --2- 172.21.15.47:0/2082119520 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823ef6d0 0x55fd823eebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.807+0000 7f8914cdd740 1 -- 172.21.15.47:0/2082119520 >> 172.21.15.47:0/2082119520 conn(0x55fd823ed500 msgr2=0x55fd823ebd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.807+0000 7f8914cdd740 1 -- 172.21.15.47:0/2082119520 shutdown_connections 2024-07-24T22:15:36.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.807+0000 7f8914cdd740 1 -- 172.21.15.47:0/2082119520 wait complete. 2024-07-24T22:15:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.807+0000 7f8914cdd740 1 -- start start 2024-07-24T22:15:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.807+0000 7f8914cdd740 1 Processor -- start 2024-07-24T22:15:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f8914cdd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823ef6d0 0x55fd824042a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f8914cdd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 0x55fd823ff770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f8914cdd740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823fbf80 0x55fd823ffcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f8914cdd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f890c1acdd0 con 0x55fd823efff0 2024-07-24T22:15:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f8914cdd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f890c1ae240 con 0x55fd823ef6d0 2024-07-24T22:15:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f8914cdd740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f890c1ad4a0 con 0x55fd823fbf80 2024-07-24T22:15:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f8914cdd740 10 client.0 _ll_register_callbacks cb 0x7f89040077a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f890b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 0x55fd823ff770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f890b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 0x55fd823ff770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44482/0 (socket says 172.21.15.47:44482) 2024-07-24T22:15:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f890b7fe640 1 -- 172.21.15.47:0/2533372340 learned_addr learned my addr 172.21.15.47:0/2533372340 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f8910ec9640 1 --2- 172.21.15.47:0/2533372340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823fbf80 0x55fd823ffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f890bfff640 1 --2- 172.21.15.47:0/2533372340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823ef6d0 0x55fd824042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f890b7fe640 1 -- 172.21.15.47:0/2533372340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823fbf80 msgr2=0x55fd823ffcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f890b7fe640 1 --2- 172.21.15.47:0/2533372340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823fbf80 0x55fd823ffcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f890b7fe640 1 -- 172.21.15.47:0/2533372340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823ef6d0 msgr2=0x55fd824042a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f890b7fe640 1 --2- 172.21.15.47:0/2533372340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823ef6d0 0x55fd824042a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f890b7fe640 1 -- 172.21.15.47:0/2533372340 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd824002f0 con 0x55fd823efff0 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f890b7fe640 1 --2- 172.21.15.47:0/2533372340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 0x55fd823ff770 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f890001f8f0 tx=0x7f8900005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db94215845fd382 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.808+0000 7f88eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f88eb7fe640 1 -- 172.21.15.47:0/2533372340 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900004220 con 0x55fd823efff0 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f88eb7fe640 1 -- 172.21.15.47:0/2533372340 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f89000043c0 con 0x55fd823efff0 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f8914cdd740 1 -- 172.21.15.47:0/2533372340 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89040af610 con 0x55fd823efff0 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f88eb7fe640 1 -- 172.21.15.47:0/2533372340 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f890001c610 con 0x55fd823efff0 2024-07-24T22:15:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f8914cdd740 10 client.17304 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f8914cdd740 1 -- 172.21.15.47:0/2533372340 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fd82476570 con 0x55fd823efff0 2024-07-24T22:15:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f88eb7fe640 1 -- 172.21.15.47:0/2533372340 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89040af610 con 0x55fd823efff0 2024-07-24T22:15:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f88eb7fe640 1 -- 172.21.15.47:0/2533372340 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8900028070 con 0x55fd823efff0 2024-07-24T22:15:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f8914cdd740 10 client.17304 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f8914cdd740 10 client.17304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f8914cdd740 20 client.17304 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f8914cdd740 1 --2- 172.21.15.47:0/2533372340 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fd82476da0 0x55fd824791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f8914cdd740 4 client.17304 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:15:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.809+0000 7f8914cdd740 1 -- 172.21.15.47:0/2533372340 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd823643a0 con 0x55fd82476da0 2024-07-24T22:15:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.810+0000 7f890bfff640 1 --2- 172.21.15.47:0/2533372340 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fd82476da0 0x55fd824791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.810+0000 7f88eb7fe640 10 client.17304 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.810+0000 7f890bfff640 1 --2- 172.21.15.47:0/2533372340 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fd82476da0 0x55fd824791c0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a76c8248ec0bbd07 server_cookie=bf4304ed14e7c688 in_seq=0 out_seq=0 2024-07-24T22:15:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f88eb7fe640 1 -- 172.21.15.47:0/2533372340 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd823643a0 con 0x55fd82476da0 2024-07-24T22:15:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f88eb7fe640 10 client.17304 handle_command_reply: tid=0 2024-07-24T22:15:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f8914cdd740 1 client.17304 shutdown 2024-07-24T22:15:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f8914cdd740 1 -- 172.21.15.47:0/2533372340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 msgr2=0x55fd823ff770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f8914cdd740 1 --2- 172.21.15.47:0/2533372340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 0x55fd823ff770 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f890001f8f0 tx=0x7f8900005850 comp rx=0 tx=0).stop 2024-07-24T22:15:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f8914cdd740 1 -- 172.21.15.47:0/2533372340 shutdown_connections 2024-07-24T22:15:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f8914cdd740 1 --2- 172.21.15.47:0/2533372340 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55fd82476da0 0x55fd824791c0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f8914cdd740 1 --2- 172.21.15.47:0/2533372340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fd823fbf80 0x55fd823ffcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f8914cdd740 1 --2- 172.21.15.47:0/2533372340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd823efff0 0x55fd823ff770 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f8914cdd740 1 --2- 172.21.15.47:0/2533372340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fd823ef6d0 0x55fd824042a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f8914cdd740 1 -- 172.21.15.47:0/2533372340 >> 172.21.15.47:0/2533372340 conn(0x55fd823ed500 msgr2=0x55fd823ec570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f88eb7fe640 0 client.17304 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f8914cdd740 1 -- 172.21.15.47:0/2533372340 shutdown_connections 2024-07-24T22:15:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f8914cdd740 1 -- 172.21.15.47:0/2533372340 wait complete. 2024-07-24T22:15:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.811+0000 7f8914cdd740 20 client.17304 trim_cache size 0 max 16384 2024-07-24T22:15:36.828 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:15:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.812+0000 7f891292c640 1 -- 172.21.15.47:0/1644155086 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88f40b3dc0 msgr2=0x7f88f40b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.812+0000 7f891292c640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88f40b3dc0 0x7f88f40b6280 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f89000058c0 tx=0x7f890000b580 comp rx=0 tx=0).stop 2024-07-24T22:15:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.812+0000 7f891292c640 1 -- 172.21.15.47:0/1644155086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f890c107a20 msgr2=0x7f890c19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.812+0000 7f891292c640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f890c107a20 0x7f890c19a480 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f890400cce0 tx=0x7f890400a620 comp rx=0 tx=0).stop 2024-07-24T22:15:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.812+0000 7f891292c640 1 -- 172.21.15.47:0/1644155086 shutdown_connections 2024-07-24T22:15:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.812+0000 7f891292c640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f88f40b3dc0 0x7f88f40b6280 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.812+0000 7f891292c640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f890c107a20 0x7f890c19a480 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.812+0000 7f891292c640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f890c1070a0 0x7f890c199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.812+0000 7f891292c640 1 --2- 172.21.15.47:0/1644155086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f890c101690 0x7f890c1999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.812+0000 7f891292c640 1 -- 172.21.15.47:0/1644155086 >> 172.21.15.47:0/1644155086 conn(0x7f890c0fd100 msgr2=0x7f890c0fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.812+0000 7f891292c640 1 -- 172.21.15.47:0/1644155086 shutdown_connections 2024-07-24T22:15:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:36.812+0000 7f891292c640 1 -- 172.21.15.47:0/1644155086 wait complete. 2024-07-24T22:15:37.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.251+0000 7f40c75e8640 1 -- 172.21.15.47:0/2170704941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40c010ed80 msgr2=0x7f40c0111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:37.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.251+0000 7f40c75e8640 1 --2- 172.21.15.47:0/2170704941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40c010ed80 0x7f40c0111170 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009ca0 tx=0x7f40b802a950 comp rx=0 tx=0).stop 2024-07-24T22:15:37.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.251+0000 7f40c75e8640 1 -- 172.21.15.47:0/2170704941 shutdown_connections 2024-07-24T22:15:37.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.251+0000 7f40c75e8640 1 --2- 172.21.15.47:0/2170704941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40c010ed80 0x7f40c0111170 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.251+0000 7f40c75e8640 1 --2- 172.21.15.47:0/2170704941 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40c0101af0 0x7f40c010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.251+0000 7f40c75e8640 1 --2- 172.21.15.47:0/2170704941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40c01011d0 0x7f40c01015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.251+0000 7f40c75e8640 1 -- 172.21.15.47:0/2170704941 >> 172.21.15.47:0/2170704941 conn(0x7f40c00782e0 msgr2=0x7f40c00ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.251+0000 7f40c75e8640 1 -- 172.21.15.47:0/2170704941 shutdown_connections 2024-07-24T22:15:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.251+0000 7f40c75e8640 1 -- 172.21.15.47:0/2170704941 wait complete. 2024-07-24T22:15:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c75e8640 1 Processor -- start 2024-07-24T22:15:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c75e8640 1 -- start start 2024-07-24T22:15:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c75e8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40c01011d0 0x7f40c019ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c75e8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40c0101af0 0x7f40c019b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c75e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40c010ed80 0x7f40c01a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c75e8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40c0114860 con 0x7f40c010ed80 2024-07-24T22:15:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c75e8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01146e0 con 0x7f40c0101af0 2024-07-24T22:15:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c75e8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01149e0 con 0x7f40c01011d0 2024-07-24T22:15:37.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c5b85640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40c010ed80 0x7f40c01a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c5b85640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40c010ed80 0x7f40c01a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44502/0 (socket says 172.21.15.47:44502) 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c5b85640 1 -- 172.21.15.47:0/3850601765 learned_addr learned my addr 172.21.15.47:0/3850601765 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c4b83640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40c0101af0 0x7f40c019b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c5b85640 1 -- 172.21.15.47:0/3850601765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40c01011d0 msgr2=0x7f40c019ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c5384640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40c01011d0 0x7f40c019ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c5b85640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40c01011d0 0x7f40c019ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c5b85640 1 -- 172.21.15.47:0/3850601765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40c0101af0 msgr2=0x7f40c019b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c5b85640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40c0101af0 0x7f40c019b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c5b85640 1 -- 172.21.15.47:0/3850601765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c01a0e20 con 0x7f40c010ed80 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c4b83640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40c0101af0 0x7f40c019b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.252+0000 7f40c5b85640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40c010ed80 0x7f40c01a0650 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f40b802ae70 tx=0x7f40b802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.253+0000 7f40b67fc640 1 -- 172.21.15.47:0/3850601765 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b8034040 con 0x7f40c010ed80 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.253+0000 7f40b67fc640 1 -- 172.21.15.47:0/3850601765 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40b80308f0 con 0x7f40c010ed80 2024-07-24T22:15:37.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.253+0000 7f40c75e8640 1 -- 172.21.15.47:0/3850601765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c01a10b0 con 0x7f40c010ed80 2024-07-24T22:15:37.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.253+0000 7f40b67fc640 1 -- 172.21.15.47:0/3850601765 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b80047f0 con 0x7f40c010ed80 2024-07-24T22:15:37.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.253+0000 7f40c75e8640 1 -- 172.21.15.47:0/3850601765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c01a77d0 con 0x7f40c010ed80 2024-07-24T22:15:37.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40ca411740 1 Processor -- start 2024-07-24T22:15:37.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40b67fc640 1 -- 172.21.15.47:0/3850601765 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f40b8037020 con 0x7f40c010ed80 2024-07-24T22:15:37.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40ca411740 1 -- start start 2024-07-24T22:15:37.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40ca411740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa6118c0 0x55adfa611ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40ca411740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6121e0 0x55adfa61dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40ca411740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa61e170 0x55adfa620560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40ca411740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55adfa587280 con 0x55adfa6121e0 2024-07-24T22:15:37.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40ca411740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55adfa576780 con 0x55adfa6118c0 2024-07-24T22:15:37.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40ca411740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55adfa57a7c0 con 0x55adfa61e170 2024-07-24T22:15:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40c5384640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6121e0 0x55adfa61dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40c5384640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6121e0 0x55adfa61dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44518/0 (socket says 172.21.15.47:44518) 2024-07-24T22:15:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40c5384640 1 -- 172.21.15.47:0/4066230717 learned_addr learned my addr 172.21.15.47:0/4066230717 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40c4b83640 1 --2- 172.21.15.47:0/4066230717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa6118c0 0x55adfa611ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40c4b83640 1 --2- 172.21.15.47:0/4066230717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa61e170 0x55adfa620560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40c5384640 1 -- 172.21.15.47:0/4066230717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa61e170 msgr2=0x55adfa620560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40c5384640 1 --2- 172.21.15.47:0/4066230717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa61e170 0x55adfa620560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40c5384640 1 -- 172.21.15.47:0/4066230717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa6118c0 msgr2=0x55adfa611ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40c5384640 1 --2- 172.21.15.47:0/4066230717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa6118c0 0x55adfa611ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40c5384640 1 -- 172.21.15.47:0/4066230717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adfa2da790 con 0x55adfa6121e0 2024-07-24T22:15:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40c4b83640 1 --2- 172.21.15.47:0/4066230717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa6118c0 0x55adfa611ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:15:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.256+0000 7f40b67fc640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40ac0b3d40 0x7f40ac0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.257+0000 7f40c5384640 1 --2- 172.21.15.47:0/4066230717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6121e0 0x55adfa61dc30 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00baa0 tx=0x7f40bc00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112473401b8363bc server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.257+0000 7f40c4b83640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40ac0b3d40 0x7f40ac0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.257+0000 7f40b67fc640 1 -- 172.21.15.47:0/3850601765 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f40b8104f70 con 0x7f40c010ed80 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.257+0000 7f40ab7fe640 1 -- 172.21.15.47:0/4066230717 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc017420 con 0x55adfa6121e0 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.257+0000 7f40ab7fe640 1 -- 172.21.15.47:0/4066230717 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40bc017a70 con 0x55adfa6121e0 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.257+0000 7f40ab7fe640 1 -- 172.21.15.47:0/4066230717 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc00fa50 con 0x55adfa6121e0 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 -- 172.21.15.47:0/4066230717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6121e0 msgr2=0x55adfa61dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40c4b83640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40ac0b3d40 0x7f40ac0b6200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f40b00058c0 tx=0x7f40b000b3a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 --2- 172.21.15.47:0/4066230717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6121e0 0x55adfa61dc30 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00baa0 tx=0x7f40bc00bf60 comp rx=0 tx=0).stop 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 -- 172.21.15.47:0/4066230717 shutdown_connections 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 --2- 172.21.15.47:0/4066230717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa61e170 0x55adfa620560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 --2- 172.21.15.47:0/4066230717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6121e0 0x55adfa61dc30 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 --2- 172.21.15.47:0/4066230717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa6118c0 0x55adfa611ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 -- 172.21.15.47:0/4066230717 >> 172.21.15.47:0/4066230717 conn(0x55adfa60f6f0 msgr2=0x55adfa610890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:37.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 -- 172.21.15.47:0/4066230717 shutdown_connections 2024-07-24T22:15:37.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 -- 172.21.15.47:0/4066230717 wait complete. 2024-07-24T22:15:37.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 -- start start 2024-07-24T22:15:37.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 Processor -- start 2024-07-24T22:15:37.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa61d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 0x55adfa61ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 0x55adfa61b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55adfa4b0ab0 con 0x55adfa6118c0 2024-07-24T22:15:37.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55adfa4fe9e0 con 0x55adfa61e170 2024-07-24T22:15:37.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.258+0000 7f40ca411740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55adfa620e50 con 0x55adfa6121e0 2024-07-24T22:15:37.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40ca411740 10 client.0 _ll_register_callbacks cb 0x55adfa286a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:37.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40c5384640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa61d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40c5384640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa61d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44528/0 (socket says 172.21.15.47:44528) 2024-07-24T22:15:37.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40c5384640 1 -- 172.21.15.47:0/33725554 learned_addr learned my addr 172.21.15.47:0/33725554 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:37.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40c5b85640 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 0x55adfa61b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40c4b83640 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 0x55adfa61ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40c5384640 1 -- 172.21.15.47:0/33725554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 msgr2=0x55adfa61ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:37.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40c5384640 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 0x55adfa61ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40c5384640 1 -- 172.21.15.47:0/33725554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 msgr2=0x55adfa61b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:37.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40c5384640 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 0x55adfa61b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40c5384640 1 -- 172.21.15.47:0/33725554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adfa353620 con 0x55adfa6118c0 2024-07-24T22:15:37.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40c5b85640 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 0x55adfa61b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:15:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40c5384640 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa61d8c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f40bc019040 tx=0x7f40bc005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98d48742eedfed2 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40a8ff9640 1 -- 172.21.15.47:0/33725554 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc025070 con 0x55adfa6118c0 2024-07-24T22:15:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40a8ff9640 1 -- 172.21.15.47:0/33725554 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f40bc00f9d0 con 0x55adfa6118c0 2024-07-24T22:15:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40ca411740 1 -- 172.21.15.47:0/33725554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55adfa525ce0 con 0x55adfa6118c0 2024-07-24T22:15:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40a8ff9640 1 -- 172.21.15.47:0/33725554 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f40bc031050 con 0x55adfa6118c0 2024-07-24T22:15:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.259+0000 7f40ca411740 10 client.17316 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.260+0000 7f40ca411740 1 -- 172.21.15.47:0/33725554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55adfa62c610 con 0x55adfa6118c0 2024-07-24T22:15:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.260+0000 7f40a8ff9640 1 -- 172.21.15.47:0/33725554 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55adfa525ce0 con 0x55adfa6118c0 2024-07-24T22:15:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.260+0000 7f40a8ff9640 1 -- 172.21.15.47:0/33725554 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f40bc021420 con 0x55adfa6118c0 2024-07-24T22:15:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.260+0000 7f40ca411740 10 client.17316 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.260+0000 7f40ca411740 10 client.17316 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:37.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.260+0000 7f40ca411740 20 client.17316 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:37.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.260+0000 7f40ca411740 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55adfa62da20 0x55adfa62fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.260+0000 7f40ca411740 4 client.17316 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:15:37.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.260+0000 7f40ca411740 1 -- 172.21.15.47:0/33725554 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55adfa5891d0 con 0x55adfa62da20 2024-07-24T22:15:37.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.260+0000 7f40c4b83640 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55adfa62da20 0x55adfa62fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.261+0000 7f40a8ff9640 10 client.17316 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:37.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.261+0000 7f40c4b83640 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55adfa62da20 0x55adfa62fe10 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22ff6bb5d1f3aa29 server_cookie=5048aa8064426398 in_seq=0 out_seq=0 2024-07-24T22:15:37.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.261+0000 7f40a8ff9640 1 -- 172.21.15.47:0/33725554 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55adfa5891d0 con 0x55adfa62da20 2024-07-24T22:15:37.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.261+0000 7f40a8ff9640 10 client.17316 handle_command_reply: tid=0 2024-07-24T22:15:37.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.261+0000 7f40ca411740 1 client.17316 shutdown 2024-07-24T22:15:37.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.262+0000 7f40ca411740 1 -- 172.21.15.47:0/33725554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 msgr2=0x55adfa61d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:37.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.262+0000 7f40ca411740 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa61d8c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f40bc019040 tx=0x7f40bc005270 comp rx=0 tx=0).stop 2024-07-24T22:15:37.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.262+0000 7f40ca411740 1 -- 172.21.15.47:0/33725554 shutdown_connections 2024-07-24T22:15:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.262+0000 7f40ca411740 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55adfa62da20 0x55adfa62fe10 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.262+0000 7f40ca411740 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 0x55adfa61b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.262+0000 7f40a8ff9640 0 client.17316 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.262+0000 7f40ca411740 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 0x55adfa61ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.262+0000 7f40ca411740 1 --2- 172.21.15.47:0/33725554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa61d8c0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.262+0000 7f40ca411740 1 -- 172.21.15.47:0/33725554 >> 172.21.15.47:0/33725554 conn(0x55adfa60f6f0 msgr2=0x55adfa615290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.262+0000 7f40ca411740 1 -- 172.21.15.47:0/33725554 shutdown_connections 2024-07-24T22:15:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.262+0000 7f40ca411740 1 -- 172.21.15.47:0/33725554 wait complete. 2024-07-24T22:15:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.262+0000 7f40ca411740 20 client.17316 trim_cache size 0 max 16384 2024-07-24T22:15:37.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.277+0000 7f40ca411740 1 Processor -- start 2024-07-24T22:15:37.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.277+0000 7f40ca411740 1 -- start start 2024-07-24T22:15:37.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.277+0000 7f40ca411740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa61a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.277+0000 7f40ca411740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 0x55adfa61d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.277+0000 7f40ca411740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 0x55adfa61d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.277+0000 7f40ca411740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01ae2d0 con 0x55adfa6118c0 2024-07-24T22:15:37.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.277+0000 7f40ca411740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01b0b30 con 0x55adfa61e170 2024-07-24T22:15:37.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.277+0000 7f40ca411740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01ae920 con 0x55adfa6121e0 2024-07-24T22:15:37.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.277+0000 7f40c5384640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa61a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.278+0000 7f40c5384640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa61a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44536/0 (socket says 172.21.15.47:44536) 2024-07-24T22:15:37.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.278+0000 7f40c5384640 1 -- 172.21.15.47:0/2879283093 learned_addr learned my addr 172.21.15.47:0/2879283093 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:37.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.278+0000 7f40c5384640 1 -- 172.21.15.47:0/2879283093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 msgr2=0x55adfa61d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:37.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.278+0000 7f40c5384640 1 --2- 172.21.15.47:0/2879283093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 0x55adfa61d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.278+0000 7f40c5384640 1 -- 172.21.15.47:0/2879283093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 msgr2=0x55adfa61d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:37.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.278+0000 7f40c5384640 1 --2- 172.21.15.47:0/2879283093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 0x55adfa61d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.278+0000 7f40c5384640 1 -- 172.21.15.47:0/2879283093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adfa6125c0 con 0x55adfa6118c0 2024-07-24T22:15:37.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.278+0000 7f40c5384640 1 --2- 172.21.15.47:0/2879283093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa61a4e0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00baa0 tx=0x7f40bc0056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7293a43babb9a978 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.278+0000 7f40aaffd640 1 -- 172.21.15.47:0/2879283093 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc03a070 con 0x55adfa6118c0 2024-07-24T22:15:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.278+0000 7f40aaffd640 1 -- 172.21.15.47:0/2879283093 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40bc02e030 con 0x55adfa6118c0 2024-07-24T22:15:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.278+0000 7f40aaffd640 1 -- 172.21.15.47:0/2879283093 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc025040 con 0x55adfa6118c0 2024-07-24T22:15:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 -- 172.21.15.47:0/2879283093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 msgr2=0x55adfa61a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 --2- 172.21.15.47:0/2879283093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa61a4e0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00baa0 tx=0x7f40bc0056a0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 -- 172.21.15.47:0/2879283093 shutdown_connections 2024-07-24T22:15:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 --2- 172.21.15.47:0/2879283093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 0x55adfa61d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 --2- 172.21.15.47:0/2879283093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 0x55adfa61d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 --2- 172.21.15.47:0/2879283093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa61a4e0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 -- 172.21.15.47:0/2879283093 >> 172.21.15.47:0/2879283093 conn(0x55adfa60f6f0 msgr2=0x55adfa60e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 -- 172.21.15.47:0/2879283093 shutdown_connections 2024-07-24T22:15:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 -- 172.21.15.47:0/2879283093 wait complete. 2024-07-24T22:15:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 -- start start 2024-07-24T22:15:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 Processor -- start 2024-07-24T22:15:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa621240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 0x55adfa621780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.279+0000 7f40ca411740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 0x55adfa696430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40ca411740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01aeff0 con 0x55adfa6118c0 2024-07-24T22:15:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40ca411740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01b0460 con 0x55adfa61e170 2024-07-24T22:15:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40ca411740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01af6c0 con 0x55adfa6121e0 2024-07-24T22:15:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40ca411740 10 client.0 _ll_register_callbacks cb 0x7f40bc00b8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40c5384640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa621240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40c5384640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa621240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44550/0 (socket says 172.21.15.47:44550) 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40c5384640 1 -- 172.21.15.47:0/3529056285 learned_addr learned my addr 172.21.15.47:0/3529056285 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40c4b83640 1 --2- 172.21.15.47:0/3529056285 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 0x55adfa621780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40c5384640 1 -- 172.21.15.47:0/3529056285 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 msgr2=0x55adfa621780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40c5384640 1 --2- 172.21.15.47:0/3529056285 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 0x55adfa621780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40c5384640 1 -- 172.21.15.47:0/3529056285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 msgr2=0x55adfa696430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40c5384640 1 --2- 172.21.15.47:0/3529056285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 0x55adfa696430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40c5384640 1 -- 172.21.15.47:0/3529056285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adfa622050 con 0x55adfa6118c0 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40c5384640 1 --2- 172.21.15.47:0/3529056285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa621240 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f40bc038040 tx=0x7f40bc005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bf8b1a218f8ed5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40a8ff9640 1 -- 172.21.15.47:0/3529056285 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc03a070 con 0x55adfa6118c0 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40a8ff9640 1 -- 172.21.15.47:0/3529056285 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f40bc021420 con 0x55adfa6118c0 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40ca411740 1 -- 172.21.15.47:0/3529056285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40bc02e030 con 0x55adfa6118c0 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40a8ff9640 1 -- 172.21.15.47:0/3529056285 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f40bc025040 con 0x55adfa6118c0 2024-07-24T22:15:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40ca411740 10 client.17322 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.280+0000 7f40ca411740 1 -- 172.21.15.47:0/3529056285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55adfa697a80 con 0x55adfa6118c0 2024-07-24T22:15:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.281+0000 7f40a8ff9640 1 -- 172.21.15.47:0/3529056285 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40bc02e030 con 0x55adfa6118c0 2024-07-24T22:15:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.281+0000 7f40a8ff9640 1 -- 172.21.15.47:0/3529056285 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f40bc004b60 con 0x55adfa6118c0 2024-07-24T22:15:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.281+0000 7f40ca411740 10 client.17322 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.281+0000 7f40ca411740 10 client.17322 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.281+0000 7f40ca411740 20 client.17322 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.281+0000 7f40ca411740 1 --2- 172.21.15.47:0/3529056285 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55adfa6981a0 0x55adfa69a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.281+0000 7f40ca411740 4 client.17322 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:15:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.281+0000 7f40ca411740 1 -- 172.21.15.47:0/3529056285 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55adfa584c70 con 0x55adfa6981a0 2024-07-24T22:15:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.281+0000 7f40c4b83640 1 --2- 172.21.15.47:0/3529056285 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55adfa6981a0 0x55adfa69a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.281+0000 7f40a8ff9640 10 client.17322 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.281+0000 7f40c4b83640 1 --2- 172.21.15.47:0/3529056285 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55adfa6981a0 0x55adfa69a5c0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10c834e94cf31add server_cookie=301b6accef947ae7 in_seq=0 out_seq=0 2024-07-24T22:15:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.286+0000 7f40a8ff9640 1 -- 172.21.15.47:0/3529056285 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55adfa584c70 con 0x55adfa6981a0 2024-07-24T22:15:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.286+0000 7f40a8ff9640 10 client.17322 handle_command_reply: tid=0 2024-07-24T22:15:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.286+0000 7f40ca411740 1 client.17322 shutdown 2024-07-24T22:15:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40ca411740 1 -- 172.21.15.47:0/3529056285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 msgr2=0x55adfa621240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40ca411740 1 --2- 172.21.15.47:0/3529056285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa621240 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f40bc038040 tx=0x7f40bc005a10 comp rx=0 tx=0).stop 2024-07-24T22:15:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40ca411740 1 -- 172.21.15.47:0/3529056285 shutdown_connections 2024-07-24T22:15:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40ca411740 1 --2- 172.21.15.47:0/3529056285 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55adfa6981a0 0x55adfa69a5c0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40ca411740 1 --2- 172.21.15.47:0/3529056285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55adfa61e170 0x55adfa696430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40a8ff9640 0 client.17322 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40ca411740 1 --2- 172.21.15.47:0/3529056285 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55adfa6121e0 0x55adfa621780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40ca411740 1 --2- 172.21.15.47:0/3529056285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55adfa6118c0 0x55adfa621240 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40ca411740 1 -- 172.21.15.47:0/3529056285 >> 172.21.15.47:0/3529056285 conn(0x55adfa60f6f0 msgr2=0x55adfa60df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40ca411740 1 -- 172.21.15.47:0/3529056285 shutdown_connections 2024-07-24T22:15:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40ca411740 1 -- 172.21.15.47:0/3529056285 wait complete. 2024-07-24T22:15:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40ca411740 20 client.17322 trim_cache size 0 max 16384 2024-07-24T22:15:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:15:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:15:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:15:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:15:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40c75e8640 1 -- 172.21.15.47:0/3850601765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40ac0b3d40 msgr2=0x7f40ac0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40c75e8640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40ac0b3d40 0x7f40ac0b6200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f40b00058c0 tx=0x7f40b000b3a0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40c75e8640 1 -- 172.21.15.47:0/3850601765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40c010ed80 msgr2=0x7f40c01a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40c75e8640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40c010ed80 0x7f40c01a0650 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f40b802ae70 tx=0x7f40b802f5d0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40c75e8640 1 -- 172.21.15.47:0/3850601765 shutdown_connections 2024-07-24T22:15:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40c75e8640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f40ac0b3d40 0x7f40ac0b6200 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40c75e8640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40c010ed80 0x7f40c01a0650 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40c75e8640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40c0101af0 0x7f40c019b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40c75e8640 1 --2- 172.21.15.47:0/3850601765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40c01011d0 0x7f40c019ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.287+0000 7f40c75e8640 1 -- 172.21.15.47:0/3850601765 >> 172.21.15.47:0/3850601765 conn(0x7f40c00782e0 msgr2=0x7f40c0110fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.288+0000 7f40c75e8640 1 -- 172.21.15.47:0/3850601765 shutdown_connections 2024-07-24T22:15:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:37.288+0000 7f40c75e8640 1 -- 172.21.15.47:0/3850601765 wait complete. 2024-07-24T22:15:37.491 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:37 smithi047 ceph-mon[32551]: pgmap v624: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:37.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:37 smithi183 ceph-mon[37007]: pgmap v624: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:37.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:37 smithi188 ceph-mon[37380]: pgmap v624: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:38.520 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:15:38.520 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:15:38.801 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:15:39.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:39 smithi183 ceph-mon[37007]: pgmap v625: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:39.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:39 smithi047 ceph-mon[32551]: pgmap v625: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:39.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:39 smithi188 ceph-mon[37380]: pgmap v625: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:40.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.592+0000 7f092e460640 1 -- 172.21.15.47:0/3366509694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0928108b00 msgr2=0x7f092810f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:40.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.592+0000 7f092e460640 1 --2- 172.21.15.47:0/3366509694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0928108b00 0x7f092810f300 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f0920009ca0 tx=0x7f092002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.592+0000 7f092e460640 1 -- 172.21.15.47:0/3366509694 shutdown_connections 2024-07-24T22:15:40.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.592+0000 7f092e460640 1 --2- 172.21.15.47:0/3366509694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0928108b00 0x7f092810f300 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.592+0000 7f092e460640 1 --2- 172.21.15.47:0/3366509694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0928108180 0x7f09281085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.592+0000 7f092e460640 1 --2- 172.21.15.47:0/3366509694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0928102770 0x7f0928102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.592+0000 7f092e460640 1 -- 172.21.15.47:0/3366509694 >> 172.21.15.47:0/3366509694 conn(0x7f09280fe1c0 msgr2=0x7f09281005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:40.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.592+0000 7f092e460640 1 -- 172.21.15.47:0/3366509694 shutdown_connections 2024-07-24T22:15:40.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.592+0000 7f092e460640 1 -- 172.21.15.47:0/3366509694 wait complete. 2024-07-24T22:15:40.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.592+0000 7f092e460640 1 Processor -- start 2024-07-24T22:15:40.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.592+0000 7f092e460640 1 -- start start 2024-07-24T22:15:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092e460640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0928102770 0x7f0928198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092e460640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0928108180 0x7f09281992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092e460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0928108b00 0x7f092819e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092e460640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0928112800 con 0x7f0928108b00 2024-07-24T22:15:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092e460640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0928112680 con 0x7f0928102770 2024-07-24T22:15:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092e460640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0928112980 con 0x7f0928108180 2024-07-24T22:15:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092c9fd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0928108b00 0x7f092819e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092c9fd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0928108b00 0x7f092819e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44562/0 (socket says 172.21.15.47:44562) 2024-07-24T22:15:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092c9fd640 1 -- 172.21.15.47:0/863629008 learned_addr learned my addr 172.21.15.47:0/863629008 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f09277fe640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0928108180 0x7f09281992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f0927fff640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0928102770 0x7f0928198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092c9fd640 1 -- 172.21.15.47:0/863629008 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0928108180 msgr2=0x7f09281992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092c9fd640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0928108180 0x7f09281992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092c9fd640 1 -- 172.21.15.47:0/863629008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0928102770 msgr2=0x7f0928198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092c9fd640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0928102770 0x7f0928198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092c9fd640 1 -- 172.21.15.47:0/863629008 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092819ee60 con 0x7f0928108b00 2024-07-24T22:15:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f0927fff640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0928102770 0x7f0928198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:15:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.593+0000 7f092c9fd640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0928108b00 0x7f092819e690 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0920005cc0 tx=0x7f092002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.594+0000 7f09257fa640 1 -- 172.21.15.47:0/863629008 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920003cf0 con 0x7f0928108b00 2024-07-24T22:15:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.594+0000 7f09257fa640 1 -- 172.21.15.47:0/863629008 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09200044f0 con 0x7f0928108b00 2024-07-24T22:15:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.594+0000 7f092e460640 1 -- 172.21.15.47:0/863629008 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f092819f0f0 con 0x7f0928108b00 2024-07-24T22:15:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.594+0000 7f09257fa640 1 -- 172.21.15.47:0/863629008 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092002fd10 con 0x7f0928108b00 2024-07-24T22:15:40.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.594+0000 7f092e460640 1 -- 172.21.15.47:0/863629008 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09281a5890 con 0x7f0928108b00 2024-07-24T22:15:40.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.597+0000 7f0930811740 1 Processor -- start 2024-07-24T22:15:40.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.597+0000 7f09257fa640 1 -- 172.21.15.47:0/863629008 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f0920004040 con 0x7f0928108b00 2024-07-24T22:15:40.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.597+0000 7f0930811740 1 -- start start 2024-07-24T22:15:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.597+0000 7f0930811740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b788f30 0x55872b789310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.597+0000 7f0930811740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b789850 0x55872b7996b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.597+0000 7f0930811740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b79bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.597+0000 7f0930811740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55872b7009f0 con 0x55872b799bf0 2024-07-24T22:15:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.597+0000 7f0930811740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55872b6efef0 con 0x55872b789850 2024-07-24T22:15:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.597+0000 7f0930811740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55872b6f3f30 con 0x55872b788f30 2024-07-24T22:15:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.597+0000 7f09277fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b79bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.597+0000 7f09277fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b79bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44576/0 (socket says 172.21.15.47:44576) 2024-07-24T22:15:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.597+0000 7f09277fe640 1 -- 172.21.15.47:0/954157210 learned_addr learned my addr 172.21.15.47:0/954157210 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f0927fff640 1 --2- 172.21.15.47:0/954157210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b789850 0x55872b7996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f09277fe640 1 --2- 172.21.15.47:0/954157210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b788f30 0x55872b789310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f09277fe640 1 -- 172.21.15.47:0/954157210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b788f30 msgr2=0x55872b789310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f09257fa640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09100b3d40 0x7f09100b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f09277fe640 1 --2- 172.21.15.47:0/954157210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b788f30 0x55872b789310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f09277fe640 1 -- 172.21.15.47:0/954157210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b789850 msgr2=0x55872b7996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f09277fe640 1 --2- 172.21.15.47:0/954157210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b789850 0x55872b7996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f09277fe640 1 -- 172.21.15.47:0/954157210 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55872b450930 con 0x55872b799bf0 2024-07-24T22:15:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f092c9fd640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09100b3d40 0x7f09100b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f09277fe640 1 --2- 172.21.15.47:0/954157210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b79bfe0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f091c00adb0 tx=0x7f091c00a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59cfa2633657ea5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f09257fa640 1 -- 172.21.15.47:0/863629008 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f0920105840 con 0x7f0928108b00 2024-07-24T22:15:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f090e7fc640 1 -- 172.21.15.47:0/954157210 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c01b070 con 0x55872b799bf0 2024-07-24T22:15:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f090e7fc640 1 -- 172.21.15.47:0/954157210 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f091c00fdf0 con 0x55872b799bf0 2024-07-24T22:15:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.598+0000 7f090e7fc640 1 -- 172.21.15.47:0/954157210 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c014650 con 0x55872b799bf0 2024-07-24T22:15:40.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.599+0000 7f092c9fd640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09100b3d40 0x7f09100b6200 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f09200cc4c0 tx=0x7f09200b3db0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:40.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.599+0000 7f0930811740 1 -- 172.21.15.47:0/954157210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 msgr2=0x55872b79bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:40.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.599+0000 7f0930811740 1 --2- 172.21.15.47:0/954157210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b79bfe0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f091c00adb0 tx=0x7f091c00a490 comp rx=0 tx=0).stop 2024-07-24T22:15:40.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.599+0000 7f0930811740 1 -- 172.21.15.47:0/954157210 shutdown_connections 2024-07-24T22:15:40.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.599+0000 7f0930811740 1 --2- 172.21.15.47:0/954157210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b79bfe0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.599+0000 7f0930811740 1 --2- 172.21.15.47:0/954157210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b789850 0x55872b7996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.599+0000 7f0930811740 1 --2- 172.21.15.47:0/954157210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b788f30 0x55872b789310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.599+0000 7f0930811740 1 -- 172.21.15.47:0/954157210 >> 172.21.15.47:0/954157210 conn(0x55872b786d60 msgr2=0x55872b787f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:40.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.599+0000 7f0930811740 1 -- 172.21.15.47:0/954157210 shutdown_connections 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.599+0000 7f0930811740 1 -- 172.21.15.47:0/954157210 wait complete. 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.599+0000 7f0930811740 1 -- start start 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.600+0000 7f0930811740 1 Processor -- start 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.600+0000 7f0930811740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 0x55872b796bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.600+0000 7f0930811740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 0x55872b7970f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.600+0000 7f0930811740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b797630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.600+0000 7f0930811740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55872b553890 con 0x55872b799bf0 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.600+0000 7f0930811740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55872b692390 con 0x55872b788f30 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.600+0000 7f0930811740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55872b79c8f0 con 0x55872b789850 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.600+0000 7f0930811740 10 client.0 _ll_register_callbacks cb 0x55872b69c500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.600+0000 7f09277fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b797630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.600+0000 7f09277fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b797630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44582/0 (socket says 172.21.15.47:44582) 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.600+0000 7f09277fe640 1 -- 172.21.15.47:0/1187842027 learned_addr learned my addr 172.21.15.47:0/1187842027 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.600+0000 7f09277fe640 1 --2- 172.21.15.47:0/1187842027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 0x55872b796bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.600+0000 7f0927fff640 1 --2- 172.21.15.47:0/1187842027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 0x55872b7970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f09277fe640 1 -- 172.21.15.47:0/1187842027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 msgr2=0x55872b7970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f09277fe640 1 --2- 172.21.15.47:0/1187842027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 0x55872b7970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f09277fe640 1 -- 172.21.15.47:0/1187842027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 msgr2=0x55872b796bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f09277fe640 1 --2- 172.21.15.47:0/1187842027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 0x55872b796bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f09277fe640 1 -- 172.21.15.47:0/1187842027 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55872b68cd60 con 0x55872b799bf0 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f09277fe640 1 --2- 172.21.15.47:0/1187842027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b797630 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f091c016fd0 tx=0x7f091c006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7509fe4bf2062644 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f09077fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f09077fe640 1 -- 172.21.15.47:0/1187842027 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c01b030 con 0x55872b799bf0 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f09077fe640 1 -- 172.21.15.47:0/1187842027 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f091c016cc0 con 0x55872b799bf0 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f0930811740 1 -- 172.21.15.47:0/1187842027 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f091c00fdf0 con 0x55872b799bf0 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f09077fe640 1 -- 172.21.15.47:0/1187842027 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f091c025400 con 0x55872b799bf0 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f0930811740 10 client.17334 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f0930811740 1 -- 172.21.15.47:0/1187842027 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55872b7a8870 con 0x55872b799bf0 2024-07-24T22:15:40.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.601+0000 7f09077fe640 1 -- 172.21.15.47:0/1187842027 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f091c00fdf0 con 0x55872b799bf0 2024-07-24T22:15:40.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.602+0000 7f09077fe640 1 -- 172.21.15.47:0/1187842027 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f091c015040 con 0x55872b799bf0 2024-07-24T22:15:40.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.602+0000 7f0930811740 10 client.17334 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:40.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.602+0000 7f0930811740 10 client.17334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:40.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.602+0000 7f0930811740 20 client.17334 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:40.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.602+0000 7f0930811740 1 --2- 172.21.15.47:0/1187842027 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55872b7a9bc0 0x55872b7abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.602+0000 7f0930811740 4 client.17334 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:15:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.602+0000 7f0930811740 1 -- 172.21.15.47:0/1187842027 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55872b702940 con 0x55872b7a9bc0 2024-07-24T22:15:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.602+0000 7f0927fff640 1 --2- 172.21.15.47:0/1187842027 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55872b7a9bc0 0x55872b7abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.602+0000 7f0927fff640 1 --2- 172.21.15.47:0/1187842027 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55872b7a9bc0 0x55872b7abfb0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68c6d663893096fb server_cookie=f09b88daa4012799 in_seq=0 out_seq=0 2024-07-24T22:15:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.602+0000 7f09077fe640 10 client.17334 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.603+0000 7f09077fe640 1 -- 172.21.15.47:0/1187842027 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55872b702940 con 0x55872b7a9bc0 2024-07-24T22:15:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.603+0000 7f09077fe640 10 client.17334 handle_command_reply: tid=0 2024-07-24T22:15:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.603+0000 7f0930811740 1 client.17334 shutdown 2024-07-24T22:15:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.603+0000 7f0930811740 1 -- 172.21.15.47:0/1187842027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 msgr2=0x55872b797630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.603+0000 7f0930811740 1 --2- 172.21.15.47:0/1187842027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b797630 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f091c016fd0 tx=0x7f091c006a30 comp rx=0 tx=0).stop 2024-07-24T22:15:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.603+0000 7f0930811740 1 -- 172.21.15.47:0/1187842027 shutdown_connections 2024-07-24T22:15:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.603+0000 7f0930811740 1 --2- 172.21.15.47:0/1187842027 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55872b7a9bc0 0x55872b7abfb0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.604+0000 7f0930811740 1 --2- 172.21.15.47:0/1187842027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b797630 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.604+0000 7f0930811740 1 --2- 172.21.15.47:0/1187842027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 0x55872b7970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.604+0000 7f09077fe640 0 client.17334 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:40.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.604+0000 7f0930811740 1 --2- 172.21.15.47:0/1187842027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 0x55872b796bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.604+0000 7f0930811740 1 -- 172.21.15.47:0/1187842027 >> 172.21.15.47:0/1187842027 conn(0x55872b786d60 msgr2=0x55872b78c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:40.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.604+0000 7f0930811740 1 -- 172.21.15.47:0/1187842027 shutdown_connections 2024-07-24T22:15:40.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.604+0000 7f0930811740 1 -- 172.21.15.47:0/1187842027 wait complete. 2024-07-24T22:15:40.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.604+0000 7f0930811740 20 client.17334 trim_cache size 0 max 16384 2024-07-24T22:15:40.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.622+0000 7f0930811740 1 Processor -- start 2024-07-24T22:15:40.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.622+0000 7f0930811740 1 -- start start 2024-07-24T22:15:40.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.622+0000 7f0930811740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 0x55872b794680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.622+0000 7f0930811740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 0x55872b798850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.622+0000 7f0930811740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b7b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.622+0000 7f0930811740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f09281aa0c0 con 0x55872b799bf0 2024-07-24T22:15:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.622+0000 7f0930811740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f09281ac920 con 0x55872b788f30 2024-07-24T22:15:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.622+0000 7f0930811740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f09281aa710 con 0x55872b789850 2024-07-24T22:15:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f09277fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b7b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f09277fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b7b15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44586/0 (socket says 172.21.15.47:44586) 2024-07-24T22:15:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f09277fe640 1 -- 172.21.15.47:0/36347706 learned_addr learned my addr 172.21.15.47:0/36347706 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f09277fe640 1 --2- 172.21.15.47:0/36347706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 0x55872b794680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f0927fff640 1 --2- 172.21.15.47:0/36347706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 0x55872b798850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f09277fe640 1 -- 172.21.15.47:0/36347706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 msgr2=0x55872b798850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f09277fe640 1 --2- 172.21.15.47:0/36347706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 0x55872b798850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f09277fe640 1 -- 172.21.15.47:0/36347706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 msgr2=0x55872b794680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f09277fe640 1 --2- 172.21.15.47:0/36347706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 0x55872b794680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f09277fe640 1 -- 172.21.15.47:0/36347706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55872b7812a0 con 0x55872b799bf0 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f09277fe640 1 --2- 172.21.15.47:0/36347706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b7b15b0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f091c019040 tx=0x7f091c00f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1e78ba64992183 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f090dffb640 1 -- 172.21.15.47:0/36347706 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c01b040 con 0x55872b799bf0 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f090dffb640 1 -- 172.21.15.47:0/36347706 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f091c01c040 con 0x55872b799bf0 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.623+0000 7f090dffb640 1 -- 172.21.15.47:0/36347706 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c0255a0 con 0x55872b799bf0 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.624+0000 7f0930811740 1 -- 172.21.15.47:0/36347706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 msgr2=0x55872b7b15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.624+0000 7f0930811740 1 --2- 172.21.15.47:0/36347706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b7b15b0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f091c019040 tx=0x7f091c00f040 comp rx=0 tx=0).stop 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.624+0000 7f0930811740 1 -- 172.21.15.47:0/36347706 shutdown_connections 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.624+0000 7f0930811740 1 --2- 172.21.15.47:0/36347706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b7b15b0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.624+0000 7f0930811740 1 --2- 172.21.15.47:0/36347706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 0x55872b798850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.624+0000 7f0930811740 1 --2- 172.21.15.47:0/36347706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 0x55872b794680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.624+0000 7f0930811740 1 -- 172.21.15.47:0/36347706 >> 172.21.15.47:0/36347706 conn(0x55872b786d60 msgr2=0x55872b785e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.624+0000 7f0930811740 1 -- 172.21.15.47:0/36347706 shutdown_connections 2024-07-24T22:15:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.624+0000 7f0930811740 1 -- 172.21.15.47:0/36347706 wait complete. 2024-07-24T22:15:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.624+0000 7f0930811740 1 -- start start 2024-07-24T22:15:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f0930811740 1 Processor -- start 2024-07-24T22:15:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f0930811740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 0x55872b7a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f0930811740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 0x55872b7a22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f0930811740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b79eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f0930811740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f09281aade0 con 0x55872b799bf0 2024-07-24T22:15:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f0930811740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f09281ac250 con 0x55872b788f30 2024-07-24T22:15:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f0930811740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f09281ab4b0 con 0x55872b789850 2024-07-24T22:15:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f0930811740 10 client.0 _ll_register_callbacks cb 0x7f091c016750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f09277fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b79eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f09277fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b79eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44598/0 (socket says 172.21.15.47:44598) 2024-07-24T22:15:40.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f09277fe640 1 -- 172.21.15.47:0/601963625 learned_addr learned my addr 172.21.15.47:0/601963625 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f09277fe640 1 --2- 172.21.15.47:0/601963625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 0x55872b7a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f0927fff640 1 --2- 172.21.15.47:0/601963625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 0x55872b7a22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f09277fe640 1 -- 172.21.15.47:0/601963625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 msgr2=0x55872b7a22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f09277fe640 1 --2- 172.21.15.47:0/601963625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 0x55872b7a22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f09277fe640 1 -- 172.21.15.47:0/601963625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 msgr2=0x55872b7a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f09277fe640 1 --2- 172.21.15.47:0/601963625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 0x55872b7a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.625+0000 7f09277fe640 1 -- 172.21.15.47:0/601963625 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55872b79f390 con 0x55872b799bf0 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f09277fe640 1 --2- 172.21.15.47:0/601963625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b79eb80 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f091c0146c0 tx=0x7f091c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38085271f498e7ba server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f09077fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f09077fe640 1 -- 172.21.15.47:0/601963625 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c049060 con 0x55872b799bf0 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f09077fe640 1 -- 172.21.15.47:0/601963625 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f091c00faf0 con 0x55872b799bf0 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f0930811740 1 -- 172.21.15.47:0/601963625 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f091c01c040 con 0x55872b799bf0 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f09077fe640 1 -- 172.21.15.47:0/601963625 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f091c01b040 con 0x55872b799bf0 2024-07-24T22:15:40.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f0930811740 10 client.17340 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f0930811740 1 -- 172.21.15.47:0/601963625 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55872b8150d0 con 0x55872b799bf0 2024-07-24T22:15:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f09077fe640 1 -- 172.21.15.47:0/601963625 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f091c01c040 con 0x55872b799bf0 2024-07-24T22:15:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f09077fe640 1 -- 172.21.15.47:0/601963625 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f091c025780 con 0x55872b799bf0 2024-07-24T22:15:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f0930811740 10 client.17340 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f0930811740 10 client.17340 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f0930811740 20 client.17340 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.626+0000 7f0930811740 1 --2- 172.21.15.47:0/601963625 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55872b815760 0x55872b817b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.627+0000 7f0930811740 4 client.17340 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:15:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.627+0000 7f0930811740 1 -- 172.21.15.47:0/601963625 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55872b6fe3e0 con 0x55872b815760 2024-07-24T22:15:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.627+0000 7f0927fff640 1 --2- 172.21.15.47:0/601963625 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55872b815760 0x55872b817b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.627+0000 7f0927fff640 1 --2- 172.21.15.47:0/601963625 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55872b815760 0x55872b817b80 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aadbf02def985f3 server_cookie=1bb6fcfea65c3e8 in_seq=0 out_seq=0 2024-07-24T22:15:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.627+0000 7f09077fe640 10 client.17340 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.628+0000 7f09077fe640 1 -- 172.21.15.47:0/601963625 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55872b6fe3e0 con 0x55872b815760 2024-07-24T22:15:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.628+0000 7f09077fe640 10 client.17340 handle_command_reply: tid=0 2024-07-24T22:15:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.628+0000 7f0930811740 1 client.17340 shutdown 2024-07-24T22:15:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.628+0000 7f0930811740 1 -- 172.21.15.47:0/601963625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 msgr2=0x55872b79eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.628+0000 7f0930811740 1 --2- 172.21.15.47:0/601963625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b79eb80 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f091c0146c0 tx=0x7f091c000bc0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.628+0000 7f0930811740 1 -- 172.21.15.47:0/601963625 shutdown_connections 2024-07-24T22:15:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.628+0000 7f0930811740 1 --2- 172.21.15.47:0/601963625 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55872b815760 0x55872b817b80 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.628+0000 7f09077fe640 0 client.17340 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.628+0000 7f0930811740 1 --2- 172.21.15.47:0/601963625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55872b799bf0 0x55872b79eb80 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.628+0000 7f0930811740 1 --2- 172.21.15.47:0/601963625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872b789850 0x55872b7a22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f0930811740 1 --2- 172.21.15.47:0/601963625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55872b788f30 0x55872b7a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f0930811740 1 -- 172.21.15.47:0/601963625 >> 172.21.15.47:0/601963625 conn(0x55872b786d60 msgr2=0x55872b78e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f0930811740 1 -- 172.21.15.47:0/601963625 shutdown_connections 2024-07-24T22:15:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f0930811740 1 -- 172.21.15.47:0/601963625 wait complete. 2024-07-24T22:15:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f0930811740 20 client.17340 trim_cache size 0 max 16384 2024-07-24T22:15:40.636 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:15:40.636 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:15:40.636 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "5142c86c-4fba-4411-ae41-525af9e9044d", 2024-07-24T22:15:40.636 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:15:40.636 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:15:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f092e460640 1 -- 172.21.15.47:0/863629008 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09100b3d40 msgr2=0x7f09100b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f092e460640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09100b3d40 0x7f09100b6200 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f09200cc4c0 tx=0x7f09200b3db0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f092e460640 1 -- 172.21.15.47:0/863629008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0928108b00 msgr2=0x7f092819e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f092e460640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0928108b00 0x7f092819e690 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0920005cc0 tx=0x7f092002f470 comp rx=0 tx=0).stop 2024-07-24T22:15:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f092e460640 1 -- 172.21.15.47:0/863629008 shutdown_connections 2024-07-24T22:15:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f092e460640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f09100b3d40 0x7f09100b6200 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f092e460640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0928108b00 0x7f092819e690 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f092e460640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0928108180 0x7f09281992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f092e460640 1 --2- 172.21.15.47:0/863629008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0928102770 0x7f0928198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.629+0000 7f092e460640 1 -- 172.21.15.47:0/863629008 >> 172.21.15.47:0/863629008 conn(0x7f09280fe1c0 msgr2=0x7f09281005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:40.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.630+0000 7f092e460640 1 -- 172.21.15.47:0/863629008 shutdown_connections 2024-07-24T22:15:40.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:40.630+0000 7f092e460640 1 -- 172.21.15.47:0/863629008 wait complete. 2024-07-24T22:15:41.591 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:15:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:41 smithi183 ceph-mon[37007]: pgmap v626: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:15:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:41 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:15:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:41 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:15:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:41 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:15:41.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:41 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:15:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:41 smithi047 ceph-mon[32551]: pgmap v626: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:15:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:41 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:15:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:41 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:15:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:41 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:15:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:41 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:15:41.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:41 smithi188 ceph-mon[37380]: pgmap v626: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:15:41.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:41 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:15:41.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:41 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:15:41.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:41 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:15:41.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:41 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:15:41.864 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:15:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.561+0000 7f00aa886640 1 -- 172.21.15.47:0/2026141970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a4103f30 msgr2=0x7f00a410c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.561+0000 7f00aa886640 1 --2- 172.21.15.47:0/2026141970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a4103f30 0x7f00a410c510 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f008c009900 tx=0x7f008c02a410 comp rx=0 tx=0).stop 2024-07-24T22:15:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.561+0000 7f00aa886640 1 -- 172.21.15.47:0/2026141970 shutdown_connections 2024-07-24T22:15:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.561+0000 7f00aa886640 1 --2- 172.21.15.47:0/2026141970 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00a410cae0 0x7f00a410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.561+0000 7f00aa886640 1 --2- 172.21.15.47:0/2026141970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a4103f30 0x7f00a410c510 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.561+0000 7f00aa886640 1 --2- 172.21.15.47:0/2026141970 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00a4103530 0x7f00a4103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.561+0000 7f00aa886640 1 -- 172.21.15.47:0/2026141970 >> 172.21.15.47:0/2026141970 conn(0x7f00a40fd100 msgr2=0x7f00a40ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.561+0000 7f00aa886640 1 -- 172.21.15.47:0/2026141970 shutdown_connections 2024-07-24T22:15:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.561+0000 7f00aa886640 1 -- 172.21.15.47:0/2026141970 wait complete. 2024-07-24T22:15:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.561+0000 7f00aa886640 1 Processor -- start 2024-07-24T22:15:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.561+0000 7f00aa886640 1 -- start start 2024-07-24T22:15:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00aa886640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a4103530 0x7f00a4198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00aa886640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00a4103f30 0x7f00a41991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00aa886640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00a410cae0 0x7f00a419e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00aa886640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00a41127a0 con 0x7f00a4103530 2024-07-24T22:15:43.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00aa886640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f00a4112620 con 0x7f00a4103f30 2024-07-24T22:15:43.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00aa886640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f00a4112920 con 0x7f00a410cae0 2024-07-24T22:15:43.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00a3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a4103530 0x7f00a4198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00a3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a4103530 0x7f00a4198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44618/0 (socket says 172.21.15.47:44618) 2024-07-24T22:15:43.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00a3fff640 1 -- 172.21.15.47:0/1119048180 learned_addr learned my addr 172.21.15.47:0/1119048180 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:43.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00a8e23640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00a410cae0 0x7f00a419e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f009bfff640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00a4103f30 0x7f00a41991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00a3fff640 1 -- 172.21.15.47:0/1119048180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00a410cae0 msgr2=0x7f00a419e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:43.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00a3fff640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00a410cae0 0x7f00a419e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00a3fff640 1 -- 172.21.15.47:0/1119048180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00a4103f30 msgr2=0x7f00a41991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:43.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00a3fff640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00a4103f30 0x7f00a41991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00a3fff640 1 -- 172.21.15.47:0/1119048180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a419ed60 con 0x7f00a4103530 2024-07-24T22:15:43.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00a3fff640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a4103530 0x7f00a4198cb0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f009400c920 tx=0x7f009400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.562+0000 7f00a1ffb640 1 -- 172.21.15.47:0/1119048180 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094007c70 con 0x7f00a4103530 2024-07-24T22:15:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.563+0000 7f00a1ffb640 1 -- 172.21.15.47:0/1119048180 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0094007e10 con 0x7f00a4103530 2024-07-24T22:15:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.563+0000 7f00aa886640 1 -- 172.21.15.47:0/1119048180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a419f050 con 0x7f00a4103530 2024-07-24T22:15:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.563+0000 7f00a1ffb640 1 -- 172.21.15.47:0/1119048180 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094018820 con 0x7f00a4103530 2024-07-24T22:15:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.563+0000 7f00aa886640 1 -- 172.21.15.47:0/1119048180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a41a5710 con 0x7f00a4103530 2024-07-24T22:15:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.565+0000 7f00a1ffb640 1 -- 172.21.15.47:0/1119048180 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f009400f450 con 0x7f00a4103530 2024-07-24T22:15:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.565+0000 7f00acc37740 1 Processor -- start 2024-07-24T22:15:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.565+0000 7f00acc37740 1 -- start start 2024-07-24T22:15:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.565+0000 7f00acc37740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad26b0 0x55a98aad2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.565+0000 7f00acc37740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 0x55a98aadea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.565+0000 7f00acc37740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aadef60 0x55a98aae1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00acc37740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a98aa49990 con 0x55a98aad2fd0 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00acc37740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a98aa38e90 con 0x55a98aad26b0 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00acc37740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a98aa3ced0 con 0x55a98aadef60 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 0x55a98aadea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 0x55a98aadea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44630/0 (socket says 172.21.15.47:44630) 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a3fff640 1 -- 172.21.15.47:0/4243178618 learned_addr learned my addr 172.21.15.47:0/4243178618 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f009bfff640 1 --2- 172.21.15.47:0/4243178618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aadef60 0x55a98aae1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a8e23640 1 --2- 172.21.15.47:0/4243178618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad26b0 0x55a98aad2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a3fff640 1 -- 172.21.15.47:0/4243178618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aadef60 msgr2=0x55a98aae1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a3fff640 1 --2- 172.21.15.47:0/4243178618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aadef60 0x55a98aae1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a3fff640 1 -- 172.21.15.47:0/4243178618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad26b0 msgr2=0x55a98aad2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a3fff640 1 --2- 172.21.15.47:0/4243178618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad26b0 0x55a98aad2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a3fff640 1 -- 172.21.15.47:0/4243178618 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a98a9c2300 con 0x55a98aad2fd0 2024-07-24T22:15:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a1ffb640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00900b3d40 0x7f00900b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a8e23640 1 --2- 172.21.15.47:0/4243178618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad26b0 0x55a98aad2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:15:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a8e23640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00900b3d40 0x7f00900b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a1ffb640 1 -- 172.21.15.47:0/1119048180 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f00940e40f0 con 0x7f00a4103530 2024-07-24T22:15:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.566+0000 7f00a3fff640 1 --2- 172.21.15.47:0/4243178618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 0x55a98aadea20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f00940e1820 tx=0x7f00940ec540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65aeaf59c86434b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.567+0000 7f009a7fc640 1 -- 172.21.15.47:0/4243178618 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00940a6c30 con 0x55a98aad2fd0 2024-07-24T22:15:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.567+0000 7f009a7fc640 1 -- 172.21.15.47:0/4243178618 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00940aa880 con 0x55a98aad2fd0 2024-07-24T22:15:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.567+0000 7f009a7fc640 1 -- 172.21.15.47:0/4243178618 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00940aa4e0 con 0x55a98aad2fd0 2024-07-24T22:15:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.567+0000 7f00acc37740 1 -- 172.21.15.47:0/4243178618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 msgr2=0x55a98aadea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.567+0000 7f00a8e23640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00900b3d40 0x7f00900b6200 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f009c009fd0 tx=0x7f009c00d040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.567+0000 7f00acc37740 1 --2- 172.21.15.47:0/4243178618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 0x55a98aadea20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f00940e1820 tx=0x7f00940ec540 comp rx=0 tx=0).stop 2024-07-24T22:15:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.567+0000 7f00acc37740 1 -- 172.21.15.47:0/4243178618 shutdown_connections 2024-07-24T22:15:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.567+0000 7f00acc37740 1 --2- 172.21.15.47:0/4243178618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aadef60 0x55a98aae1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.567+0000 7f00acc37740 1 --2- 172.21.15.47:0/4243178618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 0x55a98aadea20 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.567+0000 7f00acc37740 1 --2- 172.21.15.47:0/4243178618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad26b0 0x55a98aad2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.567+0000 7f00acc37740 1 -- 172.21.15.47:0/4243178618 >> 172.21.15.47:0/4243178618 conn(0x55a98aad04e0 msgr2=0x55a98aad1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.567+0000 7f00acc37740 1 -- 172.21.15.47:0/4243178618 shutdown_connections 2024-07-24T22:15:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.567+0000 7f00acc37740 1 -- 172.21.15.47:0/4243178618 wait complete. 2024-07-24T22:15:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.568+0000 7f00acc37740 1 -- start start 2024-07-24T22:15:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.568+0000 7f00acc37740 1 Processor -- start 2024-07-24T22:15:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.568+0000 7f00acc37740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad26b0 0x55a98aadbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.568+0000 7f00acc37740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad2fd0 0x55a98aadc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.568+0000 7f00acc37740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aadef60 0x55a98aadc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.568+0000 7f00acc37740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a98a89c700 con 0x55a98aad26b0 2024-07-24T22:15:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.568+0000 7f00acc37740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a98a9db5d0 con 0x55a98aad2fd0 2024-07-24T22:15:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.568+0000 7f00acc37740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a98aae1be0 con 0x55a98aadef60 2024-07-24T22:15:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00acc37740 10 client.0 _ll_register_callbacks cb 0x55a98a9fb940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00a3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad26b0 0x55a98aadbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00a3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad26b0 0x55a98aadbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44632/0 (socket says 172.21.15.47:44632) 2024-07-24T22:15:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00a3fff640 1 -- 172.21.15.47:0/1064568991 learned_addr learned my addr 172.21.15.47:0/1064568991 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00a8e23640 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aadef60 0x55a98aadc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f009bfff640 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad2fd0 0x55a98aadc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00a3fff640 1 -- 172.21.15.47:0/1064568991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aadef60 msgr2=0x55a98aadc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00a3fff640 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aadef60 0x55a98aadc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00a3fff640 1 -- 172.21.15.47:0/1064568991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad2fd0 msgr2=0x55a98aadc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00a3fff640 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad2fd0 0x55a98aadc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00a3fff640 1 -- 172.21.15.47:0/1064568991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a98a9ce660 con 0x55a98aad26b0 2024-07-24T22:15:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00a8e23640 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aadef60 0x55a98aadc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f009bfff640 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad2fd0 0x55a98aadc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00a3fff640 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad26b0 0x55a98aadbec0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f00940aaa70 tx=0x7f009400fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5365d5e9b7e7efc9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00837fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00837fe640 1 -- 172.21.15.47:0/1064568991 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00940aa6c0 con 0x55a98aad26b0 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00837fe640 1 -- 172.21.15.47:0/1064568991 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f00940ece20 con 0x55a98aad26b0 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.569+0000 7f00acc37740 1 -- 172.21.15.47:0/1064568991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00940aa880 con 0x55a98aad26b0 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.570+0000 7f00837fe640 1 -- 172.21.15.47:0/1064568991 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f00940aab40 con 0x55a98aad26b0 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.570+0000 7f00acc37740 10 client.17352 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.570+0000 7f00acc37740 1 -- 172.21.15.47:0/1064568991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a98a799650 con 0x55a98aad26b0 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.570+0000 7f00837fe640 1 -- 172.21.15.47:0/1064568991 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00940aa880 con 0x55a98aad26b0 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.570+0000 7f00837fe640 1 -- 172.21.15.47:0/1064568991 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f00940aafd0 con 0x55a98aad26b0 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.570+0000 7f00acc37740 10 client.17352 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.570+0000 7f00acc37740 10 client.17352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.570+0000 7f00acc37740 20 client.17352 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:43.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.570+0000 7f00acc37740 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a98aaee920 0x55a98aaf0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.570+0000 7f00acc37740 4 client.17352 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:15:43.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.570+0000 7f00acc37740 1 -- 172.21.15.47:0/1064568991 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a98aa4b8e0 con 0x55a98aaee920 2024-07-24T22:15:43.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.570+0000 7f009bfff640 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a98aaee920 0x55a98aaf0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.571+0000 7f009bfff640 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a98aaee920 0x55a98aaf0d10 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e779ad542cec597 server_cookie=56009779a9b09615 in_seq=0 out_seq=0 2024-07-24T22:15:43.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.571+0000 7f00837fe640 10 client.17352 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:43.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.571+0000 7f00837fe640 1 -- 172.21.15.47:0/1064568991 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a98aa4b8e0 con 0x55a98aaee920 2024-07-24T22:15:43.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.571+0000 7f00837fe640 10 client.17352 handle_command_reply: tid=0 2024-07-24T22:15:43.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.572+0000 7f00acc37740 1 client.17352 shutdown 2024-07-24T22:15:43.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.572+0000 7f00acc37740 1 -- 172.21.15.47:0/1064568991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad26b0 msgr2=0x55a98aadbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:43.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.572+0000 7f00acc37740 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad26b0 0x55a98aadbec0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f00940aaa70 tx=0x7f009400fcc0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.572+0000 7f00acc37740 1 -- 172.21.15.47:0/1064568991 shutdown_connections 2024-07-24T22:15:43.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.572+0000 7f00acc37740 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a98aaee920 0x55a98aaf0d10 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.572+0000 7f00acc37740 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aadef60 0x55a98aadc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.572+0000 7f00acc37740 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad2fd0 0x55a98aadc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.572+0000 7f00acc37740 1 --2- 172.21.15.47:0/1064568991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad26b0 0x55a98aadbec0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.572+0000 7f00acc37740 1 -- 172.21.15.47:0/1064568991 >> 172.21.15.47:0/1064568991 conn(0x55a98aad04e0 msgr2=0x55a98aad6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:43.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.572+0000 7f00837fe640 0 client.17352 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:43.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.572+0000 7f00acc37740 1 -- 172.21.15.47:0/1064568991 shutdown_connections 2024-07-24T22:15:43.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.572+0000 7f00acc37740 1 -- 172.21.15.47:0/1064568991 wait complete. 2024-07-24T22:15:43.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.572+0000 7f00acc37740 20 client.17352 trim_cache size 0 max 16384 2024-07-24T22:15:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.590+0000 7f00acc37740 1 Processor -- start 2024-07-24T22:15:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.590+0000 7f00acc37740 1 -- start start 2024-07-24T22:15:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00acc37740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad26b0 0x55a98aaf3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00acc37740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aad2fd0 0x55a98aaf3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00acc37740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aadef60 0x55a98aad90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00acc37740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00a41ac1f0 con 0x55a98aadef60 2024-07-24T22:15:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00acc37740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f00a41aea50 con 0x55a98aad26b0 2024-07-24T22:15:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00acc37740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f00a41ac840 con 0x55a98aad2fd0 2024-07-24T22:15:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00a8e23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aadef60 0x55a98aad90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00a8e23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aadef60 0x55a98aad90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44644/0 (socket says 172.21.15.47:44644) 2024-07-24T22:15:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00a8e23640 1 -- 172.21.15.47:0/812225303 learned_addr learned my addr 172.21.15.47:0/812225303 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:43.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f009bfff640 1 --2- 172.21.15.47:0/812225303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aad2fd0 0x55a98aaf3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00a3fff640 1 --2- 172.21.15.47:0/812225303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad26b0 0x55a98aaf3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00a8e23640 1 -- 172.21.15.47:0/812225303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aad2fd0 msgr2=0x55a98aaf3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00a8e23640 1 --2- 172.21.15.47:0/812225303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aad2fd0 0x55a98aaf3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00a8e23640 1 -- 172.21.15.47:0/812225303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad26b0 msgr2=0x55a98aaf3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00a8e23640 1 --2- 172.21.15.47:0/812225303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad26b0 0x55a98aaf3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00a8e23640 1 -- 172.21.15.47:0/812225303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a98aad6c00 con 0x55a98aadef60 2024-07-24T22:15:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00a3fff640 1 --2- 172.21.15.47:0/812225303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad26b0 0x55a98aaf3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:15:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f00a8e23640 1 --2- 172.21.15.47:0/812225303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aadef60 0x55a98aad90d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f009c009b80 tx=0x7f009c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76175a2695e38401 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f0099ffb640 1 -- 172.21.15.47:0/812225303 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c007bb0 con 0x55a98aadef60 2024-07-24T22:15:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.591+0000 7f0099ffb640 1 -- 172.21.15.47:0/812225303 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f009c029070 con 0x55a98aadef60 2024-07-24T22:15:43.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.592+0000 7f0099ffb640 1 -- 172.21.15.47:0/812225303 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c016630 con 0x55a98aadef60 2024-07-24T22:15:43.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.592+0000 7f00acc37740 1 -- 172.21.15.47:0/812225303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aadef60 msgr2=0x55a98aad90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:43.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.592+0000 7f00acc37740 1 --2- 172.21.15.47:0/812225303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aadef60 0x55a98aad90d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f009c009b80 tx=0x7f009c017000 comp rx=0 tx=0).stop 2024-07-24T22:15:43.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.592+0000 7f00acc37740 1 -- 172.21.15.47:0/812225303 shutdown_connections 2024-07-24T22:15:43.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.592+0000 7f00acc37740 1 --2- 172.21.15.47:0/812225303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aadef60 0x55a98aad90d0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.592+0000 7f00acc37740 1 --2- 172.21.15.47:0/812225303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aad2fd0 0x55a98aaf3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.592+0000 7f00acc37740 1 --2- 172.21.15.47:0/812225303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aad26b0 0x55a98aaf3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.592+0000 7f00acc37740 1 -- 172.21.15.47:0/812225303 >> 172.21.15.47:0/812225303 conn(0x55a98aad04e0 msgr2=0x55a98aada740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.592+0000 7f00acc37740 1 -- 172.21.15.47:0/812225303 shutdown_connections 2024-07-24T22:15:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.592+0000 7f00acc37740 1 -- 172.21.15.47:0/812225303 wait complete. 2024-07-24T22:15:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.593+0000 7f00acc37740 1 -- start start 2024-07-24T22:15:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.593+0000 7f00acc37740 1 Processor -- start 2024-07-24T22:15:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.593+0000 7f00acc37740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aad26b0 0x55a98aaf1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.593+0000 7f00acc37740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 0x55a98aaf1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.593+0000 7f00acc37740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aadef60 0x55a98aaf2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.593+0000 7f00acc37740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00a41acf10 con 0x55a98aad2fd0 2024-07-24T22:15:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.593+0000 7f00acc37740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f00a41ae380 con 0x55a98aadef60 2024-07-24T22:15:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.593+0000 7f00acc37740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f00a41ad5e0 con 0x55a98aad26b0 2024-07-24T22:15:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.593+0000 7f00acc37740 10 client.0 _ll_register_callbacks cb 0x7f008c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:43.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.593+0000 7f009bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 0x55a98aaf1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.593+0000 7f009bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 0x55a98aaf1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44654/0 (socket says 172.21.15.47:44654) 2024-07-24T22:15:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.593+0000 7f009bfff640 1 -- 172.21.15.47:0/1028722487 learned_addr learned my addr 172.21.15.47:0/1028722487 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.593+0000 7f00a8e23640 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aadef60 0x55a98aaf2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f00a3fff640 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aad26b0 0x55a98aaf1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f009bfff640 1 -- 172.21.15.47:0/1028722487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aad26b0 msgr2=0x55a98aaf1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f009bfff640 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aad26b0 0x55a98aaf1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f009bfff640 1 -- 172.21.15.47:0/1028722487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aadef60 msgr2=0x55a98aaf2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f009bfff640 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aadef60 0x55a98aaf2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f009bfff640 1 -- 172.21.15.47:0/1028722487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a98ab58500 con 0x55a98aad2fd0 2024-07-24T22:15:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f00a8e23640 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aadef60 0x55a98aaf2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:15:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f00a3fff640 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aad26b0 0x55a98aaf1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:15:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f009bfff640 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 0x55a98aaf1f50 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f008c02a930 tx=0x7f008c031d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa65ce3159f3aac9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:43.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f00837fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f00837fe640 1 -- 172.21.15.47:0/1028722487 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c048030 con 0x55a98aad2fd0 2024-07-24T22:15:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f00837fe640 1 -- 172.21.15.47:0/1028722487 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f008c004040 con 0x55a98aad2fd0 2024-07-24T22:15:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f00acc37740 1 -- 172.21.15.47:0/1028722487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f009c029070 con 0x55a98aad2fd0 2024-07-24T22:15:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f00837fe640 1 -- 172.21.15.47:0/1028722487 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f008c054050 con 0x55a98aad2fd0 2024-07-24T22:15:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f00acc37740 10 client.17358 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f00acc37740 1 -- 172.21.15.47:0/1028722487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a98ab59790 con 0x55a98aad2fd0 2024-07-24T22:15:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.594+0000 7f00837fe640 1 -- 172.21.15.47:0/1028722487 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f009c029070 con 0x55a98aad2fd0 2024-07-24T22:15:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.595+0000 7f00837fe640 1 -- 172.21.15.47:0/1028722487 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f008c0442c0 con 0x55a98aad2fd0 2024-07-24T22:15:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.595+0000 7f00acc37740 10 client.17358 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.595+0000 7f00acc37740 10 client.17358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.595+0000 7f00acc37740 20 client.17358 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.595+0000 7f00acc37740 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a98ab59ef0 0x55a98ab5c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.595+0000 7f00acc37740 4 client.17358 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:15:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.595+0000 7f00acc37740 1 -- 172.21.15.47:0/1028722487 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a98aa47380 con 0x55a98ab59ef0 2024-07-24T22:15:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.595+0000 7f00a3fff640 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a98ab59ef0 0x55a98ab5c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.595+0000 7f00a3fff640 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a98ab59ef0 0x55a98ab5c310 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=743cd4063a165cdb server_cookie=16e792b41f02dd2d in_seq=0 out_seq=0 2024-07-24T22:15:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.595+0000 7f00837fe640 10 client.17358 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.595+0000 7f00837fe640 1 -- 172.21.15.47:0/1028722487 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a98aa47380 con 0x55a98ab59ef0 2024-07-24T22:15:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.595+0000 7f00837fe640 10 client.17358 handle_command_reply: tid=0 2024-07-24T22:15:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.595+0000 7f00acc37740 1 client.17358 shutdown 2024-07-24T22:15:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00acc37740 1 -- 172.21.15.47:0/1028722487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 msgr2=0x55a98aaf1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00acc37740 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 0x55a98aaf1f50 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f008c02a930 tx=0x7f008c031d00 comp rx=0 tx=0).stop 2024-07-24T22:15:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00acc37740 1 -- 172.21.15.47:0/1028722487 shutdown_connections 2024-07-24T22:15:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00acc37740 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a98ab59ef0 0x55a98ab5c310 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00acc37740 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a98aadef60 0x55a98aaf2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00acc37740 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a98aad2fd0 0x55a98aaf1f50 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00837fe640 0 client.17358 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00acc37740 1 --2- 172.21.15.47:0/1028722487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a98aad26b0 0x55a98aaf1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00acc37740 1 -- 172.21.15.47:0/1028722487 >> 172.21.15.47:0/1028722487 conn(0x55a98aad04e0 msgr2=0x55a98aae9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00acc37740 1 -- 172.21.15.47:0/1028722487 shutdown_connections 2024-07-24T22:15:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00acc37740 1 -- 172.21.15.47:0/1028722487 wait complete. 2024-07-24T22:15:43.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00acc37740 20 client.17358 trim_cache size 0 max 16384 2024-07-24T22:15:43.604 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:15:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-07-24T22:15:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-07-24T22:15:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: "5142c86c-4fba-4411-ae41-525af9e9044d": { 2024-07-24T22:15:43.604 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-07-24T22:15:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "5142c86c-4fba-4411-ae41-525af9e9044d", 2024-07-24T22:15:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-07-24T22:15:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:15:43.605 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:15:43.605 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:15:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00aa886640 1 -- 172.21.15.47:0/1119048180 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00900b3d40 msgr2=0x7f00900b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00aa886640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00900b3d40 0x7f00900b6200 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f009c009fd0 tx=0x7f009c00d040 comp rx=0 tx=0).stop 2024-07-24T22:15:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00aa886640 1 -- 172.21.15.47:0/1119048180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a4103530 msgr2=0x7f00a4198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.596+0000 7f00aa886640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a4103530 0x7f00a4198cb0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f009400c920 tx=0x7f009400cde0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.597+0000 7f00aa886640 1 -- 172.21.15.47:0/1119048180 shutdown_connections 2024-07-24T22:15:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.597+0000 7f00aa886640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f00900b3d40 0x7f00900b6200 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.597+0000 7f00aa886640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00a410cae0 0x7f00a419e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.597+0000 7f00aa886640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00a4103f30 0x7f00a41991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.597+0000 7f00aa886640 1 --2- 172.21.15.47:0/1119048180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00a4103530 0x7f00a4198cb0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.597+0000 7f00aa886640 1 -- 172.21.15.47:0/1119048180 >> 172.21.15.47:0/1119048180 conn(0x7f00a40fd100 msgr2=0x7f00a410ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.597+0000 7f00aa886640 1 -- 172.21.15.47:0/1119048180 shutdown_connections 2024-07-24T22:15:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:15:43.597+0000 7f00aa886640 1 -- 172.21.15.47:0/1119048180 wait complete. 2024-07-24T22:15:43.608 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:43 smithi047 ceph-mon[32551]: pgmap v627: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-07-24T22:15:43.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:43 smithi183 ceph-mon[37007]: pgmap v627: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-07-24T22:15:43.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:43 smithi188 ceph-mon[37380]: pgmap v627: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-07-24T22:15:44.404 INFO:tasks.cephfs.filesystem:scrub status for tag:5142c86c-4fba-4411-ae41-525af9e9044d - {'path': '/', 'tag': '5142c86c-4fba-4411-ae41-525af9e9044d', 'options': 'recursive,force'} 2024-07-24T22:15:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:45 smithi183 ceph-mon[37007]: pgmap v628: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:15:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:45 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:15:45.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:45 smithi047 ceph-mon[32551]: pgmap v628: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:15:45.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:45 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:15:45.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:45 smithi188 ceph-mon[37380]: pgmap v628: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:15:45.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:45 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:15:47.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:47 smithi183 ceph-mon[37007]: pgmap v629: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:15:47.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:47 smithi047 ceph-mon[32551]: pgmap v629: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:15:47.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:47 smithi188 ceph-mon[37380]: pgmap v629: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:15:49.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:49 smithi047 ceph-mon[32551]: pgmap v630: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:15:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:49 smithi188 ceph-mon[37380]: pgmap v630: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:15:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:49 smithi183 ceph-mon[37007]: pgmap v630: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:15:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.389+0000 7fc1f0940640 1 -- 172.21.15.47:0/3628692782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1ec10c9f0 msgr2=0x7fc1ec10ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.389+0000 7fc1f0940640 1 --2- 172.21.15.47:0/3628692782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1ec10c9f0 0x7fc1ec10ee70 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009ca0 tx=0x7fc1e402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.390+0000 7fc1f0940640 1 -- 172.21.15.47:0/3628692782 shutdown_connections 2024-07-24T22:15:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.390+0000 7fc1f0940640 1 --2- 172.21.15.47:0/3628692782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1ec10c9f0 0x7fc1ec10ee70 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.390+0000 7fc1f0940640 1 --2- 172.21.15.47:0/3628692782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1ec103ef0 0x7fc1ec10c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.390+0000 7fc1f0940640 1 --2- 172.21.15.47:0/3628692782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1ec1035d0 0x7fc1ec1039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.390+0000 7fc1f0940640 1 -- 172.21.15.47:0/3628692782 >> 172.21.15.47:0/3628692782 conn(0x7fc1ec0782e0 msgr2=0x7fc1ec0ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.390+0000 7fc1f0940640 1 -- 172.21.15.47:0/3628692782 shutdown_connections 2024-07-24T22:15:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.390+0000 7fc1f0940640 1 -- 172.21.15.47:0/3628692782 wait complete. 2024-07-24T22:15:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.390+0000 7fc1f0940640 1 Processor -- start 2024-07-24T22:15:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.390+0000 7fc1f0940640 1 -- start start 2024-07-24T22:15:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1f0940640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1ec1035d0 0x7fc1ec198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1f0940640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1ec103ef0 0x7fc1ec199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1f0940640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1ec10c9f0 0x7fc1ec19e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1f0940640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec112660 con 0x7fc1ec10c9f0 2024-07-24T22:15:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1f0940640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec1124e0 con 0x7fc1ec1035d0 2024-07-24T22:15:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1f0940640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec1127e0 con 0x7fc1ec103ef0 2024-07-24T22:15:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1ead9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1ec10c9f0 0x7fc1ec19e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1ead9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1ec10c9f0 0x7fc1ec19e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45542/0 (socket says 172.21.15.47:45542) 2024-07-24T22:15:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1ead9d640 1 -- 172.21.15.47:0/1337104081 learned_addr learned my addr 172.21.15.47:0/1337104081 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1ec103ef0 0x7fc1ec199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1ea59c640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1ec1035d0 0x7fc1ec198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1ead9d640 1 -- 172.21.15.47:0/1337104081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1ec103ef0 msgr2=0x7fc1ec199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1ead9d640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1ec103ef0 0x7fc1ec199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1ead9d640 1 -- 172.21.15.47:0/1337104081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1ec1035d0 msgr2=0x7fc1ec198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1ead9d640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1ec1035d0 0x7fc1ec198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1ead9d640 1 -- 172.21.15.47:0/1337104081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec19ebc0 con 0x7fc1ec10c9f0 2024-07-24T22:15:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.391+0000 7fc1ead9d640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1ec10c9f0 0x7fc1ec19e3f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4005cc0 tx=0x7fc1e402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.392+0000 7fc1db7fe640 1 -- 172.21.15.47:0/1337104081 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4003bf0 con 0x7fc1ec10c9f0 2024-07-24T22:15:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.392+0000 7fc1db7fe640 1 -- 172.21.15.47:0/1337104081 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1e4003d90 con 0x7fc1ec10c9f0 2024-07-24T22:15:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.392+0000 7fc1f0940640 1 -- 172.21.15.47:0/1337104081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1ec19ee50 con 0x7fc1ec10c9f0 2024-07-24T22:15:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.392+0000 7fc1db7fe640 1 -- 172.21.15.47:0/1337104081 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e402fbc0 con 0x7fc1ec10c9f0 2024-07-24T22:15:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.392+0000 7fc1f0940640 1 -- 172.21.15.47:0/1337104081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1ec1a5570 con 0x7fc1ec10c9f0 2024-07-24T22:15:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.394+0000 7fc1db7fe640 1 -- 172.21.15.47:0/1337104081 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fc1e402fd60 con 0x7fc1ec10c9f0 2024-07-24T22:15:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.394+0000 7fc1f3771740 1 Processor -- start 2024-07-24T22:15:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.395+0000 7fc1f3771740 1 -- start start 2024-07-24T22:15:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.395+0000 7fc1f3771740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb6f8c0 0x55ccadb6fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.395+0000 7fc1f3771740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 0x55ccadb7bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.395+0000 7fc1f3771740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb7c170 0x55ccadb7e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.395+0000 7fc1f3771740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ccadae5280 con 0x55ccadb701e0 2024-07-24T22:15:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.395+0000 7fc1f3771740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ccadad4780 con 0x55ccadb7c170 2024-07-24T22:15:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.395+0000 7fc1f3771740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ccadad87c0 con 0x55ccadb6f8c0 2024-07-24T22:15:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.395+0000 7fc1ea59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 0x55ccadb7bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.395+0000 7fc1ea59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 0x55ccadb7bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45546/0 (socket says 172.21.15.47:45546) 2024-07-24T22:15:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.395+0000 7fc1ea59c640 1 -- 172.21.15.47:0/1623565954 learned_addr learned my addr 172.21.15.47:0/1623565954 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.395+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/1623565954 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb6f8c0 0x55ccadb6fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.395+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/1623565954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb7c170 0x55ccadb7e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.395+0000 7fc1db7fe640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1d40b3dc0 0x7fc1d40b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.396+0000 7fc1ea59c640 1 -- 172.21.15.47:0/1623565954 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb6f8c0 msgr2=0x55ccadb6fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.396+0000 7fc1ea59c640 1 --2- 172.21.15.47:0/1623565954 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb6f8c0 0x55ccadb6fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.396+0000 7fc1ea59c640 1 -- 172.21.15.47:0/1623565954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb7c170 msgr2=0x55ccadb7e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.396+0000 7fc1ea59c640 1 --2- 172.21.15.47:0/1623565954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb7c170 0x55ccadb7e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.396+0000 7fc1ead9d640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1d40b3dc0 0x7fc1d40b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.396+0000 7fc1ea59c640 1 -- 172.21.15.47:0/1623565954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccad838790 con 0x55ccadb701e0 2024-07-24T22:15:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.396+0000 7fc1db7fe640 1 -- 172.21.15.47:0/1337104081 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fc1e4105550 con 0x7fc1ec10c9f0 2024-07-24T22:15:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.396+0000 7fc1ea59c640 1 --2- 172.21.15.47:0/1623565954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 0x55ccadb7bc30 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00cc60 tx=0x7fc1dc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9f4d47a09aaa66 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.396+0000 7fc1d8ff9640 1 -- 172.21.15.47:0/1623565954 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc014070 con 0x55ccadb701e0 2024-07-24T22:15:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.396+0000 7fc1d8ff9640 1 -- 172.21.15.47:0/1623565954 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1dc0047a0 con 0x55ccadb701e0 2024-07-24T22:15:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.396+0000 7fc1d8ff9640 1 -- 172.21.15.47:0/1623565954 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc010690 con 0x55ccadb701e0 2024-07-24T22:15:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.397+0000 7fc1f3771740 1 -- 172.21.15.47:0/1623565954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 msgr2=0x55ccadb7bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.397+0000 7fc1ead9d640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1d40b3dc0 0x7fc1d40b6280 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40cbf40 tx=0x7fc1e40cc090 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.397+0000 7fc1f3771740 1 --2- 172.21.15.47:0/1623565954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 0x55ccadb7bc30 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00cc60 tx=0x7fc1dc00e720 comp rx=0 tx=0).stop 2024-07-24T22:15:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.397+0000 7fc1f3771740 1 -- 172.21.15.47:0/1623565954 shutdown_connections 2024-07-24T22:15:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.397+0000 7fc1f3771740 1 --2- 172.21.15.47:0/1623565954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb7c170 0x55ccadb7e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.397+0000 7fc1f3771740 1 --2- 172.21.15.47:0/1623565954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 0x55ccadb7bc30 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.397+0000 7fc1f3771740 1 --2- 172.21.15.47:0/1623565954 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb6f8c0 0x55ccadb6fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.397+0000 7fc1f3771740 1 -- 172.21.15.47:0/1623565954 >> 172.21.15.47:0/1623565954 conn(0x55ccadb6d6f0 msgr2=0x55ccadb6e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.397+0000 7fc1f3771740 1 -- 172.21.15.47:0/1623565954 shutdown_connections 2024-07-24T22:15:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.397+0000 7fc1f3771740 1 -- 172.21.15.47:0/1623565954 wait complete. 2024-07-24T22:15:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.397+0000 7fc1f3771740 1 -- start start 2024-07-24T22:15:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.397+0000 7fc1f3771740 1 Processor -- start 2024-07-24T22:15:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1f3771740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb6f8c0 0x55ccadb7b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1f3771740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 0x55ccadb78da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1f3771740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb7c170 0x55ccadb792e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1f3771740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ccada0eab0 con 0x55ccadb701e0 2024-07-24T22:15:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1f3771740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ccada5c9e0 con 0x55ccadb6f8c0 2024-07-24T22:15:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1f3771740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ccadb7ee50 con 0x55ccadb7c170 2024-07-24T22:15:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1f3771740 10 client.0 _ll_register_callbacks cb 0x55ccad7e4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1ea59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 0x55ccadb78da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1ea59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 0x55ccadb78da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45550/0 (socket says 172.21.15.47:45550) 2024-07-24T22:15:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1ea59c640 1 -- 172.21.15.47:0/2145400351 learned_addr learned my addr 172.21.15.47:0/2145400351 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb7c170 0x55ccadb792e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb6f8c0 0x55ccadb7b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1ea59c640 1 -- 172.21.15.47:0/2145400351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb7c170 msgr2=0x55ccadb792e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1ea59c640 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb7c170 0x55ccadb792e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1ea59c640 1 -- 172.21.15.47:0/2145400351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb6f8c0 msgr2=0x55ccadb7b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1ea59c640 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb6f8c0 0x55ccadb7b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1ea59c640 1 -- 172.21.15.47:0/2145400351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccad8b1620 con 0x55ccadb701e0 2024-07-24T22:15:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb7c170 0x55ccadb792e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:15:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1ea59c640 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 0x55ccadb78da0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00cc30 tx=0x7fc1dc0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9967716d46f43b0d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.398+0000 7fc1d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1d1ffb640 1 -- 172.21.15.47:0/2145400351 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc027060 con 0x55ccadb701e0 2024-07-24T22:15:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1d1ffb640 1 -- 172.21.15.47:0/2145400351 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fc1dc004ad0 con 0x55ccadb701e0 2024-07-24T22:15:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1f3771740 1 -- 172.21.15.47:0/2145400351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ccada83ce0 con 0x55ccadb701e0 2024-07-24T22:15:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1d1ffb640 1 -- 172.21.15.47:0/2145400351 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc1dc014070 con 0x55ccadb701e0 2024-07-24T22:15:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1f3771740 10 client.17370 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1f3771740 1 -- 172.21.15.47:0/2145400351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ccadb8a610 con 0x55ccadb701e0 2024-07-24T22:15:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1d1ffb640 1 -- 172.21.15.47:0/2145400351 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ccada83ce0 con 0x55ccadb701e0 2024-07-24T22:15:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1d1ffb640 1 -- 172.21.15.47:0/2145400351 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc1dc018410 con 0x55ccadb701e0 2024-07-24T22:15:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1f3771740 10 client.17370 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1f3771740 10 client.17370 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1f3771740 20 client.17370 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1f3771740 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ccadb8ba10 0x55ccadb8de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1f3771740 4 client.17370 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:15:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1f3771740 1 -- 172.21.15.47:0/2145400351 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ccadae71d0 con 0x55ccadb8ba10 2024-07-24T22:15:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.399+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ccadb8ba10 0x55ccadb8de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.400+0000 7fc1d1ffb640 10 client.17370 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.400+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ccadb8ba10 0x55ccadb8de00 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93c84a6ab5fca710 server_cookie=3e37f2939d4e9de7 in_seq=0 out_seq=0 2024-07-24T22:15:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1d1ffb640 1 -- 172.21.15.47:0/2145400351 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ccadae71d0 con 0x55ccadb8ba10 2024-07-24T22:15:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1d1ffb640 10 client.17370 handle_command_reply: tid=0 2024-07-24T22:15:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1f3771740 1 client.17370 shutdown 2024-07-24T22:15:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1f3771740 1 -- 172.21.15.47:0/2145400351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 msgr2=0x55ccadb78da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1f3771740 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 0x55ccadb78da0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00cc30 tx=0x7fc1dc0056d0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1f3771740 1 -- 172.21.15.47:0/2145400351 shutdown_connections 2024-07-24T22:15:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1f3771740 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ccadb8ba10 0x55ccadb8de00 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1f3771740 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb7c170 0x55ccadb792e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1f3771740 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb701e0 0x55ccadb78da0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1d1ffb640 0 client.17370 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1f3771740 1 --2- 172.21.15.47:0/2145400351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb6f8c0 0x55ccadb7b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1f3771740 1 -- 172.21.15.47:0/2145400351 >> 172.21.15.47:0/2145400351 conn(0x55ccadb6d6f0 msgr2=0x55ccadb73290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1f3771740 1 -- 172.21.15.47:0/2145400351 shutdown_connections 2024-07-24T22:15:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1f3771740 1 -- 172.21.15.47:0/2145400351 wait complete. 2024-07-24T22:15:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.401+0000 7fc1f3771740 20 client.17370 trim_cache size 0 max 16384 2024-07-24T22:15:50.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.417+0000 7fc1f3771740 1 Processor -- start 2024-07-24T22:15:50.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.417+0000 7fc1f3771740 1 -- start start 2024-07-24T22:15:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.417+0000 7fc1f3771740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb6f8c0 0x55ccadb933a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.417+0000 7fc1f3771740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb701e0 0x55ccadb938e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.417+0000 7fc1f3771740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb7c170 0x55ccadb84100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.417+0000 7fc1f3771740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec1ac130 con 0x55ccadb6f8c0 2024-07-24T22:15:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1f3771740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec1ae990 con 0x55ccadb7c170 2024-07-24T22:15:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1f3771740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec1ac780 con 0x55ccadb701e0 2024-07-24T22:15:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1e9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb6f8c0 0x55ccadb933a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1e9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb6f8c0 0x55ccadb933a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45554/0 (socket says 172.21.15.47:45554) 2024-07-24T22:15:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1e9d9b640 1 -- 172.21.15.47:0/2454646478 learned_addr learned my addr 172.21.15.47:0/2454646478 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1ea59c640 1 --2- 172.21.15.47:0/2454646478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb701e0 0x55ccadb938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/2454646478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb7c170 0x55ccadb84100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1e9d9b640 1 -- 172.21.15.47:0/2454646478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb701e0 msgr2=0x55ccadb938e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/2454646478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb701e0 0x55ccadb938e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1e9d9b640 1 -- 172.21.15.47:0/2454646478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb7c170 msgr2=0x55ccadb84100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/2454646478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb7c170 0x55ccadb84100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1e9d9b640 1 -- 172.21.15.47:0/2454646478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccadb7e9a0 con 0x55ccadb6f8c0 2024-07-24T22:15:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/2454646478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb6f8c0 0x55ccadb933a0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0005fd0 tx=0x7fc1e000b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83833e002cac3e71 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1d3fff640 1 -- 172.21.15.47:0/2454646478 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000b9c0 con 0x55ccadb6f8c0 2024-07-24T22:15:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1d3fff640 1 -- 172.21.15.47:0/2454646478 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1e0026070 con 0x55ccadb6f8c0 2024-07-24T22:15:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.418+0000 7fc1d3fff640 1 -- 172.21.15.47:0/2454646478 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0003b90 con 0x55ccadb6f8c0 2024-07-24T22:15:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.419+0000 7fc1f3771740 1 -- 172.21.15.47:0/2454646478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb6f8c0 msgr2=0x55ccadb933a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.419+0000 7fc1f3771740 1 --2- 172.21.15.47:0/2454646478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb6f8c0 0x55ccadb933a0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0005fd0 tx=0x7fc1e000b410 comp rx=0 tx=0).stop 2024-07-24T22:15:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.419+0000 7fc1f3771740 1 -- 172.21.15.47:0/2454646478 shutdown_connections 2024-07-24T22:15:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.419+0000 7fc1f3771740 1 --2- 172.21.15.47:0/2454646478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb7c170 0x55ccadb84100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.419+0000 7fc1f3771740 1 --2- 172.21.15.47:0/2454646478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb701e0 0x55ccadb938e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.419+0000 7fc1f3771740 1 --2- 172.21.15.47:0/2454646478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb6f8c0 0x55ccadb933a0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.419+0000 7fc1f3771740 1 -- 172.21.15.47:0/2454646478 >> 172.21.15.47:0/2454646478 conn(0x55ccadb6d6f0 msgr2=0x55ccadb6e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.419+0000 7fc1f3771740 1 -- 172.21.15.47:0/2454646478 shutdown_connections 2024-07-24T22:15:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.419+0000 7fc1f3771740 1 -- 172.21.15.47:0/2454646478 wait complete. 2024-07-24T22:15:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1f3771740 1 -- start start 2024-07-24T22:15:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1f3771740 1 Processor -- start 2024-07-24T22:15:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1f3771740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb6f8c0 0x55ccadb81a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1f3771740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb701e0 0x55ccadb82030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1f3771740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb7c170 0x55ccadbed330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1f3771740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec1ace50 con 0x55ccadb7c170 2024-07-24T22:15:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1f3771740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec1ae2c0 con 0x55ccadb701e0 2024-07-24T22:15:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1f3771740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec1ad520 con 0x55ccadb6f8c0 2024-07-24T22:15:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1f3771740 10 client.0 _ll_register_callbacks cb 0x7fc1e000be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:15:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1e9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb7c170 0x55ccadbed330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1e9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb7c170 0x55ccadbed330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45568/0 (socket says 172.21.15.47:45568) 2024-07-24T22:15:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1e9d9b640 1 -- 172.21.15.47:0/3853462671 learned_addr learned my addr 172.21.15.47:0/3853462671 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:15:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1ea59c640 1 --2- 172.21.15.47:0/3853462671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb701e0 0x55ccadb82030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/3853462671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb6f8c0 0x55ccadb81a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1e9d9b640 1 -- 172.21.15.47:0/3853462671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb6f8c0 msgr2=0x55ccadb81a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/3853462671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb6f8c0 0x55ccadb81a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1e9d9b640 1 -- 172.21.15.47:0/3853462671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb701e0 msgr2=0x55ccadb82030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:15:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/3853462671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb701e0 0x55ccadb82030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.420+0000 7fc1e9d9b640 1 -- 172.21.15.47:0/3853462671 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccadbeda70 con 0x55ccadb7c170 2024-07-24T22:15:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1e9d9b640 1 --2- 172.21.15.47:0/3853462671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb7c170 0x55ccadbed330 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0004340 tx=0x7fc1e0004160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4382e3557e6889c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:15:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:15:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1d1ffb640 1 -- 172.21.15.47:0/3853462671 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e00035f0 con 0x55ccadb7c170 2024-07-24T22:15:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1d1ffb640 1 -- 172.21.15.47:0/3853462671 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fc1e0003790 con 0x55ccadb7c170 2024-07-24T22:15:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1f3771740 1 -- 172.21.15.47:0/3853462671 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1e0026070 con 0x55ccadb7c170 2024-07-24T22:15:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1d1ffb640 1 -- 172.21.15.47:0/3853462671 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc1e0003b10 con 0x55ccadb7c170 2024-07-24T22:15:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1f3771740 10 client.17376 fetch_fsmap learned FSMap version 20 2024-07-24T22:15:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1f3771740 1 -- 172.21.15.47:0/3853462671 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ccadbf6010 con 0x55ccadb7c170 2024-07-24T22:15:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1d1ffb640 1 -- 172.21.15.47:0/3853462671 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1e0026070 con 0x55ccadb7c170 2024-07-24T22:15:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1d1ffb640 1 -- 172.21.15.47:0/3853462671 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc1e0039070 con 0x55ccadb7c170 2024-07-24T22:15:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1f3771740 10 client.17376 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:15:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1f3771740 10 client.17376 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:15:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1f3771740 20 client.17376 populate_metadata read hostname 'smithi047' 2024-07-24T22:15:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1f3771740 1 --2- 172.21.15.47:0/3853462671 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ccadbf6600 0x55ccadbf8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:15:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1f3771740 4 client.17376 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:15:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.421+0000 7fc1f3771740 1 -- 172.21.15.47:0/3853462671 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ccadae2c70 con 0x55ccadbf6600 2024-07-24T22:15:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.422+0000 7fc1ea59c640 1 --2- 172.21.15.47:0/3853462671 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ccadbf6600 0x55ccadbf8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:15:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.422+0000 7fc1ea59c640 1 --2- 172.21.15.47:0/3853462671 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ccadbf6600 0x55ccadbf8a20 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f05e62c9c7d9b516 server_cookie=8beefa3a3d225dd8 in_seq=0 out_seq=0 2024-07-24T22:15:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.422+0000 7fc1d1ffb640 10 client.17376 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:50.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.427+0000 7fc1d1ffb640 1 -- 172.21.15.47:0/3853462671 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ccadae2c70 con 0x55ccadbf6600 2024-07-24T22:15:50.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.427+0000 7fc1d1ffb640 10 client.17376 handle_command_reply: tid=0 2024-07-24T22:15:50.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.427+0000 7fc1f3771740 1 client.17376 shutdown 2024-07-24T22:15:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.427+0000 7fc1f3771740 1 -- 172.21.15.47:0/3853462671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb7c170 msgr2=0x55ccadbed330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.427+0000 7fc1f3771740 1 --2- 172.21.15.47:0/3853462671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb7c170 0x55ccadbed330 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0004340 tx=0x7fc1e0004160 comp rx=0 tx=0).stop 2024-07-24T22:15:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f3771740 1 -- 172.21.15.47:0/3853462671 shutdown_connections 2024-07-24T22:15:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f3771740 1 --2- 172.21.15.47:0/3853462671 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ccadbf6600 0x55ccadbf8a20 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f3771740 1 --2- 172.21.15.47:0/3853462671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccadb7c170 0x55ccadbed330 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f3771740 1 --2- 172.21.15.47:0/3853462671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ccadb701e0 0x55ccadb82030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f3771740 1 --2- 172.21.15.47:0/3853462671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ccadb6f8c0 0x55ccadb81a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1d1ffb640 0 client.17376 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:15:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f3771740 1 -- 172.21.15.47:0/3853462671 >> 172.21.15.47:0/3853462671 conn(0x55ccadb6d6f0 msgr2=0x55ccadb6bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f3771740 1 -- 172.21.15.47:0/3853462671 shutdown_connections 2024-07-24T22:15:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f3771740 1 -- 172.21.15.47:0/3853462671 wait complete. 2024-07-24T22:15:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f3771740 20 client.17376 trim_cache size 0 max 16384 2024-07-24T22:15:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:15:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:15:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:15:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:15:50.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f0940640 1 -- 172.21.15.47:0/1337104081 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1d40b3dc0 msgr2=0x7fc1d40b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:50.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f0940640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1d40b3dc0 0x7fc1d40b6280 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40cbf40 tx=0x7fc1e40cc090 comp rx=0 tx=0).stop 2024-07-24T22:15:50.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f0940640 1 -- 172.21.15.47:0/1337104081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1ec10c9f0 msgr2=0x7fc1ec19e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:15:50.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f0940640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1ec10c9f0 0x7fc1ec19e3f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4005cc0 tx=0x7fc1e402f380 comp rx=0 tx=0).stop 2024-07-24T22:15:50.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f0940640 1 -- 172.21.15.47:0/1337104081 shutdown_connections 2024-07-24T22:15:50.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f0940640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1d40b3dc0 0x7fc1d40b6280 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f0940640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1ec10c9f0 0x7fc1ec19e3f0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f0940640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1ec103ef0 0x7fc1ec199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f0940640 1 --2- 172.21.15.47:0/1337104081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1ec1035d0 0x7fc1ec198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:15:50.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f0940640 1 -- 172.21.15.47:0/1337104081 >> 172.21.15.47:0/1337104081 conn(0x7fc1ec0782e0 msgr2=0x7fc1ec0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:15:50.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f0940640 1 -- 172.21.15.47:0/1337104081 shutdown_connections 2024-07-24T22:15:50.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:15:50.428+0000 7fc1f0940640 1 -- 172.21.15.47:0/1337104081 wait complete. 2024-07-24T22:15:51.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:51 smithi047 ceph-mon[32551]: pgmap v631: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:15:51.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:51 smithi188 ceph-mon[37380]: pgmap v631: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:15:51.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:51 smithi183 ceph-mon[37007]: pgmap v631: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:15:53.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:53 smithi047 ceph-mon[32551]: pgmap v632: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-07-24T22:15:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:53 smithi188 ceph-mon[37380]: pgmap v632: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-07-24T22:15:53.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:53 smithi183 ceph-mon[37007]: pgmap v632: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-07-24T22:15:55.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:55 smithi047 ceph-mon[32551]: pgmap v633: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:15:55.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:55 smithi188 ceph-mon[37380]: pgmap v633: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:15:55.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:55 smithi183 ceph-mon[37007]: pgmap v633: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:15:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:57 smithi047 ceph-mon[32551]: pgmap v634: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:57.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:57 smithi188 ceph-mon[37380]: pgmap v634: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:57 smithi183 ceph-mon[37007]: pgmap v634: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:59.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:15:59 smithi047 ceph-mon[32551]: pgmap v635: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:59.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:15:59 smithi188 ceph-mon[37380]: pgmap v635: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:15:59.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:15:59 smithi183 ceph-mon[37007]: pgmap v635: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:16:01.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:01 smithi047 ceph-mon[32551]: pgmap v636: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:16:01.714 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:01 smithi183 ceph-mon[37007]: pgmap v636: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:16:01.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:01 smithi188 ceph-mon[37380]: pgmap v636: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:16:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.531+0000 7f3c223a6640 1 -- 172.21.15.47:0/4032728589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c1c10ca30 msgr2=0x7f3c1c10eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.531+0000 7f3c223a6640 1 --2- 172.21.15.47:0/4032728589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c1c10ca30 0x7f3c1c10eeb0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009ca0 tx=0x7f3c1402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.531+0000 7f3c223a6640 1 -- 172.21.15.47:0/4032728589 shutdown_connections 2024-07-24T22:16:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.531+0000 7f3c223a6640 1 --2- 172.21.15.47:0/4032728589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c1c10ca30 0x7f3c1c10eeb0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.531+0000 7f3c223a6640 1 --2- 172.21.15.47:0/4032728589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c1c103f00 0x7f3c1c10c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.531+0000 7f3c223a6640 1 --2- 172.21.15.47:0/4032728589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c1c1035e0 0x7f3c1c1039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.531+0000 7f3c223a6640 1 -- 172.21.15.47:0/4032728589 >> 172.21.15.47:0/4032728589 conn(0x7f3c1c0fd030 msgr2=0x7f3c1c0ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.531+0000 7f3c223a6640 1 -- 172.21.15.47:0/4032728589 shutdown_connections 2024-07-24T22:16:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.531+0000 7f3c223a6640 1 -- 172.21.15.47:0/4032728589 wait complete. 2024-07-24T22:16:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.531+0000 7f3c223a6640 1 Processor -- start 2024-07-24T22:16:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c223a6640 1 -- start start 2024-07-24T22:16:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c223a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c1c1035e0 0x7f3c1c198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c223a6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c1c103f00 0x7f3c1c1990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c223a6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c1c10ca30 0x7f3c1c19e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c223a6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1126b0 con 0x7f3c1c1035e0 2024-07-24T22:16:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c223a6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c112530 con 0x7f3c1c103f00 2024-07-24T22:16:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c223a6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c112830 con 0x7f3c1c10ca30 2024-07-24T22:16:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c1bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c1c1035e0 0x7f3c1c198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c1bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c1c1035e0 0x7f3c1c198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38050/0 (socket says 172.21.15.47:38050) 2024-07-24T22:16:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c1bfff640 1 -- 172.21.15.47:0/1132216679 learned_addr learned my addr 172.21.15.47:0/1132216679 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c20943640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c1c10ca30 0x7f3c1c19e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c1b7fe640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c1c103f00 0x7f3c1c1990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c1bfff640 1 -- 172.21.15.47:0/1132216679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c1c10ca30 msgr2=0x7f3c1c19e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c1bfff640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c1c10ca30 0x7f3c1c19e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c1bfff640 1 -- 172.21.15.47:0/1132216679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c1c103f00 msgr2=0x7f3c1c1990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.532+0000 7f3c1bfff640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c1c103f00 0x7f3c1c1990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.533+0000 7f3c1bfff640 1 -- 172.21.15.47:0/1132216679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c19ec30 con 0x7f3c1c1035e0 2024-07-24T22:16:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.533+0000 7f3c1b7fe640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c1c103f00 0x7f3c1c1990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.533+0000 7f3c1bfff640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c1c1035e0 0x7f3c1c198b90 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00d950 tx=0x7f3c0c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.533+0000 7f3c197fa640 1 -- 172.21.15.47:0/1132216679 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c017070 con 0x7f3c1c1035e0 2024-07-24T22:16:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.533+0000 7f3c223a6640 1 -- 172.21.15.47:0/1132216679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1c19ef20 con 0x7f3c1c1035e0 2024-07-24T22:16:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.533+0000 7f3c197fa640 1 -- 172.21.15.47:0/1132216679 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c0c009c30 con 0x7f3c1c1035e0 2024-07-24T22:16:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.533+0000 7f3c197fa640 1 -- 172.21.15.47:0/1132216679 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c00f620 con 0x7f3c1c1035e0 2024-07-24T22:16:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.533+0000 7f3c223a6640 1 -- 172.21.15.47:0/1132216679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1c1a57c0 con 0x7f3c1c1035e0 2024-07-24T22:16:03.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c251ce740 1 Processor -- start 2024-07-24T22:16:03.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c197fa640 1 -- 172.21.15.47:0/1132216679 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f3c0c010460 con 0x7f3c1c1035e0 2024-07-24T22:16:03.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c251ce740 1 -- start start 2024-07-24T22:16:03.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c251ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 0x55f98e35cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c251ce740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e35d1e0 0x55f98e368c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c251ce740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e369170 0x55f98e36b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c251ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f98e2d2280 con 0x55f98e35c8c0 2024-07-24T22:16:03.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c251ce740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f98e2c1780 con 0x55f98e369170 2024-07-24T22:16:03.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c251ce740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f98e2c57c0 con 0x55f98e35d1e0 2024-07-24T22:16:03.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c20943640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 0x55f98e35cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c20943640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 0x55f98e35cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38060/0 (socket says 172.21.15.47:38060) 2024-07-24T22:16:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c20943640 1 -- 172.21.15.47:0/3929157009 learned_addr learned my addr 172.21.15.47:0/3929157009 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c1b7fe640 1 --2- 172.21.15.47:0/3929157009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e369170 0x55f98e36b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c1bfff640 1 --2- 172.21.15.47:0/3929157009 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e35d1e0 0x55f98e368c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c20943640 1 -- 172.21.15.47:0/3929157009 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e35d1e0 msgr2=0x55f98e368c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c20943640 1 --2- 172.21.15.47:0/3929157009 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e35d1e0 0x55f98e368c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c20943640 1 -- 172.21.15.47:0/3929157009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e369170 msgr2=0x55f98e36b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.536+0000 7f3c20943640 1 --2- 172.21.15.47:0/3929157009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e369170 0x55f98e36b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.537+0000 7f3c20943640 1 -- 172.21.15.47:0/3929157009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f98e025790 con 0x55f98e35c8c0 2024-07-24T22:16:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.537+0000 7f3c197fa640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3c040b3d40 0x7f3c040b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.537+0000 7f3c1bfff640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3c040b3d40 0x7f3c040b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.537+0000 7f3c20943640 1 --2- 172.21.15.47:0/3929157009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 0x55f98e35cca0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3c14005fa0 tx=0x7f3c14009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8ace081b90b899 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.537+0000 7f3c197fa640 1 -- 172.21.15.47:0/1132216679 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f3c0c0e3c70 con 0x7f3c1c1035e0 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.537+0000 7f3c027fc640 1 -- 172.21.15.47:0/3929157009 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14031cf0 con 0x55f98e35c8c0 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.537+0000 7f3c027fc640 1 -- 172.21.15.47:0/3929157009 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c14036030 con 0x55f98e35c8c0 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.537+0000 7f3c027fc640 1 -- 172.21.15.47:0/3929157009 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140042a0 con 0x55f98e35c8c0 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.538+0000 7f3c251ce740 1 -- 172.21.15.47:0/3929157009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 msgr2=0x55f98e35cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.538+0000 7f3c1bfff640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3c040b3d40 0x7f3c040b6200 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0e1440 tx=0x7f3c0c000bc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.538+0000 7f3c251ce740 1 --2- 172.21.15.47:0/3929157009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 0x55f98e35cca0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3c14005fa0 tx=0x7f3c14009800 comp rx=0 tx=0).stop 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.538+0000 7f3c251ce740 1 -- 172.21.15.47:0/3929157009 shutdown_connections 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.538+0000 7f3c251ce740 1 --2- 172.21.15.47:0/3929157009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e369170 0x55f98e36b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.538+0000 7f3c251ce740 1 --2- 172.21.15.47:0/3929157009 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e35d1e0 0x55f98e368c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.538+0000 7f3c251ce740 1 --2- 172.21.15.47:0/3929157009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 0x55f98e35cca0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.538+0000 7f3c251ce740 1 -- 172.21.15.47:0/3929157009 >> 172.21.15.47:0/3929157009 conn(0x55f98e35a6f0 msgr2=0x55f98e35b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.538+0000 7f3c251ce740 1 -- 172.21.15.47:0/3929157009 shutdown_connections 2024-07-24T22:16:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.538+0000 7f3c251ce740 1 -- 172.21.15.47:0/3929157009 wait complete. 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.538+0000 7f3c251ce740 1 -- start start 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c251ce740 1 Processor -- start 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c251ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 0x55f98e368830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c251ce740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35d1e0 0x55f98e365d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c251ce740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e369170 0x55f98e366250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c251ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f98e1fbab0 con 0x55f98e35c8c0 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c251ce740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f98e2499e0 con 0x55f98e35d1e0 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c251ce740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f98e36bc70 con 0x55f98e369170 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c251ce740 10 client.0 _ll_register_callbacks cb 0x55f98dfd1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c20943640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 0x55f98e368830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c20943640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 0x55f98e368830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38070/0 (socket says 172.21.15.47:38070) 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c20943640 1 -- 172.21.15.47:0/3592856558 learned_addr learned my addr 172.21.15.47:0/3592856558 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c20943640 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e369170 0x55f98e366250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c1b7fe640 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35d1e0 0x55f98e365d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c20943640 1 -- 172.21.15.47:0/3592856558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e369170 msgr2=0x55f98e366250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c20943640 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e369170 0x55f98e366250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c20943640 1 -- 172.21.15.47:0/3592856558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35d1e0 msgr2=0x55f98e365d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c20943640 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35d1e0 0x55f98e365d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c20943640 1 -- 172.21.15.47:0/3592856558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f98e09e620 con 0x55f98e35c8c0 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.539+0000 7f3c1b7fe640 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35d1e0 0x55f98e365d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3c20943640 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 0x55f98e368830 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009bf0 tx=0x7f3c14003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abeb30018b8f6278 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3bfb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3bfb7fe640 1 -- 172.21.15.47:0/3592856558 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14057060 con 0x55f98e35c8c0 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3bfb7fe640 1 -- 172.21.15.47:0/3592856558 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f3c140317d0 con 0x55f98e35c8c0 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3c251ce740 1 -- 172.21.15.47:0/3592856558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f98e270ce0 con 0x55f98e35c8c0 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3bfb7fe640 1 -- 172.21.15.47:0/3592856558 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3c1402f660 con 0x55f98e35c8c0 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3c251ce740 10 client.17388 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:03.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3c251ce740 1 -- 172.21.15.47:0/3592856558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f98e377380 con 0x55f98e35c8c0 2024-07-24T22:16:03.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3bfb7fe640 1 -- 172.21.15.47:0/3592856558 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f98e270ce0 con 0x55f98e35c8c0 2024-07-24T22:16:03.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3bfb7fe640 1 -- 172.21.15.47:0/3592856558 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3c14043070 con 0x55f98e35c8c0 2024-07-24T22:16:03.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3c251ce740 10 client.17388 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:03.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3c251ce740 10 client.17388 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:03.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3c251ce740 20 client.17388 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:03.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3c251ce740 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f98e3786d0 0x55f98e37aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3c251ce740 4 client.17388 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:16:03.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.540+0000 7f3c251ce740 1 -- 172.21.15.47:0/3592856558 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f98e2d41d0 con 0x55f98e3786d0 2024-07-24T22:16:03.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.541+0000 7f3c1b7fe640 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f98e3786d0 0x55f98e37aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.541+0000 7f3c1b7fe640 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f98e3786d0 0x55f98e37aac0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1db585b4f9e4a572 server_cookie=2a8fd8c46981e542 in_seq=0 out_seq=0 2024-07-24T22:16:03.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.541+0000 7f3bfb7fe640 10 client.17388 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3bfb7fe640 1 -- 172.21.15.47:0/3592856558 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f98e2d41d0 con 0x55f98e3786d0 2024-07-24T22:16:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3bfb7fe640 10 client.17388 handle_command_reply: tid=0 2024-07-24T22:16:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3c251ce740 1 client.17388 shutdown 2024-07-24T22:16:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3c251ce740 1 -- 172.21.15.47:0/3592856558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 msgr2=0x55f98e368830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3c251ce740 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 0x55f98e368830 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009bf0 tx=0x7f3c14003d40 comp rx=0 tx=0).stop 2024-07-24T22:16:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3c251ce740 1 -- 172.21.15.47:0/3592856558 shutdown_connections 2024-07-24T22:16:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3c251ce740 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f98e3786d0 0x55f98e37aac0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3c251ce740 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e369170 0x55f98e366250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3c251ce740 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35d1e0 0x55f98e365d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3bfb7fe640 0 client.17388 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:03.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3c251ce740 1 --2- 172.21.15.47:0/3592856558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35c8c0 0x55f98e368830 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3c251ce740 1 -- 172.21.15.47:0/3592856558 >> 172.21.15.47:0/3592856558 conn(0x55f98e35a6f0 msgr2=0x55f98e360220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:03.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3c251ce740 1 -- 172.21.15.47:0/3592856558 shutdown_connections 2024-07-24T22:16:03.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3c251ce740 1 -- 172.21.15.47:0/3592856558 wait complete. 2024-07-24T22:16:03.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.542+0000 7f3c251ce740 20 client.17388 trim_cache size 0 max 16384 2024-07-24T22:16:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c251ce740 1 Processor -- start 2024-07-24T22:16:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c251ce740 1 -- start start 2024-07-24T22:16:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c251ce740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35c8c0 0x55f98e366350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c251ce740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e35d1e0 0x55f98e35bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c251ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e369170 0x55f98e368710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c251ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1ac010 con 0x55f98e369170 2024-07-24T22:16:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c251ce740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1ae870 con 0x55f98e35c8c0 2024-07-24T22:16:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c251ce740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1ac660 con 0x55f98e35d1e0 2024-07-24T22:16:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c20943640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e369170 0x55f98e368710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c20943640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e369170 0x55f98e368710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38078/0 (socket says 172.21.15.47:38078) 2024-07-24T22:16:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c20943640 1 -- 172.21.15.47:0/2187089542 learned_addr learned my addr 172.21.15.47:0/2187089542 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c1b7fe640 1 --2- 172.21.15.47:0/2187089542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e35d1e0 0x55f98e35bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c20943640 1 --2- 172.21.15.47:0/2187089542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35c8c0 0x55f98e366350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c20943640 1 -- 172.21.15.47:0/2187089542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e35d1e0 msgr2=0x55f98e35bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c20943640 1 --2- 172.21.15.47:0/2187089542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e35d1e0 0x55f98e35bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c20943640 1 -- 172.21.15.47:0/2187089542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35c8c0 msgr2=0x55f98e366350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c20943640 1 --2- 172.21.15.47:0/2187089542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35c8c0 0x55f98e366350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c20943640 1 -- 172.21.15.47:0/2187089542 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f98e35d5c0 con 0x55f98e369170 2024-07-24T22:16:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.558+0000 7f3c20943640 1 --2- 172.21.15.47:0/2187089542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e369170 0x55f98e368710 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009620 tx=0x7f3c1402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4e5d6e3e7a615b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.559+0000 7f3c01ffb640 1 -- 172.21.15.47:0/2187089542 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14057070 con 0x55f98e369170 2024-07-24T22:16:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.559+0000 7f3c01ffb640 1 -- 172.21.15.47:0/2187089542 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c14036070 con 0x55f98e369170 2024-07-24T22:16:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.559+0000 7f3c01ffb640 1 -- 172.21.15.47:0/2187089542 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1402fad0 con 0x55f98e369170 2024-07-24T22:16:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.559+0000 7f3c251ce740 1 -- 172.21.15.47:0/2187089542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e369170 msgr2=0x55f98e368710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.559+0000 7f3c251ce740 1 --2- 172.21.15.47:0/2187089542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e369170 0x55f98e368710 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009620 tx=0x7f3c1402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.559+0000 7f3c251ce740 1 -- 172.21.15.47:0/2187089542 shutdown_connections 2024-07-24T22:16:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.559+0000 7f3c251ce740 1 --2- 172.21.15.47:0/2187089542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e369170 0x55f98e368710 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.559+0000 7f3c251ce740 1 --2- 172.21.15.47:0/2187089542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e35d1e0 0x55f98e35bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.559+0000 7f3c251ce740 1 --2- 172.21.15.47:0/2187089542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35c8c0 0x55f98e366350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.559+0000 7f3c251ce740 1 -- 172.21.15.47:0/2187089542 >> 172.21.15.47:0/2187089542 conn(0x55f98e35a6f0 msgr2=0x55f98e35b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.559+0000 7f3c251ce740 1 -- 172.21.15.47:0/2187089542 shutdown_connections 2024-07-24T22:16:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.559+0000 7f3c251ce740 1 -- 172.21.15.47:0/2187089542 wait complete. 2024-07-24T22:16:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c251ce740 1 -- start start 2024-07-24T22:16:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c251ce740 1 Processor -- start 2024-07-24T22:16:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c251ce740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35c8c0 0x55f98e369550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c251ce740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35d1e0 0x55f98e369a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c251ce740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e369170 0x55f98e369fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c251ce740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1acd30 con 0x55f98e35d1e0 2024-07-24T22:16:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c251ce740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1ae1a0 con 0x55f98e35c8c0 2024-07-24T22:16:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c251ce740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1ad400 con 0x55f98e369170 2024-07-24T22:16:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c251ce740 10 client.0 _ll_register_callbacks cb 0x7f3c1c06bd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c1b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35d1e0 0x55f98e369a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c1b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35d1e0 0x55f98e369a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38090/0 (socket says 172.21.15.47:38090) 2024-07-24T22:16:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c1b7fe640 1 -- 172.21.15.47:0/2433780800 learned_addr learned my addr 172.21.15.47:0/2433780800 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c20943640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35c8c0 0x55f98e369550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.560+0000 7f3c20943640 1 --2- 172.21.15.47:0/2433780800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e369170 0x55f98e369fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3c1b7fe640 1 -- 172.21.15.47:0/2433780800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e369170 msgr2=0x55f98e369fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3c1b7fe640 1 --2- 172.21.15.47:0/2433780800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e369170 0x55f98e369fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3c1b7fe640 1 -- 172.21.15.47:0/2433780800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35c8c0 msgr2=0x55f98e369550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3c1b7fe640 1 --2- 172.21.15.47:0/2433780800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35c8c0 0x55f98e369550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3c1b7fe640 1 -- 172.21.15.47:0/2433780800 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f98e36ff80 con 0x55f98e35d1e0 2024-07-24T22:16:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3c20943640 1 --2- 172.21.15.47:0/2433780800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e369170 0x55f98e369fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3c1b7fe640 1 --2- 172.21.15.47:0/2433780800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35d1e0 0x55f98e369a90 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x55f98e37b1f0 tx=0x7f3c100039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8454aa7993b7c6e7 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3bfb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3bfb7fe640 1 -- 172.21.15.47:0/2433780800 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10023070 con 0x55f98e35d1e0 2024-07-24T22:16:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3bfb7fe640 1 -- 172.21.15.47:0/2433780800 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f3c1001e7c0 con 0x55f98e35d1e0 2024-07-24T22:16:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3c251ce740 1 -- 172.21.15.47:0/2433780800 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c14036070 con 0x55f98e35d1e0 2024-07-24T22:16:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3bfb7fe640 1 -- 172.21.15.47:0/2433780800 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3c1002e050 con 0x55f98e35d1e0 2024-07-24T22:16:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3c251ce740 10 client.17394 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3c251ce740 1 -- 172.21.15.47:0/2433780800 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f98e3712e0 con 0x55f98e35d1e0 2024-07-24T22:16:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.561+0000 7f3bfb7fe640 1 -- 172.21.15.47:0/2433780800 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c14036070 con 0x55f98e35d1e0 2024-07-24T22:16:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.562+0000 7f3bfb7fe640 1 -- 172.21.15.47:0/2433780800 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3c140039f0 con 0x55f98e35d1e0 2024-07-24T22:16:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.562+0000 7f3c251ce740 10 client.17394 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.562+0000 7f3c251ce740 10 client.17394 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.562+0000 7f3c251ce740 20 client.17394 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.562+0000 7f3c251ce740 1 --2- 172.21.15.47:0/2433780800 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f98e3e3220 0x55f98e3e5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.562+0000 7f3c251ce740 4 client.17394 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:16:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.562+0000 7f3c251ce740 1 -- 172.21.15.47:0/2433780800 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f98e2cfc70 con 0x55f98e3e3220 2024-07-24T22:16:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.562+0000 7f3c20943640 1 --2- 172.21.15.47:0/2433780800 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f98e3e3220 0x55f98e3e5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.562+0000 7f3c20943640 1 --2- 172.21.15.47:0/2433780800 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f98e3e3220 0x55f98e3e5610 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a88c64430fe5fe72 server_cookie=7b7bb6067fe9b849 in_seq=0 out_seq=0 2024-07-24T22:16:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:03.562+0000 7f3bfb7fe640 10 client.17394 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:03.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:03 smithi047 ceph-mon[32551]: pgmap v637: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-07-24T22:16:03.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:03 smithi188 ceph-mon[37380]: pgmap v637: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-07-24T22:16:03.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:03 smithi183 ceph-mon[37007]: pgmap v637: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-07-24T22:16:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3bfb7fe640 1 -- 172.21.15.47:0/2433780800 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f98e2cfc70 con 0x55f98e3e3220 2024-07-24T22:16:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3bfb7fe640 10 client.17394 handle_command_reply: tid=0 2024-07-24T22:16:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3c251ce740 1 client.17394 shutdown 2024-07-24T22:16:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3c251ce740 1 -- 172.21.15.47:0/2433780800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35d1e0 msgr2=0x55f98e369a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3c251ce740 1 --2- 172.21.15.47:0/2433780800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35d1e0 0x55f98e369a90 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x55f98e37b1f0 tx=0x7f3c100039c0 comp rx=0 tx=0).stop 2024-07-24T22:16:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3c251ce740 1 -- 172.21.15.47:0/2433780800 shutdown_connections 2024-07-24T22:16:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3c251ce740 1 --2- 172.21.15.47:0/2433780800 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f98e3e3220 0x55f98e3e5610 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3c251ce740 1 --2- 172.21.15.47:0/2433780800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f98e369170 0x55f98e369fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3c251ce740 1 --2- 172.21.15.47:0/2433780800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f98e35d1e0 0x55f98e369a90 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3c251ce740 1 --2- 172.21.15.47:0/2433780800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f98e35c8c0 0x55f98e369550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3bfb7fe640 0 client.17394 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3c251ce740 1 -- 172.21.15.47:0/2433780800 >> 172.21.15.47:0/2433780800 conn(0x55f98e35a6f0 msgr2=0x55f98e360b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3c251ce740 1 -- 172.21.15.47:0/2433780800 shutdown_connections 2024-07-24T22:16:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3c251ce740 1 -- 172.21.15.47:0/2433780800 wait complete. 2024-07-24T22:16:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.114+0000 7f3c251ce740 20 client.17394 trim_cache size 0 max 16384 2024-07-24T22:16:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:16:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:16:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:16:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:16:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.115+0000 7f3c223a6640 1 -- 172.21.15.47:0/1132216679 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3c040b3d40 msgr2=0x7f3c040b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.115+0000 7f3c223a6640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3c040b3d40 0x7f3c040b6200 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0e1440 tx=0x7f3c0c000bc0 comp rx=0 tx=0).stop 2024-07-24T22:16:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.115+0000 7f3c223a6640 1 -- 172.21.15.47:0/1132216679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c1c1035e0 msgr2=0x7f3c1c198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.115+0000 7f3c223a6640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c1c1035e0 0x7f3c1c198b90 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00d950 tx=0x7f3c0c00de10 comp rx=0 tx=0).stop 2024-07-24T22:16:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.115+0000 7f3c223a6640 1 -- 172.21.15.47:0/1132216679 shutdown_connections 2024-07-24T22:16:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.115+0000 7f3c223a6640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3c040b3d40 0x7f3c040b6200 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.115+0000 7f3c223a6640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c1c10ca30 0x7f3c1c19e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.115+0000 7f3c223a6640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c1c103f00 0x7f3c1c1990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.115+0000 7f3c223a6640 1 --2- 172.21.15.47:0/1132216679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c1c1035e0 0x7f3c1c198b90 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.115+0000 7f3c223a6640 1 -- 172.21.15.47:0/1132216679 >> 172.21.15.47:0/1132216679 conn(0x7f3c1c0fd030 msgr2=0x7f3c1c10ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.115+0000 7f3c223a6640 1 -- 172.21.15.47:0/1132216679 shutdown_connections 2024-07-24T22:16:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:05.115+0000 7f3c223a6640 1 -- 172.21.15.47:0/1132216679 wait complete. 2024-07-24T22:16:05.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:05 smithi188 ceph-mon[37380]: pgmap v638: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 853 B/s wr, 2 op/s 2024-07-24T22:16:05.913 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:05 smithi183 ceph-mon[37007]: pgmap v638: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 853 B/s wr, 2 op/s 2024-07-24T22:16:05.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:05 smithi047 ceph-mon[32551]: pgmap v638: 97 pgs: 97 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 853 B/s wr, 2 op/s 2024-07-24T22:16:06.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:06 smithi188 ceph-mon[37380]: osdmap e92: 12 total, 12 up, 12 in 2024-07-24T22:16:06.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:06 smithi183 ceph-mon[37007]: osdmap e92: 12 total, 12 up, 12 in 2024-07-24T22:16:06.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:06 smithi047 ceph-mon[32551]: osdmap e92: 12 total, 12 up, 12 in 2024-07-24T22:16:07.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:07 smithi188 ceph-mon[37380]: pgmap v640: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:16:07.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:07 smithi183 ceph-mon[37007]: pgmap v640: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:16:07.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:07 smithi047 ceph-mon[32551]: pgmap v640: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 40 GiB data, 122 GiB used, 951 GiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:16:09.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:09 smithi188 ceph-mon[37380]: pgmap v641: 97 pgs: 15 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 55 active+clean; 39 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-07-24T22:16:09.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:09 smithi183 ceph-mon[37007]: pgmap v641: 97 pgs: 15 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 55 active+clean; 39 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-07-24T22:16:09.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:09 smithi047 ceph-mon[32551]: pgmap v641: 97 pgs: 15 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 55 active+clean; 39 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-07-24T22:16:11.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:11 smithi188 ceph-mon[37380]: pgmap v642: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 38 GiB data, 117 GiB used, 956 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-07-24T22:16:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:11 smithi183 ceph-mon[37007]: pgmap v642: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 38 GiB data, 117 GiB used, 956 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-07-24T22:16:11.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:11 smithi047 ceph-mon[32551]: pgmap v642: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 38 GiB data, 117 GiB used, 956 GiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-07-24T22:16:13.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:13 smithi188 ceph-mon[37380]: pgmap v643: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 37 GiB data, 113 GiB used, 960 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-07-24T22:16:13.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:13 smithi183 ceph-mon[37007]: pgmap v643: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 37 GiB data, 113 GiB used, 960 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-07-24T22:16:13.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:13 smithi047 ceph-mon[32551]: pgmap v643: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 37 GiB data, 113 GiB used, 960 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-07-24T22:16:14.405 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:16:14.694 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:16:15.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:15 smithi047 ceph-mon[32551]: pgmap v644: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 35 GiB data, 108 GiB used, 965 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-07-24T22:16:15.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:15 smithi188 ceph-mon[37380]: pgmap v644: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 35 GiB data, 108 GiB used, 965 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-07-24T22:16:15.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:15 smithi183 ceph-mon[37007]: pgmap v644: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 35 GiB data, 108 GiB used, 965 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-07-24T22:16:16.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.537+0000 7fc2ed14e640 1 -- 172.21.15.47:0/112082330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2e810cac0 msgr2=0x7fc2e810ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.537+0000 7fc2ed14e640 1 --2- 172.21.15.47:0/112082330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2e810cac0 0x7fc2e810ef20 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009ca0 tx=0x7fc2e002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.537+0000 7fc2ed14e640 1 -- 172.21.15.47:0/112082330 shutdown_connections 2024-07-24T22:16:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.537+0000 7fc2ed14e640 1 --2- 172.21.15.47:0/112082330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2e810cac0 0x7fc2e810ef20 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.537+0000 7fc2ed14e640 1 --2- 172.21.15.47:0/112082330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2e8103f80 0x7fc2e810c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.537+0000 7fc2ed14e640 1 --2- 172.21.15.47:0/112082330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2e8103660 0x7fc2e8103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.537+0000 7fc2ed14e640 1 -- 172.21.15.47:0/112082330 >> 172.21.15.47:0/112082330 conn(0x7fc2e80fd0c0 msgr2=0x7fc2e80ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.537+0000 7fc2ed14e640 1 -- 172.21.15.47:0/112082330 shutdown_connections 2024-07-24T22:16:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.537+0000 7fc2ed14e640 1 -- 172.21.15.47:0/112082330 wait complete. 2024-07-24T22:16:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.538+0000 7fc2ed14e640 1 Processor -- start 2024-07-24T22:16:16.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.538+0000 7fc2ed14e640 1 -- start start 2024-07-24T22:16:16.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.538+0000 7fc2ed14e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2e8103660 0x7fc2e8198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.538+0000 7fc2ed14e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2e8103f80 0x7fc2e8199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.538+0000 7fc2ed14e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2e810cac0 0x7fc2e819e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.538+0000 7fc2ed14e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e8112760 con 0x7fc2e8103f80 2024-07-24T22:16:16.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.538+0000 7fc2ed14e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81125e0 con 0x7fc2e8103660 2024-07-24T22:16:16.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.538+0000 7fc2ed14e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81128e0 con 0x7fc2e810cac0 2024-07-24T22:16:16.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.538+0000 7fc2dffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2e8103f80 0x7fc2e8199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.538+0000 7fc2e6d9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2e8103660 0x7fc2e8198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.538+0000 7fc2dffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2e8103f80 0x7fc2e8199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46070/0 (socket says 172.21.15.47:46070) 2024-07-24T22:16:16.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.538+0000 7fc2dffff640 1 -- 172.21.15.47:0/631346084 learned_addr learned my addr 172.21.15.47:0/631346084 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:16.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.539+0000 7fc2e759e640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2e810cac0 0x7fc2e819e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.539+0000 7fc2dffff640 1 -- 172.21.15.47:0/631346084 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2e810cac0 msgr2=0x7fc2e819e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:16.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.539+0000 7fc2dffff640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2e810cac0 0x7fc2e819e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.539+0000 7fc2dffff640 1 -- 172.21.15.47:0/631346084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2e8103660 msgr2=0x7fc2e8198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:16.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.539+0000 7fc2dffff640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2e8103660 0x7fc2e8198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.539+0000 7fc2dffff640 1 -- 172.21.15.47:0/631346084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e819ece0 con 0x7fc2e8103f80 2024-07-24T22:16:16.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.539+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2e8103660 0x7fc2e8198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:16:16.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.539+0000 7fc2dffff640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2e8103f80 0x7fc2e8199170 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000e9c0 tx=0x7fc2d000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:16.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.539+0000 7fc2e4d99640 1 -- 172.21.15.47:0/631346084 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d000ccc0 con 0x7fc2e8103f80 2024-07-24T22:16:16.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.539+0000 7fc2e4d99640 1 -- 172.21.15.47:0/631346084 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2d00035f0 con 0x7fc2e8103f80 2024-07-24T22:16:16.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.539+0000 7fc2e4d99640 1 -- 172.21.15.47:0/631346084 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d000ce60 con 0x7fc2e8103f80 2024-07-24T22:16:16.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.539+0000 7fc2ed14e640 1 -- 172.21.15.47:0/631346084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e819efd0 con 0x7fc2e8103f80 2024-07-24T22:16:16.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.539+0000 7fc2ed14e640 1 -- 172.21.15.47:0/631346084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e81a5690 con 0x7fc2e8103f80 2024-07-24T22:16:16.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.542+0000 7fc2ef4ff740 1 Processor -- start 2024-07-24T22:16:16.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.542+0000 7fc2ef4ff740 1 -- start start 2024-07-24T22:16:16.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.542+0000 7fc2e4d99640 1 -- 172.21.15.47:0/631346084 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fc2d0004000 con 0x7fc2e8103f80 2024-07-24T22:16:16.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.542+0000 7fc2ef4ff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 0x55e0e3c89a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.542+0000 7fc2ef4ff740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89fa0 0x55e0e3c99e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.542+0000 7fc2ef4ff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c9a340 0x55e0e3c9c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.542+0000 7fc2ef4ff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e0e3c00960 con 0x55e0e3c89680 2024-07-24T22:16:16.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.542+0000 7fc2ef4ff740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e0e3befe60 con 0x55e0e3c9a340 2024-07-24T22:16:16.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.542+0000 7fc2ef4ff740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e0e3bf3ea0 con 0x55e0e3c89fa0 2024-07-24T22:16:16.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.542+0000 7fc2e759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 0x55e0e3c89a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.542+0000 7fc2e759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 0x55e0e3c89a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46078/0 (socket says 172.21.15.47:46078) 2024-07-24T22:16:16.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2e759e640 1 -- 172.21.15.47:0/1461355783 learned_addr learned my addr 172.21.15.47:0/1461355783 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:16.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/1461355783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89fa0 0x55e0e3c99e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2dffff640 1 --2- 172.21.15.47:0/1461355783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c9a340 0x55e0e3c9c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2e759e640 1 -- 172.21.15.47:0/1461355783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89fa0 msgr2=0x55e0e3c99e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:16.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2e759e640 1 --2- 172.21.15.47:0/1461355783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89fa0 0x55e0e3c99e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2e759e640 1 -- 172.21.15.47:0/1461355783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c9a340 msgr2=0x55e0e3c9c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:16.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2e759e640 1 --2- 172.21.15.47:0/1461355783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c9a340 0x55e0e3c9c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2e759e640 1 -- 172.21.15.47:0/1461355783 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0e3b792d0 con 0x55e0e3c89680 2024-07-24T22:16:16.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/1461355783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89fa0 0x55e0e3c99e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:16:16.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2dffff640 1 --2- 172.21.15.47:0/1461355783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c9a340 0x55e0e3c9c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:16.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2e759e640 1 --2- 172.21.15.47:0/1461355783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 0x55e0e3c89a60 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009870 tx=0x7fc2e00098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879785bfbb3ffe7b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:16.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2dd7fa640 1 -- 172.21.15.47:0/1461355783 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0031cf0 con 0x55e0e3c89680 2024-07-24T22:16:16.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2dd7fa640 1 -- 172.21.15.47:0/1461355783 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2e0036040 con 0x55e0e3c89680 2024-07-24T22:16:16.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.543+0000 7fc2dd7fa640 1 -- 172.21.15.47:0/1461355783 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0004280 con 0x55e0e3c89680 2024-07-24T22:16:16.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.544+0000 7fc2e4d99640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc2d40b3d40 0x7fc2d40b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.544+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc2d40b3d40 0x7fc2d40b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.594 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:16:16.594 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:16:16.594 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:16:16.594 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:16:16.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.544+0000 7fc2e4d99640 1 -- 172.21.15.47:0/631346084 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7fc2d00e43d0 con 0x7fc2e8103f80 2024-07-24T22:16:16.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.544+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/1461355783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 msgr2=0x55e0e3c89a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:16.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.544+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/1461355783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 0x55e0e3c89a60 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009870 tx=0x7fc2e00098a0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.544+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/1461355783 shutdown_connections 2024-07-24T22:16:16.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.544+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/1461355783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c9a340 0x55e0e3c9c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.544+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/1461355783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89fa0 0x55e0e3c99e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.544+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc2d40b3d40 0x7fc2d40b6200 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009fd0 tx=0x7fc2d8005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:16.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.544+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/1461355783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 0x55e0e3c89a60 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.544+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/1461355783 >> 172.21.15.47:0/1461355783 conn(0x55e0e3c874b0 msgr2=0x55e0e3c88650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:16.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.544+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/1461355783 shutdown_connections 2024-07-24T22:16:16.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.544+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/1461355783 wait complete. 2024-07-24T22:16:16.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2ef4ff740 1 -- start start 2024-07-24T22:16:16.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2ef4ff740 1 Processor -- start 2024-07-24T22:16:16.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2ef4ff740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89680 0x55e0e3c97290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2ef4ff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89fa0 0x55e0e3c977d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2ef4ff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 0x55e0e3c97d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2ef4ff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e0e3a53700 con 0x55e0e3c9a340 2024-07-24T22:16:16.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2ef4ff740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e0e3b925a0 con 0x55e0e3c89fa0 2024-07-24T22:16:16.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2ef4ff740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e0e3c9cf90 con 0x55e0e3c89680 2024-07-24T22:16:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2ef4ff740 10 client.0 _ll_register_callbacks cb 0x55e0e3bb2910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2e759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 0x55e0e3c97d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2e6d9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89680 0x55e0e3c97290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2e759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 0x55e0e3c97d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46090/0 (socket says 172.21.15.47:46090) 2024-07-24T22:16:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2e759e640 1 -- 172.21.15.47:0/2074582616 learned_addr learned my addr 172.21.15.47:0/2074582616 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.545+0000 7fc2dffff640 1 --2- 172.21.15.47:0/2074582616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89fa0 0x55e0e3c977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2e6d9d640 1 -- 172.21.15.47:0/2074582616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89fa0 msgr2=0x55e0e3c977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/2074582616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89fa0 0x55e0e3c977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2e6d9d640 1 -- 172.21.15.47:0/2074582616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 msgr2=0x55e0e3c97d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/2074582616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 0x55e0e3c97d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2e6d9d640 1 -- 172.21.15.47:0/2074582616 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0e3b85630 con 0x55e0e3c89680 2024-07-24T22:16:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2e759e640 1 --2- 172.21.15.47:0/2074582616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 0x55e0e3c97d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:16:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/2074582616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89680 0x55e0e3c97290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8012d70 tx=0x7fc2d8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9000ae6af9758b2f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:16:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2ce7fc640 1 -- 172.21.15.47:0/2074582616 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8004050 con 0x55e0e3c89680 2024-07-24T22:16:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2074582616 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2e0036040 con 0x55e0e3c89680 2024-07-24T22:16:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2ce7fc640 1 -- 172.21.15.47:0/2074582616 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7fc2d80041f0 con 0x55e0e3c89680 2024-07-24T22:16:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2ce7fc640 1 -- 172.21.15.47:0/2074582616 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc2d80043f0 con 0x55e0e3c89680 2024-07-24T22:16:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2ef4ff740 10 client.26575 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.546+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2074582616 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e0e3950650 con 0x55e0e3c89680 2024-07-24T22:16:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.547+0000 7fc2ce7fc640 1 -- 172.21.15.47:0/2074582616 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2e0036040 con 0x55e0e3c89680 2024-07-24T22:16:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.547+0000 7fc2ce7fc640 1 -- 172.21.15.47:0/2074582616 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc2d8027020 con 0x55e0e3c89680 2024-07-24T22:16:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.547+0000 7fc2ef4ff740 10 client.26575 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.547+0000 7fc2ef4ff740 10 client.26575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.547+0000 7fc2ef4ff740 20 client.26575 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.547+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/2074582616 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e0e3ca9e40 0x55e0e3cac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.547+0000 7fc2ef4ff740 4 client.26575 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:16:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.547+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2074582616 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0e3c028b0 con 0x55e0e3ca9e40 2024-07-24T22:16:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.547+0000 7fc2dffff640 1 --2- 172.21.15.47:0/2074582616 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e0e3ca9e40 0x55e0e3cac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.547+0000 7fc2dffff640 1 --2- 172.21.15.47:0/2074582616 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e0e3ca9e40 0x55e0e3cac230 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bac651a2f91ccee4 server_cookie=67e853c2ec06b232 in_seq=0 out_seq=0 2024-07-24T22:16:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.547+0000 7fc2ce7fc640 10 client.26575 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.548+0000 7fc2ce7fc640 1 -- 172.21.15.47:0/2074582616 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e0e3c028b0 con 0x55e0e3ca9e40 2024-07-24T22:16:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.548+0000 7fc2ce7fc640 10 client.26575 handle_command_reply: tid=0 2024-07-24T22:16:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.548+0000 7fc2ef4ff740 1 client.26575 shutdown 2024-07-24T22:16:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.548+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2074582616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89680 msgr2=0x55e0e3c97290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.548+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/2074582616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89680 0x55e0e3c97290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8012d70 tx=0x7fc2d8004730 comp rx=0 tx=0).stop 2024-07-24T22:16:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.548+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2074582616 shutdown_connections 2024-07-24T22:16:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.548+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/2074582616 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e0e3ca9e40 0x55e0e3cac230 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.548+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/2074582616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 0x55e0e3c97d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.548+0000 7fc2ce7fc640 0 client.26575 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.548+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/2074582616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89fa0 0x55e0e3c977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.548+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/2074582616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89680 0x55e0e3c97290 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.548+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2074582616 >> 172.21.15.47:0/2074582616 conn(0x55e0e3c874b0 msgr2=0x55e0e3c8cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.548+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2074582616 shutdown_connections 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.549+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2074582616 wait complete. 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.549+0000 7fc2ef4ff740 20 client.26575 trim_cache size 0 max 16384 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.569+0000 7fc2ef4ff740 1 Processor -- start 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.569+0000 7fc2ef4ff740 1 -- start start 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.569+0000 7fc2ef4ff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 0x55e0e3c94dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.569+0000 7fc2ef4ff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89fa0 0x55e0e3c95b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.569+0000 7fc2ef4ff740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c9a340 0x55e0e3c96050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.569+0000 7fc2ef4ff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81aa110 con 0x55e0e3c89680 2024-07-24T22:16:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.569+0000 7fc2ef4ff740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81ac970 con 0x55e0e3c89fa0 2024-07-24T22:16:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.569+0000 7fc2ef4ff740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81aa760 con 0x55e0e3c9a340 2024-07-24T22:16:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2e6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 0x55e0e3c94dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2e6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 0x55e0e3c94dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46092/0 (socket says 172.21.15.47:46092) 2024-07-24T22:16:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2e6d9d640 1 -- 172.21.15.47:0/3540803388 learned_addr learned my addr 172.21.15.47:0/3540803388 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2e759e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c9a340 0x55e0e3c96050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2dffff640 1 --2- 172.21.15.47:0/3540803388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89fa0 0x55e0e3c95b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2e6d9d640 1 -- 172.21.15.47:0/3540803388 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c9a340 msgr2=0x55e0e3c96050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/3540803388 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c9a340 0x55e0e3c96050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2e6d9d640 1 -- 172.21.15.47:0/3540803388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89fa0 msgr2=0x55e0e3c95b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/3540803388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89fa0 0x55e0e3c95b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2e6d9d640 1 -- 172.21.15.47:0/3540803388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0e3ca8a40 con 0x55e0e3c89680 2024-07-24T22:16:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/3540803388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 0x55e0e3c94dd0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8019040 tx=0x7fc2d80294f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1313b9fc9c193bb server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2dcff9640 1 -- 172.21.15.47:0/3540803388 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8035070 con 0x55e0e3c89680 2024-07-24T22:16:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2dcff9640 1 -- 172.21.15.47:0/3540803388 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2d8004220 con 0x55e0e3c89680 2024-07-24T22:16:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.570+0000 7fc2dcff9640 1 -- 172.21.15.47:0/3540803388 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8011e30 con 0x55e0e3c89680 2024-07-24T22:16:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.571+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/3540803388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 msgr2=0x55e0e3c94dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.571+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/3540803388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 0x55e0e3c94dd0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8019040 tx=0x7fc2d80294f0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.571+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/3540803388 shutdown_connections 2024-07-24T22:16:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.571+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/3540803388 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c9a340 0x55e0e3c96050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.571+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/3540803388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89fa0 0x55e0e3c95b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.571+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/3540803388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c89680 0x55e0e3c94dd0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.571+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/3540803388 >> 172.21.15.47:0/3540803388 conn(0x55e0e3c874b0 msgr2=0x55e0e3c9b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.571+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/3540803388 shutdown_connections 2024-07-24T22:16:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.571+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/3540803388 wait complete. 2024-07-24T22:16:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.571+0000 7fc2ef4ff740 1 -- start start 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.571+0000 7fc2ef4ff740 1 Processor -- start 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2ef4ff740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89680 0x55e0e3cb1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2ef4ff740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89fa0 0x55e0e3cb2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2ef4ff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 0x55e0e3ca23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2ef4ff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81aae30 con 0x55e0e3c9a340 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2ef4ff740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81ac2a0 con 0x55e0e3c89680 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2ef4ff740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81ab500 con 0x55e0e3c89fa0 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2ef4ff740 10 client.0 _ll_register_callbacks cb 0x7fc2d8009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2e759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 0x55e0e3ca23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2e759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 0x55e0e3ca23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46098/0 (socket says 172.21.15.47:46098) 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2e759e640 1 -- 172.21.15.47:0/2760318183 learned_addr learned my addr 172.21.15.47:0/2760318183 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2dffff640 1 --2- 172.21.15.47:0/2760318183 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89fa0 0x55e0e3cb2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/2760318183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89680 0x55e0e3cb1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2e759e640 1 -- 172.21.15.47:0/2760318183 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89fa0 msgr2=0x55e0e3cb2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2e759e640 1 --2- 172.21.15.47:0/2760318183 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89fa0 0x55e0e3cb2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2e759e640 1 -- 172.21.15.47:0/2760318183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89680 msgr2=0x55e0e3cb1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2e759e640 1 --2- 172.21.15.47:0/2760318183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89680 0x55e0e3cb1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2e759e640 1 -- 172.21.15.47:0/2760318183 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0e3ca2bf0 con 0x55e0e3c9a340 2024-07-24T22:16:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2e759e640 1 --2- 172.21.15.47:0/2760318183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 0x55e0e3ca23c0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009870 tx=0x7fc2e0003dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5225f4172ae1ae82 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.572+0000 7fc2ce7fc640 1 -- 172.21.15.47:0/2760318183 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0052020 con 0x55e0e3c9a340 2024-07-24T22:16:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2ce7fc640 1 -- 172.21.15.47:0/2760318183 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7fc2e0031db0 con 0x55e0e3c9a340 2024-07-24T22:16:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2760318183 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2d8004220 con 0x55e0e3c9a340 2024-07-24T22:16:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2ce7fc640 1 -- 172.21.15.47:0/2760318183 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc2e004a040 con 0x55e0e3c9a340 2024-07-24T22:16:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2ef4ff740 10 client.17412 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2760318183 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e0e3c8baf0 con 0x55e0e3c9a340 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2ce7fc640 1 -- 172.21.15.47:0/2760318183 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2d8004220 con 0x55e0e3c9a340 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2ce7fc640 1 -- 172.21.15.47:0/2760318183 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc2e002fb80 con 0x55e0e3c9a340 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2ef4ff740 10 client.17412 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2ef4ff740 10 client.17412 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2ef4ff740 20 client.17412 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/2760318183 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e0e3d14d40 0x55e0e3d17130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2ef4ff740 4 client.17412 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2760318183 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e0e3c9ae60 con 0x55e0e3d14d40 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.573+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/2760318183 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e0e3d14d40 0x55e0e3d17130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ce7fc640 10 client.17412 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2e6d9d640 1 --2- 172.21.15.47:0/2760318183 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e0e3d14d40 0x55e0e3d17130 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e6def294d2a21d5 server_cookie=ace98db0ff0746b8 in_seq=0 out_seq=0 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ce7fc640 1 -- 172.21.15.47:0/2760318183 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e0e3c9ae60 con 0x55e0e3d14d40 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ce7fc640 10 client.17412 handle_command_reply: tid=0 2024-07-24T22:16:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ef4ff740 1 client.17412 shutdown 2024-07-24T22:16:16.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2760318183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 msgr2=0x55e0e3ca23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:16.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/2760318183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 0x55e0e3ca23c0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009870 tx=0x7fc2e0003dc0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2760318183 shutdown_connections 2024-07-24T22:16:16.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/2760318183 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e0e3d14d40 0x55e0e3d17130 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/2760318183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e0e3c9a340 0x55e0e3ca23c0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/2760318183 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e0e3c89fa0 0x55e0e3cb2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ce7fc640 0 client.17412 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:16.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ef4ff740 1 --2- 172.21.15.47:0/2760318183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e0e3c89680 0x55e0e3cb1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2760318183 >> 172.21.15.47:0/2760318183 conn(0x55e0e3c874b0 msgr2=0x55e0e3c88270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:16.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2760318183 shutdown_connections 2024-07-24T22:16:16.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.574+0000 7fc2ef4ff740 1 -- 172.21.15.47:0/2760318183 wait complete. 2024-07-24T22:16:16.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.575+0000 7fc2ef4ff740 20 client.17412 trim_cache size 0 max 16384 2024-07-24T22:16:16.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.575+0000 7fc2ed14e640 1 -- 172.21.15.47:0/631346084 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc2d40b3d40 msgr2=0x7fc2d40b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.575+0000 7fc2ed14e640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc2d40b3d40 0x7fc2d40b6200 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009fd0 tx=0x7fc2d8005f90 comp rx=0 tx=0).stop 2024-07-24T22:16:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.575+0000 7fc2ed14e640 1 -- 172.21.15.47:0/631346084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2e8103f80 msgr2=0x7fc2e8199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.575+0000 7fc2ed14e640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2e8103f80 0x7fc2e8199170 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000e9c0 tx=0x7fc2d000ee80 comp rx=0 tx=0).stop 2024-07-24T22:16:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.575+0000 7fc2ed14e640 1 -- 172.21.15.47:0/631346084 shutdown_connections 2024-07-24T22:16:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.575+0000 7fc2ed14e640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc2d40b3d40 0x7fc2d40b6200 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.575+0000 7fc2ed14e640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2e810cac0 0x7fc2e819e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.575+0000 7fc2ed14e640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2e8103f80 0x7fc2e8199170 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.575+0000 7fc2ed14e640 1 --2- 172.21.15.47:0/631346084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2e8103660 0x7fc2e8198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.575+0000 7fc2ed14e640 1 -- 172.21.15.47:0/631346084 >> 172.21.15.47:0/631346084 conn(0x7fc2e80fd0c0 msgr2=0x7fc2e80fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.575+0000 7fc2ed14e640 1 -- 172.21.15.47:0/631346084 shutdown_connections 2024-07-24T22:16:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:16.575+0000 7fc2ed14e640 1 -- 172.21.15.47:0/631346084 wait complete. 2024-07-24T22:16:17.450 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:16:17.451 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:16:17.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:17 smithi047 ceph-mon[32551]: pgmap v645: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 34 GiB data, 105 GiB used, 967 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 846 B/s wr, 2 op/s 2024-07-24T22:16:17.743 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:16:17.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:17 smithi188 ceph-mon[37380]: pgmap v645: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 34 GiB data, 105 GiB used, 967 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 846 B/s wr, 2 op/s 2024-07-24T22:16:17.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:17 smithi183 ceph-mon[37007]: pgmap v645: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 34 GiB data, 105 GiB used, 967 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 846 B/s wr, 2 op/s 2024-07-24T22:16:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.219+0000 7f3a18e83640 1 -- 172.21.15.47:0/3766051333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a141080a0 msgr2=0x7f3a141084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.219+0000 7f3a18e83640 1 --2- 172.21.15.47:0/3766051333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a141080a0 0x7f3a141084e0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f39fc009900 tx=0x7f39fc02a410 comp rx=0 tx=0).stop 2024-07-24T22:16:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.219+0000 7f3a18e83640 1 -- 172.21.15.47:0/3766051333 shutdown_connections 2024-07-24T22:16:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.219+0000 7f3a18e83640 1 --2- 172.21.15.47:0/3766051333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a14108a20 0x7f3a1410f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.219+0000 7f3a18e83640 1 --2- 172.21.15.47:0/3766051333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a141080a0 0x7f3a141084e0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.219+0000 7f3a18e83640 1 --2- 172.21.15.47:0/3766051333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a141026a0 0x7f3a14102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.219+0000 7f3a18e83640 1 -- 172.21.15.47:0/3766051333 >> 172.21.15.47:0/3766051333 conn(0x7f3a140fe0e0 msgr2=0x7f3a14100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.219+0000 7f3a18e83640 1 -- 172.21.15.47:0/3766051333 shutdown_connections 2024-07-24T22:16:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.219+0000 7f3a18e83640 1 -- 172.21.15.47:0/3766051333 wait complete. 2024-07-24T22:16:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.220+0000 7f3a18e83640 1 Processor -- start 2024-07-24T22:16:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.220+0000 7f3a18e83640 1 -- start start 2024-07-24T22:16:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.220+0000 7f3a18e83640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a141026a0 0x7f3a14198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.220+0000 7f3a18e83640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a141080a0 0x7f3a14199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.220+0000 7f3a18e83640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a14108a20 0x7f3a1419e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.220+0000 7f3a18e83640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3a14112670 con 0x7f3a141026a0 2024-07-24T22:16:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.220+0000 7f3a18e83640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141124f0 con 0x7f3a14108a20 2024-07-24T22:16:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.220+0000 7f3a18e83640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141127f0 con 0x7f3a141080a0 2024-07-24T22:16:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.220+0000 7f3a1259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a141026a0 0x7f3a14198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.220+0000 7f3a1259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a141026a0 0x7f3a14198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46118/0 (socket says 172.21.15.47:46118) 2024-07-24T22:16:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.220+0000 7f3a1259c640 1 -- 172.21.15.47:0/800344541 learned_addr learned my addr 172.21.15.47:0/800344541 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.220+0000 7f3a0bfff640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a141080a0 0x7f3a14199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.220+0000 7f3a12d9d640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a14108a20 0x7f3a1419e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.221+0000 7f3a1259c640 1 -- 172.21.15.47:0/800344541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a141080a0 msgr2=0x7f3a14199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.221+0000 7f3a1259c640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a141080a0 0x7f3a14199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.221+0000 7f3a1259c640 1 -- 172.21.15.47:0/800344541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a14108a20 msgr2=0x7f3a1419e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.221+0000 7f3a1259c640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a14108a20 0x7f3a1419e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.221+0000 7f3a1259c640 1 -- 172.21.15.47:0/800344541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1419ec90 con 0x7f3a141026a0 2024-07-24T22:16:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.221+0000 7f3a1259c640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a141026a0 0x7f3a14198bf0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400e9f0 tx=0x7f3a0400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.221+0000 7f3a0b7fe640 1 -- 172.21.15.47:0/800344541 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0400cd80 con 0x7f3a141026a0 2024-07-24T22:16:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.221+0000 7f3a0b7fe640 1 -- 172.21.15.47:0/800344541 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a040108e0 con 0x7f3a141026a0 2024-07-24T22:16:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.221+0000 7f3a18e83640 1 -- 172.21.15.47:0/800344541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1419ef80 con 0x7f3a141026a0 2024-07-24T22:16:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.221+0000 7f3a0b7fe640 1 -- 172.21.15.47:0/800344541 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04018980 con 0x7f3a141026a0 2024-07-24T22:16:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.221+0000 7f3a18e83640 1 -- 172.21.15.47:0/800344541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a141a5820 con 0x7f3a141026a0 2024-07-24T22:16:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.224+0000 7f3a0b7fe640 1 -- 172.21.15.47:0/800344541 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f3a04010430 con 0x7f3a141026a0 2024-07-24T22:16:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.224+0000 7f3a1bbda740 1 Processor -- start 2024-07-24T22:16:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.224+0000 7f3a1bbda740 1 -- start start 2024-07-24T22:16:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.224+0000 7f3a1bbda740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ad990b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.224+0000 7f3a1bbda740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 0x55a90ada5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.224+0000 7f3a1bbda740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ada5580 0x55a90ada7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.224+0000 7f3a1bbda740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a90ad0a280 con 0x55a90ad98cd0 2024-07-24T22:16:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.224+0000 7f3a1bbda740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a90acf9780 con 0x55a90ada5580 2024-07-24T22:16:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.224+0000 7f3a1bbda740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a90acfd7c0 con 0x55a90ad995f0 2024-07-24T22:16:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a12d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ad990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a12d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ad990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46124/0 (socket says 172.21.15.47:46124) 2024-07-24T22:16:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a1259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 0x55a90ada5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a12d9d640 1 -- 172.21.15.47:0/2230713220 learned_addr learned my addr 172.21.15.47:0/2230713220 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a0bfff640 1 --2- 172.21.15.47:0/2230713220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ada5580 0x55a90ada7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a12d9d640 1 -- 172.21.15.47:0/2230713220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 msgr2=0x55a90ada5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a0b7fe640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3a000b3dc0 0x7f3a000b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a12d9d640 1 --2- 172.21.15.47:0/2230713220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 0x55a90ada5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a12d9d640 1 -- 172.21.15.47:0/2230713220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ada5580 msgr2=0x55a90ada7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a12d9d640 1 --2- 172.21.15.47:0/2230713220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ada5580 0x55a90ada7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a12d9d640 1 -- 172.21.15.47:0/2230713220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a90aa5d790 con 0x55a90ad98cd0 2024-07-24T22:16:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a0b7fe640 1 -- 172.21.15.47:0/800344541 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7f3a040e4300 con 0x7f3a141026a0 2024-07-24T22:16:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a12d9d640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3a000b3dc0 0x7f3a000b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a12d9d640 1 --2- 172.21.15.47:0/2230713220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ad990b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009fd0 tx=0x7f3a0c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8875b329acdfe91 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a08ff9640 1 -- 172.21.15.47:0/2230713220 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c004250 con 0x55a90ad98cd0 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.225+0000 7f3a08ff9640 1 -- 172.21.15.47:0/2230713220 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a0c003db0 con 0x55a90ad98cd0 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.226+0000 7f3a08ff9640 1 -- 172.21.15.47:0/2230713220 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c01bb80 con 0x55a90ad98cd0 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.226+0000 7f3a1bbda740 1 -- 172.21.15.47:0/2230713220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 msgr2=0x55a90ad990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.226+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/2230713220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ad990b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009fd0 tx=0x7f3a0c0118d0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.226+0000 7f3a12d9d640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3a000b3dc0 0x7f3a000b6280 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c020000 tx=0x7f3a0c021000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.226+0000 7f3a1bbda740 1 -- 172.21.15.47:0/2230713220 shutdown_connections 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.226+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/2230713220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ada5580 0x55a90ada7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.226+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/2230713220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 0x55a90ada5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.226+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/2230713220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ad990b0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.226+0000 7f3a1bbda740 1 -- 172.21.15.47:0/2230713220 >> 172.21.15.47:0/2230713220 conn(0x55a90ad96b00 msgr2=0x55a90ad97ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.226+0000 7f3a1bbda740 1 -- 172.21.15.47:0/2230713220 shutdown_connections 2024-07-24T22:16:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.226+0000 7f3a1bbda740 1 -- 172.21.15.47:0/2230713220 wait complete. 2024-07-24T22:16:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1bbda740 1 -- start start 2024-07-24T22:16:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1bbda740 1 Processor -- start 2024-07-24T22:16:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1bbda740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ada4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1bbda740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 0x55a90ada21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1bbda740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ada5580 0x55a90ada26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1bbda740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a90ac33ab0 con 0x55a90ad98cd0 2024-07-24T22:16:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1bbda740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a90ac819e0 con 0x55a90ada5580 2024-07-24T22:16:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1bbda740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a90ada8260 con 0x55a90ad995f0 2024-07-24T22:16:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1bbda740 10 client.0 _ll_register_callbacks cb 0x55a90aa09a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ada4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ada4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46136/0 (socket says 172.21.15.47:46136) 2024-07-24T22:16:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1259c640 1 -- 172.21.15.47:0/1646619205 learned_addr learned my addr 172.21.15.47:0/1646619205 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a0bfff640 1 --2- 172.21.15.47:0/1646619205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 0x55a90ada21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a12d9d640 1 --2- 172.21.15.47:0/1646619205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ada5580 0x55a90ada26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1259c640 1 -- 172.21.15.47:0/1646619205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 msgr2=0x55a90ada21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1259c640 1 --2- 172.21.15.47:0/1646619205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 0x55a90ada21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1259c640 1 -- 172.21.15.47:0/1646619205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ada5580 msgr2=0x55a90ada26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1259c640 1 --2- 172.21.15.47:0/1646619205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ada5580 0x55a90ada26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.227+0000 7f3a1259c640 1 -- 172.21.15.47:0/1646619205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a90aad6620 con 0x55a90ad98cd0 2024-07-24T22:16:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f3a1259c640 1 --2- 172.21.15.47:0/1646619205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ada4cc0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400c6a0 tx=0x7f3a04010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fa7b88efa2a327 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f39f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f39f9ffb640 1 -- 172.21.15.47:0/1646619205 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a040aa6d0 con 0x55a90ad98cd0 2024-07-24T22:16:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f39f9ffb640 1 -- 172.21.15.47:0/1646619205 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7f3a04018b40 con 0x55a90ad98cd0 2024-07-24T22:16:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f3a1bbda740 1 -- 172.21.15.47:0/1646619205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a90aca8ce0 con 0x55a90ad98cd0 2024-07-24T22:16:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f39f9ffb640 1 -- 172.21.15.47:0/1646619205 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3a04010720 con 0x55a90ad98cd0 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f3a1bbda740 10 client.17424 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f3a1bbda740 1 -- 172.21.15.47:0/1646619205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a90adb3a40 con 0x55a90ad98cd0 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f39f9ffb640 1 -- 172.21.15.47:0/1646619205 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a90aca8ce0 con 0x55a90ad98cd0 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f39f9ffb640 1 -- 172.21.15.47:0/1646619205 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3a040a68d0 con 0x55a90ad98cd0 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f3a1bbda740 10 client.17424 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f3a1bbda740 10 client.17424 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f3a1bbda740 20 client.17424 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/1646619205 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a90adb4f50 0x55a90adb7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f3a1bbda740 4 client.17424 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.228+0000 7f3a1bbda740 1 -- 172.21.15.47:0/1646619205 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a90ad0c1d0 con 0x55a90adb4f50 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.229+0000 7f3a0bfff640 1 --2- 172.21.15.47:0/1646619205 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a90adb4f50 0x55a90adb7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.229+0000 7f39f9ffb640 10 client.17424 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.229+0000 7f3a0bfff640 1 --2- 172.21.15.47:0/1646619205 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a90adb4f50 0x55a90adb7340 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f52b99322e1e9fc server_cookie=6c390419f59634c5 in_seq=0 out_seq=0 2024-07-24T22:16:18.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f39f9ffb640 1 -- 172.21.15.47:0/1646619205 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a90ad0c1d0 con 0x55a90adb4f50 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f39f9ffb640 10 client.17424 handle_command_reply: tid=0 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f3a1bbda740 1 client.17424 shutdown 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f3a1bbda740 1 -- 172.21.15.47:0/1646619205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 msgr2=0x55a90ada4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/1646619205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ada4cc0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400c6a0 tx=0x7f3a04010cc0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f3a1bbda740 1 -- 172.21.15.47:0/1646619205 shutdown_connections 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/1646619205 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a90adb4f50 0x55a90adb7340 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/1646619205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ada5580 0x55a90ada26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/1646619205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 0x55a90ada21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f39f9ffb640 0 client.17424 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/1646619205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ada4cc0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f3a1bbda740 1 -- 172.21.15.47:0/1646619205 >> 172.21.15.47:0/1646619205 conn(0x55a90ad96b00 msgr2=0x55a90ad9c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f3a1bbda740 1 -- 172.21.15.47:0/1646619205 shutdown_connections 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f3a1bbda740 1 -- 172.21.15.47:0/1646619205 wait complete. 2024-07-24T22:16:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.230+0000 7f3a1bbda740 20 client.17424 trim_cache size 0 max 16384 2024-07-24T22:16:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.245+0000 7f3a1bbda740 1 Processor -- start 2024-07-24T22:16:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.245+0000 7f3a1bbda740 1 -- start start 2024-07-24T22:16:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.245+0000 7f3a1bbda740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ada2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.245+0000 7f3a1bbda740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ad995f0 0x55a90adbcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.245+0000 7f3a1bbda740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ada5580 0x55a90adbd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.245+0000 7f3a1bbda740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141aa080 con 0x55a90ad98cd0 2024-07-24T22:16:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.245+0000 7f3a1bbda740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141ac8e0 con 0x55a90ad995f0 2024-07-24T22:16:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.245+0000 7f3a1bbda740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141aa6d0 con 0x55a90ada5580 2024-07-24T22:16:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.246+0000 7f3a1259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ada2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.246+0000 7f3a1259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ada2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46138/0 (socket says 172.21.15.47:46138) 2024-07-24T22:16:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.246+0000 7f3a1259c640 1 -- 172.21.15.47:0/843794719 learned_addr learned my addr 172.21.15.47:0/843794719 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.246+0000 7f3a0bfff640 1 --2- 172.21.15.47:0/843794719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ad995f0 0x55a90adbcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.246+0000 7f3a1259c640 1 -- 172.21.15.47:0/843794719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ada5580 msgr2=0x55a90adbd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.246+0000 7f3a1259c640 1 --2- 172.21.15.47:0/843794719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ada5580 0x55a90adbd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.246+0000 7f3a1259c640 1 -- 172.21.15.47:0/843794719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ad995f0 msgr2=0x55a90adbcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.246+0000 7f3a1259c640 1 --2- 172.21.15.47:0/843794719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ad995f0 0x55a90adbcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.246+0000 7f3a1259c640 1 -- 172.21.15.47:0/843794719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a90ad999d0 con 0x55a90ad98cd0 2024-07-24T22:16:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.246+0000 7f3a1259c640 1 --2- 172.21.15.47:0/843794719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ada2170 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f3a040e1ff0 tx=0x7f3a040e4240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb0e5e24ec8e16 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.246+0000 7f39fbfff640 1 -- 172.21.15.47:0/843794719 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a040a6e20 con 0x55a90ad98cd0 2024-07-24T22:16:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.246+0000 7f39fbfff640 1 -- 172.21.15.47:0/843794719 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a040aaa70 con 0x55a90ad98cd0 2024-07-24T22:16:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.246+0000 7f39fbfff640 1 -- 172.21.15.47:0/843794719 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a040aa1c0 con 0x55a90ad98cd0 2024-07-24T22:16:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 -- 172.21.15.47:0/843794719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 msgr2=0x55a90ada2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/843794719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ada2170 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f3a040e1ff0 tx=0x7f3a040e4240 comp rx=0 tx=0).stop 2024-07-24T22:16:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 -- 172.21.15.47:0/843794719 shutdown_connections 2024-07-24T22:16:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/843794719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ada5580 0x55a90adbd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/843794719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ad995f0 0x55a90adbcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/843794719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ad98cd0 0x55a90ada2170 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 -- 172.21.15.47:0/843794719 >> 172.21.15.47:0/843794719 conn(0x55a90ad96b00 msgr2=0x55a90ada0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 -- 172.21.15.47:0/843794719 shutdown_connections 2024-07-24T22:16:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 -- 172.21.15.47:0/843794719 wait complete. 2024-07-24T22:16:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 -- start start 2024-07-24T22:16:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 Processor -- start 2024-07-24T22:16:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ad98cd0 0x55a90ada8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 0x55a90ada9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ada5580 0x55a90ae1db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141aada0 con 0x55a90ada5580 2024-07-24T22:16:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141ac210 con 0x55a90ad98cd0 2024-07-24T22:16:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141ab470 con 0x55a90ad995f0 2024-07-24T22:16:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a1bbda740 10 client.0 _ll_register_callbacks cb 0x7f3a040e7b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.247+0000 7f3a12d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ada5580 0x55a90ae1db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f3a12d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ada5580 0x55a90ae1db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46142/0 (socket says 172.21.15.47:46142) 2024-07-24T22:16:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f3a12d9d640 1 -- 172.21.15.47:0/2158761978 learned_addr learned my addr 172.21.15.47:0/2158761978 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f3a1259c640 1 --2- 172.21.15.47:0/2158761978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ad98cd0 0x55a90ada8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f3a0bfff640 1 --2- 172.21.15.47:0/2158761978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 0x55a90ada9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f3a12d9d640 1 -- 172.21.15.47:0/2158761978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 msgr2=0x55a90ada9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f3a12d9d640 1 --2- 172.21.15.47:0/2158761978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 0x55a90ada9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f3a12d9d640 1 -- 172.21.15.47:0/2158761978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ad98cd0 msgr2=0x55a90ada8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f3a12d9d640 1 --2- 172.21.15.47:0/2158761978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ad98cd0 0x55a90ada8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f3a12d9d640 1 -- 172.21.15.47:0/2158761978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a90ada7d10 con 0x55a90ada5580 2024-07-24T22:16:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f3a12d9d640 1 --2- 172.21.15.47:0/2158761978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ada5580 0x55a90ae1db80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009fd0 tx=0x7f3a0c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a79e883493a4663 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f39f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f39f9ffb640 1 -- 172.21.15.47:0/2158761978 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c033030 con 0x55a90ada5580 2024-07-24T22:16:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f39f9ffb640 1 -- 172.21.15.47:0/2158761978 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7f3a0c01b430 con 0x55a90ada5580 2024-07-24T22:16:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f3a1bbda740 1 -- 172.21.15.47:0/2158761978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a040aaa70 con 0x55a90ada5580 2024-07-24T22:16:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f39f9ffb640 1 -- 172.21.15.47:0/2158761978 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3a0c029040 con 0x55a90ada5580 2024-07-24T22:16:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f3a1bbda740 10 client.17430 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f3a1bbda740 1 -- 172.21.15.47:0/2158761978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a90ae1f3e0 con 0x55a90ada5580 2024-07-24T22:16:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.248+0000 7f39f9ffb640 1 -- 172.21.15.47:0/2158761978 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a040aaa70 con 0x55a90ada5580 2024-07-24T22:16:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.249+0000 7f39f9ffb640 1 -- 172.21.15.47:0/2158761978 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3a0c00fcd0 con 0x55a90ada5580 2024-07-24T22:16:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.249+0000 7f3a1bbda740 10 client.17430 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.249+0000 7f3a1bbda740 10 client.17430 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.249+0000 7f3a1bbda740 20 client.17430 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.249+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/2158761978 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a90ae1f9f0 0x55a90ae21e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.249+0000 7f3a1bbda740 4 client.17430 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:16:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.249+0000 7f3a1bbda740 1 -- 172.21.15.47:0/2158761978 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a90ad07c70 con 0x55a90ae1f9f0 2024-07-24T22:16:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.249+0000 7f3a1259c640 1 --2- 172.21.15.47:0/2158761978 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a90ae1f9f0 0x55a90ae21e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.249+0000 7f3a1259c640 1 --2- 172.21.15.47:0/2158761978 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a90ae1f9f0 0x55a90ae21e10 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccfe347b5659c0f6 server_cookie=7d3d30e303b61353 in_seq=0 out_seq=0 2024-07-24T22:16:18.259 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.249+0000 7f39f9ffb640 10 client.17430 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f39f9ffb640 1 -- 172.21.15.47:0/2158761978 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a90ad07c70 con 0x55a90ae1f9f0 2024-07-24T22:16:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f39f9ffb640 10 client.17430 handle_command_reply: tid=0 2024-07-24T22:16:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f3a1bbda740 1 client.17430 shutdown 2024-07-24T22:16:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f3a1bbda740 1 -- 172.21.15.47:0/2158761978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ada5580 msgr2=0x55a90ae1db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/2158761978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ada5580 0x55a90ae1db80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009fd0 tx=0x7f3a0c003f60 comp rx=0 tx=0).stop 2024-07-24T22:16:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f3a1bbda740 1 -- 172.21.15.47:0/2158761978 shutdown_connections 2024-07-24T22:16:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/2158761978 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55a90ae1f9f0 0x55a90ae21e10 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/2158761978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a90ada5580 0x55a90ae1db80 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/2158761978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a90ad995f0 0x55a90ada9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f39f9ffb640 0 client.17430 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f3a1bbda740 1 --2- 172.21.15.47:0/2158761978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a90ad98cd0 0x55a90ada8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f3a1bbda740 1 -- 172.21.15.47:0/2158761978 >> 172.21.15.47:0/2158761978 conn(0x55a90ad96b00 msgr2=0x55a90ad9cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f3a1bbda740 1 -- 172.21.15.47:0/2158761978 shutdown_connections 2024-07-24T22:16:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f3a1bbda740 1 -- 172.21.15.47:0/2158761978 wait complete. 2024-07-24T22:16:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.428+0000 7f3a1bbda740 20 client.17430 trim_cache size 0 max 16384 2024-07-24T22:16:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:16:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:16:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:16:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:16:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.429+0000 7f3a18e83640 1 -- 172.21.15.47:0/800344541 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3a000b3dc0 msgr2=0x7f3a000b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.429+0000 7f3a18e83640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3a000b3dc0 0x7f3a000b6280 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c020000 tx=0x7f3a0c021000 comp rx=0 tx=0).stop 2024-07-24T22:16:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.429+0000 7f3a18e83640 1 -- 172.21.15.47:0/800344541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a141026a0 msgr2=0x7f3a14198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.429+0000 7f3a18e83640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a141026a0 0x7f3a14198bf0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400e9f0 tx=0x7f3a0400eeb0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.429+0000 7f3a18e83640 1 -- 172.21.15.47:0/800344541 shutdown_connections 2024-07-24T22:16:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.429+0000 7f3a18e83640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f3a000b3dc0 0x7f3a000b6280 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.429+0000 7f3a18e83640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a14108a20 0x7f3a1419e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.429+0000 7f3a18e83640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a141080a0 0x7f3a14199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.429+0000 7f3a18e83640 1 --2- 172.21.15.47:0/800344541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a141026a0 0x7f3a14198bf0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.429+0000 7f3a18e83640 1 -- 172.21.15.47:0/800344541 >> 172.21.15.47:0/800344541 conn(0x7f3a140fe0e0 msgr2=0x7f3a141004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.429+0000 7f3a18e83640 1 -- 172.21.15.47:0/800344541 shutdown_connections 2024-07-24T22:16:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:18.429+0000 7f3a18e83640 1 -- 172.21.15.47:0/800344541 wait complete. 2024-07-24T22:16:19.278 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.3 2024-07-24T22:16:19.278 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:16:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.389+0000 7f39d359e640 1 -- 172.21.15.47:0/2780177100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39d41014c0 msgr2=0x7f39d41018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:19.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.389+0000 7f39d359e640 1 --2- 172.21.15.47:0/2780177100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39d41014c0 0x7f39d41018a0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009900 tx=0x7f39c402a410 comp rx=0 tx=0).stop 2024-07-24T22:16:19.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.389+0000 7f39d359e640 1 -- 172.21.15.47:0/2780177100 shutdown_connections 2024-07-24T22:16:19.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.389+0000 7f39d359e640 1 --2- 172.21.15.47:0/2780177100 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39d4107850 0x7f39d410e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:19.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.389+0000 7f39d359e640 1 --2- 172.21.15.47:0/2780177100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d4106ed0 0x7f39d4107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:19.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.389+0000 7f39d359e640 1 --2- 172.21.15.47:0/2780177100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39d41014c0 0x7f39d41018a0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:19.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.389+0000 7f39d359e640 1 -- 172.21.15.47:0/2780177100 >> 172.21.15.47:0/2780177100 conn(0x7f39d40fcf90 msgr2=0x7f39d40ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.389+0000 7f39d359e640 1 -- 172.21.15.47:0/2780177100 shutdown_connections 2024-07-24T22:16:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.389+0000 7f39d359e640 1 -- 172.21.15.47:0/2780177100 wait complete. 2024-07-24T22:16:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.390+0000 7f39d359e640 1 Processor -- start 2024-07-24T22:16:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.390+0000 7f39d359e640 1 -- start start 2024-07-24T22:16:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.390+0000 7f39d359e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d41014c0 0x7f39d41989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:19.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.390+0000 7f39d359e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39d4106ed0 0x7f39d4198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:19.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.390+0000 7f39d359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39d4107850 0x7f39d419e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:19.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.390+0000 7f39d359e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f39d4112630 con 0x7f39d4107850 2024-07-24T22:16:19.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.390+0000 7f39d359e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f39d41124b0 con 0x7f39d4106ed0 2024-07-24T22:16:19.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.390+0000 7f39d359e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f39d41127b0 con 0x7f39d41014c0 2024-07-24T22:16:19.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39d4107850 0x7f39d419e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:19.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39d4107850 0x7f39d419e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46158/0 (socket says 172.21.15.47:46158) 2024-07-24T22:16:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d2d9d640 1 -- 172.21.15.47:0/296217769 learned_addr learned my addr 172.21.15.47:0/296217769 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d1d9b640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39d4106ed0 0x7f39d4198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d259c640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d41014c0 0x7f39d41989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:19.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d2d9d640 1 -- 172.21.15.47:0/296217769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d41014c0 msgr2=0x7f39d41989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d2d9d640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d41014c0 0x7f39d41989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d2d9d640 1 -- 172.21.15.47:0/296217769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39d4106ed0 msgr2=0x7f39d4198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d2d9d640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39d4106ed0 0x7f39d4198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d2d9d640 1 -- 172.21.15.47:0/296217769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d419ea70 con 0x7f39d4107850 2024-07-24T22:16:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d259c640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d41014c0 0x7f39d41989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:19.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d2d9d640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39d4107850 0x7f39d419e2a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00eaa0 tx=0x7f39cc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39c37fe640 1 -- 172.21.15.47:0/296217769 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc00cdb0 con 0x7f39d4107850 2024-07-24T22:16:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39c37fe640 1 -- 172.21.15.47:0/296217769 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39cc005020 con 0x7f39d4107850 2024-07-24T22:16:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d359e640 1 -- 172.21.15.47:0/296217769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d419ed60 con 0x7f39d4107850 2024-07-24T22:16:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39c37fe640 1 -- 172.21.15.47:0/296217769 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc0116d0 con 0x7f39d4107850 2024-07-24T22:16:19.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.391+0000 7f39d359e640 1 -- 172.21.15.47:0/296217769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d41a5420 con 0x7f39d4107850 2024-07-24T22:16:19.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.393+0000 7f39d359e640 1 -- 172.21.15.47:0/296217769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d41018a0 con 0x7f39d4107850 2024-07-24T22:16:19.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.394+0000 7f39c37fe640 1 -- 172.21.15.47:0/296217769 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f39cc0051d0 con 0x7f39d4107850 2024-07-24T22:16:19.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.395+0000 7f39c37fe640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f39bc0b3de0 0x7f39bc0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:19.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.395+0000 7f39d259c640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f39bc0b3de0 0x7f39bc0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:19.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.395+0000 7f39c37fe640 1 -- 172.21.15.47:0/296217769 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7f39cc0e4220 con 0x7f39d4107850 2024-07-24T22:16:19.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.395+0000 7f39d259c640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f39bc0b3de0 0x7f39bc0b62a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f39c4031440 tx=0x7f39c4005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:19.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.399+0000 7f39c37fe640 1 -- 172.21.15.47:0/296217769 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f39cc016030 con 0x7f39d4107850 2024-07-24T22:16:19.558 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:16:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.647+0000 7f39d359e640 1 -- 172.21.15.47:0/296217769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39d41a57c0 con 0x7f39d4107850 2024-07-24T22:16:19.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.648+0000 7f39c37fe640 1 -- 172.21.15.47:0/296217769 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f39cc0ab4d0 con 0x7f39d4107850 2024-07-24T22:16:19.651 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:16:19.651 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:16:19.651 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:16:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.650+0000 7f39d359e640 1 -- 172.21.15.47:0/296217769 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f39bc0b3de0 msgr2=0x7f39bc0b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.650+0000 7f39d359e640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f39bc0b3de0 0x7f39bc0b62a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f39c4031440 tx=0x7f39c4005a20 comp rx=0 tx=0).stop 2024-07-24T22:16:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.650+0000 7f39d359e640 1 -- 172.21.15.47:0/296217769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39d4107850 msgr2=0x7f39d419e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.650+0000 7f39d359e640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39d4107850 0x7f39d419e2a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00eaa0 tx=0x7f39cc00ef60 comp rx=0 tx=0).stop 2024-07-24T22:16:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.650+0000 7f39d359e640 1 -- 172.21.15.47:0/296217769 shutdown_connections 2024-07-24T22:16:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.650+0000 7f39d359e640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f39bc0b3de0 0x7f39bc0b62a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.650+0000 7f39d359e640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39d4107850 0x7f39d419e2a0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.650+0000 7f39d359e640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39d4106ed0 0x7f39d4198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.650+0000 7f39d359e640 1 --2- 172.21.15.47:0/296217769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39d41014c0 0x7f39d41989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:19.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.650+0000 7f39d359e640 1 -- 172.21.15.47:0/296217769 >> 172.21.15.47:0/296217769 conn(0x7f39d40fcf90 msgr2=0x7f39d40ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:19.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.650+0000 7f39d359e640 1 -- 172.21.15.47:0/296217769 shutdown_connections 2024-07-24T22:16:19.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:19.650+0000 7f39d359e640 1 -- 172.21.15.47:0/296217769 wait complete. 2024-07-24T22:16:19.662 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:19 smithi047 ceph-mon[32551]: pgmap v646: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 32 GiB data, 98 GiB used, 974 GiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-07-24T22:16:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:19 smithi188 ceph-mon[37380]: pgmap v646: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 32 GiB data, 98 GiB used, 974 GiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-07-24T22:16:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:19 smithi183 ceph-mon[37007]: pgmap v646: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 32 GiB data, 98 GiB used, 974 GiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-07-24T22:16:20.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:20 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/296217769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:16:20.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:16:20.776 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:20 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/296217769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:16:20.776 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:16:20.786 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:20 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/296217769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:16:20.786 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:16:21.622 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:16:22.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:21 smithi047 ceph-mon[32551]: pgmap v647: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 31 GiB data, 95 GiB used, 977 GiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-07-24T22:16:22.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:21 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:21 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:21 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:21 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:21 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:21 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.121+0000 7f679fbf2640 1 -- 172.21.15.47:0/3476992162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6798108180 msgr2=0x7f67981085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.121+0000 7f679fbf2640 1 --2- 172.21.15.47:0/3476992162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6798108180 0x7f67981085c0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f6788009900 tx=0x7f678802a410 comp rx=0 tx=0).stop 2024-07-24T22:16:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.121+0000 7f679fbf2640 1 -- 172.21.15.47:0/3476992162 shutdown_connections 2024-07-24T22:16:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.121+0000 7f679fbf2640 1 --2- 172.21.15.47:0/3476992162 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6798108b00 0x7f679810f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.121+0000 7f679fbf2640 1 --2- 172.21.15.47:0/3476992162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6798108180 0x7f67981085c0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.121+0000 7f679fbf2640 1 --2- 172.21.15.47:0/3476992162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6798100bd0 0x7f6798100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.121+0000 7f679fbf2640 1 -- 172.21.15.47:0/3476992162 >> 172.21.15.47:0/3476992162 conn(0x7f6798077af0 msgr2=0x7f67980feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.121+0000 7f679fbf2640 1 -- 172.21.15.47:0/3476992162 shutdown_connections 2024-07-24T22:16:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.121+0000 7f679fbf2640 1 -- 172.21.15.47:0/3476992162 wait complete. 2024-07-24T22:16:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.122+0000 7f679fbf2640 1 Processor -- start 2024-07-24T22:16:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.122+0000 7f679fbf2640 1 -- start start 2024-07-24T22:16:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679fbf2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6798100bd0 0x7f6798198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679fbf2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6798108180 0x7f67981991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679fbf2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6798108b00 0x7f679819e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679fbf2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6798112730 con 0x7f6798108180 2024-07-24T22:16:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679fbf2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f67981125b0 con 0x7f6798100bd0 2024-07-24T22:16:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679fbf2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f67981128b0 con 0x7f6798108b00 2024-07-24T22:16:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679d18d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6798108180 0x7f67981991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679d18d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6798108180 0x7f67981991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46178/0 (socket says 172.21.15.47:46178) 2024-07-24T22:16:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679d18d640 1 -- 172.21.15.47:0/1750615530 learned_addr learned my addr 172.21.15.47:0/1750615530 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679e18f640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6798108b00 0x7f679819e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679d98e640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6798100bd0 0x7f6798198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679d18d640 1 -- 172.21.15.47:0/1750615530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6798108b00 msgr2=0x7f679819e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679d18d640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6798108b00 0x7f679819e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679d18d640 1 -- 172.21.15.47:0/1750615530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6798100bd0 msgr2=0x7f6798198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679d18d640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6798100bd0 0x7f6798198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679d18d640 1 -- 172.21.15.47:0/1750615530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679819ed10 con 0x7f6798108180 2024-07-24T22:16:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679e18f640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6798108b00 0x7f679819e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679d98e640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6798100bd0 0x7f6798198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.123+0000 7f679d18d640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6798108180 0x7f67981991a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f6788005940 tx=0x7f67880040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.124+0000 7f678effd640 1 -- 172.21.15.47:0/1750615530 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678803f030 con 0x7f6798108180 2024-07-24T22:16:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.124+0000 7f679fbf2640 1 -- 172.21.15.47:0/1750615530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679819efa0 con 0x7f6798108180 2024-07-24T22:16:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.124+0000 7f678effd640 1 -- 172.21.15.47:0/1750615530 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67880044c0 con 0x7f6798108180 2024-07-24T22:16:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.124+0000 7f678effd640 1 -- 172.21.15.47:0/1750615530 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788035070 con 0x7f6798108180 2024-07-24T22:16:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.124+0000 7f679fbf2640 1 -- 172.21.15.47:0/1750615530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67981a56c0 con 0x7f6798108180 2024-07-24T22:16:22.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.125+0000 7f679fbf2640 1 -- 172.21.15.47:0/1750615530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6798100fb0 con 0x7f6798108180 2024-07-24T22:16:22.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.126+0000 7f678effd640 1 -- 172.21.15.47:0/1750615530 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f6788042030 con 0x7f6798108180 2024-07-24T22:16:22.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.127+0000 7f678effd640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f67840b3d40 0x7f67840b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:22.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.127+0000 7f679d98e640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f67840b3d40 0x7f67840b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:22.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.127+0000 7f678effd640 1 -- 172.21.15.47:0/1750615530 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7f67881041c0 con 0x7f6798108180 2024-07-24T22:16:22.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.127+0000 7f679d98e640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f67840b3d40 0x7f67840b6200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6794009c20 tx=0x7f6794005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:22.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.131+0000 7f678effd640 1 -- 172.21.15.47:0/1750615530 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f67880cb410 con 0x7f6798108180 2024-07-24T22:16:22.205 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:16:22.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:21 smithi188 ceph-mon[37380]: pgmap v647: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 31 GiB data, 95 GiB used, 977 GiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-07-24T22:16:22.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:21 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:21 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:21 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:21 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:21 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:21 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.380+0000 7f679fbf2640 1 -- 172.21.15.47:0/1750615530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6798199d90 con 0x7f6798108180 2024-07-24T22:16:22.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.381+0000 7f678effd640 1 -- 172.21.15.47:0/1750615530 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f67880cad10 con 0x7f6798108180 2024-07-24T22:16:22.384 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:16:22.384 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:16:22.384 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:16:22.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.383+0000 7f679fbf2640 1 -- 172.21.15.47:0/1750615530 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f67840b3d40 msgr2=0x7f67840b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:22.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.383+0000 7f679fbf2640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f67840b3d40 0x7f67840b6200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6794009c20 tx=0x7f6794005f90 comp rx=0 tx=0).stop 2024-07-24T22:16:22.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.383+0000 7f679fbf2640 1 -- 172.21.15.47:0/1750615530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6798108180 msgr2=0x7f67981991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:22.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.383+0000 7f679fbf2640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6798108180 0x7f67981991a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f6788005940 tx=0x7f67880040c0 comp rx=0 tx=0).stop 2024-07-24T22:16:22.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.383+0000 7f679fbf2640 1 -- 172.21.15.47:0/1750615530 shutdown_connections 2024-07-24T22:16:22.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.383+0000 7f679fbf2640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f67840b3d40 0x7f67840b6200 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:22.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.383+0000 7f679fbf2640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6798108b00 0x7f679819e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:22.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.383+0000 7f679fbf2640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6798108180 0x7f67981991a0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:22.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.383+0000 7f679fbf2640 1 --2- 172.21.15.47:0/1750615530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6798100bd0 0x7f6798198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:22.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.383+0000 7f679fbf2640 1 -- 172.21.15.47:0/1750615530 >> 172.21.15.47:0/1750615530 conn(0x7f6798077af0 msgr2=0x7f6798105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:22.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.383+0000 7f679fbf2640 1 -- 172.21.15.47:0/1750615530 shutdown_connections 2024-07-24T22:16:22.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:22.383+0000 7f679fbf2640 1 -- 172.21.15.47:0/1750615530 wait complete. 2024-07-24T22:16:22.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:21 smithi183 ceph-mon[37007]: pgmap v647: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 31 GiB data, 95 GiB used, 977 GiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-07-24T22:16:22.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:21 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:21 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:21 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:21 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:21 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:22.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:21 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:23.103 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:22 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1750615530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:16:23.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:22 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1750615530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:16:23.220 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db / --timeout 90 --expiration 141.3 --await-for 45.0' 2024-07-24T22:16:23.220 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db / --timeout 90 --expiration 141.3 --await-for 45.0 2024-07-24T22:16:23.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:22 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1750615530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:16:24.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:23 smithi183 ceph-mon[37007]: pgmap v648: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 426 B/s wr, 3 op/s 2024-07-24T22:16:24.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:23 smithi047 ceph-mon[32551]: pgmap v648: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 426 B/s wr, 3 op/s 2024-07-24T22:16:24.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:23 smithi188 ceph-mon[37380]: pgmap v648: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 426 B/s wr, 3 op/s 2024-07-24T22:16:25.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.384+0000 7f639eb5f640 1 -- 172.21.15.47:0/2620067678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f639810cae0 msgr2=0x7f639810ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:25.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.384+0000 7f639eb5f640 1 --2- 172.21.15.47:0/2620067678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f639810cae0 0x7f639810ef10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f6390009ca0 tx=0x7f639002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.384+0000 7f639eb5f640 1 -- 172.21.15.47:0/2620067678 shutdown_connections 2024-07-24T22:16:25.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.384+0000 7f639eb5f640 1 --2- 172.21.15.47:0/2620067678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f639810cae0 0x7f639810ef10 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.384+0000 7f639eb5f640 1 --2- 172.21.15.47:0/2620067678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6398103f30 0x7f639810c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.384+0000 7f639eb5f640 1 --2- 172.21.15.47:0/2620067678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6398103530 0x7f6398103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.384+0000 7f639eb5f640 1 -- 172.21.15.47:0/2620067678 >> 172.21.15.47:0/2620067678 conn(0x7f63980fd0c0 msgr2=0x7f63980ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:25.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.384+0000 7f639eb5f640 1 -- 172.21.15.47:0/2620067678 shutdown_connections 2024-07-24T22:16:25.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.384+0000 7f639eb5f640 1 -- 172.21.15.47:0/2620067678 wait complete. 2024-07-24T22:16:25.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639eb5f640 1 Processor -- start 2024-07-24T22:16:25.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639eb5f640 1 -- start start 2024-07-24T22:16:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639eb5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6398103530 0x7f6398198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639eb5f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6398103f30 0x7f6398199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639eb5f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f639810cae0 0x7f639819e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639eb5f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6398112700 con 0x7f6398103530 2024-07-24T22:16:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639eb5f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6398112580 con 0x7f639810cae0 2024-07-24T22:16:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639eb5f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6398112880 con 0x7f6398103f30 2024-07-24T22:16:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639c8fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6398103530 0x7f6398198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639c8fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6398103530 0x7f6398198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46564/0 (socket says 172.21.15.47:46564) 2024-07-24T22:16:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639c8fb640 1 -- 172.21.15.47:0/672816439 learned_addr learned my addr 172.21.15.47:0/672816439 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639d0fc640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f639810cae0 0x7f639819e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639c8fb640 1 -- 172.21.15.47:0/672816439 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6398103f30 msgr2=0x7f6398199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f6397fff640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6398103f30 0x7f6398199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639c8fb640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6398103f30 0x7f6398199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639c8fb640 1 -- 172.21.15.47:0/672816439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f639810cae0 msgr2=0x7f639819e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:25.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639c8fb640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f639810cae0 0x7f639819e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.385+0000 7f639c8fb640 1 -- 172.21.15.47:0/672816439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639819ec80 con 0x7f6398103530 2024-07-24T22:16:25.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.386+0000 7f639d0fc640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f639810cae0 0x7f639819e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:25.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.386+0000 7f639c8fb640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6398103530 0x7f6398198bd0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f638c00d950 tx=0x7f638c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:25.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.386+0000 7f6395ffb640 1 -- 172.21.15.47:0/672816439 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c017070 con 0x7f6398103530 2024-07-24T22:16:25.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.386+0000 7f6395ffb640 1 -- 172.21.15.47:0/672816439 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f638c009c30 con 0x7f6398103530 2024-07-24T22:16:25.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.386+0000 7f639eb5f640 1 -- 172.21.15.47:0/672816439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639819ef70 con 0x7f6398103530 2024-07-24T22:16:25.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.386+0000 7f6395ffb640 1 -- 172.21.15.47:0/672816439 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c00f620 con 0x7f6398103530 2024-07-24T22:16:25.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.386+0000 7f639eb5f640 1 -- 172.21.15.47:0/672816439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63981a5630 con 0x7f6398103530 2024-07-24T22:16:25.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.389+0000 7f6395ffb640 1 -- 172.21.15.47:0/672816439 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f638c010460 con 0x7f6398103530 2024-07-24T22:16:25.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.389+0000 7f63a0f10740 1 Processor -- start 2024-07-24T22:16:25.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.389+0000 7f63a0f10740 1 -- start start 2024-07-24T22:16:25.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.389+0000 7f63a0f10740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.389+0000 7f63a0f10740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b6ff0 0x562fa86c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.389+0000 7f63a0f10740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86c2f80 0x562fa86c5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.389+0000 7f63a0f10740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562fa862d9b0 con 0x562fa86b66d0 2024-07-24T22:16:25.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.389+0000 7f63a0f10740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562fa861ceb0 con 0x562fa86b6ff0 2024-07-24T22:16:25.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.389+0000 7f63a0f10740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562fa8620ef0 con 0x562fa86c2f80 2024-07-24T22:16:25.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.389+0000 7f639d0fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f639d0fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86b6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46580/0 (socket says 172.21.15.47:46580) 2024-07-24T22:16:25.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f639d0fc640 1 -- 172.21.15.47:0/1514115558 learned_addr learned my addr 172.21.15.47:0/1514115558 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:25.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f6397fff640 1 --2- 172.21.15.47:0/1514115558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86c2f80 0x562fa86c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f639c8fb640 1 --2- 172.21.15.47:0/1514115558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b6ff0 0x562fa86c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f6395ffb640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63880b3d40 0x7f63880b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f639d0fc640 1 -- 172.21.15.47:0/1514115558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86c2f80 msgr2=0x562fa86c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:25.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f639d0fc640 1 --2- 172.21.15.47:0/1514115558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86c2f80 0x562fa86c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f639d0fc640 1 -- 172.21.15.47:0/1514115558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b6ff0 msgr2=0x562fa86c2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:25.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f639d0fc640 1 --2- 172.21.15.47:0/1514115558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b6ff0 0x562fa86c2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f639d0fc640 1 -- 172.21.15.47:0/1514115558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fa85a6320 con 0x562fa86b66d0 2024-07-24T22:16:25.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f639c8fb640 1 --2- 172.21.15.47:0/1514115558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b6ff0 0x562fa86c2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:16:25.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f6395ffb640 1 -- 172.21.15.47:0/672816439 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7f638c0e3db0 con 0x7f6398103530 2024-07-24T22:16:25.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f639d0fc640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63880b3d40 0x7f63880b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f639d0fc640 1 --2- 172.21.15.47:0/1514115558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86b6ab0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f6390009800 tx=0x7f6390009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251fae9df183fd0d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:25.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f6382ffd640 1 -- 172.21.15.47:0/1514115558 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639004d070 con 0x562fa86b66d0 2024-07-24T22:16:25.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f6382ffd640 1 -- 172.21.15.47:0/1514115558 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6390036040 con 0x562fa86b66d0 2024-07-24T22:16:25.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.390+0000 7f6382ffd640 1 -- 172.21.15.47:0/1514115558 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639002f860 con 0x562fa86b66d0 2024-07-24T22:16:25.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.391+0000 7f63a0f10740 1 -- 172.21.15.47:0/1514115558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 msgr2=0x562fa86b6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:25.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.391+0000 7f639d0fc640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63880b3d40 0x7f63880b6200 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f639004a000 tx=0x7f639004b000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.391+0000 7f63a0f10740 1 --2- 172.21.15.47:0/1514115558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86b6ab0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f6390009800 tx=0x7f6390009830 comp rx=0 tx=0).stop 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.391+0000 7f63a0f10740 1 -- 172.21.15.47:0/1514115558 shutdown_connections 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.391+0000 7f63a0f10740 1 --2- 172.21.15.47:0/1514115558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86c2f80 0x562fa86c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.391+0000 7f63a0f10740 1 --2- 172.21.15.47:0/1514115558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b6ff0 0x562fa86c2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.391+0000 7f63a0f10740 1 --2- 172.21.15.47:0/1514115558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86b6ab0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.391+0000 7f63a0f10740 1 -- 172.21.15.47:0/1514115558 >> 172.21.15.47:0/1514115558 conn(0x562fa86b4500 msgr2=0x562fa86b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.391+0000 7f63a0f10740 1 -- 172.21.15.47:0/1514115558 shutdown_connections 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.391+0000 7f63a0f10740 1 -- 172.21.15.47:0/1514115558 wait complete. 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f63a0f10740 1 -- start start 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f63a0f10740 1 Processor -- start 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f63a0f10740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f63a0f10740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b6ff0 0x562fa86c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f63a0f10740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86c2f80 0x562fa86c0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f63a0f10740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562fa8480700 con 0x562fa86b66d0 2024-07-24T22:16:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f63a0f10740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562fa85bf5f0 con 0x562fa86b6ff0 2024-07-24T22:16:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f63a0f10740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562fa86c5c00 con 0x562fa86c2f80 2024-07-24T22:16:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f63a0f10740 10 client.0 _ll_register_callbacks cb 0x562fa85df960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f639c8fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f639c8fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86bfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46584/0 (socket says 172.21.15.47:46584) 2024-07-24T22:16:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f639c8fb640 1 -- 172.21.15.47:0/3718247626 learned_addr learned my addr 172.21.15.47:0/3718247626 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f6397fff640 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b6ff0 0x562fa86c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f639d0fc640 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86c2f80 0x562fa86c0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.392+0000 7f639c8fb640 1 -- 172.21.15.47:0/3718247626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86c2f80 msgr2=0x562fa86c0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f639c8fb640 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86c2f80 0x562fa86c0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f639c8fb640 1 -- 172.21.15.47:0/3718247626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b6ff0 msgr2=0x562fa86c03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f639c8fb640 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b6ff0 0x562fa86c03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f639c8fb640 1 -- 172.21.15.47:0/3718247626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fa85b2680 con 0x562fa86b66d0 2024-07-24T22:16:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f639d0fc640 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86c2f80 0x562fa86c0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:16:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f6397fff640 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b6ff0 0x562fa86c03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:16:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f639c8fb640 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86bfea0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f638c0e14a0 tx=0x7f638c0aa340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d1fbb7aa82a9cc server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f6377fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f6377fff640 1 -- 172.21.15.47:0/3718247626 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c020030 con 0x562fa86b66d0 2024-07-24T22:16:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f6377fff640 1 -- 172.21.15.47:0/3718247626 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7f638c0a6ef0 con 0x562fa86b66d0 2024-07-24T22:16:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f63a0f10740 1 -- 172.21.15.47:0/3718247626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6390036040 con 0x562fa86b66d0 2024-07-24T22:16:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f6377fff640 1 -- 172.21.15.47:0/3718247626 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f638c0aa410 con 0x562fa86b66d0 2024-07-24T22:16:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f63a0f10740 10 client.17454 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f63a0f10740 1 -- 172.21.15.47:0/3718247626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562fa837d650 con 0x562fa86b66d0 2024-07-24T22:16:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f6377fff640 1 -- 172.21.15.47:0/3718247626 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6390036040 con 0x562fa86b66d0 2024-07-24T22:16:25.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f6377fff640 1 -- 172.21.15.47:0/3718247626 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f638c0a6b90 con 0x562fa86b66d0 2024-07-24T22:16:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f63a0f10740 10 client.17454 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f63a0f10740 10 client.17454 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f63a0f10740 20 client.17454 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f63a0f10740 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562fa86d2880 0x562fa86d4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f63a0f10740 4 client.17454 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:16:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.393+0000 7f63a0f10740 1 -- 172.21.15.47:0/3718247626 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fa862f900 con 0x562fa86d2880 2024-07-24T22:16:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.394+0000 7f6397fff640 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562fa86d2880 0x562fa86d4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.394+0000 7f6397fff640 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562fa86d2880 0x562fa86d4c70 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b0a618120e6d7eb server_cookie=2868bfcfc86f4d3a in_seq=0 out_seq=0 2024-07-24T22:16:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.394+0000 7f6377fff640 10 client.17454 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f6377fff640 1 -- 172.21.15.47:0/3718247626 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562fa862f900 con 0x562fa86d2880 2024-07-24T22:16:25.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f6377fff640 10 client.17454 handle_command_reply: tid=0 2024-07-24T22:16:25.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f63a0f10740 1 client.17454 shutdown 2024-07-24T22:16:25.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f63a0f10740 1 -- 172.21.15.47:0/3718247626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 msgr2=0x562fa86bfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:25.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f63a0f10740 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86bfea0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f638c0e14a0 tx=0x7f638c0aa340 comp rx=0 tx=0).stop 2024-07-24T22:16:25.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f63a0f10740 1 -- 172.21.15.47:0/3718247626 shutdown_connections 2024-07-24T22:16:25.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f63a0f10740 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562fa86d2880 0x562fa86d4c70 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f63a0f10740 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86c2f80 0x562fa86c0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f63a0f10740 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b6ff0 0x562fa86c03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f63a0f10740 1 --2- 172.21.15.47:0/3718247626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86bfea0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f63a0f10740 1 -- 172.21.15.47:0/3718247626 >> 172.21.15.47:0/3718247626 conn(0x562fa86b4500 msgr2=0x562fa86ba0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:25.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f6377fff640 0 client.17454 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:25.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f63a0f10740 1 -- 172.21.15.47:0/3718247626 shutdown_connections 2024-07-24T22:16:25.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f63a0f10740 1 -- 172.21.15.47:0/3718247626 wait complete. 2024-07-24T22:16:25.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.395+0000 7f63a0f10740 20 client.17454 trim_cache size 0 max 16384 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.409+0000 7f63a0f10740 1 Processor -- start 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.409+0000 7f63a0f10740 1 -- start start 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.409+0000 7f63a0f10740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b66d0 0x562fa86ba820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.409+0000 7f63a0f10740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86b6ff0 0x562fa86b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.409+0000 7f63a0f10740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86c2f80 0x562fa86da540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.409+0000 7f63a0f10740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f63981ac270 con 0x562fa86c2f80 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.409+0000 7f63a0f10740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f63981aead0 con 0x562fa86b66d0 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.409+0000 7f63a0f10740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f63981ac8c0 con 0x562fa86b6ff0 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.409+0000 7f639d0fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86c2f80 0x562fa86da540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.409+0000 7f639d0fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86c2f80 0x562fa86da540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46600/0 (socket says 172.21.15.47:46600) 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.409+0000 7f639d0fc640 1 -- 172.21.15.47:0/2529373765 learned_addr learned my addr 172.21.15.47:0/2529373765 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.409+0000 7f6397fff640 1 --2- 172.21.15.47:0/2529373765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86b6ff0 0x562fa86b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f639c8fb640 1 --2- 172.21.15.47:0/2529373765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b66d0 0x562fa86ba820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f639d0fc640 1 -- 172.21.15.47:0/2529373765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86b6ff0 msgr2=0x562fa86b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f639d0fc640 1 --2- 172.21.15.47:0/2529373765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86b6ff0 0x562fa86b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f639d0fc640 1 -- 172.21.15.47:0/2529373765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b66d0 msgr2=0x562fa86ba820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f639d0fc640 1 --2- 172.21.15.47:0/2529373765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b66d0 0x562fa86ba820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f639d0fc640 1 -- 172.21.15.47:0/2529373765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fa86be3a0 con 0x562fa86c2f80 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f6397fff640 1 --2- 172.21.15.47:0/2529373765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86b6ff0 0x562fa86b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f639c8fb640 1 --2- 172.21.15.47:0/2529373765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b66d0 0x562fa86ba820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f639d0fc640 1 --2- 172.21.15.47:0/2529373765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86c2f80 0x562fa86da540 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f6390009ca0 tx=0x7f6390050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a018fa7f0f72cf3 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f63827fc640 1 -- 172.21.15.47:0/2529373765 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639004d040 con 0x562fa86c2f80 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f63827fc640 1 -- 172.21.15.47:0/2529373765 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f639005b070 con 0x562fa86c2f80 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f63827fc640 1 -- 172.21.15.47:0/2529373765 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390003fe0 con 0x562fa86c2f80 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f63a0f10740 1 -- 172.21.15.47:0/2529373765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86c2f80 msgr2=0x562fa86da540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.410+0000 7f63a0f10740 1 --2- 172.21.15.47:0/2529373765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86c2f80 0x562fa86da540 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f6390009ca0 tx=0x7f6390050000 comp rx=0 tx=0).stop 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 -- 172.21.15.47:0/2529373765 shutdown_connections 2024-07-24T22:16:25.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 --2- 172.21.15.47:0/2529373765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86c2f80 0x562fa86da540 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 --2- 172.21.15.47:0/2529373765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86b6ff0 0x562fa86b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 --2- 172.21.15.47:0/2529373765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86b66d0 0x562fa86ba820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 -- 172.21.15.47:0/2529373765 >> 172.21.15.47:0/2529373765 conn(0x562fa86b4500 msgr2=0x562fa86c1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 -- 172.21.15.47:0/2529373765 shutdown_connections 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 -- 172.21.15.47:0/2529373765 wait complete. 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 -- start start 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 Processor -- start 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86c6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86b6ff0 0x562fa86c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86c2f80 0x562fa873f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f63981acf90 con 0x562fa86b66d0 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f63981ae400 con 0x562fa86c2f80 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f63981ad660 con 0x562fa86b6ff0 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f63a0f10740 10 client.0 _ll_register_callbacks cb 0x7f638c00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.411+0000 7f639c8fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f639c8fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46614/0 (socket says 172.21.15.47:46614) 2024-07-24T22:16:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f639c8fb640 1 -- 172.21.15.47:0/211389787 learned_addr learned my addr 172.21.15.47:0/211389787 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f639d0fc640 1 --2- 172.21.15.47:0/211389787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86c2f80 0x562fa873f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f639c8fb640 1 -- 172.21.15.47:0/211389787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86b6ff0 msgr2=0x562fa86c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f639c8fb640 1 --2- 172.21.15.47:0/211389787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86b6ff0 0x562fa86c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f639c8fb640 1 -- 172.21.15.47:0/211389787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86c2f80 msgr2=0x562fa873f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f639c8fb640 1 --2- 172.21.15.47:0/211389787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86c2f80 0x562fa873f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f639c8fb640 1 -- 172.21.15.47:0/211389787 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fa873fe50 con 0x562fa86b66d0 2024-07-24T22:16:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f639d0fc640 1 --2- 172.21.15.47:0/211389787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86c2f80 0x562fa873f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f639c8fb640 1 --2- 172.21.15.47:0/211389787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86c6290 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f638c0b1660 tx=0x7f638c0aa7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb673a3cdea7d03c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f6377fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f6377fff640 1 -- 172.21.15.47:0/211389787 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c020030 con 0x562fa86b66d0 2024-07-24T22:16:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f6377fff640 1 -- 172.21.15.47:0/211389787 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7f638c0a6ef0 con 0x562fa86b66d0 2024-07-24T22:16:25.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f63a0f10740 1 -- 172.21.15.47:0/211389787 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f639005b070 con 0x562fa86b66d0 2024-07-24T22:16:25.433 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:16:25.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f6377fff640 1 -- 172.21.15.47:0/211389787 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f638c0ab000 con 0x562fa86b66d0 2024-07-24T22:16:25.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f63a0f10740 10 client.17460 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:25.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f63a0f10740 1 -- 172.21.15.47:0/211389787 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562fa8741070 con 0x562fa86b66d0 2024-07-24T22:16:25.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.412+0000 7f6377fff640 1 -- 172.21.15.47:0/211389787 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f639005b070 con 0x562fa86b66d0 2024-07-24T22:16:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.413+0000 7f6377fff640 1 -- 172.21.15.47:0/211389787 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f638c0e1b90 con 0x562fa86b66d0 2024-07-24T22:16:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.413+0000 7f63a0f10740 10 client.17460 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.413+0000 7f63a0f10740 10 client.17460 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.413+0000 7f63a0f10740 20 client.17460 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.413+0000 7f63a0f10740 1 --2- 172.21.15.47:0/211389787 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562fa8741630 0x562fa8743a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.413+0000 7f63a0f10740 4 client.17460 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:16:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.413+0000 7f63a0f10740 1 -- 172.21.15.47:0/211389787 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562fa862b3a0 con 0x562fa8741630 2024-07-24T22:16:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.413+0000 7f6397fff640 1 --2- 172.21.15.47:0/211389787 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562fa8741630 0x562fa8743a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.413+0000 7f6397fff640 1 --2- 172.21.15.47:0/211389787 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562fa8741630 0x562fa8743a50 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f1bef5ee99288ad server_cookie=ce3eb9e63745d287 in_seq=0 out_seq=0 2024-07-24T22:16:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.413+0000 7f6377fff640 10 client.17460 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.413+0000 7f6377fff640 1 -- 172.21.15.47:0/211389787 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562fa862b3a0 con 0x562fa8741630 2024-07-24T22:16:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.413+0000 7f6377fff640 10 client.17460 handle_command_reply: tid=0 2024-07-24T22:16:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.413+0000 7f63a0f10740 1 client.17460 shutdown 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f63a0f10740 1 -- 172.21.15.47:0/211389787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 msgr2=0x562fa86c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f63a0f10740 1 --2- 172.21.15.47:0/211389787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86c6290 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f638c0b1660 tx=0x7f638c0aa7e0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f63a0f10740 1 -- 172.21.15.47:0/211389787 shutdown_connections 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f63a0f10740 1 --2- 172.21.15.47:0/211389787 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562fa8741630 0x562fa8743a50 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f63a0f10740 1 --2- 172.21.15.47:0/211389787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562fa86c2f80 0x562fa873f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f63a0f10740 1 --2- 172.21.15.47:0/211389787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562fa86b6ff0 0x562fa86c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f63a0f10740 1 --2- 172.21.15.47:0/211389787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562fa86b66d0 0x562fa86c6290 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f6377fff640 0 client.17460 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f63a0f10740 1 -- 172.21.15.47:0/211389787 >> 172.21.15.47:0/211389787 conn(0x562fa86b4500 msgr2=0x562fa86be720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f63a0f10740 1 -- 172.21.15.47:0/211389787 shutdown_connections 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f63a0f10740 1 -- 172.21.15.47:0/211389787 wait complete. 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f63a0f10740 20 client.17460 trim_cache size 0 max 16384 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f639eb5f640 1 -- 172.21.15.47:0/672816439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63880b3d40 msgr2=0x7f63880b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f639eb5f640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63880b3d40 0x7f63880b6200 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f639004a000 tx=0x7f639004b000 comp rx=0 tx=0).stop 2024-07-24T22:16:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f639eb5f640 1 -- 172.21.15.47:0/672816439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6398103530 msgr2=0x7f6398198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f639eb5f640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6398103530 0x7f6398198bd0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f638c00d950 tx=0x7f638c00de10 comp rx=0 tx=0).stop 2024-07-24T22:16:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f639eb5f640 1 -- 172.21.15.47:0/672816439 shutdown_connections 2024-07-24T22:16:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f639eb5f640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f63880b3d40 0x7f63880b6200 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f639eb5f640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f639810cae0 0x7f639819e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f639eb5f640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6398103f30 0x7f6398199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f639eb5f640 1 --2- 172.21.15.47:0/672816439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6398103530 0x7f6398198bd0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.414+0000 7f639eb5f640 1 -- 172.21.15.47:0/672816439 >> 172.21.15.47:0/672816439 conn(0x7f63980fd0c0 msgr2=0x7f63980fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.415+0000 7f639eb5f640 1 -- 172.21.15.47:0/672816439 shutdown_connections 2024-07-24T22:16:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:25.415+0000 7f639eb5f640 1 -- 172.21.15.47:0/672816439 wait complete. 2024-07-24T22:16:26.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:25 smithi047 ceph-mon[32551]: pgmap v649: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:16:26.245 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:16:26.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:25 smithi188 ceph-mon[37380]: pgmap v649: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:16:26.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:25 smithi183 ceph-mon[37007]: pgmap v649: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:16:27.244 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:16:27.244 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:16:27.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.943+0000 7fcc52044640 1 -- 172.21.15.47:0/2034649714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4c101b30 msgr2=0x7fcc4c10e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:27.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.943+0000 7fcc52044640 1 --2- 172.21.15.47:0/2034649714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4c101b30 0x7fcc4c10e880 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009900 tx=0x7fcc4002a410 comp rx=0 tx=0).stop 2024-07-24T22:16:27.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.943+0000 7fcc52044640 1 -- 172.21.15.47:0/2034649714 shutdown_connections 2024-07-24T22:16:27.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.943+0000 7fcc52044640 1 --2- 172.21.15.47:0/2034649714 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc4c10edc0 0x7fcc4c1111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.943+0000 7fcc52044640 1 --2- 172.21.15.47:0/2034649714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4c101b30 0x7fcc4c10e880 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.943+0000 7fcc52044640 1 --2- 172.21.15.47:0/2034649714 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc4c101210 0x7fcc4c1015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.943+0000 7fcc52044640 1 -- 172.21.15.47:0/2034649714 >> 172.21.15.47:0/2034649714 conn(0x7fcc4c0fd0c0 msgr2=0x7fcc4c0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:27.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.943+0000 7fcc52044640 1 -- 172.21.15.47:0/2034649714 shutdown_connections 2024-07-24T22:16:27.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.943+0000 7fcc52044640 1 -- 172.21.15.47:0/2034649714 wait complete. 2024-07-24T22:16:27.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.944+0000 7fcc52044640 1 Processor -- start 2024-07-24T22:16:27.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.944+0000 7fcc52044640 1 -- start start 2024-07-24T22:16:27.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc52044640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc4c101210 0x7fcc4c19ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc52044640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc4c101b30 0x7fcc4c19b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc52044640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4c10edc0 0x7fcc4c1a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc52044640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c114990 con 0x7fcc4c10edc0 2024-07-24T22:16:27.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc52044640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c114810 con 0x7fcc4c101b30 2024-07-24T22:16:27.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc52044640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c114b10 con 0x7fcc4c101210 2024-07-24T22:16:27.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc4bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4c10edc0 0x7fcc4c1a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc4c101210 0x7fcc4c19ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc4bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4c10edc0 0x7fcc4c1a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46634/0 (socket says 172.21.15.47:46634) 2024-07-24T22:16:27.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc4bfff640 1 -- 172.21.15.47:0/836109153 learned_addr learned my addr 172.21.15.47:0/836109153 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:27.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc4affd640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc4c101b30 0x7fcc4c19b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/836109153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc4c101b30 msgr2=0x7fcc4c19b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:27.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc4c101b30 0x7fcc4c19b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/836109153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4c10edc0 msgr2=0x7fcc4c1a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:27.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4c10edc0 0x7fcc4c1a0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/836109153 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4c1a0f10 con 0x7fcc4c101210 2024-07-24T22:16:27.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc4bfff640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4c10edc0 0x7fcc4c1a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:16:27.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.945+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc4c101210 0x7fcc4c19ae60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00c970 tx=0x7fcc3c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:27.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.946+0000 7fcc48ff9640 1 -- 172.21.15.47:0/836109153 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c007bb0 con 0x7fcc4c101210 2024-07-24T22:16:27.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.946+0000 7fcc48ff9640 1 -- 172.21.15.47:0/836109153 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc3c007d50 con 0x7fcc4c101210 2024-07-24T22:16:27.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.946+0000 7fcc52044640 1 -- 172.21.15.47:0/836109153 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4c1a1200 con 0x7fcc4c101210 2024-07-24T22:16:27.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.946+0000 7fcc48ff9640 1 -- 172.21.15.47:0/836109153 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c004df0 con 0x7fcc4c101210 2024-07-24T22:16:27.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.946+0000 7fcc52044640 1 -- 172.21.15.47:0/836109153 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc4c1a7a90 con 0x7fcc4c101210 2024-07-24T22:16:27.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.948+0000 7fcc543f5740 1 Processor -- start 2024-07-24T22:16:27.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc543f5740 1 -- start start 2024-07-24T22:16:27.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc543f5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 0x55c750976230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc543f5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c750976b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc543f5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7509825a0 0x55c750984990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc543f5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c7508ec670 con 0x55c750976770 2024-07-24T22:16:27.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc543f5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c7508dbb70 con 0x55c750977cd0 2024-07-24T22:16:27.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc543f5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c7508dfbb0 con 0x55c7509825a0 2024-07-24T22:16:27.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc4affd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7509825a0 0x55c750984990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc4affd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7509825a0 0x55c750984990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:38222/0 (socket says 172.21.15.47:38222) 2024-07-24T22:16:27.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc4affd640 1 -- 172.21.15.47:0/2999219773 learned_addr learned my addr 172.21.15.47:0/2999219773 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:27.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc4bfff640 1 --2- 172.21.15.47:0/2999219773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 0x55c750976230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc48ff9640 1 -- 172.21.15.47:0/836109153 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fcc3c005000 con 0x7fcc4c101210 2024-07-24T22:16:27.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc4affd640 1 -- 172.21.15.47:0/2999219773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 msgr2=0x55c750976230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:27.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc4affd640 1 --2- 172.21.15.47:0/2999219773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 0x55c750976230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc4affd640 1 -- 172.21.15.47:0/2999219773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 msgr2=0x55c750976b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:27.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc4affd640 1 --2- 172.21.15.47:0/2999219773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c750976b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc4affd640 1 -- 172.21.15.47:0/2999219773 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c750873d30 con 0x55c7509825a0 2024-07-24T22:16:27.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.949+0000 7fcc4bfff640 1 --2- 172.21.15.47:0/2999219773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 0x55c750976230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:27.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.950+0000 7fcc4affd640 1 --2- 172.21.15.47:0/2999219773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7509825a0 0x55c750984990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009230 tx=0x7fcc40004180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0f40ef88a3946a0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:27.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.950+0000 7fcc31ffb640 1 -- 172.21.15.47:0/2999219773 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40035040 con 0x55c7509825a0 2024-07-24T22:16:27.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.950+0000 7fcc31ffb640 1 -- 172.21.15.47:0/2999219773 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc400054f0 con 0x55c7509825a0 2024-07-24T22:16:27.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.950+0000 7fcc31ffb640 1 -- 172.21.15.47:0/2999219773 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40003850 con 0x55c7509825a0 2024-07-24T22:16:27.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.950+0000 7fcc48ff9640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcc340b3dc0 0x7fcc340b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.950+0000 7fcc4bfff640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcc340b3dc0 0x7fcc340b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.951+0000 7fcc543f5740 1 -- 172.21.15.47:0/2999219773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7509825a0 msgr2=0x55c750984990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:27.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.951+0000 7fcc543f5740 1 --2- 172.21.15.47:0/2999219773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7509825a0 0x55c750984990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009230 tx=0x7fcc40004180 comp rx=0 tx=0).stop 2024-07-24T22:16:27.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.951+0000 7fcc48ff9640 1 -- 172.21.15.47:0/836109153 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7fcc3c0e3bf0 con 0x7fcc4c101210 2024-07-24T22:16:27.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.951+0000 7fcc543f5740 1 -- 172.21.15.47:0/2999219773 shutdown_connections 2024-07-24T22:16:27.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.951+0000 7fcc543f5740 1 --2- 172.21.15.47:0/2999219773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7509825a0 0x55c750984990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.951+0000 7fcc543f5740 1 --2- 172.21.15.47:0/2999219773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c750976b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.951+0000 7fcc543f5740 1 --2- 172.21.15.47:0/2999219773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 0x55c750976230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.951+0000 7fcc543f5740 1 -- 172.21.15.47:0/2999219773 >> 172.21.15.47:0/2999219773 conn(0x55c750940720 msgr2=0x55c750974060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:27.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.951+0000 7fcc4bfff640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcc340b3dc0 0x7fcc340b6280 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcc440119d0 tx=0x7fcc44009500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:27.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.951+0000 7fcc543f5740 1 -- 172.21.15.47:0/2999219773 shutdown_connections 2024-07-24T22:16:27.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.951+0000 7fcc543f5740 1 -- 172.21.15.47:0/2999219773 wait complete. 2024-07-24T22:16:27.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.952+0000 7fcc543f5740 1 -- start start 2024-07-24T22:16:27.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.952+0000 7fcc543f5740 1 Processor -- start 2024-07-24T22:16:27.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.952+0000 7fcc543f5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c75097f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.952+0000 7fcc543f5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c750977cd0 0x55c75097fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.952+0000 7fcc543f5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c7509825a0 0x55c750980050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.952+0000 7fcc543f5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c75073f7a0 con 0x55c750976770 2024-07-24T22:16:27.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.952+0000 7fcc543f5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c75087dff0 con 0x55c7509825a0 2024-07-24T22:16:27.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.952+0000 7fcc543f5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c750985400 con 0x55c750977cd0 2024-07-24T22:16:27.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c75097f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c75097f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46644/0 (socket says 172.21.15.47:46644) 2024-07-24T22:16:27.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/4056506703 learned_addr learned my addr 172.21.15.47:0/4056506703 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:27.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc543f5740 10 client.0 _ll_register_callbacks cb 0x55c7505e9090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:27.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc4affd640 1 --2- 172.21.15.47:0/4056506703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c750977cd0 0x55c75097fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc4bfff640 1 --2- 172.21.15.47:0/4056506703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c7509825a0 0x55c750980050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/4056506703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c750977cd0 msgr2=0x55c75097fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:27.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/4056506703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c750977cd0 0x55c75097fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/4056506703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c7509825a0 msgr2=0x55c750980050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:27.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/4056506703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c7509825a0 0x55c750980050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/4056506703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7508820a0 con 0x55c750976770 2024-07-24T22:16:27.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/4056506703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c75097f5d0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0e18e0 tx=0x7fcc3c0aa260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3761193731f96ca6 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:27.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc2affd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:27.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc2affd640 1 -- 172.21.15.47:0/4056506703 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c01d070 con 0x55c750976770 2024-07-24T22:16:27.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc2affd640 1 -- 172.21.15.47:0/4056506703 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7fcc3c0cd2d0 con 0x55c750976770 2024-07-24T22:16:27.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc543f5740 1 -- 172.21.15.47:0/4056506703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc400054f0 con 0x55c750976770 2024-07-24T22:16:27.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.953+0000 7fcc2affd640 1 -- 172.21.15.47:0/4056506703 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcc3c0aa850 con 0x55c750976770 2024-07-24T22:16:27.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.954+0000 7fcc543f5740 10 client.17469 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:27.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.954+0000 7fcc543f5740 1 -- 172.21.15.47:0/4056506703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c75064bb90 con 0x55c750976770 2024-07-24T22:16:27.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.954+0000 7fcc2affd640 1 -- 172.21.15.47:0/4056506703 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc400054f0 con 0x55c750976770 2024-07-24T22:16:27.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.954+0000 7fcc2affd640 1 -- 172.21.15.47:0/4056506703 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcc3c0a61c0 con 0x55c750976770 2024-07-24T22:16:27.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.954+0000 7fcc543f5740 10 client.17469 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:27.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.954+0000 7fcc543f5740 10 client.17469 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:16:27.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.954+0000 7fcc543f5740 20 client.17469 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:27.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.954+0000 7fcc543f5740 1 --2- 172.21.15.47:0/4056506703 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c750992580 0x55c750994970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.954+0000 7fcc543f5740 4 client.17469 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:16:27.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.954+0000 7fcc543f5740 1 -- 172.21.15.47:0/4056506703 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7508ee5c0 con 0x55c750992580 2024-07-24T22:16:27.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.955+0000 7fcc4affd640 1 --2- 172.21.15.47:0/4056506703 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c750992580 0x55c750994970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.955+0000 7fcc4affd640 1 --2- 172.21.15.47:0/4056506703 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c750992580 0x55c750994970 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea264cf9c879aeef server_cookie=5ae97bd141db62e9 in_seq=0 out_seq=0 2024-07-24T22:16:27.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.955+0000 7fcc2affd640 10 client.17469 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:27.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc2affd640 1 -- 172.21.15.47:0/4056506703 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c7508ee5c0 con 0x55c750992580 2024-07-24T22:16:27.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc2affd640 10 client.17469 handle_command_reply: tid=0 2024-07-24T22:16:27.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc543f5740 1 client.17469 shutdown 2024-07-24T22:16:27.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc543f5740 1 -- 172.21.15.47:0/4056506703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 msgr2=0x55c75097f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:27.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc543f5740 1 --2- 172.21.15.47:0/4056506703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c75097f5d0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0e18e0 tx=0x7fcc3c0aa260 comp rx=0 tx=0).stop 2024-07-24T22:16:27.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc543f5740 1 -- 172.21.15.47:0/4056506703 shutdown_connections 2024-07-24T22:16:27.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc543f5740 1 --2- 172.21.15.47:0/4056506703 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c750992580 0x55c750994970 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc543f5740 1 --2- 172.21.15.47:0/4056506703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c7509825a0 0x55c750980050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc543f5740 1 --2- 172.21.15.47:0/4056506703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c750977cd0 0x55c75097fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc543f5740 1 --2- 172.21.15.47:0/4056506703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c75097f5d0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc2affd640 0 client.17469 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:27.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc543f5740 1 -- 172.21.15.47:0/4056506703 >> 172.21.15.47:0/4056506703 conn(0x55c750940720 msgr2=0x55c750979c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:27.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc543f5740 1 -- 172.21.15.47:0/4056506703 shutdown_connections 2024-07-24T22:16:27.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc543f5740 1 -- 172.21.15.47:0/4056506703 wait complete. 2024-07-24T22:16:27.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.956+0000 7fcc543f5740 20 client.17469 trim_cache size 0 max 16384 2024-07-24T22:16:27.979 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:16:27.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.975+0000 7fcc543f5740 1 Processor -- start 2024-07-24T22:16:27.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.975+0000 7fcc543f5740 1 -- start start 2024-07-24T22:16:27.980 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:27 smithi047 ceph-mon[32551]: pgmap v650: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:16:27.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc543f5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c750976770 0x55c750975f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc543f5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 0x55c750974110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc543f5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c7509825a0 0x55c750978810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc543f5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c1ae390 con 0x55c7509825a0 2024-07-24T22:16:27.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc543f5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c1b0bf0 con 0x55c750977cd0 2024-07-24T22:16:27.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc543f5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c1ae9e0 con 0x55c750976770 2024-07-24T22:16:27.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc4bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c7509825a0 0x55c750978810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c750976770 0x55c750975f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c750976770 0x55c750975f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:38246/0 (socket says 172.21.15.47:38246) 2024-07-24T22:16:27.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/3112970959 learned_addr learned my addr 172.21.15.47:0/3112970959 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:27.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc4affd640 1 --2- 172.21.15.47:0/3112970959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 0x55c750974110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/3112970959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 msgr2=0x55c750974110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:27.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/3112970959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 0x55c750974110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/3112970959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c7509825a0 msgr2=0x55c750978810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:27.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/3112970959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c7509825a0 0x55c750978810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.976+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/3112970959 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c75096f990 con 0x55c750976770 2024-07-24T22:16:27.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.977+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/3112970959 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c750976770 0x55c750975f10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c004fd0 tx=0x7fcc3c0aa2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc5cd78495227bea server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:27.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.977+0000 7fcc317fa640 1 -- 172.21.15.47:0/3112970959 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c01d070 con 0x55c750976770 2024-07-24T22:16:27.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.977+0000 7fcc317fa640 1 -- 172.21.15.47:0/3112970959 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc3c0aeda0 con 0x55c750976770 2024-07-24T22:16:27.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.977+0000 7fcc317fa640 1 -- 172.21.15.47:0/3112970959 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c0a61c0 con 0x55c750976770 2024-07-24T22:16:27.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.978+0000 7fcc543f5740 1 -- 172.21.15.47:0/3112970959 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c750976770 msgr2=0x55c750975f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:27.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.978+0000 7fcc543f5740 1 --2- 172.21.15.47:0/3112970959 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c750976770 0x55c750975f10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c004fd0 tx=0x7fcc3c0aa2d0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.978+0000 7fcc543f5740 1 -- 172.21.15.47:0/3112970959 shutdown_connections 2024-07-24T22:16:27.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.978+0000 7fcc543f5740 1 --2- 172.21.15.47:0/3112970959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c7509825a0 0x55c750978810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.978+0000 7fcc543f5740 1 --2- 172.21.15.47:0/3112970959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 0x55c750974110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.978+0000 7fcc543f5740 1 --2- 172.21.15.47:0/3112970959 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c750976770 0x55c750975f10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.978+0000 7fcc543f5740 1 -- 172.21.15.47:0/3112970959 >> 172.21.15.47:0/3112970959 conn(0x55c750940720 msgr2=0x55c750978100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:27.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.978+0000 7fcc543f5740 1 -- 172.21.15.47:0/3112970959 shutdown_connections 2024-07-24T22:16:27.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.978+0000 7fcc543f5740 1 -- 172.21.15.47:0/3112970959 wait complete. 2024-07-24T22:16:27.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.978+0000 7fcc543f5740 1 -- start start 2024-07-24T22:16:27.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.978+0000 7fcc543f5740 1 Processor -- start 2024-07-24T22:16:27.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc543f5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c75098a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc543f5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 0x55c75098adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc543f5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7509825a0 0x55c750985650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc543f5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c1af0b0 con 0x55c750976770 2024-07-24T22:16:27.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc543f5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c1b0520 con 0x55c750977cd0 2024-07-24T22:16:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc543f5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c1af780 con 0x55c7509825a0 2024-07-24T22:16:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc543f5740 10 client.0 _ll_register_callbacks cb 0x7fcc3c00a470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c75098a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc4bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7509825a0 0x55c750985650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c75098a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46672/0 (socket says 172.21.15.47:46672) 2024-07-24T22:16:27.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/3036829635 learned_addr learned my addr 172.21.15.47:0/3036829635 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:27.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc4affd640 1 --2- 172.21.15.47:0/3036829635 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 0x55c75098adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc4bfff640 1 -- 172.21.15.47:0/3036829635 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 msgr2=0x55c75098adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:27.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc4bfff640 1 --2- 172.21.15.47:0/3036829635 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 0x55c75098adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc4bfff640 1 -- 172.21.15.47:0/3036829635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 msgr2=0x55c75098a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:27.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc4bfff640 1 --2- 172.21.15.47:0/3036829635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c75098a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.979+0000 7fcc4bfff640 1 -- 172.21.15.47:0/3036829635 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c750985e80 con 0x55c7509825a0 2024-07-24T22:16:27.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.980+0000 7fcc4bfff640 1 --2- 172.21.15.47:0/3036829635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7509825a0 0x55c750985650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcc440117b0 tx=0x7fcc44004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e92d4c2b9531372 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:27.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.980+0000 7fcc2affd640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:16:27.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.980+0000 7fcc2affd640 1 -- 172.21.15.47:0/3036829635 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44003e00 con 0x55c7509825a0 2024-07-24T22:16:27.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.980+0000 7fcc2affd640 1 -- 172.21.15.47:0/3036829635 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8609+0+0 (secure 0 0 0) 0x7fcc44004730 con 0x55c7509825a0 2024-07-24T22:16:27.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.980+0000 7fcc543f5740 1 -- 172.21.15.47:0/3036829635 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc3c0aeda0 con 0x55c7509825a0 2024-07-24T22:16:27.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.980+0000 7fcc2affd640 1 -- 172.21.15.47:0/3036829635 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcc44004b20 con 0x55c7509825a0 2024-07-24T22:16:27.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.980+0000 7fcc543f5740 10 client.26629 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:27.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.980+0000 7fcc543f5740 1 -- 172.21.15.47:0/3036829635 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c7509fdd20 con 0x55c7509825a0 2024-07-24T22:16:27.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.981+0000 7fcc2affd640 1 -- 172.21.15.47:0/3036829635 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc44004cc0 con 0x55c7509825a0 2024-07-24T22:16:27.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.981+0000 7fcc2affd640 1 -- 172.21.15.47:0/3036829635 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcc44010430 con 0x55c7509825a0 2024-07-24T22:16:27.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.981+0000 7fcc543f5740 10 client.26629 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:27.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.981+0000 7fcc543f5740 10 client.26629 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:16:27.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.981+0000 7fcc543f5740 20 client.26629 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:27.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.981+0000 7fcc543f5740 1 --2- 172.21.15.47:0/3036829635 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c7509fe5c0 0x55c750a009e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:27.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.981+0000 7fcc543f5740 4 client.26629 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.3, "await_for": 45.0}] 2024-07-24T22:16:27.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.981+0000 7fcc543f5740 1 -- 172.21.15.47:0/3036829635 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.3, "await_for": 45.0}) -- 0x7fcc3c0aeda0 con 0x55c7509fe5c0 2024-07-24T22:16:27.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.981+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/3036829635 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c7509fe5c0 0x55c750a009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:27.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.982+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/3036829635 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c7509fe5c0 0x55c750a009e0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c0bbb365c32c8bd server_cookie=7fe21b95ab7b453 in_seq=0 out_seq=0 2024-07-24T22:16:27.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.982+0000 7fcc2affd640 10 client.26629 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:27.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.990+0000 7fcc2affd640 1 -- 172.21.15.47:0/3036829635 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fcc3c0aeda0 con 0x55c7509fe5c0 2024-07-24T22:16:27.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.990+0000 7fcc2affd640 10 client.26629 handle_command_reply: tid=0 2024-07-24T22:16:27.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.990+0000 7fcc543f5740 1 client.26629 shutdown 2024-07-24T22:16:27.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.991+0000 7fcc543f5740 1 -- 172.21.15.47:0/3036829635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7509825a0 msgr2=0x55c750985650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:27.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.991+0000 7fcc543f5740 1 --2- 172.21.15.47:0/3036829635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7509825a0 0x55c750985650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcc440117b0 tx=0x7fcc44004a40 comp rx=0 tx=0).stop 2024-07-24T22:16:27.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.991+0000 7fcc543f5740 1 -- 172.21.15.47:0/3036829635 shutdown_connections 2024-07-24T22:16:27.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.991+0000 7fcc543f5740 1 --2- 172.21.15.47:0/3036829635 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c7509fe5c0 0x55c750a009e0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.991+0000 7fcc543f5740 1 --2- 172.21.15.47:0/3036829635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7509825a0 0x55c750985650 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.991+0000 7fcc543f5740 1 --2- 172.21.15.47:0/3036829635 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c750977cd0 0x55c75098adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.991+0000 7fcc543f5740 1 --2- 172.21.15.47:0/3036829635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c750976770 0x55c75098a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:27.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.991+0000 7fcc543f5740 1 -- 172.21.15.47:0/3036829635 >> 172.21.15.47:0/3036829635 conn(0x55c750940720 msgr2=0x55c75098dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:27.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.991+0000 7fcc2affd640 0 client.26629 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:27.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.991+0000 7fcc543f5740 1 -- 172.21.15.47:0/3036829635 shutdown_connections 2024-07-24T22:16:27.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.991+0000 7fcc543f5740 1 -- 172.21.15.47:0/3036829635 wait complete. 2024-07-24T22:16:27.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.991+0000 7fcc543f5740 20 client.26629 trim_cache size 0 max 16384 2024-07-24T22:16:27.997 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:16:27.998 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:16:27.998 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:16:27.998 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 26, 2024-07-24T22:16:27.998 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:16:27.998 INFO:teuthology.orchestra.run.smithi047.stdout: "d00c7dd7": { 2024-07-24T22:16:27.998 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 26, 2024-07-24T22:16:27.998 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:16:27.998 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:16:27.998 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:16:27.999 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:16:27.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:16:27.999 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:16:27.999 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 141.3, 2024-07-24T22:16:27.999 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:16:27.999 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:16:27.999 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:16:27.999 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:16:28.000 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:16:28.000 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:16:28.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:16:28.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:16:28.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:16:28.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:16:28.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:16:28.000 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:16:28.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.992+0000 7fcc52044640 1 -- 172.21.15.47:0/836109153 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcc340b3dc0 msgr2=0x7fcc340b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:28.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.992+0000 7fcc52044640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcc340b3dc0 0x7fcc340b6280 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcc440119d0 tx=0x7fcc44009500 comp rx=0 tx=0).stop 2024-07-24T22:16:28.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.992+0000 7fcc52044640 1 -- 172.21.15.47:0/836109153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc4c101210 msgr2=0x7fcc4c19ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:28.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.992+0000 7fcc52044640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc4c101210 0x7fcc4c19ae60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00c970 tx=0x7fcc3c00ce30 comp rx=0 tx=0).stop 2024-07-24T22:16:28.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.992+0000 7fcc52044640 1 -- 172.21.15.47:0/836109153 shutdown_connections 2024-07-24T22:16:28.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.992+0000 7fcc52044640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcc340b3dc0 0x7fcc340b6280 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:28.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.992+0000 7fcc52044640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4c10edc0 0x7fcc4c1a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:28.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.992+0000 7fcc52044640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc4c101b30 0x7fcc4c19b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:28.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.992+0000 7fcc52044640 1 --2- 172.21.15.47:0/836109153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc4c101210 0x7fcc4c19ae60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:28.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.992+0000 7fcc52044640 1 -- 172.21.15.47:0/836109153 >> 172.21.15.47:0/836109153 conn(0x7fcc4c0fd0c0 msgr2=0x7fcc4c110fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:28.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.992+0000 7fcc52044640 1 -- 172.21.15.47:0/836109153 shutdown_connections 2024-07-24T22:16:28.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:27.992+0000 7fcc52044640 1 -- 172.21.15.47:0/836109153 wait complete. 2024-07-24T22:16:28.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:27 smithi188 ceph-mon[37380]: pgmap v650: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:16:28.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:27 smithi183 ceph-mon[37007]: pgmap v650: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:16:28.857 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd00c7dd7', quiesce took 9.6 seconds. Will release after: 11.700000000000001 2024-07-24T22:16:30.117 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:29 smithi047 ceph-mon[32551]: pgmap v651: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:16:30.117 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:29 smithi047 ceph-mon[32551]: osdmap e93: 12 total, 12 up, 12 in 2024-07-24T22:16:30.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:29 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:30.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:29 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:30.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:29 smithi188 ceph-mon[37380]: pgmap v651: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:16:30.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:29 smithi188 ceph-mon[37380]: osdmap e93: 12 total, 12 up, 12 in 2024-07-24T22:16:30.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:29 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:30.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:29 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:30.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.355+0000 7f33059ef640 1 -- 172.21.15.47:0/2436165652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3300101650 msgr2=0x7f3300101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:30.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.355+0000 7f33059ef640 1 --2- 172.21.15.47:0/2436165652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3300101650 0x7f3300101a30 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f32f0009ca0 tx=0x7f32f002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.355+0000 7f33059ef640 1 -- 172.21.15.47:0/2436165652 shutdown_connections 2024-07-24T22:16:30.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.355+0000 7f33059ef640 1 --2- 172.21.15.47:0/2436165652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33001079e0 0x7f330010e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.355+0000 7f33059ef640 1 --2- 172.21.15.47:0/2436165652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3300107060 0x7f33001074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.355+0000 7f33059ef640 1 --2- 172.21.15.47:0/2436165652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3300101650 0x7f3300101a30 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.355+0000 7f33059ef640 1 -- 172.21.15.47:0/2436165652 >> 172.21.15.47:0/2436165652 conn(0x7f33000fd0c0 msgr2=0x7f33000ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:30.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.355+0000 7f33059ef640 1 -- 172.21.15.47:0/2436165652 shutdown_connections 2024-07-24T22:16:30.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.355+0000 7f33059ef640 1 -- 172.21.15.47:0/2436165652 wait complete. 2024-07-24T22:16:30.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.355+0000 7f33059ef640 1 Processor -- start 2024-07-24T22:16:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f33059ef640 1 -- start start 2024-07-24T22:16:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f33059ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3300101650 0x7f33000fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f33059ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3300107060 0x7f33000fdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f33059ef640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33001079e0 0x7f33000fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f33059ef640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3300111610 con 0x7f3300107060 2024-07-24T22:16:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f33059ef640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3300111490 con 0x7f33001079e0 2024-07-24T22:16:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f33059ef640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3300111790 con 0x7f3300101650 2024-07-24T22:16:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f32fe7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3300107060 0x7f33000fdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f32fe7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3300107060 0x7f33000fdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46686/0 (socket says 172.21.15.47:46686) 2024-07-24T22:16:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f32fe7fc640 1 -- 172.21.15.47:0/1812218453 learned_addr learned my addr 172.21.15.47:0/1812218453 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f32ff7fe640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33001079e0 0x7f33000fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f32feffd640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3300101650 0x7f33000fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f32fe7fc640 1 -- 172.21.15.47:0/1812218453 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3300101650 msgr2=0x7f33000fd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:30.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f32fe7fc640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3300101650 0x7f33000fd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f32fe7fc640 1 -- 172.21.15.47:0/1812218453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33001079e0 msgr2=0x7f33000fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:30.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f32fe7fc640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33001079e0 0x7f33000fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.356+0000 7f32fe7fc640 1 -- 172.21.15.47:0/1812218453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33001a7070 con 0x7f3300107060 2024-07-24T22:16:30.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.357+0000 7f32fe7fc640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3300107060 0x7f33000fdb00 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f32f400d770 tx=0x7f32f400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:30.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.357+0000 7f33049ed640 1 -- 172.21.15.47:0/1812218453 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4017070 con 0x7f3300107060 2024-07-24T22:16:30.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.357+0000 7f33059ef640 1 -- 172.21.15.47:0/1812218453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33001a7360 con 0x7f3300107060 2024-07-24T22:16:30.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.357+0000 7f33049ed640 1 -- 172.21.15.47:0/1812218453 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32f40054d0 con 0x7f3300107060 2024-07-24T22:16:30.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.357+0000 7f33049ed640 1 -- 172.21.15.47:0/1812218453 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4004c30 con 0x7f3300107060 2024-07-24T22:16:30.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.358+0000 7f33059ef640 1 -- 172.21.15.47:0/1812218453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33001a78a0 con 0x7f3300107060 2024-07-24T22:16:30.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.359+0000 7f33049ed640 1 -- 172.21.15.47:0/1812218453 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f32f4004e10 con 0x7f3300107060 2024-07-24T22:16:30.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.360+0000 7f3307da0740 1 Processor -- start 2024-07-24T22:16:30.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.360+0000 7f3307da0740 1 -- start start 2024-07-24T22:16:30.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f33049ed640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f32e80b3dc0 0x7f32e80b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f3307da0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905dff20 0x5631905e0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f3307da0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 0x5631905ec290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f3307da0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631905eebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f3307da0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5631905579f0 con 0x5631905ec7d0 2024-07-24T22:16:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f3307da0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x563190546ef0 con 0x5631905dff20 2024-07-24T22:16:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f3307da0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56319054af30 con 0x5631905e0840 2024-07-24T22:16:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f32ff7fe640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f32e80b3dc0 0x7f32e80b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f33049ed640 1 -- 172.21.15.47:0/1812218453 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f32f40e39e0 con 0x7f3300107060 2024-07-24T22:16:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f32feffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905dff20 0x5631905e0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631905eebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f32feffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905dff20 0x5631905e0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:48072/0 (socket says 172.21.15.47:48072) 2024-07-24T22:16:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f32feffd640 1 -- 172.21.15.47:0/319911660 learned_addr learned my addr 172.21.15.47:0/319911660 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f32fe7fc640 1 --2- 172.21.15.47:0/319911660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 0x5631905ec290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f32feffd640 1 -- 172.21.15.47:0/319911660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 msgr2=0x5631905ec290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f32feffd640 1 --2- 172.21.15.47:0/319911660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 0x5631905ec290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f32feffd640 1 -- 172.21.15.47:0/319911660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 msgr2=0x5631905eebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:30.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f32feffd640 1 --2- 172.21.15.47:0/319911660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631905eebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f32feffd640 1 -- 172.21.15.47:0/319911660 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631902a7930 con 0x5631905dff20 2024-07-24T22:16:30.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.361+0000 7f32fe7fc640 1 --2- 172.21.15.47:0/319911660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 0x5631905ec290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:30.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.362+0000 7f32ff7fe640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f32e80b3dc0 0x7f32e80b6280 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f32f800b590 tx=0x7f32f800baa0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:30.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.362+0000 7f32feffd640 1 --2- 172.21.15.47:0/319911660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905dff20 0x5631905e0300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f32f0009ca0 tx=0x7f32f00098b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f27919058ed2d6f1 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:30.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.362+0000 7f32e5ffb640 1 -- 172.21.15.47:0/319911660 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0031e30 con 0x5631905dff20 2024-07-24T22:16:30.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.362+0000 7f32e5ffb640 1 -- 172.21.15.47:0/319911660 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32f0036030 con 0x5631905dff20 2024-07-24T22:16:30.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.362+0000 7f32e5ffb640 1 -- 172.21.15.47:0/319911660 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f00042a0 con 0x5631905dff20 2024-07-24T22:16:30.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.363+0000 7f3307da0740 1 -- 172.21.15.47:0/319911660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905dff20 msgr2=0x5631905e0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:30.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.363+0000 7f3307da0740 1 --2- 172.21.15.47:0/319911660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905dff20 0x5631905e0300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f32f0009ca0 tx=0x7f32f00098b0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.363+0000 7f3307da0740 1 -- 172.21.15.47:0/319911660 shutdown_connections 2024-07-24T22:16:30.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.363+0000 7f3307da0740 1 --2- 172.21.15.47:0/319911660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631905eebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.363+0000 7f3307da0740 1 --2- 172.21.15.47:0/319911660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 0x5631905ec290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.363+0000 7f3307da0740 1 --2- 172.21.15.47:0/319911660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905dff20 0x5631905e0300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.363+0000 7f3307da0740 1 -- 172.21.15.47:0/319911660 >> 172.21.15.47:0/319911660 conn(0x5631905ddd50 msgr2=0x5631905deef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:30.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.363+0000 7f3307da0740 1 -- 172.21.15.47:0/319911660 shutdown_connections 2024-07-24T22:16:30.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.363+0000 7f3307da0740 1 -- 172.21.15.47:0/319911660 wait complete. 2024-07-24T22:16:30.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.363+0000 7f3307da0740 1 -- start start 2024-07-24T22:16:30.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.363+0000 7f3307da0740 1 Processor -- start 2024-07-24T22:16:30.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f3307da0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905dff20 0x5631905e9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f3307da0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905e0840 0x5631905e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f3307da0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631905ea180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f3307da0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5631903aa890 con 0x5631905ec7d0 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f3307da0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5631904e9390 con 0x5631905e0840 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f3307da0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5631905ef270 con 0x5631905dff20 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f3307da0740 10 client.0 _ll_register_callbacks cb 0x5631904f3500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631905ea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631905ea180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46706/0 (socket says 172.21.15.47:46706) 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f32ff7fe640 1 -- 172.21.15.47:0/252410373 learned_addr learned my addr 172.21.15.47:0/252410373 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f32fe7fc640 1 --2- 172.21.15.47:0/252410373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905e0840 0x5631905e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f32feffd640 1 --2- 172.21.15.47:0/252410373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905dff20 0x5631905e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f32ff7fe640 1 -- 172.21.15.47:0/252410373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905dff20 msgr2=0x5631905e9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f32ff7fe640 1 --2- 172.21.15.47:0/252410373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905dff20 0x5631905e9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f32ff7fe640 1 -- 172.21.15.47:0/252410373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905e0840 msgr2=0x5631905e9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:30.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f32ff7fe640 1 --2- 172.21.15.47:0/252410373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905e0840 0x5631905e9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f32ff7fe640 1 -- 172.21.15.47:0/252410373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631904e3d60 con 0x5631905ec7d0 2024-07-24T22:16:30.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f32ff7fe640 1 --2- 172.21.15.47:0/252410373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631905ea180 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f32f8010c90 tx=0x7f32f801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab0694b7ce06f5a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:30.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.364+0000 7f32deffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:30.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f32deffd640 1 -- 172.21.15.47:0/252410373 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8020400 con 0x5631905ec7d0 2024-07-24T22:16:30.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f3307da0740 1 -- 172.21.15.47:0/252410373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32f0036030 con 0x5631905ec7d0 2024-07-24T22:16:30.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f32deffd640 1 -- 172.21.15.47:0/252410373 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f32f80205a0 con 0x5631905ec7d0 2024-07-24T22:16:30.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f32deffd640 1 -- 172.21.15.47:0/252410373 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f32f80207a0 con 0x5631905ec7d0 2024-07-24T22:16:30.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f3307da0740 10 client.17487 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:30.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f3307da0740 1 -- 172.21.15.47:0/252410373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5631905fb170 con 0x5631905ec7d0 2024-07-24T22:16:30.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f32deffd640 1 -- 172.21.15.47:0/252410373 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32f0036030 con 0x5631905ec7d0 2024-07-24T22:16:30.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f32deffd640 1 -- 172.21.15.47:0/252410373 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f32f801f070 con 0x5631905ec7d0 2024-07-24T22:16:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f3307da0740 10 client.17487 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f3307da0740 10 client.17487 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f3307da0740 20 client.17487 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f3307da0740 1 --2- 172.21.15.47:0/252410373 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5631905fc6d0 0x5631905feac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f3307da0740 4 client.17487 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:16:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.365+0000 7f3307da0740 1 -- 172.21.15.47:0/252410373 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563190559940 con 0x5631905fc6d0 2024-07-24T22:16:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.366+0000 7f32feffd640 1 --2- 172.21.15.47:0/252410373 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5631905fc6d0 0x5631905feac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.366+0000 7f32feffd640 1 --2- 172.21.15.47:0/252410373 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5631905fc6d0 0x5631905feac0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e38d61a51fd9643e server_cookie=b6b7c9a25d513916 in_seq=0 out_seq=0 2024-07-24T22:16:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.366+0000 7f32deffd640 10 client.17487 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f32deffd640 1 -- 172.21.15.47:0/252410373 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563190559940 con 0x5631905fc6d0 2024-07-24T22:16:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f32deffd640 10 client.17487 handle_command_reply: tid=0 2024-07-24T22:16:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f3307da0740 1 client.17487 shutdown 2024-07-24T22:16:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f3307da0740 1 -- 172.21.15.47:0/252410373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 msgr2=0x5631905ea180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:30.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f3307da0740 1 --2- 172.21.15.47:0/252410373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631905ea180 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f32f8010c90 tx=0x7f32f801c000 comp rx=0 tx=0).stop 2024-07-24T22:16:30.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f3307da0740 1 -- 172.21.15.47:0/252410373 shutdown_connections 2024-07-24T22:16:30.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f3307da0740 1 --2- 172.21.15.47:0/252410373 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5631905fc6d0 0x5631905feac0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f3307da0740 1 --2- 172.21.15.47:0/252410373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631905ea180 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f3307da0740 1 --2- 172.21.15.47:0/252410373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905e0840 0x5631905e9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f3307da0740 1 --2- 172.21.15.47:0/252410373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905dff20 0x5631905e9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f32deffd640 0 client.17487 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:30.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f3307da0740 1 -- 172.21.15.47:0/252410373 >> 172.21.15.47:0/252410373 conn(0x5631905ddd50 msgr2=0x5631905e38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:30.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f3307da0740 1 -- 172.21.15.47:0/252410373 shutdown_connections 2024-07-24T22:16:30.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f3307da0740 1 -- 172.21.15.47:0/252410373 wait complete. 2024-07-24T22:16:30.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.367+0000 7f3307da0740 20 client.17487 trim_cache size 0 max 16384 2024-07-24T22:16:30.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.386+0000 7f3307da0740 1 Processor -- start 2024-07-24T22:16:30.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.386+0000 7f3307da0740 1 -- start start 2024-07-24T22:16:30.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.386+0000 7f3307da0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905dff20 0x5631905e4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.386+0000 7f3307da0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 0x5631905eb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.386+0000 7f3307da0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631906043d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.386+0000 7f3307da0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f33001ae290 con 0x5631905ec7d0 2024-07-24T22:16:30.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.386+0000 7f3307da0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f33001b0af0 con 0x5631905dff20 2024-07-24T22:16:30.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.386+0000 7f3307da0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f33001ae8e0 con 0x5631905e0840 2024-07-24T22:16:30.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.386+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631906043d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.386+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631906043d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46718/0 (socket says 172.21.15.47:46718) 2024-07-24T22:16:30.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.386+0000 7f32ff7fe640 1 -- 172.21.15.47:0/3039946968 learned_addr learned my addr 172.21.15.47:0/3039946968 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:30.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.386+0000 7f32fe7fc640 1 --2- 172.21.15.47:0/3039946968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 0x5631905eb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.387+0000 7f32feffd640 1 --2- 172.21.15.47:0/3039946968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905dff20 0x5631905e4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.387+0000 7f32ff7fe640 1 -- 172.21.15.47:0/3039946968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 msgr2=0x5631905eb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:30.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.387+0000 7f32ff7fe640 1 --2- 172.21.15.47:0/3039946968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 0x5631905eb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.387+0000 7f32ff7fe640 1 -- 172.21.15.47:0/3039946968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905dff20 msgr2=0x5631905e4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:30.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.387+0000 7f32ff7fe640 1 --2- 172.21.15.47:0/3039946968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905dff20 0x5631905e4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.387+0000 7f32ff7fe640 1 -- 172.21.15.47:0/3039946968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631905e7c00 con 0x5631905ec7d0 2024-07-24T22:16:30.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.387+0000 7f32feffd640 1 --2- 172.21.15.47:0/3039946968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905dff20 0x5631905e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:30.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.387+0000 7f32ff7fe640 1 --2- 172.21.15.47:0/3039946968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631906043d0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f32f801ec80 tx=0x7f32f8010790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611d0048e988da50 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:30.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.387+0000 7f32e57fa640 1 -- 172.21.15.47:0/3039946968 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f800b600 con 0x5631905ec7d0 2024-07-24T22:16:30.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.387+0000 7f32e57fa640 1 -- 172.21.15.47:0/3039946968 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32f8012e50 con 0x5631905ec7d0 2024-07-24T22:16:30.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.387+0000 7f32e57fa640 1 -- 172.21.15.47:0/3039946968 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f80205c0 con 0x5631905ec7d0 2024-07-24T22:16:30.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.388+0000 7f3307da0740 1 -- 172.21.15.47:0/3039946968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 msgr2=0x5631906043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:30.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.388+0000 7f3307da0740 1 --2- 172.21.15.47:0/3039946968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631906043d0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f32f801ec80 tx=0x7f32f8010790 comp rx=0 tx=0).stop 2024-07-24T22:16:30.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.388+0000 7f3307da0740 1 -- 172.21.15.47:0/3039946968 shutdown_connections 2024-07-24T22:16:30.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.388+0000 7f3307da0740 1 --2- 172.21.15.47:0/3039946968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905ec7d0 0x5631906043d0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.388+0000 7f3307da0740 1 --2- 172.21.15.47:0/3039946968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 0x5631905eb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.388+0000 7f3307da0740 1 --2- 172.21.15.47:0/3039946968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905dff20 0x5631905e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.388+0000 7f3307da0740 1 -- 172.21.15.47:0/3039946968 >> 172.21.15.47:0/3039946968 conn(0x5631905ddd50 msgr2=0x5631905ead30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:30.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.388+0000 7f3307da0740 1 -- 172.21.15.47:0/3039946968 shutdown_connections 2024-07-24T22:16:30.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.388+0000 7f3307da0740 1 -- 172.21.15.47:0/3039946968 wait complete. 2024-07-24T22:16:30.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.388+0000 7f3307da0740 1 -- start start 2024-07-24T22:16:30.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f3307da0740 1 Processor -- start 2024-07-24T22:16:30.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f3307da0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905dff20 0x5631905f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f3307da0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 0x5631905f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f3307da0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905ec7d0 0x5631905f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f3307da0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f33001aefb0 con 0x5631905dff20 2024-07-24T22:16:30.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f3307da0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f33001b0420 con 0x5631905ec7d0 2024-07-24T22:16:30.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f3307da0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f33001af680 con 0x5631905e0840 2024-07-24T22:16:30.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f3307da0740 10 client.0 _ll_register_callbacks cb 0x7f32f8010940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:30.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f32feffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905dff20 0x5631905f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f32feffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905dff20 0x5631905f03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46730/0 (socket says 172.21.15.47:46730) 2024-07-24T22:16:30.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f32feffd640 1 -- 172.21.15.47:0/4127929814 learned_addr learned my addr 172.21.15.47:0/4127929814 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:30.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f32fe7fc640 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 0x5631905f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f32ff7fe640 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905ec7d0 0x5631905f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f32feffd640 1 -- 172.21.15.47:0/4127929814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 msgr2=0x5631905f08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:30.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f32feffd640 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 0x5631905f08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f32feffd640 1 -- 172.21.15.47:0/4127929814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905ec7d0 msgr2=0x5631905f0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:30.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f32feffd640 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905ec7d0 0x5631905f0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f32feffd640 1 -- 172.21.15.47:0/4127929814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563190666450 con 0x5631905dff20 2024-07-24T22:16:30.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.389+0000 7f32ff7fe640 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905ec7d0 0x5631905f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:16:30.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.390+0000 7f32feffd640 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905dff20 0x5631905f03a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f32f0006010 tx=0x7f32f002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d719b2005398d49 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:30.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.390+0000 7f32deffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:30.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.390+0000 7f32deffd640 1 -- 172.21.15.47:0/4127929814 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0031e10 con 0x5631905dff20 2024-07-24T22:16:30.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.390+0000 7f32deffd640 1 -- 172.21.15.47:0/4127929814 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f32f0003970 con 0x5631905dff20 2024-07-24T22:16:30.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.390+0000 7f3307da0740 1 -- 172.21.15.47:0/4127929814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32f8012e50 con 0x5631905dff20 2024-07-24T22:16:30.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.390+0000 7f32deffd640 1 -- 172.21.15.47:0/4127929814 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f32f0003b90 con 0x5631905dff20 2024-07-24T22:16:30.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.390+0000 7f3307da0740 10 client.17493 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:30.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.390+0000 7f3307da0740 1 -- 172.21.15.47:0/4127929814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5631906677d0 con 0x5631905dff20 2024-07-24T22:16:30.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.390+0000 7f32deffd640 1 -- 172.21.15.47:0/4127929814 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32f8012e50 con 0x5631905dff20 2024-07-24T22:16:30.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.391+0000 7f32deffd640 1 -- 172.21.15.47:0/4127929814 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f32f0062070 con 0x5631905dff20 2024-07-24T22:16:30.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.391+0000 7f3307da0740 10 client.17493 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:30.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.391+0000 7f3307da0740 10 client.17493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:30.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.391+0000 7f3307da0740 20 client.17493 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:30.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.391+0000 7f3307da0740 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563190667c70 0x56319066a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:30.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.391+0000 7f3307da0740 4 client.17493 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:16:30.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.391+0000 7f3307da0740 1 -- 172.21.15.47:0/4127929814 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5631905553e0 con 0x563190667c70 2024-07-24T22:16:30.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.391+0000 7f32fe7fc640 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563190667c70 0x56319066a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:30.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.392+0000 7f32fe7fc640 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563190667c70 0x56319066a060 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5adba670a9df208 server_cookie=7cc58c0227c18874 in_seq=0 out_seq=0 2024-07-24T22:16:30.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.392+0000 7f32deffd640 10 client.17493 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:30.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f32deffd640 1 -- 172.21.15.47:0/4127929814 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5631905553e0 con 0x563190667c70 2024-07-24T22:16:30.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f32deffd640 10 client.17493 handle_command_reply: tid=0 2024-07-24T22:16:30.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f3307da0740 1 client.17493 shutdown 2024-07-24T22:16:30.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f3307da0740 1 -- 172.21.15.47:0/4127929814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905dff20 msgr2=0x5631905f03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:30.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f3307da0740 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905dff20 0x5631905f03a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f32f0006010 tx=0x7f32f002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f3307da0740 1 -- 172.21.15.47:0/4127929814 shutdown_connections 2024-07-24T22:16:30.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f3307da0740 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x563190667c70 0x56319066a060 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f32deffd640 0 client.17493 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:30.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f3307da0740 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5631905ec7d0 0x5631905f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f3307da0740 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631905e0840 0x5631905f08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f3307da0740 1 --2- 172.21.15.47:0/4127929814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5631905dff20 0x5631905f03a0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f3307da0740 1 -- 172.21.15.47:0/4127929814 >> 172.21.15.47:0/4127929814 conn(0x5631905ddd50 msgr2=0x5631905eb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:30.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f3307da0740 1 -- 172.21.15.47:0/4127929814 shutdown_connections 2024-07-24T22:16:30.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f3307da0740 1 -- 172.21.15.47:0/4127929814 wait complete. 2024-07-24T22:16:30.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.393+0000 7f3307da0740 20 client.17493 trim_cache size 0 max 16384 2024-07-24T22:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "33f332b9-620e-4c89-9411-4125d7521148", 2024-07-24T22:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:16:30.405 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:16:30.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.394+0000 7f33059ef640 1 -- 172.21.15.47:0/1812218453 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f32e80b3dc0 msgr2=0x7f32e80b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:30.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.394+0000 7f33059ef640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f32e80b3dc0 0x7f32e80b6280 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f32f800b590 tx=0x7f32f800baa0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.394+0000 7f33059ef640 1 -- 172.21.15.47:0/1812218453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3300107060 msgr2=0x7f33000fdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:30.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.394+0000 7f33059ef640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3300107060 0x7f33000fdb00 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f32f400d770 tx=0x7f32f400dc30 comp rx=0 tx=0).stop 2024-07-24T22:16:30.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.394+0000 7f33059ef640 1 -- 172.21.15.47:0/1812218453 shutdown_connections 2024-07-24T22:16:30.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.394+0000 7f33059ef640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f32e80b3dc0 0x7f32e80b6280 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.394+0000 7f33059ef640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33001079e0 0x7f33000fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.394+0000 7f33059ef640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3300107060 0x7f33000fdb00 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.394+0000 7f33059ef640 1 --2- 172.21.15.47:0/1812218453 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3300101650 0x7f33000fd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:30.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.394+0000 7f33059ef640 1 -- 172.21.15.47:0/1812218453 >> 172.21.15.47:0/1812218453 conn(0x7f33000fd0c0 msgr2=0x7f330006a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:30.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.394+0000 7f33059ef640 1 -- 172.21.15.47:0/1812218453 shutdown_connections 2024-07-24T22:16:30.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:30.394+0000 7f33059ef640 1 -- 172.21.15.47:0/1812218453 wait complete. 2024-07-24T22:16:30.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:29 smithi183 ceph-mon[37007]: pgmap v651: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 341 B/s wr, 2 op/s 2024-07-24T22:16:30.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:29 smithi183 ceph-mon[37007]: osdmap e93: 12 total, 12 up, 12 in 2024-07-24T22:16:30.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:29 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:30.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:29 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:31.057 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:16:31.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:16:31.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:16:31.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:31.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:16:31.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:16:31.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:31.313 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:16:31.313 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:16:31.313 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:16:31.323 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:16:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.521+0000 7f2248f9f640 1 -- 172.21.15.47:0/2203781773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22441079e0 msgr2=0x7f224410e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.521+0000 7f2248f9f640 1 --2- 172.21.15.47:0/2203781773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22441079e0 0x7f224410e1e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f223c009ca0 tx=0x7f223c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.521+0000 7f2248f9f640 1 -- 172.21.15.47:0/2203781773 shutdown_connections 2024-07-24T22:16:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.521+0000 7f2248f9f640 1 --2- 172.21.15.47:0/2203781773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22441079e0 0x7f224410e1e0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.521+0000 7f2248f9f640 1 --2- 172.21.15.47:0/2203781773 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2244107060 0x7f22441074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.521+0000 7f2248f9f640 1 --2- 172.21.15.47:0/2203781773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2244101660 0x7f2244101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.521+0000 7f2248f9f640 1 -- 172.21.15.47:0/2203781773 >> 172.21.15.47:0/2203781773 conn(0x7f22440fd0c0 msgr2=0x7f22440ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.521+0000 7f2248f9f640 1 -- 172.21.15.47:0/2203781773 shutdown_connections 2024-07-24T22:16:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.521+0000 7f2248f9f640 1 -- 172.21.15.47:0/2203781773 wait complete. 2024-07-24T22:16:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.522+0000 7f2248f9f640 1 Processor -- start 2024-07-24T22:16:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.522+0000 7f2248f9f640 1 -- start start 2024-07-24T22:16:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.522+0000 7f2248f9f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2244101660 0x7f22440fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.522+0000 7f2248f9f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2244107060 0x7f22440fdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.522+0000 7f2248f9f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22441079e0 0x7f22440fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.522+0000 7f2248f9f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2244111630 con 0x7f2244107060 2024-07-24T22:16:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.522+0000 7f2248f9f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f22441114b0 con 0x7f2244101660 2024-07-24T22:16:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.522+0000 7f2248f9f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f22441117b0 con 0x7f22441079e0 2024-07-24T22:16:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.522+0000 7f223bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2244107060 0x7f22440fdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.522+0000 7f223bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2244107060 0x7f22440fdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46750/0 (socket says 172.21.15.47:46750) 2024-07-24T22:16:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.522+0000 7f223bfff640 1 -- 172.21.15.47:0/2842297768 learned_addr learned my addr 172.21.15.47:0/2842297768 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.523+0000 7f224259c640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2244101660 0x7f22440fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.523+0000 7f2242d9d640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22441079e0 0x7f22440fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.523+0000 7f223bfff640 1 -- 172.21.15.47:0/2842297768 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22441079e0 msgr2=0x7f22440fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.523+0000 7f223bfff640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22441079e0 0x7f22440fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.523+0000 7f223bfff640 1 -- 172.21.15.47:0/2842297768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2244101660 msgr2=0x7f22440fd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.523+0000 7f223bfff640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2244101660 0x7f22440fd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.523+0000 7f223bfff640 1 -- 172.21.15.47:0/2842297768 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22441a70c0 con 0x7f2244107060 2024-07-24T22:16:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.523+0000 7f223bfff640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2244107060 0x7f22440fdb00 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f222c00d770 tx=0x7f222c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.523+0000 7f223b7fe640 1 -- 172.21.15.47:0/2842297768 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c017070 con 0x7f2244107060 2024-07-24T22:16:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.523+0000 7f223b7fe640 1 -- 172.21.15.47:0/2842297768 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f222c0054d0 con 0x7f2244107060 2024-07-24T22:16:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.523+0000 7f2248f9f640 1 -- 172.21.15.47:0/2842297768 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22441a73b0 con 0x7f2244107060 2024-07-24T22:16:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.523+0000 7f223b7fe640 1 -- 172.21.15.47:0/2842297768 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c004c30 con 0x7f2244107060 2024-07-24T22:16:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.523+0000 7f2248f9f640 1 -- 172.21.15.47:0/2842297768 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22441a78b0 con 0x7f2244107060 2024-07-24T22:16:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f224bdcb740 1 Processor -- start 2024-07-24T22:16:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f223b7fe640 1 -- 172.21.15.47:0/2842297768 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f222c004e10 con 0x7f2244107060 2024-07-24T22:16:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f224bdcb740 1 -- start start 2024-07-24T22:16:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f224bdcb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f3c90 0x5588b22f4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f224bdcb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f45b0 0x5588b2300000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f224bdcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 0x5588b2302930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f224bdcb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5588b2269280 con 0x5588b2300540 2024-07-24T22:16:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f224bdcb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5588b2258780 con 0x5588b22f45b0 2024-07-24T22:16:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f224bdcb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5588b225c7c0 con 0x5588b22f3c90 2024-07-24T22:16:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f223bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 0x5588b2302930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f223bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 0x5588b2302930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46752/0 (socket says 172.21.15.47:46752) 2024-07-24T22:16:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f223bfff640 1 -- 172.21.15.47:0/1698141599 learned_addr learned my addr 172.21.15.47:0/1698141599 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f224259c640 1 --2- 172.21.15.47:0/1698141599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f45b0 0x5588b2300000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.526+0000 7f2242d9d640 1 --2- 172.21.15.47:0/1698141599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f3c90 0x5588b22f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.527+0000 7f223bfff640 1 -- 172.21.15.47:0/1698141599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f3c90 msgr2=0x5588b22f4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.527+0000 7f223bfff640 1 --2- 172.21.15.47:0/1698141599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f3c90 0x5588b22f4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.527+0000 7f223bfff640 1 -- 172.21.15.47:0/1698141599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f45b0 msgr2=0x5588b2300000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.527+0000 7f223bfff640 1 --2- 172.21.15.47:0/1698141599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f45b0 0x5588b2300000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.527+0000 7f223bfff640 1 -- 172.21.15.47:0/1698141599 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b1fbc790 con 0x5588b2300540 2024-07-24T22:16:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.527+0000 7f2242d9d640 1 --2- 172.21.15.47:0/1698141599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f3c90 0x5588b22f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.527+0000 7f223b7fe640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f22300b3d40 0x7f22300b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.527+0000 7f223bfff640 1 --2- 172.21.15.47:0/1698141599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 0x5588b2302930 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f222c0e11e0 tx=0x7f222c0ec690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a550548de49a7d4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.527+0000 7f2242d9d640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f22300b3d40 0x7f22300b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.527+0000 7f223b7fe640 1 -- 172.21.15.47:0/2842297768 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f222c0e3b50 con 0x7f2244107060 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.527+0000 7f2238ff9640 1 -- 172.21.15.47:0/1698141599 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c0a65f0 con 0x5588b2300540 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.527+0000 7f2238ff9640 1 -- 172.21.15.47:0/1698141599 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f222c0a4e50 con 0x5588b2300540 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.527+0000 7f2238ff9640 1 -- 172.21.15.47:0/1698141599 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c0a9ea0 con 0x5588b2300540 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.528+0000 7f224bdcb740 1 -- 172.21.15.47:0/1698141599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 msgr2=0x5588b2302930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.528+0000 7f224bdcb740 1 --2- 172.21.15.47:0/1698141599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 0x5588b2302930 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f222c0e11e0 tx=0x7f222c0ec690 comp rx=0 tx=0).stop 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.528+0000 7f2242d9d640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f22300b3d40 0x7f22300b6200 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f223c006010 tx=0x7f223c009360 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.528+0000 7f224bdcb740 1 -- 172.21.15.47:0/1698141599 shutdown_connections 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.528+0000 7f224bdcb740 1 --2- 172.21.15.47:0/1698141599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 0x5588b2302930 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.528+0000 7f224bdcb740 1 --2- 172.21.15.47:0/1698141599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f45b0 0x5588b2300000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.528+0000 7f224bdcb740 1 --2- 172.21.15.47:0/1698141599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f3c90 0x5588b22f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.528+0000 7f224bdcb740 1 -- 172.21.15.47:0/1698141599 >> 172.21.15.47:0/1698141599 conn(0x5588b22f1ac0 msgr2=0x5588b22f2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.528+0000 7f224bdcb740 1 -- 172.21.15.47:0/1698141599 shutdown_connections 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.528+0000 7f224bdcb740 1 -- 172.21.15.47:0/1698141599 wait complete. 2024-07-24T22:16:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.528+0000 7f224bdcb740 1 -- start start 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.528+0000 7f224bdcb740 1 Processor -- start 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224bdcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 0x5588b22ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224bdcb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f45b0 0x5588b22fd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224bdcb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b2300540 0x5588b22fd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224bdcb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5588b2192ab0 con 0x5588b22f3c90 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224bdcb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5588b21e09e0 con 0x5588b22f45b0 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224bdcb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5588b2303220 con 0x5588b2300540 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224bdcb740 10 client.0 _ll_register_callbacks cb 0x5588b1f68a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 0x5588b22ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 0x5588b22ffca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46760/0 (socket says 172.21.15.47:46760) 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224259c640 1 -- 172.21.15.47:0/3660478222 learned_addr learned my addr 172.21.15.47:0/3660478222 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f2242d9d640 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b2300540 0x5588b22fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f223bfff640 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f45b0 0x5588b22fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224259c640 1 -- 172.21.15.47:0/3660478222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b2300540 msgr2=0x5588b22fd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224259c640 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b2300540 0x5588b22fd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224259c640 1 -- 172.21.15.47:0/3660478222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f45b0 msgr2=0x5588b22fd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224259c640 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f45b0 0x5588b22fd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224259c640 1 -- 172.21.15.47:0/3660478222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b2035620 con 0x5588b22f3c90 2024-07-24T22:16:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f223bfff640 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f45b0 0x5588b22fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:16:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f2242d9d640 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b2300540 0x5588b22fd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224259c640 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 0x5588b22ffca0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f223400bad0 tx=0x7f223400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60471d5b3895b84e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f2229ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f2229ffb640 1 -- 172.21.15.47:0/3660478222 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234003e00 con 0x5588b22f3c90 2024-07-24T22:16:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f224bdcb740 1 -- 172.21.15.47:0/3660478222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5588b2207ce0 con 0x5588b22f3c90 2024-07-24T22:16:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.529+0000 7f2229ffb640 1 -- 172.21.15.47:0/3660478222 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f2234005020 con 0x5588b22f3c90 2024-07-24T22:16:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.530+0000 7f2229ffb640 1 -- 172.21.15.47:0/3660478222 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2234005220 con 0x5588b22f3c90 2024-07-24T22:16:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.530+0000 7f224bdcb740 10 client.17505 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.530+0000 7f224bdcb740 1 -- 172.21.15.47:0/3660478222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5588b230ea30 con 0x5588b22f3c90 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.530+0000 7f2229ffb640 1 -- 172.21.15.47:0/3660478222 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5588b2207ce0 con 0x5588b22f3c90 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.530+0000 7f2229ffb640 1 -- 172.21.15.47:0/3660478222 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2234022070 con 0x5588b22f3c90 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.530+0000 7f224bdcb740 10 client.17505 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.530+0000 7f224bdcb740 10 client.17505 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.530+0000 7f224bdcb740 20 client.17505 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.530+0000 7f224bdcb740 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5588b230ff40 0x5588b2312330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.530+0000 7f224bdcb740 4 client.17505 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.530+0000 7f224bdcb740 1 -- 172.21.15.47:0/3660478222 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588b226b1d0 con 0x5588b230ff40 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.530+0000 7f223bfff640 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5588b230ff40 0x5588b2312330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.531+0000 7f223bfff640 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5588b230ff40 0x5588b2312330 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=870805b3a33ed670 server_cookie=93614027ddf36648 in_seq=0 out_seq=0 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.531+0000 7f2229ffb640 10 client.17505 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f2229ffb640 1 -- 172.21.15.47:0/3660478222 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5588b226b1d0 con 0x5588b230ff40 2024-07-24T22:16:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f2229ffb640 10 client.17505 handle_command_reply: tid=0 2024-07-24T22:16:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f224bdcb740 1 client.17505 shutdown 2024-07-24T22:16:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f224bdcb740 1 -- 172.21.15.47:0/3660478222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 msgr2=0x5588b22ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f224bdcb740 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 0x5588b22ffca0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f223400bad0 tx=0x7f223400bf90 comp rx=0 tx=0).stop 2024-07-24T22:16:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f224bdcb740 1 -- 172.21.15.47:0/3660478222 shutdown_connections 2024-07-24T22:16:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f224bdcb740 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5588b230ff40 0x5588b2312330 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f224bdcb740 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b2300540 0x5588b22fd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f224bdcb740 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f45b0 0x5588b22fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f224bdcb740 1 --2- 172.21.15.47:0/3660478222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 0x5588b22ffca0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f2229ffb640 0 client.17505 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f224bdcb740 1 -- 172.21.15.47:0/3660478222 >> 172.21.15.47:0/3660478222 conn(0x5588b22f1ac0 msgr2=0x5588b22f7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f224bdcb740 1 -- 172.21.15.47:0/3660478222 shutdown_connections 2024-07-24T22:16:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f224bdcb740 1 -- 172.21.15.47:0/3660478222 wait complete. 2024-07-24T22:16:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.532+0000 7f224bdcb740 20 client.17505 trim_cache size 0 max 16384 2024-07-24T22:16:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.547+0000 7f224bdcb740 1 Processor -- start 2024-07-24T22:16:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.547+0000 7f224bdcb740 1 -- start start 2024-07-24T22:16:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224bdcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 0x5588b22ffb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224bdcb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f45b0 0x5588b2317c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224bdcb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b2300540 0x5588b2318160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224bdcb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f22441ae430 con 0x5588b22f3c90 2024-07-24T22:16:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224bdcb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f22441b0c90 con 0x5588b2300540 2024-07-24T22:16:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224bdcb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f22441aea80 con 0x5588b22f45b0 2024-07-24T22:16:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 0x5588b22ffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 0x5588b22ffb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46762/0 (socket says 172.21.15.47:46762) 2024-07-24T22:16:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224259c640 1 -- 172.21.15.47:0/738836080 learned_addr learned my addr 172.21.15.47:0/738836080 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224259c640 1 -- 172.21.15.47:0/738836080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f45b0 msgr2=0x5588b2317c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224259c640 1 --2- 172.21.15.47:0/738836080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f45b0 0x5588b2317c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224259c640 1 -- 172.21.15.47:0/738836080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b2300540 msgr2=0x5588b2318160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:31.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224259c640 1 --2- 172.21.15.47:0/738836080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b2300540 0x5588b2318160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224259c640 1 -- 172.21.15.47:0/738836080 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b22f18f0 con 0x5588b22f3c90 2024-07-24T22:16:31.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f224259c640 1 --2- 172.21.15.47:0/738836080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 0x5588b22ffb80 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f223401b600 tx=0x7f223401b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d6465955f2358d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:31.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f222bfff640 1 -- 172.21.15.47:0/738836080 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234028040 con 0x5588b22f3c90 2024-07-24T22:16:31.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f222bfff640 1 -- 172.21.15.47:0/738836080 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2234003e00 con 0x5588b22f3c90 2024-07-24T22:16:31.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.548+0000 7f222bfff640 1 -- 172.21.15.47:0/738836080 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234024c40 con 0x5588b22f3c90 2024-07-24T22:16:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.549+0000 7f224bdcb740 1 -- 172.21.15.47:0/738836080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 msgr2=0x5588b22ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.549+0000 7f224bdcb740 1 --2- 172.21.15.47:0/738836080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 0x5588b22ffb80 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f223401b600 tx=0x7f223401b970 comp rx=0 tx=0).stop 2024-07-24T22:16:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.549+0000 7f224bdcb740 1 -- 172.21.15.47:0/738836080 shutdown_connections 2024-07-24T22:16:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.549+0000 7f224bdcb740 1 --2- 172.21.15.47:0/738836080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b2300540 0x5588b2318160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.549+0000 7f224bdcb740 1 --2- 172.21.15.47:0/738836080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f45b0 0x5588b2317c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.549+0000 7f224bdcb740 1 --2- 172.21.15.47:0/738836080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b22f3c90 0x5588b22ffb80 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.549+0000 7f224bdcb740 1 -- 172.21.15.47:0/738836080 >> 172.21.15.47:0/738836080 conn(0x5588b22f1ac0 msgr2=0x5588b22fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.549+0000 7f224bdcb740 1 -- 172.21.15.47:0/738836080 shutdown_connections 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.549+0000 7f224bdcb740 1 -- 172.21.15.47:0/738836080 wait complete. 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.549+0000 7f224bdcb740 1 -- start start 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.549+0000 7f224bdcb740 1 Processor -- start 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f224bdcb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f3c90 0x5588b2308be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f224bdcb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f45b0 0x5588b23050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f224bdcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 0x5588b2305690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f224bdcb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f22441af150 con 0x5588b2300540 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f224bdcb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f22441b05c0 con 0x5588b22f3c90 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f224bdcb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f22441af820 con 0x5588b22f45b0 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f224bdcb740 10 client.0 _ll_register_callbacks cb 0x7f2234004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f2242d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 0x5588b2305690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f2242d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 0x5588b2305690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46778/0 (socket says 172.21.15.47:46778) 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f2242d9d640 1 -- 172.21.15.47:0/3745390613 learned_addr learned my addr 172.21.15.47:0/3745390613 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f223bfff640 1 --2- 172.21.15.47:0/3745390613 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f45b0 0x5588b23050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f2242d9d640 1 -- 172.21.15.47:0/3745390613 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f45b0 msgr2=0x5588b23050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f2242d9d640 1 --2- 172.21.15.47:0/3745390613 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f45b0 0x5588b23050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f2242d9d640 1 -- 172.21.15.47:0/3745390613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f3c90 msgr2=0x5588b2308be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f2242d9d640 1 --2- 172.21.15.47:0/3745390613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f3c90 0x5588b2308be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f2242d9d640 1 -- 172.21.15.47:0/3745390613 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b2378bf0 con 0x5588b2300540 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f223bfff640 1 --2- 172.21.15.47:0/3745390613 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f45b0 0x5588b23050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f2242d9d640 1 --2- 172.21.15.47:0/3745390613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 0x5588b2305690 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f223c009ca0 tx=0x7f223c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a90929c2908fcb server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f2229ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f2229ffb640 1 -- 172.21.15.47:0/3745390613 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c004040 con 0x5588b2300540 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f2229ffb640 1 -- 172.21.15.47:0/3745390613 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f223c0041e0 con 0x5588b2300540 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.550+0000 7f224bdcb740 1 -- 172.21.15.47:0/3745390613 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2234003e00 con 0x5588b2300540 2024-07-24T22:16:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.551+0000 7f2229ffb640 1 -- 172.21.15.47:0/3745390613 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f223c0043e0 con 0x5588b2300540 2024-07-24T22:16:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.551+0000 7f224bdcb740 10 client.17511 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.551+0000 7f224bdcb740 1 -- 172.21.15.47:0/3745390613 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5588b2379cf0 con 0x5588b2300540 2024-07-24T22:16:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.551+0000 7f2229ffb640 1 -- 172.21.15.47:0/3745390613 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2234003e00 con 0x5588b2300540 2024-07-24T22:16:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.551+0000 7f2229ffb640 1 -- 172.21.15.47:0/3745390613 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f223c044040 con 0x5588b2300540 2024-07-24T22:16:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.551+0000 7f224bdcb740 10 client.17511 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.551+0000 7f224bdcb740 10 client.17511 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.551+0000 7f224bdcb740 20 client.17511 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.551+0000 7f224bdcb740 1 --2- 172.21.15.47:0/3745390613 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5588b237a4a0 0x5588b237c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.551+0000 7f224bdcb740 4 client.17511 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:16:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.551+0000 7f224bdcb740 1 -- 172.21.15.47:0/3745390613 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5588b2266c70 con 0x5588b237a4a0 2024-07-24T22:16:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.551+0000 7f224259c640 1 --2- 172.21.15.47:0/3745390613 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5588b237a4a0 0x5588b237c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.552+0000 7f224259c640 1 --2- 172.21.15.47:0/3745390613 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5588b237a4a0 0x5588b237c8c0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f41e2bba811cdff3 server_cookie=586ebaf839b096a4 in_seq=0 out_seq=0 2024-07-24T22:16:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.552+0000 7f2229ffb640 10 client.17511 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f2229ffb640 1 -- 172.21.15.47:0/3745390613 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5588b2266c70 con 0x5588b237a4a0 2024-07-24T22:16:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f2229ffb640 10 client.17511 handle_command_reply: tid=0 2024-07-24T22:16:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f224bdcb740 1 client.17511 shutdown 2024-07-24T22:16:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f224bdcb740 1 -- 172.21.15.47:0/3745390613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 msgr2=0x5588b2305690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f224bdcb740 1 --2- 172.21.15.47:0/3745390613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 0x5588b2305690 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f223c009ca0 tx=0x7f223c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f224bdcb740 1 -- 172.21.15.47:0/3745390613 shutdown_connections 2024-07-24T22:16:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f224bdcb740 1 --2- 172.21.15.47:0/3745390613 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5588b237a4a0 0x5588b237c8c0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f224bdcb740 1 --2- 172.21.15.47:0/3745390613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588b2300540 0x5588b2305690 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f224bdcb740 1 --2- 172.21.15.47:0/3745390613 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5588b22f45b0 0x5588b23050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f2229ffb640 0 client.17511 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f224bdcb740 1 --2- 172.21.15.47:0/3745390613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5588b22f3c90 0x5588b2308be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f224bdcb740 1 -- 172.21.15.47:0/3745390613 >> 172.21.15.47:0/3745390613 conn(0x5588b22f1ac0 msgr2=0x5588b22fbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f224bdcb740 1 -- 172.21.15.47:0/3745390613 shutdown_connections 2024-07-24T22:16:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.557+0000 7f224bdcb740 1 -- 172.21.15.47:0/3745390613 wait complete. 2024-07-24T22:16:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.558+0000 7f224bdcb740 20 client.17511 trim_cache size 0 max 16384 2024-07-24T22:16:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:16:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:16:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:16:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:16:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.558+0000 7f2248f9f640 1 -- 172.21.15.47:0/2842297768 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f22300b3d40 msgr2=0x7f22300b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.558+0000 7f2248f9f640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f22300b3d40 0x7f22300b6200 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f223c006010 tx=0x7f223c009360 comp rx=0 tx=0).stop 2024-07-24T22:16:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.558+0000 7f2248f9f640 1 -- 172.21.15.47:0/2842297768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2244107060 msgr2=0x7f22440fdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.558+0000 7f2248f9f640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2244107060 0x7f22440fdb00 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f222c00d770 tx=0x7f222c00dc30 comp rx=0 tx=0).stop 2024-07-24T22:16:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.558+0000 7f2248f9f640 1 -- 172.21.15.47:0/2842297768 shutdown_connections 2024-07-24T22:16:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.558+0000 7f2248f9f640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f22300b3d40 0x7f22300b6200 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.558+0000 7f2248f9f640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22441079e0 0x7f22440fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.558+0000 7f2248f9f640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2244107060 0x7f22440fdb00 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.558+0000 7f2248f9f640 1 --2- 172.21.15.47:0/2842297768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2244101660 0x7f22440fd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.558+0000 7f2248f9f640 1 -- 172.21.15.47:0/2842297768 >> 172.21.15.47:0/2842297768 conn(0x7f22440fd0c0 msgr2=0x7f22440fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.558+0000 7f2248f9f640 1 -- 172.21.15.47:0/2842297768 shutdown_connections 2024-07-24T22:16:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:31.558+0000 7f2248f9f640 1 -- 172.21.15.47:0/2842297768 wait complete. 2024-07-24T22:16:32.176 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:31 smithi047 ceph-mon[32551]: pgmap v653: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:16:32.176 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:31 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:16:32.176 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:31 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:16:32.176 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:31 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:16:32.177 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:31 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:16:32.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:31 smithi188 ceph-mon[37380]: pgmap v653: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:16:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:31 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:16:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:31 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:16:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:31 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:16:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:31 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:16:32.333 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:31 smithi183 ceph-mon[37007]: pgmap v653: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:16:32.333 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:31 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:16:32.333 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:31 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:16:32.333 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:31 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:16:32.333 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:31 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:16:32.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.980+0000 7fe29a015640 1 -- 172.21.15.47:0/448851468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ff0 msgr2=0x7fe2941013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:32.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.980+0000 7fe29a015640 1 --2- 172.21.15.47:0/448851468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ff0 0x7fe2941013d0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe284009900 tx=0x7fe28402a410 comp rx=0 tx=0).stop 2024-07-24T22:16:32.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.980+0000 7fe29a015640 1 -- 172.21.15.47:0/448851468 shutdown_connections 2024-07-24T22:16:32.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.980+0000 7fe29a015640 1 --2- 172.21.15.47:0/448851468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe29410eca0 0x7fe294111110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.980+0000 7fe29a015640 1 --2- 172.21.15.47:0/448851468 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2941019f0 0x7fe29410e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.980+0000 7fe29a015640 1 --2- 172.21.15.47:0/448851468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ff0 0x7fe2941013d0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.980+0000 7fe29a015640 1 -- 172.21.15.47:0/448851468 >> 172.21.15.47:0/448851468 conn(0x7fe294076890 msgr2=0x7fe294076ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.980+0000 7fe29a015640 1 -- 172.21.15.47:0/448851468 shutdown_connections 2024-07-24T22:16:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.980+0000 7fe29a015640 1 -- 172.21.15.47:0/448851468 wait complete. 2024-07-24T22:16:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe29a015640 1 Processor -- start 2024-07-24T22:16:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe29a015640 1 -- start start 2024-07-24T22:16:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe29a015640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ff0 0x7fe29419aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe29a015640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2941019f0 0x7fe29419b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe29a015640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe29410eca0 0x7fe2941a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe29a015640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe294114920 con 0x7fe294100ff0 2024-07-24T22:16:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe29a015640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe2941147a0 con 0x7fe2941019f0 2024-07-24T22:16:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe29a015640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe294114aa0 con 0x7fe29410eca0 2024-07-24T22:16:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe2937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ff0 0x7fe29419aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe2937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ff0 0x7fe29419aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46806/0 (socket says 172.21.15.47:46806) 2024-07-24T22:16:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe2937fe640 1 -- 172.21.15.47:0/2781862667 learned_addr learned my addr 172.21.15.47:0/2781862667 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe292ffd640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2941019f0 0x7fe29419b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe293fff640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe29410eca0 0x7fe2941a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe2937fe640 1 -- 172.21.15.47:0/2781862667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe29410eca0 msgr2=0x7fe2941a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe2937fe640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe29410eca0 0x7fe2941a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe2937fe640 1 -- 172.21.15.47:0/2781862667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2941019f0 msgr2=0x7fe29419b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe2937fe640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2941019f0 0x7fe29419b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe2937fe640 1 -- 172.21.15.47:0/2781862667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2941a0f80 con 0x7fe294100ff0 2024-07-24T22:16:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.981+0000 7fe293fff640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe29410eca0 0x7fe2941a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:16:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.982+0000 7fe2937fe640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ff0 0x7fe29419aed0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe284005940 tx=0x7fe284004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.982+0000 7fe290ff9640 1 -- 172.21.15.47:0/2781862667 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28403f030 con 0x7fe294100ff0 2024-07-24T22:16:32.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.982+0000 7fe29a015640 1 -- 172.21.15.47:0/2781862667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2941a1210 con 0x7fe294100ff0 2024-07-24T22:16:32.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.982+0000 7fe290ff9640 1 -- 172.21.15.47:0/2781862667 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe284003aa0 con 0x7fe294100ff0 2024-07-24T22:16:32.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.982+0000 7fe290ff9640 1 -- 172.21.15.47:0/2781862667 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284035070 con 0x7fe294100ff0 2024-07-24T22:16:32.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.982+0000 7fe29a015640 1 -- 172.21.15.47:0/2781862667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2941a7930 con 0x7fe294100ff0 2024-07-24T22:16:32.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe290ff9640 1 -- 172.21.15.47:0/2781862667 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe284042030 con 0x7fe294100ff0 2024-07-24T22:16:32.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe29c3c6740 1 Processor -- start 2024-07-24T22:16:32.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe29c3c6740 1 -- start start 2024-07-24T22:16:32.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe29c3c6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 0x5572b4608a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:32.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe29c3c6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b46149f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:32.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe29c3c6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 0x5572b4617320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:32.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe29c3c6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5572b457f960 con 0x5572b4614f30 2024-07-24T22:16:32.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe29c3c6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5572b456ee60 con 0x5572b4608fa0 2024-07-24T22:16:32.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe29c3c6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5572b4572ea0 con 0x5572b4608680 2024-07-24T22:16:32.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe292ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 0x5572b4617320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:32.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe293fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 0x5572b4608a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:32.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe2937fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b46149f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:32.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe292ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 0x5572b4617320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46822/0 (socket says 172.21.15.47:46822) 2024-07-24T22:16:32.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe292ffd640 1 -- 172.21.15.47:0/4124585121 learned_addr learned my addr 172.21.15.47:0/4124585121 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:32.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe292ffd640 1 -- 172.21.15.47:0/4124585121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 msgr2=0x5572b4608a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:32.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe292ffd640 1 --2- 172.21.15.47:0/4124585121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 0x5572b4608a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:32.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.985+0000 7fe292ffd640 1 -- 172.21.15.47:0/4124585121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 msgr2=0x5572b46149f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:32.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.986+0000 7fe292ffd640 1 --2- 172.21.15.47:0/4124585121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b46149f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:32.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.986+0000 7fe292ffd640 1 -- 172.21.15.47:0/4124585121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b44f82d0 con 0x5572b4614f30 2024-07-24T22:16:32.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.986+0000 7fe290ff9640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe27c0b3d40 0x7fe27c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:32.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.986+0000 7fe290ff9640 1 -- 172.21.15.47:0/2781862667 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7fe284104710 con 0x7fe294100ff0 2024-07-24T22:16:32.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.986+0000 7fe2937fe640 1 --2- 172.21.15.47:0/4124585121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b46149f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:16:32.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.986+0000 7fe293fff640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe27c0b3d40 0x7fe27c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:32.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.987+0000 7fe292ffd640 1 --2- 172.21.15.47:0/4124585121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 0x5572b4617320 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe28800b740 tx=0x7fe28800bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b6162493f8c4a0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:32.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.987+0000 7fe279ffb640 1 -- 172.21.15.47:0/4124585121 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288003dd0 con 0x5572b4614f30 2024-07-24T22:16:32.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.987+0000 7fe279ffb640 1 -- 172.21.15.47:0/4124585121 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe288015070 con 0x5572b4614f30 2024-07-24T22:16:32.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.987+0000 7fe279ffb640 1 -- 172.21.15.47:0/4124585121 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288004d30 con 0x5572b4614f30 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.988+0000 7fe29c3c6740 1 -- 172.21.15.47:0/4124585121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 msgr2=0x5572b4617320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.988+0000 7fe293fff640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe27c0b3d40 0x7fe27c0b6200 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe28c005fd0 tx=0x7fe28c009500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.988+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/4124585121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 0x5572b4617320 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe28800b740 tx=0x7fe28800bc00 comp rx=0 tx=0).stop 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.988+0000 7fe29c3c6740 1 -- 172.21.15.47:0/4124585121 shutdown_connections 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.988+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/4124585121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 0x5572b4617320 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.988+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/4124585121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b46149f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.988+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/4124585121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 0x5572b4608a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.988+0000 7fe29c3c6740 1 -- 172.21.15.47:0/4124585121 >> 172.21.15.47:0/4124585121 conn(0x5572b46064b0 msgr2=0x5572b4607650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.988+0000 7fe29c3c6740 1 -- 172.21.15.47:0/4124585121 shutdown_connections 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.988+0000 7fe29c3c6740 1 -- 172.21.15.47:0/4124585121 wait complete. 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.988+0000 7fe29c3c6740 1 -- start start 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.988+0000 7fe29c3c6740 1 Processor -- start 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe29c3c6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608680 0x5572b4611e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe29c3c6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b46123b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe29c3c6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4614f30 0x5572b46128f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe29c3c6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5572b43d2700 con 0x5572b4608680 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe29c3c6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5572b45115a0 con 0x5572b4608fa0 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe29c3c6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5572b4617bb0 con 0x5572b4614f30 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe29c3c6740 10 client.0 _ll_register_callbacks cb 0x5572b4531910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe2937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608680 0x5572b4611e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe2937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608680 0x5572b4611e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46836/0 (socket says 172.21.15.47:46836) 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe2937fe640 1 -- 172.21.15.47:0/2687841688 learned_addr learned my addr 172.21.15.47:0/2687841688 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe292ffd640 1 --2- 172.21.15.47:0/2687841688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b46123b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe2937fe640 1 -- 172.21.15.47:0/2687841688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4614f30 msgr2=0x5572b46128f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe2937fe640 1 --2- 172.21.15.47:0/2687841688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4614f30 0x5572b46128f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe2937fe640 1 -- 172.21.15.47:0/2687841688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 msgr2=0x5572b46123b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe2937fe640 1 --2- 172.21.15.47:0/2687841688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b46123b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe2937fe640 1 -- 172.21.15.47:0/2687841688 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b4504630 con 0x5572b4608680 2024-07-24T22:16:33.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe292ffd640 1 --2- 172.21.15.47:0/2687841688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b46123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:16:33.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe2937fe640 1 --2- 172.21.15.47:0/2687841688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608680 0x5572b4611e70 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fe2840c8560 tx=0x7fe284005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9108fb698542094f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:33.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe272ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:33.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe272ffd640 1 -- 172.21.15.47:0/2687841688 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284049070 con 0x5572b4608680 2024-07-24T22:16:33.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.989+0000 7fe272ffd640 1 -- 172.21.15.47:0/2687841688 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7fe28403bcc0 con 0x5572b4608680 2024-07-24T22:16:33.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.990+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2687841688 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe288015070 con 0x5572b4608680 2024-07-24T22:16:33.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.990+0000 7fe272ffd640 1 -- 172.21.15.47:0/2687841688 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe2840c71b0 con 0x5572b4608680 2024-07-24T22:16:33.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.990+0000 7fe29c3c6740 10 client.17523 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:33.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.990+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2687841688 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5572b42cf650 con 0x5572b4608680 2024-07-24T22:16:33.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.990+0000 7fe272ffd640 1 -- 172.21.15.47:0/2687841688 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe288015070 con 0x5572b4608680 2024-07-24T22:16:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.990+0000 7fe272ffd640 1 -- 172.21.15.47:0/2687841688 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe2840cb550 con 0x5572b4608680 2024-07-24T22:16:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.990+0000 7fe29c3c6740 10 client.17523 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.990+0000 7fe29c3c6740 10 client.17523 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.990+0000 7fe29c3c6740 20 client.17523 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.990+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/2687841688 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572b46249d0 0x5572b4626e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.990+0000 7fe29c3c6740 4 client.17523 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:16:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.990+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2687841688 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572b45818b0 con 0x5572b46249d0 2024-07-24T22:16:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.991+0000 7fe292ffd640 1 --2- 172.21.15.47:0/2687841688 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572b46249d0 0x5572b4626e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.993+0000 7fe292ffd640 1 --2- 172.21.15.47:0/2687841688 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572b46249d0 0x5572b4626e60 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10f67f590a6badc7 server_cookie=77603e4941b36071 in_seq=0 out_seq=0 2024-07-24T22:16:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.993+0000 7fe272ffd640 10 client.17523 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.994+0000 7fe272ffd640 1 -- 172.21.15.47:0/2687841688 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572b45818b0 con 0x5572b46249d0 2024-07-24T22:16:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.994+0000 7fe272ffd640 10 client.17523 handle_command_reply: tid=0 2024-07-24T22:16:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.994+0000 7fe29c3c6740 1 client.17523 shutdown 2024-07-24T22:16:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.994+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2687841688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608680 msgr2=0x5572b4611e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.994+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/2687841688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608680 0x5572b4611e70 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fe2840c8560 tx=0x7fe284005c90 comp rx=0 tx=0).stop 2024-07-24T22:16:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.994+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2687841688 shutdown_connections 2024-07-24T22:16:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.994+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/2687841688 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572b46249d0 0x5572b4626e60 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.994+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/2687841688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4614f30 0x5572b46128f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.994+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/2687841688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b46123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.994+0000 7fe272ffd640 0 client.17523 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.994+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/2687841688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608680 0x5572b4611e70 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.995+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2687841688 >> 172.21.15.47:0/2687841688 conn(0x5572b46064b0 msgr2=0x5572b460c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.995+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2687841688 shutdown_connections 2024-07-24T22:16:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.995+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2687841688 wait complete. 2024-07-24T22:16:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:32.995+0000 7fe29c3c6740 20 client.17523 trim_cache size 0 max 16384 2024-07-24T22:16:33.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.013+0000 7fe29c3c6740 1 Processor -- start 2024-07-24T22:16:33.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.013+0000 7fe29c3c6740 1 -- start start 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.013+0000 7fe29c3c6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 0x5572b460c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.013+0000 7fe29c3c6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608fa0 0x5572b462c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.013+0000 7fe29c3c6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4614f30 0x5572b462cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.013+0000 7fe29c3c6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe2941ae400 con 0x5572b4608fa0 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.013+0000 7fe29c3c6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe2941b0c60 con 0x5572b4614f30 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.013+0000 7fe29c3c6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe2941aea50 con 0x5572b4608680 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe292ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608fa0 0x5572b462c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe292ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608fa0 0x5572b462c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46840/0 (socket says 172.21.15.47:46840) 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe292ffd640 1 -- 172.21.15.47:0/1399058103 learned_addr learned my addr 172.21.15.47:0/1399058103 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe293fff640 1 --2- 172.21.15.47:0/1399058103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4614f30 0x5572b462cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe2937fe640 1 --2- 172.21.15.47:0/1399058103 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 0x5572b460c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe292ffd640 1 -- 172.21.15.47:0/1399058103 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 msgr2=0x5572b460c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe292ffd640 1 --2- 172.21.15.47:0/1399058103 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 0x5572b460c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe292ffd640 1 -- 172.21.15.47:0/1399058103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4614f30 msgr2=0x5572b462cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:33.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe292ffd640 1 --2- 172.21.15.47:0/1399058103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4614f30 0x5572b462cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe292ffd640 1 -- 172.21.15.47:0/1399058103 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b4605df0 con 0x5572b4608fa0 2024-07-24T22:16:33.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe292ffd640 1 --2- 172.21.15.47:0/1399058103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608fa0 0x5572b462c730 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fe28800c010 tx=0x7fe2880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d5895276ffa0ca server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:33.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe2797fa640 1 -- 172.21.15.47:0/1399058103 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288003e50 con 0x5572b4608fa0 2024-07-24T22:16:33.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe2797fa640 1 -- 172.21.15.47:0/1399058103 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe288015040 con 0x5572b4608fa0 2024-07-24T22:16:33.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.014+0000 7fe2797fa640 1 -- 172.21.15.47:0/1399058103 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2880196a0 con 0x5572b4608fa0 2024-07-24T22:16:33.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.015+0000 7fe29c3c6740 1 -- 172.21.15.47:0/1399058103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608fa0 msgr2=0x5572b462c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:33.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.015+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/1399058103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608fa0 0x5572b462c730 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fe28800c010 tx=0x7fe2880047c0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.015+0000 7fe29c3c6740 1 -- 172.21.15.47:0/1399058103 shutdown_connections 2024-07-24T22:16:33.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.015+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/1399058103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4614f30 0x5572b462cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.015+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/1399058103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4608fa0 0x5572b462c730 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.015+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/1399058103 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 0x5572b460c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.015+0000 7fe29c3c6740 1 -- 172.21.15.47:0/1399058103 >> 172.21.15.47:0/1399058103 conn(0x5572b46064b0 msgr2=0x5572b4613cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:33.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.015+0000 7fe29c3c6740 1 -- 172.21.15.47:0/1399058103 shutdown_connections 2024-07-24T22:16:33.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.015+0000 7fe29c3c6740 1 -- 172.21.15.47:0/1399058103 wait complete. 2024-07-24T22:16:33.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.015+0000 7fe29c3c6740 1 -- start start 2024-07-24T22:16:33.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe29c3c6740 1 Processor -- start 2024-07-24T22:16:33.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe29c3c6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 0x5572b461d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:33.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe29c3c6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b461d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe29c3c6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 0x5572b460eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe29c3c6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe2941af120 con 0x5572b4614f30 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe29c3c6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe2941b0590 con 0x5572b4608fa0 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe29c3c6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe2941af7f0 con 0x5572b4608680 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe29c3c6740 10 client.0 _ll_register_callbacks cb 0x7fe284005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe293fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 0x5572b460eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe293fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 0x5572b460eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46854/0 (socket says 172.21.15.47:46854) 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe293fff640 1 -- 172.21.15.47:0/2476596371 learned_addr learned my addr 172.21.15.47:0/2476596371 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe292ffd640 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b461d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe2937fe640 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 0x5572b461d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe293fff640 1 -- 172.21.15.47:0/2476596371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 msgr2=0x5572b461d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe293fff640 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 0x5572b461d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe293fff640 1 -- 172.21.15.47:0/2476596371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 msgr2=0x5572b461d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:33.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.016+0000 7fe293fff640 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b461d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.017+0000 7fe293fff640 1 -- 172.21.15.47:0/2476596371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b460f370 con 0x5572b4614f30 2024-07-24T22:16:33.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.017+0000 7fe292ffd640 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b461d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:16:33.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.017+0000 7fe293fff640 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 0x5572b460eb40 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fe28c010ab0 tx=0x7fe28c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc64020ca1f80d31 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:33.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.017+0000 7fe272ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:33.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.017+0000 7fe272ffd640 1 -- 172.21.15.47:0/2476596371 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c02c060 con 0x5572b4614f30 2024-07-24T22:16:33.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.017+0000 7fe272ffd640 1 -- 172.21.15.47:0/2476596371 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7fe28c01e6e0 con 0x5572b4614f30 2024-07-24T22:16:33.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.017+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2476596371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe288015040 con 0x5572b4614f30 2024-07-24T22:16:33.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.017+0000 7fe272ffd640 1 -- 172.21.15.47:0/2476596371 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe28c01e8e0 con 0x5572b4614f30 2024-07-24T22:16:33.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.017+0000 7fe29c3c6740 10 client.17529 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:33.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.017+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2476596371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5572b468f4c0 con 0x5572b4614f30 2024-07-24T22:16:33.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.017+0000 7fe272ffd640 1 -- 172.21.15.47:0/2476596371 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe288015040 con 0x5572b4614f30 2024-07-24T22:16:33.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.018+0000 7fe272ffd640 1 -- 172.21.15.47:0/2476596371 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe28c027c90 con 0x5572b4614f30 2024-07-24T22:16:33.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.018+0000 7fe29c3c6740 10 client.17529 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:33.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.018+0000 7fe29c3c6740 10 client.17529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:33.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.018+0000 7fe29c3c6740 20 client.17529 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:33.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.018+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572b46249d0 0x5572b4691cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:33.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.018+0000 7fe29c3c6740 4 client.17529 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:16:33.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.018+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2476596371 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5572b457d350 con 0x5572b46249d0 2024-07-24T22:16:33.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.018+0000 7fe2937fe640 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572b46249d0 0x5572b4691cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:33.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.018+0000 7fe2937fe640 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572b46249d0 0x5572b4691cb0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=820c36a4d78049fd server_cookie=7cf759eeb2871484 in_seq=0 out_seq=0 2024-07-24T22:16:33.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.018+0000 7fe272ffd640 10 client.17529 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:33.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe272ffd640 1 -- 172.21.15.47:0/2476596371 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5572b457d350 con 0x5572b46249d0 2024-07-24T22:16:33.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe272ffd640 10 client.17529 handle_command_reply: tid=0 2024-07-24T22:16:33.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe29c3c6740 1 client.17529 shutdown 2024-07-24T22:16:33.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2476596371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 msgr2=0x5572b460eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:33.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 0x5572b460eb40 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fe28c010ab0 tx=0x7fe28c004ab0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2476596371 shutdown_connections 2024-07-24T22:16:33.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5572b46249d0 0x5572b4691cb0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5572b4614f30 0x5572b460eb40 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5572b4608fa0 0x5572b461d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe29c3c6740 1 --2- 172.21.15.47:0/2476596371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5572b4608680 0x5572b461d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2476596371 >> 172.21.15.47:0/2476596371 conn(0x5572b46064b0 msgr2=0x5572b46106f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:33.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe272ffd640 0 client.17529 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:33.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2476596371 shutdown_connections 2024-07-24T22:16:33.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe29c3c6740 1 -- 172.21.15.47:0/2476596371 wait complete. 2024-07-24T22:16:33.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.019+0000 7fe29c3c6740 20 client.17529 trim_cache size 0 max 16384 2024-07-24T22:16:33.028 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:16:33.028 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-07-24T22:16:33.028 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-07-24T22:16:33.028 INFO:teuthology.orchestra.run.smithi047.stdout: "33f332b9-620e-4c89-9411-4125d7521148": { 2024-07-24T22:16:33.028 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-07-24T22:16:33.028 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "33f332b9-620e-4c89-9411-4125d7521148", 2024-07-24T22:16:33.028 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-07-24T22:16:33.028 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:16:33.028 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:16:33.028 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:16:33.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.020+0000 7fe29a015640 1 -- 172.21.15.47:0/2781862667 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe27c0b3d40 msgr2=0x7fe27c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:33.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.020+0000 7fe29a015640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe27c0b3d40 0x7fe27c0b6200 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe28c005fd0 tx=0x7fe28c009500 comp rx=0 tx=0).stop 2024-07-24T22:16:33.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.020+0000 7fe29a015640 1 -- 172.21.15.47:0/2781862667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ff0 msgr2=0x7fe29419aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:33.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.020+0000 7fe29a015640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ff0 0x7fe29419aed0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe284005940 tx=0x7fe284004270 comp rx=0 tx=0).stop 2024-07-24T22:16:33.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.020+0000 7fe29a015640 1 -- 172.21.15.47:0/2781862667 shutdown_connections 2024-07-24T22:16:33.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.020+0000 7fe29a015640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe27c0b3d40 0x7fe27c0b6200 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.020+0000 7fe29a015640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe29410eca0 0x7fe2941a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.020+0000 7fe29a015640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2941019f0 0x7fe29419b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.020+0000 7fe29a015640 1 --2- 172.21.15.47:0/2781862667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ff0 0x7fe29419aed0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:33.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.020+0000 7fe29a015640 1 -- 172.21.15.47:0/2781862667 >> 172.21.15.47:0/2781862667 conn(0x7fe294076890 msgr2=0x7fe29410f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:33.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.020+0000 7fe29a015640 1 -- 172.21.15.47:0/2781862667 shutdown_connections 2024-07-24T22:16:33.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:33.020+0000 7fe29a015640 1 -- 172.21.15.47:0/2781862667 wait complete. 2024-07-24T22:16:33.955 INFO:tasks.cephfs.filesystem:scrub status for tag:33f332b9-620e-4c89-9411-4125d7521148 - {'path': '/', 'tag': '33f332b9-620e-4c89-9411-4125d7521148', 'options': 'recursive,force'} 2024-07-24T22:16:34.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:33 smithi047 ceph-mon[32551]: pgmap v654: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.1 KiB/s rd, 307 B/s wr, 3 op/s 2024-07-24T22:16:34.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:33 smithi188 ceph-mon[37380]: pgmap v654: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.1 KiB/s rd, 307 B/s wr, 3 op/s 2024-07-24T22:16:34.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:33 smithi183 ceph-mon[37007]: pgmap v654: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.1 KiB/s rd, 307 B/s wr, 3 op/s 2024-07-24T22:16:36.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:35 smithi047 ceph-mon[32551]: pgmap v655: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.0 KiB/s rd, 307 B/s wr, 5 op/s 2024-07-24T22:16:36.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:35 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:16:36.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:35 smithi188 ceph-mon[37380]: pgmap v655: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.0 KiB/s rd, 307 B/s wr, 5 op/s 2024-07-24T22:16:36.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:35 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:16:36.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:35 smithi183 ceph-mon[37007]: pgmap v655: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.0 KiB/s rd, 307 B/s wr, 5 op/s 2024-07-24T22:16:36.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:35 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:16:38.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:37 smithi047 ceph-mon[32551]: pgmap v656: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 307 B/s wr, 5 op/s 2024-07-24T22:16:38.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:37 smithi188 ceph-mon[37380]: pgmap v656: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 307 B/s wr, 5 op/s 2024-07-24T22:16:38.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:37 smithi183 ceph-mon[37007]: pgmap v656: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 307 B/s wr, 5 op/s 2024-07-24T22:16:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:39 smithi047 ceph-mon[32551]: pgmap v657: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 307 B/s wr, 5 op/s 2024-07-24T22:16:40.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:39 smithi188 ceph-mon[37380]: pgmap v657: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 307 B/s wr, 5 op/s 2024-07-24T22:16:40.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:39 smithi183 ceph-mon[37007]: pgmap v657: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 307 B/s wr, 5 op/s 2024-07-24T22:16:40.558 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:16:40.838 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:16:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:41 smithi047 ceph-mon[32551]: pgmap v658: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 275 B/s wr, 5 op/s 2024-07-24T22:16:42.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:41 smithi188 ceph-mon[37380]: pgmap v658: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 275 B/s wr, 5 op/s 2024-07-24T22:16:42.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:41 smithi183 ceph-mon[37007]: pgmap v658: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 275 B/s wr, 5 op/s 2024-07-24T22:16:42.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.497+0000 7fc19b747640 1 -- 172.21.15.47:0/93825947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1941034f0 msgr2=0x7fc1941038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:42.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.497+0000 7fc19b747640 1 --2- 172.21.15.47:0/93825947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1941034f0 0x7fc1941038d0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc190009900 tx=0x7fc19002a410 comp rx=0 tx=0).stop 2024-07-24T22:16:42.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.497+0000 7fc19b747640 1 -- 172.21.15.47:0/93825947 shutdown_connections 2024-07-24T22:16:42.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.497+0000 7fc19b747640 1 --2- 172.21.15.47:0/93825947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc19410caa0 0x7fc19410ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:42.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.497+0000 7fc19b747640 1 --2- 172.21.15.47:0/93825947 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc194103ef0 0x7fc19410c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:42.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.497+0000 7fc19b747640 1 --2- 172.21.15.47:0/93825947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1941034f0 0x7fc1941038d0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:42.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.497+0000 7fc19b747640 1 -- 172.21.15.47:0/93825947 >> 172.21.15.47:0/93825947 conn(0x7fc1940fd0c0 msgr2=0x7fc1940ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:42.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.497+0000 7fc19b747640 1 -- 172.21.15.47:0/93825947 shutdown_connections 2024-07-24T22:16:42.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.497+0000 7fc19b747640 1 -- 172.21.15.47:0/93825947 wait complete. 2024-07-24T22:16:42.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.498+0000 7fc19b747640 1 Processor -- start 2024-07-24T22:16:42.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.498+0000 7fc19b747640 1 -- start start 2024-07-24T22:16:42.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.498+0000 7fc19b747640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1941034f0 0x7fc194198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:42.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.498+0000 7fc19b747640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc194103ef0 0x7fc1941991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:42.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.498+0000 7fc19b747640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc19410caa0 0x7fc19419e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:42.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.498+0000 7fc19b747640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc1941126f0 con 0x7fc1941034f0 2024-07-24T22:16:42.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.498+0000 7fc19b747640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc194112570 con 0x7fc19410caa0 2024-07-24T22:16:42.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.498+0000 7fc19b747640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc194112870 con 0x7fc194103ef0 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.498+0000 7fc1994e3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1941034f0 0x7fc194198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.498+0000 7fc1994e3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1941034f0 0x7fc194198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40992/0 (socket says 172.21.15.47:40992) 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.498+0000 7fc1994e3640 1 -- 172.21.15.47:0/2866277792 learned_addr learned my addr 172.21.15.47:0/2866277792 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.499+0000 7fc198ce2640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc194103ef0 0x7fc1941991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.499+0000 7fc199ce4640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc19410caa0 0x7fc19419e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.499+0000 7fc1994e3640 1 -- 172.21.15.47:0/2866277792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc194103ef0 msgr2=0x7fc1941991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.499+0000 7fc1994e3640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc194103ef0 0x7fc1941991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.499+0000 7fc1994e3640 1 -- 172.21.15.47:0/2866277792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc19410caa0 msgr2=0x7fc19419e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.499+0000 7fc1994e3640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc19410caa0 0x7fc19419e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.499+0000 7fc1994e3640 1 -- 172.21.15.47:0/2866277792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19419ed10 con 0x7fc1941034f0 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.499+0000 7fc1994e3640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1941034f0 0x7fc194198c60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc190005940 tx=0x7fc1900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.499+0000 7fc18a7fc640 1 -- 172.21.15.47:0/2866277792 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19003f030 con 0x7fc1941034f0 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.499+0000 7fc18a7fc640 1 -- 172.21.15.47:0/2866277792 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc190003cb0 con 0x7fc1941034f0 2024-07-24T22:16:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.499+0000 7fc19b747640 1 -- 172.21.15.47:0/2866277792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19419efa0 con 0x7fc1941034f0 2024-07-24T22:16:42.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.499+0000 7fc18a7fc640 1 -- 172.21.15.47:0/2866277792 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190035070 con 0x7fc1941034f0 2024-07-24T22:16:42.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.499+0000 7fc19b747640 1 -- 172.21.15.47:0/2866277792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1941a56c0 con 0x7fc1941034f0 2024-07-24T22:16:42.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.501+0000 7fc19b747640 1 -- 172.21.15.47:0/2866277792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1941038d0 con 0x7fc1941034f0 2024-07-24T22:16:42.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.502+0000 7fc18a7fc640 1 -- 172.21.15.47:0/2866277792 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fc190042030 con 0x7fc1941034f0 2024-07-24T22:16:42.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.503+0000 7fc18a7fc640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1800b3dc0 0x7fc1800b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:42.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.503+0000 7fc198ce2640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1800b3dc0 0x7fc1800b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:42.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.503+0000 7fc18a7fc640 1 -- 172.21.15.47:0/2866277792 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7fc1901048e0 con 0x7fc1941034f0 2024-07-24T22:16:42.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.503+0000 7fc198ce2640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1800b3dc0 0x7fc1800b6280 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc19410f270 tx=0x7fc18400b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:42.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.507+0000 7fc18a7fc640 1 -- 172.21.15.47:0/2866277792 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fc1900cbb60 con 0x7fc1941034f0 2024-07-24T22:16:42.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.740+0000 7fc19b747640 1 -- 172.21.15.47:0/2866277792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc194199d90 con 0x7fc1941034f0 2024-07-24T22:16:42.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.740+0000 7fc18a7fc640 1 -- 172.21.15.47:0/2866277792 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7fc1900cb460 con 0x7fc1941034f0 2024-07-24T22:16:42.743 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:16:42.743 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:16:42.743 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:16:42.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.743+0000 7fc19b747640 1 -- 172.21.15.47:0/2866277792 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1800b3dc0 msgr2=0x7fc1800b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:42.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.743+0000 7fc19b747640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1800b3dc0 0x7fc1800b6280 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc19410f270 tx=0x7fc18400b390 comp rx=0 tx=0).stop 2024-07-24T22:16:42.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.743+0000 7fc19b747640 1 -- 172.21.15.47:0/2866277792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1941034f0 msgr2=0x7fc194198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:42.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.743+0000 7fc19b747640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1941034f0 0x7fc194198c60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc190005940 tx=0x7fc1900042f0 comp rx=0 tx=0).stop 2024-07-24T22:16:42.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.743+0000 7fc19b747640 1 -- 172.21.15.47:0/2866277792 shutdown_connections 2024-07-24T22:16:42.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.743+0000 7fc19b747640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc1800b3dc0 0x7fc1800b6280 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:42.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.743+0000 7fc19b747640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc19410caa0 0x7fc19419e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:42.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.743+0000 7fc19b747640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc194103ef0 0x7fc1941991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:42.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.743+0000 7fc19b747640 1 --2- 172.21.15.47:0/2866277792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1941034f0 0x7fc194198c60 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:42.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.743+0000 7fc19b747640 1 -- 172.21.15.47:0/2866277792 >> 172.21.15.47:0/2866277792 conn(0x7fc1940fd0c0 msgr2=0x7fc1940fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:42.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.743+0000 7fc19b747640 1 -- 172.21.15.47:0/2866277792 shutdown_connections 2024-07-24T22:16:42.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:42.743+0000 7fc19b747640 1 -- 172.21.15.47:0/2866277792 wait complete. 2024-07-24T22:16:43.050 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:42 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2866277792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:16:43.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:42 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2866277792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:16:43.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:42 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2866277792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:16:43.438 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db --set-id d00c7dd7 --release --await' 2024-07-24T22:16:43.438 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db --set-id d00c7dd7 --release --await 2024-07-24T22:16:43.709 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:16:44.136 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:43 smithi047 ceph-mon[32551]: pgmap v659: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:16:44.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:43 smithi188 ceph-mon[37380]: pgmap v659: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:16:44.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:43 smithi183 ceph-mon[37007]: pgmap v659: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:16:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.658+0000 7f8847c83640 1 -- 172.21.15.47:0/1528090575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8840102740 msgr2=0x7f8840102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.658+0000 7f8847c83640 1 --2- 172.21.15.47:0/1528090575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8840102740 0x7f8840102b20 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f883c009900 tx=0x7f883c02a3f0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.658+0000 7f8847c83640 1 -- 172.21.15.47:0/1528090575 shutdown_connections 2024-07-24T22:16:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.658+0000 7f8847c83640 1 --2- 172.21.15.47:0/1528090575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8840108ac0 0x7f884010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.658+0000 7f8847c83640 1 --2- 172.21.15.47:0/1528090575 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8840108140 0x7f8840108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.658+0000 7f8847c83640 1 --2- 172.21.15.47:0/1528090575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8840102740 0x7f8840102b20 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.658+0000 7f8847c83640 1 -- 172.21.15.47:0/1528090575 >> 172.21.15.47:0/1528090575 conn(0x7f88400fe180 msgr2=0x7f88401005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.658+0000 7f8847c83640 1 -- 172.21.15.47:0/1528090575 shutdown_connections 2024-07-24T22:16:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.658+0000 7f8847c83640 1 -- 172.21.15.47:0/1528090575 wait complete. 2024-07-24T22:16:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8847c83640 1 Processor -- start 2024-07-24T22:16:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8847c83640 1 -- start start 2024-07-24T22:16:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8847c83640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8840102740 0x7f8840074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8847c83640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8840108140 0x7f88400753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8847c83640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8840108ac0 0x7f8840075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8847c83640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f88401126f0 con 0x7f8840108ac0 2024-07-24T22:16:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8847c83640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8840112570 con 0x7f8840108140 2024-07-24T22:16:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8847c83640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8840112870 con 0x7f8840102740 2024-07-24T22:16:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8846220640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8840108ac0 0x7f8840075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8846220640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8840108ac0 0x7f8840075910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41010/0 (socket says 172.21.15.47:41010) 2024-07-24T22:16:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8846220640 1 -- 172.21.15.47:0/1621045093 learned_addr learned my addr 172.21.15.47:0/1621045093 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f884521e640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8840108140 0x7f88400753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8845a1f640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8840102740 0x7f8840074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8846220640 1 -- 172.21.15.47:0/1621045093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8840102740 msgr2=0x7f8840074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.659+0000 7f8846220640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8840102740 0x7f8840074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.660+0000 7f8846220640 1 -- 172.21.15.47:0/1621045093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8840108140 msgr2=0x7f88400753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.660+0000 7f8846220640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8840108140 0x7f88400753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.660+0000 7f8846220640 1 -- 172.21.15.47:0/1621045093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88401a7080 con 0x7f8840108ac0 2024-07-24T22:16:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.660+0000 7f884521e640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8840108140 0x7f88400753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.660+0000 7f8846220640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8840108ac0 0x7f8840075910 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f883800eaa0 tx=0x7f883800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.660+0000 7f8836ffd640 1 -- 172.21.15.47:0/1621045093 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883800cdb0 con 0x7f8840108ac0 2024-07-24T22:16:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.660+0000 7f8836ffd640 1 -- 172.21.15.47:0/1621045093 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8838005020 con 0x7f8840108ac0 2024-07-24T22:16:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.660+0000 7f8847c83640 1 -- 172.21.15.47:0/1621045093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88401a7370 con 0x7f8840108ac0 2024-07-24T22:16:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.660+0000 7f8836ffd640 1 -- 172.21.15.47:0/1621045093 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88380116d0 con 0x7f8840108ac0 2024-07-24T22:16:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.660+0000 7f8847c83640 1 -- 172.21.15.47:0/1621045093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88401a7870 con 0x7f8840108ac0 2024-07-24T22:16:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.663+0000 7f884a9d9740 1 Processor -- start 2024-07-24T22:16:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.663+0000 7f8836ffd640 1 -- 172.21.15.47:0/1621045093 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f88380051d0 con 0x7f8840108ac0 2024-07-24T22:16:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.663+0000 7f884a9d9740 1 -- start start 2024-07-24T22:16:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884a9d9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 0x557f65854ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884a9d9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658551e0 0x557f65860c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884a9d9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f65861170 0x557f65863560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884a9d9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557f657ca280 con 0x557f658548c0 2024-07-24T22:16:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884a9d9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557f657b9780 con 0x557f65861170 2024-07-24T22:16:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884a9d9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557f657bd7c0 con 0x557f658551e0 2024-07-24T22:16:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884521e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 0x557f65854ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884521e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 0x557f65854ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41012/0 (socket says 172.21.15.47:41012) 2024-07-24T22:16:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884521e640 1 -- 172.21.15.47:0/922958973 learned_addr learned my addr 172.21.15.47:0/922958973 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884521e640 1 --2- 172.21.15.47:0/922958973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f65861170 0x557f65863560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f8845a1f640 1 --2- 172.21.15.47:0/922958973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658551e0 0x557f65860c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884521e640 1 -- 172.21.15.47:0/922958973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658551e0 msgr2=0x557f65860c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884521e640 1 --2- 172.21.15.47:0/922958973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658551e0 0x557f65860c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884521e640 1 -- 172.21.15.47:0/922958973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f65861170 msgr2=0x557f65863560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884521e640 1 --2- 172.21.15.47:0/922958973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f65861170 0x557f65863560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f8836ffd640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f882c0b3d40 0x7f882c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884521e640 1 -- 172.21.15.47:0/922958973 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f6551d790 con 0x557f658548c0 2024-07-24T22:16:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f8846220640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f882c0b3d40 0x7f882c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f884521e640 1 --2- 172.21.15.47:0/922958973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 0x557f65854ca0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f8830013660 tx=0x7f883000b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86bb65a957333398 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.664+0000 7f8836ffd640 1 -- 172.21.15.47:0/1621045093 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f88380e4290 con 0x7f8840108ac0 2024-07-24T22:16:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.665+0000 7f882bfff640 1 -- 172.21.15.47:0/922958973 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830019070 con 0x557f658548c0 2024-07-24T22:16:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.665+0000 7f882bfff640 1 -- 172.21.15.47:0/922958973 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88300054d0 con 0x557f658548c0 2024-07-24T22:16:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.665+0000 7f882bfff640 1 -- 172.21.15.47:0/922958973 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830004bd0 con 0x557f658548c0 2024-07-24T22:16:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.665+0000 7f884a9d9740 1 -- 172.21.15.47:0/922958973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 msgr2=0x557f65854ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.665+0000 7f8846220640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f882c0b3d40 0x7f882c0b6200 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f88380aab70 tx=0x7f8838070130 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.665+0000 7f884a9d9740 1 --2- 172.21.15.47:0/922958973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 0x557f65854ca0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f8830013660 tx=0x7f883000b730 comp rx=0 tx=0).stop 2024-07-24T22:16:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.665+0000 7f884a9d9740 1 -- 172.21.15.47:0/922958973 shutdown_connections 2024-07-24T22:16:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.665+0000 7f884a9d9740 1 --2- 172.21.15.47:0/922958973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f65861170 0x557f65863560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.665+0000 7f884a9d9740 1 --2- 172.21.15.47:0/922958973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658551e0 0x557f65860c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.665+0000 7f884a9d9740 1 --2- 172.21.15.47:0/922958973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 0x557f65854ca0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.665+0000 7f884a9d9740 1 -- 172.21.15.47:0/922958973 >> 172.21.15.47:0/922958973 conn(0x557f658526f0 msgr2=0x557f65853890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.665+0000 7f884a9d9740 1 -- 172.21.15.47:0/922958973 shutdown_connections 2024-07-24T22:16:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.666+0000 7f884a9d9740 1 -- 172.21.15.47:0/922958973 wait complete. 2024-07-24T22:16:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.666+0000 7f884a9d9740 1 -- start start 2024-07-24T22:16:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.666+0000 7f884a9d9740 1 Processor -- start 2024-07-24T22:16:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.666+0000 7f884a9d9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658548c0 0x557f658608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.666+0000 7f884a9d9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 0x557f6585ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.666+0000 7f884a9d9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 0x557f6585e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.666+0000 7f884a9d9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557f656f3ab0 con 0x557f65861170 2024-07-24T22:16:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.666+0000 7f884a9d9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557f657419e0 con 0x557f658551e0 2024-07-24T22:16:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.666+0000 7f884a9d9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557f65863e50 con 0x557f658548c0 2024-07-24T22:16:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.666+0000 7f884a9d9740 10 client.0 _ll_register_callbacks cb 0x557f654c9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f884521e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 0x557f6585e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f884521e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 0x557f6585e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41014/0 (socket says 172.21.15.47:41014) 2024-07-24T22:16:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f884521e640 1 -- 172.21.15.47:0/3935010693 learned_addr learned my addr 172.21.15.47:0/3935010693 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f8845a1f640 1 --2- 172.21.15.47:0/3935010693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 0x557f6585ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f884521e640 1 --2- 172.21.15.47:0/3935010693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658548c0 0x557f658608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f884521e640 1 -- 172.21.15.47:0/3935010693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658548c0 msgr2=0x557f658608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f884521e640 1 --2- 172.21.15.47:0/3935010693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658548c0 0x557f658608d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f884521e640 1 -- 172.21.15.47:0/3935010693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 msgr2=0x557f6585ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f884521e640 1 --2- 172.21.15.47:0/3935010693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 0x557f6585ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f884521e640 1 -- 172.21.15.47:0/3935010693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f65596620 con 0x557f65861170 2024-07-24T22:16:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f884521e640 1 --2- 172.21.15.47:0/3935010693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 0x557f6585e2f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f883000ba20 tx=0x7f8830004870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f487890d0a5311b8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f88297fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f88297fa640 1 -- 172.21.15.47:0/3935010693 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830019070 con 0x557f65861170 2024-07-24T22:16:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f884a9d9740 1 -- 172.21.15.47:0/3935010693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f65768ce0 con 0x557f65861170 2024-07-24T22:16:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.667+0000 7f88297fa640 1 -- 172.21.15.47:0/3935010693 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f8830003a00 con 0x557f65861170 2024-07-24T22:16:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.668+0000 7f88297fa640 1 -- 172.21.15.47:0/3935010693 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8830003c00 con 0x557f65861170 2024-07-24T22:16:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.668+0000 7f884a9d9740 10 client.17547 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.668+0000 7f884a9d9740 1 -- 172.21.15.47:0/3935010693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557f6586f600 con 0x557f65861170 2024-07-24T22:16:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.668+0000 7f88297fa640 1 -- 172.21.15.47:0/3935010693 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557f65768ce0 con 0x557f65861170 2024-07-24T22:16:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.668+0000 7f88297fa640 1 -- 172.21.15.47:0/3935010693 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8830032070 con 0x557f65861170 2024-07-24T22:16:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.668+0000 7f884a9d9740 10 client.17547 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.668+0000 7f884a9d9740 10 client.17547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.668+0000 7f884a9d9740 20 client.17547 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.668+0000 7f884a9d9740 1 --2- 172.21.15.47:0/3935010693 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557f65870a60 0x557f65872e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.668+0000 7f884a9d9740 4 client.17547 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:16:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.668+0000 7f884a9d9740 1 -- 172.21.15.47:0/3935010693 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f657cc1d0 con 0x557f65870a60 2024-07-24T22:16:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.668+0000 7f8845a1f640 1 --2- 172.21.15.47:0/3935010693 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557f65870a60 0x557f65872e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.669+0000 7f88297fa640 10 client.17547 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.669+0000 7f8845a1f640 1 --2- 172.21.15.47:0/3935010693 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557f65870a60 0x557f65872e50 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e67fd8d60cedee6e server_cookie=1828d58d61157dd6 in_seq=0 out_seq=0 2024-07-24T22:16:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.669+0000 7f88297fa640 1 -- 172.21.15.47:0/3935010693 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f657cc1d0 con 0x557f65870a60 2024-07-24T22:16:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f88297fa640 10 client.17547 handle_command_reply: tid=0 2024-07-24T22:16:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f884a9d9740 1 client.17547 shutdown 2024-07-24T22:16:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f884a9d9740 1 -- 172.21.15.47:0/3935010693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 msgr2=0x557f6585e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f884a9d9740 1 --2- 172.21.15.47:0/3935010693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 0x557f6585e2f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f883000ba20 tx=0x7f8830004870 comp rx=0 tx=0).stop 2024-07-24T22:16:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f884a9d9740 1 -- 172.21.15.47:0/3935010693 shutdown_connections 2024-07-24T22:16:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f884a9d9740 1 --2- 172.21.15.47:0/3935010693 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557f65870a60 0x557f65872e50 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f884a9d9740 1 --2- 172.21.15.47:0/3935010693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 0x557f6585e2f0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f884a9d9740 1 --2- 172.21.15.47:0/3935010693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 0x557f6585ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f88297fa640 0 client.17547 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f884a9d9740 1 --2- 172.21.15.47:0/3935010693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658548c0 0x557f658608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f884a9d9740 1 -- 172.21.15.47:0/3935010693 >> 172.21.15.47:0/3935010693 conn(0x557f658526f0 msgr2=0x557f65858220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f884a9d9740 1 -- 172.21.15.47:0/3935010693 shutdown_connections 2024-07-24T22:16:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f884a9d9740 1 -- 172.21.15.47:0/3935010693 wait complete. 2024-07-24T22:16:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.670+0000 7f884a9d9740 20 client.17547 trim_cache size 0 max 16384 2024-07-24T22:16:44.689 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.685+0000 7f884a9d9740 1 Processor -- start 2024-07-24T22:16:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.685+0000 7f884a9d9740 1 -- start start 2024-07-24T22:16:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.685+0000 7f884a9d9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658548c0 0x557f6585d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.685+0000 7f884a9d9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 0x557f658785c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.685+0000 7f884a9d9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 0x557f65878b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.685+0000 7f884a9d9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f88401ae370 con 0x557f65861170 2024-07-24T22:16:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.685+0000 7f884a9d9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f88401b0bd0 con 0x557f658551e0 2024-07-24T22:16:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.685+0000 7f884a9d9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f88401ae9c0 con 0x557f658548c0 2024-07-24T22:16:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.686+0000 7f884521e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 0x557f65878b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.686+0000 7f884521e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 0x557f65878b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41028/0 (socket says 172.21.15.47:41028) 2024-07-24T22:16:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.686+0000 7f884521e640 1 -- 172.21.15.47:0/983337311 learned_addr learned my addr 172.21.15.47:0/983337311 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.686+0000 7f884521e640 1 --2- 172.21.15.47:0/983337311 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658548c0 0x557f6585d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.686+0000 7f884521e640 1 -- 172.21.15.47:0/983337311 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658548c0 msgr2=0x557f6585d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.686+0000 7f884521e640 1 --2- 172.21.15.47:0/983337311 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658548c0 0x557f6585d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.686+0000 7f884521e640 1 -- 172.21.15.47:0/983337311 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 msgr2=0x557f658785c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.686+0000 7f884521e640 1 --2- 172.21.15.47:0/983337311 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 0x557f658785c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.686+0000 7f884521e640 1 -- 172.21.15.47:0/983337311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f65852520 con 0x557f65861170 2024-07-24T22:16:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.686+0000 7f884521e640 1 --2- 172.21.15.47:0/983337311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 0x557f65878b00 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f8830013460 tx=0x7f8830015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd8c47fc339c006 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.686+0000 7f882b7fe640 1 -- 172.21.15.47:0/983337311 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830019070 con 0x557f65861170 2024-07-24T22:16:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.686+0000 7f882b7fe640 1 -- 172.21.15.47:0/983337311 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8830004250 con 0x557f65861170 2024-07-24T22:16:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.686+0000 7f882b7fe640 1 -- 172.21.15.47:0/983337311 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830038070 con 0x557f65861170 2024-07-24T22:16:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.687+0000 7f884a9d9740 1 -- 172.21.15.47:0/983337311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 msgr2=0x557f65878b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.687+0000 7f884a9d9740 1 --2- 172.21.15.47:0/983337311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 0x557f65878b00 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f8830013460 tx=0x7f8830015040 comp rx=0 tx=0).stop 2024-07-24T22:16:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.687+0000 7f884a9d9740 1 -- 172.21.15.47:0/983337311 shutdown_connections 2024-07-24T22:16:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.687+0000 7f884a9d9740 1 --2- 172.21.15.47:0/983337311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f65861170 0x557f65878b00 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.687+0000 7f884a9d9740 1 --2- 172.21.15.47:0/983337311 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 0x557f658785c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.687+0000 7f884a9d9740 1 --2- 172.21.15.47:0/983337311 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f658548c0 0x557f6585d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.687+0000 7f884a9d9740 1 -- 172.21.15.47:0/983337311 >> 172.21.15.47:0/983337311 conn(0x557f658526f0 msgr2=0x557f65859390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:44.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.687+0000 7f884a9d9740 1 -- 172.21.15.47:0/983337311 shutdown_connections 2024-07-24T22:16:44.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.687+0000 7f884a9d9740 1 -- 172.21.15.47:0/983337311 wait complete. 2024-07-24T22:16:44.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.687+0000 7f884a9d9740 1 -- start start 2024-07-24T22:16:44.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.687+0000 7f884a9d9740 1 Processor -- start 2024-07-24T22:16:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884a9d9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 0x557f658695b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884a9d9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 0x557f658640a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884a9d9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f65861170 0x557f658645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884a9d9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f88401af090 con 0x557f658548c0 2024-07-24T22:16:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884a9d9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f88401b0500 con 0x557f658551e0 2024-07-24T22:16:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884a9d9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f88401af760 con 0x557f65861170 2024-07-24T22:16:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884a9d9740 10 client.0 _ll_register_callbacks cb 0x7f8830013490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884521e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 0x557f658695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884521e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 0x557f658695b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41030/0 (socket says 172.21.15.47:41030) 2024-07-24T22:16:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884521e640 1 -- 172.21.15.47:0/1941550046 learned_addr learned my addr 172.21.15.47:0/1941550046 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f8845a1f640 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 0x557f658640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884521e640 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f65861170 0x557f658645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884521e640 1 -- 172.21.15.47:0/1941550046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f65861170 msgr2=0x557f658645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884521e640 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f65861170 0x557f658645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884521e640 1 -- 172.21.15.47:0/1941550046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 msgr2=0x557f658640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884521e640 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 0x557f658640a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f884521e640 1 -- 172.21.15.47:0/1941550046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f658555c0 con 0x557f658548c0 2024-07-24T22:16:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.688+0000 7f8845a1f640 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 0x557f658640a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:16:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f884521e640 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 0x557f658695b0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f8830006010 tx=0x7f8830013140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce17a0b1aa23da3 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f88297fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f88297fa640 1 -- 172.21.15.47:0/1941550046 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830038070 con 0x557f658548c0 2024-07-24T22:16:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f88297fa640 1 -- 172.21.15.47:0/1941550046 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f883002b8a0 con 0x557f658548c0 2024-07-24T22:16:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f884a9d9740 1 -- 172.21.15.47:0/1941550046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f657c7c70 con 0x557f658548c0 2024-07-24T22:16:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f88297fa640 1 -- 172.21.15.47:0/1941550046 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8830019070 con 0x557f658548c0 2024-07-24T22:16:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f884a9d9740 10 client.17553 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f884a9d9740 1 -- 172.21.15.47:0/1941550046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557f658da230 con 0x557f658548c0 2024-07-24T22:16:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f88297fa640 1 -- 172.21.15.47:0/1941550046 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557f657c7c70 con 0x557f658548c0 2024-07-24T22:16:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f88297fa640 1 -- 172.21.15.47:0/1941550046 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8830032040 con 0x557f658548c0 2024-07-24T22:16:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f884a9d9740 10 client.17553 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f884a9d9740 10 client.17553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f884a9d9740 20 client.17553 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f884a9d9740 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557f658da7e0 0x557f658dcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f884a9d9740 4 client.17553 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:16:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.689+0000 7f884a9d9740 1 -- 172.21.15.47:0/1941550046 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f657c53b0 con 0x557f658da7e0 2024-07-24T22:16:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.690+0000 7f8845a1f640 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557f658da7e0 0x557f658dcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.690+0000 7f8845a1f640 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557f658da7e0 0x557f658dcc00 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=474cb9b3df35d81e server_cookie=e4dbb88296f1da1c in_seq=0 out_seq=0 2024-07-24T22:16:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.690+0000 7f88297fa640 10 client.17553 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.695+0000 7f88297fa640 1 -- 172.21.15.47:0/1941550046 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f657c53b0 con 0x557f658da7e0 2024-07-24T22:16:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.695+0000 7f88297fa640 10 client.17553 handle_command_reply: tid=0 2024-07-24T22:16:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.695+0000 7f884a9d9740 1 client.17553 shutdown 2024-07-24T22:16:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.695+0000 7f884a9d9740 1 -- 172.21.15.47:0/1941550046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 msgr2=0x557f658695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.695+0000 7f884a9d9740 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 0x557f658695b0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f8830006010 tx=0x7f8830013140 comp rx=0 tx=0).stop 2024-07-24T22:16:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f884a9d9740 1 -- 172.21.15.47:0/1941550046 shutdown_connections 2024-07-24T22:16:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f884a9d9740 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557f658da7e0 0x557f658dcc00 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f884a9d9740 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557f65861170 0x557f658645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f884a9d9740 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557f658551e0 0x557f658640a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f884a9d9740 1 --2- 172.21.15.47:0/1941550046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557f658548c0 0x557f658695b0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f884a9d9740 1 -- 172.21.15.47:0/1941550046 >> 172.21.15.47:0/1941550046 conn(0x557f658526f0 msgr2=0x557f65857a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f88297fa640 0 client.17553 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f884a9d9740 1 -- 172.21.15.47:0/1941550046 shutdown_connections 2024-07-24T22:16:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f884a9d9740 1 -- 172.21.15.47:0/1941550046 wait complete. 2024-07-24T22:16:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f884a9d9740 20 client.17553 trim_cache size 0 max 16384 2024-07-24T22:16:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:16:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:16:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:16:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:16:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f8847c83640 1 -- 172.21.15.47:0/1621045093 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f882c0b3d40 msgr2=0x7f882c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f8847c83640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f882c0b3d40 0x7f882c0b6200 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f88380aab70 tx=0x7f8838070130 comp rx=0 tx=0).stop 2024-07-24T22:16:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f8847c83640 1 -- 172.21.15.47:0/1621045093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8840108ac0 msgr2=0x7f8840075910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f8847c83640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8840108ac0 0x7f8840075910 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f883800eaa0 tx=0x7f883800ef60 comp rx=0 tx=0).stop 2024-07-24T22:16:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f8847c83640 1 -- 172.21.15.47:0/1621045093 shutdown_connections 2024-07-24T22:16:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f8847c83640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f882c0b3d40 0x7f882c0b6200 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f8847c83640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8840108ac0 0x7f8840075910 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f8847c83640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8840108140 0x7f88400753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f8847c83640 1 --2- 172.21.15.47:0/1621045093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8840102740 0x7f8840074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f8847c83640 1 -- 172.21.15.47:0/1621045093 >> 172.21.15.47:0/1621045093 conn(0x7f88400fe180 msgr2=0x7f88400feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f8847c83640 1 -- 172.21.15.47:0/1621045093 shutdown_connections 2024-07-24T22:16:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:44.696+0000 7f8847c83640 1 -- 172.21.15.47:0/1621045093 wait complete. 2024-07-24T22:16:45.121 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:44 smithi047 ceph-mon[32551]: pgmap v660: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-07-24T22:16:45.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:44 smithi188 ceph-mon[37380]: pgmap v660: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-07-24T22:16:45.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.350+0000 7f8a9c4ff640 1 -- 172.21.15.47:0/534059321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a94103f90 msgr2=0x7f8a9410c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:45.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.350+0000 7f8a9c4ff640 1 --2- 172.21.15.47:0/534059321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a94103f90 0x7f8a9410c570 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009900 tx=0x7f8a8402a410 comp rx=0 tx=0).stop 2024-07-24T22:16:45.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.350+0000 7f8a9c4ff640 1 -- 172.21.15.47:0/534059321 shutdown_connections 2024-07-24T22:16:45.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.350+0000 7f8a9c4ff640 1 --2- 172.21.15.47:0/534059321 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a9410cb40 0x7f8a9410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.350+0000 7f8a9c4ff640 1 --2- 172.21.15.47:0/534059321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a94103f90 0x7f8a9410c570 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.350+0000 7f8a9c4ff640 1 --2- 172.21.15.47:0/534059321 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a94103590 0x7f8a94103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.350+0000 7f8a9c4ff640 1 -- 172.21.15.47:0/534059321 >> 172.21.15.47:0/534059321 conn(0x7f8a940fd100 msgr2=0x7f8a940ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:45.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.350+0000 7f8a9c4ff640 1 -- 172.21.15.47:0/534059321 shutdown_connections 2024-07-24T22:16:45.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.350+0000 7f8a9c4ff640 1 -- 172.21.15.47:0/534059321 wait complete. 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.351+0000 7f8a9c4ff640 1 Processor -- start 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.351+0000 7f8a9c4ff640 1 -- start start 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.352+0000 7f8a9c4ff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a94103590 0x7f8a94198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.352+0000 7f8a9c4ff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a94103f90 0x7f8a94199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.352+0000 7f8a9c4ff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a9410cb40 0x7f8a9419e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.352+0000 7f8a9c4ff640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8a94112740 con 0x7f8a94103f90 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.352+0000 7f8a9c4ff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941125c0 con 0x7f8a94103590 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.352+0000 7f8a9c4ff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941128c0 con 0x7f8a9410cb40 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.352+0000 7f8a99a9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a94103f90 0x7f8a94199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.352+0000 7f8a9a29b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a94103590 0x7f8a94198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.352+0000 7f8a99a9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a94103f90 0x7f8a94199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42564/0 (socket says 172.21.15.47:42564) 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.352+0000 7f8a99a9a640 1 -- 172.21.15.47:0/1105992255 learned_addr learned my addr 172.21.15.47:0/1105992255 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.352+0000 7f8a9a29b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a94103590 0x7f8a94198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:43962/0 (socket says 172.21.15.47:43962) 2024-07-24T22:16:45.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.352+0000 7f8a9aa9c640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a9410cb40 0x7f8a9419e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.353+0000 7f8a9a29b640 1 -- 172.21.15.47:0/1105992255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a9410cb40 msgr2=0x7f8a9419e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:45.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.353+0000 7f8a9a29b640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a9410cb40 0x7f8a9419e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.353+0000 7f8a9a29b640 1 -- 172.21.15.47:0/1105992255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a94103f90 msgr2=0x7f8a94199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:45.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.353+0000 7f8a9a29b640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a94103f90 0x7f8a94199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.353+0000 7f8a9a29b640 1 -- 172.21.15.47:0/1105992255 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9419eca0 con 0x7f8a94103590 2024-07-24T22:16:45.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.353+0000 7f8a99a9a640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a94103f90 0x7f8a94199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:16:45.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.353+0000 7f8a9a29b640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a94103590 0x7f8a94198bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000c970 tx=0x7f8a9000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:45.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.353+0000 7f8a8b7fe640 1 -- 172.21.15.47:0/1105992255 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a90007bb0 con 0x7f8a94103590 2024-07-24T22:16:45.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.353+0000 7f8a9c4ff640 1 -- 172.21.15.47:0/1105992255 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9419ef90 con 0x7f8a94103590 2024-07-24T22:16:45.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.353+0000 7f8a8b7fe640 1 -- 172.21.15.47:0/1105992255 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a90007d50 con 0x7f8a94103590 2024-07-24T22:16:45.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.353+0000 7f8a8b7fe640 1 -- 172.21.15.47:0/1105992255 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a90018780 con 0x7f8a94103590 2024-07-24T22:16:45.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.353+0000 7f8a9c4ff640 1 -- 172.21.15.47:0/1105992255 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a941a5650 con 0x7f8a94103590 2024-07-24T22:16:45.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.355+0000 7f8a9e8b0740 1 Processor -- start 2024-07-24T22:16:45.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.356+0000 7f8a9e8b0740 1 -- start start 2024-07-24T22:16:45.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.356+0000 7f8a9e8b0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dd1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.356+0000 7f8a9e8b0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 0x55e3f9dddda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.356+0000 7f8a9e8b0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dde2e0 0x55e3f9de06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.356+0000 7f8a9e8b0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e3f9d48dd0 con 0x55e3f9dd2350 2024-07-24T22:16:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.356+0000 7f8a9e8b0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e3f9d382d0 con 0x55e3f9dd1a30 2024-07-24T22:16:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.356+0000 7f8a9e8b0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e3f9d3c310 con 0x55e3f9dde2e0 2024-07-24T22:16:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.356+0000 7f8a8b7fe640 1 -- 172.21.15.47:0/1105992255 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8a9000f450 con 0x7f8a94103590 2024-07-24T22:16:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.356+0000 7f8a9a29b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 0x55e3f9dddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.356+0000 7f8a9a29b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 0x55e3f9dddda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42566/0 (socket says 172.21.15.47:42566) 2024-07-24T22:16:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.356+0000 7f8a9a29b640 1 -- 172.21.15.47:0/2193462052 learned_addr learned my addr 172.21.15.47:0/2193462052 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.356+0000 7f8a9aa9c640 1 --2- 172.21.15.47:0/2193462052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dd1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.356+0000 7f8a99a9a640 1 --2- 172.21.15.47:0/2193462052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dde2e0 0x55e3f9de06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.357+0000 7f8a9a29b640 1 -- 172.21.15.47:0/2193462052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dde2e0 msgr2=0x55e3f9de06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.357+0000 7f8a9a29b640 1 --2- 172.21.15.47:0/2193462052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dde2e0 0x55e3f9de06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.357+0000 7f8a9a29b640 1 -- 172.21.15.47:0/2193462052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 msgr2=0x55e3f9dd1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:45.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.357+0000 7f8a9a29b640 1 --2- 172.21.15.47:0/2193462052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dd1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.357+0000 7f8a9a29b640 1 -- 172.21.15.47:0/2193462052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3f9a98b00 con 0x55e3f9dd2350 2024-07-24T22:16:45.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.357+0000 7f8a9a29b640 1 --2- 172.21.15.47:0/2193462052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 0x55e3f9dddda0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f8a900e16b0 tx=0x7f8a900e7f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49e111c78753dc9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:45.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.357+0000 7f8a8b7fe640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8a800b3d40 0x7f8a800b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.357+0000 7f8a88ff9640 1 -- 172.21.15.47:0/2193462052 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a900f7070 con 0x55e3f9dd2350 2024-07-24T22:16:45.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.357+0000 7f8a88ff9640 1 -- 172.21.15.47:0/2193462052 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a900aa710 con 0x55e3f9dd2350 2024-07-24T22:16:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.357+0000 7f8a9aa9c640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8a800b3d40 0x7f8a800b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.357+0000 7f8a8b7fe640 1 -- 172.21.15.47:0/1105992255 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f8a900e4020 con 0x7f8a94103590 2024-07-24T22:16:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.357+0000 7f8a88ff9640 1 -- 172.21.15.47:0/2193462052 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a900ab300 con 0x55e3f9dd2350 2024-07-24T22:16:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.358+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2193462052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 msgr2=0x55e3f9dddda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.358+0000 7f8a9aa9c640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8a800b3d40 0x7f8a800b6200 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8a9406bf30 tx=0x7f8a8c009500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.358+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2193462052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 0x55e3f9dddda0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f8a900e16b0 tx=0x7f8a900e7f90 comp rx=0 tx=0).stop 2024-07-24T22:16:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.358+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2193462052 shutdown_connections 2024-07-24T22:16:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.358+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2193462052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dde2e0 0x55e3f9de06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.358+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2193462052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 0x55e3f9dddda0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.358+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2193462052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dd1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.358+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2193462052 >> 172.21.15.47:0/2193462052 conn(0x55e3f9dcf860 msgr2=0x55e3f9dd0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.358+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2193462052 shutdown_connections 2024-07-24T22:16:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.358+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2193462052 wait complete. 2024-07-24T22:16:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9e8b0740 1 -- start start 2024-07-24T22:16:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9e8b0740 1 Processor -- start 2024-07-24T22:16:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9e8b0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dddd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9e8b0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dd2350 0x55e3f9ddb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9e8b0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dde2e0 0x55e3f9ddb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9e8b0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e3f9b9bbb0 con 0x55e3f9dd1a30 2024-07-24T22:16:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9e8b0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e3f9cda900 con 0x55e3f9dde2e0 2024-07-24T22:16:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9e8b0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e3f9de0fb0 con 0x55e3f9dd2350 2024-07-24T22:16:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9e8b0740 10 client.0 _ll_register_callbacks cb 0x55e3f9ce4c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9a29b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dddd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9a29b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dddd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42582/0 (socket says 172.21.15.47:42582) 2024-07-24T22:16:45.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9a29b640 1 -- 172.21.15.47:0/2078733045 learned_addr learned my addr 172.21.15.47:0/2078733045 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:45.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9aa9c640 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dde2e0 0x55e3f9ddb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a99a9a640 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dd2350 0x55e3f9ddb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9a29b640 1 -- 172.21.15.47:0/2078733045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dd2350 msgr2=0x55e3f9ddb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:45.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9a29b640 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dd2350 0x55e3f9ddb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9a29b640 1 -- 172.21.15.47:0/2078733045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dde2e0 msgr2=0x55e3f9ddb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:45.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9a29b640 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dde2e0 0x55e3f9ddb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9a29b640 1 -- 172.21.15.47:0/2078733045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3f9b0f960 con 0x55e3f9dd1a30 2024-07-24T22:16:45.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.359+0000 7f8a9aa9c640 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dde2e0 0x55e3f9ddb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:16:45.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a9a29b640 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dddd60 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f8a900aa4e0 tx=0x7f8a900aa9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36be9556598329f5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:45.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a7dffb640 1 -- 172.21.15.47:0/2078733045 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a900a6ac0 con 0x55e3f9dd1a30 2024-07-24T22:16:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a7dffb640 1 -- 172.21.15.47:0/2078733045 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f8a900e7350 con 0x55e3f9dd1a30 2024-07-24T22:16:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2078733045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a900aa710 con 0x55e3f9dd1a30 2024-07-24T22:16:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a7dffb640 1 -- 172.21.15.47:0/2078733045 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8a900aa550 con 0x55e3f9dd1a30 2024-07-24T22:16:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a9e8b0740 10 client.17565 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2078733045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e3f9decaa0 con 0x55e3f9dd1a30 2024-07-24T22:16:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a7dffb640 1 -- 172.21.15.47:0/2078733045 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a900aa710 con 0x55e3f9dd1a30 2024-07-24T22:16:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a7dffb640 1 -- 172.21.15.47:0/2078733045 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8a900a6e90 con 0x55e3f9dd1a30 2024-07-24T22:16:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a9e8b0740 10 client.17565 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a9e8b0740 10 client.17565 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:16:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a9e8b0740 20 client.17565 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e3f9deddf0 0x55e3f9df01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a9e8b0740 4 client.17565 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:16:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.360+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2078733045 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3f9d4ad20 con 0x55e3f9deddf0 2024-07-24T22:16:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.361+0000 7f8a99a9a640 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e3f9deddf0 0x55e3f9df01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.361+0000 7f8a99a9a640 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e3f9deddf0 0x55e3f9df01e0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1be013dab8ef2c8d server_cookie=b45ffcd6c223e15c in_seq=0 out_seq=0 2024-07-24T22:16:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.361+0000 7f8a7dffb640 10 client.17565 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a7dffb640 1 -- 172.21.15.47:0/2078733045 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3f9d4ad20 con 0x55e3f9deddf0 2024-07-24T22:16:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a7dffb640 10 client.17565 handle_command_reply: tid=0 2024-07-24T22:16:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a9e8b0740 1 client.17565 shutdown 2024-07-24T22:16:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2078733045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd1a30 msgr2=0x55e3f9dddd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dddd60 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f8a900aa4e0 tx=0x7f8a900aa9d0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2078733045 shutdown_connections 2024-07-24T22:16:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e3f9deddf0 0x55e3f9df01e0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dde2e0 0x55e3f9ddb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a7dffb640 0 client.17565 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:45.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dd2350 0x55e3f9ddb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2078733045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dddd60 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2078733045 >> 172.21.15.47:0/2078733045 conn(0x55e3f9dcf860 msgr2=0x55e3f9dd5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:45.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2078733045 shutdown_connections 2024-07-24T22:16:45.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2078733045 wait complete. 2024-07-24T22:16:45.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.362+0000 7f8a9e8b0740 20 client.17565 trim_cache size 0 max 16384 2024-07-24T22:16:45.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.380+0000 7f8a9e8b0740 1 Processor -- start 2024-07-24T22:16:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.380+0000 7f8a9e8b0740 1 -- start start 2024-07-24T22:16:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9e8b0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dd5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9e8b0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dd2350 0x55e3f9dd0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9e8b0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dde2e0 0x55e3f9ddce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9e8b0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941ac150 con 0x55e3f9dde2e0 2024-07-24T22:16:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9e8b0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941ae9b0 con 0x55e3f9dd1a30 2024-07-24T22:16:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9e8b0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941ac7a0 con 0x55e3f9dd2350 2024-07-24T22:16:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9aa9c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dde2e0 0x55e3f9ddce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9aa9c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dde2e0 0x55e3f9ddce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42594/0 (socket says 172.21.15.47:42594) 2024-07-24T22:16:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9aa9c640 1 -- 172.21.15.47:0/2057013478 learned_addr learned my addr 172.21.15.47:0/2057013478 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9a29b640 1 --2- 172.21.15.47:0/2057013478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dd5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a99a9a640 1 --2- 172.21.15.47:0/2057013478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dd2350 0x55e3f9dd0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9aa9c640 1 -- 172.21.15.47:0/2057013478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dd2350 msgr2=0x55e3f9dd0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9aa9c640 1 --2- 172.21.15.47:0/2057013478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dd2350 0x55e3f9dd0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9aa9c640 1 -- 172.21.15.47:0/2057013478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 msgr2=0x55e3f9dd5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9aa9c640 1 --2- 172.21.15.47:0/2057013478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dd5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.381+0000 7f8a9aa9c640 1 -- 172.21.15.47:0/2057013478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3f9ddbc70 con 0x55e3f9dde2e0 2024-07-24T22:16:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.382+0000 7f8a9aa9c640 1 --2- 172.21.15.47:0/2057013478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dde2e0 0x55e3f9ddce50 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c003d50 tx=0x7f8a8c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7d46a92b61fa15 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:45.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.382+0000 7f8a7ffff640 1 -- 172.21.15.47:0/2057013478 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c004b20 con 0x55e3f9dde2e0 2024-07-24T22:16:45.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.382+0000 7f8a7ffff640 1 -- 172.21.15.47:0/2057013478 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a8c004cc0 con 0x55e3f9dde2e0 2024-07-24T22:16:45.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.382+0000 7f8a7ffff640 1 -- 172.21.15.47:0/2057013478 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c005020 con 0x55e3f9dde2e0 2024-07-24T22:16:45.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.382+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2057013478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dde2e0 msgr2=0x55e3f9ddce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:45.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.382+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2057013478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dde2e0 0x55e3f9ddce50 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c003d50 tx=0x7f8a8c016000 comp rx=0 tx=0).stop 2024-07-24T22:16:45.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.382+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2057013478 shutdown_connections 2024-07-24T22:16:45.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.382+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2057013478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dde2e0 0x55e3f9ddce50 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.382+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2057013478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dd2350 0x55e3f9dd0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.382+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/2057013478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 0x55e3f9dd5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.382+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2057013478 >> 172.21.15.47:0/2057013478 conn(0x55e3f9dcf860 msgr2=0x55e3f9dce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:45.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.383+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2057013478 shutdown_connections 2024-07-24T22:16:45.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.383+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/2057013478 wait complete. 2024-07-24T22:16:45.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.383+0000 7f8a9e8b0740 1 -- start start 2024-07-24T22:16:45.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.383+0000 7f8a9e8b0740 1 Processor -- start 2024-07-24T22:16:45.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.383+0000 7f8a9e8b0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 0x55e3f9df3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.383+0000 7f8a9e8b0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 0x55e3f9defc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.383+0000 7f8a9e8b0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dde2e0 0x55e3f9df0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.383+0000 7f8a9e8b0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941ace70 con 0x55e3f9dd2350 2024-07-24T22:16:45.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.383+0000 7f8a9e8b0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941ae2e0 con 0x55e3f9dd1a30 2024-07-24T22:16:45.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.383+0000 7f8a9e8b0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941ad540 con 0x55e3f9dde2e0 2024-07-24T22:16:45.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.383+0000 7f8a9e8b0740 10 client.0 _ll_register_callbacks cb 0x7f8a84009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:45.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a9a29b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 0x55e3f9df3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a99a9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 0x55e3f9defc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a9a29b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 0x55e3f9df3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:43998/0 (socket says 172.21.15.47:43998) 2024-07-24T22:16:45.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a9a29b640 1 -- 172.21.15.47:0/1008535761 learned_addr learned my addr 172.21.15.47:0/1008535761 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:45.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a99a9a640 1 --2- 172.21.15.47:0/1008535761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 0x55e3f9defc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42610/0 (socket says 172.21.15.47:42610) 2024-07-24T22:16:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a99a9a640 1 -- 172.21.15.47:0/1008535761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dde2e0 msgr2=0x55e3f9df0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a99a9a640 1 --2- 172.21.15.47:0/1008535761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dde2e0 0x55e3f9df0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a99a9a640 1 -- 172.21.15.47:0/1008535761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 msgr2=0x55e3f9df3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a99a9a640 1 --2- 172.21.15.47:0/1008535761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 0x55e3f9df3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a99a9a640 1 -- 172.21.15.47:0/1008535761 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3f9df0840 con 0x55e3f9dd2350 2024-07-24T22:16:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a99a9a640 1 --2- 172.21.15.47:0/1008535761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 0x55e3f9defc10 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f8a84004770 tx=0x7f8a840042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4c59ac3ff79d3b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a7dffb640 1 -- 172.21.15.47:0/1008535761 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84035040 con 0x55e3f9dd2350 2024-07-24T22:16:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a7dffb640 1 -- 172.21.15.47:0/1008535761 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f8a84005220 con 0x55e3f9dd2350 2024-07-24T22:16:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.384+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/1008535761 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a8c004cc0 con 0x55e3f9dd2350 2024-07-24T22:16:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.385+0000 7f8a7dffb640 1 -- 172.21.15.47:0/1008535761 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8a84059050 con 0x55e3f9dd2350 2024-07-24T22:16:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.385+0000 7f8a9e8b0740 10 client.17571 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.385+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/1008535761 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e3f9e596b0 con 0x55e3f9dd2350 2024-07-24T22:16:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.385+0000 7f8a7dffb640 1 -- 172.21.15.47:0/1008535761 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a8c004cc0 con 0x55e3f9dd2350 2024-07-24T22:16:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.385+0000 7f8a7dffb640 1 -- 172.21.15.47:0/1008535761 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8a84004810 con 0x55e3f9dd2350 2024-07-24T22:16:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.385+0000 7f8a9e8b0740 10 client.17571 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.385+0000 7f8a9e8b0740 10 client.17571 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:16:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.385+0000 7f8a9e8b0740 20 client.17571 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.385+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/1008535761 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e3f9e59e10 0x55e3f9e5c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.385+0000 7f8a9e8b0740 4 client.17571 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d00c7dd7", "release": true, "await": true}] 2024-07-24T22:16:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.385+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/1008535761 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d00c7dd7", "release": true, "await": true}) -- 0x55e3f9d467c0 con 0x55e3f9e59e10 2024-07-24T22:16:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.385+0000 7f8a9a29b640 1 --2- 172.21.15.47:0/1008535761 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e3f9e59e10 0x55e3f9e5c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.386+0000 7f8a9a29b640 1 --2- 172.21.15.47:0/1008535761 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e3f9e59e10 0x55e3f9e5c230 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5c7c1e023f661fd server_cookie=688301df3fd55ae8 in_seq=0 out_seq=0 2024-07-24T22:16:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.386+0000 7f8a7dffb640 10 client.17571 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:45.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a7dffb640 1 -- 172.21.15.47:0/1008535761 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e3f9d467c0 con 0x55e3f9e59e10 2024-07-24T22:16:45.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a7dffb640 10 client.17571 handle_command_reply: tid=0 2024-07-24T22:16:45.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a9e8b0740 1 client.17571 shutdown 2024-07-24T22:16:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/1008535761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 msgr2=0x55e3f9defc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/1008535761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 0x55e3f9defc10 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f8a84004770 tx=0x7f8a840042c0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/1008535761 shutdown_connections 2024-07-24T22:16:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/1008535761 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e3f9e59e10 0x55e3f9e5c230 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/1008535761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e3f9dde2e0 0x55e3f9df0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/1008535761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3f9dd2350 0x55e3f9defc10 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a9e8b0740 1 --2- 172.21.15.47:0/1008535761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e3f9dd1a30 0x55e3f9df3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/1008535761 >> 172.21.15.47:0/1008535761 conn(0x55e3f9dcf860 msgr2=0x55e3f9de9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a7dffb640 0 client.17571 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/1008535761 shutdown_connections 2024-07-24T22:16:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a9e8b0740 1 -- 172.21.15.47:0/1008535761 wait complete. 2024-07-24T22:16:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.388+0000 7f8a9e8b0740 20 client.17571 trim_cache size 0 max 16384 2024-07-24T22:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 28, 2024-07-24T22:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "d00c7dd7": { 2024-07-24T22:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 28, 2024-07-24T22:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:16:45.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 141.3, 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:16:45.395 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:16:45.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.389+0000 7f8a9c4ff640 1 -- 172.21.15.47:0/1105992255 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8a800b3d40 msgr2=0x7f8a800b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:45.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.389+0000 7f8a9c4ff640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8a800b3d40 0x7f8a800b6200 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8a9406bf30 tx=0x7f8a8c009500 comp rx=0 tx=0).stop 2024-07-24T22:16:45.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.389+0000 7f8a9c4ff640 1 -- 172.21.15.47:0/1105992255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a94103590 msgr2=0x7f8a94198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:45.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.389+0000 7f8a9c4ff640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a94103590 0x7f8a94198bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000c970 tx=0x7f8a9000ce30 comp rx=0 tx=0).stop 2024-07-24T22:16:45.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.389+0000 7f8a9c4ff640 1 -- 172.21.15.47:0/1105992255 shutdown_connections 2024-07-24T22:16:45.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.389+0000 7f8a9c4ff640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8a800b3d40 0x7f8a800b6200 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.389+0000 7f8a9c4ff640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a9410cb40 0x7f8a9419e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.389+0000 7f8a9c4ff640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a94103f90 0x7f8a94199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.389+0000 7f8a9c4ff640 1 --2- 172.21.15.47:0/1105992255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a94103590 0x7f8a94198bf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:45.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.389+0000 7f8a9c4ff640 1 -- 172.21.15.47:0/1105992255 >> 172.21.15.47:0/1105992255 conn(0x7f8a940fd100 msgr2=0x7f8a9410ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:45.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.389+0000 7f8a9c4ff640 1 -- 172.21.15.47:0/1105992255 shutdown_connections 2024-07-24T22:16:45.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:16:45.389+0000 7f8a9c4ff640 1 -- 172.21.15.47:0/1105992255 wait complete. 2024-07-24T22:16:45.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:44 smithi183 ceph-mon[37007]: pgmap v660: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-07-24T22:16:46.077 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd00c7dd7', total seconds elapsed: 26.8 2024-07-24T22:16:47.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:47 smithi183 ceph-mon[37007]: pgmap v661: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:16:47.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:47 smithi047 ceph-mon[32551]: pgmap v661: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:16:47.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:47 smithi188 ceph-mon[37380]: pgmap v661: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:16:49.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:49 smithi183 ceph-mon[37007]: pgmap v662: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:16:49.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:49 smithi047 ceph-mon[32551]: pgmap v662: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:16:49.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:49 smithi188 ceph-mon[37380]: pgmap v662: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:16:51.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:51 smithi183 ceph-mon[37007]: pgmap v663: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:16:51.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:51 smithi047 ceph-mon[32551]: pgmap v663: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:16:51.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:51 smithi188 ceph-mon[37380]: pgmap v663: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:16:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:53 smithi183 ceph-mon[37007]: pgmap v664: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:16:53.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:53 smithi047 ceph-mon[32551]: pgmap v664: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:16:53.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:53 smithi188 ceph-mon[37380]: pgmap v664: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:16:55.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:55 smithi183 ceph-mon[37007]: pgmap v665: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:16:55.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:55 smithi047 ceph-mon[32551]: pgmap v665: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:16:55.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:55 smithi188 ceph-mon[37380]: pgmap v665: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:16:57.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:57 smithi183 ceph-mon[37007]: pgmap v666: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:16:57.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:57 smithi047 ceph-mon[32551]: pgmap v666: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:16:57.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:57 smithi188 ceph-mon[37380]: pgmap v666: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-07-24T22:16:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.798+0000 7f9bc074b640 1 -- 172.21.15.47:0/2440555505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9bb81011e0 msgr2=0x7f9bb81015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.798+0000 7f9bc074b640 1 --2- 172.21.15.47:0/2440555505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9bb81011e0 0x7f9bb81015c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009900 tx=0x7f9bb402a410 comp rx=0 tx=0).stop 2024-07-24T22:16:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.798+0000 7f9bc074b640 1 -- 172.21.15.47:0/2440555505 shutdown_connections 2024-07-24T22:16:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.798+0000 7f9bc074b640 1 --2- 172.21.15.47:0/2440555505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bb8103f20 0x7f9bb810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.798+0000 7f9bc074b640 1 --2- 172.21.15.47:0/2440555505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bb81035a0 0x7f9bb81039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.798+0000 7f9bc074b640 1 --2- 172.21.15.47:0/2440555505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9bb81011e0 0x7f9bb81015c0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.798+0000 7f9bc074b640 1 -- 172.21.15.47:0/2440555505 >> 172.21.15.47:0/2440555505 conn(0x7f9bb8076730 msgr2=0x7f9bb8076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.798+0000 7f9bc074b640 1 -- 172.21.15.47:0/2440555505 shutdown_connections 2024-07-24T22:16:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.798+0000 7f9bc074b640 1 -- 172.21.15.47:0/2440555505 wait complete. 2024-07-24T22:16:57.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bc074b640 1 Processor -- start 2024-07-24T22:16:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bc074b640 1 -- start start 2024-07-24T22:16:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bc074b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9bb81011e0 0x7f9bb80fe070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bc074b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bb81035a0 0x7f9bb80fe5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bc074b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bb8103f20 0x7f9bb80feaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bc074b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb8110e20 con 0x7f9bb81011e0 2024-07-24T22:16:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bc074b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb8110ca0 con 0x7f9bb81035a0 2024-07-24T22:16:57.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bc074b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb8110fa0 con 0x7f9bb8103f20 2024-07-24T22:16:57.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bbe4e7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9bb81011e0 0x7f9bb80fe070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bbe4e7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9bb81011e0 0x7f9bb80fe070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57052/0 (socket says 172.21.15.47:57052) 2024-07-24T22:16:57.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bbe4e7640 1 -- 172.21.15.47:0/336629000 learned_addr learned my addr 172.21.15.47:0/336629000 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:57.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bbdce6640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bb81035a0 0x7f9bb80fe5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bbece8640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bb8103f20 0x7f9bb80feaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bbe4e7640 1 -- 172.21.15.47:0/336629000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bb8103f20 msgr2=0x7f9bb80feaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bbe4e7640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bb8103f20 0x7f9bb80feaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bbe4e7640 1 -- 172.21.15.47:0/336629000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bb81035a0 msgr2=0x7f9bb80fe5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.799+0000 7f9bbe4e7640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bb81035a0 0x7f9bb80fe5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.800+0000 7f9bbe4e7640 1 -- 172.21.15.47:0/336629000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb81a70c0 con 0x7f9bb81011e0 2024-07-24T22:16:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.800+0000 7f9bbece8640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bb8103f20 0x7f9bb80feaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:16:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.800+0000 7f9bbe4e7640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9bb81011e0 0x7f9bb80fe070 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4005940 tx=0x7f9bb40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.800+0000 7f9baf7fe640 1 -- 172.21.15.47:0/336629000 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb403f030 con 0x7f9bb81011e0 2024-07-24T22:16:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.800+0000 7f9bc074b640 1 -- 172.21.15.47:0/336629000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb81a7350 con 0x7f9bb81011e0 2024-07-24T22:16:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.800+0000 7f9baf7fe640 1 -- 172.21.15.47:0/336629000 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bb4003cb0 con 0x7f9bb81011e0 2024-07-24T22:16:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.800+0000 7f9baf7fe640 1 -- 172.21.15.47:0/336629000 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4035070 con 0x7f9bb81011e0 2024-07-24T22:16:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.800+0000 7f9bc074b640 1 -- 172.21.15.47:0/336629000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb81a7840 con 0x7f9bb81011e0 2024-07-24T22:16:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9bc357f740 1 Processor -- start 2024-07-24T22:16:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9bc357f740 1 -- start start 2024-07-24T22:16:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9baf7fe640 1 -- 172.21.15.47:0/336629000 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f9bb4042030 con 0x7f9bb81011e0 2024-07-24T22:16:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9bc357f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784918c0 0x55d678491ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9bc357f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784921e0 0x55d67849dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9bc357f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d6784a0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9bc357f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d678407280 con 0x55d67849e170 2024-07-24T22:16:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9bc357f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d6783f6780 con 0x55d6784918c0 2024-07-24T22:16:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9bc357f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d6783fa7c0 con 0x55d6784921e0 2024-07-24T22:16:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9bbdce6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d6784a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9bbdce6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d6784a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57056/0 (socket says 172.21.15.47:57056) 2024-07-24T22:16:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9bbdce6640 1 -- 172.21.15.47:0/800054515 learned_addr learned my addr 172.21.15.47:0/800054515 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9bbece8640 1 --2- 172.21.15.47:0/800054515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784918c0 0x55d678491ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.803+0000 7f9bbe4e7640 1 --2- 172.21.15.47:0/800054515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784921e0 0x55d67849dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.804+0000 7f9bbdce6640 1 -- 172.21.15.47:0/800054515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784921e0 msgr2=0x55d67849dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.804+0000 7f9bbdce6640 1 --2- 172.21.15.47:0/800054515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784921e0 0x55d67849dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.804+0000 7f9bbdce6640 1 -- 172.21.15.47:0/800054515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784918c0 msgr2=0x55d678491ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.804+0000 7f9bbdce6640 1 --2- 172.21.15.47:0/800054515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784918c0 0x55d678491ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.804+0000 7f9bbdce6640 1 -- 172.21.15.47:0/800054515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d67815a790 con 0x55d67849e170 2024-07-24T22:16:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.804+0000 7f9baf7fe640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9ba40b3d40 0x7f9ba40b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.804+0000 7f9bbdce6640 1 --2- 172.21.15.47:0/800054515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d6784a0560 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800bcb0 tx=0x7f9ba80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a753526c0208b5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.804+0000 7f9bbece8640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9ba40b3d40 0x7f9ba40b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.804+0000 7f9bacff9640 1 -- 172.21.15.47:0/800054515 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8004030 con 0x55d67849e170 2024-07-24T22:16:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.804+0000 7f9bacff9640 1 -- 172.21.15.47:0/800054515 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ba80041d0 con 0x55d67849e170 2024-07-24T22:16:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.804+0000 7f9baf7fe640 1 -- 172.21.15.47:0/336629000 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f9bb4104960 con 0x7f9bb81011e0 2024-07-24T22:16:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.804+0000 7f9bacff9640 1 -- 172.21.15.47:0/800054515 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8011770 con 0x55d67849e170 2024-07-24T22:16:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.805+0000 7f9bc357f740 1 -- 172.21.15.47:0/800054515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 msgr2=0x55d6784a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.805+0000 7f9bc357f740 1 --2- 172.21.15.47:0/800054515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d6784a0560 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800bcb0 tx=0x7f9ba80107a0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.805+0000 7f9bbece8640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9ba40b3d40 0x7f9ba40b6200 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0005fd0 tx=0x7f9bb0008630 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.805+0000 7f9bc357f740 1 -- 172.21.15.47:0/800054515 shutdown_connections 2024-07-24T22:16:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.805+0000 7f9bc357f740 1 --2- 172.21.15.47:0/800054515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d6784a0560 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.805+0000 7f9bc357f740 1 --2- 172.21.15.47:0/800054515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784921e0 0x55d67849dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.805+0000 7f9bc357f740 1 --2- 172.21.15.47:0/800054515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784918c0 0x55d678491ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.805+0000 7f9bc357f740 1 -- 172.21.15.47:0/800054515 >> 172.21.15.47:0/800054515 conn(0x55d67848f6f0 msgr2=0x55d678490890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.805+0000 7f9bc357f740 1 -- 172.21.15.47:0/800054515 shutdown_connections 2024-07-24T22:16:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.805+0000 7f9bc357f740 1 -- 172.21.15.47:0/800054515 wait complete. 2024-07-24T22:16:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.805+0000 7f9bc357f740 1 -- start start 2024-07-24T22:16:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bc357f740 1 Processor -- start 2024-07-24T22:16:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bc357f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 0x55d67849d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bc357f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784921e0 0x55d67849ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bc357f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d67849b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bc357f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d678330ab0 con 0x55d67849e170 2024-07-24T22:16:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bc357f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d67837e9e0 con 0x55d6784921e0 2024-07-24T22:16:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bc357f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d6784a0e50 con 0x55d6784918c0 2024-07-24T22:16:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bc357f740 10 client.0 _ll_register_callbacks cb 0x55d678106a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bbece8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d67849b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bbe4e7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 0x55d67849d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bbece8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d67849b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57064/0 (socket says 172.21.15.47:57064) 2024-07-24T22:16:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bbece8640 1 -- 172.21.15.47:0/1157664366 learned_addr learned my addr 172.21.15.47:0/1157664366 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bbdce6640 1 --2- 172.21.15.47:0/1157664366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784921e0 0x55d67849ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bbece8640 1 -- 172.21.15.47:0/1157664366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 msgr2=0x55d67849d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bbece8640 1 --2- 172.21.15.47:0/1157664366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 0x55d67849d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bbece8640 1 -- 172.21.15.47:0/1157664366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784921e0 msgr2=0x55d67849ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bbece8640 1 --2- 172.21.15.47:0/1157664366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784921e0 0x55d67849ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.806+0000 7f9bbece8640 1 -- 172.21.15.47:0/1157664366 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6781d3620 con 0x55d67849e170 2024-07-24T22:16:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9bbece8640 1 --2- 172.21.15.47:0/1157664366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d67849b2b0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000ee10 tx=0x7f9bb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada80a27afc7e53c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9ba1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9ba1ffb640 1 -- 172.21.15.47:0/1157664366 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0025600 con 0x55d67849e170 2024-07-24T22:16:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9ba1ffb640 1 -- 172.21.15.47:0/1157664366 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f9bb00257a0 con 0x55d67849e170 2024-07-24T22:16:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9bc357f740 1 -- 172.21.15.47:0/1157664366 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d6783a5ce0 con 0x55d67849e170 2024-07-24T22:16:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9ba1ffb640 1 -- 172.21.15.47:0/1157664366 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9bb00259a0 con 0x55d67849e170 2024-07-24T22:16:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9bc357f740 10 client.17583 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9bc357f740 1 -- 172.21.15.47:0/1157664366 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d6784ac610 con 0x55d67849e170 2024-07-24T22:16:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9ba1ffb640 1 -- 172.21.15.47:0/1157664366 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d6783a5ce0 con 0x55d67849e170 2024-07-24T22:16:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9ba1ffb640 1 -- 172.21.15.47:0/1157664366 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9bb002c070 con 0x55d67849e170 2024-07-24T22:16:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9bc357f740 10 client.17583 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9bc357f740 10 client.17583 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9bc357f740 20 client.17583 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9bc357f740 1 --2- 172.21.15.47:0/1157664366 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d6784adad0 0x55d6784afec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9bc357f740 4 client.17583 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:16:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.807+0000 7f9bc357f740 1 -- 172.21.15.47:0/1157664366 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6784091d0 con 0x55d6784adad0 2024-07-24T22:16:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.808+0000 7f9bbe4e7640 1 --2- 172.21.15.47:0/1157664366 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d6784adad0 0x55d6784afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.808+0000 7f9bbe4e7640 1 --2- 172.21.15.47:0/1157664366 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d6784adad0 0x55d6784afec0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ce7dff322a1cd32 server_cookie=137ad3fc7bfbd21f in_seq=0 out_seq=0 2024-07-24T22:16:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.808+0000 7f9ba1ffb640 10 client.17583 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9ba1ffb640 1 -- 172.21.15.47:0/1157664366 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6784091d0 con 0x55d6784adad0 2024-07-24T22:16:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9ba1ffb640 10 client.17583 handle_command_reply: tid=0 2024-07-24T22:16:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9bc357f740 1 client.17583 shutdown 2024-07-24T22:16:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9bc357f740 1 -- 172.21.15.47:0/1157664366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 msgr2=0x55d67849b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9bc357f740 1 --2- 172.21.15.47:0/1157664366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d67849b2b0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000ee10 tx=0x7f9bb0004a40 comp rx=0 tx=0).stop 2024-07-24T22:16:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9bc357f740 1 -- 172.21.15.47:0/1157664366 shutdown_connections 2024-07-24T22:16:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9bc357f740 1 --2- 172.21.15.47:0/1157664366 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d6784adad0 0x55d6784afec0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9bc357f740 1 --2- 172.21.15.47:0/1157664366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d67849b2b0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9bc357f740 1 --2- 172.21.15.47:0/1157664366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784921e0 0x55d67849ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9bc357f740 1 --2- 172.21.15.47:0/1157664366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 0x55d67849d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9ba1ffb640 0 client.17583 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9bc357f740 1 -- 172.21.15.47:0/1157664366 >> 172.21.15.47:0/1157664366 conn(0x55d67848f6f0 msgr2=0x55d678495290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9bc357f740 1 -- 172.21.15.47:0/1157664366 shutdown_connections 2024-07-24T22:16:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9bc357f740 1 -- 172.21.15.47:0/1157664366 wait complete. 2024-07-24T22:16:57.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.809+0000 7f9bc357f740 20 client.17583 trim_cache size 0 max 16384 2024-07-24T22:16:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bc357f740 1 Processor -- start 2024-07-24T22:16:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bc357f740 1 -- start start 2024-07-24T22:16:57.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bc357f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 0x55d67848e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bc357f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784921e0 0x55d6784b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bc357f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d6784b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bc357f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb81ae3a0 con 0x55d67849e170 2024-07-24T22:16:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bc357f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb81b0c00 con 0x55d6784921e0 2024-07-24T22:16:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bc357f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb81ae9f0 con 0x55d6784918c0 2024-07-24T22:16:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bbece8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d6784b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bbece8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d6784b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57078/0 (socket says 172.21.15.47:57078) 2024-07-24T22:16:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bbece8640 1 -- 172.21.15.47:0/3718382833 learned_addr learned my addr 172.21.15.47:0/3718382833 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bbe4e7640 1 --2- 172.21.15.47:0/3718382833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 0x55d67848e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bbece8640 1 -- 172.21.15.47:0/3718382833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 msgr2=0x55d67848e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bbece8640 1 --2- 172.21.15.47:0/3718382833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 0x55d67848e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bbece8640 1 -- 172.21.15.47:0/3718382833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784921e0 msgr2=0x55d6784b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:57.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bbece8640 1 --2- 172.21.15.47:0/3718382833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784921e0 0x55d6784b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.825+0000 7f9bbece8640 1 -- 172.21.15.47:0/3718382833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d67849dc00 con 0x55d67849e170 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.826+0000 7f9bbece8640 1 --2- 172.21.15.47:0/3718382833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d6784b5cd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0004af0 tx=0x7f9bb0010e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fc0be0d2f31183 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.826+0000 7f9ba3fff640 1 -- 172.21.15.47:0/3718382833 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0034070 con 0x55d67849e170 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.826+0000 7f9ba3fff640 1 -- 172.21.15.47:0/3718382833 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bb000dc00 con 0x55d67849e170 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.826+0000 7f9ba3fff640 1 -- 172.21.15.47:0/3718382833 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb001db20 con 0x55d67849e170 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.826+0000 7f9bc357f740 1 -- 172.21.15.47:0/3718382833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 msgr2=0x55d6784b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.826+0000 7f9bc357f740 1 --2- 172.21.15.47:0/3718382833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d6784b5cd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0004af0 tx=0x7f9bb0010e60 comp rx=0 tx=0).stop 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.826+0000 7f9bc357f740 1 -- 172.21.15.47:0/3718382833 shutdown_connections 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.826+0000 7f9bc357f740 1 --2- 172.21.15.47:0/3718382833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d67849e170 0x55d6784b5cd0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.826+0000 7f9bc357f740 1 --2- 172.21.15.47:0/3718382833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d6784921e0 0x55d6784b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.826+0000 7f9bc357f740 1 --2- 172.21.15.47:0/3718382833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 0x55d67848e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.826+0000 7f9bc357f740 1 -- 172.21.15.47:0/3718382833 >> 172.21.15.47:0/3718382833 conn(0x55d67848f6f0 msgr2=0x55d67848df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.826+0000 7f9bc357f740 1 -- 172.21.15.47:0/3718382833 shutdown_connections 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.826+0000 7f9bc357f740 1 -- 172.21.15.47:0/3718382833 wait complete. 2024-07-24T22:16:57.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bc357f740 1 -- start start 2024-07-24T22:16:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bc357f740 1 Processor -- start 2024-07-24T22:16:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bc357f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 0x55d6784a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bc357f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6784921e0 0x55d6784a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bc357f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d67849e170 0x55d678516750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bc357f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb81af0c0 con 0x55d6784921e0 2024-07-24T22:16:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bc357f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb81b0530 con 0x55d67849e170 2024-07-24T22:16:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bc357f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb81af790 con 0x55d6784918c0 2024-07-24T22:16:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bc357f740 10 client.0 _ll_register_callbacks cb 0x7f9bb0008b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:16:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bbdce6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6784921e0 0x55d6784a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bbdce6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6784921e0 0x55d6784a1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57090/0 (socket says 172.21.15.47:57090) 2024-07-24T22:16:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bbdce6640 1 -- 172.21.15.47:0/2805965415 learned_addr learned my addr 172.21.15.47:0/2805965415 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:16:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bbe4e7640 1 --2- 172.21.15.47:0/2805965415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 0x55d6784a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bbece8640 1 --2- 172.21.15.47:0/2805965415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d67849e170 0x55d678516750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bbdce6640 1 -- 172.21.15.47:0/2805965415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 msgr2=0x55d6784a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bbdce6640 1 --2- 172.21.15.47:0/2805965415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 0x55d6784a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.827+0000 7f9bbdce6640 1 -- 172.21.15.47:0/2805965415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d67849e170 msgr2=0x55d678516750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:16:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9bbdce6640 1 --2- 172.21.15.47:0/2805965415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d67849e170 0x55d678516750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9bbdce6640 1 -- 172.21.15.47:0/2805965415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d678516d90 con 0x55d6784921e0 2024-07-24T22:16:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9bbdce6640 1 --2- 172.21.15.47:0/2805965415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6784921e0 0x55d6784a1de0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800b3d0 tx=0x7f9ba8005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5079e52aa38256ee server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:16:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9ba1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:16:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9ba1ffb640 1 -- 172.21.15.47:0/2805965415 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba802b060 con 0x55d6784921e0 2024-07-24T22:16:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9ba1ffb640 1 -- 172.21.15.47:0/2805965415 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f9ba80055c0 con 0x55d6784921e0 2024-07-24T22:16:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9bc357f740 1 -- 172.21.15.47:0/2805965415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bb000dc00 con 0x55d6784921e0 2024-07-24T22:16:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9ba1ffb640 1 -- 172.21.15.47:0/2805965415 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9ba80035f0 con 0x55d6784921e0 2024-07-24T22:16:57.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9bc357f740 10 client.17589 fetch_fsmap learned FSMap version 20 2024-07-24T22:16:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9bc357f740 1 -- 172.21.15.47:0/2805965415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d6785180d0 con 0x55d6784921e0 2024-07-24T22:16:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9ba1ffb640 1 -- 172.21.15.47:0/2805965415 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bb000dc00 con 0x55d6784921e0 2024-07-24T22:16:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9ba1ffb640 1 -- 172.21.15.47:0/2805965415 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9ba8025070 con 0x55d6784921e0 2024-07-24T22:16:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9bc357f740 10 client.17589 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:16:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9bc357f740 10 client.17589 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:16:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9bc357f740 20 client.17589 populate_metadata read hostname 'smithi047' 2024-07-24T22:16:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9bc357f740 1 --2- 172.21.15.47:0/2805965415 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d678518580 0x55d67851a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:16:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9bc357f740 4 client.17589 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:16:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.828+0000 7f9bc357f740 1 -- 172.21.15.47:0/2805965415 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d678404c70 con 0x55d678518580 2024-07-24T22:16:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.829+0000 7f9bbe4e7640 1 --2- 172.21.15.47:0/2805965415 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d678518580 0x55d67851a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:16:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.829+0000 7f9ba1ffb640 10 client.17589 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:57.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.829+0000 7f9bbe4e7640 1 --2- 172.21.15.47:0/2805965415 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d678518580 0x55d67851a9a0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb7794c7e1b6274c server_cookie=c21ec055d952b0d2 in_seq=0 out_seq=0 2024-07-24T22:16:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.833+0000 7f9ba1ffb640 1 -- 172.21.15.47:0/2805965415 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d678404c70 con 0x55d678518580 2024-07-24T22:16:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.833+0000 7f9ba1ffb640 10 client.17589 handle_command_reply: tid=0 2024-07-24T22:16:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.833+0000 7f9bc357f740 1 client.17589 shutdown 2024-07-24T22:16:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.833+0000 7f9bc357f740 1 -- 172.21.15.47:0/2805965415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6784921e0 msgr2=0x55d6784a1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.833+0000 7f9bc357f740 1 --2- 172.21.15.47:0/2805965415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6784921e0 0x55d6784a1de0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800b3d0 tx=0x7f9ba8005040 comp rx=0 tx=0).stop 2024-07-24T22:16:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc357f740 1 -- 172.21.15.47:0/2805965415 shutdown_connections 2024-07-24T22:16:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc357f740 1 --2- 172.21.15.47:0/2805965415 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55d678518580 0x55d67851a9a0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc357f740 1 --2- 172.21.15.47:0/2805965415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d67849e170 0x55d678516750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc357f740 1 --2- 172.21.15.47:0/2805965415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6784921e0 0x55d6784a1de0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9ba1ffb640 0 client.17589 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:16:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc357f740 1 --2- 172.21.15.47:0/2805965415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6784918c0 0x55d6784a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc357f740 1 -- 172.21.15.47:0/2805965415 >> 172.21.15.47:0/2805965415 conn(0x55d67848f6f0 msgr2=0x55d67848df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc357f740 1 -- 172.21.15.47:0/2805965415 shutdown_connections 2024-07-24T22:16:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc357f740 1 -- 172.21.15.47:0/2805965415 wait complete. 2024-07-24T22:16:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc357f740 20 client.17589 trim_cache size 0 max 16384 2024-07-24T22:16:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:16:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:16:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:16:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:16:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc074b640 1 -- 172.21.15.47:0/336629000 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9ba40b3d40 msgr2=0x7f9ba40b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc074b640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9ba40b3d40 0x7f9ba40b6200 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0005fd0 tx=0x7f9bb0008630 comp rx=0 tx=0).stop 2024-07-24T22:16:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc074b640 1 -- 172.21.15.47:0/336629000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9bb81011e0 msgr2=0x7f9bb80fe070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:16:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc074b640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9bb81011e0 0x7f9bb80fe070 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4005940 tx=0x7f9bb40042f0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc074b640 1 -- 172.21.15.47:0/336629000 shutdown_connections 2024-07-24T22:16:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc074b640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f9ba40b3d40 0x7f9ba40b6200 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc074b640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bb8103f20 0x7f9bb80feaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc074b640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bb81035a0 0x7f9bb80fe5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc074b640 1 --2- 172.21.15.47:0/336629000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9bb81011e0 0x7f9bb80fe070 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:16:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc074b640 1 -- 172.21.15.47:0/336629000 >> 172.21.15.47:0/336629000 conn(0x7f9bb8076730 msgr2=0x7f9bb8107830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:16:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc074b640 1 -- 172.21.15.47:0/336629000 shutdown_connections 2024-07-24T22:16:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:16:57.834+0000 7f9bc074b640 1 -- 172.21.15.47:0/336629000 wait complete. 2024-07-24T22:16:59.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:16:59 smithi047 ceph-mon[32551]: pgmap v667: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:16:59.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:16:59 smithi188 ceph-mon[37380]: pgmap v667: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:16:59.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:16:59 smithi183 ceph-mon[37007]: pgmap v667: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:01.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:01 smithi047 ceph-mon[32551]: pgmap v668: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:17:01.714 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:01 smithi183 ceph-mon[37007]: pgmap v668: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:17:01.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:01 smithi188 ceph-mon[37380]: pgmap v668: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:17:03.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:03 smithi047 ceph-mon[32551]: pgmap v669: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.8 KiB/s rd, 938 B/s wr, 3 op/s 2024-07-24T22:17:03.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:03 smithi188 ceph-mon[37380]: pgmap v669: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.8 KiB/s rd, 938 B/s wr, 3 op/s 2024-07-24T22:17:03.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:03 smithi183 ceph-mon[37007]: pgmap v669: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.8 KiB/s rd, 938 B/s wr, 3 op/s 2024-07-24T22:17:03.956 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:17:04.235 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:17:05.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:05 smithi047 ceph-mon[32551]: pgmap v670: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 938 B/s wr, 2 op/s 2024-07-24T22:17:05.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:05 smithi188 ceph-mon[37380]: pgmap v670: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 938 B/s wr, 2 op/s 2024-07-24T22:17:05.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:05 smithi183 ceph-mon[37007]: pgmap v670: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 938 B/s wr, 2 op/s 2024-07-24T22:17:05.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.996+0000 7f8b292b6640 1 -- 172.21.15.47:0/495341991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b24108b20 msgr2=0x7f8b2410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:05.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.996+0000 7f8b292b6640 1 --2- 172.21.15.47:0/495341991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b24108b20 0x7f8b2410f320 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009ca0 tx=0x7f8b1c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:17:05.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.996+0000 7f8b292b6640 1 -- 172.21.15.47:0/495341991 shutdown_connections 2024-07-24T22:17:06.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.996+0000 7f8b292b6640 1 --2- 172.21.15.47:0/495341991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b24108b20 0x7f8b2410f320 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.996+0000 7f8b292b6640 1 --2- 172.21.15.47:0/495341991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b241081a0 0x7f8b241085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.996+0000 7f8b292b6640 1 --2- 172.21.15.47:0/495341991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b24102790 0x7f8b24102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.996+0000 7f8b292b6640 1 -- 172.21.15.47:0/495341991 >> 172.21.15.47:0/495341991 conn(0x7f8b240fe200 msgr2=0x7f8b24100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:06.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.996+0000 7f8b292b6640 1 -- 172.21.15.47:0/495341991 shutdown_connections 2024-07-24T22:17:06.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.996+0000 7f8b292b6640 1 -- 172.21.15.47:0/495341991 wait complete. 2024-07-24T22:17:06.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.997+0000 7f8b292b6640 1 Processor -- start 2024-07-24T22:17:06.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.997+0000 7f8b292b6640 1 -- start start 2024-07-24T22:17:06.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.997+0000 7f8b292b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b24102790 0x7f8b24074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b292b6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b241081a0 0x7f8b240753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b292b6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b24108b20 0x7f8b24075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b292b6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24112740 con 0x7f8b24102790 2024-07-24T22:17:06.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b292b6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241125c0 con 0x7f8b241081a0 2024-07-24T22:17:06.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b292b6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241128c0 con 0x7f8b24108b20 2024-07-24T22:17:06.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b22ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b24102790 0x7f8b24074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b22ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b24102790 0x7f8b24074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43584/0 (socket says 172.21.15.47:43584) 2024-07-24T22:17:06.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b22ffd640 1 -- 172.21.15.47:0/1700036565 learned_addr learned my addr 172.21.15.47:0/1700036565 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:06.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b227fc640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b241081a0 0x7f8b240753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b237fe640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b24108b20 0x7f8b24075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b22ffd640 1 -- 172.21.15.47:0/1700036565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b24108b20 msgr2=0x7f8b24075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:06.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b22ffd640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b24108b20 0x7f8b24075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b22ffd640 1 -- 172.21.15.47:0/1700036565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b241081a0 msgr2=0x7f8b240753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:06.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b22ffd640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b241081a0 0x7f8b240753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b22ffd640 1 -- 172.21.15.47:0/1700036565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b241a6f90 con 0x7f8b24102790 2024-07-24T22:17:06.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b237fe640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b24108b20 0x7f8b24075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:17:06.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b22ffd640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b24102790 0x7f8b24074e90 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400c920 tx=0x7f8b1400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:06.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b0bfff640 1 -- 172.21.15.47:0/1700036565 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14007c70 con 0x7f8b24102790 2024-07-24T22:17:06.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b292b6640 1 -- 172.21.15.47:0/1700036565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b241a7280 con 0x7f8b24102790 2024-07-24T22:17:06.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b0bfff640 1 -- 172.21.15.47:0/1700036565 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b14007e10 con 0x7f8b24102790 2024-07-24T22:17:06.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.998+0000 7f8b0bfff640 1 -- 172.21.15.47:0/1700036565 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14018820 con 0x7f8b24102790 2024-07-24T22:17:06.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:05.999+0000 7f8b292b6640 1 -- 172.21.15.47:0/1700036565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b241a77c0 con 0x7f8b24102790 2024-07-24T22:17:06.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b2b667740 1 Processor -- start 2024-07-24T22:17:06.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b2b667740 1 -- start start 2024-07-24T22:17:06.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b0bfff640 1 -- 172.21.15.47:0/1700036565 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f8b1400f450 con 0x7f8b24102790 2024-07-24T22:17:06.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b2b667740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 0x5571d125ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b2b667740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125efd0 0x5571d126aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b2b667740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d126af60 0x5571d126d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b2b667740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5571d11d5990 con 0x5571d125e6b0 2024-07-24T22:17:06.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b2b667740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5571d11c4e90 con 0x5571d125efd0 2024-07-24T22:17:06.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b2b667740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5571d11c8ed0 con 0x5571d126af60 2024-07-24T22:17:06.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 0x5571d125ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 0x5571d125ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43590/0 (socket says 172.21.15.47:43590) 2024-07-24T22:17:06.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b237fe640 1 -- 172.21.15.47:0/2822733956 learned_addr learned my addr 172.21.15.47:0/2822733956 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b22ffd640 1 --2- 172.21.15.47:0/2822733956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125efd0 0x5571d126aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.002+0000 7f8b227fc640 1 --2- 172.21.15.47:0/2822733956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d126af60 0x5571d126d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.003+0000 7f8b237fe640 1 -- 172.21.15.47:0/2822733956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d126af60 msgr2=0x5571d126d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.003+0000 7f8b237fe640 1 --2- 172.21.15.47:0/2822733956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d126af60 0x5571d126d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.003+0000 7f8b237fe640 1 -- 172.21.15.47:0/2822733956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125efd0 msgr2=0x5571d126aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.003+0000 7f8b237fe640 1 --2- 172.21.15.47:0/2822733956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125efd0 0x5571d126aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.003+0000 7f8b237fe640 1 -- 172.21.15.47:0/2822733956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571d114e300 con 0x5571d125e6b0 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.003+0000 7f8b0bfff640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b0c0b3d40 0x7f8b0c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.003+0000 7f8b237fe640 1 --2- 172.21.15.47:0/2822733956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 0x5571d125ea90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c006010 tx=0x7f8b1c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b89741eac2e24b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.003+0000 7f8b22ffd640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b0c0b3d40 0x7f8b0c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.003+0000 7f8b097fa640 1 -- 172.21.15.47:0/2822733956 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c031cf0 con 0x5571d125e6b0 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.003+0000 7f8b097fa640 1 -- 172.21.15.47:0/2822733956 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b1c036070 con 0x5571d125e6b0 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.003+0000 7f8b0bfff640 1 -- 172.21.15.47:0/1700036565 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f8b140e4100 con 0x7f8b24102790 2024-07-24T22:17:06.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.003+0000 7f8b097fa640 1 -- 172.21.15.47:0/2822733956 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c0042a0 con 0x5571d125e6b0 2024-07-24T22:17:06.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.004+0000 7f8b2b667740 1 -- 172.21.15.47:0/2822733956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 msgr2=0x5571d125ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:06.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.004+0000 7f8b22ffd640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b0c0b3d40 0x7f8b0c0b6200 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8b140e1970 tx=0x7f8b140a5040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:06.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.004+0000 7f8b2b667740 1 --2- 172.21.15.47:0/2822733956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 0x5571d125ea90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c006010 tx=0x7f8b1c009800 comp rx=0 tx=0).stop 2024-07-24T22:17:06.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.004+0000 7f8b2b667740 1 -- 172.21.15.47:0/2822733956 shutdown_connections 2024-07-24T22:17:06.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.004+0000 7f8b2b667740 1 --2- 172.21.15.47:0/2822733956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d126af60 0x5571d126d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.004+0000 7f8b2b667740 1 --2- 172.21.15.47:0/2822733956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125efd0 0x5571d126aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.004+0000 7f8b2b667740 1 --2- 172.21.15.47:0/2822733956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 0x5571d125ea90 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.004+0000 7f8b2b667740 1 -- 172.21.15.47:0/2822733956 >> 172.21.15.47:0/2822733956 conn(0x5571d125c4e0 msgr2=0x5571d125d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:06.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.004+0000 7f8b2b667740 1 -- 172.21.15.47:0/2822733956 shutdown_connections 2024-07-24T22:17:06.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.004+0000 7f8b2b667740 1 -- 172.21.15.47:0/2822733956 wait complete. 2024-07-24T22:17:06.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.004+0000 7f8b2b667740 1 -- start start 2024-07-24T22:17:06.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.004+0000 7f8b2b667740 1 Processor -- start 2024-07-24T22:17:06.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b2b667740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125e6b0 0x5571d1267e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b2b667740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125efd0 0x5571d12683c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b2b667740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d126af60 0x5571d1268900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b2b667740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5571d1028700 con 0x5571d125efd0 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b2b667740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5571d11675d0 con 0x5571d125e6b0 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b2b667740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5571d126dbd0 con 0x5571d126af60 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b2b667740 10 client.0 _ll_register_callbacks cb 0x5571d1187940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b227fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125efd0 0x5571d12683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b227fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125efd0 0x5571d12683c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43594/0 (socket says 172.21.15.47:43594) 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b227fc640 1 -- 172.21.15.47:0/4205359183 learned_addr learned my addr 172.21.15.47:0/4205359183 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b237fe640 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d126af60 0x5571d1268900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b237fe640 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125e6b0 0x5571d1267e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b227fc640 1 -- 172.21.15.47:0/4205359183 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d126af60 msgr2=0x5571d1268900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b227fc640 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d126af60 0x5571d1268900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b227fc640 1 -- 172.21.15.47:0/4205359183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125e6b0 msgr2=0x5571d1267e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b227fc640 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125e6b0 0x5571d1267e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b227fc640 1 -- 172.21.15.47:0/4205359183 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571d115a660 con 0x5571d125efd0 2024-07-24T22:17:06.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b237fe640 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125e6b0 0x5571d1267e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:17:06.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b227fc640 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125efd0 0x5571d12683c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800bad0 tx=0x7f8b1800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d9ee8cd8132be0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:06.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.005+0000 7f8b06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:06.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b06ff5640 1 -- 172.21.15.47:0/4205359183 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b18005020 con 0x5571d125efd0 2024-07-24T22:17:06.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b06ff5640 1 -- 172.21.15.47:0/4205359183 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f8b180051c0 con 0x5571d125efd0 2024-07-24T22:17:06.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b2b667740 1 -- 172.21.15.47:0/4205359183 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b1c036070 con 0x5571d125efd0 2024-07-24T22:17:06.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b06ff5640 1 -- 172.21.15.47:0/4205359183 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8b180053c0 con 0x5571d125efd0 2024-07-24T22:17:06.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b2b667740 10 client.17601 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:06.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b2b667740 1 -- 172.21.15.47:0/4205359183 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5571d0f25650 con 0x5571d125efd0 2024-07-24T22:17:06.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b06ff5640 1 -- 172.21.15.47:0/4205359183 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b1c036070 con 0x5571d125efd0 2024-07-24T22:17:06.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b06ff5640 1 -- 172.21.15.47:0/4205359183 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8b18022070 con 0x5571d125efd0 2024-07-24T22:17:06.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b2b667740 10 client.17601 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b2b667740 10 client.17601 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b2b667740 20 client.17601 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b2b667740 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5571d127aa30 0x5571d127ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b2b667740 4 client.17601 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.006+0000 7f8b2b667740 1 -- 172.21.15.47:0/4205359183 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571d11d78e0 con 0x5571d127aa30 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.007+0000 7f8b237fe640 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5571d127aa30 0x5571d127ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.007+0000 7f8b237fe640 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5571d127aa30 0x5571d127ce20 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=302a7ce72a33047a server_cookie=38acf9136575b792 in_seq=0 out_seq=0 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.007+0000 7f8b06ff5640 10 client.17601 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b06ff5640 1 -- 172.21.15.47:0/4205359183 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571d11d78e0 con 0x5571d127aa30 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b06ff5640 10 client.17601 handle_command_reply: tid=0 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b2b667740 1 client.17601 shutdown 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b2b667740 1 -- 172.21.15.47:0/4205359183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125efd0 msgr2=0x5571d12683c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b2b667740 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125efd0 0x5571d12683c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800bad0 tx=0x7f8b1800bed0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b2b667740 1 -- 172.21.15.47:0/4205359183 shutdown_connections 2024-07-24T22:17:06.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b2b667740 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5571d127aa30 0x5571d127ce20 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b2b667740 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d126af60 0x5571d1268900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b2b667740 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125efd0 0x5571d12683c0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b06ff5640 0 client.17601 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:06.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b2b667740 1 --2- 172.21.15.47:0/4205359183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125e6b0 0x5571d1267e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b2b667740 1 -- 172.21.15.47:0/4205359183 >> 172.21.15.47:0/4205359183 conn(0x5571d125c4e0 msgr2=0x5571d1262080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:06.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b2b667740 1 -- 172.21.15.47:0/4205359183 shutdown_connections 2024-07-24T22:17:06.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b2b667740 1 -- 172.21.15.47:0/4205359183 wait complete. 2024-07-24T22:17:06.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.008+0000 7f8b2b667740 20 client.17601 trim_cache size 0 max 16384 2024-07-24T22:17:06.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b2b667740 1 Processor -- start 2024-07-24T22:17:06.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b2b667740 1 -- start start 2024-07-24T22:17:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b2b667740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 0x5571d1268500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b2b667740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d125efd0 0x5571d1282730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b2b667740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d126af60 0x5571d1282c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b2b667740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241ae2d0 con 0x5571d125e6b0 2024-07-24T22:17:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b2b667740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241b0b30 con 0x5571d126af60 2024-07-24T22:17:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b2b667740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241ae920 con 0x5571d125efd0 2024-07-24T22:17:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 0x5571d1268500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 0x5571d1268500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43610/0 (socket says 172.21.15.47:43610) 2024-07-24T22:17:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b237fe640 1 -- 172.21.15.47:0/2708617748 learned_addr learned my addr 172.21.15.47:0/2708617748 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b227fc640 1 --2- 172.21.15.47:0/2708617748 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d125efd0 0x5571d1282730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b237fe640 1 --2- 172.21.15.47:0/2708617748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d126af60 0x5571d1282c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b237fe640 1 -- 172.21.15.47:0/2708617748 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d125efd0 msgr2=0x5571d1282730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b237fe640 1 --2- 172.21.15.47:0/2708617748 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d125efd0 0x5571d1282730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b237fe640 1 -- 172.21.15.47:0/2708617748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d126af60 msgr2=0x5571d1282c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b237fe640 1 --2- 172.21.15.47:0/2708617748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d126af60 0x5571d1282c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.027+0000 7f8b237fe640 1 -- 172.21.15.47:0/2708617748 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571d127d190 con 0x5571d125e6b0 2024-07-24T22:17:06.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.028+0000 7f8b237fe640 1 --2- 172.21.15.47:0/2708617748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 0x5571d1268500 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c003db0 tx=0x7f8b1c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c6d1df3edf66aa server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:06.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.028+0000 7f8b08ff9640 1 -- 172.21.15.47:0/2708617748 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c049040 con 0x5571d125e6b0 2024-07-24T22:17:06.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.028+0000 7f8b08ff9640 1 -- 172.21.15.47:0/2708617748 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b1c036040 con 0x5571d125e6b0 2024-07-24T22:17:06.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.028+0000 7f8b08ff9640 1 -- 172.21.15.47:0/2708617748 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c004720 con 0x5571d125e6b0 2024-07-24T22:17:06.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.028+0000 7f8b2b667740 1 -- 172.21.15.47:0/2708617748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 msgr2=0x5571d1268500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:06.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.028+0000 7f8b2b667740 1 --2- 172.21.15.47:0/2708617748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 0x5571d1268500 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c003db0 tx=0x7f8b1c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.029+0000 7f8b2b667740 1 -- 172.21.15.47:0/2708617748 shutdown_connections 2024-07-24T22:17:06.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.029+0000 7f8b2b667740 1 --2- 172.21.15.47:0/2708617748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d126af60 0x5571d1282c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.029+0000 7f8b2b667740 1 --2- 172.21.15.47:0/2708617748 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d125efd0 0x5571d1282730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.029+0000 7f8b2b667740 1 --2- 172.21.15.47:0/2708617748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d125e6b0 0x5571d1268500 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.029+0000 7f8b2b667740 1 -- 172.21.15.47:0/2708617748 >> 172.21.15.47:0/2708617748 conn(0x5571d125c4e0 msgr2=0x5571d1267df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:06.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.029+0000 7f8b2b667740 1 -- 172.21.15.47:0/2708617748 shutdown_connections 2024-07-24T22:17:06.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.029+0000 7f8b2b667740 1 -- 172.21.15.47:0/2708617748 wait complete. 2024-07-24T22:17:06.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.029+0000 7f8b2b667740 1 -- start start 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.029+0000 7f8b2b667740 1 Processor -- start 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.029+0000 7f8b2b667740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125e6b0 0x5571d126ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.029+0000 7f8b2b667740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d125efd0 0x5571d126f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b2b667740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d126af60 0x5571d126f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b2b667740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241aeff0 con 0x5571d126af60 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b2b667740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241b0460 con 0x5571d125e6b0 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b2b667740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241af6c0 con 0x5571d125efd0 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b2b667740 10 client.0 _ll_register_callbacks cb 0x7f8b180040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d126af60 0x5571d126f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d126af60 0x5571d126f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43622/0 (socket says 172.21.15.47:43622) 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b237fe640 1 -- 172.21.15.47:0/1962605386 learned_addr learned my addr 172.21.15.47:0/1962605386 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b227fc640 1 --2- 172.21.15.47:0/1962605386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d125efd0 0x5571d126f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b237fe640 1 --2- 172.21.15.47:0/1962605386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125e6b0 0x5571d126ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b237fe640 1 -- 172.21.15.47:0/1962605386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d125efd0 msgr2=0x5571d126f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:06.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b237fe640 1 --2- 172.21.15.47:0/1962605386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d125efd0 0x5571d126f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b237fe640 1 -- 172.21.15.47:0/1962605386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125e6b0 msgr2=0x5571d126ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:06.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b237fe640 1 --2- 172.21.15.47:0/1962605386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125e6b0 0x5571d126ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b237fe640 1 -- 172.21.15.47:0/1962605386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571d12e47d0 con 0x5571d126af60 2024-07-24T22:17:06.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b237fe640 1 --2- 172.21.15.47:0/1962605386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d126af60 0x5571d126f7b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009870 tx=0x7f8b1c03d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e70747258539ca server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:06.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:06.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b06ff5640 1 -- 172.21.15.47:0/1962605386 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c031db0 con 0x5571d126af60 2024-07-24T22:17:06.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b06ff5640 1 -- 172.21.15.47:0/1962605386 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f8b1c031450 con 0x5571d126af60 2024-07-24T22:17:06.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.030+0000 7f8b2b667740 1 -- 172.21.15.47:0/1962605386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b1c036040 con 0x5571d126af60 2024-07-24T22:17:06.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.031+0000 7f8b06ff5640 1 -- 172.21.15.47:0/1962605386 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8b1c0041c0 con 0x5571d126af60 2024-07-24T22:17:06.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.031+0000 7f8b2b667740 10 client.17607 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:06.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.031+0000 7f8b2b667740 1 -- 172.21.15.47:0/1962605386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5571d12e5ae0 con 0x5571d126af60 2024-07-24T22:17:06.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.031+0000 7f8b06ff5640 1 -- 172.21.15.47:0/1962605386 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b1c036040 con 0x5571d126af60 2024-07-24T22:17:06.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.031+0000 7f8b06ff5640 1 -- 172.21.15.47:0/1962605386 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8b1c02f7f0 con 0x5571d126af60 2024-07-24T22:17:06.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.031+0000 7f8b2b667740 10 client.17607 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:06.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.031+0000 7f8b2b667740 10 client.17607 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:06.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.031+0000 7f8b2b667740 20 client.17607 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:06.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.031+0000 7f8b2b667740 1 --2- 172.21.15.47:0/1962605386 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5571d12e5d00 0x5571d12e80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:06.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.031+0000 7f8b2b667740 4 client.17607 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:17:06.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.031+0000 7f8b2b667740 1 -- 172.21.15.47:0/1962605386 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5571d11d3380 con 0x5571d12e5d00 2024-07-24T22:17:06.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.031+0000 7f8b227fc640 1 --2- 172.21.15.47:0/1962605386 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5571d12e5d00 0x5571d12e80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:06.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b227fc640 1 --2- 172.21.15.47:0/1962605386 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5571d12e5d00 0x5571d12e80f0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c36fae88249b6445 server_cookie=6a7377015b47e05f in_seq=0 out_seq=0 2024-07-24T22:17:06.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b06ff5640 10 client.17607 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:06.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b06ff5640 1 -- 172.21.15.47:0/1962605386 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5571d11d3380 con 0x5571d12e5d00 2024-07-24T22:17:06.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b06ff5640 10 client.17607 handle_command_reply: tid=0 2024-07-24T22:17:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b2b667740 1 client.17607 shutdown 2024-07-24T22:17:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b2b667740 1 -- 172.21.15.47:0/1962605386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d126af60 msgr2=0x5571d126f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b2b667740 1 --2- 172.21.15.47:0/1962605386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d126af60 0x5571d126f7b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009870 tx=0x7f8b1c03d040 comp rx=0 tx=0).stop 2024-07-24T22:17:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b2b667740 1 -- 172.21.15.47:0/1962605386 shutdown_connections 2024-07-24T22:17:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b2b667740 1 --2- 172.21.15.47:0/1962605386 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5571d12e5d00 0x5571d12e80f0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b2b667740 1 --2- 172.21.15.47:0/1962605386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5571d126af60 0x5571d126f7b0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b2b667740 1 --2- 172.21.15.47:0/1962605386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5571d125efd0 0x5571d126f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b2b667740 1 --2- 172.21.15.47:0/1962605386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5571d125e6b0 0x5571d126ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b2b667740 1 -- 172.21.15.47:0/1962605386 >> 172.21.15.47:0/1962605386 conn(0x5571d125c4e0 msgr2=0x5571d1269cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b06ff5640 0 client.17607 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b2b667740 1 -- 172.21.15.47:0/1962605386 shutdown_connections 2024-07-24T22:17:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b2b667740 1 -- 172.21.15.47:0/1962605386 wait complete. 2024-07-24T22:17:06.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.032+0000 7f8b2b667740 20 client.17607 trim_cache size 0 max 16384 2024-07-24T22:17:06.040 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:17:06.040 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:17:06.040 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:17:06.040 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:17:06.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.033+0000 7f8b292b6640 1 -- 172.21.15.47:0/1700036565 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b0c0b3d40 msgr2=0x7f8b0c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:06.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.033+0000 7f8b292b6640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b0c0b3d40 0x7f8b0c0b6200 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8b140e1970 tx=0x7f8b140a5040 comp rx=0 tx=0).stop 2024-07-24T22:17:06.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.033+0000 7f8b292b6640 1 -- 172.21.15.47:0/1700036565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b24102790 msgr2=0x7f8b24074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.033+0000 7f8b292b6640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b24102790 0x7f8b24074e90 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400c920 tx=0x7f8b1400cde0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.033+0000 7f8b292b6640 1 -- 172.21.15.47:0/1700036565 shutdown_connections 2024-07-24T22:17:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.033+0000 7f8b292b6640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f8b0c0b3d40 0x7f8b0c0b6200 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.033+0000 7f8b292b6640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b24108b20 0x7f8b24075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.033+0000 7f8b292b6640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b241081a0 0x7f8b240753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.033+0000 7f8b292b6640 1 --2- 172.21.15.47:0/1700036565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b24102790 0x7f8b24074e90 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.033+0000 7f8b292b6640 1 -- 172.21.15.47:0/1700036565 >> 172.21.15.47:0/1700036565 conn(0x7f8b240fe200 msgr2=0x7f8b241005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.033+0000 7f8b292b6640 1 -- 172.21.15.47:0/1700036565 shutdown_connections 2024-07-24T22:17:06.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:06.033+0000 7f8b292b6640 1 -- 172.21.15.47:0/1700036565 wait complete. 2024-07-24T22:17:06.844 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:17:06.845 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:17:07.119 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:17:07.535 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:07 smithi047 ceph-mon[32551]: pgmap v671: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-07-24T22:17:07.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:07 smithi188 ceph-mon[37380]: pgmap v671: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-07-24T22:17:07.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:07 smithi183 ceph-mon[37007]: pgmap v671: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-07-24T22:17:08.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.748+0000 7f5786b0f640 1 -- 172.21.15.47:0/3911643721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57801070a0 msgr2=0x7f57801074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:08.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.748+0000 7f5786b0f640 1 --2- 172.21.15.47:0/3911643721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57801070a0 0x7f57801074e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f5770009900 tx=0x7f577002a410 comp rx=0 tx=0).stop 2024-07-24T22:17:08.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.748+0000 7f5786b0f640 1 -- 172.21.15.47:0/3911643721 shutdown_connections 2024-07-24T22:17:08.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.748+0000 7f5786b0f640 1 --2- 172.21.15.47:0/3911643721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5780107a20 0x7f578010e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:08.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.748+0000 7f5786b0f640 1 --2- 172.21.15.47:0/3911643721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57801070a0 0x7f57801074e0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:08.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.748+0000 7f5786b0f640 1 --2- 172.21.15.47:0/3911643721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5780101690 0x7f5780101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:08.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.748+0000 7f5786b0f640 1 -- 172.21.15.47:0/3911643721 >> 172.21.15.47:0/3911643721 conn(0x7f57800fd100 msgr2=0x7f57800ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:08.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.748+0000 7f5786b0f640 1 -- 172.21.15.47:0/3911643721 shutdown_connections 2024-07-24T22:17:08.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.748+0000 7f5786b0f640 1 -- 172.21.15.47:0/3911643721 wait complete. 2024-07-24T22:17:08.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.749+0000 7f5786b0f640 1 Processor -- start 2024-07-24T22:17:08.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.749+0000 7f5786b0f640 1 -- start start 2024-07-24T22:17:08.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.749+0000 7f5786b0f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5780101690 0x7f578019afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:08.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.749+0000 7f5786b0f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57801070a0 0x7f578019b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:08.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.749+0000 7f5786b0f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5780107a20 0x7f57801a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:08.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.749+0000 7f5786b0f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5780111720 con 0x7f57801070a0 2024-07-24T22:17:08.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.749+0000 7f5786b0f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f57801115a0 con 0x7f5780101690 2024-07-24T22:17:08.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.749+0000 7f5786b0f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f57801118a0 con 0x7f5780107a20 2024-07-24T22:17:08.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.749+0000 7f577ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57801070a0 0x7f578019b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:08.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.749+0000 7f577ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57801070a0 0x7f578019b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43638/0 (socket says 172.21.15.47:43638) 2024-07-24T22:17:08.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.749+0000 7f577ffff640 1 -- 172.21.15.47:0/109778927 learned_addr learned my addr 172.21.15.47:0/109778927 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:08.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.749+0000 7f57848ab640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5780101690 0x7f578019afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:08.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.750+0000 7f57850ac640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5780107a20 0x7f57801a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:08.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.750+0000 7f577ffff640 1 -- 172.21.15.47:0/109778927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5780107a20 msgr2=0x7f57801a08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:08.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.750+0000 7f577ffff640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5780107a20 0x7f57801a08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:08.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.750+0000 7f577ffff640 1 -- 172.21.15.47:0/109778927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5780101690 msgr2=0x7f578019afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:08.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.750+0000 7f577ffff640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5780101690 0x7f578019afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:08.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.750+0000 7f577ffff640 1 -- 172.21.15.47:0/109778927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57801a1090 con 0x7f57801070a0 2024-07-24T22:17:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.750+0000 7f577ffff640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57801070a0 0x7f578019b520 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f5770006010 tx=0x7f57700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.750+0000 7f577dffb640 1 -- 172.21.15.47:0/109778927 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577003f030 con 0x7f57801070a0 2024-07-24T22:17:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.750+0000 7f577dffb640 1 -- 172.21.15.47:0/109778927 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5770003800 con 0x7f57801070a0 2024-07-24T22:17:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.750+0000 7f5786b0f640 1 -- 172.21.15.47:0/109778927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57801a1320 con 0x7f57801070a0 2024-07-24T22:17:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.750+0000 7f577dffb640 1 -- 172.21.15.47:0/109778927 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770035070 con 0x7f57801070a0 2024-07-24T22:17:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.750+0000 7f5786b0f640 1 -- 172.21.15.47:0/109778927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57801a7a40 con 0x7f57801070a0 2024-07-24T22:17:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.751+0000 7f5786b0f640 1 -- 172.21.15.47:0/109778927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5780101af0 con 0x7f57801070a0 2024-07-24T22:17:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.753+0000 7f577dffb640 1 -- 172.21.15.47:0/109778927 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f5770003cb0 con 0x7f57801070a0 2024-07-24T22:17:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.754+0000 7f577dffb640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f576c0b3d40 0x7f576c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.754+0000 7f57848ab640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f576c0b3d40 0x7f576c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.754+0000 7f577dffb640 1 -- 172.21.15.47:0/109778927 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8565+0+0 (secure 0 0 0) 0x7f5770104ce0 con 0x7f57801070a0 2024-07-24T22:17:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.754+0000 7f57848ab640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f576c0b3d40 0x7f576c0b6200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5768009890 tx=0x7f5768008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:08.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.756+0000 7f577dffb640 1 -- 172.21.15.47:0/109778927 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f57700cbf60 con 0x7f57801070a0 2024-07-24T22:17:08.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.996+0000 7f5786b0f640 1 -- 172.21.15.47:0/109778927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57801a7d80 con 0x7f57801070a0 2024-07-24T22:17:08.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.997+0000 7f577dffb640 1 -- 172.21.15.47:0/109778927 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f57700cb860 con 0x7f57801070a0 2024-07-24T22:17:09.000 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:17:09.000 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:17:09.000 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:17:09.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.999+0000 7f5786b0f640 1 -- 172.21.15.47:0/109778927 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f576c0b3d40 msgr2=0x7f576c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.999+0000 7f5786b0f640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f576c0b3d40 0x7f576c0b6200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5768009890 tx=0x7f5768008040 comp rx=0 tx=0).stop 2024-07-24T22:17:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.999+0000 7f5786b0f640 1 -- 172.21.15.47:0/109778927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57801070a0 msgr2=0x7f578019b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.999+0000 7f5786b0f640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57801070a0 0x7f578019b520 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f5770006010 tx=0x7f57700042f0 comp rx=0 tx=0).stop 2024-07-24T22:17:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.999+0000 7f5786b0f640 1 -- 172.21.15.47:0/109778927 shutdown_connections 2024-07-24T22:17:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.999+0000 7f5786b0f640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f576c0b3d40 0x7f576c0b6200 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.999+0000 7f5786b0f640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5780107a20 0x7f57801a08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.999+0000 7f5786b0f640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57801070a0 0x7f578019b520 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.999+0000 7f5786b0f640 1 --2- 172.21.15.47:0/109778927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5780101690 0x7f578019afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.999+0000 7f5786b0f640 1 -- 172.21.15.47:0/109778927 >> 172.21.15.47:0/109778927 conn(0x7f57800fd100 msgr2=0x7f57801004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.999+0000 7f5786b0f640 1 -- 172.21.15.47:0/109778927 shutdown_connections 2024-07-24T22:17:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:08.999+0000 7f5786b0f640 1 -- 172.21.15.47:0/109778927 wait complete. 2024-07-24T22:17:09.622 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:09 smithi047 ceph-mon[32551]: pgmap v672: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-07-24T22:17:09.622 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:09 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/109778927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:17:09.653 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:17:09.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:09 smithi188 ceph-mon[37380]: pgmap v672: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-07-24T22:17:09.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:09 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/109778927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:17:09.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:09 smithi183 ceph-mon[37007]: pgmap v672: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2024-07-24T22:17:09.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:09 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/109778927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:17:09.924 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:17:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.932+0000 7f658c3ec640 1 -- 172.21.15.47:0/3632459615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6584103ef0 msgr2=0x7f658410c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.932+0000 7f658c3ec640 1 --2- 172.21.15.47:0/3632459615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6584103ef0 0x7f658410c3d0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f6574009900 tx=0x7f657402a410 comp rx=0 tx=0).stop 2024-07-24T22:17:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.932+0000 7f658c3ec640 1 -- 172.21.15.47:0/3632459615 shutdown_connections 2024-07-24T22:17:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.932+0000 7f658c3ec640 1 --2- 172.21.15.47:0/3632459615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f658410c9f0 0x7f658410ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.932+0000 7f658c3ec640 1 --2- 172.21.15.47:0/3632459615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6584103ef0 0x7f658410c3d0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.932+0000 7f658c3ec640 1 --2- 172.21.15.47:0/3632459615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65841035d0 0x7f65841039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.932+0000 7f658c3ec640 1 -- 172.21.15.47:0/3632459615 >> 172.21.15.47:0/3632459615 conn(0x7f65840782e0 msgr2=0x7f65840ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.932+0000 7f658c3ec640 1 -- 172.21.15.47:0/3632459615 shutdown_connections 2024-07-24T22:17:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.932+0000 7f658c3ec640 1 -- 172.21.15.47:0/3632459615 wait complete. 2024-07-24T22:17:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f658c3ec640 1 Processor -- start 2024-07-24T22:17:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f658c3ec640 1 -- start start 2024-07-24T22:17:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f658c3ec640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65841035d0 0x7f6584198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f658c3ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6584103ef0 0x7f6584199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f658c3ec640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f658410c9f0 0x7f658419e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f658a188640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65841035d0 0x7f6584198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f658a188640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65841035d0 0x7f6584198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43652/0 (socket says 172.21.15.47:43652) 2024-07-24T22:17:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f658a188640 1 -- 172.21.15.47:0/3142378675 learned_addr learned my addr 172.21.15.47:0/3142378675 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f658c3ec640 1 -- 172.21.15.47:0/3142378675 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6584112670 con 0x7f65841035d0 2024-07-24T22:17:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f658c3ec640 1 -- 172.21.15.47:0/3142378675 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f65841124f0 con 0x7f6584103ef0 2024-07-24T22:17:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f658c3ec640 1 -- 172.21.15.47:0/3142378675 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f65841127f0 con 0x7f658410c9f0 2024-07-24T22:17:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f6589987640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6584103ef0 0x7f6584199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f658a989640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f658410c9f0 0x7f658419e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f6589987640 1 -- 172.21.15.47:0/3142378675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f658410c9f0 msgr2=0x7f658419e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:10.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f6589987640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f658410c9f0 0x7f658419e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f6589987640 1 -- 172.21.15.47:0/3142378675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65841035d0 msgr2=0x7f6584198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:10.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f6589987640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65841035d0 0x7f6584198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f6589987640 1 -- 172.21.15.47:0/3142378675 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658419ecf0 con 0x7f6584103ef0 2024-07-24T22:17:10.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.933+0000 7f658a188640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65841035d0 0x7f6584198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:17:10.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.934+0000 7f6589987640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6584103ef0 0x7f6584199190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f657402a930 tx=0x7f6574005e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:10.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.934+0000 7f657b7fe640 1 -- 172.21.15.47:0/3142378675 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657403f070 con 0x7f6584103ef0 2024-07-24T22:17:10.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.934+0000 7f658c3ec640 1 -- 172.21.15.47:0/3142378675 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658419ef80 con 0x7f6584103ef0 2024-07-24T22:17:10.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.934+0000 7f657b7fe640 1 -- 172.21.15.47:0/3142378675 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6574004490 con 0x7f6584103ef0 2024-07-24T22:17:10.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.934+0000 7f658c3ec640 1 -- 172.21.15.47:0/3142378675 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65841a56a0 con 0x7f6584103ef0 2024-07-24T22:17:10.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.934+0000 7f657b7fe640 1 -- 172.21.15.47:0/3142378675 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574035070 con 0x7f6584103ef0 2024-07-24T22:17:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.937+0000 7f658f218740 1 Processor -- start 2024-07-24T22:17:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.937+0000 7f658f218740 1 -- start start 2024-07-24T22:17:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658f218740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dc88c0 0x556421dc8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658f218740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421dd4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658f218740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dd5170 0x556421dd7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658f218740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556421d3e280 con 0x556421dc91e0 2024-07-24T22:17:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658f218740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556421d2d780 con 0x556421dd5170 2024-07-24T22:17:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658f218740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556421d317c0 con 0x556421dc88c0 2024-07-24T22:17:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658a188640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421dd4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658a188640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421dd4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43664/0 (socket says 172.21.15.47:43664) 2024-07-24T22:17:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f657b7fe640 1 -- 172.21.15.47:0/3142378675 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f65740037f0 con 0x7f6584103ef0 2024-07-24T22:17:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658a989640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dc88c0 0x556421dc8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658a188640 1 -- 172.21.15.47:0/674282515 learned_addr learned my addr 172.21.15.47:0/674282515 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658a188640 1 -- 172.21.15.47:0/674282515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dc88c0 msgr2=0x556421dc8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f6589987640 1 --2- 172.21.15.47:0/674282515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dd5170 0x556421dd7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658a188640 1 --2- 172.21.15.47:0/674282515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dc88c0 0x556421dc8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658a188640 1 -- 172.21.15.47:0/674282515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dd5170 msgr2=0x556421dd7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658a188640 1 --2- 172.21.15.47:0/674282515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dd5170 0x556421dd7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658a188640 1 -- 172.21.15.47:0/674282515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556421a91790 con 0x556421dc91e0 2024-07-24T22:17:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658a989640 1 --2- 172.21.15.47:0/674282515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dc88c0 0x556421dc8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:17:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f6589987640 1 --2- 172.21.15.47:0/674282515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dd5170 0x556421dd7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:17:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f658a188640 1 --2- 172.21.15.47:0/674282515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421dd4c30 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6580011630 tx=0x7f6580011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58153c47d3fda5c3 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.938+0000 7f6578bfe640 1 -- 172.21.15.47:0/674282515 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658001e070 con 0x556421dc91e0 2024-07-24T22:17:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f6578bfe640 1 -- 172.21.15.47:0/674282515 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f658000fba0 con 0x556421dc91e0 2024-07-24T22:17:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f6578bfe640 1 -- 172.21.15.47:0/674282515 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580019c80 con 0x556421dc91e0 2024-07-24T22:17:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f657b7fe640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f65700b3d40 0x7f65700b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f658a989640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f65700b3d40 0x7f65700b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f657b7fe640 1 -- 172.21.15.47:0/3142378675 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7f6574104480 con 0x7f6584103ef0 2024-07-24T22:17:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f658f218740 1 -- 172.21.15.47:0/674282515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 msgr2=0x556421dd4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f658a989640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f65700b3d40 0x7f65700b6200 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f657c009fd0 tx=0x7f657c009500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f658f218740 1 --2- 172.21.15.47:0/674282515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421dd4c30 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6580011630 tx=0x7f6580011af0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f658f218740 1 -- 172.21.15.47:0/674282515 shutdown_connections 2024-07-24T22:17:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f658f218740 1 --2- 172.21.15.47:0/674282515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dd5170 0x556421dd7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f658f218740 1 --2- 172.21.15.47:0/674282515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421dd4c30 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f658f218740 1 --2- 172.21.15.47:0/674282515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dc88c0 0x556421dc8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f658f218740 1 -- 172.21.15.47:0/674282515 >> 172.21.15.47:0/674282515 conn(0x556421dc66f0 msgr2=0x556421dc7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.939+0000 7f658f218740 1 -- 172.21.15.47:0/674282515 shutdown_connections 2024-07-24T22:17:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f658f218740 1 -- 172.21.15.47:0/674282515 wait complete. 2024-07-24T22:17:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f658f218740 1 -- start start 2024-07-24T22:17:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f658f218740 1 Processor -- start 2024-07-24T22:17:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f658f218740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 0x556421dd4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f658f218740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421dd1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f658f218740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 0x556421dd2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f658f218740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556421c67ab0 con 0x556421dc91e0 2024-07-24T22:17:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f658f218740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556421cb59e0 con 0x556421dc88c0 2024-07-24T22:17:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f658f218740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556421dd7e50 con 0x556421dd5170 2024-07-24T22:17:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f658f218740 10 client.0 _ll_register_callbacks cb 0x556421a3da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f6589987640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421dd1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f6589987640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421dd1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43670/0 (socket says 172.21.15.47:43670) 2024-07-24T22:17:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f6589987640 1 -- 172.21.15.47:0/3190820714 learned_addr learned my addr 172.21.15.47:0/3190820714 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:10.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f658a188640 1 --2- 172.21.15.47:0/3190820714 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 0x556421dd4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f658a989640 1 --2- 172.21.15.47:0/3190820714 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 0x556421dd2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.940+0000 7f6589987640 1 -- 172.21.15.47:0/3190820714 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 msgr2=0x556421dd2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f6589987640 1 --2- 172.21.15.47:0/3190820714 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 0x556421dd2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f6589987640 1 -- 172.21.15.47:0/3190820714 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 msgr2=0x556421dd4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f6589987640 1 --2- 172.21.15.47:0/3190820714 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 0x556421dd4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f6589987640 1 -- 172.21.15.47:0/3190820714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556421b0a620 con 0x556421dc91e0 2024-07-24T22:17:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f6589987640 1 --2- 172.21.15.47:0/3190820714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421dd1d40 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f65740c8350 tx=0x7f6574005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6beb0fa77af6f3dc server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f656dffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f656dffb640 1 -- 172.21.15.47:0/3190820714 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574048040 con 0x556421dc91e0 2024-07-24T22:17:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f656dffb640 1 -- 172.21.15.47:0/3190820714 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7f65740cb340 con 0x556421dc91e0 2024-07-24T22:17:10.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f658f218740 1 -- 172.21.15.47:0/3190820714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556421cdcce0 con 0x556421dc91e0 2024-07-24T22:17:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f656dffb640 1 -- 172.21.15.47:0/3190820714 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f65740ca850 con 0x556421dc91e0 2024-07-24T22:17:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f658f218740 10 client.17625 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f658f218740 1 -- 172.21.15.47:0/3190820714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556421de3520 con 0x556421dc91e0 2024-07-24T22:17:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f656dffb640 1 -- 172.21.15.47:0/3190820714 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556421cdcce0 con 0x556421dc91e0 2024-07-24T22:17:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f656dffb640 1 -- 172.21.15.47:0/3190820714 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f657404b060 con 0x556421dc91e0 2024-07-24T22:17:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f658f218740 10 client.17625 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f658f218740 10 client.17625 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f658f218740 20 client.17625 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f658f218740 1 --2- 172.21.15.47:0/3190820714 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556421de48c0 0x556421de6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f658f218740 4 client.17625 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:17:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.941+0000 7f658f218740 1 -- 172.21.15.47:0/3190820714 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556421d401d0 con 0x556421de48c0 2024-07-24T22:17:10.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.942+0000 7f658a188640 1 --2- 172.21.15.47:0/3190820714 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556421de48c0 0x556421de6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.942+0000 7f656dffb640 10 client.17625 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.942+0000 7f658a188640 1 --2- 172.21.15.47:0/3190820714 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556421de48c0 0x556421de6d40 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3af37a8b22178e98 server_cookie=f421ec73edd18216 in_seq=0 out_seq=0 2024-07-24T22:17:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f656dffb640 1 -- 172.21.15.47:0/3190820714 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556421d401d0 con 0x556421de48c0 2024-07-24T22:17:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f656dffb640 10 client.17625 handle_command_reply: tid=0 2024-07-24T22:17:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f658f218740 1 client.17625 shutdown 2024-07-24T22:17:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f658f218740 1 -- 172.21.15.47:0/3190820714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 msgr2=0x556421dd1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f658f218740 1 --2- 172.21.15.47:0/3190820714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421dd1d40 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f65740c8350 tx=0x7f6574005fd0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f658f218740 1 -- 172.21.15.47:0/3190820714 shutdown_connections 2024-07-24T22:17:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f658f218740 1 --2- 172.21.15.47:0/3190820714 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556421de48c0 0x556421de6d40 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f658f218740 1 --2- 172.21.15.47:0/3190820714 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 0x556421dd2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f658f218740 1 --2- 172.21.15.47:0/3190820714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421dd1d40 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f656dffb640 0 client.17625 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f658f218740 1 --2- 172.21.15.47:0/3190820714 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 0x556421dd4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f658f218740 1 -- 172.21.15.47:0/3190820714 >> 172.21.15.47:0/3190820714 conn(0x556421dc66f0 msgr2=0x556421dcc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f658f218740 1 -- 172.21.15.47:0/3190820714 shutdown_connections 2024-07-24T22:17:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f658f218740 1 -- 172.21.15.47:0/3190820714 wait complete. 2024-07-24T22:17:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.943+0000 7f658f218740 20 client.17625 trim_cache size 0 max 16384 2024-07-24T22:17:10.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f658f218740 1 Processor -- start 2024-07-24T22:17:10.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f658f218740 1 -- start start 2024-07-24T22:17:10.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f658f218740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 0x556421dec650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f658f218740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421decb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f658f218740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 0x556421dccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f658f218740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f65841ac1f0 con 0x556421dc91e0 2024-07-24T22:17:10.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f658f218740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f65841aea50 con 0x556421dc88c0 2024-07-24T22:17:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f658f218740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f65841ac840 con 0x556421dd5170 2024-07-24T22:17:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f6589987640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421decb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f6589987640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421decb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43676/0 (socket says 172.21.15.47:43676) 2024-07-24T22:17:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f658a989640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 0x556421dccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f6589987640 1 -- 172.21.15.47:0/3010213749 learned_addr learned my addr 172.21.15.47:0/3010213749 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f658a188640 1 --2- 172.21.15.47:0/3010213749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 0x556421dec650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f6589987640 1 -- 172.21.15.47:0/3010213749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 msgr2=0x556421dccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f6589987640 1 --2- 172.21.15.47:0/3010213749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 0x556421dccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f6589987640 1 -- 172.21.15.47:0/3010213749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 msgr2=0x556421dec650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f6589987640 1 --2- 172.21.15.47:0/3010213749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 0x556421dec650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f6589987640 1 -- 172.21.15.47:0/3010213749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556421dc5fa0 con 0x556421dc91e0 2024-07-24T22:17:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.960+0000 7f6589987640 1 --2- 172.21.15.47:0/3010213749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421decb90 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f65740cb070 tx=0x7f657403b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1b8e27d7b65398 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.961+0000 7f656ffff640 1 -- 172.21.15.47:0/3010213749 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574048030 con 0x556421dc91e0 2024-07-24T22:17:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.961+0000 7f656ffff640 1 -- 172.21.15.47:0/3010213749 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65740b2040 con 0x556421dc91e0 2024-07-24T22:17:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.961+0000 7f656ffff640 1 -- 172.21.15.47:0/3010213749 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740cb340 con 0x556421dc91e0 2024-07-24T22:17:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.961+0000 7f658f218740 1 -- 172.21.15.47:0/3010213749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 msgr2=0x556421decb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.961+0000 7f658f218740 1 --2- 172.21.15.47:0/3010213749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421decb90 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f65740cb070 tx=0x7f657403b720 comp rx=0 tx=0).stop 2024-07-24T22:17:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.961+0000 7f658f218740 1 -- 172.21.15.47:0/3010213749 shutdown_connections 2024-07-24T22:17:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.961+0000 7f658f218740 1 --2- 172.21.15.47:0/3010213749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 0x556421dccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.961+0000 7f658f218740 1 --2- 172.21.15.47:0/3010213749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421decb90 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.961+0000 7f658f218740 1 --2- 172.21.15.47:0/3010213749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 0x556421dec650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.961+0000 7f658f218740 1 -- 172.21.15.47:0/3010213749 >> 172.21.15.47:0/3010213749 conn(0x556421dc66f0 msgr2=0x556421dd05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.961+0000 7f658f218740 1 -- 172.21.15.47:0/3010213749 shutdown_connections 2024-07-24T22:17:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.961+0000 7f658f218740 1 -- 172.21.15.47:0/3010213749 wait complete. 2024-07-24T22:17:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f658f218740 1 -- start start 2024-07-24T22:17:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f658f218740 1 Processor -- start 2024-07-24T22:17:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f658f218740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 0x556421ddd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f658f218740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421ddd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f658f218740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 0x556421dce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f658f218740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f65841acf10 con 0x556421dc91e0 2024-07-24T22:17:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f658f218740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f65841ae380 con 0x556421dc88c0 2024-07-24T22:17:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f658f218740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f65841ad5e0 con 0x556421dd5170 2024-07-24T22:17:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f658f218740 10 client.0 _ll_register_callbacks cb 0x7f6574003ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f658a989640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 0x556421dce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f6589987640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421ddd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f658a989640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 0x556421dce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:34216/0 (socket says 172.21.15.47:34216) 2024-07-24T22:17:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f658a989640 1 -- 172.21.15.47:0/1287156020 learned_addr learned my addr 172.21.15.47:0/1287156020 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f658a188640 1 --2- 172.21.15.47:0/1287156020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 0x556421ddd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f6589987640 1 -- 172.21.15.47:0/1287156020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 msgr2=0x556421dce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f6589987640 1 --2- 172.21.15.47:0/1287156020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 0x556421dce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f6589987640 1 -- 172.21.15.47:0/1287156020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 msgr2=0x556421ddd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f6589987640 1 --2- 172.21.15.47:0/1287156020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 0x556421ddd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.962+0000 7f6589987640 1 -- 172.21.15.47:0/1287156020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556421dce880 con 0x556421dc91e0 2024-07-24T22:17:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f6589987640 1 --2- 172.21.15.47:0/1287156020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421ddd650 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6574101c20 tx=0x7f657402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30daed6a26c6940d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f656dffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f656dffb640 1 -- 172.21.15.47:0/1287156020 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740ea060 con 0x556421dc91e0 2024-07-24T22:17:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f656dffb640 1 -- 172.21.15.47:0/1287156020 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7f65740e5b70 con 0x556421dc91e0 2024-07-24T22:17:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f658f218740 1 -- 172.21.15.47:0/1287156020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65740b2040 con 0x556421dc91e0 2024-07-24T22:17:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f656dffb640 1 -- 172.21.15.47:0/1287156020 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6574048070 con 0x556421dc91e0 2024-07-24T22:17:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f658f218740 10 client.17631 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f658f218740 1 -- 172.21.15.47:0/1287156020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556421dce880 con 0x556421dc91e0 2024-07-24T22:17:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f656dffb640 1 -- 172.21.15.47:0/1287156020 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65740b2040 con 0x556421dc91e0 2024-07-24T22:17:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f656dffb640 1 -- 172.21.15.47:0/1287156020 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f65740c9db0 con 0x556421dc91e0 2024-07-24T22:17:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f658f218740 10 client.17631 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f658f218740 10 client.17631 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f658f218740 20 client.17631 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f658f218740 1 --2- 172.21.15.47:0/1287156020 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556421e4f060 0x556421e51480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f658f218740 4 client.17631 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:17:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f658f218740 1 -- 172.21.15.47:0/1287156020 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556421d3bc70 con 0x556421e4f060 2024-07-24T22:17:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.963+0000 7f658a188640 1 --2- 172.21.15.47:0/1287156020 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556421e4f060 0x556421e51480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.964+0000 7f656dffb640 10 client.17631 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:10.964+0000 7f658a188640 1 --2- 172.21.15.47:0/1287156020 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556421e4f060 0x556421e51480 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b3fab03f51e228 server_cookie=cef5587edf37f67d in_seq=0 out_seq=0 2024-07-24T22:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f656dffb640 1 -- 172.21.15.47:0/1287156020 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556421d3bc70 con 0x556421e4f060 2024-07-24T22:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f656dffb640 10 client.17631 handle_command_reply: tid=0 2024-07-24T22:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f658f218740 1 client.17631 shutdown 2024-07-24T22:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f658f218740 1 -- 172.21.15.47:0/1287156020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 msgr2=0x556421ddd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f658f218740 1 --2- 172.21.15.47:0/1287156020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421ddd650 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6574101c20 tx=0x7f657402a410 comp rx=0 tx=0).stop 2024-07-24T22:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f658f218740 1 -- 172.21.15.47:0/1287156020 shutdown_connections 2024-07-24T22:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f658f218740 1 --2- 172.21.15.47:0/1287156020 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556421e4f060 0x556421e51480 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f658f218740 1 --2- 172.21.15.47:0/1287156020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556421dd5170 0x556421dce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f658f218740 1 --2- 172.21.15.47:0/1287156020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556421dc91e0 0x556421ddd650 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f658f218740 1 --2- 172.21.15.47:0/1287156020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556421dc88c0 0x556421ddd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f658f218740 1 -- 172.21.15.47:0/1287156020 >> 172.21.15.47:0/1287156020 conn(0x556421dc66f0 msgr2=0x556421dccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f656dffb640 0 client.17631 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f658f218740 1 -- 172.21.15.47:0/1287156020 shutdown_connections 2024-07-24T22:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f658f218740 1 -- 172.21.15.47:0/1287156020 wait complete. 2024-07-24T22:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.552+0000 7f658f218740 20 client.17631 trim_cache size 0 max 16384 2024-07-24T22:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:17:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:17:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:17:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:17:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.553+0000 7f658c3ec640 1 -- 172.21.15.47:0/3142378675 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f65700b3d40 msgr2=0x7f65700b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.553+0000 7f658c3ec640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f65700b3d40 0x7f65700b6200 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f657c009fd0 tx=0x7f657c009500 comp rx=0 tx=0).stop 2024-07-24T22:17:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.553+0000 7f658c3ec640 1 -- 172.21.15.47:0/3142378675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6584103ef0 msgr2=0x7f6584199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.553+0000 7f658c3ec640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6584103ef0 0x7f6584199190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f657402a930 tx=0x7f6574005e60 comp rx=0 tx=0).stop 2024-07-24T22:17:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.553+0000 7f658c3ec640 1 -- 172.21.15.47:0/3142378675 shutdown_connections 2024-07-24T22:17:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.553+0000 7f658c3ec640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f65700b3d40 0x7f65700b6200 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.553+0000 7f658c3ec640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f658410c9f0 0x7f658419e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.553+0000 7f658c3ec640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6584103ef0 0x7f6584199190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.553+0000 7f658c3ec640 1 --2- 172.21.15.47:0/3142378675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65841035d0 0x7f6584198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.553+0000 7f658c3ec640 1 -- 172.21.15.47:0/3142378675 >> 172.21.15.47:0/3142378675 conn(0x7f65840782e0 msgr2=0x7f65840ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.554+0000 7f658c3ec640 1 -- 172.21.15.47:0/3142378675 shutdown_connections 2024-07-24T22:17:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:11.554+0000 7f658c3ec640 1 -- 172.21.15.47:0/3142378675 wait complete. 2024-07-24T22:17:11.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:11 smithi047 ceph-mon[32551]: pgmap v673: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-07-24T22:17:11.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:11 smithi047 ceph-mon[32551]: osdmap e94: 12 total, 12 up, 12 in 2024-07-24T22:17:11.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.688+0000 7f6cebefe640 1 -- 172.21.15.47:0/1469468886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ce4108b20 msgr2=0x7f6ce410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:11.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.688+0000 7f6cebefe640 1 --2- 172.21.15.47:0/1469468886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ce4108b20 0x7f6ce410f320 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009900 tx=0x7f6cdc02a410 comp rx=0 tx=0).stop 2024-07-24T22:17:11.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.688+0000 7f6cebefe640 1 -- 172.21.15.47:0/1469468886 shutdown_connections 2024-07-24T22:17:11.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.688+0000 7f6cebefe640 1 --2- 172.21.15.47:0/1469468886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ce4108b20 0x7f6ce410f320 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.688+0000 7f6cebefe640 1 --2- 172.21.15.47:0/1469468886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ce41081a0 0x7f6ce41085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.688+0000 7f6cebefe640 1 --2- 172.21.15.47:0/1469468886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ce4102790 0x7f6ce4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.688+0000 7f6cebefe640 1 -- 172.21.15.47:0/1469468886 >> 172.21.15.47:0/1469468886 conn(0x7f6ce40fe200 msgr2=0x7f6ce4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:11.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.688+0000 7f6cebefe640 1 -- 172.21.15.47:0/1469468886 shutdown_connections 2024-07-24T22:17:11.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.688+0000 7f6cebefe640 1 -- 172.21.15.47:0/1469468886 wait complete. 2024-07-24T22:17:11.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.689+0000 7f6cebefe640 1 Processor -- start 2024-07-24T22:17:11.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.689+0000 7f6cebefe640 1 -- start start 2024-07-24T22:17:11.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.689+0000 7f6cebefe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ce4102790 0x7f6ce410e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.689+0000 7f6cebefe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ce41081a0 0x7f6ce410ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.689+0000 7f6cebefe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ce4108b20 0x7f6ce41a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.689+0000 7f6cebefe640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce4112740 con 0x7f6ce4102790 2024-07-24T22:17:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.689+0000 7f6cebefe640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce41125c0 con 0x7f6ce4108b20 2024-07-24T22:17:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.689+0000 7f6cebefe640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce41128c0 con 0x7f6ce41081a0 2024-07-24T22:17:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.689+0000 7f6ce9c9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ce4102790 0x7f6ce410e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.689+0000 7f6cea49b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ce4108b20 0x7f6ce41a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.689+0000 7f6cea49b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ce4108b20 0x7f6ce41a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:41976/0 (socket says 172.21.15.47:41976) 2024-07-24T22:17:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.689+0000 7f6ce9c9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ce4102790 0x7f6ce410e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43704/0 (socket says 172.21.15.47:43704) 2024-07-24T22:17:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.689+0000 7f6cea49b640 1 -- 172.21.15.47:0/512684591 learned_addr learned my addr 172.21.15.47:0/512684591 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.690+0000 7f6cea49b640 1 -- 172.21.15.47:0/512684591 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ce41081a0 msgr2=0x7f6ce410ebf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T22:17:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.690+0000 7f6cea49b640 1 --2- 172.21.15.47:0/512684591 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ce41081a0 0x7f6ce410ebf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.690+0000 7f6cea49b640 1 -- 172.21.15.47:0/512684591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ce4102790 msgr2=0x7f6ce410e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.690+0000 7f6cea49b640 1 --2- 172.21.15.47:0/512684591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ce4102790 0x7f6ce410e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.690+0000 7f6cea49b640 1 -- 172.21.15.47:0/512684591 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce41a20e0 con 0x7f6ce4108b20 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.690+0000 7f6ce9c9a640 1 --2- 172.21.15.47:0/512684591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ce4102790 0x7f6ce410e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.690+0000 7f6cea49b640 1 --2- 172.21.15.47:0/512684591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ce4108b20 0x7f6ce41a1910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc004770 tx=0x7f6cdc004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.690+0000 7f6ce2ffd640 1 -- 172.21.15.47:0/512684591 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc03f030 con 0x7f6ce4108b20 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.691+0000 7f6cebefe640 1 -- 172.21.15.47:0/512684591 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce41a2370 con 0x7f6ce4108b20 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.691+0000 7f6ce2ffd640 1 -- 172.21.15.47:0/512684591 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cdc003aa0 con 0x7f6ce4108b20 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.691+0000 7f6ce2ffd640 1 -- 172.21.15.47:0/512684591 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc049060 con 0x7f6ce4108b20 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.691+0000 7f6cebefe640 1 -- 172.21.15.47:0/512684591 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce41abcb0 con 0x7f6ce4108b20 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.693+0000 7f6ce2ffd640 1 -- 172.21.15.47:0/512684591 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f6cdc042030 con 0x7f6ce4108b20 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.693+0000 7f6cee2af740 1 Processor -- start 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6cee2af740 1 -- start start 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6cee2af740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 0x5582810b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6cee2af740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 0x5582810bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6cee2af740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6cee2af740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55828102a9b0 con 0x5582810b36d0 2024-07-24T22:17:11.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6cee2af740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558281019eb0 con 0x5582810b3ff0 2024-07-24T22:17:11.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6cee2af740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55828101def0 con 0x5582810bff80 2024-07-24T22:17:11.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6ce9499640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 0x5582810b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6ce9499640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 0x5582810b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43710/0 (socket says 172.21.15.47:43710) 2024-07-24T22:17:11.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6ce9499640 1 -- 172.21.15.47:0/3641317532 learned_addr learned my addr 172.21.15.47:0/3641317532 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:11.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6ce9c9a640 1 --2- 172.21.15.47:0/3641317532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 0x5582810bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6ce9499640 1 --2- 172.21.15.47:0/3641317532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6ce9499640 1 -- 172.21.15.47:0/3641317532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 msgr2=0x5582810c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:11.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6ce9499640 1 --2- 172.21.15.47:0/3641317532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6ce9499640 1 -- 172.21.15.47:0/3641317532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 msgr2=0x5582810bfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:11.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6ce9499640 1 --2- 172.21.15.47:0/3641317532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 0x5582810bfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6ce9499640 1 -- 172.21.15.47:0/3641317532 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558280fa3320 con 0x5582810b36d0 2024-07-24T22:17:11.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6ce2ffd640 1 --2- 172.21.15.47:0/512684591 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6ccc0b3d40 0x7f6ccc0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6ce9499640 1 --2- 172.21.15.47:0/3641317532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 0x5582810b3ab0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009f60 tx=0x7f6cd80099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c720a69bc4b51831 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:11.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.694+0000 7f6ce9c9a640 1 --2- 172.21.15.47:0/512684591 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6ccc0b3d40 0x7f6ccc0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.695+0000 7f6ce2ffd640 1 -- 172.21.15.47:0/512684591 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7f6cdc104380 con 0x7f6ce4108b20 2024-07-24T22:17:11.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.695+0000 7f6ccbfff640 1 -- 172.21.15.47:0/3641317532 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8018070 con 0x5582810b36d0 2024-07-24T22:17:11.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.695+0000 7f6ccbfff640 1 -- 172.21.15.47:0/3641317532 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cd80108f0 con 0x5582810b36d0 2024-07-24T22:17:11.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.695+0000 7f6ccbfff640 1 -- 172.21.15.47:0/3641317532 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80053a0 con 0x5582810b36d0 2024-07-24T22:17:11.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.695+0000 7f6cee2af740 1 -- 172.21.15.47:0/3641317532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 msgr2=0x5582810b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:11.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.695+0000 7f6ce9c9a640 1 --2- 172.21.15.47:0/512684591 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6ccc0b3d40 0x7f6ccc0b6200 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x5582810b23e0 tx=0x7f6cd400b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:11.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.695+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3641317532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 0x5582810b3ab0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009f60 tx=0x7f6cd80099f0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 -- 172.21.15.47:0/3641317532 shutdown_connections 2024-07-24T22:17:11.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3641317532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3641317532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 0x5582810bfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3641317532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 0x5582810b3ab0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 -- 172.21.15.47:0/3641317532 >> 172.21.15.47:0/3641317532 conn(0x5582810b1500 msgr2=0x5582810b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:11.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 -- 172.21.15.47:0/3641317532 shutdown_connections 2024-07-24T22:17:11.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 -- 172.21.15.47:0/3641317532 wait complete. 2024-07-24T22:17:11.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 -- start start 2024-07-24T22:17:11.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 Processor -- start 2024-07-24T22:17:11.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 0x5582810bfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 0x5582810bce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810bd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558280e7d700 con 0x5582810b36d0 2024-07-24T22:17:11.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558280fbc5f0 con 0x5582810b3ff0 2024-07-24T22:17:11.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.696+0000 7f6cee2af740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5582810c2c00 con 0x5582810bff80 2024-07-24T22:17:11.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6cee2af740 10 client.0 _ll_register_callbacks cb 0x558280fdc960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:11.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6ce9c9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 0x5582810bfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6cea49b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6ce9c9a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 0x5582810bfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43716/0 (socket says 172.21.15.47:43716) 2024-07-24T22:17:11.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6ce9c9a640 1 -- 172.21.15.47:0/1438008040 learned_addr learned my addr 172.21.15.47:0/1438008040 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:11.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6ce9499640 1 --2- 172.21.15.47:0/1438008040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 0x5582810bce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6cea49b640 1 -- 172.21.15.47:0/1438008040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 msgr2=0x5582810bce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:11.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6cea49b640 1 --2- 172.21.15.47:0/1438008040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 0x5582810bce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6cea49b640 1 -- 172.21.15.47:0/1438008040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 msgr2=0x5582810bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:11.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6cea49b640 1 --2- 172.21.15.47:0/1438008040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 0x5582810bfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6cea49b640 1 -- 172.21.15.47:0/1438008040 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558280faf680 con 0x5582810bff80 2024-07-24T22:17:11.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6ce9c9a640 1 --2- 172.21.15.47:0/1438008040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 0x5582810bfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:17:11.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6cea49b640 1 --2- 172.21.15.47:0/1438008040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810bd620 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc101a70 tx=0x7f6cdc0cadc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=311155ad8ddb4248 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:11.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6cc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:17:11.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6cc97fa640 1 -- 172.21.15.47:0/1438008040 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc035070 con 0x5582810bff80 2024-07-24T22:17:11.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6cee2af740 1 -- 172.21.15.47:0/1438008040 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cd80108f0 con 0x5582810bff80 2024-07-24T22:17:11.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.697+0000 7f6cc97fa640 1 -- 172.21.15.47:0/1438008040 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7f6cdc0c71c0 con 0x5582810bff80 2024-07-24T22:17:11.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.698+0000 7f6cc97fa640 1 -- 172.21.15.47:0/1438008040 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6cdc0cb630 con 0x5582810bff80 2024-07-24T22:17:11.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.698+0000 7f6cee2af740 10 client.26767 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:11.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.698+0000 7f6cee2af740 1 -- 172.21.15.47:0/1438008040 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558280d7a650 con 0x5582810bff80 2024-07-24T22:17:11.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.698+0000 7f6cc97fa640 1 -- 172.21.15.47:0/1438008040 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cd80108f0 con 0x5582810bff80 2024-07-24T22:17:11.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.698+0000 7f6cc97fa640 1 -- 172.21.15.47:0/1438008040 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6cdc04c060 con 0x5582810bff80 2024-07-24T22:17:11.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.698+0000 7f6cee2af740 10 client.26767 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:11.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.698+0000 7f6cee2af740 10 client.26767 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:11.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.698+0000 7f6cee2af740 20 client.26767 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:11.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.698+0000 7f6cee2af740 1 --2- 172.21.15.47:0/1438008040 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582810cf9d0 0x5582810d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.698+0000 7f6cee2af740 4 client.26767 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:17:11.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.698+0000 7f6cee2af740 1 -- 172.21.15.47:0/1438008040 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55828102c900 con 0x5582810cf9d0 2024-07-24T22:17:11.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.698+0000 7f6ce9c9a640 1 --2- 172.21.15.47:0/1438008040 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582810cf9d0 0x5582810d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.699+0000 7f6ce9c9a640 1 --2- 172.21.15.47:0/1438008040 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582810cf9d0 0x5582810d1dc0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=783d5f0a2963261 server_cookie=282db484009666ab in_seq=0 out_seq=0 2024-07-24T22:17:11.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.699+0000 7f6cc97fa640 10 client.26767 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:11.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cc97fa640 1 -- 172.21.15.47:0/1438008040 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55828102c900 con 0x5582810cf9d0 2024-07-24T22:17:11.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cc97fa640 10 client.26767 handle_command_reply: tid=0 2024-07-24T22:17:11.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cee2af740 1 client.26767 shutdown 2024-07-24T22:17:11.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cee2af740 1 -- 172.21.15.47:0/1438008040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 msgr2=0x5582810bd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:11.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cee2af740 1 --2- 172.21.15.47:0/1438008040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810bd620 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc101a70 tx=0x7f6cdc0cadc0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cee2af740 1 -- 172.21.15.47:0/1438008040 shutdown_connections 2024-07-24T22:17:11.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cee2af740 1 --2- 172.21.15.47:0/1438008040 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5582810cf9d0 0x5582810d1dc0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cee2af740 1 --2- 172.21.15.47:0/1438008040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810bd620 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cee2af740 1 --2- 172.21.15.47:0/1438008040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 0x5582810bce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cee2af740 1 --2- 172.21.15.47:0/1438008040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b36d0 0x5582810bfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cc97fa640 0 client.26767 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:11.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cee2af740 1 -- 172.21.15.47:0/1438008040 >> 172.21.15.47:0/1438008040 conn(0x5582810b1500 msgr2=0x5582810b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:11.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cee2af740 1 -- 172.21.15.47:0/1438008040 shutdown_connections 2024-07-24T22:17:11.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cee2af740 1 -- 172.21.15.47:0/1438008040 wait complete. 2024-07-24T22:17:11.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.700+0000 7f6cee2af740 20 client.26767 trim_cache size 0 max 16384 2024-07-24T22:17:11.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cee2af740 1 Processor -- start 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cee2af740 1 -- start start 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cee2af740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b36d0 0x5582810d7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cee2af740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b3ff0 0x5582810d7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cee2af740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810ba080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cee2af740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce41b2780 con 0x5582810b3ff0 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cee2af740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce41b4fe0 con 0x5582810b36d0 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cee2af740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce41b2dd0 con 0x5582810bff80 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6ce9499640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b3ff0 0x5582810d7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6ce9499640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b3ff0 0x5582810d7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43720/0 (socket says 172.21.15.47:43720) 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cea49b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810ba080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6ce9499640 1 -- 172.21.15.47:0/3350888480 learned_addr learned my addr 172.21.15.47:0/3350888480 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6ce9c9a640 1 --2- 172.21.15.47:0/3350888480 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b36d0 0x5582810d7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cea49b640 1 -- 172.21.15.47:0/3350888480 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b36d0 msgr2=0x5582810d7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:11.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cea49b640 1 --2- 172.21.15.47:0/3350888480 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b36d0 0x5582810d7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cea49b640 1 -- 172.21.15.47:0/3350888480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b3ff0 msgr2=0x5582810d7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:11.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cea49b640 1 --2- 172.21.15.47:0/3350888480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b3ff0 0x5582810d7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6cea49b640 1 -- 172.21.15.47:0/3350888480 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582810d2130 con 0x5582810bff80 2024-07-24T22:17:11.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.716+0000 7f6ce9499640 1 --2- 172.21.15.47:0/3350888480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b3ff0 0x5582810d7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:17:11.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.717+0000 7f6cea49b640 1 --2- 172.21.15.47:0/3350888480 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810ba080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc101b20 tx=0x7f6cdc0cae30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb56f4b8a6613c6d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:11.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.717+0000 7f6ccb7fe640 1 -- 172.21.15.47:0/3350888480 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc035070 con 0x5582810bff80 2024-07-24T22:17:11.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.717+0000 7f6ccb7fe640 1 -- 172.21.15.47:0/3350888480 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cdc0cf530 con 0x5582810bff80 2024-07-24T22:17:11.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.717+0000 7f6ccb7fe640 1 -- 172.21.15.47:0/3350888480 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc0d3b50 con 0x5582810bff80 2024-07-24T22:17:11.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.717+0000 7f6cee2af740 1 -- 172.21.15.47:0/3350888480 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 msgr2=0x5582810ba080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.717+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3350888480 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810ba080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc101b20 tx=0x7f6cdc0cae30 comp rx=0 tx=0).stop 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.718+0000 7f6cee2af740 1 -- 172.21.15.47:0/3350888480 shutdown_connections 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.718+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3350888480 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810bff80 0x5582810ba080 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.718+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3350888480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810b3ff0 0x5582810d7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.718+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3350888480 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b36d0 0x5582810d7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.718+0000 7f6cee2af740 1 -- 172.21.15.47:0/3350888480 >> 172.21.15.47:0/3350888480 conn(0x5582810b1500 msgr2=0x5582810bb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.718+0000 7f6cee2af740 1 -- 172.21.15.47:0/3350888480 shutdown_connections 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.718+0000 7f6cee2af740 1 -- 172.21.15.47:0/3350888480 wait complete. 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.718+0000 7f6cee2af740 1 -- start start 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.718+0000 7f6cee2af740 1 Processor -- start 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cee2af740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810b36d0 0x5582810c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cee2af740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 0x5582810c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cee2af740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810bff80 0x5582810c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cee2af740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce41b34a0 con 0x5582810bff80 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cee2af740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce41b4910 con 0x5582810b3ff0 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cee2af740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce41b3b70 con 0x5582810b36d0 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6ce9c9a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810b36d0 0x5582810c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6ce9c9a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810b36d0 0x5582810c3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:34268/0 (socket says 172.21.15.47:34268) 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6ce9c9a640 1 -- 172.21.15.47:0/3275304657 learned_addr learned my addr 172.21.15.47:0/3275304657 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6ce9499640 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 0x5582810c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cea49b640 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810bff80 0x5582810c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cee2af740 10 client.0 _ll_register_callbacks cb 0x7f6cdc005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cea49b640 1 -- 172.21.15.47:0/3275304657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810b36d0 msgr2=0x5582810c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cea49b640 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810b36d0 0x5582810c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cea49b640 1 -- 172.21.15.47:0/3275304657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 msgr2=0x5582810c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cea49b640 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 0x5582810c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cea49b640 1 -- 172.21.15.47:0/3275304657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558281139690 con 0x5582810bff80 2024-07-24T22:17:11.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6ce9c9a640 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810b36d0 0x5582810c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:17:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cea49b640 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810bff80 0x5582810c4810 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x558280fbc720 tx=0x7f6cdc0cab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d8e908e7f3ae08 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.719+0000 7f6cc97fa640 1 -- 172.21.15.47:0/3275304657 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc035070 con 0x5582810bff80 2024-07-24T22:17:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6cc97fa640 1 -- 172.21.15.47:0/3275304657 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7f6cdc0d3b50 con 0x5582810bff80 2024-07-24T22:17:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6cee2af740 1 -- 172.21.15.47:0/3275304657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cdc0cf530 con 0x5582810bff80 2024-07-24T22:17:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6cc97fa640 1 -- 172.21.15.47:0/3275304657 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6cdc0a6020 con 0x5582810bff80 2024-07-24T22:17:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6cee2af740 10 client.17649 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6cee2af740 1 -- 172.21.15.47:0/3275304657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558281139690 con 0x5582810bff80 2024-07-24T22:17:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6cc97fa640 1 -- 172.21.15.47:0/3275304657 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cdc0cf530 con 0x5582810bff80 2024-07-24T22:17:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6cc97fa640 1 -- 172.21.15.47:0/3275304657 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6cdc0c68a0 con 0x5582810bff80 2024-07-24T22:17:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6cee2af740 10 client.17649 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6cee2af740 10 client.17649 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:11.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6cee2af740 20 client.17649 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:11.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55828113ac40 0x55828113d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:11.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6cee2af740 4 client.17649 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:17:11.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6cee2af740 1 -- 172.21.15.47:0/3275304657 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5582810283a0 con 0x55828113ac40 2024-07-24T22:17:11.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.720+0000 7f6ce9c9a640 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55828113ac40 0x55828113d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:11.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.721+0000 7f6cc97fa640 10 client.17649 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:11.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.721+0000 7f6ce9c9a640 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55828113ac40 0x55828113d030 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4799c1a8608f567 server_cookie=cd764fb3eeff8946 in_seq=0 out_seq=0 2024-07-24T22:17:11.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.721+0000 7f6cc97fa640 1 -- 172.21.15.47:0/3275304657 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5582810283a0 con 0x55828113ac40 2024-07-24T22:17:11.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.721+0000 7f6cc97fa640 10 client.17649 handle_command_reply: tid=0 2024-07-24T22:17:11.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.721+0000 7f6cee2af740 1 client.17649 shutdown 2024-07-24T22:17:11.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.721+0000 7f6cee2af740 1 -- 172.21.15.47:0/3275304657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810bff80 msgr2=0x5582810c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:11.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.721+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810bff80 0x5582810c4810 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x558280fbc720 tx=0x7f6cdc0cab00 comp rx=0 tx=0).stop 2024-07-24T22:17:11.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.721+0000 7f6cee2af740 1 -- 172.21.15.47:0/3275304657 shutdown_connections 2024-07-24T22:17:11.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.721+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55828113ac40 0x55828113d030 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5582810bff80 0x5582810c4810 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5582810b3ff0 0x5582810c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cee2af740 1 --2- 172.21.15.47:0/3275304657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5582810b36d0 0x5582810c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cee2af740 1 -- 172.21.15.47:0/3275304657 >> 172.21.15.47:0/3275304657 conn(0x5582810b1500 msgr2=0x5582810b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:11.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cc97fa640 0 client.17649 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:11.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cee2af740 1 -- 172.21.15.47:0/3275304657 shutdown_connections 2024-07-24T22:17:11.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cee2af740 1 -- 172.21.15.47:0/3275304657 wait complete. 2024-07-24T22:17:11.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cee2af740 20 client.17649 trim_cache size 0 max 16384 2024-07-24T22:17:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:17:11.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cebefe640 1 -- 172.21.15.47:0/512684591 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6ccc0b3d40 msgr2=0x7f6ccc0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:11.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cebefe640 1 --2- 172.21.15.47:0/512684591 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6ccc0b3d40 0x7f6ccc0b6200 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x5582810b23e0 tx=0x7f6cd400b390 comp rx=0 tx=0).stop 2024-07-24T22:17:11.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cebefe640 1 -- 172.21.15.47:0/512684591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ce4108b20 msgr2=0x7f6ce41a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:11.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cebefe640 1 --2- 172.21.15.47:0/512684591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ce4108b20 0x7f6ce41a1910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc004770 tx=0x7f6cdc004270 comp rx=0 tx=0).stop 2024-07-24T22:17:11.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cebefe640 1 -- 172.21.15.47:0/512684591 shutdown_connections 2024-07-24T22:17:11.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cebefe640 1 --2- 172.21.15.47:0/512684591 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f6ccc0b3d40 0x7f6ccc0b6200 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cebefe640 1 --2- 172.21.15.47:0/512684591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ce4108b20 0x7f6ce41a1910 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cebefe640 1 --2- 172.21.15.47:0/512684591 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ce41081a0 0x7f6ce410ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cebefe640 1 --2- 172.21.15.47:0/512684591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ce4102790 0x7f6ce410e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:11.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.722+0000 7f6cebefe640 1 -- 172.21.15.47:0/512684591 >> 172.21.15.47:0/512684591 conn(0x7f6ce40fe200 msgr2=0x7f6ce41067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:11.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.723+0000 7f6cebefe640 1 -- 172.21.15.47:0/512684591 shutdown_connections 2024-07-24T22:17:11.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:11.723+0000 7f6cebefe640 1 -- 172.21.15.47:0/512684591 wait complete. 2024-07-24T22:17:11.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:11 smithi188 ceph-mon[37380]: pgmap v673: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-07-24T22:17:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:11 smithi188 ceph-mon[37380]: osdmap e94: 12 total, 12 up, 12 in 2024-07-24T22:17:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:11 smithi183 ceph-mon[37007]: pgmap v673: 97 pgs: 97 active+clean; 30 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-07-24T22:17:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:11 smithi183 ceph-mon[37007]: osdmap e94: 12 total, 12 up, 12 in 2024-07-24T22:17:13.497 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:17:13.498 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:17:13.787 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:17:13.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:13 smithi188 ceph-mon[37380]: pgmap v675: 97 pgs: 15 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 73 active+clean; 30 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:17:13.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:13 smithi183 ceph-mon[37007]: pgmap v675: 97 pgs: 15 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 73 active+clean; 30 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:17:13.912 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:13 smithi047 ceph-mon[32551]: pgmap v675: 97 pgs: 15 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 73 active+clean; 30 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:17:15.504 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:15 smithi047 ceph-mon[32551]: pgmap v676: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 28 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-07-24T22:17:15.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.602+0000 7fdb847c1640 1 -- 172.21.15.47:0/2322761739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb7c108180 msgr2=0x7fdb7c1085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:15.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.602+0000 7fdb847c1640 1 --2- 172.21.15.47:0/2322761739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb7c108180 0x7fdb7c1085c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009900 tx=0x7fdb6c02a410 comp rx=0 tx=0).stop 2024-07-24T22:17:15.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.602+0000 7fdb847c1640 1 -- 172.21.15.47:0/2322761739 shutdown_connections 2024-07-24T22:17:15.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.602+0000 7fdb847c1640 1 --2- 172.21.15.47:0/2322761739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb7c108b00 0x7fdb7c10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.602+0000 7fdb847c1640 1 --2- 172.21.15.47:0/2322761739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb7c108180 0x7fdb7c1085c0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.602+0000 7fdb847c1640 1 --2- 172.21.15.47:0/2322761739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c102770 0x7fdb7c102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.602+0000 7fdb847c1640 1 -- 172.21.15.47:0/2322761739 >> 172.21.15.47:0/2322761739 conn(0x7fdb7c0fe1c0 msgr2=0x7fdb7c1005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:15.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.602+0000 7fdb847c1640 1 -- 172.21.15.47:0/2322761739 shutdown_connections 2024-07-24T22:17:15.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.602+0000 7fdb847c1640 1 -- 172.21.15.47:0/2322761739 wait complete. 2024-07-24T22:17:15.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.602+0000 7fdb847c1640 1 Processor -- start 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.602+0000 7fdb847c1640 1 -- start start 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb847c1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb7c102770 0x7fdb7c198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb847c1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c108180 0x7fdb7c199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb847c1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb7c108b00 0x7fdb7c19e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb847c1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c112700 con 0x7fdb7c102770 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb847c1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c112580 con 0x7fdb7c108b00 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb847c1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c112880 con 0x7fdb7c108180 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb8255d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb7c102770 0x7fdb7c198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb8255d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb7c102770 0x7fdb7c198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59726/0 (socket says 172.21.15.47:59726) 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb8255d640 1 -- 172.21.15.47:0/1434905693 learned_addr learned my addr 172.21.15.47:0/1434905693 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb81d5c640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c108180 0x7fdb7c199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb82d5e640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb7c108b00 0x7fdb7c19e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb8255d640 1 -- 172.21.15.47:0/1434905693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c108180 msgr2=0x7fdb7c199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:15.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb8255d640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c108180 0x7fdb7c199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb8255d640 1 -- 172.21.15.47:0/1434905693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb7c108b00 msgr2=0x7fdb7c19e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb8255d640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb7c108b00 0x7fdb7c19e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb8255d640 1 -- 172.21.15.47:0/1434905693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c19ed00 con 0x7fdb7c102770 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb8255d640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb7c102770 0x7fdb7c198c50 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800e9f0 tx=0x7fdb7800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.603+0000 7fdb737fe640 1 -- 172.21.15.47:0/1434905693 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7800cd80 con 0x7fdb7c102770 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.604+0000 7fdb847c1640 1 -- 172.21.15.47:0/1434905693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7c19eff0 con 0x7fdb7c102770 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.604+0000 7fdb737fe640 1 -- 172.21.15.47:0/1434905693 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb780108e0 con 0x7fdb7c102770 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.604+0000 7fdb737fe640 1 -- 172.21.15.47:0/1434905693 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb78018980 con 0x7fdb7c102770 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.604+0000 7fdb847c1640 1 -- 172.21.15.47:0/1434905693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb7c1a5880 con 0x7fdb7c102770 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.606+0000 7fdb737fe640 1 -- 172.21.15.47:0/1434905693 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fdb78010430 con 0x7fdb7c102770 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.606+0000 7fdb86b72740 1 Processor -- start 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.607+0000 7fdb86b72740 1 -- start start 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.607+0000 7fdb86b72740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b2ff30 0x55ead7b30310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.607+0000 7fdb86b72740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b30850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.607+0000 7fdb86b72740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b44e90 0x55ead7b47280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.607+0000 7fdb86b72740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ead7aa79f0 con 0x55ead7b2ff30 2024-07-24T22:17:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.607+0000 7fdb86b72740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ead7a96ef0 con 0x55ead7b44e90 2024-07-24T22:17:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.607+0000 7fdb86b72740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ead7a9af30 con 0x55ead7b3a290 2024-07-24T22:17:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.607+0000 7fdb82d5e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b2ff30 0x55ead7b30310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.607+0000 7fdb82d5e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b2ff30 0x55ead7b30310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59740/0 (socket says 172.21.15.47:59740) 2024-07-24T22:17:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.608+0000 7fdb82d5e640 1 -- 172.21.15.47:0/2904938678 learned_addr learned my addr 172.21.15.47:0/2904938678 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.608+0000 7fdb81d5c640 1 --2- 172.21.15.47:0/2904938678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b44e90 0x55ead7b47280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.608+0000 7fdb82d5e640 1 -- 172.21.15.47:0/2904938678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 msgr2=0x55ead7b30850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:17:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.608+0000 7fdb82d5e640 1 --2- 172.21.15.47:0/2904938678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b30850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.608+0000 7fdb82d5e640 1 -- 172.21.15.47:0/2904938678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b44e90 msgr2=0x55ead7b47280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.608+0000 7fdb82d5e640 1 --2- 172.21.15.47:0/2904938678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b44e90 0x55ead7b47280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.608+0000 7fdb82d5e640 1 -- 172.21.15.47:0/2904938678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ead77f7930 con 0x55ead7b2ff30 2024-07-24T22:17:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.608+0000 7fdb737fe640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdb680b3d40 0x7fdb680b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.608+0000 7fdb8255d640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdb680b3d40 0x7fdb680b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.608+0000 7fdb737fe640 1 -- 172.21.15.47:0/1434905693 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7fdb780e4370 con 0x7fdb7c102770 2024-07-24T22:17:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.608+0000 7fdb82d5e640 1 --2- 172.21.15.47:0/2904938678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b2ff30 0x55ead7b30310 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009fd0 tx=0x7fdb740118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bc6fb349a38b93 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.609+0000 7fdb70ff9640 1 -- 172.21.15.47:0/2904938678 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74004d20 con 0x55ead7b2ff30 2024-07-24T22:17:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.609+0000 7fdb70ff9640 1 -- 172.21.15.47:0/2904938678 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb74004050 con 0x55ead7b2ff30 2024-07-24T22:17:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.609+0000 7fdb8255d640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdb680b3d40 0x7fdb680b6200 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdb780a7050 tx=0x7fdb7806ff60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.609+0000 7fdb70ff9640 1 -- 172.21.15.47:0/2904938678 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74005280 con 0x55ead7b2ff30 2024-07-24T22:17:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.610+0000 7fdb86b72740 1 -- 172.21.15.47:0/2904938678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b2ff30 msgr2=0x55ead7b30310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.610+0000 7fdb86b72740 1 --2- 172.21.15.47:0/2904938678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b2ff30 0x55ead7b30310 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009fd0 tx=0x7fdb740118d0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.610+0000 7fdb86b72740 1 -- 172.21.15.47:0/2904938678 shutdown_connections 2024-07-24T22:17:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.610+0000 7fdb86b72740 1 --2- 172.21.15.47:0/2904938678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b44e90 0x55ead7b47280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.610+0000 7fdb86b72740 1 --2- 172.21.15.47:0/2904938678 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b30850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.610+0000 7fdb86b72740 1 --2- 172.21.15.47:0/2904938678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b2ff30 0x55ead7b30310 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.610+0000 7fdb86b72740 1 -- 172.21.15.47:0/2904938678 >> 172.21.15.47:0/2904938678 conn(0x55ead7b2dd60 msgr2=0x55ead7b2ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.610+0000 7fdb86b72740 1 -- 172.21.15.47:0/2904938678 shutdown_connections 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.610+0000 7fdb86b72740 1 -- 172.21.15.47:0/2904938678 wait complete. 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb86b72740 1 -- start start 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb86b72740 1 Processor -- start 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb86b72740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 0x55ead7b39d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb86b72740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b371e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb86b72740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b44e90 0x55ead7b37970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb86b72740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ead78fa890 con 0x55ead7b44e90 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb86b72740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ead7a39390 con 0x55ead7b2ff30 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb86b72740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ead7b47cd0 con 0x55ead7b3a290 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb86b72740 10 client.0 _ll_register_callbacks cb 0x55ead7a43500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb81d5c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb82d5e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b44e90 0x55ead7b37970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb81d5c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b371e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:42360/0 (socket says 172.21.15.47:42360) 2024-07-24T22:17:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb81d5c640 1 -- 172.21.15.47:0/3178679351 learned_addr learned my addr 172.21.15.47:0/3178679351 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.611+0000 7fdb82d5e640 1 --2- 172.21.15.47:0/3178679351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 0x55ead7b39d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.612+0000 7fdb81d5c640 1 -- 172.21.15.47:0/3178679351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 msgr2=0x55ead7b39d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.612+0000 7fdb81d5c640 1 --2- 172.21.15.47:0/3178679351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 0x55ead7b39d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.612+0000 7fdb81d5c640 1 -- 172.21.15.47:0/3178679351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b44e90 msgr2=0x55ead7b37970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.612+0000 7fdb81d5c640 1 --2- 172.21.15.47:0/3178679351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b44e90 0x55ead7b37970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.612+0000 7fdb81d5c640 1 -- 172.21.15.47:0/3178679351 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ead7a33d60 con 0x55ead7b3a290 2024-07-24T22:17:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.612+0000 7fdb81d5c640 1 --2- 172.21.15.47:0/3178679351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b371e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009900 tx=0x7fdb6c009660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0abdbdc833225a6 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.612+0000 7fdb65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:17:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.612+0000 7fdb65ffb640 1 -- 172.21.15.47:0/3178679351 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c035040 con 0x55ead7b3a290 2024-07-24T22:17:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.612+0000 7fdb86b72740 1 -- 172.21.15.47:0/3178679351 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb74004050 con 0x55ead7b3a290 2024-07-24T22:17:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.612+0000 7fdb65ffb640 1 -- 172.21.15.47:0/3178679351 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7fdb6c031720 con 0x55ead7b3a290 2024-07-24T22:17:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.612+0000 7fdb65ffb640 1 -- 172.21.15.47:0/3178679351 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdb6c031920 con 0x55ead7b3a290 2024-07-24T22:17:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.612+0000 7fdb86b72740 10 client.26782 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.612+0000 7fdb86b72740 1 -- 172.21.15.47:0/3178679351 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ead7b53b90 con 0x55ead7b3a290 2024-07-24T22:17:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.613+0000 7fdb65ffb640 1 -- 172.21.15.47:0/3178679351 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb74004050 con 0x55ead7b3a290 2024-07-24T22:17:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.613+0000 7fdb65ffb640 1 -- 172.21.15.47:0/3178679351 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdb6c004750 con 0x55ead7b3a290 2024-07-24T22:17:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.613+0000 7fdb86b72740 10 client.26782 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.613+0000 7fdb86b72740 10 client.26782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.613+0000 7fdb86b72740 20 client.26782 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.613+0000 7fdb86b72740 1 --2- 172.21.15.47:0/3178679351 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ead7b55410 0x55ead7b57830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.613+0000 7fdb86b72740 4 client.26782 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.613+0000 7fdb86b72740 1 -- 172.21.15.47:0/3178679351 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ead7aa9940 con 0x55ead7b55410 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.613+0000 7fdb82d5e640 1 --2- 172.21.15.47:0/3178679351 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ead7b55410 0x55ead7b57830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.614+0000 7fdb82d5e640 1 --2- 172.21.15.47:0/3178679351 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ead7b55410 0x55ead7b57830 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1521e8b2f5e13412 server_cookie=1f58703550fc31c5 in_seq=0 out_seq=0 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.614+0000 7fdb65ffb640 10 client.26782 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.614+0000 7fdb65ffb640 1 -- 172.21.15.47:0/3178679351 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ead7aa9940 con 0x55ead7b55410 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.614+0000 7fdb65ffb640 10 client.26782 handle_command_reply: tid=0 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.614+0000 7fdb86b72740 1 client.26782 shutdown 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.615+0000 7fdb86b72740 1 -- 172.21.15.47:0/3178679351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 msgr2=0x55ead7b371e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.615+0000 7fdb86b72740 1 --2- 172.21.15.47:0/3178679351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b371e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009900 tx=0x7fdb6c009660 comp rx=0 tx=0).stop 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.615+0000 7fdb86b72740 1 -- 172.21.15.47:0/3178679351 shutdown_connections 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.615+0000 7fdb86b72740 1 --2- 172.21.15.47:0/3178679351 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ead7b55410 0x55ead7b57830 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.615+0000 7fdb86b72740 1 --2- 172.21.15.47:0/3178679351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b44e90 0x55ead7b37970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.615+0000 7fdb86b72740 1 --2- 172.21.15.47:0/3178679351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b371e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.615+0000 7fdb86b72740 1 --2- 172.21.15.47:0/3178679351 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 0x55ead7b39d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.615+0000 7fdb86b72740 1 -- 172.21.15.47:0/3178679351 >> 172.21.15.47:0/3178679351 conn(0x55ead7b2dd60 msgr2=0x55ead7b2c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:15.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.615+0000 7fdb65ffb640 0 client.26782 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:15.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.615+0000 7fdb86b72740 1 -- 172.21.15.47:0/3178679351 shutdown_connections 2024-07-24T22:17:15.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.615+0000 7fdb86b72740 1 -- 172.21.15.47:0/3178679351 wait complete. 2024-07-24T22:17:15.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.615+0000 7fdb86b72740 20 client.26782 trim_cache size 0 max 16384 2024-07-24T22:17:15.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.637+0000 7fdb86b72740 1 Processor -- start 2024-07-24T22:17:15.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.637+0000 7fdb86b72740 1 -- start start 2024-07-24T22:17:15.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb86b72740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 0x55ead7b30a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb86b72740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b3a290 0x55ead7b2c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb86b72740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b44e90 0x55ead7b2cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb86b72740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c1aa020 con 0x55ead7b3a290 2024-07-24T22:17:15.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb86b72740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c1ac880 con 0x55ead7b2ff30 2024-07-24T22:17:15.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb86b72740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c1aa670 con 0x55ead7b44e90 2024-07-24T22:17:15.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb81d5c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b3a290 0x55ead7b2c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb81d5c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b3a290 0x55ead7b2c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59768/0 (socket says 172.21.15.47:59768) 2024-07-24T22:17:15.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb81d5c640 1 -- 172.21.15.47:0/3459598085 learned_addr learned my addr 172.21.15.47:0/3459598085 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:15.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb81d5c640 1 -- 172.21.15.47:0/3459598085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b44e90 msgr2=0x55ead7b2cb40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:17:15.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb81d5c640 1 --2- 172.21.15.47:0/3459598085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b44e90 0x55ead7b2cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb81d5c640 1 -- 172.21.15.47:0/3459598085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 msgr2=0x55ead7b30a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:17:15.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb81d5c640 1 --2- 172.21.15.47:0/3459598085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 0x55ead7b30a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.638+0000 7fdb81d5c640 1 -- 172.21.15.47:0/3459598085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ead7b36120 con 0x55ead7b3a290 2024-07-24T22:17:15.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.639+0000 7fdb81d5c640 1 --2- 172.21.15.47:0/3459598085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b3a290 0x55ead7b2c600 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c02a930 tx=0x7fdb6c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb73027d09888331 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:15.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.639+0000 7fdb67fff640 1 -- 172.21.15.47:0/3459598085 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c035030 con 0x55ead7b3a290 2024-07-24T22:17:15.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.639+0000 7fdb67fff640 1 -- 172.21.15.47:0/3459598085 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb6c0314a0 con 0x55ead7b3a290 2024-07-24T22:17:15.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.639+0000 7fdb67fff640 1 -- 172.21.15.47:0/3459598085 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c005410 con 0x55ead7b3a290 2024-07-24T22:17:15.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.640+0000 7fdb86b72740 1 -- 172.21.15.47:0/3459598085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b3a290 msgr2=0x55ead7b2c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:15.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.640+0000 7fdb86b72740 1 --2- 172.21.15.47:0/3459598085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b3a290 0x55ead7b2c600 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c02a930 tx=0x7fdb6c02a410 comp rx=0 tx=0).stop 2024-07-24T22:17:15.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.640+0000 7fdb86b72740 1 -- 172.21.15.47:0/3459598085 shutdown_connections 2024-07-24T22:17:15.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.640+0000 7fdb86b72740 1 --2- 172.21.15.47:0/3459598085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b44e90 0x55ead7b2cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.640+0000 7fdb86b72740 1 --2- 172.21.15.47:0/3459598085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b3a290 0x55ead7b2c600 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.640+0000 7fdb86b72740 1 --2- 172.21.15.47:0/3459598085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 0x55ead7b30a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.640+0000 7fdb86b72740 1 -- 172.21.15.47:0/3459598085 >> 172.21.15.47:0/3459598085 conn(0x55ead7b2dd60 msgr2=0x55ead7b30310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:15.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.641+0000 7fdb86b72740 1 -- 172.21.15.47:0/3459598085 shutdown_connections 2024-07-24T22:17:15.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.641+0000 7fdb86b72740 1 -- 172.21.15.47:0/3459598085 wait complete. 2024-07-24T22:17:15.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.641+0000 7fdb86b72740 1 -- start start 2024-07-24T22:17:15.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.641+0000 7fdb86b72740 1 Processor -- start 2024-07-24T22:17:15.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb86b72740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 0x55ead7b4d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb86b72740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b48bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb86b72740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b44e90 0x55ead7b491a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb86b72740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c1aad40 con 0x55ead7b44e90 2024-07-24T22:17:15.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb86b72740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c1ac1b0 con 0x55ead7b2ff30 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb86b72740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c1ab410 con 0x55ead7b3a290 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb86b72740 10 client.0 _ll_register_callbacks cb 0x7fdb6c032c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb82d5e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b44e90 0x55ead7b491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb82d5e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b44e90 0x55ead7b491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59778/0 (socket says 172.21.15.47:59778) 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb82d5e640 1 -- 172.21.15.47:0/221771579 learned_addr learned my addr 172.21.15.47:0/221771579 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb81d5c640 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b48bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb82d5e640 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 0x55ead7b4d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb82d5e640 1 -- 172.21.15.47:0/221771579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 msgr2=0x55ead7b48bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb82d5e640 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b48bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb82d5e640 1 -- 172.21.15.47:0/221771579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 msgr2=0x55ead7b4d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb82d5e640 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 0x55ead7b4d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb82d5e640 1 -- 172.21.15.47:0/221771579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ead7b499d0 con 0x55ead7b44e90 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.642+0000 7fdb81d5c640 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b48bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:17:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb82d5e640 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b44e90 0x55ead7b491a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fdb74005fd0 tx=0x7fdb74003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804c1479047a251f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb65ffb640 1 -- 172.21.15.47:0/221771579 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7402c030 con 0x55ead7b44e90 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb65ffb640 1 -- 172.21.15.47:0/221771579 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7fdb74004260 con 0x55ead7b44e90 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb86b72740 1 -- 172.21.15.47:0/221771579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb6c0314a0 con 0x55ead7b44e90 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb65ffb640 1 -- 172.21.15.47:0/221771579 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdb74041050 con 0x55ead7b44e90 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb86b72740 10 client.17667 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb86b72740 1 -- 172.21.15.47:0/221771579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ead7bc0210 con 0x55ead7b44e90 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb65ffb640 1 -- 172.21.15.47:0/221771579 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb6c0314a0 con 0x55ead7b44e90 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb65ffb640 1 -- 172.21.15.47:0/221771579 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdb7400fb70 con 0x55ead7b44e90 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb86b72740 10 client.17667 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb86b72740 10 client.17667 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb86b72740 20 client.17667 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb86b72740 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ead7bc07a0 0x55ead7bc2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb86b72740 4 client.17667 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:17:15.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.643+0000 7fdb86b72740 1 -- 172.21.15.47:0/221771579 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ead7aa53e0 con 0x55ead7bc07a0 2024-07-24T22:17:15.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.644+0000 7fdb81d5c640 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ead7bc07a0 0x55ead7bc2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:15.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.644+0000 7fdb81d5c640 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ead7bc07a0 0x55ead7bc2bc0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e1ab6aa7f33c5f8 server_cookie=c628bdcda0ea61a7 in_seq=0 out_seq=0 2024-07-24T22:17:15.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.644+0000 7fdb65ffb640 10 client.17667 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:15.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.645+0000 7fdb65ffb640 1 -- 172.21.15.47:0/221771579 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ead7aa53e0 con 0x55ead7bc07a0 2024-07-24T22:17:15.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.645+0000 7fdb65ffb640 10 client.17667 handle_command_reply: tid=0 2024-07-24T22:17:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.645+0000 7fdb86b72740 1 client.17667 shutdown 2024-07-24T22:17:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.645+0000 7fdb86b72740 1 -- 172.21.15.47:0/221771579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b44e90 msgr2=0x55ead7b491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.645+0000 7fdb86b72740 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b44e90 0x55ead7b491a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fdb74005fd0 tx=0x7fdb74003f50 comp rx=0 tx=0).stop 2024-07-24T22:17:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.645+0000 7fdb86b72740 1 -- 172.21.15.47:0/221771579 shutdown_connections 2024-07-24T22:17:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.645+0000 7fdb86b72740 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55ead7bc07a0 0x55ead7bc2bc0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.645+0000 7fdb86b72740 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ead7b44e90 0x55ead7b491a0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.645+0000 7fdb86b72740 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ead7b3a290 0x55ead7b48bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.645+0000 7fdb86b72740 1 --2- 172.21.15.47:0/221771579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ead7b2ff30 0x55ead7b4d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.645+0000 7fdb65ffb640 0 client.17667 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.645+0000 7fdb86b72740 1 -- 172.21.15.47:0/221771579 >> 172.21.15.47:0/221771579 conn(0x55ead7b2dd60 msgr2=0x55ead7b2c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.645+0000 7fdb86b72740 1 -- 172.21.15.47:0/221771579 shutdown_connections 2024-07-24T22:17:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb86b72740 1 -- 172.21.15.47:0/221771579 wait complete. 2024-07-24T22:17:15.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb86b72740 20 client.17667 trim_cache size 0 max 16384 2024-07-24T22:17:15.652 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:17:15.652 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:17:15.652 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "1fce2217-56d1-483a-9b02-e27042052132", 2024-07-24T22:17:15.652 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:17:15.652 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:17:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb847c1640 1 -- 172.21.15.47:0/1434905693 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdb680b3d40 msgr2=0x7fdb680b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb847c1640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdb680b3d40 0x7fdb680b6200 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdb780a7050 tx=0x7fdb7806ff60 comp rx=0 tx=0).stop 2024-07-24T22:17:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb847c1640 1 -- 172.21.15.47:0/1434905693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb7c102770 msgr2=0x7fdb7c198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb847c1640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb7c102770 0x7fdb7c198c50 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800e9f0 tx=0x7fdb7800eeb0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb847c1640 1 -- 172.21.15.47:0/1434905693 shutdown_connections 2024-07-24T22:17:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb847c1640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdb680b3d40 0x7fdb680b6200 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb847c1640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb7c108b00 0x7fdb7c19e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb847c1640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb7c108180 0x7fdb7c199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb847c1640 1 --2- 172.21.15.47:0/1434905693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb7c102770 0x7fdb7c198c50 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb847c1640 1 -- 172.21.15.47:0/1434905693 >> 172.21.15.47:0/1434905693 conn(0x7fdb7c0fe1c0 msgr2=0x7fdb7c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb847c1640 1 -- 172.21.15.47:0/1434905693 shutdown_connections 2024-07-24T22:17:15.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:15.646+0000 7fdb847c1640 1 -- 172.21.15.47:0/1434905693 wait complete. 2024-07-24T22:17:15.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:15 smithi188 ceph-mon[37380]: pgmap v676: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 28 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-07-24T22:17:15.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:15 smithi183 ceph-mon[37007]: pgmap v676: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 28 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-07-24T22:17:16.536 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:17:16.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:16 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:17:16.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:16 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:17:16.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:16 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:17:16.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:16 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:17:16.852 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:17:16.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:16 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:17:16.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:16 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:17:16.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:16 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:17:16.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:16 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:17:16.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:16 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:17:16.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:16 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:17:16.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:16 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:17:16.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:16 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:17:17.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:17 smithi047 ceph-mon[32551]: pgmap v677: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 28 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 1.5 KiB/s rd, 921 B/s wr, 3 op/s 2024-07-24T22:17:17.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:17 smithi188 ceph-mon[37380]: pgmap v677: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 28 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 1.5 KiB/s rd, 921 B/s wr, 3 op/s 2024-07-24T22:17:17.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:17 smithi183 ceph-mon[37007]: pgmap v677: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 28 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 1.5 KiB/s rd, 921 B/s wr, 3 op/s 2024-07-24T22:17:18.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.597+0000 7facda78c640 1 -- 172.21.15.47:0/1839991123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facd4101690 msgr2=0x7facd4101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:18.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.597+0000 7facda78c640 1 --2- 172.21.15.47:0/1839991123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facd4101690 0x7facd4101a70 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7facc4009900 tx=0x7facc402a410 comp rx=0 tx=0).stop 2024-07-24T22:17:18.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.598+0000 7facda78c640 1 -- 172.21.15.47:0/1839991123 shutdown_connections 2024-07-24T22:17:18.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.598+0000 7facda78c640 1 --2- 172.21.15.47:0/1839991123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd4107a20 0x7facd410e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.598+0000 7facda78c640 1 --2- 172.21.15.47:0/1839991123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd41070a0 0x7facd41074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.598+0000 7facda78c640 1 --2- 172.21.15.47:0/1839991123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facd4101690 0x7facd4101a70 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.598+0000 7facda78c640 1 -- 172.21.15.47:0/1839991123 >> 172.21.15.47:0/1839991123 conn(0x7facd40fd100 msgr2=0x7facd40ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:18.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.598+0000 7facda78c640 1 -- 172.21.15.47:0/1839991123 shutdown_connections 2024-07-24T22:17:18.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.598+0000 7facda78c640 1 -- 172.21.15.47:0/1839991123 wait complete. 2024-07-24T22:17:18.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.599+0000 7facda78c640 1 Processor -- start 2024-07-24T22:17:18.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.599+0000 7facda78c640 1 -- start start 2024-07-24T22:17:18.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7facda78c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd4101690 0x7facd40ff0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7facda78c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd41070a0 0x7facd40fd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7facda78c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facd4107a20 0x7facd40fdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7facda78c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7facd4111650 con 0x7facd4107a20 2024-07-24T22:17:18.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7facda78c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7facd41114d0 con 0x7facd4101690 2024-07-24T22:17:18.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7facda78c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7facd41117d0 con 0x7facd41070a0 2024-07-24T22:17:18.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7facd3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd4101690 0x7facd40ff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7faccbfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd41070a0 0x7facd40fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7facd8d29640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facd4107a20 0x7facd40fdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7faccbfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd41070a0 0x7facd40fd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:42392/0 (socket says 172.21.15.47:42392) 2024-07-24T22:17:18.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7faccbfff640 1 -- 172.21.15.47:0/4287099304 learned_addr learned my addr 172.21.15.47:0/4287099304 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:18.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7facd3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd4101690 0x7facd40ff0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:41726/0 (socket says 172.21.15.47:41726) 2024-07-24T22:17:18.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7faccbfff640 1 -- 172.21.15.47:0/4287099304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd4101690 msgr2=0x7facd40ff0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:18.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7faccbfff640 1 --2- 172.21.15.47:0/4287099304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd4101690 0x7facd40ff0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7faccbfff640 1 -- 172.21.15.47:0/4287099304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facd4107a20 msgr2=0x7facd40fdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:18.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7faccbfff640 1 --2- 172.21.15.47:0/4287099304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facd4107a20 0x7facd40fdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7faccbfff640 1 -- 172.21.15.47:0/4287099304 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd41ab580 con 0x7facd41070a0 2024-07-24T22:17:18.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.600+0000 7faccbfff640 1 --2- 172.21.15.47:0/4287099304 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd41070a0 0x7facd40fd600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7facbc00e9f0 tx=0x7facbc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:18.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.601+0000 7facd1ffb640 1 -- 172.21.15.47:0/4287099304 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc00cd80 con 0x7facd41070a0 2024-07-24T22:17:18.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.601+0000 7facd1ffb640 1 -- 172.21.15.47:0/4287099304 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facbc0054d0 con 0x7facd41070a0 2024-07-24T22:17:18.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.601+0000 7facda78c640 1 -- 172.21.15.47:0/4287099304 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd41ab750 con 0x7facd41070a0 2024-07-24T22:17:18.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.601+0000 7facda78c640 1 -- 172.21.15.47:0/4287099304 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd41abc10 con 0x7facd41070a0 2024-07-24T22:17:18.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.601+0000 7facd1ffb640 1 -- 172.21.15.47:0/4287099304 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc010690 con 0x7facd41070a0 2024-07-24T22:17:18.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.603+0000 7facd1ffb640 1 -- 172.21.15.47:0/4287099304 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7facbc004e90 con 0x7facd41070a0 2024-07-24T22:17:18.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.604+0000 7facdcb3d740 1 Processor -- start 2024-07-24T22:17:18.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.604+0000 7facdcb3d740 1 -- start start 2024-07-24T22:17:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.604+0000 7facdcb3d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4680 0x55681eee4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.604+0000 7facdcb3d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4fa0 0x55681eef09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.604+0000 7facdcb3d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eef0f30 0x55681eef3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.604+0000 7facdcb3d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55681ee5b960 con 0x55681eef0f30 2024-07-24T22:17:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.604+0000 7facdcb3d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55681ee4ae60 con 0x55681eee4fa0 2024-07-24T22:17:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.604+0000 7facdcb3d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55681ee4eea0 con 0x55681eee4680 2024-07-24T22:17:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.604+0000 7facd8d29640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4680 0x55681eee4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.604+0000 7facd8d29640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4680 0x55681eee4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:42406/0 (socket says 172.21.15.47:42406) 2024-07-24T22:17:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.604+0000 7facd8d29640 1 -- 172.21.15.47:0/1548041666 learned_addr learned my addr 172.21.15.47:0/1548041666 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.605+0000 7facd8d29640 1 -- 172.21.15.47:0/1548041666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4fa0 msgr2=0x55681eef09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.605+0000 7facd8d29640 1 --2- 172.21.15.47:0/1548041666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4fa0 0x55681eef09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.605+0000 7facd8d29640 1 -- 172.21.15.47:0/1548041666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eef0f30 msgr2=0x55681eef3320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-24T22:17:18.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.605+0000 7facd8d29640 1 --2- 172.21.15.47:0/1548041666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eef0f30 0x55681eef3320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.605+0000 7facd8d29640 1 -- 172.21.15.47:0/1548041666 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55681edd42d0 con 0x55681eee4680 2024-07-24T22:17:18.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.605+0000 7facd8d29640 1 --2- 172.21.15.47:0/1548041666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4680 0x55681eee4a60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faccc007f40 tx=0x7faccc00f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1393896ba7f8114e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:18.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.605+0000 7facca7fc640 1 -- 172.21.15.47:0/1548041666 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc010900 con 0x55681eee4680 2024-07-24T22:17:18.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.605+0000 7facca7fc640 1 -- 172.21.15.47:0/1548041666 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faccc0183f0 con 0x55681eee4680 2024-07-24T22:17:18.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.605+0000 7facca7fc640 1 -- 172.21.15.47:0/1548041666 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc017600 con 0x55681eee4680 2024-07-24T22:17:18.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.606+0000 7facd1ffb640 1 --2- 172.21.15.47:0/4287099304 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7facc00b3d40 0x7facc00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.606+0000 7facd3fff640 1 --2- 172.21.15.47:0/4287099304 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7facc00b3d40 0x7facc00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.606+0000 7facd1ffb640 1 -- 172.21.15.47:0/4287099304 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7facbc0e4440 con 0x7facd41070a0 2024-07-24T22:17:18.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.606+0000 7facdcb3d740 1 -- 172.21.15.47:0/1548041666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4680 msgr2=0x55681eee4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:18.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.606+0000 7facdcb3d740 1 --2- 172.21.15.47:0/1548041666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4680 0x55681eee4a60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faccc007f40 tx=0x7faccc00f850 comp rx=0 tx=0).stop 2024-07-24T22:17:18.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.607+0000 7facdcb3d740 1 -- 172.21.15.47:0/1548041666 shutdown_connections 2024-07-24T22:17:18.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.607+0000 7facdcb3d740 1 --2- 172.21.15.47:0/1548041666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eef0f30 0x55681eef3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.607+0000 7facdcb3d740 1 --2- 172.21.15.47:0/1548041666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4fa0 0x55681eef09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.607+0000 7facdcb3d740 1 --2- 172.21.15.47:0/1548041666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4680 0x55681eee4a60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.607+0000 7facdcb3d740 1 -- 172.21.15.47:0/1548041666 >> 172.21.15.47:0/1548041666 conn(0x55681eee24b0 msgr2=0x55681eee3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:18.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.607+0000 7facdcb3d740 1 -- 172.21.15.47:0/1548041666 shutdown_connections 2024-07-24T22:17:18.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.607+0000 7facdcb3d740 1 -- 172.21.15.47:0/1548041666 wait complete. 2024-07-24T22:17:18.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.607+0000 7facd3fff640 1 --2- 172.21.15.47:0/4287099304 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7facc00b3d40 0x7facc00b6200 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7facc4031440 tx=0x7facc4005bc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:18.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.607+0000 7facdcb3d740 1 -- start start 2024-07-24T22:17:18.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.607+0000 7facdcb3d740 1 Processor -- start 2024-07-24T22:17:18.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facdcb3d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4680 0x55681eeede50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facdcb3d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4fa0 0x55681eeee390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facdcb3d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eef0f30 0x55681eeee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facdcb3d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55681ecae700 con 0x55681eef0f30 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facdcb3d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55681eded5a0 con 0x55681eee4680 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facdcb3d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55681eef3c00 con 0x55681eee4fa0 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facdcb3d740 10 client.0 _ll_register_callbacks cb 0x55681ee0d910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facd3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4680 0x55681eeede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facd8d29640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eef0f30 0x55681eeee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facd3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4680 0x55681eeede50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:41748/0 (socket says 172.21.15.47:41748) 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facd3fff640 1 -- 172.21.15.47:0/2787552694 learned_addr learned my addr 172.21.15.47:0/2787552694 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7faccbfff640 1 --2- 172.21.15.47:0/2787552694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4fa0 0x55681eeee390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facd8d29640 1 -- 172.21.15.47:0/2787552694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4fa0 msgr2=0x55681eeee390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facd8d29640 1 --2- 172.21.15.47:0/2787552694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4fa0 0x55681eeee390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facd8d29640 1 -- 172.21.15.47:0/2787552694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4680 msgr2=0x55681eeede50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facd8d29640 1 --2- 172.21.15.47:0/2787552694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4680 0x55681eeede50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facd8d29640 1 -- 172.21.15.47:0/2787552694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55681ede0630 con 0x55681eef0f30 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.608+0000 7facd3fff640 1 --2- 172.21.15.47:0/2787552694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4680 0x55681eeede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.609+0000 7facd8d29640 1 --2- 172.21.15.47:0/2787552694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eef0f30 0x55681eeee8d0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7faccc01a040 tx=0x7faccc007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1d4cf4fcdb05fb server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.609+0000 7facb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.609+0000 7facb37fe640 1 -- 172.21.15.47:0/2787552694 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc025020 con 0x55681eef0f30 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.609+0000 7facb37fe640 1 -- 172.21.15.47:0/2787552694 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7faccc004d10 con 0x55681eef0f30 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.609+0000 7facdcb3d740 1 -- 172.21.15.47:0/2787552694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faccc0183f0 con 0x55681eef0f30 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.609+0000 7facb37fe640 1 -- 172.21.15.47:0/2787552694 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7faccc030050 con 0x55681eef0f30 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.609+0000 7facdcb3d740 10 client.17676 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.609+0000 7facdcb3d740 1 -- 172.21.15.47:0/2787552694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55681ebab650 con 0x55681eef0f30 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.609+0000 7facb37fe640 1 -- 172.21.15.47:0/2787552694 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faccc0183f0 con 0x55681eef0f30 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.609+0000 7facb37fe640 1 -- 172.21.15.47:0/2787552694 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7faccc004040 con 0x55681eef0f30 2024-07-24T22:17:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.610+0000 7facdcb3d740 10 client.17676 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.610+0000 7facdcb3d740 10 client.17676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.610+0000 7facdcb3d740 20 client.17676 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.610+0000 7facdcb3d740 1 --2- 172.21.15.47:0/2787552694 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55681ef009a0 0x55681ef02d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.610+0000 7facdcb3d740 4 client.17676 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.610+0000 7facdcb3d740 1 -- 172.21.15.47:0/2787552694 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55681ee5d8b0 con 0x55681ef009a0 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.610+0000 7facd3fff640 1 --2- 172.21.15.47:0/2787552694 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55681ef009a0 0x55681ef02d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.610+0000 7facd3fff640 1 --2- 172.21.15.47:0/2787552694 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55681ef009a0 0x55681ef02d90 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40a0f3408b019b09 server_cookie=e93efae6a69c3b84 in_seq=0 out_seq=0 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.610+0000 7facb37fe640 10 client.17676 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facb37fe640 1 -- 172.21.15.47:0/2787552694 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55681ee5d8b0 con 0x55681ef009a0 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facb37fe640 10 client.17676 handle_command_reply: tid=0 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facdcb3d740 1 client.17676 shutdown 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facdcb3d740 1 -- 172.21.15.47:0/2787552694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eef0f30 msgr2=0x55681eeee8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facdcb3d740 1 --2- 172.21.15.47:0/2787552694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eef0f30 0x55681eeee8d0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7faccc01a040 tx=0x7faccc007c40 comp rx=0 tx=0).stop 2024-07-24T22:17:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facdcb3d740 1 -- 172.21.15.47:0/2787552694 shutdown_connections 2024-07-24T22:17:18.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facdcb3d740 1 --2- 172.21.15.47:0/2787552694 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55681ef009a0 0x55681ef02d90 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facdcb3d740 1 --2- 172.21.15.47:0/2787552694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eef0f30 0x55681eeee8d0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facdcb3d740 1 --2- 172.21.15.47:0/2787552694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4fa0 0x55681eeee390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facdcb3d740 1 --2- 172.21.15.47:0/2787552694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4680 0x55681eeede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facdcb3d740 1 -- 172.21.15.47:0/2787552694 >> 172.21.15.47:0/2787552694 conn(0x55681eee24b0 msgr2=0x55681eee8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:18.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facb37fe640 0 client.17676 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:18.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facdcb3d740 1 -- 172.21.15.47:0/2787552694 shutdown_connections 2024-07-24T22:17:18.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facdcb3d740 1 -- 172.21.15.47:0/2787552694 wait complete. 2024-07-24T22:17:18.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.611+0000 7facdcb3d740 20 client.17676 trim_cache size 0 max 16384 2024-07-24T22:17:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.631+0000 7facdcb3d740 1 Processor -- start 2024-07-24T22:17:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.631+0000 7facdcb3d740 1 -- start start 2024-07-24T22:17:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.631+0000 7facdcb3d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4680 0x55681ef08390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.631+0000 7facdcb3d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eee4fa0 0x55681ef088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.631+0000 7facdcb3d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eef0f30 0x55681eee77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7facdcb3d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7facd41b2830 con 0x55681eee4fa0 2024-07-24T22:17:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7facdcb3d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7facd41b5090 con 0x55681eef0f30 2024-07-24T22:17:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7facdcb3d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7facd41b2e80 con 0x55681eee4680 2024-07-24T22:17:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7facd8d29640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eef0f30 0x55681eee77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7facd8d29640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eef0f30 0x55681eee77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:41762/0 (socket says 172.21.15.47:41762) 2024-07-24T22:17:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7facd8d29640 1 -- 172.21.15.47:0/2064199176 learned_addr learned my addr 172.21.15.47:0/2064199176 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7facd3fff640 1 --2- 172.21.15.47:0/2064199176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4680 0x55681ef08390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7faccbfff640 1 --2- 172.21.15.47:0/2064199176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eee4fa0 0x55681ef088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7facd8d29640 1 -- 172.21.15.47:0/2064199176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4680 msgr2=0x55681ef08390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7facd8d29640 1 --2- 172.21.15.47:0/2064199176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4680 0x55681ef08390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7facd8d29640 1 -- 172.21.15.47:0/2064199176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eee4fa0 msgr2=0x55681ef088d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7facd8d29640 1 --2- 172.21.15.47:0/2064199176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eee4fa0 0x55681ef088d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7facd8d29640 1 -- 172.21.15.47:0/2064199176 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55681eedddd0 con 0x55681eef0f30 2024-07-24T22:17:18.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.632+0000 7facd8d29640 1 --2- 172.21.15.47:0/2064199176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eef0f30 0x55681eee77c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faccc003d70 tx=0x7faccc018d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=290bf7befd3d079d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.633+0000 7facc9ffb640 1 -- 172.21.15.47:0/2064199176 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc025030 con 0x55681eef0f30 2024-07-24T22:17:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.633+0000 7facc9ffb640 1 -- 172.21.15.47:0/2064199176 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faccc039070 con 0x55681eef0f30 2024-07-24T22:17:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.633+0000 7facc9ffb640 1 -- 172.21.15.47:0/2064199176 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc018e60 con 0x55681eef0f30 2024-07-24T22:17:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.633+0000 7facdcb3d740 1 -- 172.21.15.47:0/2064199176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eef0f30 msgr2=0x55681eee77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.633+0000 7facdcb3d740 1 --2- 172.21.15.47:0/2064199176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eef0f30 0x55681eee77c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faccc003d70 tx=0x7faccc018d80 comp rx=0 tx=0).stop 2024-07-24T22:17:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.634+0000 7facdcb3d740 1 -- 172.21.15.47:0/2064199176 shutdown_connections 2024-07-24T22:17:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.634+0000 7facdcb3d740 1 --2- 172.21.15.47:0/2064199176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eef0f30 0x55681eee77c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.634+0000 7facdcb3d740 1 --2- 172.21.15.47:0/2064199176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eee4fa0 0x55681ef088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.634+0000 7facdcb3d740 1 --2- 172.21.15.47:0/2064199176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eee4680 0x55681ef08390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.634+0000 7facdcb3d740 1 -- 172.21.15.47:0/2064199176 >> 172.21.15.47:0/2064199176 conn(0x55681eee24b0 msgr2=0x55681eeefca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.634+0000 7facdcb3d740 1 -- 172.21.15.47:0/2064199176 shutdown_connections 2024-07-24T22:17:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.634+0000 7facdcb3d740 1 -- 172.21.15.47:0/2064199176 wait complete. 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.634+0000 7facdcb3d740 1 -- start start 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.634+0000 7facdcb3d740 1 Processor -- start 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facdcb3d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eee4680 0x55681eef3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facdcb3d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4fa0 0x55681eef4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facdcb3d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eef0f30 0x55681eef48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facdcb3d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7facd41b3550 con 0x55681eee4680 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facdcb3d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7facd41b49c0 con 0x55681eee4fa0 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facdcb3d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7facd41b3c20 con 0x55681eef0f30 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facdcb3d740 10 client.0 _ll_register_callbacks cb 0x7faccc007d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facd3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eee4680 0x55681eef3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facd3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eee4680 0x55681eef3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59810/0 (socket says 172.21.15.47:59810) 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7faccbfff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4fa0 0x55681eef4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facd3fff640 1 -- 172.21.15.47:0/1018954192 learned_addr learned my addr 172.21.15.47:0/1018954192 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facd8d29640 1 --2- 172.21.15.47:0/1018954192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eef0f30 0x55681eef48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facd3fff640 1 -- 172.21.15.47:0/1018954192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eef0f30 msgr2=0x55681eef48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facd3fff640 1 --2- 172.21.15.47:0/1018954192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eef0f30 0x55681eef48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facd3fff640 1 -- 172.21.15.47:0/1018954192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4fa0 msgr2=0x55681eef4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facd3fff640 1 --2- 172.21.15.47:0/1018954192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4fa0 0x55681eef4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facd3fff640 1 -- 172.21.15.47:0/1018954192 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55681ef69500 con 0x55681eee4680 2024-07-24T22:17:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facd3fff640 1 --2- 172.21.15.47:0/1018954192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eee4680 0x55681eef3e50 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7facc4000c00 tx=0x7facc403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafff149e6786094 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facb37fe640 1 -- 172.21.15.47:0/1018954192 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4035040 con 0x55681eee4680 2024-07-24T22:17:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facb37fe640 1 -- 172.21.15.47:0/1018954192 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7facc4004040 con 0x55681eee4680 2024-07-24T22:17:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.635+0000 7facdcb3d740 1 -- 172.21.15.47:0/1018954192 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faccc039070 con 0x55681eee4680 2024-07-24T22:17:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.636+0000 7facb37fe640 1 -- 172.21.15.47:0/1018954192 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7facc4004240 con 0x55681eee4680 2024-07-24T22:17:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.636+0000 7facdcb3d740 10 client.17682 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.636+0000 7facdcb3d740 1 -- 172.21.15.47:0/1018954192 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55681ef6a870 con 0x55681eee4680 2024-07-24T22:17:18.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.636+0000 7facb37fe640 1 -- 172.21.15.47:0/1018954192 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faccc039070 con 0x55681eee4680 2024-07-24T22:17:18.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.636+0000 7facb37fe640 1 -- 172.21.15.47:0/1018954192 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7facc4004910 con 0x55681eee4680 2024-07-24T22:17:18.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.636+0000 7facdcb3d740 10 client.17682 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:18.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.636+0000 7facdcb3d740 10 client.17682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:18.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.636+0000 7facdcb3d740 20 client.17682 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:18.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.636+0000 7facdcb3d740 1 --2- 172.21.15.47:0/1018954192 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55681ef6aff0 0x55681ef6d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:18.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.636+0000 7facdcb3d740 4 client.17682 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.636+0000 7facdcb3d740 1 -- 172.21.15.47:0/1018954192 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55681ee59350 con 0x55681ef6aff0 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.636+0000 7faccbfff640 1 --2- 172.21.15.47:0/1018954192 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55681ef6aff0 0x55681ef6d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7faccbfff640 1 --2- 172.21.15.47:0/1018954192 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55681ef6aff0 0x55681ef6d410 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4617c7aeee0f9415 server_cookie=2aca2da653cdd32c in_seq=0 out_seq=0 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facb37fe640 10 client.17682 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facb37fe640 1 -- 172.21.15.47:0/1018954192 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55681ee59350 con 0x55681ef6aff0 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facb37fe640 10 client.17682 handle_command_reply: tid=0 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facdcb3d740 1 client.17682 shutdown 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facdcb3d740 1 -- 172.21.15.47:0/1018954192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eee4680 msgr2=0x55681eef3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facdcb3d740 1 --2- 172.21.15.47:0/1018954192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eee4680 0x55681eef3e50 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7facc4000c00 tx=0x7facc403d000 comp rx=0 tx=0).stop 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facdcb3d740 1 -- 172.21.15.47:0/1018954192 shutdown_connections 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facdcb3d740 1 --2- 172.21.15.47:0/1018954192 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55681ef6aff0 0x55681ef6d410 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facdcb3d740 1 --2- 172.21.15.47:0/1018954192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55681eef0f30 0x55681eef48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facdcb3d740 1 --2- 172.21.15.47:0/1018954192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55681eee4fa0 0x55681eef4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facdcb3d740 1 --2- 172.21.15.47:0/1018954192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681eee4680 0x55681eef3e50 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facdcb3d740 1 -- 172.21.15.47:0/1018954192 >> 172.21.15.47:0/1018954192 conn(0x55681eee24b0 msgr2=0x55681eee77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:18.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facb37fe640 0 client.17682 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:18.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facdcb3d740 1 -- 172.21.15.47:0/1018954192 shutdown_connections 2024-07-24T22:17:18.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facdcb3d740 1 -- 172.21.15.47:0/1018954192 wait complete. 2024-07-24T22:17:18.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.637+0000 7facdcb3d740 20 client.17682 trim_cache size 0 max 16384 2024-07-24T22:17:18.644 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:17:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-07-24T22:17:18.644 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-07-24T22:17:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "1fce2217-56d1-483a-9b02-e27042052132": { 2024-07-24T22:17:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-07-24T22:17:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "1fce2217-56d1-483a-9b02-e27042052132", 2024-07-24T22:17:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-07-24T22:17:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:17:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:17:18.645 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:17:18.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.638+0000 7facda78c640 1 -- 172.21.15.47:0/4287099304 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7facc00b3d40 msgr2=0x7facc00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:18.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.638+0000 7facda78c640 1 --2- 172.21.15.47:0/4287099304 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7facc00b3d40 0x7facc00b6200 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7facc4031440 tx=0x7facc4005bc0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.638+0000 7facda78c640 1 -- 172.21.15.47:0/4287099304 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd41070a0 msgr2=0x7facd40fd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:18.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.638+0000 7facda78c640 1 --2- 172.21.15.47:0/4287099304 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd41070a0 0x7facd40fd600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7facbc00e9f0 tx=0x7facbc00edf0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.638+0000 7facda78c640 1 -- 172.21.15.47:0/4287099304 shutdown_connections 2024-07-24T22:17:18.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.638+0000 7facda78c640 1 --2- 172.21.15.47:0/4287099304 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7facc00b3d40 0x7facc00b6200 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.638+0000 7facda78c640 1 --2- 172.21.15.47:0/4287099304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7facd4107a20 0x7facd40fdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.638+0000 7facda78c640 1 --2- 172.21.15.47:0/4287099304 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd41070a0 0x7facd40fd600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.638+0000 7facda78c640 1 --2- 172.21.15.47:0/4287099304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd4101690 0x7facd40ff0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.638+0000 7facda78c640 1 -- 172.21.15.47:0/4287099304 >> 172.21.15.47:0/4287099304 conn(0x7facd40fd100 msgr2=0x7facd406b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.638+0000 7facda78c640 1 -- 172.21.15.47:0/4287099304 shutdown_connections 2024-07-24T22:17:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:18.638+0000 7facda78c640 1 -- 172.21.15.47:0/4287099304 wait complete. 2024-07-24T22:17:19.527 INFO:tasks.cephfs.filesystem:scrub status for tag:1fce2217-56d1-483a-9b02-e27042052132 - {'path': '/', 'tag': '1fce2217-56d1-483a-9b02-e27042052132', 'options': 'recursive,force'} 2024-07-24T22:17:19.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:19 smithi188 ceph-mon[37380]: pgmap v678: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 25 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 3.2 KiB/s rd, 818 B/s wr, 4 op/s 2024-07-24T22:17:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:19 smithi183 ceph-mon[37007]: pgmap v678: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 25 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 3.2 KiB/s rd, 818 B/s wr, 4 op/s 2024-07-24T22:17:19.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:19 smithi047 ceph-mon[32551]: pgmap v678: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 25 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 3.2 KiB/s rd, 818 B/s wr, 4 op/s 2024-07-24T22:17:20.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:20 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:17:20.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:20 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:17:20.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:20 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:17:21.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:21 smithi188 ceph-mon[37380]: pgmap v679: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 24 GiB data, 76 GiB used, 997 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 818 B/s wr, 6 op/s 2024-07-24T22:17:21.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:21 smithi183 ceph-mon[37007]: pgmap v679: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 24 GiB data, 76 GiB used, 997 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 818 B/s wr, 6 op/s 2024-07-24T22:17:21.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:21 smithi047 ceph-mon[32551]: pgmap v679: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 24 GiB data, 76 GiB used, 997 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 818 B/s wr, 6 op/s 2024-07-24T22:17:23.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:23 smithi188 ceph-mon[37380]: pgmap v680: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 23 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 4.4 KiB/s rd, 687 B/s wr, 6 op/s 2024-07-24T22:17:23.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:23 smithi183 ceph-mon[37007]: pgmap v680: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 23 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 4.4 KiB/s rd, 687 B/s wr, 6 op/s 2024-07-24T22:17:23.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:23 smithi047 ceph-mon[32551]: pgmap v680: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 23 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 4.4 KiB/s rd, 687 B/s wr, 6 op/s 2024-07-24T22:17:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.657+0000 7f85b4dae640 1 -- 172.21.15.47:0/433015158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b01035d0 msgr2=0x7f85b01039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.657+0000 7f85b4dae640 1 --2- 172.21.15.47:0/433015158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b01035d0 0x7f85b01039b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009ca0 tx=0x7f85a802a8c0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.657+0000 7f85b4dae640 1 -- 172.21.15.47:0/433015158 shutdown_connections 2024-07-24T22:17:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.657+0000 7f85b4dae640 1 --2- 172.21.15.47:0/433015158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b010c9f0 0x7f85b010ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.657+0000 7f85b4dae640 1 --2- 172.21.15.47:0/433015158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85b0103ef0 0x7f85b010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.657+0000 7f85b4dae640 1 --2- 172.21.15.47:0/433015158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b01035d0 0x7f85b01039b0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.657+0000 7f85b4dae640 1 -- 172.21.15.47:0/433015158 >> 172.21.15.47:0/433015158 conn(0x7f85b00782e0 msgr2=0x7f85b00ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.657+0000 7f85b4dae640 1 -- 172.21.15.47:0/433015158 shutdown_connections 2024-07-24T22:17:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.657+0000 7f85b4dae640 1 -- 172.21.15.47:0/433015158 wait complete. 2024-07-24T22:17:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.658+0000 7f85b4dae640 1 Processor -- start 2024-07-24T22:17:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.658+0000 7f85b4dae640 1 -- start start 2024-07-24T22:17:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85b4dae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b01035d0 0x7f85b0198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85b4dae640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85b0103ef0 0x7f85b0199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85b4dae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b010c9f0 0x7f85b019e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85b4dae640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f85b0112660 con 0x7f85b010c9f0 2024-07-24T22:17:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85b4dae640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01124e0 con 0x7f85b0103ef0 2024-07-24T22:17:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85b4dae640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01127e0 con 0x7f85b01035d0 2024-07-24T22:17:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85aed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b010c9f0 0x7f85b019e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85aed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b010c9f0 0x7f85b019e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59838/0 (socket says 172.21.15.47:59838) 2024-07-24T22:17:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85aed9d640 1 -- 172.21.15.47:0/2476164686 learned_addr learned my addr 172.21.15.47:0/2476164686 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85ae59c640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b01035d0 0x7f85b0198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85add9b640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85b0103ef0 0x7f85b0199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85aed9d640 1 -- 172.21.15.47:0/2476164686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b01035d0 msgr2=0x7f85b0198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85aed9d640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b01035d0 0x7f85b0198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85aed9d640 1 -- 172.21.15.47:0/2476164686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85b0103ef0 msgr2=0x7f85b0199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85aed9d640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85b0103ef0 0x7f85b0199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85aed9d640 1 -- 172.21.15.47:0/2476164686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b019eca0 con 0x7f85b010c9f0 2024-07-24T22:17:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.659+0000 7f85aed9d640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b010c9f0 0x7f85b019e4d0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f85a000d750 tx=0x7f85a000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.660+0000 7f85a77fe640 1 -- 172.21.15.47:0/2476164686 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0017070 con 0x7f85b010c9f0 2024-07-24T22:17:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.660+0000 7f85b4dae640 1 -- 172.21.15.47:0/2476164686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b019ef90 con 0x7f85b010c9f0 2024-07-24T22:17:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.660+0000 7f85a77fe640 1 -- 172.21.15.47:0/2476164686 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85a00054d0 con 0x7f85b010c9f0 2024-07-24T22:17:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.660+0000 7f85a77fe640 1 -- 172.21.15.47:0/2476164686 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0004c60 con 0x7f85b010c9f0 2024-07-24T22:17:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.660+0000 7f85b4dae640 1 -- 172.21.15.47:0/2476164686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b01a5650 con 0x7f85b010c9f0 2024-07-24T22:17:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.663+0000 7f85b7be4740 1 Processor -- start 2024-07-24T22:17:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.663+0000 7f85a77fe640 1 -- 172.21.15.47:0/2476164686 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f85a0009bd0 con 0x7f85b010c9f0 2024-07-24T22:17:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.663+0000 7f85b7be4740 1 -- start start 2024-07-24T22:17:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85b7be4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14a5c90 0x5606c14a6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85b7be4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 0x5606c14b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85b7be4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14b2540 0x5606c14b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85b7be4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5606c141b280 con 0x5606c14a65b0 2024-07-24T22:17:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85b7be4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5606c140a780 con 0x5606c14b2540 2024-07-24T22:17:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85b7be4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5606c140e7c0 con 0x5606c14a5c90 2024-07-24T22:17:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 0x5606c14b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 0x5606c14b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59844/0 (socket says 172.21.15.47:59844) 2024-07-24T22:17:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85ae59c640 1 -- 172.21.15.47:0/3524325468 learned_addr learned my addr 172.21.15.47:0/3524325468 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85add9b640 1 --2- 172.21.15.47:0/3524325468 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14a5c90 0x5606c14a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85add9b640 1 --2- 172.21.15.47:0/3524325468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14b2540 0x5606c14b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85ae59c640 1 -- 172.21.15.47:0/3524325468 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14a5c90 msgr2=0x5606c14a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85ae59c640 1 --2- 172.21.15.47:0/3524325468 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14a5c90 0x5606c14a6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85ae59c640 1 -- 172.21.15.47:0/3524325468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14b2540 msgr2=0x5606c14b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85ae59c640 1 --2- 172.21.15.47:0/3524325468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14b2540 0x5606c14b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85ae59c640 1 -- 172.21.15.47:0/3524325468 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c116e790 con 0x5606c14a65b0 2024-07-24T22:17:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85add9b640 1 --2- 172.21.15.47:0/3524325468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14b2540 0x5606c14b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:17:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85a77fe640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f859c0b3d40 0x7f859c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85ae59c640 1 --2- 172.21.15.47:0/3524325468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 0x5606c14b2000 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009ca0 tx=0x7f85a80098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68641e01684d2442 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85add9b640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f859c0b3d40 0x7f859c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.664+0000 7f85a4ff9640 1 -- 172.21.15.47:0/3524325468 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8031e30 con 0x5606c14a65b0 2024-07-24T22:17:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.665+0000 7f85a77fe640 1 -- 172.21.15.47:0/2476164686 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7f85a00e3a80 con 0x7f85b010c9f0 2024-07-24T22:17:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.665+0000 7f85a4ff9640 1 -- 172.21.15.47:0/3524325468 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85a8036030 con 0x5606c14a65b0 2024-07-24T22:17:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.665+0000 7f85a4ff9640 1 -- 172.21.15.47:0/3524325468 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8004310 con 0x5606c14a65b0 2024-07-24T22:17:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.665+0000 7f85b7be4740 1 -- 172.21.15.47:0/3524325468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 msgr2=0x5606c14b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.665+0000 7f85add9b640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f859c0b3d40 0x7f859c0b6200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f85b010eb90 tx=0x7f85980046c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.665+0000 7f85b7be4740 1 --2- 172.21.15.47:0/3524325468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 0x5606c14b2000 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009ca0 tx=0x7f85a80098b0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.665+0000 7f85b7be4740 1 -- 172.21.15.47:0/3524325468 shutdown_connections 2024-07-24T22:17:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.665+0000 7f85b7be4740 1 --2- 172.21.15.47:0/3524325468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14b2540 0x5606c14b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.665+0000 7f85b7be4740 1 --2- 172.21.15.47:0/3524325468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 0x5606c14b2000 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.665+0000 7f85b7be4740 1 --2- 172.21.15.47:0/3524325468 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14a5c90 0x5606c14a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.665+0000 7f85b7be4740 1 -- 172.21.15.47:0/3524325468 >> 172.21.15.47:0/3524325468 conn(0x5606c14a3ac0 msgr2=0x5606c14a4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85b7be4740 1 -- 172.21.15.47:0/3524325468 shutdown_connections 2024-07-24T22:17:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85b7be4740 1 -- 172.21.15.47:0/3524325468 wait complete. 2024-07-24T22:17:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85b7be4740 1 -- start start 2024-07-24T22:17:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85b7be4740 1 Processor -- start 2024-07-24T22:17:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85b7be4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14a5c90 0x5606c14b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85b7be4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 0x5606c14af170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85b7be4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14b2540 0x5606c14af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85b7be4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5606c1344ab0 con 0x5606c14a65b0 2024-07-24T22:17:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85b7be4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5606c13929e0 con 0x5606c14b2540 2024-07-24T22:17:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85b7be4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5606c14b5040 con 0x5606c14a5c90 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85b7be4740 10 client.0 _ll_register_callbacks cb 0x5606c111aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85add9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 0x5606c14af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85add9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 0x5606c14af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59850/0 (socket says 172.21.15.47:59850) 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.666+0000 7f85add9b640 1 -- 172.21.15.47:0/1505466361 learned_addr learned my addr 172.21.15.47:0/1505466361 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f85ae59c640 1 --2- 172.21.15.47:0/1505466361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14a5c90 0x5606c14b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f85aed9d640 1 --2- 172.21.15.47:0/1505466361 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14b2540 0x5606c14af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f85add9b640 1 -- 172.21.15.47:0/1505466361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14a5c90 msgr2=0x5606c14b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f85add9b640 1 --2- 172.21.15.47:0/1505466361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14a5c90 0x5606c14b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f85add9b640 1 -- 172.21.15.47:0/1505466361 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14b2540 msgr2=0x5606c14af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f85add9b640 1 --2- 172.21.15.47:0/1505466361 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14b2540 0x5606c14af6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f85add9b640 1 -- 172.21.15.47:0/1505466361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606c11e7620 con 0x5606c14a65b0 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f85add9b640 1 --2- 172.21.15.47:0/1505466361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 0x5606c14af170 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8598011c00 tx=0x7f8598004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a73e1b8b202b054 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f8595ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f8595ffb640 1 -- 172.21.15.47:0/1505466361 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859800fe50 con 0x5606c14a65b0 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f8595ffb640 1 -- 172.21.15.47:0/1505466361 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7f8598027400 con 0x5606c14a65b0 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f85b7be4740 1 -- 172.21.15.47:0/1505466361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5606c13b9ce0 con 0x5606c14a65b0 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f8595ffb640 1 -- 172.21.15.47:0/1505466361 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8598027600 con 0x5606c14a65b0 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f85b7be4740 10 client.17694 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.667+0000 7f85b7be4740 1 -- 172.21.15.47:0/1505466361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5606c14c0820 con 0x5606c14a65b0 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.668+0000 7f8595ffb640 1 -- 172.21.15.47:0/1505466361 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5606c13b9ce0 con 0x5606c14a65b0 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.668+0000 7f8595ffb640 1 -- 172.21.15.47:0/1505466361 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f859802f900 con 0x5606c14a65b0 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.668+0000 7f85b7be4740 10 client.17694 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.668+0000 7f85b7be4740 10 client.17694 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.668+0000 7f85b7be4740 20 client.17694 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.668+0000 7f85b7be4740 1 --2- 172.21.15.47:0/1505466361 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606c14c1d30 0x5606c14c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.668+0000 7f85b7be4740 4 client.17694 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.668+0000 7f85b7be4740 1 -- 172.21.15.47:0/1505466361 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606c141d1d0 con 0x5606c14c1d30 2024-07-24T22:17:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.668+0000 7f85ae59c640 1 --2- 172.21.15.47:0/1505466361 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606c14c1d30 0x5606c14c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.668+0000 7f8595ffb640 10 client.17694 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.668+0000 7f85ae59c640 1 --2- 172.21.15.47:0/1505466361 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606c14c1d30 0x5606c14c4120 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aba58cb7550272b server_cookie=f11096c5abf66eff in_seq=0 out_seq=0 2024-07-24T22:17:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f8595ffb640 1 -- 172.21.15.47:0/1505466361 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606c141d1d0 con 0x5606c14c1d30 2024-07-24T22:17:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f8595ffb640 10 client.17694 handle_command_reply: tid=0 2024-07-24T22:17:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f85b7be4740 1 client.17694 shutdown 2024-07-24T22:17:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f85b7be4740 1 -- 172.21.15.47:0/1505466361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 msgr2=0x5606c14af170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f85b7be4740 1 --2- 172.21.15.47:0/1505466361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 0x5606c14af170 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8598011c00 tx=0x7f8598004730 comp rx=0 tx=0).stop 2024-07-24T22:17:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f85b7be4740 1 -- 172.21.15.47:0/1505466361 shutdown_connections 2024-07-24T22:17:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f85b7be4740 1 --2- 172.21.15.47:0/1505466361 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606c14c1d30 0x5606c14c4120 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f85b7be4740 1 --2- 172.21.15.47:0/1505466361 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14b2540 0x5606c14af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f85b7be4740 1 --2- 172.21.15.47:0/1505466361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a65b0 0x5606c14af170 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f85b7be4740 1 --2- 172.21.15.47:0/1505466361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14a5c90 0x5606c14b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f8595ffb640 0 client.17694 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f85b7be4740 1 -- 172.21.15.47:0/1505466361 >> 172.21.15.47:0/1505466361 conn(0x5606c14a3ac0 msgr2=0x5606c14a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f85b7be4740 1 -- 172.21.15.47:0/1505466361 shutdown_connections 2024-07-24T22:17:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f85b7be4740 1 -- 172.21.15.47:0/1505466361 wait complete. 2024-07-24T22:17:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.669+0000 7f85b7be4740 20 client.17694 trim_cache size 0 max 16384 2024-07-24T22:17:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85b7be4740 1 Processor -- start 2024-07-24T22:17:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85b7be4740 1 -- start start 2024-07-24T22:17:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85b7be4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 0x5606c14c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85b7be4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14a65b0 0x5606c14c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85b7be4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14b2540 0x5606c14ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85b7be4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01ac130 con 0x5606c14a5c90 2024-07-24T22:17:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85b7be4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01ae990 con 0x5606c14a65b0 2024-07-24T22:17:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85b7be4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01ac780 con 0x5606c14b2540 2024-07-24T22:17:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 0x5606c14c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 0x5606c14c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59866/0 (socket says 172.21.15.47:59866) 2024-07-24T22:17:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85ae59c640 1 -- 172.21.15.47:0/431936235 learned_addr learned my addr 172.21.15.47:0/431936235 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85add9b640 1 --2- 172.21.15.47:0/431936235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14a65b0 0x5606c14c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85aed9d640 1 --2- 172.21.15.47:0/431936235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14b2540 0x5606c14ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85ae59c640 1 -- 172.21.15.47:0/431936235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14b2540 msgr2=0x5606c14ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85ae59c640 1 --2- 172.21.15.47:0/431936235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14b2540 0x5606c14ba2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85ae59c640 1 -- 172.21.15.47:0/431936235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14a65b0 msgr2=0x5606c14c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85ae59c640 1 --2- 172.21.15.47:0/431936235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14a65b0 0x5606c14c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85ae59c640 1 -- 172.21.15.47:0/431936235 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c14c4780 con 0x5606c14a5c90 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.685+0000 7f85aed9d640 1 --2- 172.21.15.47:0/431936235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14b2540 0x5606c14ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.686+0000 7f85ae59c640 1 --2- 172.21.15.47:0/431936235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 0x5606c14c99f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009ca0 tx=0x7f85a8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86fd8f86c5fa1e4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.686+0000 7f8597fff640 1 -- 172.21.15.47:0/431936235 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8003970 con 0x5606c14a5c90 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.686+0000 7f8597fff640 1 -- 172.21.15.47:0/431936235 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85a8036040 con 0x5606c14a5c90 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.686+0000 7f8597fff640 1 -- 172.21.15.47:0/431936235 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8004450 con 0x5606c14a5c90 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.686+0000 7f85b7be4740 1 -- 172.21.15.47:0/431936235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 msgr2=0x5606c14c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.686+0000 7f85b7be4740 1 --2- 172.21.15.47:0/431936235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 0x5606c14c99f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009ca0 tx=0x7f85a8000f40 comp rx=0 tx=0).stop 2024-07-24T22:17:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.686+0000 7f85b7be4740 1 -- 172.21.15.47:0/431936235 shutdown_connections 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.686+0000 7f85b7be4740 1 --2- 172.21.15.47:0/431936235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14b2540 0x5606c14ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.686+0000 7f85b7be4740 1 --2- 172.21.15.47:0/431936235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14a65b0 0x5606c14c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.686+0000 7f85b7be4740 1 --2- 172.21.15.47:0/431936235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 0x5606c14c99f0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.686+0000 7f85b7be4740 1 -- 172.21.15.47:0/431936235 >> 172.21.15.47:0/431936235 conn(0x5606c14a3ac0 msgr2=0x5606c14af140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.686+0000 7f85b7be4740 1 -- 172.21.15.47:0/431936235 shutdown_connections 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85b7be4740 1 -- 172.21.15.47:0/431936235 wait complete. 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85b7be4740 1 -- start start 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85b7be4740 1 Processor -- start 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85b7be4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 0x5606c14b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85b7be4740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14a65b0 0x5606c14b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85b7be4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14b2540 0x5606c14b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85b7be4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01ace50 con 0x5606c14a5c90 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85b7be4740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01ae2c0 con 0x5606c14a65b0 2024-07-24T22:17:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85b7be4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01ad520 con 0x5606c14b2540 2024-07-24T22:17:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85b7be4740 10 client.0 _ll_register_callbacks cb 0x7f859800ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 0x5606c14b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85ae59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 0x5606c14b72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59874/0 (socket says 172.21.15.47:59874) 2024-07-24T22:17:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85ae59c640 1 -- 172.21.15.47:0/556797984 learned_addr learned my addr 172.21.15.47:0/556797984 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85add9b640 1 --2- 172.21.15.47:0/556797984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14a65b0 0x5606c14b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85aed9d640 1 --2- 172.21.15.47:0/556797984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14b2540 0x5606c14b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85ae59c640 1 -- 172.21.15.47:0/556797984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14b2540 msgr2=0x5606c14b7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85ae59c640 1 --2- 172.21.15.47:0/556797984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14b2540 0x5606c14b7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.687+0000 7f85ae59c640 1 -- 172.21.15.47:0/556797984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14a65b0 msgr2=0x5606c14b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.688+0000 7f85ae59c640 1 --2- 172.21.15.47:0/556797984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14a65b0 0x5606c14b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.688+0000 7f85ae59c640 1 -- 172.21.15.47:0/556797984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606c152abc0 con 0x5606c14a5c90 2024-07-24T22:17:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.688+0000 7f85ae59c640 1 --2- 172.21.15.47:0/556797984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 0x5606c14b72e0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f85a802ade0 tx=0x7f85a8003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9b4a0a27c930ab server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.688+0000 7f8595ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.688+0000 7f8595ffb640 1 -- 172.21.15.47:0/556797984 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8031450 con 0x5606c14a5c90 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.688+0000 7f85b7be4740 1 -- 172.21.15.47:0/556797984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85a8036040 con 0x5606c14a5c90 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.688+0000 7f8595ffb640 1 -- 172.21.15.47:0/556797984 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7f85a80315f0 con 0x5606c14a5c90 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.688+0000 7f8595ffb640 1 -- 172.21.15.47:0/556797984 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f85a80317f0 con 0x5606c14a5c90 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.688+0000 7f85b7be4740 10 client.17700 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.688+0000 7f85b7be4740 1 -- 172.21.15.47:0/556797984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5606c152be20 con 0x5606c14a5c90 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.688+0000 7f8595ffb640 1 -- 172.21.15.47:0/556797984 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85a8036040 con 0x5606c14a5c90 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.688+0000 7f8595ffb640 1 -- 172.21.15.47:0/556797984 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f85a8043070 con 0x5606c14a5c90 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.688+0000 7f85b7be4740 10 client.17700 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.689+0000 7f85b7be4740 10 client.17700 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.689+0000 7f85b7be4740 20 client.17700 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.689+0000 7f85b7be4740 1 --2- 172.21.15.47:0/556797984 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606c152c260 0x5606c152e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.689+0000 7f85b7be4740 4 client.17700 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:17:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.689+0000 7f85b7be4740 1 -- 172.21.15.47:0/556797984 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5606c1418c70 con 0x5606c152c260 2024-07-24T22:17:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.689+0000 7f85add9b640 1 --2- 172.21.15.47:0/556797984 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606c152c260 0x5606c152e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.689+0000 7f85add9b640 1 --2- 172.21.15.47:0/556797984 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606c152c260 0x5606c152e680 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67ee816f172ee9f0 server_cookie=5da392684535325b in_seq=0 out_seq=0 2024-07-24T22:17:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.689+0000 7f8595ffb640 10 client.17700 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f8595ffb640 1 -- 172.21.15.47:0/556797984 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5606c1418c70 con 0x5606c152c260 2024-07-24T22:17:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f8595ffb640 10 client.17700 handle_command_reply: tid=0 2024-07-24T22:17:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b7be4740 1 client.17700 shutdown 2024-07-24T22:17:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b7be4740 1 -- 172.21.15.47:0/556797984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 msgr2=0x5606c14b72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b7be4740 1 --2- 172.21.15.47:0/556797984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 0x5606c14b72e0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f85a802ade0 tx=0x7f85a8003e00 comp rx=0 tx=0).stop 2024-07-24T22:17:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b7be4740 1 -- 172.21.15.47:0/556797984 shutdown_connections 2024-07-24T22:17:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b7be4740 1 --2- 172.21.15.47:0/556797984 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606c152c260 0x5606c152e680 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b7be4740 1 --2- 172.21.15.47:0/556797984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606c14b2540 0x5606c14b7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b7be4740 1 --2- 172.21.15.47:0/556797984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606c14a65b0 0x5606c14b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f8595ffb640 0 client.17700 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b7be4740 1 --2- 172.21.15.47:0/556797984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606c14a5c90 0x5606c14b72e0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b7be4740 1 -- 172.21.15.47:0/556797984 >> 172.21.15.47:0/556797984 conn(0x5606c14a3ac0 msgr2=0x5606c14a2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b7be4740 1 -- 172.21.15.47:0/556797984 shutdown_connections 2024-07-24T22:17:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b7be4740 1 -- 172.21.15.47:0/556797984 wait complete. 2024-07-24T22:17:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b7be4740 20 client.17700 trim_cache size 0 max 16384 2024-07-24T22:17:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:17:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:17:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:17:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:17:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b4dae640 1 -- 172.21.15.47:0/2476164686 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f859c0b3d40 msgr2=0x7f859c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b4dae640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f859c0b3d40 0x7f859c0b6200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f85b010eb90 tx=0x7f85980046c0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.693+0000 7f85b4dae640 1 -- 172.21.15.47:0/2476164686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b010c9f0 msgr2=0x7f85b019e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.694+0000 7f85b4dae640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b010c9f0 0x7f85b019e4d0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f85a000d750 tx=0x7f85a000dc10 comp rx=0 tx=0).stop 2024-07-24T22:17:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.694+0000 7f85b4dae640 1 -- 172.21.15.47:0/2476164686 shutdown_connections 2024-07-24T22:17:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.694+0000 7f85b4dae640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f859c0b3d40 0x7f859c0b6200 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.694+0000 7f85b4dae640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b010c9f0 0x7f85b019e4d0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.694+0000 7f85b4dae640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85b0103ef0 0x7f85b0199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.694+0000 7f85b4dae640 1 --2- 172.21.15.47:0/2476164686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b01035d0 0x7f85b0198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.694+0000 7f85b4dae640 1 -- 172.21.15.47:0/2476164686 >> 172.21.15.47:0/2476164686 conn(0x7f85b00782e0 msgr2=0x7f85b00ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.694+0000 7f85b4dae640 1 -- 172.21.15.47:0/2476164686 shutdown_connections 2024-07-24T22:17:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:24.694+0000 7f85b4dae640 1 -- 172.21.15.47:0/2476164686 wait complete. 2024-07-24T22:17:25.635 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-07-24T22:17:25.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:17:25.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:25 smithi188 ceph-mon[37380]: pgmap v681: 97 pgs: 11 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 80 active+clean; 21 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-07-24T22:17:25.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:25 smithi183 ceph-mon[37007]: pgmap v681: 97 pgs: 11 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 80 active+clean; 21 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-07-24T22:17:25.914 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:17:25.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:25 smithi047 ceph-mon[32551]: pgmap v681: 97 pgs: 11 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 80 active+clean; 21 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-07-24T22:17:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:27 smithi047 ceph-mon[32551]: pgmap v682: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 20 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 4 op/s 2024-07-24T22:17:27.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.590+0000 7f949d3b2640 1 -- 172.21.15.47:0/1446522093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9498108b20 msgr2=0x7f949810f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:27.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.590+0000 7f949d3b2640 1 --2- 172.21.15.47:0/1446522093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9498108b20 0x7f949810f320 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f9490009ca0 tx=0x7f949002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:17:27.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.590+0000 7f949d3b2640 1 -- 172.21.15.47:0/1446522093 shutdown_connections 2024-07-24T22:17:27.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.590+0000 7f949d3b2640 1 --2- 172.21.15.47:0/1446522093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9498108b20 0x7f949810f320 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:27.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.590+0000 7f949d3b2640 1 --2- 172.21.15.47:0/1446522093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94981081a0 0x7f94981085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:27.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.590+0000 7f949d3b2640 1 --2- 172.21.15.47:0/1446522093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9498102790 0x7f9498102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:27.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.590+0000 7f949d3b2640 1 -- 172.21.15.47:0/1446522093 >> 172.21.15.47:0/1446522093 conn(0x7f94980fe200 msgr2=0x7f9498100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:27.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.590+0000 7f949d3b2640 1 -- 172.21.15.47:0/1446522093 shutdown_connections 2024-07-24T22:17:27.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.591+0000 7f949d3b2640 1 -- 172.21.15.47:0/1446522093 wait complete. 2024-07-24T22:17:27.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.591+0000 7f949d3b2640 1 Processor -- start 2024-07-24T22:17:27.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f949d3b2640 1 -- start start 2024-07-24T22:17:27.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f949d3b2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9498102790 0x7f9498198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:27.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f949d3b2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94981081a0 0x7f94981991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:27.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f949d3b2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9498108b20 0x7f949819e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:27.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f949d3b2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9498112740 con 0x7f9498108b20 2024-07-24T22:17:27.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f949d3b2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f94981125c0 con 0x7f9498102790 2024-07-24T22:17:27.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f949d3b2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f94981128c0 con 0x7f94981081a0 2024-07-24T22:17:27.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f94977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9498108b20 0x7f949819e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:27.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f94977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9498108b20 0x7f949819e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56810/0 (socket says 172.21.15.47:56810) 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f94977fe640 1 -- 172.21.15.47:0/4030145742 learned_addr learned my addr 172.21.15.47:0/4030145742 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f94967fc640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94981081a0 0x7f94981991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f9496ffd640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9498102790 0x7f9498198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f94977fe640 1 -- 172.21.15.47:0/4030145742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94981081a0 msgr2=0x7f94981991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f94977fe640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94981081a0 0x7f94981991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f94977fe640 1 -- 172.21.15.47:0/4030145742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9498102790 msgr2=0x7f9498198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f94977fe640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9498102790 0x7f9498198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.592+0000 7f94977fe640 1 -- 172.21.15.47:0/4030145742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949819ed40 con 0x7f9498108b20 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.593+0000 7f94977fe640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9498108b20 0x7f949819e570 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f9490005cc0 tx=0x7f949002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.593+0000 7f947ffff640 1 -- 172.21.15.47:0/4030145742 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9490003bf0 con 0x7f9498108b20 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.593+0000 7f949d3b2640 1 -- 172.21.15.47:0/4030145742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f949819efd0 con 0x7f9498108b20 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.593+0000 7f947ffff640 1 -- 172.21.15.47:0/4030145742 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9490003d90 con 0x7f9498108b20 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.593+0000 7f947ffff640 1 -- 172.21.15.47:0/4030145742 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949002fbc0 con 0x7f9498108b20 2024-07-24T22:17:27.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.593+0000 7f949d3b2640 1 -- 172.21.15.47:0/4030145742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94981a56f0 con 0x7f9498108b20 2024-07-24T22:17:27.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.594+0000 7f949d3b2640 1 -- 172.21.15.47:0/4030145742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9498102b70 con 0x7f9498108b20 2024-07-24T22:17:27.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.595+0000 7f947ffff640 1 -- 172.21.15.47:0/4030145742 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f949002fd60 con 0x7f9498108b20 2024-07-24T22:17:27.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.596+0000 7f947ffff640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94800b3d40 0x7f94800b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:27.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.596+0000 7f9496ffd640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94800b3d40 0x7f94800b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:27.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.596+0000 7f947ffff640 1 -- 172.21.15.47:0/4030145742 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8609+0+0 (secure 0 0 0) 0x7f9490105640 con 0x7f9498108b20 2024-07-24T22:17:27.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.597+0000 7f9496ffd640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94800b3d40 0x7f94800b6200 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9488005fd0 tx=0x7f948800b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:27.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.600+0000 7f947ffff640 1 -- 172.21.15.47:0/4030145742 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f94900cc9a0 con 0x7f9498108b20 2024-07-24T22:17:27.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:27 smithi188 ceph-mon[37380]: pgmap v682: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 20 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 4 op/s 2024-07-24T22:17:27.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.833+0000 7f949d3b2640 1 -- 172.21.15.47:0/4030145742 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f949810a960 con 0x7f9498108b20 2024-07-24T22:17:27.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.833+0000 7f947ffff640 1 -- 172.21.15.47:0/4030145742 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f94900cc2a0 con 0x7f9498108b20 2024-07-24T22:17:27.836 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:17:27.836 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:17:27.836 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:17:27.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.836+0000 7f949d3b2640 1 -- 172.21.15.47:0/4030145742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94800b3d40 msgr2=0x7f94800b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:27.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.836+0000 7f949d3b2640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94800b3d40 0x7f94800b6200 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9488005fd0 tx=0x7f948800b390 comp rx=0 tx=0).stop 2024-07-24T22:17:27.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.836+0000 7f949d3b2640 1 -- 172.21.15.47:0/4030145742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9498108b20 msgr2=0x7f949819e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:27.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.836+0000 7f949d3b2640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9498108b20 0x7f949819e570 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f9490005cc0 tx=0x7f949002f380 comp rx=0 tx=0).stop 2024-07-24T22:17:27.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.836+0000 7f949d3b2640 1 -- 172.21.15.47:0/4030145742 shutdown_connections 2024-07-24T22:17:27.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.836+0000 7f949d3b2640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f94800b3d40 0x7f94800b6200 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:27.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.836+0000 7f949d3b2640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9498108b20 0x7f949819e570 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:27.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.836+0000 7f949d3b2640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94981081a0 0x7f94981991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:27.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.836+0000 7f949d3b2640 1 --2- 172.21.15.47:0/4030145742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9498102790 0x7f9498198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:27.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.836+0000 7f949d3b2640 1 -- 172.21.15.47:0/4030145742 >> 172.21.15.47:0/4030145742 conn(0x7f94980fe200 msgr2=0x7f94981005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:27.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.836+0000 7f949d3b2640 1 -- 172.21.15.47:0/4030145742 shutdown_connections 2024-07-24T22:17:27.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:27.836+0000 7f949d3b2640 1 -- 172.21.15.47:0/4030145742 wait complete. 2024-07-24T22:17:27.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:27 smithi183 ceph-mon[37007]: pgmap v682: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 20 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 4 op/s 2024-07-24T22:17:28.606 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-07-24T22:17:28.607 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-07-24T22:17:28.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:28 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/4030145742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:17:28.877 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:17:28.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:28 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/4030145742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:17:28.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:28 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/4030145742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:17:29.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:29 smithi047 ceph-mon[32551]: pgmap v683: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:17:29.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:29 smithi047 ceph-mon[32551]: osdmap e95: 12 total, 12 up, 12 in 2024-07-24T22:17:29.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:29 smithi188 ceph-mon[37380]: pgmap v683: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:17:29.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:29 smithi188 ceph-mon[37380]: osdmap e95: 12 total, 12 up, 12 in 2024-07-24T22:17:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:29 smithi183 ceph-mon[37007]: pgmap v683: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:17:29.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:29 smithi183 ceph-mon[37007]: osdmap e95: 12 total, 12 up, 12 in 2024-07-24T22:17:30.539 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:30 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:17:30.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.528+0000 7f7e52f05640 1 -- 172.21.15.47:0/1256836641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e4c103fa0 msgr2=0x7f7e4c10c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:30.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.528+0000 7f7e52f05640 1 --2- 172.21.15.47:0/1256836641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e4c103fa0 0x7f7e4c10c490 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009900 tx=0x7f7e3802a410 comp rx=0 tx=0).stop 2024-07-24T22:17:30.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.528+0000 7f7e52f05640 1 -- 172.21.15.47:0/1256836641 shutdown_connections 2024-07-24T22:17:30.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.528+0000 7f7e52f05640 1 --2- 172.21.15.47:0/1256836641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e4c10cae0 0x7f7e4c10ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.528+0000 7f7e52f05640 1 --2- 172.21.15.47:0/1256836641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e4c103fa0 0x7f7e4c10c490 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.528+0000 7f7e52f05640 1 --2- 172.21.15.47:0/1256836641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e4c103680 0x7f7e4c103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.528+0000 7f7e52f05640 1 -- 172.21.15.47:0/1256836641 >> 172.21.15.47:0/1256836641 conn(0x7f7e4c0fd0e0 msgr2=0x7f7e4c0ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:30.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.528+0000 7f7e52f05640 1 -- 172.21.15.47:0/1256836641 shutdown_connections 2024-07-24T22:17:30.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.528+0000 7f7e52f05640 1 -- 172.21.15.47:0/1256836641 wait complete. 2024-07-24T22:17:30.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.529+0000 7f7e52f05640 1 Processor -- start 2024-07-24T22:17:30.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.529+0000 7f7e52f05640 1 -- start start 2024-07-24T22:17:30.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.529+0000 7f7e52f05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e4c103680 0x7f7e4c198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e52f05640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e4c103fa0 0x7f7e4c199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e52f05640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e4c10cae0 0x7f7e4c19e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e52f05640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c112720 con 0x7f7e4c103680 2024-07-24T22:17:30.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e52f05640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1125a0 con 0x7f7e4c10cae0 2024-07-24T22:17:30.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e52f05640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1128a0 con 0x7f7e4c103fa0 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e50ca1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e4c103680 0x7f7e4c198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e50ca1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e4c103680 0x7f7e4c198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56834/0 (socket says 172.21.15.47:56834) 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e50ca1640 1 -- 172.21.15.47:0/1150399207 learned_addr learned my addr 172.21.15.47:0/1150399207 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e4bfff640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e4c103fa0 0x7f7e4c199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e514a2640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e4c10cae0 0x7f7e4c19e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e50ca1640 1 -- 172.21.15.47:0/1150399207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e4c103fa0 msgr2=0x7f7e4c199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e50ca1640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e4c103fa0 0x7f7e4c199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e50ca1640 1 -- 172.21.15.47:0/1150399207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e4c10cae0 msgr2=0x7f7e4c19e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e50ca1640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e4c10cae0 0x7f7e4c19e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e50ca1640 1 -- 172.21.15.47:0/1150399207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4c19ed00 con 0x7f7e4c103680 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e514a2640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e4c10cae0 0x7f7e4c19e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e50ca1640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e4c103680 0x7f7e4c198c50 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000e9f0 tx=0x7f7e4000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e49ffb640 1 -- 172.21.15.47:0/1150399207 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4000cd80 con 0x7f7e4c103680 2024-07-24T22:17:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e49ffb640 1 -- 172.21.15.47:0/1150399207 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e400108e0 con 0x7f7e4c103680 2024-07-24T22:17:30.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e52f05640 1 -- 172.21.15.47:0/1150399207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e4c19eff0 con 0x7f7e4c103680 2024-07-24T22:17:30.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.530+0000 7f7e49ffb640 1 -- 172.21.15.47:0/1150399207 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40018980 con 0x7f7e4c103680 2024-07-24T22:17:30.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.531+0000 7f7e52f05640 1 -- 172.21.15.47:0/1150399207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e4c1a5880 con 0x7f7e4c103680 2024-07-24T22:17:30.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.533+0000 7f7e552b6740 1 Processor -- start 2024-07-24T22:17:30.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.533+0000 7f7e49ffb640 1 -- 172.21.15.47:0/1150399207 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f7e40010430 con 0x7f7e4c103680 2024-07-24T22:17:30.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.533+0000 7f7e552b6740 1 -- start start 2024-07-24T22:17:30.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.533+0000 7f7e552b6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561435675cd0 0x561435674260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.533+0000 7f7e552b6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 0x561435674c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.533+0000 7f7e552b6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614356849e0 0x561435686dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e552b6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5614355ea6a0 con 0x5614356747a0 2024-07-24T22:17:30.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e552b6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5614355d9ba0 con 0x561435675cd0 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e552b6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5614355ddbe0 con 0x5614356849e0 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e50ca1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 0x561435674c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e50ca1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 0x561435674c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56842/0 (socket says 172.21.15.47:56842) 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e50ca1640 1 -- 172.21.15.47:0/327440503 learned_addr learned my addr 172.21.15.47:0/327440503 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e514a2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561435675cd0 0x561435674260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e4bfff640 1 --2- 172.21.15.47:0/327440503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614356849e0 0x561435686dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e514a2640 1 -- 172.21.15.47:0/327440503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614356849e0 msgr2=0x561435686dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e514a2640 1 --2- 172.21.15.47:0/327440503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614356849e0 0x561435686dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e514a2640 1 -- 172.21.15.47:0/327440503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 msgr2=0x561435674c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e514a2640 1 --2- 172.21.15.47:0/327440503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 0x561435674c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e514a2640 1 -- 172.21.15.47:0/327440503 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561435571d60 con 0x561435675cd0 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e50ca1640 1 --2- 172.21.15.47:0/327440503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 0x561435674c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e49ffb640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7e3c0b3dc0 0x7f7e3c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.534+0000 7f7e514a2640 1 --2- 172.21.15.47:0/327440503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561435675cd0 0x561435674260 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009f90 tx=0x7f7e44010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7a995581e74a124 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e50ca1640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7e3c0b3dc0 0x7f7e3c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e36ffd640 1 -- 172.21.15.47:0/327440503 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44004d20 con 0x561435675cd0 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e36ffd640 1 -- 172.21.15.47:0/327440503 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e440119b0 con 0x561435675cd0 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e36ffd640 1 -- 172.21.15.47:0/327440503 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e440054f0 con 0x561435675cd0 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e49ffb640 1 -- 172.21.15.47:0/1150399207 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f7e400e43e0 con 0x7f7e4c103680 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e552b6740 1 -- 172.21.15.47:0/327440503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561435675cd0 msgr2=0x561435674260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e50ca1640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7e3c0b3dc0 0x7f7e3c0b6280 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7e40000c00 tx=0x7f7e400e9040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e552b6740 1 --2- 172.21.15.47:0/327440503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561435675cd0 0x561435674260 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009f90 tx=0x7f7e44010860 comp rx=0 tx=0).stop 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e552b6740 1 -- 172.21.15.47:0/327440503 shutdown_connections 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e552b6740 1 --2- 172.21.15.47:0/327440503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614356849e0 0x561435686dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e552b6740 1 --2- 172.21.15.47:0/327440503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 0x561435674c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e552b6740 1 --2- 172.21.15.47:0/327440503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561435675cd0 0x561435674260 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e552b6740 1 -- 172.21.15.47:0/327440503 >> 172.21.15.47:0/327440503 conn(0x56143563e750 msgr2=0x561435672090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.535+0000 7f7e552b6740 1 -- 172.21.15.47:0/327440503 shutdown_connections 2024-07-24T22:17:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.536+0000 7f7e552b6740 1 -- 172.21.15.47:0/327440503 wait complete. 2024-07-24T22:17:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.536+0000 7f7e552b6740 1 -- start start 2024-07-24T22:17:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.536+0000 7f7e552b6740 1 Processor -- start 2024-07-24T22:17:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.536+0000 7f7e552b6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356747a0 0x5614356844a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.536+0000 7f7e552b6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561435675cd0 0x561435681930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.536+0000 7f7e552b6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356849e0 0x5614356820c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.536+0000 7f7e552b6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56143543d7a0 con 0x5614356849e0 2024-07-24T22:17:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.536+0000 7f7e552b6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56143557c020 con 0x5614356747a0 2024-07-24T22:17:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.536+0000 7f7e552b6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561435687870 con 0x561435675cd0 2024-07-24T22:17:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.536+0000 7f7e552b6740 10 client.0 _ll_register_callbacks cb 0x5614352e7090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:30.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e514a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356849e0 0x5614356820c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e514a2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356747a0 0x5614356844a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e514a2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356747a0 0x5614356844a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:45230/0 (socket says 172.21.15.47:45230) 2024-07-24T22:17:30.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e4bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561435675cd0 0x561435681930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e514a2640 1 -- 172.21.15.47:0/2652972980 learned_addr learned my addr 172.21.15.47:0/2652972980 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:30.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e514a2640 1 -- 172.21.15.47:0/2652972980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561435675cd0 msgr2=0x561435681930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:30.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e514a2640 1 --2- 172.21.15.47:0/2652972980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561435675cd0 0x561435681930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e514a2640 1 -- 172.21.15.47:0/2652972980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356849e0 msgr2=0x5614356820c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:30.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e514a2640 1 --2- 172.21.15.47:0/2652972980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356849e0 0x5614356820c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e514a2640 1 -- 172.21.15.47:0/2652972980 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614355800d0 con 0x5614356747a0 2024-07-24T22:17:30.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e514a2640 1 --2- 172.21.15.47:0/2652972980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356747a0 0x5614356844a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e44011970 tx=0x7f7e44010fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=953c790015685e9f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:30.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:17:30.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e2bfff640 1 -- 172.21.15.47:0/2652972980 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44024040 con 0x5614356747a0 2024-07-24T22:17:30.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e2bfff640 1 -- 172.21.15.47:0/2652972980 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f7e440052d0 con 0x5614356747a0 2024-07-24T22:17:30.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.537+0000 7f7e552b6740 1 -- 172.21.15.47:0/2652972980 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e440119b0 con 0x5614356747a0 2024-07-24T22:17:30.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.538+0000 7f7e2bfff640 1 -- 172.21.15.47:0/2652972980 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7e440054d0 con 0x5614356747a0 2024-07-24T22:17:30.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.538+0000 7f7e552b6740 10 client.26819 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:30.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.538+0000 7f7e552b6740 1 -- 172.21.15.47:0/2652972980 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561435349b90 con 0x5614356747a0 2024-07-24T22:17:30.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.538+0000 7f7e2bfff640 1 -- 172.21.15.47:0/2652972980 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e440119b0 con 0x5614356747a0 2024-07-24T22:17:30.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.538+0000 7f7e2bfff640 1 -- 172.21.15.47:0/2652972980 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7e4401b960 con 0x5614356747a0 2024-07-24T22:17:30.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.538+0000 7f7e552b6740 10 client.26819 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:30.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.538+0000 7f7e552b6740 10 client.26819 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:17:30.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.538+0000 7f7e552b6740 20 client.26819 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:30.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.538+0000 7f7e552b6740 1 --2- 172.21.15.47:0/2652972980 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561435694950 0x561435696d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.538+0000 7f7e552b6740 4 client.26819 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:17:30.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.538+0000 7f7e552b6740 1 -- 172.21.15.47:0/2652972980 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614355ec5f0 con 0x561435694950 2024-07-24T22:17:30.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.538+0000 7f7e4bfff640 1 --2- 172.21.15.47:0/2652972980 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561435694950 0x561435696d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.539+0000 7f7e4bfff640 1 --2- 172.21.15.47:0/2652972980 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561435694950 0x561435696d40 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44d0b20b2f70655d server_cookie=66e93661963f4e7d in_seq=0 out_seq=0 2024-07-24T22:17:30.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.539+0000 7f7e2bfff640 10 client.26819 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:30.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.539+0000 7f7e2bfff640 1 -- 172.21.15.47:0/2652972980 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614355ec5f0 con 0x561435694950 2024-07-24T22:17:30.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.539+0000 7f7e2bfff640 10 client.26819 handle_command_reply: tid=0 2024-07-24T22:17:30.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.539+0000 7f7e552b6740 1 client.26819 shutdown 2024-07-24T22:17:30.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.539+0000 7f7e552b6740 1 -- 172.21.15.47:0/2652972980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356747a0 msgr2=0x5614356844a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:30.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.539+0000 7f7e552b6740 1 --2- 172.21.15.47:0/2652972980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356747a0 0x5614356844a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e44011970 tx=0x7f7e44010fd0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.540+0000 7f7e552b6740 1 -- 172.21.15.47:0/2652972980 shutdown_connections 2024-07-24T22:17:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.540+0000 7f7e552b6740 1 --2- 172.21.15.47:0/2652972980 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561435694950 0x561435696d40 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.540+0000 7f7e552b6740 1 --2- 172.21.15.47:0/2652972980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356849e0 0x5614356820c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.540+0000 7f7e2bfff640 0 client.26819 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.540+0000 7f7e552b6740 1 --2- 172.21.15.47:0/2652972980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561435675cd0 0x561435681930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.540+0000 7f7e552b6740 1 --2- 172.21.15.47:0/2652972980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356747a0 0x5614356844a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.540+0000 7f7e552b6740 1 -- 172.21.15.47:0/2652972980 >> 172.21.15.47:0/2652972980 conn(0x56143563e750 msgr2=0x561435677c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.540+0000 7f7e552b6740 1 -- 172.21.15.47:0/2652972980 shutdown_connections 2024-07-24T22:17:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.540+0000 7f7e552b6740 1 -- 172.21.15.47:0/2652972980 wait complete. 2024-07-24T22:17:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.540+0000 7f7e552b6740 20 client.26819 trim_cache size 0 max 16384 2024-07-24T22:17:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.558+0000 7f7e552b6740 1 Processor -- start 2024-07-24T22:17:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.558+0000 7f7e552b6740 1 -- start start 2024-07-24T22:17:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.558+0000 7f7e552b6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 0x5614356856e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.558+0000 7f7e552b6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561435675cd0 0x561435672030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.558+0000 7f7e552b6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356849e0 0x561435686c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.558+0000 7f7e552b6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1aa090 con 0x5614356747a0 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.558+0000 7f7e552b6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1ac8f0 con 0x5614356849e0 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.558+0000 7f7e552b6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1aa6e0 con 0x561435675cd0 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.558+0000 7f7e514a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 0x5614356856e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.558+0000 7f7e514a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 0x5614356856e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56860/0 (socket says 172.21.15.47:56860) 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.559+0000 7f7e514a2640 1 -- 172.21.15.47:0/3852554553 learned_addr learned my addr 172.21.15.47:0/3852554553 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.559+0000 7f7e4bfff640 1 --2- 172.21.15.47:0/3852554553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561435675cd0 0x561435672030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.559+0000 7f7e514a2640 1 --2- 172.21.15.47:0/3852554553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356849e0 0x561435686c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.559+0000 7f7e514a2640 1 -- 172.21.15.47:0/3852554553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561435675cd0 msgr2=0x561435672030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.559+0000 7f7e514a2640 1 --2- 172.21.15.47:0/3852554553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561435675cd0 0x561435672030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.559+0000 7f7e514a2640 1 -- 172.21.15.47:0/3852554553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356849e0 msgr2=0x561435686c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.559+0000 7f7e514a2640 1 --2- 172.21.15.47:0/3852554553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356849e0 0x561435686c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.559+0000 7f7e514a2640 1 -- 172.21.15.47:0/3852554553 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143567a3c0 con 0x5614356747a0 2024-07-24T22:17:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.559+0000 7f7e514a2640 1 --2- 172.21.15.47:0/3852554553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 0x5614356856e0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f7e44011940 tx=0x7f7e44013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0dbe17a242c0a3 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.559+0000 7f7e367fc640 1 -- 172.21.15.47:0/3852554553 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44037070 con 0x5614356747a0 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.559+0000 7f7e367fc640 1 -- 172.21.15.47:0/3852554553 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e44011970 con 0x5614356747a0 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.559+0000 7f7e367fc640 1 -- 172.21.15.47:0/3852554553 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4402d8a0 con 0x5614356747a0 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.560+0000 7f7e552b6740 1 -- 172.21.15.47:0/3852554553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 msgr2=0x5614356856e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.560+0000 7f7e552b6740 1 --2- 172.21.15.47:0/3852554553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 0x5614356856e0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f7e44011940 tx=0x7f7e44013040 comp rx=0 tx=0).stop 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.560+0000 7f7e552b6740 1 -- 172.21.15.47:0/3852554553 shutdown_connections 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.560+0000 7f7e552b6740 1 --2- 172.21.15.47:0/3852554553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356849e0 0x561435686c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.560+0000 7f7e552b6740 1 --2- 172.21.15.47:0/3852554553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561435675cd0 0x561435672030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.560+0000 7f7e552b6740 1 --2- 172.21.15.47:0/3852554553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5614356747a0 0x5614356856e0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.560+0000 7f7e552b6740 1 -- 172.21.15.47:0/3852554553 >> 172.21.15.47:0/3852554553 conn(0x56143563e750 msgr2=0x561435670950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.560+0000 7f7e552b6740 1 -- 172.21.15.47:0/3852554553 shutdown_connections 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.560+0000 7f7e552b6740 1 -- 172.21.15.47:0/3852554553 wait complete. 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e552b6740 1 -- start start 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e552b6740 1 Processor -- start 2024-07-24T22:17:30.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e552b6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356747a0 0x56143568cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e552b6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561435675cd0 0x56143568d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e552b6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614356849e0 0x56143569b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e552b6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1aadb0 con 0x561435675cd0 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e552b6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1ac220 con 0x5614356747a0 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e552b6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1ab480 con 0x5614356849e0 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e552b6740 10 client.0 _ll_register_callbacks cb 0x7f7e400e7d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e4bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561435675cd0 0x56143568d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e514a2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356747a0 0x56143568cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e4bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561435675cd0 0x56143568d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56864/0 (socket says 172.21.15.47:56864) 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e514a2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356747a0 0x56143568cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:45248/0 (socket says 172.21.15.47:45248) 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e4bfff640 1 -- 172.21.15.47:0/1583670396 learned_addr learned my addr 172.21.15.47:0/1583670396 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.561+0000 7f7e514a2640 1 --2- 172.21.15.47:0/1583670396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614356849e0 0x56143569b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e4bfff640 1 -- 172.21.15.47:0/1583670396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614356849e0 msgr2=0x56143569b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:30.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e4bfff640 1 --2- 172.21.15.47:0/1583670396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614356849e0 0x56143569b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e4bfff640 1 -- 172.21.15.47:0/1583670396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356747a0 msgr2=0x56143568cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e4bfff640 1 --2- 172.21.15.47:0/1583670396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356747a0 0x56143568cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e4bfff640 1 -- 172.21.15.47:0/1583670396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56143569ba00 con 0x561435675cd0 2024-07-24T22:17:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e4bfff640 1 --2- 172.21.15.47:0/1583670396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561435675cd0 0x56143568d0a0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7e3802a450 tx=0x7f7e38009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e264f19b98d423cf server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e2bfff640 1 -- 172.21.15.47:0/1583670396 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38035040 con 0x561435675cd0 2024-07-24T22:17:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e2bfff640 1 -- 172.21.15.47:0/1583670396 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f7e38005040 con 0x561435675cd0 2024-07-24T22:17:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e552b6740 1 -- 172.21.15.47:0/1583670396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e44011970 con 0x561435675cd0 2024-07-24T22:17:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e2bfff640 1 -- 172.21.15.47:0/1583670396 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7e38055050 con 0x561435675cd0 2024-07-24T22:17:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e552b6740 10 client.17724 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e552b6740 1 -- 172.21.15.47:0/1583670396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56143569cd10 con 0x561435675cd0 2024-07-24T22:17:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.562+0000 7f7e2bfff640 1 -- 172.21.15.47:0/1583670396 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e44011970 con 0x561435675cd0 2024-07-24T22:17:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.563+0000 7f7e2bfff640 1 -- 172.21.15.47:0/1583670396 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7e380035f0 con 0x561435675cd0 2024-07-24T22:17:30.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.563+0000 7f7e552b6740 10 client.17724 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:30.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.563+0000 7f7e552b6740 10 client.17724 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:17:30.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.563+0000 7f7e552b6740 20 client.17724 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:30.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.563+0000 7f7e552b6740 1 --2- 172.21.15.47:0/1583670396 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561435700700 0x561435702b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:30.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.563+0000 7f7e552b6740 4 client.17724 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-07-24T22:17:30.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.563+0000 7f7e552b6740 1 -- 172.21.15.47:0/1583670396 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x5614355e8090 con 0x561435700700 2024-07-24T22:17:30.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.563+0000 7f7e514a2640 1 --2- 172.21.15.47:0/1583670396 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561435700700 0x561435702b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:30.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.563+0000 7f7e514a2640 1 --2- 172.21.15.47:0/1583670396 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561435700700 0x561435702b20 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac6a7ca95495838b server_cookie=a846f878f5ac77c7 in_seq=0 out_seq=0 2024-07-24T22:17:30.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.563+0000 7f7e2bfff640 10 client.17724 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:30.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.571+0000 7f7e2bfff640 1 -- 172.21.15.47:0/1583670396 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5614355e8090 con 0x561435700700 2024-07-24T22:17:30.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.571+0000 7f7e2bfff640 10 client.17724 handle_command_reply: tid=0 2024-07-24T22:17:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.571+0000 7f7e552b6740 1 client.17724 shutdown 2024-07-24T22:17:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.571+0000 7f7e552b6740 1 -- 172.21.15.47:0/1583670396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561435675cd0 msgr2=0x56143568d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.571+0000 7f7e552b6740 1 --2- 172.21.15.47:0/1583670396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561435675cd0 0x56143568d0a0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7e3802a450 tx=0x7f7e38009660 comp rx=0 tx=0).stop 2024-07-24T22:17:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.571+0000 7f7e552b6740 1 -- 172.21.15.47:0/1583670396 shutdown_connections 2024-07-24T22:17:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.571+0000 7f7e552b6740 1 --2- 172.21.15.47:0/1583670396 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x561435700700 0x561435702b20 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.571+0000 7f7e552b6740 1 --2- 172.21.15.47:0/1583670396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5614356849e0 0x56143569b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.571+0000 7f7e552b6740 1 --2- 172.21.15.47:0/1583670396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561435675cd0 0x56143568d0a0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.571+0000 7f7e552b6740 1 --2- 172.21.15.47:0/1583670396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614356747a0 0x56143568cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.571+0000 7f7e552b6740 1 -- 172.21.15.47:0/1583670396 >> 172.21.15.47:0/1583670396 conn(0x56143563e750 msgr2=0x561435679bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.572+0000 7f7e2bfff640 0 client.17724 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.572+0000 7f7e552b6740 1 -- 172.21.15.47:0/1583670396 shutdown_connections 2024-07-24T22:17:30.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.572+0000 7f7e552b6740 1 -- 172.21.15.47:0/1583670396 wait complete. 2024-07-24T22:17:30.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.572+0000 7f7e552b6740 20 client.17724 trim_cache size 0 max 16384 2024-07-24T22:17:30.586 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:17:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:17:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:17:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 30, 2024-07-24T22:17:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:17:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "b7c021aa": { 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 30, 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 130.0, 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:17:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:17:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:17:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:17:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:17:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:17:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:17:30.588 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:17:30.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.573+0000 7f7e52f05640 1 -- 172.21.15.47:0/1150399207 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7e3c0b3dc0 msgr2=0x7f7e3c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:30.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.573+0000 7f7e52f05640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7e3c0b3dc0 0x7f7e3c0b6280 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7e40000c00 tx=0x7f7e400e9040 comp rx=0 tx=0).stop 2024-07-24T22:17:30.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.573+0000 7f7e52f05640 1 -- 172.21.15.47:0/1150399207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e4c103680 msgr2=0x7f7e4c198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:30.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.573+0000 7f7e52f05640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e4c103680 0x7f7e4c198c50 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000e9f0 tx=0x7f7e4000eeb0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.573+0000 7f7e52f05640 1 -- 172.21.15.47:0/1150399207 shutdown_connections 2024-07-24T22:17:30.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.573+0000 7f7e52f05640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7e3c0b3dc0 0x7f7e3c0b6280 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.573+0000 7f7e52f05640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e4c10cae0 0x7f7e4c19e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.573+0000 7f7e52f05640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e4c103fa0 0x7f7e4c199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.573+0000 7f7e52f05640 1 --2- 172.21.15.47:0/1150399207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e4c103680 0x7f7e4c198c50 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:30.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.573+0000 7f7e52f05640 1 -- 172.21.15.47:0/1150399207 >> 172.21.15.47:0/1150399207 conn(0x7f7e4c0fd0e0 msgr2=0x7f7e4c0fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:30.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.573+0000 7f7e52f05640 1 -- 172.21.15.47:0/1150399207 shutdown_connections 2024-07-24T22:17:30.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:30.573+0000 7f7e52f05640 1 -- 172.21.15.47:0/1150399207 wait complete. 2024-07-24T22:17:30.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:30 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:17:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:30 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:17:31.152 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b7c021aa', quiesce took 5.5 seconds. Will release after: 4.5 2024-07-24T22:17:32.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:31 smithi188 ceph-mon[37380]: pgmap v685: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:17:32.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:17:32.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:17:32.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:31 smithi183 ceph-mon[37007]: pgmap v685: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:17:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:17:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:17:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:31 smithi047 ceph-mon[32551]: pgmap v685: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:17:32.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:32.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:17:32.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:17:32.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:17:34.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:33 smithi188 ceph-mon[37380]: pgmap v686: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:17:34.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:33 smithi183 ceph-mon[37007]: pgmap v686: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:17:34.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:33 smithi047 ceph-mon[32551]: pgmap v686: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:17:35.654 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:17:35.932 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:17:35.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:35 smithi047 ceph-mon[32551]: pgmap v687: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:17:36.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:35 smithi188 ceph-mon[37380]: pgmap v687: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:17:36.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:35 smithi183 ceph-mon[37007]: pgmap v687: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:17:37.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.714+0000 7f36c1248640 1 -- 172.21.15.47:0/2378492299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36bc101650 msgr2=0x7f36bc101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.714+0000 7f36c1248640 1 --2- 172.21.15.47:0/2378492299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36bc101650 0x7f36bc101a30 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009900 tx=0x7f36ac02a410 comp rx=0 tx=0).stop 2024-07-24T22:17:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.714+0000 7f36c1248640 1 -- 172.21.15.47:0/2378492299 shutdown_connections 2024-07-24T22:17:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.714+0000 7f36c1248640 1 --2- 172.21.15.47:0/2378492299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36bc1079e0 0x7f36bc10e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.714+0000 7f36c1248640 1 --2- 172.21.15.47:0/2378492299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36bc107060 0x7f36bc1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.714+0000 7f36c1248640 1 --2- 172.21.15.47:0/2378492299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36bc101650 0x7f36bc101a30 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.714+0000 7f36c1248640 1 -- 172.21.15.47:0/2378492299 >> 172.21.15.47:0/2378492299 conn(0x7f36bc0fd0c0 msgr2=0x7f36bc0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.714+0000 7f36c1248640 1 -- 172.21.15.47:0/2378492299 shutdown_connections 2024-07-24T22:17:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.714+0000 7f36c1248640 1 -- 172.21.15.47:0/2378492299 wait complete. 2024-07-24T22:17:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.715+0000 7f36c1248640 1 Processor -- start 2024-07-24T22:17:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.715+0000 7f36c1248640 1 -- start start 2024-07-24T22:17:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36c1248640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36bc101650 0x7f36bc198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36c1248640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36bc107060 0x7f36bc1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36c1248640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36bc1079e0 0x7f36bc19e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36c1248640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc1127c0 con 0x7f36bc1079e0 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36c1248640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc112640 con 0x7f36bc101650 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36c1248640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc112940 con 0x7f36bc107060 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36bb59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36bc1079e0 0x7f36bc19e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36bb59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36bc1079e0 0x7f36bc19e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43114/0 (socket says 172.21.15.47:43114) 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36bb59e640 1 -- 172.21.15.47:0/3559420518 learned_addr learned my addr 172.21.15.47:0/3559420518 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36ba59c640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36bc107060 0x7f36bc1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36bad9d640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36bc101650 0x7f36bc198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36bb59e640 1 -- 172.21.15.47:0/3559420518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36bc107060 msgr2=0x7f36bc1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36bb59e640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36bc107060 0x7f36bc1991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36bb59e640 1 -- 172.21.15.47:0/3559420518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36bc101650 msgr2=0x7f36bc198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36bb59e640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36bc101650 0x7f36bc198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36bb59e640 1 -- 172.21.15.47:0/3559420518 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc19ed20 con 0x7f36bc1079e0 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36ba59c640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36bc107060 0x7f36bc1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:17:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.716+0000 7f36bad9d640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36bc101650 0x7f36bc198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:17:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.717+0000 7f36bb59e640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36bc1079e0 0x7f36bc19e550 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f36b400cad0 tx=0x7f36b400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.717+0000 7f36a3fff640 1 -- 172.21.15.47:0/3559420518 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b400ae20 con 0x7f36bc1079e0 2024-07-24T22:17:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.717+0000 7f36c1248640 1 -- 172.21.15.47:0/3559420518 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36bc19f010 con 0x7f36bc1079e0 2024-07-24T22:17:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.717+0000 7f36a3fff640 1 -- 172.21.15.47:0/3559420518 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36b4005020 con 0x7f36bc1079e0 2024-07-24T22:17:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.717+0000 7f36a3fff640 1 -- 172.21.15.47:0/3559420518 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b400f6b0 con 0x7f36bc1079e0 2024-07-24T22:17:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.717+0000 7f36c1248640 1 -- 172.21.15.47:0/3559420518 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36bc1a56d0 con 0x7f36bc1079e0 2024-07-24T22:17:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.718+0000 7f36c1248640 1 -- 172.21.15.47:0/3559420518 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36bc101a30 con 0x7f36bc1079e0 2024-07-24T22:17:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.719+0000 7f36a3fff640 1 -- 172.21.15.47:0/3559420518 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f36b40051d0 con 0x7f36bc1079e0 2024-07-24T22:17:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.720+0000 7f36a3fff640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f36a40b3d40 0x7f36a40b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.720+0000 7f36bad9d640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f36a40b3d40 0x7f36a40b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.720+0000 7f36a3fff640 1 -- 172.21.15.47:0/3559420518 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f36b40e40d0 con 0x7f36bc1079e0 2024-07-24T22:17:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.721+0000 7f36bad9d640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f36a40b3d40 0x7f36a40b6200 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f36ac031440 tx=0x7f36ac005a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.724+0000 7f36a3fff640 1 -- 172.21.15.47:0/3559420518 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f36b4014030 con 0x7f36bc1079e0 2024-07-24T22:17:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.789+0000 7f0cdbda6640 1 -- 172.21.15.47:0/1578181477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cd41026a0 msgr2=0x7f0cd4102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.789+0000 7f0cdbda6640 1 --2- 172.21.15.47:0/1578181477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cd41026a0 0x7f0cd4102a80 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009ca0 tx=0x7f0cd002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.789+0000 7f0cdbda6640 1 -- 172.21.15.47:0/1578181477 shutdown_connections 2024-07-24T22:17:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.789+0000 7f0cdbda6640 1 --2- 172.21.15.47:0/1578181477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cd4108a20 0x7f0cd410f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.789+0000 7f0cdbda6640 1 --2- 172.21.15.47:0/1578181477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0cd41080a0 0x7f0cd41084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.789+0000 7f0cdbda6640 1 --2- 172.21.15.47:0/1578181477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cd41026a0 0x7f0cd4102a80 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.789+0000 7f0cdbda6640 1 -- 172.21.15.47:0/1578181477 >> 172.21.15.47:0/1578181477 conn(0x7f0cd40fe0e0 msgr2=0x7f0cd4100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.789+0000 7f0cdbda6640 1 -- 172.21.15.47:0/1578181477 shutdown_connections 2024-07-24T22:17:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.789+0000 7f0cdbda6640 1 -- 172.21.15.47:0/1578181477 wait complete. 2024-07-24T22:17:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.789+0000 7f0cdbda6640 1 Processor -- start 2024-07-24T22:17:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.789+0000 7f0cdbda6640 1 -- start start 2024-07-24T22:17:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cdbda6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cd41026a0 0x7f0cd4074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cdbda6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0cd41080a0 0x7f0cd40753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cdbda6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cd4108a20 0x7f0cd4075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cdbda6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd4112670 con 0x7f0cd41026a0 2024-07-24T22:17:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cdbda6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41124f0 con 0x7f0cd41080a0 2024-07-24T22:17:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cdbda6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41127f0 con 0x7f0cd4108a20 2024-07-24T22:17:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cd9b42640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cd41026a0 0x7f0cd4074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cd9b42640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cd41026a0 0x7f0cd4074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43124/0 (socket says 172.21.15.47:43124) 2024-07-24T22:17:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cd9b42640 1 -- 172.21.15.47:0/3532263404 learned_addr learned my addr 172.21.15.47:0/3532263404 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cda343640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cd4108a20 0x7f0cd4075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cd9b42640 1 -- 172.21.15.47:0/3532263404 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cd4108a20 msgr2=0x7f0cd4075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cd9b42640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cd4108a20 0x7f0cd4075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cd9b42640 1 -- 172.21.15.47:0/3532263404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0cd41080a0 msgr2=0x7f0cd40753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cd9341640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0cd41080a0 0x7f0cd40753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cd9b42640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0cd41080a0 0x7f0cd40753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cd9b42640 1 -- 172.21.15.47:0/3532263404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd41a7080 con 0x7f0cd41026a0 2024-07-24T22:17:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cd9b42640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cd41026a0 0x7f0cd4074e90 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0006010 tx=0x7f0cd00319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0ccaffd640 1 -- 172.21.15.47:0/3532263404 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0003bf0 con 0x7f0cd41026a0 2024-07-24T22:17:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0ccaffd640 1 -- 172.21.15.47:0/3532263404 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cd0003d90 con 0x7f0cd41026a0 2024-07-24T22:17:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0cdbda6640 1 -- 172.21.15.47:0/3532263404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd41a7310 con 0x7f0cd41026a0 2024-07-24T22:17:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.790+0000 7f0ccaffd640 1 -- 172.21.15.47:0/3532263404 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd002fc20 con 0x7f0cd41026a0 2024-07-24T22:17:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.791+0000 7f0cdbda6640 1 -- 172.21.15.47:0/3532263404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd41a78b0 con 0x7f0cd41026a0 2024-07-24T22:17:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.793+0000 7f0cdebd0740 1 Processor -- start 2024-07-24T22:17:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.793+0000 7f0ccaffd640 1 -- 172.21.15.47:0/3532263404 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f0cd00046a0 con 0x7f0cd41026a0 2024-07-24T22:17:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.793+0000 7f0cdebd0740 1 -- start start 2024-07-24T22:17:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cdebd0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 0x558bf1e4a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cdebd0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e4a5b0 0x558bf1e56000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cdebd0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e56540 0x558bf1e58930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cdebd0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558bf1dbf280 con 0x558bf1e4a5b0 2024-07-24T22:17:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cdebd0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558bf1dae780 con 0x558bf1e49c90 2024-07-24T22:17:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cdebd0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558bf1db27c0 con 0x558bf1e56540 2024-07-24T22:17:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cd9b42640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e4a5b0 0x558bf1e56000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cd9b42640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e4a5b0 0x558bf1e56000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43136/0 (socket says 172.21.15.47:43136) 2024-07-24T22:17:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cd9b42640 1 -- 172.21.15.47:0/957429189 learned_addr learned my addr 172.21.15.47:0/957429189 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cd9341640 1 --2- 172.21.15.47:0/957429189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e56540 0x558bf1e58930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cda343640 1 --2- 172.21.15.47:0/957429189 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 0x558bf1e4a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cd9b42640 1 -- 172.21.15.47:0/957429189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e56540 msgr2=0x558bf1e58930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cd9b42640 1 --2- 172.21.15.47:0/957429189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e56540 0x558bf1e58930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cd9b42640 1 -- 172.21.15.47:0/957429189 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 msgr2=0x558bf1e4a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cd9b42640 1 --2- 172.21.15.47:0/957429189 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 0x558bf1e4a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cd9b42640 1 -- 172.21.15.47:0/957429189 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bf1b12790 con 0x558bf1e4a5b0 2024-07-24T22:17:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0ccaffd640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0cc00b3dc0 0x7f0cc00b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.794+0000 7f0cda343640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0cc00b3dc0 0x7f0cc00b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.795+0000 7f0cd9b42640 1 --2- 172.21.15.47:0/957429189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e4a5b0 0x558bf1e56000 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0102c50 tx=0x7f0cd010b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6c08879d9be773 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.795+0000 7f0ccaffd640 1 -- 172.21.15.47:0/3532263404 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f0cd01054b0 con 0x7f0cd41026a0 2024-07-24T22:17:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.795+0000 7f0cbffff640 1 -- 172.21.15.47:0/957429189 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00c8060 con 0x558bf1e4a5b0 2024-07-24T22:17:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.795+0000 7f0cbffff640 1 -- 172.21.15.47:0/957429189 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cd0036070 con 0x558bf1e4a5b0 2024-07-24T22:17:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.795+0000 7f0cbffff640 1 -- 172.21.15.47:0/957429189 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00d3b20 con 0x558bf1e4a5b0 2024-07-24T22:17:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.796+0000 7f0cdebd0740 1 -- 172.21.15.47:0/957429189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e4a5b0 msgr2=0x558bf1e56000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.796+0000 7f0cda343640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0cc00b3dc0 0x7f0cc00b6280 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc005fd0 tx=0x7f0ccc005dc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.796+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/957429189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e4a5b0 0x558bf1e56000 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0102c50 tx=0x7f0cd010b5c0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.796+0000 7f0cdebd0740 1 -- 172.21.15.47:0/957429189 shutdown_connections 2024-07-24T22:17:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.796+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/957429189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e56540 0x558bf1e58930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.796+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/957429189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e4a5b0 0x558bf1e56000 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.796+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/957429189 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 0x558bf1e4a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.796+0000 7f0cdebd0740 1 -- 172.21.15.47:0/957429189 >> 172.21.15.47:0/957429189 conn(0x558bf1e47ac0 msgr2=0x558bf1e48c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.796+0000 7f0cdebd0740 1 -- 172.21.15.47:0/957429189 shutdown_connections 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.796+0000 7f0cdebd0740 1 -- 172.21.15.47:0/957429189 wait complete. 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.796+0000 7f0cdebd0740 1 -- start start 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.796+0000 7f0cdebd0740 1 Processor -- start 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cdebd0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e49c90 0x558bf1e55c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cdebd0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e4a5b0 0x558bf1e53120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cdebd0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e56540 0x558bf1e53660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cdebd0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558bf1ce8ab0 con 0x558bf1e49c90 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cdebd0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558bf1d369e0 con 0x558bf1e4a5b0 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cdebd0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558bf1dbf280 con 0x558bf1e56540 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cdebd0740 10 client.0 _ll_register_callbacks cb 0x558bf1abea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cd9b42640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e49c90 0x558bf1e55c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cd9b42640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e49c90 0x558bf1e55c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43138/0 (socket says 172.21.15.47:43138) 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cd9b42640 1 -- 172.21.15.47:0/2694662173 learned_addr learned my addr 172.21.15.47:0/2694662173 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cda343640 1 --2- 172.21.15.47:0/2694662173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e56540 0x558bf1e53660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cd9341640 1 --2- 172.21.15.47:0/2694662173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e4a5b0 0x558bf1e53120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cd9b42640 1 -- 172.21.15.47:0/2694662173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e56540 msgr2=0x558bf1e53660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cd9b42640 1 --2- 172.21.15.47:0/2694662173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e56540 0x558bf1e53660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cd9b42640 1 -- 172.21.15.47:0/2694662173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e4a5b0 msgr2=0x558bf1e53120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cd9b42640 1 --2- 172.21.15.47:0/2694662173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e4a5b0 0x558bf1e53120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cd9b42640 1 -- 172.21.15.47:0/2694662173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bf1b8b620 con 0x558bf1e49c90 2024-07-24T22:17:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cd9b42640 1 --2- 172.21.15.47:0/2694662173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e49c90 0x558bf1e55c40 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f0cd002ade0 tx=0x7f0cd002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ed7d07aba4c3ef server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cbd7fa640 1 -- 172.21.15.47:0/2694662173 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00cb910 con 0x558bf1e49c90 2024-07-24T22:17:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cbd7fa640 1 -- 172.21.15.47:0/2694662173 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f0cd00cc610 con 0x558bf1e49c90 2024-07-24T22:17:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.797+0000 7f0cdebd0740 1 -- 172.21.15.47:0/2694662173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558bf1d5dce0 con 0x558bf1e49c90 2024-07-24T22:17:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.798+0000 7f0cbd7fa640 1 -- 172.21.15.47:0/2694662173 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0cd00cbaf0 con 0x558bf1e49c90 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.798+0000 7f0cdebd0740 10 client.17742 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.798+0000 7f0cdebd0740 1 -- 172.21.15.47:0/2694662173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558bf1e644e0 con 0x558bf1e49c90 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.798+0000 7f0cbd7fa640 1 -- 172.21.15.47:0/2694662173 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558bf1d5dce0 con 0x558bf1e49c90 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.798+0000 7f0cbd7fa640 1 -- 172.21.15.47:0/2694662173 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0cd00e6ce0 con 0x558bf1e49c90 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.798+0000 7f0cdebd0740 10 client.17742 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.798+0000 7f0cdebd0740 10 client.17742 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.798+0000 7f0cdebd0740 20 client.17742 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.798+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/2694662173 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558bf1e658a0 0x558bf1e67cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.798+0000 7f0cdebd0740 4 client.17742 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.798+0000 7f0cdebd0740 1 -- 172.21.15.47:0/2694662173 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bf1dc11d0 con 0x558bf1e658a0 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.798+0000 7f0cd9341640 1 --2- 172.21.15.47:0/2694662173 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558bf1e658a0 0x558bf1e67cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.799+0000 7f0cd9341640 1 --2- 172.21.15.47:0/2694662173 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558bf1e658a0 0x558bf1e67cd0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad03648a3f706c8c server_cookie=939e51032f3a56d4 in_seq=0 out_seq=0 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.799+0000 7f0cbd7fa640 10 client.17742 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.799+0000 7f0cbd7fa640 1 -- 172.21.15.47:0/2694662173 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558bf1dc11d0 con 0x558bf1e658a0 2024-07-24T22:17:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.799+0000 7f0cbd7fa640 10 client.17742 handle_command_reply: tid=0 2024-07-24T22:17:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.799+0000 7f0cdebd0740 1 client.17742 shutdown 2024-07-24T22:17:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.800+0000 7f0cdebd0740 1 -- 172.21.15.47:0/2694662173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e49c90 msgr2=0x558bf1e55c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.800+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/2694662173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e49c90 0x558bf1e55c40 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f0cd002ade0 tx=0x7f0cd002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.800+0000 7f0cdebd0740 1 -- 172.21.15.47:0/2694662173 shutdown_connections 2024-07-24T22:17:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.800+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/2694662173 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558bf1e658a0 0x558bf1e67cd0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.800+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/2694662173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e56540 0x558bf1e53660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.800+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/2694662173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e4a5b0 0x558bf1e53120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.800+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/2694662173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e49c90 0x558bf1e55c40 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.800+0000 7f0cbd7fa640 0 client.17742 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.800+0000 7f0cdebd0740 1 -- 172.21.15.47:0/2694662173 >> 172.21.15.47:0/2694662173 conn(0x558bf1e47ac0 msgr2=0x558bf1e4d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.800+0000 7f0cdebd0740 1 -- 172.21.15.47:0/2694662173 shutdown_connections 2024-07-24T22:17:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.800+0000 7f0cdebd0740 1 -- 172.21.15.47:0/2694662173 wait complete. 2024-07-24T22:17:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.800+0000 7f0cdebd0740 20 client.17742 trim_cache size 0 max 16384 2024-07-24T22:17:37.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.815+0000 7f0cdebd0740 1 Processor -- start 2024-07-24T22:17:37.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.815+0000 7f0cdebd0740 1 -- start start 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.815+0000 7f0cdebd0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 0x558bf1e61f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.815+0000 7f0cdebd0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e4a5b0 0x558bf1e51980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.815+0000 7f0cdebd0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 0x558bf1e51ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.815+0000 7f0cdebd0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41ae3a0 con 0x558bf1e56540 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.815+0000 7f0cdebd0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41b0c00 con 0x558bf1e49c90 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.815+0000 7f0cdebd0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41ae9f0 con 0x558bf1e4a5b0 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.815+0000 7f0cda343640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 0x558bf1e51ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.816+0000 7f0cda343640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 0x558bf1e51ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43150/0 (socket says 172.21.15.47:43150) 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.816+0000 7f0cda343640 1 -- 172.21.15.47:0/267951894 learned_addr learned my addr 172.21.15.47:0/267951894 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.816+0000 7f0cd9b42640 1 --2- 172.21.15.47:0/267951894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 0x558bf1e61f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.816+0000 7f0cd9341640 1 --2- 172.21.15.47:0/267951894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e4a5b0 0x558bf1e51980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.816+0000 7f0cda343640 1 -- 172.21.15.47:0/267951894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e4a5b0 msgr2=0x558bf1e51980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.816+0000 7f0cda343640 1 --2- 172.21.15.47:0/267951894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e4a5b0 0x558bf1e51980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.816+0000 7f0cda343640 1 -- 172.21.15.47:0/267951894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 msgr2=0x558bf1e61f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.816+0000 7f0cda343640 1 --2- 172.21.15.47:0/267951894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 0x558bf1e61f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.816+0000 7f0cda343640 1 -- 172.21.15.47:0/267951894 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bf1e68320 con 0x558bf1e56540 2024-07-24T22:17:37.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.816+0000 7f0cda343640 1 --2- 172.21.15.47:0/267951894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 0x558bf1e51ec0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc011010 tx=0x7f0ccc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5329b211e02e0b1b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:37.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.816+0000 7f0cbf7fe640 1 -- 172.21.15.47:0/267951894 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc02b070 con 0x558bf1e56540 2024-07-24T22:17:37.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.816+0000 7f0cbf7fe640 1 -- 172.21.15.47:0/267951894 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ccc011ca0 con 0x558bf1e56540 2024-07-24T22:17:37.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.816+0000 7f0cbf7fe640 1 -- 172.21.15.47:0/267951894 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc017070 con 0x558bf1e56540 2024-07-24T22:17:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.817+0000 7f0cdebd0740 1 -- 172.21.15.47:0/267951894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 msgr2=0x558bf1e51ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.817+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/267951894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 0x558bf1e51ec0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc011010 tx=0x7f0ccc013000 comp rx=0 tx=0).stop 2024-07-24T22:17:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.817+0000 7f0cdebd0740 1 -- 172.21.15.47:0/267951894 shutdown_connections 2024-07-24T22:17:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.817+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/267951894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 0x558bf1e51ec0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.817+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/267951894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e4a5b0 0x558bf1e51980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.817+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/267951894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 0x558bf1e61f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.817+0000 7f0cdebd0740 1 -- 172.21.15.47:0/267951894 >> 172.21.15.47:0/267951894 conn(0x558bf1e47ac0 msgr2=0x558bf1e48b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.817+0000 7f0cdebd0740 1 -- 172.21.15.47:0/267951894 shutdown_connections 2024-07-24T22:17:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.817+0000 7f0cdebd0740 1 -- 172.21.15.47:0/267951894 wait complete. 2024-07-24T22:17:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.817+0000 7f0cdebd0740 1 -- start start 2024-07-24T22:17:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.817+0000 7f0cdebd0740 1 Processor -- start 2024-07-24T22:17:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cdebd0740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 0x558bf1e4cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cdebd0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e4a5b0 0x558bf1e4d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cdebd0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 0x558bf1e5c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cdebd0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41af0c0 con 0x558bf1e56540 2024-07-24T22:17:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cdebd0740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41b0530 con 0x558bf1e49c90 2024-07-24T22:17:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cdebd0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41af790 con 0x558bf1e4a5b0 2024-07-24T22:17:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cdebd0740 10 client.0 _ll_register_callbacks cb 0x7f0cc40092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cda343640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 0x558bf1e5c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cda343640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 0x558bf1e5c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43164/0 (socket says 172.21.15.47:43164) 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cda343640 1 -- 172.21.15.47:0/1421424195 learned_addr learned my addr 172.21.15.47:0/1421424195 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cd9341640 1 --2- 172.21.15.47:0/1421424195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e4a5b0 0x558bf1e4d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cd9b42640 1 --2- 172.21.15.47:0/1421424195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 0x558bf1e4cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cda343640 1 -- 172.21.15.47:0/1421424195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e4a5b0 msgr2=0x558bf1e4d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cda343640 1 --2- 172.21.15.47:0/1421424195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e4a5b0 0x558bf1e4d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cda343640 1 -- 172.21.15.47:0/1421424195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 msgr2=0x558bf1e4cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cda343640 1 --2- 172.21.15.47:0/1421424195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 0x558bf1e4cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cda343640 1 -- 172.21.15.47:0/1421424195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bf1e5ca80 con 0x558bf1e56540 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cda343640 1 --2- 172.21.15.47:0/1421424195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 0x558bf1e5c340 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc029040 tx=0x7f0ccc01deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e5baa860eee8a5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.818+0000 7f0cbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cbd7fa640 1 -- 172.21.15.47:0/1421424195 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc02b070 con 0x558bf1e56540 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cbd7fa640 1 -- 172.21.15.47:0/1421424195 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f0ccc0048d0 con 0x558bf1e56540 2024-07-24T22:17:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cdebd0740 1 -- 172.21.15.47:0/1421424195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ccc011ca0 con 0x558bf1e56540 2024-07-24T22:17:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cbd7fa640 1 -- 172.21.15.47:0/1421424195 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0ccc011e50 con 0x558bf1e56540 2024-07-24T22:17:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cdebd0740 10 client.17748 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cdebd0740 1 -- 172.21.15.47:0/1421424195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558bf1e5ded0 con 0x558bf1e56540 2024-07-24T22:17:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cbd7fa640 1 -- 172.21.15.47:0/1421424195 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ccc011ca0 con 0x558bf1e56540 2024-07-24T22:17:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cbd7fa640 1 -- 172.21.15.47:0/1421424195 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0ccc031410 con 0x558bf1e56540 2024-07-24T22:17:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cdebd0740 10 client.17748 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cdebd0740 10 client.17748 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cdebd0740 20 client.17748 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/1421424195 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558bf1e5e630 0x558bf1ed25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cdebd0740 4 client.17748 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:17:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.819+0000 7f0cdebd0740 1 -- 172.21.15.47:0/1421424195 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558bf1dbcc70 con 0x558bf1e5e630 2024-07-24T22:17:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.820+0000 7f0cd9b42640 1 --2- 172.21.15.47:0/1421424195 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558bf1e5e630 0x558bf1ed25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.820+0000 7f0cbd7fa640 10 client.17748 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.820+0000 7f0cd9b42640 1 --2- 172.21.15.47:0/1421424195 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558bf1e5e630 0x558bf1ed25e0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5159e718854282d server_cookie=4ad31cf4a8d8cf86 in_seq=0 out_seq=0 2024-07-24T22:17:37.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.825+0000 7f0cbd7fa640 1 -- 172.21.15.47:0/1421424195 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558bf1dbcc70 con 0x558bf1e5e630 2024-07-24T22:17:37.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.825+0000 7f0cbd7fa640 10 client.17748 handle_command_reply: tid=0 2024-07-24T22:17:37.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.825+0000 7f0cdebd0740 1 client.17748 shutdown 2024-07-24T22:17:37.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.825+0000 7f0cdebd0740 1 -- 172.21.15.47:0/1421424195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 msgr2=0x558bf1e5c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.825+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/1421424195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 0x558bf1e5c340 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc029040 tx=0x7f0ccc01deb0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.825+0000 7f0cdebd0740 1 -- 172.21.15.47:0/1421424195 shutdown_connections 2024-07-24T22:17:37.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.825+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/1421424195 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x558bf1e5e630 0x558bf1ed25e0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.825+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/1421424195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558bf1e56540 0x558bf1e5c340 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.825+0000 7f0cbd7fa640 0 client.17748 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:37.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.825+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/1421424195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558bf1e4a5b0 0x558bf1e4d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.825+0000 7f0cdebd0740 1 --2- 172.21.15.47:0/1421424195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558bf1e49c90 0x558bf1e4cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.825+0000 7f0cdebd0740 1 -- 172.21.15.47:0/1421424195 >> 172.21.15.47:0/1421424195 conn(0x558bf1e47ac0 msgr2=0x558bf1e52e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:37.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdebd0740 1 -- 172.21.15.47:0/1421424195 shutdown_connections 2024-07-24T22:17:37.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdebd0740 1 -- 172.21.15.47:0/1421424195 wait complete. 2024-07-24T22:17:37.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdebd0740 20 client.17748 trim_cache size 0 max 16384 2024-07-24T22:17:37.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:17:37.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:17:37.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:17:37.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:17:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdbda6640 1 -- 172.21.15.47:0/3532263404 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0cc00b3dc0 msgr2=0x7f0cc00b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdbda6640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0cc00b3dc0 0x7f0cc00b6280 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc005fd0 tx=0x7f0ccc005dc0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdbda6640 1 -- 172.21.15.47:0/3532263404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cd41026a0 msgr2=0x7f0cd4074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdbda6640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cd41026a0 0x7f0cd4074e90 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0006010 tx=0x7f0cd00319f0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdbda6640 1 -- 172.21.15.47:0/3532263404 shutdown_connections 2024-07-24T22:17:37.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdbda6640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0cc00b3dc0 0x7f0cc00b6280 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdbda6640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cd4108a20 0x7f0cd4075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdbda6640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0cd41080a0 0x7f0cd40753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdbda6640 1 --2- 172.21.15.47:0/3532263404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cd41026a0 0x7f0cd4074e90 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdbda6640 1 -- 172.21.15.47:0/3532263404 >> 172.21.15.47:0/3532263404 conn(0x7f0cd40fe0e0 msgr2=0x7f0cd40feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:37.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdbda6640 1 -- 172.21.15.47:0/3532263404 shutdown_connections 2024-07-24T22:17:37.831 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:37.826+0000 7f0cdbda6640 1 -- 172.21.15.47:0/3532263404 wait complete. 2024-07-24T22:17:37.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:37 smithi047 ceph-mon[32551]: pgmap v688: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:17:37.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.967+0000 7f36c1248640 1 -- 172.21.15.47:0/3559420518 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36bc109230 con 0x7f36bc1079e0 2024-07-24T22:17:37.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.968+0000 7f36a3fff640 1 -- 172.21.15.47:0/3559420518 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f36b40cd070 con 0x7f36bc1079e0 2024-07-24T22:17:37.970 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:17:37.970 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:17:37.971 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:17:37.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.970+0000 7f36c1248640 1 -- 172.21.15.47:0/3559420518 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f36a40b3d40 msgr2=0x7f36a40b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.970+0000 7f36c1248640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f36a40b3d40 0x7f36a40b6200 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f36ac031440 tx=0x7f36ac005a20 comp rx=0 tx=0).stop 2024-07-24T22:17:37.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.970+0000 7f36c1248640 1 -- 172.21.15.47:0/3559420518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36bc1079e0 msgr2=0x7f36bc19e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:37.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.970+0000 7f36c1248640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36bc1079e0 0x7f36bc19e550 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f36b400cad0 tx=0x7f36b400cf90 comp rx=0 tx=0).stop 2024-07-24T22:17:37.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.970+0000 7f36c1248640 1 -- 172.21.15.47:0/3559420518 shutdown_connections 2024-07-24T22:17:37.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.970+0000 7f36c1248640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f36a40b3d40 0x7f36a40b6200 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.970+0000 7f36c1248640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36bc1079e0 0x7f36bc19e550 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.970+0000 7f36c1248640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36bc107060 0x7f36bc1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.970+0000 7f36c1248640 1 --2- 172.21.15.47:0/3559420518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36bc101650 0x7f36bc198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:37.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.970+0000 7f36c1248640 1 -- 172.21.15.47:0/3559420518 >> 172.21.15.47:0/3559420518 conn(0x7f36bc0fd0c0 msgr2=0x7f36bc0ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:37.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.970+0000 7f36c1248640 1 -- 172.21.15.47:0/3559420518 shutdown_connections 2024-07-24T22:17:37.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:37.970+0000 7f36c1248640 1 -- 172.21.15.47:0/3559420518 wait complete. 2024-07-24T22:17:38.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:37 smithi188 ceph-mon[37380]: pgmap v688: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:17:38.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:37 smithi183 ceph-mon[37007]: pgmap v688: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:17:38.714 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db --set-id b7c021aa --release --await' 2024-07-24T22:17:38.714 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db --set-id b7c021aa --release --await 2024-07-24T22:17:38.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:38 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3559420518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:17:38.991 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:17:39.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:38 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3559420518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:17:39.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:38 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3559420518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:17:40.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:39 smithi188 ceph-mon[37380]: pgmap v689: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:17:40.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:39 smithi183 ceph-mon[37007]: pgmap v689: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:17:40.175 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:39 smithi047 ceph-mon[32551]: pgmap v689: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1023 B/s rd, 0 B/s wr, 2 op/s 2024-07-24T22:17:40.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.709+0000 7fca1c5ab640 1 -- 172.21.15.47:0/1274580924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca14102790 msgr2=0x7fca14102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:40.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.709+0000 7fca1c5ab640 1 --2- 172.21.15.47:0/1274580924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca14102790 0x7fca14102b70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fca10009ca0 tx=0x7fca1002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.709+0000 7fca1c5ab640 1 -- 172.21.15.47:0/1274580924 shutdown_connections 2024-07-24T22:17:40.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.709+0000 7fca1c5ab640 1 --2- 172.21.15.47:0/1274580924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca14108b20 0x7fca1410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.709+0000 7fca1c5ab640 1 --2- 172.21.15.47:0/1274580924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca141081a0 0x7fca141085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.709+0000 7fca1c5ab640 1 --2- 172.21.15.47:0/1274580924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca14102790 0x7fca14102b70 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.709+0000 7fca1c5ab640 1 -- 172.21.15.47:0/1274580924 >> 172.21.15.47:0/1274580924 conn(0x7fca140fe200 msgr2=0x7fca14100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:40.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.709+0000 7fca1c5ab640 1 -- 172.21.15.47:0/1274580924 shutdown_connections 2024-07-24T22:17:40.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.709+0000 7fca1c5ab640 1 -- 172.21.15.47:0/1274580924 wait complete. 2024-07-24T22:17:40.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca1c5ab640 1 Processor -- start 2024-07-24T22:17:40.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca1c5ab640 1 -- start start 2024-07-24T22:17:40.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca1c5ab640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca14102790 0x7fca14074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca1c5ab640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca141081a0 0x7fca140753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca1c5ab640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca14108b20 0x7fca14075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca1c5ab640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca141127a0 con 0x7fca141081a0 2024-07-24T22:17:40.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca1c5ab640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fca14112620 con 0x7fca14108b20 2024-07-24T22:17:40.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca1c5ab640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fca14112920 con 0x7fca14102790 2024-07-24T22:17:40.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca19b46640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca141081a0 0x7fca140753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca19b46640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca141081a0 0x7fca140753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43168/0 (socket says 172.21.15.47:43168) 2024-07-24T22:17:40.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca19b46640 1 -- 172.21.15.47:0/2408655063 learned_addr learned my addr 172.21.15.47:0/2408655063 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:40.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca1a347640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca14102790 0x7fca14074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca1ab48640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca14108b20 0x7fca14075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca19b46640 1 -- 172.21.15.47:0/2408655063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca14102790 msgr2=0x7fca14074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:40.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca19b46640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca14102790 0x7fca14074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca19b46640 1 -- 172.21.15.47:0/2408655063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca14108b20 msgr2=0x7fca14075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:40.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca19b46640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca14108b20 0x7fca14075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.710+0000 7fca19b46640 1 -- 172.21.15.47:0/2408655063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca141a7050 con 0x7fca141081a0 2024-07-24T22:17:40.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.711+0000 7fca19b46640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca141081a0 0x7fca140753d0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fca0400c920 tx=0x7fca0400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:40.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.711+0000 7fca0b7fe640 1 -- 172.21.15.47:0/2408655063 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca04007c70 con 0x7fca141081a0 2024-07-24T22:17:40.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.711+0000 7fca0b7fe640 1 -- 172.21.15.47:0/2408655063 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca04007e10 con 0x7fca141081a0 2024-07-24T22:17:40.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.711+0000 7fca1c5ab640 1 -- 172.21.15.47:0/2408655063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca141a7340 con 0x7fca141081a0 2024-07-24T22:17:40.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.711+0000 7fca0b7fe640 1 -- 172.21.15.47:0/2408655063 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca04018820 con 0x7fca141081a0 2024-07-24T22:17:40.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.711+0000 7fca1c5ab640 1 -- 172.21.15.47:0/2408655063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca141a7950 con 0x7fca141081a0 2024-07-24T22:17:40.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.713+0000 7fca1e95c740 1 Processor -- start 2024-07-24T22:17:40.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.713+0000 7fca0b7fe640 1 -- 172.21.15.47:0/2408655063 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fca0400f450 con 0x7fca141081a0 2024-07-24T22:17:40.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1e95c740 1 -- start start 2024-07-24T22:17:40.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1e95c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcced0 0x560ca5bcd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1e95c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcd7f0 0x560ca5bd9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1e95c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bd9780 0x560ca5bdbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1e95c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560ca5b43dd0 con 0x560ca5bcced0 2024-07-24T22:17:40.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1e95c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560ca5b332d0 con 0x560ca5bcd7f0 2024-07-24T22:17:40.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1e95c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x560ca5b37310 con 0x560ca5bd9780 2024-07-24T22:17:40.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1ab48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcced0 0x560ca5bcd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1ab48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcced0 0x560ca5bcd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43184/0 (socket says 172.21.15.47:43184) 2024-07-24T22:17:40.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1ab48640 1 -- 172.21.15.47:0/2058954988 learned_addr learned my addr 172.21.15.47:0/2058954988 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:40.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca19b46640 1 --2- 172.21.15.47:0/2058954988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bd9780 0x560ca5bdbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1a347640 1 --2- 172.21.15.47:0/2058954988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcd7f0 0x560ca5bd9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1ab48640 1 -- 172.21.15.47:0/2058954988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bd9780 msgr2=0x560ca5bdbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:40.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1ab48640 1 --2- 172.21.15.47:0/2058954988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bd9780 0x560ca5bdbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1ab48640 1 -- 172.21.15.47:0/2058954988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcd7f0 msgr2=0x560ca5bd9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:40.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1ab48640 1 --2- 172.21.15.47:0/2058954988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcd7f0 0x560ca5bd9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca1ab48640 1 -- 172.21.15.47:0/2058954988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ca5893b00 con 0x560ca5bcced0 2024-07-24T22:17:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.714+0000 7fca0b7fe640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fca000b3dc0 0x7fca000b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.715+0000 7fca1ab48640 1 --2- 172.21.15.47:0/2058954988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcced0 0x560ca5bcd2b0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00b780 tx=0x7fca0c00bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731cbb087a052847 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.715+0000 7fca1a347640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fca000b3dc0 0x7fca000b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.715+0000 7fca0b7fe640 1 -- 172.21.15.47:0/2408655063 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7fca040e4120 con 0x7fca141081a0 2024-07-24T22:17:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.715+0000 7fca08ff9640 1 -- 172.21.15.47:0/2058954988 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c00d950 con 0x560ca5bcced0 2024-07-24T22:17:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.715+0000 7fca08ff9640 1 -- 172.21.15.47:0/2058954988 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca0c014430 con 0x560ca5bcced0 2024-07-24T22:17:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.715+0000 7fca08ff9640 1 -- 172.21.15.47:0/2058954988 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c0123e0 con 0x560ca5bcced0 2024-07-24T22:17:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 -- 172.21.15.47:0/2058954988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcced0 msgr2=0x560ca5bcd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1a347640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fca000b3dc0 0x7fca000b6280 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fca1002f500 tx=0x7fca10009a20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2058954988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcced0 0x560ca5bcd2b0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00b780 tx=0x7fca0c00bc40 comp rx=0 tx=0).stop 2024-07-24T22:17:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 -- 172.21.15.47:0/2058954988 shutdown_connections 2024-07-24T22:17:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2058954988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bd9780 0x560ca5bdbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2058954988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcd7f0 0x560ca5bd9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2058954988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcced0 0x560ca5bcd2b0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 -- 172.21.15.47:0/2058954988 >> 172.21.15.47:0/2058954988 conn(0x560ca5bcad00 msgr2=0x560ca5bcbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 -- 172.21.15.47:0/2058954988 shutdown_connections 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 -- 172.21.15.47:0/2058954988 wait complete. 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 -- start start 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 Processor -- start 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcced0 0x560ca5bd6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcd7f0 0x560ca5bd6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bd9780 0x560ca5bd7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560ca5996bb0 con 0x560ca5bcd7f0 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560ca5ad5900 con 0x560ca5bd9780 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x560ca5bdc400 con 0x560ca5bcced0 2024-07-24T22:17:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.716+0000 7fca1e95c740 10 client.0 _ll_register_callbacks cb 0x560ca5b01390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:40.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca19b46640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcd7f0 0x560ca5bd6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca19b46640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcd7f0 0x560ca5bd6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43188/0 (socket says 172.21.15.47:43188) 2024-07-24T22:17:40.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca19b46640 1 -- 172.21.15.47:0/1773810340 learned_addr learned my addr 172.21.15.47:0/1773810340 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:40.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca1a347640 1 --2- 172.21.15.47:0/1773810340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcced0 0x560ca5bd6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca1ab48640 1 --2- 172.21.15.47:0/1773810340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bd9780 0x560ca5bd7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca19b46640 1 -- 172.21.15.47:0/1773810340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcced0 msgr2=0x560ca5bd6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:40.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca19b46640 1 --2- 172.21.15.47:0/1773810340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcced0 0x560ca5bd6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca19b46640 1 -- 172.21.15.47:0/1773810340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bd9780 msgr2=0x560ca5bd7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:40.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca19b46640 1 --2- 172.21.15.47:0/1773810340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bd9780 0x560ca5bd7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca19b46640 1 -- 172.21.15.47:0/1773810340 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ca590a960 con 0x560ca5bcd7f0 2024-07-24T22:17:40.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca19b46640 1 --2- 172.21.15.47:0/1773810340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcd7f0 0x560ca5bd6c50 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fca040aaaa0 tx=0x7fca0400fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2391eb4bf78451 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fc9fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fc9fdffb640 1 -- 172.21.15.47:0/1773810340 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca040ab4a0 con 0x560ca5bcd7f0 2024-07-24T22:17:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fc9fdffb640 1 -- 172.21.15.47:0/1773810340 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7fca040a7390 con 0x560ca5bcd7f0 2024-07-24T22:17:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca1e95c740 1 -- 172.21.15.47:0/1773810340 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca0c014430 con 0x560ca5bcd7f0 2024-07-24T22:17:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fc9fdffb640 1 -- 172.21.15.47:0/1773810340 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fca040aada0 con 0x560ca5bcd7f0 2024-07-24T22:17:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca1e95c740 10 client.17760 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.717+0000 7fca1e95c740 1 -- 172.21.15.47:0/1773810340 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560ca5be7ff0 con 0x560ca5bcd7f0 2024-07-24T22:17:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.718+0000 7fc9fdffb640 1 -- 172.21.15.47:0/1773810340 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca0c014430 con 0x560ca5bcd7f0 2024-07-24T22:17:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.718+0000 7fc9fdffb640 1 -- 172.21.15.47:0/1773810340 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fca040ab000 con 0x560ca5bcd7f0 2024-07-24T22:17:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.718+0000 7fca1e95c740 10 client.17760 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.718+0000 7fca1e95c740 10 client.17760 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:17:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.718+0000 7fca1e95c740 20 client.17760 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.718+0000 7fca1e95c740 1 --2- 172.21.15.47:0/1773810340 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560ca5be94b0 0x560ca5beb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.718+0000 7fca1e95c740 4 client.17760 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:17:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.718+0000 7fca1e95c740 1 -- 172.21.15.47:0/1773810340 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ca5b45d20 con 0x560ca5be94b0 2024-07-24T22:17:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.718+0000 7fca1a347640 1 --2- 172.21.15.47:0/1773810340 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560ca5be94b0 0x560ca5beb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.719+0000 7fca1a347640 1 --2- 172.21.15.47:0/1773810340 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560ca5be94b0 0x560ca5beb8a0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cec3d8ff7caadcef server_cookie=e1285f82be8f1c50 in_seq=0 out_seq=0 2024-07-24T22:17:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.719+0000 7fc9fdffb640 10 client.17760 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.719+0000 7fc9fdffb640 1 -- 172.21.15.47:0/1773810340 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ca5b45d20 con 0x560ca5be94b0 2024-07-24T22:17:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.719+0000 7fc9fdffb640 10 client.17760 handle_command_reply: tid=0 2024-07-24T22:17:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.719+0000 7fca1e95c740 1 client.17760 shutdown 2024-07-24T22:17:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.719+0000 7fca1e95c740 1 -- 172.21.15.47:0/1773810340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcd7f0 msgr2=0x560ca5bd6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.719+0000 7fca1e95c740 1 --2- 172.21.15.47:0/1773810340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcd7f0 0x560ca5bd6c50 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fca040aaaa0 tx=0x7fca0400fcc0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.720+0000 7fca1e95c740 1 -- 172.21.15.47:0/1773810340 shutdown_connections 2024-07-24T22:17:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.720+0000 7fca1e95c740 1 --2- 172.21.15.47:0/1773810340 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560ca5be94b0 0x560ca5beb8a0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.720+0000 7fca1e95c740 1 --2- 172.21.15.47:0/1773810340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bd9780 0x560ca5bd7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.720+0000 7fca1e95c740 1 --2- 172.21.15.47:0/1773810340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bcd7f0 0x560ca5bd6c50 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.720+0000 7fc9fdffb640 0 client.17760 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.720+0000 7fca1e95c740 1 --2- 172.21.15.47:0/1773810340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcced0 0x560ca5bd6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.720+0000 7fca1e95c740 1 -- 172.21.15.47:0/1773810340 >> 172.21.15.47:0/1773810340 conn(0x560ca5bcad00 msgr2=0x560ca5bd08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.720+0000 7fca1e95c740 1 -- 172.21.15.47:0/1773810340 shutdown_connections 2024-07-24T22:17:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.720+0000 7fca1e95c740 1 -- 172.21.15.47:0/1773810340 wait complete. 2024-07-24T22:17:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.720+0000 7fca1e95c740 20 client.17760 trim_cache size 0 max 16384 2024-07-24T22:17:40.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1e95c740 1 Processor -- start 2024-07-24T22:17:40.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1e95c740 1 -- start start 2024-07-24T22:17:40.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1e95c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcced0 0x560ca5bd0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1e95c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcd7f0 0x560ca5bf1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1e95c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 0x560ca5bf1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1e95c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca141ae400 con 0x560ca5bd9780 2024-07-24T22:17:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1e95c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fca141b0c60 con 0x560ca5bcced0 2024-07-24T22:17:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1e95c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fca141aea50 con 0x560ca5bcd7f0 2024-07-24T22:17:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1ab48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 0x560ca5bf1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1ab48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 0x560ca5bf1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43198/0 (socket says 172.21.15.47:43198) 2024-07-24T22:17:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1ab48640 1 -- 172.21.15.47:0/2580771698 learned_addr learned my addr 172.21.15.47:0/2580771698 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1a347640 1 --2- 172.21.15.47:0/2580771698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcced0 0x560ca5bd0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca19b46640 1 --2- 172.21.15.47:0/2580771698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcd7f0 0x560ca5bf1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1ab48640 1 -- 172.21.15.47:0/2580771698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcd7f0 msgr2=0x560ca5bf1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1ab48640 1 --2- 172.21.15.47:0/2580771698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcd7f0 0x560ca5bf1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1ab48640 1 -- 172.21.15.47:0/2580771698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcced0 msgr2=0x560ca5bd0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:40.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1ab48640 1 --2- 172.21.15.47:0/2580771698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcced0 0x560ca5bd0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.738+0000 7fca1ab48640 1 -- 172.21.15.47:0/2580771698 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ca5bcd620 con 0x560ca5bd9780 2024-07-24T22:17:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.739+0000 7fca1ab48640 1 --2- 172.21.15.47:0/2580771698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 0x560ca5bf1690 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fca0c006aa0 tx=0x7fca0c00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee34a4da4b973d23 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.739+0000 7fc9fffff640 1 -- 172.21.15.47:0/2580771698 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c028070 con 0x560ca5bd9780 2024-07-24T22:17:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.739+0000 7fc9fffff640 1 -- 172.21.15.47:0/2580771698 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca0c022b90 con 0x560ca5bd9780 2024-07-24T22:17:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.739+0000 7fc9fffff640 1 -- 172.21.15.47:0/2580771698 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c014990 con 0x560ca5bd9780 2024-07-24T22:17:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 -- 172.21.15.47:0/2580771698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 msgr2=0x560ca5bf1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2580771698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 0x560ca5bf1690 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fca0c006aa0 tx=0x7fca0c00be90 comp rx=0 tx=0).stop 2024-07-24T22:17:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 -- 172.21.15.47:0/2580771698 shutdown_connections 2024-07-24T22:17:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2580771698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 0x560ca5bf1690 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2580771698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcd7f0 0x560ca5bf1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2580771698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcced0 0x560ca5bd0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 -- 172.21.15.47:0/2580771698 >> 172.21.15.47:0/2580771698 conn(0x560ca5bcad00 msgr2=0x560ca5bd0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 -- 172.21.15.47:0/2580771698 shutdown_connections 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 -- 172.21.15.47:0/2580771698 wait complete. 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 -- start start 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 Processor -- start 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcced0 0x560ca5be1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcd7f0 0x560ca5bdd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 0x560ca5bdd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca141af120 con 0x560ca5bd9780 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fca141b0590 con 0x560ca5bcced0 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fca141af7f0 con 0x560ca5bcd7f0 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.740+0000 7fca1e95c740 10 client.0 _ll_register_callbacks cb 0x7fca0400fd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fca1ab48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 0x560ca5bdd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fca1ab48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 0x560ca5bdd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43202/0 (socket says 172.21.15.47:43202) 2024-07-24T22:17:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fca1ab48640 1 -- 172.21.15.47:0/2340490329 learned_addr learned my addr 172.21.15.47:0/2340490329 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fca19b46640 1 --2- 172.21.15.47:0/2340490329 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcd7f0 0x560ca5bdd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fca1a347640 1 --2- 172.21.15.47:0/2340490329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcced0 0x560ca5be1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fca1ab48640 1 -- 172.21.15.47:0/2340490329 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcd7f0 msgr2=0x560ca5bdd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fca1ab48640 1 --2- 172.21.15.47:0/2340490329 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcd7f0 0x560ca5bdd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fca1ab48640 1 -- 172.21.15.47:0/2340490329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcced0 msgr2=0x560ca5be1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fca1ab48640 1 --2- 172.21.15.47:0/2340490329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcced0 0x560ca5be1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fca1ab48640 1 -- 172.21.15.47:0/2340490329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ca5bddf10 con 0x560ca5bd9780 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fca1ab48640 1 --2- 172.21.15.47:0/2340490329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 0x560ca5bdd6e0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fca0c006cd0 tx=0x7fca0c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beefd4a96b29068a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fc9fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fc9fdffb640 1 -- 172.21.15.47:0/2340490329 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c028040 con 0x560ca5bd9780 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fc9fdffb640 1 -- 172.21.15.47:0/2340490329 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7fca0c014a60 con 0x560ca5bd9780 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.741+0000 7fca1e95c740 1 -- 172.21.15.47:0/2340490329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca0c022b90 con 0x560ca5bd9780 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.742+0000 7fc9fdffb640 1 -- 172.21.15.47:0/2340490329 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fca0c014c80 con 0x560ca5bd9780 2024-07-24T22:17:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.742+0000 7fca1e95c740 10 client.17766 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:40.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.742+0000 7fca1e95c740 1 -- 172.21.15.47:0/2340490329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560ca5c54160 con 0x560ca5bd9780 2024-07-24T22:17:40.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.742+0000 7fc9fdffb640 1 -- 172.21.15.47:0/2340490329 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca0c022b90 con 0x560ca5bd9780 2024-07-24T22:17:40.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.742+0000 7fc9fdffb640 1 -- 172.21.15.47:0/2340490329 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fca0c03c070 con 0x560ca5bd9780 2024-07-24T22:17:40.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.742+0000 7fca1e95c740 10 client.17766 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:40.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.742+0000 7fca1e95c740 10 client.17766 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:17:40.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.742+0000 7fca1e95c740 20 client.17766 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:40.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.742+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2340490329 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560ca5c54600 0x560ca5c56a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:40.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.742+0000 7fca1e95c740 4 client.17766 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b7c021aa", "release": true, "await": true}] 2024-07-24T22:17:40.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.742+0000 7fca1e95c740 1 -- 172.21.15.47:0/2340490329 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b7c021aa", "release": true, "await": true}) -- 0x560ca5b417c0 con 0x560ca5c54600 2024-07-24T22:17:40.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.742+0000 7fca1a347640 1 --2- 172.21.15.47:0/2340490329 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560ca5c54600 0x560ca5c56a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:40.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.743+0000 7fc9fdffb640 10 client.17766 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:40.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.743+0000 7fca1a347640 1 --2- 172.21.15.47:0/2340490329 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560ca5c54600 0x560ca5c56a20 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f51ffe283a78f96 server_cookie=6fc1b9b07006b966 in_seq=0 out_seq=0 2024-07-24T22:17:40.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fc9fdffb640 1 -- 172.21.15.47:0/2340490329 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560ca5b417c0 con 0x560ca5c54600 2024-07-24T22:17:40.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fc9fdffb640 10 client.17766 handle_command_reply: tid=0 2024-07-24T22:17:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fca1e95c740 1 client.17766 shutdown 2024-07-24T22:17:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fca1e95c740 1 -- 172.21.15.47:0/2340490329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 msgr2=0x560ca5bdd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2340490329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 0x560ca5bdd6e0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fca0c006cd0 tx=0x7fca0c00ec80 comp rx=0 tx=0).stop 2024-07-24T22:17:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fca1e95c740 1 -- 172.21.15.47:0/2340490329 shutdown_connections 2024-07-24T22:17:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2340490329 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560ca5c54600 0x560ca5c56a20 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2340490329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560ca5bd9780 0x560ca5bdd6e0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2340490329 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560ca5bcd7f0 0x560ca5bdd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fca1e95c740 1 --2- 172.21.15.47:0/2340490329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560ca5bcced0 0x560ca5be1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fca1e95c740 1 -- 172.21.15.47:0/2340490329 >> 172.21.15.47:0/2340490329 conn(0x560ca5bcad00 msgr2=0x560ca5bc9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fc9fdffb640 0 client.17766 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fca1e95c740 1 -- 172.21.15.47:0/2340490329 shutdown_connections 2024-07-24T22:17:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fca1e95c740 1 -- 172.21.15.47:0/2340490329 wait complete. 2024-07-24T22:17:40.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.745+0000 7fca1e95c740 20 client.17766 trim_cache size 0 max 16384 2024-07-24T22:17:40.751 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:17:40.751 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:17:40.751 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:17:40.751 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 32, 2024-07-24T22:17:40.751 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:17:40.751 INFO:teuthology.orchestra.run.smithi047.stdout: "b7c021aa": { 2024-07-24T22:17:40.751 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 32, 2024-07-24T22:17:40.751 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:17:40.751 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:17:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:17:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:17:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:17:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:17:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 130.0, 2024-07-24T22:17:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:17:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:17:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:17:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:17:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:17:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:17:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:17:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:17:40.753 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:17:40.753 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:17:40.753 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:17:40.753 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:17:40.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.746+0000 7fca1c5ab640 1 -- 172.21.15.47:0/2408655063 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fca000b3dc0 msgr2=0x7fca000b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:40.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.746+0000 7fca1c5ab640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fca000b3dc0 0x7fca000b6280 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fca1002f500 tx=0x7fca10009a20 comp rx=0 tx=0).stop 2024-07-24T22:17:40.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.746+0000 7fca1c5ab640 1 -- 172.21.15.47:0/2408655063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca141081a0 msgr2=0x7fca140753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.746+0000 7fca1c5ab640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca141081a0 0x7fca140753d0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fca0400c920 tx=0x7fca0400cde0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.746+0000 7fca1c5ab640 1 -- 172.21.15.47:0/2408655063 shutdown_connections 2024-07-24T22:17:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.746+0000 7fca1c5ab640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fca000b3dc0 0x7fca000b6280 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.746+0000 7fca1c5ab640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca14108b20 0x7fca14075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.746+0000 7fca1c5ab640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca141081a0 0x7fca140753d0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.746+0000 7fca1c5ab640 1 --2- 172.21.15.47:0/2408655063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca14102790 0x7fca14074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.746+0000 7fca1c5ab640 1 -- 172.21.15.47:0/2408655063 >> 172.21.15.47:0/2408655063 conn(0x7fca140fe200 msgr2=0x7fca141005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.746+0000 7fca1c5ab640 1 -- 172.21.15.47:0/2408655063 shutdown_connections 2024-07-24T22:17:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:40.746+0000 7fca1c5ab640 1 -- 172.21.15.47:0/2408655063 wait complete. 2024-07-24T22:17:41.448 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b7c021aa', total seconds elapsed: 15.8 2024-07-24T22:17:42.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:41 smithi188 ceph-mon[37380]: pgmap v690: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 918 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:17:42.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:41 smithi183 ceph-mon[37007]: pgmap v690: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 918 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:17:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:41 smithi047 ceph-mon[32551]: pgmap v690: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 918 B/s rd, 0 B/s wr, 1 op/s 2024-07-24T22:17:44.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:43 smithi188 ceph-mon[37380]: pgmap v691: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:44.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:43 smithi183 ceph-mon[37007]: pgmap v691: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:44.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:43 smithi047 ceph-mon[32551]: pgmap v691: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:46.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:45 smithi188 ceph-mon[37380]: pgmap v692: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:46.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:45 smithi183 ceph-mon[37007]: pgmap v692: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:46.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:45 smithi047 ceph-mon[32551]: pgmap v692: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:48.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:47 smithi188 ceph-mon[37380]: pgmap v693: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:48.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:47 smithi183 ceph-mon[37007]: pgmap v693: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:48.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:47 smithi047 ceph-mon[32551]: pgmap v693: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:49.528 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:17:49.809 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:17:49.932 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:49 smithi047 ceph-mon[32551]: pgmap v694: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:50.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:49 smithi188 ceph-mon[37380]: pgmap v694: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:50.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:49 smithi183 ceph-mon[37007]: pgmap v694: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.927+0000 7fe259f4b640 1 -- 172.21.15.47:0/439308295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe254101590 msgr2=0x7fe254101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.927+0000 7fe259f4b640 1 --2- 172.21.15.47:0/439308295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe254101590 0x7fe254101970 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fe244009900 tx=0x7fe24402a410 comp rx=0 tx=0).stop 2024-07-24T22:17:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.927+0000 7fe259f4b640 1 -- 172.21.15.47:0/439308295 shutdown_connections 2024-07-24T22:17:50.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.927+0000 7fe259f4b640 1 --2- 172.21.15.47:0/439308295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe254107910 0x7fe25410e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.927+0000 7fe259f4b640 1 --2- 172.21.15.47:0/439308295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe254106f90 0x7fe2541073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.927+0000 7fe259f4b640 1 --2- 172.21.15.47:0/439308295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe254101590 0x7fe254101970 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.927+0000 7fe259f4b640 1 -- 172.21.15.47:0/439308295 >> 172.21.15.47:0/439308295 conn(0x7fe2540fd010 msgr2=0x7fe2540ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:50.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.928+0000 7fe259f4b640 1 -- 172.21.15.47:0/439308295 shutdown_connections 2024-07-24T22:17:50.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.928+0000 7fe259f4b640 1 -- 172.21.15.47:0/439308295 wait complete. 2024-07-24T22:17:50.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.928+0000 7fe259f4b640 1 Processor -- start 2024-07-24T22:17:50.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.928+0000 7fe259f4b640 1 -- start start 2024-07-24T22:17:50.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe259f4b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe254101590 0x7fe254198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe259f4b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe254106f90 0x7fe254199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe259f4b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe254107910 0x7fe25419e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe259f4b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe254111540 con 0x7fe254107910 2024-07-24T22:17:50.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe259f4b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541113c0 con 0x7fe254106f90 2024-07-24T22:17:50.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe259f4b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541116c0 con 0x7fe254101590 2024-07-24T22:17:50.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe253fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe254107910 0x7fe25419e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe253fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe254107910 0x7fe25419e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49324/0 (socket says 172.21.15.47:49324) 2024-07-24T22:17:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe253fff640 1 -- 172.21.15.47:0/2738503503 learned_addr learned my addr 172.21.15.47:0/2738503503 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe252ffd640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe254106f90 0x7fe254199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe2537fe640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe254101590 0x7fe254198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe253fff640 1 -- 172.21.15.47:0/2738503503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe254101590 msgr2=0x7fe254198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe253fff640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe254101590 0x7fe254198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe253fff640 1 -- 172.21.15.47:0/2738503503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe254106f90 msgr2=0x7fe254199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe253fff640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe254106f90 0x7fe254199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe253fff640 1 -- 172.21.15.47:0/2738503503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25419ed90 con 0x7fe254107910 2024-07-24T22:17:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe2537fe640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe254101590 0x7fe254198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:17:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe253fff640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe254107910 0x7fe25419e5c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009fd0 tx=0x7fe24c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.929+0000 7fe250ff9640 1 -- 172.21.15.47:0/2738503503 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c017070 con 0x7fe254107910 2024-07-24T22:17:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.930+0000 7fe250ff9640 1 -- 172.21.15.47:0/2738503503 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe24c003e20 con 0x7fe254107910 2024-07-24T22:17:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.930+0000 7fe259f4b640 1 -- 172.21.15.47:0/2738503503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25419f080 con 0x7fe254107910 2024-07-24T22:17:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.930+0000 7fe250ff9640 1 -- 172.21.15.47:0/2738503503 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c010460 con 0x7fe254107910 2024-07-24T22:17:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.930+0000 7fe259f4b640 1 -- 172.21.15.47:0/2738503503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2541a5740 con 0x7fe254107910 2024-07-24T22:17:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.932+0000 7fe25cd7b740 1 Processor -- start 2024-07-24T22:17:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.932+0000 7fe250ff9640 1 -- 172.21.15.47:0/2738503503 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe24c003970 con 0x7fe254107910 2024-07-24T22:17:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.932+0000 7fe25cd7b740 1 -- start start 2024-07-24T22:17:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe25cd7b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a607c90 0x55e17a608070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe25cd7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 0x55e17a614000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe25cd7b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a614540 0x55e17a616930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe25cd7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e17a57d280 con 0x55e17a6085b0 2024-07-24T22:17:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe25cd7b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e17a56c780 con 0x55e17a614540 2024-07-24T22:17:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe25cd7b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e17a5707c0 con 0x55e17a607c90 2024-07-24T22:17:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe2537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 0x55e17a614000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe2537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 0x55e17a614000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49334/0 (socket says 172.21.15.47:49334) 2024-07-24T22:17:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe2537fe640 1 -- 172.21.15.47:0/545819833 learned_addr learned my addr 172.21.15.47:0/545819833 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe252ffd640 1 --2- 172.21.15.47:0/545819833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a607c90 0x55e17a608070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe252ffd640 1 --2- 172.21.15.47:0/545819833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a614540 0x55e17a616930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe2537fe640 1 -- 172.21.15.47:0/545819833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a607c90 msgr2=0x55e17a608070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:50.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe2537fe640 1 --2- 172.21.15.47:0/545819833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a607c90 0x55e17a608070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe2537fe640 1 -- 172.21.15.47:0/545819833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a614540 msgr2=0x55e17a616930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:50.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe2537fe640 1 --2- 172.21.15.47:0/545819833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a614540 0x55e17a616930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe2537fe640 1 -- 172.21.15.47:0/545819833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e17a2d0790 con 0x55e17a6085b0 2024-07-24T22:17:50.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe252ffd640 1 --2- 172.21.15.47:0/545819833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a607c90 0x55e17a608070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:17:50.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe250ff9640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe23c0b3d40 0x7fe23c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe2537fe640 1 --2- 172.21.15.47:0/545819833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 0x55e17a614000 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe244009900 tx=0x7fe244032c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14840feb82527345 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.933+0000 7fe252ffd640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe23c0b3d40 0x7fe23c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.934+0000 7fe250ff9640 1 -- 172.21.15.47:0/2738503503 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7fe24c0e3d90 con 0x7fe254107910 2024-07-24T22:17:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.934+0000 7fe239ffb640 1 -- 172.21.15.47:0/545819833 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24403f070 con 0x55e17a6085b0 2024-07-24T22:17:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.934+0000 7fe239ffb640 1 -- 172.21.15.47:0/545819833 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe244032e10 con 0x55e17a6085b0 2024-07-24T22:17:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.934+0000 7fe239ffb640 1 -- 172.21.15.47:0/545819833 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244035070 con 0x55e17a6085b0 2024-07-24T22:17:50.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.934+0000 7fe25cd7b740 1 -- 172.21.15.47:0/545819833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 msgr2=0x55e17a614000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:50.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.934+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/545819833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 0x55e17a614000 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe244009900 tx=0x7fe244032c20 comp rx=0 tx=0).stop 2024-07-24T22:17:50.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.934+0000 7fe252ffd640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe23c0b3d40 0x7fe23c0b6200 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe254100ad0 tx=0x7fe248005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:50.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.934+0000 7fe25cd7b740 1 -- 172.21.15.47:0/545819833 shutdown_connections 2024-07-24T22:17:50.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.934+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/545819833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a614540 0x55e17a616930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.934+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/545819833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 0x55e17a614000 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.934+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/545819833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a607c90 0x55e17a608070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.934+0000 7fe25cd7b740 1 -- 172.21.15.47:0/545819833 >> 172.21.15.47:0/545819833 conn(0x55e17a605ac0 msgr2=0x55e17a606c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:50.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.934+0000 7fe25cd7b740 1 -- 172.21.15.47:0/545819833 shutdown_connections 2024-07-24T22:17:50.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.935+0000 7fe25cd7b740 1 -- 172.21.15.47:0/545819833 wait complete. 2024-07-24T22:17:50.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.935+0000 7fe25cd7b740 1 -- start start 2024-07-24T22:17:50.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.935+0000 7fe25cd7b740 1 Processor -- start 2024-07-24T22:17:50.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.935+0000 7fe25cd7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a607c90 0x55e17a613c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.935+0000 7fe25cd7b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a6085b0 0x55e17a6110e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.935+0000 7fe25cd7b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a614540 0x55e17a611620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.935+0000 7fe25cd7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e17a4a6ab0 con 0x55e17a607c90 2024-07-24T22:17:50.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.935+0000 7fe25cd7b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e17a4f49e0 con 0x55e17a6085b0 2024-07-24T22:17:50.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.935+0000 7fe25cd7b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e17a6171c0 con 0x55e17a614540 2024-07-24T22:17:50.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe25cd7b740 10 client.0 _ll_register_callbacks cb 0x55e17a27ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:50.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe2537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a607c90 0x55e17a613c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe2537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a607c90 0x55e17a613c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49342/0 (socket says 172.21.15.47:49342) 2024-07-24T22:17:50.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe2537fe640 1 -- 172.21.15.47:0/517054579 learned_addr learned my addr 172.21.15.47:0/517054579 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:50.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe252ffd640 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a6085b0 0x55e17a6110e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe253fff640 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a614540 0x55e17a611620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe2537fe640 1 -- 172.21.15.47:0/517054579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a614540 msgr2=0x55e17a611620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:50.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe2537fe640 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a614540 0x55e17a611620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe2537fe640 1 -- 172.21.15.47:0/517054579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a6085b0 msgr2=0x55e17a6110e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:50.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe2537fe640 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a6085b0 0x55e17a6110e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe2537fe640 1 -- 172.21.15.47:0/517054579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e17a349620 con 0x55e17a607c90 2024-07-24T22:17:50.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe252ffd640 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a6085b0 0x55e17a6110e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:17:50.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe2537fe640 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a607c90 0x55e17a613c00 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe244000c00 tx=0x7fe244031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c1651a0ea5436b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:50.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe232ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:50.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe232ffd640 1 -- 172.21.15.47:0/517054579 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24404b060 con 0x55e17a607c90 2024-07-24T22:17:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe232ffd640 1 -- 172.21.15.47:0/517054579 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7fe244004440 con 0x55e17a607c90 2024-07-24T22:17:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.936+0000 7fe25cd7b740 1 -- 172.21.15.47:0/517054579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e17a51bce0 con 0x55e17a607c90 2024-07-24T22:17:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.937+0000 7fe232ffd640 1 -- 172.21.15.47:0/517054579 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe24403f030 con 0x55e17a607c90 2024-07-24T22:17:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.937+0000 7fe25cd7b740 10 client.17778 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.937+0000 7fe25cd7b740 1 -- 172.21.15.47:0/517054579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e17a622900 con 0x55e17a607c90 2024-07-24T22:17:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.937+0000 7fe232ffd640 1 -- 172.21.15.47:0/517054579 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e17a51bce0 con 0x55e17a607c90 2024-07-24T22:17:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.937+0000 7fe232ffd640 1 -- 172.21.15.47:0/517054579 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe2440048f0 con 0x55e17a607c90 2024-07-24T22:17:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.937+0000 7fe25cd7b740 10 client.17778 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.937+0000 7fe25cd7b740 10 client.17778 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.937+0000 7fe25cd7b740 20 client.17778 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.937+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e17a623c50 0x55e17a626040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.937+0000 7fe25cd7b740 4 client.17778 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:17:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.937+0000 7fe25cd7b740 1 -- 172.21.15.47:0/517054579 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e17a57f1d0 con 0x55e17a623c50 2024-07-24T22:17:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.938+0000 7fe252ffd640 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e17a623c50 0x55e17a626040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.938+0000 7fe232ffd640 10 client.17778 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.938+0000 7fe252ffd640 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e17a623c50 0x55e17a626040 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0a40d85625ab001 server_cookie=576155e09116149f in_seq=0 out_seq=0 2024-07-24T22:17:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe232ffd640 1 -- 172.21.15.47:0/517054579 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e17a57f1d0 con 0x55e17a623c50 2024-07-24T22:17:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe232ffd640 10 client.17778 handle_command_reply: tid=0 2024-07-24T22:17:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe25cd7b740 1 client.17778 shutdown 2024-07-24T22:17:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe25cd7b740 1 -- 172.21.15.47:0/517054579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a607c90 msgr2=0x55e17a613c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a607c90 0x55e17a613c00 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe244000c00 tx=0x7fe244031750 comp rx=0 tx=0).stop 2024-07-24T22:17:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe25cd7b740 1 -- 172.21.15.47:0/517054579 shutdown_connections 2024-07-24T22:17:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e17a623c50 0x55e17a626040 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a614540 0x55e17a611620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a6085b0 0x55e17a6110e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe232ffd640 0 client.17778 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/517054579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a607c90 0x55e17a613c00 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe25cd7b740 1 -- 172.21.15.47:0/517054579 >> 172.21.15.47:0/517054579 conn(0x55e17a605ac0 msgr2=0x55e17a60b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe25cd7b740 1 -- 172.21.15.47:0/517054579 shutdown_connections 2024-07-24T22:17:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe25cd7b740 1 -- 172.21.15.47:0/517054579 wait complete. 2024-07-24T22:17:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.939+0000 7fe25cd7b740 20 client.17778 trim_cache size 0 max 16384 2024-07-24T22:17:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.954+0000 7fe25cd7b740 1 Processor -- start 2024-07-24T22:17:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe25cd7b740 1 -- start start 2024-07-24T22:17:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe25cd7b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a607c90 0x55e17a620310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe25cd7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 0x55e17a607220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe25cd7b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a614540 0x55e17a62b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe25cd7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541ac100 con 0x55e17a6085b0 2024-07-24T22:17:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe25cd7b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541ae960 con 0x55e17a607c90 2024-07-24T22:17:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe25cd7b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541ac750 con 0x55e17a614540 2024-07-24T22:17:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe252ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 0x55e17a607220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe252ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 0x55e17a607220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49346/0 (socket says 172.21.15.47:49346) 2024-07-24T22:17:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe252ffd640 1 -- 172.21.15.47:0/433059503 learned_addr learned my addr 172.21.15.47:0/433059503 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe253fff640 1 --2- 172.21.15.47:0/433059503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a614540 0x55e17a62b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe2537fe640 1 --2- 172.21.15.47:0/433059503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a607c90 0x55e17a620310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe252ffd640 1 -- 172.21.15.47:0/433059503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a614540 msgr2=0x55e17a62b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe252ffd640 1 --2- 172.21.15.47:0/433059503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a614540 0x55e17a62b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe252ffd640 1 -- 172.21.15.47:0/433059503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a607c90 msgr2=0x55e17a620310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe252ffd640 1 --2- 172.21.15.47:0/433059503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a607c90 0x55e17a620310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe252ffd640 1 -- 172.21.15.47:0/433059503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e17a6083e0 con 0x55e17a6085b0 2024-07-24T22:17:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.955+0000 7fe252ffd640 1 --2- 172.21.15.47:0/433059503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 0x55e17a607220 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe248009730 tx=0x7fe248004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a3fe0bb8690046 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:50.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.956+0000 7fe2397fa640 1 -- 172.21.15.47:0/433059503 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248003c40 con 0x55e17a6085b0 2024-07-24T22:17:50.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.956+0000 7fe2397fa640 1 -- 172.21.15.47:0/433059503 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe248003de0 con 0x55e17a6085b0 2024-07-24T22:17:50.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.956+0000 7fe2397fa640 1 -- 172.21.15.47:0/433059503 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248004d90 con 0x55e17a6085b0 2024-07-24T22:17:50.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.956+0000 7fe25cd7b740 1 -- 172.21.15.47:0/433059503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 msgr2=0x55e17a607220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:50.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.956+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/433059503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 0x55e17a607220 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe248009730 tx=0x7fe248004730 comp rx=0 tx=0).stop 2024-07-24T22:17:50.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.956+0000 7fe25cd7b740 1 -- 172.21.15.47:0/433059503 shutdown_connections 2024-07-24T22:17:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.956+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/433059503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a614540 0x55e17a62b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.956+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/433059503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a6085b0 0x55e17a607220 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.956+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/433059503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a607c90 0x55e17a620310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.956+0000 7fe25cd7b740 1 -- 172.21.15.47:0/433059503 >> 172.21.15.47:0/433059503 conn(0x55e17a605ac0 msgr2=0x55e17a606b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.956+0000 7fe25cd7b740 1 -- 172.21.15.47:0/433059503 shutdown_connections 2024-07-24T22:17:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.956+0000 7fe25cd7b740 1 -- 172.21.15.47:0/433059503 wait complete. 2024-07-24T22:17:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe25cd7b740 1 -- start start 2024-07-24T22:17:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe25cd7b740 1 Processor -- start 2024-07-24T22:17:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe25cd7b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a607c90 0x55e17a617610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe25cd7b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a6085b0 0x55e17a617b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe25cd7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a614540 0x55e17a68c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe25cd7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541ace20 con 0x55e17a614540 2024-07-24T22:17:50.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe25cd7b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541ae290 con 0x55e17a6085b0 2024-07-24T22:17:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe25cd7b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541ad4f0 con 0x55e17a607c90 2024-07-24T22:17:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe25cd7b740 10 client.0 _ll_register_callbacks cb 0x7fe244009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe253fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a614540 0x55e17a68c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe253fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a614540 0x55e17a68c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49360/0 (socket says 172.21.15.47:49360) 2024-07-24T22:17:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe253fff640 1 -- 172.21.15.47:0/1536441764 learned_addr learned my addr 172.21.15.47:0/1536441764 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe252ffd640 1 --2- 172.21.15.47:0/1536441764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a6085b0 0x55e17a617b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.957+0000 7fe2537fe640 1 --2- 172.21.15.47:0/1536441764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a607c90 0x55e17a617610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe253fff640 1 -- 172.21.15.47:0/1536441764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a607c90 msgr2=0x55e17a617610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe253fff640 1 --2- 172.21.15.47:0/1536441764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a607c90 0x55e17a617610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe253fff640 1 -- 172.21.15.47:0/1536441764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a6085b0 msgr2=0x55e17a617b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe253fff640 1 --2- 172.21.15.47:0/1536441764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a6085b0 0x55e17a617b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe253fff640 1 -- 172.21.15.47:0/1536441764 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e17a68cbc0 con 0x55e17a614540 2024-07-24T22:17:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe253fff640 1 --2- 172.21.15.47:0/1536441764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a614540 0x55e17a68c680 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0aa900 tx=0x7fe24c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a687097d3cf1326 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe232ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe232ffd640 1 -- 172.21.15.47:0/1536441764 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c020040 con 0x55e17a614540 2024-07-24T22:17:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe232ffd640 1 -- 172.21.15.47:0/1536441764 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7fe24c0a6c00 con 0x55e17a614540 2024-07-24T22:17:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe25cd7b740 1 -- 172.21.15.47:0/1536441764 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe248003de0 con 0x55e17a614540 2024-07-24T22:17:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe232ffd640 1 -- 172.21.15.47:0/1536441764 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe24c003c60 con 0x55e17a614540 2024-07-24T22:17:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe25cd7b740 10 client.17784 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe25cd7b740 1 -- 172.21.15.47:0/1536441764 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e17a68dd30 con 0x55e17a614540 2024-07-24T22:17:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe232ffd640 1 -- 172.21.15.47:0/1536441764 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe248003de0 con 0x55e17a614540 2024-07-24T22:17:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe232ffd640 1 -- 172.21.15.47:0/1536441764 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe24c0a62e0 con 0x55e17a614540 2024-07-24T22:17:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe25cd7b740 10 client.17784 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.958+0000 7fe25cd7b740 10 client.17784 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.959+0000 7fe25cd7b740 20 client.17784 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.959+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/1536441764 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e17a68e3d0 0x55e17a6907f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.959+0000 7fe25cd7b740 4 client.17784 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:17:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.959+0000 7fe25cd7b740 1 -- 172.21.15.47:0/1536441764 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e17a57ac70 con 0x55e17a68e3d0 2024-07-24T22:17:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.959+0000 7fe2537fe640 1 --2- 172.21.15.47:0/1536441764 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e17a68e3d0 0x55e17a6907f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.959+0000 7fe2537fe640 1 --2- 172.21.15.47:0/1536441764 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e17a68e3d0 0x55e17a6907f0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=507033bdaaea4662 server_cookie=4e25de8df7d655ce in_seq=0 out_seq=0 2024-07-24T22:17:50.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.959+0000 7fe232ffd640 10 client.17784 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:50.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.963+0000 7fe232ffd640 1 -- 172.21.15.47:0/1536441764 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e17a57ac70 con 0x55e17a68e3d0 2024-07-24T22:17:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.963+0000 7fe232ffd640 10 client.17784 handle_command_reply: tid=0 2024-07-24T22:17:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.963+0000 7fe25cd7b740 1 client.17784 shutdown 2024-07-24T22:17:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe25cd7b740 1 -- 172.21.15.47:0/1536441764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a614540 msgr2=0x55e17a68c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/1536441764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a614540 0x55e17a68c680 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0aa900 tx=0x7fe24c0042e0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe25cd7b740 1 -- 172.21.15.47:0/1536441764 shutdown_connections 2024-07-24T22:17:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/1536441764 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55e17a68e3d0 0x55e17a6907f0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/1536441764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e17a614540 0x55e17a68c680 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/1536441764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e17a6085b0 0x55e17a617b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe232ffd640 0 client.17784 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe25cd7b740 1 --2- 172.21.15.47:0/1536441764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e17a607c90 0x55e17a617610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe25cd7b740 1 -- 172.21.15.47:0/1536441764 >> 172.21.15.47:0/1536441764 conn(0x55e17a605ac0 msgr2=0x55e17a60bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe25cd7b740 1 -- 172.21.15.47:0/1536441764 shutdown_connections 2024-07-24T22:17:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe25cd7b740 1 -- 172.21.15.47:0/1536441764 wait complete. 2024-07-24T22:17:50.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe25cd7b740 20 client.17784 trim_cache size 0 max 16384 2024-07-24T22:17:50.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:17:50.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:17:50.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:17:50.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:17:50.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe259f4b640 1 -- 172.21.15.47:0/2738503503 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe23c0b3d40 msgr2=0x7fe23c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:50.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe259f4b640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe23c0b3d40 0x7fe23c0b6200 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe254100ad0 tx=0x7fe248005f90 comp rx=0 tx=0).stop 2024-07-24T22:17:50.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe259f4b640 1 -- 172.21.15.47:0/2738503503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe254107910 msgr2=0x7fe25419e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:50.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.964+0000 7fe259f4b640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe254107910 0x7fe25419e5c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009fd0 tx=0x7fe24c00b260 comp rx=0 tx=0).stop 2024-07-24T22:17:50.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.965+0000 7fe259f4b640 1 -- 172.21.15.47:0/2738503503 shutdown_connections 2024-07-24T22:17:50.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.965+0000 7fe259f4b640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe23c0b3d40 0x7fe23c0b6200 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.965+0000 7fe259f4b640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe254107910 0x7fe25419e5c0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.965+0000 7fe259f4b640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe254106f90 0x7fe254199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.965+0000 7fe259f4b640 1 --2- 172.21.15.47:0/2738503503 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe254101590 0x7fe254198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:50.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.965+0000 7fe259f4b640 1 -- 172.21.15.47:0/2738503503 >> 172.21.15.47:0/2738503503 conn(0x7fe2540fd010 msgr2=0x7fe2541034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:50.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.965+0000 7fe259f4b640 1 -- 172.21.15.47:0/2738503503 shutdown_connections 2024-07-24T22:17:50.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:17:50.965+0000 7fe259f4b640 1 -- 172.21.15.47:0/2738503503 wait complete. 2024-07-24T22:17:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.568+0000 7fab838dc640 1 -- 172.21.15.47:0/1915055758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab7c102790 msgr2=0x7fab7c102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.568+0000 7fab838dc640 1 --2- 172.21.15.47:0/1915055758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab7c102790 0x7fab7c102b70 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fab74009900 tx=0x7fab7402a410 comp rx=0 tx=0).stop 2024-07-24T22:17:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.568+0000 7fab838dc640 1 -- 172.21.15.47:0/1915055758 shutdown_connections 2024-07-24T22:17:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.568+0000 7fab838dc640 1 --2- 172.21.15.47:0/1915055758 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab7c108b20 0x7fab7c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.568+0000 7fab838dc640 1 --2- 172.21.15.47:0/1915055758 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab7c1081a0 0x7fab7c1085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.568+0000 7fab838dc640 1 --2- 172.21.15.47:0/1915055758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab7c102790 0x7fab7c102b70 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.568+0000 7fab838dc640 1 -- 172.21.15.47:0/1915055758 >> 172.21.15.47:0/1915055758 conn(0x7fab7c0fe200 msgr2=0x7fab7c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.568+0000 7fab838dc640 1 -- 172.21.15.47:0/1915055758 shutdown_connections 2024-07-24T22:17:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.568+0000 7fab838dc640 1 -- 172.21.15.47:0/1915055758 wait complete. 2024-07-24T22:17:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.569+0000 7fab838dc640 1 Processor -- start 2024-07-24T22:17:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.569+0000 7fab838dc640 1 -- start start 2024-07-24T22:17:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.569+0000 7fab838dc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab7c102790 0x7fab7c198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.569+0000 7fab838dc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab7c1081a0 0x7fab7c199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.569+0000 7fab838dc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab7c108b20 0x7fab7c19e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.569+0000 7fab838dc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c112720 con 0x7fab7c102790 2024-07-24T22:17:51.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.569+0000 7fab838dc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1125a0 con 0x7fab7c108b20 2024-07-24T22:17:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.569+0000 7fab838dc640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1128a0 con 0x7fab7c1081a0 2024-07-24T22:17:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.569+0000 7fab81678640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab7c102790 0x7fab7c198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.569+0000 7fab81678640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab7c102790 0x7fab7c198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49368/0 (socket says 172.21.15.47:49368) 2024-07-24T22:17:51.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.569+0000 7fab81678640 1 -- 172.21.15.47:0/3197582449 learned_addr learned my addr 172.21.15.47:0/3197582449 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:51.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab81e79640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab7c108b20 0x7fab7c19e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab80e77640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab7c1081a0 0x7fab7c199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab81678640 1 -- 172.21.15.47:0/3197582449 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab7c1081a0 msgr2=0x7fab7c199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:51.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab81678640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab7c1081a0 0x7fab7c199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab81678640 1 -- 172.21.15.47:0/3197582449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab7c108b20 msgr2=0x7fab7c19e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:51.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab81678640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab7c108b20 0x7fab7c19e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab81678640 1 -- 172.21.15.47:0/3197582449 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c19eca0 con 0x7fab7c102790 2024-07-24T22:17:51.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab81e79640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab7c108b20 0x7fab7c19e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:17:51.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab80e77640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab7c1081a0 0x7fab7c199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:17:51.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab81678640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab7c102790 0x7fab7c198bf0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fab74005940 tx=0x7fab740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:51.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab7a7fc640 1 -- 172.21.15.47:0/3197582449 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7403f030 con 0x7fab7c102790 2024-07-24T22:17:51.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab7a7fc640 1 -- 172.21.15.47:0/3197582449 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab74003cb0 con 0x7fab7c102790 2024-07-24T22:17:51.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab838dc640 1 -- 172.21.15.47:0/3197582449 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7c19ef30 con 0x7fab7c102790 2024-07-24T22:17:51.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab7a7fc640 1 -- 172.21.15.47:0/3197582449 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74035070 con 0x7fab7c102790 2024-07-24T22:17:51.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.570+0000 7fab838dc640 1 -- 172.21.15.47:0/3197582449 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab7c1a5650 con 0x7fab7c102790 2024-07-24T22:17:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.573+0000 7fab7a7fc640 1 -- 172.21.15.47:0/3197582449 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fab74042030 con 0x7fab7c102790 2024-07-24T22:17:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.573+0000 7fab85c8d740 1 Processor -- start 2024-07-24T22:17:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.573+0000 7fab85c8d740 1 -- start start 2024-07-24T22:17:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.573+0000 7fab85c8d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4c2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.573+0000 7fab85c8d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4d2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.573+0000 7fab85c8d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.573+0000 7fab85c8d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cb9b439990 con 0x55cb9b4d3370 2024-07-24T22:17:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.573+0000 7fab85c8d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cb9b428e90 con 0x55cb9b4c26b0 2024-07-24T22:17:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.573+0000 7fab85c8d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55cb9b42ced0 con 0x55cb9b4c2fd0 2024-07-24T22:17:51.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab80e77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab81e79640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4c2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab80e77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49380/0 (socket says 172.21.15.47:49380) 2024-07-24T22:17:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab80e77640 1 -- 172.21.15.47:0/3389336666 learned_addr learned my addr 172.21.15.47:0/3389336666 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab81e79640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4c2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:40352/0 (socket says 172.21.15.47:40352) 2024-07-24T22:17:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab81678640 1 --2- 172.21.15.47:0/3389336666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4d2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab80e77640 1 -- 172.21.15.47:0/3389336666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c2fd0 msgr2=0x55cb9b4d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab80e77640 1 --2- 172.21.15.47:0/3389336666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4d2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab80e77640 1 -- 172.21.15.47:0/3389336666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 msgr2=0x55cb9b4c2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab80e77640 1 --2- 172.21.15.47:0/3389336666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4c2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab80e77640 1 -- 172.21.15.47:0/3389336666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9b3b2300 con 0x55cb9b4d3370 2024-07-24T22:17:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab7a7fc640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fab640b3dc0 0x7fab640b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab80e77640 1 --2- 172.21.15.47:0/3389336666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d5760 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fab7000bd60 tx=0x7fab7000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e729196adaf879 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:51.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab81e79640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fab640b3dc0 0x7fab640b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab7a7fc640 1 -- 172.21.15.47:0/3197582449 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7fab74104550 con 0x7fab7c102790 2024-07-24T22:17:51.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.574+0000 7fab637fe640 1 -- 172.21.15.47:0/3389336666 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70005020 con 0x55cb9b4d3370 2024-07-24T22:17:51.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.575+0000 7fab637fe640 1 -- 172.21.15.47:0/3389336666 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab700047a0 con 0x55cb9b4d3370 2024-07-24T22:17:51.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.575+0000 7fab637fe640 1 -- 172.21.15.47:0/3389336666 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab700116a0 con 0x55cb9b4d3370 2024-07-24T22:17:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.575+0000 7fab85c8d740 1 -- 172.21.15.47:0/3389336666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 msgr2=0x55cb9b4d5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.575+0000 7fab81e79640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fab640b3dc0 0x7fab640b6280 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fab6c007f10 tx=0x7fab6c0076a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.575+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3389336666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d5760 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fab7000bd60 tx=0x7fab7000f730 comp rx=0 tx=0).stop 2024-07-24T22:17:51.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.575+0000 7fab85c8d740 1 -- 172.21.15.47:0/3389336666 shutdown_connections 2024-07-24T22:17:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.575+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3389336666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d5760 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.575+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3389336666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4d2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.575+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3389336666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4c2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.575+0000 7fab85c8d740 1 -- 172.21.15.47:0/3389336666 >> 172.21.15.47:0/3389336666 conn(0x55cb9b4c04e0 msgr2=0x55cb9b4c1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.575+0000 7fab85c8d740 1 -- 172.21.15.47:0/3389336666 shutdown_connections 2024-07-24T22:17:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.575+0000 7fab85c8d740 1 -- 172.21.15.47:0/3389336666 wait complete. 2024-07-24T22:17:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.576+0000 7fab85c8d740 1 -- start start 2024-07-24T22:17:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.576+0000 7fab85c8d740 1 Processor -- start 2024-07-24T22:17:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.576+0000 7fab85c8d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.576+0000 7fab85c8d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.576+0000 7fab85c8d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.576+0000 7fab85c8d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cb9b28c700 con 0x55cb9b4d3370 2024-07-24T22:17:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.576+0000 7fab85c8d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cb9b3cb5d0 con 0x55cb9b4c2fd0 2024-07-24T22:17:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.576+0000 7fab85c8d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55cb9b4d6020 con 0x55cb9b4c26b0 2024-07-24T22:17:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.576+0000 7fab85c8d740 10 client.0 _ll_register_callbacks cb 0x55cb9b3eb940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.576+0000 7fab81e79640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab81e79640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49390/0 (socket says 172.21.15.47:49390) 2024-07-24T22:17:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab81e79640 1 -- 172.21.15.47:0/3163470738 learned_addr learned my addr 172.21.15.47:0/3163470738 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab81678640 1 --2- 172.21.15.47:0/3163470738 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab80e77640 1 --2- 172.21.15.47:0/3163470738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab81e79640 1 -- 172.21.15.47:0/3163470738 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c26b0 msgr2=0x55cb9b4d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab81e79640 1 --2- 172.21.15.47:0/3163470738 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab81e79640 1 -- 172.21.15.47:0/3163470738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c2fd0 msgr2=0x55cb9b4d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:51.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab81e79640 1 --2- 172.21.15.47:0/3163470738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab81e79640 1 -- 172.21.15.47:0/3163470738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb9b3be660 con 0x55cb9b4d3370 2024-07-24T22:17:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab81e79640 1 --2- 172.21.15.47:0/3163470738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d0d60 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00ed60 tx=0x7fab6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c76b7299a35ac2 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab60ff9640 1 -- 172.21.15.47:0/3163470738 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c01cd30 con 0x55cb9b4d3370 2024-07-24T22:17:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab85c8d740 1 -- 172.21.15.47:0/3163470738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab700047a0 con 0x55cb9b4d3370 2024-07-24T22:17:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab60ff9640 1 -- 172.21.15.47:0/3163470738 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7fab6c028480 con 0x55cb9b4d3370 2024-07-24T22:17:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab60ff9640 1 -- 172.21.15.47:0/3163470738 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fab6c0286c0 con 0x55cb9b4d3370 2024-07-24T22:17:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab85c8d740 10 client.17796 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.577+0000 7fab85c8d740 1 -- 172.21.15.47:0/3163470738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cb9b189650 con 0x55cb9b4d3370 2024-07-24T22:17:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.578+0000 7fab60ff9640 1 -- 172.21.15.47:0/3163470738 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab700047a0 con 0x55cb9b4d3370 2024-07-24T22:17:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.578+0000 7fab60ff9640 1 -- 172.21.15.47:0/3163470738 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fab6c02f070 con 0x55cb9b4d3370 2024-07-24T22:17:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.578+0000 7fab85c8d740 10 client.17796 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:51.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.578+0000 7fab85c8d740 10 client.17796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.578+0000 7fab85c8d740 20 client.17796 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.578+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3163470738 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cb9b4e2fa0 0x55cb9b4e53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.578+0000 7fab85c8d740 4 client.17796 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:17:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.578+0000 7fab85c8d740 1 -- 172.21.15.47:0/3163470738 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb9b43b8e0 con 0x55cb9b4e2fa0 2024-07-24T22:17:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.578+0000 7fab81678640 1 --2- 172.21.15.47:0/3163470738 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cb9b4e2fa0 0x55cb9b4e53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.579+0000 7fab81678640 1 --2- 172.21.15.47:0/3163470738 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cb9b4e2fa0 0x55cb9b4e53e0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd1ecdc60e373020 server_cookie=6de4d49bdcf30210 in_seq=0 out_seq=0 2024-07-24T22:17:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.579+0000 7fab60ff9640 10 client.17796 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.579+0000 7fab60ff9640 1 -- 172.21.15.47:0/3163470738 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb9b43b8e0 con 0x55cb9b4e2fa0 2024-07-24T22:17:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.579+0000 7fab60ff9640 10 client.17796 handle_command_reply: tid=0 2024-07-24T22:17:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.579+0000 7fab85c8d740 1 client.17796 shutdown 2024-07-24T22:17:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.580+0000 7fab85c8d740 1 -- 172.21.15.47:0/3163470738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 msgr2=0x55cb9b4d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.580+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3163470738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d0d60 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00ed60 tx=0x7fab6c004a40 comp rx=0 tx=0).stop 2024-07-24T22:17:51.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.580+0000 7fab85c8d740 1 -- 172.21.15.47:0/3163470738 shutdown_connections 2024-07-24T22:17:51.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.580+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3163470738 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cb9b4e2fa0 0x55cb9b4e53e0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.580+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3163470738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d0d60 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.580+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3163470738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.580+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3163470738 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.580+0000 7fab85c8d740 1 -- 172.21.15.47:0/3163470738 >> 172.21.15.47:0/3163470738 conn(0x55cb9b4c04e0 msgr2=0x55cb9b4c6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:51.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.580+0000 7fab60ff9640 0 client.17796 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:51.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.580+0000 7fab85c8d740 1 -- 172.21.15.47:0/3163470738 shutdown_connections 2024-07-24T22:17:51.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.580+0000 7fab85c8d740 1 -- 172.21.15.47:0/3163470738 wait complete. 2024-07-24T22:17:51.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.580+0000 7fab85c8d740 20 client.17796 trim_cache size 0 max 16384 2024-07-24T22:17:51.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.598+0000 7fab85c8d740 1 Processor -- start 2024-07-24T22:17:51.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.598+0000 7fab85c8d740 1 -- start start 2024-07-24T22:17:51.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.598+0000 7fab85c8d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.598+0000 7fab85c8d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4eacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.598+0000 7fab85c8d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4d3370 0x55cb9b4eb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.598+0000 7fab85c8d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1a9f00 con 0x55cb9b4c2fd0 2024-07-24T22:17:51.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.598+0000 7fab85c8d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1ac760 con 0x55cb9b4c26b0 2024-07-24T22:17:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.598+0000 7fab85c8d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1aa550 con 0x55cb9b4d3370 2024-07-24T22:17:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.598+0000 7fab80e77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4eacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.598+0000 7fab80e77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4eacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49406/0 (socket says 172.21.15.47:49406) 2024-07-24T22:17:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.598+0000 7fab80e77640 1 -- 172.21.15.47:0/4271614518 learned_addr learned my addr 172.21.15.47:0/4271614518 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.598+0000 7fab81678640 1 --2- 172.21.15.47:0/4271614518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.599+0000 7fab80e77640 1 -- 172.21.15.47:0/4271614518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4d3370 msgr2=0x55cb9b4eb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.599+0000 7fab81e79640 1 --2- 172.21.15.47:0/4271614518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4d3370 0x55cb9b4eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.599+0000 7fab80e77640 1 --2- 172.21.15.47:0/4271614518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4d3370 0x55cb9b4eb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.599+0000 7fab80e77640 1 -- 172.21.15.47:0/4271614518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 msgr2=0x55cb9b4c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.599+0000 7fab80e77640 1 --2- 172.21.15.47:0/4271614518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4c1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.599+0000 7fab80e77640 1 -- 172.21.15.47:0/4271614518 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9b4bbbe0 con 0x55cb9b4c2fd0 2024-07-24T22:17:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.599+0000 7fab81678640 1 --2- 172.21.15.47:0/4271614518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:17:51.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.599+0000 7fab81e79640 1 --2- 172.21.15.47:0/4271614518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4d3370 0x55cb9b4eb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:17:51.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.599+0000 7fab80e77640 1 --2- 172.21.15.47:0/4271614518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4eacf0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fab7000fc30 tx=0x7fab70005cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acd08986aab4532 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:51.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.599+0000 7fab62ffd640 1 -- 172.21.15.47:0/4271614518 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70004020 con 0x55cb9b4c2fd0 2024-07-24T22:17:51.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.599+0000 7fab62ffd640 1 -- 172.21.15.47:0/4271614518 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab700054f0 con 0x55cb9b4c2fd0 2024-07-24T22:17:51.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.599+0000 7fab62ffd640 1 -- 172.21.15.47:0/4271614518 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70004a40 con 0x55cb9b4c2fd0 2024-07-24T22:17:51.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.600+0000 7fab85c8d740 1 -- 172.21.15.47:0/4271614518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4c2fd0 msgr2=0x55cb9b4eacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:51.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.600+0000 7fab85c8d740 1 --2- 172.21.15.47:0/4271614518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4eacf0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fab7000fc30 tx=0x7fab70005cd0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.600+0000 7fab85c8d740 1 -- 172.21.15.47:0/4271614518 shutdown_connections 2024-07-24T22:17:51.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.600+0000 7fab85c8d740 1 --2- 172.21.15.47:0/4271614518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4d3370 0x55cb9b4eb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.600+0000 7fab85c8d740 1 --2- 172.21.15.47:0/4271614518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4eacf0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.600+0000 7fab85c8d740 1 --2- 172.21.15.47:0/4271614518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.600+0000 7fab85c8d740 1 -- 172.21.15.47:0/4271614518 >> 172.21.15.47:0/4271614518 conn(0x55cb9b4c04e0 msgr2=0x55cb9b4c1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:51.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.600+0000 7fab85c8d740 1 -- 172.21.15.47:0/4271614518 shutdown_connections 2024-07-24T22:17:51.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.600+0000 7fab85c8d740 1 -- 172.21.15.47:0/4271614518 wait complete. 2024-07-24T22:17:51.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.600+0000 7fab85c8d740 1 -- start start 2024-07-24T22:17:51.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.600+0000 7fab85c8d740 1 Processor -- start 2024-07-24T22:17:51.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab85c8d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4d93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab85c8d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4d9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab85c8d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab85c8d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1aac20 con 0x55cb9b4d3370 2024-07-24T22:17:51.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab85c8d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1ac090 con 0x55cb9b4c26b0 2024-07-24T22:17:51.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab85c8d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1ab2f0 con 0x55cb9b4c2fd0 2024-07-24T22:17:51.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab85c8d740 10 client.0 _ll_register_callbacks cb 0x7fab6c00ea10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:51.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab81e79640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab81e79640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49420/0 (socket says 172.21.15.47:49420) 2024-07-24T22:17:51.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab81e79640 1 -- 172.21.15.47:0/3827754087 learned_addr learned my addr 172.21.15.47:0/3827754087 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:51.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab80e77640 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4d9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab81678640 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4d93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab81e79640 1 -- 172.21.15.47:0/3827754087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c2fd0 msgr2=0x55cb9b4d9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:51.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab81e79640 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4d9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab81e79640 1 -- 172.21.15.47:0/3827754087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 msgr2=0x55cb9b4d93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab81e79640 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4d93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab81e79640 1 -- 172.21.15.47:0/3827754087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb9b4cca50 con 0x55cb9b4d3370 2024-07-24T22:17:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab80e77640 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4d9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:17:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab81678640 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4d93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:17:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab81e79640 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d9ea0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00efd0 tx=0x7fab6c0072b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3258bbddf5f11d0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.601+0000 7fab60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:51.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab60ff9640 1 -- 172.21.15.47:0/3827754087 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c040060 con 0x55cb9b4d3370 2024-07-24T22:17:51.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab60ff9640 1 -- 172.21.15.47:0/3827754087 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7fab6c01cb30 con 0x55cb9b4d3370 2024-07-24T22:17:51.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab85c8d740 1 -- 172.21.15.47:0/3827754087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab700054f0 con 0x55cb9b4d3370 2024-07-24T22:17:51.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab60ff9640 1 -- 172.21.15.47:0/3827754087 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fab6c035070 con 0x55cb9b4d3370 2024-07-24T22:17:51.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab85c8d740 10 client.17802 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:51.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab85c8d740 1 -- 172.21.15.47:0/3827754087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cb9b4cdd60 con 0x55cb9b4d3370 2024-07-24T22:17:51.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab60ff9640 1 -- 172.21.15.47:0/3827754087 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab700054f0 con 0x55cb9b4d3370 2024-07-24T22:17:51.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab60ff9640 1 -- 172.21.15.47:0/3827754087 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fab6c02f050 con 0x55cb9b4d3370 2024-07-24T22:17:51.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab85c8d740 10 client.17802 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:51.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab85c8d740 10 client.17802 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:51.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab85c8d740 20 client.17802 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:51.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cb9b5524b0 0x55cb9b5548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:51.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab85c8d740 4 client.17802 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:17:51.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab85c8d740 1 -- 172.21.15.47:0/3827754087 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cb9b437380 con 0x55cb9b5524b0 2024-07-24T22:17:51.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.602+0000 7fab81678640 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cb9b5524b0 0x55cb9b5548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:51.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab81678640 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cb9b5524b0 0x55cb9b5548a0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e87b466cc8afa177 server_cookie=e91406109ee7f37c in_seq=0 out_seq=0 2024-07-24T22:17:51.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab60ff9640 10 client.17802 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:51.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab60ff9640 1 -- 172.21.15.47:0/3827754087 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cb9b437380 con 0x55cb9b5524b0 2024-07-24T22:17:51.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab60ff9640 10 client.17802 handle_command_reply: tid=0 2024-07-24T22:17:51.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab85c8d740 1 client.17802 shutdown 2024-07-24T22:17:51.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab85c8d740 1 -- 172.21.15.47:0/3827754087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 msgr2=0x55cb9b4d9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:51.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d9ea0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00efd0 tx=0x7fab6c0072b0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab85c8d740 1 -- 172.21.15.47:0/3827754087 shutdown_connections 2024-07-24T22:17:51.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cb9b5524b0 0x55cb9b5548a0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb9b4d3370 0x55cb9b4d9ea0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cb9b4c2fd0 0x55cb9b4d9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab85c8d740 1 --2- 172.21.15.47:0/3827754087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cb9b4c26b0 0x55cb9b4d93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab60ff9640 0 client.17802 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:51.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab85c8d740 1 -- 172.21.15.47:0/3827754087 >> 172.21.15.47:0/3827754087 conn(0x55cb9b4c04e0 msgr2=0x55cb9b4d2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:51.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab85c8d740 1 -- 172.21.15.47:0/3827754087 shutdown_connections 2024-07-24T22:17:51.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab85c8d740 1 -- 172.21.15.47:0/3827754087 wait complete. 2024-07-24T22:17:51.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.603+0000 7fab85c8d740 20 client.17802 trim_cache size 0 max 16384 2024-07-24T22:17:51.618 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:17:51.618 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:17:51.618 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:17:51.618 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:17:51.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.604+0000 7fab838dc640 1 -- 172.21.15.47:0/3197582449 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fab640b3dc0 msgr2=0x7fab640b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:51.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.604+0000 7fab838dc640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fab640b3dc0 0x7fab640b6280 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fab6c007f10 tx=0x7fab6c0076a0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.604+0000 7fab838dc640 1 -- 172.21.15.47:0/3197582449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab7c102790 msgr2=0x7fab7c198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:51.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.604+0000 7fab838dc640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab7c102790 0x7fab7c198bf0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fab74005940 tx=0x7fab740042f0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.604+0000 7fab838dc640 1 -- 172.21.15.47:0/3197582449 shutdown_connections 2024-07-24T22:17:51.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.604+0000 7fab838dc640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fab640b3dc0 0x7fab640b6280 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.604+0000 7fab838dc640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab7c108b20 0x7fab7c19e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.604+0000 7fab838dc640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab7c1081a0 0x7fab7c199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.604+0000 7fab838dc640 1 --2- 172.21.15.47:0/3197582449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab7c102790 0x7fab7c198bf0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:51.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.604+0000 7fab838dc640 1 -- 172.21.15.47:0/3197582449 >> 172.21.15.47:0/3197582449 conn(0x7fab7c0fe200 msgr2=0x7fab7c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:51.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.604+0000 7fab838dc640 1 -- 172.21.15.47:0/3197582449 shutdown_connections 2024-07-24T22:17:51.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:51.604+0000 7fab838dc640 1 -- 172.21.15.47:0/3197582449 wait complete. 2024-07-24T22:17:51.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:51 smithi047 ceph-mon[32551]: pgmap v695: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:52.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:51 smithi188 ceph-mon[37380]: pgmap v695: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:52.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:51 smithi183 ceph-mon[37007]: pgmap v695: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:52.399 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:17:52.399 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:17:52.667 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:17:54.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:53 smithi188 ceph-mon[37380]: pgmap v696: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 3 op/s 2024-07-24T22:17:54.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:53 smithi047 ceph-mon[32551]: pgmap v696: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 3 op/s 2024-07-24T22:17:54.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:53 smithi183 ceph-mon[37007]: pgmap v696: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 3 op/s 2024-07-24T22:17:54.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.401+0000 7fb0741a1640 1 -- 172.21.15.47:0/4268431690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb06c10ede0 msgr2=0x7fb06c1111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:54.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.401+0000 7fb0741a1640 1 --2- 172.21.15.47:0/4268431690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb06c10ede0 0x7fb06c1111d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fb064009ca0 tx=0x7fb06402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:17:54.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.401+0000 7fb0741a1640 1 -- 172.21.15.47:0/4268431690 shutdown_connections 2024-07-24T22:17:54.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.401+0000 7fb0741a1640 1 --2- 172.21.15.47:0/4268431690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb06c10ede0 0x7fb06c1111d0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:54.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.401+0000 7fb0741a1640 1 --2- 172.21.15.47:0/4268431690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb06c101b50 0x7fb06c10e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:54.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.401+0000 7fb0741a1640 1 --2- 172.21.15.47:0/4268431690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb06c101230 0x7fb06c101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:54.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.401+0000 7fb0741a1640 1 -- 172.21.15.47:0/4268431690 >> 172.21.15.47:0/4268431690 conn(0x7fb06c0fd100 msgr2=0x7fb06c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:54.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.401+0000 7fb0741a1640 1 -- 172.21.15.47:0/4268431690 shutdown_connections 2024-07-24T22:17:54.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.401+0000 7fb0741a1640 1 -- 172.21.15.47:0/4268431690 wait complete. 2024-07-24T22:17:54.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.402+0000 7fb0741a1640 1 Processor -- start 2024-07-24T22:17:54.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.402+0000 7fb0741a1640 1 -- start start 2024-07-24T22:17:54.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.402+0000 7fb0741a1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb06c101230 0x7fb06c19ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:54.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.402+0000 7fb0741a1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb06c101b50 0x7fb06c19b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:54.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.402+0000 7fb0741a1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb06c10ede0 0x7fb06c1a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:54.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.402+0000 7fb0741a1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c114960 con 0x7fb06c101b50 2024-07-24T22:17:54.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.402+0000 7fb0741a1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c1147e0 con 0x7fb06c101230 2024-07-24T22:17:54.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.402+0000 7fb0741a1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c114ae0 con 0x7fb06c10ede0 2024-07-24T22:17:54.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.402+0000 7fb07173c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb06c101b50 0x7fb06c19b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:54.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.402+0000 7fb07173c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb06c101b50 0x7fb06c19b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49430/0 (socket says 172.21.15.47:49430) 2024-07-24T22:17:54.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.402+0000 7fb07173c640 1 -- 172.21.15.47:0/2315592207 learned_addr learned my addr 172.21.15.47:0/2315592207 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:54.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.402+0000 7fb071f3d640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb06c101230 0x7fb06c19ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:54.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.403+0000 7fb07273e640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb06c10ede0 0x7fb06c1a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:54.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.403+0000 7fb07173c640 1 -- 172.21.15.47:0/2315592207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb06c10ede0 msgr2=0x7fb06c1a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:54.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.403+0000 7fb07173c640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb06c10ede0 0x7fb06c1a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:54.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.403+0000 7fb07173c640 1 -- 172.21.15.47:0/2315592207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb06c101230 msgr2=0x7fb06c19ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:54.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.403+0000 7fb07173c640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb06c101230 0x7fb06c19ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:54.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.403+0000 7fb07173c640 1 -- 172.21.15.47:0/2315592207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06c1a0f00 con 0x7fb06c101b50 2024-07-24T22:17:54.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.403+0000 7fb07273e640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb06c10ede0 0x7fb06c1a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:17:54.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.403+0000 7fb07173c640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb06c101b50 0x7fb06c19b390 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00d950 tx=0x7fb05c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:54.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.403+0000 7fb062ffd640 1 -- 172.21.15.47:0/2315592207 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c017070 con 0x7fb06c101b50 2024-07-24T22:17:54.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.403+0000 7fb0741a1640 1 -- 172.21.15.47:0/2315592207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06c1a11f0 con 0x7fb06c101b50 2024-07-24T22:17:54.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.403+0000 7fb062ffd640 1 -- 172.21.15.47:0/2315592207 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb05c009c30 con 0x7fb06c101b50 2024-07-24T22:17:54.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.403+0000 7fb062ffd640 1 -- 172.21.15.47:0/2315592207 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c00f620 con 0x7fb06c101b50 2024-07-24T22:17:54.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.403+0000 7fb0741a1640 1 -- 172.21.15.47:0/2315592207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb06c1a78b0 con 0x7fb06c101b50 2024-07-24T22:17:54.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.404+0000 7fb0741a1640 1 -- 172.21.15.47:0/2315592207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb06c101610 con 0x7fb06c101b50 2024-07-24T22:17:54.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.406+0000 7fb062ffd640 1 -- 172.21.15.47:0/2315592207 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fb05c010460 con 0x7fb06c101b50 2024-07-24T22:17:54.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.406+0000 7fb062ffd640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb0580b3d40 0x7fb0580b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:54.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.407+0000 7fb071f3d640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb0580b3d40 0x7fb0580b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:54.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.407+0000 7fb062ffd640 1 -- 172.21.15.47:0/2315592207 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7fb05c0e3c60 con 0x7fb06c101b50 2024-07-24T22:17:54.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.408+0000 7fb071f3d640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb0580b3d40 0x7fb0580b6200 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb068005fd0 tx=0x7fb06800b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:54.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.410+0000 7fb062ffd640 1 -- 172.21.15.47:0/2315592207 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fb05c0aaf40 con 0x7fb06c101b50 2024-07-24T22:17:54.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.643+0000 7fb0741a1640 1 -- 172.21.15.47:0/2315592207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb06c1a7c20 con 0x7fb06c101b50 2024-07-24T22:17:54.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.643+0000 7fb062ffd640 1 -- 172.21.15.47:0/2315592207 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7fb05c009de0 con 0x7fb06c101b50 2024-07-24T22:17:54.646 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:17:54.646 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:17:54.646 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:17:54.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.645+0000 7fb0741a1640 1 -- 172.21.15.47:0/2315592207 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb0580b3d40 msgr2=0x7fb0580b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:54.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.645+0000 7fb0741a1640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb0580b3d40 0x7fb0580b6200 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb068005fd0 tx=0x7fb06800b390 comp rx=0 tx=0).stop 2024-07-24T22:17:54.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.645+0000 7fb0741a1640 1 -- 172.21.15.47:0/2315592207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb06c101b50 msgr2=0x7fb06c19b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:54.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.645+0000 7fb0741a1640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb06c101b50 0x7fb06c19b390 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00d950 tx=0x7fb05c00de10 comp rx=0 tx=0).stop 2024-07-24T22:17:54.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.645+0000 7fb0741a1640 1 -- 172.21.15.47:0/2315592207 shutdown_connections 2024-07-24T22:17:54.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.645+0000 7fb0741a1640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb0580b3d40 0x7fb0580b6200 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:54.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.645+0000 7fb0741a1640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb06c10ede0 0x7fb06c1a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:54.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.645+0000 7fb0741a1640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb06c101b50 0x7fb06c19b390 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:54.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.645+0000 7fb0741a1640 1 --2- 172.21.15.47:0/2315592207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb06c101230 0x7fb06c19ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:54.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.645+0000 7fb0741a1640 1 -- 172.21.15.47:0/2315592207 >> 172.21.15.47:0/2315592207 conn(0x7fb06c0fd100 msgr2=0x7fb06c0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:54.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.646+0000 7fb0741a1640 1 -- 172.21.15.47:0/2315592207 shutdown_connections 2024-07-24T22:17:54.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:54.646+0000 7fb0741a1640 1 -- 172.21.15.47:0/2315592207 wait complete. 2024-07-24T22:17:54.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:54 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2315592207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:17:55.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:54 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2315592207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:17:55.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:54 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2315592207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:17:55.426 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:17:55.699 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:17:56.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:55 smithi188 ceph-mon[37380]: pgmap v697: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:56.050 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:55 smithi047 ceph-mon[32551]: pgmap v697: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:56.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:55 smithi183 ceph-mon[37007]: pgmap v697: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:57.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.359+0000 7f0ef5db3640 1 -- 172.21.15.47:0/3207861273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0101650 msgr2=0x7f0ef0101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:57.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.359+0000 7f0ef5db3640 1 --2- 172.21.15.47:0/3207861273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0101650 0x7f0ef0101a30 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009900 tx=0x7f0ee002a410 comp rx=0 tx=0).stop 2024-07-24T22:17:57.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.359+0000 7f0ef5db3640 1 -- 172.21.15.47:0/3207861273 shutdown_connections 2024-07-24T22:17:57.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.359+0000 7f0ef5db3640 1 --2- 172.21.15.47:0/3207861273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef01079e0 0x7f0ef010e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.359+0000 7f0ef5db3640 1 --2- 172.21.15.47:0/3207861273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ef0107060 0x7f0ef01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.359+0000 7f0ef5db3640 1 --2- 172.21.15.47:0/3207861273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0101650 0x7f0ef0101a30 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.359+0000 7f0ef5db3640 1 -- 172.21.15.47:0/3207861273 >> 172.21.15.47:0/3207861273 conn(0x7f0ef00fd0c0 msgr2=0x7f0ef00ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.359+0000 7f0ef5db3640 1 -- 172.21.15.47:0/3207861273 shutdown_connections 2024-07-24T22:17:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.359+0000 7f0ef5db3640 1 -- 172.21.15.47:0/3207861273 wait complete. 2024-07-24T22:17:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.360+0000 7f0ef5db3640 1 Processor -- start 2024-07-24T22:17:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.360+0000 7f0ef5db3640 1 -- start start 2024-07-24T22:17:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.360+0000 7f0ef5db3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ef0101650 0x7f0ef0199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.360+0000 7f0ef5db3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0107060 0x7f0ef019a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.360+0000 7f0ef5db3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef01079e0 0x7f0ef019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.360+0000 7f0ef5db3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01116e0 con 0x7f0ef0107060 2024-07-24T22:17:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.360+0000 7f0ef5db3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef0111560 con 0x7f0ef01079e0 2024-07-24T22:17:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.360+0000 7f0ef5db3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef0111860 con 0x7f0ef0101650 2024-07-24T22:17:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.360+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0107060 0x7f0ef019a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.360+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0107060 0x7f0ef019a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47176/0 (socket says 172.21.15.47:47176) 2024-07-24T22:17:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.360+0000 7f0eeeffd640 1 -- 172.21.15.47:0/1020738663 learned_addr learned my addr 172.21.15.47:0/1020738663 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.360+0000 7f0eeffff640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef01079e0 0x7f0ef019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.361+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ef0101650 0x7f0ef0199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.361+0000 7f0eeeffd640 1 -- 172.21.15.47:0/1020738663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ef0101650 msgr2=0x7f0ef0199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.361+0000 7f0eeeffd640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ef0101650 0x7f0ef0199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.361+0000 7f0eeeffd640 1 -- 172.21.15.47:0/1020738663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef01079e0 msgr2=0x7f0ef019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.361+0000 7f0eeeffd640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef01079e0 0x7f0ef019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.361+0000 7f0eeeffd640 1 -- 172.21.15.47:0/1020738663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef01a4f90 con 0x7f0ef0107060 2024-07-24T22:17:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.361+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ef0101650 0x7f0ef0199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:17:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.361+0000 7f0eeeffd640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0107060 0x7f0ef019a0f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400b4a0 tx=0x7f0ee400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.361+0000 7f0eecff9640 1 -- 172.21.15.47:0/1020738663 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4014070 con 0x7f0ef0107060 2024-07-24T22:17:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.361+0000 7f0eecff9640 1 -- 172.21.15.47:0/1020738663 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee4010ac0 con 0x7f0ef0107060 2024-07-24T22:17:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.361+0000 7f0ef5db3640 1 -- 172.21.15.47:0/1020738663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef01a5280 con 0x7f0ef0107060 2024-07-24T22:17:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.361+0000 7f0eecff9640 1 -- 172.21.15.47:0/1020738663 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4017c30 con 0x7f0ef0107060 2024-07-24T22:17:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.361+0000 7f0ef5db3640 1 -- 172.21.15.47:0/1020738663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef01a57f0 con 0x7f0ef0107060 2024-07-24T22:17:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0eecff9640 1 -- 172.21.15.47:0/1020738663 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f0ee4017070 con 0x7f0ef0107060 2024-07-24T22:17:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0ef8164740 1 Processor -- start 2024-07-24T22:17:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0ef8164740 1 -- start start 2024-07-24T22:17:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0ef8164740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 0x5585b561eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0ef8164740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b562aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0ef8164740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 0x5585b562d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0ef8164740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5585b55959b0 con 0x5585b561eff0 2024-07-24T22:17:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0ef8164740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5585b5584eb0 con 0x5585b562af80 2024-07-24T22:17:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0ef8164740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5585b5588ef0 con 0x5585b561e6d0 2024-07-24T22:17:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0eef7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b562aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0eef7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b562aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47190/0 (socket says 172.21.15.47:47190) 2024-07-24T22:17:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0eef7fe640 1 -- 172.21.15.47:0/3329961872 learned_addr learned my addr 172.21.15.47:0/3329961872 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0eeffff640 1 --2- 172.21.15.47:0/3329961872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 0x5585b561eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0eeeffd640 1 --2- 172.21.15.47:0/3329961872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 0x5585b562d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0eef7fe640 1 -- 172.21.15.47:0/3329961872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 msgr2=0x5585b561eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/3329961872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 0x5585b561eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0eef7fe640 1 -- 172.21.15.47:0/3329961872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 msgr2=0x5585b562d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.364+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/3329961872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 0x5585b562d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.365+0000 7f0eef7fe640 1 -- 172.21.15.47:0/3329961872 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585b550e320 con 0x5585b561eff0 2024-07-24T22:17:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.365+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/3329961872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b562aa40 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0000c00 tx=0x7f0ee0032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12808e33222841e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.365+0000 7f0eecff9640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0ed80b3d40 0x7f0ed80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.365+0000 7f0ed5ffb640 1 -- 172.21.15.47:0/3329961872 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee003f070 con 0x5585b561eff0 2024-07-24T22:17:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.365+0000 7f0eeffff640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0ed80b3d40 0x7f0ed80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.365+0000 7f0ed5ffb640 1 -- 172.21.15.47:0/3329961872 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee0031760 con 0x5585b561eff0 2024-07-24T22:17:57.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.365+0000 7f0ed5ffb640 1 -- 172.21.15.47:0/3329961872 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0035070 con 0x5585b561eff0 2024-07-24T22:17:57.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.365+0000 7f0eecff9640 1 -- 172.21.15.47:0/1020738663 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f0ee40e32f0 con 0x7f0ef0107060 2024-07-24T22:17:57.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.366+0000 7f0eeffff640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0ed80b3d40 0x7f0ed80b6200 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0ef019ab90 tx=0x7f0ee800d040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:57.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.366+0000 7f0ef8164740 1 -- 172.21.15.47:0/3329961872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 msgr2=0x5585b562aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.366+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3329961872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b562aa40 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0000c00 tx=0x7f0ee0032e90 comp rx=0 tx=0).stop 2024-07-24T22:17:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.366+0000 7f0ef8164740 1 -- 172.21.15.47:0/3329961872 shutdown_connections 2024-07-24T22:17:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.366+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3329961872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 0x5585b562d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.366+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3329961872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b562aa40 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.366+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3329961872 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 0x5585b561eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.366+0000 7f0ef8164740 1 -- 172.21.15.47:0/3329961872 >> 172.21.15.47:0/3329961872 conn(0x5585b561c500 msgr2=0x5585b561d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.366+0000 7f0ef8164740 1 -- 172.21.15.47:0/3329961872 shutdown_connections 2024-07-24T22:17:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.366+0000 7f0ef8164740 1 -- 172.21.15.47:0/3329961872 wait complete. 2024-07-24T22:17:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.366+0000 7f0ef8164740 1 -- start start 2024-07-24T22:17:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0ef8164740 1 Processor -- start 2024-07-24T22:17:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0ef8164740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 0x5585b5627eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0ef8164740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b56283f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0ef8164740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 0x5585b5628930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0ef8164740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5585b53e8700 con 0x5585b561eff0 2024-07-24T22:17:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0ef8164740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5585b55275f0 con 0x5585b562af80 2024-07-24T22:17:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0ef8164740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5585b5631fb0 con 0x5585b561e6d0 2024-07-24T22:17:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0ef8164740 10 client.0 _ll_register_callbacks cb 0x5585b5547960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b56283f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b56283f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47196/0 (socket says 172.21.15.47:47196) 2024-07-24T22:17:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0eeeffd640 1 -- 172.21.15.47:0/1933806323 learned_addr learned my addr 172.21.15.47:0/1933806323 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/1933806323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 0x5585b5627eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0eeffff640 1 --2- 172.21.15.47:0/1933806323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 0x5585b5628930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0eeeffd640 1 -- 172.21.15.47:0/1933806323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 msgr2=0x5585b5627eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0eeeffd640 1 --2- 172.21.15.47:0/1933806323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 0x5585b5627eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.367+0000 7f0eeeffd640 1 -- 172.21.15.47:0/1933806323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 msgr2=0x5585b5628930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0eeeffd640 1 --2- 172.21.15.47:0/1933806323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 0x5585b5628930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0eeeffd640 1 -- 172.21.15.47:0/1933806323 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585b551a680 con 0x5585b561eff0 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0eeeffd640 1 --2- 172.21.15.47:0/1933806323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b56283f0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400be60 tx=0x7f0ee40a9750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eabe3f913595635 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0eceffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0eceffd640 1 -- 172.21.15.47:0/1933806323 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee401e070 con 0x5585b561eff0 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0eceffd640 1 -- 172.21.15.47:0/1933806323 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f0ee4010610 con 0x5585b561eff0 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0ef8164740 1 -- 172.21.15.47:0/1933806323 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ee0031760 con 0x5585b561eff0 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0eceffd640 1 -- 172.21.15.47:0/1933806323 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0ee40a9af0 con 0x5585b561eff0 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0ef8164740 10 client.17820 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0ef8164740 1 -- 172.21.15.47:0/1933806323 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5585b52e5650 con 0x5585b561eff0 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0eceffd640 1 -- 172.21.15.47:0/1933806323 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee0031760 con 0x5585b561eff0 2024-07-24T22:17:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0eceffd640 1 -- 172.21.15.47:0/1933806323 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0ee40a9240 con 0x5585b561eff0 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0ef8164740 10 client.17820 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0ef8164740 10 client.17820 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0ef8164740 20 client.17820 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.368+0000 7f0ef8164740 1 --2- 172.21.15.47:0/1933806323 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5585b563edc0 0x5585b56411d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.369+0000 7f0ef8164740 4 client.17820 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.369+0000 7f0ef8164740 1 -- 172.21.15.47:0/1933806323 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585b5597900 con 0x5585b563edc0 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.369+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/1933806323 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5585b563edc0 0x5585b56411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.369+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/1933806323 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5585b563edc0 0x5585b56411d0 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=171d9ea7d6c02ded server_cookie=fe76a96046fe353 in_seq=0 out_seq=0 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.369+0000 7f0eceffd640 10 client.17820 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0eceffd640 1 -- 172.21.15.47:0/1933806323 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585b5597900 con 0x5585b563edc0 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0eceffd640 10 client.17820 handle_command_reply: tid=0 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0ef8164740 1 client.17820 shutdown 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0ef8164740 1 -- 172.21.15.47:0/1933806323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 msgr2=0x5585b56283f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0ef8164740 1 --2- 172.21.15.47:0/1933806323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b56283f0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400be60 tx=0x7f0ee40a9750 comp rx=0 tx=0).stop 2024-07-24T22:17:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0ef8164740 1 -- 172.21.15.47:0/1933806323 shutdown_connections 2024-07-24T22:17:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0ef8164740 1 --2- 172.21.15.47:0/1933806323 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5585b563edc0 0x5585b56411d0 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0ef8164740 1 --2- 172.21.15.47:0/1933806323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 0x5585b5628930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0ef8164740 1 --2- 172.21.15.47:0/1933806323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b56283f0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0ef8164740 1 --2- 172.21.15.47:0/1933806323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 0x5585b5627eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0ef8164740 1 -- 172.21.15.47:0/1933806323 >> 172.21.15.47:0/1933806323 conn(0x5585b561c500 msgr2=0x5585b56220a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0eceffd640 0 client.17820 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0ef8164740 1 -- 172.21.15.47:0/1933806323 shutdown_connections 2024-07-24T22:17:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.370+0000 7f0ef8164740 1 -- 172.21.15.47:0/1933806323 wait complete. 2024-07-24T22:17:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.371+0000 7f0ef8164740 20 client.17820 trim_cache size 0 max 16384 2024-07-24T22:17:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.384+0000 7f0ef8164740 1 Processor -- start 2024-07-24T22:17:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.384+0000 7f0ef8164740 1 -- start start 2024-07-24T22:17:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0ef8164740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561e6d0 0x5585b5622820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0ef8164740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b561eff0 0x5585b56294e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0ef8164740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b562af80 0x5585b5646aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0ef8164740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01aa0a0 con 0x5585b561e6d0 2024-07-24T22:17:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0ef8164740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01ac900 con 0x5585b561eff0 2024-07-24T22:17:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0ef8164740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01aa6f0 con 0x5585b562af80 2024-07-24T22:17:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0eef7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561e6d0 0x5585b5622820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0eef7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561e6d0 0x5585b5622820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47202/0 (socket says 172.21.15.47:47202) 2024-07-24T22:17:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0eef7fe640 1 -- 172.21.15.47:0/3143852153 learned_addr learned my addr 172.21.15.47:0/3143852153 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0eeffff640 1 --2- 172.21.15.47:0/3143852153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b562af80 0x5585b5646aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0eeeffd640 1 --2- 172.21.15.47:0/3143852153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b561eff0 0x5585b56294e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0eef7fe640 1 -- 172.21.15.47:0/3143852153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b562af80 msgr2=0x5585b5646aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/3143852153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b562af80 0x5585b5646aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0eef7fe640 1 -- 172.21.15.47:0/3143852153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b561eff0 msgr2=0x5585b56294e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/3143852153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b561eff0 0x5585b56294e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.385+0000 7f0eef7fe640 1 -- 172.21.15.47:0/3143852153 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585b5628d50 con 0x5585b561e6d0 2024-07-24T22:17:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.386+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/3143852153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561e6d0 0x5585b5622820 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0005480 tx=0x7f0ee0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7342283babb7d22b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.386+0000 7f0ed57fa640 1 -- 172.21.15.47:0/3143852153 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0052070 con 0x5585b561e6d0 2024-07-24T22:17:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.386+0000 7f0ed57fa640 1 -- 172.21.15.47:0/3143852153 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee0005540 con 0x5585b561e6d0 2024-07-24T22:17:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.386+0000 7f0ed57fa640 1 -- 172.21.15.47:0/3143852153 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee003f040 con 0x5585b561e6d0 2024-07-24T22:17:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.386+0000 7f0ef8164740 1 -- 172.21.15.47:0/3143852153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561e6d0 msgr2=0x5585b5622820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.386+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3143852153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561e6d0 0x5585b5622820 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0005480 tx=0x7f0ee0005fd0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.386+0000 7f0ef8164740 1 -- 172.21.15.47:0/3143852153 shutdown_connections 2024-07-24T22:17:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.386+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3143852153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b562af80 0x5585b5646aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.386+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3143852153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b561eff0 0x5585b56294e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.386+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3143852153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561e6d0 0x5585b5622820 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.386+0000 7f0ef8164740 1 -- 172.21.15.47:0/3143852153 >> 172.21.15.47:0/3143852153 conn(0x5585b561c500 msgr2=0x5585b5628640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.387+0000 7f0ef8164740 1 -- 172.21.15.47:0/3143852153 shutdown_connections 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.387+0000 7f0ef8164740 1 -- 172.21.15.47:0/3143852153 wait complete. 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.387+0000 7f0ef8164740 1 -- start start 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.387+0000 7f0ef8164740 1 Processor -- start 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.387+0000 7f0ef8164740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 0x5585b56332a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.387+0000 7f0ef8164740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b56337e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.387+0000 7f0ef8164740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 0x5585b5633d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.387+0000 7f0ef8164740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01aadc0 con 0x5585b561eff0 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.387+0000 7f0ef8164740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01ac230 con 0x5585b562af80 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.387+0000 7f0ef8164740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01ab490 con 0x5585b561e6d0 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.387+0000 7f0ef8164740 10 client.0 _ll_register_callbacks cb 0x7f0ee40e6950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b56337e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b56337e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47208/0 (socket says 172.21.15.47:47208) 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eeeffd640 1 -- 172.21.15.47:0/3151393524 learned_addr learned my addr 172.21.15.47:0/3151393524 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:17:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eeffff640 1 --2- 172.21.15.47:0/3151393524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 0x5585b5633d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/3151393524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 0x5585b56332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eeeffd640 1 -- 172.21.15.47:0/3151393524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 msgr2=0x5585b56332a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eeeffd640 1 --2- 172.21.15.47:0/3151393524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 0x5585b56332a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eeeffd640 1 -- 172.21.15.47:0/3151393524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 msgr2=0x5585b5633d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:17:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eeeffd640 1 --2- 172.21.15.47:0/3151393524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 0x5585b5633d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eeeffd640 1 -- 172.21.15.47:0/3151393524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585b56a8c70 con 0x5585b561eff0 2024-07-24T22:17:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eeeffd640 1 --2- 172.21.15.47:0/3151393524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b56337e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40a9c90 tx=0x7f0ee40a9880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277bf642d8d9e285 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:17:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eceffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:17:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eceffd640 1 -- 172.21.15.47:0/3151393524 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee401e070 con 0x5585b561eff0 2024-07-24T22:17:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eceffd640 1 -- 172.21.15.47:0/3151393524 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f0ee4017df0 con 0x5585b561eff0 2024-07-24T22:17:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0ef8164740 1 -- 172.21.15.47:0/3151393524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ee0005540 con 0x5585b561eff0 2024-07-24T22:17:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.388+0000 7f0eceffd640 1 -- 172.21.15.47:0/3151393524 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0ee40a9db0 con 0x5585b561eff0 2024-07-24T22:17:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.389+0000 7f0ef8164740 10 client.17826 fetch_fsmap learned FSMap version 20 2024-07-24T22:17:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.389+0000 7f0ef8164740 1 -- 172.21.15.47:0/3151393524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5585b56a9f70 con 0x5585b561eff0 2024-07-24T22:17:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.389+0000 7f0eceffd640 1 -- 172.21.15.47:0/3151393524 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee0005540 con 0x5585b561eff0 2024-07-24T22:17:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.389+0000 7f0eceffd640 1 -- 172.21.15.47:0/3151393524 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0ee40a5950 con 0x5585b561eff0 2024-07-24T22:17:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.389+0000 7f0ef8164740 10 client.17826 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:17:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.389+0000 7f0ef8164740 10 client.17826 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:17:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.389+0000 7f0ef8164740 20 client.17826 populate_metadata read hostname 'smithi047' 2024-07-24T22:17:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.389+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3151393524 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5585b56aa6c0 0x5585b56acab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:17:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.389+0000 7f0ef8164740 4 client.17826 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:17:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.389+0000 7f0ef8164740 1 -- 172.21.15.47:0/3151393524 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585b55933a0 con 0x5585b56aa6c0 2024-07-24T22:17:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.389+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/3151393524 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5585b56aa6c0 0x5585b56acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:17:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0eceffd640 10 client.17826 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0eef7fe640 1 --2- 172.21.15.47:0/3151393524 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5585b56aa6c0 0x5585b56acab0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4186c6f4e8c5e9fc server_cookie=e46059d0d1d36429 in_seq=0 out_seq=0 2024-07-24T22:17:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0eceffd640 1 -- 172.21.15.47:0/3151393524 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585b55933a0 con 0x5585b56aa6c0 2024-07-24T22:17:57.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0eceffd640 10 client.17826 handle_command_reply: tid=0 2024-07-24T22:17:57.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0ef8164740 1 client.17826 shutdown 2024-07-24T22:17:57.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0ef8164740 1 -- 172.21.15.47:0/3151393524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 msgr2=0x5585b56337e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:57.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3151393524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b56337e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40a9c90 tx=0x7f0ee40a9880 comp rx=0 tx=0).stop 2024-07-24T22:17:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0ef8164740 1 -- 172.21.15.47:0/3151393524 shutdown_connections 2024-07-24T22:17:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3151393524 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5585b56aa6c0 0x5585b56acab0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3151393524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5585b562af80 0x5585b5633d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3151393524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b561eff0 0x5585b56337e0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0ef8164740 1 --2- 172.21.15.47:0/3151393524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5585b561e6d0 0x5585b56332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0ef8164740 1 -- 172.21.15.47:0/3151393524 >> 172.21.15.47:0/3151393524 conn(0x5585b561c500 msgr2=0x5585b561ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0eceffd640 0 client.17826 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:17:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.390+0000 7f0ef8164740 1 -- 172.21.15.47:0/3151393524 shutdown_connections 2024-07-24T22:17:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef8164740 1 -- 172.21.15.47:0/3151393524 wait complete. 2024-07-24T22:17:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef8164740 20 client.17826 trim_cache size 0 max 16384 2024-07-24T22:17:57.397 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:17:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef5db3640 1 -- 172.21.15.47:0/1020738663 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0ed80b3d40 msgr2=0x7f0ed80b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef5db3640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0ed80b3d40 0x7f0ed80b6200 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0ef019ab90 tx=0x7f0ee800d040 comp rx=0 tx=0).stop 2024-07-24T22:17:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef5db3640 1 -- 172.21.15.47:0/1020738663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0107060 msgr2=0x7f0ef019a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:17:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef5db3640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0107060 0x7f0ef019a0f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400b4a0 tx=0x7f0ee400b960 comp rx=0 tx=0).stop 2024-07-24T22:17:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef5db3640 1 -- 172.21.15.47:0/1020738663 shutdown_connections 2024-07-24T22:17:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef5db3640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0ed80b3d40 0x7f0ed80b6200 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef5db3640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef01079e0 0x7f0ef019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef5db3640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0107060 0x7f0ef019a0f0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef5db3640 1 --2- 172.21.15.47:0/1020738663 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ef0101650 0x7f0ef0199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:17:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef5db3640 1 -- 172.21.15.47:0/1020738663 >> 172.21.15.47:0/1020738663 conn(0x7f0ef00fd0c0 msgr2=0x7f0ef00ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:17:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef5db3640 1 -- 172.21.15.47:0/1020738663 shutdown_connections 2024-07-24T22:17:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:17:57.391+0000 7f0ef5db3640 1 -- 172.21.15.47:0/1020738663 wait complete. 2024-07-24T22:17:58.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:57 smithi188 ceph-mon[37380]: pgmap v698: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:58.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:57 smithi183 ceph-mon[37007]: pgmap v698: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:58.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:57 smithi047 ceph-mon[32551]: pgmap v698: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:17:59.018 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:17:59.018 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:17:59.302 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:00.021 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.5 2024-07-24T22:18:00.022 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:18:00.045 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:17:59 smithi047 ceph-mon[32551]: pgmap v699: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:18:00.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:17:59 smithi188 ceph-mon[37380]: pgmap v699: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:18:00.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:17:59 smithi183 ceph-mon[37007]: pgmap v699: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:18:00.622 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:01.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.159+0000 7f919d3e8640 1 -- 172.21.15.47:0/1453549628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91981079e0 msgr2=0x7f919810e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:01.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.160+0000 7f919d3e8640 1 --2- 172.21.15.47:0/1453549628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91981079e0 0x7f919810e1e0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f9190009900 tx=0x7f919002a410 comp rx=0 tx=0).stop 2024-07-24T22:18:01.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.160+0000 7f919d3e8640 1 -- 172.21.15.47:0/1453549628 shutdown_connections 2024-07-24T22:18:01.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.160+0000 7f919d3e8640 1 --2- 172.21.15.47:0/1453549628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91981079e0 0x7f919810e1e0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.160+0000 7f919d3e8640 1 --2- 172.21.15.47:0/1453549628 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9198107060 0x7f91981074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.160+0000 7f919d3e8640 1 --2- 172.21.15.47:0/1453549628 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9198101650 0x7f9198101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.160+0000 7f919d3e8640 1 -- 172.21.15.47:0/1453549628 >> 172.21.15.47:0/1453549628 conn(0x7f91980fd0c0 msgr2=0x7f91980ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:01.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.160+0000 7f919d3e8640 1 -- 172.21.15.47:0/1453549628 shutdown_connections 2024-07-24T22:18:01.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.160+0000 7f919d3e8640 1 -- 172.21.15.47:0/1453549628 wait complete. 2024-07-24T22:18:01.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.160+0000 7f919d3e8640 1 Processor -- start 2024-07-24T22:18:01.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.161+0000 7f919d3e8640 1 -- start start 2024-07-24T22:18:01.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.161+0000 7f919d3e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9198101650 0x7f9198198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.161+0000 7f919d3e8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9198107060 0x7f91981991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.161+0000 7f919d3e8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91981079e0 0x7f919819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.161+0000 7f919d3e8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9198112780 con 0x7f9198101650 2024-07-24T22:18:01.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.161+0000 7f919d3e8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9198112600 con 0x7f91981079e0 2024-07-24T22:18:01.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.161+0000 7f919d3e8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9198112900 con 0x7f9198107060 2024-07-24T22:18:01.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.161+0000 7f9196ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9198101650 0x7f9198198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.161+0000 7f9196ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9198101650 0x7f9198198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47214/0 (socket says 172.21.15.47:47214) 2024-07-24T22:18:01.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.161+0000 7f9196ffd640 1 -- 172.21.15.47:0/934923048 learned_addr learned my addr 172.21.15.47:0/934923048 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:01.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.161+0000 7f91967fc640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9198107060 0x7f91981991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.161+0000 7f91977fe640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91981079e0 0x7f919819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.162+0000 7f9196ffd640 1 -- 172.21.15.47:0/934923048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9198107060 msgr2=0x7f91981991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:01.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.162+0000 7f9196ffd640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9198107060 0x7f91981991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.162+0000 7f9196ffd640 1 -- 172.21.15.47:0/934923048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91981079e0 msgr2=0x7f919819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:01.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.162+0000 7f9196ffd640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91981079e0 0x7f919819e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.162+0000 7f9196ffd640 1 -- 172.21.15.47:0/934923048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919819ed20 con 0x7f9198101650 2024-07-24T22:18:01.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.162+0000 7f9196ffd640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9198101650 0x7f9198198c70 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f918800eab0 tx=0x7f918800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:01.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.162+0000 7f917ffff640 1 -- 172.21.15.47:0/934923048 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918800ce40 con 0x7f9198101650 2024-07-24T22:18:01.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.162+0000 7f917ffff640 1 -- 172.21.15.47:0/934923048 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9188011920 con 0x7f9198101650 2024-07-24T22:18:01.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.162+0000 7f917ffff640 1 -- 172.21.15.47:0/934923048 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188010a30 con 0x7f9198101650 2024-07-24T22:18:01.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.162+0000 7f919d3e8640 1 -- 172.21.15.47:0/934923048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919819f010 con 0x7f9198101650 2024-07-24T22:18:01.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.162+0000 7f919d3e8640 1 -- 172.21.15.47:0/934923048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91981a58a0 con 0x7f9198101650 2024-07-24T22:18:01.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.164+0000 7f919f799740 1 Processor -- start 2024-07-24T22:18:01.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f919f799740 1 -- start start 2024-07-24T22:18:01.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f917ffff640 1 -- 172.21.15.47:0/934923048 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f9188010bd0 con 0x7f9198101650 2024-07-24T22:18:01.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f919f799740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40ef30 0x56501d40f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f919f799740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 0x56501d41b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f919f799740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 0x56501d41dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f919f799740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56501d3869f0 con 0x56501d41b7e0 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f919f799740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56501d375ef0 con 0x56501d40f850 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f919f799740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56501d379f30 con 0x56501d40ef30 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f91977fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40ef30 0x56501d40f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f91967fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 0x56501d41dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f91977fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40ef30 0x56501d40f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:48206/0 (socket says 172.21.15.47:48206) 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f91977fe640 1 -- 172.21.15.47:0/2757339830 learned_addr learned my addr 172.21.15.47:0/2757339830 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f91967fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 0x56501d41dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47220/0 (socket says 172.21.15.47:47220) 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f9196ffd640 1 --2- 172.21.15.47:0/2757339830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 0x56501d41b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f91977fe640 1 -- 172.21.15.47:0/2757339830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 msgr2=0x56501d41b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f91977fe640 1 --2- 172.21.15.47:0/2757339830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 0x56501d41b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f91977fe640 1 -- 172.21.15.47:0/2757339830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 msgr2=0x56501d41dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f91977fe640 1 --2- 172.21.15.47:0/2757339830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 0x56501d41dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f91977fe640 1 -- 172.21.15.47:0/2757339830 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56501d0d6930 con 0x56501d40ef30 2024-07-24T22:18:01.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.165+0000 7f91967fc640 1 --2- 172.21.15.47:0/2757339830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 0x56501d41dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:01.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.166+0000 7f917ffff640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f91800b3dc0 0x7f91800b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.166+0000 7f91977fe640 1 --2- 172.21.15.47:0/2757339830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40ef30 0x56501d40f310 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f919002a930 tx=0x7f9190032c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36a444a15a9b3688 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:01.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.166+0000 7f9196ffd640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f91800b3dc0 0x7f91800b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.166+0000 7f917ffff640 1 -- 172.21.15.47:0/934923048 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f91880e4570 con 0x7f9198101650 2024-07-24T22:18:01.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.166+0000 7f917d7fa640 1 -- 172.21.15.47:0/2757339830 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190040070 con 0x56501d40ef30 2024-07-24T22:18:01.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.166+0000 7f917d7fa640 1 -- 172.21.15.47:0/2757339830 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91900316a0 con 0x56501d40ef30 2024-07-24T22:18:01.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.166+0000 7f917d7fa640 1 -- 172.21.15.47:0/2757339830 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190035040 con 0x56501d40ef30 2024-07-24T22:18:01.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.167+0000 7f919f799740 1 -- 172.21.15.47:0/2757339830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40ef30 msgr2=0x56501d40f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:01.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.167+0000 7f919f799740 1 --2- 172.21.15.47:0/2757339830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40ef30 0x56501d40f310 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f919002a930 tx=0x7f9190032c50 comp rx=0 tx=0).stop 2024-07-24T22:18:01.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.167+0000 7f9196ffd640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f91800b3dc0 0x7f91800b6280 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f91880e1d40 tx=0x7f91880104d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:01.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.167+0000 7f919f799740 1 -- 172.21.15.47:0/2757339830 shutdown_connections 2024-07-24T22:18:01.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.167+0000 7f919f799740 1 --2- 172.21.15.47:0/2757339830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 0x56501d41dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.167+0000 7f919f799740 1 --2- 172.21.15.47:0/2757339830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 0x56501d41b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.167+0000 7f919f799740 1 --2- 172.21.15.47:0/2757339830 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40ef30 0x56501d40f310 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.167+0000 7f919f799740 1 -- 172.21.15.47:0/2757339830 >> 172.21.15.47:0/2757339830 conn(0x56501d40cd60 msgr2=0x56501d40df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:01.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.167+0000 7f919f799740 1 -- 172.21.15.47:0/2757339830 shutdown_connections 2024-07-24T22:18:01.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.167+0000 7f919f799740 1 -- 172.21.15.47:0/2757339830 wait complete. 2024-07-24T22:18:01.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.167+0000 7f919f799740 1 -- start start 2024-07-24T22:18:01.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.167+0000 7f919f799740 1 Processor -- start 2024-07-24T22:18:01.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f919f799740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 0x56501d4187a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f919f799740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40f850 0x56501d418ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f919f799740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d41b7e0 0x56501d419220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f919f799740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56501d1d9890 con 0x56501d40ef30 2024-07-24T22:18:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f919f799740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56501d318390 con 0x56501d41b7e0 2024-07-24T22:18:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f919f799740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56501d41e400 con 0x56501d40f850 2024-07-24T22:18:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f919f799740 10 client.0 _ll_register_callbacks cb 0x56501d322500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f91977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 0x56501d4187a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f91977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 0x56501d4187a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47234/0 (socket says 172.21.15.47:47234) 2024-07-24T22:18:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f91977fe640 1 -- 172.21.15.47:0/1344167692 learned_addr learned my addr 172.21.15.47:0/1344167692 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f91967fc640 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40f850 0x56501d418ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f91977fe640 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d41b7e0 0x56501d419220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f91977fe640 1 -- 172.21.15.47:0/1344167692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40f850 msgr2=0x56501d418ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f91977fe640 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40f850 0x56501d418ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f91977fe640 1 -- 172.21.15.47:0/1344167692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d41b7e0 msgr2=0x56501d419220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f91977fe640 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d41b7e0 0x56501d419220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f91977fe640 1 -- 172.21.15.47:0/1344167692 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56501d312d60 con 0x56501d40ef30 2024-07-24T22:18:01.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f91967fc640 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40f850 0x56501d418ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:01.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f91977fe640 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 0x56501d4187a0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f9190005370 tx=0x7f9190005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eda73fa34812466 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:01.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f917aff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:01.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.168+0000 7f917aff5640 1 -- 172.21.15.47:0/1344167692 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190035040 con 0x56501d40ef30 2024-07-24T22:18:01.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.169+0000 7f917aff5640 1 -- 172.21.15.47:0/1344167692 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f9190004240 con 0x56501d40ef30 2024-07-24T22:18:01.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.169+0000 7f919f799740 1 -- 172.21.15.47:0/1344167692 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91900316a0 con 0x56501d40ef30 2024-07-24T22:18:01.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.169+0000 7f917aff5640 1 -- 172.21.15.47:0/1344167692 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9190040040 con 0x56501d40ef30 2024-07-24T22:18:01.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.169+0000 7f919f799740 10 client.17838 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:01.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.169+0000 7f919f799740 1 -- 172.21.15.47:0/1344167692 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56501d42a350 con 0x56501d40ef30 2024-07-24T22:18:01.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.169+0000 7f917aff5640 1 -- 172.21.15.47:0/1344167692 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91900316a0 con 0x56501d40ef30 2024-07-24T22:18:01.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.169+0000 7f917aff5640 1 -- 172.21.15.47:0/1344167692 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f919003c440 con 0x56501d40ef30 2024-07-24T22:18:01.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.169+0000 7f919f799740 10 client.17838 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:01.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.169+0000 7f919f799740 10 client.17838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:01.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.169+0000 7f919f799740 20 client.17838 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:01.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.169+0000 7f919f799740 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56501d42b6a0 0x56501d42da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.169+0000 7f919f799740 4 client.17838 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:01.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.169+0000 7f919f799740 1 -- 172.21.15.47:0/1344167692 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56501d388940 con 0x56501d42b6a0 2024-07-24T22:18:01.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.170+0000 7f91967fc640 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56501d42b6a0 0x56501d42da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.170+0000 7f91967fc640 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56501d42b6a0 0x56501d42da90 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0e0764bdd6d8688 server_cookie=f691e7e56fdb47e5 in_seq=0 out_seq=0 2024-07-24T22:18:01.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.170+0000 7f917aff5640 10 client.17838 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:01.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f917aff5640 1 -- 172.21.15.47:0/1344167692 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56501d388940 con 0x56501d42b6a0 2024-07-24T22:18:01.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f917aff5640 10 client.17838 handle_command_reply: tid=0 2024-07-24T22:18:01.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f919f799740 1 client.17838 shutdown 2024-07-24T22:18:01.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f919f799740 1 -- 172.21.15.47:0/1344167692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 msgr2=0x56501d4187a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:01.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f919f799740 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 0x56501d4187a0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f9190005370 tx=0x7f9190005d90 comp rx=0 tx=0).stop 2024-07-24T22:18:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f919f799740 1 -- 172.21.15.47:0/1344167692 shutdown_connections 2024-07-24T22:18:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f919f799740 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56501d42b6a0 0x56501d42da90 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f919f799740 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d41b7e0 0x56501d419220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f919f799740 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40f850 0x56501d418ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f919f799740 1 --2- 172.21.15.47:0/1344167692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 0x56501d4187a0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f919f799740 1 -- 172.21.15.47:0/1344167692 >> 172.21.15.47:0/1344167692 conn(0x56501d40cd60 msgr2=0x56501d412900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f917aff5640 0 client.17838 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f919f799740 1 -- 172.21.15.47:0/1344167692 shutdown_connections 2024-07-24T22:18:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f919f799740 1 -- 172.21.15.47:0/1344167692 wait complete. 2024-07-24T22:18:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.171+0000 7f919f799740 20 client.17838 trim_cache size 0 max 16384 2024-07-24T22:18:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f919f799740 1 Processor -- start 2024-07-24T22:18:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f919f799740 1 -- start start 2024-07-24T22:18:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f919f799740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 0x56501d418e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f919f799740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 0x56501d433050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f919f799740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d41b7e0 0x56501d433590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f919f799740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f91981ac1c0 con 0x56501d40ef30 2024-07-24T22:18:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f919f799740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f91981aea20 con 0x56501d40f850 2024-07-24T22:18:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f919f799740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f91981ac810 con 0x56501d41b7e0 2024-07-24T22:18:01.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f91977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 0x56501d418e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f91977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 0x56501d418e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47248/0 (socket says 172.21.15.47:47248) 2024-07-24T22:18:01.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f91977fe640 1 -- 172.21.15.47:0/3717290386 learned_addr learned my addr 172.21.15.47:0/3717290386 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:01.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f91967fc640 1 --2- 172.21.15.47:0/3717290386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 0x56501d433050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f91977fe640 1 -- 172.21.15.47:0/3717290386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d41b7e0 msgr2=0x56501d433590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:01.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f91977fe640 1 --2- 172.21.15.47:0/3717290386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d41b7e0 0x56501d433590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f91977fe640 1 -- 172.21.15.47:0/3717290386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 msgr2=0x56501d433050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:01.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f91977fe640 1 --2- 172.21.15.47:0/3717290386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 0x56501d433050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f91977fe640 1 -- 172.21.15.47:0/3717290386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56501d41af80 con 0x56501d40ef30 2024-07-24T22:18:01.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.190+0000 7f91967fc640 1 --2- 172.21.15.47:0/3717290386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 0x56501d433050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:01.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.191+0000 7f91977fe640 1 --2- 172.21.15.47:0/3717290386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 0x56501d418e20 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9190009850 tx=0x7f9190032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b7807717c8b269 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:01.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.191+0000 7f917cff9640 1 -- 172.21.15.47:0/3717290386 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190048070 con 0x56501d40ef30 2024-07-24T22:18:01.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.191+0000 7f917cff9640 1 -- 172.21.15.47:0/3717290386 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f919003cc80 con 0x56501d40ef30 2024-07-24T22:18:01.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.191+0000 7f917cff9640 1 -- 172.21.15.47:0/3717290386 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190032320 con 0x56501d40ef30 2024-07-24T22:18:01.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.191+0000 7f919f799740 1 -- 172.21.15.47:0/3717290386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 msgr2=0x56501d418e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:01.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.191+0000 7f919f799740 1 --2- 172.21.15.47:0/3717290386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 0x56501d418e20 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9190009850 tx=0x7f9190032c50 comp rx=0 tx=0).stop 2024-07-24T22:18:01.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 -- 172.21.15.47:0/3717290386 shutdown_connections 2024-07-24T22:18:01.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 --2- 172.21.15.47:0/3717290386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d41b7e0 0x56501d433590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 --2- 172.21.15.47:0/3717290386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 0x56501d433050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 --2- 172.21.15.47:0/3717290386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d40ef30 0x56501d418e20 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 -- 172.21.15.47:0/3717290386 >> 172.21.15.47:0/3717290386 conn(0x56501d40cd60 msgr2=0x56501d418710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 -- 172.21.15.47:0/3717290386 shutdown_connections 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 -- 172.21.15.47:0/3717290386 wait complete. 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 -- start start 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 Processor -- start 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40ef30 0x56501d423df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 0x56501d41f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 0x56501d41f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f91981acee0 con 0x56501d41b7e0 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f91981ae350 con 0x56501d40f850 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f91981ad5b0 con 0x56501d40ef30 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.192+0000 7f919f799740 10 client.0 _ll_register_callbacks cb 0x7f91900314a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f91977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 0x56501d41f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f91977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 0x56501d41f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47262/0 (socket says 172.21.15.47:47262) 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f91977fe640 1 -- 172.21.15.47:0/1013504052 learned_addr learned my addr 172.21.15.47:0/1013504052 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f91967fc640 1 --2- 172.21.15.47:0/1013504052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 0x56501d41f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f91977fe640 1 -- 172.21.15.47:0/1013504052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40ef30 msgr2=0x56501d423df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f91977fe640 1 --2- 172.21.15.47:0/1013504052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40ef30 0x56501d423df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f91977fe640 1 -- 172.21.15.47:0/1013504052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 msgr2=0x56501d41f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f91977fe640 1 --2- 172.21.15.47:0/1013504052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 0x56501d41f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f91977fe640 1 -- 172.21.15.47:0/1013504052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56501d4200f0 con 0x56501d41b7e0 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f91977fe640 1 --2- 172.21.15.47:0/1013504052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 0x56501d41f8f0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f919003c980 tx=0x7f9190005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0cc49bd84f68d1 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f917aff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f917aff5640 1 -- 172.21.15.47:0/1013504052 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190035070 con 0x56501d41b7e0 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f917aff5640 1 -- 172.21.15.47:0/1013504052 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f9190031c70 con 0x56501d41b7e0 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f919f799740 1 -- 172.21.15.47:0/1013504052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f919003cc80 con 0x56501d41b7e0 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f917aff5640 1 -- 172.21.15.47:0/1013504052 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9190048040 con 0x56501d41b7e0 2024-07-24T22:18:01.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f919f799740 10 client.17844 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.193+0000 7f919f799740 1 -- 172.21.15.47:0/1013504052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56501d496190 con 0x56501d41b7e0 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.194+0000 7f917aff5640 1 -- 172.21.15.47:0/1013504052 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f919003cc80 con 0x56501d41b7e0 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.194+0000 7f917aff5640 1 -- 172.21.15.47:0/1013504052 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f919005c030 con 0x56501d41b7e0 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.194+0000 7f919f799740 10 client.17844 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.194+0000 7f919f799740 10 client.17844 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.194+0000 7f919f799740 20 client.17844 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.194+0000 7f919f799740 1 --2- 172.21.15.47:0/1013504052 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56501d4966c0 0x56501d498ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.194+0000 7f919f799740 4 client.17844 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.194+0000 7f919f799740 1 -- 172.21.15.47:0/1013504052 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56501d3843e0 con 0x56501d4966c0 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.194+0000 7f91967fc640 1 --2- 172.21.15.47:0/1013504052 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56501d4966c0 0x56501d498ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.195+0000 7f91967fc640 1 --2- 172.21.15.47:0/1013504052 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56501d4966c0 0x56501d498ae0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a25664712263195 server_cookie=accbb9af32eaf805 in_seq=0 out_seq=0 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.195+0000 7f917aff5640 10 client.17844 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f917aff5640 1 -- 172.21.15.47:0/1013504052 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56501d3843e0 con 0x56501d4966c0 2024-07-24T22:18:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f917aff5640 10 client.17844 handle_command_reply: tid=0 2024-07-24T22:18:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f919f799740 1 client.17844 shutdown 2024-07-24T22:18:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f919f799740 1 -- 172.21.15.47:0/1013504052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 msgr2=0x56501d41f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f919f799740 1 --2- 172.21.15.47:0/1013504052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 0x56501d41f8f0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f919003c980 tx=0x7f9190005d90 comp rx=0 tx=0).stop 2024-07-24T22:18:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f919f799740 1 -- 172.21.15.47:0/1013504052 shutdown_connections 2024-07-24T22:18:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f919f799740 1 --2- 172.21.15.47:0/1013504052 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56501d4966c0 0x56501d498ae0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f917aff5640 0 client.17844 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f919f799740 1 --2- 172.21.15.47:0/1013504052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56501d41b7e0 0x56501d41f8f0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f919f799740 1 --2- 172.21.15.47:0/1013504052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56501d40f850 0x56501d41f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f919f799740 1 --2- 172.21.15.47:0/1013504052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56501d40ef30 0x56501d423df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f919f799740 1 -- 172.21.15.47:0/1013504052 >> 172.21.15.47:0/1013504052 conn(0x56501d40cd60 msgr2=0x56501d418f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f919f799740 1 -- 172.21.15.47:0/1013504052 shutdown_connections 2024-07-24T22:18:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f919f799740 1 -- 172.21.15.47:0/1013504052 wait complete. 2024-07-24T22:18:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.196+0000 7f919f799740 20 client.17844 trim_cache size 0 max 16384 2024-07-24T22:18:01.203 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:18:01.203 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:18:01.203 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "3eaf8a11-29a2-44ef-a69d-df0b6cb68a45", 2024-07-24T22:18:01.203 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:18:01.203 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:18:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.197+0000 7f919d3e8640 1 -- 172.21.15.47:0/934923048 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f91800b3dc0 msgr2=0x7f91800b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.197+0000 7f919d3e8640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f91800b3dc0 0x7f91800b6280 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f91880e1d40 tx=0x7f91880104d0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.197+0000 7f919d3e8640 1 -- 172.21.15.47:0/934923048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9198101650 msgr2=0x7f9198198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.197+0000 7f919d3e8640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9198101650 0x7f9198198c70 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f918800eab0 tx=0x7f918800ef70 comp rx=0 tx=0).stop 2024-07-24T22:18:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.197+0000 7f919d3e8640 1 -- 172.21.15.47:0/934923048 shutdown_connections 2024-07-24T22:18:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.197+0000 7f919d3e8640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f91800b3dc0 0x7f91800b6280 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.197+0000 7f919d3e8640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91981079e0 0x7f919819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.197+0000 7f919d3e8640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9198107060 0x7f91981991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.197+0000 7f919d3e8640 1 --2- 172.21.15.47:0/934923048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9198101650 0x7f9198198c70 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.197+0000 7f919d3e8640 1 -- 172.21.15.47:0/934923048 >> 172.21.15.47:0/934923048 conn(0x7f91980fd0c0 msgr2=0x7f91980fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.197+0000 7f919d3e8640 1 -- 172.21.15.47:0/934923048 shutdown_connections 2024-07-24T22:18:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:01.197+0000 7f919d3e8640 1 -- 172.21.15.47:0/934923048 wait complete. 2024-07-24T22:18:01.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:01 smithi047 ceph-mon[32551]: pgmap v700: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:18:01.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:01 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:18:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:01 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:01 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:18:01.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:01 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:02.009 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:18:02.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:01 smithi188 ceph-mon[37380]: pgmap v700: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:18:02.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:01 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:18:02.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:01 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:02.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:01 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:18:02.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:01 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:02.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:01 smithi183 ceph-mon[37007]: pgmap v700: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-07-24T22:18:02.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:01 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:18:02.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:01 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:02.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:01 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:18:02.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:01 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:03.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.483+0000 7f89c9323640 1 -- 172.21.15.47:0/3314451090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c4108b00 msgr2=0x7f89c410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:03.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.483+0000 7f89c9323640 1 --2- 172.21.15.47:0/3314451090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c4108b00 0x7f89c410f300 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009ca0 tx=0x7f89bc02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:18:03.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.483+0000 7f89c9323640 1 -- 172.21.15.47:0/3314451090 shutdown_connections 2024-07-24T22:18:03.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.483+0000 7f89c9323640 1 --2- 172.21.15.47:0/3314451090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c4108b00 0x7f89c410f300 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:03.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.483+0000 7f89c9323640 1 --2- 172.21.15.47:0/3314451090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89c4108180 0x7f89c41085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:03.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.483+0000 7f89c9323640 1 --2- 172.21.15.47:0/3314451090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f89c4102770 0x7f89c4102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:03.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.483+0000 7f89c9323640 1 -- 172.21.15.47:0/3314451090 >> 172.21.15.47:0/3314451090 conn(0x7f89c40fe1c0 msgr2=0x7f89c41005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:03.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.483+0000 7f89c9323640 1 -- 172.21.15.47:0/3314451090 shutdown_connections 2024-07-24T22:18:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.483+0000 7f89c9323640 1 -- 172.21.15.47:0/3314451090 wait complete. 2024-07-24T22:18:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.483+0000 7f89c9323640 1 Processor -- start 2024-07-24T22:18:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.483+0000 7f89c9323640 1 -- start start 2024-07-24T22:18:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c9323640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c4102770 0x7f89c4198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c9323640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89c4108180 0x7f89c4199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c9323640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f89c4108b00 0x7f89c419e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c9323640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89c4112730 con 0x7f89c4102770 2024-07-24T22:18:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c9323640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f89c41125b0 con 0x7f89c4108180 2024-07-24T22:18:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c9323640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f89c41128b0 con 0x7f89c4108b00 2024-07-24T22:18:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c4102770 0x7f89c4198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:03.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c4102770 0x7f89c4198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47272/0 (socket says 172.21.15.47:47272) 2024-07-24T22:18:03.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c2ffd640 1 -- 172.21.15.47:0/3632508488 learned_addr learned my addr 172.21.15.47:0/3632508488 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:03.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c37fe640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f89c4108b00 0x7f89c419e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:03.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89bbfff640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89c4108180 0x7f89c4199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:03.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c2ffd640 1 -- 172.21.15.47:0/3632508488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f89c4108b00 msgr2=0x7f89c419e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:03.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c2ffd640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f89c4108b00 0x7f89c419e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:03.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c2ffd640 1 -- 172.21.15.47:0/3632508488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89c4108180 msgr2=0x7f89c4199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:03.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c2ffd640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89c4108180 0x7f89c4199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:03.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c2ffd640 1 -- 172.21.15.47:0/3632508488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c419eca0 con 0x7f89c4102770 2024-07-24T22:18:03.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89bbfff640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89c4108180 0x7f89c4199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:03.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.484+0000 7f89c2ffd640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c4102770 0x7f89c4198bf0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f89b400e9f0 tx=0x7f89b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:03.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.485+0000 7f89c0ff9640 1 -- 172.21.15.47:0/3632508488 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b400cd80 con 0x7f89c4102770 2024-07-24T22:18:03.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.485+0000 7f89c0ff9640 1 -- 172.21.15.47:0/3632508488 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89b40054d0 con 0x7f89c4102770 2024-07-24T22:18:03.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.485+0000 7f89c9323640 1 -- 172.21.15.47:0/3632508488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c419ef90 con 0x7f89c4102770 2024-07-24T22:18:03.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.485+0000 7f89c0ff9640 1 -- 172.21.15.47:0/3632508488 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4010690 con 0x7f89c4102770 2024-07-24T22:18:03.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.485+0000 7f89c9323640 1 -- 172.21.15.47:0/3632508488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c41a5650 con 0x7f89c4102770 2024-07-24T22:18:03.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.486+0000 7f89c9323640 1 -- 172.21.15.47:0/3632508488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c4102b50 con 0x7f89c4102770 2024-07-24T22:18:03.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.487+0000 7f89c0ff9640 1 -- 172.21.15.47:0/3632508488 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f89b4004e30 con 0x7f89c4102770 2024-07-24T22:18:03.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.488+0000 7f89c0ff9640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f89b00b3d40 0x7f89b00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:03.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.488+0000 7f89bbfff640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f89b00b3d40 0x7f89b00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:03.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.488+0000 7f89c0ff9640 1 -- 172.21.15.47:0/3632508488 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7f89b40e4720 con 0x7f89c4102770 2024-07-24T22:18:03.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.489+0000 7f89bbfff640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f89b00b3d40 0x7f89b00b6200 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0058c0 tx=0x7f89ac005850 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:03.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.491+0000 7f89c0ff9640 1 -- 172.21.15.47:0/3632508488 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f89b40555e0 con 0x7f89c4102770 2024-07-24T22:18:03.537 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:03.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.743+0000 7f89c9323640 1 -- 172.21.15.47:0/3632508488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89c4199d20 con 0x7f89c4102770 2024-07-24T22:18:03.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.743+0000 7f89c0ff9640 1 -- 172.21.15.47:0/3632508488 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f89b40aba00 con 0x7f89c4102770 2024-07-24T22:18:03.746 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:18:03.746 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:18:03.746 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:18:03.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.745+0000 7f89c9323640 1 -- 172.21.15.47:0/3632508488 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f89b00b3d40 msgr2=0x7f89b00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:03.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.745+0000 7f89c9323640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f89b00b3d40 0x7f89b00b6200 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0058c0 tx=0x7f89ac005850 comp rx=0 tx=0).stop 2024-07-24T22:18:03.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.745+0000 7f89c9323640 1 -- 172.21.15.47:0/3632508488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c4102770 msgr2=0x7f89c4198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:03.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.745+0000 7f89c9323640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c4102770 0x7f89c4198bf0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f89b400e9f0 tx=0x7f89b400edf0 comp rx=0 tx=0).stop 2024-07-24T22:18:03.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.745+0000 7f89c9323640 1 -- 172.21.15.47:0/3632508488 shutdown_connections 2024-07-24T22:18:03.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.745+0000 7f89c9323640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f89b00b3d40 0x7f89b00b6200 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:03.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.745+0000 7f89c9323640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f89c4108b00 0x7f89c419e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:03.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.745+0000 7f89c9323640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89c4108180 0x7f89c4199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:03.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.746+0000 7f89c9323640 1 --2- 172.21.15.47:0/3632508488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c4102770 0x7f89c4198bf0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:03.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.746+0000 7f89c9323640 1 -- 172.21.15.47:0/3632508488 >> 172.21.15.47:0/3632508488 conn(0x7f89c40fe1c0 msgr2=0x7f89c41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:03.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.746+0000 7f89c9323640 1 -- 172.21.15.47:0/3632508488 shutdown_connections 2024-07-24T22:18:03.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:03.746+0000 7f89c9323640 1 -- 172.21.15.47:0/3632508488 wait complete. 2024-07-24T22:18:03.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:03 smithi047 ceph-mon[32551]: pgmap v701: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.4 KiB/s rd, 938 B/s wr, 3 op/s 2024-07-24T22:18:03.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:03 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3632508488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:04.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:03 smithi188 ceph-mon[37380]: pgmap v701: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.4 KiB/s rd, 938 B/s wr, 3 op/s 2024-07-24T22:18:04.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:03 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3632508488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:04.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.056+0000 7efe3946c640 1 -- 172.21.15.47:0/1721908011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe3410ca30 msgr2=0x7efe3410eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:04.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.056+0000 7efe3946c640 1 --2- 172.21.15.47:0/1721908011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe3410ca30 0x7efe3410eeb0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009ca0 tx=0x7efe2c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.056+0000 7efe3946c640 1 -- 172.21.15.47:0/1721908011 shutdown_connections 2024-07-24T22:18:04.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.056+0000 7efe3946c640 1 --2- 172.21.15.47:0/1721908011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe3410ca30 0x7efe3410eeb0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.056+0000 7efe3946c640 1 --2- 172.21.15.47:0/1721908011 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe34103f00 0x7efe3410c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.056+0000 7efe3946c640 1 --2- 172.21.15.47:0/1721908011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe341035e0 0x7efe341039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.056+0000 7efe3946c640 1 -- 172.21.15.47:0/1721908011 >> 172.21.15.47:0/1721908011 conn(0x7efe340fd030 msgr2=0x7efe340ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.056+0000 7efe3946c640 1 -- 172.21.15.47:0/1721908011 shutdown_connections 2024-07-24T22:18:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.056+0000 7efe3946c640 1 -- 172.21.15.47:0/1721908011 wait complete. 2024-07-24T22:18:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.057+0000 7efe3946c640 1 Processor -- start 2024-07-24T22:18:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.057+0000 7efe3946c640 1 -- start start 2024-07-24T22:18:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.057+0000 7efe3946c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe341035e0 0x7efe34101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.057+0000 7efe3946c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe34103f00 0x7efe341017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.057+0000 7efe3946c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe3410ca30 0x7efe34101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.057+0000 7efe3946c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efe341126a0 con 0x7efe341035e0 2024-07-24T22:18:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.057+0000 7efe3946c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efe34112520 con 0x7efe3410ca30 2024-07-24T22:18:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.057+0000 7efe3946c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efe34112820 con 0x7efe34103f00 2024-07-24T22:18:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.057+0000 7efe32ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe341035e0 0x7efe34101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.057+0000 7efe32ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe341035e0 0x7efe34101280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47300/0 (socket says 172.21.15.47:47300) 2024-07-24T22:18:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.057+0000 7efe32ffd640 1 -- 172.21.15.47:0/3221335810 learned_addr learned my addr 172.21.15.47:0/3221335810 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.058+0000 7efe337fe640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe3410ca30 0x7efe34101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.058+0000 7efe32ffd640 1 -- 172.21.15.47:0/3221335810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe34103f00 msgr2=0x7efe341017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.058+0000 7efe32ffd640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe34103f00 0x7efe341017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.058+0000 7efe32ffd640 1 -- 172.21.15.47:0/3221335810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe3410ca30 msgr2=0x7efe34101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.058+0000 7efe32ffd640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe3410ca30 0x7efe34101d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.058+0000 7efe32ffd640 1 -- 172.21.15.47:0/3221335810 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe341a6f30 con 0x7efe341035e0 2024-07-24T22:18:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.058+0000 7efe337fe640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe3410ca30 0x7efe34101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.058+0000 7efe32ffd640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe341035e0 0x7efe34101280 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7efe2400d950 tx=0x7efe2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:04.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.058+0000 7efe30ff9640 1 -- 172.21.15.47:0/3221335810 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe24017070 con 0x7efe341035e0 2024-07-24T22:18:04.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.058+0000 7efe30ff9640 1 -- 172.21.15.47:0/3221335810 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe24009c30 con 0x7efe341035e0 2024-07-24T22:18:04.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.058+0000 7efe3946c640 1 -- 172.21.15.47:0/3221335810 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe341a7220 con 0x7efe341035e0 2024-07-24T22:18:04.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.058+0000 7efe30ff9640 1 -- 172.21.15.47:0/3221335810 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2400f620 con 0x7efe341035e0 2024-07-24T22:18:04.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.058+0000 7efe3946c640 1 -- 172.21.15.47:0/3221335810 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe341a77c0 con 0x7efe341035e0 2024-07-24T22:18:04.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.061+0000 7efe30ff9640 1 -- 172.21.15.47:0/3221335810 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7efe24010460 con 0x7efe341035e0 2024-07-24T22:18:04.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.061+0000 7efe3c1c9740 1 Processor -- start 2024-07-24T22:18:04.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.061+0000 7efe3c1c9740 1 -- start start 2024-07-24T22:18:04.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.061+0000 7efe3c1c9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.061+0000 7efe3c1c9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.061+0000 7efe3c1c9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8d1170 0x55f2bd8d3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.061+0000 7efe3c1c9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f2bd83a280 con 0x55f2bd8c48c0 2024-07-24T22:18:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.061+0000 7efe3c1c9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f2bd829780 con 0x55f2bd8c51e0 2024-07-24T22:18:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.061+0000 7efe3c1c9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f2bd82d7c0 con 0x55f2bd8d1170 2024-07-24T22:18:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.061+0000 7efe337fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.061+0000 7efe337fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47308/0 (socket says 172.21.15.47:47308) 2024-07-24T22:18:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.061+0000 7efe337fe640 1 -- 172.21.15.47:0/90816573 learned_addr learned my addr 172.21.15.47:0/90816573 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe32ffd640 1 --2- 172.21.15.47:0/90816573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe337fe640 1 -- 172.21.15.47:0/90816573 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8d1170 msgr2=0x55f2bd8d3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe337fe640 1 --2- 172.21.15.47:0/90816573 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8d1170 0x55f2bd8d3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe337fe640 1 -- 172.21.15.47:0/90816573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c51e0 msgr2=0x55f2bd8d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe337fe640 1 --2- 172.21.15.47:0/90816573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8d0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe337fe640 1 -- 172.21.15.47:0/90816573 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2bd58d790 con 0x55f2bd8c48c0 2024-07-24T22:18:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe30ff9640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efe200b3dc0 0x7efe200b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe32ffd640 1 --2- 172.21.15.47:0/90816573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8d0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe32ffd640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efe200b3dc0 0x7efe200b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe337fe640 1 --2- 172.21.15.47:0/90816573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8c4ca0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0098e0 tx=0x7efe2c009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d01f419827e67c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe30ff9640 1 -- 172.21.15.47:0/3221335810 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7efe240e3cb0 con 0x7efe341035e0 2024-07-24T22:18:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe297fa640 1 -- 172.21.15.47:0/90816573 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c031df0 con 0x55f2bd8c48c0 2024-07-24T22:18:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe297fa640 1 -- 172.21.15.47:0/90816573 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe2c036070 con 0x55f2bd8c48c0 2024-07-24T22:18:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.062+0000 7efe297fa640 1 -- 172.21.15.47:0/90816573 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c004380 con 0x55f2bd8c48c0 2024-07-24T22:18:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.063+0000 7efe3c1c9740 1 -- 172.21.15.47:0/90816573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 msgr2=0x55f2bd8c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.063+0000 7efe32ffd640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efe200b3dc0 0x7efe200b6280 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efe240e1480 tx=0x7efe24010cb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.063+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/90816573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8c4ca0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0098e0 tx=0x7efe2c009910 comp rx=0 tx=0).stop 2024-07-24T22:18:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.063+0000 7efe3c1c9740 1 -- 172.21.15.47:0/90816573 shutdown_connections 2024-07-24T22:18:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.063+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/90816573 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8d1170 0x55f2bd8d3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.063+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/90816573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8d0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.063+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/90816573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8c4ca0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.063+0000 7efe3c1c9740 1 -- 172.21.15.47:0/90816573 >> 172.21.15.47:0/90816573 conn(0x55f2bd8c26f0 msgr2=0x55f2bd8c3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.063+0000 7efe3c1c9740 1 -- 172.21.15.47:0/90816573 shutdown_connections 2024-07-24T22:18:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.063+0000 7efe3c1c9740 1 -- 172.21.15.47:0/90816573 wait complete. 2024-07-24T22:18:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.063+0000 7efe3c1c9740 1 -- start start 2024-07-24T22:18:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe3c1c9740 1 Processor -- start 2024-07-24T22:18:04.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe3c1c9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe3c1c9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe3c1c9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8d1170 0x55f2bd8ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe3c1c9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f2bd763ab0 con 0x55f2bd8c51e0 2024-07-24T22:18:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe3c1c9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f2bd7b19e0 con 0x55f2bd8c48c0 2024-07-24T22:18:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe3c1c9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f2bd8d3df0 con 0x55f2bd8d1170 2024-07-24T22:18:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe3c1c9740 10 client.0 _ll_register_callbacks cb 0x55f2bd539a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe2a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe2a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8cddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47324/0 (socket says 172.21.15.47:47324) 2024-07-24T22:18:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe2a7fc640 1 -- 172.21.15.47:0/2939221834 learned_addr learned my addr 172.21.15.47:0/2939221834 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe337fe640 1 --2- 172.21.15.47:0/2939221834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8d1170 0x55f2bd8ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe337fe640 1 --2- 172.21.15.47:0/2939221834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe2a7fc640 1 -- 172.21.15.47:0/2939221834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8d1170 msgr2=0x55f2bd8ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe2a7fc640 1 --2- 172.21.15.47:0/2939221834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8d1170 0x55f2bd8ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe2a7fc640 1 -- 172.21.15.47:0/2939221834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c48c0 msgr2=0x55f2bd8d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe2a7fc640 1 --2- 172.21.15.47:0/2939221834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe2a7fc640 1 -- 172.21.15.47:0/2939221834 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2bd606620 con 0x55f2bd8c51e0 2024-07-24T22:18:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe2a7fc640 1 --2- 172.21.15.47:0/2939221834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8cddc0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00c3a0 tx=0x7efe1c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbc2ead044ac468 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.064+0000 7efe1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe1a7fc640 1 -- 172.21.15.47:0/2939221834 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c004220 con 0x55f2bd8c51e0 2024-07-24T22:18:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe1a7fc640 1 -- 172.21.15.47:0/2939221834 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7efe1c0043c0 con 0x55f2bd8c51e0 2024-07-24T22:18:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe3c1c9740 1 -- 172.21.15.47:0/2939221834 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f2bd7d8ce0 con 0x55f2bd8c51e0 2024-07-24T22:18:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe1a7fc640 1 -- 172.21.15.47:0/2939221834 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efe1c01f050 con 0x55f2bd8c51e0 2024-07-24T22:18:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe3c1c9740 10 client.17862 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe3c1c9740 1 -- 172.21.15.47:0/2939221834 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f2bd8df600 con 0x55f2bd8c51e0 2024-07-24T22:18:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe1a7fc640 1 -- 172.21.15.47:0/2939221834 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f2bd7d8ce0 con 0x55f2bd8c51e0 2024-07-24T22:18:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe1a7fc640 1 -- 172.21.15.47:0/2939221834 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7efe1c00e680 con 0x55f2bd8c51e0 2024-07-24T22:18:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe3c1c9740 10 client.17862 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe3c1c9740 10 client.17862 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe3c1c9740 20 client.17862 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/2939221834 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f2bd8e0ac0 0x55f2bd8e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe3c1c9740 4 client.17862 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.065+0000 7efe3c1c9740 1 -- 172.21.15.47:0/2939221834 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2bd83c1d0 con 0x55f2bd8e0ac0 2024-07-24T22:18:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.066+0000 7efe337fe640 1 --2- 172.21.15.47:0/2939221834 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f2bd8e0ac0 0x55f2bd8e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.066+0000 7efe1a7fc640 10 client.17862 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.066+0000 7efe337fe640 1 --2- 172.21.15.47:0/2939221834 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f2bd8e0ac0 0x55f2bd8e2f20 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94d5aab9dc22ebfa server_cookie=7afa6c98b1f7759e in_seq=0 out_seq=0 2024-07-24T22:18:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe1a7fc640 1 -- 172.21.15.47:0/2939221834 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2bd83c1d0 con 0x55f2bd8e0ac0 2024-07-24T22:18:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe1a7fc640 10 client.17862 handle_command_reply: tid=0 2024-07-24T22:18:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe3c1c9740 1 client.17862 shutdown 2024-07-24T22:18:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe3c1c9740 1 -- 172.21.15.47:0/2939221834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c51e0 msgr2=0x55f2bd8cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/2939221834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8cddc0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00c3a0 tx=0x7efe1c00c860 comp rx=0 tx=0).stop 2024-07-24T22:18:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe3c1c9740 1 -- 172.21.15.47:0/2939221834 shutdown_connections 2024-07-24T22:18:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/2939221834 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f2bd8e0ac0 0x55f2bd8e2f20 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/2939221834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8d1170 0x55f2bd8ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/2939221834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8cddc0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe1a7fc640 0 client.17862 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/2939221834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe3c1c9740 1 -- 172.21.15.47:0/2939221834 >> 172.21.15.47:0/2939221834 conn(0x55f2bd8c26f0 msgr2=0x55f2bd8c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe3c1c9740 1 -- 172.21.15.47:0/2939221834 shutdown_connections 2024-07-24T22:18:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe3c1c9740 1 -- 172.21.15.47:0/2939221834 wait complete. 2024-07-24T22:18:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.067+0000 7efe3c1c9740 20 client.17862 trim_cache size 0 max 16384 2024-07-24T22:18:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.082+0000 7efe3c1c9740 1 Processor -- start 2024-07-24T22:18:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe3c1c9740 1 -- start start 2024-07-24T22:18:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe3c1c9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8dcf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe3c1c9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe3c1c9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8d1170 0x55f2bd8ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe3c1c9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efe341ae2e0 con 0x55f2bd8c48c0 2024-07-24T22:18:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe3c1c9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efe341b0b40 con 0x55f2bd8c51e0 2024-07-24T22:18:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe3c1c9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efe341ae930 con 0x55f2bd8d1170 2024-07-24T22:18:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe337fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8dcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe337fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8dcf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47338/0 (socket says 172.21.15.47:47338) 2024-07-24T22:18:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe337fe640 1 -- 172.21.15.47:0/3469110587 learned_addr learned my addr 172.21.15.47:0/3469110587 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe2a7fc640 1 --2- 172.21.15.47:0/3469110587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe337fe640 1 -- 172.21.15.47:0/3469110587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8d1170 msgr2=0x55f2bd8ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe337fe640 1 --2- 172.21.15.47:0/3469110587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8d1170 0x55f2bd8ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe337fe640 1 -- 172.21.15.47:0/3469110587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c51e0 msgr2=0x55f2bd8cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe337fe640 1 --2- 172.21.15.47:0/3469110587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe337fe640 1 -- 172.21.15.47:0/3469110587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2bd8c5010 con 0x55f2bd8c48c0 2024-07-24T22:18:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.083+0000 7efe2a7fc640 1 --2- 172.21.15.47:0/3469110587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:04.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.084+0000 7efe337fe640 1 --2- 172.21.15.47:0/3469110587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8dcf10 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0098e0 tx=0x7efe2c03d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955a78c977f86b7d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:04.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.084+0000 7efe28ff9640 1 -- 172.21.15.47:0/3469110587 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c003cf0 con 0x55f2bd8c48c0 2024-07-24T22:18:04.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.084+0000 7efe28ff9640 1 -- 172.21.15.47:0/3469110587 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe2c036040 con 0x55f2bd8c48c0 2024-07-24T22:18:04.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.084+0000 7efe28ff9640 1 -- 172.21.15.47:0/3469110587 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c004830 con 0x55f2bd8c48c0 2024-07-24T22:18:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.084+0000 7efe3c1c9740 1 -- 172.21.15.47:0/3469110587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 msgr2=0x55f2bd8dcf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.084+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/3469110587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8dcf10 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0098e0 tx=0x7efe2c03d040 comp rx=0 tx=0).stop 2024-07-24T22:18:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 -- 172.21.15.47:0/3469110587 shutdown_connections 2024-07-24T22:18:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/3469110587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8d1170 0x55f2bd8ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/3469110587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/3469110587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8dcf10 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 -- 172.21.15.47:0/3469110587 >> 172.21.15.47:0/3469110587 conn(0x55f2bd8c26f0 msgr2=0x55f2bd8cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 -- 172.21.15.47:0/3469110587 shutdown_connections 2024-07-24T22:18:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 -- 172.21.15.47:0/3469110587 wait complete. 2024-07-24T22:18:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 -- start start 2024-07-24T22:18:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 Processor -- start 2024-07-24T22:18:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8d6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8d6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8d1170 0x55f2bd8d6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efe341af000 con 0x55f2bd8c48c0 2024-07-24T22:18:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efe341b0470 con 0x55f2bd8d1170 2024-07-24T22:18:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efe341af6d0 con 0x55f2bd8c51e0 2024-07-24T22:18:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe3c1c9740 10 client.0 _ll_register_callbacks cb 0x7efe3406bd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe337fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8d6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe337fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8d6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47352/0 (socket says 172.21.15.47:47352) 2024-07-24T22:18:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.085+0000 7efe337fe640 1 -- 172.21.15.47:0/345638940 learned_addr learned my addr 172.21.15.47:0/345638940 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe2a7fc640 1 --2- 172.21.15.47:0/345638940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8d6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe337fe640 1 -- 172.21.15.47:0/345638940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8c51e0 msgr2=0x55f2bd8d6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe337fe640 1 --2- 172.21.15.47:0/345638940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8d6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe337fe640 1 -- 172.21.15.47:0/345638940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8d1170 msgr2=0x55f2bd8d6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe337fe640 1 --2- 172.21.15.47:0/345638940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8d1170 0x55f2bd8d6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe337fe640 1 -- 172.21.15.47:0/345638940 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2bd949a90 con 0x55f2bd8c48c0 2024-07-24T22:18:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe337fe640 1 --2- 172.21.15.47:0/345638940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8d6140 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009430 tx=0x7efe2c003cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c8190ffead3126 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe1a7fc640 1 -- 172.21.15.47:0/345638940 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c05c070 con 0x55f2bd8c48c0 2024-07-24T22:18:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe1a7fc640 1 -- 172.21.15.47:0/345638940 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8565+0+0 (secure 0 0 0) 0x7efe2c004040 con 0x55f2bd8c48c0 2024-07-24T22:18:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe3c1c9740 1 -- 172.21.15.47:0/345638940 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe2c036040 con 0x55f2bd8c48c0 2024-07-24T22:18:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe1a7fc640 1 -- 172.21.15.47:0/345638940 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efe2c004240 con 0x55f2bd8c48c0 2024-07-24T22:18:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe3c1c9740 10 client.17868 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe3c1c9740 1 -- 172.21.15.47:0/345638940 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f2bd94ada0 con 0x55f2bd8c48c0 2024-07-24T22:18:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.086+0000 7efe1a7fc640 1 -- 172.21.15.47:0/345638940 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe2c036040 con 0x55f2bd8c48c0 2024-07-24T22:18:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.087+0000 7efe1a7fc640 1 -- 172.21.15.47:0/345638940 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7efe2c02f780 con 0x55f2bd8c48c0 2024-07-24T22:18:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.087+0000 7efe3c1c9740 10 client.17868 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.087+0000 7efe3c1c9740 10 client.17868 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.087+0000 7efe3c1c9740 20 client.17868 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.087+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/345638940 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f2bd94afc0 0x55f2bd94d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.087+0000 7efe3c1c9740 4 client.17868 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:18:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.087+0000 7efe3c1c9740 1 -- 172.21.15.47:0/345638940 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f2bd837c70 con 0x55f2bd94afc0 2024-07-24T22:18:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.087+0000 7efe2a7fc640 1 --2- 172.21.15.47:0/345638940 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f2bd94afc0 0x55f2bd94d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:04.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.087+0000 7efe2a7fc640 1 --2- 172.21.15.47:0/345638940 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f2bd94afc0 0x55f2bd94d3b0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7aff0afa1082ad6 server_cookie=4f53535a91bebfa0 in_seq=0 out_seq=0 2024-07-24T22:18:04.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:04.087+0000 7efe1a7fc640 10 client.17868 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:04.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:03 smithi183 ceph-mon[37007]: pgmap v701: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.4 KiB/s rd, 938 B/s wr, 3 op/s 2024-07-24T22:18:04.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:03 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3632508488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:04.577 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db / --timeout 90 --expiration 147.5 --await-for 45.0' 2024-07-24T22:18:04.578 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db / --timeout 90 --expiration 147.5 --await-for 45.0 2024-07-24T22:18:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe1a7fc640 1 -- 172.21.15.47:0/345638940 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f2bd837c70 con 0x55f2bd94afc0 2024-07-24T22:18:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe1a7fc640 10 client.17868 handle_command_reply: tid=0 2024-07-24T22:18:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe3c1c9740 1 client.17868 shutdown 2024-07-24T22:18:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe3c1c9740 1 -- 172.21.15.47:0/345638940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 msgr2=0x55f2bd8d6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/345638940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8d6140 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009430 tx=0x7efe2c003cf0 comp rx=0 tx=0).stop 2024-07-24T22:18:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe3c1c9740 1 -- 172.21.15.47:0/345638940 shutdown_connections 2024-07-24T22:18:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/345638940 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55f2bd94afc0 0x55f2bd94d3b0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/345638940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f2bd8d1170 0x55f2bd8d6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe1a7fc640 0 client.17868 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/345638940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f2bd8c51e0 0x55f2bd8d6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe3c1c9740 1 --2- 172.21.15.47:0/345638940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2bd8c48c0 0x55f2bd8d6140 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe3c1c9740 1 -- 172.21.15.47:0/345638940 >> 172.21.15.47:0/345638940 conn(0x55f2bd8c26f0 msgr2=0x55f2bd8cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe3c1c9740 1 -- 172.21.15.47:0/345638940 shutdown_connections 2024-07-24T22:18:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.116+0000 7efe3c1c9740 1 -- 172.21.15.47:0/345638940 wait complete. 2024-07-24T22:18:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.117+0000 7efe3c1c9740 20 client.17868 trim_cache size 0 max 16384 2024-07-24T22:18:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:18:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:18:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:18:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:18:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.117+0000 7efe3946c640 1 -- 172.21.15.47:0/3221335810 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efe200b3dc0 msgr2=0x7efe200b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.117+0000 7efe3946c640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efe200b3dc0 0x7efe200b6280 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efe240e1480 tx=0x7efe24010cb0 comp rx=0 tx=0).stop 2024-07-24T22:18:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.117+0000 7efe3946c640 1 -- 172.21.15.47:0/3221335810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe341035e0 msgr2=0x7efe34101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.117+0000 7efe3946c640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe341035e0 0x7efe34101280 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7efe2400d950 tx=0x7efe2400de10 comp rx=0 tx=0).stop 2024-07-24T22:18:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.117+0000 7efe3946c640 1 -- 172.21.15.47:0/3221335810 shutdown_connections 2024-07-24T22:18:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.117+0000 7efe3946c640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7efe200b3dc0 0x7efe200b6280 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.117+0000 7efe3946c640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe3410ca30 0x7efe34101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.117+0000 7efe3946c640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe34103f00 0x7efe341017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.117+0000 7efe3946c640 1 --2- 172.21.15.47:0/3221335810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe341035e0 0x7efe34101280 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.117+0000 7efe3946c640 1 -- 172.21.15.47:0/3221335810 >> 172.21.15.47:0/3221335810 conn(0x7efe340fd030 msgr2=0x7efe3410ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.118+0000 7efe3946c640 1 -- 172.21.15.47:0/3221335810 shutdown_connections 2024-07-24T22:18:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:05.118+0000 7efe3946c640 1 -- 172.21.15.47:0/3221335810 wait complete. 2024-07-24T22:18:05.594 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:06.120 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:05 smithi047 ceph-mon[32551]: pgmap v702: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-07-24T22:18:06.121 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:05 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:18:06.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:05 smithi183 ceph-mon[37007]: pgmap v702: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-07-24T22:18:06.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:05 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:18:06.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:05 smithi188 ceph-mon[37380]: pgmap v702: 97 pgs: 97 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-07-24T22:18:06.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:05 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:18:06.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.323+0000 7f95d7ede640 1 -- 172.21.15.47:0/1430374857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d01079e0 msgr2=0x7f95d010e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:06.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.323+0000 7f95d7ede640 1 --2- 172.21.15.47:0/1430374857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d01079e0 0x7f95d010e1e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009ca0 tx=0x7f95c002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.323+0000 7f95d7ede640 1 -- 172.21.15.47:0/1430374857 shutdown_connections 2024-07-24T22:18:06.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.323+0000 7f95d7ede640 1 --2- 172.21.15.47:0/1430374857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d01079e0 0x7f95d010e1e0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.323+0000 7f95d7ede640 1 --2- 172.21.15.47:0/1430374857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95d0107060 0x7f95d01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.323+0000 7f95d7ede640 1 --2- 172.21.15.47:0/1430374857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d0101650 0x7f95d0101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.323+0000 7f95d7ede640 1 -- 172.21.15.47:0/1430374857 >> 172.21.15.47:0/1430374857 conn(0x7f95d00fd0c0 msgr2=0x7f95d00ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:06.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.323+0000 7f95d7ede640 1 -- 172.21.15.47:0/1430374857 shutdown_connections 2024-07-24T22:18:06.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.323+0000 7f95d7ede640 1 -- 172.21.15.47:0/1430374857 wait complete. 2024-07-24T22:18:06.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d7ede640 1 Processor -- start 2024-07-24T22:18:06.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d7ede640 1 -- start start 2024-07-24T22:18:06.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d7ede640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95d0101650 0x7f95d00fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d7ede640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0107060 0x7f95d00fdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d7ede640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d01079e0 0x7f95d00fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d7ede640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f95d0111610 con 0x7f95d0107060 2024-07-24T22:18:06.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d7ede640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f95d0111490 con 0x7f95d01079e0 2024-07-24T22:18:06.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d7ede640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f95d0111790 con 0x7f95d0101650 2024-07-24T22:18:06.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d5479640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0107060 0x7f95d00fdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d5479640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0107060 0x7f95d00fdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43128/0 (socket says 172.21.15.47:43128) 2024-07-24T22:18:06.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d5479640 1 -- 172.21.15.47:0/4213754039 learned_addr learned my addr 172.21.15.47:0/4213754039 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:06.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d647b640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d01079e0 0x7f95d00fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d5c7a640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95d0101650 0x7f95d00fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d5479640 1 -- 172.21.15.47:0/4213754039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95d0101650 msgr2=0x7f95d00fd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:06.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d5479640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95d0101650 0x7f95d00fd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d5479640 1 -- 172.21.15.47:0/4213754039 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d01079e0 msgr2=0x7f95d00fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:06.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d5479640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d01079e0 0x7f95d00fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.324+0000 7f95d5479640 1 -- 172.21.15.47:0/4213754039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d01a7010 con 0x7f95d0107060 2024-07-24T22:18:06.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.325+0000 7f95d5479640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0107060 0x7f95d00fdb00 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f95c400d950 tx=0x7f95c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:06.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.325+0000 7f95ceffd640 1 -- 172.21.15.47:0/4213754039 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4017030 con 0x7f95d0107060 2024-07-24T22:18:06.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.325+0000 7f95d7ede640 1 -- 172.21.15.47:0/4213754039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d01a7300 con 0x7f95d0107060 2024-07-24T22:18:06.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.325+0000 7f95ceffd640 1 -- 172.21.15.47:0/4213754039 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95c4004020 con 0x7f95d0107060 2024-07-24T22:18:06.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.325+0000 7f95ceffd640 1 -- 172.21.15.47:0/4213754039 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c40047a0 con 0x7f95d0107060 2024-07-24T22:18:06.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.325+0000 7f95d7ede640 1 -- 172.21.15.47:0/4213754039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d01a7890 con 0x7f95d0107060 2024-07-24T22:18:06.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.327+0000 7f95da28f740 1 Processor -- start 2024-07-24T22:18:06.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95da28f740 1 -- start start 2024-07-24T22:18:06.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95ceffd640 1 -- 172.21.15.47:0/4213754039 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f95c4009a30 con 0x7f95d0107060 2024-07-24T22:18:06.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95da28f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 0x555f1c971a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95da28f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c971fd0 0x555f1c97da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95da28f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 0x555f1c980350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95da28f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555f1c8e8990 con 0x555f1c9716b0 2024-07-24T22:18:06.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95da28f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555f1c8d7e90 con 0x555f1c971fd0 2024-07-24T22:18:06.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95da28f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555f1c8dbed0 con 0x555f1c97df60 2024-07-24T22:18:06.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95d647b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 0x555f1c971a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95d647b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 0x555f1c971a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43140/0 (socket says 172.21.15.47:43140) 2024-07-24T22:18:06.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95d647b640 1 -- 172.21.15.47:0/3516205509 learned_addr learned my addr 172.21.15.47:0/3516205509 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:06.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95d5c7a640 1 --2- 172.21.15.47:0/3516205509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c971fd0 0x555f1c97da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95d5479640 1 --2- 172.21.15.47:0/3516205509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 0x555f1c980350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95d647b640 1 -- 172.21.15.47:0/3516205509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 msgr2=0x555f1c980350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:06.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95d647b640 1 --2- 172.21.15.47:0/3516205509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 0x555f1c980350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95d647b640 1 -- 172.21.15.47:0/3516205509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c971fd0 msgr2=0x555f1c97da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:06.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95d647b640 1 --2- 172.21.15.47:0/3516205509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c971fd0 0x555f1c97da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.328+0000 7f95d647b640 1 -- 172.21.15.47:0/3516205509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f1c861300 con 0x555f1c9716b0 2024-07-24T22:18:06.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.329+0000 7f95d647b640 1 --2- 172.21.15.47:0/3516205509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 0x555f1c971a90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009ca0 tx=0x7f95c00098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4624955b0079fd server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:06.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.329+0000 7f95ceffd640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95b80b3d40 0x7f95b80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.329+0000 7f95d5c7a640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95b80b3d40 0x7f95b80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.329+0000 7f95b7fff640 1 -- 172.21.15.47:0/3516205509 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0031db0 con 0x555f1c9716b0 2024-07-24T22:18:06.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.329+0000 7f95b7fff640 1 -- 172.21.15.47:0/3516205509 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95c0036030 con 0x555f1c9716b0 2024-07-24T22:18:06.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.329+0000 7f95ceffd640 1 -- 172.21.15.47:0/4213754039 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f95c40e3a40 con 0x7f95d0107060 2024-07-24T22:18:06.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.329+0000 7f95b7fff640 1 -- 172.21.15.47:0/3516205509 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c00042a0 con 0x555f1c9716b0 2024-07-24T22:18:06.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.330+0000 7f95da28f740 1 -- 172.21.15.47:0/3516205509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 msgr2=0x555f1c971a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:06.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.330+0000 7f95da28f740 1 --2- 172.21.15.47:0/3516205509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 0x555f1c971a90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009ca0 tx=0x7f95c00098b0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.330+0000 7f95d5c7a640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95b80b3d40 0x7f95b80b6200 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x555f1c9703c0 tx=0x7f95c800b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:06.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.330+0000 7f95da28f740 1 -- 172.21.15.47:0/3516205509 shutdown_connections 2024-07-24T22:18:06.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.330+0000 7f95da28f740 1 --2- 172.21.15.47:0/3516205509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 0x555f1c980350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.330+0000 7f95da28f740 1 --2- 172.21.15.47:0/3516205509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c971fd0 0x555f1c97da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.330+0000 7f95da28f740 1 --2- 172.21.15.47:0/3516205509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 0x555f1c971a90 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.330+0000 7f95da28f740 1 -- 172.21.15.47:0/3516205509 >> 172.21.15.47:0/3516205509 conn(0x555f1c96f4e0 msgr2=0x555f1c970680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:06.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.330+0000 7f95da28f740 1 -- 172.21.15.47:0/3516205509 shutdown_connections 2024-07-24T22:18:06.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.330+0000 7f95da28f740 1 -- 172.21.15.47:0/3516205509 wait complete. 2024-07-24T22:18:06.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.330+0000 7f95da28f740 1 -- start start 2024-07-24T22:18:06.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.330+0000 7f95da28f740 1 Processor -- start 2024-07-24T22:18:06.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95da28f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c9716b0 0x555f1c97aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95da28f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c971fd0 0x555f1c97b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95da28f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c97df60 0x555f1c97b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95da28f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555f1c73b700 con 0x555f1c97df60 2024-07-24T22:18:06.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95da28f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555f1c87a5d0 con 0x555f1c9716b0 2024-07-24T22:18:06.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95da28f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555f1c980a00 con 0x555f1c971fd0 2024-07-24T22:18:06.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95da28f740 10 client.0 _ll_register_callbacks cb 0x555f1c89a940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:06.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95d647b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c97df60 0x555f1c97b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95d647b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c97df60 0x555f1c97b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43144/0 (socket says 172.21.15.47:43144) 2024-07-24T22:18:06.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95d647b640 1 -- 172.21.15.47:0/569254631 learned_addr learned my addr 172.21.15.47:0/569254631 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:06.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95d5c7a640 1 --2- 172.21.15.47:0/569254631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c9716b0 0x555f1c97aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95d5479640 1 --2- 172.21.15.47:0/569254631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c971fd0 0x555f1c97b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95d647b640 1 -- 172.21.15.47:0/569254631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c971fd0 msgr2=0x555f1c97b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:06.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95d647b640 1 --2- 172.21.15.47:0/569254631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c971fd0 0x555f1c97b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95d647b640 1 -- 172.21.15.47:0/569254631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c9716b0 msgr2=0x555f1c97aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:06.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95d647b640 1 --2- 172.21.15.47:0/569254631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c9716b0 0x555f1c97aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.331+0000 7f95d647b640 1 -- 172.21.15.47:0/569254631 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f1c86d660 con 0x555f1c97df60 2024-07-24T22:18:06.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95d647b640 1 --2- 172.21.15.47:0/569254631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c97df60 0x555f1c97b960 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f95c002a900 tx=0x7f95c0005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbeef00d57ebbe7d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:06.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:06.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95b57fa640 1 -- 172.21.15.47:0/569254631 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c004a040 con 0x555f1c97df60 2024-07-24T22:18:06.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95b57fa640 1 -- 172.21.15.47:0/569254631 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f95c0031650 con 0x555f1c97df60 2024-07-24T22:18:06.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95da28f740 1 -- 172.21.15.47:0/569254631 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95c0036030 con 0x555f1c97df60 2024-07-24T22:18:06.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95b57fa640 1 -- 172.21.15.47:0/569254631 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f95c0031850 con 0x555f1c97df60 2024-07-24T22:18:06.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95da28f740 10 client.17880 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95da28f740 1 -- 172.21.15.47:0/569254631 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555f1c638650 con 0x555f1c97df60 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95b57fa640 1 -- 172.21.15.47:0/569254631 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95c0036030 con 0x555f1c97df60 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95b57fa640 1 -- 172.21.15.47:0/569254631 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f95c004d030 con 0x555f1c97df60 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95da28f740 10 client.17880 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95da28f740 10 client.17880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95da28f740 20 client.17880 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95da28f740 1 --2- 172.21.15.47:0/569254631 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555f1c98d6f0 0x555f1c98fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95da28f740 4 client.17880 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.332+0000 7f95da28f740 1 -- 172.21.15.47:0/569254631 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f1c8ea8e0 con 0x555f1c98d6f0 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.333+0000 7f95d5c7a640 1 --2- 172.21.15.47:0/569254631 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555f1c98d6f0 0x555f1c98fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.333+0000 7f95b57fa640 10 client.17880 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.333+0000 7f95d5c7a640 1 --2- 172.21.15.47:0/569254631 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555f1c98d6f0 0x555f1c98fae0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8ef78e8e01bef6c server_cookie=7cb3a22a77ea67f1 in_seq=0 out_seq=0 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95b57fa640 1 -- 172.21.15.47:0/569254631 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f1c8ea8e0 con 0x555f1c98d6f0 2024-07-24T22:18:06.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95b57fa640 10 client.17880 handle_command_reply: tid=0 2024-07-24T22:18:06.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95da28f740 1 client.17880 shutdown 2024-07-24T22:18:06.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95da28f740 1 -- 172.21.15.47:0/569254631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c97df60 msgr2=0x555f1c97b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:06.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95da28f740 1 --2- 172.21.15.47:0/569254631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c97df60 0x555f1c97b960 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f95c002a900 tx=0x7f95c0005c50 comp rx=0 tx=0).stop 2024-07-24T22:18:06.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95da28f740 1 -- 172.21.15.47:0/569254631 shutdown_connections 2024-07-24T22:18:06.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95da28f740 1 --2- 172.21.15.47:0/569254631 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555f1c98d6f0 0x555f1c98fae0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95da28f740 1 --2- 172.21.15.47:0/569254631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c97df60 0x555f1c97b960 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95da28f740 1 --2- 172.21.15.47:0/569254631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c971fd0 0x555f1c97b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95b57fa640 0 client.17880 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:06.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95da28f740 1 --2- 172.21.15.47:0/569254631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c9716b0 0x555f1c97aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95da28f740 1 -- 172.21.15.47:0/569254631 >> 172.21.15.47:0/569254631 conn(0x555f1c96f4e0 msgr2=0x555f1c975080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:06.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95da28f740 1 -- 172.21.15.47:0/569254631 shutdown_connections 2024-07-24T22:18:06.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95da28f740 1 -- 172.21.15.47:0/569254631 wait complete. 2024-07-24T22:18:06.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.334+0000 7f95da28f740 20 client.17880 trim_cache size 0 max 16384 2024-07-24T22:18:06.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.356+0000 7f95da28f740 1 Processor -- start 2024-07-24T22:18:06.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.356+0000 7f95da28f740 1 -- start start 2024-07-24T22:18:06.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.356+0000 7f95da28f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 0x555f1c96e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.356+0000 7f95da28f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c971fd0 0x555f1c9951f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.356+0000 7f95da28f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 0x555f1c995730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.356+0000 7f95da28f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f95d01ae3d0 con 0x555f1c9716b0 2024-07-24T22:18:06.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.356+0000 7f95da28f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f95d01b0c30 con 0x555f1c971fd0 2024-07-24T22:18:06.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.356+0000 7f95da28f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f95d01aea20 con 0x555f1c97df60 2024-07-24T22:18:06.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.356+0000 7f95d5c7a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 0x555f1c96e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.356+0000 7f95d5c7a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 0x555f1c96e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43154/0 (socket says 172.21.15.47:43154) 2024-07-24T22:18:06.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.356+0000 7f95d5c7a640 1 -- 172.21.15.47:0/3341723383 learned_addr learned my addr 172.21.15.47:0/3341723383 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:06.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.356+0000 7f95d647b640 1 --2- 172.21.15.47:0/3341723383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 0x555f1c995730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.357+0000 7f95d5479640 1 --2- 172.21.15.47:0/3341723383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c971fd0 0x555f1c9951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.357+0000 7f95d5c7a640 1 -- 172.21.15.47:0/3341723383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 msgr2=0x555f1c995730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:06.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.357+0000 7f95d5c7a640 1 --2- 172.21.15.47:0/3341723383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 0x555f1c995730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.357+0000 7f95d5c7a640 1 -- 172.21.15.47:0/3341723383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c971fd0 msgr2=0x555f1c9951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:06.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.357+0000 7f95d5c7a640 1 --2- 172.21.15.47:0/3341723383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c971fd0 0x555f1c9951f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.357+0000 7f95d5c7a640 1 -- 172.21.15.47:0/3341723383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f1c9793e0 con 0x555f1c9716b0 2024-07-24T22:18:06.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.357+0000 7f95d5c7a640 1 --2- 172.21.15.47:0/3341723383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 0x555f1c96e800 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x555f1c990110 tx=0x7f95c8004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35492fc9dac77a0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:06.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.357+0000 7f95b77fe640 1 -- 172.21.15.47:0/3341723383 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c801eb90 con 0x555f1c9716b0 2024-07-24T22:18:06.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.357+0000 7f95b77fe640 1 -- 172.21.15.47:0/3341723383 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95c801ed30 con 0x555f1c9716b0 2024-07-24T22:18:06.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.357+0000 7f95b77fe640 1 -- 172.21.15.47:0/3341723383 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c801d7f0 con 0x555f1c9716b0 2024-07-24T22:18:06.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.358+0000 7f95da28f740 1 -- 172.21.15.47:0/3341723383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 msgr2=0x555f1c96e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:06.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.358+0000 7f95da28f740 1 --2- 172.21.15.47:0/3341723383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 0x555f1c96e800 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x555f1c990110 tx=0x7f95c8004610 comp rx=0 tx=0).stop 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.358+0000 7f95da28f740 1 -- 172.21.15.47:0/3341723383 shutdown_connections 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.358+0000 7f95da28f740 1 --2- 172.21.15.47:0/3341723383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 0x555f1c995730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.358+0000 7f95da28f740 1 --2- 172.21.15.47:0/3341723383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c971fd0 0x555f1c9951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.358+0000 7f95da28f740 1 --2- 172.21.15.47:0/3341723383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c9716b0 0x555f1c96e800 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.358+0000 7f95da28f740 1 -- 172.21.15.47:0/3341723383 >> 172.21.15.47:0/3341723383 conn(0x555f1c96f4e0 msgr2=0x555f1c975010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.358+0000 7f95da28f740 1 -- 172.21.15.47:0/3341723383 shutdown_connections 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.358+0000 7f95da28f740 1 -- 172.21.15.47:0/3341723383 wait complete. 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.358+0000 7f95da28f740 1 -- start start 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95da28f740 1 Processor -- start 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95da28f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c9716b0 0x555f1c9864c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95da28f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c971fd0 0x555f1c981990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95da28f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 0x555f1c982060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95da28f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f95d01af0f0 con 0x555f1c971fd0 2024-07-24T22:18:06.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95da28f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f95d01b0560 con 0x555f1c9716b0 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95da28f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f95d01af7c0 con 0x555f1c97df60 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95da28f740 10 client.0 _ll_register_callbacks cb 0x7f95c800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95d5479640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c971fd0 0x555f1c981990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95d5479640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c971fd0 0x555f1c981990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43170/0 (socket says 172.21.15.47:43170) 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95d5479640 1 -- 172.21.15.47:0/3025173674 learned_addr learned my addr 172.21.15.47:0/3025173674 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95d647b640 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 0x555f1c982060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95d5c7a640 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c9716b0 0x555f1c9864c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95d5479640 1 -- 172.21.15.47:0/3025173674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 msgr2=0x555f1c982060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95d5479640 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 0x555f1c982060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95d5479640 1 -- 172.21.15.47:0/3025173674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c9716b0 msgr2=0x555f1c9864c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95d5479640 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c9716b0 0x555f1c9864c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95d5479640 1 -- 172.21.15.47:0/3025173674 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f1c9f71c0 con 0x555f1c971fd0 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.359+0000 7f95d647b640 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 0x555f1c982060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95d5479640 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c971fd0 0x555f1c981990 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f95c40e1190 tx=0x7f95c4009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d956689c8a85c229 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95b57fa640 1 -- 172.21.15.47:0/3025173674 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c40ea070 con 0x555f1c971fd0 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95b57fa640 1 -- 172.21.15.47:0/3025173674 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f95c40e13b0 con 0x555f1c971fd0 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95da28f740 1 -- 172.21.15.47:0/3025173674 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95c801ed30 con 0x555f1c971fd0 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95b57fa640 1 -- 172.21.15.47:0/3025173674 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f95c40aa100 con 0x555f1c971fd0 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95da28f740 10 client.17886 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95da28f740 1 -- 172.21.15.47:0/3025173674 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555f1c9f83d0 con 0x555f1c971fd0 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95b57fa640 1 -- 172.21.15.47:0/3025173674 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95c801ed30 con 0x555f1c971fd0 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95b57fa640 1 -- 172.21.15.47:0/3025173674 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f95c40a6880 con 0x555f1c971fd0 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95da28f740 10 client.17886 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95da28f740 10 client.17886 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95da28f740 20 client.17886 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.360+0000 7f95da28f740 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555f1c9f8b00 0x555f1c9faf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.361+0000 7f95da28f740 4 client.17886 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:18:06.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.361+0000 7f95da28f740 1 -- 172.21.15.47:0/3025173674 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555f1c8e6380 con 0x555f1c9f8b00 2024-07-24T22:18:06.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.361+0000 7f95d5c7a640 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555f1c9f8b00 0x555f1c9faf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:06.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.361+0000 7f95b57fa640 10 client.17886 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:06.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.361+0000 7f95d5c7a640 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555f1c9f8b00 0x555f1c9faf20 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b45150e9bc0dc17 server_cookie=119f5efda5ad8181 in_seq=0 out_seq=0 2024-07-24T22:18:06.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.361+0000 7f95b57fa640 1 -- 172.21.15.47:0/3025173674 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555f1c8e6380 con 0x555f1c9f8b00 2024-07-24T22:18:06.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95b57fa640 10 client.17886 handle_command_reply: tid=0 2024-07-24T22:18:06.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95da28f740 1 client.17886 shutdown 2024-07-24T22:18:06.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95da28f740 1 -- 172.21.15.47:0/3025173674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c971fd0 msgr2=0x555f1c981990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:06.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95da28f740 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c971fd0 0x555f1c981990 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f95c40e1190 tx=0x7f95c4009f50 comp rx=0 tx=0).stop 2024-07-24T22:18:06.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95da28f740 1 -- 172.21.15.47:0/3025173674 shutdown_connections 2024-07-24T22:18:06.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95da28f740 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x555f1c9f8b00 0x555f1c9faf20 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95da28f740 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555f1c97df60 0x555f1c982060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95da28f740 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f1c971fd0 0x555f1c981990 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95da28f740 1 --2- 172.21.15.47:0/3025173674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555f1c9716b0 0x555f1c9864c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95b57fa640 0 client.17886 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:06.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95da28f740 1 -- 172.21.15.47:0/3025173674 >> 172.21.15.47:0/3025173674 conn(0x555f1c96f4e0 msgr2=0x555f1c979760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:06.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95da28f740 1 -- 172.21.15.47:0/3025173674 shutdown_connections 2024-07-24T22:18:06.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95da28f740 1 -- 172.21.15.47:0/3025173674 wait complete. 2024-07-24T22:18:06.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.362+0000 7f95da28f740 20 client.17886 trim_cache size 0 max 16384 2024-07-24T22:18:06.370 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:18:06.370 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:18:06.370 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:18:06.370 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:18:06.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.363+0000 7f95d7ede640 1 -- 172.21.15.47:0/4213754039 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95b80b3d40 msgr2=0x7f95b80b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:06.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.363+0000 7f95d7ede640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95b80b3d40 0x7f95b80b6200 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x555f1c9703c0 tx=0x7f95c800b390 comp rx=0 tx=0).stop 2024-07-24T22:18:06.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.363+0000 7f95d7ede640 1 -- 172.21.15.47:0/4213754039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0107060 msgr2=0x7f95d00fdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:06.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.363+0000 7f95d7ede640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0107060 0x7f95d00fdb00 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f95c400d950 tx=0x7f95c400de10 comp rx=0 tx=0).stop 2024-07-24T22:18:06.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.363+0000 7f95d7ede640 1 -- 172.21.15.47:0/4213754039 shutdown_connections 2024-07-24T22:18:06.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.363+0000 7f95d7ede640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f95b80b3d40 0x7f95b80b6200 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.363+0000 7f95d7ede640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d01079e0 0x7f95d00fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.363+0000 7f95d7ede640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0107060 0x7f95d00fdb00 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.363+0000 7f95d7ede640 1 --2- 172.21.15.47:0/4213754039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95d0101650 0x7f95d00fd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:06.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.363+0000 7f95d7ede640 1 -- 172.21.15.47:0/4213754039 >> 172.21.15.47:0/4213754039 conn(0x7f95d00fd0c0 msgr2=0x7f95d006a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:06.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.363+0000 7f95d7ede640 1 -- 172.21.15.47:0/4213754039 shutdown_connections 2024-07-24T22:18:06.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:06.363+0000 7f95d7ede640 1 -- 172.21.15.47:0/4213754039 wait complete. 2024-07-24T22:18:06.904 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:06 smithi047 ceph-mon[32551]: osdmap e96: 12 total, 12 up, 12 in 2024-07-24T22:18:07.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:06 smithi183 ceph-mon[37007]: osdmap e96: 12 total, 12 up, 12 in 2024-07-24T22:18:07.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:06 smithi188 ceph-mon[37380]: osdmap e96: 12 total, 12 up, 12 in 2024-07-24T22:18:07.673 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:18:07.673 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:18:07.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:07 smithi047 ceph-mon[32551]: pgmap v704: 97 pgs: 5 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 90 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-07-24T22:18:08.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:07 smithi183 ceph-mon[37007]: pgmap v704: 97 pgs: 5 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 90 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-07-24T22:18:08.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:07 smithi188 ceph-mon[37380]: pgmap v704: 97 pgs: 5 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 90 active+clean; 20 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-07-24T22:18:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.751+0000 7fc97fbaf640 1 -- 172.21.15.47:0/3160411882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc978107a00 msgr2=0x7fc97810e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.751+0000 7fc97fbaf640 1 --2- 172.21.15.47:0/3160411882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc978107a00 0x7fc97810e200 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc970009ca0 tx=0x7fc97002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.751+0000 7fc97fbaf640 1 -- 172.21.15.47:0/3160411882 shutdown_connections 2024-07-24T22:18:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.751+0000 7fc97fbaf640 1 --2- 172.21.15.47:0/3160411882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc978107a00 0x7fc97810e200 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.751+0000 7fc97fbaf640 1 --2- 172.21.15.47:0/3160411882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc978107080 0x7fc9781074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.751+0000 7fc97fbaf640 1 --2- 172.21.15.47:0/3160411882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc978101670 0x7fc978101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.751+0000 7fc97fbaf640 1 -- 172.21.15.47:0/3160411882 >> 172.21.15.47:0/3160411882 conn(0x7fc9780fd0e0 msgr2=0x7fc9780ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:08.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.751+0000 7fc97fbaf640 1 -- 172.21.15.47:0/3160411882 shutdown_connections 2024-07-24T22:18:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.751+0000 7fc97fbaf640 1 -- 172.21.15.47:0/3160411882 wait complete. 2024-07-24T22:18:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.751+0000 7fc97fbaf640 1 Processor -- start 2024-07-24T22:18:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97fbaf640 1 -- start start 2024-07-24T22:18:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97fbaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc978101670 0x7fc978198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97fbaf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc978107080 0x7fc978199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97fbaf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc978107a00 0x7fc97819e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97fbaf640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781127a0 con 0x7fc978101670 2024-07-24T22:18:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97fbaf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc978112620 con 0x7fc978107080 2024-07-24T22:18:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97d94b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc978101670 0x7fc978198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97fbaf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc978112920 con 0x7fc978107a00 2024-07-24T22:18:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97d94b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc978101670 0x7fc978198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43200/0 (socket says 172.21.15.47:43200) 2024-07-24T22:18:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97d94b640 1 -- 172.21.15.47:0/2363961536 learned_addr learned my addr 172.21.15.47:0/2363961536 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:08.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97d14a640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc978107080 0x7fc978199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97e14c640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc978107a00 0x7fc97819e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97d94b640 1 -- 172.21.15.47:0/2363961536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc978107a00 msgr2=0x7fc97819e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97d94b640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc978107a00 0x7fc97819e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97d94b640 1 -- 172.21.15.47:0/2363961536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc978107080 msgr2=0x7fc978199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97d94b640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc978107080 0x7fc978199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.752+0000 7fc97d94b640 1 -- 172.21.15.47:0/2363961536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97819ec80 con 0x7fc978101670 2024-07-24T22:18:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.753+0000 7fc97d94b640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc978101670 0x7fc978198bd0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fc97400e9f0 tx=0x7fc97400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.753+0000 7fc96effd640 1 -- 172.21.15.47:0/2363961536 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97400cd80 con 0x7fc978101670 2024-07-24T22:18:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.753+0000 7fc97fbaf640 1 -- 172.21.15.47:0/2363961536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97819ef70 con 0x7fc978101670 2024-07-24T22:18:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.753+0000 7fc96effd640 1 -- 172.21.15.47:0/2363961536 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9740054d0 con 0x7fc978101670 2024-07-24T22:18:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.753+0000 7fc96effd640 1 -- 172.21.15.47:0/2363961536 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974010690 con 0x7fc978101670 2024-07-24T22:18:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.753+0000 7fc97fbaf640 1 -- 172.21.15.47:0/2363961536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9781a5630 con 0x7fc978101670 2024-07-24T22:18:08.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.755+0000 7fc981f60740 1 Processor -- start 2024-07-24T22:18:08.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc981f60740 1 -- start start 2024-07-24T22:18:08.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc981f60740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5dcd0 0x562e96e5c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc981f60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5c7a0 0x562e96e5cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc981f60740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e6edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc981f60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562e96dd26a0 con 0x562e96e5c7a0 2024-07-24T22:18:08.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc981f60740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562e96dc1ba0 con 0x562e96e6c9e0 2024-07-24T22:18:08.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc981f60740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562e96dc5be0 con 0x562e96e5dcd0 2024-07-24T22:18:08.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc96effd640 1 -- 172.21.15.47:0/2363961536 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fc974004e90 con 0x7fc978101670 2024-07-24T22:18:08.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc97d14a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e6edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc97e14c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5dcd0 0x562e96e5c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc97d14a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e6edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:37994/0 (socket says 172.21.15.47:37994) 2024-07-24T22:18:08.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc97d14a640 1 -- 172.21.15.47:0/1767830185 learned_addr learned my addr 172.21.15.47:0/1767830185 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:08.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc97d94b640 1 --2- 172.21.15.47:0/1767830185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5c7a0 0x562e96e5cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc97d14a640 1 -- 172.21.15.47:0/1767830185 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5dcd0 msgr2=0x562e96e5c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:08.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc97d14a640 1 --2- 172.21.15.47:0/1767830185 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5dcd0 0x562e96e5c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc97d14a640 1 -- 172.21.15.47:0/1767830185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5c7a0 msgr2=0x562e96e5cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:08.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc97d14a640 1 --2- 172.21.15.47:0/1767830185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5c7a0 0x562e96e5cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.756+0000 7fc97d14a640 1 -- 172.21.15.47:0/1767830185 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e96d59d60 con 0x562e96e6c9e0 2024-07-24T22:18:08.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.757+0000 7fc97d14a640 1 --2- 172.21.15.47:0/1767830185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e6edd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc96800bc90 tx=0x7fc9680107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e321fb000b5f227 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:08.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.757+0000 7fc963fff640 1 -- 172.21.15.47:0/1767830185 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968005220 con 0x562e96e6c9e0 2024-07-24T22:18:08.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.757+0000 7fc963fff640 1 -- 172.21.15.47:0/1767830185 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc96800be40 con 0x562e96e6c9e0 2024-07-24T22:18:08.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.757+0000 7fc963fff640 1 -- 172.21.15.47:0/1767830185 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9680116a0 con 0x562e96e6c9e0 2024-07-24T22:18:08.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.757+0000 7fc96effd640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc9640b3dc0 0x7fc9640b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.758+0000 7fc97e14c640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc9640b3dc0 0x7fc9640b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.758+0000 7fc96effd640 1 -- 172.21.15.47:0/2363961536 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7fc9740e44e0 con 0x7fc978101670 2024-07-24T22:18:08.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.758+0000 7fc981f60740 1 -- 172.21.15.47:0/1767830185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 msgr2=0x562e96e6edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:08.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.758+0000 7fc981f60740 1 --2- 172.21.15.47:0/1767830185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e6edd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc96800bc90 tx=0x7fc9680107a0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.758+0000 7fc981f60740 1 -- 172.21.15.47:0/1767830185 shutdown_connections 2024-07-24T22:18:08.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.758+0000 7fc981f60740 1 --2- 172.21.15.47:0/1767830185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e6edd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.758+0000 7fc981f60740 1 --2- 172.21.15.47:0/1767830185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5c7a0 0x562e96e5cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.758+0000 7fc981f60740 1 --2- 172.21.15.47:0/1767830185 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5dcd0 0x562e96e5c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.758+0000 7fc981f60740 1 -- 172.21.15.47:0/1767830185 >> 172.21.15.47:0/1767830185 conn(0x562e96e26750 msgr2=0x562e96e5a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:08.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.758+0000 7fc981f60740 1 -- 172.21.15.47:0/1767830185 shutdown_connections 2024-07-24T22:18:08.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.758+0000 7fc981f60740 1 -- 172.21.15.47:0/1767830185 wait complete. 2024-07-24T22:18:08.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.758+0000 7fc97e14c640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc9640b3dc0 0x7fc9640b6280 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc970006010 tx=0x7fc9700099a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:08.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.758+0000 7fc981f60740 1 -- start start 2024-07-24T22:18:08.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.759+0000 7fc981f60740 1 Processor -- start 2024-07-24T22:18:08.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.759+0000 7fc981f60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5c7a0 0x562e96e69910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.759+0000 7fc981f60740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5dcd0 0x562e96e69e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.759+0000 7fc981f60740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e6a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.759+0000 7fc981f60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562e96c257a0 con 0x562e96e5c7a0 2024-07-24T22:18:08.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.759+0000 7fc981f60740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562e96d64020 con 0x562e96e6c9e0 2024-07-24T22:18:08.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.759+0000 7fc981f60740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562e96e6f870 con 0x562e96e5dcd0 2024-07-24T22:18:08.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.759+0000 7fc981f60740 10 client.0 _ll_register_callbacks cb 0x562e96acf090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:08.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.759+0000 7fc97d94b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5c7a0 0x562e96e69910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.759+0000 7fc97d14a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5dcd0 0x562e96e69e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.759+0000 7fc97d94b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5c7a0 0x562e96e69910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43222/0 (socket says 172.21.15.47:43222) 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.759+0000 7fc97d94b640 1 -- 172.21.15.47:0/315515545 learned_addr learned my addr 172.21.15.47:0/315515545 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.759+0000 7fc97e14c640 1 --2- 172.21.15.47:0/315515545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e6a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc97d94b640 1 -- 172.21.15.47:0/315515545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5dcd0 msgr2=0x562e96e69e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc97d94b640 1 --2- 172.21.15.47:0/315515545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5dcd0 0x562e96e69e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc97d94b640 1 -- 172.21.15.47:0/315515545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 msgr2=0x562e96e6a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc97d94b640 1 --2- 172.21.15.47:0/315515545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e6a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc97d94b640 1 -- 172.21.15.47:0/315515545 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e96d680d0 con 0x562e96e5c7a0 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc97d14a640 1 --2- 172.21.15.47:0/315515545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5dcd0 0x562e96e69e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc97d94b640 1 --2- 172.21.15.47:0/315515545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5c7a0 0x562e96e69910 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc9740a82a0 tx=0x7fc9740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73cc3d7efc8382bc server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc9617fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc9617fa640 1 -- 172.21.15.47:0/315515545 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974005180 con 0x562e96e5c7a0 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc9617fa640 1 -- 172.21.15.47:0/315515545 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7fc9740e7c10 con 0x562e96e5c7a0 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc981f60740 1 -- 172.21.15.47:0/315515545 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562e96dd45f0 con 0x562e96e5c7a0 2024-07-24T22:18:08.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc9617fa640 1 -- 172.21.15.47:0/315515545 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc9740aab40 con 0x562e96e5c7a0 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc981f60740 10 client.17898 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.760+0000 7fc981f60740 1 -- 172.21.15.47:0/315515545 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562e96b31b90 con 0x562e96e5c7a0 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.761+0000 7fc9617fa640 1 -- 172.21.15.47:0/315515545 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562e96dd45f0 con 0x562e96e5c7a0 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.761+0000 7fc9617fa640 1 -- 172.21.15.47:0/315515545 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc9740b3c50 con 0x562e96e5c7a0 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.761+0000 7fc981f60740 10 client.17898 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.761+0000 7fc981f60740 10 client.17898 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.761+0000 7fc981f60740 20 client.17898 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.761+0000 7fc981f60740 1 --2- 172.21.15.47:0/315515545 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562e96e7ca70 0x562e96e7eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.761+0000 7fc981f60740 4 client.17898 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.761+0000 7fc981f60740 1 -- 172.21.15.47:0/315515545 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e96dd0090 con 0x562e96e7ca70 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.761+0000 7fc97d14a640 1 --2- 172.21.15.47:0/315515545 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562e96e7ca70 0x562e96e7eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.761+0000 7fc97d14a640 1 --2- 172.21.15.47:0/315515545 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562e96e7ca70 0x562e96e7eef0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5541528f124e00a server_cookie=8fd751b4430f5ac4 in_seq=0 out_seq=0 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.761+0000 7fc9617fa640 10 client.17898 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:08.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.762+0000 7fc9617fa640 1 -- 172.21.15.47:0/315515545 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e96dd0090 con 0x562e96e7ca70 2024-07-24T22:18:08.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.762+0000 7fc9617fa640 10 client.17898 handle_command_reply: tid=0 2024-07-24T22:18:08.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.762+0000 7fc981f60740 1 client.17898 shutdown 2024-07-24T22:18:08.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.762+0000 7fc981f60740 1 -- 172.21.15.47:0/315515545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5c7a0 msgr2=0x562e96e69910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:08.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.762+0000 7fc981f60740 1 --2- 172.21.15.47:0/315515545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5c7a0 0x562e96e69910 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc9740a82a0 tx=0x7fc9740048f0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.762+0000 7fc981f60740 1 -- 172.21.15.47:0/315515545 shutdown_connections 2024-07-24T22:18:08.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.762+0000 7fc981f60740 1 --2- 172.21.15.47:0/315515545 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562e96e7ca70 0x562e96e7eef0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.762+0000 7fc981f60740 1 --2- 172.21.15.47:0/315515545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e6a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.762+0000 7fc981f60740 1 --2- 172.21.15.47:0/315515545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5dcd0 0x562e96e69e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.762+0000 7fc9617fa640 0 client.17898 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:08.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.762+0000 7fc981f60740 1 --2- 172.21.15.47:0/315515545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5c7a0 0x562e96e69910 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.762+0000 7fc981f60740 1 -- 172.21.15.47:0/315515545 >> 172.21.15.47:0/315515545 conn(0x562e96e26750 msgr2=0x562e96e5fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:08.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.763+0000 7fc981f60740 1 -- 172.21.15.47:0/315515545 shutdown_connections 2024-07-24T22:18:08.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.763+0000 7fc981f60740 1 -- 172.21.15.47:0/315515545 wait complete. 2024-07-24T22:18:08.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.763+0000 7fc981f60740 20 client.17898 trim_cache size 0 max 16384 2024-07-24T22:18:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.784+0000 7fc981f60740 1 Processor -- start 2024-07-24T22:18:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.784+0000 7fc981f60740 1 -- start start 2024-07-24T22:18:08.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.784+0000 7fc981f60740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5c7a0 0x562e96e6ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc981f60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5dcd0 0x562e96e59c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc981f60740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc981f60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781a9f70 con 0x562e96e5dcd0 2024-07-24T22:18:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc981f60740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781ac7d0 con 0x562e96e6c9e0 2024-07-24T22:18:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc981f60740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781aa5c0 con 0x562e96e5c7a0 2024-07-24T22:18:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc97d14a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5dcd0 0x562e96e59c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc97d14a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5dcd0 0x562e96e59c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43230/0 (socket says 172.21.15.47:43230) 2024-07-24T22:18:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc97d14a640 1 -- 172.21.15.47:0/2704197095 learned_addr learned my addr 172.21.15.47:0/2704197095 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc97d94b640 1 --2- 172.21.15.47:0/2704197095 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5c7a0 0x562e96e6ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc97e14c640 1 --2- 172.21.15.47:0/2704197095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc97d14a640 1 -- 172.21.15.47:0/2704197095 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5c7a0 msgr2=0x562e96e6ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:08.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc97d14a640 1 --2- 172.21.15.47:0/2704197095 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5c7a0 0x562e96e6ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc97d14a640 1 -- 172.21.15.47:0/2704197095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 msgr2=0x562e96e670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc97d14a640 1 --2- 172.21.15.47:0/2704197095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc97d14a640 1 -- 172.21.15.47:0/2704197095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e96e6b620 con 0x562e96e5dcd0 2024-07-24T22:18:08.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.785+0000 7fc97d14a640 1 --2- 172.21.15.47:0/2704197095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5dcd0 0x562e96e59c20 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc968005d00 tx=0x7fc9680054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567af7a6ec476a94 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:08.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.786+0000 7fc9637fe640 1 -- 172.21.15.47:0/2704197095 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968034070 con 0x562e96e5dcd0 2024-07-24T22:18:08.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.786+0000 7fc9637fe640 1 -- 172.21.15.47:0/2704197095 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc968004b10 con 0x562e96e5dcd0 2024-07-24T22:18:08.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.786+0000 7fc9637fe640 1 -- 172.21.15.47:0/2704197095 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968011730 con 0x562e96e5dcd0 2024-07-24T22:18:08.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.786+0000 7fc981f60740 1 -- 172.21.15.47:0/2704197095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5dcd0 msgr2=0x562e96e59c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.786+0000 7fc981f60740 1 --2- 172.21.15.47:0/2704197095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5dcd0 0x562e96e59c20 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc968005d00 tx=0x7fc9680054f0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.787+0000 7fc981f60740 1 -- 172.21.15.47:0/2704197095 shutdown_connections 2024-07-24T22:18:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.787+0000 7fc981f60740 1 --2- 172.21.15.47:0/2704197095 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.787+0000 7fc981f60740 1 --2- 172.21.15.47:0/2704197095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5dcd0 0x562e96e59c20 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.787+0000 7fc981f60740 1 --2- 172.21.15.47:0/2704197095 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5c7a0 0x562e96e6ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.787+0000 7fc981f60740 1 -- 172.21.15.47:0/2704197095 >> 172.21.15.47:0/2704197095 conn(0x562e96e26750 msgr2=0x562e96e669a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.787+0000 7fc981f60740 1 -- 172.21.15.47:0/2704197095 shutdown_connections 2024-07-24T22:18:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.787+0000 7fc981f60740 1 -- 172.21.15.47:0/2704197095 wait complete. 2024-07-24T22:18:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.787+0000 7fc981f60740 1 -- start start 2024-07-24T22:18:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.787+0000 7fc981f60740 1 Processor -- start 2024-07-24T22:18:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc981f60740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5c7a0 0x562e96e74b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc981f60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5dcd0 0x562e96e750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc981f60740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e5b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc981f60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781aac90 con 0x562e96e5dcd0 2024-07-24T22:18:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc981f60740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781ac100 con 0x562e96e6c9e0 2024-07-24T22:18:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc981f60740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781ab360 con 0x562e96e5c7a0 2024-07-24T22:18:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc981f60740 10 client.0 _ll_register_callbacks cb 0x7fc9740a6ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc97d94b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5c7a0 0x562e96e74b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc97e14c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e5b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc97d94b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5c7a0 0x562e96e74b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:53950/0 (socket says 172.21.15.47:53950) 2024-07-24T22:18:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc97d14a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5dcd0 0x562e96e750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc97d94b640 1 -- 172.21.15.47:0/1566921681 learned_addr learned my addr 172.21.15.47:0/1566921681 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc97d94b640 1 -- 172.21.15.47:0/1566921681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 msgr2=0x562e96e5b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc97d94b640 1 --2- 172.21.15.47:0/1566921681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e5b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc97d94b640 1 -- 172.21.15.47:0/1566921681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5dcd0 msgr2=0x562e96e750a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.788+0000 7fc97d94b640 1 --2- 172.21.15.47:0/1566921681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5dcd0 0x562e96e750a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.789+0000 7fc97d94b640 1 -- 172.21.15.47:0/1566921681 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e96e75740 con 0x562e96e5c7a0 2024-07-24T22:18:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.789+0000 7fc97d94b640 1 --2- 172.21.15.47:0/1566921681 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5c7a0 0x562e96e74b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc9740e7a90 tx=0x7fc9740aaf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d3099662e8cdf5 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.789+0000 7fc9617fa640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:18:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.789+0000 7fc9617fa640 1 -- 172.21.15.47:0/1566921681 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974005180 con 0x562e96e5c7a0 2024-07-24T22:18:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.790+0000 7fc981f60740 1 -- 172.21.15.47:0/1566921681 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc968004b10 con 0x562e96e5c7a0 2024-07-24T22:18:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.790+0000 7fc9617fa640 1 -- 172.21.15.47:0/1566921681 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7fc9740aa4a0 con 0x562e96e5c7a0 2024-07-24T22:18:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.790+0000 7fc9617fa640 1 -- 172.21.15.47:0/1566921681 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc9740bd050 con 0x562e96e5c7a0 2024-07-24T22:18:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.790+0000 7fc981f60740 10 client.26977 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.790+0000 7fc981f60740 1 -- 172.21.15.47:0/1566921681 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562e96eec0c0 con 0x562e96e5c7a0 2024-07-24T22:18:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.790+0000 7fc9617fa640 1 -- 172.21.15.47:0/1566921681 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc974005680 con 0x562e96e5c7a0 2024-07-24T22:18:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.790+0000 7fc9617fa640 1 -- 172.21.15.47:0/1566921681 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc9740a69a0 con 0x562e96e5c7a0 2024-07-24T22:18:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.791+0000 7fc981f60740 10 client.26977 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.791+0000 7fc981f60740 10 client.26977 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:18:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.791+0000 7fc981f60740 20 client.26977 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.791+0000 7fc981f60740 1 --2- 172.21.15.47:0/1566921681 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562e96eec8e0 0x562e96eeed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.791+0000 7fc981f60740 4 client.26977 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.5, "await_for": 45.0}] 2024-07-24T22:18:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.791+0000 7fc981f60740 1 -- 172.21.15.47:0/1566921681 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.5, "await_for": 45.0}) -- 0x7fc968004b10 con 0x562e96eec8e0 2024-07-24T22:18:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.792+0000 7fc97d14a640 1 --2- 172.21.15.47:0/1566921681 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562e96eec8e0 0x562e96eeed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:08.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.792+0000 7fc9617fa640 10 client.26977 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:08.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.792+0000 7fc97d14a640 1 --2- 172.21.15.47:0/1566921681 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562e96eec8e0 0x562e96eeed00 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7c8cc8fa0bbfdcf server_cookie=6fa3ca5395e2f165 in_seq=0 out_seq=0 2024-07-24T22:18:08.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.800+0000 7fc9617fa640 1 -- 172.21.15.47:0/1566921681 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fc968004b10 con 0x562e96eec8e0 2024-07-24T22:18:08.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.800+0000 7fc9617fa640 10 client.26977 handle_command_reply: tid=0 2024-07-24T22:18:08.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.800+0000 7fc981f60740 1 client.26977 shutdown 2024-07-24T22:18:08.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.800+0000 7fc981f60740 1 -- 172.21.15.47:0/1566921681 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5c7a0 msgr2=0x562e96e74b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:08.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.800+0000 7fc981f60740 1 --2- 172.21.15.47:0/1566921681 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5c7a0 0x562e96e74b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc9740e7a90 tx=0x7fc9740aaf30 comp rx=0 tx=0).stop 2024-07-24T22:18:08.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.801+0000 7fc981f60740 1 -- 172.21.15.47:0/1566921681 shutdown_connections 2024-07-24T22:18:08.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.801+0000 7fc981f60740 1 --2- 172.21.15.47:0/1566921681 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562e96eec8e0 0x562e96eeed00 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.801+0000 7fc981f60740 1 --2- 172.21.15.47:0/1566921681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562e96e6c9e0 0x562e96e5b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.801+0000 7fc9617fa640 0 client.26977 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:08.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.801+0000 7fc981f60740 1 --2- 172.21.15.47:0/1566921681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562e96e5dcd0 0x562e96e750a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.801+0000 7fc981f60740 1 --2- 172.21.15.47:0/1566921681 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e96e5c7a0 0x562e96e74b60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.801+0000 7fc981f60740 1 -- 172.21.15.47:0/1566921681 >> 172.21.15.47:0/1566921681 conn(0x562e96e26750 msgr2=0x562e96e59170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:08.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.801+0000 7fc981f60740 1 -- 172.21.15.47:0/1566921681 shutdown_connections 2024-07-24T22:18:08.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.801+0000 7fc981f60740 1 -- 172.21.15.47:0/1566921681 wait complete. 2024-07-24T22:18:08.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.801+0000 7fc981f60740 20 client.26977 trim_cache size 0 max 16384 2024-07-24T22:18:08.804 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:18:08.804 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:18:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:18:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 34, 2024-07-24T22:18:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:18:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "4204a3b9": { 2024-07-24T22:18:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 34, 2024-07-24T22:18:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:18:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:18:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:18:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:18:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:18:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:18:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 147.5, 2024-07-24T22:18:08.805 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:18:08.806 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:18:08.806 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:18:08.806 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:18:08.806 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-07-24T22:18:08.806 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:18:08.806 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:18:08.806 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:18:08.806 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:18:08.806 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:18:08.806 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:18:08.806 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:18:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.802+0000 7fc97fbaf640 1 -- 172.21.15.47:0/2363961536 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc9640b3dc0 msgr2=0x7fc9640b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.802+0000 7fc97fbaf640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc9640b3dc0 0x7fc9640b6280 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc970006010 tx=0x7fc9700099a0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.802+0000 7fc97fbaf640 1 -- 172.21.15.47:0/2363961536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc978101670 msgr2=0x7fc978198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.802+0000 7fc97fbaf640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc978101670 0x7fc978198bd0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fc97400e9f0 tx=0x7fc97400edf0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.802+0000 7fc97fbaf640 1 -- 172.21.15.47:0/2363961536 shutdown_connections 2024-07-24T22:18:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.802+0000 7fc97fbaf640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc9640b3dc0 0x7fc9640b6280 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.802+0000 7fc97fbaf640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc978107a00 0x7fc97819e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.802+0000 7fc97fbaf640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc978107080 0x7fc978199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.802+0000 7fc97fbaf640 1 --2- 172.21.15.47:0/2363961536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc978101670 0x7fc978198bd0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:08.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.802+0000 7fc97fbaf640 1 -- 172.21.15.47:0/2363961536 >> 172.21.15.47:0/2363961536 conn(0x7fc9780fd0e0 msgr2=0x7fc9780fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:08.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.802+0000 7fc97fbaf640 1 -- 172.21.15.47:0/2363961536 shutdown_connections 2024-07-24T22:18:08.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:08.802+0000 7fc97fbaf640 1 -- 172.21.15.47:0/2363961536 wait complete. 2024-07-24T22:18:09.157 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:09.695 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4204a3b9', quiesce took 9.7 seconds. Will release after: 17.8 2024-07-24T22:18:09.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:09 smithi047 ceph-mon[32551]: pgmap v705: 97 pgs: 27 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 55 active+clean; 20 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 17 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-07-24T22:18:10.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:09 smithi183 ceph-mon[37007]: pgmap v705: 97 pgs: 27 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 55 active+clean; 20 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 17 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-07-24T22:18:10.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:09 smithi188 ceph-mon[37380]: pgmap v705: 97 pgs: 27 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 55 active+clean; 20 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 17 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-07-24T22:18:11.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.383+0000 7fb237949640 1 -- 172.21.15.47:0/915411889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb230103510 msgr2=0x7fb2301038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:11.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.383+0000 7fb237949640 1 --2- 172.21.15.47:0/915411889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb230103510 0x7fb2301038f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009900 tx=0x7fb22c02a410 comp rx=0 tx=0).stop 2024-07-24T22:18:11.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.384+0000 7fb237949640 1 -- 172.21.15.47:0/915411889 shutdown_connections 2024-07-24T22:18:11.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.384+0000 7fb237949640 1 --2- 172.21.15.47:0/915411889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb23010cac0 0x7fb23010ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:11.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.384+0000 7fb237949640 1 --2- 172.21.15.47:0/915411889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb230103f10 0x7fb23010c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:11.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.384+0000 7fb237949640 1 --2- 172.21.15.47:0/915411889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb230103510 0x7fb2301038f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:11.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.384+0000 7fb237949640 1 -- 172.21.15.47:0/915411889 >> 172.21.15.47:0/915411889 conn(0x7fb2300fd0c0 msgr2=0x7fb2300ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:11.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.384+0000 7fb237949640 1 -- 172.21.15.47:0/915411889 shutdown_connections 2024-07-24T22:18:11.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.384+0000 7fb237949640 1 -- 172.21.15.47:0/915411889 wait complete. 2024-07-24T22:18:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.384+0000 7fb237949640 1 Processor -- start 2024-07-24T22:18:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb237949640 1 -- start start 2024-07-24T22:18:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb237949640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb230103510 0x7fb230198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb237949640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb230103f10 0x7fb2301991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb237949640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb23010cac0 0x7fb23019e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb237949640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb230112750 con 0x7fb230103510 2024-07-24T22:18:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb237949640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb2301125d0 con 0x7fb230103f10 2024-07-24T22:18:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb237949640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb2301128d0 con 0x7fb23010cac0 2024-07-24T22:18:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb2356e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb230103510 0x7fb230198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb2356e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb230103510 0x7fb230198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43274/0 (socket says 172.21.15.47:43274) 2024-07-24T22:18:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb2356e5640 1 -- 172.21.15.47:0/3378858660 learned_addr learned my addr 172.21.15.47:0/3378858660 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:11.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb234ee4640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb230103f10 0x7fb2301991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb235ee6640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb23010cac0 0x7fb23019e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb2356e5640 1 -- 172.21.15.47:0/3378858660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb23010cac0 msgr2=0x7fb23019e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb2356e5640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb23010cac0 0x7fb23019e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb2356e5640 1 -- 172.21.15.47:0/3378858660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb230103f10 msgr2=0x7fb2301991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb2356e5640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb230103f10 0x7fb2301991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb2356e5640 1 -- 172.21.15.47:0/3378858660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23019ed10 con 0x7fb230103510 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.385+0000 7fb234ee4640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb230103f10 0x7fb2301991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.386+0000 7fb2356e5640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb230103510 0x7fb230198c60 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb22c005ab0 tx=0x7fb22c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.386+0000 7fb2267fc640 1 -- 172.21.15.47:0/3378858660 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c03f070 con 0x7fb230103510 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.386+0000 7fb237949640 1 -- 172.21.15.47:0/3378858660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23019efa0 con 0x7fb230103510 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.386+0000 7fb2267fc640 1 -- 172.21.15.47:0/3378858660 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb22c031b60 con 0x7fb230103510 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.386+0000 7fb2267fc640 1 -- 172.21.15.47:0/3378858660 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c035030 con 0x7fb230103510 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.386+0000 7fb237949640 1 -- 172.21.15.47:0/3378858660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2301a56c0 con 0x7fb230103510 2024-07-24T22:18:11.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.387+0000 7fb237949640 1 -- 172.21.15.47:0/3378858660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2301038f0 con 0x7fb230103510 2024-07-24T22:18:11.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.388+0000 7fb2267fc640 1 -- 172.21.15.47:0/3378858660 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fb22c042070 con 0x7fb230103510 2024-07-24T22:18:11.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.389+0000 7fb2267fc640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb21c0b3d40 0x7fb21c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:11.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.389+0000 7fb234ee4640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb21c0b3d40 0x7fb21c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:11.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.389+0000 7fb2267fc640 1 -- 172.21.15.47:0/3378858660 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7fb22c104710 con 0x7fb230103510 2024-07-24T22:18:11.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.389+0000 7fb234ee4640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb21c0b3d40 0x7fb21c0b6200 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb23010f100 tx=0x7fb220005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:11.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.393+0000 7fb2267fc640 1 -- 172.21.15.47:0/3378858660 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fb22c0cb960 con 0x7fb230103510 2024-07-24T22:18:11.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.646+0000 7fb237949640 1 -- 172.21.15.47:0/3378858660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2301a58f0 con 0x7fb230103510 2024-07-24T22:18:11.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.646+0000 7fb2267fc640 1 -- 172.21.15.47:0/3378858660 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7fb22c0cb260 con 0x7fb230103510 2024-07-24T22:18:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:18:11.649 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:18:11.649 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:18:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.649+0000 7fb237949640 1 -- 172.21.15.47:0/3378858660 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb21c0b3d40 msgr2=0x7fb21c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.649+0000 7fb237949640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb21c0b3d40 0x7fb21c0b6200 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb23010f100 tx=0x7fb220005f90 comp rx=0 tx=0).stop 2024-07-24T22:18:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.649+0000 7fb237949640 1 -- 172.21.15.47:0/3378858660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb230103510 msgr2=0x7fb230198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.649+0000 7fb237949640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb230103510 0x7fb230198c60 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb22c005ab0 tx=0x7fb22c003c10 comp rx=0 tx=0).stop 2024-07-24T22:18:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.649+0000 7fb237949640 1 -- 172.21.15.47:0/3378858660 shutdown_connections 2024-07-24T22:18:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.649+0000 7fb237949640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb21c0b3d40 0x7fb21c0b6200 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.649+0000 7fb237949640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb23010cac0 0x7fb23019e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.649+0000 7fb237949640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb230103f10 0x7fb2301991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.649+0000 7fb237949640 1 --2- 172.21.15.47:0/3378858660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb230103510 0x7fb230198c60 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.649+0000 7fb237949640 1 -- 172.21.15.47:0/3378858660 >> 172.21.15.47:0/3378858660 conn(0x7fb2300fd0c0 msgr2=0x7fb2300fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.649+0000 7fb237949640 1 -- 172.21.15.47:0/3378858660 shutdown_connections 2024-07-24T22:18:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:11.649+0000 7fb237949640 1 -- 172.21.15.47:0/3378858660 wait complete. 2024-07-24T22:18:12.017 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:11 smithi047 ceph-mon[32551]: pgmap v706: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 19 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 17 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-07-24T22:18:12.017 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:11 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3378858660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:12.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:11 smithi183 ceph-mon[37007]: pgmap v706: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 19 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 17 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-07-24T22:18:12.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:11 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3378858660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:12.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:11 smithi188 ceph-mon[37380]: pgmap v706: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 19 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 17 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-07-24T22:18:12.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:11 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3378858660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:12.332 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:18:12.609 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:14.074 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:13 smithi047 ceph-mon[32551]: pgmap v707: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 17 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-07-24T22:18:14.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:13 smithi183 ceph-mon[37007]: pgmap v707: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 17 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-07-24T22:18:14.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:13 smithi188 ceph-mon[37380]: pgmap v707: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 17 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-07-24T22:18:14.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.303+0000 7f86f4a1a640 1 -- 172.21.15.47:0/1473169928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86f0102750 msgr2=0x7f86f0102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:14.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.303+0000 7f86f4a1a640 1 --2- 172.21.15.47:0/1473169928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86f0102750 0x7f86f0102b30 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009900 tx=0x7f86e002a410 comp rx=0 tx=0).stop 2024-07-24T22:18:14.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.303+0000 7f86f4a1a640 1 -- 172.21.15.47:0/1473169928 shutdown_connections 2024-07-24T22:18:14.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.303+0000 7f86f4a1a640 1 --2- 172.21.15.47:0/1473169928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0108ae0 0x7f86f010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.303+0000 7f86f4a1a640 1 --2- 172.21.15.47:0/1473169928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86f0108160 0x7f86f01085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.303+0000 7f86f4a1a640 1 --2- 172.21.15.47:0/1473169928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86f0102750 0x7f86f0102b30 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.303+0000 7f86f4a1a640 1 -- 172.21.15.47:0/1473169928 >> 172.21.15.47:0/1473169928 conn(0x7f86f00fe200 msgr2=0x7f86f0100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:14.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.303+0000 7f86f4a1a640 1 -- 172.21.15.47:0/1473169928 shutdown_connections 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.303+0000 7f86f4a1a640 1 -- 172.21.15.47:0/1473169928 wait complete. 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.304+0000 7f86f4a1a640 1 Processor -- start 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.304+0000 7f86f4a1a640 1 -- start start 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.304+0000 7f86f4a1a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86f0102750 0x7f86f0198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.304+0000 7f86f4a1a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86f0108160 0x7f86f0199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.304+0000 7f86f4a1a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0108ae0 0x7f86f019e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.304+0000 7f86f4a1a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86f0112710 con 0x7f86f0108160 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.304+0000 7f86f4a1a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f86f0112590 con 0x7f86f0108ae0 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.304+0000 7f86f4a1a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f86f0112890 con 0x7f86f0102750 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86edd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86f0108160 0x7f86f0199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86edd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86f0108160 0x7f86f0199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43286/0 (socket says 172.21.15.47:43286) 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86edd9b640 1 -- 172.21.15.47:0/1252548316 learned_addr learned my addr 172.21.15.47:0/1252548316 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86eed9d640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0108ae0 0x7f86f019e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86ee59c640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86f0102750 0x7f86f0198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86edd9b640 1 -- 172.21.15.47:0/1252548316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86f0102750 msgr2=0x7f86f0198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:14.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86edd9b640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86f0102750 0x7f86f0198cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86edd9b640 1 -- 172.21.15.47:0/1252548316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0108ae0 msgr2=0x7f86f019e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:14.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86edd9b640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0108ae0 0x7f86f019e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86edd9b640 1 -- 172.21.15.47:0/1252548316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f019ed70 con 0x7f86f0108160 2024-07-24T22:18:14.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86edd9b640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86f0108160 0x7f86f0199200 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f86e400e9f0 tx=0x7f86e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:14.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86df7fe640 1 -- 172.21.15.47:0/1252548316 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e400cd80 con 0x7f86f0108160 2024-07-24T22:18:14.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86df7fe640 1 -- 172.21.15.47:0/1252548316 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e40054d0 con 0x7f86f0108160 2024-07-24T22:18:14.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86df7fe640 1 -- 172.21.15.47:0/1252548316 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4010690 con 0x7f86f0108160 2024-07-24T22:18:14.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.305+0000 7f86f4a1a640 1 -- 172.21.15.47:0/1252548316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f019f060 con 0x7f86f0108160 2024-07-24T22:18:14.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.306+0000 7f86f4a1a640 1 -- 172.21.15.47:0/1252548316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f01a5720 con 0x7f86f0108160 2024-07-24T22:18:14.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.308+0000 7f86f6dcb740 1 Processor -- start 2024-07-24T22:18:14.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.308+0000 7f86f6dcb740 1 -- start start 2024-07-24T22:18:14.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86f6dcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde26d0 0x55cdcbde2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86f6dcb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdf2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86f6dcb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbdf3390 0x55cdcbdf5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86f6dcb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cdcbd599b0 con 0x55cdcbde26d0 2024-07-24T22:18:14.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86f6dcb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cdcbd48eb0 con 0x55cdcbde2ff0 2024-07-24T22:18:14.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86f6dcb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55cdcbd4cef0 con 0x55cdcbdf3390 2024-07-24T22:18:14.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86eed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde26d0 0x55cdcbde2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86eed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde26d0 0x55cdcbde2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43292/0 (socket says 172.21.15.47:43292) 2024-07-24T22:18:14.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86eed9d640 1 -- 172.21.15.47:0/2074857026 learned_addr learned my addr 172.21.15.47:0/2074857026 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:14.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86ee59c640 1 --2- 172.21.15.47:0/2074857026 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdf2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86df7fe640 1 -- 172.21.15.47:0/1252548316 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f86e4004e90 con 0x7f86f0108160 2024-07-24T22:18:14.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86eed9d640 1 -- 172.21.15.47:0/2074857026 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbdf3390 msgr2=0x55cdcbdf5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:14.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86eed9d640 1 --2- 172.21.15.47:0/2074857026 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbdf3390 0x55cdcbdf5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86eed9d640 1 -- 172.21.15.47:0/2074857026 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbde2ff0 msgr2=0x55cdcbdf2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:14.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86eed9d640 1 --2- 172.21.15.47:0/2074857026 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdf2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86eed9d640 1 -- 172.21.15.47:0/2074857026 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdcbcd2320 con 0x55cdcbde26d0 2024-07-24T22:18:14.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86ee59c640 1 --2- 172.21.15.47:0/2074857026 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdf2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:14.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.309+0000 7f86eed9d640 1 --2- 172.21.15.47:0/2074857026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde26d0 0x55cdcbde2ab0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009f90 tx=0x7f86e8010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8602809e04c7163 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:14.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.310+0000 7f86dcff9640 1 -- 172.21.15.47:0/2074857026 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8011700 con 0x55cdcbde26d0 2024-07-24T22:18:14.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.310+0000 7f86dcff9640 1 -- 172.21.15.47:0/2074857026 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e8011d50 con 0x55cdcbde26d0 2024-07-24T22:18:14.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.310+0000 7f86dcff9640 1 -- 172.21.15.47:0/2074857026 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8019d40 con 0x55cdcbde26d0 2024-07-24T22:18:14.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.310+0000 7f86df7fe640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86d80b3d40 0x7f86d80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.310+0000 7f86ee59c640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86d80b3d40 0x7f86d80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.310+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2074857026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde26d0 msgr2=0x55cdcbde2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:14.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.310+0000 7f86df7fe640 1 -- 172.21.15.47:0/1252548316 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f86e40e4440 con 0x7f86f0108160 2024-07-24T22:18:14.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.310+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2074857026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde26d0 0x55cdcbde2ab0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009f90 tx=0x7f86e8010860 comp rx=0 tx=0).stop 2024-07-24T22:18:14.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.311+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2074857026 shutdown_connections 2024-07-24T22:18:14.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.311+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2074857026 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbdf3390 0x55cdcbdf5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.311+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2074857026 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdf2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.311+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2074857026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde26d0 0x55cdcbde2ab0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.311+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2074857026 >> 172.21.15.47:0/2074857026 conn(0x55cdcbde0500 msgr2=0x55cdcbde16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:14.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.311+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2074857026 shutdown_connections 2024-07-24T22:18:14.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.311+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2074857026 wait complete. 2024-07-24T22:18:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.311+0000 7f86ee59c640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86d80b3d40 0x7f86d80b6200 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f86e0031440 tx=0x7f86e0005b90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.311+0000 7f86f6dcb740 1 -- start start 2024-07-24T22:18:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.311+0000 7f86f6dcb740 1 Processor -- start 2024-07-24T22:18:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.312+0000 7f86f6dcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde26d0 0x55cdcbdf0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.312+0000 7f86f6dcb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdf0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.312+0000 7f86ee59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde26d0 0x55cdcbdf0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.312+0000 7f86ee59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde26d0 0x55cdcbdf0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43304/0 (socket says 172.21.15.47:43304) 2024-07-24T22:18:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.312+0000 7f86ee59c640 1 -- 172.21.15.47:0/2278230878 learned_addr learned my addr 172.21.15.47:0/2278230878 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.312+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbdf3390 0x55cdcbdf0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.312+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2278230878 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cdcbbac700 con 0x55cdcbde26d0 2024-07-24T22:18:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.312+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2278230878 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cdcbceb5f0 con 0x55cdcbdf3390 2024-07-24T22:18:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.312+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2278230878 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55cdcbdf6040 con 0x55cdcbde2ff0 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.312+0000 7f86edd9b640 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdf0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.312+0000 7f86f6dcb740 10 client.0 _ll_register_callbacks cb 0x55cdcbd0b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.312+0000 7f86eed9d640 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbdf3390 0x55cdcbdf0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86edd9b640 1 -- 172.21.15.47:0/2278230878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbdf3390 msgr2=0x55cdcbdf0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86edd9b640 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbdf3390 0x55cdcbdf0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86edd9b640 1 -- 172.21.15.47:0/2278230878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde26d0 msgr2=0x55cdcbdf0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86edd9b640 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde26d0 0x55cdcbdf0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86edd9b640 1 -- 172.21.15.47:0/2278230878 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdcbcde680 con 0x55cdcbde2ff0 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86eed9d640 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbdf3390 0x55cdcbdf0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86edd9b640 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdf0860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f86e40e1b30 tx=0x7f86e40048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d90f78ac293c9681 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86d5ffb640 1 -- 172.21.15.47:0/2278230878 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e40c5060 con 0x55cdcbde2ff0 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86d5ffb640 1 -- 172.21.15.47:0/2278230878 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f86e40b3c10 con 0x55cdcbde2ff0 2024-07-24T22:18:14.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2278230878 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e8011d50 con 0x55cdcbde2ff0 2024-07-24T22:18:14.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86d5ffb640 1 -- 172.21.15.47:0/2278230878 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f86e40cc050 con 0x55cdcbde2ff0 2024-07-24T22:18:14.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86f6dcb740 10 client.26992 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:14.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2278230878 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cdcbaa9650 con 0x55cdcbde2ff0 2024-07-24T22:18:14.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.313+0000 7f86d5ffb640 1 -- 172.21.15.47:0/2278230878 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e8011d50 con 0x55cdcbde2ff0 2024-07-24T22:18:14.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.314+0000 7f86d5ffb640 1 -- 172.21.15.47:0/2278230878 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f86e40b5070 con 0x55cdcbde2ff0 2024-07-24T22:18:14.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.314+0000 7f86f6dcb740 10 client.26992 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:14.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.314+0000 7f86f6dcb740 10 client.26992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:14.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.314+0000 7f86f6dcb740 20 client.26992 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:14.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.314+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cdcbe02e10 0x55cdcbe05200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.314+0000 7f86f6dcb740 4 client.26992 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:14.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.314+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2278230878 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdcbd5b900 con 0x55cdcbe02e10 2024-07-24T22:18:14.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.314+0000 7f86ee59c640 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cdcbe02e10 0x55cdcbe05200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.314+0000 7f86ee59c640 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cdcbe02e10 0x55cdcbe05200 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b36da1bc7776fb3a server_cookie=259d5592e2455dba in_seq=0 out_seq=0 2024-07-24T22:18:14.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.314+0000 7f86d5ffb640 10 client.26992 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:14.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86d5ffb640 1 -- 172.21.15.47:0/2278230878 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cdcbd5b900 con 0x55cdcbe02e10 2024-07-24T22:18:14.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86d5ffb640 10 client.26992 handle_command_reply: tid=0 2024-07-24T22:18:14.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86f6dcb740 1 client.26992 shutdown 2024-07-24T22:18:14.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2278230878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbde2ff0 msgr2=0x55cdcbdf0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:14.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdf0860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f86e40e1b30 tx=0x7f86e40048f0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2278230878 shutdown_connections 2024-07-24T22:18:14.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cdcbe02e10 0x55cdcbe05200 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbdf3390 0x55cdcbdf0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86d5ffb640 0 client.26992 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:14.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdf0860 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2278230878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde26d0 0x55cdcbdf0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2278230878 >> 172.21.15.47:0/2278230878 conn(0x55cdcbde0500 msgr2=0x55cdcbde6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:14.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2278230878 shutdown_connections 2024-07-24T22:18:14.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2278230878 wait complete. 2024-07-24T22:18:14.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.315+0000 7f86f6dcb740 20 client.26992 trim_cache size 0 max 16384 2024-07-24T22:18:14.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.330+0000 7f86f6dcb740 1 Processor -- start 2024-07-24T22:18:14.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.330+0000 7f86f6dcb740 1 -- start start 2024-07-24T22:18:14.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86f6dcb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbde26d0 0x55cdcbdede20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86f6dcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde2ff0 0x55cdcbde5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86f6dcb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbdf3390 0x55cdcbde5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86f6dcb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01aa060 con 0x55cdcbde2ff0 2024-07-24T22:18:14.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86f6dcb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01ac8c0 con 0x55cdcbde26d0 2024-07-24T22:18:14.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86f6dcb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01aa6b0 con 0x55cdcbdf3390 2024-07-24T22:18:14.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86ee59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbde26d0 0x55cdcbdede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86edd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde2ff0 0x55cdcbde5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86ee59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbde26d0 0x55cdcbdede20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:38082/0 (socket says 172.21.15.47:38082) 2024-07-24T22:18:14.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86ee59c640 1 -- 172.21.15.47:0/2350748972 learned_addr learned my addr 172.21.15.47:0/2350748972 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:14.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86eed9d640 1 --2- 172.21.15.47:0/2350748972 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbdf3390 0x55cdcbde5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86ee59c640 1 -- 172.21.15.47:0/2350748972 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbdf3390 msgr2=0x55cdcbde5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:14.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86ee59c640 1 --2- 172.21.15.47:0/2350748972 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbdf3390 0x55cdcbde5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86ee59c640 1 -- 172.21.15.47:0/2350748972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde2ff0 msgr2=0x55cdcbde5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:14.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86ee59c640 1 --2- 172.21.15.47:0/2350748972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde2ff0 0x55cdcbde5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86ee59c640 1 -- 172.21.15.47:0/2350748972 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdcbdee820 con 0x55cdcbde26d0 2024-07-24T22:18:14.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.331+0000 7f86ee59c640 1 --2- 172.21.15.47:0/2350748972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbde26d0 0x55cdcbdede20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009230 tx=0x7f86e003f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7777a4aac218aa8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:14.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.332+0000 7f86d7fff640 1 -- 172.21.15.47:0/2350748972 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0035040 con 0x55cdcbde26d0 2024-07-24T22:18:14.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.332+0000 7f86d7fff640 1 -- 172.21.15.47:0/2350748972 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e0059070 con 0x55cdcbde26d0 2024-07-24T22:18:14.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.332+0000 7f86d7fff640 1 -- 172.21.15.47:0/2350748972 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0053610 con 0x55cdcbde26d0 2024-07-24T22:18:14.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.332+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2350748972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbde26d0 msgr2=0x55cdcbdede20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:14.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.332+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2350748972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbde26d0 0x55cdcbdede20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009230 tx=0x7f86e003f000 comp rx=0 tx=0).stop 2024-07-24T22:18:14.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.332+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2350748972 shutdown_connections 2024-07-24T22:18:14.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.332+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2350748972 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbdf3390 0x55cdcbde5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.332+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2350748972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde2ff0 0x55cdcbde5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.332+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/2350748972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbde26d0 0x55cdcbdede20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.333+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2350748972 >> 172.21.15.47:0/2350748972 conn(0x55cdcbde0500 msgr2=0x55cdcbdf2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.333+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2350748972 shutdown_connections 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.333+0000 7f86f6dcb740 1 -- 172.21.15.47:0/2350748972 wait complete. 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.333+0000 7f86f6dcb740 1 -- start start 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.333+0000 7f86f6dcb740 1 Processor -- start 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.333+0000 7f86f6dcb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbde26d0 0x55cdcbdfb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.333+0000 7f86f6dcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdfb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.333+0000 7f86f6dcb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbdf3390 0x55cdcbde46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.333+0000 7f86f6dcb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01aad80 con 0x55cdcbde2ff0 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.333+0000 7f86f6dcb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01ac1f0 con 0x55cdcbdf3390 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.333+0000 7f86f6dcb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f86f01ab450 con 0x55cdcbde26d0 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.333+0000 7f86f6dcb740 10 client.0 _ll_register_callbacks cb 0x7f86e400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:14.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86ee59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbde26d0 0x55cdcbdfb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86edd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdfb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86edd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdfb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43322/0 (socket says 172.21.15.47:43322) 2024-07-24T22:18:14.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86eed9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbdf3390 0x55cdcbde46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86edd9b640 1 -- 172.21.15.47:0/4029736968 learned_addr learned my addr 172.21.15.47:0/4029736968 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:14.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86ee59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbde26d0 0x55cdcbdfb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:54020/0 (socket says 172.21.15.47:54020) 2024-07-24T22:18:14.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86edd9b640 1 -- 172.21.15.47:0/4029736968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbde26d0 msgr2=0x55cdcbdfb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:14.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86edd9b640 1 --2- 172.21.15.47:0/4029736968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbde26d0 0x55cdcbdfb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86edd9b640 1 -- 172.21.15.47:0/4029736968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbdf3390 msgr2=0x55cdcbde46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:14.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86edd9b640 1 --2- 172.21.15.47:0/4029736968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbdf3390 0x55cdcbde46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86edd9b640 1 -- 172.21.15.47:0/4029736968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdcbdfbf20 con 0x55cdcbde2ff0 2024-07-24T22:18:14.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86ee59c640 1 --2- 172.21.15.47:0/4029736968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbde26d0 0x55cdcbdfb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:14.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86edd9b640 1 --2- 172.21.15.47:0/4029736968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdfb810 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f86e40aaf80 tx=0x7f86e4004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd84afdc4e97cea server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:14.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:14.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86d5ffb640 1 -- 172.21.15.47:0/4029736968 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e40bc060 con 0x55cdcbde2ff0 2024-07-24T22:18:14.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86d5ffb640 1 -- 172.21.15.47:0/4029736968 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f86e40cc270 con 0x55cdcbde2ff0 2024-07-24T22:18:14.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86f6dcb740 1 -- 172.21.15.47:0/4029736968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e0059070 con 0x55cdcbde2ff0 2024-07-24T22:18:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.334+0000 7f86d5ffb640 1 -- 172.21.15.47:0/4029736968 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f86e40aa760 con 0x55cdcbde2ff0 2024-07-24T22:18:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.335+0000 7f86f6dcb740 10 client.17928 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.335+0000 7f86f6dcb740 1 -- 172.21.15.47:0/4029736968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cdcbe0a2a0 con 0x55cdcbde2ff0 2024-07-24T22:18:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.335+0000 7f86d5ffb640 1 -- 172.21.15.47:0/4029736968 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e0059070 con 0x55cdcbde2ff0 2024-07-24T22:18:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.335+0000 7f86d5ffb640 1 -- 172.21.15.47:0/4029736968 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f86e40b5040 con 0x55cdcbde2ff0 2024-07-24T22:18:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.335+0000 7f86f6dcb740 10 client.17928 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.335+0000 7f86f6dcb740 10 client.17928 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.335+0000 7f86f6dcb740 20 client.17928 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.335+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/4029736968 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cdcbe6ea60 0x55cdcbe70e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.335+0000 7f86f6dcb740 4 client.17928 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:18:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.335+0000 7f86f6dcb740 1 -- 172.21.15.47:0/4029736968 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cdcbd573a0 con 0x55cdcbe6ea60 2024-07-24T22:18:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.335+0000 7f86ee59c640 1 --2- 172.21.15.47:0/4029736968 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cdcbe6ea60 0x55cdcbe70e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86d5ffb640 10 client.17928 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86ee59c640 1 --2- 172.21.15.47:0/4029736968 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cdcbe6ea60 0x55cdcbe70e50 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5927f3473736a1d server_cookie=70b91dee4fd56e50 in_seq=0 out_seq=0 2024-07-24T22:18:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86d5ffb640 1 -- 172.21.15.47:0/4029736968 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cdcbd573a0 con 0x55cdcbe6ea60 2024-07-24T22:18:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86d5ffb640 10 client.17928 handle_command_reply: tid=0 2024-07-24T22:18:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86f6dcb740 1 client.17928 shutdown 2024-07-24T22:18:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86f6dcb740 1 -- 172.21.15.47:0/4029736968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde2ff0 msgr2=0x55cdcbdfb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/4029736968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdfb810 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f86e40aaf80 tx=0x7f86e4004990 comp rx=0 tx=0).stop 2024-07-24T22:18:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86f6dcb740 1 -- 172.21.15.47:0/4029736968 shutdown_connections 2024-07-24T22:18:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/4029736968 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55cdcbe6ea60 0x55cdcbe70e50 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/4029736968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cdcbdf3390 0x55cdcbde46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/4029736968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cdcbde2ff0 0x55cdcbdfb810 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86f6dcb740 1 --2- 172.21.15.47:0/4029736968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cdcbde26d0 0x55cdcbdfb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86d5ffb640 0 client.17928 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:14.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86f6dcb740 1 -- 172.21.15.47:0/4029736968 >> 172.21.15.47:0/4029736968 conn(0x55cdcbde0500 msgr2=0x55cdcbdded50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:14.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86f6dcb740 1 -- 172.21.15.47:0/4029736968 shutdown_connections 2024-07-24T22:18:14.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86f6dcb740 1 -- 172.21.15.47:0/4029736968 wait complete. 2024-07-24T22:18:14.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.336+0000 7f86f6dcb740 20 client.17928 trim_cache size 0 max 16384 2024-07-24T22:18:14.344 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:18:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.337+0000 7f86f4a1a640 1 -- 172.21.15.47:0/1252548316 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86d80b3d40 msgr2=0x7f86d80b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.337+0000 7f86f4a1a640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86d80b3d40 0x7f86d80b6200 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f86e0031440 tx=0x7f86e0005b90 comp rx=0 tx=0).stop 2024-07-24T22:18:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.337+0000 7f86f4a1a640 1 -- 172.21.15.47:0/1252548316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86f0108160 msgr2=0x7f86f0199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.337+0000 7f86f4a1a640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86f0108160 0x7f86f0199200 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f86e400e9f0 tx=0x7f86e400edf0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.337+0000 7f86f4a1a640 1 -- 172.21.15.47:0/1252548316 shutdown_connections 2024-07-24T22:18:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.337+0000 7f86f4a1a640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f86d80b3d40 0x7f86d80b6200 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.337+0000 7f86f4a1a640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0108ae0 0x7f86f019e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.337+0000 7f86f4a1a640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86f0108160 0x7f86f0199200 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.337+0000 7f86f4a1a640 1 --2- 172.21.15.47:0/1252548316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86f0102750 0x7f86f0198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.337+0000 7f86f4a1a640 1 -- 172.21.15.47:0/1252548316 >> 172.21.15.47:0/1252548316 conn(0x7f86f00fe200 msgr2=0x7f86f01005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.337+0000 7f86f4a1a640 1 -- 172.21.15.47:0/1252548316 shutdown_connections 2024-07-24T22:18:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:14.337+0000 7f86f4a1a640 1 -- 172.21.15.47:0/1252548316 wait complete. 2024-07-24T22:18:16.159 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:18:16.159 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:18:16.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:15 smithi183 ceph-mon[37007]: pgmap v708: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 3.0 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-07-24T22:18:16.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:15 smithi047 ceph-mon[32551]: pgmap v708: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 3.0 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-07-24T22:18:16.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:15 smithi188 ceph-mon[37380]: pgmap v708: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 15 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 3.0 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-07-24T22:18:16.440 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:17 smithi047 ceph-mon[32551]: pgmap v709: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 775 B/s wr, 3 op/s 2024-07-24T22:18:18.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:17 smithi183 ceph-mon[37007]: pgmap v709: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 775 B/s wr, 3 op/s 2024-07-24T22:18:18.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.216+0000 7f19194cb640 1 -- 172.21.15.47:0/3680774995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191410c9f0 msgr2=0x7f191410ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.216+0000 7f19194cb640 1 --2- 172.21.15.47:0/3680774995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191410c9f0 0x7f191410ee70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f190c009ca0 tx=0x7f190c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.216+0000 7f19194cb640 1 -- 172.21.15.47:0/3680774995 shutdown_connections 2024-07-24T22:18:18.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.216+0000 7f19194cb640 1 --2- 172.21.15.47:0/3680774995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191410c9f0 0x7f191410ee70 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.216+0000 7f19194cb640 1 --2- 172.21.15.47:0/3680774995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1914103ef0 0x7f191410c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.216+0000 7f19194cb640 1 --2- 172.21.15.47:0/3680774995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19141035d0 0x7f19141039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.216+0000 7f19194cb640 1 -- 172.21.15.47:0/3680774995 >> 172.21.15.47:0/3680774995 conn(0x7f19140782e0 msgr2=0x7f19140ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.216+0000 7f19194cb640 1 -- 172.21.15.47:0/3680774995 shutdown_connections 2024-07-24T22:18:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.217+0000 7f19194cb640 1 -- 172.21.15.47:0/3680774995 wait complete. 2024-07-24T22:18:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.217+0000 7f19194cb640 1 Processor -- start 2024-07-24T22:18:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.217+0000 7f19194cb640 1 -- start start 2024-07-24T22:18:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f19194cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19141035d0 0x7f191419add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f19194cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1914103ef0 0x7f191419b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f19194cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f191410c9f0 0x7f19141a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f19194cb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1914112670 con 0x7f19141035d0 2024-07-24T22:18:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f19194cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f19141124f0 con 0x7f191410c9f0 2024-07-24T22:18:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f19194cb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f19141127f0 con 0x7f1914103ef0 2024-07-24T22:18:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f1912ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19141035d0 0x7f191419add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f1912ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19141035d0 0x7f191419add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53138/0 (socket says 172.21.15.47:53138) 2024-07-24T22:18:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f1912ffd640 1 -- 172.21.15.47:0/1482444442 learned_addr learned my addr 172.21.15.47:0/1482444442 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f19137fe640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f191410c9f0 0x7f19141a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f190bfff640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1914103ef0 0x7f191419b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f1912ffd640 1 -- 172.21.15.47:0/1482444442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1914103ef0 msgr2=0x7f191419b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f1912ffd640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1914103ef0 0x7f191419b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f1912ffd640 1 -- 172.21.15.47:0/1482444442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f191410c9f0 msgr2=0x7f19141a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f1912ffd640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f191410c9f0 0x7f19141a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f1912ffd640 1 -- 172.21.15.47:0/1482444442 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19141a0e70 con 0x7f19141035d0 2024-07-24T22:18:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f1912ffd640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19141035d0 0x7f191419add0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f190400e9f0 tx=0x7f190400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.218+0000 7f1910ff9640 1 -- 172.21.15.47:0/1482444442 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190400cd80 con 0x7f19141035d0 2024-07-24T22:18:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.219+0000 7f1910ff9640 1 -- 172.21.15.47:0/1482444442 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19040054d0 con 0x7f19141035d0 2024-07-24T22:18:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.219+0000 7f19194cb640 1 -- 172.21.15.47:0/1482444442 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19141a1160 con 0x7f19141035d0 2024-07-24T22:18:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.219+0000 7f1910ff9640 1 -- 172.21.15.47:0/1482444442 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904010690 con 0x7f19141035d0 2024-07-24T22:18:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.219+0000 7f19194cb640 1 -- 172.21.15.47:0/1482444442 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19141a7820 con 0x7f19141035d0 2024-07-24T22:18:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.221+0000 7f191c21e740 1 Processor -- start 2024-07-24T22:18:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.221+0000 7f191c21e740 1 -- start start 2024-07-24T22:18:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.221+0000 7f1910ff9640 1 -- 172.21.15.47:0/1482444442 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f1904004e90 con 0x7f19141035d0 2024-07-24T22:18:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.221+0000 7f191c21e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869eb1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.221+0000 7f191c21e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eb21e0 0x55b869ebdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f191c21e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869ebe170 0x55b869ec0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f191c21e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b869e27280 con 0x55b869ebe170 2024-07-24T22:18:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f191c21e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b869e16780 con 0x55b869eb21e0 2024-07-24T22:18:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f191c21e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b869e1a7c0 con 0x55b869eb18c0 2024-07-24T22:18:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f190bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869ebe170 0x55b869ec0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f19137fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869eb1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f1912ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eb21e0 0x55b869ebdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f190bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869ebe170 0x55b869ec0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53152/0 (socket says 172.21.15.47:53152) 2024-07-24T22:18:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f190bfff640 1 -- 172.21.15.47:0/271882981 learned_addr learned my addr 172.21.15.47:0/271882981 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f19137fe640 1 -- 172.21.15.47:0/271882981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eb21e0 msgr2=0x55b869ebdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f19137fe640 1 --2- 172.21.15.47:0/271882981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eb21e0 0x55b869ebdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f19137fe640 1 -- 172.21.15.47:0/271882981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869ebe170 msgr2=0x55b869ec0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f19137fe640 1 --2- 172.21.15.47:0/271882981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869ebe170 0x55b869ec0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f19137fe640 1 -- 172.21.15.47:0/271882981 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b869b7a790 con 0x55b869eb18c0 2024-07-24T22:18:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f190bfff640 1 --2- 172.21.15.47:0/271882981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869ebe170 0x55b869ec0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f19137fe640 1 --2- 172.21.15.47:0/271882981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869eb1ca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f190c005e30 tx=0x7f190c005f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4abea6bcaa6ffb41 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f1910ff9640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f19000b3d40 0x7f19000b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f19097fa640 1 -- 172.21.15.47:0/271882981 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c031cf0 con 0x55b869eb18c0 2024-07-24T22:18:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f1912ffd640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f19000b3d40 0x7f19000b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f19097fa640 1 -- 172.21.15.47:0/271882981 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f190c036030 con 0x55b869eb18c0 2024-07-24T22:18:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.222+0000 7f19097fa640 1 -- 172.21.15.47:0/271882981 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c0042a0 con 0x55b869eb18c0 2024-07-24T22:18:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.223+0000 7f1910ff9640 1 -- 172.21.15.47:0/1482444442 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f19040e4440 con 0x7f19141035d0 2024-07-24T22:18:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.223+0000 7f191c21e740 1 -- 172.21.15.47:0/271882981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 msgr2=0x55b869eb1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.223+0000 7f1912ffd640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f19000b3d40 0x7f19000b6200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f19040e1be0 tx=0x7f19040e7f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.223+0000 7f191c21e740 1 --2- 172.21.15.47:0/271882981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869eb1ca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f190c005e30 tx=0x7f190c005f60 comp rx=0 tx=0).stop 2024-07-24T22:18:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.223+0000 7f191c21e740 1 -- 172.21.15.47:0/271882981 shutdown_connections 2024-07-24T22:18:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.223+0000 7f191c21e740 1 --2- 172.21.15.47:0/271882981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869ebe170 0x55b869ec0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.223+0000 7f191c21e740 1 --2- 172.21.15.47:0/271882981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eb21e0 0x55b869ebdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.223+0000 7f191c21e740 1 --2- 172.21.15.47:0/271882981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869eb1ca0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.223+0000 7f191c21e740 1 -- 172.21.15.47:0/271882981 >> 172.21.15.47:0/271882981 conn(0x55b869eaf6f0 msgr2=0x55b869eb0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.223+0000 7f191c21e740 1 -- 172.21.15.47:0/271882981 shutdown_connections 2024-07-24T22:18:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.223+0000 7f191c21e740 1 -- 172.21.15.47:0/271882981 wait complete. 2024-07-24T22:18:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f191c21e740 1 -- start start 2024-07-24T22:18:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f191c21e740 1 Processor -- start 2024-07-24T22:18:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f191c21e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869ebd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f191c21e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869ebadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f191c21e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869ebe170 0x55b869ebb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f191c21e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b869d50ab0 con 0x55b869eb21e0 2024-07-24T22:18:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f191c21e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b869d9e9e0 con 0x55b869ebe170 2024-07-24T22:18:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f191c21e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b869ec0c70 con 0x55b869eb18c0 2024-07-24T22:18:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f191c21e740 10 client.0 _ll_register_callbacks cb 0x55b869b26a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f190bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869ebadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f19137fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869ebe170 0x55b869ebb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f190bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869ebadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53156/0 (socket says 172.21.15.47:53156) 2024-07-24T22:18:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f190bfff640 1 -- 172.21.15.47:0/2196702064 learned_addr learned my addr 172.21.15.47:0/2196702064 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.224+0000 7f19137fe640 1 --2- 172.21.15.47:0/2196702064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869ebd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.225+0000 7f190bfff640 1 -- 172.21.15.47:0/2196702064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 msgr2=0x55b869ebd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.225+0000 7f190bfff640 1 --2- 172.21.15.47:0/2196702064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869ebd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.225+0000 7f190bfff640 1 -- 172.21.15.47:0/2196702064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869ebe170 msgr2=0x55b869ebb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.225+0000 7f190bfff640 1 --2- 172.21.15.47:0/2196702064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869ebe170 0x55b869ebb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.225+0000 7f190bfff640 1 -- 172.21.15.47:0/2196702064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b869bf3620 con 0x55b869eb21e0 2024-07-24T22:18:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.225+0000 7f190bfff640 1 --2- 172.21.15.47:0/2196702064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869ebadc0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f18fc012810 tx=0x7f18fc012cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d7c96e7e757313 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.225+0000 7f18fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.225+0000 7f18fa7fc640 1 -- 172.21.15.47:0/2196702064 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc00f920 con 0x55b869eb21e0 2024-07-24T22:18:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.225+0000 7f18fa7fc640 1 -- 172.21.15.47:0/2196702064 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f18fc00fac0 con 0x55b869eb21e0 2024-07-24T22:18:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.225+0000 7f191c21e740 1 -- 172.21.15.47:0/2196702064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b869dc5ce0 con 0x55b869eb21e0 2024-07-24T22:18:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.225+0000 7f18fa7fc640 1 -- 172.21.15.47:0/2196702064 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f18fc00fcc0 con 0x55b869eb21e0 2024-07-24T22:18:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.225+0000 7f191c21e740 10 client.17940 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.225+0000 7f191c21e740 1 -- 172.21.15.47:0/2196702064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b869ecc460 con 0x55b869eb21e0 2024-07-24T22:18:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.226+0000 7f18fa7fc640 1 -- 172.21.15.47:0/2196702064 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b869dc5ce0 con 0x55b869eb21e0 2024-07-24T22:18:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.226+0000 7f18fa7fc640 1 -- 172.21.15.47:0/2196702064 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f18fc01c420 con 0x55b869eb21e0 2024-07-24T22:18:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.226+0000 7f191c21e740 10 client.17940 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.226+0000 7f191c21e740 10 client.17940 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.226+0000 7f191c21e740 20 client.17940 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.226+0000 7f191c21e740 1 --2- 172.21.15.47:0/2196702064 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b869ecd9e0 0x55b869ecfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.226+0000 7f191c21e740 4 client.17940 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.226+0000 7f191c21e740 1 -- 172.21.15.47:0/2196702064 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b869e291d0 con 0x55b869ecd9e0 2024-07-24T22:18:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.226+0000 7f19137fe640 1 --2- 172.21.15.47:0/2196702064 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b869ecd9e0 0x55b869ecfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.226+0000 7f19137fe640 1 --2- 172.21.15.47:0/2196702064 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b869ecd9e0 0x55b869ecfdd0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbbd4acb22008f17 server_cookie=8d979bbe8287dd59 in_seq=0 out_seq=0 2024-07-24T22:18:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.226+0000 7f18fa7fc640 10 client.17940 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:18.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f18fa7fc640 1 -- 172.21.15.47:0/2196702064 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b869e291d0 con 0x55b869ecd9e0 2024-07-24T22:18:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f18fa7fc640 10 client.17940 handle_command_reply: tid=0 2024-07-24T22:18:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f191c21e740 1 client.17940 shutdown 2024-07-24T22:18:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f191c21e740 1 -- 172.21.15.47:0/2196702064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 msgr2=0x55b869ebadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f191c21e740 1 --2- 172.21.15.47:0/2196702064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869ebadc0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f18fc012810 tx=0x7f18fc012cd0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f191c21e740 1 -- 172.21.15.47:0/2196702064 shutdown_connections 2024-07-24T22:18:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f191c21e740 1 --2- 172.21.15.47:0/2196702064 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b869ecd9e0 0x55b869ecfdd0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f191c21e740 1 --2- 172.21.15.47:0/2196702064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869ebe170 0x55b869ebb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f18fa7fc640 0 client.17940 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f191c21e740 1 --2- 172.21.15.47:0/2196702064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869ebadc0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f191c21e740 1 --2- 172.21.15.47:0/2196702064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869ebd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f191c21e740 1 -- 172.21.15.47:0/2196702064 >> 172.21.15.47:0/2196702064 conn(0x55b869eaf6f0 msgr2=0x55b869eb5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:18.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f191c21e740 1 -- 172.21.15.47:0/2196702064 shutdown_connections 2024-07-24T22:18:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.227+0000 7f191c21e740 1 -- 172.21.15.47:0/2196702064 wait complete. 2024-07-24T22:18:18.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.228+0000 7f191c21e740 20 client.17940 trim_cache size 0 max 16384 2024-07-24T22:18:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.243+0000 7f191c21e740 1 Processor -- start 2024-07-24T22:18:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.243+0000 7f191c21e740 1 -- start start 2024-07-24T22:18:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f191c21e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eaf6f0 0x55b869ebb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f191c21e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eb18c0 0x55b869ed5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f191c21e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869ed5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f191c21e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f19141ae370 con 0x55b869eb21e0 2024-07-24T22:18:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f191c21e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f19141b0bd0 con 0x55b869eb18c0 2024-07-24T22:18:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f191c21e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f19141ae9c0 con 0x55b869eaf6f0 2024-07-24T22:18:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f19137fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eaf6f0 0x55b869ebb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f19137fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eaf6f0 0x55b869ebb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:41838/0 (socket says 172.21.15.47:41838) 2024-07-24T22:18:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f19137fe640 1 -- 172.21.15.47:0/3271811517 learned_addr learned my addr 172.21.15.47:0/3271811517 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f19137fe640 1 --2- 172.21.15.47:0/3271811517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869ed5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f190bfff640 1 --2- 172.21.15.47:0/3271811517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eb18c0 0x55b869ed5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f19137fe640 1 -- 172.21.15.47:0/3271811517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eb18c0 msgr2=0x55b869ed5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f19137fe640 1 --2- 172.21.15.47:0/3271811517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eb18c0 0x55b869ed5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f19137fe640 1 -- 172.21.15.47:0/3271811517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 msgr2=0x55b869ed5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f19137fe640 1 --2- 172.21.15.47:0/3271811517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869ed5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.244+0000 7f19137fe640 1 -- 172.21.15.47:0/3271811517 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b869ed0430 con 0x55b869eaf6f0 2024-07-24T22:18:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.245+0000 7f19137fe640 1 --2- 172.21.15.47:0/3271811517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eaf6f0 0x55b869ebb2a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f190c02ade0 tx=0x7f190c005f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f2a4527c39d2fd6 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:18.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.245+0000 7f1908ff9640 1 -- 172.21.15.47:0/3271811517 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c04a040 con 0x55b869eaf6f0 2024-07-24T22:18:18.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.245+0000 7f1908ff9640 1 -- 172.21.15.47:0/3271811517 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f190c036040 con 0x55b869eaf6f0 2024-07-24T22:18:18.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.245+0000 7f1908ff9640 1 -- 172.21.15.47:0/3271811517 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c004180 con 0x55b869eaf6f0 2024-07-24T22:18:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.246+0000 7f191c21e740 1 -- 172.21.15.47:0/3271811517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eaf6f0 msgr2=0x55b869ebb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.246+0000 7f191c21e740 1 --2- 172.21.15.47:0/3271811517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eaf6f0 0x55b869ebb2a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f190c02ade0 tx=0x7f190c005f60 comp rx=0 tx=0).stop 2024-07-24T22:18:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.246+0000 7f191c21e740 1 -- 172.21.15.47:0/3271811517 shutdown_connections 2024-07-24T22:18:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.246+0000 7f191c21e740 1 --2- 172.21.15.47:0/3271811517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869ed5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.246+0000 7f191c21e740 1 --2- 172.21.15.47:0/3271811517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eb18c0 0x55b869ed5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.246+0000 7f191c21e740 1 --2- 172.21.15.47:0/3271811517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eaf6f0 0x55b869ebb2a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.246+0000 7f191c21e740 1 -- 172.21.15.47:0/3271811517 >> 172.21.15.47:0/3271811517 conn(0x55b869eb6720 msgr2=0x55b869eb0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.246+0000 7f191c21e740 1 -- 172.21.15.47:0/3271811517 shutdown_connections 2024-07-24T22:18:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.246+0000 7f191c21e740 1 -- 172.21.15.47:0/3271811517 wait complete. 2024-07-24T22:18:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.246+0000 7f191c21e740 1 -- start start 2024-07-24T22:18:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.246+0000 7f191c21e740 1 Processor -- start 2024-07-24T22:18:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f191c21e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eaf6f0 0x55b869ec1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f191c21e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869ec1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f191c21e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869f306f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f191c21e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f19141af090 con 0x55b869eb21e0 2024-07-24T22:18:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f191c21e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f19141b0500 con 0x55b869eaf6f0 2024-07-24T22:18:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f191c21e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f19141af760 con 0x55b869eb18c0 2024-07-24T22:18:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f191c21e740 10 client.0 _ll_register_callbacks cb 0x7f18fc009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f190bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869ec1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f19137fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eaf6f0 0x55b869ec1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f190bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869ec1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:41842/0 (socket says 172.21.15.47:41842) 2024-07-24T22:18:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f190bfff640 1 -- 172.21.15.47:0/279442607 learned_addr learned my addr 172.21.15.47:0/279442607 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f19137fe640 1 --2- 172.21.15.47:0/279442607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869f306f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f190bfff640 1 -- 172.21.15.47:0/279442607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eaf6f0 msgr2=0x55b869ec1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f190bfff640 1 --2- 172.21.15.47:0/279442607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eaf6f0 0x55b869ec1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f190bfff640 1 -- 172.21.15.47:0/279442607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 msgr2=0x55b869f306f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f190bfff640 1 --2- 172.21.15.47:0/279442607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869f306f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f190bfff640 1 -- 172.21.15.47:0/279442607 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b869f30e30 con 0x55b869eb18c0 2024-07-24T22:18:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f190bfff640 1 --2- 172.21.15.47:0/279442607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869ec1e00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55b869eab2e0 tx=0x7f18fc009fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2658c120807c1f87 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f18fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:18:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f18fa7fc640 1 -- 172.21.15.47:0/279442607 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc00fe60 con 0x55b869eb18c0 2024-07-24T22:18:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f191c21e740 1 -- 172.21.15.47:0/279442607 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f190c036040 con 0x55b869eb18c0 2024-07-24T22:18:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.247+0000 7f18fa7fc640 1 -- 172.21.15.47:0/279442607 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f18fc01c420 con 0x55b869eb18c0 2024-07-24T22:18:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.248+0000 7f18fa7fc640 1 -- 172.21.15.47:0/279442607 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f18fc034050 con 0x55b869eb18c0 2024-07-24T22:18:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.248+0000 7f191c21e740 10 client.27016 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.248+0000 7f191c21e740 1 -- 172.21.15.47:0/279442607 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b869f382f0 con 0x55b869eb18c0 2024-07-24T22:18:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.248+0000 7f18fa7fc640 1 -- 172.21.15.47:0/279442607 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f190c036040 con 0x55b869eb18c0 2024-07-24T22:18:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.248+0000 7f18fa7fc640 1 -- 172.21.15.47:0/279442607 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f18fc02b070 con 0x55b869eb18c0 2024-07-24T22:18:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.248+0000 7f191c21e740 10 client.27016 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.248+0000 7f191c21e740 10 client.27016 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.248+0000 7f191c21e740 20 client.27016 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.248+0000 7f191c21e740 1 --2- 172.21.15.47:0/279442607 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b869ebe170 0x55b869f3aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.248+0000 7f191c21e740 4 client.27016 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:18:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.248+0000 7f191c21e740 1 -- 172.21.15.47:0/279442607 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b869e24c70 con 0x55b869ebe170 2024-07-24T22:18:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.248+0000 7f19137fe640 1 --2- 172.21.15.47:0/279442607 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b869ebe170 0x55b869f3aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.249+0000 7f18fa7fc640 10 client.27016 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.249+0000 7f19137fe640 1 --2- 172.21.15.47:0/279442607 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b869ebe170 0x55b869f3aa80 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58f31b7d9d58ce43 server_cookie=24d44237c33e339e in_seq=0 out_seq=0 2024-07-24T22:18:18.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:17 smithi188 ceph-mon[37380]: pgmap v709: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 775 B/s wr, 3 op/s 2024-07-24T22:18:18.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.334+0000 7fe18a8b6640 1 -- 172.21.15.47:0/2486704300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1841079e0 msgr2=0x7fe18410e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.334+0000 7fe18a8b6640 1 --2- 172.21.15.47:0/2486704300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1841079e0 0x7fe18410e1e0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009ca0 tx=0x7fe17c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.334+0000 7fe18a8b6640 1 -- 172.21.15.47:0/2486704300 shutdown_connections 2024-07-24T22:18:18.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.334+0000 7fe18a8b6640 1 --2- 172.21.15.47:0/2486704300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1841079e0 0x7fe18410e1e0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.334+0000 7fe18a8b6640 1 --2- 172.21.15.47:0/2486704300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe184107060 0x7fe1841074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.334+0000 7fe18a8b6640 1 --2- 172.21.15.47:0/2486704300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe184101650 0x7fe184101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.334+0000 7fe18a8b6640 1 -- 172.21.15.47:0/2486704300 >> 172.21.15.47:0/2486704300 conn(0x7fe1840fd0c0 msgr2=0x7fe1840ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:18.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.334+0000 7fe18a8b6640 1 -- 172.21.15.47:0/2486704300 shutdown_connections 2024-07-24T22:18:18.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.334+0000 7fe18a8b6640 1 -- 172.21.15.47:0/2486704300 wait complete. 2024-07-24T22:18:18.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.334+0000 7fe18a8b6640 1 Processor -- start 2024-07-24T22:18:18.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.334+0000 7fe18a8b6640 1 -- start start 2024-07-24T22:18:18.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe18a8b6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe184101650 0x7fe18410ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe18a8b6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe184107060 0x7fe18410f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe18a8b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1841079e0 0x7fe18410f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe18a8b6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe1841127c0 con 0x7fe1841079e0 2024-07-24T22:18:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe18a8b6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe184112640 con 0x7fe184107060 2024-07-24T22:18:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe18a8b6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe184112940 con 0x7fe184101650 2024-07-24T22:18:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe183fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe184101650 0x7fe18410ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe188e53640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1841079e0 0x7fe18410f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe183fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe184101650 0x7fe18410ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:41856/0 (socket says 172.21.15.47:41856) 2024-07-24T22:18:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe183fff640 1 -- 172.21.15.47:0/1060032343 learned_addr learned my addr 172.21.15.47:0/1060032343 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe184107060 0x7fe18410f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe188e53640 1 -- 172.21.15.47:0/1060032343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe184101650 msgr2=0x7fe18410ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe188e53640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe184101650 0x7fe18410ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe188e53640 1 -- 172.21.15.47:0/1060032343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe184107060 msgr2=0x7fe18410f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe188e53640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe184107060 0x7fe18410f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe188e53640 1 -- 172.21.15.47:0/1060032343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1841a6fd0 con 0x7fe1841079e0 2024-07-24T22:18:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe184107060 0x7fe18410f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe183fff640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe184101650 0x7fe18410ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe188e53640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1841079e0 0x7fe18410f770 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fe17c005e30 tx=0x7fe17c0317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.335+0000 7fe181ffb640 1 -- 172.21.15.47:0/1060032343 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c003b70 con 0x7fe1841079e0 2024-07-24T22:18:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.336+0000 7fe181ffb640 1 -- 172.21.15.47:0/1060032343 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe17c003d10 con 0x7fe1841079e0 2024-07-24T22:18:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.336+0000 7fe18a8b6640 1 -- 172.21.15.47:0/1060032343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1841a7260 con 0x7fe1841079e0 2024-07-24T22:18:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.336+0000 7fe181ffb640 1 -- 172.21.15.47:0/1060032343 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c02f970 con 0x7fe1841079e0 2024-07-24T22:18:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.336+0000 7fe18a8b6640 1 -- 172.21.15.47:0/1060032343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1841a77a0 con 0x7fe1841079e0 2024-07-24T22:18:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.338+0000 7fe18cc67740 1 Processor -- start 2024-07-24T22:18:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.338+0000 7fe181ffb640 1 -- 172.21.15.47:0/1060032343 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe17c02fb10 con 0x7fe1841079e0 2024-07-24T22:18:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.339+0000 7fe18cc67740 1 -- start start 2024-07-24T22:18:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.339+0000 7fe18cc67740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e149310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.339+0000 7fe18cc67740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e149850 0x56198e1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.339+0000 7fe18cc67740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e1557e0 0x56198e157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.339+0000 7fe18cc67740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56198e0c09f0 con 0x56198e148f30 2024-07-24T22:18:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.339+0000 7fe18cc67740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56198e0afef0 con 0x56198e1557e0 2024-07-24T22:18:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.339+0000 7fe18cc67740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56198e0b3f30 con 0x56198e149850 2024-07-24T22:18:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.339+0000 7fe181ffb640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe1700b3d40 0x7fe1700b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe183fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e149850 0x56198e1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe183fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e149850 0x56198e1552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:41866/0 (socket says 172.21.15.47:41866) 2024-07-24T22:18:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe183fff640 1 -- 172.21.15.47:0/1397201113 learned_addr learned my addr 172.21.15.47:0/1397201113 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/1397201113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe181ffb640 1 -- 172.21.15.47:0/1060032343 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7fe17c105140 con 0x7fe1841079e0 2024-07-24T22:18:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/1397201113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e1557e0 0x56198e157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe183fff640 1 -- 172.21.15.47:0/1397201113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e1557e0 msgr2=0x56198e157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe183fff640 1 --2- 172.21.15.47:0/1397201113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e1557e0 0x56198e157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe183fff640 1 -- 172.21.15.47:0/1397201113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 msgr2=0x56198e149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe183fff640 1 --2- 172.21.15.47:0/1397201113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe183fff640 1 -- 172.21.15.47:0/1397201113 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56198de10930 con 0x56198e149850 2024-07-24T22:18:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/1397201113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:18.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe183fff640 1 --2- 172.21.15.47:0/1397201113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e149850 0x56198e1552a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe174011650 tx=0x7fe174009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a2362e589d79b3 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:18.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.340+0000 7fe188e53640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe1700b3d40 0x7fe1700b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.341+0000 7fe17a7fc640 1 -- 172.21.15.47:0/1397201113 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17401e070 con 0x56198e149850 2024-07-24T22:18:18.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.341+0000 7fe188e53640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe1700b3d40 0x7fe1700b6200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe17c102a90 tx=0x7fe17c004890 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:18.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.341+0000 7fe17a7fc640 1 -- 172.21.15.47:0/1397201113 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe17400fb70 con 0x56198e149850 2024-07-24T22:18:18.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.341+0000 7fe17a7fc640 1 -- 172.21.15.47:0/1397201113 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174019c60 con 0x56198e149850 2024-07-24T22:18:18.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.342+0000 7fe18cc67740 1 -- 172.21.15.47:0/1397201113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e149850 msgr2=0x56198e1552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.342+0000 7fe18cc67740 1 --2- 172.21.15.47:0/1397201113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e149850 0x56198e1552a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe174011650 tx=0x7fe174009f90 comp rx=0 tx=0).stop 2024-07-24T22:18:18.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.342+0000 7fe18cc67740 1 -- 172.21.15.47:0/1397201113 shutdown_connections 2024-07-24T22:18:18.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.342+0000 7fe18cc67740 1 --2- 172.21.15.47:0/1397201113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e1557e0 0x56198e157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.342+0000 7fe18cc67740 1 --2- 172.21.15.47:0/1397201113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e149850 0x56198e1552a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.342+0000 7fe18cc67740 1 --2- 172.21.15.47:0/1397201113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.342+0000 7fe18cc67740 1 -- 172.21.15.47:0/1397201113 >> 172.21.15.47:0/1397201113 conn(0x56198e146d60 msgr2=0x56198e147f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:18.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.342+0000 7fe18cc67740 1 -- 172.21.15.47:0/1397201113 shutdown_connections 2024-07-24T22:18:18.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.343+0000 7fe18cc67740 1 -- 172.21.15.47:0/1397201113 wait complete. 2024-07-24T22:18:18.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.343+0000 7fe18cc67740 1 -- start start 2024-07-24T22:18:18.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.343+0000 7fe18cc67740 1 Processor -- start 2024-07-24T22:18:18.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.344+0000 7fe18cc67740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e152780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.344+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.344+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53212/0 (socket says 172.21.15.47:53212) 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.344+0000 7fe17b7fe640 1 -- 172.21.15.47:0/4064774371 learned_addr learned my addr 172.21.15.47:0/4064774371 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.344+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e149850 0x56198e152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.344+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e1557e0 0x56198e153200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.344+0000 7fe18cc67740 1 -- 172.21.15.47:0/4064774371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56198df13890 con 0x56198e148f30 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.344+0000 7fe18cc67740 1 -- 172.21.15.47:0/4064774371 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56198e052390 con 0x56198e149850 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.344+0000 7fe18cc67740 1 -- 172.21.15.47:0/4064774371 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56198e158460 con 0x56198e1557e0 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.345+0000 7fe17b7fe640 1 -- 172.21.15.47:0/4064774371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e1557e0 msgr2=0x56198e153200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.345+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e1557e0 0x56198e153200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.345+0000 7fe17b7fe640 1 -- 172.21.15.47:0/4064774371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e149850 msgr2=0x56198e152cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.345+0000 7fe183fff640 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e149850 0x56198e152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.345+0000 7fe18cc67740 10 client.0 _ll_register_callbacks cb 0x56198e05c500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.345+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e149850 0x56198e152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.345+0000 7fe17b7fe640 1 -- 172.21.15.47:0/4064774371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56198e04cd60 con 0x56198e148f30 2024-07-24T22:18:18.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.345+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e152780 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fe16c012dc0 tx=0x7fe16c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1517a65db2f88876 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:18.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.345+0000 7fe1637fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:18.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.345+0000 7fe1637fe640 1 -- 172.21.15.47:0/4064774371 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16c01b030 con 0x56198e148f30 2024-07-24T22:18:18.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.345+0000 7fe1637fe640 1 -- 172.21.15.47:0/4064774371 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7fe16c009d50 con 0x56198e148f30 2024-07-24T22:18:18.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.345+0000 7fe18cc67740 1 -- 172.21.15.47:0/4064774371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe17400fb70 con 0x56198e148f30 2024-07-24T22:18:18.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.346+0000 7fe1637fe640 1 -- 172.21.15.47:0/4064774371 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe16c005020 con 0x56198e148f30 2024-07-24T22:18:18.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.346+0000 7fe18cc67740 10 client.17958 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:18.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.346+0000 7fe18cc67740 1 -- 172.21.15.47:0/4064774371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({fsmap=20}) -- 0x56198e1642d0 con 0x56198e148f30 2024-07-24T22:18:18.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.347+0000 7fe1637fe640 1 -- 172.21.15.47:0/4064774371 <== mon.0 v2:172.21.15.47:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe16c0051c0 con 0x56198e148f30 2024-07-24T22:18:18.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.347+0000 7fe18cc67740 10 client.17958 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:18.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.347+0000 7fe18cc67740 10 client.17958 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:18.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.347+0000 7fe18cc67740 20 client.17958 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:18.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.347+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56198e165620 0x56198e167ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.347+0000 7fe18cc67740 4 client.17958 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:18.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.347+0000 7fe18cc67740 1 -- 172.21.15.47:0/4064774371 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56198e0c2940 con 0x56198e165620 2024-07-24T22:18:18.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.347+0000 7fe183fff640 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56198e165620 0x56198e167ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.348+0000 7fe1637fe640 10 client.17958 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:18.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.348+0000 7fe183fff640 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56198e165620 0x56198e167ac0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58a4fa360bbb5722 server_cookie=58cb148896372aa2 in_seq=0 out_seq=0 2024-07-24T22:18:18.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.348+0000 7fe1637fe640 1 -- 172.21.15.47:0/4064774371 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56198e0c2940 con 0x56198e165620 2024-07-24T22:18:18.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.348+0000 7fe1637fe640 10 client.17958 handle_command_reply: tid=0 2024-07-24T22:18:18.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.348+0000 7fe18cc67740 1 client.17958 shutdown 2024-07-24T22:18:18.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.349+0000 7fe18cc67740 1 -- 172.21.15.47:0/4064774371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 msgr2=0x56198e152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.349+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e152780 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fe16c012dc0 tx=0x7fe16c011810 comp rx=0 tx=0).stop 2024-07-24T22:18:18.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.349+0000 7fe18cc67740 1 -- 172.21.15.47:0/4064774371 shutdown_connections 2024-07-24T22:18:18.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.349+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56198e165620 0x56198e167ac0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.349+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e1557e0 0x56198e153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.349+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e149850 0x56198e152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.349+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4064774371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e152780 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.349+0000 7fe18cc67740 1 -- 172.21.15.47:0/4064774371 >> 172.21.15.47:0/4064774371 conn(0x56198e146d60 msgr2=0x56198e14c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:18.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.349+0000 7fe1637fe640 0 client.17958 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.361+0000 7fe18cc67740 1 -- 172.21.15.47:0/4064774371 shutdown_connections 2024-07-24T22:18:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.361+0000 7fe18cc67740 1 -- 172.21.15.47:0/4064774371 wait complete. 2024-07-24T22:18:18.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.361+0000 7fe18cc67740 20 client.17958 trim_cache size 0 max 16384 2024-07-24T22:18:18.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.383+0000 7fe18cc67740 1 Processor -- start 2024-07-24T22:18:18.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.383+0000 7fe18cc67740 1 -- start start 2024-07-24T22:18:18.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.383+0000 7fe18cc67740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e148f30 0x56198e14d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.383+0000 7fe18cc67740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e149850 0x56198e145d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.383+0000 7fe18cc67740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e1557e0 0x56198e16d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.383+0000 7fe18cc67740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe1841ae360 con 0x56198e1557e0 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.383+0000 7fe18cc67740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe1841b0bc0 con 0x56198e148f30 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.383+0000 7fe18cc67740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe1841ae9b0 con 0x56198e149850 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.383+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e1557e0 0x56198e16d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.383+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e1557e0 0x56198e16d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53218/0 (socket says 172.21.15.47:53218) 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.383+0000 7fe17b7fe640 1 -- 172.21.15.47:0/1541117708 learned_addr learned my addr 172.21.15.47:0/1541117708 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.383+0000 7fe183fff640 1 --2- 172.21.15.47:0/1541117708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e149850 0x56198e145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.384+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/1541117708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e148f30 0x56198e14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.384+0000 7fe17b7fe640 1 -- 172.21.15.47:0/1541117708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e149850 msgr2=0x56198e145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.384+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/1541117708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e149850 0x56198e145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.384+0000 7fe17b7fe640 1 -- 172.21.15.47:0/1541117708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e148f30 msgr2=0x56198e14d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.384+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/1541117708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e148f30 0x56198e14d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.384+0000 7fe17b7fe640 1 -- 172.21.15.47:0/1541117708 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56198e150c80 con 0x56198e1557e0 2024-07-24T22:18:18.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.384+0000 7fe183fff640 1 --2- 172.21.15.47:0/1541117708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e149850 0x56198e145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:18.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.384+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/1541117708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e1557e0 0x56198e16d390 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0095f0 tx=0x7fe16c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b88ab0025037003 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:18.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.384+0000 7fe179ffb640 1 -- 172.21.15.47:0/1541117708 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16c01b050 con 0x56198e1557e0 2024-07-24T22:18:18.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.384+0000 7fe179ffb640 1 -- 172.21.15.47:0/1541117708 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe17400fb70 con 0x56198e1557e0 2024-07-24T22:18:18.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.384+0000 7fe179ffb640 1 -- 172.21.15.47:0/1541117708 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0208b0 con 0x56198e1557e0 2024-07-24T22:18:18.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.385+0000 7fe18cc67740 1 -- 172.21.15.47:0/1541117708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e1557e0 msgr2=0x56198e16d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.385+0000 7fe18cc67740 1 --2- 172.21.15.47:0/1541117708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e1557e0 0x56198e16d390 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0095f0 tx=0x7fe16c015000 comp rx=0 tx=0).stop 2024-07-24T22:18:18.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.385+0000 7fe18cc67740 1 -- 172.21.15.47:0/1541117708 shutdown_connections 2024-07-24T22:18:18.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.385+0000 7fe18cc67740 1 --2- 172.21.15.47:0/1541117708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e1557e0 0x56198e16d390 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.385+0000 7fe18cc67740 1 --2- 172.21.15.47:0/1541117708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e149850 0x56198e145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.385+0000 7fe18cc67740 1 --2- 172.21.15.47:0/1541117708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e148f30 0x56198e14d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.385+0000 7fe18cc67740 1 -- 172.21.15.47:0/1541117708 >> 172.21.15.47:0/1541117708 conn(0x56198e146d60 msgr2=0x56198e145600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:18.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.385+0000 7fe18cc67740 1 -- 172.21.15.47:0/1541117708 shutdown_connections 2024-07-24T22:18:18.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.385+0000 7fe18cc67740 1 -- 172.21.15.47:0/1541117708 wait complete. 2024-07-24T22:18:18.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.385+0000 7fe18cc67740 1 -- start start 2024-07-24T22:18:18.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.386+0000 7fe18cc67740 1 Processor -- start 2024-07-24T22:18:18.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.386+0000 7fe18cc67740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.386+0000 7fe18cc67740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e149850 0x56198e15df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.386+0000 7fe18cc67740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e1557e0 0x56198e14f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.386+0000 7fe18cc67740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe1841af080 con 0x56198e148f30 2024-07-24T22:18:18.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.386+0000 7fe18cc67740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe1841b04f0 con 0x56198e149850 2024-07-24T22:18:18.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.386+0000 7fe18cc67740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe1841af750 con 0x56198e1557e0 2024-07-24T22:18:18.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.386+0000 7fe18cc67740 10 client.0 _ll_register_callbacks cb 0x7fe16c012760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:18.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.386+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.386+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53232/0 (socket says 172.21.15.47:53232) 2024-07-24T22:18:18.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.386+0000 7fe183fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e149850 0x56198e15df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.386+0000 7fe17b7fe640 1 -- 172.21.15.47:0/4208490938 learned_addr learned my addr 172.21.15.47:0/4208490938 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:18.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.386+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/4208490938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e1557e0 0x56198e14f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.387+0000 7fe183fff640 1 -- 172.21.15.47:0/4208490938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e1557e0 msgr2=0x56198e14f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.387+0000 7fe183fff640 1 --2- 172.21.15.47:0/4208490938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e1557e0 0x56198e14f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.387+0000 7fe183fff640 1 -- 172.21.15.47:0/4208490938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 msgr2=0x56198e15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.387+0000 7fe183fff640 1 --2- 172.21.15.47:0/4208490938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e15d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.387+0000 7fe183fff640 1 -- 172.21.15.47:0/4208490938 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56198e14fab0 con 0x56198e149850 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.387+0000 7fe183fff640 1 --2- 172.21.15.47:0/4208490938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e149850 0x56198e15df00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe174019880 tx=0x7fe174005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c7d06af969218e1 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.387+0000 7fe1637fe640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.387+0000 7fe1637fe640 1 -- 172.21.15.47:0/4208490938 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17401e040 con 0x56198e149850 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.387+0000 7fe1637fe640 1 -- 172.21.15.47:0/4208490938 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7fe174009c10 con 0x56198e149850 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.387+0000 7fe18cc67740 1 -- 172.21.15.47:0/4208490938 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe17400fb70 con 0x56198e149850 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.387+0000 7fe1637fe640 1 -- 172.21.15.47:0/4208490938 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe17400fd20 con 0x56198e149850 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.387+0000 7fe18cc67740 10 client.27035 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.387+0000 7fe18cc67740 1 -- 172.21.15.47:0/4208490938 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56198e1d0000 con 0x56198e149850 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.388+0000 7fe1637fe640 1 -- 172.21.15.47:0/4208490938 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe17400fb70 con 0x56198e149850 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.388+0000 7fe1637fe640 1 -- 172.21.15.47:0/4208490938 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe174005050 con 0x56198e149850 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.388+0000 7fe18cc67740 10 client.27035 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.388+0000 7fe18cc67740 10 client.27035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:18.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.388+0000 7fe18cc67740 20 client.27035 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:18.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.388+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4208490938 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56198e1d0590 0x56198e1d29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:18.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.388+0000 7fe18cc67740 4 client.27035 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:18:18.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.388+0000 7fe18cc67740 1 -- 172.21.15.47:0/4208490938 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56198e0be3e0 con 0x56198e1d0590 2024-07-24T22:18:18.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.388+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/4208490938 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56198e1d0590 0x56198e1d29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:18.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.388+0000 7fe17b7fe640 1 --2- 172.21.15.47:0/4208490938 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56198e1d0590 0x56198e1d29b0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd76f5b764236133 server_cookie=aaa04fc3db2b16de in_seq=0 out_seq=0 2024-07-24T22:18:18.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.388+0000 7fe1637fe640 10 client.27035 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:18.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.389+0000 7fe1637fe640 1 -- 172.21.15.47:0/4208490938 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56198e0be3e0 con 0x56198e1d0590 2024-07-24T22:18:18.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.389+0000 7fe1637fe640 10 client.27035 handle_command_reply: tid=0 2024-07-24T22:18:18.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.389+0000 7fe18cc67740 1 client.27035 shutdown 2024-07-24T22:18:18.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.390+0000 7fe18cc67740 1 -- 172.21.15.47:0/4208490938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e149850 msgr2=0x56198e15df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.390+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4208490938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e149850 0x56198e15df00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe174019880 tx=0x7fe174005dc0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.390+0000 7fe18cc67740 1 -- 172.21.15.47:0/4208490938 shutdown_connections 2024-07-24T22:18:18.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.390+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4208490938 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56198e1d0590 0x56198e1d29b0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.390+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4208490938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56198e1557e0 0x56198e14f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.390+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4208490938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56198e149850 0x56198e15df00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.390+0000 7fe1637fe640 0 client.27035 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:18.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.390+0000 7fe18cc67740 1 --2- 172.21.15.47:0/4208490938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198e148f30 0x56198e15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.390+0000 7fe18cc67740 1 -- 172.21.15.47:0/4208490938 >> 172.21.15.47:0/4208490938 conn(0x56198e146d60 msgr2=0x56198e152f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:18.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.390+0000 7fe18cc67740 1 -- 172.21.15.47:0/4208490938 shutdown_connections 2024-07-24T22:18:18.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.390+0000 7fe18cc67740 1 -- 172.21.15.47:0/4208490938 wait complete. 2024-07-24T22:18:18.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.390+0000 7fe18cc67740 20 client.27035 trim_cache size 0 max 16384 2024-07-24T22:18:18.396 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:18:18.396 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:18:18.396 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "2cbf937c-b3cf-4814-98cf-c2c889f3cb18", 2024-07-24T22:18:18.396 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:18:18.396 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:18:18.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.391+0000 7fe18a8b6640 1 -- 172.21.15.47:0/1060032343 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe1700b3d40 msgr2=0x7fe1700b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.391+0000 7fe18a8b6640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe1700b3d40 0x7fe1700b6200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe17c102a90 tx=0x7fe17c004890 comp rx=0 tx=0).stop 2024-07-24T22:18:18.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.391+0000 7fe18a8b6640 1 -- 172.21.15.47:0/1060032343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1841079e0 msgr2=0x7fe18410f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.391+0000 7fe18a8b6640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1841079e0 0x7fe18410f770 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fe17c005e30 tx=0x7fe17c0317c0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.391+0000 7fe18a8b6640 1 -- 172.21.15.47:0/1060032343 shutdown_connections 2024-07-24T22:18:18.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.391+0000 7fe18a8b6640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe1700b3d40 0x7fe1700b6200 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.391+0000 7fe18a8b6640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1841079e0 0x7fe18410f770 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.391+0000 7fe18a8b6640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe184107060 0x7fe18410f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.391+0000 7fe18a8b6640 1 --2- 172.21.15.47:0/1060032343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe184101650 0x7fe18410ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.391+0000 7fe18a8b6640 1 -- 172.21.15.47:0/1060032343 >> 172.21.15.47:0/1060032343 conn(0x7fe1840fd0c0 msgr2=0x7fe1840ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:18.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.391+0000 7fe18a8b6640 1 -- 172.21.15.47:0/1060032343 shutdown_connections 2024-07-24T22:18:18.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:18.391+0000 7fe18a8b6640 1 -- 172.21.15.47:0/1060032343 wait complete. 2024-07-24T22:18:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.692+0000 7f18fa7fc640 1 -- 172.21.15.47:0/279442607 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b869e24c70 con 0x55b869ebe170 2024-07-24T22:18:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.692+0000 7f18fa7fc640 10 client.27016 handle_command_reply: tid=0 2024-07-24T22:18:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.692+0000 7f191c21e740 1 client.27016 shutdown 2024-07-24T22:18:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.692+0000 7f191c21e740 1 -- 172.21.15.47:0/279442607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 msgr2=0x55b869ec1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.692+0000 7f191c21e740 1 --2- 172.21.15.47:0/279442607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869ec1e00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55b869eab2e0 tx=0x7f18fc009fa0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.693+0000 7f191c21e740 1 -- 172.21.15.47:0/279442607 shutdown_connections 2024-07-24T22:18:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.693+0000 7f191c21e740 1 --2- 172.21.15.47:0/279442607 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55b869ebe170 0x55b869f3aa80 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.693+0000 7f191c21e740 1 --2- 172.21.15.47:0/279442607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b869eb21e0 0x55b869f306f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.693+0000 7f191c21e740 1 --2- 172.21.15.47:0/279442607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b869eb18c0 0x55b869ec1e00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.693+0000 7f191c21e740 1 --2- 172.21.15.47:0/279442607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b869eaf6f0 0x55b869ec1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.693+0000 7f18fa7fc640 0 client.27016 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.693+0000 7f191c21e740 1 -- 172.21.15.47:0/279442607 >> 172.21.15.47:0/279442607 conn(0x55b869eb6720 msgr2=0x55b869eb4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.693+0000 7f191c21e740 1 -- 172.21.15.47:0/279442607 shutdown_connections 2024-07-24T22:18:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.693+0000 7f191c21e740 1 -- 172.21.15.47:0/279442607 wait complete. 2024-07-24T22:18:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.693+0000 7f191c21e740 20 client.27016 trim_cache size 0 max 16384 2024-07-24T22:18:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:18:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:18:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:18:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:18:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.694+0000 7f19194cb640 1 -- 172.21.15.47:0/1482444442 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f19000b3d40 msgr2=0x7f19000b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.694+0000 7f19194cb640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f19000b3d40 0x7f19000b6200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f19040e1be0 tx=0x7f19040e7f90 comp rx=0 tx=0).stop 2024-07-24T22:18:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.694+0000 7f19194cb640 1 -- 172.21.15.47:0/1482444442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19141035d0 msgr2=0x7f191419add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.694+0000 7f19194cb640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19141035d0 0x7f191419add0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f190400e9f0 tx=0x7f190400edf0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.694+0000 7f19194cb640 1 -- 172.21.15.47:0/1482444442 shutdown_connections 2024-07-24T22:18:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.694+0000 7f19194cb640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f19000b3d40 0x7f19000b6200 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.694+0000 7f19194cb640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f191410c9f0 0x7f19141a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.694+0000 7f19194cb640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1914103ef0 0x7f191419b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.694+0000 7f19194cb640 1 --2- 172.21.15.47:0/1482444442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19141035d0 0x7f191419add0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.694+0000 7f19194cb640 1 -- 172.21.15.47:0/1482444442 >> 172.21.15.47:0/1482444442 conn(0x7f19140782e0 msgr2=0x7f1914101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.694+0000 7f19194cb640 1 -- 172.21.15.47:0/1482444442 shutdown_connections 2024-07-24T22:18:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:18.694+0000 7f19194cb640 1 -- 172.21.15.47:0/1482444442 wait complete. 2024-07-24T22:18:19.193 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:18:19.478 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:19.859 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:19 smithi047 ceph-mon[32551]: pgmap v710: 97 pgs: 31 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 50 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 3 op/s 2024-07-24T22:18:19.859 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:19 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:18:19.859 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:19 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:19.859 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:19 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:18:19.860 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:19 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:20.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:19 smithi183 ceph-mon[37007]: pgmap v710: 97 pgs: 31 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 50 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 3 op/s 2024-07-24T22:18:20.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:19 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:18:20.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:19 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:20.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:19 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:18:20.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:19 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:20.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:19 smithi188 ceph-mon[37380]: pgmap v710: 97 pgs: 31 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 50 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 3 op/s 2024-07-24T22:18:20.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:19 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:18:20.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:19 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:20.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:19 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:18:20.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:19 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:20.901 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:20 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:18:21.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:20 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:18:21.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:20 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:18:21.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.429+0000 7f59f9136640 1 -- 172.21.15.47:0/3543749460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59f41079e0 msgr2=0x7f59f410e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:21.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.429+0000 7f59f9136640 1 --2- 172.21.15.47:0/3543749460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59f41079e0 0x7f59f410e1e0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009ca0 tx=0x7f59ec02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.429+0000 7f59f9136640 1 -- 172.21.15.47:0/3543749460 shutdown_connections 2024-07-24T22:18:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.429+0000 7f59f9136640 1 --2- 172.21.15.47:0/3543749460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59f41079e0 0x7f59f410e1e0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.429+0000 7f59f9136640 1 --2- 172.21.15.47:0/3543749460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59f4107060 0x7f59f41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.429+0000 7f59f9136640 1 --2- 172.21.15.47:0/3543749460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59f4101650 0x7f59f4101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.429+0000 7f59f9136640 1 -- 172.21.15.47:0/3543749460 >> 172.21.15.47:0/3543749460 conn(0x7f59f40fd0c0 msgr2=0x7f59f40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.429+0000 7f59f9136640 1 -- 172.21.15.47:0/3543749460 shutdown_connections 2024-07-24T22:18:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.429+0000 7f59f9136640 1 -- 172.21.15.47:0/3543749460 wait complete. 2024-07-24T22:18:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.430+0000 7f59f9136640 1 Processor -- start 2024-07-24T22:18:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.430+0000 7f59f9136640 1 -- start start 2024-07-24T22:18:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f9136640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59f4101650 0x7f59f419adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f9136640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59f4107060 0x7f59f419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f9136640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59f41079e0 0x7f59f41a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f9136640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f59f4111610 con 0x7f59f41079e0 2024-07-24T22:18:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f9136640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f59f4111490 con 0x7f59f4107060 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f9136640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f59f4111790 con 0x7f59f4101650 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59f41079e0 0x7f59f41a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59f41079e0 0x7f59f41a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53246/0 (socket says 172.21.15.47:53246) 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f359e640 1 -- 172.21.15.47:0/2507606319 learned_addr learned my addr 172.21.15.47:0/2507606319 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f2d9d640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59f4101650 0x7f59f419adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f259c640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59f4107060 0x7f59f419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f359e640 1 -- 172.21.15.47:0/2507606319 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59f4101650 msgr2=0x7f59f419adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f359e640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59f4101650 0x7f59f419adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f359e640 1 -- 172.21.15.47:0/2507606319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59f4107060 msgr2=0x7f59f419b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f359e640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59f4107060 0x7f59f419b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f359e640 1 -- 172.21.15.47:0/2507606319 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f41a0ea0 con 0x7f59f41079e0 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59f359e640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59f41079e0 0x7f59f41a06d0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f59ec005cc0 tx=0x7f59ec031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.431+0000 7f59dbfff640 1 -- 172.21.15.47:0/2507606319 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec003b70 con 0x7f59f41079e0 2024-07-24T22:18:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.432+0000 7f59f9136640 1 -- 172.21.15.47:0/2507606319 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f41a1130 con 0x7f59f41079e0 2024-07-24T22:18:21.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.432+0000 7f59dbfff640 1 -- 172.21.15.47:0/2507606319 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59ec0318f0 con 0x7f59f41079e0 2024-07-24T22:18:21.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.432+0000 7f59dbfff640 1 -- 172.21.15.47:0/2507606319 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec02f950 con 0x7f59f41079e0 2024-07-24T22:18:21.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.432+0000 7f59f9136640 1 -- 172.21.15.47:0/2507606319 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f41a7850 con 0x7f59f41079e0 2024-07-24T22:18:21.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.434+0000 7f59dbfff640 1 -- 172.21.15.47:0/2507606319 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f59ec02fb50 con 0x7f59f41079e0 2024-07-24T22:18:21.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.434+0000 7f59fb4e7740 1 Processor -- start 2024-07-24T22:18:21.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.434+0000 7f59fb4e7740 1 -- start start 2024-07-24T22:18:21.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59fb4e7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1b7680 0x557b9b1b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59fb4e7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59fb4e7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1c3f30 0x557b9b1c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59fb4e7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557b9b12e960 con 0x557b9b1c3f30 2024-07-24T22:18:21.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59fb4e7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557b9b11de60 con 0x557b9b1b7680 2024-07-24T22:18:21.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59fb4e7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557b9b121ea0 con 0x557b9b1b7fa0 2024-07-24T22:18:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59f259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1c3f30 0x557b9b1c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59f259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1c3f30 0x557b9b1c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53258/0 (socket says 172.21.15.47:53258) 2024-07-24T22:18:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59dbfff640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f59dc0b3d40 0x7f59dc0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59f259c640 1 -- 172.21.15.47:0/3566616118 learned_addr learned my addr 172.21.15.47:0/3566616118 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59f259c640 1 --2- 172.21.15.47:0/3566616118 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1b7680 0x557b9b1b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59f2d9d640 1 --2- 172.21.15.47:0/3566616118 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59f359e640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f59dc0b3d40 0x7f59dc0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59dbfff640 1 -- 172.21.15.47:0/2507606319 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f59ec105320 con 0x7f59f41079e0 2024-07-24T22:18:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59f2d9d640 1 -- 172.21.15.47:0/3566616118 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1b7680 msgr2=0x557b9b1b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59f2d9d640 1 --2- 172.21.15.47:0/3566616118 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1b7680 0x557b9b1b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59f2d9d640 1 -- 172.21.15.47:0/3566616118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1c3f30 msgr2=0x557b9b1c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59f2d9d640 1 --2- 172.21.15.47:0/3566616118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1c3f30 0x557b9b1c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59f2d9d640 1 -- 172.21.15.47:0/3566616118 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9b0a72d0 con 0x557b9b1b7fa0 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.435+0000 7f59f259c640 1 --2- 172.21.15.47:0/3566616118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1c3f30 0x557b9b1c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.436+0000 7f59f359e640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f59dc0b3d40 0x7f59dc0b6200 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0c91f0 tx=0x7f59ec02a8c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.436+0000 7f59f2d9d640 1 --2- 172.21.15.47:0/3566616118 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c39f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f59e4009c20 tx=0x7f59e4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a728505b72c8c59a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.436+0000 7f59d97fa640 1 -- 172.21.15.47:0/3566616118 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4009dd0 con 0x557b9b1b7fa0 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.436+0000 7f59d97fa640 1 -- 172.21.15.47:0/3566616118 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59e4005020 con 0x557b9b1b7fa0 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.436+0000 7f59d97fa640 1 -- 172.21.15.47:0/3566616118 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4004a00 con 0x557b9b1b7fa0 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.436+0000 7f59fb4e7740 1 -- 172.21.15.47:0/3566616118 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 msgr2=0x557b9b1c39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.436+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/3566616118 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c39f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f59e4009c20 tx=0x7f59e4011810 comp rx=0 tx=0).stop 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 -- 172.21.15.47:0/3566616118 shutdown_connections 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/3566616118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1c3f30 0x557b9b1c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/3566616118 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c39f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/3566616118 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1b7680 0x557b9b1b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 -- 172.21.15.47:0/3566616118 >> 172.21.15.47:0/3566616118 conn(0x557b9b1b54b0 msgr2=0x557b9b1b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 -- 172.21.15.47:0/3566616118 shutdown_connections 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 -- 172.21.15.47:0/3566616118 wait complete. 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 -- start start 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 Processor -- start 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 0x557b9b1c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 0x557b9b1c15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557b9af81700 con 0x557b9b1b7680 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557b9b0c05a0 con 0x557b9b1c3f30 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.437+0000 7f59fb4e7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557b9b1c6bb0 con 0x557b9b1b7fa0 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59fb4e7740 10 client.0 _ll_register_callbacks cb 0x557b9b0e0910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59f259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 0x557b9b1c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59f2d9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59f259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 0x557b9b1c39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53274/0 (socket says 172.21.15.47:53274) 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59f259c640 1 -- 172.21.15.47:0/4075287220 learned_addr learned my addr 172.21.15.47:0/4075287220 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:21.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59f259c640 1 --2- 172.21.15.47:0/4075287220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 0x557b9b1c15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59f259c640 1 -- 172.21.15.47:0/4075287220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 msgr2=0x557b9b1c0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59f259c640 1 --2- 172.21.15.47:0/4075287220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59f259c640 1 -- 172.21.15.47:0/4075287220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 msgr2=0x557b9b1c15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59f259c640 1 --2- 172.21.15.47:0/4075287220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 0x557b9b1c15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59f259c640 1 -- 172.21.15.47:0/4075287220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b9b0b3630 con 0x557b9b1b7680 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59f259c640 1 --2- 172.21.15.47:0/4075287220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 0x557b9b1c39c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f59e8011df0 tx=0x7f59e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb381d093517c303 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59d6ff5640 1 -- 172.21.15.47:0/4075287220 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8005020 con 0x557b9b1b7680 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59d6ff5640 1 -- 172.21.15.47:0/4075287220 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f59e80051c0 con 0x557b9b1b7680 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59fb4e7740 1 -- 172.21.15.47:0/4075287220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59e4005020 con 0x557b9b1b7680 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59d6ff5640 1 -- 172.21.15.47:0/4075287220 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f59e80053c0 con 0x557b9b1b7680 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59fb4e7740 10 client.17976 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.438+0000 7f59fb4e7740 1 -- 172.21.15.47:0/4075287220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557b9ae7e650 con 0x557b9b1b7680 2024-07-24T22:18:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.439+0000 7f59d6ff5640 1 -- 172.21.15.47:0/4075287220 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59e4005020 con 0x557b9b1b7680 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.439+0000 7f59d6ff5640 1 -- 172.21.15.47:0/4075287220 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f59e80204c0 con 0x557b9b1b7680 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.439+0000 7f59fb4e7740 10 client.17976 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.439+0000 7f59fb4e7740 10 client.17976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.439+0000 7f59fb4e7740 20 client.17976 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.439+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/4075287220 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557b9b1d3a00 0x557b9b1d5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.439+0000 7f59fb4e7740 4 client.17976 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.439+0000 7f59fb4e7740 1 -- 172.21.15.47:0/4075287220 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b9b1308b0 con 0x557b9b1d3a00 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.439+0000 7f59f2d9d640 1 --2- 172.21.15.47:0/4075287220 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557b9b1d3a00 0x557b9b1d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.440+0000 7f59d6ff5640 10 client.17976 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.440+0000 7f59f2d9d640 1 --2- 172.21.15.47:0/4075287220 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557b9b1d3a00 0x557b9b1d5df0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=974e18fa335dcea8 server_cookie=f6a1a2ba010206e2 in_seq=0 out_seq=0 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.440+0000 7f59d6ff5640 1 -- 172.21.15.47:0/4075287220 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b9b1308b0 con 0x557b9b1d3a00 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.440+0000 7f59d6ff5640 10 client.17976 handle_command_reply: tid=0 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.440+0000 7f59fb4e7740 1 client.17976 shutdown 2024-07-24T22:18:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.440+0000 7f59fb4e7740 1 -- 172.21.15.47:0/4075287220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 msgr2=0x557b9b1c39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:21.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.440+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/4075287220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 0x557b9b1c39c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f59e8011df0 tx=0x7f59e8004730 comp rx=0 tx=0).stop 2024-07-24T22:18:21.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.440+0000 7f59fb4e7740 1 -- 172.21.15.47:0/4075287220 shutdown_connections 2024-07-24T22:18:21.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.440+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/4075287220 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557b9b1d3a00 0x557b9b1d5df0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.440+0000 7f59d6ff5640 0 client.17976 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:21.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.440+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/4075287220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 0x557b9b1c15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.440+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/4075287220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.441+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/4075287220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 0x557b9b1c39c0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.441+0000 7f59fb4e7740 1 -- 172.21.15.47:0/4075287220 >> 172.21.15.47:0/4075287220 conn(0x557b9b1b54b0 msgr2=0x557b9b1bb050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:21.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.441+0000 7f59fb4e7740 1 -- 172.21.15.47:0/4075287220 shutdown_connections 2024-07-24T22:18:21.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.441+0000 7f59fb4e7740 1 -- 172.21.15.47:0/4075287220 wait complete. 2024-07-24T22:18:21.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.441+0000 7f59fb4e7740 20 client.17976 trim_cache size 0 max 16384 2024-07-24T22:18:21.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.459+0000 7f59fb4e7740 1 Processor -- start 2024-07-24T22:18:21.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.459+0000 7f59fb4e7740 1 -- start start 2024-07-24T22:18:21.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.459+0000 7f59fb4e7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 0x557b9b1c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.459+0000 7f59fb4e7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 0x557b9b1db6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.459+0000 7f59fb4e7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 0x557b9b1dbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59f259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 0x557b9b1c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59fb4e7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41ae390 con 0x557b9b1b7680 2024-07-24T22:18:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59fb4e7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41b0bf0 con 0x557b9b1c3f30 2024-07-24T22:18:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59fb4e7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41ae9e0 con 0x557b9b1b7fa0 2024-07-24T22:18:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59f259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 0x557b9b1c2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53284/0 (socket says 172.21.15.47:53284) 2024-07-24T22:18:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59f259c640 1 -- 172.21.15.47:0/3518835134 learned_addr learned my addr 172.21.15.47:0/3518835134 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59f2d9d640 1 --2- 172.21.15.47:0/3518835134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 0x557b9b1db6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59f259c640 1 -- 172.21.15.47:0/3518835134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 msgr2=0x557b9b1db6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59f259c640 1 --2- 172.21.15.47:0/3518835134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 0x557b9b1db6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59f259c640 1 -- 172.21.15.47:0/3518835134 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 msgr2=0x557b9b1dbc00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:18:21.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59f259c640 1 --2- 172.21.15.47:0/3518835134 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 0x557b9b1dbc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59f259c640 1 -- 172.21.15.47:0/3518835134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9b1c1930 con 0x557b9b1b7680 2024-07-24T22:18:21.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59f259c640 1 --2- 172.21.15.47:0/3518835134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 0x557b9b1c2b50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f59e8006010 tx=0x7f59e8009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fa8a27592192ec server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:21.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.460+0000 7f59d8ff9640 1 -- 172.21.15.47:0/3518835134 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8005560 con 0x557b9b1b7680 2024-07-24T22:18:21.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.461+0000 7f59d8ff9640 1 -- 172.21.15.47:0/3518835134 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59e8005700 con 0x557b9b1b7680 2024-07-24T22:18:21.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.461+0000 7f59d8ff9640 1 -- 172.21.15.47:0/3518835134 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8020690 con 0x557b9b1b7680 2024-07-24T22:18:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.462+0000 7f59fb4e7740 1 -- 172.21.15.47:0/3518835134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 msgr2=0x557b9b1c2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.462+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/3518835134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 0x557b9b1c2b50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f59e8006010 tx=0x7f59e8009f80 comp rx=0 tx=0).stop 2024-07-24T22:18:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.462+0000 7f59fb4e7740 1 -- 172.21.15.47:0/3518835134 shutdown_connections 2024-07-24T22:18:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.462+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/3518835134 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 0x557b9b1dbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.462+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/3518835134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7fa0 0x557b9b1db6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.462+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/3518835134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7680 0x557b9b1c2b50 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.462+0000 7f59fb4e7740 1 -- 172.21.15.47:0/3518835134 >> 172.21.15.47:0/3518835134 conn(0x557b9b1b54b0 msgr2=0x557b9b1c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.462+0000 7f59fb4e7740 1 -- 172.21.15.47:0/3518835134 shutdown_connections 2024-07-24T22:18:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.462+0000 7f59fb4e7740 1 -- 172.21.15.47:0/3518835134 wait complete. 2024-07-24T22:18:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.462+0000 7f59fb4e7740 1 -- start start 2024-07-24T22:18:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.462+0000 7f59fb4e7740 1 Processor -- start 2024-07-24T22:18:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59fb4e7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7680 0x557b9b1c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59fb4e7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59f259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7680 0x557b9b1c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59f2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59f259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7680 0x557b9b1c77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:41922/0 (socket says 172.21.15.47:41922) 2024-07-24T22:18:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59f2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53296/0 (socket says 172.21.15.47:53296) 2024-07-24T22:18:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59f259c640 1 -- 172.21.15.47:0/2335576955 learned_addr learned my addr 172.21.15.47:0/2335576955 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 0x557b9b236730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59fb4e7740 1 -- 172.21.15.47:0/2335576955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41af0b0 con 0x557b9b1b7fa0 2024-07-24T22:18:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59fb4e7740 1 -- 172.21.15.47:0/2335576955 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41b0520 con 0x557b9b1c3f30 2024-07-24T22:18:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59fb4e7740 1 -- 172.21.15.47:0/2335576955 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41af780 con 0x557b9b1b7680 2024-07-24T22:18:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59fb4e7740 10 client.0 _ll_register_callbacks cb 0x7f59e8011c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59f259c640 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 0x557b9b236730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59f2d9d640 1 -- 172.21.15.47:0/2335576955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7680 msgr2=0x557b9b1c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59f2d9d640 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7680 0x557b9b1c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59f2d9d640 1 -- 172.21.15.47:0/2335576955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 msgr2=0x557b9b236730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59f2d9d640 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 0x557b9b236730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59f2d9d640 1 -- 172.21.15.47:0/2335576955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b9b236e70 con 0x557b9b1b7fa0 2024-07-24T22:18:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.463+0000 7f59f259c640 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 0x557b9b236730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.464+0000 7f59f2d9d640 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c7d40 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f59e401b040 tx=0x7f59e4009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141f2be8447b0100 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.464+0000 7f59d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:21.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.464+0000 7f59d6ff5640 1 -- 172.21.15.47:0/2335576955 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e40035f0 con 0x557b9b1b7fa0 2024-07-24T22:18:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.464+0000 7f59d6ff5640 1 -- 172.21.15.47:0/2335576955 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f59e4003790 con 0x557b9b1b7fa0 2024-07-24T22:18:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.464+0000 7f59fb4e7740 1 -- 172.21.15.47:0/2335576955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59e8005700 con 0x557b9b1b7fa0 2024-07-24T22:18:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.464+0000 7f59d6ff5640 1 -- 172.21.15.47:0/2335576955 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f59e4003990 con 0x557b9b1b7fa0 2024-07-24T22:18:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.464+0000 7f59fb4e7740 10 client.17982 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.464+0000 7f59fb4e7740 1 -- 172.21.15.47:0/2335576955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557b9b23e2e0 con 0x557b9b1b7fa0 2024-07-24T22:18:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.464+0000 7f59d6ff5640 1 -- 172.21.15.47:0/2335576955 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59e8005700 con 0x557b9b1b7fa0 2024-07-24T22:18:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.465+0000 7f59d6ff5640 1 -- 172.21.15.47:0/2335576955 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f59e402a7b0 con 0x557b9b1b7fa0 2024-07-24T22:18:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.465+0000 7f59fb4e7740 10 client.17982 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.465+0000 7f59fb4e7740 10 client.17982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.465+0000 7f59fb4e7740 20 client.17982 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.465+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557b9b1d3a00 0x557b9b2408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.465+0000 7f59fb4e7740 4 client.17982 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:18:21.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.465+0000 7f59fb4e7740 1 -- 172.21.15.47:0/2335576955 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557b9b12c350 con 0x557b9b1d3a00 2024-07-24T22:18:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.465+0000 7f59f259c640 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557b9b1d3a00 0x557b9b2408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.465+0000 7f59f259c640 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557b9b1d3a00 0x557b9b2408d0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba302a7bf7ac8804 server_cookie=c99b408038e58449 in_seq=0 out_seq=0 2024-07-24T22:18:21.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.465+0000 7f59d6ff5640 10 client.17982 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.465+0000 7f59d6ff5640 1 -- 172.21.15.47:0/2335576955 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557b9b12c350 con 0x557b9b1d3a00 2024-07-24T22:18:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.465+0000 7f59d6ff5640 10 client.17982 handle_command_reply: tid=0 2024-07-24T22:18:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.465+0000 7f59fb4e7740 1 client.17982 shutdown 2024-07-24T22:18:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59fb4e7740 1 -- 172.21.15.47:0/2335576955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7fa0 msgr2=0x557b9b1c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c7d40 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f59e401b040 tx=0x7f59e4009ef0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59fb4e7740 1 -- 172.21.15.47:0/2335576955 shutdown_connections 2024-07-24T22:18:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x557b9b1d3a00 0x557b9b2408d0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b9b1c3f30 0x557b9b236730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557b9b1b7fa0 0x557b9b1c7d40 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59fb4e7740 1 --2- 172.21.15.47:0/2335576955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557b9b1b7680 0x557b9b1c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59fb4e7740 1 -- 172.21.15.47:0/2335576955 >> 172.21.15.47:0/2335576955 conn(0x557b9b1b54b0 msgr2=0x557b9b1bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59d6ff5640 0 client.17982 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:21.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59fb4e7740 1 -- 172.21.15.47:0/2335576955 shutdown_connections 2024-07-24T22:18:21.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59fb4e7740 1 -- 172.21.15.47:0/2335576955 wait complete. 2024-07-24T22:18:21.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59fb4e7740 20 client.17982 trim_cache size 0 max 16384 2024-07-24T22:18:21.473 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:18:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:18:21.473 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:18:21.473 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:18:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59f9136640 1 -- 172.21.15.47:0/2507606319 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f59dc0b3d40 msgr2=0x7f59dc0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59f9136640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f59dc0b3d40 0x7f59dc0b6200 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0c91f0 tx=0x7f59ec02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59f9136640 1 -- 172.21.15.47:0/2507606319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59f41079e0 msgr2=0x7f59f41a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.466+0000 7f59f9136640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59f41079e0 0x7f59f41a06d0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f59ec005cc0 tx=0x7f59ec031700 comp rx=0 tx=0).stop 2024-07-24T22:18:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.467+0000 7f59f9136640 1 -- 172.21.15.47:0/2507606319 shutdown_connections 2024-07-24T22:18:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.467+0000 7f59f9136640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f59dc0b3d40 0x7f59dc0b6200 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.467+0000 7f59f9136640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59f41079e0 0x7f59f41a06d0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.467+0000 7f59f9136640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59f4107060 0x7f59f419b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.467+0000 7f59f9136640 1 --2- 172.21.15.47:0/2507606319 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59f4101650 0x7f59f419adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.467+0000 7f59f9136640 1 -- 172.21.15.47:0/2507606319 >> 172.21.15.47:0/2507606319 conn(0x7f59f40fd0c0 msgr2=0x7f59f406ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:21.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.467+0000 7f59f9136640 1 -- 172.21.15.47:0/2507606319 shutdown_connections 2024-07-24T22:18:21.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:21.467+0000 7f59f9136640 1 -- 172.21.15.47:0/2507606319 wait complete. 2024-07-24T22:18:22.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:21 smithi183 ceph-mon[37007]: pgmap v711: 97 pgs: 29 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 54 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-07-24T22:18:22.174 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:21 smithi047 ceph-mon[32551]: pgmap v711: 97 pgs: 29 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 54 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-07-24T22:18:22.203 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:18:22.203 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:18:22.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:21 smithi188 ceph-mon[37380]: pgmap v711: 97 pgs: 29 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 54 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-07-24T22:18:22.470 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:24.117 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:23 smithi047 ceph-mon[32551]: pgmap v712: 97 pgs: 21 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 67 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-07-24T22:18:24.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.115+0000 7f1147ac9640 1 -- 172.21.15.47:0/3908546723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114010cac0 msgr2=0x7f114010ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:24.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.115+0000 7f1147ac9640 1 --2- 172.21.15.47:0/3908546723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114010cac0 0x7f114010ef20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f1138009900 tx=0x7f113802a410 comp rx=0 tx=0).stop 2024-07-24T22:18:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.115+0000 7f1147ac9640 1 -- 172.21.15.47:0/3908546723 shutdown_connections 2024-07-24T22:18:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.115+0000 7f1147ac9640 1 --2- 172.21.15.47:0/3908546723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f114010cac0 0x7f114010ef20 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.115+0000 7f1147ac9640 1 --2- 172.21.15.47:0/3908546723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1140103f80 0x7f114010c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.115+0000 7f1147ac9640 1 --2- 172.21.15.47:0/3908546723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1140103660 0x7f1140103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.115+0000 7f1147ac9640 1 -- 172.21.15.47:0/3908546723 >> 172.21.15.47:0/3908546723 conn(0x7f11400fd0c0 msgr2=0x7f11400ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.115+0000 7f1147ac9640 1 -- 172.21.15.47:0/3908546723 shutdown_connections 2024-07-24T22:18:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.115+0000 7f1147ac9640 1 -- 172.21.15.47:0/3908546723 wait complete. 2024-07-24T22:18:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.116+0000 7f1147ac9640 1 Processor -- start 2024-07-24T22:18:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.116+0000 7f1147ac9640 1 -- start start 2024-07-24T22:18:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.116+0000 7f1147ac9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1140103660 0x7f1140101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.116+0000 7f1147ac9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1140103f80 0x7f1140101850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:24.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.116+0000 7f1147ac9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f114010cac0 0x7f1140101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.116+0000 7f1147ac9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1140112790 con 0x7f1140103660 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.116+0000 7f1147ac9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1140112610 con 0x7f114010cac0 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.116+0000 7f1147ac9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1140112910 con 0x7f1140103f80 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.116+0000 7f1145865640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1140103660 0x7f1140101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.116+0000 7f1145865640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1140103660 0x7f1140101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53322/0 (socket says 172.21.15.47:53322) 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.116+0000 7f1145865640 1 -- 172.21.15.47:0/1460160734 learned_addr learned my addr 172.21.15.47:0/1460160734 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1146066640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f114010cac0 0x7f1140101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1145064640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1140103f80 0x7f1140101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1145865640 1 -- 172.21.15.47:0/1460160734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1140103f80 msgr2=0x7f1140101850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1145865640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1140103f80 0x7f1140101850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1145865640 1 -- 172.21.15.47:0/1460160734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f114010cac0 msgr2=0x7f1140101d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1145865640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f114010cac0 0x7f1140101d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1145865640 1 -- 172.21.15.47:0/1460160734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11401a70a0 con 0x7f1140103660 2024-07-24T22:18:24.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1145064640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1140103f80 0x7f1140101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:24.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1145865640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1140103660 0x7f1140101310 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f113c00cce0 tx=0x7f113c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:24.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1136ffd640 1 -- 172.21.15.47:0/1460160734 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c00f650 con 0x7f1140103660 2024-07-24T22:18:24.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1136ffd640 1 -- 172.21.15.47:0/1460160734 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f113c00fca0 con 0x7f1140103660 2024-07-24T22:18:24.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1147ac9640 1 -- 172.21.15.47:0/1460160734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11401a7390 con 0x7f1140103660 2024-07-24T22:18:24.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1136ffd640 1 -- 172.21.15.47:0/1460160734 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c018b40 con 0x7f1140103660 2024-07-24T22:18:24.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.117+0000 7f1147ac9640 1 -- 172.21.15.47:0/1460160734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11401a78d0 con 0x7f1140103660 2024-07-24T22:18:24.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.118+0000 7f1147ac9640 1 -- 172.21.15.47:0/1460160734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1140103a40 con 0x7f1140103660 2024-07-24T22:18:24.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.119+0000 7f1136ffd640 1 -- 172.21.15.47:0/1460160734 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f113c018d00 con 0x7f1140103660 2024-07-24T22:18:24.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.120+0000 7f1136ffd640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f112c0b3d40 0x7f112c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:24.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.120+0000 7f1145064640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f112c0b3d40 0x7f112c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:24.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.120+0000 7f1136ffd640 1 -- 172.21.15.47:0/1460160734 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f113c0e48c0 con 0x7f1140103660 2024-07-24T22:18:24.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.121+0000 7f1145064640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f112c0b3d40 0x7f112c0b6200 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1130006fd0 tx=0x7f1130008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:24.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.123+0000 7f1136ffd640 1 -- 172.21.15.47:0/1460160734 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f113c014030 con 0x7f1140103660 2024-07-24T22:18:24.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:23 smithi183 ceph-mon[37007]: pgmap v712: 97 pgs: 21 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 67 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-07-24T22:18:24.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:23 smithi188 ceph-mon[37380]: pgmap v712: 97 pgs: 21 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 67 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-07-24T22:18:24.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.357+0000 7f1147ac9640 1 -- 172.21.15.47:0/1460160734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11401a7cb0 con 0x7f1140103660 2024-07-24T22:18:24.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.357+0000 7f1136ffd640 1 -- 172.21.15.47:0/1460160734 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f113c0abba0 con 0x7f1140103660 2024-07-24T22:18:24.360 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:18:24.360 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:18:24.360 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:18:24.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.360+0000 7f1147ac9640 1 -- 172.21.15.47:0/1460160734 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f112c0b3d40 msgr2=0x7f112c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:24.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.360+0000 7f1147ac9640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f112c0b3d40 0x7f112c0b6200 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1130006fd0 tx=0x7f1130008040 comp rx=0 tx=0).stop 2024-07-24T22:18:24.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.360+0000 7f1147ac9640 1 -- 172.21.15.47:0/1460160734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1140103660 msgr2=0x7f1140101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:24.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.360+0000 7f1147ac9640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1140103660 0x7f1140101310 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f113c00cce0 tx=0x7f113c00a620 comp rx=0 tx=0).stop 2024-07-24T22:18:24.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.360+0000 7f1147ac9640 1 -- 172.21.15.47:0/1460160734 shutdown_connections 2024-07-24T22:18:24.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.360+0000 7f1147ac9640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f112c0b3d40 0x7f112c0b6200 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:24.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.360+0000 7f1147ac9640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f114010cac0 0x7f1140101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:24.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.360+0000 7f1147ac9640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1140103f80 0x7f1140101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:24.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.360+0000 7f1147ac9640 1 --2- 172.21.15.47:0/1460160734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1140103660 0x7f1140101310 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:24.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.360+0000 7f1147ac9640 1 -- 172.21.15.47:0/1460160734 >> 172.21.15.47:0/1460160734 conn(0x7f11400fd0c0 msgr2=0x7f114010ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:24.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.360+0000 7f1147ac9640 1 -- 172.21.15.47:0/1460160734 shutdown_connections 2024-07-24T22:18:24.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:24.360+0000 7f1147ac9640 1 -- 172.21.15.47:0/1460160734 wait complete. 2024-07-24T22:18:24.995 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:24 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1460160734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:25.024 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:18:25.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:24 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1460160734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:25.289 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:25.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:24 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1460160734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:26.119 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:25 smithi047 ceph-mon[32551]: pgmap v713: 97 pgs: 5 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 90 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-07-24T22:18:26.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:25 smithi183 ceph-mon[37007]: pgmap v713: 97 pgs: 5 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 90 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-07-24T22:18:26.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:25 smithi188 ceph-mon[37380]: pgmap v713: 97 pgs: 5 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 90 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-07-24T22:18:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.077+0000 7f7a507af640 1 -- 172.21.15.47:0/3419182242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a48107070 msgr2=0x7f7a481074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.077+0000 7f7a507af640 1 --2- 172.21.15.47:0/3419182242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a48107070 0x7f7a481074b0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009900 tx=0x7f7a3802a410 comp rx=0 tx=0).stop 2024-07-24T22:18:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.077+0000 7f7a507af640 1 -- 172.21.15.47:0/3419182242 shutdown_connections 2024-07-24T22:18:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.077+0000 7f7a507af640 1 --2- 172.21.15.47:0/3419182242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a481079f0 0x7f7a4810e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.077+0000 7f7a507af640 1 --2- 172.21.15.47:0/3419182242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a48107070 0x7f7a481074b0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.077+0000 7f7a507af640 1 --2- 172.21.15.47:0/3419182242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a48101660 0x7f7a48101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.077+0000 7f7a507af640 1 -- 172.21.15.47:0/3419182242 >> 172.21.15.47:0/3419182242 conn(0x7f7a480fd0f0 msgr2=0x7f7a480ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.077+0000 7f7a507af640 1 -- 172.21.15.47:0/3419182242 shutdown_connections 2024-07-24T22:18:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.077+0000 7f7a507af640 1 -- 172.21.15.47:0/3419182242 wait complete. 2024-07-24T22:18:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a507af640 1 Processor -- start 2024-07-24T22:18:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a507af640 1 -- start start 2024-07-24T22:18:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a507af640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a48101660 0x7f7a4810ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a507af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a48107070 0x7f7a4810f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a507af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a481079f0 0x7f7a4810f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a507af640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7a48112790 con 0x7f7a48107070 2024-07-24T22:18:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a507af640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7a48112610 con 0x7f7a48101660 2024-07-24T22:18:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a507af640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7a48112910 con 0x7f7a481079f0 2024-07-24T22:18:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a4dd4a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a48107070 0x7f7a4810f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a4dd4a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a48107070 0x7f7a4810f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35656/0 (socket says 172.21.15.47:35656) 2024-07-24T22:18:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a4dd4a640 1 -- 172.21.15.47:0/688716950 learned_addr learned my addr 172.21.15.47:0/688716950 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a4ed4c640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a481079f0 0x7f7a4810f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a4e54b640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a48101660 0x7f7a4810ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a4dd4a640 1 -- 172.21.15.47:0/688716950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a481079f0 msgr2=0x7f7a4810f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a4dd4a640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a481079f0 0x7f7a4810f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a4dd4a640 1 -- 172.21.15.47:0/688716950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a48101660 msgr2=0x7f7a4810ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a4dd4a640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a48101660 0x7f7a4810ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a4dd4a640 1 -- 172.21.15.47:0/688716950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a481a7080 con 0x7f7a48107070 2024-07-24T22:18:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.078+0000 7f7a4e54b640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a48101660 0x7f7a4810ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:27.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.079+0000 7f7a4dd4a640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a48107070 0x7f7a4810f240 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f7a38005940 tx=0x7f7a38004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:27.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.079+0000 7f7a3f7fe640 1 -- 172.21.15.47:0/688716950 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3803f030 con 0x7f7a48107070 2024-07-24T22:18:27.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.079+0000 7f7a3f7fe640 1 -- 172.21.15.47:0/688716950 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a38003aa0 con 0x7f7a48107070 2024-07-24T22:18:27.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.079+0000 7f7a507af640 1 -- 172.21.15.47:0/688716950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a481a7310 con 0x7f7a48107070 2024-07-24T22:18:27.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.079+0000 7f7a3f7fe640 1 -- 172.21.15.47:0/688716950 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a38035070 con 0x7f7a48107070 2024-07-24T22:18:27.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.079+0000 7f7a507af640 1 -- 172.21.15.47:0/688716950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a481a7840 con 0x7f7a48107070 2024-07-24T22:18:27.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.082+0000 7f7a52b60740 1 Processor -- start 2024-07-24T22:18:27.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.082+0000 7f7a52b60740 1 -- start start 2024-07-24T22:18:27.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a52b60740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7d56d0 0x56428c7d5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a52b60740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d5ff0 0x56428c7e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a52b60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 0x56428c7e4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a3f7fe640 1 -- 172.21.15.47:0/688716950 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f7a38042030 con 0x7f7a48107070 2024-07-24T22:18:27.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a52b60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56428c74c9b0 con 0x56428c7e1f80 2024-07-24T22:18:27.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a52b60740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56428c73beb0 con 0x56428c7d5ff0 2024-07-24T22:18:27.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a52b60740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56428c73fef0 con 0x56428c7d56d0 2024-07-24T22:18:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a4dd4a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 0x56428c7e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a4dd4a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 0x56428c7e4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35668/0 (socket says 172.21.15.47:35668) 2024-07-24T22:18:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a4dd4a640 1 -- 172.21.15.47:0/384292573 learned_addr learned my addr 172.21.15.47:0/384292573 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a4ed4c640 1 --2- 172.21.15.47:0/384292573 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7d56d0 0x56428c7d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a4e54b640 1 --2- 172.21.15.47:0/384292573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d5ff0 0x56428c7e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a4dd4a640 1 -- 172.21.15.47:0/384292573 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7d56d0 msgr2=0x56428c7d5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a4dd4a640 1 --2- 172.21.15.47:0/384292573 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7d56d0 0x56428c7d5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a4dd4a640 1 -- 172.21.15.47:0/384292573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d5ff0 msgr2=0x56428c7e1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a4dd4a640 1 --2- 172.21.15.47:0/384292573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d5ff0 0x56428c7e1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a4dd4a640 1 -- 172.21.15.47:0/384292573 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56428c6c5320 con 0x56428c7e1f80 2024-07-24T22:18:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.083+0000 7f7a4ed4c640 1 --2- 172.21.15.47:0/384292573 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7d56d0 0x56428c7d5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.084+0000 7f7a4dd4a640 1 --2- 172.21.15.47:0/384292573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 0x56428c7e4370 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f7a38101c40 tx=0x7f7a3810acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fd7f1e1153c604 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:27.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.084+0000 7f7a3f7fe640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7a340b3dc0 0x7f7a340b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.084+0000 7f7a3cff9640 1 -- 172.21.15.47:0/384292573 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3810e670 con 0x56428c7e1f80 2024-07-24T22:18:27.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.084+0000 7f7a4ed4c640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7a340b3dc0 0x7f7a340b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.084+0000 7f7a3cff9640 1 -- 172.21.15.47:0/384292573 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a38114020 con 0x56428c7e1f80 2024-07-24T22:18:27.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.084+0000 7f7a3cff9640 1 -- 172.21.15.47:0/384292573 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3809d960 con 0x56428c7e1f80 2024-07-24T22:18:27.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.084+0000 7f7a3f7fe640 1 -- 172.21.15.47:0/688716950 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f7a381045e0 con 0x7f7a48107070 2024-07-24T22:18:27.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.085+0000 7f7a52b60740 1 -- 172.21.15.47:0/384292573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 msgr2=0x56428c7e4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:27.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.085+0000 7f7a4ed4c640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7a340b3dc0 0x7f7a340b6280 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7a48110dc0 tx=0x7f7a40009500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:27.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.085+0000 7f7a52b60740 1 --2- 172.21.15.47:0/384292573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 0x56428c7e4370 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f7a38101c40 tx=0x7f7a3810acd0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.085+0000 7f7a52b60740 1 -- 172.21.15.47:0/384292573 shutdown_connections 2024-07-24T22:18:27.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.085+0000 7f7a52b60740 1 --2- 172.21.15.47:0/384292573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 0x56428c7e4370 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.085+0000 7f7a52b60740 1 --2- 172.21.15.47:0/384292573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d5ff0 0x56428c7e1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.085+0000 7f7a52b60740 1 --2- 172.21.15.47:0/384292573 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7d56d0 0x56428c7d5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.085+0000 7f7a52b60740 1 -- 172.21.15.47:0/384292573 >> 172.21.15.47:0/384292573 conn(0x56428c7d3500 msgr2=0x56428c7d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:27.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.085+0000 7f7a52b60740 1 -- 172.21.15.47:0/384292573 shutdown_connections 2024-07-24T22:18:27.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.085+0000 7f7a52b60740 1 -- 172.21.15.47:0/384292573 wait complete. 2024-07-24T22:18:27.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.085+0000 7f7a52b60740 1 -- start start 2024-07-24T22:18:27.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a52b60740 1 Processor -- start 2024-07-24T22:18:27.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a52b60740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d56d0 0x56428c7e19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a52b60740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7d5ff0 0x56428c7dee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a52b60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 0x56428c7df5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a52b60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56428c59f700 con 0x56428c7e1f80 2024-07-24T22:18:27.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a52b60740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56428c6de5f0 con 0x56428c7d56d0 2024-07-24T22:18:27.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a52b60740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56428c7e49c0 con 0x56428c7d5ff0 2024-07-24T22:18:27.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a52b60740 10 client.0 _ll_register_callbacks cb 0x56428c6fe960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:27.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a4ed4c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 0x56428c7df5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a4ed4c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 0x56428c7df5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35680/0 (socket says 172.21.15.47:35680) 2024-07-24T22:18:27.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a4ed4c640 1 -- 172.21.15.47:0/1847585022 learned_addr learned my addr 172.21.15.47:0/1847585022 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:27.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a4dd4a640 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7d5ff0 0x56428c7dee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a4e54b640 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d56d0 0x56428c7e19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a4ed4c640 1 -- 172.21.15.47:0/1847585022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7d5ff0 msgr2=0x56428c7dee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:27.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a4ed4c640 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7d5ff0 0x56428c7dee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a4ed4c640 1 -- 172.21.15.47:0/1847585022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d56d0 msgr2=0x56428c7e19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:27.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a4ed4c640 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d56d0 0x56428c7e19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a4ed4c640 1 -- 172.21.15.47:0/1847585022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56428c6d1680 con 0x56428c7e1f80 2024-07-24T22:18:27.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.086+0000 7f7a4e54b640 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d56d0 0x56428c7e19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:27.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.087+0000 7f7a4ed4c640 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 0x56428c7df5d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7a40010b70 tx=0x7f7a40004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507589f5e7941c3d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:27.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.087+0000 7f7a31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:27.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.087+0000 7f7a31ffb640 1 -- 172.21.15.47:0/1847585022 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4002c060 con 0x56428c7e1f80 2024-07-24T22:18:27.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.087+0000 7f7a52b60740 1 -- 172.21.15.47:0/1847585022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a38114020 con 0x56428c7e1f80 2024-07-24T22:18:27.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.087+0000 7f7a31ffb640 1 -- 172.21.15.47:0/1847585022 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f7a40017030 con 0x56428c7e1f80 2024-07-24T22:18:27.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.087+0000 7f7a31ffb640 1 -- 172.21.15.47:0/1847585022 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7a4001fbc0 con 0x56428c7e1f80 2024-07-24T22:18:27.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.087+0000 7f7a52b60740 10 client.18000 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:27.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.087+0000 7f7a52b60740 1 -- 172.21.15.47:0/1847585022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56428c49c650 con 0x56428c7e1f80 2024-07-24T22:18:27.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.087+0000 7f7a31ffb640 1 -- 172.21.15.47:0/1847585022 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a38114020 con 0x56428c7e1f80 2024-07-24T22:18:27.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.088+0000 7f7a31ffb640 1 -- 172.21.15.47:0/1847585022 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7a40027410 con 0x56428c7e1f80 2024-07-24T22:18:27.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.088+0000 7f7a52b60740 10 client.18000 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:27.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.088+0000 7f7a52b60740 10 client.18000 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:27.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.088+0000 7f7a52b60740 20 client.18000 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:27.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.088+0000 7f7a52b60740 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56428c7f1ad0 0x56428c7f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.088+0000 7f7a52b60740 4 client.18000 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:27.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.088+0000 7f7a52b60740 1 -- 172.21.15.47:0/1847585022 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56428c74e900 con 0x56428c7f1ad0 2024-07-24T22:18:27.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.088+0000 7f7a4e54b640 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56428c7f1ad0 0x56428c7f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.088+0000 7f7a4e54b640 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56428c7f1ad0 0x56428c7f3f70 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14de437544c4f786 server_cookie=4b5bc954408f822d in_seq=0 out_seq=0 2024-07-24T22:18:27.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.088+0000 7f7a31ffb640 10 client.18000 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:27.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.089+0000 7f7a31ffb640 1 -- 172.21.15.47:0/1847585022 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56428c74e900 con 0x56428c7f1ad0 2024-07-24T22:18:27.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.089+0000 7f7a31ffb640 10 client.18000 handle_command_reply: tid=0 2024-07-24T22:18:27.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.089+0000 7f7a52b60740 1 client.18000 shutdown 2024-07-24T22:18:27.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.089+0000 7f7a52b60740 1 -- 172.21.15.47:0/1847585022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 msgr2=0x56428c7df5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:27.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.089+0000 7f7a52b60740 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 0x56428c7df5d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7a40010b70 tx=0x7f7a40004ab0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.089+0000 7f7a52b60740 1 -- 172.21.15.47:0/1847585022 shutdown_connections 2024-07-24T22:18:27.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.089+0000 7f7a52b60740 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56428c7f1ad0 0x56428c7f3f70 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.089+0000 7f7a52b60740 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7e1f80 0x56428c7df5d0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.089+0000 7f7a52b60740 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7d5ff0 0x56428c7dee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.089+0000 7f7a52b60740 1 --2- 172.21.15.47:0/1847585022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d56d0 0x56428c7e19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.089+0000 7f7a52b60740 1 -- 172.21.15.47:0/1847585022 >> 172.21.15.47:0/1847585022 conn(0x56428c7d3500 msgr2=0x56428c7d90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:27.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.089+0000 7f7a31ffb640 0 client.18000 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:27.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.090+0000 7f7a52b60740 1 -- 172.21.15.47:0/1847585022 shutdown_connections 2024-07-24T22:18:27.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.090+0000 7f7a52b60740 1 -- 172.21.15.47:0/1847585022 wait complete. 2024-07-24T22:18:27.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.090+0000 7f7a52b60740 20 client.18000 trim_cache size 0 max 16384 2024-07-24T22:18:27.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.103+0000 7f7a52b60740 1 Processor -- start 2024-07-24T22:18:27.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.103+0000 7f7a52b60740 1 -- start start 2024-07-24T22:18:27.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a52b60740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d56d0 0x56428c7e0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a52b60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d5ff0 0x56428c7f9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a52b60740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7e1f80 0x56428c7f9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a52b60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7a481ae4f0 con 0x56428c7d5ff0 2024-07-24T22:18:27.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a52b60740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7a481b0d50 con 0x56428c7d56d0 2024-07-24T22:18:27.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a52b60740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7a481aeb40 con 0x56428c7e1f80 2024-07-24T22:18:27.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a4dd4a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d5ff0 0x56428c7f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a4dd4a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d5ff0 0x56428c7f9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35692/0 (socket says 172.21.15.47:35692) 2024-07-24T22:18:27.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a4dd4a640 1 -- 172.21.15.47:0/65669320 learned_addr learned my addr 172.21.15.47:0/65669320 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:27.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a4e54b640 1 --2- 172.21.15.47:0/65669320 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d56d0 0x56428c7e0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a4ed4c640 1 --2- 172.21.15.47:0/65669320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7e1f80 0x56428c7f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a4dd4a640 1 -- 172.21.15.47:0/65669320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7e1f80 msgr2=0x56428c7f9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:27.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a4dd4a640 1 --2- 172.21.15.47:0/65669320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7e1f80 0x56428c7f9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a4dd4a640 1 -- 172.21.15.47:0/65669320 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d56d0 msgr2=0x56428c7e0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:27.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a4dd4a640 1 --2- 172.21.15.47:0/65669320 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d56d0 0x56428c7e0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a4dd4a640 1 -- 172.21.15.47:0/65669320 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56428c7d2e80 con 0x56428c7d5ff0 2024-07-24T22:18:27.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a4ed4c640 1 --2- 172.21.15.47:0/65669320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7e1f80 0x56428c7f9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:27.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a4dd4a640 1 --2- 172.21.15.47:0/65669320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d5ff0 0x56428c7f9880 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7a381022d0 tx=0x7f7a3802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560298143094974 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:27.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a33fff640 1 -- 172.21.15.47:0/65669320 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3809cb90 con 0x56428c7d5ff0 2024-07-24T22:18:27.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a33fff640 1 -- 172.21.15.47:0/65669320 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a38107e50 con 0x56428c7d5ff0 2024-07-24T22:18:27.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.104+0000 7f7a33fff640 1 -- 172.21.15.47:0/65669320 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3809cd80 con 0x56428c7d5ff0 2024-07-24T22:18:27.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.105+0000 7f7a52b60740 1 -- 172.21.15.47:0/65669320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d5ff0 msgr2=0x56428c7f9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:27.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.105+0000 7f7a52b60740 1 --2- 172.21.15.47:0/65669320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d5ff0 0x56428c7f9880 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7a381022d0 tx=0x7f7a3802a410 comp rx=0 tx=0).stop 2024-07-24T22:18:27.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.105+0000 7f7a52b60740 1 -- 172.21.15.47:0/65669320 shutdown_connections 2024-07-24T22:18:27.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.105+0000 7f7a52b60740 1 --2- 172.21.15.47:0/65669320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7e1f80 0x56428c7f9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.105+0000 7f7a52b60740 1 --2- 172.21.15.47:0/65669320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d5ff0 0x56428c7f9880 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.105+0000 7f7a52b60740 1 --2- 172.21.15.47:0/65669320 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d56d0 0x56428c7e0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.105+0000 7f7a52b60740 1 -- 172.21.15.47:0/65669320 >> 172.21.15.47:0/65669320 conn(0x56428c7d3500 msgr2=0x56428c7e0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:27.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.105+0000 7f7a52b60740 1 -- 172.21.15.47:0/65669320 shutdown_connections 2024-07-24T22:18:27.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.105+0000 7f7a52b60740 1 -- 172.21.15.47:0/65669320 wait complete. 2024-07-24T22:18:27.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a52b60740 1 -- start start 2024-07-24T22:18:27.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a52b60740 1 Processor -- start 2024-07-24T22:18:27.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a52b60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d56d0 0x56428c7e9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a52b60740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d5ff0 0x56428c7ea160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a52b60740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7e1f80 0x56428c7e4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a52b60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7a481af210 con 0x56428c7d56d0 2024-07-24T22:18:27.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a52b60740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7a481b0680 con 0x56428c7d5ff0 2024-07-24T22:18:27.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a52b60740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7a481af8e0 con 0x56428c7e1f80 2024-07-24T22:18:27.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a52b60740 10 client.0 _ll_register_callbacks cb 0x7f7a40010a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:27.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a4e54b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d56d0 0x56428c7e9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a4e54b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d56d0 0x56428c7e9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35708/0 (socket says 172.21.15.47:35708) 2024-07-24T22:18:27.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a4e54b640 1 -- 172.21.15.47:0/1589984851 learned_addr learned my addr 172.21.15.47:0/1589984851 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:27.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a4dd4a640 1 --2- 172.21.15.47:0/1589984851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d5ff0 0x56428c7ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a4ed4c640 1 --2- 172.21.15.47:0/1589984851 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7e1f80 0x56428c7e4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a4e54b640 1 -- 172.21.15.47:0/1589984851 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7e1f80 msgr2=0x56428c7e4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:27.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a4e54b640 1 --2- 172.21.15.47:0/1589984851 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7e1f80 0x56428c7e4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a4e54b640 1 -- 172.21.15.47:0/1589984851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d5ff0 msgr2=0x56428c7ea160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:27.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a4e54b640 1 --2- 172.21.15.47:0/1589984851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d5ff0 0x56428c7ea160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.106+0000 7f7a4e54b640 1 -- 172.21.15.47:0/1589984851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56428c7edaa0 con 0x56428c7d56d0 2024-07-24T22:18:27.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.107+0000 7f7a4e54b640 1 --2- 172.21.15.47:0/1589984851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d56d0 0x56428c7e9c20 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f7a44005fd0 tx=0x7f7a44013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fbd4cda4b0dd1ef server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:27.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.107+0000 7f7a31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.107+0000 7f7a31ffb640 1 -- 172.21.15.47:0/1589984851 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4401d410 con 0x56428c7d56d0 2024-07-24T22:18:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.107+0000 7f7a31ffb640 1 -- 172.21.15.47:0/1589984851 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8609+0+0 (secure 0 0 0) 0x7f7a4401d5b0 con 0x56428c7d56d0 2024-07-24T22:18:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.107+0000 7f7a52b60740 1 -- 172.21.15.47:0/1589984851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a38107e50 con 0x56428c7d56d0 2024-07-24T22:18:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.107+0000 7f7a31ffb640 1 -- 172.21.15.47:0/1589984851 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7a4401d7b0 con 0x56428c7d56d0 2024-07-24T22:18:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.107+0000 7f7a52b60740 10 client.18006 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.107+0000 7f7a52b60740 1 -- 172.21.15.47:0/1589984851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56428c85cc00 con 0x56428c7d56d0 2024-07-24T22:18:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.107+0000 7f7a31ffb640 1 -- 172.21.15.47:0/1589984851 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a38107e50 con 0x56428c7d56d0 2024-07-24T22:18:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.107+0000 7f7a31ffb640 1 -- 172.21.15.47:0/1589984851 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7a44024030 con 0x56428c7d56d0 2024-07-24T22:18:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.107+0000 7f7a52b60740 10 client.18006 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.108+0000 7f7a52b60740 10 client.18006 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.108+0000 7f7a52b60740 20 client.18006 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.108+0000 7f7a52b60740 1 --2- 172.21.15.47:0/1589984851 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56428c85d390 0x56428c85f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.108+0000 7f7a52b60740 4 client.18006 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:18:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.108+0000 7f7a52b60740 1 -- 172.21.15.47:0/1589984851 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56428c74a3a0 con 0x56428c85d390 2024-07-24T22:18:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.108+0000 7f7a4dd4a640 1 --2- 172.21.15.47:0/1589984851 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56428c85d390 0x56428c85f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.108+0000 7f7a4dd4a640 1 --2- 172.21.15.47:0/1589984851 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56428c85d390 0x56428c85f7b0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aaf06ef0726142c server_cookie=ab24bfc9c6c6497c in_seq=0 out_seq=0 2024-07-24T22:18:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.108+0000 7f7a31ffb640 10 client.18006 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.108+0000 7f7a31ffb640 1 -- 172.21.15.47:0/1589984851 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56428c74a3a0 con 0x56428c85d390 2024-07-24T22:18:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.108+0000 7f7a31ffb640 10 client.18006 handle_command_reply: tid=0 2024-07-24T22:18:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.108+0000 7f7a52b60740 1 client.18006 shutdown 2024-07-24T22:18:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a52b60740 1 -- 172.21.15.47:0/1589984851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d56d0 msgr2=0x56428c7e9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a52b60740 1 --2- 172.21.15.47:0/1589984851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d56d0 0x56428c7e9c20 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f7a44005fd0 tx=0x7f7a44013830 comp rx=0 tx=0).stop 2024-07-24T22:18:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a52b60740 1 -- 172.21.15.47:0/1589984851 shutdown_connections 2024-07-24T22:18:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a52b60740 1 --2- 172.21.15.47:0/1589984851 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56428c85d390 0x56428c85f7b0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a52b60740 1 --2- 172.21.15.47:0/1589984851 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56428c7e1f80 0x56428c7e4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a52b60740 1 --2- 172.21.15.47:0/1589984851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56428c7d5ff0 0x56428c7ea160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a52b60740 1 --2- 172.21.15.47:0/1589984851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56428c7d56d0 0x56428c7e9c20 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a52b60740 1 -- 172.21.15.47:0/1589984851 >> 172.21.15.47:0/1589984851 conn(0x56428c7d3500 msgr2=0x56428c7ed2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:27.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a31ffb640 0 client.18006 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:27.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a52b60740 1 -- 172.21.15.47:0/1589984851 shutdown_connections 2024-07-24T22:18:27.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a52b60740 1 -- 172.21.15.47:0/1589984851 wait complete. 2024-07-24T22:18:27.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a52b60740 20 client.18006 trim_cache size 0 max 16384 2024-07-24T22:18:27.118 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:18:27.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a507af640 1 -- 172.21.15.47:0/688716950 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7a340b3dc0 msgr2=0x7f7a340b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:27.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a507af640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7a340b3dc0 0x7f7a340b6280 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7a48110dc0 tx=0x7f7a40009500 comp rx=0 tx=0).stop 2024-07-24T22:18:27.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a507af640 1 -- 172.21.15.47:0/688716950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a48107070 msgr2=0x7f7a4810f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:27.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a507af640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a48107070 0x7f7a4810f240 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f7a38005940 tx=0x7f7a38004270 comp rx=0 tx=0).stop 2024-07-24T22:18:27.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a507af640 1 -- 172.21.15.47:0/688716950 shutdown_connections 2024-07-24T22:18:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a507af640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f7a340b3dc0 0x7f7a340b6280 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a507af640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a481079f0 0x7f7a4810f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a507af640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a48107070 0x7f7a4810f240 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a507af640 1 --2- 172.21.15.47:0/688716950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a48101660 0x7f7a4810ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.109+0000 7f7a507af640 1 -- 172.21.15.47:0/688716950 >> 172.21.15.47:0/688716950 conn(0x7f7a480fd0f0 msgr2=0x7f7a480ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.110+0000 7f7a507af640 1 -- 172.21.15.47:0/688716950 shutdown_connections 2024-07-24T22:18:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:27.110+0000 7f7a507af640 1 -- 172.21.15.47:0/688716950 wait complete. 2024-07-24T22:18:27.496 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:18:27.869 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:28.101 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:27 smithi188 ceph-mon[37380]: pgmap v714: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-07-24T22:18:28.113 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:27 smithi047 ceph-mon[32551]: pgmap v714: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-07-24T22:18:28.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:27 smithi183 ceph-mon[37007]: pgmap v714: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-07-24T22:18:28.806 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:18:28.806 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:18:29.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.461+0000 7f3813f86640 1 -- 172.21.15.47:0/994650842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380c103f70 msgr2=0x7f380c10c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:29.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.461+0000 7f3813f86640 1 --2- 172.21.15.47:0/994650842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380c103f70 0x7f380c10c550 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009900 tx=0x7f37fc02a410 comp rx=0 tx=0).stop 2024-07-24T22:18:29.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.461+0000 7f3813f86640 1 -- 172.21.15.47:0/994650842 shutdown_connections 2024-07-24T22:18:29.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.461+0000 7f3813f86640 1 --2- 172.21.15.47:0/994650842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f380c10cb20 0x7f380c10ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:29.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.461+0000 7f3813f86640 1 --2- 172.21.15.47:0/994650842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380c103f70 0x7f380c10c550 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:29.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.461+0000 7f3813f86640 1 --2- 172.21.15.47:0/994650842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f380c103570 0x7f380c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:29.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.461+0000 7f3813f86640 1 -- 172.21.15.47:0/994650842 >> 172.21.15.47:0/994650842 conn(0x7f380c0fd100 msgr2=0x7f380c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:29.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.461+0000 7f3813f86640 1 -- 172.21.15.47:0/994650842 shutdown_connections 2024-07-24T22:18:29.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.461+0000 7f3813f86640 1 -- 172.21.15.47:0/994650842 wait complete. 2024-07-24T22:18:29.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3813f86640 1 Processor -- start 2024-07-24T22:18:29.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3813f86640 1 -- start start 2024-07-24T22:18:29.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3813f86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380c103570 0x7f380c19adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:29.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3813f86640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f380c103f70 0x7f380c19b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:29.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3813f86640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f380c10cb20 0x7f380c1a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:29.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3813f86640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f380c112740 con 0x7f380c103570 2024-07-24T22:18:29.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3813f86640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f380c1125c0 con 0x7f380c103f70 2024-07-24T22:18:29.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3813f86640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f380c1128c0 con 0x7f380c10cb20 2024-07-24T22:18:29.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3811d22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380c103570 0x7f380c19adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:29.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3811d22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380c103570 0x7f380c19adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35734/0 (socket says 172.21.15.47:35734) 2024-07-24T22:18:29.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3811d22640 1 -- 172.21.15.47:0/2545553601 learned_addr learned my addr 172.21.15.47:0/2545553601 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:29.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3811521640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f380c103f70 0x7f380c19b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:29.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3812523640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f380c10cb20 0x7f380c1a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:29.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3811d22640 1 -- 172.21.15.47:0/2545553601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f380c10cb20 msgr2=0x7f380c1a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:29.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3811d22640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f380c10cb20 0x7f380c1a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:29.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3811d22640 1 -- 172.21.15.47:0/2545553601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f380c103f70 msgr2=0x7f380c19b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:29.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3811d22640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f380c103f70 0x7f380c19b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:29.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.462+0000 7f3811d22640 1 -- 172.21.15.47:0/2545553601 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380c1a0e70 con 0x7f380c103570 2024-07-24T22:18:29.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.463+0000 7f3811d22640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380c103570 0x7f380c19adc0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f380800c920 tx=0x7f380800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:29.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.463+0000 7f3802ffd640 1 -- 172.21.15.47:0/2545553601 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3808007c70 con 0x7f380c103570 2024-07-24T22:18:29.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.463+0000 7f3813f86640 1 -- 172.21.15.47:0/2545553601 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f380c1a1160 con 0x7f380c103570 2024-07-24T22:18:29.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.463+0000 7f3813f86640 1 -- 172.21.15.47:0/2545553601 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f380c1a79f0 con 0x7f380c103570 2024-07-24T22:18:29.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.463+0000 7f3802ffd640 1 -- 172.21.15.47:0/2545553601 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3808007e10 con 0x7f380c103570 2024-07-24T22:18:29.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.463+0000 7f3802ffd640 1 -- 172.21.15.47:0/2545553601 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3808018820 con 0x7f380c103570 2024-07-24T22:18:29.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.464+0000 7f3813f86640 1 -- 172.21.15.47:0/2545553601 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f00052c0 con 0x7f380c103570 2024-07-24T22:18:29.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.466+0000 7f3802ffd640 1 -- 172.21.15.47:0/2545553601 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f38080189c0 con 0x7f380c103570 2024-07-24T22:18:29.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.467+0000 7f3802ffd640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f37f80b3dc0 0x7f37f80b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:29.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.467+0000 7f3811521640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f37f80b3dc0 0x7f37f80b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:29.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.467+0000 7f3802ffd640 1 -- 172.21.15.47:0/2545553601 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f38080e41a0 con 0x7f380c103570 2024-07-24T22:18:29.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.467+0000 7f3811521640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f37f80b3dc0 0x7f37f80b6280 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f37fc031440 tx=0x7f37fc005b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:29.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.470+0000 7f3802ffd640 1 -- 172.21.15.47:0/2545553601 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f3808014030 con 0x7f380c103570 2024-07-24T22:18:29.494 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:29.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.709+0000 7f3813f86640 1 -- 172.21.15.47:0/2545553601 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37f00055b0 con 0x7f380c103570 2024-07-24T22:18:29.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.710+0000 7f3802ffd640 1 -- 172.21.15.47:0/2545553601 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f38080ab530 con 0x7f380c103570 2024-07-24T22:18:29.712 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:18:29.712 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:18:29.713 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:18:29.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.712+0000 7f3813f86640 1 -- 172.21.15.47:0/2545553601 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f37f80b3dc0 msgr2=0x7f37f80b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:29.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.712+0000 7f3813f86640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f37f80b3dc0 0x7f37f80b6280 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f37fc031440 tx=0x7f37fc005b50 comp rx=0 tx=0).stop 2024-07-24T22:18:29.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.712+0000 7f3813f86640 1 -- 172.21.15.47:0/2545553601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380c103570 msgr2=0x7f380c19adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:29.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.712+0000 7f3813f86640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380c103570 0x7f380c19adc0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f380800c920 tx=0x7f380800cde0 comp rx=0 tx=0).stop 2024-07-24T22:18:29.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.712+0000 7f3813f86640 1 -- 172.21.15.47:0/2545553601 shutdown_connections 2024-07-24T22:18:29.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.712+0000 7f3813f86640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f37f80b3dc0 0x7f37f80b6280 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:29.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.712+0000 7f3813f86640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f380c10cb20 0x7f380c1a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:29.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.712+0000 7f3813f86640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f380c103f70 0x7f380c19b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:29.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.712+0000 7f3813f86640 1 --2- 172.21.15.47:0/2545553601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380c103570 0x7f380c19adc0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:29.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.712+0000 7f3813f86640 1 -- 172.21.15.47:0/2545553601 >> 172.21.15.47:0/2545553601 conn(0x7f380c0fd100 msgr2=0x7f380c10ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:29.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.712+0000 7f3813f86640 1 -- 172.21.15.47:0/2545553601 shutdown_connections 2024-07-24T22:18:29.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:29.712+0000 7f3813f86640 1 -- 172.21.15.47:0/2545553601 wait complete. 2024-07-24T22:18:29.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:29 smithi047 ceph-mon[32551]: pgmap v715: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 5 op/s 2024-07-24T22:18:29.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:29 smithi047 ceph-mon[32551]: osdmap e97: 12 total, 12 up, 12 in 2024-07-24T22:18:29.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:29 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2545553601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:30.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:29 smithi183 ceph-mon[37007]: pgmap v715: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 5 op/s 2024-07-24T22:18:30.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:29 smithi183 ceph-mon[37007]: osdmap e97: 12 total, 12 up, 12 in 2024-07-24T22:18:30.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:29 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2545553601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:30.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:29 smithi188 ceph-mon[37380]: pgmap v715: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 5 op/s 2024-07-24T22:18:30.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:29 smithi188 ceph-mon[37380]: osdmap e97: 12 total, 12 up, 12 in 2024-07-24T22:18:30.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:29 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2545553601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:30.360 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db --set-id 4204a3b9 --release --await' 2024-07-24T22:18:30.360 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db --set-id 4204a3b9 --release --await 2024-07-24T22:18:31.298 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.797+0000 7fbe212cb640 1 -- 172.21.15.47:0/1164191650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe1c107930 msgr2=0x7fbe1c10e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.797+0000 7fbe212cb640 1 --2- 172.21.15.47:0/1164191650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe1c107930 0x7fbe1c10e130 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009ca0 tx=0x7fbe1402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 -- 172.21.15.47:0/1164191650 shutdown_connections 2024-07-24T22:18:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 --2- 172.21.15.47:0/1164191650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe1c107930 0x7fbe1c10e130 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 --2- 172.21.15.47:0/1164191650 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe1c106fb0 0x7fbe1c1073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 --2- 172.21.15.47:0/1164191650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe1c1015b0 0x7fbe1c101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 -- 172.21.15.47:0/1164191650 >> 172.21.15.47:0/1164191650 conn(0x7fbe1c0fd010 msgr2=0x7fbe1c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 -- 172.21.15.47:0/1164191650 shutdown_connections 2024-07-24T22:18:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 -- 172.21.15.47:0/1164191650 wait complete. 2024-07-24T22:18:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 Processor -- start 2024-07-24T22:18:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 -- start start 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe1c1015b0 0x7fbe1c1999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe1c106fb0 0x7fbe1c199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe1c107930 0x7fbe1c1a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c111560 con 0x7fbe1c106fb0 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1113e0 con 0x7fbe1c1015b0 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.798+0000 7fbe212cb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1116e0 con 0x7fbe1c107930 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe1c106fb0 0x7fbe1c199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe1c106fb0 0x7fbe1c199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35744/0 (socket says 172.21.15.47:35744) 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe13fff640 1 -- 172.21.15.47:0/609470278 learned_addr learned my addr 172.21.15.47:0/609470278 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe1b7fe640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe1c107930 0x7fbe1c1a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe1affd640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe1c1015b0 0x7fbe1c1999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe13fff640 1 -- 172.21.15.47:0/609470278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe1c107930 msgr2=0x7fbe1c1a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe13fff640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe1c107930 0x7fbe1c1a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe13fff640 1 -- 172.21.15.47:0/609470278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe1c1015b0 msgr2=0x7fbe1c1999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe13fff640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe1c1015b0 0x7fbe1c1999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe13fff640 1 -- 172.21.15.47:0/609470278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1c1a4f70 con 0x7fbe1c106fb0 2024-07-24T22:18:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe1affd640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe1c1015b0 0x7fbe1c1999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe13fff640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe1c106fb0 0x7fbe1c199ef0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400d950 tx=0x7fbe0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe18ff9640 1 -- 172.21.15.47:0/609470278 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04017070 con 0x7fbe1c106fb0 2024-07-24T22:18:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe18ff9640 1 -- 172.21.15.47:0/609470278 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe04009c30 con 0x7fbe1c106fb0 2024-07-24T22:18:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe212cb640 1 -- 172.21.15.47:0/609470278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1c1a5140 con 0x7fbe1c106fb0 2024-07-24T22:18:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe18ff9640 1 -- 172.21.15.47:0/609470278 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0400f620 con 0x7fbe1c106fb0 2024-07-24T22:18:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.799+0000 7fbe212cb640 1 -- 172.21.15.47:0/609470278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe1c1a5680 con 0x7fbe1c106fb0 2024-07-24T22:18:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.802+0000 7fbe24027740 1 Processor -- start 2024-07-24T22:18:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.802+0000 7fbe24027740 1 -- start start 2024-07-24T22:18:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe18ff9640 1 -- 172.21.15.47:0/609470278 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fbe04010460 con 0x7fbe1c106fb0 2024-07-24T22:18:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe24027740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f38c0 0x5580a45f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe24027740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f41e0 0x5580a45ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe24027740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a4600170 0x5580a4602560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe24027740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5580a4569280 con 0x5580a45f41e0 2024-07-24T22:18:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe24027740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5580a4558780 con 0x5580a4600170 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe24027740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5580a455c7c0 con 0x5580a45f38c0 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe1affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f41e0 0x5580a45ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe1b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f38c0 0x5580a45f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe1affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f41e0 0x5580a45ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35760/0 (socket says 172.21.15.47:35760) 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe1affd640 1 -- 172.21.15.47:0/3428804347 learned_addr learned my addr 172.21.15.47:0/3428804347 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe13fff640 1 --2- 172.21.15.47:0/3428804347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a4600170 0x5580a4602560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe1b7fe640 1 -- 172.21.15.47:0/3428804347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a4600170 msgr2=0x5580a4602560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe1b7fe640 1 --2- 172.21.15.47:0/3428804347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a4600170 0x5580a4602560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe1b7fe640 1 -- 172.21.15.47:0/3428804347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f41e0 msgr2=0x5580a45ffc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe1b7fe640 1 --2- 172.21.15.47:0/3428804347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f41e0 0x5580a45ffc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe1b7fe640 1 -- 172.21.15.47:0/3428804347 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580a42bc790 con 0x5580a45f38c0 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.803+0000 7fbe1affd640 1 --2- 172.21.15.47:0/3428804347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f41e0 0x5580a45ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.804+0000 7fbe1b7fe640 1 --2- 172.21.15.47:0/3428804347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f38c0 0x5580a45f3ca0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbe14006010 tx=0x7fbe14009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=665d0427b0051b29 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.804+0000 7fbe117fa640 1 -- 172.21.15.47:0/3428804347 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14031cf0 con 0x5580a45f38c0 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.804+0000 7fbe117fa640 1 -- 172.21.15.47:0/3428804347 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe14036030 con 0x5580a45f38c0 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.804+0000 7fbe18ff9640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbe080b3dc0 0x7fbe080b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.804+0000 7fbe117fa640 1 -- 172.21.15.47:0/3428804347 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe140042a0 con 0x5580a45f38c0 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.804+0000 7fbe1affd640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbe080b3dc0 0x7fbe080b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.804+0000 7fbe18ff9640 1 -- 172.21.15.47:0/609470278 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fbe040e3b90 con 0x7fbe1c106fb0 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 -- 172.21.15.47:0/3428804347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f38c0 msgr2=0x5580a45f3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe1affd640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbe080b3dc0 0x7fbe080b6280 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x5580a45f6a40 tx=0x7fbe0c009560 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 --2- 172.21.15.47:0/3428804347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f38c0 0x5580a45f3ca0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbe14006010 tx=0x7fbe14009800 comp rx=0 tx=0).stop 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 -- 172.21.15.47:0/3428804347 shutdown_connections 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 --2- 172.21.15.47:0/3428804347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a4600170 0x5580a4602560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 --2- 172.21.15.47:0/3428804347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f41e0 0x5580a45ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 --2- 172.21.15.47:0/3428804347 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f38c0 0x5580a45f3ca0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 -- 172.21.15.47:0/3428804347 >> 172.21.15.47:0/3428804347 conn(0x5580a45f16f0 msgr2=0x5580a45f2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 -- 172.21.15.47:0/3428804347 shutdown_connections 2024-07-24T22:18:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 -- 172.21.15.47:0/3428804347 wait complete. 2024-07-24T22:18:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 -- start start 2024-07-24T22:18:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 Processor -- start 2024-07-24T22:18:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f38c0 0x5580a45ff8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f41e0 0x5580a45fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.805+0000 7fbe24027740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a4600170 0x5580a45fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe24027740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5580a4492ab0 con 0x5580a45f38c0 2024-07-24T22:18:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe24027740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5580a44e09e0 con 0x5580a4600170 2024-07-24T22:18:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe24027740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5580a4602c70 con 0x5580a45f41e0 2024-07-24T22:18:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe24027740 10 client.0 _ll_register_callbacks cb 0x5580a4268a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe1affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f38c0 0x5580a45ff8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe1affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f38c0 0x5580a45ff8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35766/0 (socket says 172.21.15.47:35766) 2024-07-24T22:18:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe1affd640 1 -- 172.21.15.47:0/2544381590 learned_addr learned my addr 172.21.15.47:0/2544381590 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe13fff640 1 --2- 172.21.15.47:0/2544381590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f41e0 0x5580a45fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe1b7fe640 1 --2- 172.21.15.47:0/2544381590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a4600170 0x5580a45fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe1affd640 1 -- 172.21.15.47:0/2544381590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f41e0 msgr2=0x5580a45fcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe1affd640 1 --2- 172.21.15.47:0/2544381590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f41e0 0x5580a45fcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe1affd640 1 -- 172.21.15.47:0/2544381590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a4600170 msgr2=0x5580a45fd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe1affd640 1 --2- 172.21.15.47:0/2544381590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a4600170 0x5580a45fd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe1affd640 1 -- 172.21.15.47:0/2544381590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580a4335620 con 0x5580a45f38c0 2024-07-24T22:18:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe1affd640 1 --2- 172.21.15.47:0/2544381590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f38c0 0x5580a45ff8b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c005e50 tx=0x7fbe0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2712a3b7d567285 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe027fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe027fc640 1 -- 172.21.15.47:0/2544381590 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c004220 con 0x5580a45f38c0 2024-07-24T22:18:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe027fc640 1 -- 172.21.15.47:0/2544381590 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fbe0c0043c0 con 0x5580a45f38c0 2024-07-24T22:18:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe24027740 1 -- 172.21.15.47:0/2544381590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5580a4507ce0 con 0x5580a45f38c0 2024-07-24T22:18:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe027fc640 1 -- 172.21.15.47:0/2544381590 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbe0c01f7b0 con 0x5580a45f38c0 2024-07-24T22:18:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe24027740 10 client.18024 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.806+0000 7fbe24027740 1 -- 172.21.15.47:0/2544381590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5580a460e480 con 0x5580a45f38c0 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.807+0000 7fbe027fc640 1 -- 172.21.15.47:0/2544381590 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5580a4507ce0 con 0x5580a45f38c0 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.807+0000 7fbe027fc640 1 -- 172.21.15.47:0/2544381590 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbe0c00f040 con 0x5580a45f38c0 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.807+0000 7fbe24027740 10 client.18024 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.807+0000 7fbe24027740 10 client.18024 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.807+0000 7fbe24027740 20 client.18024 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.807+0000 7fbe24027740 1 --2- 172.21.15.47:0/2544381590 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5580a460f9b0 0x5580a4611da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.807+0000 7fbe24027740 4 client.18024 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.807+0000 7fbe24027740 1 -- 172.21.15.47:0/2544381590 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580a456b1d0 con 0x5580a460f9b0 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.807+0000 7fbe13fff640 1 --2- 172.21.15.47:0/2544381590 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5580a460f9b0 0x5580a4611da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.807+0000 7fbe13fff640 1 --2- 172.21.15.47:0/2544381590 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5580a460f9b0 0x5580a4611da0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5de496c71d3d1314 server_cookie=1548cc2de786e6c8 in_seq=0 out_seq=0 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.807+0000 7fbe027fc640 10 client.18024 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe027fc640 1 -- 172.21.15.47:0/2544381590 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5580a456b1d0 con 0x5580a460f9b0 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe027fc640 10 client.18024 handle_command_reply: tid=0 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe24027740 1 client.18024 shutdown 2024-07-24T22:18:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe24027740 1 -- 172.21.15.47:0/2544381590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f38c0 msgr2=0x5580a45ff8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe24027740 1 --2- 172.21.15.47:0/2544381590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f38c0 0x5580a45ff8b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c005e50 tx=0x7fbe0c0046c0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe24027740 1 -- 172.21.15.47:0/2544381590 shutdown_connections 2024-07-24T22:18:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe24027740 1 --2- 172.21.15.47:0/2544381590 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5580a460f9b0 0x5580a4611da0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe24027740 1 --2- 172.21.15.47:0/2544381590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a4600170 0x5580a45fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe24027740 1 --2- 172.21.15.47:0/2544381590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f41e0 0x5580a45fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe027fc640 0 client.18024 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe24027740 1 --2- 172.21.15.47:0/2544381590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a45f38c0 0x5580a45ff8b0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe24027740 1 -- 172.21.15.47:0/2544381590 >> 172.21.15.47:0/2544381590 conn(0x5580a45f16f0 msgr2=0x5580a45f7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe24027740 1 -- 172.21.15.47:0/2544381590 shutdown_connections 2024-07-24T22:18:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe24027740 1 -- 172.21.15.47:0/2544381590 wait complete. 2024-07-24T22:18:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.808+0000 7fbe24027740 20 client.18024 trim_cache size 0 max 16384 2024-07-24T22:18:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.824+0000 7fbe24027740 1 Processor -- start 2024-07-24T22:18:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe24027740 1 -- start start 2024-07-24T22:18:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe24027740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a45f38c0 0x5580a460bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe24027740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f41e0 0x5580a46176c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe24027740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 0x5580a4617c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe24027740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1ac150 con 0x5580a4600170 2024-07-24T22:18:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe24027740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1ae9b0 con 0x5580a45f38c0 2024-07-24T22:18:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe24027740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1ac7a0 con 0x5580a45f41e0 2024-07-24T22:18:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe1b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 0x5580a4617c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe1affd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a45f38c0 0x5580a460bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe1b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 0x5580a4617c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35780/0 (socket says 172.21.15.47:35780) 2024-07-24T22:18:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe1b7fe640 1 -- 172.21.15.47:0/164582391 learned_addr learned my addr 172.21.15.47:0/164582391 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe13fff640 1 --2- 172.21.15.47:0/164582391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f41e0 0x5580a46176c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe1b7fe640 1 -- 172.21.15.47:0/164582391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f41e0 msgr2=0x5580a46176c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe1b7fe640 1 --2- 172.21.15.47:0/164582391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f41e0 0x5580a46176c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe1b7fe640 1 -- 172.21.15.47:0/164582391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a45f38c0 msgr2=0x5580a460bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe1b7fe640 1 --2- 172.21.15.47:0/164582391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a45f38c0 0x5580a460bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe1b7fe640 1 -- 172.21.15.47:0/164582391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580a4612110 con 0x5580a4600170 2024-07-24T22:18:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe13fff640 1 --2- 172.21.15.47:0/164582391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f41e0 0x5580a46176c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.825+0000 7fbe1affd640 1 --2- 172.21.15.47:0/164582391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a45f38c0 0x5580a460bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.826+0000 7fbe1b7fe640 1 --2- 172.21.15.47:0/164582391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 0x5580a4617c00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009ca0 tx=0x7fbe1402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f382c624cf36019d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.826+0000 7fbe10ff9640 1 -- 172.21.15.47:0/164582391 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14054020 con 0x5580a4600170 2024-07-24T22:18:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.826+0000 7fbe10ff9640 1 -- 172.21.15.47:0/164582391 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe14036040 con 0x5580a4600170 2024-07-24T22:18:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.826+0000 7fbe10ff9640 1 -- 172.21.15.47:0/164582391 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1402f8c0 con 0x5580a4600170 2024-07-24T22:18:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.826+0000 7fbe24027740 1 -- 172.21.15.47:0/164582391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 msgr2=0x5580a4617c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.826+0000 7fbe24027740 1 --2- 172.21.15.47:0/164582391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 0x5580a4617c00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009ca0 tx=0x7fbe1402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.826+0000 7fbe24027740 1 -- 172.21.15.47:0/164582391 shutdown_connections 2024-07-24T22:18:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 --2- 172.21.15.47:0/164582391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 0x5580a4617c00 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 --2- 172.21.15.47:0/164582391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f41e0 0x5580a46176c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 --2- 172.21.15.47:0/164582391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a45f38c0 0x5580a460bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 -- 172.21.15.47:0/164582391 >> 172.21.15.47:0/164582391 conn(0x5580a45f16f0 msgr2=0x5580a45fb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 -- 172.21.15.47:0/164582391 shutdown_connections 2024-07-24T22:18:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 -- 172.21.15.47:0/164582391 wait complete. 2024-07-24T22:18:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 -- start start 2024-07-24T22:18:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 Processor -- start 2024-07-24T22:18:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f38c0 0x5580a4605050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a45f41e0 0x5580a4605590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 0x5580a4605af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1ace70 con 0x5580a4600170 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1ae2e0 con 0x5580a45f41e0 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1ad540 con 0x5580a45f38c0 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe24027740 10 client.0 _ll_register_callbacks cb 0x7fbe0c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe1b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 0x5580a4605af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe13fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a45f41e0 0x5580a4605590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe1b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 0x5580a4605af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35794/0 (socket says 172.21.15.47:35794) 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.827+0000 7fbe1b7fe640 1 -- 172.21.15.47:0/3819806566 learned_addr learned my addr 172.21.15.47:0/3819806566 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe1affd640 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f38c0 0x5580a4605050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe13fff640 1 -- 172.21.15.47:0/3819806566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f38c0 msgr2=0x5580a4605050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe13fff640 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f38c0 0x5580a4605050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe13fff640 1 -- 172.21.15.47:0/3819806566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 msgr2=0x5580a4605af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe13fff640 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 0x5580a4605af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe13fff640 1 -- 172.21.15.47:0/3819806566 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580a4678960 con 0x5580a45f41e0 2024-07-24T22:18:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe1affd640 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f38c0 0x5580a4605050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe1b7fe640 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 0x5580a4605af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe13fff640 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a45f41e0 0x5580a4605590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbe040e12b0 tx=0x7fbe04010cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea456c943ea4e138 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe027fc640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe027fc640 1 -- 172.21.15.47:0/3819806566 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04020040 con 0x5580a45f41e0 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe24027740 1 -- 172.21.15.47:0/3819806566 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe14036040 con 0x5580a45f41e0 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe027fc640 1 -- 172.21.15.47:0/3819806566 <== mon.2 v2:172.21.15.183:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fbe040b3390 con 0x5580a45f41e0 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe027fc640 1 -- 172.21.15.47:0/3819806566 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbe040a9ee0 con 0x5580a45f41e0 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe24027740 10 client.27086 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe24027740 1 -- 172.21.15.47:0/3819806566 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5580a4679cd0 con 0x5580a45f41e0 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.828+0000 7fbe027fc640 1 -- 172.21.15.47:0/3819806566 <== mon.2 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe14036040 con 0x5580a45f41e0 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.829+0000 7fbe027fc640 1 -- 172.21.15.47:0/3819806566 <== mon.2 v2:172.21.15.183:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbe040ec040 con 0x5580a45f41e0 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.829+0000 7fbe24027740 10 client.27086 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.829+0000 7fbe24027740 10 client.27086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.829+0000 7fbe24027740 20 client.27086 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.829+0000 7fbe24027740 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5580a467a400 0x5580a467c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.829+0000 7fbe24027740 4 client.27086 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:18:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.829+0000 7fbe24027740 1 -- 172.21.15.47:0/3819806566 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5580a4566c70 con 0x5580a467a400 2024-07-24T22:18:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.829+0000 7fbe1affd640 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5580a467a400 0x5580a467c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.829+0000 7fbe1affd640 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5580a467a400 0x5580a467c820 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=950019b39f30acc4 server_cookie=a936f55a0972b4c7 in_seq=0 out_seq=0 2024-07-24T22:18:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.829+0000 7fbe027fc640 10 client.27086 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe027fc640 1 -- 172.21.15.47:0/3819806566 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5580a4566c70 con 0x5580a467a400 2024-07-24T22:18:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe027fc640 10 client.27086 handle_command_reply: tid=0 2024-07-24T22:18:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe24027740 1 client.27086 shutdown 2024-07-24T22:18:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe24027740 1 -- 172.21.15.47:0/3819806566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a45f41e0 msgr2=0x5580a4605590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe24027740 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a45f41e0 0x5580a4605590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbe040e12b0 tx=0x7fbe04010cb0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe24027740 1 -- 172.21.15.47:0/3819806566 shutdown_connections 2024-07-24T22:18:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe24027740 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5580a467a400 0x5580a467c820 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe24027740 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580a4600170 0x5580a4605af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe24027740 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5580a45f41e0 0x5580a4605590 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe027fc640 0 client.27086 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe24027740 1 --2- 172.21.15.47:0/3819806566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5580a45f38c0 0x5580a4605050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe24027740 1 -- 172.21.15.47:0/3819806566 >> 172.21.15.47:0/3819806566 conn(0x5580a45f16f0 msgr2=0x5580a45fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe24027740 1 -- 172.21.15.47:0/3819806566 shutdown_connections 2024-07-24T22:18:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe24027740 1 -- 172.21.15.47:0/3819806566 wait complete. 2024-07-24T22:18:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.833+0000 7fbe24027740 20 client.27086 trim_cache size 0 max 16384 2024-07-24T22:18:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:18:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:18:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:18:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:18:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.834+0000 7fbe212cb640 1 -- 172.21.15.47:0/609470278 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbe080b3dc0 msgr2=0x7fbe080b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.834+0000 7fbe212cb640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbe080b3dc0 0x7fbe080b6280 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x5580a45f6a40 tx=0x7fbe0c009560 comp rx=0 tx=0).stop 2024-07-24T22:18:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.834+0000 7fbe212cb640 1 -- 172.21.15.47:0/609470278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe1c106fb0 msgr2=0x7fbe1c199ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.834+0000 7fbe212cb640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe1c106fb0 0x7fbe1c199ef0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400d950 tx=0x7fbe0400de10 comp rx=0 tx=0).stop 2024-07-24T22:18:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.834+0000 7fbe212cb640 1 -- 172.21.15.47:0/609470278 shutdown_connections 2024-07-24T22:18:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.834+0000 7fbe212cb640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbe080b3dc0 0x7fbe080b6280 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.834+0000 7fbe212cb640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe1c107930 0x7fbe1c1a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.834+0000 7fbe212cb640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe1c106fb0 0x7fbe1c199ef0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.834+0000 7fbe212cb640 1 --2- 172.21.15.47:0/609470278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe1c1015b0 0x7fbe1c1999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:31.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.834+0000 7fbe212cb640 1 -- 172.21.15.47:0/609470278 >> 172.21.15.47:0/609470278 conn(0x7fbe1c0fd010 msgr2=0x7fbe1c0fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:31.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.834+0000 7fbe212cb640 1 -- 172.21.15.47:0/609470278 shutdown_connections 2024-07-24T22:18:31.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:31.834+0000 7fbe212cb640 1 -- 172.21.15.47:0/609470278 wait complete. 2024-07-24T22:18:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:31 smithi183 ceph-mon[37007]: pgmap v717: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 4 op/s 2024-07-24T22:18:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:18:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:18:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:18:32.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:18:32.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:31 smithi047 ceph-mon[32551]: pgmap v717: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 4 op/s 2024-07-24T22:18:32.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:18:32.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:18:32.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:18:32.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:18:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:31 smithi188 ceph-mon[37380]: pgmap v717: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 4 op/s 2024-07-24T22:18:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:18:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:18:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:18:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:18:32.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.835+0000 7f17491c4640 1 -- 172.21.15.47:0/2914780466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f174410cb00 msgr2=0x7f174410ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:32.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.835+0000 7f17491c4640 1 --2- 172.21.15.47:0/2914780466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f174410cb00 0x7f174410ef60 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f173c009ca0 tx=0x7f173c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.835+0000 7f17491c4640 1 -- 172.21.15.47:0/2914780466 shutdown_connections 2024-07-24T22:18:32.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.835+0000 7f17491c4640 1 --2- 172.21.15.47:0/2914780466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f174410cb00 0x7f174410ef60 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.835+0000 7f17491c4640 1 --2- 172.21.15.47:0/2914780466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1744103fc0 0x7f174410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.835+0000 7f17491c4640 1 --2- 172.21.15.47:0/2914780466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17441036a0 0x7f1744103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.835+0000 7f17491c4640 1 -- 172.21.15.47:0/2914780466 >> 172.21.15.47:0/2914780466 conn(0x7f17440fd100 msgr2=0x7f17440ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:32.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.835+0000 7f17491c4640 1 -- 172.21.15.47:0/2914780466 shutdown_connections 2024-07-24T22:18:32.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.835+0000 7f17491c4640 1 -- 172.21.15.47:0/2914780466 wait complete. 2024-07-24T22:18:32.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.836+0000 7f17491c4640 1 Processor -- start 2024-07-24T22:18:32.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.836+0000 7f17491c4640 1 -- start start 2024-07-24T22:18:32.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.836+0000 7f17491c4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17441036a0 0x7f1744101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.836+0000 7f17491c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1744103fc0 0x7f1744101890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.836+0000 7f17491c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f174410cb00 0x7f1744101dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.836+0000 7f17491c4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1744112760 con 0x7f174410cb00 2024-07-24T22:18:32.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.836+0000 7f17491c4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17441125e0 con 0x7f17441036a0 2024-07-24T22:18:32.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.836+0000 7f17491c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f17441128e0 con 0x7f1744103fc0 2024-07-24T22:18:32.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f174359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f174410cb00 0x7f1744101dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f174359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f174410cb00 0x7f1744101dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35814/0 (socket says 172.21.15.47:35814) 2024-07-24T22:18:32.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f174359e640 1 -- 172.21.15.47:0/442602528 learned_addr learned my addr 172.21.15.47:0/442602528 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:32.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f1742d9d640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17441036a0 0x7f1744101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f174259c640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1744103fc0 0x7f1744101890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f174359e640 1 -- 172.21.15.47:0/442602528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1744103fc0 msgr2=0x7f1744101890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:32.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f174359e640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1744103fc0 0x7f1744101890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f174359e640 1 -- 172.21.15.47:0/442602528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17441036a0 msgr2=0x7f1744101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:32.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f174359e640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17441036a0 0x7f1744101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f174359e640 1 -- 172.21.15.47:0/442602528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17441a7070 con 0x7f174410cb00 2024-07-24T22:18:32.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f174359e640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f174410cb00 0x7f1744101dd0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f173c005cc0 tx=0x7f173c02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:32.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f172bfff640 1 -- 172.21.15.47:0/442602528 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c003cf0 con 0x7f174410cb00 2024-07-24T22:18:32.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f172bfff640 1 -- 172.21.15.47:0/442602528 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f173c0044f0 con 0x7f174410cb00 2024-07-24T22:18:32.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f17491c4640 1 -- 172.21.15.47:0/442602528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17441a7300 con 0x7f174410cb00 2024-07-24T22:18:32.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f172bfff640 1 -- 172.21.15.47:0/442602528 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c02fd10 con 0x7f174410cb00 2024-07-24T22:18:32.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.837+0000 7f17491c4640 1 -- 172.21.15.47:0/442602528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17441a7840 con 0x7f174410cb00 2024-07-24T22:18:32.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.840+0000 7f172bfff640 1 -- 172.21.15.47:0/442602528 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f173c004040 con 0x7f174410cb00 2024-07-24T22:18:32.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.840+0000 7f174b575740 1 Processor -- start 2024-07-24T22:18:32.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.840+0000 7f174b575740 1 -- start start 2024-07-24T22:18:32.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.840+0000 7f174b575740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9168ff30 0x560d91690310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.840+0000 7f174b575740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d91690850 0x560d9169c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.840+0000 7f174b575740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d9169c7e0 0x560d9169ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.840+0000 7f174b575740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560d916079f0 con 0x560d9168ff30 2024-07-24T22:18:32.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.840+0000 7f174b575740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560d915f6ef0 con 0x560d91690850 2024-07-24T22:18:32.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.840+0000 7f174b575740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x560d915faf30 con 0x560d9169c7e0 2024-07-24T22:18:32.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.840+0000 7f174259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9168ff30 0x560d91690310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.840+0000 7f174259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9168ff30 0x560d91690310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35818/0 (socket says 172.21.15.47:35818) 2024-07-24T22:18:32.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.840+0000 7f174259c640 1 -- 172.21.15.47:0/463817042 learned_addr learned my addr 172.21.15.47:0/463817042 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f1742d9d640 1 --2- 172.21.15.47:0/463817042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d91690850 0x560d9169c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f174259c640 1 --2- 172.21.15.47:0/463817042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d9169c7e0 0x560d9169ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f174259c640 1 -- 172.21.15.47:0/463817042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d9169c7e0 msgr2=0x560d9169ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f174259c640 1 --2- 172.21.15.47:0/463817042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d9169c7e0 0x560d9169ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f172bfff640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f172c0b3d40 0x7f172c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f174259c640 1 -- 172.21.15.47:0/463817042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d91690850 msgr2=0x560d9169c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f174259c640 1 --2- 172.21.15.47:0/463817042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d91690850 0x560d9169c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f174259c640 1 -- 172.21.15.47:0/463817042 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d91357930 con 0x560d9168ff30 2024-07-24T22:18:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f174359e640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f172c0b3d40 0x7f172c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f174259c640 1 --2- 172.21.15.47:0/463817042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9168ff30 0x560d91690310 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f173800bf90 tx=0x7f173800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bca953cb2f528a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f172bfff640 1 -- 172.21.15.47:0/442602528 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f173c105840 con 0x7f174410cb00 2024-07-24T22:18:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f17297fa640 1 -- 172.21.15.47:0/463817042 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1738004220 con 0x560d9168ff30 2024-07-24T22:18:32.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f17297fa640 1 -- 172.21.15.47:0/463817042 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17380043c0 con 0x560d9168ff30 2024-07-24T22:18:32.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.841+0000 7f17297fa640 1 -- 172.21.15.47:0/463817042 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1738003900 con 0x560d9168ff30 2024-07-24T22:18:32.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.842+0000 7f174b575740 1 -- 172.21.15.47:0/463817042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9168ff30 msgr2=0x560d91690310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:32.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.842+0000 7f174359e640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f172c0b3d40 0x7f172c0b6200 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f173c0cc4c0 tx=0x7f173c0989e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:32.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.842+0000 7f174b575740 1 --2- 172.21.15.47:0/463817042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9168ff30 0x560d91690310 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f173800bf90 tx=0x7f173800b460 comp rx=0 tx=0).stop 2024-07-24T22:18:32.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.842+0000 7f174b575740 1 -- 172.21.15.47:0/463817042 shutdown_connections 2024-07-24T22:18:32.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.842+0000 7f174b575740 1 --2- 172.21.15.47:0/463817042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d9169c7e0 0x560d9169ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.842+0000 7f174b575740 1 --2- 172.21.15.47:0/463817042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d91690850 0x560d9169c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.842+0000 7f174b575740 1 --2- 172.21.15.47:0/463817042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9168ff30 0x560d91690310 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.842+0000 7f174b575740 1 -- 172.21.15.47:0/463817042 >> 172.21.15.47:0/463817042 conn(0x560d9168dd60 msgr2=0x560d9168ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:32.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.842+0000 7f174b575740 1 -- 172.21.15.47:0/463817042 shutdown_connections 2024-07-24T22:18:32.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.842+0000 7f174b575740 1 -- 172.21.15.47:0/463817042 wait complete. 2024-07-24T22:18:32.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.842+0000 7f174b575740 1 -- start start 2024-07-24T22:18:32.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174b575740 1 Processor -- start 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174b575740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d9168ff30 0x560d91699720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174b575740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d91690850 0x560d91699c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174b575740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d9169a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174b575740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560d9145a890 con 0x560d9169c7e0 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174b575740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560d91599390 con 0x560d9168ff30 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174b575740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x560d9169f460 con 0x560d91690850 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174b575740 10 client.0 _ll_register_callbacks cb 0x560d915a3500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d9169a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d9169a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35822/0 (socket says 172.21.15.47:35822) 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174259c640 1 -- 172.21.15.47:0/4040453445 learned_addr learned my addr 172.21.15.47:0/4040453445 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f1742d9d640 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d91690850 0x560d91699c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174259c640 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d9168ff30 0x560d91699720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174259c640 1 -- 172.21.15.47:0/4040453445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d91690850 msgr2=0x560d91699c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:32.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174259c640 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d91690850 0x560d91699c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174259c640 1 -- 172.21.15.47:0/4040453445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d9168ff30 msgr2=0x560d91699720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174259c640 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d9168ff30 0x560d91699720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.843+0000 7f174259c640 1 -- 172.21.15.47:0/4040453445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d91593d60 con 0x560d9169c7e0 2024-07-24T22:18:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.844+0000 7f1742d9d640 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d91690850 0x560d91699c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.844+0000 7f174259c640 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d9169a1a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f1738005fc0 tx=0x7f1738012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c972efdc0c10568 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.844+0000 7f1726ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.844+0000 7f1726ff5640 1 -- 172.21.15.47:0/4040453445 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380041d0 con 0x560d9169c7e0 2024-07-24T22:18:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.844+0000 7f1726ff5640 1 -- 172.21.15.47:0/4040453445 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f1738012660 con 0x560d9169c7e0 2024-07-24T22:18:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.844+0000 7f174b575740 1 -- 172.21.15.47:0/4040453445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17380043c0 con 0x560d9169c7e0 2024-07-24T22:18:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.844+0000 7f1726ff5640 1 -- 172.21.15.47:0/4040453445 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1738034050 con 0x560d9169c7e0 2024-07-24T22:18:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.844+0000 7f174b575740 10 client.18042 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.844+0000 7f174b575740 1 -- 172.21.15.47:0/4040453445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560d916ab340 con 0x560d9169c7e0 2024-07-24T22:18:32.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.844+0000 7f1726ff5640 1 -- 172.21.15.47:0/4040453445 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17380043c0 con 0x560d9169c7e0 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.844+0000 7f1726ff5640 1 -- 172.21.15.47:0/4040453445 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1738003cd0 con 0x560d9169c7e0 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.845+0000 7f174b575740 10 client.18042 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.845+0000 7f174b575740 10 client.18042 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.845+0000 7f174b575740 20 client.18042 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.845+0000 7f174b575740 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560d916ac690 0x560d916aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.845+0000 7f174b575740 4 client.18042 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.845+0000 7f174b575740 1 -- 172.21.15.47:0/4040453445 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d91609940 con 0x560d916ac690 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.845+0000 7f1742d9d640 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560d916ac690 0x560d916aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.845+0000 7f1726ff5640 10 client.18042 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.845+0000 7f1742d9d640 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560d916ac690 0x560d916aea80 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb9e0534f85b6424 server_cookie=427f2dc6cd3119af in_seq=0 out_seq=0 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f1726ff5640 1 -- 172.21.15.47:0/4040453445 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d91609940 con 0x560d916ac690 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f1726ff5640 10 client.18042 handle_command_reply: tid=0 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f174b575740 1 client.18042 shutdown 2024-07-24T22:18:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f174b575740 1 -- 172.21.15.47:0/4040453445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 msgr2=0x560d9169a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f174b575740 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d9169a1a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f1738005fc0 tx=0x7f1738012ea0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f174b575740 1 -- 172.21.15.47:0/4040453445 shutdown_connections 2024-07-24T22:18:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f174b575740 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560d916ac690 0x560d916aea80 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f174b575740 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d9169a1a0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f174b575740 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d91690850 0x560d91699c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f1726ff5640 0 client.18042 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f174b575740 1 --2- 172.21.15.47:0/4040453445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d9168ff30 0x560d91699720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f174b575740 1 -- 172.21.15.47:0/4040453445 >> 172.21.15.47:0/4040453445 conn(0x560d9168dd60 msgr2=0x560d91693900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f174b575740 1 -- 172.21.15.47:0/4040453445 shutdown_connections 2024-07-24T22:18:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f174b575740 1 -- 172.21.15.47:0/4040453445 wait complete. 2024-07-24T22:18:32.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.846+0000 7f174b575740 20 client.18042 trim_cache size 0 max 16384 2024-07-24T22:18:32.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.865+0000 7f174b575740 1 Processor -- start 2024-07-24T22:18:32.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.866+0000 7f174b575740 1 -- start start 2024-07-24T22:18:32.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.866+0000 7f174b575740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d9168ff30 0x560d916b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.866+0000 7f174b575740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d91690850 0x560d916b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.866+0000 7f174b575740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d91696930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.866+0000 7f174b575740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f17441ae3b0 con 0x560d9169c7e0 2024-07-24T22:18:32.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.866+0000 7f174b575740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17441b0c10 con 0x560d91690850 2024-07-24T22:18:32.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.866+0000 7f174b575740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f17441aea00 con 0x560d9168ff30 2024-07-24T22:18:32.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.866+0000 7f174259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d91696930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.866+0000 7f174259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d91696930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35828/0 (socket says 172.21.15.47:35828) 2024-07-24T22:18:32.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.866+0000 7f174259c640 1 -- 172.21.15.47:0/841652885 learned_addr learned my addr 172.21.15.47:0/841652885 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:32.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.866+0000 7f1742d9d640 1 --2- 172.21.15.47:0/841652885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d91690850 0x560d916b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.866+0000 7f174259c640 1 --2- 172.21.15.47:0/841652885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d9168ff30 0x560d916b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.867+0000 7f174259c640 1 -- 172.21.15.47:0/841652885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d9168ff30 msgr2=0x560d916b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:32.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.867+0000 7f174259c640 1 --2- 172.21.15.47:0/841652885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d9168ff30 0x560d916b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.867+0000 7f174259c640 1 -- 172.21.15.47:0/841652885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d91690850 msgr2=0x560d916b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.867+0000 7f174259c640 1 --2- 172.21.15.47:0/841652885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d91690850 0x560d916b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.867+0000 7f174259c640 1 -- 172.21.15.47:0/841652885 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d91690680 con 0x560d9169c7e0 2024-07-24T22:18:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.867+0000 7f174259c640 1 --2- 172.21.15.47:0/841652885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d91696930 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f173800fc80 tx=0x7f1738005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e99af33fd47ebd server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.867+0000 7f1728ff9640 1 -- 172.21.15.47:0/841652885 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173801d780 con 0x560d9169c7e0 2024-07-24T22:18:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.867+0000 7f1728ff9640 1 -- 172.21.15.47:0/841652885 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1738004180 con 0x560d9169c7e0 2024-07-24T22:18:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.867+0000 7f1728ff9640 1 -- 172.21.15.47:0/841652885 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1738003b20 con 0x560d9169c7e0 2024-07-24T22:18:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.868+0000 7f174b575740 1 -- 172.21.15.47:0/841652885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 msgr2=0x560d91696930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.868+0000 7f174b575740 1 --2- 172.21.15.47:0/841652885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d91696930 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f173800fc80 tx=0x7f1738005c50 comp rx=0 tx=0).stop 2024-07-24T22:18:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.868+0000 7f174b575740 1 -- 172.21.15.47:0/841652885 shutdown_connections 2024-07-24T22:18:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.868+0000 7f174b575740 1 --2- 172.21.15.47:0/841652885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d91696930 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.868+0000 7f174b575740 1 --2- 172.21.15.47:0/841652885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d91690850 0x560d916b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.868+0000 7f174b575740 1 --2- 172.21.15.47:0/841652885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d9168ff30 0x560d916b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.868+0000 7f174b575740 1 -- 172.21.15.47:0/841652885 >> 172.21.15.47:0/841652885 conn(0x560d9168dd60 msgr2=0x560d91693890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.868+0000 7f174b575740 1 -- 172.21.15.47:0/841652885 shutdown_connections 2024-07-24T22:18:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.868+0000 7f174b575740 1 -- 172.21.15.47:0/841652885 wait complete. 2024-07-24T22:18:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.868+0000 7f174b575740 1 -- start start 2024-07-24T22:18:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.868+0000 7f174b575740 1 Processor -- start 2024-07-24T22:18:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174b575740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d9168ff30 0x560d916a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174b575740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d91690850 0x560d916a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174b575740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d9169f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174b575740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f17441af0d0 con 0x560d9169c7e0 2024-07-24T22:18:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174b575740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17441b0540 con 0x560d9168ff30 2024-07-24T22:18:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174b575740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f17441af7a0 con 0x560d91690850 2024-07-24T22:18:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174b575740 10 client.0 _ll_register_callbacks cb 0x7f1738004020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d9169f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d9169f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35836/0 (socket says 172.21.15.47:35836) 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174259c640 1 -- 172.21.15.47:0/1746274256 learned_addr learned my addr 172.21.15.47:0/1746274256 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f1742d9d640 1 --2- 172.21.15.47:0/1746274256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d91690850 0x560d916a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174259c640 1 -- 172.21.15.47:0/1746274256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d91690850 msgr2=0x560d916a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174259c640 1 --2- 172.21.15.47:0/1746274256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d91690850 0x560d916a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174259c640 1 -- 172.21.15.47:0/1746274256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d9168ff30 msgr2=0x560d916a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174259c640 1 --2- 172.21.15.47:0/1746274256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d9168ff30 0x560d916a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.869+0000 7f174259c640 1 -- 172.21.15.47:0/1746274256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d9169ff00 con 0x560d9169c7e0 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.870+0000 7f174259c640 1 --2- 172.21.15.47:0/1746274256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d9169f6d0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f173800fef0 tx=0x7f173800ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99df4d97bf7e58d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.870+0000 7f1726ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.870+0000 7f1726ff5640 1 -- 172.21.15.47:0/1746274256 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173801daa0 con 0x560d9169c7e0 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.870+0000 7f1726ff5640 1 -- 172.21.15.47:0/1746274256 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f173801dc40 con 0x560d9169c7e0 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.870+0000 7f174b575740 1 -- 172.21.15.47:0/1746274256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1738004180 con 0x560d9169c7e0 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.870+0000 7f1726ff5640 1 -- 172.21.15.47:0/1746274256 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f17380047c0 con 0x560d9169c7e0 2024-07-24T22:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.870+0000 7f174b575740 10 client.18048 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.870+0000 7f174b575740 1 -- 172.21.15.47:0/1746274256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560d91717de0 con 0x560d9169c7e0 2024-07-24T22:18:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.870+0000 7f1726ff5640 1 -- 172.21.15.47:0/1746274256 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1738004e10 con 0x560d9169c7e0 2024-07-24T22:18:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.870+0000 7f1726ff5640 1 -- 172.21.15.47:0/1746274256 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f17380053a0 con 0x560d9169c7e0 2024-07-24T22:18:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.870+0000 7f174b575740 10 client.18048 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.870+0000 7f174b575740 10 client.18048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.871+0000 7f174b575740 20 client.18048 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.871+0000 7f174b575740 1 --2- 172.21.15.47:0/1746274256 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560d917184a0 0x560d9171a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.871+0000 7f174b575740 4 client.18048 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:18:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.871+0000 7f174b575740 1 -- 172.21.15.47:0/1746274256 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f1738004180 con 0x560d917184a0 2024-07-24T22:18:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.871+0000 7f1742d9d640 1 --2- 172.21.15.47:0/1746274256 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560d917184a0 0x560d9171a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.871+0000 7f1742d9d640 1 --2- 172.21.15.47:0/1746274256 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560d917184a0 0x560d9171a890 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ae66c505008ee6d server_cookie=2d22d2e8ddfee3f3 in_seq=0 out_seq=0 2024-07-24T22:18:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.871+0000 7f1726ff5640 10 client.18048 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.872+0000 7f1726ff5640 1 -- 172.21.15.47:0/1746274256 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f1738004180 con 0x560d917184a0 2024-07-24T22:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.872+0000 7f1726ff5640 10 client.18048 handle_command_reply: tid=0 2024-07-24T22:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.872+0000 7f174b575740 1 client.18048 shutdown 2024-07-24T22:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.872+0000 7f174b575740 1 -- 172.21.15.47:0/1746274256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 msgr2=0x560d9169f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.872+0000 7f174b575740 1 --2- 172.21.15.47:0/1746274256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d9169f6d0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f173800fef0 tx=0x7f173800ff20 comp rx=0 tx=0).stop 2024-07-24T22:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.873+0000 7f174b575740 1 -- 172.21.15.47:0/1746274256 shutdown_connections 2024-07-24T22:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.873+0000 7f174b575740 1 --2- 172.21.15.47:0/1746274256 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x560d917184a0 0x560d9171a890 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.873+0000 7f174b575740 1 --2- 172.21.15.47:0/1746274256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560d9169c7e0 0x560d9169f6d0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.873+0000 7f174b575740 1 --2- 172.21.15.47:0/1746274256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560d91690850 0x560d916a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.873+0000 7f174b575740 1 --2- 172.21.15.47:0/1746274256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560d9168ff30 0x560d916a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.873+0000 7f174b575740 1 -- 172.21.15.47:0/1746274256 >> 172.21.15.47:0/1746274256 conn(0x560d9168dd60 msgr2=0x560d91699690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.873+0000 7f1726ff5640 0 client.18048 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.873+0000 7f174b575740 1 -- 172.21.15.47:0/1746274256 shutdown_connections 2024-07-24T22:18:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.873+0000 7f174b575740 1 -- 172.21.15.47:0/1746274256 wait complete. 2024-07-24T22:18:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.873+0000 7f174b575740 20 client.18048 trim_cache size 0 max 16384 2024-07-24T22:18:32.879 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:18:32.879 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:18:32.879 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "6803ab02-3b4f-44e7-beec-38954a3b2267", 2024-07-24T22:18:32.879 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:18:32.879 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:18:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.874+0000 7f17491c4640 1 -- 172.21.15.47:0/442602528 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f172c0b3d40 msgr2=0x7f172c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.874+0000 7f17491c4640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f172c0b3d40 0x7f172c0b6200 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f173c0cc4c0 tx=0x7f173c0989e0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.874+0000 7f17491c4640 1 -- 172.21.15.47:0/442602528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f174410cb00 msgr2=0x7f1744101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.874+0000 7f17491c4640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f174410cb00 0x7f1744101dd0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f173c005cc0 tx=0x7f173c02f470 comp rx=0 tx=0).stop 2024-07-24T22:18:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.874+0000 7f17491c4640 1 -- 172.21.15.47:0/442602528 shutdown_connections 2024-07-24T22:18:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.874+0000 7f17491c4640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f172c0b3d40 0x7f172c0b6200 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.874+0000 7f17491c4640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f174410cb00 0x7f1744101dd0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.874+0000 7f17491c4640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1744103fc0 0x7f1744101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.874+0000 7f17491c4640 1 --2- 172.21.15.47:0/442602528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17441036a0 0x7f1744101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.874+0000 7f17491c4640 1 -- 172.21.15.47:0/442602528 >> 172.21.15.47:0/442602528 conn(0x7f17440fd100 msgr2=0x7f174410ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.874+0000 7f17491c4640 1 -- 172.21.15.47:0/442602528 shutdown_connections 2024-07-24T22:18:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:32.874+0000 7f17491c4640 1 -- 172.21.15.47:0/442602528 wait complete. 2024-07-24T22:18:33.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.332+0000 7f42eaba4640 1 -- 172.21.15.47:0/2167411635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42e41081a0 msgr2=0x7f42e41085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.332+0000 7f42eaba4640 1 --2- 172.21.15.47:0/2167411635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42e41081a0 0x7f42e41085e0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009900 tx=0x7f42d002a410 comp rx=0 tx=0).stop 2024-07-24T22:18:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.332+0000 7f42eaba4640 1 -- 172.21.15.47:0/2167411635 shutdown_connections 2024-07-24T22:18:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.332+0000 7f42eaba4640 1 --2- 172.21.15.47:0/2167411635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f42e4108b20 0x7f42e410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.332+0000 7f42eaba4640 1 --2- 172.21.15.47:0/2167411635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42e41081a0 0x7f42e41085e0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.332+0000 7f42eaba4640 1 --2- 172.21.15.47:0/2167411635 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42e4102790 0x7f42e4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.332+0000 7f42eaba4640 1 -- 172.21.15.47:0/2167411635 >> 172.21.15.47:0/2167411635 conn(0x7f42e40fe200 msgr2=0x7f42e4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.332+0000 7f42eaba4640 1 -- 172.21.15.47:0/2167411635 shutdown_connections 2024-07-24T22:18:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.332+0000 7f42eaba4640 1 -- 172.21.15.47:0/2167411635 wait complete. 2024-07-24T22:18:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.333+0000 7f42eaba4640 1 Processor -- start 2024-07-24T22:18:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.333+0000 7f42eaba4640 1 -- start start 2024-07-24T22:18:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.333+0000 7f42eaba4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42e4102790 0x7f42e4198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.333+0000 7f42eaba4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42e41081a0 0x7f42e41991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.333+0000 7f42eaba4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f42e4108b20 0x7f42e419e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.333+0000 7f42eaba4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f42e41127a0 con 0x7f42e41081a0 2024-07-24T22:18:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.333+0000 7f42eaba4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f42e4112620 con 0x7f42e4102790 2024-07-24T22:18:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.333+0000 7f42eaba4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f42e4112920 con 0x7f42e4108b20 2024-07-24T22:18:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42e41081a0 0x7f42e41991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42e41081a0 0x7f42e41991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35858/0 (socket says 172.21.15.47:35858) 2024-07-24T22:18:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e3fff640 1 -- 172.21.15.47:0/1969971438 learned_addr learned my addr 172.21.15.47:0/1969971438 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e8940640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42e4102790 0x7f42e4198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e9141640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f42e4108b20 0x7f42e419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e3fff640 1 -- 172.21.15.47:0/1969971438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f42e4108b20 msgr2=0x7f42e419e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e3fff640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f42e4108b20 0x7f42e419e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e3fff640 1 -- 172.21.15.47:0/1969971438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42e4102790 msgr2=0x7f42e4198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e3fff640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42e4102790 0x7f42e4198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e3fff640 1 -- 172.21.15.47:0/1969971438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e419ed40 con 0x7f42e41081a0 2024-07-24T22:18:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e3fff640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42e41081a0 0x7f42e41991d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f42d0005940 tx=0x7f42d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e1ffb640 1 -- 172.21.15.47:0/1969971438 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d003f030 con 0x7f42e41081a0 2024-07-24T22:18:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e1ffb640 1 -- 172.21.15.47:0/1969971438 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42d0003cb0 con 0x7f42e41081a0 2024-07-24T22:18:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42eaba4640 1 -- 172.21.15.47:0/1969971438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e419efd0 con 0x7f42e41081a0 2024-07-24T22:18:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.334+0000 7f42e1ffb640 1 -- 172.21.15.47:0/1969971438 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0035070 con 0x7f42e41081a0 2024-07-24T22:18:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.335+0000 7f42eaba4640 1 -- 172.21.15.47:0/1969971438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e41a56f0 con 0x7f42e41081a0 2024-07-24T22:18:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.337+0000 7f42e1ffb640 1 -- 172.21.15.47:0/1969971438 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f42d0042030 con 0x7f42e41081a0 2024-07-24T22:18:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.337+0000 7f42ecf55740 1 Processor -- start 2024-07-24T22:18:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.337+0000 7f42ecf55740 1 -- start start 2024-07-24T22:18:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.337+0000 7f42ecf55740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 0x5649b3825220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.337+0000 7f42ecf55740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3825760 0x5649b38311b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.337+0000 7f42ecf55740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b38316f0 0x5649b3833ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.337+0000 7f42ecf55740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5649b3797dd0 con 0x5649b3824e40 2024-07-24T22:18:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.337+0000 7f42ecf55740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5649b37872d0 con 0x5649b3825760 2024-07-24T22:18:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.337+0000 7f42ecf55740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5649b378b310 con 0x5649b38316f0 2024-07-24T22:18:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e9141640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 0x5649b3825220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e9141640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 0x5649b3825220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35862/0 (socket says 172.21.15.47:35862) 2024-07-24T22:18:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e9141640 1 -- 172.21.15.47:0/526217284 learned_addr learned my addr 172.21.15.47:0/526217284 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e8940640 1 --2- 172.21.15.47:0/526217284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3825760 0x5649b38311b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e9141640 1 -- 172.21.15.47:0/526217284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b38316f0 msgr2=0x5649b3833ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e9141640 1 --2- 172.21.15.47:0/526217284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b38316f0 0x5649b3833ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e9141640 1 -- 172.21.15.47:0/526217284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3825760 msgr2=0x5649b38311b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e9141640 1 --2- 172.21.15.47:0/526217284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3825760 0x5649b38311b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e9141640 1 -- 172.21.15.47:0/526217284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649b34e7b00 con 0x5649b3824e40 2024-07-24T22:18:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e8940640 1 --2- 172.21.15.47:0/526217284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3825760 0x5649b38311b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e1ffb640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f42d40b3dc0 0x7f42d40b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e9141640 1 --2- 172.21.15.47:0/526217284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 0x5649b3825220 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00a430 tx=0x7f42dc009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9152c9b0df2640c6 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e8940640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f42d40b3dc0 0x7f42d40b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42e1ffb640 1 -- 172.21.15.47:0/1969971438 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f42d0104830 con 0x7f42e41081a0 2024-07-24T22:18:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42ceffd640 1 -- 172.21.15.47:0/526217284 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc013790 con 0x5649b3824e40 2024-07-24T22:18:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42ceffd640 1 -- 172.21.15.47:0/526217284 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42dc019070 con 0x5649b3824e40 2024-07-24T22:18:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.338+0000 7f42ceffd640 1 -- 172.21.15.47:0/526217284 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc014d00 con 0x5649b3824e40 2024-07-24T22:18:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.339+0000 7f42ecf55740 1 -- 172.21.15.47:0/526217284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 msgr2=0x5649b3825220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.339+0000 7f42ecf55740 1 --2- 172.21.15.47:0/526217284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 0x5649b3825220 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00a430 tx=0x7f42dc009650 comp rx=0 tx=0).stop 2024-07-24T22:18:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.339+0000 7f42e8940640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f42d40b3dc0 0x7f42d40b6280 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x5649b38248b0 tx=0x7f42d800b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.339+0000 7f42ecf55740 1 -- 172.21.15.47:0/526217284 shutdown_connections 2024-07-24T22:18:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.339+0000 7f42ecf55740 1 --2- 172.21.15.47:0/526217284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b38316f0 0x5649b3833ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.339+0000 7f42ecf55740 1 --2- 172.21.15.47:0/526217284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3825760 0x5649b38311b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.339+0000 7f42ecf55740 1 --2- 172.21.15.47:0/526217284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 0x5649b3825220 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.339+0000 7f42ecf55740 1 -- 172.21.15.47:0/526217284 >> 172.21.15.47:0/526217284 conn(0x5649b3822c70 msgr2=0x5649b3823e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.339+0000 7f42ecf55740 1 -- 172.21.15.47:0/526217284 shutdown_connections 2024-07-24T22:18:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.339+0000 7f42ecf55740 1 -- 172.21.15.47:0/526217284 wait complete. 2024-07-24T22:18:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.339+0000 7f42ecf55740 1 -- start start 2024-07-24T22:18:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42ecf55740 1 Processor -- start 2024-07-24T22:18:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42ecf55740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3824e40 0x5649b382e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42ecf55740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3825760 0x5649b382ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42ecf55740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b38316f0 0x5649b382f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42ecf55740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5649b35eabb0 con 0x5649b3825760 2024-07-24T22:18:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42ecf55740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5649b3729900 con 0x5649b3824e40 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42ecf55740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5649b3834370 con 0x5649b38316f0 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42ecf55740 10 client.0 _ll_register_callbacks cb 0x5649b3733c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42e3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3825760 0x5649b382ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42e3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3825760 0x5649b382ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35874/0 (socket says 172.21.15.47:35874) 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42e3fff640 1 -- 172.21.15.47:0/1027810267 learned_addr learned my addr 172.21.15.47:0/1027810267 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42e8940640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3824e40 0x5649b382e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42e9141640 1 --2- 172.21.15.47:0/1027810267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b38316f0 0x5649b382f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42e3fff640 1 -- 172.21.15.47:0/1027810267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b38316f0 msgr2=0x5649b382f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.340+0000 7f42e3fff640 1 --2- 172.21.15.47:0/1027810267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b38316f0 0x5649b382f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42e3fff640 1 -- 172.21.15.47:0/1027810267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3824e40 msgr2=0x5649b382e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42e3fff640 1 --2- 172.21.15.47:0/1027810267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3824e40 0x5649b382e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42e3fff640 1 -- 172.21.15.47:0/1027810267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649b355e960 con 0x5649b3825760 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42e3fff640 1 --2- 172.21.15.47:0/1027810267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3825760 0x5649b382ece0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f42d00cb160 tx=0x7f42d00cb2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8d090ff66ba4d7 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42c3fff640 1 -- 172.21.15.47:0/1027810267 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0049040 con 0x5649b3825760 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42c3fff640 1 -- 172.21.15.47:0/1027810267 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f42d003bbf0 con 0x5649b3825760 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42ecf55740 1 -- 172.21.15.47:0/1027810267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42dc019070 con 0x5649b3825760 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42c3fff640 1 -- 172.21.15.47:0/1027810267 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f42d0102380 con 0x5649b3825760 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42ecf55740 10 client.18060 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42ecf55740 1 -- 172.21.15.47:0/1027810267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5649b3840010 con 0x5649b3825760 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42c3fff640 1 -- 172.21.15.47:0/1027810267 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42dc019070 con 0x5649b3825760 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42c3fff640 1 -- 172.21.15.47:0/1027810267 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f42d00cb6c0 con 0x5649b3825760 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42ecf55740 10 client.18060 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.341+0000 7f42ecf55740 10 client.18060 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.342+0000 7f42ecf55740 20 client.18060 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.342+0000 7f42ecf55740 1 --2- 172.21.15.47:0/1027810267 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649b3841450 0x5649b3843840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.342+0000 7f42ecf55740 4 client.18060 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.342+0000 7f42ecf55740 1 -- 172.21.15.47:0/1027810267 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649b3799d20 con 0x5649b3841450 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.342+0000 7f42e8940640 1 --2- 172.21.15.47:0/1027810267 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649b3841450 0x5649b3843840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.342+0000 7f42e8940640 1 --2- 172.21.15.47:0/1027810267 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649b3841450 0x5649b3843840 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec7fe3e24e988bb3 server_cookie=4f9ae343c512d5e9 in_seq=0 out_seq=0 2024-07-24T22:18:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.342+0000 7f42c3fff640 10 client.18060 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42c3fff640 1 -- 172.21.15.47:0/1027810267 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649b3799d20 con 0x5649b3841450 2024-07-24T22:18:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42c3fff640 10 client.18060 handle_command_reply: tid=0 2024-07-24T22:18:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42ecf55740 1 client.18060 shutdown 2024-07-24T22:18:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42ecf55740 1 -- 172.21.15.47:0/1027810267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3825760 msgr2=0x5649b382ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42ecf55740 1 --2- 172.21.15.47:0/1027810267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3825760 0x5649b382ece0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f42d00cb160 tx=0x7f42d00cb2f0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42ecf55740 1 -- 172.21.15.47:0/1027810267 shutdown_connections 2024-07-24T22:18:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42ecf55740 1 --2- 172.21.15.47:0/1027810267 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649b3841450 0x5649b3843840 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42ecf55740 1 --2- 172.21.15.47:0/1027810267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b38316f0 0x5649b382f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42ecf55740 1 --2- 172.21.15.47:0/1027810267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3825760 0x5649b382ece0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42ecf55740 1 --2- 172.21.15.47:0/1027810267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3824e40 0x5649b382e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42ecf55740 1 -- 172.21.15.47:0/1027810267 >> 172.21.15.47:0/1027810267 conn(0x5649b3822c70 msgr2=0x5649b3828810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42c3fff640 0 client.18060 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42ecf55740 1 -- 172.21.15.47:0/1027810267 shutdown_connections 2024-07-24T22:18:33.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42ecf55740 1 -- 172.21.15.47:0/1027810267 wait complete. 2024-07-24T22:18:33.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.343+0000 7f42ecf55740 20 client.18060 trim_cache size 0 max 16384 2024-07-24T22:18:33.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.361+0000 7f42ecf55740 1 Processor -- start 2024-07-24T22:18:33.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.361+0000 7f42ecf55740 1 -- start start 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.361+0000 7f42ecf55740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b3824e40 0x5649b3828690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42ecf55740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3825760 0x5649b38490c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42ecf55740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b38316f0 0x5649b3849600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42ecf55740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f42e41aa000 con 0x5649b38316f0 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42ecf55740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f42e41ac860 con 0x5649b3825760 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42ecf55740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f42e41aa650 con 0x5649b3824e40 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42e9141640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b38316f0 0x5649b3849600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42e9141640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b38316f0 0x5649b3849600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35876/0 (socket says 172.21.15.47:35876) 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42e9141640 1 -- 172.21.15.47:0/3093852812 learned_addr learned my addr 172.21.15.47:0/3093852812 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42e8940640 1 --2- 172.21.15.47:0/3093852812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b3824e40 0x5649b3828690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42e3fff640 1 --2- 172.21.15.47:0/3093852812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3825760 0x5649b38490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42e9141640 1 -- 172.21.15.47:0/3093852812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b3824e40 msgr2=0x5649b3828690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42e9141640 1 --2- 172.21.15.47:0/3093852812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b3824e40 0x5649b3828690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42e9141640 1 -- 172.21.15.47:0/3093852812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3825760 msgr2=0x5649b38490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42e9141640 1 --2- 172.21.15.47:0/3093852812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3825760 0x5649b38490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42e9141640 1 -- 172.21.15.47:0/3093852812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649b38246c0 con 0x5649b38316f0 2024-07-24T22:18:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42e3fff640 1 --2- 172.21.15.47:0/3093852812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3825760 0x5649b38490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42e9141640 1 --2- 172.21.15.47:0/3093852812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b38316f0 0x5649b3849600 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f42dc018000 tx=0x7f42dc009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c026137108bf37 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42ce7fc640 1 -- 172.21.15.47:0/3093852812 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc014910 con 0x5649b38316f0 2024-07-24T22:18:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42ce7fc640 1 -- 172.21.15.47:0/3093852812 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42dc019040 con 0x5649b38316f0 2024-07-24T22:18:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.362+0000 7f42ce7fc640 1 -- 172.21.15.47:0/3093852812 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc013e00 con 0x5649b38316f0 2024-07-24T22:18:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.363+0000 7f42ecf55740 1 -- 172.21.15.47:0/3093852812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b38316f0 msgr2=0x5649b3849600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.363+0000 7f42ecf55740 1 --2- 172.21.15.47:0/3093852812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b38316f0 0x5649b3849600 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f42dc018000 tx=0x7f42dc009850 comp rx=0 tx=0).stop 2024-07-24T22:18:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.363+0000 7f42ecf55740 1 -- 172.21.15.47:0/3093852812 shutdown_connections 2024-07-24T22:18:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.363+0000 7f42ecf55740 1 --2- 172.21.15.47:0/3093852812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b38316f0 0x5649b3849600 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.363+0000 7f42ecf55740 1 --2- 172.21.15.47:0/3093852812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b3825760 0x5649b38490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.363+0000 7f42ecf55740 1 --2- 172.21.15.47:0/3093852812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b3824e40 0x5649b3828690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.363+0000 7f42ecf55740 1 -- 172.21.15.47:0/3093852812 >> 172.21.15.47:0/3093852812 conn(0x5649b3822c70 msgr2=0x5649b3827f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.363+0000 7f42ecf55740 1 -- 172.21.15.47:0/3093852812 shutdown_connections 2024-07-24T22:18:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.363+0000 7f42ecf55740 1 -- 172.21.15.47:0/3093852812 wait complete. 2024-07-24T22:18:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.363+0000 7f42ecf55740 1 -- start start 2024-07-24T22:18:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.363+0000 7f42ecf55740 1 Processor -- start 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42ecf55740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 0x5649b3839e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42ecf55740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b3825760 0x5649b3835330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42ecf55740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b38316f0 0x5649b3835ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42ecf55740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f42e41aad20 con 0x5649b3824e40 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42ecf55740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f42e41ac190 con 0x5649b38316f0 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42ecf55740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f42e41ab3f0 con 0x5649b3825760 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42ecf55740 10 client.0 _ll_register_callbacks cb 0x7f42d00c73f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42e8940640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 0x5649b3839e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42e8940640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 0x5649b3839e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35886/0 (socket says 172.21.15.47:35886) 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42e8940640 1 -- 172.21.15.47:0/695911241 learned_addr learned my addr 172.21.15.47:0/695911241 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42e3fff640 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b3825760 0x5649b3835330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42e9141640 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b38316f0 0x5649b3835ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42e8940640 1 -- 172.21.15.47:0/695911241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b3825760 msgr2=0x5649b3835330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42e8940640 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b3825760 0x5649b3835330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42e8940640 1 -- 172.21.15.47:0/695911241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b38316f0 msgr2=0x5649b3835ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42e8940640 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b38316f0 0x5649b3835ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42e8940640 1 -- 172.21.15.47:0/695911241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649b38ab090 con 0x5649b3824e40 2024-07-24T22:18:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.364+0000 7f42e9141640 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b38316f0 0x5649b3835ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42e8940640 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 0x5649b3839e60 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f42d80039c0 tx=0x7f42d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17364154791d7963 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42c3fff640 1 -- 172.21.15.47:0/695911241 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d802d020 con 0x5649b3824e40 2024-07-24T22:18:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42c3fff640 1 -- 172.21.15.47:0/695911241 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f42d8028420 con 0x5649b3824e40 2024-07-24T22:18:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42ecf55740 1 -- 172.21.15.47:0/695911241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42dc019040 con 0x5649b3824e40 2024-07-24T22:18:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42c3fff640 1 -- 172.21.15.47:0/695911241 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f42d8028620 con 0x5649b3824e40 2024-07-24T22:18:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42ecf55740 10 client.18066 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42ecf55740 1 -- 172.21.15.47:0/695911241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5649b38ac2c0 con 0x5649b3824e40 2024-07-24T22:18:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42c3fff640 1 -- 172.21.15.47:0/695911241 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42dc019040 con 0x5649b3824e40 2024-07-24T22:18:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42c3fff640 1 -- 172.21.15.47:0/695911241 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f42d8019040 con 0x5649b3824e40 2024-07-24T22:18:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42ecf55740 10 client.18066 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42ecf55740 10 client.18066 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:18:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42ecf55740 20 client.18066 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42ecf55740 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649b38aca10 0x5649b38aee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42ecf55740 4 client.18066 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4204a3b9", "release": true, "await": true}] 2024-07-24T22:18:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.365+0000 7f42ecf55740 1 -- 172.21.15.47:0/695911241 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4204a3b9", "release": true, "await": true}) -- 0x5649b37957c0 con 0x5649b38aca10 2024-07-24T22:18:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.366+0000 7f42e3fff640 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649b38aca10 0x5649b38aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.366+0000 7f42e3fff640 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649b38aca10 0x5649b38aee30 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5394c99d4c2f7e1 server_cookie=fe2e13b30d6a6340 in_seq=0 out_seq=0 2024-07-24T22:18:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.366+0000 7f42c3fff640 10 client.18066 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:33.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42c3fff640 1 -- 172.21.15.47:0/695911241 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5649b37957c0 con 0x5649b38aca10 2024-07-24T22:18:33.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42c3fff640 10 client.18066 handle_command_reply: tid=0 2024-07-24T22:18:33.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42ecf55740 1 client.18066 shutdown 2024-07-24T22:18:33.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42ecf55740 1 -- 172.21.15.47:0/695911241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 msgr2=0x5649b3839e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42ecf55740 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 0x5649b3839e60 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f42d80039c0 tx=0x7f42d80046c0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42ecf55740 1 -- 172.21.15.47:0/695911241 shutdown_connections 2024-07-24T22:18:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42ecf55740 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5649b38aca10 0x5649b38aee30 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42ecf55740 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5649b38316f0 0x5649b3835ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42ecf55740 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5649b3825760 0x5649b3835330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42c3fff640 0 client.18066 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42ecf55740 1 --2- 172.21.15.47:0/695911241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5649b3824e40 0x5649b3839e60 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42ecf55740 1 -- 172.21.15.47:0/695911241 >> 172.21.15.47:0/695911241 conn(0x5649b3822c70 msgr2=0x5649b38305f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42ecf55740 1 -- 172.21.15.47:0/695911241 shutdown_connections 2024-07-24T22:18:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42ecf55740 1 -- 172.21.15.47:0/695911241 wait complete. 2024-07-24T22:18:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.370+0000 7f42ecf55740 20 client.18066 trim_cache size 0 max 16384 2024-07-24T22:18:33.375 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:18:33.375 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:18:33.375 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:18:33.375 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 36, 2024-07-24T22:18:33.375 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-07-24T22:18:33.375 INFO:teuthology.orchestra.run.smithi047.stdout: "4204a3b9": { 2024-07-24T22:18:33.375 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 36, 2024-07-24T22:18:33.375 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-07-24T22:18:33.375 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:18:33.375 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:18:33.376 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:18:33.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:18:33.376 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 90.0, 2024-07-24T22:18:33.376 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 147.5, 2024-07-24T22:18:33.376 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-07-24T22:18:33.376 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-07-24T22:18:33.376 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-07-24T22:18:33.376 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-07-24T22:18:33.376 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-07-24T22:18:33.376 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-07-24T22:18:33.376 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:18:33.376 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:18:33.376 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:18:33.377 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:18:33.377 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:18:33.377 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:18:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.371+0000 7f42eaba4640 1 -- 172.21.15.47:0/1969971438 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f42d40b3dc0 msgr2=0x7f42d40b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.371+0000 7f42eaba4640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f42d40b3dc0 0x7f42d40b6280 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x5649b38248b0 tx=0x7f42d800b390 comp rx=0 tx=0).stop 2024-07-24T22:18:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.371+0000 7f42eaba4640 1 -- 172.21.15.47:0/1969971438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42e41081a0 msgr2=0x7f42e41991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.371+0000 7f42eaba4640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42e41081a0 0x7f42e41991d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f42d0005940 tx=0x7f42d00042f0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.371+0000 7f42eaba4640 1 -- 172.21.15.47:0/1969971438 shutdown_connections 2024-07-24T22:18:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.371+0000 7f42eaba4640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f42d40b3dc0 0x7f42d40b6280 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.371+0000 7f42eaba4640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f42e4108b20 0x7f42e419e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.371+0000 7f42eaba4640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42e41081a0 0x7f42e41991d0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.371+0000 7f42eaba4640 1 --2- 172.21.15.47:0/1969971438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42e4102790 0x7f42e4198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.371+0000 7f42eaba4640 1 -- 172.21.15.47:0/1969971438 >> 172.21.15.47:0/1969971438 conn(0x7f42e40fe200 msgr2=0x7f42e41005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.371+0000 7f42eaba4640 1 -- 172.21.15.47:0/1969971438 shutdown_connections 2024-07-24T22:18:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:33.371+0000 7f42eaba4640 1 -- 172.21.15.47:0/1969971438 wait complete. 2024-07-24T22:18:33.999 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:33 smithi047 ceph-mon[32551]: pgmap v718: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 102 B/s wr, 3 op/s 2024-07-24T22:18:34.000 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:33 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:18:34.000 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:33 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:34.000 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:33 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:18:34.000 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:33 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:34.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:33 smithi183 ceph-mon[37007]: pgmap v718: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 102 B/s wr, 3 op/s 2024-07-24T22:18:34.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:33 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:18:34.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:33 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:34.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:33 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:18:34.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:33 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:34.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:33 smithi188 ceph-mon[37380]: pgmap v718: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 102 B/s wr, 3 op/s 2024-07-24T22:18:34.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:33 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:18:34.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:33 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:34.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:33 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:18:34.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:33 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:34.353 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:18:34.790 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4204a3b9', total seconds elapsed: 34.8 2024-07-24T22:18:34.861 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:35.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:35 smithi047 ceph-mon[32551]: pgmap v719: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 102 B/s wr, 3 op/s 2024-07-24T22:18:35.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:35 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:18:36.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:35 smithi183 ceph-mon[37007]: pgmap v719: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 102 B/s wr, 3 op/s 2024-07-24T22:18:36.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:35 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:18:36.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:35 smithi188 ceph-mon[37380]: pgmap v719: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 102 B/s wr, 3 op/s 2024-07-24T22:18:36.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:35 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:18:36.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.564+0000 7fc9ce8ba640 1 -- 172.21.15.47:0/649287242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c81081a0 msgr2=0x7fc9c81085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:36.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.564+0000 7fc9ce8ba640 1 --2- 172.21.15.47:0/649287242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c81081a0 0x7fc9c81085e0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009860 tx=0x7fc9bc02a340 comp rx=0 tx=0).stop 2024-07-24T22:18:36.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.564+0000 7fc9ce8ba640 1 -- 172.21.15.47:0/649287242 shutdown_connections 2024-07-24T22:18:36.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.564+0000 7fc9ce8ba640 1 --2- 172.21.15.47:0/649287242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9c8108b20 0x7fc9c810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.564+0000 7fc9ce8ba640 1 --2- 172.21.15.47:0/649287242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c81081a0 0x7fc9c81085e0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.564+0000 7fc9ce8ba640 1 --2- 172.21.15.47:0/649287242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9c8102790 0x7fc9c8102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.564+0000 7fc9ce8ba640 1 -- 172.21.15.47:0/649287242 >> 172.21.15.47:0/649287242 conn(0x7fc9c80fe200 msgr2=0x7fc9c8100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:36.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.564+0000 7fc9ce8ba640 1 -- 172.21.15.47:0/649287242 shutdown_connections 2024-07-24T22:18:36.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.564+0000 7fc9ce8ba640 1 -- 172.21.15.47:0/649287242 wait complete. 2024-07-24T22:18:36.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.565+0000 7fc9ce8ba640 1 Processor -- start 2024-07-24T22:18:36.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.565+0000 7fc9ce8ba640 1 -- start start 2024-07-24T22:18:36.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.565+0000 7fc9ce8ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9c8102790 0x7fc9c8198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.565+0000 7fc9ce8ba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c81081a0 0x7fc9c81991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.565+0000 7fc9ce8ba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9c8108b20 0x7fc9c819e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.565+0000 7fc9ce8ba640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c8112730 con 0x7fc9c81081a0 2024-07-24T22:18:36.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.565+0000 7fc9ce8ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c81125b0 con 0x7fc9c8102790 2024-07-24T22:18:36.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.565+0000 7fc9ce8ba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c81128b0 con 0x7fc9c8108b20 2024-07-24T22:18:36.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9c77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c81081a0 0x7fc9c81991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9c77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c81081a0 0x7fc9c81991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37680/0 (socket says 172.21.15.47:37680) 2024-07-24T22:18:36.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9c77fe640 1 -- 172.21.15.47:0/2003450186 learned_addr learned my addr 172.21.15.47:0/2003450186 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:36.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9cce57640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9c8108b20 0x7fc9c819e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9c8102790 0x7fc9c8198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9c77fe640 1 -- 172.21.15.47:0/2003450186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9c8108b20 msgr2=0x7fc9c819e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:36.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9c77fe640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9c8108b20 0x7fc9c819e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9c77fe640 1 -- 172.21.15.47:0/2003450186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9c8102790 msgr2=0x7fc9c8198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:36.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9c77fe640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9c8102790 0x7fc9c8198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9c77fe640 1 -- 172.21.15.47:0/2003450186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c819ed10 con 0x7fc9c81081a0 2024-07-24T22:18:36.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9c77fe640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c81081a0 0x7fc9c81991a0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0303f0 tx=0x7fc9bc032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:36.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9c57fa640 1 -- 172.21.15.47:0/2003450186 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc040020 con 0x7fc9c81081a0 2024-07-24T22:18:36.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9ce8ba640 1 -- 172.21.15.47:0/2003450186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c819efa0 con 0x7fc9c81081a0 2024-07-24T22:18:36.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.566+0000 7fc9c57fa640 1 -- 172.21.15.47:0/2003450186 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9bc030dd0 con 0x7fc9c81081a0 2024-07-24T22:18:36.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.567+0000 7fc9c57fa640 1 -- 172.21.15.47:0/2003450186 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc037040 con 0x7fc9c81081a0 2024-07-24T22:18:36.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.567+0000 7fc9ce8ba640 1 -- 172.21.15.47:0/2003450186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c81a56c0 con 0x7fc9c81081a0 2024-07-24T22:18:36.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.569+0000 7fc9d0c6b740 1 Processor -- start 2024-07-24T22:18:36.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.569+0000 7fc9c57fa640 1 -- 172.21.15.47:0/2003450186 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fc9bc043020 con 0x7fc9c81081a0 2024-07-24T22:18:36.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.569+0000 7fc9d0c6b740 1 -- start start 2024-07-24T22:18:36.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.569+0000 7fc9d0c6b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 0x56479e872a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.569+0000 7fc9d0c6b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e872fd0 0x56479e87ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.569+0000 7fc9d0c6b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e87ef60 0x56479e881350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.569+0000 7fc9d0c6b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56479e7e9990 con 0x56479e8726b0 2024-07-24T22:18:36.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.569+0000 7fc9d0c6b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56479e7d8e90 con 0x56479e87ef60 2024-07-24T22:18:36.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.569+0000 7fc9d0c6b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56479e7dced0 con 0x56479e872fd0 2024-07-24T22:18:36.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.569+0000 7fc9cce57640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 0x56479e872a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.569+0000 7fc9cce57640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 0x56479e872a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37694/0 (socket says 172.21.15.47:37694) 2024-07-24T22:18:36.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.569+0000 7fc9cce57640 1 -- 172.21.15.47:0/2467532100 learned_addr learned my addr 172.21.15.47:0/2467532100 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:36.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/2467532100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e872fd0 0x56479e87ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9c77fe640 1 --2- 172.21.15.47:0/2467532100 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e87ef60 0x56479e881350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9cce57640 1 -- 172.21.15.47:0/2467532100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e872fd0 msgr2=0x56479e87ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:36.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9cce57640 1 --2- 172.21.15.47:0/2467532100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e872fd0 0x56479e87ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9cce57640 1 -- 172.21.15.47:0/2467532100 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e87ef60 msgr2=0x56479e881350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:36.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9cce57640 1 --2- 172.21.15.47:0/2467532100 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e87ef60 0x56479e881350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9cce57640 1 -- 172.21.15.47:0/2467532100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56479e762300 con 0x56479e8726b0 2024-07-24T22:18:36.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9c57fa640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc9b00b3d40 0x7fc9b00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9cce57640 1 --2- 172.21.15.47:0/2467532100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 0x56479e872a90 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000e450 tx=0x7fc9c00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b7ecce195b9d5e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:36.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc9b00b3d40 0x7fc9b00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9c57fa640 1 -- 172.21.15.47:0/2003450186 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fc9bc103ec0 con 0x7fc9c81081a0 2024-07-24T22:18:36.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9ae7fc640 1 -- 172.21.15.47:0/2467532100 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000d910 con 0x56479e8726b0 2024-07-24T22:18:36.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9ae7fc640 1 -- 172.21.15.47:0/2467532100 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9c001c070 con 0x56479e8726b0 2024-07-24T22:18:36.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.570+0000 7fc9ae7fc640 1 -- 172.21.15.47:0/2467532100 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0017e10 con 0x56479e8726b0 2024-07-24T22:18:36.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.571+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/2467532100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 msgr2=0x56479e872a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:36.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.571+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc9b00b3d40 0x7fc9b00b6200 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x56479e8713c0 tx=0x7fc9b8005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:36.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.571+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/2467532100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 0x56479e872a90 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000e450 tx=0x7fc9c00095c0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.571+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/2467532100 shutdown_connections 2024-07-24T22:18:36.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.571+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/2467532100 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e87ef60 0x56479e881350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.571+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/2467532100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e872fd0 0x56479e87ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.571+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/2467532100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 0x56479e872a90 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.571+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/2467532100 >> 172.21.15.47:0/2467532100 conn(0x56479e8704e0 msgr2=0x56479e871680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:36.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.571+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/2467532100 shutdown_connections 2024-07-24T22:18:36.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.571+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/2467532100 wait complete. 2024-07-24T22:18:36.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9d0c6b740 1 -- start start 2024-07-24T22:18:36.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9d0c6b740 1 Processor -- start 2024-07-24T22:18:36.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9d0c6b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e8726b0 0x56479e87bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9d0c6b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e872fd0 0x56479e87c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9d0c6b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e87ef60 0x56479e87c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9d0c6b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56479e63c700 con 0x56479e872fd0 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9d0c6b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56479e77b5d0 con 0x56479e8726b0 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9d0c6b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56479e881be0 con 0x56479e87ef60 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9d0c6b740 10 client.0 _ll_register_callbacks cb 0x56479e79b940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9c77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e872fd0 0x56479e87c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9c77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e872fd0 0x56479e87c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37702/0 (socket says 172.21.15.47:37702) 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9c77fe640 1 -- 172.21.15.47:0/242680943 learned_addr learned my addr 172.21.15.47:0/242680943 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e8726b0 0x56479e87bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.572+0000 7fc9cce57640 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e87ef60 0x56479e87c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9c77fe640 1 -- 172.21.15.47:0/242680943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e87ef60 msgr2=0x56479e87c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9c77fe640 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e87ef60 0x56479e87c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9c77fe640 1 -- 172.21.15.47:0/242680943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e8726b0 msgr2=0x56479e87bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:36.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9c77fe640 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e8726b0 0x56479e87bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9c77fe640 1 -- 172.21.15.47:0/242680943 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56479e76e660 con 0x56479e872fd0 2024-07-24T22:18:36.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9cce57640 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e87ef60 0x56479e87c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:36.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9c77fe640 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e872fd0 0x56479e87c430 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0cab40 tx=0x7fc9bc030740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4e60c9a030cd0f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:36.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:36.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9a77fe640 1 -- 172.21.15.47:0/242680943 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc0ca980 con 0x56479e872fd0 2024-07-24T22:18:36.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9a77fe640 1 -- 172.21.15.47:0/242680943 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fc9bc0d37d0 con 0x56479e872fd0 2024-07-24T22:18:36.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/242680943 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9c001c070 con 0x56479e872fd0 2024-07-24T22:18:36.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9a77fe640 1 -- 172.21.15.47:0/242680943 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc9bc0ca320 con 0x56479e872fd0 2024-07-24T22:18:36.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9d0c6b740 10 client.18078 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:36.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/242680943 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56479e539650 con 0x56479e872fd0 2024-07-24T22:18:36.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9a77fe640 1 -- 172.21.15.47:0/242680943 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9c001c070 con 0x56479e872fd0 2024-07-24T22:18:36.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.573+0000 7fc9a77fe640 1 -- 172.21.15.47:0/242680943 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc9bc0c6520 con 0x56479e872fd0 2024-07-24T22:18:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.574+0000 7fc9d0c6b740 10 client.18078 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.574+0000 7fc9d0c6b740 10 client.18078 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.574+0000 7fc9d0c6b740 20 client.18078 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.574+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56479e88ea50 0x56479e890e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.574+0000 7fc9d0c6b740 4 client.18078 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.574+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/242680943 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56479e7eb8e0 con 0x56479e88ea50 2024-07-24T22:18:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.574+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56479e88ea50 0x56479e890e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.574+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56479e88ea50 0x56479e890e40 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59964c2b4e6da991 server_cookie=e39d4fb34b455e5a in_seq=0 out_seq=0 2024-07-24T22:18:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.574+0000 7fc9a77fe640 10 client.18078 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.575+0000 7fc9a77fe640 1 -- 172.21.15.47:0/242680943 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56479e7eb8e0 con 0x56479e88ea50 2024-07-24T22:18:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.575+0000 7fc9a77fe640 10 client.18078 handle_command_reply: tid=0 2024-07-24T22:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.575+0000 7fc9d0c6b740 1 client.18078 shutdown 2024-07-24T22:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.575+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/242680943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e872fd0 msgr2=0x56479e87c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.575+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e872fd0 0x56479e87c430 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0cab40 tx=0x7fc9bc030740 comp rx=0 tx=0).stop 2024-07-24T22:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.576+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/242680943 shutdown_connections 2024-07-24T22:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.576+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56479e88ea50 0x56479e890e40 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.576+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e87ef60 0x56479e87c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.576+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e872fd0 0x56479e87c430 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.576+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/242680943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e8726b0 0x56479e87bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.576+0000 7fc9a77fe640 0 client.18078 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.576+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/242680943 >> 172.21.15.47:0/242680943 conn(0x56479e8704e0 msgr2=0x56479e876080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.576+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/242680943 shutdown_connections 2024-07-24T22:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.576+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/242680943 wait complete. 2024-07-24T22:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.576+0000 7fc9d0c6b740 20 client.18078 trim_cache size 0 max 16384 2024-07-24T22:18:36.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.595+0000 7fc9d0c6b740 1 Processor -- start 2024-07-24T22:18:36.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.595+0000 7fc9d0c6b740 1 -- start start 2024-07-24T22:18:36.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.595+0000 7fc9d0c6b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e8726b0 0x56479e86f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.595+0000 7fc9d0c6b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e872fd0 0x56479e896710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.595+0000 7fc9d0c6b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e87ef60 0x56479e896c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.595+0000 7fc9d0c6b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c81ac1f0 con 0x56479e87ef60 2024-07-24T22:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.595+0000 7fc9d0c6b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c81aea50 con 0x56479e872fd0 2024-07-24T22:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.595+0000 7fc9d0c6b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c81ac840 con 0x56479e8726b0 2024-07-24T22:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.595+0000 7fc9cce57640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e87ef60 0x56479e896c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.595+0000 7fc9cce57640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e87ef60 0x56479e896c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37718/0 (socket says 172.21.15.47:37718) 2024-07-24T22:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.595+0000 7fc9cce57640 1 -- 172.21.15.47:0/2677950202 learned_addr learned my addr 172.21.15.47:0/2677950202 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.595+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/2677950202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e8726b0 0x56479e86f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.595+0000 7fc9c77fe640 1 --2- 172.21.15.47:0/2677950202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e872fd0 0x56479e896710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.596+0000 7fc9c7fff640 1 -- 172.21.15.47:0/2677950202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e872fd0 msgr2=0x56479e896710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.596+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/2677950202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e872fd0 0x56479e896710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.596+0000 7fc9c7fff640 1 -- 172.21.15.47:0/2677950202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e87ef60 msgr2=0x56479e896c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.596+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/2677950202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e87ef60 0x56479e896c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.596+0000 7fc9c7fff640 1 -- 172.21.15.47:0/2677950202 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56479e87a3f0 con 0x56479e8726b0 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.596+0000 7fc9cce57640 1 --2- 172.21.15.47:0/2677950202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e87ef60 0x56479e896c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.596+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/2677950202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e8726b0 0x56479e86f440 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x56479e87d010 tx=0x7fc9b801b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1651f7b5e5741528 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.596+0000 7fc9adffb640 1 -- 172.21.15.47:0/2677950202 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8005020 con 0x56479e8726b0 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.596+0000 7fc9adffb640 1 -- 172.21.15.47:0/2677950202 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9b80047a0 con 0x56479e8726b0 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.596+0000 7fc9adffb640 1 -- 172.21.15.47:0/2677950202 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b802b620 con 0x56479e8726b0 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.597+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/2677950202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e8726b0 msgr2=0x56479e86f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.597+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/2677950202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e8726b0 0x56479e86f440 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x56479e87d010 tx=0x7fc9b801b000 comp rx=0 tx=0).stop 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.597+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/2677950202 shutdown_connections 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.597+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/2677950202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e87ef60 0x56479e896c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.597+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/2677950202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e872fd0 0x56479e896710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.597+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/2677950202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e8726b0 0x56479e86f440 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.597+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/2677950202 >> 172.21.15.47:0/2677950202 conn(0x56479e8704e0 msgr2=0x56479e86ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.597+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/2677950202 shutdown_connections 2024-07-24T22:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.597+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/2677950202 wait complete. 2024-07-24T22:18:36.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.597+0000 7fc9d0c6b740 1 -- start start 2024-07-24T22:18:36.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.598+0000 7fc9d0c6b740 1 Processor -- start 2024-07-24T22:18:36.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.598+0000 7fc9d0c6b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 0x56479e882cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.598+0000 7fc9d0c6b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e872fd0 0x56479e883200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.598+0000 7fc9d0c6b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e87ef60 0x56479e883740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.598+0000 7fc9d0c6b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c81acf10 con 0x56479e8726b0 2024-07-24T22:18:36.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.598+0000 7fc9d0c6b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c81ae380 con 0x56479e872fd0 2024-07-24T22:18:36.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.598+0000 7fc9d0c6b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c81ad5e0 con 0x56479e87ef60 2024-07-24T22:18:36.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.598+0000 7fc9d0c6b740 10 client.0 _ll_register_callbacks cb 0x7fc9bc005f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:36.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.598+0000 7fc9c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 0x56479e882cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.598+0000 7fc9c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 0x56479e882cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37730/0 (socket says 172.21.15.47:37730) 2024-07-24T22:18:36.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.598+0000 7fc9c7fff640 1 -- 172.21.15.47:0/1869136443 learned_addr learned my addr 172.21.15.47:0/1869136443 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:36.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.598+0000 7fc9cce57640 1 --2- 172.21.15.47:0/1869136443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e87ef60 0x56479e883740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.598+0000 7fc9c77fe640 1 --2- 172.21.15.47:0/1869136443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e872fd0 0x56479e883200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.599+0000 7fc9c7fff640 1 -- 172.21.15.47:0/1869136443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e87ef60 msgr2=0x56479e883740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:36.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.599+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/1869136443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e87ef60 0x56479e883740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.599+0000 7fc9c7fff640 1 -- 172.21.15.47:0/1869136443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e872fd0 msgr2=0x56479e883200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:36.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.599+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/1869136443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e872fd0 0x56479e883200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.599+0000 7fc9c7fff640 1 -- 172.21.15.47:0/1869136443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56479e8f8730 con 0x56479e8726b0 2024-07-24T22:18:36.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.599+0000 7fc9c7fff640 1 --2- 172.21.15.47:0/1869136443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 0x56479e882cc0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009e10 tx=0x7fc9b8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86250fbdbdc6da6b server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:36.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.599+0000 7fc9a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:36.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.599+0000 7fc9a77fe640 1 -- 172.21.15.47:0/1869136443 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8004b50 con 0x56479e8726b0 2024-07-24T22:18:36.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.599+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/1869136443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9b80047a0 con 0x56479e8726b0 2024-07-24T22:18:36.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.599+0000 7fc9a77fe640 1 -- 172.21.15.47:0/1869136443 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fc9b8004cf0 con 0x56479e8726b0 2024-07-24T22:18:36.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.599+0000 7fc9a77fe640 1 -- 172.21.15.47:0/1869136443 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc9b8005000 con 0x56479e8726b0 2024-07-24T22:18:36.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.599+0000 7fc9d0c6b740 10 client.18084 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:36.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.599+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/1869136443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56479e8f9a40 con 0x56479e8726b0 2024-07-24T22:18:36.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.600+0000 7fc9a77fe640 1 -- 172.21.15.47:0/1869136443 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9b80047a0 con 0x56479e8726b0 2024-07-24T22:18:36.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.600+0000 7fc9a77fe640 1 -- 172.21.15.47:0/1869136443 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc9b8047070 con 0x56479e8726b0 2024-07-24T22:18:36.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.600+0000 7fc9d0c6b740 10 client.18084 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:36.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.600+0000 7fc9d0c6b740 10 client.18084 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:36.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.600+0000 7fc9d0c6b740 20 client.18084 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:36.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.600+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/1869136443 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56479e8fa100 0x56479e8fc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:36.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.600+0000 7fc9d0c6b740 4 client.18084 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:18:36.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.600+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/1869136443 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56479e7e7380 con 0x56479e8fa100 2024-07-24T22:18:36.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.600+0000 7fc9c77fe640 1 --2- 172.21.15.47:0/1869136443 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56479e8fa100 0x56479e8fc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:36.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.600+0000 7fc9c77fe640 1 --2- 172.21.15.47:0/1869136443 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56479e8fa100 0x56479e8fc520 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecf23630efc28259 server_cookie=773da15f01695a8 in_seq=0 out_seq=0 2024-07-24T22:18:36.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.600+0000 7fc9a77fe640 10 client.18084 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:36.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9a77fe640 1 -- 172.21.15.47:0/1869136443 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56479e7e7380 con 0x56479e8fa100 2024-07-24T22:18:36.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9a77fe640 10 client.18084 handle_command_reply: tid=0 2024-07-24T22:18:36.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9d0c6b740 1 client.18084 shutdown 2024-07-24T22:18:36.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/1869136443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 msgr2=0x56479e882cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:36.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/1869136443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 0x56479e882cc0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009e10 tx=0x7fc9b8004290 comp rx=0 tx=0).stop 2024-07-24T22:18:36.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/1869136443 shutdown_connections 2024-07-24T22:18:36.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/1869136443 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56479e8fa100 0x56479e8fc520 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/1869136443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56479e87ef60 0x56479e883740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/1869136443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56479e872fd0 0x56479e883200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9d0c6b740 1 --2- 172.21.15.47:0/1869136443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479e8726b0 0x56479e882cc0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/1869136443 >> 172.21.15.47:0/1869136443 conn(0x56479e8704e0 msgr2=0x56479e876010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:36.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9a77fe640 0 client.18084 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:36.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/1869136443 shutdown_connections 2024-07-24T22:18:36.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9d0c6b740 1 -- 172.21.15.47:0/1869136443 wait complete. 2024-07-24T22:18:36.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.601+0000 7fc9d0c6b740 20 client.18084 trim_cache size 0 max 16384 2024-07-24T22:18:36.613 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:18:36.614 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:18:36.614 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:18:36.614 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:18:36.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.602+0000 7fc9ce8ba640 1 -- 172.21.15.47:0/2003450186 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc9b00b3d40 msgr2=0x7fc9b00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:36.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.602+0000 7fc9ce8ba640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc9b00b3d40 0x7fc9b00b6200 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x56479e8713c0 tx=0x7fc9b8005f90 comp rx=0 tx=0).stop 2024-07-24T22:18:36.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.602+0000 7fc9ce8ba640 1 -- 172.21.15.47:0/2003450186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c81081a0 msgr2=0x7fc9c81991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:36.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.602+0000 7fc9ce8ba640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c81081a0 0x7fc9c81991a0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0303f0 tx=0x7fc9bc032da0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.602+0000 7fc9ce8ba640 1 -- 172.21.15.47:0/2003450186 shutdown_connections 2024-07-24T22:18:36.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.602+0000 7fc9ce8ba640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fc9b00b3d40 0x7fc9b00b6200 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.602+0000 7fc9ce8ba640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9c8108b20 0x7fc9c819e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.602+0000 7fc9ce8ba640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c81081a0 0x7fc9c81991a0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.602+0000 7fc9ce8ba640 1 --2- 172.21.15.47:0/2003450186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9c8102790 0x7fc9c8198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:36.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.602+0000 7fc9ce8ba640 1 -- 172.21.15.47:0/2003450186 >> 172.21.15.47:0/2003450186 conn(0x7fc9c80fe200 msgr2=0x7fc9c81005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:36.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.602+0000 7fc9ce8ba640 1 -- 172.21.15.47:0/2003450186 shutdown_connections 2024-07-24T22:18:36.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:36.602+0000 7fc9ce8ba640 1 -- 172.21.15.47:0/2003450186 wait complete. 2024-07-24T22:18:37.268 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:18:37.268 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:18:37.541 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:37.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:37 smithi047 ceph-mon[32551]: pgmap v720: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 4 op/s 2024-07-24T22:18:38.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:37 smithi183 ceph-mon[37007]: pgmap v720: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 4 op/s 2024-07-24T22:18:38.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:37 smithi188 ceph-mon[37380]: pgmap v720: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 4 op/s 2024-07-24T22:18:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.354+0000 7fbbb77d3640 1 -- 172.21.15.47:0/3006121661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb01070a0 msgr2=0x7fbbb01074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.354+0000 7fbbb77d3640 1 --2- 172.21.15.47:0/3006121661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb01070a0 0x7fbbb01074e0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009900 tx=0x7fbba002a410 comp rx=0 tx=0).stop 2024-07-24T22:18:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.354+0000 7fbbb77d3640 1 -- 172.21.15.47:0/3006121661 shutdown_connections 2024-07-24T22:18:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.354+0000 7fbbb77d3640 1 --2- 172.21.15.47:0/3006121661 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbb0107a20 0x7fbbb010e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.354+0000 7fbbb77d3640 1 --2- 172.21.15.47:0/3006121661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb01070a0 0x7fbbb01074e0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.354+0000 7fbbb77d3640 1 --2- 172.21.15.47:0/3006121661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbb0101690 0x7fbbb0101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:39.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.354+0000 7fbbb77d3640 1 -- 172.21.15.47:0/3006121661 >> 172.21.15.47:0/3006121661 conn(0x7fbbb00fd100 msgr2=0x7fbbb00ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:39.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.354+0000 7fbbb77d3640 1 -- 172.21.15.47:0/3006121661 shutdown_connections 2024-07-24T22:18:39.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.354+0000 7fbbb77d3640 1 -- 172.21.15.47:0/3006121661 wait complete. 2024-07-24T22:18:39.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.354+0000 7fbbb77d3640 1 Processor -- start 2024-07-24T22:18:39.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.354+0000 7fbbb77d3640 1 -- start start 2024-07-24T22:18:39.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb77d3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbb0101690 0x7fbbb00fd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:39.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb77d3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbb01070a0 0x7fbbb00fdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:39.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb77d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb0107a20 0x7fbbb00fe080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:39.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb77d3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb0111650 con 0x7fbbb0107a20 2024-07-24T22:18:39.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb77d3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb01114d0 con 0x7fbbb0101690 2024-07-24T22:18:39.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb77d3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb01117d0 con 0x7fbbb01070a0 2024-07-24T22:18:39.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb5d70640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb0107a20 0x7fbbb00fe080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:39.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb5d70640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb0107a20 0x7fbbb00fe080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37746/0 (socket says 172.21.15.47:37746) 2024-07-24T22:18:39.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb5d70640 1 -- 172.21.15.47:0/704759274 learned_addr learned my addr 172.21.15.47:0/704759274 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:39.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb556f640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbb0101690 0x7fbbb00fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:39.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb4d6e640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbb01070a0 0x7fbbb00fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:39.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb5d70640 1 -- 172.21.15.47:0/704759274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbb01070a0 msgr2=0x7fbbb00fdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:39.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb5d70640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbb01070a0 0x7fbbb00fdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:39.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb5d70640 1 -- 172.21.15.47:0/704759274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbb0101690 msgr2=0x7fbbb00fd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:39.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb5d70640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbb0101690 0x7fbbb00fd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:39.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb5d70640 1 -- 172.21.15.47:0/704759274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb01a70e0 con 0x7fbbb0107a20 2024-07-24T22:18:39.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.355+0000 7fbbb5d70640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb0107a20 0x7fbbb00fe080 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fbba800eaa0 tx=0x7fbba800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:39.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.356+0000 7fbba67fc640 1 -- 172.21.15.47:0/704759274 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba8004d20 con 0x7fbbb0107a20 2024-07-24T22:18:39.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.356+0000 7fbbb77d3640 1 -- 172.21.15.47:0/704759274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb01a73d0 con 0x7fbbb0107a20 2024-07-24T22:18:39.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.356+0000 7fbba67fc640 1 -- 172.21.15.47:0/704759274 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbba8005020 con 0x7fbbb0107a20 2024-07-24T22:18:39.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.356+0000 7fbba67fc640 1 -- 172.21.15.47:0/704759274 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba80116d0 con 0x7fbbb0107a20 2024-07-24T22:18:39.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.356+0000 7fbbb77d3640 1 -- 172.21.15.47:0/704759274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb01a7930 con 0x7fbbb0107a20 2024-07-24T22:18:39.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.357+0000 7fbbb77d3640 1 -- 172.21.15.47:0/704759274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb0101a70 con 0x7fbbb0107a20 2024-07-24T22:18:39.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.358+0000 7fbba67fc640 1 -- 172.21.15.47:0/704759274 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fbba800caf0 con 0x7fbbb0107a20 2024-07-24T22:18:39.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.359+0000 7fbba67fc640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb9c0b3d40 0x7fbb9c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:39.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.359+0000 7fbbb556f640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb9c0b3d40 0x7fbb9c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:39.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.359+0000 7fbba67fc640 1 -- 172.21.15.47:0/704759274 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fbba80e4480 con 0x7fbbb0107a20 2024-07-24T22:18:39.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.359+0000 7fbbb556f640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb9c0b3d40 0x7fbb9c0b6200 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00abe0 tx=0x7fbbac00a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:39.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.361+0000 7fbba67fc640 1 -- 172.21.15.47:0/704759274 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fbba8016030 con 0x7fbbb0107a20 2024-07-24T22:18:39.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.594+0000 7fbbb77d3640 1 -- 172.21.15.47:0/704759274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbb00fe900 con 0x7fbbb0107a20 2024-07-24T22:18:39.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.595+0000 7fbba67fc640 1 -- 172.21.15.47:0/704759274 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7fbba80ab760 con 0x7fbbb0107a20 2024-07-24T22:18:39.598 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:18:39.598 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:18:39.598 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:18:39.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.597+0000 7fbbb77d3640 1 -- 172.21.15.47:0/704759274 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb9c0b3d40 msgr2=0x7fbb9c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:39.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.597+0000 7fbbb77d3640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb9c0b3d40 0x7fbb9c0b6200 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00abe0 tx=0x7fbbac00a2d0 comp rx=0 tx=0).stop 2024-07-24T22:18:39.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.597+0000 7fbbb77d3640 1 -- 172.21.15.47:0/704759274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb0107a20 msgr2=0x7fbbb00fe080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:39.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.597+0000 7fbbb77d3640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb0107a20 0x7fbbb00fe080 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fbba800eaa0 tx=0x7fbba800eea0 comp rx=0 tx=0).stop 2024-07-24T22:18:39.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.597+0000 7fbbb77d3640 1 -- 172.21.15.47:0/704759274 shutdown_connections 2024-07-24T22:18:39.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.597+0000 7fbbb77d3640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb9c0b3d40 0x7fbb9c0b6200 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:39.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.597+0000 7fbbb77d3640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb0107a20 0x7fbbb00fe080 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:39.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.597+0000 7fbbb77d3640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbb01070a0 0x7fbbb00fdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:39.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.597+0000 7fbbb77d3640 1 --2- 172.21.15.47:0/704759274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbb0101690 0x7fbbb00fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:39.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.598+0000 7fbbb77d3640 1 -- 172.21.15.47:0/704759274 >> 172.21.15.47:0/704759274 conn(0x7fbbb00fd100 msgr2=0x7fbbb006b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:39.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.598+0000 7fbbb77d3640 1 -- 172.21.15.47:0/704759274 shutdown_connections 2024-07-24T22:18:39.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:39.598+0000 7fbbb77d3640 1 -- 172.21.15.47:0/704759274 wait complete. 2024-07-24T22:18:40.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:39 smithi183 ceph-mon[37007]: pgmap v721: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 307 B/s wr, 5 op/s 2024-07-24T22:18:40.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:39 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/704759274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:39 smithi047 ceph-mon[32551]: pgmap v721: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 307 B/s wr, 5 op/s 2024-07-24T22:18:40.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:39 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/704759274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:40.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:39 smithi188 ceph-mon[37380]: pgmap v721: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 307 B/s wr, 5 op/s 2024-07-24T22:18:40.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:39 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/704759274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:40.300 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:18:40.568 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:42.137 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:41 smithi047 ceph-mon[32551]: pgmap v722: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 275 B/s wr, 5 op/s 2024-07-24T22:18:42.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:41 smithi183 ceph-mon[37007]: pgmap v722: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 275 B/s wr, 5 op/s 2024-07-24T22:18:42.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:41 smithi188 ceph-mon[37380]: pgmap v722: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 275 B/s wr, 5 op/s 2024-07-24T22:18:42.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.383+0000 7fcd8f185640 1 -- 172.21.15.47:0/4229744084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd88102790 msgr2=0x7fcd88102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:42.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.383+0000 7fcd8f185640 1 --2- 172.21.15.47:0/4229744084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd88102790 0x7fcd88102b70 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009900 tx=0x7fcd7c02a410 comp rx=0 tx=0).stop 2024-07-24T22:18:42.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.383+0000 7fcd8f185640 1 -- 172.21.15.47:0/4229744084 shutdown_connections 2024-07-24T22:18:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.383+0000 7fcd8f185640 1 --2- 172.21.15.47:0/4229744084 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd88108b20 0x7fcd8810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.383+0000 7fcd8f185640 1 --2- 172.21.15.47:0/4229744084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd881081a0 0x7fcd881085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.383+0000 7fcd8f185640 1 --2- 172.21.15.47:0/4229744084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd88102790 0x7fcd88102b70 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.383+0000 7fcd8f185640 1 -- 172.21.15.47:0/4229744084 >> 172.21.15.47:0/4229744084 conn(0x7fcd880fe200 msgr2=0x7fcd88100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.383+0000 7fcd8f185640 1 -- 172.21.15.47:0/4229744084 shutdown_connections 2024-07-24T22:18:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.383+0000 7fcd8f185640 1 -- 172.21.15.47:0/4229744084 wait complete. 2024-07-24T22:18:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.384+0000 7fcd8f185640 1 Processor -- start 2024-07-24T22:18:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.384+0000 7fcd8f185640 1 -- start start 2024-07-24T22:18:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.384+0000 7fcd8f185640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd88102790 0x7fcd88074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.384+0000 7fcd8f185640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd881081a0 0x7fcd880753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.384+0000 7fcd8f185640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd88108b20 0x7fcd88075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.384+0000 7fcd8f185640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcd88112820 con 0x7fcd88108b20 2024-07-24T22:18:42.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.384+0000 7fcd8f185640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcd881126a0 con 0x7fcd881081a0 2024-07-24T22:18:42.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.384+0000 7fcd8f185640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcd881129a0 con 0x7fcd88102790 2024-07-24T22:18:42.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.384+0000 7fcd8d722640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd88108b20 0x7fcd88075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.384+0000 7fcd8d722640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd88108b20 0x7fcd88075910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37762/0 (socket says 172.21.15.47:37762) 2024-07-24T22:18:42.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.384+0000 7fcd8d722640 1 -- 172.21.15.47:0/1854943922 learned_addr learned my addr 172.21.15.47:0/1854943922 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:42.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.384+0000 7fcd87fff640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd881081a0 0x7fcd880753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.385+0000 7fcd8cf21640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd88102790 0x7fcd88074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.385+0000 7fcd8d722640 1 -- 172.21.15.47:0/1854943922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd88102790 msgr2=0x7fcd88074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:42.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.385+0000 7fcd8d722640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd88102790 0x7fcd88074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.385+0000 7fcd8d722640 1 -- 172.21.15.47:0/1854943922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd881081a0 msgr2=0x7fcd880753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:42.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.385+0000 7fcd8d722640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd881081a0 0x7fcd880753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.385+0000 7fcd8d722640 1 -- 172.21.15.47:0/1854943922 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd881a7250 con 0x7fcd88108b20 2024-07-24T22:18:42.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.385+0000 7fcd8d722640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd88108b20 0x7fcd88075910 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000b970 tx=0x7fcd8000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.385+0000 7fcd85ffb640 1 -- 172.21.15.47:0/1854943922 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80019070 con 0x7fcd88108b20 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.385+0000 7fcd85ffb640 1 -- 172.21.15.47:0/1854943922 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd80014440 con 0x7fcd88108b20 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.385+0000 7fcd8f185640 1 -- 172.21.15.47:0/1854943922 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd881a7540 con 0x7fcd88108b20 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.385+0000 7fcd85ffb640 1 -- 172.21.15.47:0/1854943922 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd800075d0 con 0x7fcd88108b20 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.385+0000 7fcd8f185640 1 -- 172.21.15.47:0/1854943922 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd881a7a80 con 0x7fcd88108b20 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.388+0000 7fcd85ffb640 1 -- 172.21.15.47:0/1854943922 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fcd8001c070 con 0x7fcd88108b20 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.388+0000 7fcd91536740 1 Processor -- start 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.388+0000 7fcd91536740 1 -- start start 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.388+0000 7fcd91536740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e3f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.388+0000 7fcd91536740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e3fea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.388+0000 7fcd91536740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 0x56046e401370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.388+0000 7fcd91536740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56046e3699b0 con 0x56046e3f2ff0 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.388+0000 7fcd91536740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56046e358eb0 con 0x56046e3f26d0 2024-07-24T22:18:42.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.388+0000 7fcd91536740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56046e35cef0 con 0x56046e3fef80 2024-07-24T22:18:42.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.388+0000 7fcd8cf21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e3fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.388+0000 7fcd8cf21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e3fea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37778/0 (socket says 172.21.15.47:37778) 2024-07-24T22:18:42.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.388+0000 7fcd8cf21640 1 -- 172.21.15.47:0/299821555 learned_addr learned my addr 172.21.15.47:0/299821555 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:42.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.388+0000 7fcd87fff640 1 --2- 172.21.15.47:0/299821555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e3f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.389+0000 7fcd87fff640 1 --2- 172.21.15.47:0/299821555 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 0x56046e401370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.389+0000 7fcd85ffb640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcd780b3dc0 0x7fcd780b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.389+0000 7fcd8cf21640 1 -- 172.21.15.47:0/299821555 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 msgr2=0x56046e401370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:42.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.389+0000 7fcd8cf21640 1 --2- 172.21.15.47:0/299821555 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 0x56046e401370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.389+0000 7fcd8cf21640 1 -- 172.21.15.47:0/299821555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 msgr2=0x56046e3f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:42.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.389+0000 7fcd8cf21640 1 --2- 172.21.15.47:0/299821555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e3f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.389+0000 7fcd8cf21640 1 -- 172.21.15.47:0/299821555 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56046e2e2320 con 0x56046e3f2ff0 2024-07-24T22:18:42.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.389+0000 7fcd8d722640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcd780b3dc0 0x7fcd780b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.389+0000 7fcd8cf21640 1 --2- 172.21.15.47:0/299821555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e3fea40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c02a930 tx=0x7fcd7c031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731e025621e06d2f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.389+0000 7fcd85ffb640 1 -- 172.21.15.47:0/1854943922 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fcd800e3440 con 0x7fcd88108b20 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.389+0000 7fcd72ffd640 1 -- 172.21.15.47:0/299821555 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c03f070 con 0x56046e3f2ff0 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.389+0000 7fcd72ffd640 1 -- 172.21.15.47:0/299821555 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd7c0316a0 con 0x56046e3f2ff0 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.389+0000 7fcd72ffd640 1 -- 172.21.15.47:0/299821555 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c035070 con 0x56046e3f2ff0 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.390+0000 7fcd91536740 1 -- 172.21.15.47:0/299821555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 msgr2=0x56046e3fea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.390+0000 7fcd8d722640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcd780b3dc0 0x7fcd780b6280 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcd800a9e30 tx=0x7fcd800a9f80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.390+0000 7fcd91536740 1 --2- 172.21.15.47:0/299821555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e3fea40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c02a930 tx=0x7fcd7c031cd0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.390+0000 7fcd91536740 1 -- 172.21.15.47:0/299821555 shutdown_connections 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.390+0000 7fcd91536740 1 --2- 172.21.15.47:0/299821555 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 0x56046e401370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.390+0000 7fcd91536740 1 --2- 172.21.15.47:0/299821555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e3fea40 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.390+0000 7fcd91536740 1 --2- 172.21.15.47:0/299821555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e3f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.390+0000 7fcd91536740 1 -- 172.21.15.47:0/299821555 >> 172.21.15.47:0/299821555 conn(0x56046e3f0500 msgr2=0x56046e3f16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.390+0000 7fcd91536740 1 -- 172.21.15.47:0/299821555 shutdown_connections 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.390+0000 7fcd91536740 1 -- 172.21.15.47:0/299821555 wait complete. 2024-07-24T22:18:42.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.390+0000 7fcd91536740 1 -- start start 2024-07-24T22:18:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.390+0000 7fcd91536740 1 Processor -- start 2024-07-24T22:18:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd91536740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e3fbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd91536740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e3fc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd91536740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 0x56046e3fc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd91536740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56046e1bc700 con 0x56046e3f2ff0 2024-07-24T22:18:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd91536740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56046e2fb5f0 con 0x56046e3f26d0 2024-07-24T22:18:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd91536740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56046e401ba0 con 0x56046e3fef80 2024-07-24T22:18:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd91536740 10 client.0 _ll_register_callbacks cb 0x56046e31b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd8cf21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e3fc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd8cf21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e3fc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37790/0 (socket says 172.21.15.47:37790) 2024-07-24T22:18:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd8cf21640 1 -- 172.21.15.47:0/237807303 learned_addr learned my addr 172.21.15.47:0/237807303 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd87fff640 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e3fbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd8cf21640 1 -- 172.21.15.47:0/237807303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 msgr2=0x56046e3fc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:42.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd87fff640 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 0x56046e3fc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd8cf21640 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 0x56046e3fc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd8cf21640 1 -- 172.21.15.47:0/237807303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 msgr2=0x56046e3fbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:42.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd8cf21640 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e3fbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd8cf21640 1 -- 172.21.15.47:0/237807303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56046e2ee680 con 0x56046e3f2ff0 2024-07-24T22:18:42.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.391+0000 7fcd87fff640 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e3fbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:42.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd8cf21640 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e3fc430 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c031a80 tx=0x7fcd7c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7db7f17d77f8341 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:42.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd67fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:42.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd67fff640 1 -- 172.21.15.47:0/237807303 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c04a020 con 0x56046e3f2ff0 2024-07-24T22:18:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd91536740 1 -- 172.21.15.47:0/237807303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd7c0316a0 con 0x56046e3f2ff0 2024-07-24T22:18:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd67fff640 1 -- 172.21.15.47:0/237807303 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fcd7c0049b0 con 0x56046e3f2ff0 2024-07-24T22:18:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd67fff640 1 -- 172.21.15.47:0/237807303 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcd7c055050 con 0x56046e3f2ff0 2024-07-24T22:18:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd91536740 10 client.18102 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd91536740 1 -- 172.21.15.47:0/237807303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56046e0b9650 con 0x56046e3f2ff0 2024-07-24T22:18:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd67fff640 1 -- 172.21.15.47:0/237807303 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd7c0316a0 con 0x56046e3f2ff0 2024-07-24T22:18:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd67fff640 1 -- 172.21.15.47:0/237807303 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcd7c043400 con 0x56046e3f2ff0 2024-07-24T22:18:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd91536740 10 client.18102 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd91536740 10 client.18102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd91536740 20 client.18102 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd91536740 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56046e40e880 0x56046e410c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd91536740 4 client.18102 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:42.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.392+0000 7fcd91536740 1 -- 172.21.15.47:0/237807303 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56046e36b900 con 0x56046e40e880 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.393+0000 7fcd87fff640 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56046e40e880 0x56046e410c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.393+0000 7fcd67fff640 10 client.18102 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.393+0000 7fcd87fff640 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56046e40e880 0x56046e410c70 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a10970bc616d7cb7 server_cookie=5682bf09e98eb63a in_seq=0 out_seq=0 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd67fff640 1 -- 172.21.15.47:0/237807303 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56046e36b900 con 0x56046e40e880 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd67fff640 10 client.18102 handle_command_reply: tid=0 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd91536740 1 client.18102 shutdown 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd91536740 1 -- 172.21.15.47:0/237807303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 msgr2=0x56046e3fc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd91536740 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e3fc430 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c031a80 tx=0x7fcd7c005780 comp rx=0 tx=0).stop 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd91536740 1 -- 172.21.15.47:0/237807303 shutdown_connections 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd91536740 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56046e40e880 0x56046e410c70 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd91536740 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 0x56046e3fc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd91536740 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e3fc430 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd91536740 1 --2- 172.21.15.47:0/237807303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e3fbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd91536740 1 -- 172.21.15.47:0/237807303 >> 172.21.15.47:0/237807303 conn(0x56046e3f0500 msgr2=0x56046e3f60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd67fff640 0 client.18102 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd91536740 1 -- 172.21.15.47:0/237807303 shutdown_connections 2024-07-24T22:18:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd91536740 1 -- 172.21.15.47:0/237807303 wait complete. 2024-07-24T22:18:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.394+0000 7fcd91536740 20 client.18102 trim_cache size 0 max 16384 2024-07-24T22:18:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.408+0000 7fcd91536740 1 Processor -- start 2024-07-24T22:18:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.408+0000 7fcd91536740 1 -- start start 2024-07-24T22:18:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.408+0000 7fcd91536740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3f26d0 0x56046e3fa770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.408+0000 7fcd91536740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e416270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.408+0000 7fcd91536740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3fef80 0x56046e4167b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.408+0000 7fcd91536740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcd881ae4b0 con 0x56046e3f2ff0 2024-07-24T22:18:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.408+0000 7fcd91536740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcd881b0d10 con 0x56046e3fef80 2024-07-24T22:18:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.408+0000 7fcd91536740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcd881aeb00 con 0x56046e3f26d0 2024-07-24T22:18:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.408+0000 7fcd8cf21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e416270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.408+0000 7fcd8cf21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e416270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37800/0 (socket says 172.21.15.47:37800) 2024-07-24T22:18:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.409+0000 7fcd8cf21640 1 -- 172.21.15.47:0/1152835639 learned_addr learned my addr 172.21.15.47:0/1152835639 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.409+0000 7fcd8cf21640 1 -- 172.21.15.47:0/1152835639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3f26d0 msgr2=0x56046e3fa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.409+0000 7fcd8cf21640 1 --2- 172.21.15.47:0/1152835639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3f26d0 0x56046e3fa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.409+0000 7fcd8cf21640 1 -- 172.21.15.47:0/1152835639 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3fef80 msgr2=0x56046e4167b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.409+0000 7fcd8cf21640 1 --2- 172.21.15.47:0/1152835639 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3fef80 0x56046e4167b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.409+0000 7fcd8cf21640 1 -- 172.21.15.47:0/1152835639 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56046e3fae50 con 0x56046e3f2ff0 2024-07-24T22:18:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.409+0000 7fcd8cf21640 1 --2- 172.21.15.47:0/1152835639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e416270 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c043690 tx=0x7fcd7c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72c6f058faba75a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.409+0000 7fcd727fc640 1 -- 172.21.15.47:0/1152835639 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c05e070 con 0x56046e3f2ff0 2024-07-24T22:18:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.409+0000 7fcd727fc640 1 -- 172.21.15.47:0/1152835639 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd7c0316a0 con 0x56046e3f2ff0 2024-07-24T22:18:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.409+0000 7fcd727fc640 1 -- 172.21.15.47:0/1152835639 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c04a070 con 0x56046e3f2ff0 2024-07-24T22:18:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.410+0000 7fcd91536740 1 -- 172.21.15.47:0/1152835639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 msgr2=0x56046e416270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.410+0000 7fcd91536740 1 --2- 172.21.15.47:0/1152835639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e416270 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c043690 tx=0x7fcd7c000bc0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.410+0000 7fcd91536740 1 -- 172.21.15.47:0/1152835639 shutdown_connections 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.410+0000 7fcd91536740 1 --2- 172.21.15.47:0/1152835639 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3fef80 0x56046e4167b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.410+0000 7fcd91536740 1 --2- 172.21.15.47:0/1152835639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e416270 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.410+0000 7fcd91536740 1 --2- 172.21.15.47:0/1152835639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3f26d0 0x56046e3fa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.410+0000 7fcd91536740 1 -- 172.21.15.47:0/1152835639 >> 172.21.15.47:0/1152835639 conn(0x56046e3f0500 msgr2=0x56046e3f1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.410+0000 7fcd91536740 1 -- 172.21.15.47:0/1152835639 shutdown_connections 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.410+0000 7fcd91536740 1 -- 172.21.15.47:0/1152835639 wait complete. 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.410+0000 7fcd91536740 1 -- start start 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.410+0000 7fcd91536740 1 Processor -- start 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd91536740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e407370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd91536740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e402840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd91536740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 0x56046e402d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd91536740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcd881af1d0 con 0x56046e3f2ff0 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd91536740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcd881b0640 con 0x56046e3f26d0 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd91536740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcd881af8a0 con 0x56046e3fef80 2024-07-24T22:18:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd91536740 10 client.0 _ll_register_callbacks cb 0x7fcd740097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd8cf21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e402840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd8cf21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e402840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37804/0 (socket says 172.21.15.47:37804) 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd8cf21640 1 -- 172.21.15.47:0/4103583731 learned_addr learned my addr 172.21.15.47:0/4103583731 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd87fff640 1 --2- 172.21.15.47:0/4103583731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e407370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd8cf21640 1 -- 172.21.15.47:0/4103583731 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 msgr2=0x56046e402d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd8cf21640 1 --2- 172.21.15.47:0/4103583731 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 0x56046e402d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd8cf21640 1 -- 172.21.15.47:0/4103583731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 msgr2=0x56046e407370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd8cf21640 1 --2- 172.21.15.47:0/4103583731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e407370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd8cf21640 1 -- 172.21.15.47:0/4103583731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56046e3f2e20 con 0x56046e3f2ff0 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd87fff640 1 --2- 172.21.15.47:0/4103583731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e407370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd8cf21640 1 --2- 172.21.15.47:0/4103583731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e402840 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0057c0 tx=0x7fcd7c031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722638158dc0f40c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd67fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd67fff640 1 -- 172.21.15.47:0/4103583731 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c05e020 con 0x56046e3f2ff0 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd67fff640 1 -- 172.21.15.47:0/4103583731 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fcd7c004bc0 con 0x56046e3f2ff0 2024-07-24T22:18:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd91536740 1 -- 172.21.15.47:0/4103583731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd7c0316a0 con 0x56046e3f2ff0 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.411+0000 7fcd67fff640 1 -- 172.21.15.47:0/4103583731 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcd7c069050 con 0x56046e3f2ff0 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.412+0000 7fcd91536740 10 client.18108 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.412+0000 7fcd91536740 1 -- 172.21.15.47:0/4103583731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56046e478f70 con 0x56046e3f2ff0 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.412+0000 7fcd67fff640 1 -- 172.21.15.47:0/4103583731 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd7c0316a0 con 0x56046e3f2ff0 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.412+0000 7fcd67fff640 1 -- 172.21.15.47:0/4103583731 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcd7c003710 con 0x56046e3f2ff0 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.412+0000 7fcd91536740 10 client.18108 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.412+0000 7fcd91536740 10 client.18108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.412+0000 7fcd91536740 20 client.18108 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.412+0000 7fcd91536740 1 --2- 172.21.15.47:0/4103583731 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56046e479710 0x56046e47bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.412+0000 7fcd91536740 4 client.18108 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.412+0000 7fcd91536740 1 -- 172.21.15.47:0/4103583731 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56046e3673a0 con 0x56046e479710 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.412+0000 7fcd87fff640 1 --2- 172.21.15.47:0/4103583731 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56046e479710 0x56046e47bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd87fff640 1 --2- 172.21.15.47:0/4103583731 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56046e479710 0x56046e47bb30 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bafbc428e24296d server_cookie=402234328a9a367b in_seq=0 out_seq=0 2024-07-24T22:18:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd67fff640 10 client.18108 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd67fff640 1 -- 172.21.15.47:0/4103583731 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56046e3673a0 con 0x56046e479710 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd67fff640 10 client.18108 handle_command_reply: tid=0 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd91536740 1 client.18108 shutdown 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd91536740 1 -- 172.21.15.47:0/4103583731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 msgr2=0x56046e402840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd91536740 1 --2- 172.21.15.47:0/4103583731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e402840 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0057c0 tx=0x7fcd7c031ba0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd91536740 1 -- 172.21.15.47:0/4103583731 shutdown_connections 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd91536740 1 --2- 172.21.15.47:0/4103583731 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x56046e479710 0x56046e47bb30 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd67fff640 0 client.18108 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd91536740 1 --2- 172.21.15.47:0/4103583731 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56046e3fef80 0x56046e402d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd91536740 1 --2- 172.21.15.47:0/4103583731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56046e3f2ff0 0x56046e402840 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd91536740 1 --2- 172.21.15.47:0/4103583731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56046e3f26d0 0x56046e407370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd91536740 1 -- 172.21.15.47:0/4103583731 >> 172.21.15.47:0/4103583731 conn(0x56046e3f0500 msgr2=0x56046e3fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd91536740 1 -- 172.21.15.47:0/4103583731 shutdown_connections 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd91536740 1 -- 172.21.15.47:0/4103583731 wait complete. 2024-07-24T22:18:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.413+0000 7fcd91536740 20 client.18108 trim_cache size 0 max 16384 2024-07-24T22:18:42.432 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:18:42.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.414+0000 7fcd8f185640 1 -- 172.21.15.47:0/1854943922 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcd780b3dc0 msgr2=0x7fcd780b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:42.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.414+0000 7fcd8f185640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcd780b3dc0 0x7fcd780b6280 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcd800a9e30 tx=0x7fcd800a9f80 comp rx=0 tx=0).stop 2024-07-24T22:18:42.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.414+0000 7fcd8f185640 1 -- 172.21.15.47:0/1854943922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd88108b20 msgr2=0x7fcd88075910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:42.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.414+0000 7fcd8f185640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd88108b20 0x7fcd88075910 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000b970 tx=0x7fcd8000bd70 comp rx=0 tx=0).stop 2024-07-24T22:18:42.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.414+0000 7fcd8f185640 1 -- 172.21.15.47:0/1854943922 shutdown_connections 2024-07-24T22:18:42.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.414+0000 7fcd8f185640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fcd780b3dc0 0x7fcd780b6280 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.414+0000 7fcd8f185640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd88108b20 0x7fcd88075910 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.414+0000 7fcd8f185640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd881081a0 0x7fcd880753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.414+0000 7fcd8f185640 1 --2- 172.21.15.47:0/1854943922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd88102790 0x7fcd88074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:42.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.414+0000 7fcd8f185640 1 -- 172.21.15.47:0/1854943922 >> 172.21.15.47:0/1854943922 conn(0x7fcd880fe200 msgr2=0x7fcd881005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:42.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.414+0000 7fcd8f185640 1 -- 172.21.15.47:0/1854943922 shutdown_connections 2024-07-24T22:18:42.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:42.414+0000 7fcd8f185640 1 -- 172.21.15.47:0/1854943922 wait complete. 2024-07-24T22:18:44.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:43 smithi183 ceph-mon[37007]: pgmap v723: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:18:44.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:43 smithi047 ceph-mon[32551]: pgmap v723: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:18:44.218 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-07-24T22:18:44.219 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-07-24T22:18:44.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:43 smithi188 ceph-mon[37380]: pgmap v723: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:18:44.497 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.930+0000 7f209b141640 1 -- 172.21.15.47:0/1288188171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2094103460 msgr2=0x7f2094103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.930+0000 7f209b141640 1 --2- 172.21.15.47:0/1288188171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2094103460 0x7f2094103840 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f207c009900 tx=0x7f207c02a410 comp rx=0 tx=0).stop 2024-07-24T22:18:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.930+0000 7f209b141640 1 -- 172.21.15.47:0/1288188171 shutdown_connections 2024-07-24T22:18:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.930+0000 7f209b141640 1 --2- 172.21.15.47:0/1288188171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f209410ca10 0x7f209410ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.930+0000 7f209b141640 1 --2- 172.21.15.47:0/1288188171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2094103e60 0x7f209410c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.930+0000 7f209b141640 1 --2- 172.21.15.47:0/1288188171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2094103460 0x7f2094103840 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.930+0000 7f209b141640 1 -- 172.21.15.47:0/1288188171 >> 172.21.15.47:0/1288188171 conn(0x7f20940fd030 msgr2=0x7f20940ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.931+0000 7f209b141640 1 -- 172.21.15.47:0/1288188171 shutdown_connections 2024-07-24T22:18:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.931+0000 7f209b141640 1 -- 172.21.15.47:0/1288188171 wait complete. 2024-07-24T22:18:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.931+0000 7f209b141640 1 Processor -- start 2024-07-24T22:18:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.931+0000 7f209b141640 1 -- start start 2024-07-24T22:18:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.931+0000 7f209b141640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2094103460 0x7f2094198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.931+0000 7f209b141640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2094103e60 0x7f2094199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.931+0000 7f209b141640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209410ca10 0x7f209419e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.931+0000 7f209b141640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20941126a0 con 0x7f209410ca10 2024-07-24T22:18:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.931+0000 7f209b141640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2094112520 con 0x7f2094103460 2024-07-24T22:18:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.931+0000 7f209b141640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2094112820 con 0x7f2094103e60 2024-07-24T22:18:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f20996de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209410ca10 0x7f209419e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f20996de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209410ca10 0x7f209419e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41250/0 (socket says 172.21.15.47:41250) 2024-07-24T22:18:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f20996de640 1 -- 172.21.15.47:0/516856876 learned_addr learned my addr 172.21.15.47:0/516856876 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f2093fff640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2094103e60 0x7f2094199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f2098edd640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2094103460 0x7f2094198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f20996de640 1 -- 172.21.15.47:0/516856876 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2094103e60 msgr2=0x7f2094199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f20996de640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2094103e60 0x7f2094199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f20996de640 1 -- 172.21.15.47:0/516856876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2094103460 msgr2=0x7f2094198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f20996de640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2094103460 0x7f2094198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f20996de640 1 -- 172.21.15.47:0/516856876 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209419ebc0 con 0x7f209410ca10 2024-07-24T22:18:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f2098edd640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2094103460 0x7f2094198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f20996de640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209410ca10 0x7f209419e3f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f208c00eaa0 tx=0x7f208c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f2091ffb640 1 -- 172.21.15.47:0/516856876 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c004d20 con 0x7f209410ca10 2024-07-24T22:18:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f2091ffb640 1 -- 172.21.15.47:0/516856876 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f208c005020 con 0x7f209410ca10 2024-07-24T22:18:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f209b141640 1 -- 172.21.15.47:0/516856876 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209419eeb0 con 0x7f209410ca10 2024-07-24T22:18:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f2091ffb640 1 -- 172.21.15.47:0/516856876 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c0116b0 con 0x7f209410ca10 2024-07-24T22:18:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.932+0000 7f209b141640 1 -- 172.21.15.47:0/516856876 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20941a5570 con 0x7f209410ca10 2024-07-24T22:18:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.935+0000 7f209df70740 1 Processor -- start 2024-07-24T22:18:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f2091ffb640 1 -- 172.21.15.47:0/516856876 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f208c0051d0 con 0x7f209410ca10 2024-07-24T22:18:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f209df70740 1 -- start start 2024-07-24T22:18:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f209df70740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0e5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f209df70740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f209df70740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0f2170 0x562f2c0f4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f209df70740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562f2c05b280 con 0x562f2c0e61e0 2024-07-24T22:18:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f209df70740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562f2c04a780 con 0x562f2c0f2170 2024-07-24T22:18:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f209df70740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562f2c04e7c0 con 0x562f2c0e58c0 2024-07-24T22:18:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f2098edd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f2098edd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0f1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41264/0 (socket says 172.21.15.47:41264) 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f2098edd640 1 -- 172.21.15.47:0/2386156051 learned_addr learned my addr 172.21.15.47:0/2386156051 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f2093fff640 1 --2- 172.21.15.47:0/2386156051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0e5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f2093fff640 1 --2- 172.21.15.47:0/2386156051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0f2170 0x562f2c0f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f2091ffb640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f20800b3d40 0x7f20800b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f2098edd640 1 -- 172.21.15.47:0/2386156051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 msgr2=0x562f2c0e5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f2098edd640 1 --2- 172.21.15.47:0/2386156051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0e5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f2098edd640 1 -- 172.21.15.47:0/2386156051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0f2170 msgr2=0x562f2c0f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f2098edd640 1 --2- 172.21.15.47:0/2386156051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0f2170 0x562f2c0f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f2098edd640 1 -- 172.21.15.47:0/2386156051 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f2bdae790 con 0x562f2c0e61e0 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.936+0000 7f2093fff640 1 --2- 172.21.15.47:0/2386156051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0f2170 0x562f2c0f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.937+0000 7f20996de640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f20800b3d40 0x7f20800b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.937+0000 7f2091ffb640 1 -- 172.21.15.47:0/516856876 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f208c0e4230 con 0x7f209410ca10 2024-07-24T22:18:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.937+0000 7f2098edd640 1 --2- 172.21.15.47:0/2386156051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0f1c30 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f207c000c00 tx=0x7f207c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87435a3d90a7e491 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.937+0000 7f208affd640 1 -- 172.21.15.47:0/2386156051 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c03f070 con 0x562f2c0e61e0 2024-07-24T22:18:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.937+0000 7f208affd640 1 -- 172.21.15.47:0/2386156051 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f207c0316a0 con 0x562f2c0e61e0 2024-07-24T22:18:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.937+0000 7f208affd640 1 -- 172.21.15.47:0/2386156051 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c035070 con 0x562f2c0e61e0 2024-07-24T22:18:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.938+0000 7f209df70740 1 -- 172.21.15.47:0/2386156051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 msgr2=0x562f2c0f1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.938+0000 7f20996de640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f20800b3d40 0x7f20800b6200 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f208c0e1a00 tx=0x7f208c000f40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.938+0000 7f209df70740 1 --2- 172.21.15.47:0/2386156051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0f1c30 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f207c000c00 tx=0x7f207c032ce0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.938+0000 7f209df70740 1 -- 172.21.15.47:0/2386156051 shutdown_connections 2024-07-24T22:18:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.938+0000 7f209df70740 1 --2- 172.21.15.47:0/2386156051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0f2170 0x562f2c0f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.938+0000 7f209df70740 1 --2- 172.21.15.47:0/2386156051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0f1c30 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.938+0000 7f209df70740 1 --2- 172.21.15.47:0/2386156051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0e5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.938+0000 7f209df70740 1 -- 172.21.15.47:0/2386156051 >> 172.21.15.47:0/2386156051 conn(0x562f2c0e36f0 msgr2=0x562f2c0e4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.938+0000 7f209df70740 1 -- 172.21.15.47:0/2386156051 shutdown_connections 2024-07-24T22:18:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.938+0000 7f209df70740 1 -- 172.21.15.47:0/2386156051 wait complete. 2024-07-24T22:18:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.938+0000 7f209df70740 1 -- start start 2024-07-24T22:18:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.938+0000 7f209df70740 1 Processor -- start 2024-07-24T22:18:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f209df70740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0f1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f209df70740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0eed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f209df70740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0f2170 0x562f2c0ef290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f209df70740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562f2bf84ab0 con 0x562f2c0e61e0 2024-07-24T22:18:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f209df70740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562f2bfd29e0 con 0x562f2c0f2170 2024-07-24T22:18:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f209df70740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562f2c0f4df0 con 0x562f2c0e58c0 2024-07-24T22:18:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f209df70740 10 client.0 _ll_register_callbacks cb 0x562f2bd5aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f2098edd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0eed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f2098edd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0eed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41270/0 (socket says 172.21.15.47:41270) 2024-07-24T22:18:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f2098edd640 1 -- 172.21.15.47:0/2983720878 learned_addr learned my addr 172.21.15.47:0/2983720878 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f2093fff640 1 --2- 172.21.15.47:0/2983720878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f2098edd640 1 -- 172.21.15.47:0/2983720878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 msgr2=0x562f2c0f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f2098edd640 1 --2- 172.21.15.47:0/2983720878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f2098edd640 1 -- 172.21.15.47:0/2983720878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0f2170 msgr2=0x562f2c0ef290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f2098edd640 1 --2- 172.21.15.47:0/2983720878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0f2170 0x562f2c0ef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f2098edd640 1 -- 172.21.15.47:0/2983720878 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f2be27620 con 0x562f2c0e61e0 2024-07-24T22:18:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f2098edd640 1 --2- 172.21.15.47:0/2983720878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0eed50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f207c02a450 tx=0x7f207c0314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9dd6d99e951ddb server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f2073fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f2073fff640 1 -- 172.21.15.47:0/2983720878 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c03f070 con 0x562f2c0e61e0 2024-07-24T22:18:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f2073fff640 1 -- 172.21.15.47:0/2983720878 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f207c004050 con 0x562f2c0e61e0 2024-07-24T22:18:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.939+0000 7f209df70740 1 -- 172.21.15.47:0/2983720878 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562f2bff9ce0 con 0x562f2c0e61e0 2024-07-24T22:18:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.940+0000 7f2073fff640 1 -- 172.21.15.47:0/2983720878 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f207c035040 con 0x562f2c0e61e0 2024-07-24T22:18:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.940+0000 7f209df70740 10 client.18120 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.940+0000 7f209df70740 1 -- 172.21.15.47:0/2983720878 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562f2c1004d0 con 0x562f2c0e61e0 2024-07-24T22:18:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.940+0000 7f2073fff640 1 -- 172.21.15.47:0/2983720878 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562f2bff9ce0 con 0x562f2c0e61e0 2024-07-24T22:18:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.940+0000 7f2073fff640 1 -- 172.21.15.47:0/2983720878 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f207c0046c0 con 0x562f2c0e61e0 2024-07-24T22:18:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.940+0000 7f209df70740 10 client.18120 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.940+0000 7f209df70740 10 client.18120 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.940+0000 7f209df70740 20 client.18120 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.940+0000 7f209df70740 1 --2- 172.21.15.47:0/2983720878 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562f2c101820 0x562f2c103c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.940+0000 7f209df70740 4 client.18120 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.940+0000 7f209df70740 1 -- 172.21.15.47:0/2983720878 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f2c05d1d0 con 0x562f2c101820 2024-07-24T22:18:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.940+0000 7f2093fff640 1 --2- 172.21.15.47:0/2983720878 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562f2c101820 0x562f2c103c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.941+0000 7f2093fff640 1 --2- 172.21.15.47:0/2983720878 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562f2c101820 0x562f2c103c10 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fa3afcac84709f8 server_cookie=4a0eb526eef4a4d6 in_seq=0 out_seq=0 2024-07-24T22:18:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.941+0000 7f2073fff640 10 client.18120 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.941+0000 7f2073fff640 1 -- 172.21.15.47:0/2983720878 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f2c05d1d0 con 0x562f2c101820 2024-07-24T22:18:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.941+0000 7f2073fff640 10 client.18120 handle_command_reply: tid=0 2024-07-24T22:18:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.941+0000 7f209df70740 1 client.18120 shutdown 2024-07-24T22:18:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.941+0000 7f209df70740 1 -- 172.21.15.47:0/2983720878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 msgr2=0x562f2c0eed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.941+0000 7f209df70740 1 --2- 172.21.15.47:0/2983720878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0eed50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f207c02a450 tx=0x7f207c0314a0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.942+0000 7f209df70740 1 -- 172.21.15.47:0/2983720878 shutdown_connections 2024-07-24T22:18:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.942+0000 7f209df70740 1 --2- 172.21.15.47:0/2983720878 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562f2c101820 0x562f2c103c10 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.942+0000 7f209df70740 1 --2- 172.21.15.47:0/2983720878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0f2170 0x562f2c0ef290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.942+0000 7f2073fff640 0 client.18120 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.942+0000 7f209df70740 1 --2- 172.21.15.47:0/2983720878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0eed50 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.942+0000 7f209df70740 1 --2- 172.21.15.47:0/2983720878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.942+0000 7f209df70740 1 -- 172.21.15.47:0/2983720878 >> 172.21.15.47:0/2983720878 conn(0x562f2c0e36f0 msgr2=0x562f2c0e9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.942+0000 7f209df70740 1 -- 172.21.15.47:0/2983720878 shutdown_connections 2024-07-24T22:18:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.942+0000 7f209df70740 1 -- 172.21.15.47:0/2983720878 wait complete. 2024-07-24T22:18:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.942+0000 7f209df70740 20 client.18120 trim_cache size 0 max 16384 2024-07-24T22:18:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.957+0000 7f209df70740 1 Processor -- start 2024-07-24T22:18:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.957+0000 7f209df70740 1 -- start start 2024-07-24T22:18:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f209df70740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0e36f0 0x562f2c0fdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f209df70740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0ee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f209df70740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f209df70740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20941ac190 con 0x562f2c0e61e0 2024-07-24T22:18:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f209df70740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f20941ae9f0 con 0x562f2c0e36f0 2024-07-24T22:18:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f209df70740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f20941ac7e0 con 0x562f2c0e58c0 2024-07-24T22:18:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f2093fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0ea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f2093fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0ea2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41284/0 (socket says 172.21.15.47:41284) 2024-07-24T22:18:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f2093fff640 1 -- 172.21.15.47:0/1680986395 learned_addr learned my addr 172.21.15.47:0/1680986395 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f2098edd640 1 --2- 172.21.15.47:0/1680986395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0ee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f2093fff640 1 --2- 172.21.15.47:0/1680986395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0e36f0 0x562f2c0fdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f2098edd640 1 -- 172.21.15.47:0/1680986395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0e36f0 msgr2=0x562f2c0fdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f2098edd640 1 --2- 172.21.15.47:0/1680986395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0e36f0 0x562f2c0fdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f2098edd640 1 -- 172.21.15.47:0/1680986395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 msgr2=0x562f2c0ea2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f2098edd640 1 --2- 172.21.15.47:0/1680986395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0ea2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f2098edd640 1 -- 172.21.15.47:0/1680986395 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f2c0e6010 con 0x562f2c0e58c0 2024-07-24T22:18:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f2093fff640 1 --2- 172.21.15.47:0/1680986395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f2098edd640 1 --2- 172.21.15.47:0/1680986395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0ee5c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f207c004a90 tx=0x7f207c005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63c46c615a3ea59e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.958+0000 7f208a7fc640 1 -- 172.21.15.47:0/1680986395 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c059070 con 0x562f2c0e58c0 2024-07-24T22:18:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.959+0000 7f208a7fc640 1 -- 172.21.15.47:0/1680986395 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f207c048030 con 0x562f2c0e58c0 2024-07-24T22:18:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.959+0000 7f208a7fc640 1 -- 172.21.15.47:0/1680986395 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c03f040 con 0x562f2c0e58c0 2024-07-24T22:18:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.959+0000 7f209df70740 1 -- 172.21.15.47:0/1680986395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 msgr2=0x562f2c0ee5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.959+0000 7f209df70740 1 --2- 172.21.15.47:0/1680986395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0ee5c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f207c004a90 tx=0x7f207c005a20 comp rx=0 tx=0).stop 2024-07-24T22:18:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.959+0000 7f209df70740 1 -- 172.21.15.47:0/1680986395 shutdown_connections 2024-07-24T22:18:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.959+0000 7f209df70740 1 --2- 172.21.15.47:0/1680986395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e61e0 0x562f2c0ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.959+0000 7f209df70740 1 --2- 172.21.15.47:0/1680986395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0ee5c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.959+0000 7f209df70740 1 --2- 172.21.15.47:0/1680986395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0e36f0 0x562f2c0fdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.959+0000 7f209df70740 1 -- 172.21.15.47:0/1680986395 >> 172.21.15.47:0/1680986395 conn(0x562f2c0ef490 msgr2=0x562f2c0e9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.959+0000 7f209df70740 1 -- 172.21.15.47:0/1680986395 shutdown_connections 2024-07-24T22:18:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.959+0000 7f209df70740 1 -- 172.21.15.47:0/1680986395 wait complete. 2024-07-24T22:18:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f209df70740 1 -- start start 2024-07-24T22:18:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f209df70740 1 Processor -- start 2024-07-24T22:18:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f209df70740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e36f0 0x562f2c0fa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f209df70740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0f5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f209df70740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0e61e0 0x562f2c0f5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f209df70740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20941aceb0 con 0x562f2c0e36f0 2024-07-24T22:18:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f209df70740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f20941ae320 con 0x562f2c0e61e0 2024-07-24T22:18:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f209df70740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f20941ad580 con 0x562f2c0e58c0 2024-07-24T22:18:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f209df70740 10 client.0 _ll_register_callbacks cb 0x7f207c032bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f2093fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e36f0 0x562f2c0fa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f2093fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e36f0 0x562f2c0fa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41294/0 (socket says 172.21.15.47:41294) 2024-07-24T22:18:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f2093fff640 1 -- 172.21.15.47:0/2192511838 learned_addr learned my addr 172.21.15.47:0/2192511838 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f2093fff640 1 --2- 172.21.15.47:0/2192511838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0e61e0 0x562f2c0f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f2098edd640 1 --2- 172.21.15.47:0/2192511838 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f2093fff640 1 -- 172.21.15.47:0/2192511838 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 msgr2=0x562f2c0f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f2093fff640 1 --2- 172.21.15.47:0/2192511838 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f2093fff640 1 -- 172.21.15.47:0/2192511838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0e61e0 msgr2=0x562f2c0f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f2093fff640 1 --2- 172.21.15.47:0/2192511838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0e61e0 0x562f2c0f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.960+0000 7f2093fff640 1 -- 172.21.15.47:0/2192511838 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f2c16a230 con 0x562f2c0e36f0 2024-07-24T22:18:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f2093fff640 1 --2- 172.21.15.47:0/2192511838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e36f0 0x562f2c0fa8b0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f208401f9c0 tx=0x7f20840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72149f5a0782db47 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f2073fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f2073fff640 1 -- 172.21.15.47:0/2192511838 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2084012110 con 0x562f2c0e36f0 2024-07-24T22:18:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f2073fff640 1 -- 172.21.15.47:0/2192511838 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f2084005050 con 0x562f2c0e36f0 2024-07-24T22:18:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f209df70740 1 -- 172.21.15.47:0/2192511838 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f207c048030 con 0x562f2c0e36f0 2024-07-24T22:18:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f2073fff640 1 -- 172.21.15.47:0/2192511838 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f20840122b0 con 0x562f2c0e36f0 2024-07-24T22:18:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f209df70740 10 client.18126 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f209df70740 1 -- 172.21.15.47:0/2192511838 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562f2c16b490 con 0x562f2c0e36f0 2024-07-24T22:18:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f2073fff640 1 -- 172.21.15.47:0/2192511838 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f207c048030 con 0x562f2c0e36f0 2024-07-24T22:18:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f2073fff640 1 -- 172.21.15.47:0/2192511838 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2084031070 con 0x562f2c0e36f0 2024-07-24T22:18:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f209df70740 10 client.18126 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f209df70740 10 client.18126 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f209df70740 20 client.18126 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f209df70740 1 --2- 172.21.15.47:0/2192511838 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562f2c0f2170 0x562f2c16dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f209df70740 4 client.18126 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:18:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.961+0000 7f209df70740 1 -- 172.21.15.47:0/2192511838 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562f2c058c70 con 0x562f2c0f2170 2024-07-24T22:18:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.962+0000 7f2098edd640 1 --2- 172.21.15.47:0/2192511838 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562f2c0f2170 0x562f2c16dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.962+0000 7f2098edd640 1 --2- 172.21.15.47:0/2192511838 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562f2c0f2170 0x562f2c16dc60 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20d5b52dd97d4ca1 server_cookie=407368a62fea7ab1 in_seq=0 out_seq=0 2024-07-24T22:18:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.962+0000 7f2073fff640 10 client.18126 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.966+0000 7f2073fff640 1 -- 172.21.15.47:0/2192511838 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562f2c058c70 con 0x562f2c0f2170 2024-07-24T22:18:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.966+0000 7f2073fff640 10 client.18126 handle_command_reply: tid=0 2024-07-24T22:18:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.966+0000 7f209df70740 1 client.18126 shutdown 2024-07-24T22:18:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209df70740 1 -- 172.21.15.47:0/2192511838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e36f0 msgr2=0x562f2c0fa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209df70740 1 --2- 172.21.15.47:0/2192511838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e36f0 0x562f2c0fa8b0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f208401f9c0 tx=0x7f20840046c0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209df70740 1 -- 172.21.15.47:0/2192511838 shutdown_connections 2024-07-24T22:18:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209df70740 1 --2- 172.21.15.47:0/2192511838 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562f2c0f2170 0x562f2c16dc60 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209df70740 1 --2- 172.21.15.47:0/2192511838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562f2c0e61e0 0x562f2c0f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f2073fff640 0 client.18126 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209df70740 1 --2- 172.21.15.47:0/2192511838 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562f2c0e58c0 0x562f2c0f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209df70740 1 --2- 172.21.15.47:0/2192511838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562f2c0e36f0 0x562f2c0fa8b0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209df70740 1 -- 172.21.15.47:0/2192511838 >> 172.21.15.47:0/2192511838 conn(0x562f2c0ef490 msgr2=0x562f2c0f0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209df70740 1 -- 172.21.15.47:0/2192511838 shutdown_connections 2024-07-24T22:18:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209df70740 1 -- 172.21.15.47:0/2192511838 wait complete. 2024-07-24T22:18:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209df70740 20 client.18126 trim_cache size 0 max 16384 2024-07-24T22:18:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:18:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:18:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:18:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:18:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209b141640 1 -- 172.21.15.47:0/516856876 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f20800b3d40 msgr2=0x7f20800b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209b141640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f20800b3d40 0x7f20800b6200 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f208c0e1a00 tx=0x7f208c000f40 comp rx=0 tx=0).stop 2024-07-24T22:18:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209b141640 1 -- 172.21.15.47:0/516856876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209410ca10 msgr2=0x7f209419e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209b141640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209410ca10 0x7f209419e3f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f208c00eaa0 tx=0x7f208c00eea0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209b141640 1 -- 172.21.15.47:0/516856876 shutdown_connections 2024-07-24T22:18:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209b141640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f20800b3d40 0x7f20800b6200 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209b141640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f209410ca10 0x7f209419e3f0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209b141640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2094103e60 0x7f2094199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209b141640 1 --2- 172.21.15.47:0/516856876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2094103460 0x7f2094198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.967+0000 7f209b141640 1 -- 172.21.15.47:0/516856876 >> 172.21.15.47:0/516856876 conn(0x7f20940fd030 msgr2=0x7f209410ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.968+0000 7f209b141640 1 -- 172.21.15.47:0/516856876 shutdown_connections 2024-07-24T22:18:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:44.968+0000 7f209b141640 1 -- 172.21.15.47:0/516856876 wait complete. 2024-07-24T22:18:45.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:45 smithi047 ceph-mon[32551]: pgmap v724: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 4 op/s 2024-07-24T22:18:46.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:45 smithi183 ceph-mon[37007]: pgmap v724: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 4 op/s 2024-07-24T22:18:46.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:45 smithi188 ceph-mon[37380]: pgmap v724: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 4 op/s 2024-07-24T22:18:46.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.271+0000 7f2838fc6640 1 -- 172.21.15.47:0/978274027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2834103f90 msgr2=0x7f283410c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:46.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.271+0000 7f2838fc6640 1 --2- 172.21.15.47:0/978274027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2834103f90 0x7f283410c480 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f281c009900 tx=0x7f281c02a410 comp rx=0 tx=0).stop 2024-07-24T22:18:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.271+0000 7f2838fc6640 1 -- 172.21.15.47:0/978274027 shutdown_connections 2024-07-24T22:18:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.271+0000 7f2838fc6640 1 --2- 172.21.15.47:0/978274027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f283410cad0 0x7f283410ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.271+0000 7f2838fc6640 1 --2- 172.21.15.47:0/978274027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2834103f90 0x7f283410c480 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.271+0000 7f2838fc6640 1 --2- 172.21.15.47:0/978274027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2834103670 0x7f2834103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.271+0000 7f2838fc6640 1 -- 172.21.15.47:0/978274027 >> 172.21.15.47:0/978274027 conn(0x7f28340fd0f0 msgr2=0x7f28340ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.271+0000 7f2838fc6640 1 -- 172.21.15.47:0/978274027 shutdown_connections 2024-07-24T22:18:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.271+0000 7f2838fc6640 1 -- 172.21.15.47:0/978274027 wait complete. 2024-07-24T22:18:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f2838fc6640 1 Processor -- start 2024-07-24T22:18:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f2838fc6640 1 -- start start 2024-07-24T22:18:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f2838fc6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2834103670 0x7f2834198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f2838fc6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2834103f90 0x7f2834199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f2838fc6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f283410cad0 0x7f283419e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f2838fc6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2834112770 con 0x7f2834103670 2024-07-24T22:18:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f2838fc6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f28341125f0 con 0x7f2834103f90 2024-07-24T22:18:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f2838fc6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f28341128f0 con 0x7f283410cad0 2024-07-24T22:18:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f283259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2834103670 0x7f2834198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f283259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2834103670 0x7f2834198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41316/0 (socket says 172.21.15.47:41316) 2024-07-24T22:18:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f283259c640 1 -- 172.21.15.47:0/1788286307 learned_addr learned my addr 172.21.15.47:0/1788286307 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f282bfff640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2834103f90 0x7f2834199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f2832d9d640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f283410cad0 0x7f283419e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f283259c640 1 -- 172.21.15.47:0/1788286307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f283410cad0 msgr2=0x7f283419e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f283259c640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f283410cad0 0x7f283419e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f283259c640 1 -- 172.21.15.47:0/1788286307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2834103f90 msgr2=0x7f2834199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f283259c640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2834103f90 0x7f2834199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.272+0000 7f283259c640 1 -- 172.21.15.47:0/1788286307 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283419ed70 con 0x7f2834103670 2024-07-24T22:18:46.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.273+0000 7f283259c640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2834103670 0x7f2834198cc0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f282400d770 tx=0x7f282400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.273+0000 7f282b7fe640 1 -- 172.21.15.47:0/1788286307 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824017070 con 0x7f2834103670 2024-07-24T22:18:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.273+0000 7f282b7fe640 1 -- 172.21.15.47:0/1788286307 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28240054d0 con 0x7f2834103670 2024-07-24T22:18:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.273+0000 7f2838fc6640 1 -- 172.21.15.47:0/1788286307 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283419f060 con 0x7f2834103670 2024-07-24T22:18:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.273+0000 7f282b7fe640 1 -- 172.21.15.47:0/1788286307 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824004c30 con 0x7f2834103670 2024-07-24T22:18:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.273+0000 7f2838fc6640 1 -- 172.21.15.47:0/1788286307 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28341a5720 con 0x7f2834103670 2024-07-24T22:18:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.275+0000 7f283b377740 1 Processor -- start 2024-07-24T22:18:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.275+0000 7f282b7fe640 1 -- 172.21.15.47:0/1788286307 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f2824004e10 con 0x7f2834103670 2024-07-24T22:18:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f283b377740 1 -- start start 2024-07-24T22:18:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f283b377740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 0x55c243346310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f283b377740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243346850 0x55c2433566b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f283b377740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 0x55c243358fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f283b377740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c2432bd9f0 con 0x55c243356bf0 2024-07-24T22:18:46.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f283b377740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c2432acef0 con 0x55c243346850 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f283b377740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c2432b0f30 con 0x55c243345f30 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f282bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 0x55c243358fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f282bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 0x55c243358fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41318/0 (socket says 172.21.15.47:41318) 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f282bfff640 1 -- 172.21.15.47:0/289616393 learned_addr learned my addr 172.21.15.47:0/289616393 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f2832d9d640 1 --2- 172.21.15.47:0/289616393 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 0x55c243346310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f283259c640 1 --2- 172.21.15.47:0/289616393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243346850 0x55c2433566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f282bfff640 1 -- 172.21.15.47:0/289616393 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 msgr2=0x55c243346310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f282bfff640 1 --2- 172.21.15.47:0/289616393 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 0x55c243346310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f282bfff640 1 -- 172.21.15.47:0/289616393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243346850 msgr2=0x55c2433566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f282bfff640 1 --2- 172.21.15.47:0/289616393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243346850 0x55c2433566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f282bfff640 1 -- 172.21.15.47:0/289616393 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c24300d930 con 0x55c243356bf0 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.276+0000 7f282b7fe640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f28200b3d40 0x7f28200b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.277+0000 7f282bfff640 1 --2- 172.21.15.47:0/289616393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 0x55c243358fe0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f281c005ab0 tx=0x7f281c004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bcc22bc9ee14b3 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:46.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.277+0000 7f2832d9d640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f28200b3d40 0x7f28200b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.277+0000 7f282b7fe640 1 -- 172.21.15.47:0/1788286307 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f28240e3b50 con 0x7f2834103670 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.277+0000 7f2828ff9640 1 -- 172.21.15.47:0/289616393 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c040070 con 0x55c243356bf0 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.277+0000 7f2828ff9640 1 -- 172.21.15.47:0/289616393 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f281c005500 con 0x55c243356bf0 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.277+0000 7f2828ff9640 1 -- 172.21.15.47:0/289616393 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c035040 con 0x55c243356bf0 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 -- 172.21.15.47:0/289616393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 msgr2=0x55c243358fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 --2- 172.21.15.47:0/289616393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 0x55c243358fe0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f281c005ab0 tx=0x7f281c004180 comp rx=0 tx=0).stop 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f2832d9d640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f28200b3d40 0x7f28200b6200 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f282c005fd0 tx=0x7f282c009740 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 -- 172.21.15.47:0/289616393 shutdown_connections 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 --2- 172.21.15.47:0/289616393 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 0x55c243358fe0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 --2- 172.21.15.47:0/289616393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243346850 0x55c2433566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 --2- 172.21.15.47:0/289616393 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 0x55c243346310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 -- 172.21.15.47:0/289616393 >> 172.21.15.47:0/289616393 conn(0x55c243343d60 msgr2=0x55c243344f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 -- 172.21.15.47:0/289616393 shutdown_connections 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 -- 172.21.15.47:0/289616393 wait complete. 2024-07-24T22:18:46.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 -- start start 2024-07-24T22:18:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 Processor -- start 2024-07-24T22:18:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 0x55c243353b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 0x55c2433540c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243356bf0 0x55c243354600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c243110890 con 0x55c243346850 2024-07-24T22:18:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c24324f390 con 0x55c243356bf0 2024-07-24T22:18:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.278+0000 7f283b377740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c243359840 con 0x55c243345f30 2024-07-24T22:18:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f283b377740 10 client.0 _ll_register_callbacks cb 0x55c243259500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f282bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 0x55c2433540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f282bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 0x55c2433540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41326/0 (socket says 172.21.15.47:41326) 2024-07-24T22:18:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f282bfff640 1 -- 172.21.15.47:0/884970356 learned_addr learned my addr 172.21.15.47:0/884970356 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f283259c640 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 0x55c243353b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f2832d9d640 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243356bf0 0x55c243354600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f282bfff640 1 -- 172.21.15.47:0/884970356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 msgr2=0x55c243353b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f282bfff640 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 0x55c243353b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f282bfff640 1 -- 172.21.15.47:0/884970356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243356bf0 msgr2=0x55c243354600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f282bfff640 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243356bf0 0x55c243354600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f282bfff640 1 -- 172.21.15.47:0/884970356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c243249d60 con 0x55c243346850 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f2832d9d640 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243356bf0 0x55c243354600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f282bfff640 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 0x55c2433540c0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f281c009230 tx=0x7f281c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f00efd230fece46 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f2819ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f2819ffb640 1 -- 172.21.15.47:0/884970356 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c040070 con 0x55c243346850 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f2819ffb640 1 -- 172.21.15.47:0/884970356 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f281c004750 con 0x55c243346850 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f283b377740 1 -- 172.21.15.47:0/884970356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f281c005500 con 0x55c243346850 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f2819ffb640 1 -- 172.21.15.47:0/884970356 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f281c057050 con 0x55c243346850 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.279+0000 7f283b377740 10 client.18138 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.280+0000 7f283b377740 1 -- 172.21.15.47:0/884970356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c243365760 con 0x55c243346850 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.280+0000 7f2819ffb640 1 -- 172.21.15.47:0/884970356 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f281c005500 con 0x55c243346850 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.280+0000 7f2819ffb640 1 -- 172.21.15.47:0/884970356 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f281c0314a0 con 0x55c243346850 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.280+0000 7f283b377740 10 client.18138 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.280+0000 7f283b377740 10 client.18138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.280+0000 7f283b377740 20 client.18138 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.280+0000 7f283b377740 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c243366ab0 0x55c243368ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.280+0000 7f283b377740 4 client.18138 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.280+0000 7f283b377740 1 -- 172.21.15.47:0/884970356 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2432bf940 con 0x55c243366ab0 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.280+0000 7f283259c640 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c243366ab0 0x55c243368ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.281+0000 7f283259c640 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c243366ab0 0x55c243368ea0 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81cdf2ff68e30b66 server_cookie=6cefa0eb1c9e7cea in_seq=0 out_seq=0 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.281+0000 7f2819ffb640 10 client.18138 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.281+0000 7f2819ffb640 1 -- 172.21.15.47:0/884970356 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2432bf940 con 0x55c243366ab0 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.281+0000 7f2819ffb640 10 client.18138 handle_command_reply: tid=0 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.281+0000 7f283b377740 1 client.18138 shutdown 2024-07-24T22:18:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.281+0000 7f283b377740 1 -- 172.21.15.47:0/884970356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 msgr2=0x55c2433540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.281+0000 7f283b377740 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 0x55c2433540c0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f281c009230 tx=0x7f281c009260 comp rx=0 tx=0).stop 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.281+0000 7f283b377740 1 -- 172.21.15.47:0/884970356 shutdown_connections 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.281+0000 7f283b377740 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c243366ab0 0x55c243368ea0 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.282+0000 7f283b377740 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243356bf0 0x55c243354600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.282+0000 7f283b377740 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 0x55c2433540c0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.282+0000 7f2819ffb640 0 client.18138 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.282+0000 7f283b377740 1 --2- 172.21.15.47:0/884970356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 0x55c243353b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.282+0000 7f283b377740 1 -- 172.21.15.47:0/884970356 >> 172.21.15.47:0/884970356 conn(0x55c243343d60 msgr2=0x55c2433498d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.282+0000 7f283b377740 1 -- 172.21.15.47:0/884970356 shutdown_connections 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.282+0000 7f283b377740 1 -- 172.21.15.47:0/884970356 wait complete. 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.282+0000 7f283b377740 20 client.18138 trim_cache size 0 max 16384 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.300+0000 7f283b377740 1 Processor -- start 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.300+0000 7f283b377740 1 -- start start 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.300+0000 7f283b377740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243345f30 0x55c243351680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.300+0000 7f283b377740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243346850 0x55c243353090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f283b377740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 0x55c243343610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f283b377740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f28341a9f70 con 0x55c243356bf0 2024-07-24T22:18:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f283b377740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f28341ac7d0 con 0x55c243345f30 2024-07-24T22:18:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f283b377740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f28341aa5c0 con 0x55c243346850 2024-07-24T22:18:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f2832d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 0x55c243343610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f2832d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 0x55c243343610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41338/0 (socket says 172.21.15.47:41338) 2024-07-24T22:18:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f2832d9d640 1 -- 172.21.15.47:0/955203573 learned_addr learned my addr 172.21.15.47:0/955203573 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f283259c640 1 --2- 172.21.15.47:0/955203573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243345f30 0x55c243351680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f282bfff640 1 --2- 172.21.15.47:0/955203573 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243346850 0x55c243353090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f2832d9d640 1 -- 172.21.15.47:0/955203573 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243346850 msgr2=0x55c243353090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f2832d9d640 1 --2- 172.21.15.47:0/955203573 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243346850 0x55c243353090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f2832d9d640 1 -- 172.21.15.47:0/955203573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243345f30 msgr2=0x55c243351680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:46.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f2832d9d640 1 --2- 172.21.15.47:0/955203573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243345f30 0x55c243351680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f2832d9d640 1 -- 172.21.15.47:0/955203573 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c243359780 con 0x55c243356bf0 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f282bfff640 1 --2- 172.21.15.47:0/955203573 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243346850 0x55c243353090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f2832d9d640 1 --2- 172.21.15.47:0/955203573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 0x55c243343610 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f282c01d700 tx=0x7f282c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7a9aa70296f8d2 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f281bfff640 1 -- 172.21.15.47:0/955203573 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c028630 con 0x55c243356bf0 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f281bfff640 1 -- 172.21.15.47:0/955203573 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f282c01de30 con 0x55c243356bf0 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.301+0000 7f281bfff640 1 -- 172.21.15.47:0/955203573 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c0277f0 con 0x55c243356bf0 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.302+0000 7f283b377740 1 -- 172.21.15.47:0/955203573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 msgr2=0x55c243343610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.302+0000 7f283b377740 1 --2- 172.21.15.47:0/955203573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 0x55c243343610 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f282c01d700 tx=0x7f282c015000 comp rx=0 tx=0).stop 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.302+0000 7f283b377740 1 -- 172.21.15.47:0/955203573 shutdown_connections 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.302+0000 7f283b377740 1 --2- 172.21.15.47:0/955203573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243356bf0 0x55c243343610 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.302+0000 7f283b377740 1 --2- 172.21.15.47:0/955203573 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243346850 0x55c243353090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.302+0000 7f283b377740 1 --2- 172.21.15.47:0/955203573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243345f30 0x55c243351680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.302+0000 7f283b377740 1 -- 172.21.15.47:0/955203573 >> 172.21.15.47:0/955203573 conn(0x55c243343d60 msgr2=0x55c243361ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.302+0000 7f283b377740 1 -- 172.21.15.47:0/955203573 shutdown_connections 2024-07-24T22:18:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.302+0000 7f283b377740 1 -- 172.21.15.47:0/955203573 wait complete. 2024-07-24T22:18:46.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.302+0000 7f283b377740 1 -- start start 2024-07-24T22:18:46.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f283b377740 1 Processor -- start 2024-07-24T22:18:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f283b377740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 0x55c243347db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f283b377740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 0x55c2433482f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f283b377740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243356bf0 0x55c243348830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f283b377740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f28341aac90 con 0x55c243346850 2024-07-24T22:18:46.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f283b377740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f28341ac100 con 0x55c243356bf0 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f283b377740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f28341ab360 con 0x55c243345f30 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f283b377740 10 client.0 _ll_register_callbacks cb 0x7f281c005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f282bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 0x55c2433482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f282bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 0x55c2433482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41342/0 (socket says 172.21.15.47:41342) 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f282bfff640 1 -- 172.21.15.47:0/3780613465 learned_addr learned my addr 172.21.15.47:0/3780613465 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f283259c640 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 0x55c243347db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f2832d9d640 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243356bf0 0x55c243348830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f282bfff640 1 -- 172.21.15.47:0/3780613465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 msgr2=0x55c243347db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f282bfff640 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 0x55c243347db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f282bfff640 1 -- 172.21.15.47:0/3780613465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243356bf0 msgr2=0x55c243348830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f282bfff640 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243356bf0 0x55c243348830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f282bfff640 1 -- 172.21.15.47:0/3780613465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2433d0590 con 0x55c243346850 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.303+0000 7f283259c640 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 0x55c243347db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f282bfff640 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 0x55c2433482f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f281c031870 tx=0x7f281c004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b60c68dafbb469 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:46.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f2819ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f2819ffb640 1 -- 172.21.15.47:0/3780613465 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c040070 con 0x55c243346850 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f2819ffb640 1 -- 172.21.15.47:0/3780613465 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f281c005260 con 0x55c243346850 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f283b377740 1 -- 172.21.15.47:0/3780613465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f282c01de30 con 0x55c243346850 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f2819ffb640 1 -- 172.21.15.47:0/3780613465 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f281c035040 con 0x55c243346850 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f283b377740 10 client.18144 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f283b377740 1 -- 172.21.15.47:0/3780613465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c2433d1840 con 0x55c243346850 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f2819ffb640 1 -- 172.21.15.47:0/3780613465 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f282c01de30 con 0x55c243346850 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f2819ffb640 1 -- 172.21.15.47:0/3780613465 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f281c003780 con 0x55c243346850 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f283b377740 10 client.18144 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f283b377740 10 client.18144 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f283b377740 20 client.18144 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f283b377740 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c243366ab0 0x55c2433d4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f283b377740 4 client.18144 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.304+0000 7f283b377740 1 -- 172.21.15.47:0/3780613465 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c2432bb3e0 con 0x55c243366ab0 2024-07-24T22:18:46.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.305+0000 7f283259c640 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c243366ab0 0x55c2433d4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.305+0000 7f2819ffb640 10 client.18144 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.305+0000 7f283259c640 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c243366ab0 0x55c2433d4000 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=583d56d5652bbb53 server_cookie=35585b6ba254f53 in_seq=0 out_seq=0 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.306+0000 7f2819ffb640 1 -- 172.21.15.47:0/3780613465 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c2432bb3e0 con 0x55c243366ab0 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.306+0000 7f2819ffb640 10 client.18144 handle_command_reply: tid=0 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.306+0000 7f283b377740 1 client.18144 shutdown 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.306+0000 7f283b377740 1 -- 172.21.15.47:0/3780613465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 msgr2=0x55c2433482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.306+0000 7f283b377740 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 0x55c2433482f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f281c031870 tx=0x7f281c004300 comp rx=0 tx=0).stop 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f283b377740 1 -- 172.21.15.47:0/3780613465 shutdown_connections 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f283b377740 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x55c243366ab0 0x55c2433d4000 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f283b377740 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c243356bf0 0x55c243348830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f283b377740 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c243346850 0x55c2433482f0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f2819ffb640 0 client.18144 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f283b377740 1 --2- 172.21.15.47:0/3780613465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c243345f30 0x55c243347db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f283b377740 1 -- 172.21.15.47:0/3780613465 >> 172.21.15.47:0/3780613465 conn(0x55c243343d60 msgr2=0x55c2433622f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:46.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f283b377740 1 -- 172.21.15.47:0/3780613465 shutdown_connections 2024-07-24T22:18:46.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f283b377740 1 -- 172.21.15.47:0/3780613465 wait complete. 2024-07-24T22:18:46.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f283b377740 20 client.18144 trim_cache size 0 max 16384 2024-07-24T22:18:46.322 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:18:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-07-24T22:18:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "2787e72f-1199-4b3b-9bb3-782c47708ed7", 2024-07-24T22:18:46.322 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-07-24T22:18:46.322 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:18:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f2838fc6640 1 -- 172.21.15.47:0/1788286307 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f28200b3d40 msgr2=0x7f28200b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f2838fc6640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f28200b3d40 0x7f28200b6200 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f282c005fd0 tx=0x7f282c009740 comp rx=0 tx=0).stop 2024-07-24T22:18:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f2838fc6640 1 -- 172.21.15.47:0/1788286307 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2834103670 msgr2=0x7f2834198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.307+0000 7f2838fc6640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2834103670 0x7f2834198cc0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f282400d770 tx=0x7f282400dc30 comp rx=0 tx=0).stop 2024-07-24T22:18:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.308+0000 7f2838fc6640 1 -- 172.21.15.47:0/1788286307 shutdown_connections 2024-07-24T22:18:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.308+0000 7f2838fc6640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f28200b3d40 0x7f28200b6200 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.308+0000 7f2838fc6640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f283410cad0 0x7f283419e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.308+0000 7f2838fc6640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2834103f90 0x7f2834199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.308+0000 7f2838fc6640 1 --2- 172.21.15.47:0/1788286307 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2834103670 0x7f2834198cc0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.308+0000 7f2838fc6640 1 -- 172.21.15.47:0/1788286307 >> 172.21.15.47:0/1788286307 conn(0x7f28340fd0f0 msgr2=0x7f28340fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.308+0000 7f2838fc6640 1 -- 172.21.15.47:0/1788286307 shutdown_connections 2024-07-24T22:18:46.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:46.308+0000 7f2838fc6640 1 -- 172.21.15.47:0/1788286307 wait complete. 2024-07-24T22:18:47.058 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:46 smithi047 ceph-mon[32551]: scrub queued for path: / 2024-07-24T22:18:47.058 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:46 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:47.058 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:46 smithi047 ceph-mon[32551]: scrub summary: active paths [/] 2024-07-24T22:18:47.058 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:46 smithi047 ceph-mon[32551]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:47.089 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:18:47.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:46 smithi183 ceph-mon[37007]: scrub queued for path: / 2024-07-24T22:18:47.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:46 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:47.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:46 smithi183 ceph-mon[37007]: scrub summary: active paths [/] 2024-07-24T22:18:47.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:46 smithi183 ceph-mon[37007]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:47.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:46 smithi188 ceph-mon[37380]: scrub queued for path: / 2024-07-24T22:18:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:46 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:46 smithi188 ceph-mon[37380]: scrub summary: active paths [/] 2024-07-24T22:18:47.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:46 smithi188 ceph-mon[37380]: scrub summary: idle+waiting paths [/] 2024-07-24T22:18:47.356 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:48.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:47 smithi047 ceph-mon[32551]: pgmap v725: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-07-24T22:18:48.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:47 smithi183 ceph-mon[37007]: pgmap v725: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-07-24T22:18:48.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:47 smithi188 ceph-mon[37380]: pgmap v725: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-07-24T22:18:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.008+0000 7febb67d2640 1 -- 172.21.15.47:0/1395544739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febb0101660 msgr2=0x7febb0101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.008+0000 7febb67d2640 1 --2- 172.21.15.47:0/1395544739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febb0101660 0x7febb0101a40 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7feba0009900 tx=0x7feba002a410 comp rx=0 tx=0).stop 2024-07-24T22:18:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.008+0000 7febb67d2640 1 -- 172.21.15.47:0/1395544739 shutdown_connections 2024-07-24T22:18:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.008+0000 7febb67d2640 1 --2- 172.21.15.47:0/1395544739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7febb01079f0 0x7febb010e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.008+0000 7febb67d2640 1 --2- 172.21.15.47:0/1395544739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febb0107070 0x7febb01074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.008+0000 7febb67d2640 1 --2- 172.21.15.47:0/1395544739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febb0101660 0x7febb0101a40 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.008+0000 7febb67d2640 1 -- 172.21.15.47:0/1395544739 >> 172.21.15.47:0/1395544739 conn(0x7febb00fd0f0 msgr2=0x7febb00ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.008+0000 7febb67d2640 1 -- 172.21.15.47:0/1395544739 shutdown_connections 2024-07-24T22:18:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.008+0000 7febb67d2640 1 -- 172.21.15.47:0/1395544739 wait complete. 2024-07-24T22:18:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.008+0000 7febb67d2640 1 Processor -- start 2024-07-24T22:18:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb67d2640 1 -- start start 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb67d2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7febb0101660 0x7febb0199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb67d2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febb0107070 0x7febb0199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb67d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febb01079f0 0x7febb01a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb67d2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7febb0111620 con 0x7febb01079f0 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb67d2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7febb01114a0 con 0x7febb0107070 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb67d2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7febb01117a0 con 0x7febb0101660 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb4d6f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febb01079f0 0x7febb01a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb4d6f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febb01079f0 0x7febb01a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41354/0 (socket says 172.21.15.47:41354) 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb4d6f640 1 -- 172.21.15.47:0/1371099392 learned_addr learned my addr 172.21.15.47:0/1371099392 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febaffff640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7febb0101660 0x7febb0199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febaf7fe640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febb0107070 0x7febb0199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb4d6f640 1 -- 172.21.15.47:0/1371099392 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7febb0101660 msgr2=0x7febb0199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb4d6f640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7febb0101660 0x7febb0199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb4d6f640 1 -- 172.21.15.47:0/1371099392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febb0107070 msgr2=0x7febb0199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb4d6f640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febb0107070 0x7febb0199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.009+0000 7febb4d6f640 1 -- 172.21.15.47:0/1371099392 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb01a5010 con 0x7febb01079f0 2024-07-24T22:18:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.010+0000 7febb4d6f640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febb01079f0 0x7febb01a4ad0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7feba800eaa0 tx=0x7feba800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.010+0000 7febad7fa640 1 -- 172.21.15.47:0/1371099392 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba800cdb0 con 0x7febb01079f0 2024-07-24T22:18:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.010+0000 7febad7fa640 1 -- 172.21.15.47:0/1371099392 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba8005020 con 0x7febb01079f0 2024-07-24T22:18:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.010+0000 7febad7fa640 1 -- 172.21.15.47:0/1371099392 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba80116d0 con 0x7febb01079f0 2024-07-24T22:18:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.010+0000 7febb67d2640 1 -- 172.21.15.47:0/1371099392 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb01a51e0 con 0x7febb01079f0 2024-07-24T22:18:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.010+0000 7febb67d2640 1 -- 172.21.15.47:0/1371099392 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb01a56e0 con 0x7febb01079f0 2024-07-24T22:18:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.013+0000 7febb8b83740 1 Processor -- start 2024-07-24T22:18:49.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.013+0000 7febad7fa640 1 -- 172.21.15.47:0/1371099392 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7feba80051d0 con 0x7febb01079f0 2024-07-24T22:18:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.013+0000 7febb8b83740 1 -- start start 2024-07-24T22:18:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.013+0000 7febb8b83740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 0x5628b58dda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.013+0000 7febb8b83740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58ddfa0 0x5628b58e99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.013+0000 7febb8b83740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58e9f30 0x5628b58ec320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.013+0000 7febb8b83740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5628b5854960 con 0x5628b58dd680 2024-07-24T22:18:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.013+0000 7febb8b83740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5628b5843e60 con 0x5628b58ddfa0 2024-07-24T22:18:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.013+0000 7febb8b83740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5628b5847ea0 con 0x5628b58e9f30 2024-07-24T22:18:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febaf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 0x5628b58dda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febaf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 0x5628b58dda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41370/0 (socket says 172.21.15.47:41370) 2024-07-24T22:18:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febaf7fe640 1 -- 172.21.15.47:0/1289506453 learned_addr learned my addr 172.21.15.47:0/1289506453 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febaf7fe640 1 --2- 172.21.15.47:0/1289506453 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58e9f30 0x5628b58ec320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febaffff640 1 --2- 172.21.15.47:0/1289506453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58ddfa0 0x5628b58e99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febaf7fe640 1 -- 172.21.15.47:0/1289506453 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58e9f30 msgr2=0x5628b58ec320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:49.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febaf7fe640 1 --2- 172.21.15.47:0/1289506453 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58e9f30 0x5628b58ec320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febaf7fe640 1 -- 172.21.15.47:0/1289506453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58ddfa0 msgr2=0x5628b58e99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:49.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febaf7fe640 1 --2- 172.21.15.47:0/1289506453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58ddfa0 0x5628b58e99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febaf7fe640 1 -- 172.21.15.47:0/1289506453 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b57cd2d0 con 0x5628b58dd680 2024-07-24T22:18:49.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febad7fa640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7feb980b3dc0 0x7feb980b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febaffff640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7feb980b3dc0 0x7feb980b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febaf7fe640 1 --2- 172.21.15.47:0/1289506453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 0x5628b58dda60 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7feba400bfa0 tx=0x7feba400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716d005890b11fac server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:49.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7febad7fa640 1 -- 172.21.15.47:0/1371099392 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7feba80e40b0 con 0x7febb01079f0 2024-07-24T22:18:49.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7feb967fc640 1 -- 172.21.15.47:0/1289506453 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4004030 con 0x5628b58dd680 2024-07-24T22:18:49.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7feb967fc640 1 -- 172.21.15.47:0/1289506453 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba40041d0 con 0x5628b58dd680 2024-07-24T22:18:49.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.014+0000 7feb967fc640 1 -- 172.21.15.47:0/1289506453 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4010660 con 0x5628b58dd680 2024-07-24T22:18:49.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.015+0000 7febb8b83740 1 -- 172.21.15.47:0/1289506453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 msgr2=0x5628b58dda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:49.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.015+0000 7febaffff640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7feb980b3dc0 0x7feb980b6280 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feba0031440 tx=0x7feba0005890 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:49.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.015+0000 7febb8b83740 1 --2- 172.21.15.47:0/1289506453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 0x5628b58dda60 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7feba400bfa0 tx=0x7feba400b840 comp rx=0 tx=0).stop 2024-07-24T22:18:49.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.015+0000 7febb8b83740 1 -- 172.21.15.47:0/1289506453 shutdown_connections 2024-07-24T22:18:49.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.015+0000 7febb8b83740 1 --2- 172.21.15.47:0/1289506453 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58e9f30 0x5628b58ec320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.015+0000 7febb8b83740 1 --2- 172.21.15.47:0/1289506453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58ddfa0 0x5628b58e99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.015+0000 7febb8b83740 1 --2- 172.21.15.47:0/1289506453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 0x5628b58dda60 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.015+0000 7febb8b83740 1 -- 172.21.15.47:0/1289506453 >> 172.21.15.47:0/1289506453 conn(0x5628b58db4b0 msgr2=0x5628b58dc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:49.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.015+0000 7febb8b83740 1 -- 172.21.15.47:0/1289506453 shutdown_connections 2024-07-24T22:18:49.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.015+0000 7febb8b83740 1 -- 172.21.15.47:0/1289506453 wait complete. 2024-07-24T22:18:49.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.015+0000 7febb8b83740 1 -- start start 2024-07-24T22:18:49.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb8b83740 1 Processor -- start 2024-07-24T22:18:49.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb8b83740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58dd680 0x5628b58e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb8b83740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58ddfa0 0x5628b58e73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb8b83740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58e9f30 0x5628b58e7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb8b83740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5628b56a7700 con 0x5628b58e9f30 2024-07-24T22:18:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb8b83740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5628b57e65a0 con 0x5628b58dd680 2024-07-24T22:18:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb8b83740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5628b58ecbb0 con 0x5628b58ddfa0 2024-07-24T22:18:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb8b83740 10 client.0 _ll_register_callbacks cb 0x5628b5806910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb4d6f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58e9f30 0x5628b58e7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb4d6f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58e9f30 0x5628b58e7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41380/0 (socket says 172.21.15.47:41380) 2024-07-24T22:18:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb4d6f640 1 -- 172.21.15.47:0/672516641 learned_addr learned my addr 172.21.15.47:0/672516641 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febaf7fe640 1 --2- 172.21.15.47:0/672516641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58ddfa0 0x5628b58e73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febaffff640 1 --2- 172.21.15.47:0/672516641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58dd680 0x5628b58e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb4d6f640 1 -- 172.21.15.47:0/672516641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58ddfa0 msgr2=0x5628b58e73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb4d6f640 1 --2- 172.21.15.47:0/672516641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58ddfa0 0x5628b58e73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb4d6f640 1 -- 172.21.15.47:0/672516641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58dd680 msgr2=0x5628b58e6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.016+0000 7febb4d6f640 1 --2- 172.21.15.47:0/672516641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58dd680 0x5628b58e6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7febb4d6f640 1 -- 172.21.15.47:0/672516641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b57d9630 con 0x5628b58e9f30 2024-07-24T22:18:49.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7febb4d6f640 1 --2- 172.21.15.47:0/672516641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58e9f30 0x5628b58e7930 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7feba80aaa40 tx=0x7feba80aae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3305ec7ec7e30bf server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:49.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7feb8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:49.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7feb8f7fe640 1 -- 172.21.15.47:0/672516641 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba801f040 con 0x5628b58e9f30 2024-07-24T22:18:49.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7feb8f7fe640 1 -- 172.21.15.47:0/672516641 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7feba80a9fa0 con 0x5628b58e9f30 2024-07-24T22:18:49.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7febb8b83740 1 -- 172.21.15.47:0/672516641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feba40041d0 con 0x5628b58e9f30 2024-07-24T22:18:49.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7feb8f7fe640 1 -- 172.21.15.47:0/672516641 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7feba80aa1a0 con 0x5628b58e9f30 2024-07-24T22:18:49.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7febb8b83740 10 client.18156 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:49.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7febb8b83740 1 -- 172.21.15.47:0/672516641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5628b55a4650 con 0x5628b58e9f30 2024-07-24T22:18:49.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7feb8f7fe640 1 -- 172.21.15.47:0/672516641 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba40041d0 con 0x5628b58e9f30 2024-07-24T22:18:49.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7feb8f7fe640 1 -- 172.21.15.47:0/672516641 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7feba800f040 con 0x5628b58e9f30 2024-07-24T22:18:49.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7febb8b83740 10 client.18156 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:49.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7febb8b83740 10 client.18156 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:49.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7febb8b83740 20 client.18156 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:49.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.017+0000 7febb8b83740 1 --2- 172.21.15.47:0/672516641 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5628b58f9ac0 0x5628b58fbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.018+0000 7febb8b83740 4 client.18156 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:49.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.018+0000 7febb8b83740 1 -- 172.21.15.47:0/672516641 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628b58568b0 con 0x5628b58f9ac0 2024-07-24T22:18:49.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.018+0000 7febaffff640 1 --2- 172.21.15.47:0/672516641 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5628b58f9ac0 0x5628b58fbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.018+0000 7feb8f7fe640 10 client.18156 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:49.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.018+0000 7febaffff640 1 --2- 172.21.15.47:0/672516641 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5628b58f9ac0 0x5628b58fbed0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e954c92a5576659d server_cookie=49d17279842095f0 in_seq=0 out_seq=0 2024-07-24T22:18:49.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7feb8f7fe640 1 -- 172.21.15.47:0/672516641 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628b58568b0 con 0x5628b58f9ac0 2024-07-24T22:18:49.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7feb8f7fe640 10 client.18156 handle_command_reply: tid=0 2024-07-24T22:18:49.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7febb8b83740 1 client.18156 shutdown 2024-07-24T22:18:49.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7febb8b83740 1 -- 172.21.15.47:0/672516641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58e9f30 msgr2=0x5628b58e7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:49.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7febb8b83740 1 --2- 172.21.15.47:0/672516641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58e9f30 0x5628b58e7930 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7feba80aaa40 tx=0x7feba80aae00 comp rx=0 tx=0).stop 2024-07-24T22:18:49.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7febb8b83740 1 -- 172.21.15.47:0/672516641 shutdown_connections 2024-07-24T22:18:49.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7febb8b83740 1 --2- 172.21.15.47:0/672516641 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5628b58f9ac0 0x5628b58fbed0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7febb8b83740 1 --2- 172.21.15.47:0/672516641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58e9f30 0x5628b58e7930 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7febb8b83740 1 --2- 172.21.15.47:0/672516641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58ddfa0 0x5628b58e73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7febb8b83740 1 --2- 172.21.15.47:0/672516641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58dd680 0x5628b58e6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7febb8b83740 1 -- 172.21.15.47:0/672516641 >> 172.21.15.47:0/672516641 conn(0x5628b58db4b0 msgr2=0x5628b58e1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:49.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7feb8f7fe640 0 client.18156 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:49.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7febb8b83740 1 -- 172.21.15.47:0/672516641 shutdown_connections 2024-07-24T22:18:49.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7febb8b83740 1 -- 172.21.15.47:0/672516641 wait complete. 2024-07-24T22:18:49.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.019+0000 7febb8b83740 20 client.18156 trim_cache size 0 max 16384 2024-07-24T22:18:49.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.038+0000 7febb8b83740 1 Processor -- start 2024-07-24T22:18:49.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.038+0000 7febb8b83740 1 -- start start 2024-07-24T22:18:49.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.038+0000 7febb8b83740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58dd680 0x5628b59017a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.038+0000 7febb8b83740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58ddfa0 0x5628b5901ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.038+0000 7febb8b83740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58e9f30 0x5628b58e6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.038+0000 7febb8b83740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7febb01ac280 con 0x5628b58ddfa0 2024-07-24T22:18:49.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.038+0000 7febb8b83740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7febb01aeae0 con 0x5628b58e9f30 2024-07-24T22:18:49.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.038+0000 7febb8b83740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7febb01ac8d0 con 0x5628b58dd680 2024-07-24T22:18:49.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.038+0000 7febaf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58ddfa0 0x5628b5901ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.038+0000 7febaf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58ddfa0 0x5628b5901ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41396/0 (socket says 172.21.15.47:41396) 2024-07-24T22:18:49.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.038+0000 7febaf7fe640 1 -- 172.21.15.47:0/1392156255 learned_addr learned my addr 172.21.15.47:0/1392156255 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:49.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.039+0000 7febb4d6f640 1 --2- 172.21.15.47:0/1392156255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58e9f30 0x5628b58e6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.039+0000 7febaffff640 1 --2- 172.21.15.47:0/1392156255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58dd680 0x5628b59017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.039+0000 7febaf7fe640 1 -- 172.21.15.47:0/1392156255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58dd680 msgr2=0x5628b59017a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:49.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.039+0000 7febaf7fe640 1 --2- 172.21.15.47:0/1392156255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58dd680 0x5628b59017a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.039+0000 7febaf7fe640 1 -- 172.21.15.47:0/1392156255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58e9f30 msgr2=0x5628b58e6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:49.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.039+0000 7febaf7fe640 1 --2- 172.21.15.47:0/1392156255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58e9f30 0x5628b58e6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.039+0000 7febaf7fe640 1 -- 172.21.15.47:0/1392156255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b58d6e40 con 0x5628b58ddfa0 2024-07-24T22:18:49.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.039+0000 7febaf7fe640 1 --2- 172.21.15.47:0/1392156255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58ddfa0 0x5628b5901ce0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7feba4003cc0 tx=0x7feba400b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3ffe1de7898270 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:49.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.039+0000 7feb95ffb640 1 -- 172.21.15.47:0/1392156255 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba40035f0 con 0x5628b58ddfa0 2024-07-24T22:18:49.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.039+0000 7feb95ffb640 1 -- 172.21.15.47:0/1392156255 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba40054f0 con 0x5628b58ddfa0 2024-07-24T22:18:49.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.039+0000 7feb95ffb640 1 -- 172.21.15.47:0/1392156255 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba40106c0 con 0x5628b58ddfa0 2024-07-24T22:18:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.040+0000 7febb8b83740 1 -- 172.21.15.47:0/1392156255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58ddfa0 msgr2=0x5628b5901ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.040+0000 7febb8b83740 1 --2- 172.21.15.47:0/1392156255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58ddfa0 0x5628b5901ce0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7feba4003cc0 tx=0x7feba400b570 comp rx=0 tx=0).stop 2024-07-24T22:18:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.040+0000 7febb8b83740 1 -- 172.21.15.47:0/1392156255 shutdown_connections 2024-07-24T22:18:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.040+0000 7febb8b83740 1 --2- 172.21.15.47:0/1392156255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58e9f30 0x5628b58e6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.040+0000 7febb8b83740 1 --2- 172.21.15.47:0/1392156255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58ddfa0 0x5628b5901ce0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.040+0000 7febb8b83740 1 --2- 172.21.15.47:0/1392156255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58dd680 0x5628b59017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.040+0000 7febb8b83740 1 -- 172.21.15.47:0/1392156255 >> 172.21.15.47:0/1392156255 conn(0x5628b58db4b0 msgr2=0x5628b58e8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.040+0000 7febb8b83740 1 -- 172.21.15.47:0/1392156255 shutdown_connections 2024-07-24T22:18:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.040+0000 7febb8b83740 1 -- 172.21.15.47:0/1392156255 wait complete. 2024-07-24T22:18:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.040+0000 7febb8b83740 1 -- start start 2024-07-24T22:18:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.040+0000 7febb8b83740 1 Processor -- start 2024-07-24T22:18:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febb8b83740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 0x5628b58f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febb8b83740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58ddfa0 0x5628b58f2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febb8b83740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58e9f30 0x5628b58ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febb8b83740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7febb01acfa0 con 0x5628b58dd680 2024-07-24T22:18:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febb8b83740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7febb01ae410 con 0x5628b58e9f30 2024-07-24T22:18:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febb8b83740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7febb01ad670 con 0x5628b58ddfa0 2024-07-24T22:18:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febb8b83740 10 client.0 _ll_register_callbacks cb 0x7feba80a6cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febaffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 0x5628b58f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febaffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 0x5628b58f21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41406/0 (socket says 172.21.15.47:41406) 2024-07-24T22:18:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febaffff640 1 -- 172.21.15.47:0/2825806267 learned_addr learned my addr 172.21.15.47:0/2825806267 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febaf7fe640 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58ddfa0 0x5628b58f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febb4d6f640 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58e9f30 0x5628b58ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febaffff640 1 -- 172.21.15.47:0/2825806267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58ddfa0 msgr2=0x5628b58f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febaffff640 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58ddfa0 0x5628b58f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febaffff640 1 -- 172.21.15.47:0/2825806267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58e9f30 msgr2=0x5628b58ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febaffff640 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58e9f30 0x5628b58ed8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febaffff640 1 -- 172.21.15.47:0/2825806267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b58ee0e0 con 0x5628b58dd680 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febaf7fe640 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58ddfa0 0x5628b58f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7febaffff640 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 0x5628b58f21c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7feba0009900 tx=0x7feba0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ab10c76f0c58c0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.041+0000 7feb8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7feb8f7fe640 1 -- 172.21.15.47:0/2825806267 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0058060 con 0x5628b58dd680 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7feb8f7fe640 1 -- 172.21.15.47:0/2825806267 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7feba0005040 con 0x5628b58dd680 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7febb8b83740 1 -- 172.21.15.47:0/2825806267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feba40054f0 con 0x5628b58dd680 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7feb8f7fe640 1 -- 172.21.15.47:0/2825806267 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7feba0035040 con 0x5628b58dd680 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7febb8b83740 10 client.18162 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7febb8b83740 1 -- 172.21.15.47:0/2825806267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5628b5964520 con 0x5628b58dd680 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7feb8f7fe640 1 -- 172.21.15.47:0/2825806267 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba40054f0 con 0x5628b58dd680 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7feb8f7fe640 1 -- 172.21.15.47:0/2825806267 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7feba0052070 con 0x5628b58dd680 2024-07-24T22:18:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7febb8b83740 10 client.18162 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:49.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7febb8b83740 10 client.18162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:49.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7febb8b83740 20 client.18162 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:49.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7febb8b83740 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5628b5964c80 0x5628b59670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:49.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7febb8b83740 4 client.18162 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:18:49.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.042+0000 7febb8b83740 1 -- 172.21.15.47:0/2825806267 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5628b5852350 con 0x5628b5964c80 2024-07-24T22:18:49.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7febaf7fe640 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5628b5964c80 0x5628b59670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:49.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7feb8f7fe640 10 client.18162 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:49.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7febaf7fe640 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5628b5964c80 0x5628b59670a0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3bc4a848eadae9 server_cookie=e98487a5d1bca801 in_seq=0 out_seq=0 2024-07-24T22:18:49.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7feb8f7fe640 1 -- 172.21.15.47:0/2825806267 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5628b5852350 con 0x5628b5964c80 2024-07-24T22:18:49.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7feb8f7fe640 10 client.18162 handle_command_reply: tid=0 2024-07-24T22:18:49.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7febb8b83740 1 client.18162 shutdown 2024-07-24T22:18:49.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7febb8b83740 1 -- 172.21.15.47:0/2825806267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 msgr2=0x5628b58f21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:49.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7febb8b83740 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 0x5628b58f21c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7feba0009900 tx=0x7feba0009260 comp rx=0 tx=0).stop 2024-07-24T22:18:49.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7febb8b83740 1 -- 172.21.15.47:0/2825806267 shutdown_connections 2024-07-24T22:18:49.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7febb8b83740 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5628b5964c80 0x5628b59670a0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7febb8b83740 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5628b58e9f30 0x5628b58ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7febb8b83740 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628b58ddfa0 0x5628b58f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7febb8b83740 1 --2- 172.21.15.47:0/2825806267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628b58dd680 0x5628b58f21c0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7febb8b83740 1 -- 172.21.15.47:0/2825806267 >> 172.21.15.47:0/2825806267 conn(0x5628b58db4b0 msgr2=0x5628b58e6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:49.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.043+0000 7feb8f7fe640 0 client.18162 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:49.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb8b83740 1 -- 172.21.15.47:0/2825806267 shutdown_connections 2024-07-24T22:18:49.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb8b83740 1 -- 172.21.15.47:0/2825806267 wait complete. 2024-07-24T22:18:49.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb8b83740 20 client.18162 trim_cache size 0 max 16384 2024-07-24T22:18:49.054 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:18:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-07-24T22:18:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-07-24T22:18:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "2787e72f-1199-4b3b-9bb3-782c47708ed7": { 2024-07-24T22:18:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-07-24T22:18:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "2787e72f-1199-4b3b-9bb3-782c47708ed7", 2024-07-24T22:18:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-07-24T22:18:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:18:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:18:49.054 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:18:49.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb67d2640 1 -- 172.21.15.47:0/1371099392 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7feb980b3dc0 msgr2=0x7feb980b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:49.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb67d2640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7feb980b3dc0 0x7feb980b6280 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feba0031440 tx=0x7feba0005890 comp rx=0 tx=0).stop 2024-07-24T22:18:49.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb67d2640 1 -- 172.21.15.47:0/1371099392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febb01079f0 msgr2=0x7febb01a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:49.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb67d2640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febb01079f0 0x7febb01a4ad0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7feba800eaa0 tx=0x7feba800ef60 comp rx=0 tx=0).stop 2024-07-24T22:18:49.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb67d2640 1 -- 172.21.15.47:0/1371099392 shutdown_connections 2024-07-24T22:18:49.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb67d2640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7feb980b3dc0 0x7feb980b6280 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb67d2640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febb01079f0 0x7febb01a4ad0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb67d2640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febb0107070 0x7febb0199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb67d2640 1 --2- 172.21.15.47:0/1371099392 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7febb0101660 0x7febb0199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:49.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb67d2640 1 -- 172.21.15.47:0/1371099392 >> 172.21.15.47:0/1371099392 conn(0x7febb00fd0f0 msgr2=0x7febb00fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:49.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb67d2640 1 -- 172.21.15.47:0/1371099392 shutdown_connections 2024-07-24T22:18:49.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:49.044+0000 7febb67d2640 1 -- 172.21.15.47:0/1371099392 wait complete. 2024-07-24T22:18:49.894 INFO:tasks.cephfs.filesystem:scrub status for tag:2787e72f-1199-4b3b-9bb3-782c47708ed7 - {'path': '/', 'tag': '2787e72f-1199-4b3b-9bb3-782c47708ed7', 'options': 'recursive,force'} 2024-07-24T22:18:50.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:49 smithi183 ceph-mon[37007]: pgmap v726: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 5 op/s 2024-07-24T22:18:50.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:49 smithi047 ceph-mon[32551]: pgmap v726: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 5 op/s 2024-07-24T22:18:50.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:49 smithi188 ceph-mon[37380]: pgmap v726: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 5 op/s 2024-07-24T22:18:51.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:50 smithi183 ceph-mon[37007]: scrub summary: idle 2024-07-24T22:18:51.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:50 smithi047 ceph-mon[32551]: scrub summary: idle 2024-07-24T22:18:51.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:50 smithi188 ceph-mon[37380]: scrub summary: idle 2024-07-24T22:18:52.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:51 smithi183 ceph-mon[37007]: pgmap v727: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:18:52.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:51 smithi047 ceph-mon[32551]: pgmap v727: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:18:52.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:51 smithi188 ceph-mon[37380]: pgmap v727: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-07-24T22:18:52.768 INFO:tasks.workunit.client.0.smithi047.stdout:stopping iogen 2024-07-24T22:18:52.768 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo 'stopping iogen' 2024-07-24T22:18:52.769 INFO:tasks.workunit.client.0.smithi047.stderr:+ ./iogen -k 2024-07-24T22:18:52.772 INFO:tasks.workunit.client.0.smithi047.stdout:OK 2024-07-24T22:18:52.772 INFO:tasks.workunit.client.0.smithi047.stderr:+ echo OK 2024-07-24T22:18:54.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:53 smithi183 ceph-mon[37007]: pgmap v728: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:18:54.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:53 smithi047 ceph-mon[32551]: pgmap v728: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:18:54.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:53 smithi188 ceph-mon[37380]: pgmap v728: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-07-24T22:18:54.793 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-07-24T22:18:54.793 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-07-24T22:18:54.882 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2024-07-24T22:18:54.882 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-07-24T22:18:55.179 DEBUG:teuthology.parallel:result is None 2024-07-24T22:18:55.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-07-24T22:18:55.209 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-07-24T22:18:55.209 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-07-24T22:18:55.220 INFO:tasks.quiescer:joining Quiescers 2024-07-24T22:18:55.220 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-07-24T22:18:55.220 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:18:55.511 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:56.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:55 smithi183 ceph-mon[37007]: pgmap v729: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-07-24T22:18:56.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:55 smithi047 ceph-mon[32551]: pgmap v729: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-07-24T22:18:56.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:55 smithi188 ceph-mon[37380]: pgmap v729: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-07-24T22:18:57.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.546+0000 7fbb1759e640 1 -- 172.21.15.47:0/2849290313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb10094b00 msgr2=0x7fbb10094ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:57.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.546+0000 7fbb1759e640 1 --2- 172.21.15.47:0/2849290313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb10094b00 0x7fbb10094ee0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009900 tx=0x7fbb0802a410 comp rx=0 tx=0).stop 2024-07-24T22:18:57.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.546+0000 7fbb1759e640 1 -- 172.21.15.47:0/2849290313 shutdown_connections 2024-07-24T22:18:57.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.546+0000 7fbb1759e640 1 --2- 172.21.15.47:0/2849290313 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb100978d0 0x7fbb100a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:57.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.546+0000 7fbb1759e640 1 --2- 172.21.15.47:0/2849290313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb10096f30 0x7fbb10097390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:57.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.546+0000 7fbb1759e640 1 --2- 172.21.15.47:0/2849290313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb10094b00 0x7fbb10094ee0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:57.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.546+0000 7fbb1759e640 1 -- 172.21.15.47:0/2849290313 >> 172.21.15.47:0/2849290313 conn(0x7fbb1000a150 msgr2=0x7fbb1000c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:57.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.546+0000 7fbb1759e640 1 -- 172.21.15.47:0/2849290313 shutdown_connections 2024-07-24T22:18:57.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.546+0000 7fbb1759e640 1 -- 172.21.15.47:0/2849290313 wait complete. 2024-07-24T22:18:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.548+0000 7fbb1759e640 1 Processor -- start 2024-07-24T22:18:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.548+0000 7fbb1759e640 1 -- start start 2024-07-24T22:18:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.548+0000 7fbb1759e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb10094b00 0x7fbb1013ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.548+0000 7fbb1759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb10096f30 0x7fbb1013b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.548+0000 7fbb1759e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb100978d0 0x7fbb101403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.548+0000 7fbb15d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb10096f30 0x7fbb1013b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.548+0000 7fbb15d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb10096f30 0x7fbb1013b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57100/0 (socket says 172.21.15.47:57100) 2024-07-24T22:18:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.548+0000 7fbb15d9b640 1 -- 172.21.15.47:0/2823066059 learned_addr learned my addr 172.21.15.47:0/2823066059 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.549+0000 7fbb16d9d640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb100978d0 0x7fbb101403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.548+0000 7fbb1659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb10094b00 0x7fbb1013ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.549+0000 7fbb1759e640 1 -- 172.21.15.47:0/2823066059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb100a3650 con 0x7fbb10096f30 2024-07-24T22:18:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.549+0000 7fbb1759e640 1 -- 172.21.15.47:0/2823066059 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbb100a34d0 con 0x7fbb100978d0 2024-07-24T22:18:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.549+0000 7fbb1759e640 1 -- 172.21.15.47:0/2823066059 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbb100a37d0 con 0x7fbb10094b00 2024-07-24T22:18:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.550+0000 7fbb16d9d640 1 -- 172.21.15.47:0/2823066059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb10094b00 msgr2=0x7fbb1013ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.550+0000 7fbb16d9d640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb10094b00 0x7fbb1013ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.550+0000 7fbb16d9d640 1 -- 172.21.15.47:0/2823066059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb10096f30 msgr2=0x7fbb1013b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.550+0000 7fbb16d9d640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb10096f30 0x7fbb1013b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.550+0000 7fbb16d9d640 1 -- 172.21.15.47:0/2823066059 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb10140bc0 con 0x7fbb100978d0 2024-07-24T22:18:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.550+0000 7fbb1659c640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb10094b00 0x7fbb1013ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.551+0000 7fbb16d9d640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb100978d0 0x7fbb101403f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbb1802e590 tx=0x7fbb1807ae40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.552+0000 7fbb077fe640 1 -- 172.21.15.47:0/2823066059 <== mon.2 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18078a50 con 0x7fbb100978d0 2024-07-24T22:18:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.552+0000 7fbb077fe640 1 -- 172.21.15.47:0/2823066059 <== mon.2 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb18078bf0 con 0x7fbb100978d0 2024-07-24T22:18:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.552+0000 7fbb1759e640 1 -- 172.21.15.47:0/2823066059 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb10140eb0 con 0x7fbb100978d0 2024-07-24T22:18:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.552+0000 7fbb1759e640 1 -- 172.21.15.47:0/2823066059 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb10147570 con 0x7fbb100978d0 2024-07-24T22:18:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.552+0000 7fbb077fe640 1 -- 172.21.15.47:0/2823066059 <== mon.2 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18072370 con 0x7fbb100978d0 2024-07-24T22:18:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.554+0000 7fbb1759e640 1 -- 172.21.15.47:0/2823066059 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf80052c0 con 0x7fbb100978d0 2024-07-24T22:18:57.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.557+0000 7fbb077fe640 1 -- 172.21.15.47:0/2823066059 <== mon.2 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fbb18073410 con 0x7fbb100978d0 2024-07-24T22:18:57.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.558+0000 7fbb077fe640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb000b3f50 0x7fbb000b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:57.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.558+0000 7fbb077fe640 1 -- 172.21.15.47:0/2823066059 <== mon.2 v2:172.21.15.183:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fbb18148760 con 0x7fbb100978d0 2024-07-24T22:18:57.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.558+0000 7fbb1659c640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb000b3f50 0x7fbb000b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:57.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.560+0000 7fbb1659c640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb000b3f50 0x7fbb000b6410 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbb08000c00 tx=0x7fbb08004220 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:57.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:57.566+0000 7fbb077fe640 1 -- 172.21.15.47:0/2823066059 <== mon.2 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fbb1807f020 con 0x7fbb100978d0 2024-07-24T22:18:58.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.002+0000 7fbb1759e640 1 -- 172.21.15.47:0/2823066059 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbaf8005880 con 0x7fbb100978d0 2024-07-24T22:18:58.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.004+0000 7fbb077fe640 1 -- 172.21.15.47:0/2823066059 <== mon.2 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7fbb1810f9e0 con 0x7fbb100978d0 2024-07-24T22:18:58.007 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:18:58.007 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:18:58.007 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:18:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.007+0000 7fbb1759e640 1 -- 172.21.15.47:0/2823066059 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb000b3f50 msgr2=0x7fbb000b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.007+0000 7fbb1759e640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb000b3f50 0x7fbb000b6410 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbb08000c00 tx=0x7fbb08004220 comp rx=0 tx=0).stop 2024-07-24T22:18:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.007+0000 7fbb1759e640 1 -- 172.21.15.47:0/2823066059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb100978d0 msgr2=0x7fbb101403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.007+0000 7fbb1759e640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb100978d0 0x7fbb101403f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbb1802e590 tx=0x7fbb1807ae40 comp rx=0 tx=0).stop 2024-07-24T22:18:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.008+0000 7fbb1759e640 1 -- 172.21.15.47:0/2823066059 shutdown_connections 2024-07-24T22:18:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.008+0000 7fbb1759e640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fbb000b3f50 0x7fbb000b6410 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.008+0000 7fbb1759e640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb100978d0 0x7fbb101403f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.008+0000 7fbb1759e640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb10096f30 0x7fbb1013b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.008+0000 7fbb1759e640 1 --2- 172.21.15.47:0/2823066059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb10094b00 0x7fbb1013ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.008+0000 7fbb1759e640 1 -- 172.21.15.47:0/2823066059 >> 172.21.15.47:0/2823066059 conn(0x7fbb1000a150 msgr2=0x7fbb10098020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.009+0000 7fbb1759e640 1 -- 172.21.15.47:0/2823066059 shutdown_connections 2024-07-24T22:18:58.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:18:58.011+0000 7fbb1759e640 1 -- 172.21.15.47:0/2823066059 wait complete. 2024-07-24T22:18:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.106+0000 7fb0a9048640 1 -- 172.21.15.47:0/2300184451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a41035a0 msgr2=0x7fb0a4103980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.106+0000 7fb0a9048640 1 --2- 172.21.15.47:0/2300184451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a41035a0 0x7fb0a4103980 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fb094009900 tx=0x7fb09402a410 comp rx=0 tx=0).stop 2024-07-24T22:18:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.106+0000 7fb0a9048640 1 -- 172.21.15.47:0/2300184451 shutdown_connections 2024-07-24T22:18:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.106+0000 7fb0a9048640 1 --2- 172.21.15.47:0/2300184451 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0a410c9f0 0x7fb0a410ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.106+0000 7fb0a9048640 1 --2- 172.21.15.47:0/2300184451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0a4103ec0 0x7fb0a410c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.106+0000 7fb0a9048640 1 --2- 172.21.15.47:0/2300184451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a41035a0 0x7fb0a4103980 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.106+0000 7fb0a9048640 1 -- 172.21.15.47:0/2300184451 >> 172.21.15.47:0/2300184451 conn(0x7fb0a40fd010 msgr2=0x7fb0a40ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.106+0000 7fb0a9048640 1 -- 172.21.15.47:0/2300184451 shutdown_connections 2024-07-24T22:18:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.106+0000 7fb0a9048640 1 -- 172.21.15.47:0/2300184451 wait complete. 2024-07-24T22:18:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.107+0000 7fb0a9048640 1 Processor -- start 2024-07-24T22:18:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.108+0000 7fb0a9048640 1 -- start start 2024-07-24T22:18:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.108+0000 7fb0a9048640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0a41035a0 0x7fb0a4198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.108+0000 7fb0a9048640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a4103ec0 0x7fb0a41991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.109+0000 7fb0a9048640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0a410c9f0 0x7fb0a419e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.109+0000 7fb0a259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a4103ec0 0x7fb0a41991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.109+0000 7fb0a259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a4103ec0 0x7fb0a41991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57108/0 (socket says 172.21.15.47:57108) 2024-07-24T22:18:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.109+0000 7fb0a2d9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0a41035a0 0x7fb0a4198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.109+0000 7fb0a2d9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0a41035a0 0x7fb0a4198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:34072/0 (socket says 172.21.15.47:34072) 2024-07-24T22:18:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.109+0000 7fb0a259c640 1 -- 172.21.15.47:0/3542934412 learned_addr learned my addr 172.21.15.47:0/3542934412 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.109+0000 7fb0a9048640 1 -- 172.21.15.47:0/3542934412 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a4112740 con 0x7fb0a4103ec0 2024-07-24T22:18:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.109+0000 7fb0a9048640 1 -- 172.21.15.47:0/3542934412 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41125c0 con 0x7fb0a41035a0 2024-07-24T22:18:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.109+0000 7fb0a359e640 1 --2- 172.21.15.47:0/3542934412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0a410c9f0 0x7fb0a419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.109+0000 7fb0a9048640 1 -- 172.21.15.47:0/3542934412 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41128c0 con 0x7fb0a410c9f0 2024-07-24T22:18:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.110+0000 7fb0a259c640 1 -- 172.21.15.47:0/3542934412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0a410c9f0 msgr2=0x7fb0a419e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.110+0000 7fb0a259c640 1 --2- 172.21.15.47:0/3542934412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0a410c9f0 0x7fb0a419e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.110+0000 7fb0a259c640 1 -- 172.21.15.47:0/3542934412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0a41035a0 msgr2=0x7fb0a4198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.110+0000 7fb0a259c640 1 --2- 172.21.15.47:0/3542934412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0a41035a0 0x7fb0a4198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.110+0000 7fb0a259c640 1 -- 172.21.15.47:0/3542934412 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a419ed40 con 0x7fb0a4103ec0 2024-07-24T22:18:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.110+0000 7fb0a259c640 1 --2- 172.21.15.47:0/3542934412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a4103ec0 0x7fb0a41991e0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fb09800b3c0 tx=0x7fb09800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.111+0000 7fb08bfff640 1 -- 172.21.15.47:0/3542934412 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098011830 con 0x7fb0a4103ec0 2024-07-24T22:18:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.111+0000 7fb08bfff640 1 -- 172.21.15.47:0/3542934412 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb098016070 con 0x7fb0a4103ec0 2024-07-24T22:18:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.111+0000 7fb08bfff640 1 -- 172.21.15.47:0/3542934412 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098010e10 con 0x7fb0a4103ec0 2024-07-24T22:18:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.111+0000 7fb0a9048640 1 -- 172.21.15.47:0/3542934412 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a419f030 con 0x7fb0a4103ec0 2024-07-24T22:18:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.111+0000 7fb0a9048640 1 -- 172.21.15.47:0/3542934412 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a41a56f0 con 0x7fb0a4103ec0 2024-07-24T22:18:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.115+0000 7fb0abd9d740 1 Processor -- start 2024-07-24T22:18:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.115+0000 7fb0abd9d740 1 -- start start 2024-07-24T22:18:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.115+0000 7fb0abd9d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43db350 0x5606b43db730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.115+0000 7fb0abd9d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eacd0 0x5606b43eb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.115+0000 7fb0abd9d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eb630 0x5606b43f5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.115+0000 7fb0abd9d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5606b4353280 con 0x5606b43eacd0 2024-07-24T22:18:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.115+0000 7fb0abd9d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5606b4342780 con 0x5606b43db350 2024-07-24T22:18:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.115+0000 7fb0abd9d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5606b43467c0 con 0x5606b43eb630 2024-07-24T22:18:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.116+0000 7fb0a2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eacd0 0x5606b43eb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.116+0000 7fb0a2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eacd0 0x5606b43eb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57120/0 (socket says 172.21.15.47:57120) 2024-07-24T22:18:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.116+0000 7fb0a2d9d640 1 -- 172.21.15.47:0/1448000059 learned_addr learned my addr 172.21.15.47:0/1448000059 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.116+0000 7fb08bfff640 1 -- 172.21.15.47:0/3542934412 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fb0980119d0 con 0x7fb0a4103ec0 2024-07-24T22:18:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.116+0000 7fb0a2d9d640 1 -- 172.21.15.47:0/1448000059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eb630 msgr2=0x5606b43f5020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:18:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.116+0000 7fb0a2d9d640 1 --2- 172.21.15.47:0/1448000059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eb630 0x5606b43f5020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.116+0000 7fb0a2d9d640 1 -- 172.21.15.47:0/1448000059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43db350 msgr2=0x5606b43db730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.116+0000 7fb0a2d9d640 1 --2- 172.21.15.47:0/1448000059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43db350 0x5606b43db730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.116+0000 7fb0a2d9d640 1 -- 172.21.15.47:0/1448000059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606b40a6790 con 0x5606b43eacd0 2024-07-24T22:18:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.117+0000 7fb0a2d9d640 1 --2- 172.21.15.47:0/1448000059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eacd0 0x5606b43eb0f0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fb094009230 tx=0x7fb094004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582a606bab988441 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.117+0000 7fb08bfff640 1 --2- 172.21.15.47:0/3542934412 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb08c0b3f10 0x7fb08c0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.118+0000 7fb08bfff640 1 -- 172.21.15.47:0/3542934412 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fb0980e35b0 con 0x7fb0a4103ec0 2024-07-24T22:18:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.118+0000 7fb0897fa640 1 -- 172.21.15.47:0/1448000059 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094035040 con 0x5606b43eacd0 2024-07-24T22:18:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.118+0000 7fb0897fa640 1 -- 172.21.15.47:0/1448000059 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0940054f0 con 0x5606b43eacd0 2024-07-24T22:18:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.118+0000 7fb0897fa640 1 -- 172.21.15.47:0/1448000059 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094003850 con 0x5606b43eacd0 2024-07-24T22:18:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.118+0000 7fb0a359e640 1 --2- 172.21.15.47:0/3542934412 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb08c0b3f10 0x7fb08c0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.119+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1448000059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eacd0 msgr2=0x5606b43eb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.119+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/1448000059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eacd0 0x5606b43eb0f0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fb094009230 tx=0x7fb094004180 comp rx=0 tx=0).stop 2024-07-24T22:18:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.119+0000 7fb0a359e640 1 --2- 172.21.15.47:0/3542934412 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb08c0b3f10 0x7fb08c0b63d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb09c005fd0 tx=0x7fb09c009b00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.120+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1448000059 shutdown_connections 2024-07-24T22:18:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.120+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/1448000059 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eb630 0x5606b43f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.120+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/1448000059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eacd0 0x5606b43eb0f0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.120+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/1448000059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43db350 0x5606b43db730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.120+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1448000059 >> 172.21.15.47:0/1448000059 conn(0x5606b43dd860 msgr2=0x5606b43ddc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.121+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1448000059 shutdown_connections 2024-07-24T22:18:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.121+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1448000059 wait complete. 2024-07-24T22:18:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.121+0000 7fb0abd9d740 1 -- start start 2024-07-24T22:18:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.122+0000 7fb0abd9d740 1 Processor -- start 2024-07-24T22:18:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.122+0000 7fb0abd9d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43db350 0x5606b43f4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.122+0000 7fb0abd9d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eacd0 0x5606b43f2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.122+0000 7fb0abd9d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eb630 0x5606b43f2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0a2d9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43db350 0x5606b43f4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0a2d9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43db350 0x5606b43f4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.47:34088/0 (socket says 172.21.15.47:34088) 2024-07-24T22:18:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0a259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eacd0 0x5606b43f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0a2d9d640 1 -- 172.21.15.47:0/1830313547 learned_addr learned my addr 172.21.15.47:0/1830313547 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0a259c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eacd0 0x5606b43f2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:40108/0 (socket says 172.21.15.47:40108) 2024-07-24T22:18:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0abd9d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5606b427cab0 con 0x5606b43eb630 2024-07-24T22:18:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1830313547 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5606b42ca9e0 con 0x5606b43db350 2024-07-24T22:18:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1830313547 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5606b43f5650 con 0x5606b43eacd0 2024-07-24T22:18:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0abd9d740 10 client.0 _ll_register_callbacks cb 0x5606b4052a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0a259c640 1 -- 172.21.15.47:0/1830313547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43db350 msgr2=0x5606b43f4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0a259c640 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43db350 0x5606b43f4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0a259c640 1 -- 172.21.15.47:0/1830313547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eb630 msgr2=0x5606b43f2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0a359e640 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eb630 0x5606b43f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0a259c640 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eb630 0x5606b43f2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0a259c640 1 -- 172.21.15.47:0/1830313547 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606b411f620 con 0x5606b43eacd0 2024-07-24T22:18:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.123+0000 7fb0a2d9d640 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43db350 0x5606b43f4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:18:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.124+0000 7fb0a359e640 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eb630 0x5606b43f2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:18:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.124+0000 7fb0a259c640 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eacd0 0x5606b43f2220 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb0980e0d80 tx=0x7fb0980a9910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caabda8e0687376d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.124+0000 7fb086ff5640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:18:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.124+0000 7fb086ff5640 1 -- 172.21.15.47:0/1830313547 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0980aa1a0 con 0x5606b43eacd0 2024-07-24T22:18:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.124+0000 7fb086ff5640 1 -- 172.21.15.47:0/1830313547 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fb0980e0ef0 con 0x5606b43eacd0 2024-07-24T22:18:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.124+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1830313547 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5606b42f1ce0 con 0x5606b43eacd0 2024-07-24T22:18:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.125+0000 7fb086ff5640 1 -- 172.21.15.47:0/1830313547 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb0980e10f0 con 0x5606b43eacd0 2024-07-24T22:18:58.129 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.125+0000 7fb0abd9d740 10 client.27199 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.125+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1830313547 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5606b4400e70 con 0x5606b43eacd0 2024-07-24T22:18:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.125+0000 7fb086ff5640 1 -- 172.21.15.47:0/1830313547 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0980ae7a0 con 0x5606b43eacd0 2024-07-24T22:18:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.125+0000 7fb086ff5640 1 -- 172.21.15.47:0/1830313547 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb0980c4ce0 con 0x5606b43eacd0 2024-07-24T22:18:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.125+0000 7fb0abd9d740 10 client.27199 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.125+0000 7fb0abd9d740 10 client.27199 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.125+0000 7fb0abd9d740 20 client.27199 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.125+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606b4402380 0x5606b4404770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.125+0000 7fb0abd9d740 4 client.27199 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:18:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.125+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1830313547 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606b42f1ce0 con 0x5606b4402380 2024-07-24T22:18:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.126+0000 7fb0a2d9d640 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606b4402380 0x5606b4404770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.126+0000 7fb086ff5640 10 client.27199 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:58.130 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.127+0000 7fb0a2d9d640 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606b4402380 0x5606b4404770 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d51affafeaa863f5 server_cookie=482d60821581bc36 in_seq=0 out_seq=0 2024-07-24T22:18:58.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.128+0000 7fb086ff5640 1 -- 172.21.15.47:0/1830313547 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606b42f1ce0 con 0x5606b4402380 2024-07-24T22:18:58.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.128+0000 7fb086ff5640 10 client.27199 handle_command_reply: tid=0 2024-07-24T22:18:58.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.128+0000 7fb0abd9d740 1 client.27199 shutdown 2024-07-24T22:18:58.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.128+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1830313547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eacd0 msgr2=0x5606b43f2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:58.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.128+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eacd0 0x5606b43f2220 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb0980e0d80 tx=0x7fb0980a9910 comp rx=0 tx=0).stop 2024-07-24T22:18:58.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.128+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1830313547 shutdown_connections 2024-07-24T22:18:58.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.128+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606b4402380 0x5606b4404770 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.128+0000 7fb086ff5640 0 client.27199 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:58.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.128+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eb630 0x5606b43f2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.128+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eacd0 0x5606b43f2220 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.128+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/1830313547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43db350 0x5606b43f4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.128+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1830313547 >> 172.21.15.47:0/1830313547 conn(0x5606b43dd860 msgr2=0x5606b43ee630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:58.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.129+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1830313547 shutdown_connections 2024-07-24T22:18:58.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.129+0000 7fb0abd9d740 1 -- 172.21.15.47:0/1830313547 wait complete. 2024-07-24T22:18:58.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.129+0000 7fb0abd9d740 20 client.27199 trim_cache size 0 max 16384 2024-07-24T22:18:58.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.152+0000 7fb0abd9d740 1 Processor -- start 2024-07-24T22:18:58.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.152+0000 7fb0abd9d740 1 -- start start 2024-07-24T22:18:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.152+0000 7fb0abd9d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43db350 0x5606b43fe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0abd9d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43eacd0 0x5606b43f4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0abd9d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eb630 0x5606b43f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0a2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43db350 0x5606b43fe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0a2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43db350 0x5606b43fe760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57136/0 (socket says 172.21.15.47:57136) 2024-07-24T22:18:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0a2d9d640 1 -- 172.21.15.47:0/2286617527 learned_addr learned my addr 172.21.15.47:0/2286617527 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0abd9d740 1 -- 172.21.15.47:0/2286617527 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41a9f70 con 0x5606b43db350 2024-07-24T22:18:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0abd9d740 1 -- 172.21.15.47:0/2286617527 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41ac7d0 con 0x5606b43eacd0 2024-07-24T22:18:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0abd9d740 1 -- 172.21.15.47:0/2286617527 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41aa5c0 con 0x5606b43eb630 2024-07-24T22:18:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0a259c640 1 --2- 172.21.15.47:0/2286617527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43eacd0 0x5606b43f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0a2d9d640 1 -- 172.21.15.47:0/2286617527 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eb630 msgr2=0x5606b43f4c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-24T22:18:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0a2d9d640 1 --2- 172.21.15.47:0/2286617527 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eb630 0x5606b43f4c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0a2d9d640 1 -- 172.21.15.47:0/2286617527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43eacd0 msgr2=0x5606b43f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0a2d9d640 1 --2- 172.21.15.47:0/2286617527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43eacd0 0x5606b43f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0a2d9d640 1 -- 172.21.15.47:0/2286617527 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606b43dbaa0 con 0x5606b43db350 2024-07-24T22:18:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.153+0000 7fb0a259c640 1 --2- 172.21.15.47:0/2286617527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43eacd0 0x5606b43f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:18:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.154+0000 7fb0a2d9d640 1 --2- 172.21.15.47:0/2286617527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43db350 0x5606b43fe760 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fb094009900 tx=0x7fb09402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5b895127bc30f1 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.154+0000 7fb088ff9640 1 -- 172.21.15.47:0/2286617527 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094035040 con 0x5606b43db350 2024-07-24T22:18:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.154+0000 7fb088ff9640 1 -- 172.21.15.47:0/2286617527 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb094004950 con 0x5606b43db350 2024-07-24T22:18:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.154+0000 7fb088ff9640 1 -- 172.21.15.47:0/2286617527 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094003850 con 0x5606b43db350 2024-07-24T22:18:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.155+0000 7fb0abd9d740 1 -- 172.21.15.47:0/2286617527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43db350 msgr2=0x5606b43fe760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.155+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/2286617527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43db350 0x5606b43fe760 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fb094009900 tx=0x7fb09402a410 comp rx=0 tx=0).stop 2024-07-24T22:18:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.155+0000 7fb0abd9d740 1 -- 172.21.15.47:0/2286617527 shutdown_connections 2024-07-24T22:18:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.155+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/2286617527 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43eb630 0x5606b43f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.155+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/2286617527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43eacd0 0x5606b43f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.155+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/2286617527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43db350 0x5606b43fe760 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.155+0000 7fb0abd9d740 1 -- 172.21.15.47:0/2286617527 >> 172.21.15.47:0/2286617527 conn(0x5606b43dd860 msgr2=0x5606b43ec500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.156+0000 7fb0abd9d740 1 -- 172.21.15.47:0/2286617527 shutdown_connections 2024-07-24T22:18:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.156+0000 7fb0abd9d740 1 -- 172.21.15.47:0/2286617527 wait complete. 2024-07-24T22:18:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.156+0000 7fb0abd9d740 1 -- start start 2024-07-24T22:18:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.157+0000 7fb0abd9d740 1 Processor -- start 2024-07-24T22:18:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.157+0000 7fb0abd9d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43db350 0x5606b43facf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.157+0000 7fb0abd9d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43eacd0 0x5606b43f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.157+0000 7fb0abd9d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eb630 0x5606b43f8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.157+0000 7fb0abd9d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41aac90 con 0x5606b43eb630 2024-07-24T22:18:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.157+0000 7fb0abd9d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41ac100 con 0x5606b43eacd0 2024-07-24T22:18:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.157+0000 7fb0abd9d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a41ab360 con 0x5606b43db350 2024-07-24T22:18:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.157+0000 7fb0abd9d740 10 client.0 _ll_register_callbacks cb 0x7fb0980aa000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:18:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.157+0000 7fb0a2d9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43db350 0x5606b43facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.157+0000 7fb0a2d9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43db350 0x5606b43facf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:40114/0 (socket says 172.21.15.47:40114) 2024-07-24T22:18:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.157+0000 7fb0a2d9d640 1 -- 172.21.15.47:0/3633570592 learned_addr learned my addr 172.21.15.47:0/3633570592 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:18:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.158+0000 7fb0a2d9d640 1 -- 172.21.15.47:0/3633570592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43eacd0 msgr2=0x5606b43f81d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-24T22:18:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.158+0000 7fb0a2d9d640 1 --2- 172.21.15.47:0/3633570592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43eacd0 0x5606b43f81d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.158+0000 7fb0a2d9d640 1 -- 172.21.15.47:0/3633570592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eb630 msgr2=0x5606b43f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:18:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.158+0000 7fb0a2d9d640 1 --2- 172.21.15.47:0/3633570592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eb630 0x5606b43f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.158+0000 7fb0a2d9d640 1 -- 172.21.15.47:0/3633570592 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606b43f8cd0 con 0x5606b43db350 2024-07-24T22:18:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.158+0000 7fb0a2d9d640 1 --2- 172.21.15.47:0/3633570592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43db350 0x5606b43facf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb094004620 tx=0x7fb094005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb3f994a2bd742e4 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:18:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.158+0000 7fb086ff5640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-07-24T22:18:58.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:57 smithi183 ceph-mon[37007]: pgmap v730: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 6 op/s 2024-07-24T22:18:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.159+0000 7fb086ff5640 1 -- 172.21.15.47:0/3633570592 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094057040 con 0x5606b43db350 2024-07-24T22:18:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.159+0000 7fb086ff5640 1 -- 172.21.15.47:0/3633570592 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7fb094003a00 con 0x5606b43db350 2024-07-24T22:18:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.159+0000 7fb0abd9d740 1 -- 172.21.15.47:0/3633570592 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb094004950 con 0x5606b43db350 2024-07-24T22:18:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.159+0000 7fb086ff5640 1 -- 172.21.15.47:0/3633570592 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb094035040 con 0x5606b43db350 2024-07-24T22:18:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.159+0000 7fb0abd9d740 10 client.27202 fetch_fsmap learned FSMap version 20 2024-07-24T22:18:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.159+0000 7fb0abd9d740 1 -- 172.21.15.47:0/3633570592 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5606b447ddc0 con 0x5606b43db350 2024-07-24T22:18:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.159+0000 7fb086ff5640 1 -- 172.21.15.47:0/3633570592 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb094004950 con 0x5606b43db350 2024-07-24T22:18:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.160+0000 7fb086ff5640 1 -- 172.21.15.47:0/3633570592 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb0940314a0 con 0x5606b43db350 2024-07-24T22:18:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.160+0000 7fb0abd9d740 10 client.27202 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:18:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.160+0000 7fb0abd9d740 10 client.27202 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-07-24T22:18:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.160+0000 7fb0abd9d740 20 client.27202 populate_metadata read hostname 'smithi047' 2024-07-24T22:18:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.160+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/3633570592 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606b4402380 0x5606b44803c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:18:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.160+0000 7fb0abd9d740 4 client.27202 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-07-24T22:18:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.160+0000 7fb0abd9d740 1 -- 172.21.15.47:0/3633570592 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5606b43551d0 con 0x5606b4402380 2024-07-24T22:18:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.160+0000 7fb0a259c640 1 --2- 172.21.15.47:0/3633570592 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606b4402380 0x5606b44803c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:18:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.161+0000 7fb0a259c640 1 --2- 172.21.15.47:0/3633570592 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606b4402380 0x5606b44803c0 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12a1181d51e865ca server_cookie=e0351a97fbf8ee68 in_seq=0 out_seq=0 2024-07-24T22:18:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.162+0000 7fb086ff5640 10 client.27202 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:58.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:57 smithi047 ceph-mon[32551]: pgmap v730: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 6 op/s 2024-07-24T22:18:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.196+0000 7fb086ff5640 1 -- 172.21.15.47:0/3633570592 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5606b43551d0 con 0x5606b4402380 2024-07-24T22:18:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.196+0000 7fb086ff5640 10 client.27202 handle_command_reply: tid=0 2024-07-24T22:18:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.196+0000 7fb0abd9d740 1 client.27202 shutdown 2024-07-24T22:18:58.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.196+0000 7fb0abd9d740 1 -- 172.21.15.47:0/3633570592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43db350 msgr2=0x5606b43facf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:58.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.196+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/3633570592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43db350 0x5606b43facf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb094004620 tx=0x7fb094005fd0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.196+0000 7fb0abd9d740 1 -- 172.21.15.47:0/3633570592 shutdown_connections 2024-07-24T22:18:58.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.196+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/3633570592 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5606b4402380 0x5606b44803c0 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.196+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/3633570592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606b43eb630 0x5606b43f8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.196+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/3633570592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5606b43eacd0 0x5606b43f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.196+0000 7fb0abd9d740 1 --2- 172.21.15.47:0/3633570592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5606b43db350 0x5606b43facf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.196+0000 7fb086ff5640 0 client.27202 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:18:58.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.196+0000 7fb0abd9d740 1 -- 172.21.15.47:0/3633570592 >> 172.21.15.47:0/3633570592 conn(0x5606b43dd860 msgr2=0x5606b43dc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:58.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.197+0000 7fb0abd9d740 1 -- 172.21.15.47:0/3633570592 shutdown_connections 2024-07-24T22:18:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.197+0000 7fb0abd9d740 1 -- 172.21.15.47:0/3633570592 wait complete. 2024-07-24T22:18:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.197+0000 7fb0abd9d740 20 client.27202 trim_cache size 0 max 16384 2024-07-24T22:18:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-07-24T22:18:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-07-24T22:18:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-07-24T22:18:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-07-24T22:18:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.198+0000 7fb0a9048640 1 -- 172.21.15.47:0/3542934412 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb08c0b3f10 msgr2=0x7fb08c0b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.198+0000 7fb0a9048640 1 --2- 172.21.15.47:0/3542934412 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb08c0b3f10 0x7fb08c0b63d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb09c005fd0 tx=0x7fb09c009b00 comp rx=0 tx=0).stop 2024-07-24T22:18:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.198+0000 7fb0a9048640 1 -- 172.21.15.47:0/3542934412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a4103ec0 msgr2=0x7fb0a41991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:18:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.198+0000 7fb0a9048640 1 --2- 172.21.15.47:0/3542934412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a4103ec0 0x7fb0a41991e0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fb09800b3c0 tx=0x7fb09800b880 comp rx=0 tx=0).stop 2024-07-24T22:18:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.199+0000 7fb0a9048640 1 -- 172.21.15.47:0/3542934412 shutdown_connections 2024-07-24T22:18:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.199+0000 7fb0a9048640 1 --2- 172.21.15.47:0/3542934412 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb08c0b3f10 0x7fb08c0b63d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.199+0000 7fb0a9048640 1 --2- 172.21.15.47:0/3542934412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0a410c9f0 0x7fb0a419e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.199+0000 7fb0a9048640 1 --2- 172.21.15.47:0/3542934412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0a4103ec0 0x7fb0a41991e0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.199+0000 7fb0a9048640 1 --2- 172.21.15.47:0/3542934412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0a41035a0 0x7fb0a4198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:18:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.199+0000 7fb0a9048640 1 -- 172.21.15.47:0/3542934412 >> 172.21.15.47:0/3542934412 conn(0x7fb0a40fd010 msgr2=0x7fb0a40fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:18:58.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.199+0000 7fb0a9048640 1 -- 172.21.15.47:0/3542934412 shutdown_connections 2024-07-24T22:18:58.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-07-24T22:18:58.200+0000 7fb0a9048640 1 -- 172.21.15.47:0/3542934412 wait complete. 2024-07-24T22:18:58.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:57 smithi188 ceph-mon[37380]: pgmap v730: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 6 op/s 2024-07-24T22:18:58.755 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24628 quiesce db --cancel --all' 2024-07-24T22:18:58.755 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- timeout 105 ceph tell mds.24628 quiesce db --cancel --all 2024-07-24T22:18:59.022 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:18:59.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:58 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2823066059' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:59.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:58 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2823066059' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:18:59.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:58 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2823066059' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:19:00.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:18:59 smithi183 ceph-mon[37007]: pgmap v731: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 KiB/s wr, 76 op/s 2024-07-24T22:19:00.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:18:59 smithi047 ceph-mon[32551]: pgmap v731: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 KiB/s wr, 76 op/s 2024-07-24T22:19:00.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:18:59 smithi188 ceph-mon[37380]: pgmap v731: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 KiB/s wr, 76 op/s 2024-07-24T22:19:00.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.924+0000 7f4bc473d640 1 -- 172.21.15.47:0/2083881226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bbc102770 msgr2=0x7f4bbc102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:00.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.924+0000 7f4bc473d640 1 --2- 172.21.15.47:0/2083881226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bbc102770 0x7f4bbc102b50 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009900 tx=0x7f4bb802a410 comp rx=0 tx=0).stop 2024-07-24T22:19:00.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 -- 172.21.15.47:0/2083881226 shutdown_connections 2024-07-24T22:19:00.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 --2- 172.21.15.47:0/2083881226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bbc108b00 0x7f4bbc10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 --2- 172.21.15.47:0/2083881226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bbc108180 0x7f4bbc1085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 --2- 172.21.15.47:0/2083881226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bbc102770 0x7f4bbc102b50 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 -- 172.21.15.47:0/2083881226 >> 172.21.15.47:0/2083881226 conn(0x7f4bbc0fe1c0 msgr2=0x7f4bbc1005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 -- 172.21.15.47:0/2083881226 shutdown_connections 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 -- 172.21.15.47:0/2083881226 wait complete. 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 Processor -- start 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 -- start start 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bbc102770 0x7f4bbc198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bbc108180 0x7f4bbc199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bbc108b00 0x7f4bbc19e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc112780 con 0x7f4bbc108b00 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc112600 con 0x7f4bbc108180 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.925+0000 7f4bc473d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc112900 con 0x7f4bbc102770 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc2cda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bbc108b00 0x7f4bbc19e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc2cda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bbc108b00 0x7f4bbc19e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57164/0 (socket says 172.21.15.47:57164) 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc2cda640 1 -- 172.21.15.47:0/1405053282 learned_addr learned my addr 172.21.15.47:0/1405053282 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bbc108180 0x7f4bbc199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc24d9640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bbc102770 0x7f4bbc198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc2cda640 1 -- 172.21.15.47:0/1405053282 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bbc102770 msgr2=0x7f4bbc198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc2cda640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bbc102770 0x7f4bbc198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc2cda640 1 -- 172.21.15.47:0/1405053282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bbc108180 msgr2=0x7f4bbc199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc2cda640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bbc108180 0x7f4bbc199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc2cda640 1 -- 172.21.15.47:0/1405053282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bbc19ece0 con 0x7f4bbc108b00 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc24d9640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bbc102770 0x7f4bbc198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc2cda640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bbc108b00 0x7f4bbc19e510 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400cce0 tx=0x7f4bb400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bb37fe640 1 -- 172.21.15.47:0/1405053282 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400f450 con 0x7f4bbc108b00 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc473d640 1 -- 172.21.15.47:0/1405053282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bbc19efd0 con 0x7f4bbc108b00 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bb37fe640 1 -- 172.21.15.47:0/1405053282 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb400faa0 con 0x7f4bbc108b00 2024-07-24T22:19:00.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bb37fe640 1 -- 172.21.15.47:0/1405053282 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4018a80 con 0x7f4bbc108b00 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.926+0000 7f4bc473d640 1 -- 172.21.15.47:0/1405053282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bbc1a5710 con 0x7f4bbc108b00 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.929+0000 7f4bb37fe640 1 -- 172.21.15.47:0/1405053282 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f4bb400fc50 con 0x7f4bbc108b00 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.929+0000 7f4bc6aee740 1 Processor -- start 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.930+0000 7f4bc6aee740 1 -- start start 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.930+0000 7f4bc6aee740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 0x562c83ff76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.930+0000 7f4bc6aee740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c83ff8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.930+0000 7f4bc6aee740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 0x562c84005e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.930+0000 7f4bc6aee740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562c83f6d990 con 0x562c83ff7be0 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.930+0000 7f4bc6aee740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562c83f5ce90 con 0x562c83ff9140 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.930+0000 7f4bc6aee740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562c83f60ed0 con 0x562c84003a10 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.930+0000 7f4bc24d9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c83ff8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.930+0000 7f4bc24d9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c83ff8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57172/0 (socket says 172.21.15.47:57172) 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.930+0000 7f4bc24d9640 1 -- 172.21.15.47:0/3725813029 learned_addr learned my addr 172.21.15.47:0/3725813029 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:00.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.930+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/3725813029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 0x562c83ff76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.930+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/3725813029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 0x562c84005e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.930+0000 7f4bb37fe640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4ba80b3d40 0x7f4ba80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.931+0000 7f4bc24d9640 1 -- 172.21.15.47:0/3725813029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 msgr2=0x562c84005e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.931+0000 7f4bc24d9640 1 --2- 172.21.15.47:0/3725813029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 0x562c84005e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.931+0000 7f4bc24d9640 1 -- 172.21.15.47:0/3725813029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 msgr2=0x562c83ff76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.931+0000 7f4bc24d9640 1 --2- 172.21.15.47:0/3725813029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 0x562c83ff76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.931+0000 7f4bc24d9640 1 -- 172.21.15.47:0/3725813029 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c83f3d350 con 0x562c83ff7be0 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.931+0000 7f4bc2cda640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4ba80b3d40 0x7f4ba80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.931+0000 7f4bb37fe640 1 -- 172.21.15.47:0/1405053282 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f4bb40e4560 con 0x7f4bbc108b00 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.931+0000 7f4bc24d9640 1 --2- 172.21.15.47:0/3725813029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c83ff8000 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f4bb802a930 tx=0x7f4bb8031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7fc776360364be server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.931+0000 7f4bb0ff9640 1 -- 172.21.15.47:0/3725813029 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb803f070 con 0x562c83ff7be0 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.931+0000 7f4bb0ff9640 1 -- 172.21.15.47:0/3725813029 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb80316a0 con 0x562c83ff7be0 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.931+0000 7f4bb0ff9640 1 -- 172.21.15.47:0/3725813029 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8035070 con 0x562c83ff7be0 2024-07-24T22:19:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.932+0000 7f4bc6aee740 1 -- 172.21.15.47:0/3725813029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 msgr2=0x562c83ff8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.932+0000 7f4bc2cda640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4ba80b3d40 0x7f4ba80b6200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40aade0 tx=0x7f4bb400ff70 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.932+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/3725813029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c83ff8000 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f4bb802a930 tx=0x7f4bb8031e60 comp rx=0 tx=0).stop 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.932+0000 7f4bc6aee740 1 -- 172.21.15.47:0/3725813029 shutdown_connections 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.932+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/3725813029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 0x562c84005e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.932+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/3725813029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c83ff8000 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.932+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/3725813029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 0x562c83ff76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.932+0000 7f4bc6aee740 1 -- 172.21.15.47:0/3725813029 >> 172.21.15.47:0/3725813029 conn(0x562c83fc1dd0 msgr2=0x562c83ff54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.932+0000 7f4bc6aee740 1 -- 172.21.15.47:0/3725813029 shutdown_connections 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.932+0000 7f4bc6aee740 1 -- 172.21.15.47:0/3725813029 wait complete. 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.932+0000 7f4bc6aee740 1 -- start start 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.932+0000 7f4bc6aee740 1 Processor -- start 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc6aee740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff7be0 0x562c84003200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc6aee740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c83ff9140 0x562c84000650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc6aee740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c84003a10 0x562c84000b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc6aee740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562c83dc0810 con 0x562c84003a10 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc6aee740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562c83eff600 con 0x562c83ff7be0 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc6aee740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562c84006910 con 0x562c83ff9140 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc6aee740 10 client.0 _ll_register_callbacks cb 0x562c83c69b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc1cd8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c84003a10 0x562c84000b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc1cd8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c84003a10 0x562c84000b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57182/0 (socket says 172.21.15.47:57182) 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc1cd8640 1 -- 172.21.15.47:0/319403431 learned_addr learned my addr 172.21.15.47:0/319403431 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc24d9640 1 --2- 172.21.15.47:0/319403431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c83ff9140 0x562c84000650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/319403431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff7be0 0x562c84003200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc1cd8640 1 -- 172.21.15.47:0/319403431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c83ff9140 msgr2=0x562c84000650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/319403431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c83ff9140 0x562c84000650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc1cd8640 1 -- 172.21.15.47:0/319403431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff7be0 msgr2=0x562c84003200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/319403431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff7be0 0x562c84003200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc1cd8640 1 -- 172.21.15.47:0/319403431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c83cbd8b0 con 0x562c84003a10 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/319403431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c84003a10 0x562c84000b90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f4bac01adb0 tx=0x7f4bac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24060202fcc4c61e server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.933+0000 7f4ba5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4ba5ffb640 1 -- 172.21.15.47:0/319403431 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac013ea0 con 0x562c84003a10 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4ba5ffb640 1 -- 172.21.15.47:0/319403431 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f4bac01a0d0 con 0x562c84003a10 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4bc6aee740 1 -- 172.21.15.47:0/319403431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bb80316a0 con 0x562c84003a10 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4ba5ffb640 1 -- 172.21.15.47:0/319403431 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4bac02b050 con 0x562c84003a10 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4bc6aee740 10 client.18192 fetch_fsmap learned FSMap version 20 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4bc6aee740 1 -- 172.21.15.47:0/319403431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562c83efa090 con 0x562c84003a10 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4ba5ffb640 1 -- 172.21.15.47:0/319403431 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb80316a0 con 0x562c84003a10 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4ba5ffb640 1 -- 172.21.15.47:0/319403431 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4bac017440 con 0x562c84003a10 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4bc6aee740 10 client.18192 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4bc6aee740 10 client.18192 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4bc6aee740 20 client.18192 populate_metadata read hostname 'smithi047' 2024-07-24T22:19:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/319403431 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562c84013820 0x562c84015c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4bc6aee740 4 client.18192 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:19:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.934+0000 7f4bc6aee740 1 -- 172.21.15.47:0/319403431 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c83f6f8e0 con 0x562c84013820 2024-07-24T22:19:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.935+0000 7f4bc24d9640 1 --2- 172.21.15.47:0/319403431 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562c84013820 0x562c84015c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.935+0000 7f4ba5ffb640 10 client.18192 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:19:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.935+0000 7f4bc24d9640 1 --2- 172.21.15.47:0/319403431 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562c84013820 0x562c84015c10 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e115b9f4ae739731 server_cookie=a8999baf5716d84 in_seq=0 out_seq=0 2024-07-24T22:19:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4ba5ffb640 1 -- 172.21.15.47:0/319403431 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c83f6f8e0 con 0x562c84013820 2024-07-24T22:19:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4ba5ffb640 10 client.18192 handle_command_reply: tid=0 2024-07-24T22:19:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4bc6aee740 1 client.18192 shutdown 2024-07-24T22:19:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4bc6aee740 1 -- 172.21.15.47:0/319403431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c84003a10 msgr2=0x562c84000b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/319403431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c84003a10 0x562c84000b90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f4bac01adb0 tx=0x7f4bac008040 comp rx=0 tx=0).stop 2024-07-24T22:19:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4bc6aee740 1 -- 172.21.15.47:0/319403431 shutdown_connections 2024-07-24T22:19:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/319403431 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562c84013820 0x562c84015c10 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/319403431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c84003a10 0x562c84000b90 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/319403431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c83ff9140 0x562c84000650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4ba5ffb640 0 client.18192 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:19:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/319403431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff7be0 0x562c84003200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4bc6aee740 1 -- 172.21.15.47:0/319403431 >> 172.21.15.47:0/319403431 conn(0x562c83fc1dd0 msgr2=0x562c83ffb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4bc6aee740 1 -- 172.21.15.47:0/319403431 shutdown_connections 2024-07-24T22:19:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4bc6aee740 1 -- 172.21.15.47:0/319403431 wait complete. 2024-07-24T22:19:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.936+0000 7f4bc6aee740 20 client.18192 trim_cache size 0 max 16384 2024-07-24T22:19:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.954+0000 7f4bc6aee740 1 Processor -- start 2024-07-24T22:19:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.954+0000 7f4bc6aee740 1 -- start start 2024-07-24T22:19:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.954+0000 7f4bc6aee740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c83ff7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.954+0000 7f4bc6aee740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 0x562c84002390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.954+0000 7f4bc6aee740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 0x562c8401b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.954+0000 7f4bc6aee740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc1ac130 con 0x562c83ff7be0 2024-07-24T22:19:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.954+0000 7f4bc6aee740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc1ae990 con 0x562c83ff9140 2024-07-24T22:19:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.954+0000 7f4bc6aee740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc1ac780 con 0x562c84003a10 2024-07-24T22:19:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.955+0000 7f4bc1cd8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c83ff7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.955+0000 7f4bc1cd8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c83ff7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57188/0 (socket says 172.21.15.47:57188) 2024-07-24T22:19:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.955+0000 7f4bc1cd8640 1 -- 172.21.15.47:0/3463735337 learned_addr learned my addr 172.21.15.47:0/3463735337 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.955+0000 7f4bc24d9640 1 --2- 172.21.15.47:0/3463735337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 0x562c84002390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.955+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/3463735337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 0x562c8401b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.955+0000 7f4bc1cd8640 1 -- 172.21.15.47:0/3463735337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 msgr2=0x562c8401b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.955+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/3463735337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 0x562c8401b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.955+0000 7f4bc1cd8640 1 -- 172.21.15.47:0/3463735337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 msgr2=0x562c84002390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.955+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/3463735337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 0x562c84002390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.955+0000 7f4bc1cd8640 1 -- 172.21.15.47:0/3463735337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c83ff55f0 con 0x562c83ff7be0 2024-07-24T22:19:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.955+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/3463735337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c83ff7380 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f4bac009be0 tx=0x7f4bac009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b210a2dcfc28eeb9 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.955+0000 7f4ba7fff640 1 -- 172.21.15.47:0/3463735337 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac034070 con 0x562c83ff7be0 2024-07-24T22:19:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.956+0000 7f4ba7fff640 1 -- 172.21.15.47:0/3463735337 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bac017440 con 0x562c83ff7be0 2024-07-24T22:19:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.956+0000 7f4ba7fff640 1 -- 172.21.15.47:0/3463735337 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0186b0 con 0x562c83ff7be0 2024-07-24T22:19:00.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.956+0000 7f4bc6aee740 1 -- 172.21.15.47:0/3463735337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 msgr2=0x562c83ff7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:00.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.956+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/3463735337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c83ff7380 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f4bac009be0 tx=0x7f4bac009470 comp rx=0 tx=0).stop 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.956+0000 7f4bc6aee740 1 -- 172.21.15.47:0/3463735337 shutdown_connections 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.956+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/3463735337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 0x562c8401b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.956+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/3463735337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 0x562c84002390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.956+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/3463735337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c83ff7380 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.956+0000 7f4bc6aee740 1 -- 172.21.15.47:0/3463735337 >> 172.21.15.47:0/3463735337 conn(0x562c83fc1dd0 msgr2=0x562c84001c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.956+0000 7f4bc6aee740 1 -- 172.21.15.47:0/3463735337 shutdown_connections 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.956+0000 7f4bc6aee740 1 -- 172.21.15.47:0/3463735337 wait complete. 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc6aee740 1 -- start start 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc6aee740 1 Processor -- start 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc6aee740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c8400ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc6aee740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 0x562c8400b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc6aee740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 0x562c8400b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc6aee740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc1ace50 con 0x562c83ff7be0 2024-07-24T22:19:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc6aee740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc1ae2c0 con 0x562c83ff9140 2024-07-24T22:19:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc6aee740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc1ad520 con 0x562c84003a10 2024-07-24T22:19:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc6aee740 10 client.0 _ll_register_callbacks cb 0x7f4bac009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:19:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc1cd8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c8400ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc1cd8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c8400ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57196/0 (socket says 172.21.15.47:57196) 2024-07-24T22:19:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc1cd8640 1 -- 172.21.15.47:0/2721644371 learned_addr learned my addr 172.21.15.47:0/2721644371 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc24d9640 1 --2- 172.21.15.47:0/2721644371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 0x562c8400b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.957+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/2721644371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 0x562c8400b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4bc1cd8640 1 -- 172.21.15.47:0/2721644371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 msgr2=0x562c8400b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/2721644371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 0x562c8400b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4bc1cd8640 1 -- 172.21.15.47:0/2721644371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 msgr2=0x562c8400b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/2721644371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 0x562c8400b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4bc1cd8640 1 -- 172.21.15.47:0/2721644371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c8400bbd0 con 0x562c83ff7be0 2024-07-24T22:19:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4bc1cd8640 1 --2- 172.21.15.47:0/2721644371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c8400ab90 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f4bac004700 tx=0x7f4bac01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67202464c1eba493 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4ba5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:19:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4ba5ffb640 1 -- 172.21.15.47:0/2721644371 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac034040 con 0x562c83ff7be0 2024-07-24T22:19:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4ba5ffb640 1 -- 172.21.15.47:0/2721644371 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f4bac03c470 con 0x562c83ff7be0 2024-07-24T22:19:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4bc6aee740 1 -- 172.21.15.47:0/2721644371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bac017440 con 0x562c83ff7be0 2024-07-24T22:19:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4ba5ffb640 1 -- 172.21.15.47:0/2721644371 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4bac0175f0 con 0x562c83ff7be0 2024-07-24T22:19:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4bc6aee740 10 client.18198 fetch_fsmap learned FSMap version 20 2024-07-24T22:19:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4bc6aee740 1 -- 172.21.15.47:0/2721644371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562c83ffcd10 con 0x562c83ff7be0 2024-07-24T22:19:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.958+0000 7f4ba5ffb640 1 -- 172.21.15.47:0/2721644371 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bac017440 con 0x562c83ff7be0 2024-07-24T22:19:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.959+0000 7f4ba5ffb640 1 -- 172.21.15.47:0/2721644371 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4bac044c30 con 0x562c83ff7be0 2024-07-24T22:19:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.959+0000 7f4bc6aee740 10 client.18198 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:19:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.959+0000 7f4bc6aee740 10 client.18198 resolve_mds: validated gid 24628 aka daemon mds.i 2024-07-24T22:19:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.959+0000 7f4bc6aee740 20 client.18198 populate_metadata read hostname 'smithi047' 2024-07-24T22:19:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.959+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/2721644371 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562c83ffd390 0x562c83ffd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.959+0000 7f4bc6aee740 4 client.18198 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-07-24T22:19:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.959+0000 7f4bc6aee740 1 -- 172.21.15.47:0/2721644371 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x562c83f6b380 con 0x562c83ffd390 2024-07-24T22:19:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.959+0000 7f4bc24d9640 1 --2- 172.21.15.47:0/2721644371 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562c83ffd390 0x562c83ffd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.959+0000 7f4bc24d9640 1 --2- 172.21.15.47:0/2721644371 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562c83ffd390 0x562c83ffd7a0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e7cfdb905f8cc77 server_cookie=5eec1c2dc2ad1743 in_seq=0 out_seq=0 2024-07-24T22:19:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.959+0000 7f4ba5ffb640 10 client.18198 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:19:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4ba5ffb640 1 -- 172.21.15.47:0/2721644371 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x562c83f6b380 con 0x562c83ffd390 2024-07-24T22:19:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4ba5ffb640 10 client.18198 handle_command_reply: tid=0 2024-07-24T22:19:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4bc6aee740 1 client.18198 shutdown 2024-07-24T22:19:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4bc6aee740 1 -- 172.21.15.47:0/2721644371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 msgr2=0x562c8400ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/2721644371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c8400ab90 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f4bac004700 tx=0x7f4bac01c040 comp rx=0 tx=0).stop 2024-07-24T22:19:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4bc6aee740 1 -- 172.21.15.47:0/2721644371 shutdown_connections 2024-07-24T22:19:00.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/2721644371 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x562c83ffd390 0x562c83ffd7a0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4ba5ffb640 0 client.18198 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:19:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/2721644371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562c84003a10 0x562c8400b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/2721644371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562c83ff9140 0x562c8400b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4bc6aee740 1 --2- 172.21.15.47:0/2721644371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562c83ff7be0 0x562c8400ab90 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4bc6aee740 1 -- 172.21.15.47:0/2721644371 >> 172.21.15.47:0/2721644371 conn(0x562c83fc1dd0 msgr2=0x562c840024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4bc6aee740 1 -- 172.21.15.47:0/2721644371 shutdown_connections 2024-07-24T22:19:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4bc6aee740 1 -- 172.21.15.47:0/2721644371 wait complete. 2024-07-24T22:19:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.960+0000 7f4bc6aee740 20 client.18198 trim_cache size 0 max 16384 2024-07-24T22:19:00.967 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:19:00.968 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 20, 2024-07-24T22:19:00.968 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24628, 2024-07-24T22:19:00.968 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 36, 2024-07-24T22:19:00.968 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": {} 2024-07-24T22:19:00.968 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:19:00.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.961+0000 7f4bc473d640 1 -- 172.21.15.47:0/1405053282 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4ba80b3d40 msgr2=0x7f4ba80b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.961+0000 7f4bc473d640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4ba80b3d40 0x7f4ba80b6200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40aade0 tx=0x7f4bb400ff70 comp rx=0 tx=0).stop 2024-07-24T22:19:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.961+0000 7f4bc473d640 1 -- 172.21.15.47:0/1405053282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bbc108b00 msgr2=0x7f4bbc19e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.961+0000 7f4bc473d640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bbc108b00 0x7f4bbc19e510 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400cce0 tx=0x7f4bb400a620 comp rx=0 tx=0).stop 2024-07-24T22:19:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.961+0000 7f4bc473d640 1 -- 172.21.15.47:0/1405053282 shutdown_connections 2024-07-24T22:19:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.961+0000 7f4bc473d640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4ba80b3d40 0x7f4ba80b6200 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.961+0000 7f4bc473d640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bbc108b00 0x7f4bbc19e510 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.961+0000 7f4bc473d640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bbc108180 0x7f4bbc199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.961+0000 7f4bc473d640 1 --2- 172.21.15.47:0/1405053282 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4bbc102770 0x7f4bbc198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.961+0000 7f4bc473d640 1 -- 172.21.15.47:0/1405053282 >> 172.21.15.47:0/1405053282 conn(0x7f4bbc0fe1c0 msgr2=0x7f4bbc1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.961+0000 7f4bc473d640 1 -- 172.21.15.47:0/1405053282 shutdown_connections 2024-07-24T22:19:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:00.961+0000 7f4bc473d640 1 -- 172.21.15.47:0/1405053282 wait complete. 2024-07-24T22:19:01.788 INFO:tasks.quiescer:done joining Quiescers 2024-07-24T22:19:01.788 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-07-24T22:19:01.808 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi047.front.sepia.ceph.com 2024-07-24T22:19:01.818 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-07-24T22:19:01.836 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-07-24T22:19:01.837 INFO:teuthology.task.exec:Executing custom commands... 2024-07-24T22:19:01.837 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-07-24T22:19:01.837 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-07-24T22:19:01.891 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-07-24T22:19:01.963 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-07-24T22:19:02.028 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:01 smithi047 ceph-mon[32551]: pgmap v732: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 148 op/s 2024-07-24T22:19:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.112+0000 7f0b143c6640 1 -- 172.21.15.47:0/4059193193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b0c10c9f0 msgr2=0x7f0b0c10ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.112+0000 7f0b143c6640 1 --2- 172.21.15.47:0/4059193193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b0c10c9f0 0x7f0b0c10ee70 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009ca0 tx=0x7f0b0402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.112+0000 7f0b143c6640 1 -- 172.21.15.47:0/4059193193 shutdown_connections 2024-07-24T22:19:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.112+0000 7f0b143c6640 1 --2- 172.21.15.47:0/4059193193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b0c10c9f0 0x7f0b0c10ee70 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.112+0000 7f0b143c6640 1 --2- 172.21.15.47:0/4059193193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b0c103ef0 0x7f0b0c10c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.112+0000 7f0b143c6640 1 --2- 172.21.15.47:0/4059193193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b0c1035d0 0x7f0b0c1039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.112+0000 7f0b143c6640 1 -- 172.21.15.47:0/4059193193 >> 172.21.15.47:0/4059193193 conn(0x7f0b0c0782e0 msgr2=0x7f0b0c0ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.112+0000 7f0b143c6640 1 -- 172.21.15.47:0/4059193193 shutdown_connections 2024-07-24T22:19:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.112+0000 7f0b143c6640 1 -- 172.21.15.47:0/4059193193 wait complete. 2024-07-24T22:19:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.112+0000 7f0b143c6640 1 Processor -- start 2024-07-24T22:19:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.112+0000 7f0b143c6640 1 -- start start 2024-07-24T22:19:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b143c6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b0c1035d0 0x7f0b0c101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b143c6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b0c103ef0 0x7f0b0c1017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b143c6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b0c10c9f0 0x7f0b0c101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b143c6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c112660 con 0x7f0b0c103ef0 2024-07-24T22:19:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b143c6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c1124e0 con 0x7f0b0c10c9f0 2024-07-24T22:19:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b143c6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c1127e0 con 0x7f0b0c1035d0 2024-07-24T22:19:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b11961640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b0c103ef0 0x7f0b0c1017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b11961640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b0c103ef0 0x7f0b0c1017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57210/0 (socket says 172.21.15.47:57210) 2024-07-24T22:19:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b11961640 1 -- 172.21.15.47:0/2441672063 learned_addr learned my addr 172.21.15.47:0/2441672063 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b12162640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b0c1035d0 0x7f0b0c101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b11961640 1 -- 172.21.15.47:0/2441672063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b0c1035d0 msgr2=0x7f0b0c101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b11961640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b0c1035d0 0x7f0b0c101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b11961640 1 -- 172.21.15.47:0/2441672063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b0c10c9f0 msgr2=0x7f0b0c101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b12963640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b0c10c9f0 0x7f0b0c101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b11961640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b0c10c9f0 0x7f0b0c101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b11961640 1 -- 172.21.15.47:0/2441672063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0c1a6fb0 con 0x7f0b0c103ef0 2024-07-24T22:19:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b11961640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b0c103ef0 0x7f0b0c1017b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800e9c0 tx=0x7f0b0800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0aff7fe640 1 -- 172.21.15.47:0/2441672063 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0800cd80 con 0x7f0b0c103ef0 2024-07-24T22:19:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0aff7fe640 1 -- 172.21.15.47:0/2441672063 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b080035f0 con 0x7f0b0c103ef0 2024-07-24T22:19:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.113+0000 7f0b143c6640 1 -- 172.21.15.47:0/2441672063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0c1a72a0 con 0x7f0b0c103ef0 2024-07-24T22:19:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.114+0000 7f0aff7fe640 1 -- 172.21.15.47:0/2441672063 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b08010690 con 0x7f0b0c103ef0 2024-07-24T22:19:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.114+0000 7f0b143c6640 1 -- 172.21.15.47:0/2441672063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b0c1a77f0 con 0x7f0b0c103ef0 2024-07-24T22:19:02.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.114+0000 7f0b143c6640 1 -- 172.21.15.47:0/2441672063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b0c1039b0 con 0x7f0b0c103ef0 2024-07-24T22:19:02.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.117+0000 7f0aff7fe640 1 -- 172.21.15.47:0/2441672063 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f0b080037a0 con 0x7f0b0c103ef0 2024-07-24T22:19:02.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.118+0000 7f0aff7fe640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0af80b3d40 0x7f0af80b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:02.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.118+0000 7f0b12162640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0af80b3d40 0x7f0af80b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:02.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.118+0000 7f0aff7fe640 1 -- 172.21.15.47:0/2441672063 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f0b080e45e0 con 0x7f0b0c103ef0 2024-07-24T22:19:02.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.118+0000 7f0b12162640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0af80b3d40 0x7f0af80b6200 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000bbe0 tx=0x7f0b0000b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:02.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.121+0000 7f0aff7fe640 1 -- 172.21.15.47:0/2441672063 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f0b080ab860 con 0x7f0b0c103ef0 2024-07-24T22:19:02.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:01 smithi183 ceph-mon[37007]: pgmap v732: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 148 op/s 2024-07-24T22:19:02.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:01 smithi188 ceph-mon[37380]: pgmap v732: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 148 op/s 2024-07-24T22:19:02.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.336+0000 7f0b143c6640 1 -- 172.21.15.47:0/2441672063 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f0b0c0ff780 con 0x7f0af80b3d40 2024-07-24T22:19:02.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.343+0000 7f0aff7fe640 1 -- 172.21.15.47:0/2441672063 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f0b0c0ff780 con 0x7f0af80b3d40 2024-07-24T22:19:02.346 INFO:teuthology.orchestra.run.smithi047.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T22:06:54", "first": "2024-07-24T22:07:00", "last": "2024-07-24T22:19:00", "last_pruned": "2024-07-24T22:19:00", "created_count": 13, "pruned_count": 7, "active": true} 2024-07-24T22:19:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.345+0000 7f0b143c6640 1 -- 172.21.15.47:0/2441672063 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0af80b3d40 msgr2=0x7f0af80b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.345+0000 7f0b143c6640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0af80b3d40 0x7f0af80b6200 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000bbe0 tx=0x7f0b0000b390 comp rx=0 tx=0).stop 2024-07-24T22:19:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.345+0000 7f0b143c6640 1 -- 172.21.15.47:0/2441672063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b0c103ef0 msgr2=0x7f0b0c1017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.345+0000 7f0b143c6640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b0c103ef0 0x7f0b0c1017b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800e9c0 tx=0x7f0b0800ee80 comp rx=0 tx=0).stop 2024-07-24T22:19:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.345+0000 7f0b143c6640 1 -- 172.21.15.47:0/2441672063 shutdown_connections 2024-07-24T22:19:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.345+0000 7f0b143c6640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f0af80b3d40 0x7f0af80b6200 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.345+0000 7f0b143c6640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b0c10c9f0 0x7f0b0c101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.345+0000 7f0b143c6640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b0c103ef0 0x7f0b0c1017b0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.345+0000 7f0b143c6640 1 --2- 172.21.15.47:0/2441672063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b0c1035d0 0x7f0b0c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.345+0000 7f0b143c6640 1 -- 172.21.15.47:0/2441672063 >> 172.21.15.47:0/2441672063 conn(0x7f0b0c0782e0 msgr2=0x7f0b0c0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.345+0000 7f0b143c6640 1 -- 172.21.15.47:0/2441672063 shutdown_connections 2024-07-24T22:19:02.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.346+0000 7f0b143c6640 1 -- 172.21.15.47:0/2441672063 wait complete. 2024-07-24T22:19:02.360 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-07-24T22:19:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.505+0000 7f65799c3640 1 -- 172.21.15.47:0/4259054208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65741015d0 msgr2=0x7f65741019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.505+0000 7f65799c3640 1 --2- 172.21.15.47:0/4259054208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65741015d0 0x7f65741019b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f6564009ca0 tx=0x7f656402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.505+0000 7f65799c3640 1 -- 172.21.15.47:0/4259054208 shutdown_connections 2024-07-24T22:19:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.505+0000 7f65799c3640 1 --2- 172.21.15.47:0/4259054208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6574107950 0x7f657410e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.505+0000 7f65799c3640 1 --2- 172.21.15.47:0/4259054208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6574106fd0 0x7f6574107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.505+0000 7f65799c3640 1 --2- 172.21.15.47:0/4259054208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65741015d0 0x7f65741019b0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.505+0000 7f65799c3640 1 -- 172.21.15.47:0/4259054208 >> 172.21.15.47:0/4259054208 conn(0x7f65740fd030 msgr2=0x7f65740ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.505+0000 7f65799c3640 1 -- 172.21.15.47:0/4259054208 shutdown_connections 2024-07-24T22:19:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.505+0000 7f65799c3640 1 -- 172.21.15.47:0/4259054208 wait complete. 2024-07-24T22:19:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.505+0000 7f65799c3640 1 Processor -- start 2024-07-24T22:19:02.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65799c3640 1 -- start start 2024-07-24T22:19:02.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65799c3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65741015d0 0x7f6574198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:02.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65799c3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6574106fd0 0x7f65741991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:02.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65799c3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6574107950 0x7f657419e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:02.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65799c3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f65741115f0 con 0x7f6574107950 2024-07-24T22:19:02.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65799c3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6574111470 con 0x7f65741015d0 2024-07-24T22:19:02.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65799c3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6574111770 con 0x7f6574106fd0 2024-07-24T22:19:02.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65737fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6574107950 0x7f657419e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:02.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65737fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6574107950 0x7f657419e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57224/0 (socket says 172.21.15.47:57224) 2024-07-24T22:19:02.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65737fe640 1 -- 172.21.15.47:0/1126129138 learned_addr learned my addr 172.21.15.47:0/1126129138 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:02.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f6572ffd640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65741015d0 0x7f6574198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:02.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65727fc640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6574106fd0 0x7f65741991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:02.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65737fe640 1 -- 172.21.15.47:0/1126129138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6574106fd0 msgr2=0x7f65741991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:02.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65737fe640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6574106fd0 0x7f65741991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65737fe640 1 -- 172.21.15.47:0/1126129138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65741015d0 msgr2=0x7f6574198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:02.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65737fe640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65741015d0 0x7f6574198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.506+0000 7f65737fe640 1 -- 172.21.15.47:0/1126129138 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657419ed30 con 0x7f6574107950 2024-07-24T22:19:02.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.507+0000 7f65737fe640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6574107950 0x7f657419e560 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f656c00c970 tx=0x7f656c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:02.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.507+0000 7f65789c1640 1 -- 172.21.15.47:0/1126129138 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c007bb0 con 0x7f6574107950 2024-07-24T22:19:02.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.507+0000 7f65789c1640 1 -- 172.21.15.47:0/1126129138 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f656c007d50 con 0x7f6574107950 2024-07-24T22:19:02.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.507+0000 7f65799c3640 1 -- 172.21.15.47:0/1126129138 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657419f020 con 0x7f6574107950 2024-07-24T22:19:02.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.507+0000 7f65789c1640 1 -- 172.21.15.47:0/1126129138 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c004e60 con 0x7f6574107950 2024-07-24T22:19:02.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.507+0000 7f65799c3640 1 -- 172.21.15.47:0/1126129138 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65741a58c0 con 0x7f6574107950 2024-07-24T22:19:02.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.508+0000 7f65799c3640 1 -- 172.21.15.47:0/1126129138 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65741019b0 con 0x7f6574107950 2024-07-24T22:19:02.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.509+0000 7f65789c1640 1 -- 172.21.15.47:0/1126129138 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f656c005000 con 0x7f6574107950 2024-07-24T22:19:02.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.510+0000 7f65789c1640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f655c0b3dc0 0x7f655c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:02.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.510+0000 7f6572ffd640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f655c0b3dc0 0x7f655c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:02.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.510+0000 7f65789c1640 1 -- 172.21.15.47:0/1126129138 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8565+0+0 (secure 0 0 0) 0x7f656c0e3f10 con 0x7f6574107950 2024-07-24T22:19:02.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.510+0000 7f6572ffd640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f655c0b3dc0 0x7f655c0b6280 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6564006010 tx=0x7f6564009820 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:02.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.513+0000 7f65789c1640 1 -- 172.21.15.47:0/1126129138 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f656c014030 con 0x7f6574107950 2024-07-24T22:19:02.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.733+0000 7f65799c3640 1 -- 172.21.15.47:0/1126129138 --> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f6574062f80 con 0x7f655c0b3dc0 2024-07-24T22:19:02.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.741+0000 7f65789c1640 1 -- 172.21.15.47:0/1126129138 <== mgr.14214 v2:172.21.15.47:6800/4198530936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f6574062f80 con 0x7f655c0b3dc0 2024-07-24T22:19:02.744 INFO:teuthology.orchestra.run.smithi047.stdout:/ 1m 6m3h 2024-07-24T22:19:02.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.743+0000 7f65799c3640 1 -- 172.21.15.47:0/1126129138 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f655c0b3dc0 msgr2=0x7f655c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:02.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.743+0000 7f65799c3640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f655c0b3dc0 0x7f655c0b6280 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6564006010 tx=0x7f6564009820 comp rx=0 tx=0).stop 2024-07-24T22:19:02.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.743+0000 7f65799c3640 1 -- 172.21.15.47:0/1126129138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6574107950 msgr2=0x7f657419e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:02.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.743+0000 7f65799c3640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6574107950 0x7f657419e560 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f656c00c970 tx=0x7f656c00ce30 comp rx=0 tx=0).stop 2024-07-24T22:19:02.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.743+0000 7f65799c3640 1 -- 172.21.15.47:0/1126129138 shutdown_connections 2024-07-24T22:19:02.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.743+0000 7f65799c3640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f655c0b3dc0 0x7f655c0b6280 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.743+0000 7f65799c3640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6574107950 0x7f657419e560 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.743+0000 7f65799c3640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6574106fd0 0x7f65741991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.743+0000 7f65799c3640 1 --2- 172.21.15.47:0/1126129138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65741015d0 0x7f6574198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:02.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.743+0000 7f65799c3640 1 -- 172.21.15.47:0/1126129138 >> 172.21.15.47:0/1126129138 conn(0x7f65740fd030 msgr2=0x7f657406afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:02.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.743+0000 7f65799c3640 1 -- 172.21.15.47:0/1126129138 shutdown_connections 2024-07-24T22:19:02.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:02.743+0000 7f65799c3640 1 -- 172.21.15.47:0/1126129138 wait complete. 2024-07-24T22:19:02.757 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-07-24T22:19:02.768 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-07-24T22:19:04.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:03 smithi047 ceph-mon[32551]: from='client.18204 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:19:04.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:03 smithi047 ceph-mon[32551]: pgmap v733: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 209 op/s 2024-07-24T22:19:04.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:03 smithi047 ceph-mon[32551]: from='client.18210 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:19:04.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:03 smithi188 ceph-mon[37380]: from='client.18204 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:19:04.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:03 smithi188 ceph-mon[37380]: pgmap v733: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 209 op/s 2024-07-24T22:19:04.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:03 smithi188 ceph-mon[37380]: from='client.18210 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:19:04.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:03 smithi183 ceph-mon[37007]: from='client.18204 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:19:04.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:03 smithi183 ceph-mon[37007]: pgmap v733: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 209 op/s 2024-07-24T22:19:04.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:03 smithi183 ceph-mon[37007]: from='client.18210 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-24T22:19:06.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:05 smithi047 ceph-mon[32551]: pgmap v734: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 48 KiB/s wr, 240 op/s 2024-07-24T22:19:06.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:05 smithi188 ceph-mon[37380]: pgmap v734: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 48 KiB/s wr, 240 op/s 2024-07-24T22:19:06.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:05 smithi183 ceph-mon[37007]: pgmap v734: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 48 KiB/s wr, 240 op/s 2024-07-24T22:19:08.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:07 smithi047 ceph-mon[32551]: pgmap v735: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 70 KiB/s wr, 242 op/s 2024-07-24T22:19:08.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:07 smithi188 ceph-mon[37380]: pgmap v735: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 70 KiB/s wr, 242 op/s 2024-07-24T22:19:08.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:07 smithi183 ceph-mon[37007]: pgmap v735: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 70 KiB/s wr, 242 op/s 2024-07-24T22:19:10.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:09 smithi047 ceph-mon[32551]: pgmap v736: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 71 KiB/s wr, 242 op/s 2024-07-24T22:19:10.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:09 smithi188 ceph-mon[37380]: pgmap v736: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 71 KiB/s wr, 242 op/s 2024-07-24T22:19:10.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:09 smithi183 ceph-mon[37007]: pgmap v736: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 71 KiB/s wr, 242 op/s 2024-07-24T22:19:12.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:11 smithi047 ceph-mon[32551]: pgmap v737: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 52 KiB/s wr, 172 op/s 2024-07-24T22:19:12.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:11 smithi047 ceph-mon[32551]: osdmap e98: 12 total, 12 up, 12 in 2024-07-24T22:19:12.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:11 smithi188 ceph-mon[37380]: pgmap v737: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 52 KiB/s wr, 172 op/s 2024-07-24T22:19:12.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:11 smithi188 ceph-mon[37380]: osdmap e98: 12 total, 12 up, 12 in 2024-07-24T22:19:12.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:11 smithi183 ceph-mon[37007]: pgmap v737: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 52 KiB/s wr, 172 op/s 2024-07-24T22:19:12.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:11 smithi183 ceph-mon[37007]: osdmap e98: 12 total, 12 up, 12 in 2024-07-24T22:19:14.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:13 smithi047 ceph-mon[32551]: pgmap v739: 97 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 86 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 43 op/s 2024-07-24T22:19:14.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:13 smithi188 ceph-mon[37380]: pgmap v739: 97 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 86 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 43 op/s 2024-07-24T22:19:14.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:13 smithi183 ceph-mon[37007]: pgmap v739: 97 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 86 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 43 op/s 2024-07-24T22:19:16.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:15 smithi047 ceph-mon[32551]: pgmap v740: 97 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 86 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-07-24T22:19:16.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:15 smithi188 ceph-mon[37380]: pgmap v740: 97 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 86 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-07-24T22:19:16.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:15 smithi183 ceph-mon[37007]: pgmap v740: 97 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 86 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-07-24T22:19:18.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:17 smithi188 ceph-mon[37380]: pgmap v741: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 716 B/s wr, 2 op/s 2024-07-24T22:19:18.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:17 smithi183 ceph-mon[37007]: pgmap v741: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 716 B/s wr, 2 op/s 2024-07-24T22:19:18.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:17 smithi047 ceph-mon[32551]: pgmap v741: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 716 B/s wr, 2 op/s 2024-07-24T22:19:19.895 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-07-24T22:19:20.178 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:19:20.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:19 smithi047 ceph-mon[32551]: pgmap v742: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:19:20.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:19 smithi047 ceph-mon[32551]: osdmap e99: 12 total, 12 up, 12 in 2024-07-24T22:19:20.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:19 smithi188 ceph-mon[37380]: pgmap v742: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:19:20.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:19 smithi188 ceph-mon[37380]: osdmap e99: 12 total, 12 up, 12 in 2024-07-24T22:19:20.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:19 smithi183 ceph-mon[37007]: pgmap v742: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 307 B/s wr, 2 op/s 2024-07-24T22:19:20.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:19 smithi183 ceph-mon[37007]: osdmap e99: 12 total, 12 up, 12 in 2024-07-24T22:19:21.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.877+0000 7f98dda02640 1 -- 172.21.15.47:0/86902772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d8108b20 msgr2=0x7f98d810f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:21.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.877+0000 7f98dda02640 1 --2- 172.21.15.47:0/86902772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d8108b20 0x7f98d810f320 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009ca0 tx=0x7f98d002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.877+0000 7f98dda02640 1 -- 172.21.15.47:0/86902772 shutdown_connections 2024-07-24T22:19:21.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.877+0000 7f98dda02640 1 --2- 172.21.15.47:0/86902772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d8108b20 0x7f98d810f320 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.877+0000 7f98dda02640 1 --2- 172.21.15.47:0/86902772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98d81081a0 0x7f98d81085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.877+0000 7f98dda02640 1 --2- 172.21.15.47:0/86902772 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98d8102790 0x7f98d8102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.877+0000 7f98dda02640 1 -- 172.21.15.47:0/86902772 >> 172.21.15.47:0/86902772 conn(0x7f98d80fe200 msgr2=0x7f98d8100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:21.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.877+0000 7f98dda02640 1 -- 172.21.15.47:0/86902772 shutdown_connections 2024-07-24T22:19:21.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.877+0000 7f98dda02640 1 -- 172.21.15.47:0/86902772 wait complete. 2024-07-24T22:19:21.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.878+0000 7f98dda02640 1 Processor -- start 2024-07-24T22:19:21.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.878+0000 7f98dda02640 1 -- start start 2024-07-24T22:19:21.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.878+0000 7f98dda02640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98d8102790 0x7f98d8198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.878+0000 7f98dda02640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98d81081a0 0x7f98d8199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.878+0000 7f98dda02640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d8108b20 0x7f98d819e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.878+0000 7f98dda02640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f98d8112740 con 0x7f98d8108b20 2024-07-24T22:19:21.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.878+0000 7f98dda02640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f98d81125c0 con 0x7f98d81081a0 2024-07-24T22:19:21.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.878+0000 7f98dda02640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f98d81128c0 con 0x7f98d8102790 2024-07-24T22:19:21.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.878+0000 7f98d77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d8108b20 0x7f98d819e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.878+0000 7f98d77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d8108b20 0x7f98d819e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47618/0 (socket says 172.21.15.47:47618) 2024-07-24T22:19:21.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.878+0000 7f98d77fe640 1 -- 172.21.15.47:0/4224088481 learned_addr learned my addr 172.21.15.47:0/4224088481 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:21.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.879+0000 7f98d67fc640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98d81081a0 0x7f98d8199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.879+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98d8102790 0x7f98d8198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.879+0000 7f98d77fe640 1 -- 172.21.15.47:0/4224088481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98d8102790 msgr2=0x7f98d8198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.879+0000 7f98d77fe640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98d8102790 0x7f98d8198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.879+0000 7f98d77fe640 1 -- 172.21.15.47:0/4224088481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98d81081a0 msgr2=0x7f98d8199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.879+0000 7f98d77fe640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98d81081a0 0x7f98d8199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.879+0000 7f98d77fe640 1 -- 172.21.15.47:0/4224088481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d819ecc0 con 0x7f98d8108b20 2024-07-24T22:19:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.879+0000 7f98d77fe640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d8108b20 0x7f98d819e4f0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f98d0005cc0 tx=0x7f98d002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.879+0000 7f98dca00640 1 -- 172.21.15.47:0/4224088481 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0003bf0 con 0x7f98d8108b20 2024-07-24T22:19:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.879+0000 7f98dda02640 1 -- 172.21.15.47:0/4224088481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d819ef50 con 0x7f98d8108b20 2024-07-24T22:19:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.879+0000 7f98dca00640 1 -- 172.21.15.47:0/4224088481 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98d0003d90 con 0x7f98d8108b20 2024-07-24T22:19:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.879+0000 7f98dca00640 1 -- 172.21.15.47:0/4224088481 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d002fbc0 con 0x7f98d8108b20 2024-07-24T22:19:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.879+0000 7f98dda02640 1 -- 172.21.15.47:0/4224088481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d81a5670 con 0x7f98d8108b20 2024-07-24T22:19:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.882+0000 7f98dfdb3740 1 Processor -- start 2024-07-24T22:19:21.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.882+0000 7f98dca00640 1 -- 172.21.15.47:0/4224088481 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f98d002fd60 con 0x7f98d8108b20 2024-07-24T22:19:21.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.882+0000 7f98dfdb3740 1 -- start start 2024-07-24T22:19:21.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.882+0000 7f98dfdb3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c536b0 0x556938c53a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.882+0000 7f98dfdb3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c53fd0 0x556938c5fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.882+0000 7f98dfdb3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c5ff60 0x556938c62350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.882+0000 7f98dfdb3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556938bca990 con 0x556938c536b0 2024-07-24T22:19:21.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.882+0000 7f98dfdb3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556938bb9e90 con 0x556938c5ff60 2024-07-24T22:19:21.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.882+0000 7f98dfdb3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556938bbded0 con 0x556938c53fd0 2024-07-24T22:19:21.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.882+0000 7f98d67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c536b0 0x556938c53a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.882+0000 7f98d67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c536b0 0x556938c53a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47630/0 (socket says 172.21.15.47:47630) 2024-07-24T22:19:21.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.882+0000 7f98d67fc640 1 -- 172.21.15.47:0/3475657991 learned_addr learned my addr 172.21.15.47:0/3475657991 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:21.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.882+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/3475657991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c53fd0 0x556938c5fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.883+0000 7f98d67fc640 1 -- 172.21.15.47:0/3475657991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c53fd0 msgr2=0x556938c5fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:21.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.883+0000 7f98d67fc640 1 --2- 172.21.15.47:0/3475657991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c53fd0 0x556938c5fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.883+0000 7f98d67fc640 1 -- 172.21.15.47:0/3475657991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c5ff60 msgr2=0x556938c62350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:21.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.883+0000 7f98d67fc640 1 --2- 172.21.15.47:0/3475657991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c5ff60 0x556938c62350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.883+0000 7f98d67fc640 1 -- 172.21.15.47:0/3475657991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556938b43300 con 0x556938c536b0 2024-07-24T22:19:21.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.883+0000 7f98dca00640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f98c00b3d40 0x7f98c00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.883+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f98c00b3d40 0x7f98c00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.883+0000 7f98d67fc640 1 --2- 172.21.15.47:0/3475657991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c536b0 0x556938c53a90 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00bd50 tx=0x7f98cc0127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24bed6ae4732602 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:21.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.883+0000 7f98dca00640 1 -- 172.21.15.47:0/4224088481 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7f98d0105580 con 0x7f98d8108b20 2024-07-24T22:19:21.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.883+0000 7f98bdffb640 1 -- 172.21.15.47:0/3475657991 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98cc0120d0 con 0x556938c536b0 2024-07-24T22:19:21.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.883+0000 7f98bdffb640 1 -- 172.21.15.47:0/3475657991 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98cc016070 con 0x556938c536b0 2024-07-24T22:19:21.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.883+0000 7f98bdffb640 1 -- 172.21.15.47:0/3475657991 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98cc010760 con 0x556938c536b0 2024-07-24T22:19:21.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.884+0000 7f98dfdb3740 1 -- 172.21.15.47:0/3475657991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c536b0 msgr2=0x556938c53a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:21.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.884+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f98c00b3d40 0x7f98c00b6200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x556938c523c0 tx=0x7f98c800a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:21.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.884+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/3475657991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c536b0 0x556938c53a90 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00bd50 tx=0x7f98cc0127c0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.884+0000 7f98dfdb3740 1 -- 172.21.15.47:0/3475657991 shutdown_connections 2024-07-24T22:19:21.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.884+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/3475657991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c5ff60 0x556938c62350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.884+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/3475657991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c53fd0 0x556938c5fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.884+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/3475657991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c536b0 0x556938c53a90 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.884+0000 7f98dfdb3740 1 -- 172.21.15.47:0/3475657991 >> 172.21.15.47:0/3475657991 conn(0x556938c514e0 msgr2=0x556938c52680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:21.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.884+0000 7f98dfdb3740 1 -- 172.21.15.47:0/3475657991 shutdown_connections 2024-07-24T22:19:21.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.884+0000 7f98dfdb3740 1 -- 172.21.15.47:0/3475657991 wait complete. 2024-07-24T22:19:21.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.884+0000 7f98dfdb3740 1 -- start start 2024-07-24T22:19:21.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.884+0000 7f98dfdb3740 1 Processor -- start 2024-07-24T22:19:21.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98dfdb3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c536b0 0x556938c5cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98dfdb3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c53fd0 0x556938c5d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98dfdb3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c5ff60 0x556938c5d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98dfdb3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556938a1d700 con 0x556938c53fd0 2024-07-24T22:19:21.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98dfdb3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x556938b5c5d0 con 0x556938c536b0 2024-07-24T22:19:21.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98dfdb3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x556938c62be0 con 0x556938c5ff60 2024-07-24T22:19:21.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98dfdb3740 10 client.0 _ll_register_callbacks cb 0x556938b7c940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:19:21.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98d67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c53fd0 0x556938c5d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98d67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c53fd0 0x556938c5d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47640/0 (socket says 172.21.15.47:47640) 2024-07-24T22:19:21.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98d67fc640 1 -- 172.21.15.47:0/2376997277 learned_addr learned my addr 172.21.15.47:0/2376997277 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:21.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98d77fe640 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c5ff60 0x556938c5d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c536b0 0x556938c5cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98d67fc640 1 -- 172.21.15.47:0/2376997277 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c5ff60 msgr2=0x556938c5d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:21.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98d67fc640 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c5ff60 0x556938c5d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98d67fc640 1 -- 172.21.15.47:0/2376997277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c536b0 msgr2=0x556938c5cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:21.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98d67fc640 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c536b0 0x556938c5cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98d67fc640 1 -- 172.21.15.47:0/2376997277 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556938b4f660 con 0x556938c53fd0 2024-07-24T22:19:21.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.885+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c536b0 0x556938c5cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:19:21.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98d67fc640 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c53fd0 0x556938c5d430 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f98cc005940 tx=0x7f98cc012300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f262cf2ea0bb59f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:21.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:19:21.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98b6ffd640 1 -- 172.21.15.47:0/2376997277 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98cc020070 con 0x556938c53fd0 2024-07-24T22:19:21.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98b6ffd640 1 -- 172.21.15.47:0/2376997277 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7f98cc005450 con 0x556938c53fd0 2024-07-24T22:19:21.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2376997277 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98cc016070 con 0x556938c53fd0 2024-07-24T22:19:21.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98b6ffd640 1 -- 172.21.15.47:0/2376997277 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f98cc005650 con 0x556938c53fd0 2024-07-24T22:19:21.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98dfdb3740 10 client.18222 fetch_fsmap learned FSMap version 20 2024-07-24T22:19:21.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2376997277 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55693891a650 con 0x556938c53fd0 2024-07-24T22:19:21.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98b6ffd640 1 -- 172.21.15.47:0/2376997277 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98cc016070 con 0x556938c53fd0 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98b6ffd640 1 -- 172.21.15.47:0/2376997277 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f98cc01b920 con 0x556938c53fd0 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98dfdb3740 10 client.18222 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98dfdb3740 10 client.18222 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98dfdb3740 20 client.18222 populate_metadata read hostname 'smithi047' 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556938c6f920 0x556938c71d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98dfdb3740 4 client.18222 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.886+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2376997277 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556938bcc8e0 con 0x556938c6f920 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.887+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556938c6f920 0x556938c71d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.887+0000 7f98b6ffd640 10 client.18222 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.887+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556938c6f920 0x556938c71d10 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f178f2f7b14eabde server_cookie=93ceedce1d838ab4 in_seq=0 out_seq=0 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98b6ffd640 1 -- 172.21.15.47:0/2376997277 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556938bcc8e0 con 0x556938c6f920 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98b6ffd640 10 client.18222 handle_command_reply: tid=0 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98dfdb3740 1 client.18222 shutdown 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2376997277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c53fd0 msgr2=0x556938c5d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c53fd0 0x556938c5d430 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f98cc005940 tx=0x7f98cc012300 comp rx=0 tx=0).stop 2024-07-24T22:19:21.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2376997277 shutdown_connections 2024-07-24T22:19:21.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556938c6f920 0x556938c71d10 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c5ff60 0x556938c5d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c53fd0 0x556938c5d430 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/2376997277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c536b0 0x556938c5cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98b6ffd640 0 client.18222 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:19:21.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2376997277 >> 172.21.15.47:0/2376997277 conn(0x556938c514e0 msgr2=0x556938c57080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:21.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2376997277 shutdown_connections 2024-07-24T22:19:21.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2376997277 wait complete. 2024-07-24T22:19:21.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.888+0000 7f98dfdb3740 20 client.18222 trim_cache size 0 max 16384 2024-07-24T22:19:21.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.906+0000 7f98dfdb3740 1 Processor -- start 2024-07-24T22:19:21.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98dfdb3740 1 -- start start 2024-07-24T22:19:21.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98dfdb3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c536b0 0x556938c56f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98dfdb3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c53fd0 0x556938c772b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98dfdb3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c5ff60 0x556938c777f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98dfdb3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f98d81ac160 con 0x556938c53fd0 2024-07-24T22:19:21.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98dfdb3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f98d81ae9c0 con 0x556938c5ff60 2024-07-24T22:19:21.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98dfdb3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f98d81ac7b0 con 0x556938c536b0 2024-07-24T22:19:21.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98d67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c53fd0 0x556938c772b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98d6ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c536b0 0x556938c56f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98d6ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c536b0 0x556938c56f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.47:48530/0 (socket says 172.21.15.47:48530) 2024-07-24T22:19:21.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98d6ffd640 1 -- 172.21.15.47:0/3840234258 learned_addr learned my addr 172.21.15.47:0/3840234258 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:21.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98d77fe640 1 --2- 172.21.15.47:0/3840234258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c5ff60 0x556938c777f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98d6ffd640 1 -- 172.21.15.47:0/3840234258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c5ff60 msgr2=0x556938c777f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:21.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/3840234258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c5ff60 0x556938c777f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98d6ffd640 1 -- 172.21.15.47:0/3840234258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c53fd0 msgr2=0x556938c772b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:21.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/3840234258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c53fd0 0x556938c772b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98d6ffd640 1 -- 172.21.15.47:0/3840234258 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556938c51f60 con 0x556938c536b0 2024-07-24T22:19:21.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.907+0000 7f98d67fc640 1 --2- 172.21.15.47:0/3840234258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c53fd0 0x556938c772b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T22:19:21.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.908+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/3840234258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c536b0 0x556938c56f00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x556938a1d850 tx=0x7f98c8015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3836ab34b96a5948 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:21.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.908+0000 7f98bd7fa640 1 -- 172.21.15.47:0/3840234258 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c802d070 con 0x556938c536b0 2024-07-24T22:19:21.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.908+0000 7f98bd7fa640 1 -- 172.21.15.47:0/3840234258 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98c801bd70 con 0x556938c536b0 2024-07-24T22:19:21.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.908+0000 7f98bd7fa640 1 -- 172.21.15.47:0/3840234258 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c8020070 con 0x556938c536b0 2024-07-24T22:19:21.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.909+0000 7f98dfdb3740 1 -- 172.21.15.47:0/3840234258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c536b0 msgr2=0x556938c56f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:21.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.909+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/3840234258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c536b0 0x556938c56f00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x556938a1d850 tx=0x7f98c8015000 comp rx=0 tx=0).stop 2024-07-24T22:19:21.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.909+0000 7f98dfdb3740 1 -- 172.21.15.47:0/3840234258 shutdown_connections 2024-07-24T22:19:21.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.909+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/3840234258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c5ff60 0x556938c777f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.909+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/3840234258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c53fd0 0x556938c772b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.909+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/3840234258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c536b0 0x556938c56f00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.909+0000 7f98dfdb3740 1 -- 172.21.15.47:0/3840234258 >> 172.21.15.47:0/3840234258 conn(0x556938c514e0 msgr2=0x556938c567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:21.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.909+0000 7f98dfdb3740 1 -- 172.21.15.47:0/3840234258 shutdown_connections 2024-07-24T22:19:21.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.909+0000 7f98dfdb3740 1 -- 172.21.15.47:0/3840234258 wait complete. 2024-07-24T22:19:21.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.909+0000 7f98dfdb3740 1 -- start start 2024-07-24T22:19:21.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.910+0000 7f98dfdb3740 1 Processor -- start 2024-07-24T22:19:21.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.910+0000 7f98dfdb3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c536b0 0x556938cd5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.910+0000 7f98dfdb3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c53fd0 0x556938c67ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.910+0000 7f98dfdb3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c5ff60 0x556938c684b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.910+0000 7f98dfdb3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f98d81ace80 con 0x556938c5ff60 2024-07-24T22:19:21.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.910+0000 7f98dfdb3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f98d81ae2f0 con 0x556938c536b0 2024-07-24T22:19:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.910+0000 7f98dfdb3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f98d81ad550 con 0x556938c53fd0 2024-07-24T22:19:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.910+0000 7f98dfdb3740 10 client.0 _ll_register_callbacks cb 0x7f98cc00bc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:19:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.910+0000 7f98d77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c5ff60 0x556938c684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.910+0000 7f98d77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c5ff60 0x556938c684b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47652/0 (socket says 172.21.15.47:47652) 2024-07-24T22:19:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.910+0000 7f98d77fe640 1 -- 172.21.15.47:0/2438816984 learned_addr learned my addr 172.21.15.47:0/2438816984 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.910+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/2438816984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c536b0 0x556938cd5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.910+0000 7f98d67fc640 1 --2- 172.21.15.47:0/2438816984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c53fd0 0x556938c67ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.911+0000 7f98d77fe640 1 -- 172.21.15.47:0/2438816984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c53fd0 msgr2=0x556938c67ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.911+0000 7f98d77fe640 1 --2- 172.21.15.47:0/2438816984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c53fd0 0x556938c67ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.911+0000 7f98d77fe640 1 -- 172.21.15.47:0/2438816984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c536b0 msgr2=0x556938cd5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.911+0000 7f98d77fe640 1 --2- 172.21.15.47:0/2438816984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c536b0 0x556938cd5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.911+0000 7f98d77fe640 1 -- 172.21.15.47:0/2438816984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556938cd3490 con 0x556938c5ff60 2024-07-24T22:19:21.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.911+0000 7f98d77fe640 1 --2- 172.21.15.47:0/2438816984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c5ff60 0x556938c684b0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f98d002f550 tx=0x7f98d00cbaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4cbf498015aa37 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:21.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.911+0000 7f98b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:19:21.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.911+0000 7f98b6ffd640 1 -- 172.21.15.47:0/2438816984 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d00d0870 con 0x556938c5ff60 2024-07-24T22:19:21.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.911+0000 7f98b6ffd640 1 -- 172.21.15.47:0/2438816984 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7f98d00d4e90 con 0x556938c5ff60 2024-07-24T22:19:21.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.911+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2438816984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98c801bd70 con 0x556938c5ff60 2024-07-24T22:19:21.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.911+0000 7f98b6ffd640 1 -- 172.21.15.47:0/2438816984 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f98d00d5320 con 0x556938c5ff60 2024-07-24T22:19:21.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.911+0000 7f98dfdb3740 10 client.18228 fetch_fsmap learned FSMap version 20 2024-07-24T22:19:21.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.911+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2438816984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556938ce31b0 con 0x556938c5ff60 2024-07-24T22:19:21.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.912+0000 7f98b6ffd640 1 -- 172.21.15.47:0/2438816984 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98c801bd70 con 0x556938c5ff60 2024-07-24T22:19:21.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.912+0000 7f98b6ffd640 1 -- 172.21.15.47:0/2438816984 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f98d01051a0 con 0x556938c5ff60 2024-07-24T22:19:21.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.912+0000 7f98dfdb3740 10 client.18228 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:19:21.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.912+0000 7f98dfdb3740 10 client.18228 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:19:21.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.912+0000 7f98dfdb3740 20 client.18228 populate_metadata read hostname 'smithi047' 2024-07-24T22:19:21.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.912+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/2438816984 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556938ce3950 0x556938ce5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:21.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.912+0000 7f98dfdb3740 4 client.18228 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-07-24T22:19:21.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.912+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2438816984 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556938bc8380 con 0x556938ce3950 2024-07-24T22:19:21.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.912+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/2438816984 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556938ce3950 0x556938ce5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98b6ffd640 10 client.18228 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:19:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98d6ffd640 1 --2- 172.21.15.47:0/2438816984 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556938ce3950 0x556938ce5d70 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b014b6437f43fbd1 server_cookie=12a224635b7dc407 in_seq=0 out_seq=0 2024-07-24T22:19:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98b6ffd640 1 -- 172.21.15.47:0/2438816984 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556938bc8380 con 0x556938ce3950 2024-07-24T22:19:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98b6ffd640 10 client.18228 handle_command_reply: tid=0 2024-07-24T22:19:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98dfdb3740 1 client.18228 shutdown 2024-07-24T22:19:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2438816984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c5ff60 msgr2=0x556938c684b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/2438816984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c5ff60 0x556938c684b0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f98d002f550 tx=0x7f98d00cbaf0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2438816984 shutdown_connections 2024-07-24T22:19:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/2438816984 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x556938ce3950 0x556938ce5d70 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/2438816984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556938c5ff60 0x556938c684b0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/2438816984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x556938c53fd0 0x556938c67ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98dfdb3740 1 --2- 172.21.15.47:0/2438816984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556938c536b0 0x556938cd5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2438816984 >> 172.21.15.47:0/2438816984 conn(0x556938c514e0 msgr2=0x556938c567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:21.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98b6ffd640 0 client.18228 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:19:21.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2438816984 shutdown_connections 2024-07-24T22:19:21.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.913+0000 7f98dfdb3740 1 -- 172.21.15.47:0/2438816984 wait complete. 2024-07-24T22:19:21.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.914+0000 7f98dfdb3740 20 client.18228 trim_cache size 0 max 16384 2024-07-24T22:19:21.921 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:19:21.921 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-07-24T22:19:21.921 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {} 2024-07-24T22:19:21.922 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:19:21.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.914+0000 7f98dda02640 1 -- 172.21.15.47:0/4224088481 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f98c00b3d40 msgr2=0x7f98c00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:21.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.914+0000 7f98dda02640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f98c00b3d40 0x7f98c00b6200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x556938c523c0 tx=0x7f98c800a2d0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.914+0000 7f98dda02640 1 -- 172.21.15.47:0/4224088481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d8108b20 msgr2=0x7f98d819e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:21.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.914+0000 7f98dda02640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d8108b20 0x7f98d819e4f0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f98d0005cc0 tx=0x7f98d002f380 comp rx=0 tx=0).stop 2024-07-24T22:19:21.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.914+0000 7f98dda02640 1 -- 172.21.15.47:0/4224088481 shutdown_connections 2024-07-24T22:19:21.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.914+0000 7f98dda02640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f98c00b3d40 0x7f98c00b6200 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.914+0000 7f98dda02640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d8108b20 0x7f98d819e4f0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.914+0000 7f98dda02640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98d81081a0 0x7f98d8199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.914+0000 7f98dda02640 1 --2- 172.21.15.47:0/4224088481 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98d8102790 0x7f98d8198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:21.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.914+0000 7f98dda02640 1 -- 172.21.15.47:0/4224088481 >> 172.21.15.47:0/4224088481 conn(0x7f98d80fe200 msgr2=0x7f98d81005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:21.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.915+0000 7f98dda02640 1 -- 172.21.15.47:0/4224088481 shutdown_connections 2024-07-24T22:19:21.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:21.915+0000 7f98dda02640 1 -- 172.21.15.47:0/4224088481 wait complete. 2024-07-24T22:19:22.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:21 smithi047 ceph-mon[32551]: pgmap v744: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 324 B/s wr, 2 op/s 2024-07-24T22:19:22.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:21 smithi188 ceph-mon[37380]: pgmap v744: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 324 B/s wr, 2 op/s 2024-07-24T22:19:22.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:21 smithi183 ceph-mon[37007]: pgmap v744: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 324 B/s wr, 2 op/s 2024-07-24T22:19:22.886 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-07-24T22:19:22.886 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:19:23.170 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:19:24.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:23 smithi188 ceph-mon[37380]: pgmap v745: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-07-24T22:19:24.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:23 smithi183 ceph-mon[37007]: pgmap v745: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-07-24T22:19:24.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:23 smithi047 ceph-mon[32551]: pgmap v745: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-07-24T22:19:24.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.958+0000 7f78771ce640 1 -- 172.21.15.47:0/2170913621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7870103660 msgr2=0x7f7870103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:24.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.958+0000 7f78771ce640 1 --2- 172.21.15.47:0/2170913621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7870103660 0x7f7870103a40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f7860009900 tx=0x7f786002a410 comp rx=0 tx=0).stop 2024-07-24T22:19:24.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.958+0000 7f78771ce640 1 -- 172.21.15.47:0/2170913621 shutdown_connections 2024-07-24T22:19:24.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.958+0000 7f78771ce640 1 --2- 172.21.15.47:0/2170913621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f787010cac0 0x7f787010ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:24.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.958+0000 7f78771ce640 1 --2- 172.21.15.47:0/2170913621 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7870103f80 0x7f787010c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:24.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.958+0000 7f78771ce640 1 --2- 172.21.15.47:0/2170913621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7870103660 0x7f7870103a40 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:24.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.958+0000 7f78771ce640 1 -- 172.21.15.47:0/2170913621 >> 172.21.15.47:0/2170913621 conn(0x7f78700fd0c0 msgr2=0x7f78700ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:24.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.958+0000 7f78771ce640 1 -- 172.21.15.47:0/2170913621 shutdown_connections 2024-07-24T22:19:24.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.958+0000 7f78771ce640 1 -- 172.21.15.47:0/2170913621 wait complete. 2024-07-24T22:19:24.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f78771ce640 1 Processor -- start 2024-07-24T22:19:24.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f78771ce640 1 -- start start 2024-07-24T22:19:24.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f78771ce640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7870103660 0x7f7870101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:24.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f78771ce640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7870103f80 0x7f7870101850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:24.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f78771ce640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f787010cac0 0x7f7870101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:24.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f78771ce640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7870112790 con 0x7f787010cac0 2024-07-24T22:19:24.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f78771ce640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7870112610 con 0x7f7870103f80 2024-07-24T22:19:24.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f78771ce640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7870112910 con 0x7f7870103660 2024-07-24T22:19:24.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f787576b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f787010cac0 0x7f7870101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:24.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f787576b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f787010cac0 0x7f7870101d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56184/0 (socket says 172.21.15.47:56184) 2024-07-24T22:19:24.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f787576b640 1 -- 172.21.15.47:0/1019661200 learned_addr learned my addr 172.21.15.47:0/1019661200 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:24.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f7874f6a640 1 --2- 172.21.15.47:0/1019661200 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7870103660 0x7f7870101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:24.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f787576b640 1 -- 172.21.15.47:0/1019661200 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7870103660 msgr2=0x7f7870101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:24.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f787576b640 1 --2- 172.21.15.47:0/1019661200 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7870103660 0x7f7870101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:24.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f787576b640 1 -- 172.21.15.47:0/1019661200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7870103f80 msgr2=0x7f7870101850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:24.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f787576b640 1 --2- 172.21.15.47:0/1019661200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7870103f80 0x7f7870101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:24.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f787576b640 1 -- 172.21.15.47:0/1019661200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78701a7080 con 0x7f787010cac0 2024-07-24T22:19:24.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.959+0000 7f787576b640 1 --2- 172.21.15.47:0/1019661200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f787010cac0 0x7f7870101d90 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f786800cce0 tx=0x7f786800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:24.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.960+0000 7f786dffb640 1 -- 172.21.15.47:0/1019661200 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786800f450 con 0x7f787010cac0 2024-07-24T22:19:24.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.960+0000 7f786dffb640 1 -- 172.21.15.47:0/1019661200 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f786800faa0 con 0x7f787010cac0 2024-07-24T22:19:24.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.960+0000 7f78771ce640 1 -- 172.21.15.47:0/1019661200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78701a7370 con 0x7f787010cac0 2024-07-24T22:19:24.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.960+0000 7f786dffb640 1 -- 172.21.15.47:0/1019661200 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7868018b70 con 0x7f787010cac0 2024-07-24T22:19:24.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.960+0000 7f78771ce640 1 -- 172.21.15.47:0/1019661200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78701a78e0 con 0x7f787010cac0 2024-07-24T22:19:24.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.961+0000 7f78771ce640 1 -- 172.21.15.47:0/1019661200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7870103a40 con 0x7f787010cac0 2024-07-24T22:19:24.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.962+0000 7f786dffb640 1 -- 172.21.15.47:0/1019661200 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f7868018d10 con 0x7f787010cac0 2024-07-24T22:19:24.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.963+0000 7f786dffb640 1 --2- 172.21.15.47:0/1019661200 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f785c0b3d40 0x7f785c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:24.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.963+0000 7f7874f6a640 1 --2- 172.21.15.47:0/1019661200 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f785c0b3d40 0x7f785c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:24.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.963+0000 7f786dffb640 1 -- 172.21.15.47:0/1019661200 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7f78680e44e0 con 0x7f787010cac0 2024-07-24T22:19:24.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.963+0000 7f7874f6a640 1 --2- 172.21.15.47:0/1019661200 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f785c0b3d40 0x7f785c0b6200 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7860031440 tx=0x7f7860005e80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:24.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:24.967+0000 7f786dffb640 1 -- 172.21.15.47:0/1019661200 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f7868014030 con 0x7f787010cac0 2024-07-24T22:19:25.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.199+0000 7f78771ce640 1 -- 172.21.15.47:0/1019661200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78701a7d00 con 0x7f787010cac0 2024-07-24T22:19:25.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.200+0000 7f786dffb640 1 -- 172.21.15.47:0/1019661200 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f78680ab760 con 0x7f787010cac0 2024-07-24T22:19:25.203 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:19:25.203 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:19:25.203 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:19:25.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.202+0000 7f78771ce640 1 -- 172.21.15.47:0/1019661200 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f785c0b3d40 msgr2=0x7f785c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:25.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.202+0000 7f78771ce640 1 --2- 172.21.15.47:0/1019661200 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f785c0b3d40 0x7f785c0b6200 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7860031440 tx=0x7f7860005e80 comp rx=0 tx=0).stop 2024-07-24T22:19:25.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.202+0000 7f78771ce640 1 -- 172.21.15.47:0/1019661200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f787010cac0 msgr2=0x7f7870101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:25.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.202+0000 7f78771ce640 1 --2- 172.21.15.47:0/1019661200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f787010cac0 0x7f7870101d90 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f786800cce0 tx=0x7f786800a620 comp rx=0 tx=0).stop 2024-07-24T22:19:25.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.202+0000 7f78771ce640 1 -- 172.21.15.47:0/1019661200 shutdown_connections 2024-07-24T22:19:25.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.202+0000 7f78771ce640 1 --2- 172.21.15.47:0/1019661200 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f785c0b3d40 0x7f785c0b6200 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:25.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.202+0000 7f78771ce640 1 --2- 172.21.15.47:0/1019661200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f787010cac0 0x7f7870101d90 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:25.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.202+0000 7f78771ce640 1 --2- 172.21.15.47:0/1019661200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7870103f80 0x7f7870101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:25.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.202+0000 7f78771ce640 1 --2- 172.21.15.47:0/1019661200 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7870103660 0x7f7870101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:25.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.202+0000 7f78771ce640 1 -- 172.21.15.47:0/1019661200 >> 172.21.15.47:0/1019661200 conn(0x7f78700fd0c0 msgr2=0x7f787010ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:25.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.202+0000 7f78771ce640 1 -- 172.21.15.47:0/1019661200 shutdown_connections 2024-07-24T22:19:25.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:25.202+0000 7f78771ce640 1 -- 172.21.15.47:0/1019661200 wait complete. 2024-07-24T22:19:25.938 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-07-24T22:19:26.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:25 smithi047 ceph-mon[32551]: pgmap v746: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-07-24T22:19:26.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:25 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1019661200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:19:26.210 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:19:26.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:25 smithi188 ceph-mon[37380]: pgmap v746: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-07-24T22:19:26.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:25 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1019661200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:19:26.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:25 smithi183 ceph-mon[37007]: pgmap v746: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-07-24T22:19:26.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:25 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1019661200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:19:28.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.025+0000 7f1ae8bce640 1 -- 172.21.15.47:0/2764454148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ae41081a0 msgr2=0x7f1ae41085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.025+0000 7f1ae8bce640 1 --2- 172.21.15.47:0/2764454148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ae41081a0 0x7f1ae41085e0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009900 tx=0x7f1ad802a410 comp rx=0 tx=0).stop 2024-07-24T22:19:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.026+0000 7f1ae8bce640 1 -- 172.21.15.47:0/2764454148 shutdown_connections 2024-07-24T22:19:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.026+0000 7f1ae8bce640 1 --2- 172.21.15.47:0/2764454148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ae4108b20 0x7f1ae410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.026+0000 7f1ae8bce640 1 --2- 172.21.15.47:0/2764454148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ae41081a0 0x7f1ae41085e0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.026+0000 7f1ae8bce640 1 --2- 172.21.15.47:0/2764454148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ae4102790 0x7f1ae4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.026+0000 7f1ae8bce640 1 -- 172.21.15.47:0/2764454148 >> 172.21.15.47:0/2764454148 conn(0x7f1ae40fe200 msgr2=0x7f1ae4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.026+0000 7f1ae8bce640 1 -- 172.21.15.47:0/2764454148 shutdown_connections 2024-07-24T22:19:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.026+0000 7f1ae8bce640 1 -- 172.21.15.47:0/2764454148 wait complete. 2024-07-24T22:19:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.026+0000 7f1ae8bce640 1 Processor -- start 2024-07-24T22:19:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae8bce640 1 -- start start 2024-07-24T22:19:28.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae8bce640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ae4102790 0x7f1ae4198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae8bce640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ae41081a0 0x7f1ae41991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae8bce640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ae4108b20 0x7f1ae419e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae8bce640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae4112750 con 0x7f1ae4102790 2024-07-24T22:19:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae8bce640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae41125d0 con 0x7f1ae41081a0 2024-07-24T22:19:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae8bce640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae41128d0 con 0x7f1ae4108b20 2024-07-24T22:19:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ae4102790 0x7f1ae4198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ae4102790 0x7f1ae4198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56202/0 (socket says 172.21.15.47:56202) 2024-07-24T22:19:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae259c640 1 -- 172.21.15.47:0/1940678428 learned_addr learned my addr 172.21.15.47:0/1940678428 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ae4108b20 0x7f1ae419e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae1d9b640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ae41081a0 0x7f1ae41991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae259c640 1 -- 172.21.15.47:0/1940678428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ae4108b20 msgr2=0x7f1ae419e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae259c640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ae4108b20 0x7f1ae419e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae259c640 1 -- 172.21.15.47:0/1940678428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ae41081a0 msgr2=0x7f1ae41991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae259c640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ae41081a0 0x7f1ae41991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae259c640 1 -- 172.21.15.47:0/1940678428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae419ed10 con 0x7f1ae4102790 2024-07-24T22:19:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.027+0000 7f1ae259c640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ae4102790 0x7f1ae4198c60 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400d770 tx=0x7f1ad400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.028+0000 7f1ad37fe640 1 -- 172.21.15.47:0/1940678428 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4017070 con 0x7f1ae4102790 2024-07-24T22:19:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.028+0000 7f1ae8bce640 1 -- 172.21.15.47:0/1940678428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae419f000 con 0x7f1ae4102790 2024-07-24T22:19:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.028+0000 7f1ad37fe640 1 -- 172.21.15.47:0/1940678428 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ad40054d0 con 0x7f1ae4102790 2024-07-24T22:19:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.028+0000 7f1ad37fe640 1 -- 172.21.15.47:0/1940678428 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4004c30 con 0x7f1ae4102790 2024-07-24T22:19:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.028+0000 7f1ae8bce640 1 -- 172.21.15.47:0/1940678428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae41a56c0 con 0x7f1ae4102790 2024-07-24T22:19:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.030+0000 7f1ad37fe640 1 -- 172.21.15.47:0/1940678428 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f1ad4004e10 con 0x7f1ae4102790 2024-07-24T22:19:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.030+0000 7f1aeaf7f740 1 Processor -- start 2024-07-24T22:19:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.030+0000 7f1aeaf7f740 1 -- start start 2024-07-24T22:19:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1aeaf7f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c36d0 0x5640d83c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1aeaf7f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c3ff0 0x5640d83cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1aeaf7f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 0x5640d83d2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1aeaf7f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5640d833a9b0 con 0x5640d83c36d0 2024-07-24T22:19:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1aeaf7f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5640d8329eb0 con 0x5640d83c3ff0 2024-07-24T22:19:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1aeaf7f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5640d832def0 con 0x5640d83cff80 2024-07-24T22:19:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1ae2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c36d0 0x5640d83c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1ae2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c36d0 0x5640d83c3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56206/0 (socket says 172.21.15.47:56206) 2024-07-24T22:19:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1ae2d9d640 1 -- 172.21.15.47:0/2077840738 learned_addr learned my addr 172.21.15.47:0/2077840738 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1ae1d9b640 1 --2- 172.21.15.47:0/2077840738 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 0x5640d83d2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1ae259c640 1 --2- 172.21.15.47:0/2077840738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c3ff0 0x5640d83cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1ae2d9d640 1 -- 172.21.15.47:0/2077840738 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 msgr2=0x5640d83d2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/2077840738 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 0x5640d83d2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1ae2d9d640 1 -- 172.21.15.47:0/2077840738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c3ff0 msgr2=0x5640d83cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:28.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/2077840738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c3ff0 0x5640d83cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1ae2d9d640 1 -- 172.21.15.47:0/2077840738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640d82b3320 con 0x5640d83c36d0 2024-07-24T22:19:28.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1ae1d9b640 1 --2- 172.21.15.47:0/2077840738 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 0x5640d83d2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:19:28.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/2077840738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c36d0 0x5640d83c3ab0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009ee0 tx=0x7f1adc010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937f2e08b7544c71 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:28.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.031+0000 7f1ad37fe640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1acc0b3d40 0x7f1acc0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.032+0000 7f1ad0ff9640 1 -- 172.21.15.47:0/2077840738 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1adc016070 con 0x5640d83c36d0 2024-07-24T22:19:28.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.032+0000 7f1ad0ff9640 1 -- 172.21.15.47:0/2077840738 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1adc004d20 con 0x5640d83c36d0 2024-07-24T22:19:28.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.032+0000 7f1ad0ff9640 1 -- 172.21.15.47:0/2077840738 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1adc012730 con 0x5640d83c36d0 2024-07-24T22:19:28.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.032+0000 7f1ae259c640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1acc0b3d40 0x7f1acc0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.032+0000 7f1ad37fe640 1 -- 172.21.15.47:0/1940678428 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7f1ad40e3bc0 con 0x7f1ae4102790 2024-07-24T22:19:28.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.032+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/2077840738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c36d0 msgr2=0x5640d83c3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:28.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.032+0000 7f1ae259c640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1acc0b3d40 0x7f1acc0b6200 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40e1390 tx=0x7f1ad40cd040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:28.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.032+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/2077840738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c36d0 0x5640d83c3ab0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009ee0 tx=0x7f1adc010740 comp rx=0 tx=0).stop 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.032+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/2077840738 shutdown_connections 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.032+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/2077840738 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 0x5640d83d2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.032+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/2077840738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c3ff0 0x5640d83cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.032+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/2077840738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c36d0 0x5640d83c3ab0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.032+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/2077840738 >> 172.21.15.47:0/2077840738 conn(0x5640d83c1500 msgr2=0x5640d83c26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/2077840738 shutdown_connections 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/2077840738 wait complete. 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1aeaf7f740 1 -- start start 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1aeaf7f740 1 Processor -- start 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1aeaf7f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c36d0 0x5640d83ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1aeaf7f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1aeaf7f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 0x5640d83cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1aeaf7f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5640d818d700 con 0x5640d83c3ff0 2024-07-24T22:19:28.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1aeaf7f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5640d82cc5f0 con 0x5640d83c36d0 2024-07-24T22:19:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1aeaf7f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5640d83d2c00 con 0x5640d83cff80 2024-07-24T22:19:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1aeaf7f740 10 client.0 _ll_register_callbacks cb 0x5640d82ec960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:19:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1ae1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1ae1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56214/0 (socket says 172.21.15.47:56214) 2024-07-24T22:19:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1ae1d9b640 1 -- 172.21.15.47:0/2232609163 learned_addr learned my addr 172.21.15.47:0/2232609163 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.033+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/2232609163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c36d0 0x5640d83ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/2232609163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 0x5640d83cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1ae1d9b640 1 -- 172.21.15.47:0/2232609163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 msgr2=0x5640d83cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1ae1d9b640 1 --2- 172.21.15.47:0/2232609163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 0x5640d83cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1ae1d9b640 1 -- 172.21.15.47:0/2232609163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c36d0 msgr2=0x5640d83ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1ae1d9b640 1 --2- 172.21.15.47:0/2232609163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c36d0 0x5640d83ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1ae1d9b640 1 -- 172.21.15.47:0/2232609163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640d82bf680 con 0x5640d83c3ff0 2024-07-24T22:19:28.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1ae1d9b640 1 --2- 172.21.15.47:0/2232609163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83cd400 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8005940 tx=0x7f1ad8031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49555ed0e233ad3c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1ac9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:19:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1ac9ffb640 1 -- 172.21.15.47:0/2232609163 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad803f070 con 0x5640d83c3ff0 2024-07-24T22:19:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1ac9ffb640 1 -- 172.21.15.47:0/2232609163 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7f1ad8004450 con 0x5640d83c3ff0 2024-07-24T22:19:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/2232609163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1adc004d20 con 0x5640d83c3ff0 2024-07-24T22:19:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1ac9ffb640 1 -- 172.21.15.47:0/2232609163 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1ad8035070 con 0x5640d83c3ff0 2024-07-24T22:19:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1aeaf7f740 10 client.18246 fetch_fsmap learned FSMap version 20 2024-07-24T22:19:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/2232609163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5640d808a650 con 0x5640d83c3ff0 2024-07-24T22:19:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1ac9ffb640 1 -- 172.21.15.47:0/2232609163 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1adc004d20 con 0x5640d83c3ff0 2024-07-24T22:19:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.034+0000 7f1ac9ffb640 1 -- 172.21.15.47:0/2232609163 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1ad8004ad0 con 0x5640d83c3ff0 2024-07-24T22:19:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.035+0000 7f1aeaf7f740 10 client.18246 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:19:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.035+0000 7f1aeaf7f740 10 client.18246 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:19:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.035+0000 7f1aeaf7f740 20 client.18246 populate_metadata read hostname 'smithi047' 2024-07-24T22:19:28.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.035+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/2232609163 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5640d83df9a0 0x5640d83e1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.035+0000 7f1aeaf7f740 4 client.18246 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T22:19:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.035+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/2232609163 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640d833c900 con 0x5640d83df9a0 2024-07-24T22:19:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.035+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/2232609163 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5640d83df9a0 0x5640d83e1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.035+0000 7f1ac9ffb640 10 client.18246 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:19:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.035+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/2232609163 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5640d83df9a0 0x5640d83e1de0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b2956e7816bf2ee server_cookie=6f6b56e2a27ebf81 in_seq=0 out_seq=0 2024-07-24T22:19:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1ac9ffb640 1 -- 172.21.15.47:0/2232609163 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640d833c900 con 0x5640d83df9a0 2024-07-24T22:19:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1ac9ffb640 10 client.18246 handle_command_reply: tid=0 2024-07-24T22:19:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1aeaf7f740 1 client.18246 shutdown 2024-07-24T22:19:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/2232609163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 msgr2=0x5640d83cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/2232609163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83cd400 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8005940 tx=0x7f1ad8031750 comp rx=0 tx=0).stop 2024-07-24T22:19:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/2232609163 shutdown_connections 2024-07-24T22:19:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/2232609163 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5640d83df9a0 0x5640d83e1de0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/2232609163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 0x5640d83cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/2232609163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83cd400 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/2232609163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c36d0 0x5640d83ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1ac9ffb640 0 client.18246 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:19:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/2232609163 >> 172.21.15.47:0/2232609163 conn(0x5640d83c1500 msgr2=0x5640d83c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/2232609163 shutdown_connections 2024-07-24T22:19:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/2232609163 wait complete. 2024-07-24T22:19:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.036+0000 7f1aeaf7f740 20 client.18246 trim_cache size 0 max 16384 2024-07-24T22:19:28.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.050+0000 7f1aeaf7f740 1 Processor -- start 2024-07-24T22:19:28.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.050+0000 7f1aeaf7f740 1 -- start start 2024-07-24T22:19:28.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.050+0000 7f1aeaf7f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c36d0 0x5640d83cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.050+0000 7f1aeaf7f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83e76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.050+0000 7f1aeaf7f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 0x5640d83e7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.050+0000 7f1aeaf7f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae41ac1a0 con 0x5640d83c3ff0 2024-07-24T22:19:28.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.050+0000 7f1aeaf7f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae41aea00 con 0x5640d83c36d0 2024-07-24T22:19:28.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.050+0000 7f1aeaf7f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae41ac7f0 con 0x5640d83cff80 2024-07-24T22:19:28.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.050+0000 7f1ae1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83e76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.051+0000 7f1ae1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83e76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56220/0 (socket says 172.21.15.47:56220) 2024-07-24T22:19:28.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.051+0000 7f1ae1d9b640 1 -- 172.21.15.47:0/1406518470 learned_addr learned my addr 172.21.15.47:0/1406518470 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:28.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.051+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/1406518470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c36d0 0x5640d83cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.051+0000 7f1ae1d9b640 1 -- 172.21.15.47:0/1406518470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 msgr2=0x5640d83e7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:28.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.051+0000 7f1ae1d9b640 1 --2- 172.21.15.47:0/1406518470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 0x5640d83e7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.051+0000 7f1ae1d9b640 1 -- 172.21.15.47:0/1406518470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c36d0 msgr2=0x5640d83cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:28.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.051+0000 7f1ae1d9b640 1 --2- 172.21.15.47:0/1406518470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c36d0 0x5640d83cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.051+0000 7f1ae1d9b640 1 -- 172.21.15.47:0/1406518470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640d83c3e20 con 0x5640d83c3ff0 2024-07-24T22:19:28.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.051+0000 7f1ae1d9b640 1 --2- 172.21.15.47:0/1406518470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83e76f0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8005ab0 tx=0x7f1ad8009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a725ce9aa9d039c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:28.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.051+0000 7f1acbfff640 1 -- 172.21.15.47:0/1406518470 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad804f040 con 0x5640d83c3ff0 2024-07-24T22:19:28.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.051+0000 7f1acbfff640 1 -- 172.21.15.47:0/1406518470 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ad8031900 con 0x5640d83c3ff0 2024-07-24T22:19:28.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.051+0000 7f1acbfff640 1 -- 172.21.15.47:0/1406518470 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad803f040 con 0x5640d83c3ff0 2024-07-24T22:19:28.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.052+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/1406518470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 msgr2=0x5640d83e76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:28.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.052+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/1406518470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83e76f0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8005ab0 tx=0x7f1ad8009660 comp rx=0 tx=0).stop 2024-07-24T22:19:28.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.052+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/1406518470 shutdown_connections 2024-07-24T22:19:28.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.052+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/1406518470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83cff80 0x5640d83e7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.052+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/1406518470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83e76f0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.052+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/1406518470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83c36d0 0x5640d83cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.052+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/1406518470 >> 172.21.15.47:0/1406518470 conn(0x5640d83c1500 msgr2=0x5640d83ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:28.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.052+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/1406518470 shutdown_connections 2024-07-24T22:19:28.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.052+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/1406518470 wait complete. 2024-07-24T22:19:28.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.052+0000 7f1aeaf7f740 1 -- start start 2024-07-24T22:19:28.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.052+0000 7f1aeaf7f740 1 Processor -- start 2024-07-24T22:19:28.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1aeaf7f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83c36d0 0x5640d83c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1aeaf7f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1aeaf7f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83cff80 0x5640d83caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1aeaf7f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae41acec0 con 0x5640d83c3ff0 2024-07-24T22:19:28.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1aeaf7f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae41ae330 con 0x5640d83cff80 2024-07-24T22:19:28.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1aeaf7f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae41ad590 con 0x5640d83c36d0 2024-07-24T22:19:28.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1aeaf7f740 10 client.0 _ll_register_callbacks cb 0x7f1ad8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T22:19:28.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ae1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ae1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56236/0 (socket says 172.21.15.47:56236) 2024-07-24T22:19:28.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ae1d9b640 1 -- 172.21.15.47:0/400300686 learned_addr learned my addr 172.21.15.47:0/400300686 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:28.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83c36d0 0x5640d83c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ae1d9b640 1 -- 172.21.15.47:0/400300686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83c36d0 msgr2=0x5640d83c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:28.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ae1d9b640 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83c36d0 0x5640d83c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ae1d9b640 1 -- 172.21.15.47:0/400300686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83cff80 msgr2=0x5640d83caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T22:19:28.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83cff80 0x5640d83caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ae1d9b640 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83cff80 0x5640d83caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ae1d9b640 1 -- 172.21.15.47:0/400300686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640d84497c0 con 0x5640d83c3ff0 2024-07-24T22:19:28.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83cff80 0x5640d83caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:19:28.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ae1d9b640 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83ca4f0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f1ad802a930 tx=0x7f1ad80038d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95dd2233fa6ee44c server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:28.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ac9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-07-24T22:19:28.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ac9ffb640 1 -- 172.21.15.47:0/400300686 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad804f070 con 0x5640d83c3ff0 2024-07-24T22:19:28.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1ac9ffb640 1 -- 172.21.15.47:0/400300686 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7f1ad80046c0 con 0x5640d83c3ff0 2024-07-24T22:19:28.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.053+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/400300686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5640d83383a0 con 0x5640d83c3ff0 2024-07-24T22:19:28.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.054+0000 7f1ac9ffb640 1 -- 172.21.15.47:0/400300686 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1ad8062050 con 0x5640d83c3ff0 2024-07-24T22:19:28.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.054+0000 7f1aeaf7f740 10 client.18252 fetch_fsmap learned FSMap version 20 2024-07-24T22:19:28.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.054+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/400300686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5640d844aa60 con 0x5640d83c3ff0 2024-07-24T22:19:28.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.054+0000 7f1ac9ffb640 1 -- 172.21.15.47:0/400300686 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5640d83383a0 con 0x5640d83c3ff0 2024-07-24T22:19:28.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.054+0000 7f1ac9ffb640 1 -- 172.21.15.47:0/400300686 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1ad8054470 con 0x5640d83c3ff0 2024-07-24T22:19:28.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.054+0000 7f1aeaf7f740 10 client.18252 fetch_fsmap finished waiting for FSMap version 20 2024-07-24T22:19:28.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.054+0000 7f1aeaf7f740 10 client.18252 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-07-24T22:19:28.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.054+0000 7f1aeaf7f740 20 client.18252 populate_metadata read hostname 'smithi047' 2024-07-24T22:19:28.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.054+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5640d844b060 0x5640d844d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.054+0000 7f1aeaf7f740 4 client.18252 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-07-24T22:19:28.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.054+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/400300686 --> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5640d8335ae0 con 0x5640d844b060 2024-07-24T22:19:28.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.054+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5640d844b060 0x5640d844d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1ae2d9d640 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5640d844b060 0x5640d844d450 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40cc859be37e7a83 server_cookie=40d12045bff82dac in_seq=0 out_seq=0 2024-07-24T22:19:28.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1ac9ffb640 10 client.18252 ms_handle_connect on v2:172.21.15.188:6838/3781670075 2024-07-24T22:19:28.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1ac9ffb640 1 -- 172.21.15.47:0/400300686 <== mds.0 v2:172.21.15.188:6838/3781670075 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5640d8335ae0 con 0x5640d844b060 2024-07-24T22:19:28.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1ac9ffb640 10 client.18252 handle_command_reply: tid=0 2024-07-24T22:19:28.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1aeaf7f740 1 client.18252 shutdown 2024-07-24T22:19:28.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/400300686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 msgr2=0x5640d83ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:28.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83ca4f0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f1ad802a930 tx=0x7f1ad80038d0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/400300686 shutdown_connections 2024-07-24T22:19:28.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.188:6838/3781670075,v1:172.21.15.188:6839/3781670075] conn(0x5640d844b060 0x5640d844d450 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5640d83cff80 0x5640d83caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640d83c3ff0 0x5640d83ca4f0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1aeaf7f740 1 --2- 172.21.15.47:0/400300686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5640d83c36d0 0x5640d83c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/400300686 >> 172.21.15.47:0/400300686 conn(0x5640d83c1500 msgr2=0x5640d83ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:28.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1ac9ffb640 0 client.18252 ms_handle_reset on v2:172.21.15.188:6838/3781670075 2024-07-24T22:19:28.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/400300686 shutdown_connections 2024-07-24T22:19:28.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1aeaf7f740 1 -- 172.21.15.47:0/400300686 wait complete. 2024-07-24T22:19:28.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.055+0000 7f1aeaf7f740 20 client.18252 trim_cache size 0 max 16384 2024-07-24T22:19:28.063 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-07-24T22:19:28.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.056+0000 7f1ae8bce640 1 -- 172.21.15.47:0/1940678428 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1acc0b3d40 msgr2=0x7f1acc0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:28.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.056+0000 7f1ae8bce640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1acc0b3d40 0x7f1acc0b6200 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40e1390 tx=0x7f1ad40cd040 comp rx=0 tx=0).stop 2024-07-24T22:19:28.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.056+0000 7f1ae8bce640 1 -- 172.21.15.47:0/1940678428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ae4102790 msgr2=0x7f1ae4198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:28.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.056+0000 7f1ae8bce640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ae4102790 0x7f1ae4198c60 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400d770 tx=0x7f1ad400dc30 comp rx=0 tx=0).stop 2024-07-24T22:19:28.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.056+0000 7f1ae8bce640 1 -- 172.21.15.47:0/1940678428 shutdown_connections 2024-07-24T22:19:28.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.056+0000 7f1ae8bce640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f1acc0b3d40 0x7f1acc0b6200 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.056+0000 7f1ae8bce640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ae4108b20 0x7f1ae419e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.056+0000 7f1ae8bce640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ae41081a0 0x7f1ae41991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.056+0000 7f1ae8bce640 1 --2- 172.21.15.47:0/1940678428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ae4102790 0x7f1ae4198c60 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.056+0000 7f1ae8bce640 1 -- 172.21.15.47:0/1940678428 >> 172.21.15.47:0/1940678428 conn(0x7f1ae40fe200 msgr2=0x7f1ae41005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.056+0000 7f1ae8bce640 1 -- 172.21.15.47:0/1940678428 shutdown_connections 2024-07-24T22:19:28.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.056+0000 7f1ae8bce640 1 -- 172.21.15.47:0/1940678428 wait complete. 2024-07-24T22:19:28.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:27 smithi047 ceph-mon[32551]: pgmap v747: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-07-24T22:19:28.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:27 smithi188 ceph-mon[37380]: pgmap v747: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-07-24T22:19:28.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:27 smithi183 ceph-mon[37007]: pgmap v747: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-07-24T22:19:28.850 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-07-24T22:19:28.851 INFO:tasks.fwd_scrub:done joining 2024-07-24T22:19:28.852 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-07-24T22:19:28.862 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T22:19:28.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.970+0000 7fd89fbed640 1 -- 172.21.15.47:0/2737617939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd898108a60 msgr2=0x7fd89810f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:28.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.970+0000 7fd89fbed640 1 --2- 172.21.15.47:0/2737617939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd898108a60 0x7fd89810f260 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fd890009ca0 tx=0x7fd89002a8c0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.970+0000 7fd89fbed640 1 -- 172.21.15.47:0/2737617939 shutdown_connections 2024-07-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.970+0000 7fd89fbed640 1 --2- 172.21.15.47:0/2737617939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd898108a60 0x7fd89810f260 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.970+0000 7fd89fbed640 1 --2- 172.21.15.47:0/2737617939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8981080e0 0x7fd898108520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.970+0000 7fd89fbed640 1 --2- 172.21.15.47:0/2737617939 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8981026e0 0x7fd898102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.970+0000 7fd89fbed640 1 -- 172.21.15.47:0/2737617939 >> 172.21.15.47:0/2737617939 conn(0x7fd8980fe120 msgr2=0x7fd898100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.970+0000 7fd89fbed640 1 -- 172.21.15.47:0/2737617939 shutdown_connections 2024-07-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.970+0000 7fd89fbed640 1 -- 172.21.15.47:0/2737617939 wait complete. 2024-07-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89fbed640 1 Processor -- start 2024-07-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89fbed640 1 -- start start 2024-07-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89fbed640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8981026e0 0x7fd898198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89fbed640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8981080e0 0x7fd898199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89fbed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd898108a60 0x7fd89819e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89fbed640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd8981126e0 con 0x7fd898108a60 2024-07-24T22:19:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89fbed640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd898112560 con 0x7fd8981080e0 2024-07-24T22:19:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89fbed640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd898112860 con 0x7fd8981026e0 2024-07-24T22:19:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89e18a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd898108a60 0x7fd89819e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89e18a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd898108a60 0x7fd89819e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56242/0 (socket says 172.21.15.47:56242) 2024-07-24T22:19:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89e18a640 1 -- 172.21.15.47:0/3244671683 learned_addr learned my addr 172.21.15.47:0/3244671683 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89d188640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8981080e0 0x7fd898199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89d989640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8981026e0 0x7fd898198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89e18a640 1 -- 172.21.15.47:0/3244671683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8981026e0 msgr2=0x7fd898198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89e18a640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8981026e0 0x7fd898198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89e18a640 1 -- 172.21.15.47:0/3244671683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8981080e0 msgr2=0x7fd898199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89e18a640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8981080e0 0x7fd898199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89e18a640 1 -- 172.21.15.47:0/3244671683 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89819eb80 con 0x7fd898108a60 2024-07-24T22:19:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.971+0000 7fd89d989640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8981026e0 0x7fd898198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:19:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.972+0000 7fd89e18a640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd898108a60 0x7fd89819e3b0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fd890031a20 tx=0x7fd890031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:28.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.972+0000 7fd88effd640 1 -- 172.21.15.47:0/3244671683 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd890003d30 con 0x7fd898108a60 2024-07-24T22:19:28.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.972+0000 7fd88effd640 1 -- 172.21.15.47:0/3244671683 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8900044f0 con 0x7fd898108a60 2024-07-24T22:19:28.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.972+0000 7fd89fbed640 1 -- 172.21.15.47:0/3244671683 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89819ee10 con 0x7fd898108a60 2024-07-24T22:19:28.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.972+0000 7fd88effd640 1 -- 172.21.15.47:0/3244671683 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89002fd90 con 0x7fd898108a60 2024-07-24T22:19:28.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.972+0000 7fd89fbed640 1 -- 172.21.15.47:0/3244671683 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8981a5530 con 0x7fd898108a60 2024-07-24T22:19:28.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.973+0000 7fd89fbed640 1 -- 172.21.15.47:0/3244671683 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd898102ac0 con 0x7fd898108a60 2024-07-24T22:19:28.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.974+0000 7fd88effd640 1 -- 172.21.15.47:0/3244671683 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fd890004040 con 0x7fd898108a60 2024-07-24T22:19:28.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.975+0000 7fd88effd640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8840b3d40 0x7fd8840b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:28.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.976+0000 7fd89d989640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8840b3d40 0x7fd8840b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:28.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.976+0000 7fd88effd640 1 -- 172.21.15.47:0/3244671683 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7fd890105820 con 0x7fd898108a60 2024-07-24T22:19:28.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.976+0000 7fd89d989640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8840b3d40 0x7fd8840b6200 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd8940058c0 tx=0x7fd894005d30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:28.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:28.979+0000 7fd88effd640 1 -- 172.21.15.47:0/3244671683 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fd8900cccd0 con 0x7fd898108a60 2024-07-24T22:19:29.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.172+0000 7fd89fbed640 1 -- 172.21.15.47:0/3244671683 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8981a5900 con 0x7fd898108a60 2024-07-24T22:19:29.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.174+0000 7fd88effd640 1 -- 172.21.15.47:0/3244671683 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+23228 (secure 0 0 0) 0x7fd8900cc5d0 con 0x7fd898108a60 2024-07-24T22:19:29.176 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:19:29.176 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":99,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","created":"2024-07-24T21:55:28.945912+0000","modified":"2024-07-24T22:19:19.228032+0000","last_up_change":"2024-07-24T22:02:55.044691+0000","last_in_change":"2024-07-24T22:02:35.671256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T21:59:32.066678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T22:03:49.331120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T22:03:52.034826+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":98,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60de2c3d-e4b7-4878-bdbb-ce3257e3706c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6803","nonce":2665889913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6805","nonce":2665889913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6809","nonce":2665889913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6807","nonce":2665889913}]},"public_addr":"172.21.15.47:6803/2665889913","cluster_addr":"172.21.15.47:6805/2665889913","heartbeat_back_addr":"172.21.15.47:6809/2665889913","heartbeat_front_addr":"172.21.15.47:6807/2665889913","state":["exists","up"]},{"osd":1,"uuid":"7f086675-3bed-47ca-a93f-fab9580068b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6801","nonce":3486494228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6803","nonce":3486494228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6807","nonce":3486494228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6805","nonce":3486494228}]},"public_addr":"172.21.15.183:6801/3486494228","cluster_addr":"172.21.15.183:6803/3486494228","heartbeat_back_addr":"172.21.15.183:6807/3486494228","heartbeat_front_addr":"172.21.15.183:6805/3486494228","state":["exists","up"]},{"osd":2,"uuid":"040fff27-6fa6-48de-9365-fcced8f89e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6801","nonce":2245903281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6803","nonce":2245903281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6807","nonce":2245903281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6805","nonce":2245903281}]},"public_addr":"172.21.15.188:6801/2245903281","cluster_addr":"172.21.15.188:6803/2245903281","heartbeat_back_addr":"172.21.15.188:6807/2245903281","heartbeat_front_addr":"172.21.15.188:6805/2245903281","state":["exists","up"]},{"osd":3,"uuid":"e129321a-9566-4bea-b982-34f7ddd1ae1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6811","nonce":236749130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6813","nonce":236749130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6817","nonce":236749130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6815","nonce":236749130}]},"public_addr":"172.21.15.47:6811/236749130","cluster_addr":"172.21.15.47:6813/236749130","heartbeat_back_addr":"172.21.15.47:6817/236749130","heartbeat_front_addr":"172.21.15.47:6815/236749130","state":["exists","up"]},{"osd":4,"uuid":"f969fba7-b0ff-4ea6-83bd-38aba32b1be1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6809","nonce":3978122107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6811","nonce":3978122107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6815","nonce":3978122107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6813","nonce":3978122107}]},"public_addr":"172.21.15.183:6809/3978122107","cluster_addr":"172.21.15.183:6811/3978122107","heartbeat_back_addr":"172.21.15.183:6815/3978122107","heartbeat_front_addr":"172.21.15.183:6813/3978122107","state":["exists","up"]},{"osd":5,"uuid":"3799c912-3d9f-4efd-9b36-569c385e4c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6809","nonce":2097128083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6811","nonce":2097128083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6815","nonce":2097128083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6813","nonce":2097128083}]},"public_addr":"172.21.15.188:6809/2097128083","cluster_addr":"172.21.15.188:6811/2097128083","heartbeat_back_addr":"172.21.15.188:6815/2097128083","heartbeat_front_addr":"172.21.15.188:6813/2097128083","state":["exists","up"]},{"osd":6,"uuid":"1a38cf12-619f-4e82-a7a5-21ee2014038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6819","nonce":2288252980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6821","nonce":2288252980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6825","nonce":2288252980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6823","nonce":2288252980}]},"public_addr":"172.21.15.47:6819/2288252980","cluster_addr":"172.21.15.47:6821/2288252980","heartbeat_back_addr":"172.21.15.47:6825/2288252980","heartbeat_front_addr":"172.21.15.47:6823/2288252980","state":["exists","up"]},{"osd":7,"uuid":"6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6817","nonce":465426514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6819","nonce":465426514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6823","nonce":465426514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6821","nonce":465426514}]},"public_addr":"172.21.15.183:6817/465426514","cluster_addr":"172.21.15.183:6819/465426514","heartbeat_back_addr":"172.21.15.183:6823/465426514","heartbeat_front_addr":"172.21.15.183:6821/465426514","state":["exists","up"]},{"osd":8,"uuid":"6dfd7252-61a6-423d-8498-cbcfa41ae1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6817","nonce":2247055658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6819","nonce":2247055658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6823","nonce":2247055658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6821","nonce":2247055658}]},"public_addr":"172.21.15.188:6817/2247055658","cluster_addr":"172.21.15.188:6819/2247055658","heartbeat_back_addr":"172.21.15.188:6823/2247055658","heartbeat_front_addr":"172.21.15.188:6821/2247055658","state":["exists","up"]},{"osd":9,"uuid":"abd93c5e-283e-4873-a241-1056f2894116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6827","nonce":2628721884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6829","nonce":2628721884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6833","nonce":2628721884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6831","nonce":2628721884}]},"public_addr":"172.21.15.47:6827/2628721884","cluster_addr":"172.21.15.47:6829/2628721884","heartbeat_back_addr":"172.21.15.47:6833/2628721884","heartbeat_front_addr":"172.21.15.47:6831/2628721884","state":["exists","up"]},{"osd":10,"uuid":"bc967f8f-ce27-4230-be70-e36927f89fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6825","nonce":3509332199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6827","nonce":3509332199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6831","nonce":3509332199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6829","nonce":3509332199}]},"public_addr":"172.21.15.183:6825/3509332199","cluster_addr":"172.21.15.183:6827/3509332199","heartbeat_back_addr":"172.21.15.183:6831/3509332199","heartbeat_front_addr":"172.21.15.183:6829/3509332199","state":["exists","up"]},{"osd":11,"uuid":"8b379865-3a5c-4a2d-aa74-a4f215027fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6825","nonce":3725107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6827","nonce":3725107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6831","nonce":3725107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6829","nonce":3725107101}]},"public_addr":"172.21.15.188:6825/3725107101","cluster_addr":"172.21.15.188:6827/3725107101","heartbeat_back_addr":"172.21.15.188:6831/3725107101","heartbeat_front_addr":"172.21.15.188:6829/3725107101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:58:44.413660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:06.554842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:28.651418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:50.995466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:13.906535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:36.632662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:59.003224+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:21.701327+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:44.017943+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:06.400895+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:29.625920+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:52.323223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3499235566":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/2112533111":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/2714360830":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/507334607":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6800/2524786594":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/1004458106":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6800/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/1046677443":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/899235864":"2024-07-25T21:56:15.044564+0000","172.21.15.47:6800/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/3057769442":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/2596054312":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6801/2524786594":"2024-07-25T21:57:25.995502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":8,"length":1},{"begin":21,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T22:19:29.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.176+0000 7fd89fbed640 1 -- 172.21.15.47:0/3244671683 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8840b3d40 msgr2=0x7fd8840b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.176+0000 7fd89fbed640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8840b3d40 0x7fd8840b6200 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd8940058c0 tx=0x7fd894005d30 comp rx=0 tx=0).stop 2024-07-24T22:19:29.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.176+0000 7fd89fbed640 1 -- 172.21.15.47:0/3244671683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd898108a60 msgr2=0x7fd89819e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.176+0000 7fd89fbed640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd898108a60 0x7fd89819e3b0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fd890031a20 tx=0x7fd890031a50 comp rx=0 tx=0).stop 2024-07-24T22:19:29.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.176+0000 7fd89fbed640 1 -- 172.21.15.47:0/3244671683 shutdown_connections 2024-07-24T22:19:29.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.176+0000 7fd89fbed640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd8840b3d40 0x7fd8840b6200 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.176+0000 7fd89fbed640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd898108a60 0x7fd89819e3b0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.176+0000 7fd89fbed640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8981080e0 0x7fd898199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.176+0000 7fd89fbed640 1 --2- 172.21.15.47:0/3244671683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8981026e0 0x7fd898198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.176+0000 7fd89fbed640 1 -- 172.21.15.47:0/3244671683 >> 172.21.15.47:0/3244671683 conn(0x7fd8980fe120 msgr2=0x7fd898100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:29.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.176+0000 7fd89fbed640 1 -- 172.21.15.47:0/3244671683 shutdown_connections 2024-07-24T22:19:29.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.176+0000 7fd89fbed640 1 -- 172.21.15.47:0/3244671683 wait complete. 2024-07-24T22:19:29.190 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-24T21:59:32.066678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-07-24T22:03:49.331120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-07-24T22:03:52.034826+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 21, 'snap_epoch': 98, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-07-24T22:19:29.190 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-07-24T22:19:29.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.296+0000 7fe6c248d640 1 -- 172.21.15.47:0/2894446901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6bc069fb0 msgr2=0x7fe6bc06a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.296+0000 7fe6c248d640 1 --2- 172.21.15.47:0/2894446901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6bc069fb0 0x7fe6bc06a390 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009900 tx=0x7fe6ac02a410 comp rx=0 tx=0).stop 2024-07-24T22:19:29.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.296+0000 7fe6c248d640 1 -- 172.21.15.47:0/2894446901 shutdown_connections 2024-07-24T22:19:29.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.296+0000 7fe6c248d640 1 --2- 172.21.15.47:0/2894446901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6bc1057f0 0x7fe6bc10f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.296+0000 7fe6c248d640 1 --2- 172.21.15.47:0/2894446901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc104e50 0x7fe6bc1052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.296+0000 7fe6c248d640 1 --2- 172.21.15.47:0/2894446901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6bc069fb0 0x7fe6bc06a390 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.296+0000 7fe6c248d640 1 -- 172.21.15.47:0/2894446901 >> 172.21.15.47:0/2894446901 conn(0x7fe6bc077030 msgr2=0x7fe6bc077440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:29.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.296+0000 7fe6c248d640 1 -- 172.21.15.47:0/2894446901 shutdown_connections 2024-07-24T22:19:29.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.296+0000 7fe6c248d640 1 -- 172.21.15.47:0/2894446901 wait complete. 2024-07-24T22:19:29.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.297+0000 7fe6c248d640 1 Processor -- start 2024-07-24T22:19:29.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.297+0000 7fe6c248d640 1 -- start start 2024-07-24T22:19:29.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.297+0000 7fe6c248d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6bc069fb0 0x7fe6bc19ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:29.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.297+0000 7fe6c248d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc104e50 0x7fe6bc19b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:29.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.297+0000 7fe6c248d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6bc1057f0 0x7fe6bc1a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:29.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.297+0000 7fe6c248d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc112680 con 0x7fe6bc1057f0 2024-07-24T22:19:29.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.297+0000 7fe6c248d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc112500 con 0x7fe6bc069fb0 2024-07-24T22:19:29.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.297+0000 7fe6c248d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc112800 con 0x7fe6bc104e50 2024-07-24T22:19:29.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.297+0000 7fe6c0a2a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6bc1057f0 0x7fe6bc1a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.297+0000 7fe6c0a2a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6bc1057f0 0x7fe6bc1a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56260/0 (socket says 172.21.15.47:56260) 2024-07-24T22:19:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.297+0000 7fe6c0a2a640 1 -- 172.21.15.47:0/4069184954 learned_addr learned my addr 172.21.15.47:0/4069184954 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.297+0000 7fe6bbfff640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6bc069fb0 0x7fe6bc19ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.297+0000 7fe6bb7fe640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc104e50 0x7fe6bc19b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.298+0000 7fe6c0a2a640 1 -- 172.21.15.47:0/4069184954 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc104e50 msgr2=0x7fe6bc19b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.298+0000 7fe6c0a2a640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc104e50 0x7fe6bc19b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.298+0000 7fe6c0a2a640 1 -- 172.21.15.47:0/4069184954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6bc069fb0 msgr2=0x7fe6bc19ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.298+0000 7fe6c0a2a640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6bc069fb0 0x7fe6bc19ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.298+0000 7fe6c0a2a640 1 -- 172.21.15.47:0/4069184954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc1a0f00 con 0x7fe6bc1057f0 2024-07-24T22:19:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.298+0000 7fe6c0a2a640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6bc1057f0 0x7fe6bc1a0730 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400eaa0 tx=0x7fe6b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.298+0000 7fe6b97fa640 1 -- 172.21.15.47:0/4069184954 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400cdb0 con 0x7fe6bc1057f0 2024-07-24T22:19:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.298+0000 7fe6b97fa640 1 -- 172.21.15.47:0/4069184954 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6b4005020 con 0x7fe6bc1057f0 2024-07-24T22:19:29.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.298+0000 7fe6c248d640 1 -- 172.21.15.47:0/4069184954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6bc1a11f0 con 0x7fe6bc1057f0 2024-07-24T22:19:29.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.298+0000 7fe6b97fa640 1 -- 172.21.15.47:0/4069184954 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b40116d0 con 0x7fe6bc1057f0 2024-07-24T22:19:29.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.298+0000 7fe6c248d640 1 -- 172.21.15.47:0/4069184954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6bc1a7930 con 0x7fe6bc1057f0 2024-07-24T22:19:29.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.299+0000 7fe6c248d640 1 -- 172.21.15.47:0/4069184954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6bc06a390 con 0x7fe6bc1057f0 2024-07-24T22:19:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.300+0000 7fe6b97fa640 1 -- 172.21.15.47:0/4069184954 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fe6b40051d0 con 0x7fe6bc1057f0 2024-07-24T22:19:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.301+0000 7fe6b97fa640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe6a40b3d40 0x7fe6a40b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.301+0000 7fe6b97fa640 1 -- 172.21.15.47:0/4069184954 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7fe6b40e45b0 con 0x7fe6bc1057f0 2024-07-24T22:19:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.301+0000 7fe6bbfff640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe6a40b3d40 0x7fe6a40b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:29.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.302+0000 7fe6bbfff640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe6a40b3d40 0x7fe6a40b6200 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac031440 tx=0x7fe6ac005b50 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:29.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.304+0000 7fe6b97fa640 1 -- 172.21.15.47:0/4069184954 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fe6b4016030 con 0x7fe6bc1057f0 2024-07-24T22:19:29.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.503+0000 7fe6c248d640 1 -- 172.21.15.47:0/4069184954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe6bc1a7d60 con 0x7fe6bc1057f0 2024-07-24T22:19:29.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.504+0000 7fe6b97fa640 1 -- 172.21.15.47:0/4069184954 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) ==== 93+0+10 (secure 0 0 0) 0x7fe6b40ab890 con 0x7fe6bc1057f0 2024-07-24T22:19:29.506 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-07-24T22:19:29.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.506+0000 7fe6c248d640 1 -- 172.21.15.47:0/4069184954 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe6a40b3d40 msgr2=0x7fe6a40b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.506+0000 7fe6c248d640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe6a40b3d40 0x7fe6a40b6200 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac031440 tx=0x7fe6ac005b50 comp rx=0 tx=0).stop 2024-07-24T22:19:29.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.506+0000 7fe6c248d640 1 -- 172.21.15.47:0/4069184954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6bc1057f0 msgr2=0x7fe6bc1a0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.506+0000 7fe6c248d640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6bc1057f0 0x7fe6bc1a0730 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400eaa0 tx=0x7fe6b400ef60 comp rx=0 tx=0).stop 2024-07-24T22:19:29.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.506+0000 7fe6c248d640 1 -- 172.21.15.47:0/4069184954 shutdown_connections 2024-07-24T22:19:29.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.506+0000 7fe6c248d640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fe6a40b3d40 0x7fe6a40b6200 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.506+0000 7fe6c248d640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6bc1057f0 0x7fe6bc1a0730 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.506+0000 7fe6c248d640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc104e50 0x7fe6bc19b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.506+0000 7fe6c248d640 1 --2- 172.21.15.47:0/4069184954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6bc069fb0 0x7fe6bc19ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.506+0000 7fe6c248d640 1 -- 172.21.15.47:0/4069184954 >> 172.21.15.47:0/4069184954 conn(0x7fe6bc077030 msgr2=0x7fe6bc108020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:29.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.506+0000 7fe6c248d640 1 -- 172.21.15.47:0/4069184954 shutdown_connections 2024-07-24T22:19:29.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.506+0000 7fe6c248d640 1 -- 172.21.15.47:0/4069184954 wait complete. 2024-07-24T22:19:29.520 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-07-24T22:19:29.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.626+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/1192512299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fac107940 msgr2=0x7f4fac10e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.626+0000 7f4fb2cf0640 1 --2- 172.21.15.47:0/1192512299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fac107940 0x7f4fac10e140 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009ca0 tx=0x7f4fa402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.626+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/1192512299 shutdown_connections 2024-07-24T22:19:29.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.626+0000 7f4fb2cf0640 1 --2- 172.21.15.47:0/1192512299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fac107940 0x7f4fac10e140 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.626+0000 7f4fb2cf0640 1 --2- 172.21.15.47:0/1192512299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4fac106fc0 0x7f4fac107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.626+0000 7f4fb2cf0640 1 --2- 172.21.15.47:0/1192512299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4fac1015c0 0x7f4fac1019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.626+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/1192512299 >> 172.21.15.47:0/1192512299 conn(0x7f4fac0fd020 msgr2=0x7f4fac0ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:29.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.626+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/1192512299 shutdown_connections 2024-07-24T22:19:29.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.626+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/1192512299 wait complete. 2024-07-24T22:19:29.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb2cf0640 1 Processor -- start 2024-07-24T22:19:29.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb2cf0640 1 -- start start 2024-07-24T22:19:29.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb2cf0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4fac1015c0 0x7f4fac0fd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:29.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb2cf0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4fac106fc0 0x7f4fac0fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:29.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb2cf0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fac107940 0x7f4fac0fdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:29.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb2cf0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1115f0 con 0x7f4fac107940 2024-07-24T22:19:29.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb2cf0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac111470 con 0x7f4fac1015c0 2024-07-24T22:19:29.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb2cf0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac111770 con 0x7f4fac106fc0 2024-07-24T22:19:29.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb128d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fac107940 0x7f4fac0fdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:29.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb128d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fac107940 0x7f4fac0fdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56278/0 (socket says 172.21.15.47:56278) 2024-07-24T22:19:29.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb128d640 1 -- 172.21.15.47:0/802735546 learned_addr learned my addr 172.21.15.47:0/802735546 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:29.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fabfff640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4fac106fc0 0x7f4fac0fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:29.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb0a8c640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4fac1015c0 0x7f4fac0fd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:29.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb128d640 1 -- 172.21.15.47:0/802735546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4fac106fc0 msgr2=0x7f4fac0fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb128d640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4fac106fc0 0x7f4fac0fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb128d640 1 -- 172.21.15.47:0/802735546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4fac1015c0 msgr2=0x7f4fac0fd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb128d640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4fac1015c0 0x7f4fac0fd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.627+0000 7f4fb128d640 1 -- 172.21.15.47:0/802735546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac1a7010 con 0x7f4fac107940 2024-07-24T22:19:29.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.628+0000 7f4fb128d640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fac107940 0x7f4fac0fdfa0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4005cc0 tx=0x7f4fa402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:29.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.628+0000 7f4fa9ffb640 1 -- 172.21.15.47:0/802735546 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4003bf0 con 0x7f4fac107940 2024-07-24T22:19:29.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.628+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/802735546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fac1a72a0 con 0x7f4fac107940 2024-07-24T22:19:29.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.628+0000 7f4fa9ffb640 1 -- 172.21.15.47:0/802735546 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa4003d90 con 0x7f4fac107940 2024-07-24T22:19:29.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.628+0000 7f4fa9ffb640 1 -- 172.21.15.47:0/802735546 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa402fb20 con 0x7f4fac107940 2024-07-24T22:19:29.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.628+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/802735546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fac1a78c0 con 0x7f4fac107940 2024-07-24T22:19:29.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.629+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/802735546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fac1019a0 con 0x7f4fac107940 2024-07-24T22:19:29.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.630+0000 7f4fa9ffb640 1 -- 172.21.15.47:0/802735546 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f4fa4004580 con 0x7f4fac107940 2024-07-24T22:19:29.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.631+0000 7f4fa9ffb640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4f9c0b3d40 0x7f4f9c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:29.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.631+0000 7f4fb0a8c640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4f9c0b3d40 0x7f4f9c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:29.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.631+0000 7f4fa9ffb640 1 -- 172.21.15.47:0/802735546 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7f4fa4105590 con 0x7f4fac107940 2024-07-24T22:19:29.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.632+0000 7f4fb0a8c640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4f9c0b3d40 0x7f4f9c0b6200 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009990 tx=0x7f4fa0009110 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:29.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.634+0000 7f4fa9ffb640 1 -- 172.21.15.47:0/802735546 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f4fa40cc980 con 0x7f4fac107940 2024-07-24T22:19:29.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.828+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/802735546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4fac10a730 con 0x7f4fac107940 2024-07-24T22:19:29.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.828+0000 7f4fa9ffb640 1 -- 172.21.15.47:0/802735546 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) ==== 104+0+11 (secure 0 0 0) 0x7f4fa40098b0 con 0x7f4fac107940 2024-07-24T22:19:29.831 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-07-24T22:19:29.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.830+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/802735546 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4f9c0b3d40 msgr2=0x7f4f9c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.830+0000 7f4fb2cf0640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4f9c0b3d40 0x7f4f9c0b6200 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009990 tx=0x7f4fa0009110 comp rx=0 tx=0).stop 2024-07-24T22:19:29.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.830+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/802735546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fac107940 msgr2=0x7f4fac0fdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.830+0000 7f4fb2cf0640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fac107940 0x7f4fac0fdfa0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4005cc0 tx=0x7f4fa402f380 comp rx=0 tx=0).stop 2024-07-24T22:19:29.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.831+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/802735546 shutdown_connections 2024-07-24T22:19:29.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.831+0000 7f4fb2cf0640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f4f9c0b3d40 0x7f4f9c0b6200 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.831+0000 7f4fb2cf0640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fac107940 0x7f4fac0fdfa0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.831+0000 7f4fb2cf0640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4fac106fc0 0x7f4fac0fda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.831+0000 7f4fb2cf0640 1 --2- 172.21.15.47:0/802735546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4fac1015c0 0x7f4fac0fd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.831+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/802735546 >> 172.21.15.47:0/802735546 conn(0x7f4fac0fd020 msgr2=0x7f4fac06ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:29.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.831+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/802735546 shutdown_connections 2024-07-24T22:19:29.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.831+0000 7f4fb2cf0640 1 -- 172.21.15.47:0/802735546 wait complete. 2024-07-24T22:19:29.844 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-07-24T22:19:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.950+0000 7f843e91e640 1 -- 172.21.15.47:0/29183339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84381026e0 msgr2=0x7f8438102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.950+0000 7f843e91e640 1 --2- 172.21.15.47:0/29183339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84381026e0 0x7f8438102ac0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f8428009900 tx=0x7f842802a3f0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.950+0000 7f843e91e640 1 -- 172.21.15.47:0/29183339 shutdown_connections 2024-07-24T22:19:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.950+0000 7f843e91e640 1 --2- 172.21.15.47:0/29183339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8438108a60 0x7f843810f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.950+0000 7f843e91e640 1 --2- 172.21.15.47:0/29183339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84381080e0 0x7f8438108520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.950+0000 7f843e91e640 1 --2- 172.21.15.47:0/29183339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84381026e0 0x7f8438102ac0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.950+0000 7f843e91e640 1 -- 172.21.15.47:0/29183339 >> 172.21.15.47:0/29183339 conn(0x7f84380fe120 msgr2=0x7f8438100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.950+0000 7f843e91e640 1 -- 172.21.15.47:0/29183339 shutdown_connections 2024-07-24T22:19:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.950+0000 7f843e91e640 1 -- 172.21.15.47:0/29183339 wait complete. 2024-07-24T22:19:29.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.951+0000 7f843e91e640 1 Processor -- start 2024-07-24T22:19:29.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.951+0000 7f843e91e640 1 -- start start 2024-07-24T22:19:29.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.951+0000 7f843e91e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84381026e0 0x7f8438074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:29.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.951+0000 7f843e91e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84381080e0 0x7f84380753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:29.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.951+0000 7f843e91e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8438108a60 0x7f8438075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:29.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.951+0000 7f843e91e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8438112690 con 0x7f8438108a60 2024-07-24T22:19:29.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.951+0000 7f843e91e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8438112510 con 0x7f84381026e0 2024-07-24T22:19:29.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.951+0000 7f843e91e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8438112810 con 0x7f84381080e0 2024-07-24T22:19:29.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.951+0000 7f843cebb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8438108a60 0x7f8438075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:29.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.951+0000 7f843cebb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8438108a60 0x7f8438075910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56306/0 (socket says 172.21.15.47:56306) 2024-07-24T22:19:29.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.951+0000 7f843cebb640 1 -- 172.21.15.47:0/1528511554 learned_addr learned my addr 172.21.15.47:0/1528511554 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:29.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.951+0000 7f84377fe640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84381080e0 0x7f84380753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:29.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.952+0000 7f8437fff640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84381026e0 0x7f8438074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:29.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.952+0000 7f843cebb640 1 -- 172.21.15.47:0/1528511554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84381080e0 msgr2=0x7f84380753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.952+0000 7f843cebb640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84381080e0 0x7f84380753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.952+0000 7f843cebb640 1 -- 172.21.15.47:0/1528511554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84381026e0 msgr2=0x7f8438074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:29.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.952+0000 7f843cebb640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84381026e0 0x7f8438074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:29.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.952+0000 7f843cebb640 1 -- 172.21.15.47:0/1528511554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84381a6f60 con 0x7f8438108a60 2024-07-24T22:19:29.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.952+0000 7f843cebb640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8438108a60 0x7f8438075910 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f843000cce0 tx=0x7f843000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:29.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.955+0000 7f84357fa640 1 -- 172.21.15.47:0/1528511554 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843000f450 con 0x7f8438108a60 2024-07-24T22:19:29.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.955+0000 7f84357fa640 1 -- 172.21.15.47:0/1528511554 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f843000faa0 con 0x7f8438108a60 2024-07-24T22:19:29.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.955+0000 7f843e91e640 1 -- 172.21.15.47:0/1528511554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84381a7250 con 0x7f8438108a60 2024-07-24T22:19:29.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.955+0000 7f84357fa640 1 -- 172.21.15.47:0/1528511554 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8430018a80 con 0x7f8438108a60 2024-07-24T22:19:29.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.955+0000 7f843e91e640 1 -- 172.21.15.47:0/1528511554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84381a7750 con 0x7f8438108a60 2024-07-24T22:19:29.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.956+0000 7f843e91e640 1 -- 172.21.15.47:0/1528511554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8438102ac0 con 0x7f8438108a60 2024-07-24T22:19:29.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.957+0000 7f84357fa640 1 -- 172.21.15.47:0/1528511554 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f843000fc50 con 0x7f8438108a60 2024-07-24T22:19:29.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.958+0000 7f84357fa640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f84200b3d40 0x7f84200b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:29.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.958+0000 7f84357fa640 1 -- 172.21.15.47:0/1528511554 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7f84300e4420 con 0x7f8438108a60 2024-07-24T22:19:29.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.958+0000 7f8437fff640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f84200b3d40 0x7f84200b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:29.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.959+0000 7f8437fff640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f84200b3d40 0x7f84200b6200 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8428031440 tx=0x7f8428005e80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:29.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:29.962+0000 7f84357fa640 1 -- 172.21.15.47:0/1528511554 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f8430014030 con 0x7f8438108a60 2024-07-24T22:19:30.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.155+0000 7f843e91e640 1 -- 172.21.15.47:0/1528511554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f84381a7b30 con 0x7f8438108a60 2024-07-24T22:19:30.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.155+0000 7f84357fa640 1 -- 172.21.15.47:0/1528511554 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) ==== 100+0+11 (secure 0 0 0) 0x7f84300ab6a0 con 0x7f8438108a60 2024-07-24T22:19:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-07-24T22:19:30.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.157+0000 7f843e91e640 1 -- 172.21.15.47:0/1528511554 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f84200b3d40 msgr2=0x7f84200b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:30.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.157+0000 7f843e91e640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f84200b3d40 0x7f84200b6200 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8428031440 tx=0x7f8428005e80 comp rx=0 tx=0).stop 2024-07-24T22:19:30.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.158+0000 7f843e91e640 1 -- 172.21.15.47:0/1528511554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8438108a60 msgr2=0x7f8438075910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:30.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.158+0000 7f843e91e640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8438108a60 0x7f8438075910 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f843000cce0 tx=0x7f843000a620 comp rx=0 tx=0).stop 2024-07-24T22:19:30.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.158+0000 7f843e91e640 1 -- 172.21.15.47:0/1528511554 shutdown_connections 2024-07-24T22:19:30.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.158+0000 7f843e91e640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f84200b3d40 0x7f84200b6200 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:30.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.158+0000 7f843e91e640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8438108a60 0x7f8438075910 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:30.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.158+0000 7f843e91e640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84381080e0 0x7f84380753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:30.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.158+0000 7f843e91e640 1 --2- 172.21.15.47:0/1528511554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84381026e0 0x7f8438074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:30.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.158+0000 7f843e91e640 1 -- 172.21.15.47:0/1528511554 >> 172.21.15.47:0/1528511554 conn(0x7f84380fe120 msgr2=0x7f84380fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:30.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.158+0000 7f843e91e640 1 -- 172.21.15.47:0/1528511554 shutdown_connections 2024-07-24T22:19:30.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.158+0000 7f843e91e640 1 -- 172.21.15.47:0/1528511554 wait complete. 2024-07-24T22:19:30.170 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:29 smithi047 ceph-mon[32551]: pgmap v748: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-24T22:19:30.170 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:29 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3244671683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:19:30.170 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:29 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/4069184954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-24T22:19:30.170 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:29 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/802735546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-24T22:19:30.171 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-07-24T22:19:30.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.274+0000 7fdc886be640 1 -- 172.21.15.47:0/3300412392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc80103ee0 msgr2=0x7fdc8010c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:30.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.274+0000 7fdc886be640 1 --2- 172.21.15.47:0/3300412392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc80103ee0 0x7fdc8010c3c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009900 tx=0x7fdc7002a410 comp rx=0 tx=0).stop 2024-07-24T22:19:30.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.274+0000 7fdc886be640 1 -- 172.21.15.47:0/3300412392 shutdown_connections 2024-07-24T22:19:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.274+0000 7fdc886be640 1 --2- 172.21.15.47:0/3300412392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc8010c9e0 0x7fdc8010ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.274+0000 7fdc886be640 1 --2- 172.21.15.47:0/3300412392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc80103ee0 0x7fdc8010c3c0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.274+0000 7fdc886be640 1 --2- 172.21.15.47:0/3300412392 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc801035c0 0x7fdc801039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.274+0000 7fdc886be640 1 -- 172.21.15.47:0/3300412392 >> 172.21.15.47:0/3300412392 conn(0x7fdc800fcfd0 msgr2=0x7fdc800ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.274+0000 7fdc886be640 1 -- 172.21.15.47:0/3300412392 shutdown_connections 2024-07-24T22:19:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.274+0000 7fdc886be640 1 -- 172.21.15.47:0/3300412392 wait complete. 2024-07-24T22:19:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.274+0000 7fdc886be640 1 Processor -- start 2024-07-24T22:19:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc886be640 1 -- start start 2024-07-24T22:19:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc886be640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc801035c0 0x7fdc80101260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc886be640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc80103ee0 0x7fdc801017a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc886be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc8010c9e0 0x7fdc80101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc886be640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdc80112670 con 0x7fdc801035c0 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc886be640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801124f0 con 0x7fdc80103ee0 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc886be640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801127f0 con 0x7fdc8010c9e0 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc8645a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc801035c0 0x7fdc80101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc8645a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc801035c0 0x7fdc80101260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56330/0 (socket says 172.21.15.47:56330) 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc8645a640 1 -- 172.21.15.47:0/591976117 learned_addr learned my addr 172.21.15.47:0/591976117 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc86c5b640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc8010c9e0 0x7fdc80101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc85c59640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc80103ee0 0x7fdc801017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc8645a640 1 -- 172.21.15.47:0/591976117 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc8010c9e0 msgr2=0x7fdc80101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc8645a640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc8010c9e0 0x7fdc80101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc8645a640 1 -- 172.21.15.47:0/591976117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc80103ee0 msgr2=0x7fdc801017a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc8645a640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc80103ee0 0x7fdc801017a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc8645a640 1 -- 172.21.15.47:0/591976117 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc801a6fc0 con 0x7fdc801035c0 2024-07-24T22:19:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc86c5b640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc8010c9e0 0x7fdc80101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:19:30.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.275+0000 7fdc8645a640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc801035c0 0x7fdc80101260 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c00d770 tx=0x7fdc7c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:30.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.276+0000 7fdc777fe640 1 -- 172.21.15.47:0/591976117 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c017070 con 0x7fdc801035c0 2024-07-24T22:19:30.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.276+0000 7fdc886be640 1 -- 172.21.15.47:0/591976117 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc801a72b0 con 0x7fdc801035c0 2024-07-24T22:19:30.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.276+0000 7fdc777fe640 1 -- 172.21.15.47:0/591976117 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc7c0054d0 con 0x7fdc801035c0 2024-07-24T22:19:30.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.276+0000 7fdc777fe640 1 -- 172.21.15.47:0/591976117 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c004c30 con 0x7fdc801035c0 2024-07-24T22:19:30.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.276+0000 7fdc886be640 1 -- 172.21.15.47:0/591976117 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc801a7780 con 0x7fdc801035c0 2024-07-24T22:19:30.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.277+0000 7fdc886be640 1 -- 172.21.15.47:0/591976117 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc801039a0 con 0x7fdc801035c0 2024-07-24T22:19:30.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.278+0000 7fdc777fe640 1 -- 172.21.15.47:0/591976117 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fdc7c004dd0 con 0x7fdc801035c0 2024-07-24T22:19:30.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.279+0000 7fdc777fe640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdc6c0b3d40 0x7fdc6c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:19:30.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.279+0000 7fdc777fe640 1 -- 172.21.15.47:0/591976117 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7fdc7c0e3fa0 con 0x7fdc801035c0 2024-07-24T22:19:30.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.279+0000 7fdc85c59640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdc6c0b3d40 0x7fdc6c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:19:30.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.279+0000 7fdc85c59640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdc6c0b3d40 0x7fdc6c0b6200 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdc70031440 tx=0x7fdc700095f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:19:30.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.282+0000 7fdc777fe640 1 -- 172.21.15.47:0/591976117 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fdc7c0ab280 con 0x7fdc801035c0 2024-07-24T22:19:30.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:29 smithi188 ceph-mon[37380]: pgmap v748: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-24T22:19:30.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:29 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3244671683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:19:30.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:29 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/4069184954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-24T22:19:30.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:29 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/802735546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-24T22:19:30.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:29 smithi183 ceph-mon[37007]: pgmap v748: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-24T22:19:30.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:29 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3244671683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:19:30.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:29 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/4069184954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-24T22:19:30.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:29 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/802735546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-24T22:19:30.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.532+0000 7fdc886be640 1 -- 172.21.15.47:0/591976117 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fdc80102560 con 0x7fdc801035c0 2024-07-24T22:19:30.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.540+0000 7fdc777fe640 1 -- 172.21.15.47:0/591976117 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+821909 (secure 0 0 0) 0x7fdc80102560 con 0x7fdc801035c0 2024-07-24T22:19:30.553 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:19:30.553 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:19:30.554 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 25, 2024-07-24T22:19:30.554 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.554 INFO:teuthology.orchestra.run.smithi047.stdout: "active_gid": 14214, 2024-07-24T22:19:30.554 INFO:teuthology.orchestra.run.smithi047.stdout: "active_name": "x", 2024-07-24T22:19:30.554 INFO:teuthology.orchestra.run.smithi047.stdout: "active_addrs": { 2024-07-24T22:19:30.554 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-07-24T22:19:30.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.554 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-07-24T22:19:30.554 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:6800", 2024-07-24T22:19:30.554 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 4198530936 2024-07-24T22:19:30.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.555 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-07-24T22:19:30.555 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:6801", 2024-07-24T22:19:30.555 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 4198530936 2024-07-24T22:19:30.555 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.555 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-07-24T22:19:30.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.555 INFO:teuthology.orchestra.run.smithi047.stdout: "active_addr": "172.21.15.47:6801/4198530936", 2024-07-24T22:19:30.555 INFO:teuthology.orchestra.run.smithi047.stdout: "active_change": "2024-07-24T21:57:25.995614+0000", 2024-07-24T22:19:30.555 INFO:teuthology.orchestra.run.smithi047.stdout: "active_mgr_features": 4540701547738038271, 2024-07-24T22:19:30.556 INFO:teuthology.orchestra.run.smithi047.stdout: "available": true, 2024-07-24T22:19:30.556 INFO:teuthology.orchestra.run.smithi047.stdout: "standbys": [ 2024-07-24T22:19:30.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.556 INFO:teuthology.orchestra.run.smithi047.stdout: "gid": 24139, 2024-07-24T22:19:30.556 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "z", 2024-07-24T22:19:30.556 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr_features": 4540701547738038271, 2024-07-24T22:19:30.556 INFO:teuthology.orchestra.run.smithi047.stdout: "available_modules": [ 2024-07-24T22:19:30.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.556 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "alerts", 2024-07-24T22:19:30.557 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.557 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.557 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.557 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:30.557 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:30.557 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.557 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.557 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.557 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:30.557 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.557 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How frequently to reexamine health status", 2024-07-24T22:19:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.558 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.559 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.559 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.559 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.559 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.559 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.559 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.559 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.559 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.559 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.559 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.559 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.560 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.560 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.560 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.560 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.560 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.560 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.560 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.560 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.560 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.560 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.560 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.560 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.561 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.561 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.561 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.561 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.561 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.561 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.561 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.561 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.561 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.561 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.561 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.562 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.562 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.562 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.562 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.562 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.562 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.562 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.562 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.562 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.562 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.562 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.562 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.564 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.564 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.564 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_destination": { 2024-07-24T22:19:30.564 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_destination", 2024-07-24T22:19:30.564 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.564 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.564 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.564 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.564 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.564 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.564 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.565 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email address to send alerts to", 2024-07-24T22:19:30.565 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.565 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.565 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.565 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_from_name": { 2024-07-24T22:19:30.565 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_from_name", 2024-07-24T22:19:30.565 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.565 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.565 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.565 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "Ceph", 2024-07-24T22:19:30.565 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.565 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.566 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.566 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email From: name", 2024-07-24T22:19:30.566 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.566 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.566 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.566 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_host": { 2024-07-24T22:19:30.566 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_host", 2024-07-24T22:19:30.566 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.566 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.566 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP server", 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_password": { 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_password", 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.567 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Password to authenticate with", 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_port": { 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_port", 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.568 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "465", 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP port", 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_sender": { 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_sender", 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.569 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.570 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.570 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.570 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.570 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.570 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP envelope sender", 2024-07-24T22:19:30.570 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.570 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.570 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.570 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_ssl": { 2024-07-24T22:19:30.570 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_ssl", 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use SSL to connect to SMTP server", 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_user": { 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_user", 2024-07-24T22:19:30.571 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.572 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.572 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.572 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.572 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.572 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.572 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.572 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "User to authenticate as", 2024-07-24T22:19:30.572 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.572 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.572 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.572 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.572 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.573 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.573 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.573 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.573 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.573 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.573 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.573 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.573 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.573 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.573 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.573 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.573 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.573 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "balancer", 2024-07-24T22:19:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: "active": { 2024-07-24T22:19:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "active", 2024-07-24T22:19:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically balance PGs across cluster", 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_time": { 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_time", 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0000", 2024-07-24T22:19:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "beginning time of day to automatically balance", 2024-07-24T22:19:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-24T22:19:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_weekday": { 2024-07-24T22:19:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_weekday", 2024-07-24T22:19:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-07-24T22:19:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-07-24T22:19:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-07-24T22:19:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-24T22:19:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_max_iterations": { 2024-07-24T22:19:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_max_iterations", 2024-07-24T22:19:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "25", 2024-07-24T22:19:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-07-24T22:19:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "250", 2024-07-24T22:19:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-07-24T22:19:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_metrics": { 2024-07-24T22:19:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_metrics", 2024-07-24T22:19:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "pgs,objects,bytes", 2024-07-24T22:19:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-07-24T22:19:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-07-24T22:19:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_step": { 2024-07-24T22:19:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_step", 2024-07-24T22:19:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.5", 2024-07-24T22:19:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0.001", 2024-07-24T22:19:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "0.999", 2024-07-24T22:19:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "aggressiveness of optimization", 2024-07-24T22:19:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-07-24T22:19:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: "end_time": { 2024-07-24T22:19:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_time", 2024-07-24T22:19:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2359", 2024-07-24T22:19:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ending time of day to automatically balance", 2024-07-24T22:19:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-24T22:19:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: "end_weekday": { 2024-07-24T22:19:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_weekday", 2024-07-24T22:19:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-07-24T22:19:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-07-24T22:19:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-07-24T22:19:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-24T22:19:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.586 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.587 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.588 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: "min_score": { 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_score", 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.589 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.590 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.590 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-07-24T22:19:30.590 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-07-24T22:19:30.590 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.590 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.590 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.590 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "upmap", 2024-07-24T22:19:30.590 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.590 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.590 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.590 INFO:teuthology.orchestra.run.smithi047.stdout: "crush-compat", 2024-07-24T22:19:30.590 INFO:teuthology.orchestra.run.smithi047.stdout: "none", 2024-07-24T22:19:30.591 INFO:teuthology.orchestra.run.smithi047.stdout: "read", 2024-07-24T22:19:30.591 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap", 2024-07-24T22:19:30.591 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap-read" 2024-07-24T22:19:30.591 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.591 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Balancer mode", 2024-07-24T22:19:30.591 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.591 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.591 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.591 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_ids": { 2024-07-24T22:19:30.591 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_ids", 2024-07-24T22:19:30.591 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.591 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.592 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.592 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.592 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.592 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.592 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.592 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-07-24T22:19:30.592 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.592 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.592 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.592 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:30.592 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.593 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.594 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.594 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.594 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.594 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.594 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.594 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.594 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.594 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.594 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.594 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.594 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.594 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_deviation": { 2024-07-24T22:19:30.595 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_deviation", 2024-07-24T22:19:30.595 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.595 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.595 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.595 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:30.595 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-07-24T22:19:30.595 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.595 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.595 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "deviation below which no optimization is attempted", 2024-07-24T22:19:30.595 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-07-24T22:19:30.595 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.595 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.596 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_optimizations": { 2024-07-24T22:19:30.596 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_optimizations", 2024-07-24T22:19:30.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:30.596 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.596 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:30.596 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.596 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.596 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.596 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-07-24T22:19:30.596 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.596 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm", 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_down_multiplier": { 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_down_multiplier", 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.597 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.598 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-07-24T22:19:30.598 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.598 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.598 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.598 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-07-24T22:19:30.598 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.598 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.598 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.598 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_refresh_rate": { 2024-07-24T22:19:30.598 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_refresh_rate", 2024-07-24T22:19:30.599 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.599 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.599 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.599 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "20", 2024-07-24T22:19:30.599 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.599 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.599 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.599 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-07-24T22:19:30.599 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.599 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.599 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.599 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_starting_port": { 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_starting_port", 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4721", 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.600 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_ptrace": { 2024-07-24T22:19:30.601 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_ptrace", 2024-07-24T22:19:30.601 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.601 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.601 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.601 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.601 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.601 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.601 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.601 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-07-24T22:19:30.601 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-07-24T22:19:30.601 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.601 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.602 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_interval": { 2024-07-24T22:19:30.602 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_interval", 2024-07-24T22:19:30.602 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.602 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.602 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.602 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:30.602 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.602 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.602 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.602 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to autotune daemon memory", 2024-07-24T22:19:30.602 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.602 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.602 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.603 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_memory_target_ratio": { 2024-07-24T22:19:30.603 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_memory_target_ratio", 2024-07-24T22:19:30.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:30.603 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.603 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.7", 2024-07-24T22:19:30.603 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.603 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.603 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.603 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-07-24T22:19:30.603 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.603 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.604 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.604 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm_log_destination": { 2024-07-24T22:19:30.604 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm_log_destination", 2024-07-24T22:19:30.604 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.604 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.604 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.604 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.604 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.604 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.604 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.604 INFO:teuthology.orchestra.run.smithi047.stdout: "file", 2024-07-24T22:19:30.604 INFO:teuthology.orchestra.run.smithi047.stdout: "file,syslog", 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: "syslog" 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: "cgroups_split": { 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cgroups_split", 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.605 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-07-24T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout: "config_checks_enabled": { 2024-07-24T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_checks_enabled", 2024-07-24T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.607 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.607 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.607 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.607 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-07-24T22:19:30.607 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.607 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.607 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.607 INFO:teuthology.orchestra.run.smithi047.stdout: "config_dashboard": { 2024-07-24T22:19:30.607 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_dashboard", 2024-07-24T22:19:30.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.608 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.608 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.608 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.608 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.608 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.608 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.608 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-07-24T22:19:30.608 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.608 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.608 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.608 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_alertmanager": { 2024-07-24T22:19:30.609 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_alertmanager", 2024-07-24T22:19:30.609 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.609 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.609 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.609 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-07-24T22:19:30.609 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.609 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.609 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.609 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-07-24T22:19:30.609 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.609 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.609 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.610 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_base": { 2024-07-24T22:19:30.610 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_base", 2024-07-24T22:19:30.610 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.610 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.610 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.610 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/ceph", 2024-07-24T22:19:30.610 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.610 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.610 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.610 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Container image name, without the tag", 2024-07-24T22:19:30.610 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.610 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.611 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.611 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_elasticsearch": { 2024-07-24T22:19:30.611 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_elasticsearch", 2024-07-24T22:19:30.611 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.611 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.611 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.611 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-07-24T22:19:30.611 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.611 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.611 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.612 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "elasticsearch container image", 2024-07-24T22:19:30.612 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.612 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.612 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.612 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_grafana": { 2024-07-24T22:19:30.612 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_grafana", 2024-07-24T22:19:30.612 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.612 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.612 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.612 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-07-24T22:19:30.612 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.613 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.613 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.613 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-07-24T22:19:30.613 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.613 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.613 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.613 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_haproxy": { 2024-07-24T22:19:30.613 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_haproxy", 2024-07-24T22:19:30.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.613 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.613 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.614 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-07-24T22:19:30.614 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.614 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.614 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.614 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "HAproxy container image", 2024-07-24T22:19:30.614 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.614 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.614 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.614 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_agent": { 2024-07-24T22:19:30.614 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_agent", 2024-07-24T22:19:30.614 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger agent container image", 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_collector": { 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_collector", 2024-07-24T22:19:30.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.616 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.616 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.616 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-07-24T22:19:30.616 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.616 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.616 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.616 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger collector container image", 2024-07-24T22:19:30.616 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.616 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.616 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.616 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_query": { 2024-07-24T22:19:30.616 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_query", 2024-07-24T22:19:30.617 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.617 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.617 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.617 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-07-24T22:19:30.617 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.617 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.617 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.617 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger query container image", 2024-07-24T22:19:30.617 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.617 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.617 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.617 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_keepalived": { 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_keepalived", 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Keepalived container image", 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.618 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_loki": { 2024-07-24T22:19:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_loki", 2024-07-24T22:19:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-07-24T22:19:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Loki container image", 2024-07-24T22:19:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.620 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nginx": { 2024-07-24T22:19:30.620 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nginx", 2024-07-24T22:19:30.620 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.620 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.620 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.620 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-07-24T22:19:30.620 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.620 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.620 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.620 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nginx container image", 2024-07-24T22:19:30.620 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.620 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.620 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_node_exporter": { 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_node_exporter", 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.622 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nvmeof": { 2024-07-24T22:19:30.622 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nvmeof", 2024-07-24T22:19:30.622 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.622 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.622 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.622 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-07-24T22:19:30.622 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.622 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.622 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.622 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nvme-of container image", 2024-07-24T22:19:30.622 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.622 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_prometheus": { 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_prometheus", 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.623 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.624 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_promtail": { 2024-07-24T22:19:30.624 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_promtail", 2024-07-24T22:19:30.624 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.624 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.624 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.624 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-07-24T22:19:30.624 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.624 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.624 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.624 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Promtail container image", 2024-07-24T22:19:30.625 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.625 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.625 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.625 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba": { 2024-07-24T22:19:30.625 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba", 2024-07-24T22:19:30.625 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.625 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.625 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.625 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-07-24T22:19:30.625 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.625 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.626 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.626 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB container image", 2024-07-24T22:19:30.626 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.626 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.626 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.626 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_snmp_gateway": { 2024-07-24T22:19:30.626 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_snmp_gateway", 2024-07-24T22:19:30.626 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.626 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.626 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.626 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-07-24T22:19:30.627 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.627 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.627 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.627 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SNMP Gateway container image", 2024-07-24T22:19:30.627 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.627 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.627 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.627 INFO:teuthology.orchestra.run.smithi047.stdout: "container_init": { 2024-07-24T22:19:30.627 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_init", 2024-07-24T22:19:30.627 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.627 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.627 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Run podman/docker with `--init`", 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: "daemon_cache_timeout": { 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "daemon_cache_timeout", 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.628 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.629 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:30.629 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.629 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.629 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.629 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-07-24T22:19:30.629 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.629 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.629 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.629 INFO:teuthology.orchestra.run.smithi047.stdout: "default_cephadm_command_timeout": { 2024-07-24T22:19:30.629 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_cephadm_command_timeout", 2024-07-24T22:19:30.629 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.629 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.630 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.630 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "900", 2024-07-24T22:19:30.630 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.630 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.630 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.630 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-07-24T22:19:30.630 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.630 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.630 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.630 INFO:teuthology.orchestra.run.smithi047.stdout: "default_registry": { 2024-07-24T22:19:30.630 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_registry", 2024-07-24T22:19:30.630 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io", 2024-07-24T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-07-24T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout: "device_cache_timeout": { 2024-07-24T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_cache_timeout", 2024-07-24T22:19:30.632 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.632 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.632 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.632 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1800", 2024-07-24T22:19:30.632 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.632 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.632 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.632 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache device inventory", 2024-07-24T22:19:30.632 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.632 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.632 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: "device_enhanced_scan": { 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_enhanced_scan", 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use libstoragemgmt during device scans", 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.634 INFO:teuthology.orchestra.run.smithi047.stdout: "facts_cache_timeout": { 2024-07-24T22:19:30.634 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "facts_cache_timeout", 2024-07-24T22:19:30.634 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.634 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.634 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.634 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:30.634 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.634 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.634 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.634 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache host facts data", 2024-07-24T22:19:30.634 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.634 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.634 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.635 INFO:teuthology.orchestra.run.smithi047.stdout: "grafana_dashboards_path": { 2024-07-24T22:19:30.635 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "grafana_dashboards_path", 2024-07-24T22:19:30.635 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.635 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.635 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.635 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-07-24T22:19:30.635 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.635 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.635 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.635 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-07-24T22:19:30.635 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.635 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.636 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.636 INFO:teuthology.orchestra.run.smithi047.stdout: "host_check_interval": { 2024-07-24T22:19:30.636 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "host_check_interval", 2024-07-24T22:19:30.636 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.636 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.636 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.636 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:30.636 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.636 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.636 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.636 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to perform a host check", 2024-07-24T22:19:30.636 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: "hw_monitoring": { 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hw_monitoring", 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-07-24T22:19:30.637 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.638 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.638 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.638 INFO:teuthology.orchestra.run.smithi047.stdout: "inventory_list_all": { 2024-07-24T22:19:30.638 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "inventory_list_all", 2024-07-24T22:19:30.638 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.638 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.638 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.638 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.638 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.638 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.639 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.639 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-07-24T22:19:30.639 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.639 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.639 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.639 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.639 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.639 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.639 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.639 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.639 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.639 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.640 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.640 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.640 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.640 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.640 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.640 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.640 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.640 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.640 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.640 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.640 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.640 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.640 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.641 INFO:teuthology.orchestra.run.smithi047.stdout: "log_refresh_metadata": { 2024-07-24T22:19:30.641 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_refresh_metadata", 2024-07-24T22:19:30.641 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.641 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.641 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.641 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.641 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.641 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.641 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.641 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-07-24T22:19:30.641 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.641 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.642 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.642 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.642 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.642 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.642 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.642 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.642 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.642 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.642 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.642 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.642 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-07-24T22:19:30.643 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.643 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.643 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.643 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.643 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.643 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.643 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.643 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.643 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.643 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.643 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.643 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.644 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf": { 2024-07-24T22:19:30.645 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-07-24T22:19:30.646 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.646 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.646 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.646 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.646 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.646 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.646 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.646 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-07-24T22:19:30.646 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.646 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.646 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "*", 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: "max_count_per_host": { 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_count_per_host", 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of daemons per service per host", 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.649 INFO:teuthology.orchestra.run.smithi047.stdout: "max_osd_draining_count": { 2024-07-24T22:19:30.649 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_osd_draining_count", 2024-07-24T22:19:30.649 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.649 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.649 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.649 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:30.649 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.649 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.649 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.649 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-07-24T22:19:30.649 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.650 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.650 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.650 INFO:teuthology.orchestra.run.smithi047.stdout: "migration_current": { 2024-07-24T22:19:30.650 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "migration_current", 2024-07-24T22:19:30.650 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.650 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.650 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.650 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.650 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.650 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.650 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.650 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "internal - do not modify", 2024-07-24T22:19:30.651 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.651 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.651 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.651 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-07-24T22:19:30.651 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-07-24T22:19:30.651 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.651 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.651 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.651 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "root", 2024-07-24T22:19:30.651 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.652 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.652 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.652 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm-package", 2024-07-24T22:19:30.652 INFO:teuthology.orchestra.run.smithi047.stdout: "root" 2024-07-24T22:19:30.652 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.652 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "mode for remote execution of cephadm", 2024-07-24T22:19:30.652 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.652 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.652 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.652 INFO:teuthology.orchestra.run.smithi047.stdout: "oob_default_addr": { 2024-07-24T22:19:30.652 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "oob_default_addr", 2024-07-24T22:19:30.652 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.653 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.653 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.653 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "169.254.1.1", 2024-07-24T22:19:30.653 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.653 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.653 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.653 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default address for RedFish API (oob management).", 2024-07-24T22:19:30.653 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.653 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.653 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.653 INFO:teuthology.orchestra.run.smithi047.stdout: "prometheus_alerts_path": { 2024-07-24T22:19:30.653 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus_alerts_path", 2024-07-24T22:19:30.654 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.654 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.654 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.654 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-07-24T22:19:30.654 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.654 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.654 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.654 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-07-24T22:19:30.654 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.654 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.654 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.655 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_insecure": { 2024-07-24T22:19:30.655 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_insecure", 2024-07-24T22:19:30.655 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.655 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.655 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.655 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.655 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.655 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.655 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.655 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-07-24T22:19:30.655 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.655 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.655 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.656 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_password": { 2024-07-24T22:19:30.656 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_password", 2024-07-24T22:19:30.656 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.656 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.656 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.656 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.656 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.656 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.656 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.656 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-07-24T22:19:30.656 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.657 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.657 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.657 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_url": { 2024-07-24T22:19:30.657 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_url", 2024-07-24T22:19:30.657 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.657 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.657 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.657 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.657 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.657 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.657 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.658 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-07-24T22:19:30.658 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.658 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.658 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.658 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_username": { 2024-07-24T22:19:30.658 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_username", 2024-07-24T22:19:30.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.658 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.658 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.658 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.658 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.659 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.659 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-07-24T22:19:30.659 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.659 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.659 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.659 INFO:teuthology.orchestra.run.smithi047.stdout: "secure_monitoring_stack": { 2024-07-24T22:19:30.659 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secure_monitoring_stack", 2024-07-24T22:19:30.659 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.659 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.659 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.659 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.659 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.660 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.660 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.660 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-07-24T22:19:30.660 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.660 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.660 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.660 INFO:teuthology.orchestra.run.smithi047.stdout: "service_discovery_port": { 2024-07-24T22:19:30.660 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "service_discovery_port", 2024-07-24T22:19:30.660 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.660 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.661 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.661 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8765", 2024-07-24T22:19:30.661 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.661 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.661 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.661 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "cephadm service discovery port", 2024-07-24T22:19:30.661 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.661 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.661 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.661 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.661 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.662 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.662 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.662 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.662 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.662 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.662 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.662 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.662 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.662 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.662 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.662 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.662 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_config_file": { 2024-07-24T22:19:30.663 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_config_file", 2024-07-24T22:19:30.663 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.663 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.663 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.663 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.663 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.663 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.663 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.663 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-07-24T22:19:30.663 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.663 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.663 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.664 INFO:teuthology.orchestra.run.smithi047.stdout: "use_agent": { 2024-07-24T22:19:30.664 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_agent", 2024-07-24T22:19:30.664 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.664 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.664 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.664 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.664 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.664 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.664 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.664 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-07-24T22:19:30.664 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.664 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.664 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.665 INFO:teuthology.orchestra.run.smithi047.stdout: "use_repo_digest": { 2024-07-24T22:19:30.665 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_repo_digest", 2024-07-24T22:19:30.665 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.665 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.665 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.665 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.665 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.665 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.665 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.665 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-07-24T22:19:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_failed_host_check": { 2024-07-24T22:19:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_failed_host_check", 2024-07-24T22:19:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.667 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if the host check fails", 2024-07-24T22:19:30.667 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.667 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.667 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.667 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_daemons": { 2024-07-24T22:19:30.667 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_daemons", 2024-07-24T22:19:30.667 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.667 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.667 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.667 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.667 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.667 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.668 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.668 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-07-24T22:19:30.668 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.668 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.668 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.668 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_hosts": { 2024-07-24T22:19:30.668 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_hosts", 2024-07-24T22:19:30.668 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.668 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.668 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.669 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.669 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.669 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.669 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.669 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-07-24T22:19:30.669 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.669 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.669 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.669 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.669 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.669 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crash", 2024-07-24T22:19:30.670 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.670 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.670 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.670 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.670 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.670 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.670 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.670 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.670 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.670 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.670 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.670 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.671 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.671 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.671 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.671 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.671 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.671 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.671 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.671 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.671 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.671 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.671 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.671 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.672 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.672 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.672 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.672 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.672 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.672 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.672 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.672 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.672 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.672 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.672 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.672 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.674 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: "retain_interval": { 2024-07-24T22:19:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retain_interval", 2024-07-24T22:19:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "31536000", 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain crashes before pruning them", 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.676 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_recent_interval": { 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_recent_interval", 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.677 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1209600", 2024-07-24T22:19:30.678 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.678 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.678 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.678 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "time interval in which to warn about recent crashes", 2024-07-24T22:19:30.678 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.678 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.678 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.678 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dashboard", 2024-07-24T22:19:30.678 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.679 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.679 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.679 INFO:teuthology.orchestra.run.smithi047.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-07-24T22:19:30.679 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-07-24T22:19:30.679 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.679 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.679 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.679 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:30.679 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.679 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.679 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.679 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.679 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.680 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.680 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.680 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_HOST": { 2024-07-24T22:19:30.680 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_HOST", 2024-07-24T22:19:30.680 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.680 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.680 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.680 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.680 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.680 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.680 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.681 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.681 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.681 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.681 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.681 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-07-24T22:19:30.681 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-07-24T22:19:30.681 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.681 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.681 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.681 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.681 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.682 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.682 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.682 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.682 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.682 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.682 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.682 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_ENABLED": { 2024-07-24T22:19:30.682 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_ENABLED", 2024-07-24T22:19:30.682 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.682 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.682 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.682 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.683 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.683 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.683 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.683 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.683 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.683 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.683 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.683 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-07-24T22:19:30.683 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-07-24T22:19:30.683 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.683 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.684 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.684 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.684 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.684 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.684 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.684 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.684 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.684 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.684 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.684 INFO:teuthology.orchestra.run.smithi047.stdout: "ENABLE_BROWSABLE_API": { 2024-07-24T22:19:30.684 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ENABLE_BROWSABLE_API", 2024-07-24T22:19:30.684 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.685 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.685 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.685 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.685 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.685 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.685 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.685 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.685 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.685 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.685 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.685 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-07-24T22:19:30.685 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-07-24T22:19:30.686 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.686 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.686 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.686 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.686 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.686 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.686 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.686 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.686 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.686 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.686 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.689 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_NFS": { 2024-07-24T22:19:30.690 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-07-24T22:19:30.690 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.690 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.690 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.690 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.690 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.690 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.690 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.690 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.690 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.690 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.690 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RBD": { 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RGW": { 2024-07-24T22:19:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-07-24T22:19:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.692 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.693 INFO:teuthology.orchestra.run.smithi047.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-07-24T22:19:30.693 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-07-24T22:19:30.693 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.693 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.693 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.693 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.693 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.693 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.693 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.693 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.693 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.693 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.694 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.694 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_PASSWORD": { 2024-07-24T22:19:30.694 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_PASSWORD", 2024-07-24T22:19:30.694 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.694 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.694 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.694 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-07-24T22:19:30.694 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.694 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.694 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.695 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.695 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.695 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.695 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.695 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-07-24T22:19:30.695 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-07-24T22:19:30.695 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.695 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.695 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.695 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.695 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.696 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.696 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.696 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.696 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.696 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.696 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.696 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_URL": { 2024-07-24T22:19:30.696 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_URL", 2024-07-24T22:19:30.696 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.696 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.696 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.696 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.697 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.697 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.697 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.697 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.697 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.697 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.697 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.697 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_USERNAME": { 2024-07-24T22:19:30.697 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_USERNAME", 2024-07-24T22:19:30.697 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.697 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.698 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.698 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-07-24T22:19:30.698 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.698 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.698 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.698 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.698 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.698 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.698 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.698 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-07-24T22:19:30.698 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-07-24T22:19:30.698 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-07-24T22:19:30.699 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-07-24T22:19:30.700 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: "ISSUE_TRACKER_API_KEY": { 2024-07-24T22:19:30.701 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-07-24T22:19:30.702 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.702 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.702 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.702 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.702 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.702 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.702 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.702 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.702 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.702 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.702 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.702 INFO:teuthology.orchestra.run.smithi047.stdout: "MANAGED_BY_CLUSTERS": { 2024-07-24T22:19:30.703 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-07-24T22:19:30.703 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.703 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.703 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.703 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "[]", 2024-07-24T22:19:30.703 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.703 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.703 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.703 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.703 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.703 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.703 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: "MULTICLUSTER_CONFIG": { 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MULTICLUSTER_CONFIG", 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "{}", 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.705 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_HOST": { 2024-07-24T22:19:30.705 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_HOST", 2024-07-24T22:19:30.705 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.705 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.705 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.705 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.705 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.705 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.705 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.705 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.705 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.705 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.705 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.706 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-07-24T22:19:30.706 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-07-24T22:19:30.706 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.706 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.706 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.706 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.706 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.706 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.706 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.706 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.707 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.708 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.708 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.708 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.708 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-07-24T22:19:30.708 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-07-24T22:19:30.708 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.708 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.708 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.708 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.708 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.709 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.710 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.710 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.710 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.710 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.710 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.710 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.710 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-07-24T22:19:30.710 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-07-24T22:19:30.710 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.710 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.710 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.710 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.711 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.711 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.711 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.711 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.711 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.711 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.711 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.711 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-07-24T22:19:30.711 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-07-24T22:19:30.711 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.711 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.711 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.712 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.713 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.713 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.713 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.713 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.713 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.713 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.713 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.713 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.713 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-07-24T22:19:30.713 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-07-24T22:19:30.713 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_ENABLED": { 2024-07-24T22:19:30.714 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_ENABLED", 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-07-24T22:19:30.715 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-07-24T22:19:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-07-24T22:19:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.716 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-07-24T22:19:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-07-24T22:19:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8", 2024-07-24T22:19:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "REST_REQUESTS_TIMEOUT": { 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "45", 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ACCESS_KEY": { 2024-07-24T22:19:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ACCESS_KEY", 2024-07-24T22:19:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.720 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.721 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SECRET_KEY": { 2024-07-24T22:19:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SECRET_KEY", 2024-07-24T22:19:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.722 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SSL_VERIFY": { 2024-07-24T22:19:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SSL_VERIFY", 2024-07-24T22:19:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.723 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "UNSAFE_TLS_v1_2": { 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "UNSAFE_TLS_v1_2", 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.724 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-07-24T22:19:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-07-24T22:19:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.725 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-07-24T22:19:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-07-24T22:19:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-07-24T22:19:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-07-24T22:19:30.727 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "cross_origin_url": { 2024-07-24T22:19:30.728 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cross_origin_url", 2024-07-24T22:19:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.729 INFO:teuthology.orchestra.run.smithi047.stdout: "crt_file": { 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crt_file", 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.730 INFO:teuthology.orchestra.run.smithi047.stdout: "debug": { 2024-07-24T22:19:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "debug", 2024-07-24T22:19:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable/disable debug options", 2024-07-24T22:19:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "jwt_token_ttl": { 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "jwt_token_ttl", 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "28800", 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.734 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.735 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.736 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.737 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.738 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "motd": { 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "motd", 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.739 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "The message of the day", 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect_resolve_ip_addr": { 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "redirect_resolve_ip_addr", 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-07-24T22:19:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-07-24T22:19:30.741 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-07-24T22:19:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.742 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-07-24T22:19:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-07-24T22:19:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8080", 2024-07-24T22:19:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-07-24T22:19:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-07-24T22:19:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.745 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl_server_port": { 2024-07-24T22:19:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl_server_port", 2024-07-24T22:19:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8443", 2024-07-24T22:19:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.746 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-07-24T22:19:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-07-24T22:19:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "redirect", 2024-07-24T22:19:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.747 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect" 2024-07-24T22:19:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-07-24T22:19:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-07-24T22:19:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.748 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "url_prefix": { 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url_prefix", 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.749 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-07-24T22:19:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.750 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_monitoring": { 2024-07-24T22:19:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_monitoring", 2024-07-24T22:19:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "monitor device health metrics", 2024-07-24T22:19:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.751 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.752 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.753 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.754 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.755 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.756 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "mark_out_threshold": { 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mark_out_threshold", 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.757 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2419200", 2024-07-24T22:19:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-07-24T22:19:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_name": { 2024-07-24T22:19:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_name", 2024-07-24T22:19:30.758 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "device_health_metrics", 2024-07-24T22:19:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name of pool in which to store device health metrics", 2024-07-24T22:19:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "retention_period": { 2024-07-24T22:19:30.759 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retention_period", 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15552000", 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain device health metrics", 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_frequency": { 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_frequency", 2024-07-24T22:19:30.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to scrape device health metrics", 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "self_heal": { 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "self_heal", 2024-07-24T22:19:30.761 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-07-24T22:19:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.762 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and check device health", 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.763 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.764 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_threshold": { 2024-07-24T22:19:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_threshold", 2024-07-24T22:19:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7257600", 2024-07-24T22:19:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-07-24T22:19:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.765 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "diskprediction_local", 2024-07-24T22:19:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.766 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.767 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.768 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.769 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.770 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "predict_interval": { 2024-07-24T22:19:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predict_interval", 2024-07-24T22:19:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.771 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "predictor_model": { 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predictor_model", 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.772 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "prophetstor", 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.773 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.774 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "influx", 2024-07-24T22:19:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": false, 2024-07-24T22:19:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "influxdb python module not found", 2024-07-24T22:19:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "batch_size": { 2024-07-24T22:19:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "batch_size", 2024-07-24T22:19:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5000", 2024-07-24T22:19:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.776 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-07-24T22:19:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "database": { 2024-07-24T22:19:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "database", 2024-07-24T22:19:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "ceph", 2024-07-24T22:19:30.777 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-07-24T22:19:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": { 2024-07-24T22:19:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hostname", 2024-07-24T22:19:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.778 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server hostname", 2024-07-24T22:19:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.779 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "30", 2024-07-24T22:19:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "5", 2024-07-24T22:19:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-07-24T22:19:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.780 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.781 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.782 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.783 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.783 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.783 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.783 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.783 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.783 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.783 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.783 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.783 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.783 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.783 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.783 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.784 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "password": { 2024-07-24T22:19:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "password", 2024-07-24T22:19:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "password of InfluxDB server user", 2024-07-24T22:19:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.786 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "port": { 2024-07-24T22:19:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "port", 2024-07-24T22:19:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8086", 2024-07-24T22:19:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server port", 2024-07-24T22:19:30.787 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.788 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "false", 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.789 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-07-24T22:19:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "threads": { 2024-07-24T22:19:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threads", 2024-07-24T22:19:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-07-24T22:19:30.790 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "32", 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "username": { 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "username", 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.791 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "username of InfluxDB server user", 2024-07-24T22:19:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "verify_ssl": { 2024-07-24T22:19:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "verify_ssl", 2024-07-24T22:19:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "true", 2024-07-24T22:19:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.792 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-07-24T22:19:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "insights", 2024-07-24T22:19:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.793 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.794 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.795 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.796 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.797 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.798 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.799 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "iostat", 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.801 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.802 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.803 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.804 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.805 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.806 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "k8sevents", 2024-07-24T22:19:30.807 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_event_retention_days": { 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ceph_event_retention_days", 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Days to hold ceph event information within local cache", 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.808 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "config_check_secs": { 2024-07-24T22:19:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_check_secs", 2024-07-24T22:19:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "10", 2024-07-24T22:19:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.809 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-07-24T22:19:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.810 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.811 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.813 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.814 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.815 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "localpool", 2024-07-24T22:19:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "failure_domain": { 2024-07-24T22:19:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "failure_domain", 2024-07-24T22:19:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "host", 2024-07-24T22:19:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.817 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "failure domain for any created local pool", 2024-07-24T22:19:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-07-24T22:19:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.818 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.820 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.821 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.822 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "min_size": { 2024-07-24T22:19:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_size", 2024-07-24T22:19:30.823 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default min_size for any created local pool", 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "num_rep": { 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "num_rep", 2024-07-24T22:19:30.824 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default replica count for any created local pool", 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_num": { 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_num", 2024-07-24T22:19:30.825 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "128", 2024-07-24T22:19:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default pg_num for any created local pool", 2024-07-24T22:19:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.826 INFO:teuthology.orchestra.run.smithi047.stdout: "prefix": { 2024-07-24T22:19:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prefix", 2024-07-24T22:19:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name prefix for any created local pool", 2024-07-24T22:19:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "subtree": { 2024-07-24T22:19:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "subtree", 2024-07-24T22:19:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "rack", 2024-07-24T22:19:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "CRUSH level for which to create a local pool", 2024-07-24T22:19:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-07-24T22:19:30.829 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mds_autoscaler", 2024-07-24T22:19:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.830 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.831 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.832 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.836 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirroring", 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.837 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.838 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.839 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.840 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.842 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.843 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "nfs", 2024-07-24T22:19:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.844 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.845 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.846 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.847 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.848 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.849 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.850 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.851 INFO:teuthology.orchestra.run.smithi047.stdout: "fail_fs": { 2024-07-24T22:19:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "fail_fs", 2024-07-24T22:19:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-07-24T22:19:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.853 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.854 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.855 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.856 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.857 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator": { 2024-07-24T22:19:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-07-24T22:19:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.858 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-07-24T22:19:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "rook", 2024-07-24T22:19:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "test_orchestrator" 2024-07-24T22:19:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Orchestrator backend", 2024-07-24T22:19:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.859 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_perf_query", 2024-07-24T22:19:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.861 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.862 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.863 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.864 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.865 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.866 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_support", 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.867 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.868 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.869 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.870 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.871 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.872 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.873 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_autoscaler", 2024-07-24T22:19:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.875 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.876 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.878 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.879 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.880 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.881 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "threshold": { 2024-07-24T22:19:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threshold", 2024-07-24T22:19:30.882 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-07-24T22:19:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1.0", 2024-07-24T22:19:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "scaling threshold", 2024-07-24T22:19:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-07-24T22:19:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.883 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "progress", 2024-07-24T22:19:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_pg_recovery_event": { 2024-07-24T22:19:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_pg_recovery_event", 2024-07-24T22:19:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.884 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow the module to show pg recovery progress", 2024-07-24T22:19:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-07-24T22:19:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-07-24T22:19:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.885 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.886 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.887 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.888 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.889 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.890 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.891 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "max_completed_events": { 2024-07-24T22:19:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_completed_events", 2024-07-24T22:19:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "50", 2024-07-24T22:19:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.892 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "number of past completed events to remember", 2024-07-24T22:19:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long the module is going to sleep", 2024-07-24T22:19:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.894 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus", 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.895 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "cache": { 2024-07-24T22:19:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cache", 2024-07-24T22:19:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.896 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "exclude_perf_counters": { 2024-07-24T22:19:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "exclude_perf_counters", 2024-07-24T22:19:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.897 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-07-24T22:19:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-07-24T22:19:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.898 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.899 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.900 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.901 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.902 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.903 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools": { 2024-07-24T22:19:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools", 2024-07-24T22:19:30.904 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools_refresh_interval": { 2024-07-24T22:19:30.905 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-07-24T22:19:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "300", 2024-07-24T22:19:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_interval": { 2024-07-24T22:19:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_interval", 2024-07-24T22:19:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15.0", 2024-07-24T22:19:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.907 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.908 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-07-24T22:19:30.908 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-07-24T22:19:30.908 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.908 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.908 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.908 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-07-24T22:19:30.908 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.908 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.908 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.908 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-07-24T22:19:30.908 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.909 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.909 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.909 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-07-24T22:19:30.909 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-07-24T22:19:30.909 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.909 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "9283", 2024-07-24T22:19:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-07-24T22:19:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.910 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: "stale_cache_strategy": { 2024-07-24T22:19:30.911 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stale_cache_strategy", 2024-07-24T22:19:30.912 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.912 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.912 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.912 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "log", 2024-07-24T22:19:30.912 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.912 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.912 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.912 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.912 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.912 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.912 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "default", 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: "default", 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: "error" 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.913 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.914 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.914 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.914 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-07-24T22:19:30.914 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-07-24T22:19:30.914 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.914 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.914 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.914 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-07-24T22:19:30.914 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-07-24T22:19:30.914 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-07-24T22:19:30.915 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.915 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.915 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.915 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.915 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.915 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-07-24T22:19:30.915 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.915 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.915 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.916 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.916 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.916 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.916 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.916 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.916 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.916 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.916 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.916 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.916 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.916 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.916 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.916 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.917 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.918 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.918 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.918 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.918 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.918 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.918 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.918 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.918 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.918 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.918 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.918 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.919 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.919 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.919 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.919 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.919 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.919 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.919 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.919 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.919 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.919 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.919 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.919 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.919 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_snap_create": { 2024-07-24T22:19:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_snap_create", 2024-07-24T22:19:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.922 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.922 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.922 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.922 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.922 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.922 INFO:teuthology.orchestra.run.smithi047.stdout: "mirror_snapshot_schedule": { 2024-07-24T22:19:30.922 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirror_snapshot_schedule", 2024-07-24T22:19:30.922 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.922 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.922 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.922 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.923 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.923 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.923 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.923 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.923 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.923 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.923 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.923 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.923 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.923 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.923 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.923 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: "trash_purge_schedule": { 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "trash_purge_schedule", 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.924 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.925 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.925 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.925 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.925 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.925 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.925 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.925 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.925 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.925 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.925 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.925 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "restful", 2024-07-24T22:19:30.926 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.926 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.926 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.926 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_auth": { 2024-07-24T22:19:30.926 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_auth", 2024-07-24T22:19:30.926 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.926 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.926 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.926 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.926 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.926 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.926 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.926 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.928 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.929 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.929 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.929 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.929 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.929 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.929 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.929 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.929 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.929 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.929 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.929 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.930 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.930 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.930 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.930 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.930 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.930 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.930 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.930 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.930 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.930 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.930 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.930 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.931 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.931 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.931 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.931 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.931 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.931 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.931 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.931 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.931 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.931 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.931 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.931 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.931 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.932 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.932 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.932 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.932 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.932 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.932 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.932 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.932 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.932 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.932 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.932 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.932 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-07-24T22:19:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-07-24T22:19:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.935 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rgw", 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.936 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.937 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.937 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.937 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.937 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.937 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.937 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.937 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.937 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.937 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.937 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.937 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.937 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.937 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.938 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.938 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.938 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.938 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.938 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.938 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.938 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.938 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.938 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.938 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.938 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.938 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.939 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.940 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.941 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.941 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.941 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.941 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.941 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.941 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.941 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.941 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.941 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.941 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.941 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.941 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.942 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.942 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.942 INFO:teuthology.orchestra.run.smithi047.stdout: "secondary_zone_period_retry_limit": { 2024-07-24T22:19:30.942 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secondary_zone_period_retry_limit", 2024-07-24T22:19:30.942 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.942 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.942 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.942 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:30.942 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.942 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.942 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.943 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-07-24T22:19:30.943 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.943 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.943 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.943 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.943 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.943 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.943 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.943 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.943 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.943 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.943 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rook", 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.944 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.945 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.946 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.946 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.946 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.946 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.946 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.946 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.946 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.946 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.946 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.946 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.946 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.946 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.947 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.948 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.949 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.950 INFO:teuthology.orchestra.run.smithi047.stdout: "storage_class": { 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "storage_class", 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "local", 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "selftest", 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.952 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.953 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.954 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.954 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.954 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.954 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.954 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.954 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.954 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.954 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.954 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.954 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.954 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.954 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.955 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.955 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.955 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.955 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.955 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.955 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.955 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.955 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.955 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.955 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.955 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.955 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.955 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.957 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.957 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.957 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.957 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.957 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.957 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.957 INFO:teuthology.orchestra.run.smithi047.stdout: "roption1": { 2024-07-24T22:19:30.957 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption1", 2024-07-24T22:19:30.957 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.957 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.957 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.957 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.958 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.958 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.958 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.958 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.958 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.958 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.958 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.958 INFO:teuthology.orchestra.run.smithi047.stdout: "roption2": { 2024-07-24T22:19:30.958 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption2", 2024-07-24T22:19:30.958 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.958 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.958 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "xyz", 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption1": { 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption1", 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.959 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption2": { 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption2", 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.960 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption3": { 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption3", 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.962 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.962 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.962 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.962 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.962 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.962 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.962 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.962 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption4": { 2024-07-24T22:19:30.962 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption4", 2024-07-24T22:19:30.962 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.963 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.963 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.963 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.963 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.963 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.963 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.963 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.963 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.963 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.963 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.963 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption5": { 2024-07-24T22:19:30.963 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption5", 2024-07-24T22:19:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.964 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption6": { 2024-07-24T22:19:30.965 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption6", 2024-07-24T22:19:30.965 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.965 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.965 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.965 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.965 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.965 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.965 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.965 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.965 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.965 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.965 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption7": { 2024-07-24T22:19:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption7", 2024-07-24T22:19:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-07-24T22:19:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "42", 2024-07-24T22:19:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.966 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.967 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.967 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.967 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.967 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.967 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.967 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.967 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.967 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.967 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.967 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.967 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.967 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.968 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.968 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.968 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.968 INFO:teuthology.orchestra.run.smithi047.stdout: "testkey": { 2024-07-24T22:19:30.968 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testkey", 2024-07-24T22:19:30.968 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.968 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.968 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.968 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.968 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.968 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.968 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: "testlkey": { 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testlkey", 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.969 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.970 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.970 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.970 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.970 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.970 INFO:teuthology.orchestra.run.smithi047.stdout: "testnewline": { 2024-07-24T22:19:30.970 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testnewline", 2024-07-24T22:19:30.970 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.970 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.970 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.970 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.970 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.970 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smb", 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.971 INFO:teuthology.orchestra.run.smithi047.stdout: "internal_store_backend": { 2024-07-24T22:19:30.972 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "internal_store_backend", 2024-07-24T22:19:30.972 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.972 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.972 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.972 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.972 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.972 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.972 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.972 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-07-24T22:19:30.972 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.972 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.972 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.973 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.973 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.973 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.973 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.973 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.973 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.973 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.973 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.973 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.973 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.973 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.973 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.973 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.974 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.974 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.974 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.974 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.974 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.974 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.974 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.974 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.974 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.974 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.974 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.974 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.975 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.975 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.975 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.975 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.975 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.975 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.975 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.975 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.975 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.975 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.975 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.975 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.976 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.976 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.976 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.976 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.976 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.976 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.976 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.976 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.976 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.976 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.976 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.976 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.976 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.977 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.977 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.977 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.977 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.977 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.977 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.977 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.977 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.977 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.977 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.977 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.977 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.978 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.978 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.978 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.978 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.978 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.978 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.978 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.978 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.978 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.978 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.978 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.979 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.979 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.979 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.979 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.979 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.979 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.979 INFO:teuthology.orchestra.run.smithi047.stdout: "update_orchestration": { 2024-07-24T22:19:30.979 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "update_orchestration", 2024-07-24T22:19:30.979 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.979 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.979 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:30.979 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.980 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.981 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.981 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_m_granularity": { 2024-07-24T22:19:30.981 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_m_granularity", 2024-07-24T22:19:30.981 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.981 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.981 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.981 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.981 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.981 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.981 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.981 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow minute scheduled snapshots", 2024-07-24T22:19:30.981 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.981 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.982 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.982 INFO:teuthology.orchestra.run.smithi047.stdout: "dump_on_update": { 2024-07-24T22:19:30.982 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dump_on_update", 2024-07-24T22:19:30.982 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.982 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.982 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.982 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.982 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.982 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.982 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.982 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "dump database to debug log on update", 2024-07-24T22:19:30.982 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.983 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.983 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.983 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.983 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.983 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.983 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.983 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.983 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.983 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.983 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.983 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.984 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.985 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.985 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.985 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.985 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.985 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.985 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.985 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.985 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.985 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.985 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.986 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.986 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.986 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.986 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.986 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.986 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.986 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.986 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.986 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.986 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.986 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.986 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.986 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.987 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.987 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.987 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.987 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.987 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.987 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.987 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.987 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.987 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.987 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.987 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.987 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stats", 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "status", 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telegraf", 2024-07-24T22:19:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: "address": { 2024-07-24T22:19:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "address", 2024-07-24T22:19:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-07-24T22:19:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15", 2024-07-24T22:19:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.005 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.005 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.005 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.005 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.005 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.005 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.005 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.005 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.005 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.005 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.005 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.005 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.006 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.006 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.006 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.006 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.006 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.006 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.006 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.006 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.006 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.006 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.006 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.006 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.006 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.007 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.007 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.007 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.007 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.007 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.007 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.007 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.007 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.007 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.007 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.007 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.007 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.008 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.008 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.008 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.008 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.008 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.008 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.008 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.008 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.008 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.008 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.008 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.008 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.009 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.009 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.009 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.009 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.009 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.009 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.009 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.009 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.009 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.009 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.009 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.009 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.010 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telemetry", 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_basic": { 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_basic", 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.012 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share basic cluster information (size, version)", 2024-07-24T22:19:31.013 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.013 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.013 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.013 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_crash": { 2024-07-24T22:19:31.013 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_crash", 2024-07-24T22:19:31.013 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.013 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.013 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.013 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.013 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.013 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.013 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.014 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-07-24T22:19:31.014 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.014 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.014 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.014 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_device": { 2024-07-24T22:19:31.014 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_device", 2024-07-24T22:19:31.014 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.014 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.014 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.014 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.014 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.015 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.015 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.015 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-07-24T22:19:31.015 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.015 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.015 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.015 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_ident": { 2024-07-24T22:19:31.015 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_ident", 2024-07-24T22:19:31.015 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.015 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.015 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.015 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.016 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.016 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.016 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.016 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-07-24T22:19:31.016 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.016 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.016 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.016 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_perf": { 2024-07-24T22:19:31.016 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_perf", 2024-07-24T22:19:31.016 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.016 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.016 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share various performance metrics of a cluster", 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "contact": { 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "contact", 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.017 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.018 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.018 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.018 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.018 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.018 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.018 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.018 INFO:teuthology.orchestra.run.smithi047.stdout: "description": { 2024-07-24T22:19:31.018 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "description", 2024-07-24T22:19:31.018 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.018 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.018 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.018 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: "device_url": { 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_url", 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.019 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-07-24T22:19:31.020 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.020 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.020 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.020 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.020 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.020 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.020 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.020 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-07-24T22:19:31.020 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-07-24T22:19:31.020 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.020 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.020 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.021 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "24", 2024-07-24T22:19:31.022 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "8", 2024-07-24T22:19:31.022 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.022 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.022 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.022 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.022 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.022 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.022 INFO:teuthology.orchestra.run.smithi047.stdout: "last_opt_revision": { 2024-07-24T22:19:31.022 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "last_opt_revision", 2024-07-24T22:19:31.022 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.022 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.022 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1", 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard": { 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard", 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.023 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard_description": { 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard_description", 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.024 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.025 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.025 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.025 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.025 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.025 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.025 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.025 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.025 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.025 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.025 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.025 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.025 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.026 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.026 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.026 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.026 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.026 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.026 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.026 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.026 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.026 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.026 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.026 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.026 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.026 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.027 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.027 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.027 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.027 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.027 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.027 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.027 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.027 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.027 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.027 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.027 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.027 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.030 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.030 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.030 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.030 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.030 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.030 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.030 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.030 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.030 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.030 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.030 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.030 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.031 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.031 INFO:teuthology.orchestra.run.smithi047.stdout: "organization": { 2024-07-24T22:19:31.031 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "organization", 2024-07-24T22:19:31.031 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.031 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.031 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.031 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.031 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.031 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.031 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.031 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.031 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.032 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.032 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.032 INFO:teuthology.orchestra.run.smithi047.stdout: "proxy": { 2024-07-24T22:19:31.032 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "proxy", 2024-07-24T22:19:31.032 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.032 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.032 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.032 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.032 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.032 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.032 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.032 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.033 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.033 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.033 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.033 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.033 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.033 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.033 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.033 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.033 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.033 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.033 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.033 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.034 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.034 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.034 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.034 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.034 INFO:teuthology.orchestra.run.smithi047.stdout: "url": { 2024-07-24T22:19:31.034 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url", 2024-07-24T22:19:31.034 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.034 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.034 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.034 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-07-24T22:19:31.034 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.035 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.035 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.035 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.035 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.035 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.035 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.035 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.035 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.035 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "test_orchestrator", 2024-07-24T22:19:31.035 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.036 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.036 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.036 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.036 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.036 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.036 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.036 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.036 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.036 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.036 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.036 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.036 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.036 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.037 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.037 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.037 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.037 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.037 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.037 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.037 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.037 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.037 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.037 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.037 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.037 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.038 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.038 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.038 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.038 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.038 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.038 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.038 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.038 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.038 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.038 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.038 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.039 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.042 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.042 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.042 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.042 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.042 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.042 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.042 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.042 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.042 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-07-24T22:19:31.042 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.043 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.043 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.043 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.043 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.043 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.043 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.043 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.043 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.043 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.043 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.043 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.043 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.043 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.044 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.044 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.044 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.044 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.044 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.044 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.044 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.044 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.044 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.044 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.044 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.044 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.045 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.045 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.045 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.045 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.045 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.045 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.045 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.045 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.045 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.045 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.045 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.046 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.046 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.046 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.046 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.046 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.046 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.046 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.046 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.046 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.046 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.046 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.046 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.046 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.047 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.047 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.047 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.047 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.047 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.047 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.047 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.047 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.047 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.047 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.047 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.047 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.048 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.048 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.048 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.048 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.048 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.048 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.048 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.048 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_clones": { 2024-07-24T22:19:31.048 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_clones", 2024-07-24T22:19:31.048 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.048 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.048 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.049 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4", 2024-07-24T22:19:31.049 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.049 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.049 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.049 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Number of asynchronous cloner threads", 2024-07-24T22:19:31.049 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.049 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.049 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.049 INFO:teuthology.orchestra.run.smithi047.stdout: "periodic_async_work": { 2024-07-24T22:19:31.049 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "periodic_async_work", 2024-07-24T22:19:31.049 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.049 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.050 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.050 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.050 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.050 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.050 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.050 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Periodically check for async work", 2024-07-24T22:19:31.050 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.050 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.050 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.050 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_delay": { 2024-07-24T22:19:31.050 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_delay", 2024-07-24T22:19:31.050 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_no_wait": { 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_no_wait", 2024-07-24T22:19:31.051 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.052 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.053 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.053 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.053 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.053 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.053 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.053 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.053 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.053 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.053 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.053 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.053 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.053 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.054 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix", 2024-07-24T22:19:31.054 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.054 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.054 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.054 INFO:teuthology.orchestra.run.smithi047.stdout: "discovery_interval": { 2024-07-24T22:19:31.054 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "discovery_interval", 2024-07-24T22:19:31.054 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:31.054 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.054 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.054 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "100", 2024-07-24T22:19:31.055 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.055 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.055 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.055 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.055 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.055 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.055 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.055 INFO:teuthology.orchestra.run.smithi047.stdout: "identifier": { 2024-07-24T22:19:31.055 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "identifier", 2024-07-24T22:19:31.056 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.056 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.056 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.056 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.056 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.056 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.056 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.056 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.056 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.056 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.056 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.056 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:31.057 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:31.057 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.057 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.057 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.057 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:31.057 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.057 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.057 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.057 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.057 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.057 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.057 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.058 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.059 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.059 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.059 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.059 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.059 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.059 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.059 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.059 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.059 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.059 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.059 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.060 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.061 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.061 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.061 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.061 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.061 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.061 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.061 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.061 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.061 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.061 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.061 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.061 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.061 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.062 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.062 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.062 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.062 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.062 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.062 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.062 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.062 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.062 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.062 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.062 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.062 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.063 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.063 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.063 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.063 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.063 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.063 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.063 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.063 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.063 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.063 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.063 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_host": { 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_host", 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.064 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.065 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.065 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.065 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.065 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.065 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_port": { 2024-07-24T22:19:31.065 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_port", 2024-07-24T22:19:31.065 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.065 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.065 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.065 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10051", 2024-07-24T22:19:31.065 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.065 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.066 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.066 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.066 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.066 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.066 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.066 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_sender": { 2024-07-24T22:19:31.066 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_sender", 2024-07-24T22:19:31.066 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.066 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.066 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.066 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-07-24T22:19:31.067 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.067 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.067 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.067 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.067 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.067 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.067 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.067 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.067 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.067 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.067 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-07-24T22:19:31.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.068 INFO:teuthology.orchestra.run.smithi047.stdout: "gid": 24146, 2024-07-24T22:19:31.068 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "y", 2024-07-24T22:19:31.068 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr_features": 4540701547738038271, 2024-07-24T22:19:31.068 INFO:teuthology.orchestra.run.smithi047.stdout: "available_modules": [ 2024-07-24T22:19:31.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.068 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "alerts", 2024-07-24T22:19:31.068 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.068 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.068 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.068 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:31.068 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:31.068 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.068 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How frequently to reexamine health status", 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.069 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.070 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.070 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.070 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.070 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.070 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.070 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.070 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.070 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.070 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.070 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.070 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.070 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.070 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.071 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.071 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.071 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.071 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.071 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.071 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.071 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.073 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.073 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.073 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.073 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.073 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.074 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.074 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.074 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.074 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.074 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.074 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.074 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.074 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.074 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.074 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.074 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.074 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.076 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.076 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.076 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.076 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.076 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.076 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.076 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.076 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.076 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.076 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.076 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.076 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.077 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.077 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_destination": { 2024-07-24T22:19:31.077 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_destination", 2024-07-24T22:19:31.077 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.077 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.077 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.077 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.077 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.077 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.077 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.077 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email address to send alerts to", 2024-07-24T22:19:31.078 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.078 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.078 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.078 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_from_name": { 2024-07-24T22:19:31.078 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_from_name", 2024-07-24T22:19:31.078 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.078 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.078 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.078 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "Ceph", 2024-07-24T22:19:31.078 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.079 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.079 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.079 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email From: name", 2024-07-24T22:19:31.079 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.079 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.079 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.079 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_host": { 2024-07-24T22:19:31.079 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_host", 2024-07-24T22:19:31.079 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.079 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.079 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.079 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.080 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.080 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.080 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.080 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP server", 2024-07-24T22:19:31.080 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.080 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.080 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.080 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_password": { 2024-07-24T22:19:31.080 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_password", 2024-07-24T22:19:31.080 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.080 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.080 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Password to authenticate with", 2024-07-24T22:19:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_port": { 2024-07-24T22:19:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_port", 2024-07-24T22:19:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.081 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.082 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.082 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "465", 2024-07-24T22:19:31.082 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.082 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.082 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.082 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP port", 2024-07-24T22:19:31.082 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.082 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.082 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.082 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_sender": { 2024-07-24T22:19:31.082 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_sender", 2024-07-24T22:19:31.082 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.083 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.083 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.083 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.083 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.083 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.083 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.083 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP envelope sender", 2024-07-24T22:19:31.083 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.083 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.083 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.083 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_ssl": { 2024-07-24T22:19:31.083 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_ssl", 2024-07-24T22:19:31.084 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.084 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.084 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.084 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.084 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.084 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.084 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.084 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use SSL to connect to SMTP server", 2024-07-24T22:19:31.084 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.084 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.084 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.084 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_user": { 2024-07-24T22:19:31.085 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_user", 2024-07-24T22:19:31.085 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.085 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.085 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.085 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.085 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.085 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.085 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.085 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "User to authenticate as", 2024-07-24T22:19:31.085 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.085 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.085 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.086 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.086 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.086 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.086 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.086 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.086 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.086 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.086 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.086 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.086 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.086 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.086 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.086 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.087 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.087 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.087 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "balancer", 2024-07-24T22:19:31.087 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.087 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.087 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.087 INFO:teuthology.orchestra.run.smithi047.stdout: "active": { 2024-07-24T22:19:31.087 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "active", 2024-07-24T22:19:31.087 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.087 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.087 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.088 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.088 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.088 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.088 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.088 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically balance PGs across cluster", 2024-07-24T22:19:31.088 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.088 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.088 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.088 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_time": { 2024-07-24T22:19:31.088 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_time", 2024-07-24T22:19:31.088 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.089 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.089 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.089 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0000", 2024-07-24T22:19:31.089 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.089 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.089 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.089 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "beginning time of day to automatically balance", 2024-07-24T22:19:31.089 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-24T22:19:31.089 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.089 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.089 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_weekday": { 2024-07-24T22:19:31.089 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_weekday", 2024-07-24T22:19:31.090 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:31.090 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.090 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.090 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.090 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-07-24T22:19:31.090 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-07-24T22:19:31.090 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.090 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-07-24T22:19:31.090 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-24T22:19:31.090 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.090 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.090 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_max_iterations": { 2024-07-24T22:19:31.091 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_max_iterations", 2024-07-24T22:19:31.091 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:31.091 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.091 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.091 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "25", 2024-07-24T22:19:31.091 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-07-24T22:19:31.091 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "250", 2024-07-24T22:19:31.091 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.091 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-07-24T22:19:31.091 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.091 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.091 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.092 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_metrics": { 2024-07-24T22:19:31.092 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_metrics", 2024-07-24T22:19:31.092 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.092 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.092 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.092 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "pgs,objects,bytes", 2024-07-24T22:19:31.092 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.092 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.092 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.092 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-07-24T22:19:31.092 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-07-24T22:19:31.092 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_step": { 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_step", 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.5", 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0.001", 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "0.999", 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "aggressiveness of optimization", 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-07-24T22:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.094 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.094 INFO:teuthology.orchestra.run.smithi047.stdout: "end_time": { 2024-07-24T22:19:31.094 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_time", 2024-07-24T22:19:31.094 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.094 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.094 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.094 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2359", 2024-07-24T22:19:31.094 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.094 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.094 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.094 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ending time of day to automatically balance", 2024-07-24T22:19:31.094 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-24T22:19:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: "end_weekday": { 2024-07-24T22:19:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_weekday", 2024-07-24T22:19:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-07-24T22:19:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-07-24T22:19:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.096 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.097 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.097 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.097 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.097 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.097 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.097 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.097 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.097 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.097 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.097 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.097 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.097 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.099 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.099 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.099 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.099 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.099 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.099 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.099 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.099 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.099 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.099 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.099 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.099 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.100 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.100 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.100 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.100 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.100 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.100 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.100 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.100 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.100 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.100 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.100 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: "min_score": { 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_score", 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.101 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.102 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.102 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.102 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.102 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.102 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.102 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-07-24T22:19:31.102 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.102 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.102 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.102 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-07-24T22:19:31.102 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-07-24T22:19:31.102 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "upmap", 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: "crush-compat", 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: "none", 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: "read", 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap", 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap-read" 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Balancer mode", 2024-07-24T22:19:31.103 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_ids": { 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_ids", 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-07-24T22:19:31.104 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.105 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.105 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.105 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:31.105 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:31.105 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.105 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.105 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.105 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:31.105 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.105 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.105 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.106 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-07-24T22:19:31.106 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.106 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.106 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.106 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.106 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.106 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.106 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.106 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.106 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.106 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.106 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_deviation": { 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_deviation", 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-07-24T22:19:31.107 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.108 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.108 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "deviation below which no optimization is attempted", 2024-07-24T22:19:31.108 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-07-24T22:19:31.108 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.108 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.108 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_optimizations": { 2024-07-24T22:19:31.108 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_optimizations", 2024-07-24T22:19:31.108 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:31.108 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.108 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.108 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.108 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.109 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.109 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.109 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-07-24T22:19:31.109 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.109 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.109 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.109 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.109 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.109 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm", 2024-07-24T22:19:31.109 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.109 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_down_multiplier": { 2024-07-24T22:19:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_down_multiplier", 2024-07-24T22:19:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-07-24T22:19:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-07-24T22:19:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.111 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.111 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_refresh_rate": { 2024-07-24T22:19:31.111 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_refresh_rate", 2024-07-24T22:19:31.111 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.111 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.111 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.111 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "20", 2024-07-24T22:19:31.111 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.111 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.111 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.111 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-07-24T22:19:31.111 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_starting_port": { 2024-07-24T22:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_starting_port", 2024-07-24T22:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4721", 2024-07-24T22:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.112 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_ptrace": { 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_ptrace", 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.113 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-07-24T22:19:31.114 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-07-24T22:19:31.114 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.114 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.114 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_interval": { 2024-07-24T22:19:31.114 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_interval", 2024-07-24T22:19:31.114 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.114 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.114 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.114 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:31.114 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.114 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to autotune daemon memory", 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_memory_target_ratio": { 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_memory_target_ratio", 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.7", 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.115 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.116 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.116 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-07-24T22:19:31.116 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.116 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.116 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.116 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm_log_destination": { 2024-07-24T22:19:31.116 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm_log_destination", 2024-07-24T22:19:31.116 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.116 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.116 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.116 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.116 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: "file", 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: "file,syslog", 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: "syslog" 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: "cgroups_split": { 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cgroups_split", 2024-07-24T22:19:31.117 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.118 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.118 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.118 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.118 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.118 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.118 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.118 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-07-24T22:19:31.118 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.118 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.118 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.118 INFO:teuthology.orchestra.run.smithi047.stdout: "config_checks_enabled": { 2024-07-24T22:19:31.119 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_checks_enabled", 2024-07-24T22:19:31.119 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.119 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.119 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.119 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.119 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.119 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.119 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.119 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-07-24T22:19:31.119 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.119 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.119 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.120 INFO:teuthology.orchestra.run.smithi047.stdout: "config_dashboard": { 2024-07-24T22:19:31.120 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_dashboard", 2024-07-24T22:19:31.120 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.120 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.120 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.120 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.120 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.120 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.120 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.120 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-07-24T22:19:31.120 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.120 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.120 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_alertmanager": { 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_alertmanager", 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.121 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.122 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_base": { 2024-07-24T22:19:31.122 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_base", 2024-07-24T22:19:31.122 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.122 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.122 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.122 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/ceph", 2024-07-24T22:19:31.122 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.122 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.122 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.122 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Container image name, without the tag", 2024-07-24T22:19:31.122 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.122 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.123 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.123 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_elasticsearch": { 2024-07-24T22:19:31.123 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_elasticsearch", 2024-07-24T22:19:31.123 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.123 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.123 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.123 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-07-24T22:19:31.123 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.123 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.123 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.123 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "elasticsearch container image", 2024-07-24T22:19:31.123 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_grafana": { 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_grafana", 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-07-24T22:19:31.124 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.125 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.125 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.125 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_haproxy": { 2024-07-24T22:19:31.125 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_haproxy", 2024-07-24T22:19:31.125 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.125 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.125 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.125 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-07-24T22:19:31.125 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.125 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.125 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.125 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "HAproxy container image", 2024-07-24T22:19:31.126 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.126 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.126 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.126 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_agent": { 2024-07-24T22:19:31.126 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_agent", 2024-07-24T22:19:31.126 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.126 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.126 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.126 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-07-24T22:19:31.126 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.126 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.126 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.127 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger agent container image", 2024-07-24T22:19:31.127 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.127 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.127 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.127 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_collector": { 2024-07-24T22:19:31.127 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_collector", 2024-07-24T22:19:31.127 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.127 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.127 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.127 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-07-24T22:19:31.127 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.127 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.128 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.128 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger collector container image", 2024-07-24T22:19:31.128 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.128 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.128 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.128 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_query": { 2024-07-24T22:19:31.128 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_query", 2024-07-24T22:19:31.128 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.128 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.128 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.128 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-07-24T22:19:31.128 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.129 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.129 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.129 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger query container image", 2024-07-24T22:19:31.129 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.129 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.129 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.129 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_keepalived": { 2024-07-24T22:19:31.129 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_keepalived", 2024-07-24T22:19:31.129 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.129 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.129 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.129 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-07-24T22:19:31.130 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.130 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.130 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.130 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Keepalived container image", 2024-07-24T22:19:31.130 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.130 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.130 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.130 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_loki": { 2024-07-24T22:19:31.130 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_loki", 2024-07-24T22:19:31.130 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.130 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.131 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.131 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-07-24T22:19:31.131 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.131 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.131 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.131 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Loki container image", 2024-07-24T22:19:31.131 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.131 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.131 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.131 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nginx": { 2024-07-24T22:19:31.132 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nginx", 2024-07-24T22:19:31.132 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.132 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.132 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.132 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-07-24T22:19:31.132 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.132 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.132 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.132 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nginx container image", 2024-07-24T22:19:31.132 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.132 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.132 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.133 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_node_exporter": { 2024-07-24T22:19:31.133 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_node_exporter", 2024-07-24T22:19:31.133 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.133 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.133 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.133 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-07-24T22:19:31.133 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.133 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.133 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.133 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-07-24T22:19:31.133 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.134 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.134 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.134 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nvmeof": { 2024-07-24T22:19:31.134 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nvmeof", 2024-07-24T22:19:31.134 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.134 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.134 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.134 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-07-24T22:19:31.134 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.134 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.134 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nvme-of container image", 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_prometheus": { 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_prometheus", 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.135 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_promtail": { 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_promtail", 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.136 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.137 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Promtail container image", 2024-07-24T22:19:31.137 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.137 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.137 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.137 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba": { 2024-07-24T22:19:31.137 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba", 2024-07-24T22:19:31.137 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.137 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.137 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.137 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-07-24T22:19:31.137 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.137 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.138 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.138 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB container image", 2024-07-24T22:19:31.138 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.138 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.138 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.138 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_snmp_gateway": { 2024-07-24T22:19:31.138 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_snmp_gateway", 2024-07-24T22:19:31.138 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.138 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.138 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.138 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-07-24T22:19:31.139 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.139 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.139 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.139 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SNMP Gateway container image", 2024-07-24T22:19:31.139 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.139 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.139 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.139 INFO:teuthology.orchestra.run.smithi047.stdout: "container_init": { 2024-07-24T22:19:31.139 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_init", 2024-07-24T22:19:31.139 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.139 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.139 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Run podman/docker with `--init`", 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "daemon_cache_timeout": { 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "daemon_cache_timeout", 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.140 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: "default_cephadm_command_timeout": { 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_cephadm_command_timeout", 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.141 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "900", 2024-07-24T22:19:31.142 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.142 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.142 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.142 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-07-24T22:19:31.142 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.142 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.142 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.142 INFO:teuthology.orchestra.run.smithi047.stdout: "default_registry": { 2024-07-24T22:19:31.142 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_registry", 2024-07-24T22:19:31.142 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.142 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.142 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.143 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io", 2024-07-24T22:19:31.143 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.143 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.143 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.143 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-07-24T22:19:31.143 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.143 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.143 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.143 INFO:teuthology.orchestra.run.smithi047.stdout: "device_cache_timeout": { 2024-07-24T22:19:31.143 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_cache_timeout", 2024-07-24T22:19:31.143 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.143 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.144 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.144 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1800", 2024-07-24T22:19:31.144 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.144 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.144 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.144 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache device inventory", 2024-07-24T22:19:31.144 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.144 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.144 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.145 INFO:teuthology.orchestra.run.smithi047.stdout: "device_enhanced_scan": { 2024-07-24T22:19:31.145 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_enhanced_scan", 2024-07-24T22:19:31.145 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.145 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.145 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.145 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.145 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.145 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.145 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.145 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use libstoragemgmt during device scans", 2024-07-24T22:19:31.145 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.145 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.145 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.146 INFO:teuthology.orchestra.run.smithi047.stdout: "facts_cache_timeout": { 2024-07-24T22:19:31.146 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "facts_cache_timeout", 2024-07-24T22:19:31.146 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.146 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.146 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.146 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:31.146 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.146 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.146 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.146 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache host facts data", 2024-07-24T22:19:31.146 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.147 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.147 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.147 INFO:teuthology.orchestra.run.smithi047.stdout: "grafana_dashboards_path": { 2024-07-24T22:19:31.147 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "grafana_dashboards_path", 2024-07-24T22:19:31.147 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.147 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.147 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.147 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-07-24T22:19:31.147 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.147 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.147 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.147 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-07-24T22:19:31.148 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.148 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.148 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.148 INFO:teuthology.orchestra.run.smithi047.stdout: "host_check_interval": { 2024-07-24T22:19:31.148 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "host_check_interval", 2024-07-24T22:19:31.148 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.148 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.148 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.148 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:31.148 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.148 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to perform a host check", 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: "hw_monitoring": { 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hw_monitoring", 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.149 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.150 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.150 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-07-24T22:19:31.150 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.150 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.150 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.150 INFO:teuthology.orchestra.run.smithi047.stdout: "inventory_list_all": { 2024-07-24T22:19:31.150 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "inventory_list_all", 2024-07-24T22:19:31.150 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.150 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.150 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.150 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.151 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.151 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.151 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.151 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-07-24T22:19:31.151 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.151 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.151 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.151 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.151 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.151 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.151 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.151 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.152 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.152 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.152 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.152 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.152 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.152 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.152 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.152 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.152 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.152 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.152 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.152 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.153 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.153 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.153 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.153 INFO:teuthology.orchestra.run.smithi047.stdout: "log_refresh_metadata": { 2024-07-24T22:19:31.153 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_refresh_metadata", 2024-07-24T22:19:31.153 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.153 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.153 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.153 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.153 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.153 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.153 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.154 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-07-24T22:19:31.154 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.154 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.154 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.154 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.154 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.154 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.154 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.154 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.154 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.154 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.154 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.155 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.155 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-07-24T22:19:31.155 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.155 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.155 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.155 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.155 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.155 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.155 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.155 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.155 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.155 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.157 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.157 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.157 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.157 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.157 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.157 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.157 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.157 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.157 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.157 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.157 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.157 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.157 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.158 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf": { 2024-07-24T22:19:31.158 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-07-24T22:19:31.158 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.158 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.158 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.158 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.158 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.158 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.158 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.158 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-07-24T22:19:31.158 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.158 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "*", 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.159 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: "max_count_per_host": { 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_count_per_host", 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of daemons per service per host", 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.160 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: "max_osd_draining_count": { 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_osd_draining_count", 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.161 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.162 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.162 INFO:teuthology.orchestra.run.smithi047.stdout: "migration_current": { 2024-07-24T22:19:31.162 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "migration_current", 2024-07-24T22:19:31.162 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.162 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.162 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.162 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.162 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.162 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.162 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.162 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "internal - do not modify", 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "root", 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.163 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm-package", 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: "root" 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "mode for remote execution of cephadm", 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: "oob_default_addr": { 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "oob_default_addr", 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "169.254.1.1", 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.164 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default address for RedFish API (oob management).", 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: "prometheus_alerts_path": { 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus_alerts_path", 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.166 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.166 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-07-24T22:19:31.166 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.166 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.166 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.166 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_insecure": { 2024-07-24T22:19:31.166 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_insecure", 2024-07-24T22:19:31.166 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.166 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.166 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.166 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_password": { 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_password", 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.167 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_url": { 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_url", 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.168 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.169 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.169 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-07-24T22:19:31.169 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.169 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.169 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.169 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_username": { 2024-07-24T22:19:31.169 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_username", 2024-07-24T22:19:31.169 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.169 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.169 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.169 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.169 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.170 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.170 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.170 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-07-24T22:19:31.170 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.170 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.170 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.170 INFO:teuthology.orchestra.run.smithi047.stdout: "secure_monitoring_stack": { 2024-07-24T22:19:31.170 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secure_monitoring_stack", 2024-07-24T22:19:31.170 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.170 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.170 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.171 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.171 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.171 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.171 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.171 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-07-24T22:19:31.171 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.171 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.171 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.171 INFO:teuthology.orchestra.run.smithi047.stdout: "service_discovery_port": { 2024-07-24T22:19:31.171 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "service_discovery_port", 2024-07-24T22:19:31.171 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.171 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.172 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.172 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8765", 2024-07-24T22:19:31.172 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.172 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.172 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.172 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "cephadm service discovery port", 2024-07-24T22:19:31.172 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.172 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.172 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.172 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.172 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.172 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_config_file": { 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_config_file", 2024-07-24T22:19:31.173 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.174 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.174 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.174 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.174 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.174 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.174 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.174 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-07-24T22:19:31.174 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.174 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.174 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.174 INFO:teuthology.orchestra.run.smithi047.stdout: "use_agent": { 2024-07-24T22:19:31.175 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_agent", 2024-07-24T22:19:31.175 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.175 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.175 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.175 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.175 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.175 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.175 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.175 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-07-24T22:19:31.175 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.175 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.175 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.176 INFO:teuthology.orchestra.run.smithi047.stdout: "use_repo_digest": { 2024-07-24T22:19:31.176 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_repo_digest", 2024-07-24T22:19:31.176 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.176 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.176 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.176 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.176 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.176 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.176 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.176 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-07-24T22:19:31.176 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.176 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.176 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.177 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_failed_host_check": { 2024-07-24T22:19:31.177 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_failed_host_check", 2024-07-24T22:19:31.177 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.177 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.177 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.177 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.177 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.177 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.177 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.177 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if the host check fails", 2024-07-24T22:19:31.177 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.177 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.178 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.178 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_daemons": { 2024-07-24T22:19:31.178 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_daemons", 2024-07-24T22:19:31.178 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.178 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.178 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.178 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.178 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.178 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_hosts": { 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_hosts", 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.179 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crash", 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.180 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.181 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.182 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.182 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.182 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.182 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.182 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.182 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.182 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.182 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.182 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.182 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.182 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.183 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: "retain_interval": { 2024-07-24T22:19:31.185 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retain_interval", 2024-07-24T22:19:31.186 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.186 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.186 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.186 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "31536000", 2024-07-24T22:19:31.186 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.186 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.186 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.186 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain crashes before pruning them", 2024-07-24T22:19:31.186 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.186 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.186 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.186 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.187 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_recent_interval": { 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_recent_interval", 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1209600", 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "time interval in which to warn about recent crashes", 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.188 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dashboard", 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.189 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_HOST": { 2024-07-24T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_HOST", 2024-07-24T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.191 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_ENABLED": { 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_ENABLED", 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.192 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.193 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.194 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.194 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.194 INFO:teuthology.orchestra.run.smithi047.stdout: "ENABLE_BROWSABLE_API": { 2024-07-24T22:19:31.194 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ENABLE_BROWSABLE_API", 2024-07-24T22:19:31.194 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.194 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.194 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.194 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.194 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.194 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.194 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.194 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.195 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.196 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.197 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.197 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.197 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-07-24T22:19:31.197 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-07-24T22:19:31.197 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.197 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.197 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.197 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.197 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.197 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.197 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.197 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.198 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.198 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.198 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.198 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-07-24T22:19:31.198 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-07-24T22:19:31.198 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.198 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.198 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.198 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.198 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.198 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.199 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.199 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.199 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.199 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.199 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.199 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_NFS": { 2024-07-24T22:19:31.199 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-07-24T22:19:31.199 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.199 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.199 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.199 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.199 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RBD": { 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.200 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RGW": { 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.201 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.202 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.202 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.202 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.202 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.202 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.202 INFO:teuthology.orchestra.run.smithi047.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-07-24T22:19:31.202 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-07-24T22:19:31.202 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.202 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.202 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.202 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.202 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_PASSWORD": { 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_PASSWORD", 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-07-24T22:19:31.203 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.204 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_URL": { 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_URL", 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.205 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_USERNAME": { 2024-07-24T22:19:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_USERNAME", 2024-07-24T22:19:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-07-24T22:19:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.207 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.207 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.207 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.207 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.207 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.207 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.207 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-07-24T22:19:31.207 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-07-24T22:19:31.207 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.207 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.207 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.207 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.208 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.209 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.209 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.209 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.209 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.209 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.209 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.209 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.209 INFO:teuthology.orchestra.run.smithi047.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-07-24T22:19:31.209 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-07-24T22:19:31.209 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.209 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: "ISSUE_TRACKER_API_KEY": { 2024-07-24T22:19:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-07-24T22:19:31.210 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.211 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.211 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.211 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.211 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.211 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.211 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.211 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.211 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.211 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.211 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.211 INFO:teuthology.orchestra.run.smithi047.stdout: "MANAGED_BY_CLUSTERS": { 2024-07-24T22:19:31.212 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-07-24T22:19:31.212 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.212 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.212 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.212 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "[]", 2024-07-24T22:19:31.212 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.212 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.212 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.212 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.212 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.212 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.212 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: "MULTICLUSTER_CONFIG": { 2024-07-24T22:19:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MULTICLUSTER_CONFIG", 2024-07-24T22:19:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "{}", 2024-07-24T22:19:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_HOST": { 2024-07-24T22:19:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_HOST", 2024-07-24T22:19:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.214 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.215 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.215 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-07-24T22:19:31.215 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-07-24T22:19:31.215 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.215 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.215 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.215 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.215 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.215 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.215 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.215 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.215 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.217 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.217 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.217 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-07-24T22:19:31.217 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-07-24T22:19:31.217 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.217 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.217 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.217 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.217 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.217 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.217 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.217 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.218 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.218 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.218 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.218 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-07-24T22:19:31.218 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-07-24T22:19:31.218 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.218 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.218 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.218 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.218 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.218 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.219 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.220 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.221 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.222 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_ENABLED": { 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_ENABLED", 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.223 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.224 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.225 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8", 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.226 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.227 INFO:teuthology.orchestra.run.smithi047.stdout: "REST_REQUESTS_TIMEOUT": { 2024-07-24T22:19:31.227 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-07-24T22:19:31.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.227 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.227 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.227 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "45", 2024-07-24T22:19:31.227 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.227 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.227 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.227 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.227 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.228 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.228 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.228 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ACCESS_KEY": { 2024-07-24T22:19:31.228 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ACCESS_KEY", 2024-07-24T22:19:31.228 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.228 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.228 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.228 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.228 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.228 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.228 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.228 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.229 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.230 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.230 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.230 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.230 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SECRET_KEY": { 2024-07-24T22:19:31.230 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SECRET_KEY", 2024-07-24T22:19:31.230 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.230 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.230 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.230 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.230 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.231 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.231 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.231 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.231 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.231 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.231 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.231 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SSL_VERIFY": { 2024-07-24T22:19:31.231 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SSL_VERIFY", 2024-07-24T22:19:31.231 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.231 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.231 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.231 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "UNSAFE_TLS_v1_2": { 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "UNSAFE_TLS_v1_2", 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.232 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.233 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-07-24T22:19:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-07-24T22:19:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:31.236 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.236 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.236 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.236 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.236 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.236 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.236 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.236 INFO:teuthology.orchestra.run.smithi047.stdout: "cross_origin_url": { 2024-07-24T22:19:31.236 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cross_origin_url", 2024-07-24T22:19:31.236 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.236 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.236 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.237 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.237 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.237 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.237 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.237 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.237 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.237 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.237 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.237 INFO:teuthology.orchestra.run.smithi047.stdout: "crt_file": { 2024-07-24T22:19:31.237 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crt_file", 2024-07-24T22:19:31.237 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.237 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.238 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.238 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.238 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.238 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.238 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.238 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.238 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.238 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.238 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.238 INFO:teuthology.orchestra.run.smithi047.stdout: "debug": { 2024-07-24T22:19:31.238 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "debug", 2024-07-24T22:19:31.238 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.239 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.239 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.239 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.239 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.239 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.239 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.239 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable/disable debug options", 2024-07-24T22:19:31.239 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.239 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.239 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.239 INFO:teuthology.orchestra.run.smithi047.stdout: "jwt_token_ttl": { 2024-07-24T22:19:31.239 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "jwt_token_ttl", 2024-07-24T22:19:31.240 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.240 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.240 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.240 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "28800", 2024-07-24T22:19:31.240 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.240 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.240 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.240 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.240 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.240 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.240 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.240 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-07-24T22:19:31.241 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-07-24T22:19:31.241 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.241 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.241 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.241 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.241 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.241 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.241 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.241 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.241 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.241 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.241 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.242 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.242 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.242 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.242 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.242 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.242 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.242 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.242 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.242 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.242 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.242 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.242 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.242 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.243 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.244 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.245 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.245 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.245 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.245 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.245 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.245 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.245 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.245 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.245 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.245 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.245 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.245 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.245 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.247 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.247 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.247 INFO:teuthology.orchestra.run.smithi047.stdout: "motd": { 2024-07-24T22:19:31.247 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "motd", 2024-07-24T22:19:31.247 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.247 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.247 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.247 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.247 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.247 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.247 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.247 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "The message of the day", 2024-07-24T22:19:31.248 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.248 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.248 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.248 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect_resolve_ip_addr": { 2024-07-24T22:19:31.248 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "redirect_resolve_ip_addr", 2024-07-24T22:19:31.248 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.248 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.248 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.248 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.248 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.248 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.248 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.250 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.250 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.250 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.250 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.250 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-07-24T22:19:31.250 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-07-24T22:19:31.250 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.250 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.250 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.250 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8080", 2024-07-24T22:19:31.250 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.250 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.251 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.251 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.251 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.251 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.251 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.251 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.251 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.251 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.251 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.251 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.251 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.252 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.252 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.252 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.252 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.252 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.252 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.252 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.252 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-07-24T22:19:31.252 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-07-24T22:19:31.252 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.252 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl_server_port": { 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl_server_port", 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.253 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8443", 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.254 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "redirect", 2024-07-24T22:19:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect" 2024-07-24T22:19:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi047.stdout: "url_prefix": { 2024-07-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url_prefix", 2024-07-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.257 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.258 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.258 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.258 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-07-24T22:19:31.258 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.258 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.258 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.258 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_monitoring": { 2024-07-24T22:19:31.258 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_monitoring", 2024-07-24T22:19:31.258 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.258 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.259 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.259 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.259 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.259 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.259 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.259 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "monitor device health metrics", 2024-07-24T22:19:31.259 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.259 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.259 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.259 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.259 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.259 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.260 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.260 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.260 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.260 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.260 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.260 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.260 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.260 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.260 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.260 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.260 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.260 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.261 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.261 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.261 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.261 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.261 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.261 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.261 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.261 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.261 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.261 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.261 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.261 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.262 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.262 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.262 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.262 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.262 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.262 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.262 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.262 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.262 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.262 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.262 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.262 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.263 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.263 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.263 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.263 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.263 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.263 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.263 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.263 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.263 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.263 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.263 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.263 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.263 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.264 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "mark_out_threshold": { 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mark_out_threshold", 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2419200", 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.265 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.266 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_name": { 2024-07-24T22:19:31.266 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_name", 2024-07-24T22:19:31.266 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.266 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.266 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.266 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "device_health_metrics", 2024-07-24T22:19:31.266 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.266 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.266 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.266 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name of pool in which to store device health metrics", 2024-07-24T22:19:31.266 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.266 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.267 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.267 INFO:teuthology.orchestra.run.smithi047.stdout: "retention_period": { 2024-07-24T22:19:31.267 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retention_period", 2024-07-24T22:19:31.267 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.267 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.267 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.267 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15552000", 2024-07-24T22:19:31.267 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.267 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain device health metrics", 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_frequency": { 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_frequency", 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.268 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.269 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.269 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to scrape device health metrics", 2024-07-24T22:19:31.269 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.269 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.269 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.269 INFO:teuthology.orchestra.run.smithi047.stdout: "self_heal": { 2024-07-24T22:19:31.269 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "self_heal", 2024-07-24T22:19:31.269 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.269 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.269 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.269 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.270 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.270 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.270 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.270 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-07-24T22:19:31.270 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.270 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.270 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.270 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:31.270 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:31.270 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.270 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.270 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and check device health", 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.271 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.272 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.272 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.272 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.272 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.272 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.272 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.272 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.272 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_threshold": { 2024-07-24T22:19:31.272 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_threshold", 2024-07-24T22:19:31.272 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.272 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.272 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7257600", 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "diskprediction_local", 2024-07-24T22:19:31.273 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.274 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.274 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.274 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.274 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.274 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.274 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.274 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.274 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.274 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.274 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.274 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.275 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.275 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.275 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.275 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.275 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.275 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.275 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.275 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.275 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.275 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.275 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.276 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.276 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.276 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.276 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.276 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.276 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.278 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.278 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.278 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.278 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.278 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.278 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.278 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.278 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.278 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.278 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.279 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.279 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.279 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.279 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.279 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.279 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.279 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.279 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.279 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.279 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.279 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.280 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.280 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.280 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.280 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.280 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.280 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.280 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.280 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.280 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.280 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.280 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.280 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.281 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.281 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.281 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.281 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.281 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.281 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.281 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.281 INFO:teuthology.orchestra.run.smithi047.stdout: "predict_interval": { 2024-07-24T22:19:31.281 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predict_interval", 2024-07-24T22:19:31.281 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.281 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.281 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: "predictor_model": { 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predictor_model", 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.282 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.283 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "prophetstor", 2024-07-24T22:19:31.283 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.283 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.283 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.283 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.283 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.283 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.283 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.283 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:31.283 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.284 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "influx", 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": false, 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "influxdb python module not found", 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: "batch_size": { 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "batch_size", 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5000", 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.286 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: "database": { 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "database", 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "ceph", 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.287 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": { 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hostname", 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.288 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server hostname", 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "30", 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "5", 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.289 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.290 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-07-24T22:19:31.290 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.290 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.290 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.290 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.290 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.290 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.290 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.290 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.290 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.290 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.291 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.292 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.292 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.292 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.292 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.292 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.292 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.292 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.292 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.292 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.292 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.292 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.292 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.293 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.294 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.294 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.294 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.294 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.294 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.294 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.294 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.294 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.294 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.294 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.294 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.294 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: "password": { 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "password", 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.295 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "password of InfluxDB server user", 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "port": { 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "port", 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8086", 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.296 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.297 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.297 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server port", 2024-07-24T22:19:31.297 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.297 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.297 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.297 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.297 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.297 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.297 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.297 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.297 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.297 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.298 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.298 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.298 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.298 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.298 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.298 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.298 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-07-24T22:19:31.298 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-07-24T22:19:31.298 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.298 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.298 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.298 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "false", 2024-07-24T22:19:31.299 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.299 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.299 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.299 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-07-24T22:19:31.299 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.299 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.299 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.299 INFO:teuthology.orchestra.run.smithi047.stdout: "threads": { 2024-07-24T22:19:31.299 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threads", 2024-07-24T22:19:31.299 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.299 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.299 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.300 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:31.300 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-07-24T22:19:31.300 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "32", 2024-07-24T22:19:31.300 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.300 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-07-24T22:19:31.300 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.300 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.300 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.300 INFO:teuthology.orchestra.run.smithi047.stdout: "username": { 2024-07-24T22:19:31.300 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "username", 2024-07-24T22:19:31.300 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.300 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.301 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.301 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.301 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.301 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.301 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.301 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "username of InfluxDB server user", 2024-07-24T22:19:31.301 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.301 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.301 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.301 INFO:teuthology.orchestra.run.smithi047.stdout: "verify_ssl": { 2024-07-24T22:19:31.301 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "verify_ssl", 2024-07-24T22:19:31.301 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.302 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.302 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.302 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "true", 2024-07-24T22:19:31.302 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.302 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.302 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.302 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-07-24T22:19:31.302 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.302 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.302 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.302 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.302 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "insights", 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.303 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.304 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.305 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.306 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.306 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.306 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.306 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.306 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.306 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.306 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.306 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.306 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.306 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.306 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.306 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.306 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.307 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.308 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.308 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.308 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.308 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.308 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.308 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.308 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.308 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.308 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.308 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.308 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.309 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.309 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.309 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.309 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.309 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.309 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.309 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.309 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.309 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.309 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "iostat", 2024-07-24T22:19:31.309 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.310 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.310 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.310 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.310 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.310 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.310 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.310 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.310 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.310 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.310 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.310 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.310 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.310 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.311 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.311 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.311 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.311 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.311 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.311 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.311 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.311 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.311 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.311 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.311 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.311 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.312 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.312 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.312 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.312 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.312 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.312 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.312 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.312 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.312 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.312 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.312 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.312 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.313 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.313 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.313 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.313 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.313 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.313 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.313 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.313 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.313 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.313 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.313 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.313 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.313 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.314 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.314 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.314 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.314 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.314 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.314 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.314 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.314 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.314 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.314 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.314 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.315 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "k8sevents", 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.317 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.317 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_event_retention_days": { 2024-07-24T22:19:31.317 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ceph_event_retention_days", 2024-07-24T22:19:31.317 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.317 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.317 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.317 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-07-24T22:19:31.317 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.317 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.317 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.317 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Days to hold ceph event information within local cache", 2024-07-24T22:19:31.317 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.317 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: "config_check_secs": { 2024-07-24T22:19:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_check_secs", 2024-07-24T22:19:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "10", 2024-07-24T22:19:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-07-24T22:19:31.318 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.319 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.319 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.319 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.319 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.319 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.319 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.319 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.319 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.319 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.319 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.319 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.319 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.320 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.321 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.322 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.322 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.322 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.322 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.322 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.322 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.322 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.322 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.322 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.322 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.322 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.322 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.323 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.325 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.325 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.325 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.325 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.325 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.325 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.325 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.325 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.325 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "localpool", 2024-07-24T22:19:31.325 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.325 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.326 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.326 INFO:teuthology.orchestra.run.smithi047.stdout: "failure_domain": { 2024-07-24T22:19:31.326 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "failure_domain", 2024-07-24T22:19:31.326 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.326 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.326 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.326 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "host", 2024-07-24T22:19:31.326 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.326 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.326 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.326 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "failure domain for any created local pool", 2024-07-24T22:19:31.326 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-07-24T22:19:31.327 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.327 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.327 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.327 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.327 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.327 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.327 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.327 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.327 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.327 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.327 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.327 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.328 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.328 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.328 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.328 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.328 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.328 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.328 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.328 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.328 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.328 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.328 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.328 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.329 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.329 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.329 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.329 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.329 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.329 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.329 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.329 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.329 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.329 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.329 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.329 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.331 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.331 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.331 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.331 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.331 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.331 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.331 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.331 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.331 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.331 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.331 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.331 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "min_size": { 2024-07-24T22:19:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_size", 2024-07-24T22:19:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default min_size for any created local pool", 2024-07-24T22:19:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-07-24T22:19:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "num_rep": { 2024-07-24T22:19:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "num_rep", 2024-07-24T22:19:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default replica count for any created local pool", 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_num": { 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_num", 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "128", 2024-07-24T22:19:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default pg_num for any created local pool", 2024-07-24T22:19:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "prefix": { 2024-07-24T22:19:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prefix", 2024-07-24T22:19:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name prefix for any created local pool", 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.336 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: "subtree": { 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "subtree", 2024-07-24T22:19:31.337 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.338 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.338 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.338 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "rack", 2024-07-24T22:19:31.338 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.338 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.338 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.338 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "CRUSH level for which to create a local pool", 2024-07-24T22:19:31.338 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-07-24T22:19:31.338 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.338 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.338 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.338 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.339 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mds_autoscaler", 2024-07-24T22:19:31.339 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.339 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.339 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.339 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.339 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.339 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.339 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.339 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.339 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.339 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.339 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.340 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.340 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.340 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.340 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.340 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.340 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.340 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.340 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.340 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.340 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.340 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.340 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.341 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.341 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.341 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.341 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.341 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.341 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.341 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.341 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.341 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.341 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.341 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.341 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.342 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.342 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.342 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.342 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.342 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.342 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.342 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.342 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.342 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.342 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.342 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.342 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.343 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.344 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.344 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.344 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.344 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.344 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.344 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.344 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.344 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.344 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.344 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.344 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.344 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.345 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.345 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.345 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.345 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.345 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.345 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.345 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.345 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.345 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.345 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.345 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.345 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.346 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirroring", 2024-07-24T22:19:31.346 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.346 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.346 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.346 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.346 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.346 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.346 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.346 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.346 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.346 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.347 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.347 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.347 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.347 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.347 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.347 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.347 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.347 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.347 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.347 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.347 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.347 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.347 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.348 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.348 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.348 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.348 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.348 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.348 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.348 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.348 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.348 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.348 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.348 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.348 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.349 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.350 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.350 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.350 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.350 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.350 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.350 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.350 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.350 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.350 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.350 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.350 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.350 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.351 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.352 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "nfs", 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.353 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.354 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.354 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.354 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.354 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.354 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.354 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.354 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.354 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.354 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.354 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.354 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.354 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.355 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.355 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.355 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.355 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.355 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.355 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.355 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.355 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.355 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.355 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.355 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.356 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.356 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.356 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.356 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.356 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.356 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.356 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.356 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.356 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.356 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.356 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.356 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.356 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.357 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.357 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.357 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.357 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.357 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.357 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.357 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.357 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.357 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.357 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.357 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.357 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.358 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.358 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.358 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.358 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.358 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.358 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.358 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.358 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.358 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.358 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.358 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.358 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.359 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.359 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.359 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.359 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.359 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.359 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.359 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.359 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.359 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.359 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.359 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-07-24T22:19:31.360 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.360 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.360 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.360 INFO:teuthology.orchestra.run.smithi047.stdout: "fail_fs": { 2024-07-24T22:19:31.360 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "fail_fs", 2024-07-24T22:19:31.360 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.360 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.360 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.360 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.360 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.360 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.360 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.361 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-07-24T22:19:31.361 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.361 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.361 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.361 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.361 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.361 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.361 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.361 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.361 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.361 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.361 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.362 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.362 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.362 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.362 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.362 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.362 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.362 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.362 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.362 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.362 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.362 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.362 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.363 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.363 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.363 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.363 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.363 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.363 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.363 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.363 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.363 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.363 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.364 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.364 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.364 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.364 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.364 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.364 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.364 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.364 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.364 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.364 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.365 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.365 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.365 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.365 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.365 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.365 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.365 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.365 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.365 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.365 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.365 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.365 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.365 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.366 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.366 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.366 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.366 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.366 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.366 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.366 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.366 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.366 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.366 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.366 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator": { 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-07-24T22:19:31.367 INFO:teuthology.orchestra.run.smithi047.stdout: "rook", 2024-07-24T22:19:31.368 INFO:teuthology.orchestra.run.smithi047.stdout: "test_orchestrator" 2024-07-24T22:19:31.368 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.368 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Orchestrator backend", 2024-07-24T22:19:31.368 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.368 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.368 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.368 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.368 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.368 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.368 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.368 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.368 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.369 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.369 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.369 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.369 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.369 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.369 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.369 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.369 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.369 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.369 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_perf_query", 2024-07-24T22:19:31.370 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.370 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.370 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.370 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.370 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.370 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.370 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.370 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.370 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.370 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.370 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.370 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.370 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.371 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.372 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.372 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.372 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.372 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.372 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.372 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.372 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.372 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.372 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.372 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.372 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.372 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.373 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.374 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.375 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_support", 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.376 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.377 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.379 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.379 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.379 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.379 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.379 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.379 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.379 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.379 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.379 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.379 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.379 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.379 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.380 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.380 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.380 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.380 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.380 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.380 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.380 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.380 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.380 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.380 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.380 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.380 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.382 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.382 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.382 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.382 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.382 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.382 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.382 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.382 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.382 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.382 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.382 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.382 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.382 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_autoscaler", 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.383 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.384 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.384 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.384 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.384 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.384 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.384 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.384 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.384 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.384 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.384 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.384 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.384 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.384 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.385 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.385 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.385 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.385 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.385 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.385 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.385 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.385 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.385 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.385 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.385 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.385 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.386 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.386 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.386 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.386 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.386 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.386 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.386 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.386 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.386 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.386 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.386 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.386 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.387 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.388 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.388 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.388 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.388 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.388 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.388 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.388 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.388 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.388 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.388 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.388 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:31.388 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:31.389 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.389 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.389 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.389 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:31.389 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.389 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.389 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.389 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.389 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.389 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.389 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.389 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.390 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.390 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.390 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.390 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.390 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.390 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.390 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.390 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.390 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.390 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.390 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.390 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.391 INFO:teuthology.orchestra.run.smithi047.stdout: "threshold": { 2024-07-24T22:19:31.391 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threshold", 2024-07-24T22:19:31.391 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.391 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.391 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.391 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-07-24T22:19:31.391 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1.0", 2024-07-24T22:19:31.391 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.391 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.391 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "scaling threshold", 2024-07-24T22:19:31.391 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-07-24T22:19:31.391 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.391 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "progress", 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_pg_recovery_event": { 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_pg_recovery_event", 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.392 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.393 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.393 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.393 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.393 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow the module to show pg recovery progress", 2024-07-24T22:19:31.393 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.393 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.393 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.393 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-07-24T22:19:31.393 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-07-24T22:19:31.393 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.393 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.393 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.394 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.394 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.394 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.394 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.394 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.394 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.394 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.394 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.394 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.394 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.394 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.395 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.396 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.396 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.396 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.396 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.396 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.396 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.396 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.396 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.396 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.396 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.396 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.396 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.397 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.397 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.397 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.397 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.397 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.397 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.397 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.397 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.397 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.397 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.397 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.398 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.398 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.398 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.398 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.398 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.398 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.398 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.398 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.398 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.398 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.398 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.398 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.398 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.399 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.399 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.399 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.399 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.399 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.399 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.399 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.399 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.399 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.399 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.399 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.399 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.400 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.400 INFO:teuthology.orchestra.run.smithi047.stdout: "max_completed_events": { 2024-07-24T22:19:31.400 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_completed_events", 2024-07-24T22:19:31.400 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.400 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.400 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.400 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "50", 2024-07-24T22:19:31.400 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.400 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.400 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.400 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "number of past completed events to remember", 2024-07-24T22:19:31.400 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long the module is going to sleep", 2024-07-24T22:19:31.401 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.402 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.402 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.402 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.402 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.402 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.402 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.402 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.402 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.402 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.402 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.402 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus", 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: "cache": { 2024-07-24T22:19:31.403 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cache", 2024-07-24T22:19:31.404 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.404 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.404 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.404 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.404 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.404 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.404 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.404 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.404 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.404 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.404 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.404 INFO:teuthology.orchestra.run.smithi047.stdout: "exclude_perf_counters": { 2024-07-24T22:19:31.405 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "exclude_perf_counters", 2024-07-24T22:19:31.405 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.405 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.405 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.405 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.405 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.405 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.405 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.405 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-07-24T22:19:31.405 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-07-24T22:19:31.405 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.405 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.406 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.406 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.406 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.406 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.406 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.406 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.406 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.406 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.406 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.406 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.406 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.406 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.406 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.407 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.407 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.407 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.407 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.407 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.407 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.407 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.407 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.407 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.407 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.407 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.407 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.409 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.410 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.410 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.410 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.410 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.410 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.410 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.410 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.410 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.410 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.410 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.411 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.411 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.411 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.411 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools": { 2024-07-24T22:19:31.411 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools", 2024-07-24T22:19:31.411 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.411 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.411 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.411 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.411 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.411 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.411 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools_refresh_interval": { 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "300", 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.412 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.413 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.413 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.413 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.413 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.413 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_interval": { 2024-07-24T22:19:31.413 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_interval", 2024-07-24T22:19:31.413 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.413 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.413 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.413 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15.0", 2024-07-24T22:19:31.413 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.413 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.414 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.414 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.414 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.414 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.414 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.414 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-07-24T22:19:31.414 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-07-24T22:19:31.414 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.414 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.414 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.414 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-07-24T22:19:31.414 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.415 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.415 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.415 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-07-24T22:19:31.415 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.415 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.415 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.415 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-07-24T22:19:31.415 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-07-24T22:19:31.415 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.415 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.415 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.415 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "9283", 2024-07-24T22:19:31.416 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.416 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.416 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.416 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-07-24T22:19:31.416 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.416 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.416 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.416 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.416 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.416 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.416 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.416 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: "stale_cache_strategy": { 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stale_cache_strategy", 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.418 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "log", 2024-07-24T22:19:31.418 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.418 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.418 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.418 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.418 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.418 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.418 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.418 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-07-24T22:19:31.418 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-07-24T22:19:31.418 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.418 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.419 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.419 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "default", 2024-07-24T22:19:31.419 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.419 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.419 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.419 INFO:teuthology.orchestra.run.smithi047.stdout: "default", 2024-07-24T22:19:31.419 INFO:teuthology.orchestra.run.smithi047.stdout: "error" 2024-07-24T22:19:31.419 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.419 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.419 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.420 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.420 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.420 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-07-24T22:19:31.420 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-07-24T22:19:31.420 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.421 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.421 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.421 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-07-24T22:19:31.421 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-07-24T22:19:31.421 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-07-24T22:19:31.421 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.422 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.422 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.422 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.422 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.423 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-07-24T22:19:31.423 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.423 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.423 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.423 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.423 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.424 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.424 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.424 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.424 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.424 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.424 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.424 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.425 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.425 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.425 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.425 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.425 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.425 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.425 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.426 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.426 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.426 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.426 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.426 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.426 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.427 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.427 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.427 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.427 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.427 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.427 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.427 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.428 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.428 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.428 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.428 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.428 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.428 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.429 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.429 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.429 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.429 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.429 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.429 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.429 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.430 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.430 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.430 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.430 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.430 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.430 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.430 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.431 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.431 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.431 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.431 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.431 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.431 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.431 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.432 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.432 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.432 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.432 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.432 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.432 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.432 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.432 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.433 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.433 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.433 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_snap_create": { 2024-07-24T22:19:31.433 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_snap_create", 2024-07-24T22:19:31.433 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.433 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.434 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.434 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.434 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.434 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.434 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.434 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.434 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.434 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.434 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.435 INFO:teuthology.orchestra.run.smithi047.stdout: "mirror_snapshot_schedule": { 2024-07-24T22:19:31.435 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirror_snapshot_schedule", 2024-07-24T22:19:31.435 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.435 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.435 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.435 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.435 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.435 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.435 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.436 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.436 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.436 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.436 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.436 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.436 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.436 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.436 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.436 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.436 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.436 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.436 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.437 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.437 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.437 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.437 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.437 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.437 INFO:teuthology.orchestra.run.smithi047.stdout: "trash_purge_schedule": { 2024-07-24T22:19:31.437 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "trash_purge_schedule", 2024-07-24T22:19:31.437 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.438 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.438 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.438 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.438 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.438 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.438 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.438 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.438 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.438 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.438 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.438 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.438 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "restful", 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_auth": { 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_auth", 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.439 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.440 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.440 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.440 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.440 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.440 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.440 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-07-24T22:19:31.440 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-07-24T22:19:31.440 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.440 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.440 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.440 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.440 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.441 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.441 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.441 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.441 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.441 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.441 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.441 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.441 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.441 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.441 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.441 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.442 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.442 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.442 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.442 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.442 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.442 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.442 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.442 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.442 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.442 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.442 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.442 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.443 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.444 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.445 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.446 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.446 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.446 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.446 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.446 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.446 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.446 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.446 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.446 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.446 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.446 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.446 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.447 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.448 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.450 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rgw", 2024-07-24T22:19:31.450 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.450 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.450 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.450 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.450 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.450 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.450 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.450 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.450 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.450 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.451 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.451 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.451 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.451 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.451 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.451 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.451 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.451 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.451 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.451 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.451 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.451 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.451 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.453 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.454 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.454 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.454 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.454 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.454 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.454 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.454 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.454 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.454 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.454 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.454 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.455 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.455 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.455 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.455 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.455 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.455 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.455 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.455 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.455 INFO:teuthology.orchestra.run.smithi047.stdout: "secondary_zone_period_retry_limit": { 2024-07-24T22:19:31.455 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secondary_zone_period_retry_limit", 2024-07-24T22:19:31.455 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.455 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.456 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.456 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:31.456 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.456 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.456 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.456 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-07-24T22:19:31.456 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.456 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.456 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.456 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.456 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.457 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.457 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.457 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.457 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.457 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.457 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.457 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.457 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.457 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.457 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.457 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.457 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.457 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.458 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rook", 2024-07-24T22:19:31.458 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.458 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.458 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.458 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.458 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.458 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.458 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.460 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.461 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.462 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.462 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.462 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.462 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.462 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.462 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.462 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.462 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.462 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.462 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.462 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.462 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.464 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.464 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.464 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.464 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.464 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.464 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.464 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.464 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.464 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.464 INFO:teuthology.orchestra.run.smithi047.stdout: "storage_class": { 2024-07-24T22:19:31.464 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "storage_class", 2024-07-24T22:19:31.464 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.465 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.465 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.465 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "local", 2024-07-24T22:19:31.465 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.465 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.465 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.465 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-07-24T22:19:31.465 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.465 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.465 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.465 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.465 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.466 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "selftest", 2024-07-24T22:19:31.466 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.466 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.466 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.466 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.466 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.466 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.466 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.466 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.466 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.466 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.467 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.467 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.467 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.467 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.467 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.467 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.467 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.467 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.467 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.467 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.467 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.467 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.468 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.468 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.468 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.468 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.468 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.468 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.468 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.468 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.468 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.468 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.468 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.468 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.469 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.470 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.470 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.470 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.470 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.470 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.470 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.470 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.470 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.470 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.470 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.470 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.470 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.471 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.471 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.471 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.471 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.471 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.471 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.471 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.471 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.471 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.471 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.471 INFO:teuthology.orchestra.run.smithi047.stdout: "roption1": { 2024-07-24T22:19:31.471 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption1", 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "roption2": { 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption2", 2024-07-24T22:19:31.472 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "xyz", 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption1": { 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption1", 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.473 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.474 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.474 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.474 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.474 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.474 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.474 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.474 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.474 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.474 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.474 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption2": { 2024-07-24T22:19:31.474 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption2", 2024-07-24T22:19:31.474 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.475 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.475 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.475 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.475 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.475 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.475 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.475 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.475 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.475 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.475 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.476 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption3": { 2024-07-24T22:19:31.476 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption3", 2024-07-24T22:19:31.476 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.476 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.476 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.476 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.476 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.476 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.476 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.476 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.476 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.476 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption4": { 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption4", 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.477 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.478 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.478 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption5": { 2024-07-24T22:19:31.478 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption5", 2024-07-24T22:19:31.478 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.478 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.478 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.478 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.478 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.478 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.478 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.478 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.479 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.479 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.479 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.479 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption6": { 2024-07-24T22:19:31.479 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption6", 2024-07-24T22:19:31.479 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.479 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.479 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.479 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.479 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.479 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.479 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.480 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.480 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.480 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.480 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.480 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption7": { 2024-07-24T22:19:31.480 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption7", 2024-07-24T22:19:31.480 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.480 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.480 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.480 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.480 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-07-24T22:19:31.481 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "42", 2024-07-24T22:19:31.481 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.481 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.481 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.481 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.481 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.481 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.481 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.481 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.481 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.481 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.481 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.482 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.482 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.482 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.482 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.482 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.482 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.482 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.482 INFO:teuthology.orchestra.run.smithi047.stdout: "testkey": { 2024-07-24T22:19:31.482 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testkey", 2024-07-24T22:19:31.482 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.482 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.483 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.483 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.483 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.483 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.483 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.483 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.483 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.483 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.485 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.485 INFO:teuthology.orchestra.run.smithi047.stdout: "testlkey": { 2024-07-24T22:19:31.486 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testlkey", 2024-07-24T22:19:31.486 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.486 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.486 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.486 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.486 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.486 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.486 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.486 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.486 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.486 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.486 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.487 INFO:teuthology.orchestra.run.smithi047.stdout: "testnewline": { 2024-07-24T22:19:31.487 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testnewline", 2024-07-24T22:19:31.487 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.487 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.487 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.487 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.487 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.487 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.487 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.487 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.487 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.488 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.488 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.488 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.488 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.488 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smb", 2024-07-24T22:19:31.488 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.488 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.488 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.488 INFO:teuthology.orchestra.run.smithi047.stdout: "internal_store_backend": { 2024-07-24T22:19:31.488 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "internal_store_backend", 2024-07-24T22:19:31.488 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.489 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.489 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.489 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.489 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.489 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.489 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.489 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-07-24T22:19:31.489 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.489 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.489 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.489 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.489 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.490 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.491 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.493 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.493 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.493 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.493 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.493 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.493 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.493 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.493 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.493 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.493 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.493 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.493 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.493 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.494 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.494 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.494 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.494 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.494 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.494 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.494 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.494 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.494 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.494 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.494 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.495 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "update_orchestration": { 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "update_orchestration", 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-07-24T22:19:31.496 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_m_granularity": { 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_m_granularity", 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.497 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow minute scheduled snapshots", 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: "dump_on_update": { 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dump_on_update", 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.498 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.499 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.499 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.499 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.499 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.499 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.499 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "dump database to debug log on update", 2024-07-24T22:19:31.499 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.499 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.499 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.499 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.499 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.499 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.500 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.501 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.502 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.502 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.502 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.502 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.502 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.502 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.502 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.502 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.502 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.502 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.503 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.503 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.503 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.503 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.503 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.503 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.503 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.503 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.503 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.503 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.503 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.503 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.504 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.504 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.504 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.504 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.504 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.504 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.504 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.504 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.504 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.504 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.504 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.504 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.505 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.505 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.505 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.505 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.505 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.505 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.505 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.505 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.505 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.505 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.505 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.505 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.506 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.506 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.506 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.506 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.506 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stats", 2024-07-24T22:19:31.506 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.506 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.506 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.506 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.506 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.506 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.507 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.507 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.507 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.507 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.507 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.507 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.507 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.507 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.507 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.507 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.507 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.507 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.507 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.508 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.509 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.509 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.509 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.509 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.509 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.509 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.509 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.509 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.509 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.509 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.509 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.509 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.510 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.511 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.511 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.511 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.511 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.511 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.511 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.511 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.511 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.511 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.511 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.511 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.511 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.512 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "status", 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.513 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.514 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.515 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.515 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.515 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.515 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.515 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.515 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.515 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.515 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.515 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.515 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.515 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.515 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.516 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.516 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.516 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.516 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.516 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.516 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.516 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.516 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.516 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.516 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.516 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.516 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.516 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.517 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.517 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.517 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.517 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.517 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.517 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.517 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.517 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.517 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.517 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.517 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.517 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.518 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.518 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.518 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.518 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.518 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.518 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.518 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.518 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.518 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.518 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.518 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.518 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.519 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.519 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.519 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.519 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.519 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.519 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.519 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.519 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.519 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.519 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telegraf", 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "address": { 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "address", 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.520 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15", 2024-07-24T22:19:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telemetry", 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_basic": { 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_basic", 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share basic cluster information (size, version)", 2024-07-24T22:19:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_crash": { 2024-07-24T22:19:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_crash", 2024-07-24T22:19:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_device": { 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_device", 2024-07-24T22:19:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_ident": { 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_ident", 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_perf": { 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_perf", 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share various performance metrics of a cluster", 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "contact": { 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "contact", 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "description": { 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "description", 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "device_url": { 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_url", 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "24", 2024-07-24T22:19:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "8", 2024-07-24T22:19:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "last_opt_revision": { 2024-07-24T22:19:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "last_opt_revision", 2024-07-24T22:19:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1", 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard": { 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard", 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard_description": { 2024-07-24T22:19:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard_description", 2024-07-24T22:19:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "organization": { 2024-07-24T22:19:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "organization", 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "proxy": { 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "proxy", 2024-07-24T22:19:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "url": { 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url", 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-07-24T22:19:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "test_orchestrator", 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-07-24T22:19:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_clones": { 2024-07-24T22:19:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_clones", 2024-07-24T22:19:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4", 2024-07-24T22:19:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Number of asynchronous cloner threads", 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "periodic_async_work": { 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "periodic_async_work", 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Periodically check for async work", 2024-07-24T22:19:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_delay": { 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_delay", 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-07-24T22:19:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_no_wait": { 2024-07-24T22:19:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_no_wait", 2024-07-24T22:19:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-07-24T22:19:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix", 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "discovery_interval": { 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "discovery_interval", 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "100", 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "identifier": { 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "identifier", 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_host": { 2024-07-24T22:19:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_host", 2024-07-24T22:19:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_port": { 2024-07-24T22:19:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_port", 2024-07-24T22:19:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10051", 2024-07-24T22:19:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_sender": { 2024-07-24T22:19:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_sender", 2024-07-24T22:19:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-07-24T22:19:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.582 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.582 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.582 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.582 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.582 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.582 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.582 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.582 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-07-24T22:19:31.582 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.582 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.582 INFO:teuthology.orchestra.run.smithi047.stdout: "modules": [ 2024-07-24T22:19:31.582 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-07-24T22:19:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: "dashboard", 2024-07-24T22:19:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: "iostat", 2024-07-24T22:19:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: "nfs", 2024-07-24T22:19:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: "restful", 2024-07-24T22:19:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: "snap_schedule" 2024-07-24T22:19:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: "available_modules": [ 2024-07-24T22:19:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "alerts", 2024-07-24T22:19:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How frequently to reexamine health status", 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_destination": { 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_destination", 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email address to send alerts to", 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_from_name": { 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_from_name", 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "Ceph", 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email From: name", 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_host": { 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_host", 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP server", 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_password": { 2024-07-24T22:19:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_password", 2024-07-24T22:19:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Password to authenticate with", 2024-07-24T22:19:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_port": { 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_port", 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "465", 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP port", 2024-07-24T22:19:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_sender": { 2024-07-24T22:19:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_sender", 2024-07-24T22:19:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP envelope sender", 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_ssl": { 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_ssl", 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use SSL to connect to SMTP server", 2024-07-24T22:19:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_user": { 2024-07-24T22:19:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_user", 2024-07-24T22:19:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "User to authenticate as", 2024-07-24T22:19:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "balancer", 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "active": { 2024-07-24T22:19:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "active", 2024-07-24T22:19:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically balance PGs across cluster", 2024-07-24T22:19:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_time": { 2024-07-24T22:19:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_time", 2024-07-24T22:19:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0000", 2024-07-24T22:19:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "beginning time of day to automatically balance", 2024-07-24T22:19:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-24T22:19:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_weekday": { 2024-07-24T22:19:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_weekday", 2024-07-24T22:19:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-07-24T22:19:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-07-24T22:19:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-07-24T22:19:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-24T22:19:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_max_iterations": { 2024-07-24T22:19:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_max_iterations", 2024-07-24T22:19:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "25", 2024-07-24T22:19:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-07-24T22:19:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "250", 2024-07-24T22:19:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-07-24T22:19:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_metrics": { 2024-07-24T22:19:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_metrics", 2024-07-24T22:19:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "pgs,objects,bytes", 2024-07-24T22:19:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_step": { 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_step", 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.5", 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0.001", 2024-07-24T22:19:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "0.999", 2024-07-24T22:19:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "aggressiveness of optimization", 2024-07-24T22:19:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-07-24T22:19:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "end_time": { 2024-07-24T22:19:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_time", 2024-07-24T22:19:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2359", 2024-07-24T22:19:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ending time of day to automatically balance", 2024-07-24T22:19:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-24T22:19:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "end_weekday": { 2024-07-24T22:19:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_weekday", 2024-07-24T22:19:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-07-24T22:19:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-07-24T22:19:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-07-24T22:19:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-24T22:19:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "min_score": { 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_score", 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-07-24T22:19:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-07-24T22:19:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "upmap", 2024-07-24T22:19:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "crush-compat", 2024-07-24T22:19:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "none", 2024-07-24T22:19:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "read", 2024-07-24T22:19:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap", 2024-07-24T22:19:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap-read" 2024-07-24T22:19:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Balancer mode", 2024-07-24T22:19:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_ids": { 2024-07-24T22:19:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_ids", 2024-07-24T22:19:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-07-24T22:19:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_deviation": { 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_deviation", 2024-07-24T22:19:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-07-24T22:19:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "deviation below which no optimization is attempted", 2024-07-24T22:19:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-07-24T22:19:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_optimizations": { 2024-07-24T22:19:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_optimizations", 2024-07-24T22:19:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-07-24T22:19:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm", 2024-07-24T22:19:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_down_multiplier": { 2024-07-24T22:19:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_down_multiplier", 2024-07-24T22:19:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-07-24T22:19:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-07-24T22:19:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_refresh_rate": { 2024-07-24T22:19:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_refresh_rate", 2024-07-24T22:19:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "20", 2024-07-24T22:19:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-07-24T22:19:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_starting_port": { 2024-07-24T22:19:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_starting_port", 2024-07-24T22:19:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4721", 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_ptrace": { 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_ptrace", 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-07-24T22:19:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-07-24T22:19:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_interval": { 2024-07-24T22:19:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_interval", 2024-07-24T22:19:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to autotune daemon memory", 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_memory_target_ratio": { 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_memory_target_ratio", 2024-07-24T22:19:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.7", 2024-07-24T22:19:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-07-24T22:19:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm_log_destination": { 2024-07-24T22:19:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm_log_destination", 2024-07-24T22:19:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "file", 2024-07-24T22:19:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "file,syslog", 2024-07-24T22:19:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "syslog" 2024-07-24T22:19:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "cgroups_split": { 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cgroups_split", 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-07-24T22:19:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "config_checks_enabled": { 2024-07-24T22:19:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_checks_enabled", 2024-07-24T22:19:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-07-24T22:19:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "config_dashboard": { 2024-07-24T22:19:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_dashboard", 2024-07-24T22:19:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_alertmanager": { 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_alertmanager", 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-07-24T22:19:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_base": { 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_base", 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/ceph", 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Container image name, without the tag", 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_elasticsearch": { 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_elasticsearch", 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "elasticsearch container image", 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_grafana": { 2024-07-24T22:19:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_grafana", 2024-07-24T22:19:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-07-24T22:19:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-07-24T22:19:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_haproxy": { 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_haproxy", 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "HAproxy container image", 2024-07-24T22:19:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_agent": { 2024-07-24T22:19:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_agent", 2024-07-24T22:19:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-07-24T22:19:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger agent container image", 2024-07-24T22:19:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_collector": { 2024-07-24T22:19:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_collector", 2024-07-24T22:19:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-07-24T22:19:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger collector container image", 2024-07-24T22:19:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_query": { 2024-07-24T22:19:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_query", 2024-07-24T22:19:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-07-24T22:19:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger query container image", 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_keepalived": { 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_keepalived", 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Keepalived container image", 2024-07-24T22:19:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_loki": { 2024-07-24T22:19:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_loki", 2024-07-24T22:19:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-07-24T22:19:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Loki container image", 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nginx": { 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nginx", 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-07-24T22:19:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nginx container image", 2024-07-24T22:19:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_node_exporter": { 2024-07-24T22:19:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_node_exporter", 2024-07-24T22:19:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-07-24T22:19:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-07-24T22:19:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nvmeof": { 2024-07-24T22:19:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nvmeof", 2024-07-24T22:19:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nvme-of container image", 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_prometheus": { 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_prometheus", 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_promtail": { 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_promtail", 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-07-24T22:19:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Promtail container image", 2024-07-24T22:19:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba": { 2024-07-24T22:19:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba", 2024-07-24T22:19:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-07-24T22:19:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB container image", 2024-07-24T22:19:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_snmp_gateway": { 2024-07-24T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_snmp_gateway", 2024-07-24T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-07-24T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SNMP Gateway container image", 2024-07-24T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: "container_init": { 2024-07-24T22:19:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_init", 2024-07-24T22:19:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Run podman/docker with `--init`", 2024-07-24T22:19:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.654 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.654 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.654 INFO:teuthology.orchestra.run.smithi047.stdout: "daemon_cache_timeout": { 2024-07-24T22:19:31.654 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "daemon_cache_timeout", 2024-07-24T22:19:31.654 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.654 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.654 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.654 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:31.654 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.654 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.654 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.655 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-07-24T22:19:31.655 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.655 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.655 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.655 INFO:teuthology.orchestra.run.smithi047.stdout: "default_cephadm_command_timeout": { 2024-07-24T22:19:31.655 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_cephadm_command_timeout", 2024-07-24T22:19:31.655 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.655 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.655 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.655 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "900", 2024-07-24T22:19:31.655 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.656 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.656 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.656 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-07-24T22:19:31.656 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.656 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.656 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.656 INFO:teuthology.orchestra.run.smithi047.stdout: "default_registry": { 2024-07-24T22:19:31.656 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_registry", 2024-07-24T22:19:31.656 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.656 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.656 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.657 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io", 2024-07-24T22:19:31.657 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.657 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.657 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.657 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-07-24T22:19:31.657 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.657 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.657 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.657 INFO:teuthology.orchestra.run.smithi047.stdout: "device_cache_timeout": { 2024-07-24T22:19:31.657 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_cache_timeout", 2024-07-24T22:19:31.657 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.657 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.658 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1800", 2024-07-24T22:19:31.658 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.658 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.658 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.658 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache device inventory", 2024-07-24T22:19:31.658 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.658 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.658 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.658 INFO:teuthology.orchestra.run.smithi047.stdout: "device_enhanced_scan": { 2024-07-24T22:19:31.658 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_enhanced_scan", 2024-07-24T22:19:31.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.659 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.659 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.659 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.659 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.659 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.659 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.659 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use libstoragemgmt during device scans", 2024-07-24T22:19:31.659 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.659 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.659 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.659 INFO:teuthology.orchestra.run.smithi047.stdout: "facts_cache_timeout": { 2024-07-24T22:19:31.659 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "facts_cache_timeout", 2024-07-24T22:19:31.660 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.660 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.660 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.660 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:31.660 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.660 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.660 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.660 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache host facts data", 2024-07-24T22:19:31.660 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.660 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.660 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.660 INFO:teuthology.orchestra.run.smithi047.stdout: "grafana_dashboards_path": { 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "grafana_dashboards_path", 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.661 INFO:teuthology.orchestra.run.smithi047.stdout: "host_check_interval": { 2024-07-24T22:19:31.662 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "host_check_interval", 2024-07-24T22:19:31.662 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.662 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.662 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.662 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:31.662 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.662 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.662 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.662 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to perform a host check", 2024-07-24T22:19:31.662 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.662 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.662 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: "hw_monitoring": { 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hw_monitoring", 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.664 INFO:teuthology.orchestra.run.smithi047.stdout: "inventory_list_all": { 2024-07-24T22:19:31.664 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "inventory_list_all", 2024-07-24T22:19:31.664 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.664 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.664 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.664 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.664 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.664 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.664 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.664 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-07-24T22:19:31.664 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.664 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.664 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.665 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.665 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.665 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.665 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.665 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.665 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.665 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.665 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.665 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.666 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.666 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.666 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.666 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.666 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.666 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.666 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.666 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.666 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.666 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.666 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.666 INFO:teuthology.orchestra.run.smithi047.stdout: "log_refresh_metadata": { 2024-07-24T22:19:31.667 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_refresh_metadata", 2024-07-24T22:19:31.667 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.667 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.667 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.667 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.667 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.667 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.667 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.667 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-07-24T22:19:31.667 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.667 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.667 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.669 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.669 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.669 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.669 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.669 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.669 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.669 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.669 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.669 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.669 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.669 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.669 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.669 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.670 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.670 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.670 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.670 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.670 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.670 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.670 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.670 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.670 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.670 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.670 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.670 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf": { 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.671 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.672 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.672 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.672 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.672 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.672 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-07-24T22:19:31.672 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.672 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.672 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.672 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-07-24T22:19:31.672 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-07-24T22:19:31.672 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.672 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "*", 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: "max_count_per_host": { 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_count_per_host", 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.673 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.674 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.674 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.674 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.674 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.674 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.674 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of daemons per service per host", 2024-07-24T22:19:31.674 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.674 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.674 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.674 INFO:teuthology.orchestra.run.smithi047.stdout: "max_osd_draining_count": { 2024-07-24T22:19:31.674 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_osd_draining_count", 2024-07-24T22:19:31.674 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: "migration_current": { 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "migration_current", 2024-07-24T22:19:31.675 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.676 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.676 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.676 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.676 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.676 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.676 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.676 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "internal - do not modify", 2024-07-24T22:19:31.676 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.676 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.676 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.676 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "root", 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm-package", 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: "root" 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "mode for remote execution of cephadm", 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.677 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.678 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.678 INFO:teuthology.orchestra.run.smithi047.stdout: "oob_default_addr": { 2024-07-24T22:19:31.678 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "oob_default_addr", 2024-07-24T22:19:31.678 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.678 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.678 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.678 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "169.254.1.1", 2024-07-24T22:19:31.678 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.678 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.678 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.678 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default address for RedFish API (oob management).", 2024-07-24T22:19:31.679 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.679 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.679 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.679 INFO:teuthology.orchestra.run.smithi047.stdout: "prometheus_alerts_path": { 2024-07-24T22:19:31.679 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus_alerts_path", 2024-07-24T22:19:31.679 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.679 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.679 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.679 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-07-24T22:19:31.679 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.679 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.679 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.680 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-07-24T22:19:31.680 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.680 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.680 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.680 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_insecure": { 2024-07-24T22:19:31.680 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_insecure", 2024-07-24T22:19:31.680 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.680 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.680 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.680 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.680 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.680 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.681 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.681 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-07-24T22:19:31.681 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.681 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.681 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.681 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_password": { 2024-07-24T22:19:31.681 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_password", 2024-07-24T22:19:31.681 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.681 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.681 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.681 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.682 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.682 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.682 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.682 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-07-24T22:19:31.682 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.682 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.682 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.682 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_url": { 2024-07-24T22:19:31.682 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_url", 2024-07-24T22:19:31.682 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.683 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.683 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.683 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.683 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.683 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.683 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.683 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-07-24T22:19:31.683 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.683 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.683 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.683 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_username": { 2024-07-24T22:19:31.683 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_username", 2024-07-24T22:19:31.684 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.684 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.684 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.684 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.684 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.684 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.684 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.684 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-07-24T22:19:31.684 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.684 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.684 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.685 INFO:teuthology.orchestra.run.smithi047.stdout: "secure_monitoring_stack": { 2024-07-24T22:19:31.685 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secure_monitoring_stack", 2024-07-24T22:19:31.685 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.685 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.685 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.685 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.685 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.685 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.685 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.685 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-07-24T22:19:31.685 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.685 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.685 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.686 INFO:teuthology.orchestra.run.smithi047.stdout: "service_discovery_port": { 2024-07-24T22:19:31.686 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "service_discovery_port", 2024-07-24T22:19:31.686 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.686 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.686 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.686 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8765", 2024-07-24T22:19:31.686 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.686 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.686 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.686 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "cephadm service discovery port", 2024-07-24T22:19:31.686 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.687 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.687 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.687 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.687 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.687 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.687 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.687 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.687 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.687 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.687 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.687 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.687 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.688 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.688 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.688 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.688 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_config_file": { 2024-07-24T22:19:31.689 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_config_file", 2024-07-24T22:19:31.689 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.690 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.690 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.690 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.690 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.690 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.690 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.690 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-07-24T22:19:31.690 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.690 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.690 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.690 INFO:teuthology.orchestra.run.smithi047.stdout: "use_agent": { 2024-07-24T22:19:31.691 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_agent", 2024-07-24T22:19:31.691 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.691 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.691 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.691 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.691 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.691 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.691 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.691 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-07-24T22:19:31.691 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.691 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.691 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.692 INFO:teuthology.orchestra.run.smithi047.stdout: "use_repo_digest": { 2024-07-24T22:19:31.692 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_repo_digest", 2024-07-24T22:19:31.692 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.692 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.692 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.692 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.692 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.692 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.692 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.692 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-07-24T22:19:31.692 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.692 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.693 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.693 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_failed_host_check": { 2024-07-24T22:19:31.693 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_failed_host_check", 2024-07-24T22:19:31.693 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.693 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.693 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.693 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.693 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.693 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.693 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.693 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if the host check fails", 2024-07-24T22:19:31.694 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.694 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.694 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.694 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_daemons": { 2024-07-24T22:19:31.694 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_daemons", 2024-07-24T22:19:31.694 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.694 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.694 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.694 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.694 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.694 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.694 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.695 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-07-24T22:19:31.695 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.695 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.695 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.695 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_hosts": { 2024-07-24T22:19:31.695 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_hosts", 2024-07-24T22:19:31.695 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.695 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.695 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.695 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.695 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crash", 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.696 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.697 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.698 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.698 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.698 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.698 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.698 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.698 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.698 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.698 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.698 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.698 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.698 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.699 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.700 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.700 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.700 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.700 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.700 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.700 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.700 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.700 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.700 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.700 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.700 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.700 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.700 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.701 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.701 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.701 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.701 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.701 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.701 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.701 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.701 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.701 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.701 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.701 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.701 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: "retain_interval": { 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retain_interval", 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "31536000", 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.702 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain crashes before pruning them", 2024-07-24T22:19:31.703 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.703 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.703 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.703 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.703 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.703 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.703 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.703 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.703 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.703 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.703 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.704 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.704 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.704 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.704 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.704 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.704 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_recent_interval": { 2024-07-24T22:19:31.704 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_recent_interval", 2024-07-24T22:19:31.704 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.704 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.704 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.704 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1209600", 2024-07-24T22:19:31.704 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.705 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.705 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.705 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "time interval in which to warn about recent crashes", 2024-07-24T22:19:31.705 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.705 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.705 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.705 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.705 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.705 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dashboard", 2024-07-24T22:19:31.705 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.706 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.707 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.707 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_HOST": { 2024-07-24T22:19:31.707 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_HOST", 2024-07-24T22:19:31.707 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.707 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.707 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.707 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.707 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.707 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.707 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.707 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.707 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.708 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.708 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.708 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-07-24T22:19:31.708 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-07-24T22:19:31.708 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.708 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.708 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.708 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.708 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.708 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.708 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.708 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_ENABLED": { 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_ENABLED", 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.709 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.710 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.710 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.710 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.710 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-07-24T22:19:31.710 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-07-24T22:19:31.710 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.710 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.710 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.710 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.710 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.710 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.710 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.711 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.711 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.711 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.711 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.711 INFO:teuthology.orchestra.run.smithi047.stdout: "ENABLE_BROWSABLE_API": { 2024-07-24T22:19:31.711 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ENABLE_BROWSABLE_API", 2024-07-24T22:19:31.711 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.711 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.711 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.711 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.711 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.711 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.712 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.712 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.712 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.712 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.712 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.712 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-07-24T22:19:31.712 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-07-24T22:19:31.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.712 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.712 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.712 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.712 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.713 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.713 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.713 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.713 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.713 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.713 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.713 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-07-24T22:19:31.713 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-07-24T22:19:31.713 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.713 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.713 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.713 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.714 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.714 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.714 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.714 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.714 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.714 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.714 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.714 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-07-24T22:19:31.714 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-07-24T22:19:31.714 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.714 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.714 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.715 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_NFS": { 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.716 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RBD": { 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.717 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.718 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.718 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.718 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.718 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.718 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.718 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.718 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RGW": { 2024-07-24T22:19:31.718 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-07-24T22:19:31.718 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.718 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.719 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.720 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.720 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.720 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.720 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.720 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.720 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.720 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.720 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.720 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_PASSWORD": { 2024-07-24T22:19:31.720 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_PASSWORD", 2024-07-24T22:19:31.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.721 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.721 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-07-24T22:19:31.721 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.721 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.721 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.721 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.721 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.721 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.721 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.721 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-07-24T22:19:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-07-24T22:19:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.723 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_URL": { 2024-07-24T22:19:31.723 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_URL", 2024-07-24T22:19:31.723 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.723 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.723 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.723 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.723 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.723 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.723 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.723 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.723 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.723 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.723 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.724 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_USERNAME": { 2024-07-24T22:19:31.724 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_USERNAME", 2024-07-24T22:19:31.724 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.724 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.724 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.724 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-07-24T22:19:31.724 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.724 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.724 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.724 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.724 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.724 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.726 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.726 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-07-24T22:19:31.726 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-07-24T22:19:31.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.726 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.726 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.726 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.726 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.726 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.726 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.726 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.727 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.727 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.727 INFO:teuthology.orchestra.run.smithi047.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-07-24T22:19:31.727 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-07-24T22:19:31.727 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.727 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.727 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.727 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.727 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.727 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.727 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: "ISSUE_TRACKER_API_KEY": { 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.728 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: "MANAGED_BY_CLUSTERS": { 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "[]", 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.729 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.730 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.730 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.730 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.730 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.730 INFO:teuthology.orchestra.run.smithi047.stdout: "MULTICLUSTER_CONFIG": { 2024-07-24T22:19:31.730 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MULTICLUSTER_CONFIG", 2024-07-24T22:19:31.730 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.730 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.730 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.730 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "{}", 2024-07-24T22:19:31.730 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_HOST": { 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_HOST", 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.731 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-07-24T22:19:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-07-24T22:19:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.733 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.734 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.734 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.734 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.734 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.734 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.734 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.734 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.734 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-07-24T22:19:31.734 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-07-24T22:19:31.734 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.734 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.735 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.736 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.736 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.736 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.736 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.736 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.736 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.736 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.736 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.736 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.736 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-07-24T22:19:31.736 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-07-24T22:19:31.736 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.737 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.737 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.737 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.737 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.737 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.737 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.737 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.737 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.737 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.737 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.737 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-07-24T22:19:31.737 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-07-24T22:19:31.738 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.738 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.738 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.738 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.738 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.738 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.738 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.738 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.738 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.738 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.738 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.738 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-07-24T22:19:31.739 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-07-24T22:19:31.739 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.739 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.739 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.739 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.739 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.739 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.739 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.739 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.739 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.739 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.739 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_ENABLED": { 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_ENABLED", 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.741 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-07-24T22:19:31.742 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-07-24T22:19:31.742 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.742 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.742 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.742 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-07-24T22:19:31.742 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.742 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.742 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.742 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.742 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.742 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.742 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.743 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-07-24T22:19:31.743 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-07-24T22:19:31.743 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.743 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.743 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.743 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.743 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.743 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.743 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.743 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.743 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.743 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.743 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.744 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-07-24T22:19:31.744 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-07-24T22:19:31.744 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.744 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.744 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.744 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8", 2024-07-24T22:19:31.744 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.744 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.744 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.744 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.744 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.744 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: "REST_REQUESTS_TIMEOUT": { 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "45", 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.745 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.746 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.746 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ACCESS_KEY": { 2024-07-24T22:19:31.746 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ACCESS_KEY", 2024-07-24T22:19:31.746 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.746 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.746 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.746 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.746 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.746 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.746 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.746 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.746 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.747 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.748 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.748 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.748 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SECRET_KEY": { 2024-07-24T22:19:31.748 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SECRET_KEY", 2024-07-24T22:19:31.748 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.748 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.748 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.748 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.748 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.748 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.748 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.748 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SSL_VERIFY": { 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SSL_VERIFY", 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.749 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.750 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.750 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.750 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.750 INFO:teuthology.orchestra.run.smithi047.stdout: "UNSAFE_TLS_v1_2": { 2024-07-24T22:19:31.750 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "UNSAFE_TLS_v1_2", 2024-07-24T22:19:31.750 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.750 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.750 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.750 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.750 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.750 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.750 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.751 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.751 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.751 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.751 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.751 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-07-24T22:19:31.751 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-07-24T22:19:31.751 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.751 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.751 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.751 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.751 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.752 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.752 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.752 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.752 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.752 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.752 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.752 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-07-24T22:19:31.752 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-07-24T22:19:31.752 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.752 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.752 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.752 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.753 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.753 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.753 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.753 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.753 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.753 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.753 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.753 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-07-24T22:19:31.753 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-07-24T22:19:31.753 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.753 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.754 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.754 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:31.754 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.754 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.754 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.754 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.754 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.754 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.754 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.754 INFO:teuthology.orchestra.run.smithi047.stdout: "cross_origin_url": { 2024-07-24T22:19:31.754 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cross_origin_url", 2024-07-24T22:19:31.754 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: "crt_file": { 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crt_file", 2024-07-24T22:19:31.755 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: "debug": { 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "debug", 2024-07-24T22:19:31.756 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable/disable debug options", 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: "jwt_token_ttl": { 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "jwt_token_ttl", 2024-07-24T22:19:31.757 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.758 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.758 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.758 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "28800", 2024-07-24T22:19:31.758 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.758 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.758 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.758 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.758 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.758 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.758 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.758 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-07-24T22:19:31.758 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-07-24T22:19:31.759 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.759 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.759 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.759 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.759 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.759 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.759 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.759 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.759 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.759 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.759 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.759 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.760 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.761 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.761 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.761 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.761 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.761 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.761 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.761 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.761 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.761 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.761 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.761 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.761 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.762 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.762 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.762 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.762 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.762 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.762 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.762 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.762 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.762 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.762 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.762 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.762 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.763 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.763 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.763 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.763 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.763 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.763 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.763 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.763 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.763 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.763 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.763 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.763 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.763 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.764 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.765 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.765 INFO:teuthology.orchestra.run.smithi047.stdout: "motd": { 2024-07-24T22:19:31.765 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "motd", 2024-07-24T22:19:31.765 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.765 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.765 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.765 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.765 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.765 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.765 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.765 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "The message of the day", 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect_resolve_ip_addr": { 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "redirect_resolve_ip_addr", 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.766 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.767 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.767 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.767 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.767 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-07-24T22:19:31.767 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-07-24T22:19:31.767 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.767 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.767 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.767 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-07-24T22:19:31.767 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.767 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.767 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.768 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.768 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.768 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.768 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.768 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-07-24T22:19:31.768 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-07-24T22:19:31.768 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.768 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.768 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.768 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8080", 2024-07-24T22:19:31.768 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.768 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.769 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.770 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.770 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.770 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.770 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.770 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.770 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-07-24T22:19:31.770 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-07-24T22:19:31.770 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.770 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.770 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.770 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.771 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.771 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.771 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.771 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.771 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.771 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.771 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.771 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl_server_port": { 2024-07-24T22:19:31.771 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl_server_port", 2024-07-24T22:19:31.771 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.771 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.772 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.772 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8443", 2024-07-24T22:19:31.772 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.772 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.772 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.772 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.772 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.772 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.772 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.772 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-07-24T22:19:31.772 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-07-24T22:19:31.773 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.773 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.773 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.773 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "redirect", 2024-07-24T22:19:31.773 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.773 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.773 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.773 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.773 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect" 2024-07-24T22:19:31.773 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.773 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.773 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.774 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.774 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.774 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-07-24T22:19:31.774 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-07-24T22:19:31.774 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.774 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.774 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.774 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-07-24T22:19:31.774 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-07-24T22:19:31.774 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-07-24T22:19:31.774 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.774 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.775 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.775 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.775 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.775 INFO:teuthology.orchestra.run.smithi047.stdout: "url_prefix": { 2024-07-24T22:19:31.775 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url_prefix", 2024-07-24T22:19:31.775 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.775 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.775 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.775 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.775 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.775 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.776 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.776 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.776 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.776 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.776 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.776 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.776 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.776 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-07-24T22:19:31.776 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.776 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.776 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.777 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_monitoring": { 2024-07-24T22:19:31.777 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_monitoring", 2024-07-24T22:19:31.777 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.777 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.777 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.777 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.777 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.777 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.777 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.777 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "monitor device health metrics", 2024-07-24T22:19:31.777 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.777 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.777 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.778 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.779 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.779 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.779 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.779 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.779 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.779 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.779 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.779 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.779 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.779 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.779 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.780 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.781 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.781 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.781 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.781 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.781 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.781 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.781 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.781 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.781 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.781 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.781 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.781 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.782 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.782 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.782 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.782 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.782 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.782 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.782 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.782 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.782 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.782 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.782 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.782 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.783 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.783 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.783 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.783 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.783 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.783 INFO:teuthology.orchestra.run.smithi047.stdout: "mark_out_threshold": { 2024-07-24T22:19:31.783 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mark_out_threshold", 2024-07-24T22:19:31.783 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.783 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.783 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.783 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2419200", 2024-07-24T22:19:31.784 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.784 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.784 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.784 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-07-24T22:19:31.784 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.784 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.784 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.784 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_name": { 2024-07-24T22:19:31.784 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_name", 2024-07-24T22:19:31.784 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.784 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.784 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.785 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "device_health_metrics", 2024-07-24T22:19:31.785 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.785 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.785 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.785 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name of pool in which to store device health metrics", 2024-07-24T22:19:31.785 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.785 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.785 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.785 INFO:teuthology.orchestra.run.smithi047.stdout: "retention_period": { 2024-07-24T22:19:31.785 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retention_period", 2024-07-24T22:19:31.785 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.785 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15552000", 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain device health metrics", 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_frequency": { 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_frequency", 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.786 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.787 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.787 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-07-24T22:19:31.787 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.787 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.787 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.787 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to scrape device health metrics", 2024-07-24T22:19:31.787 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.787 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.787 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.787 INFO:teuthology.orchestra.run.smithi047.stdout: "self_heal": { 2024-07-24T22:19:31.787 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "self_heal", 2024-07-24T22:19:31.788 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.788 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.788 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.788 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.788 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.788 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.788 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.788 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-07-24T22:19:31.788 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.788 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.788 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.789 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:31.789 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:31.789 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.789 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.789 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.789 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:31.789 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.789 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.789 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.789 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and check device health", 2024-07-24T22:19:31.789 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.789 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.789 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.790 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.790 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.790 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.790 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.790 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.790 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.790 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.790 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.790 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.790 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.790 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.790 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.791 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.791 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_threshold": { 2024-07-24T22:19:31.791 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_threshold", 2024-07-24T22:19:31.791 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.791 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.791 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.791 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7257600", 2024-07-24T22:19:31.791 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.791 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.791 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.791 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-07-24T22:19:31.791 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "diskprediction_local", 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.792 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.793 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.794 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.794 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.794 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.794 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.794 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.794 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.794 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.794 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.794 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.794 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.794 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.795 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.795 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.795 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.795 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.795 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.795 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.795 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.795 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.795 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.795 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.795 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.795 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.796 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.796 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.796 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.796 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.796 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.796 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.796 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.796 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.796 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.796 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.796 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.796 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.797 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.797 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.797 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.797 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.797 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.797 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.797 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.797 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.797 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.797 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.797 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.797 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.798 INFO:teuthology.orchestra.run.smithi047.stdout: "predict_interval": { 2024-07-24T22:19:31.798 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predict_interval", 2024-07-24T22:19:31.798 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.798 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.798 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.798 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-07-24T22:19:31.798 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.798 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.798 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.798 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.798 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.798 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.798 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.799 INFO:teuthology.orchestra.run.smithi047.stdout: "predictor_model": { 2024-07-24T22:19:31.799 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predictor_model", 2024-07-24T22:19:31.799 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.799 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.799 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.799 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "prophetstor", 2024-07-24T22:19:31.799 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.799 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.799 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.799 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.799 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.799 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.800 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.801 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.801 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.801 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.801 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.801 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.801 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.801 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.801 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.801 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.801 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.801 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.801 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.802 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.802 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.802 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.802 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.802 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "influx", 2024-07-24T22:19:31.802 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": false, 2024-07-24T22:19:31.802 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "influxdb python module not found", 2024-07-24T22:19:31.802 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.802 INFO:teuthology.orchestra.run.smithi047.stdout: "batch_size": { 2024-07-24T22:19:31.802 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "batch_size", 2024-07-24T22:19:31.802 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.803 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.803 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.803 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5000", 2024-07-24T22:19:31.803 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.803 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.803 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.803 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-07-24T22:19:31.803 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.803 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.803 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.803 INFO:teuthology.orchestra.run.smithi047.stdout: "database": { 2024-07-24T22:19:31.803 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "database", 2024-07-24T22:19:31.804 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.804 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.804 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.804 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "ceph", 2024-07-24T22:19:31.804 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.804 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.804 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.804 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-07-24T22:19:31.804 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.804 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.804 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.804 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": { 2024-07-24T22:19:31.805 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hostname", 2024-07-24T22:19:31.805 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.805 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.805 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.805 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.805 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.805 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.805 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.805 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server hostname", 2024-07-24T22:19:31.805 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.805 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.805 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.806 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:31.806 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:31.806 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.806 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.806 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.806 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "30", 2024-07-24T22:19:31.806 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "5", 2024-07-24T22:19:31.806 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.806 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.806 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-07-24T22:19:31.806 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.806 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.807 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.808 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.808 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.808 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.808 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.808 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.808 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.808 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.808 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.808 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.808 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.808 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.808 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.809 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.810 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.810 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.810 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.810 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.810 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.810 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.810 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.810 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.810 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.810 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.810 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.810 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.810 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.811 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.812 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.812 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.812 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.812 INFO:teuthology.orchestra.run.smithi047.stdout: "password": { 2024-07-24T22:19:31.812 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "password", 2024-07-24T22:19:31.812 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.812 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.812 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.812 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.812 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.812 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.812 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "password of InfluxDB server user", 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: "port": { 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "port", 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8086", 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.813 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.814 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server port", 2024-07-24T22:19:31.814 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.814 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.814 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.814 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.814 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.814 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.814 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.814 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.814 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.814 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.814 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.815 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.815 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.815 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.815 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.815 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.815 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-07-24T22:19:31.815 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-07-24T22:19:31.815 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.815 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.815 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.815 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "false", 2024-07-24T22:19:31.815 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.816 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.816 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.816 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-07-24T22:19:31.816 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.816 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.816 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.816 INFO:teuthology.orchestra.run.smithi047.stdout: "threads": { 2024-07-24T22:19:31.816 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threads", 2024-07-24T22:19:31.816 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.816 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.816 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.816 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:31.817 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-07-24T22:19:31.817 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "32", 2024-07-24T22:19:31.817 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.817 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-07-24T22:19:31.817 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.817 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.817 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.817 INFO:teuthology.orchestra.run.smithi047.stdout: "username": { 2024-07-24T22:19:31.817 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "username", 2024-07-24T22:19:31.817 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.817 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.817 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.818 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.818 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.818 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.818 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.818 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "username of InfluxDB server user", 2024-07-24T22:19:31.818 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.818 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.818 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.818 INFO:teuthology.orchestra.run.smithi047.stdout: "verify_ssl": { 2024-07-24T22:19:31.818 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "verify_ssl", 2024-07-24T22:19:31.818 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.818 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.819 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.819 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "true", 2024-07-24T22:19:31.819 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.819 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.819 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.819 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-07-24T22:19:31.819 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.819 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.819 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.819 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.819 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "insights", 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.820 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.821 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.822 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.822 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.822 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.822 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.822 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.822 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.822 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.822 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.822 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.822 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.822 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.822 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.823 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.823 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.823 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.823 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.823 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.823 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.823 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.823 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.823 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.823 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.823 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.823 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.823 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.824 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.825 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.825 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.825 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.825 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.825 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.825 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.825 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.825 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.825 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.825 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.825 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.825 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.826 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.826 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.826 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.826 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.826 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.826 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.826 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.826 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.826 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "iostat", 2024-07-24T22:19:31.826 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.826 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.827 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.828 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.828 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.828 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.828 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.828 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.828 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.828 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.828 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.828 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.828 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.828 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.828 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.829 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.829 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.829 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.829 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.829 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.829 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.829 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.829 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.829 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.829 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.829 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.829 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.830 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.831 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.831 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.831 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.831 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.831 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.831 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.831 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.831 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.831 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.831 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.831 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.832 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.833 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.833 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.833 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.833 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.833 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.833 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.833 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "k8sevents", 2024-07-24T22:19:31.833 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.833 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.833 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.833 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_event_retention_days": { 2024-07-24T22:19:31.834 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ceph_event_retention_days", 2024-07-24T22:19:31.834 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.834 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.834 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.834 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-07-24T22:19:31.834 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.834 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.834 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.834 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Days to hold ceph event information within local cache", 2024-07-24T22:19:31.834 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.834 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.834 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.835 INFO:teuthology.orchestra.run.smithi047.stdout: "config_check_secs": { 2024-07-24T22:19:31.835 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_check_secs", 2024-07-24T22:19:31.835 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.835 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.835 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.835 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.835 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "10", 2024-07-24T22:19:31.835 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.835 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.835 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-07-24T22:19:31.835 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.835 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.835 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.837 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.839 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.839 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.839 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.839 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.839 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.839 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.839 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.839 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.839 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.839 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.839 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.839 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.839 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.840 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.841 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.841 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.841 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.841 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.841 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.841 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.841 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.841 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.841 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.841 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.841 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.841 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.842 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.842 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.842 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.842 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.842 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.842 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.842 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "localpool", 2024-07-24T22:19:31.842 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.842 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.842 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.842 INFO:teuthology.orchestra.run.smithi047.stdout: "failure_domain": { 2024-07-24T22:19:31.843 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "failure_domain", 2024-07-24T22:19:31.843 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.843 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.843 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.843 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "host", 2024-07-24T22:19:31.843 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.843 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.843 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.843 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "failure domain for any created local pool", 2024-07-24T22:19:31.843 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-07-24T22:19:31.843 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.843 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.844 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.845 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.845 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.845 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.845 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.845 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.845 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.845 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.845 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.845 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.845 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.845 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.845 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.846 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.846 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.846 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.846 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.846 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.846 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.846 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.846 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.846 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.846 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.846 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.846 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.847 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.847 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.847 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.847 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.847 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.847 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.847 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.847 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.847 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.847 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.847 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.847 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.847 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.848 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.848 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.848 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.848 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.848 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.848 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.848 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.848 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.848 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.848 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.848 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.848 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.849 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.849 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.849 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.849 INFO:teuthology.orchestra.run.smithi047.stdout: "min_size": { 2024-07-24T22:19:31.849 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_size", 2024-07-24T22:19:31.849 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.849 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.849 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.849 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.849 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.849 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.850 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.850 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default min_size for any created local pool", 2024-07-24T22:19:31.850 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-07-24T22:19:31.850 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.850 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.850 INFO:teuthology.orchestra.run.smithi047.stdout: "num_rep": { 2024-07-24T22:19:31.850 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "num_rep", 2024-07-24T22:19:31.850 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.850 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.850 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.850 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-07-24T22:19:31.850 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default replica count for any created local pool", 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_num": { 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_num", 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "128", 2024-07-24T22:19:31.851 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.852 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.852 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.852 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default pg_num for any created local pool", 2024-07-24T22:19:31.852 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.852 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.852 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.852 INFO:teuthology.orchestra.run.smithi047.stdout: "prefix": { 2024-07-24T22:19:31.852 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prefix", 2024-07-24T22:19:31.852 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.852 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.852 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.852 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name prefix for any created local pool", 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.853 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: "subtree": { 2024-07-24T22:19:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "subtree", 2024-07-24T22:19:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.854 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "rack", 2024-07-24T22:19:31.855 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.855 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.855 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.855 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "CRUSH level for which to create a local pool", 2024-07-24T22:19:31.855 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-07-24T22:19:31.855 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.855 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.855 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.855 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.855 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mds_autoscaler", 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.856 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.857 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.857 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.857 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.857 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.857 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.857 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.857 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.857 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.857 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.857 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.857 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.858 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.859 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.859 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.859 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.859 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.859 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.859 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.859 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.859 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.859 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.859 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.859 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.859 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.860 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.861 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.861 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.861 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.861 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.861 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.861 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.861 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.861 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.861 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.862 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.862 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.862 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.862 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.862 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.862 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.862 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.862 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.862 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.862 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.862 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.862 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.862 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirroring", 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.863 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.864 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.864 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.864 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.864 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.864 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.864 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.864 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.864 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.864 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.864 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.864 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.864 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.865 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.865 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.865 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.865 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.865 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.865 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.865 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.865 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.865 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.865 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.865 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.865 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.865 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.866 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.867 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.867 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.867 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.867 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.867 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.867 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.867 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.867 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.867 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.867 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.867 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.867 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.868 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.869 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.869 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.869 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.869 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.869 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.869 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.869 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.869 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.869 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.869 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.869 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "nfs", 2024-07-24T22:19:31.870 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.870 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.870 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.870 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.870 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.870 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.870 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.870 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.870 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.870 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.870 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.870 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.870 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.871 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.872 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.872 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.872 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.872 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.872 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.872 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.872 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.872 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.872 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.872 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.872 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.872 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.873 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.873 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.873 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.873 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.873 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.873 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.873 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.873 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.873 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.873 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.873 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.873 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.873 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.875 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.876 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.876 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.876 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.876 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.876 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.876 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.876 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.876 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.876 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-07-24T22:19:31.876 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "fail_fs": { 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "fail_fs", 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.877 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.878 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.878 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.878 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.878 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.878 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.878 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.878 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.878 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.878 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.878 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.878 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.878 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.879 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.879 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.879 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.879 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.879 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.879 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.879 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.879 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.879 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.879 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.879 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.879 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.880 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.880 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.880 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.880 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.880 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.880 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.880 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.880 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.880 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.880 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.880 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.880 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.881 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.881 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.881 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.881 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.881 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.881 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.881 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.881 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.881 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.881 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.881 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.883 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.883 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.883 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.883 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.883 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.883 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.883 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.883 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.883 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator": { 2024-07-24T22:19:31.883 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-07-24T22:19:31.883 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.883 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.884 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.884 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.884 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.884 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.884 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.884 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-07-24T22:19:31.884 INFO:teuthology.orchestra.run.smithi047.stdout: "rook", 2024-07-24T22:19:31.884 INFO:teuthology.orchestra.run.smithi047.stdout: "test_orchestrator" 2024-07-24T22:19:31.884 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.884 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Orchestrator backend", 2024-07-24T22:19:31.884 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.884 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.885 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.885 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.885 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.885 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.885 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.885 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.885 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.885 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.885 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.885 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.885 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.885 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.886 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.886 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.886 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.886 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.886 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_perf_query", 2024-07-24T22:19:31.886 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.886 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.886 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.886 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.886 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.887 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.887 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.887 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.887 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.887 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.887 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.887 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.887 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.887 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.887 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.887 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.887 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.887 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.889 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.889 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.889 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.889 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.889 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.889 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.889 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.889 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.889 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.889 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.889 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.889 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.890 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.890 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.890 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.890 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.890 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.890 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.890 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.890 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.890 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.890 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.890 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.890 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.890 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.891 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.891 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.891 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.891 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.891 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.891 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.891 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.891 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.891 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.891 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.891 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.891 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.892 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_support", 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.893 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.894 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.894 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.894 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.894 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.894 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.894 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.894 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.894 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.894 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.894 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.894 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.894 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.894 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.895 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.895 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.895 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.895 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.895 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.895 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.895 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.895 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.895 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.895 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.895 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.895 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.896 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.896 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.896 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.896 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.896 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.896 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.896 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.896 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.896 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.896 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.896 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.896 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.897 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.898 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.898 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.898 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.898 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.898 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.898 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.898 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.898 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.898 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.898 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.898 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.899 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.899 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.899 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.899 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.899 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.899 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.899 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.899 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.899 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.899 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.899 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.899 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_autoscaler", 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.900 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.901 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.902 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.902 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.902 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.902 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.902 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.902 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.902 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.902 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.902 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.902 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.902 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.903 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.904 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.904 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.904 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.904 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.904 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.904 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.904 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.904 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.904 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.904 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.904 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.904 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:31.906 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.906 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.906 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.906 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:31.906 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.906 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.906 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.906 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.906 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.906 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.906 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.907 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: "threshold": { 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threshold", 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1.0", 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "scaling threshold", 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.908 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.909 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.909 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.909 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "progress", 2024-07-24T22:19:31.909 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.909 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.909 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.909 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_pg_recovery_event": { 2024-07-24T22:19:31.909 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_pg_recovery_event", 2024-07-24T22:19:31.909 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.909 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.910 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.910 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.910 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.910 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.910 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.910 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow the module to show pg recovery progress", 2024-07-24T22:19:31.910 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.910 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.910 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.910 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-07-24T22:19:31.910 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-07-24T22:19:31.910 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.911 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.912 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.912 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.912 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.912 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.912 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.912 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.912 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.912 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.912 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.912 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.912 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.912 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.912 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.913 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.913 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.913 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.913 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.913 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.913 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.913 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.913 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.914 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.914 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.914 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.914 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.914 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.914 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.914 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.914 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.914 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.914 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.915 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.915 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.915 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.915 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.915 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.915 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.915 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.915 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.915 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.915 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.915 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.915 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.915 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.916 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.916 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.916 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.916 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.916 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.916 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.916 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.916 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.916 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.916 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.916 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.916 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.917 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.917 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.917 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.917 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.917 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.917 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.917 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.917 INFO:teuthology.orchestra.run.smithi047.stdout: "max_completed_events": { 2024-07-24T22:19:31.917 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_completed_events", 2024-07-24T22:19:31.917 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.917 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.917 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.918 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "50", 2024-07-24T22:19:31.918 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.918 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.918 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.918 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "number of past completed events to remember", 2024-07-24T22:19:31.918 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.918 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.918 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.918 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-07-24T22:19:31.918 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-07-24T22:19:31.918 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:31.918 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.919 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.919 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:31.919 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.919 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.919 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.919 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long the module is going to sleep", 2024-07-24T22:19:31.919 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.919 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.919 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.919 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.919 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.919 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus", 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: "cache": { 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cache", 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.921 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.922 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.922 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.922 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.922 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.922 INFO:teuthology.orchestra.run.smithi047.stdout: "exclude_perf_counters": { 2024-07-24T22:19:31.922 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "exclude_perf_counters", 2024-07-24T22:19:31.922 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.922 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.922 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.922 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.922 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.922 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.923 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.923 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-07-24T22:19:31.923 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-07-24T22:19:31.923 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.923 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.923 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.923 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.923 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.923 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.923 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.923 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.923 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.924 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.924 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.924 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.924 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.924 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.924 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.924 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.924 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.924 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.924 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.924 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.924 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.924 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.926 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.926 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.926 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.926 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.926 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.926 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.926 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.926 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.926 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.926 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.926 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.926 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.927 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.927 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.927 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.927 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.927 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.927 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.927 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.927 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.927 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.927 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.927 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.927 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.928 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.928 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.928 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.928 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.928 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.928 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.928 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.928 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.928 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.928 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools": { 2024-07-24T22:19:31.928 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools", 2024-07-24T22:19:31.928 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools_refresh_interval": { 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.929 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.930 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.930 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "300", 2024-07-24T22:19:31.930 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.930 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.930 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.930 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.930 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.930 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.930 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.930 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_interval": { 2024-07-24T22:19:31.930 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_interval", 2024-07-24T22:19:31.931 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.931 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.931 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.931 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15.0", 2024-07-24T22:19:31.931 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.931 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.931 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.931 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.931 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.931 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.931 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.931 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-07-24T22:19:31.932 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-07-24T22:19:31.932 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.932 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.932 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.932 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-07-24T22:19:31.932 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.932 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.932 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.932 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-07-24T22:19:31.932 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.932 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.932 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.933 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-07-24T22:19:31.933 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-07-24T22:19:31.933 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.933 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.933 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.933 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "9283", 2024-07-24T22:19:31.933 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.933 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.933 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.933 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-07-24T22:19:31.933 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.933 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.934 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.934 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.934 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.934 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.934 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.934 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.934 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.934 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.934 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.934 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.934 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.934 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.935 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.935 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.935 INFO:teuthology.orchestra.run.smithi047.stdout: "stale_cache_strategy": { 2024-07-24T22:19:31.935 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stale_cache_strategy", 2024-07-24T22:19:31.935 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.935 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.935 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.935 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "log", 2024-07-24T22:19:31.935 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.935 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.935 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.935 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.936 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.936 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.936 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.936 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-07-24T22:19:31.936 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-07-24T22:19:31.936 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.936 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.936 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.936 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "default", 2024-07-24T22:19:31.936 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.936 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.936 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: "default", 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: "error" 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.937 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-07-24T22:19:31.938 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-07-24T22:19:31.938 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-07-24T22:19:31.938 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.938 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.938 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.938 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.938 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.938 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.938 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.938 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-07-24T22:19:31.938 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.939 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.939 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.939 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.939 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.939 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.939 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.939 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.939 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.939 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.939 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.939 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.939 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.939 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.940 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.941 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.941 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.941 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.941 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.941 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.941 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.941 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.941 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.941 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.941 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.941 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.941 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.942 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.942 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.942 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.942 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.942 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.942 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.942 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.942 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.942 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.942 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.942 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.942 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.942 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.943 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.944 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.944 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.944 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.944 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.944 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_snap_create": { 2024-07-24T22:19:31.944 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_snap_create", 2024-07-24T22:19:31.944 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.944 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.944 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.944 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-07-24T22:19:31.944 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.944 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.945 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.945 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.945 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.945 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.945 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.945 INFO:teuthology.orchestra.run.smithi047.stdout: "mirror_snapshot_schedule": { 2024-07-24T22:19:31.945 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirror_snapshot_schedule", 2024-07-24T22:19:31.945 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.945 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.945 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.945 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.946 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.947 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.947 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.947 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.947 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.947 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.947 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.948 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.948 INFO:teuthology.orchestra.run.smithi047.stdout: "trash_purge_schedule": { 2024-07-24T22:19:31.948 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "trash_purge_schedule", 2024-07-24T22:19:31.948 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.948 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.949 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.949 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.949 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.949 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.950 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.950 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.950 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.950 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.951 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.951 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.951 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.951 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "restful", 2024-07-24T22:19:31.952 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.952 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.952 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.952 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_auth": { 2024-07-24T22:19:31.952 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_auth", 2024-07-24T22:19:31.952 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.952 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.952 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.952 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.952 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.952 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.952 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.953 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.953 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.953 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.953 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.953 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-07-24T22:19:31.953 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-07-24T22:19:31.953 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.953 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.953 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.953 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.953 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.953 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.954 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.954 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.954 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.954 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.954 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.954 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.954 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.954 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.954 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.954 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.954 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.955 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.956 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.957 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.958 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.959 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.959 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.959 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.959 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.959 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.959 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.959 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.959 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-07-24T22:19:31.959 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-07-24T22:19:31.959 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.959 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.960 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.960 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.960 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.960 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.960 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.960 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.960 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.960 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.960 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.960 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-07-24T22:19:31.960 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-07-24T22:19:31.960 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.961 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.961 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.961 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.961 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.961 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.961 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.961 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.961 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.961 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.961 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.961 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.961 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.962 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.962 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.962 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.962 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.962 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.962 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.962 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.962 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.962 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.962 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.962 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.962 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.962 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.963 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rgw", 2024-07-24T22:19:31.963 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.963 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.963 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.963 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.963 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.963 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.963 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.963 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.963 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.963 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.965 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.965 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.965 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.965 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.965 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.965 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.965 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.965 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.965 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.965 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.965 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.965 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.965 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.966 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.966 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.966 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.966 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.966 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.966 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.966 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.966 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.966 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.966 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.966 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.967 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: "secondary_zone_period_retry_limit": { 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secondary_zone_period_retry_limit", 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.968 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.969 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.969 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-07-24T22:19:31.969 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.969 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.969 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.969 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-07-24T22:19:31.969 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.969 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.969 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.969 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.970 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.970 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.970 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.970 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.970 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.970 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.970 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.970 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.970 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.970 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.970 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.970 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rook", 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.971 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.972 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.972 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.972 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.972 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.972 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.972 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.972 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.972 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.972 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.972 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.972 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.972 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.972 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.973 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.973 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.973 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.973 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.973 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.973 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.973 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.973 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.973 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.973 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.973 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.974 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.974 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.974 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.974 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.974 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.974 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.974 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.974 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.974 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.974 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.974 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.974 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.975 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.975 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.975 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.975 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.975 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.975 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.975 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.975 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.975 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.975 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.975 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.975 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.976 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.976 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.976 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.976 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.976 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.976 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.976 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.976 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.976 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.976 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.976 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.976 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.977 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.977 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.977 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.977 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.977 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.977 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.977 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.977 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.977 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.977 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.977 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.977 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.977 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.978 INFO:teuthology.orchestra.run.smithi047.stdout: "storage_class": { 2024-07-24T22:19:31.978 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "storage_class", 2024-07-24T22:19:31.978 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.978 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.978 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.978 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "local", 2024-07-24T22:19:31.978 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.978 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.978 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.978 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-07-24T22:19:31.978 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.979 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.979 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.979 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.979 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:31.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:31.979 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "selftest", 2024-07-24T22:19:31.979 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:31.979 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:31.979 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:31.979 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:31.979 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:31.979 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.980 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.980 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.980 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.980 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.980 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.980 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.980 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.980 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.980 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.980 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.980 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.980 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.980 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.981 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.981 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.981 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.981 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.981 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:31.981 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:31.981 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.981 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.981 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.981 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.981 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.981 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.982 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.982 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.982 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.982 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.982 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.982 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:31.982 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:31.982 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.982 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.982 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.982 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:31.983 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.983 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.983 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:31.983 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:31.983 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:31.983 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:31.983 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:31.983 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:31.983 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:31.983 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:31.983 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.983 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.984 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.984 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.984 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:31.984 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:31.984 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.984 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.984 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.984 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:31.984 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.984 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.985 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.985 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.985 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.985 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.985 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.985 INFO:teuthology.orchestra.run.smithi047.stdout: "roption1": { 2024-07-24T22:19:31.985 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption1", 2024-07-24T22:19:31.985 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.985 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.985 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.985 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.986 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.986 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.986 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.986 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.986 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.986 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.986 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.986 INFO:teuthology.orchestra.run.smithi047.stdout: "roption2": { 2024-07-24T22:19:31.986 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption2", 2024-07-24T22:19:31.986 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.986 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.986 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.987 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "xyz", 2024-07-24T22:19:31.987 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.987 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.987 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.987 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.987 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.987 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.987 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.987 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption1": { 2024-07-24T22:19:31.987 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption1", 2024-07-24T22:19:31.987 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.987 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.988 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.988 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.988 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.988 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.988 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.988 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.988 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.988 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.988 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.988 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption2": { 2024-07-24T22:19:31.988 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption2", 2024-07-24T22:19:31.989 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.989 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.989 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.989 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.989 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.989 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.989 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.989 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.989 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.989 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.989 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.990 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption3": { 2024-07-24T22:19:31.990 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption3", 2024-07-24T22:19:31.990 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-07-24T22:19:31.990 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.990 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.990 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.990 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.990 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.990 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.990 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.990 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.990 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption4": { 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption4", 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.991 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.992 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.992 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption5": { 2024-07-24T22:19:31.992 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption5", 2024-07-24T22:19:31.992 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.992 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.992 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.992 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.992 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.992 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.992 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.992 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.993 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.993 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.993 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.993 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption6": { 2024-07-24T22:19:31.993 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption6", 2024-07-24T22:19:31.993 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:31.993 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.993 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.993 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:31.993 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.993 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.993 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.994 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.994 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.994 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.994 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.994 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption7": { 2024-07-24T22:19:31.994 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption7", 2024-07-24T22:19:31.994 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.994 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.994 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.994 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.995 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-07-24T22:19:31.995 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "42", 2024-07-24T22:19:31.995 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.995 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.995 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.995 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.995 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.995 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:31.995 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:31.995 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:31.995 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:31.995 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:31.996 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:31.996 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.996 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.996 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.996 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.996 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.996 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.996 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.996 INFO:teuthology.orchestra.run.smithi047.stdout: "testkey": { 2024-07-24T22:19:31.996 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testkey", 2024-07-24T22:19:31.996 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.997 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.997 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.997 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.997 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.997 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.997 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.997 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.997 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.997 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.997 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.997 INFO:teuthology.orchestra.run.smithi047.stdout: "testlkey": { 2024-07-24T22:19:31.998 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testlkey", 2024-07-24T22:19:31.998 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.998 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.998 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.998 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.998 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.998 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.998 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.998 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.998 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:31.998 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:31.998 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:31.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:31.999 INFO:teuthology.orchestra.run.smithi047.stdout: "testnewline": { 2024-07-24T22:19:31.999 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testnewline", 2024-07-24T22:19:31.999 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:31.999 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:31.999 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:31.999 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:31.999 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:31.999 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:31.999 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:31.999 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:31.999 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.000 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.000 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.000 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smb", 2024-07-24T22:19:32.000 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:32.000 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:32.000 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:32.000 INFO:teuthology.orchestra.run.smithi047.stdout: "internal_store_backend": { 2024-07-24T22:19:32.000 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "internal_store_backend", 2024-07-24T22:19:32.000 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.001 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:32.001 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.001 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.001 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.001 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.001 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.001 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-07-24T22:19:32.001 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.001 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.001 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.001 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:32.001 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:32.002 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.002 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.002 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.002 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.002 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.002 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.002 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.002 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.002 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.002 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.002 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.002 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.002 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.003 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.004 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.004 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.004 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.004 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.004 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.004 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:32.004 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:32.004 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.004 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.004 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.004 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:32.004 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.005 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.005 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.005 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.005 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.005 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.005 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.005 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.005 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.005 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.005 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.005 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.005 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.005 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.006 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.007 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:32.007 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:32.007 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.007 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:32.007 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.007 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:32.007 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.007 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.007 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.007 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.007 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: "update_orchestration": { 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "update_orchestration", 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-07-24T22:19:32.008 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.009 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.009 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.009 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.009 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.009 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-07-24T22:19:32.009 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:32.009 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:32.009 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:32.009 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_m_granularity": { 2024-07-24T22:19:32.009 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_m_granularity", 2024-07-24T22:19:32.009 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow minute scheduled snapshots", 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: "dump_on_update": { 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dump_on_update", 2024-07-24T22:19:32.010 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.011 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.011 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.011 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.011 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.011 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.011 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.011 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "dump database to debug log on update", 2024-07-24T22:19:32.011 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.011 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.011 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.012 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:32.012 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:32.012 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.012 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.012 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.012 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.012 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.012 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.012 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.012 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.012 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.012 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.013 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.013 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.013 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.013 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.013 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.013 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.013 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.013 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.013 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:32.013 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:32.013 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.014 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.014 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.014 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.014 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.014 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.014 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.014 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.014 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.014 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.014 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.015 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:32.015 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:32.015 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.015 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.015 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.015 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:32.015 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.015 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.015 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.015 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.015 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.015 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.016 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.016 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.016 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.016 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.016 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.016 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.016 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.016 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.016 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:32.016 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:32.016 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.016 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.017 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.017 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.017 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.017 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.017 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.017 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.017 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.017 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.017 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.017 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:32.017 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:32.017 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.019 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stats", 2024-07-24T22:19:32.019 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:32.019 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:32.019 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:32.019 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:32.019 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:32.019 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.019 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.019 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.019 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.019 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.019 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.020 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.020 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.020 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.020 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.020 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.020 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.020 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.020 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.020 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.020 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.020 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.021 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.021 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:32.021 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:32.021 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.021 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.021 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.021 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.021 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.021 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.021 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.021 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.022 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.022 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.022 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.022 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:32.022 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:32.022 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.022 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.022 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.022 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:32.022 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.022 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.022 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.023 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.023 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.023 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.023 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.023 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.023 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.023 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.023 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.023 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.023 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.023 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.023 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.025 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:32.025 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:32.025 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.025 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:32.025 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.025 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:32.025 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.025 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.025 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.025 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.025 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.025 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.025 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.026 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.026 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.026 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "status", 2024-07-24T22:19:32.026 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:32.026 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:32.026 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:32.026 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:32.026 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:32.026 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.026 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.026 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.027 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.027 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.027 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.027 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.027 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.027 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.027 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.027 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.027 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.027 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.027 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.027 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.027 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.028 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.028 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.028 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:32.028 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:32.028 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.028 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.028 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.028 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.028 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.028 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.028 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.028 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.029 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.029 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.029 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.029 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:32.029 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:32.029 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.029 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.029 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.029 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:32.029 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.029 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.029 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.030 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.030 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.030 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.030 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.030 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.030 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.030 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.030 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.030 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.030 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.030 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.031 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:32.031 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:32.031 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.031 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.031 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.031 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.031 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.031 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.031 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.031 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.031 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.031 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.032 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.032 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:32.032 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:32.032 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.032 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:32.032 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.032 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:32.032 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.032 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.032 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.032 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.032 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.033 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.033 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.033 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.033 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.033 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telegraf", 2024-07-24T22:19:32.033 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:32.033 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:32.033 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:32.034 INFO:teuthology.orchestra.run.smithi047.stdout: "address": { 2024-07-24T22:19:32.034 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "address", 2024-07-24T22:19:32.034 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.034 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.034 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.034 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-07-24T22:19:32.034 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.034 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.034 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.034 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.035 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.035 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.035 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.035 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:32.035 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:32.035 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:32.035 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.035 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.035 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15", 2024-07-24T22:19:32.035 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.035 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.035 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.036 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.036 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.036 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.036 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.036 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:32.036 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:32.036 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.036 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.036 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.036 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.036 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.036 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.037 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.037 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.037 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.037 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.037 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.037 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.037 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.037 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.037 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.037 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.037 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.037 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.038 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:32.038 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:32.038 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.038 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.038 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.038 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.038 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.038 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.038 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.038 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.039 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.039 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.039 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.039 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:32.039 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:32.039 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.039 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.039 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.039 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:32.039 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.039 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.039 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.040 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.040 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.040 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.040 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.040 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.040 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.040 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.040 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.040 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.040 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.040 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.041 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:32.041 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:32.041 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.041 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.041 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.041 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.041 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.041 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.041 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.041 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.041 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.041 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.041 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.042 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:32.042 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:32.042 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.042 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:32.042 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.042 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:32.042 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.042 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.042 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.042 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.042 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.043 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.043 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.043 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.043 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.043 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telemetry", 2024-07-24T22:19:32.043 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:32.043 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:32.043 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:32.043 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_basic": { 2024-07-24T22:19:32.043 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_basic", 2024-07-24T22:19:32.043 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.044 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.044 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.044 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:32.044 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.044 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.044 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.044 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share basic cluster information (size, version)", 2024-07-24T22:19:32.044 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.044 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.044 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.044 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_crash": { 2024-07-24T22:19:32.045 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_crash", 2024-07-24T22:19:32.045 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.045 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.045 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.045 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:32.045 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.045 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.045 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.045 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-07-24T22:19:32.045 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.045 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.045 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.046 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_device": { 2024-07-24T22:19:32.046 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_device", 2024-07-24T22:19:32.046 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.046 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.046 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.046 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:32.046 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.046 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.046 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.046 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-07-24T22:19:32.046 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.046 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.047 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.047 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_ident": { 2024-07-24T22:19:32.047 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_ident", 2024-07-24T22:19:32.047 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.047 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.047 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.047 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.047 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.047 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.047 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.047 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-07-24T22:19:32.047 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.048 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.048 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.048 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_perf": { 2024-07-24T22:19:32.048 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_perf", 2024-07-24T22:19:32.048 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.048 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.048 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.048 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.048 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.048 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.048 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.048 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share various performance metrics of a cluster", 2024-07-24T22:19:32.049 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.049 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.049 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.049 INFO:teuthology.orchestra.run.smithi047.stdout: "contact": { 2024-07-24T22:19:32.049 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "contact", 2024-07-24T22:19:32.049 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.049 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.049 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.049 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.049 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.049 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.049 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: "description": { 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "description", 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.050 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.051 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.051 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.051 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.051 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.051 INFO:teuthology.orchestra.run.smithi047.stdout: "device_url": { 2024-07-24T22:19:32.051 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_url", 2024-07-24T22:19:32.051 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.051 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.051 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.051 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-07-24T22:19:32.052 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.052 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.052 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.052 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.052 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.052 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.052 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.052 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-07-24T22:19:32.052 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-07-24T22:19:32.052 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.052 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.052 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.053 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.054 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "24", 2024-07-24T22:19:32.054 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "8", 2024-07-24T22:19:32.054 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.054 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.054 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.054 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.054 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.054 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.054 INFO:teuthology.orchestra.run.smithi047.stdout: "last_opt_revision": { 2024-07-24T22:19:32.054 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "last_opt_revision", 2024-07-24T22:19:32.054 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.054 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.055 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.055 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1", 2024-07-24T22:19:32.055 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.055 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.055 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.055 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.055 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.055 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.055 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.055 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard": { 2024-07-24T22:19:32.055 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard", 2024-07-24T22:19:32.055 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.056 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.056 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.056 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.056 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.056 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.056 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.056 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.056 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.056 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.056 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.056 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard_description": { 2024-07-24T22:19:32.056 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard_description", 2024-07-24T22:19:32.057 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.057 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.057 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.057 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.057 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.057 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.057 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.058 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.058 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.058 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.058 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.058 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:32.059 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:32.059 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.059 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.059 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.059 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.059 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.060 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.060 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.060 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.060 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.060 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.060 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.060 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.060 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.060 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.060 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.060 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.060 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.061 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.061 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:32.061 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:32.061 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.061 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.061 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.061 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.061 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.061 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.061 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.061 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.061 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.062 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.062 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.062 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:32.062 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:32.062 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.062 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.062 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.062 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:32.062 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.062 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.062 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.062 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:32.063 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.064 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.064 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.064 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.064 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.064 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.064 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.064 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.065 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.065 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.065 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.065 INFO:teuthology.orchestra.run.smithi047.stdout: "organization": { 2024-07-24T22:19:32.065 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "organization", 2024-07-24T22:19:32.066 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.066 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.066 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.066 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.066 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.066 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.067 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.067 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.067 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.067 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.067 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.068 INFO:teuthology.orchestra.run.smithi047.stdout: "proxy": { 2024-07-24T22:19:32.068 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "proxy", 2024-07-24T22:19:32.068 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.068 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.068 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.068 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.068 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:32.069 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.070 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.070 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.070 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.070 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.070 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.070 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.070 INFO:teuthology.orchestra.run.smithi047.stdout: "url": { 2024-07-24T22:19:32.070 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url", 2024-07-24T22:19:32.070 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.070 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.070 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.070 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-07-24T22:19:32.071 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.071 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.071 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.071 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.071 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.071 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.071 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.071 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.071 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.071 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "test_orchestrator", 2024-07-24T22:19:32.071 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.072 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.073 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.073 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.073 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.073 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.073 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.073 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.073 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.073 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.073 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:32.073 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:32.073 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.073 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.074 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.074 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.074 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.074 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.074 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.074 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.074 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.074 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.074 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.074 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:32.074 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:32.074 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.075 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.076 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.077 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-07-24T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.079 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.080 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.080 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.080 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.080 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.080 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:32.080 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:32.080 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.080 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.080 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.080 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.080 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.080 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.081 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.082 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.082 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.082 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.082 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.082 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.082 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.082 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.082 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.082 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.082 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.082 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.082 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.084 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_clones": { 2024-07-24T22:19:32.084 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_clones", 2024-07-24T22:19:32.084 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.084 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.084 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.084 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4", 2024-07-24T22:19:32.084 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.084 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.084 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.084 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Number of asynchronous cloner threads", 2024-07-24T22:19:32.084 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.084 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.084 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.085 INFO:teuthology.orchestra.run.smithi047.stdout: "periodic_async_work": { 2024-07-24T22:19:32.085 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "periodic_async_work", 2024-07-24T22:19:32.085 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.085 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.085 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.085 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.085 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.085 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.085 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.085 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Periodically check for async work", 2024-07-24T22:19:32.086 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.086 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.086 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.086 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_delay": { 2024-07-24T22:19:32.086 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_delay", 2024-07-24T22:19:32.086 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.086 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.086 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.086 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:32.086 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.086 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.087 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.087 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-07-24T22:19:32.087 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.087 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.087 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.087 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_no_wait": { 2024-07-24T22:19:32.087 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_no_wait", 2024-07-24T22:19:32.087 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.087 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.087 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.087 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-07-24T22:19:32.087 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.088 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.088 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.088 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-07-24T22:19:32.088 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.088 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.088 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.088 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:32.088 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:32.088 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.088 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:32.088 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.088 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:32.089 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.089 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.089 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.089 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.089 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.089 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.089 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.089 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.089 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.089 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix", 2024-07-24T22:19:32.090 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-07-24T22:19:32.090 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-07-24T22:19:32.090 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-07-24T22:19:32.090 INFO:teuthology.orchestra.run.smithi047.stdout: "discovery_interval": { 2024-07-24T22:19:32.090 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "discovery_interval", 2024-07-24T22:19:32.090 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-07-24T22:19:32.090 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.090 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.090 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "100", 2024-07-24T22:19:32.090 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.090 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.090 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.090 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.091 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.091 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.091 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.091 INFO:teuthology.orchestra.run.smithi047.stdout: "identifier": { 2024-07-24T22:19:32.091 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "identifier", 2024-07-24T22:19:32.091 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.091 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.091 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.091 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.091 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.091 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.091 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.092 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.092 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.092 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.092 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.092 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-07-24T22:19:32.092 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-07-24T22:19:32.092 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-07-24T22:19:32.092 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.092 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.092 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-07-24T22:19:32.092 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.093 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.093 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.093 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.093 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.093 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.093 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.093 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-07-24T22:19:32.093 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-07-24T22:19:32.093 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.093 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.093 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.094 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.095 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.096 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.096 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-07-24T22:19:32.096 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-07-24T22:19:32.096 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.096 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.096 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.096 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-07-24T22:19:32.096 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.096 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.096 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-07-24T22:19:32.096 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-07-24T22:19:32.096 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-07-24T22:19:32.097 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.098 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.098 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-07-24T22:19:32.098 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.098 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.098 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.098 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.098 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.098 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.098 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.098 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-07-24T22:19:32.098 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-07-24T22:19:32.098 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.099 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-07-24T22:19:32.099 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-07-24T22:19:32.099 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-07-24T22:19:32.099 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.099 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.099 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.099 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.099 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.099 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.099 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.099 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_host": { 2024-07-24T22:19:32.099 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_host", 2024-07-24T22:19:32.100 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.100 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.100 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.101 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-07-24T22:19:32.101 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.102 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.102 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.102 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.102 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.102 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.102 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.102 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_port": { 2024-07-24T22:19:32.102 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_port", 2024-07-24T22:19:32.102 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-07-24T22:19:32.102 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.102 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.102 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10051", 2024-07-24T22:19:32.103 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.103 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.103 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.103 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.103 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.103 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.103 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.103 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_sender": { 2024-07-24T22:19:32.103 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_sender", 2024-07-24T22:19:32.103 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-07-24T22:19:32.103 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-07-24T22:19:32.103 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-07-24T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-07-24T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-07-24T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-07-24T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-07-24T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-07-24T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-07-24T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-07-24T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-07-24T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout: "services": { 2024-07-24T22:19:32.105 INFO:teuthology.orchestra.run.smithi047.stdout: "dashboard": "https://172.21.15.47:8443/" 2024-07-24T22:19:32.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.105 INFO:teuthology.orchestra.run.smithi047.stdout: "always_on_modules": { 2024-07-24T22:19:32.105 INFO:teuthology.orchestra.run.smithi047.stdout: "octopus": [ 2024-07-24T22:19:32.105 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-07-24T22:19:32.105 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-07-24T22:19:32.105 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-07-24T22:19:32.105 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-07-24T22:19:32.105 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-07-24T22:19:32.105 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-07-24T22:19:32.105 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-07-24T22:19:32.105 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-07-24T22:19:32.105 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-07-24T22:19:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-07-24T22:19:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: "pacific": [ 2024-07-24T22:19:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-07-24T22:19:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-07-24T22:19:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-07-24T22:19:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-07-24T22:19:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-07-24T22:19:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-07-24T22:19:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-07-24T22:19:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-07-24T22:19:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-07-24T22:19:32.106 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-07-24T22:19:32.107 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.107 INFO:teuthology.orchestra.run.smithi047.stdout: "quincy": [ 2024-07-24T22:19:32.107 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-07-24T22:19:32.107 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-07-24T22:19:32.107 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-07-24T22:19:32.107 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-07-24T22:19:32.107 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-07-24T22:19:32.107 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-07-24T22:19:32.107 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-07-24T22:19:32.107 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-07-24T22:19:32.107 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-07-24T22:19:32.107 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-07-24T22:19:32.107 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: "reef": [ 2024-07-24T22:19:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-07-24T22:19:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-07-24T22:19:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-07-24T22:19:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-07-24T22:19:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-07-24T22:19:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-07-24T22:19:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-07-24T22:19:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-07-24T22:19:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-07-24T22:19:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-07-24T22:19:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-07-24T22:19:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: "squid": [ 2024-07-24T22:19:32.109 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-07-24T22:19:32.109 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-07-24T22:19:32.109 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-07-24T22:19:32.109 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-07-24T22:19:32.109 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-07-24T22:19:32.109 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-07-24T22:19:32.109 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-07-24T22:19:32.109 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-07-24T22:19:32.109 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-07-24T22:19:32.109 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-07-24T22:19:32.109 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-07-24T22:19:32.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.110 INFO:teuthology.orchestra.run.smithi047.stdout: "last_failure_osd_epoch": 5, 2024-07-24T22:19:32.110 INFO:teuthology.orchestra.run.smithi047.stdout: "active_clients": [ 2024-07-24T22:19:32.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.110 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-07-24T22:19:32.110 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-07-24T22:19:32.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.110 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-07-24T22:19:32.110 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-07-24T22:19:32.110 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3923541960 2024-07-24T22:19:32.110 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.110 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-07-24T22:19:32.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "libcephsqlite", 2024-07-24T22:19:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-07-24T22:19:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-07-24T22:19:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-07-24T22:19:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3530546501 2024-07-24T22:19:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-07-24T22:19:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-07-24T22:19:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-07-24T22:19:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.112 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-07-24T22:19:32.112 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-07-24T22:19:32.112 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3079641273 2024-07-24T22:19:32.112 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.112 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-07-24T22:19:32.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.112 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-07-24T22:19:32.112 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-07-24T22:19:32.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.112 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-07-24T22:19:32.112 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-07-24T22:19:32.112 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 4262490314 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 119538544 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:32.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.114 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-07-24T22:19:32.114 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-07-24T22:19:32.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-07-24T22:19:32.114 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-07-24T22:19:32.114 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-07-24T22:19:32.114 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 1687428340 2024-07-24T22:19:32.114 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.114 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-07-24T22:19:32.114 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:32.114 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-07-24T22:19:32.114 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:19:32.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.545+0000 7fdc886be640 1 -- 172.21.15.47:0/591976117 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdc6c0b3d40 msgr2=0x7fdc6c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:32.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.545+0000 7fdc886be640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdc6c0b3d40 0x7fdc6c0b6200 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdc70031440 tx=0x7fdc700095f0 comp rx=0 tx=0).stop 2024-07-24T22:19:32.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.545+0000 7fdc886be640 1 -- 172.21.15.47:0/591976117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc801035c0 msgr2=0x7fdc80101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:19:32.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.545+0000 7fdc886be640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc801035c0 0x7fdc80101260 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c00d770 tx=0x7fdc7c00dc30 comp rx=0 tx=0).stop 2024-07-24T22:19:32.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.545+0000 7fdc886be640 1 -- 172.21.15.47:0/591976117 shutdown_connections 2024-07-24T22:19:32.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.545+0000 7fdc886be640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fdc6c0b3d40 0x7fdc6c0b6200 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:32.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.545+0000 7fdc886be640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc8010c9e0 0x7fdc80101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:32.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.545+0000 7fdc886be640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc80103ee0 0x7fdc801017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:32.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.545+0000 7fdc886be640 1 --2- 172.21.15.47:0/591976117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc801035c0 0x7fdc80101260 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:19:32.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.545+0000 7fdc886be640 1 -- 172.21.15.47:0/591976117 >> 172.21.15.47:0/591976117 conn(0x7fdc800fcfd0 msgr2=0x7fdc800fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:19:32.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.546+0000 7fdc886be640 1 -- 172.21.15.47:0/591976117 shutdown_connections 2024-07-24T22:19:32.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:19:30.546+0000 7fdc886be640 1 -- 172.21.15.47:0/591976117 wait complete. 2024-07-24T22:19:32.169 DEBUG:tasks.check_counter:Getting stats from a 2024-07-24T22:19:32.169 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph daemon mds.a perf dump 2024-07-24T22:19:32.170 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:30 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1528511554' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-24T22:19:32.170 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:30 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/591976117' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-07-24T22:19:32.171 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:30 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1528511554' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-24T22:19:32.171 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:30 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/591976117' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-07-24T22:19:32.171 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:30 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1528511554' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-24T22:19:32.171 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:30 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/591976117' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-07-24T22:19:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:31 smithi188 ceph-mon[37380]: pgmap v749: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 917 B/s rd, 1 op/s 2024-07-24T22:19:32.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:31 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:19:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:31 smithi183 ceph-mon[37007]: pgmap v749: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 917 B/s rd, 1 op/s 2024-07-24T22:19:32.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:31 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:19:32.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:31 smithi047 ceph-mon[32551]: pgmap v749: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 917 B/s rd, 1 op/s 2024-07-24T22:19:32.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:31 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-24T22:19:32.445 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:19:33.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:19:33.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:19:33.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:32 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:19:33.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:19:33.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:19:33.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:32 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:19:33.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-24T22:19:33.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-24T22:19:33.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:32 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' 2024-07-24T22:19:34.116 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:33 smithi047 ceph-mon[32551]: pgmap v750: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:34.226 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:19:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-07-24T22:19:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 4, 2024-07-24T22:19:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 4, 2024-07-24T22:19:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 2944, 2024-07-24T22:19:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 448, 2024-07-24T22:19:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:34.226 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-07-24T22:19:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.003712682, 2024-07-24T22:19:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000045086, 2024-07-24T22:19:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.002606287, 2024-07-24T22:19:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3, 2024-07-24T22:19:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.004817196, 2024-07-24T22:19:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001605732 2024-07-24T22:19:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:34.227 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 448 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 2, 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 196, 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 320, 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 193408, 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.015850954, 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.012167688, 2024-07-24T22:19:34.228 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.001447423, 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 194, 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.017967042, 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000092613 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 320, 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 193408 2024-07-24T22:19:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-07-24T22:19:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 261, 2024-07-24T22:19:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 255, 2024-07-24T22:19:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 982912, 2024-07-24T22:19:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 157680, 2024-07-24T22:19:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-07-24T22:19:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-07-24T22:19:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.038244755, 2024-07-24T22:19:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.018564799, 2024-07-24T22:19:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.024764237, 2024-07-24T22:19:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:34.230 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 254, 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.021385765, 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000084195 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 982912, 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 157680 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-07-24T22:19:34.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-07-24T22:19:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-07-24T22:19:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-07-24T22:19:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-07-24T22:19:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-07-24T22:19:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-07-24T22:19:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-07-24T22:19:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-07-24T22:19:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-07-24T22:19:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-07-24T22:19:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-07-24T22:19:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-07-24T22:19:34.232 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-07-24T22:19:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-07-24T22:19:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-07-24T22:19:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-07-24T22:19:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-07-24T22:19:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-07-24T22:19:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-07-24T22:19:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-07-24T22:19:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-07-24T22:19:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-07-24T22:19:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-07-24T22:19:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-07-24T22:19:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-07-24T22:19:34.233 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-07-24T22:19:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-07-24T22:19:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-07-24T22:19:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-07-24T22:19:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-07-24T22:19:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-07-24T22:19:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-07-24T22:19:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-07-24T22:19:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-07-24T22:19:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-07-24T22:19:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-07-24T22:19:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-07-24T22:19:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 147937, 2024-07-24T22:19:34.234 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 28, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-07-24T22:19:34.235 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 928, 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 263, 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 946047, 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:34.236 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 263, 2024-07-24T22:19:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-07-24T22:19:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-07-24T22:19:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 263, 2024-07-24T22:19:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 946047, 2024-07-24T22:19:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-07-24T22:19:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:34.237 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:34.237 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:19:34.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:33 smithi188 ceph-mon[37380]: pgmap v750: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:34.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:33 smithi183 ceph-mon[37007]: pgmap v750: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:34.925 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-07-24T22:19:34.925 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-07-24T22:19:34.926 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-07-24T22:19:34.926 DEBUG:tasks.check_counter:Getting stats from d 2024-07-24T22:19:34.926 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph daemon mds.d perf dump 2024-07-24T22:19:35.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:35 smithi047 ceph-mon[32551]: pgmap v751: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:35.195 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:19:35.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:35 smithi188 ceph-mon[37380]: pgmap v751: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:35.412 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:35 smithi183 ceph-mon[37007]: pgmap v751: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:36.940 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:19:36.940 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-07-24T22:19:36.940 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 0, 2024-07-24T22:19:36.941 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 2, 2024-07-24T22:19:36.941 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 0, 2024-07-24T22:19:36.941 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 0, 2024-07-24T22:19:36.941 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:36.941 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-07-24T22:19:36.941 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.001385495, 2024-07-24T22:19:36.941 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000000000, 2024-07-24T22:19:36.941 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.000297822, 2024-07-24T22:19:36.941 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:36.941 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:36.941 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:36.941 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:36.941 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:36.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:36.942 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:36.942 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:36.942 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:36.942 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:36.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:36.942 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 0, 2024-07-24T22:19:36.942 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 0 2024-07-24T22:19:36.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:36.942 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-07-24T22:19:36.942 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 271, 2024-07-24T22:19:36.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 263, 2024-07-24T22:19:36.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 987552, 2024-07-24T22:19:36.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 161488, 2024-07-24T22:19:36.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-07-24T22:19:36.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-07-24T22:19:36.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.049403812, 2024-07-24T22:19:36.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.018574638, 2024-07-24T22:19:36.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.042033278, 2024-07-24T22:19:36.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:36.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:36.943 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 263, 2024-07-24T22:19:36.943 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.019383618, 2024-07-24T22:19:36.943 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000073701 2024-07-24T22:19:36.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:36.944 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:36.944 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:36.944 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:36.944 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:36.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:36.944 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 987552, 2024-07-24T22:19:36.944 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 161488 2024-07-24T22:19:36.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:36.944 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-07-24T22:19:36.944 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 2, 2024-07-24T22:19:36.944 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 200, 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 320, 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 194112, 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.016408317, 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.012722204, 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.001507021, 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 198, 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.024391995, 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000123191 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:36.945 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:36.946 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:36.946 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:36.946 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:36.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:36.946 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 320, 2024-07-24T22:19:36.946 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 194112 2024-07-24T22:19:36.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:36.946 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-07-24T22:19:36.946 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-07-24T22:19:36.946 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-07-24T22:19:36.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:36.947 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-07-24T22:19:36.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-07-24T22:19:36.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-07-24T22:19:36.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-07-24T22:19:36.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-07-24T22:19:36.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-07-24T22:19:36.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-07-24T22:19:36.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-07-24T22:19:36.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-07-24T22:19:36.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-07-24T22:19:36.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-07-24T22:19:36.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-07-24T22:19:36.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-07-24T22:19:36.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-07-24T22:19:36.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-07-24T22:19:36.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-07-24T22:19:36.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-07-24T22:19:36.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-07-24T22:19:36.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-07-24T22:19:36.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-07-24T22:19:36.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-07-24T22:19:36.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-07-24T22:19:36.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-07-24T22:19:36.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-07-24T22:19:36.949 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 147937, 2024-07-24T22:19:36.950 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 28, 2024-07-24T22:19:36.950 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-07-24T22:19:36.950 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-07-24T22:19:36.950 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-07-24T22:19:36.950 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-07-24T22:19:36.950 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-07-24T22:19:36.950 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-07-24T22:19:36.950 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-07-24T22:19:36.950 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-07-24T22:19:36.950 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-07-24T22:19:36.950 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-07-24T22:19:36.950 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-07-24T22:19:36.950 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-07-24T22:19:36.951 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-07-24T22:19:36.951 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-07-24T22:19:36.951 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 928, 2024-07-24T22:19:36.951 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-07-24T22:19:36.951 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-07-24T22:19:36.951 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-07-24T22:19:36.951 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-07-24T22:19:36.951 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-07-24T22:19:36.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:36.951 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-07-24T22:19:36.951 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-07-24T22:19:36.951 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-07-24T22:19:36.951 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 269, 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 946891, 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 269, 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 269, 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 946891, 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:36.952 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:36.953 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:19:37.682 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-07-24T22:19:37.682 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-07-24T22:19:37.682 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-07-24T22:19:37.682 DEBUG:tasks.check_counter:Getting stats from g 2024-07-24T22:19:37.682 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph daemon mds.g perf dump 2024-07-24T22:19:37.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:37 smithi047 ceph-mon[32551]: pgmap v752: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:37.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:37 smithi188 ceph-mon[37380]: pgmap v752: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:37.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:37 smithi183 ceph-mon[37007]: pgmap v752: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:37.948 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:19:39.641 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:39 smithi047 ceph-mon[32551]: pgmap v753: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:39.646 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:19:39.646 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-07-24T22:19:39.646 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 4, 2024-07-24T22:19:39.646 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 4, 2024-07-24T22:19:39.646 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 2944, 2024-07-24T22:19:39.646 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 448, 2024-07-24T22:19:39.646 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:39.646 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.003408891, 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000050097, 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.002316982, 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3, 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.004288718, 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001429572 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:39.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:39.649 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-07-24T22:19:39.649 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 448 2024-07-24T22:19:39.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:39.650 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-07-24T22:19:39.650 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 263, 2024-07-24T22:19:39.650 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 257, 2024-07-24T22:19:39.650 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 983456, 2024-07-24T22:19:39.650 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 158960, 2024-07-24T22:19:39.650 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-07-24T22:19:39.650 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-07-24T22:19:39.650 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.043566729, 2024-07-24T22:19:39.650 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.018591160, 2024-07-24T22:19:39.650 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.032344365, 2024-07-24T22:19:39.650 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:39.650 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:39.650 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 256, 2024-07-24T22:19:39.651 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.035374088, 2024-07-24T22:19:39.651 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000138180 2024-07-24T22:19:39.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:39.651 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:39.651 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:39.651 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:39.651 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:39.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:39.651 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 983456, 2024-07-24T22:19:39.651 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 158960 2024-07-24T22:19:39.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:39.651 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-07-24T22:19:39.652 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 2, 2024-07-24T22:19:39.652 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 197, 2024-07-24T22:19:39.652 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 320, 2024-07-24T22:19:39.652 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 193584, 2024-07-24T22:19:39.652 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:39.652 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-07-24T22:19:39.652 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.016925092, 2024-07-24T22:19:39.652 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.013252281, 2024-07-24T22:19:39.652 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.001461942, 2024-07-24T22:19:39.653 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:39.653 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:39.653 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 195, 2024-07-24T22:19:39.653 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.013985243, 2024-07-24T22:19:39.653 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000071719 2024-07-24T22:19:39.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:39.653 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:39.653 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:39.653 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:39.653 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:39.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:39.653 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 320, 2024-07-24T22:19:39.654 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 193584 2024-07-24T22:19:39.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:39.654 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-07-24T22:19:39.654 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-07-24T22:19:39.654 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-07-24T22:19:39.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:39.654 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-07-24T22:19:39.654 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-07-24T22:19:39.654 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-07-24T22:19:39.654 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-07-24T22:19:39.654 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-07-24T22:19:39.655 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-07-24T22:19:39.655 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-07-24T22:19:39.655 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-07-24T22:19:39.655 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-07-24T22:19:39.655 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-07-24T22:19:39.655 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-07-24T22:19:39.655 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-07-24T22:19:39.655 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-07-24T22:19:39.655 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-07-24T22:19:39.655 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-07-24T22:19:39.655 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-07-24T22:19:39.655 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-07-24T22:19:39.655 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-07-24T22:19:39.656 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-07-24T22:19:39.656 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-07-24T22:19:39.656 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-07-24T22:19:39.656 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-07-24T22:19:39.656 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-07-24T22:19:39.656 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-07-24T22:19:39.656 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-07-24T22:19:39.656 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-07-24T22:19:39.656 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-07-24T22:19:39.656 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-07-24T22:19:39.656 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-07-24T22:19:39.656 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-07-24T22:19:39.656 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-07-24T22:19:39.657 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-07-24T22:19:39.657 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-07-24T22:19:39.657 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-07-24T22:19:39.657 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-07-24T22:19:39.657 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-07-24T22:19:39.657 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-07-24T22:19:39.657 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 147898, 2024-07-24T22:19:39.657 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 27, 2024-07-24T22:19:39.657 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-07-24T22:19:39.657 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-07-24T22:19:39.657 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-07-24T22:19:39.657 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-07-24T22:19:39.657 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-07-24T22:19:39.658 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-07-24T22:19:39.658 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-07-24T22:19:39.658 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-07-24T22:19:39.658 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-07-24T22:19:39.658 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-07-24T22:19:39.658 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-07-24T22:19:39.658 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-07-24T22:19:39.658 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-07-24T22:19:39.658 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-07-24T22:19:39.658 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 928, 2024-07-24T22:19:39.658 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-07-24T22:19:39.658 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-07-24T22:19:39.659 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-07-24T22:19:39.659 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-07-24T22:19:39.659 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-07-24T22:19:39.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:39.659 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-07-24T22:19:39.659 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-07-24T22:19:39.659 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-07-24T22:19:39.659 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-07-24T22:19:39.659 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 265, 2024-07-24T22:19:39.659 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 946307, 2024-07-24T22:19:39.659 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:39.659 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 265, 2024-07-24T22:19:39.659 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-07-24T22:19:39.660 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-07-24T22:19:39.660 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 265, 2024-07-24T22:19:39.660 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 946307, 2024-07-24T22:19:39.660 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-07-24T22:19:39.660 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:39.660 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:39.660 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:39.660 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:39.660 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:39.660 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:19:39.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:39 smithi188 ceph-mon[37380]: pgmap v753: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:39.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:39 smithi183 ceph-mon[37007]: pgmap v753: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:40.332 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-07-24T22:19:40.333 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-07-24T22:19:40.333 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-07-24T22:19:40.333 DEBUG:tasks.check_counter:Getting stats from j 2024-07-24T22:19:40.333 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph daemon mds.j perf dump 2024-07-24T22:19:40.642 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:19:41.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:41 smithi047 ceph-mon[32551]: pgmap v754: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:41.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:41 smithi188 ceph-mon[37380]: pgmap v754: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:41.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:41 smithi183 ceph-mon[37007]: pgmap v754: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:42.303 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-07-24T22:19:42.304 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-07-24T22:19:42.304 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 274, 2024-07-24T22:19:42.304 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 266, 2024-07-24T22:19:42.304 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 988368, 2024-07-24T22:19:42.304 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 163408, 2024-07-24T22:19:42.304 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:42.304 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-07-24T22:19:42.304 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.046416268, 2024-07-24T22:19:42.304 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.019016118, 2024-07-24T22:19:42.304 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.032528652, 2024-07-24T22:19:42.304 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:42.305 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:42.305 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 266, 2024-07-24T22:19:42.305 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.021747742, 2024-07-24T22:19:42.305 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000081758 2024-07-24T22:19:42.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:42.305 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:42.305 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:42.305 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:42.305 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:42.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:42.305 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 988368, 2024-07-24T22:19:42.305 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 163408 2024-07-24T22:19:42.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:42.306 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-07-24T22:19:42.306 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 2, 2024-07-24T22:19:42.306 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 202, 2024-07-24T22:19:42.306 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 320, 2024-07-24T22:19:42.306 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 194464, 2024-07-24T22:19:42.306 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:42.306 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-07-24T22:19:42.306 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.016941995, 2024-07-24T22:19:42.306 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.013268857, 2024-07-24T22:19:42.306 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.001490430, 2024-07-24T22:19:42.306 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 200, 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.010408864, 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000052044 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 320, 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 194464 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:42.307 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-07-24T22:19:42.308 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 0, 2024-07-24T22:19:42.308 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 2, 2024-07-24T22:19:42.308 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 0, 2024-07-24T22:19:42.308 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 0, 2024-07-24T22:19:42.308 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-07-24T22:19:42.308 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-07-24T22:19:42.308 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.000273939, 2024-07-24T22:19:42.308 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000000000, 2024-07-24T22:19:42.308 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.000183225, 2024-07-24T22:19:42.308 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:42.308 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:42.308 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:42.308 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:42.309 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:42.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:42.309 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:42.309 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:42.309 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:42.309 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:42.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:42.309 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 0, 2024-07-24T22:19:42.309 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 0 2024-07-24T22:19:42.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:42.309 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-07-24T22:19:42.309 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-07-24T22:19:42.309 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-07-24T22:19:42.310 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-07-24T22:19:42.311 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 147898, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 27, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-07-24T22:19:42.312 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-07-24T22:19:42.313 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-07-24T22:19:42.313 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-07-24T22:19:42.313 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-07-24T22:19:42.313 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-07-24T22:19:42.313 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-07-24T22:19:42.313 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-07-24T22:19:42.313 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-07-24T22:19:42.313 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-07-24T22:19:42.313 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-07-24T22:19:42.313 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-07-24T22:19:42.313 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-07-24T22:19:42.313 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-07-24T22:19:42.313 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 928, 2024-07-24T22:19:42.314 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-07-24T22:19:42.314 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-07-24T22:19:42.314 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-07-24T22:19:42.314 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-07-24T22:19:42.314 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-07-24T22:19:42.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-07-24T22:19:42.314 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-07-24T22:19:42.314 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-07-24T22:19:42.314 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-07-24T22:19:42.314 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-07-24T22:19:42.314 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 272, 2024-07-24T22:19:42.314 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 947281, 2024-07-24T22:19:42.314 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:42.315 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 272, 2024-07-24T22:19:42.315 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-07-24T22:19:42.315 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-07-24T22:19:42.315 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 272, 2024-07-24T22:19:42.315 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 947281, 2024-07-24T22:19:42.315 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-07-24T22:19:42.315 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-07-24T22:19:42.315 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-07-24T22:19:42.315 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-07-24T22:19:42.315 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:42.315 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-07-24T22:19:42.315 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-07-24T22:19:43.088 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-07-24T22:19:43.088 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-07-24T22:19:43.088 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-07-24T22:19:43.089 DEBUG:tasks.check_counter:Getting stats from b 2024-07-24T22:19:43.089 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph daemon mds.b perf dump 2024-07-24T22:19:43.352 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.b/config 2024-07-24T22:19:43.786 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:43 smithi183 ceph-mon[37007]: pgmap v755: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:43.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:43 smithi188 ceph-mon[37380]: pgmap v755: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:43.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:43 smithi047 ceph-mon[32551]: pgmap v755: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:45.126 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-07-24T22:19:45.126 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-07-24T22:19:45.126 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 267, 2024-07-24T22:19:45.126 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 259, 2024-07-24T22:19:45.126 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 986400, 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 159408, 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 0, 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.042593162, 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.017483997, 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.031758459, 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 259, 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.019242121, 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000074293 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:45.127 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:45.128 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:45.128 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:45.128 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:45.128 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 986400, 2024-07-24T22:19:45.128 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 159408 2024-07-24T22:19:45.128 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:45.128 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-07-24T22:19:45.128 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 2, 2024-07-24T22:19:45.128 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 197, 2024-07-24T22:19:45.128 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 320, 2024-07-24T22:19:45.128 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 193584, 2024-07-24T22:19:45.128 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:45.129 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 2, 2024-07-24T22:19:45.129 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.011938127, 2024-07-24T22:19:45.129 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.008728546, 2024-07-24T22:19:45.129 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.001096081, 2024-07-24T22:19:45.129 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:45.129 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:45.129 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 195, 2024-07-24T22:19:45.129 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.011385362, 2024-07-24T22:19:45.129 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000058386 2024-07-24T22:19:45.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:45.129 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:45.129 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:45.130 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:45.130 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:45.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:45.130 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 320, 2024-07-24T22:19:45.130 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 193584 2024-07-24T22:19:45.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:45.130 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-07-24T22:19:45.130 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 0, 2024-07-24T22:19:45.130 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 2, 2024-07-24T22:19:45.130 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 0, 2024-07-24T22:19:45.130 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 0, 2024-07-24T22:19:45.130 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 2, 2024-07-24T22:19:45.130 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 1, 2024-07-24T22:19:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.000303948, 2024-07-24T22:19:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.000000000, 2024-07-24T22:19:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.000243239, 2024-07-24T22:19:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:45.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:45.132 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 0, 2024-07-24T22:19:45.132 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 0 2024-07-24T22:19:45.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:45.132 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-07-24T22:19:45.132 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 0, 2024-07-24T22:19:45.132 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-07-24T22:19:45.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:45.132 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-07-24T22:19:45.132 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-07-24T22:19:45.132 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-07-24T22:19:45.132 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-07-24T22:19:45.132 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-07-24T22:19:45.133 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-07-24T22:19:45.133 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-07-24T22:19:45.133 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-07-24T22:19:45.133 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-07-24T22:19:45.133 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-07-24T22:19:45.133 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-07-24T22:19:45.133 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-07-24T22:19:45.133 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-07-24T22:19:45.133 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-07-24T22:19:45.133 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-07-24T22:19:45.133 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-07-24T22:19:45.133 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-07-24T22:19:45.133 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-07-24T22:19:45.134 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-07-24T22:19:45.134 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-07-24T22:19:45.134 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-07-24T22:19:45.134 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-07-24T22:19:45.134 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-07-24T22:19:45.134 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-07-24T22:19:45.134 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-07-24T22:19:45.134 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-07-24T22:19:45.134 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-07-24T22:19:45.134 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-07-24T22:19:45.134 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-07-24T22:19:45.134 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-07-24T22:19:45.134 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-07-24T22:19:45.135 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-07-24T22:19:45.135 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-07-24T22:19:45.135 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-07-24T22:19:45.135 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-07-24T22:19:45.135 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-07-24T22:19:45.135 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-07-24T22:19:45.135 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 147937, 2024-07-24T22:19:45.135 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 28, 2024-07-24T22:19:45.135 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-07-24T22:19:45.135 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-07-24T22:19:45.135 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-07-24T22:19:45.135 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-07-24T22:19:45.135 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-07-24T22:19:45.136 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-07-24T22:19:45.136 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-07-24T22:19:45.136 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-07-24T22:19:45.136 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 0, 2024-07-24T22:19:45.136 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 0, 2024-07-24T22:19:45.136 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-07-24T22:19:45.136 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-07-24T22:19:45.136 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-07-24T22:19:45.136 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-07-24T22:19:45.136 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 928, 2024-07-24T22:19:45.136 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 2, 2024-07-24T22:19:45.136 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-07-24T22:19:45.137 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-07-24T22:19:45.137 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-07-24T22:19:45.137 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-07-24T22:19:45.137 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:45.137 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-07-24T22:19:45.137 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-07-24T22:19:45.137 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-07-24T22:19:45.137 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-07-24T22:19:45.137 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 265, 2024-07-24T22:19:45.137 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 946307, 2024-07-24T22:19:45.137 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:45.137 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 265, 2024-07-24T22:19:45.137 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-07-24T22:19:45.138 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-07-24T22:19:45.138 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 265, 2024-07-24T22:19:45.138 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 946307, 2024-07-24T22:19:45.138 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-07-24T22:19:45.138 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:45.138 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:45.138 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:45.138 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-07-24T22:19:45.138 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-07-24T22:19:45.138 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-07-24T22:19:45.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:45 smithi183 ceph-mon[37007]: pgmap v756: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:45.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:45 smithi188 ceph-mon[37380]: pgmap v756: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:45.843 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.b 2024-07-24T22:19:45.843 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.b 2024-07-24T22:19:45.843 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.b 2024-07-24T22:19:45.843 DEBUG:tasks.check_counter:Getting stats from e 2024-07-24T22:19:45.844 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph daemon mds.e perf dump 2024-07-24T22:19:45.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:45 smithi047 ceph-mon[32551]: pgmap v756: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:46.104 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.b/config 2024-07-24T22:19:47.604 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:47 smithi183 ceph-mon[37007]: pgmap v757: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:47.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:47 smithi188 ceph-mon[37380]: pgmap v757: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:47.853 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-07-24T22:19:47.853 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-07-24T22:19:47.853 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 4, 2024-07-24T22:19:47.854 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 4, 2024-07-24T22:19:47.854 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 2944, 2024-07-24T22:19:47.854 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 448, 2024-07-24T22:19:47.854 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:47.854 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 0, 2024-07-24T22:19:47.854 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.002980071, 2024-07-24T22:19:47.855 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.000043018, 2024-07-24T22:19:47.855 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.002145240, 2024-07-24T22:19:47.855 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:47.855 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:47.855 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 3, 2024-07-24T22:19:47.856 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.003975803, 2024-07-24T22:19:47.856 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.001325267 2024-07-24T22:19:47.856 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:47.856 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:47.856 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:47.856 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:47.856 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:47.857 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:47.857 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-07-24T22:19:47.857 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 448 2024-07-24T22:19:47.857 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:47.857 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-07-24T22:19:47.857 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 269, 2024-07-24T22:19:47.857 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 263, 2024-07-24T22:19:47.857 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 985152, 2024-07-24T22:19:47.857 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 162320, 2024-07-24T22:19:47.857 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 2, 2024-07-24T22:19:47.857 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 1, 2024-07-24T22:19:47.858 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.041335200, 2024-07-24T22:19:47.858 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.017942708, 2024-07-24T22:19:47.858 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.031559182, 2024-07-24T22:19:47.858 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:47.858 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:47.858 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 262, 2024-07-24T22:19:47.858 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.014793642, 2024-07-24T22:19:47.858 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000056464 2024-07-24T22:19:47.858 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:47.858 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:47.858 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:47.858 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:47.858 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:47.859 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:47.859 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 985152, 2024-07-24T22:19:47.859 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 162320 2024-07-24T22:19:47.859 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:47.859 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-07-24T22:19:47.859 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 2, 2024-07-24T22:19:47.859 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 202, 2024-07-24T22:19:47.859 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 320, 2024-07-24T22:19:47.859 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 194464, 2024-07-24T22:19:47.859 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:47.859 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 2, 2024-07-24T22:19:47.859 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.013217551, 2024-07-24T22:19:47.860 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.009761928, 2024-07-24T22:19:47.860 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.001208516, 2024-07-24T22:19:47.860 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:47.860 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:47.860 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 200, 2024-07-24T22:19:47.860 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.012434890, 2024-07-24T22:19:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000062174 2024-07-24T22:19:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 320, 2024-07-24T22:19:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 194464 2024-07-24T22:19:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-07-24T22:19:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 0, 2024-07-24T22:19:47.861 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-07-24T22:19:47.862 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:47.862 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-07-24T22:19:47.862 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-07-24T22:19:47.862 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-07-24T22:19:47.862 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-07-24T22:19:47.862 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-07-24T22:19:47.862 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-07-24T22:19:47.862 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-07-24T22:19:47.863 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-07-24T22:19:47.863 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-07-24T22:19:47.863 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-07-24T22:19:47.863 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-07-24T22:19:47.863 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-07-24T22:19:47.863 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-07-24T22:19:47.863 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-07-24T22:19:47.863 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-07-24T22:19:47.863 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-07-24T22:19:47.863 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-07-24T22:19:47.863 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-07-24T22:19:47.863 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-07-24T22:19:47.863 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-07-24T22:19:47.864 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-07-24T22:19:47.864 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-07-24T22:19:47.864 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-07-24T22:19:47.864 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-07-24T22:19:47.864 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-07-24T22:19:47.864 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-07-24T22:19:47.864 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-07-24T22:19:47.864 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-07-24T22:19:47.864 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-07-24T22:19:47.864 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-07-24T22:19:47.864 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-07-24T22:19:47.864 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-07-24T22:19:47.865 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-07-24T22:19:47.865 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-07-24T22:19:47.865 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-07-24T22:19:47.865 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-07-24T22:19:47.865 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-07-24T22:19:47.865 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 147898, 2024-07-24T22:19:47.865 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 27, 2024-07-24T22:19:47.865 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-07-24T22:19:47.865 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-07-24T22:19:47.866 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-07-24T22:19:47.866 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-07-24T22:19:47.866 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-07-24T22:19:47.866 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-07-24T22:19:47.866 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-07-24T22:19:47.866 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-07-24T22:19:47.866 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 0, 2024-07-24T22:19:47.866 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 0, 2024-07-24T22:19:47.866 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-07-24T22:19:47.866 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-07-24T22:19:47.867 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-07-24T22:19:47.867 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-07-24T22:19:47.867 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 928, 2024-07-24T22:19:47.870 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 2, 2024-07-24T22:19:47.870 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-07-24T22:19:47.870 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-07-24T22:19:47.870 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-07-24T22:19:47.870 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-07-24T22:19:47.870 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:47.870 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-07-24T22:19:47.870 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-07-24T22:19:47.870 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 271, 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 947151, 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 271, 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 271, 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 947151, 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:47.871 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-07-24T22:19:47.872 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-07-24T22:19:47.872 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-07-24T22:19:47.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:47 smithi047 ceph-mon[32551]: pgmap v757: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:48.506 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-07-24T22:19:48.507 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-07-24T22:19:48.507 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-07-24T22:19:48.507 DEBUG:tasks.check_counter:Getting stats from h 2024-07-24T22:19:48.507 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph daemon mds.h perf dump 2024-07-24T22:19:48.758 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.b/config 2024-07-24T22:19:49.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:49 smithi188 ceph-mon[37380]: pgmap v758: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:49.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:49 smithi183 ceph-mon[37007]: pgmap v758: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:49.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:49 smithi047 ceph-mon[32551]: pgmap v758: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:50.488 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-07-24T22:19:50.488 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-07-24T22:19:50.489 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 268, 2024-07-24T22:19:50.489 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 262, 2024-07-24T22:19:50.489 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 984880, 2024-07-24T22:19:50.489 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 161680, 2024-07-24T22:19:50.489 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:50.490 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 0, 2024-07-24T22:19:50.490 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.043257360, 2024-07-24T22:19:50.490 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.018176363, 2024-07-24T22:19:50.490 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.032870921, 2024-07-24T22:19:50.490 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:50.491 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:50.491 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 261, 2024-07-24T22:19:50.491 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.014636265, 2024-07-24T22:19:50.491 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000056077 2024-07-24T22:19:50.491 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:50.492 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:50.492 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:50.492 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:50.492 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:50.492 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:50.493 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 984880, 2024-07-24T22:19:50.493 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 161680 2024-07-24T22:19:50.493 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:50.493 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-07-24T22:19:50.493 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 6, 2024-07-24T22:19:50.493 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 203, 2024-07-24T22:19:50.494 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 3264, 2024-07-24T22:19:50.494 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 194736, 2024-07-24T22:19:50.494 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:50.494 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 2, 2024-07-24T22:19:50.494 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.015309976, 2024-07-24T22:19:50.494 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.009489796, 2024-07-24T22:19:50.495 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.003563503, 2024-07-24T22:19:50.495 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:50.495 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:50.495 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 202, 2024-07-24T22:19:50.495 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.016685499, 2024-07-24T22:19:50.495 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000082601 2024-07-24T22:19:50.496 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:50.496 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:50.496 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:50.496 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:50.496 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:50.497 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:50.497 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-07-24T22:19:50.497 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 194736 2024-07-24T22:19:50.497 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:50.497 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-07-24T22:19:50.497 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 0, 2024-07-24T22:19:50.498 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 2, 2024-07-24T22:19:50.498 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 0, 2024-07-24T22:19:50.498 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 0, 2024-07-24T22:19:50.498 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 2, 2024-07-24T22:19:50.498 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 1, 2024-07-24T22:19:50.498 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.000332009, 2024-07-24T22:19:50.498 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.000000000, 2024-07-24T22:19:50.498 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.000253937, 2024-07-24T22:19:50.498 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:50.498 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:50.498 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:50.498 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:50.498 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 0, 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 0 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 0, 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:50.499 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-07-24T22:19:50.500 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-07-24T22:19:50.501 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 148721, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 30, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-07-24T22:19:50.502 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 0, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 0, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 928, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 2, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-07-24T22:19:50.503 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 270, 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 947021, 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 270, 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-07-24T22:19:50.504 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 270, 2024-07-24T22:19:50.505 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 947021, 2024-07-24T22:19:50.505 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-07-24T22:19:50.505 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:50.505 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:50.505 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:50.505 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-07-24T22:19:50.505 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-07-24T22:19:50.505 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-07-24T22:19:51.179 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.h 2024-07-24T22:19:51.179 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.h 2024-07-24T22:19:51.179 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.h 2024-07-24T22:19:51.179 DEBUG:tasks.check_counter:Getting stats from k 2024-07-24T22:19:51.180 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph daemon mds.k perf dump 2024-07-24T22:19:51.435 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.b/config 2024-07-24T22:19:51.717 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:51 smithi183 ceph-mon[37007]: pgmap v759: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:51.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:51 smithi188 ceph-mon[37380]: pgmap v759: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:51.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:51 smithi047 ceph-mon[32551]: pgmap v759: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:53.044 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-07-24T22:19:53.044 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-07-24T22:19:53.044 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 0, 2024-07-24T22:19:53.044 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 2, 2024-07-24T22:19:53.044 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 0, 2024-07-24T22:19:53.044 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 0, 2024-07-24T22:19:53.044 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:53.044 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 0, 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.000939216, 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.000000000, 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.000171952, 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:53.045 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:53.046 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 0, 2024-07-24T22:19:53.046 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 0 2024-07-24T22:19:53.046 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:53.046 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-07-24T22:19:53.046 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 274, 2024-07-24T22:19:53.046 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 268, 2024-07-24T22:19:53.046 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 986608, 2024-07-24T22:19:53.046 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 165184, 2024-07-24T22:19:53.046 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 2, 2024-07-24T22:19:53.046 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 1, 2024-07-24T22:19:53.046 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.044445087, 2024-07-24T22:19:53.046 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.019160046, 2024-07-24T22:19:53.046 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.033439640, 2024-07-24T22:19:53.047 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:53.047 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:53.047 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 267, 2024-07-24T22:19:53.047 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.016647151, 2024-07-24T22:19:53.047 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000062348 2024-07-24T22:19:53.047 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:53.047 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:53.047 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:53.047 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:53.047 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:53.047 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:53.047 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 986608, 2024-07-24T22:19:53.047 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 165184 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 6, 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 207, 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 3264, 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 195440, 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 2, 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.015656558, 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.010197053, 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.003041448, 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:53.048 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 206, 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.017149654, 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000083250 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 195440 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 0, 2024-07-24T22:19:53.049 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-07-24T22:19:53.050 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:53.050 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-07-24T22:19:53.050 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-07-24T22:19:53.050 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-07-24T22:19:53.050 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-07-24T22:19:53.050 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-07-24T22:19:53.050 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-07-24T22:19:53.050 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-07-24T22:19:53.051 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-07-24T22:19:53.051 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-07-24T22:19:53.051 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-07-24T22:19:53.051 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-07-24T22:19:53.051 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-07-24T22:19:53.051 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-07-24T22:19:53.051 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-07-24T22:19:53.052 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-07-24T22:19:53.052 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-07-24T22:19:53.052 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-07-24T22:19:53.052 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-07-24T22:19:53.052 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-07-24T22:19:53.052 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-07-24T22:19:53.052 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-07-24T22:19:53.052 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-07-24T22:19:53.052 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-07-24T22:19:53.052 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-07-24T22:19:53.053 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 147977, 2024-07-24T22:19:53.054 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 29, 2024-07-24T22:19:53.054 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-07-24T22:19:53.054 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-07-24T22:19:53.054 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-07-24T22:19:53.054 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-07-24T22:19:53.054 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-07-24T22:19:53.054 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-07-24T22:19:53.054 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-07-24T22:19:53.054 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-07-24T22:19:53.054 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 0, 2024-07-24T22:19:53.054 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 0, 2024-07-24T22:19:53.054 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-07-24T22:19:53.054 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-07-24T22:19:53.055 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-07-24T22:19:53.055 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-07-24T22:19:53.055 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 928, 2024-07-24T22:19:53.055 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 2, 2024-07-24T22:19:53.055 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-07-24T22:19:53.055 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-07-24T22:19:53.056 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-07-24T22:19:53.056 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-07-24T22:19:53.056 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-07-24T22:19:53.056 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-07-24T22:19:53.056 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-07-24T22:19:53.056 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-07-24T22:19:53.056 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-07-24T22:19:53.057 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 276, 2024-07-24T22:19:53.057 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 947904, 2024-07-24T22:19:53.057 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:53.057 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 276, 2024-07-24T22:19:53.057 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-07-24T22:19:53.057 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-07-24T22:19:53.057 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 276, 2024-07-24T22:19:53.057 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 947904, 2024-07-24T22:19:53.057 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-07-24T22:19:53.058 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-07-24T22:19:53.058 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-07-24T22:19:53.058 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-07-24T22:19:53.058 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-07-24T22:19:53.058 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-07-24T22:19:53.058 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-07-24T22:19:53.662 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:53 smithi183 ceph-mon[37007]: pgmap v760: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:53.730 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-07-24T22:19:53.730 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-07-24T22:19:53.730 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-07-24T22:19:53.730 DEBUG:tasks.check_counter:Getting stats from c 2024-07-24T22:19:53.731 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph daemon mds.c perf dump 2024-07-24T22:19:53.757 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:53 smithi188 ceph-mon[37380]: pgmap v760: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:53.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:53 smithi047 ceph-mon[32551]: pgmap v760: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:53.996 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T22:19:55.674 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:55 smithi188 ceph-mon[37380]: pgmap v761: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:55.728 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:55 smithi183 ceph-mon[37007]: pgmap v761: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:55.778 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-07-24T22:19:55.778 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-0": { 2024-07-24T22:19:55.778 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 1665, 2024-07-24T22:19:55.778 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 1667, 2024-07-24T22:19:55.781 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 185091630, 2024-07-24T22:19:55.781 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 529480, 2024-07-24T22:19:55.781 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 8, 2024-07-24T22:19:55.782 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 4, 2024-07-24T22:19:55.782 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.273780647, 2024-07-24T22:19:55.782 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.051119673, 2024-07-24T22:19:55.782 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.148662097, 2024-07-24T22:19:55.782 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.057513632, 2024-07-24T22:19:55.782 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:55.782 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1665, 2024-07-24T22:19:55.782 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.075389174, 2024-07-24T22:19:55.782 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000045278 2024-07-24T22:19:55.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.782 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 0, 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 0 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-1": { 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 911, 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 1110, 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 139336457, 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 719774, 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 7, 2024-07-24T22:19:55.783 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 6, 2024-07-24T22:19:55.784 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.183346946, 2024-07-24T22:19:55.784 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.032077352, 2024-07-24T22:19:55.784 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.118593224, 2024-07-24T22:19:55.784 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.022901290, 2024-07-24T22:19:55.784 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:55.784 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1109, 2024-07-24T22:19:55.784 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.049146258, 2024-07-24T22:19:55.784 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000044315 2024-07-24T22:19:55.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.784 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:55.784 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.784 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.784 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.785 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-07-24T22:19:55.785 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 431600 2024-07-24T22:19:55.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.785 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-2": { 2024-07-24T22:19:55.785 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 1272, 2024-07-24T22:19:55.785 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 1265, 2024-07-24T22:19:55.785 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 127103939, 2024-07-24T22:19:55.785 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 477793, 2024-07-24T22:19:55.785 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 5, 2024-07-24T22:19:55.785 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 4, 2024-07-24T22:19:55.785 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.206611601, 2024-07-24T22:19:55.785 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.050252774, 2024-07-24T22:19:55.786 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.127305482, 2024-07-24T22:19:55.786 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.029856699, 2024-07-24T22:19:55.786 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:55.786 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1264, 2024-07-24T22:19:55.786 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.053866741, 2024-07-24T22:19:55.786 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000042616 2024-07-24T22:19:55.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.786 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:55.786 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.786 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.786 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.786 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 1010096, 2024-07-24T22:19:55.787 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 167424 2024-07-24T22:19:55.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.787 INFO:teuthology.orchestra.run.smithi188.stdout: "cct": { 2024-07-24T22:19:55.787 INFO:teuthology.orchestra.run.smithi188.stdout: "total_workers": 1, 2024-07-24T22:19:55.787 INFO:teuthology.orchestra.run.smithi188.stdout: "unhealthy_workers": 0 2024-07-24T22:19:55.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.787 INFO:teuthology.orchestra.run.smithi188.stdout: "finisher-MDSRank": { 2024-07-24T22:19:55.787 INFO:teuthology.orchestra.run.smithi188.stdout: "queue_len": 0, 2024-07-24T22:19:55.787 INFO:teuthology.orchestra.run.smithi188.stdout: "complete_latency": { 2024-07-24T22:19:55.787 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 5515, 2024-07-24T22:19:55.787 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.160158529, 2024-07-24T22:19:55.787 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000029040 2024-07-24T22:19:55.787 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:19:55.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.788 INFO:teuthology.orchestra.run.smithi188.stdout: "finisher-PurgeQueue": { 2024-07-24T22:19:55.788 INFO:teuthology.orchestra.run.smithi188.stdout: "queue_len": 0, 2024-07-24T22:19:55.788 INFO:teuthology.orchestra.run.smithi188.stdout: "complete_latency": { 2024-07-24T22:19:55.788 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.788 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.788 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.788 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:19:55.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.788 INFO:teuthology.orchestra.run.smithi188.stdout: "mds": { 2024-07-24T22:19:55.788 INFO:teuthology.orchestra.run.smithi188.stdout: "request": 0, 2024-07-24T22:19:55.788 INFO:teuthology.orchestra.run.smithi188.stdout: "reply": 0, 2024-07-24T22:19:55.788 INFO:teuthology.orchestra.run.smithi188.stdout: "reply_latency": { 2024-07-24T22:19:55.789 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.789 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.789 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.789 INFO:teuthology.orchestra.run.smithi188.stdout: "slow_reply": 0, 2024-07-24T22:19:55.789 INFO:teuthology.orchestra.run.smithi188.stdout: "forward": 0, 2024-07-24T22:19:55.789 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_fetch_complete": 0, 2024-07-24T22:19:55.789 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_fetch_keys": 0, 2024-07-24T22:19:55.789 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_commit": 0, 2024-07-24T22:19:55.789 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_split": 0, 2024-07-24T22:19:55.789 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_merge": 0, 2024-07-24T22:19:55.789 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes": 129, 2024-07-24T22:19:55.789 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_top": 40, 2024-07-24T22:19:55.790 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_bottom": 89, 2024-07-24T22:19:55.790 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_pin_tail": 0, 2024-07-24T22:19:55.790 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_pinned": 10, 2024-07-24T22:19:55.790 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_expired": 0, 2024-07-24T22:19:55.790 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_with_caps": 0, 2024-07-24T22:19:55.790 INFO:teuthology.orchestra.run.smithi188.stdout: "caps": 0, 2024-07-24T22:19:55.790 INFO:teuthology.orchestra.run.smithi188.stdout: "subtrees": 2, 2024-07-24T22:19:55.790 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse": 0, 2024-07-24T22:19:55.790 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_hit": 0, 2024-07-24T22:19:55.790 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_forward": 0, 2024-07-24T22:19:55.790 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_discover": 0, 2024-07-24T22:19:55.790 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_dir_fetch": 0, 2024-07-24T22:19:55.790 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_remote_ino": 0, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_lock": 0, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "load_cent": 0, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "q": 0, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "exported": 0, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "exported_inodes": 0, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "imported": 0, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "imported_inodes": 0, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_dir_fetch": 0, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_backtrace_fetch": 0, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_peer_discover": 0, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rfiles": 4, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rbytes": 234, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rsnaps": 6, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_backtrace_fetch": 0, 2024-07-24T22:19:55.791 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_set_tag": 0, 2024-07-24T22:19:55.792 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_backtrace_repaired": 0, 2024-07-24T22:19:55.792 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_inotable_repaired": 0, 2024-07-24T22:19:55.792 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dir_inodes": 0, 2024-07-24T22:19:55.792 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dir_base_inodes": 0, 2024-07-24T22:19:55.792 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dirfrag_rstats": 0, 2024-07-24T22:19:55.792 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_file_inodes": 0, 2024-07-24T22:19:55.792 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_inode_file_caps": 0, 2024-07-24T22:19:55.792 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_revoke": 0, 2024-07-24T22:19:55.792 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_grant": 0, 2024-07-24T22:19:55.792 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_trunc": 0, 2024-07-24T22:19:55.792 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-07-24T22:19:55.792 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_flush_ack": 0, 2024-07-24T22:19:55.793 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_caps": 0, 2024-07-24T22:19:55.793 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_caps_dirty": 0, 2024-07-24T22:19:55.793 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_cap_release": 0, 2024-07-24T22:19:55.793 INFO:teuthology.orchestra.run.smithi188.stdout: "process_request_cap_release": 0 2024-07-24T22:19:55.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.793 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_cache": { 2024-07-24T22:19:55.793 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_update": 0, 2024-07-24T22:19:55.793 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_update_receipt": 0, 2024-07-24T22:19:55.793 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_try_discover": 0, 2024-07-24T22:19:55.793 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_send_discover": 0, 2024-07-24T22:19:55.793 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_handle_discover": 0, 2024-07-24T22:19:55.793 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays": 0, 2024-07-24T22:19:55.793 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays_delayed": 0, 2024-07-24T22:19:55.794 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays_enqueuing": 0, 2024-07-24T22:19:55.794 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_created": 0, 2024-07-24T22:19:55.794 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_enqueued": 0, 2024-07-24T22:19:55.794 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_reintegrated": 0, 2024-07-24T22:19:55.794 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_migrated": 0, 2024-07-24T22:19:55.794 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_processing": 0, 2024-07-24T22:19:55.794 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_enqueued": 0, 2024-07-24T22:19:55.794 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_prioritized": 0, 2024-07-24T22:19:55.794 INFO:teuthology.orchestra.run.smithi188.stdout: "recovery_started": 0, 2024-07-24T22:19:55.794 INFO:teuthology.orchestra.run.smithi188.stdout: "recovery_completed": 0, 2024-07-24T22:19:55.794 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_quiesce_path": 0, 2024-07-24T22:19:55.794 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_quiesce_inode": 0, 2024-07-24T22:19:55.794 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_enqueue_scrub": 0, 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_exportdir": 0, 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_flush": 0, 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_fragmentdir": 0, 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_fragstats": 0, 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_inodestats": 0 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_log": { 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: "evlrg": 0, 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: "evadd": 0, 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: "evex": 0, 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: "evtrm": 0, 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: "ev": 141011, 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: "evexg": 0, 2024-07-24T22:19:55.795 INFO:teuthology.orchestra.run.smithi188.stdout: "evexd": 0, 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "segadd": 0, 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "segex": 0, 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "segtrm": 0, 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "seg": 2, 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "segmjr": 57, 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "segexg": 0, 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "segexd": 0, 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "expos": 453605546, 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "wrpos": 453643554, 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "rdpos": 453643442, 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "jlat": { 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.796 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.797 INFO:teuthology.orchestra.run.smithi188.stdout: "replayed": 141011 2024-07-24T22:19:55.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.797 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_mem": { 2024-07-24T22:19:55.797 INFO:teuthology.orchestra.run.smithi188.stdout: "ino": 86, 2024-07-24T22:19:55.797 INFO:teuthology.orchestra.run.smithi188.stdout: "ino+": 104, 2024-07-24T22:19:55.797 INFO:teuthology.orchestra.run.smithi188.stdout: "ino-": 18, 2024-07-24T22:19:55.797 INFO:teuthology.orchestra.run.smithi188.stdout: "dir": 13, 2024-07-24T22:19:55.797 INFO:teuthology.orchestra.run.smithi188.stdout: "dir+": 13, 2024-07-24T22:19:55.797 INFO:teuthology.orchestra.run.smithi188.stdout: "dir-": 0, 2024-07-24T22:19:55.797 INFO:teuthology.orchestra.run.smithi188.stdout: "dn": 129, 2024-07-24T22:19:55.797 INFO:teuthology.orchestra.run.smithi188.stdout: "dn+": 129, 2024-07-24T22:19:55.797 INFO:teuthology.orchestra.run.smithi188.stdout: "dn-": 0, 2024-07-24T22:19:55.798 INFO:teuthology.orchestra.run.smithi188.stdout: "cap": 0, 2024-07-24T22:19:55.798 INFO:teuthology.orchestra.run.smithi188.stdout: "cap+": 0, 2024-07-24T22:19:55.798 INFO:teuthology.orchestra.run.smithi188.stdout: "cap-": 0, 2024-07-24T22:19:55.798 INFO:teuthology.orchestra.run.smithi188.stdout: "rss": 51416, 2024-07-24T22:19:55.798 INFO:teuthology.orchestra.run.smithi188.stdout: "heap": 215320 2024-07-24T22:19:55.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.798 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_server": { 2024-07-24T22:19:55.798 INFO:teuthology.orchestra.run.smithi188.stdout: "dispatch_client_request": 0, 2024-07-24T22:19:55.798 INFO:teuthology.orchestra.run.smithi188.stdout: "dispatch_server_request": 0, 2024-07-24T22:19:55.798 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_request": 0, 2024-07-24T22:19:55.798 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_session": 0, 2024-07-24T22:19:55.798 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_peer_request": 0, 2024-07-24T22:19:55.798 INFO:teuthology.orchestra.run.smithi188.stdout: "req_create_latency": { 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getattr_latency": { 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getfilelock_latency": { 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.799 INFO:teuthology.orchestra.run.smithi188.stdout: "req_link_latency": { 2024-07-24T22:19:55.800 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.800 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.800 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.800 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookup_latency": { 2024-07-24T22:19:55.800 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.800 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.800 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.800 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookuphash_latency": { 2024-07-24T22:19:55.800 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.800 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.800 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupino_latency": { 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupname_latency": { 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupparent_latency": { 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.801 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.802 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.802 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupsnap_latency": { 2024-07-24T22:19:55.802 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.802 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.802 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.802 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lssnap_latency": { 2024-07-24T22:19:55.802 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.802 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.802 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.803 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mkdir_latency": { 2024-07-24T22:19:55.803 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.803 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.803 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.803 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mknod_latency": { 2024-07-24T22:19:55.804 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.804 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.804 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.804 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mksnap_latency": { 2024-07-24T22:19:55.804 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.804 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.804 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.804 INFO:teuthology.orchestra.run.smithi188.stdout: "req_open_latency": { 2024-07-24T22:19:55.804 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.804 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.804 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.805 INFO:teuthology.orchestra.run.smithi188.stdout: "req_readdir_latency": { 2024-07-24T22:19:55.805 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.805 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.805 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.805 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rename_latency": { 2024-07-24T22:19:55.805 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.805 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.805 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.805 INFO:teuthology.orchestra.run.smithi188.stdout: "req_renamesnap_latency": { 2024-07-24T22:19:55.805 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: "req_snapdiff_latency": { 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmdir_latency": { 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.806 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmsnap_latency": { 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmxattr_latency": { 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setattr_latency": { 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.808 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setdirlayout_latency": { 2024-07-24T22:19:55.808 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.808 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.808 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.808 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setfilelock_latency": { 2024-07-24T22:19:55.808 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.808 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.808 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.808 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setlayout_latency": { 2024-07-24T22:19:55.808 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.808 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setxattr_latency": { 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: "req_symlink_latency": { 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: "req_unlink_latency": { 2024-07-24T22:19:55.809 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.810 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.810 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.810 INFO:teuthology.orchestra.run.smithi188.stdout: "cap_revoke_eviction": 0, 2024-07-24T22:19:55.810 INFO:teuthology.orchestra.run.smithi188.stdout: "cap_acquisition_throttle": 0, 2024-07-24T22:19:55.810 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getvxattr_latency": { 2024-07-24T22:19:55.810 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.810 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.810 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.810 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:19:55.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.810 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_sessions": { 2024-07-24T22:19:55.810 INFO:teuthology.orchestra.run.smithi188.stdout: "session_count": 2, 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: "session_add": 3, 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: "session_remove": 1, 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: "sessions_open": 2, 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: "sessions_stale": 0, 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: "total_load": 0, 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: "average_load": 0, 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: "avg_session_uptime": 2190, 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: "mdthresh_evicted": 0 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: "mempool": { 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_bytes": 0, 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_items": 0, 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_bytes": 0, 2024-07-24T22:19:55.811 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_items": 0, 2024-07-24T22:19:55.812 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_bytes": 0, 2024-07-24T22:19:55.812 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_items": 0, 2024-07-24T22:19:55.812 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_bytes": 0, 2024-07-24T22:19:55.812 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_items": 0, 2024-07-24T22:19:55.812 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_bytes": 0, 2024-07-24T22:19:55.812 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_items": 0, 2024-07-24T22:19:55.812 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_bytes": 0, 2024-07-24T22:19:55.812 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_items": 0, 2024-07-24T22:19:55.812 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_bytes": 0, 2024-07-24T22:19:55.812 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_items": 0, 2024-07-24T22:19:55.812 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_bytes": 0, 2024-07-24T22:19:55.812 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_items": 0, 2024-07-24T22:19:55.812 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_bytes": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_items": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_bytes": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_items": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_bytes": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_items": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_bytes": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_items": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_bytes": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_items": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_bytes": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_items": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_bytes": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_items": 0, 2024-07-24T22:19:55.813 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_bytes": 0, 2024-07-24T22:19:55.814 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_items": 0, 2024-07-24T22:19:55.814 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_bytes": 0, 2024-07-24T22:19:55.814 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_items": 0, 2024-07-24T22:19:55.814 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_bytes": 0, 2024-07-24T22:19:55.814 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_items": 0, 2024-07-24T22:19:55.814 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_bytes": 242369, 2024-07-24T22:19:55.814 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_items": 158, 2024-07-24T22:19:55.814 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_bytes": 0, 2024-07-24T22:19:55.814 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_items": 0, 2024-07-24T22:19:55.814 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_bytes": 0, 2024-07-24T22:19:55.814 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_items": 0, 2024-07-24T22:19:55.814 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_bytes": 0, 2024-07-24T22:19:55.814 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_items": 0, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_bytes": 0, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_items": 0, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_bytes": 8360, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_items": 185, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_bytes": 0, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_items": 0, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_bytes": 0, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_items": 0, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_bytes": 321097, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_items": 3388, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_bytes": 0, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_items": 0, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_bytes": 0, 2024-07-24T22:19:55.815 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_items": 0 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: "objecter": { 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: "op_active": 0, 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: "op_laggy": 0, 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: "op_send": 3547, 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: "op_send_bytes": 26, 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: "op_resend": 4, 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: "op_reply": 3547, 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: "op_latency": { 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 3547, 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 41.150211024, 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.011601412 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.816 INFO:teuthology.orchestra.run.smithi188.stdout: "op_inflight": 0, 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "oplen_avg": { 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 3547, 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 3548 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "op": 3547, 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "op_r": 3547, 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "op_w": 0, 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "op_rmw": 0, 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "op_pg": 0, 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_stat": 2299, 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_create": 0, 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_read": 1245, 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_write": 0, 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_writefull": 0, 2024-07-24T22:19:55.817 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_writesame": 0, 2024-07-24T22:19:55.818 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_append": 0, 2024-07-24T22:19:55.818 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_zero": 0, 2024-07-24T22:19:55.818 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_truncate": 0, 2024-07-24T22:19:55.818 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_delete": 0, 2024-07-24T22:19:55.818 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_mapext": 0, 2024-07-24T22:19:55.818 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_sparse_read": 0, 2024-07-24T22:19:55.818 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_clonerange": 0, 2024-07-24T22:19:55.818 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_getxattr": 2, 2024-07-24T22:19:55.818 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_setxattr": 0, 2024-07-24T22:19:55.818 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_cmpxattr": 0, 2024-07-24T22:19:55.818 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_rmxattr": 0, 2024-07-24T22:19:55.818 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_resetxattrs": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_call": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_watch": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_notify": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_src_cmpxattr": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_pgls": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_pgls_filter": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_other": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_active": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_send": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_resend": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_ping": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_active": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_send": 0, 2024-07-24T22:19:55.819 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_resend": 0, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_active": 0, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_send": 0, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_resend": 0, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_active": 0, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_send": 0, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_resend": 0, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "command_active": 0, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "command_send": 0, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "command_resend": 0, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "map_epoch": 99, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "map_full": 0, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "map_inc": 18, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_sessions": 11, 2024-07-24T22:19:55.820 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_session_open": 11, 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_session_close": 0, 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_laggy": 0, 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_wr": 0, 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_rd": 2, 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_del": 0 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: "oft": { 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_objs": 0, 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_kv_pairs": 0, 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_updates": 0, 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_removes": 0 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: "osd-slow-ops": { 2024-07-24T22:19:55.821 INFO:teuthology.orchestra.run.smithi188.stdout: "slow_ops_count": 0 2024-07-24T22:19:55.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.822 INFO:teuthology.orchestra.run.smithi188.stdout: "purge_queue": { 2024-07-24T22:19:55.822 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_ops": 0, 2024-07-24T22:19:55.822 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_ops_high_water": 0, 2024-07-24T22:19:55.822 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing": 0, 2024-07-24T22:19:55.822 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_high_water": 0, 2024-07-24T22:19:55.822 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executed_ops": 0, 2024-07-24T22:19:55.822 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executed": 0, 2024-07-24T22:19:55.822 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_item_in_journal": 0 2024-07-24T22:19:55.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.822 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-07-24T22:19:55.822 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 3844, 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 451167972, 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 3844, 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 3844, 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 451167972, 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.823 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:19:55.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.824 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-objecter_bytes": { 2024-07-24T22:19:55.824 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-07-24T22:19:55.824 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-07-24T22:19:55.824 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-07-24T22:19:55.824 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-07-24T22:19:55.824 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-07-24T22:19:55.824 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:55.824 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-07-24T22:19:55.824 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 3547, 2024-07-24T22:19:55.824 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 449539724, 2024-07-24T22:19:55.824 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 3547, 2024-07-24T22:19:55.824 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 449539724, 2024-07-24T22:19:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-07-24T22:19:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:19:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-objecter_ops": { 2024-07-24T22:19:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-07-24T22:19:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 1024, 2024-07-24T22:19:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-07-24T22:19:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-07-24T22:19:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-07-24T22:19:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 3547, 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 3547, 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 3547, 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 3547, 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-write_buf_throttle": { 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-07-24T22:19:55.826 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 3758096384, 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 0, 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 0, 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.827 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:19:55.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:55.828 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-write_buf_throttle-0x55ce94264960": { 2024-07-24T22:19:55.828 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-07-24T22:19:55.828 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 3758096384, 2024-07-24T22:19:55.828 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-07-24T22:19:55.828 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-07-24T22:19:55.828 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-07-24T22:19:55.828 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:55.828 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-07-24T22:19:55.828 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-07-24T22:19:55.828 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-07-24T22:19:55.828 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 0, 2024-07-24T22:19:55.828 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 0, 2024-07-24T22:19:55.829 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-07-24T22:19:55.829 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:55.829 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:55.829 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:55.829 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:19:55.829 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:19:55.829 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-07-24T22:19:55.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:55 smithi047 ceph-mon[32551]: pgmap v761: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:56.699 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-07-24T22:19:56.699 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-07-24T22:19:56.700 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-07-24T22:19:56.700 DEBUG:tasks.check_counter:Getting stats from f 2024-07-24T22:19:56.700 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph daemon mds.f perf dump 2024-07-24T22:19:57.000 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T22:19:57.541 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:57 smithi188 ceph-mon[37380]: pgmap v762: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:57.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:57 smithi183 ceph-mon[37007]: pgmap v762: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:57.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:57 smithi047 ceph-mon[32551]: pgmap v762: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:19:58.699 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-07-24T22:19:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-0": { 2024-07-24T22:19:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 0, 2024-07-24T22:19:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 2, 2024-07-24T22:19:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 0, 2024-07-24T22:19:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 0, 2024-07-24T22:19:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 0, 2024-07-24T22:19:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.001216821, 2024-07-24T22:19:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.000000000, 2024-07-24T22:19:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.000289061, 2024-07-24T22:19:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 0, 2024-07-24T22:19:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 0 2024-07-24T22:19:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-1": { 2024-07-24T22:19:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 2, 2024-07-24T22:19:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 204, 2024-07-24T22:19:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 320, 2024-07-24T22:19:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 194816, 2024-07-24T22:19:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 4, 2024-07-24T22:19:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 2, 2024-07-24T22:19:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.012801309, 2024-07-24T22:19:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.009350355, 2024-07-24T22:19:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.001207575, 2024-07-24T22:19:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 202, 2024-07-24T22:19:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.012111464, 2024-07-24T22:19:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000059957 2024-07-24T22:19:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 320, 2024-07-24T22:19:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 194816 2024-07-24T22:19:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-2": { 2024-07-24T22:19:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 277, 2024-07-24T22:19:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 269, 2024-07-24T22:19:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 989280, 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 164992, 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 2, 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 1, 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.044217921, 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.018391215, 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.034667475, 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 269, 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.018979502, 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000070555 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 989280, 2024-07-24T22:19:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 164992 2024-07-24T22:19:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "cct": { 2024-07-24T22:19:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "total_workers": 0, 2024-07-24T22:19:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "unhealthy_workers": 0 2024-07-24T22:19:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "mempool": { 2024-07-24T22:19:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_bytes": 0, 2024-07-24T22:19:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_items": 0, 2024-07-24T22:19:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_bytes": 0, 2024-07-24T22:19:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_items": 0, 2024-07-24T22:19:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_bytes": 0, 2024-07-24T22:19:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_items": 0, 2024-07-24T22:19:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_bytes": 0, 2024-07-24T22:19:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_items": 0, 2024-07-24T22:19:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_bytes": 0, 2024-07-24T22:19:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_items": 0, 2024-07-24T22:19:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_bytes": 0, 2024-07-24T22:19:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_items": 0, 2024-07-24T22:19:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_bytes": 0, 2024-07-24T22:19:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_items": 0, 2024-07-24T22:19:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_bytes": 0, 2024-07-24T22:19:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_items": 0, 2024-07-24T22:19:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_bytes": 0, 2024-07-24T22:19:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_items": 0, 2024-07-24T22:19:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_bytes": 0, 2024-07-24T22:19:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_items": 0, 2024-07-24T22:19:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_bytes": 0, 2024-07-24T22:19:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_items": 0, 2024-07-24T22:19:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_bytes": 0, 2024-07-24T22:19:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_items": 0, 2024-07-24T22:19:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_bytes": 0, 2024-07-24T22:19:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_items": 0, 2024-07-24T22:19:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_bytes": 0, 2024-07-24T22:19:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_items": 0, 2024-07-24T22:19:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_bytes": 0, 2024-07-24T22:19:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_items": 0, 2024-07-24T22:19:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_bytes": 0, 2024-07-24T22:19:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_items": 0, 2024-07-24T22:19:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_bytes": 0, 2024-07-24T22:19:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_items": 0, 2024-07-24T22:19:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_bytes": 0, 2024-07-24T22:19:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_items": 0, 2024-07-24T22:19:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_bytes": 147960, 2024-07-24T22:19:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_items": 28, 2024-07-24T22:19:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_bytes": 0, 2024-07-24T22:19:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_items": 0, 2024-07-24T22:19:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_bytes": 0, 2024-07-24T22:19:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_items": 0, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_bytes": 0, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_items": 0, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_bytes": 0, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_items": 0, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_bytes": 0, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_items": 0, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_bytes": 0, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_items": 0, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_bytes": 0, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_items": 0, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_bytes": 928, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_items": 2, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_bytes": 0, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_items": 0, 2024-07-24T22:19:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_bytes": 0, 2024-07-24T22:19:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_items": 0 2024-07-24T22:19:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:19:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-07-24T22:19:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-07-24T22:19:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-07-24T22:19:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-07-24T22:19:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 275, 2024-07-24T22:19:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 947774, 2024-07-24T22:19:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-07-24T22:19:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 275, 2024-07-24T22:19:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-07-24T22:19:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-07-24T22:19:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 275, 2024-07-24T22:19:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 947774, 2024-07-24T22:19:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-07-24T22:19:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:19:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:19:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:19:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:19:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:19:58.711 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-07-24T22:19:59.491 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:19:59 smithi188 ceph-mon[37380]: pgmap v763: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:59.493 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-07-24T22:19:59.493 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-07-24T22:19:59.493 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-07-24T22:19:59.493 DEBUG:tasks.check_counter:Getting stats from i 2024-07-24T22:19:59.493 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph daemon mds.i perf dump 2024-07-24T22:19:59.748 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T22:19:59.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:19:59 smithi183 ceph-mon[37007]: pgmap v763: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:19:59.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:19:59 smithi047 ceph-mon[32551]: pgmap v763: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-24T22:20:00.795 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:00 smithi188 ceph-mon[37380]: Health detail: HEALTH_WARN 2 OSD(s) experiencing slow operations in BlueStore 2024-07-24T22:20:00.795 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:00 smithi188 ceph-mon[37380]: [WRN] BLUESTORE_SLOW_OP_ALERT: 2 OSD(s) experiencing slow operations in BlueStore 2024-07-24T22:20:00.795 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:00 smithi188 ceph-mon[37380]: osd.2 observed slow operation indications in BlueStore 2024-07-24T22:20:00.795 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:00 smithi188 ceph-mon[37380]: osd.10 observed slow operation indications in BlueStore 2024-07-24T22:20:00.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:00 smithi183 ceph-mon[37007]: Health detail: HEALTH_WARN 2 OSD(s) experiencing slow operations in BlueStore 2024-07-24T22:20:00.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:00 smithi183 ceph-mon[37007]: [WRN] BLUESTORE_SLOW_OP_ALERT: 2 OSD(s) experiencing slow operations in BlueStore 2024-07-24T22:20:00.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:00 smithi183 ceph-mon[37007]: osd.2 observed slow operation indications in BlueStore 2024-07-24T22:20:00.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:00 smithi183 ceph-mon[37007]: osd.10 observed slow operation indications in BlueStore 2024-07-24T22:20:00.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:00 smithi047 ceph-mon[32551]: Health detail: HEALTH_WARN 2 OSD(s) experiencing slow operations in BlueStore 2024-07-24T22:20:00.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:00 smithi047 ceph-mon[32551]: [WRN] BLUESTORE_SLOW_OP_ALERT: 2 OSD(s) experiencing slow operations in BlueStore 2024-07-24T22:20:00.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:00 smithi047 ceph-mon[32551]: osd.2 observed slow operation indications in BlueStore 2024-07-24T22:20:00.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:00 smithi047 ceph-mon[32551]: osd.10 observed slow operation indications in BlueStore 2024-07-24T22:20:01.324 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-07-24T22:20:01.324 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-0": { 2024-07-24T22:20:01.324 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 5178, 2024-07-24T22:20:01.324 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 5180, 2024-07-24T22:20:01.325 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 1420848, 2024-07-24T22:20:01.325 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 233628791, 2024-07-24T22:20:01.325 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 17, 2024-07-24T22:20:01.325 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 4, 2024-07-24T22:20:01.325 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 1.217869015, 2024-07-24T22:20:01.325 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.730794898, 2024-07-24T22:20:01.325 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.092413588, 2024-07-24T22:20:01.325 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.252037235, 2024-07-24T22:20:01.325 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:20:01.325 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 5178, 2024-07-24T22:20:01.325 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.886714656, 2024-07-24T22:20:01.326 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000171246 2024-07-24T22:20:01.326 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.326 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:20:01.326 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 8, 2024-07-24T22:20:01.326 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000001060, 2024-07-24T22:20:01.326 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000132 2024-07-24T22:20:01.326 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.326 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 0, 2024-07-24T22:20:01.326 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 0 2024-07-24T22:20:01.326 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.326 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-1": { 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 4917, 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 4379, 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 1478134, 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 147837707, 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 10, 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 6, 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.963464929, 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.530294857, 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.112689516, 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.296159243, 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 4378, 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.608490044, 2024-07-24T22:20:01.327 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000138988 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1177, 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000206618, 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000175 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 422976, 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 578768 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-2": { 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 143581, 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 146289, 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 48756269, 2024-07-24T22:20:01.328 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 78747968, 2024-07-24T22:20:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 303, 2024-07-24T22:20:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 9, 2024-07-24T22:20:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 6.306455242, 2024-07-24T22:20:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 2.766259681, 2024-07-24T22:20:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 7.636880792, 2024-07-24T22:20:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.107762750, 2024-07-24T22:20:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:20:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 146288, 2024-07-24T22:20:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 12.643204149, 2024-07-24T22:20:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000086426 2024-07-24T22:20:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:20:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 110287, 2024-07-24T22:20:01.330 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.037708958, 2024-07-24T22:20:01.330 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000341 2024-07-24T22:20:01.330 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.330 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 1080672, 2024-07-24T22:20:01.330 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 232864 2024-07-24T22:20:01.330 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.330 INFO:teuthology.orchestra.run.smithi188.stdout: "cct": { 2024-07-24T22:20:01.330 INFO:teuthology.orchestra.run.smithi188.stdout: "total_workers": 1, 2024-07-24T22:20:01.330 INFO:teuthology.orchestra.run.smithi188.stdout: "unhealthy_workers": 0 2024-07-24T22:20:01.330 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.330 INFO:teuthology.orchestra.run.smithi188.stdout: "finisher-MDSRank": { 2024-07-24T22:20:01.330 INFO:teuthology.orchestra.run.smithi188.stdout: "queue_len": 0, 2024-07-24T22:20:01.331 INFO:teuthology.orchestra.run.smithi188.stdout: "complete_latency": { 2024-07-24T22:20:01.331 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 3951, 2024-07-24T22:20:01.331 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 64.751917156, 2024-07-24T22:20:01.331 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.016388741 2024-07-24T22:20:01.331 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:20:01.331 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.331 INFO:teuthology.orchestra.run.smithi188.stdout: "finisher-PurgeQueue": { 2024-07-24T22:20:01.331 INFO:teuthology.orchestra.run.smithi188.stdout: "queue_len": 0, 2024-07-24T22:20:01.331 INFO:teuthology.orchestra.run.smithi188.stdout: "complete_latency": { 2024-07-24T22:20:01.331 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 2514, 2024-07-24T22:20:01.331 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.071136434, 2024-07-24T22:20:01.331 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000028296 2024-07-24T22:20:01.331 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:20:01.332 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.332 INFO:teuthology.orchestra.run.smithi188.stdout: "mds": { 2024-07-24T22:20:01.332 INFO:teuthology.orchestra.run.smithi188.stdout: "request": 287, 2024-07-24T22:20:01.332 INFO:teuthology.orchestra.run.smithi188.stdout: "reply": 287, 2024-07-24T22:20:01.332 INFO:teuthology.orchestra.run.smithi188.stdout: "reply_latency": { 2024-07-24T22:20:01.332 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 287, 2024-07-24T22:20:01.332 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 26.327159152, 2024-07-24T22:20:01.332 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.091732261 2024-07-24T22:20:01.332 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.332 INFO:teuthology.orchestra.run.smithi188.stdout: "slow_reply": 0, 2024-07-24T22:20:01.332 INFO:teuthology.orchestra.run.smithi188.stdout: "forward": 0, 2024-07-24T22:20:01.332 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_fetch_complete": 0, 2024-07-24T22:20:01.332 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_fetch_keys": 0, 2024-07-24T22:20:01.333 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_commit": 149, 2024-07-24T22:20:01.333 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_split": 0, 2024-07-24T22:20:01.333 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_merge": 0, 2024-07-24T22:20:01.333 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes": 121, 2024-07-24T22:20:01.333 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_top": 40, 2024-07-24T22:20:01.333 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_bottom": 81, 2024-07-24T22:20:01.333 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_pin_tail": 0, 2024-07-24T22:20:01.333 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_pinned": 19, 2024-07-24T22:20:01.333 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_expired": 0, 2024-07-24T22:20:01.333 INFO:teuthology.orchestra.run.smithi188.stdout: "inodes_with_caps": 3, 2024-07-24T22:20:01.333 INFO:teuthology.orchestra.run.smithi188.stdout: "caps": 4, 2024-07-24T22:20:01.333 INFO:teuthology.orchestra.run.smithi188.stdout: "subtrees": 2, 2024-07-24T22:20:01.333 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse": 403, 2024-07-24T22:20:01.334 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_hit": 398, 2024-07-24T22:20:01.334 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_forward": 0, 2024-07-24T22:20:01.334 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_discover": 0, 2024-07-24T22:20:01.334 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_dir_fetch": 0, 2024-07-24T22:20:01.334 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_remote_ino": 0, 2024-07-24T22:20:01.334 INFO:teuthology.orchestra.run.smithi188.stdout: "traverse_lock": 0, 2024-07-24T22:20:01.334 INFO:teuthology.orchestra.run.smithi188.stdout: "load_cent": 0, 2024-07-24T22:20:01.334 INFO:teuthology.orchestra.run.smithi188.stdout: "q": 0, 2024-07-24T22:20:01.334 INFO:teuthology.orchestra.run.smithi188.stdout: "exported": 0, 2024-07-24T22:20:01.334 INFO:teuthology.orchestra.run.smithi188.stdout: "exported_inodes": 0, 2024-07-24T22:20:01.334 INFO:teuthology.orchestra.run.smithi188.stdout: "imported": 0, 2024-07-24T22:20:01.334 INFO:teuthology.orchestra.run.smithi188.stdout: "imported_inodes": 0, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_dir_fetch": 0, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_backtrace_fetch": 652, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "openino_peer_discover": 0, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rfiles": 4, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rbytes": 234, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "root_rsnaps": 6, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_backtrace_fetch": 652, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_set_tag": 0, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_backtrace_repaired": 0, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_inotable_repaired": 0, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dir_inodes": 236, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dir_base_inodes": 23, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_dirfrag_rstats": 213, 2024-07-24T22:20:01.335 INFO:teuthology.orchestra.run.smithi188.stdout: "scrub_file_inodes": 416, 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_inode_file_caps": 0, 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_revoke": 132, 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_grant": 3496, 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_trunc": 0, 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_cap_op_flush_ack": 0, 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_caps": 140391, 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_caps_dirty": 140256, 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_cap_release": 9, 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: "process_request_cap_release": 48 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_cache": { 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_update": 0, 2024-07-24T22:20:01.336 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_update_receipt": 0, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_try_discover": 0, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_send_discover": 0, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "dir_handle_discover": 0, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays": 4, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays_delayed": 0, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "num_strays_enqueuing": 0, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_created": 22, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_enqueued": 18, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_reintegrated": 0, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "strays_migrated": 0, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_processing": 0, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_enqueued": 0, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "num_recovering_prioritized": 0, 2024-07-24T22:20:01.337 INFO:teuthology.orchestra.run.smithi188.stdout: "recovery_started": 0, 2024-07-24T22:20:01.338 INFO:teuthology.orchestra.run.smithi188.stdout: "recovery_completed": 0, 2024-07-24T22:20:01.338 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_quiesce_path": 9, 2024-07-24T22:20:01.338 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_quiesce_inode": 255, 2024-07-24T22:20:01.338 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_enqueue_scrub": 23, 2024-07-24T22:20:01.338 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_exportdir": 0, 2024-07-24T22:20:01.338 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_flush": 0, 2024-07-24T22:20:01.338 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_fragmentdir": 0, 2024-07-24T22:20:01.338 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_fragstats": 0, 2024-07-24T22:20:01.338 INFO:teuthology.orchestra.run.smithi188.stdout: "ireq_inodestats": 0 2024-07-24T22:20:01.338 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.338 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_log": { 2024-07-24T22:20:01.338 INFO:teuthology.orchestra.run.smithi188.stdout: "evlrg": 0, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "evadd": 141018, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "evex": 140994, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "evtrm": 140994, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "ev": 24, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "evexg": 0, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "evexd": 43, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "segadd": 234, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "segex": 233, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "segtrm": 233, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "seg": 1, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "segmjr": 1, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "segexg": 0, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "segexd": 1, 2024-07-24T22:20:01.339 INFO:teuthology.orchestra.run.smithi188.stdout: "expos": 453605546, 2024-07-24T22:20:01.340 INFO:teuthology.orchestra.run.smithi188.stdout: "wrpos": 453648652, 2024-07-24T22:20:01.340 INFO:teuthology.orchestra.run.smithi188.stdout: "rdpos": 0, 2024-07-24T22:20:01.340 INFO:teuthology.orchestra.run.smithi188.stdout: "jlat": { 2024-07-24T22:20:01.340 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 5992, 2024-07-24T22:20:01.340 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 4101.950440298, 2024-07-24T22:20:01.340 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.684571168 2024-07-24T22:20:01.340 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.340 INFO:teuthology.orchestra.run.smithi188.stdout: "replayed": 0 2024-07-24T22:20:01.340 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.340 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_mem": { 2024-07-24T22:20:01.340 INFO:teuthology.orchestra.run.smithi188.stdout: "ino": 95, 2024-07-24T22:20:01.340 INFO:teuthology.orchestra.run.smithi188.stdout: "ino+": 136, 2024-07-24T22:20:01.340 INFO:teuthology.orchestra.run.smithi188.stdout: "ino-": 41, 2024-07-24T22:20:01.341 INFO:teuthology.orchestra.run.smithi188.stdout: "dir": 22, 2024-07-24T22:20:01.341 INFO:teuthology.orchestra.run.smithi188.stdout: "dir+": 22, 2024-07-24T22:20:01.341 INFO:teuthology.orchestra.run.smithi188.stdout: "dir-": 0, 2024-07-24T22:20:01.341 INFO:teuthology.orchestra.run.smithi188.stdout: "dn": 121, 2024-07-24T22:20:01.341 INFO:teuthology.orchestra.run.smithi188.stdout: "dn+": 139, 2024-07-24T22:20:01.341 INFO:teuthology.orchestra.run.smithi188.stdout: "dn-": 18, 2024-07-24T22:20:01.341 INFO:teuthology.orchestra.run.smithi188.stdout: "cap": 4, 2024-07-24T22:20:01.341 INFO:teuthology.orchestra.run.smithi188.stdout: "cap+": 56, 2024-07-24T22:20:01.341 INFO:teuthology.orchestra.run.smithi188.stdout: "cap-": 52, 2024-07-24T22:20:01.341 INFO:teuthology.orchestra.run.smithi188.stdout: "rss": 72772, 2024-07-24T22:20:01.341 INFO:teuthology.orchestra.run.smithi188.stdout: "heap": 231704 2024-07-24T22:20:01.341 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.341 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_server": { 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: "dispatch_client_request": 350, 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: "dispatch_server_request": 0, 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_request": 287, 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_client_session": 27, 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: "handle_peer_request": 0, 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: "req_create_latency": { 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 22, 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.026156238, 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.001188919 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getattr_latency": { 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 155, 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 4.901242065, 2024-07-24T22:20:01.342 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.031620916 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getfilelock_latency": { 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: "req_link_latency": { 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookup_latency": { 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 23, 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.071550222, 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.003110879 2024-07-24T22:20:01.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookuphash_latency": { 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupino_latency": { 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 2, 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000357594, 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000178797 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupname_latency": { 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.344 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupparent_latency": { 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lookupsnap_latency": { 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: "req_lssnap_latency": { 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 14, 2024-07-24T22:20:01.345 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.002179091, 2024-07-24T22:20:01.346 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000155649 2024-07-24T22:20:01.346 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.346 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mkdir_latency": { 2024-07-24T22:20:01.346 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 10, 2024-07-24T22:20:01.346 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 18.553516391, 2024-07-24T22:20:01.346 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 1.855351639 2024-07-24T22:20:01.346 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.346 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mknod_latency": { 2024-07-24T22:20:01.346 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.346 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.346 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.346 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.346 INFO:teuthology.orchestra.run.smithi188.stdout: "req_mksnap_latency": { 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 14, 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 2.622514742, 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.187322481 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: "req_open_latency": { 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 2, 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000774490, 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000387245 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: "req_readdir_latency": { 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 5, 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.009469817, 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.001893963 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.347 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rename_latency": { 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 2, 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.001959035, 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000979517 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: "req_renamesnap_latency": { 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: "req_snapdiff_latency": { 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.348 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmdir_latency": { 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 4, 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.028977936, 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.007244484 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmsnap_latency": { 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 8, 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.068266736, 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.008533342 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: "req_rmxattr_latency": { 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.349 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setattr_latency": { 2024-07-24T22:20:01.350 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 1, 2024-07-24T22:20:01.350 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000927853, 2024-07-24T22:20:01.350 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000927853 2024-07-24T22:20:01.350 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.350 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setdirlayout_latency": { 2024-07-24T22:20:01.350 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.350 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.350 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.350 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.350 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setfilelock_latency": { 2024-07-24T22:20:01.350 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.350 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.350 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setlayout_latency": { 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: "req_setxattr_latency": { 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 7, 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.018905537, 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.002700791 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: "req_symlink_latency": { 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.351 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: "req_unlink_latency": { 2024-07-24T22:20:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 18, 2024-07-24T22:20:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.020361405, 2024-07-24T22:20:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.001131189 2024-07-24T22:20:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: "cap_revoke_eviction": 0, 2024-07-24T22:20:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: "cap_acquisition_throttle": 0, 2024-07-24T22:20:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: "req_getvxattr_latency": { 2024-07-24T22:20:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.353 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:20:01.353 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.353 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_sessions": { 2024-07-24T22:20:01.353 INFO:teuthology.orchestra.run.smithi188.stdout: "session_count": 2, 2024-07-24T22:20:01.353 INFO:teuthology.orchestra.run.smithi188.stdout: "session_add": 3, 2024-07-24T22:20:01.353 INFO:teuthology.orchestra.run.smithi188.stdout: "session_remove": 1, 2024-07-24T22:20:01.353 INFO:teuthology.orchestra.run.smithi188.stdout: "sessions_open": 2, 2024-07-24T22:20:01.353 INFO:teuthology.orchestra.run.smithi188.stdout: "sessions_stale": 0, 2024-07-24T22:20:01.353 INFO:teuthology.orchestra.run.smithi188.stdout: "total_load": 42, 2024-07-24T22:20:01.353 INFO:teuthology.orchestra.run.smithi188.stdout: "average_load": 21, 2024-07-24T22:20:01.353 INFO:teuthology.orchestra.run.smithi188.stdout: "avg_session_uptime": 788, 2024-07-24T22:20:01.353 INFO:teuthology.orchestra.run.smithi188.stdout: "mdthresh_evicted": 0 2024-07-24T22:20:01.353 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.354 INFO:teuthology.orchestra.run.smithi188.stdout: "mempool": { 2024-07-24T22:20:01.354 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_bytes": 0, 2024-07-24T22:20:01.354 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_items": 0, 2024-07-24T22:20:01.354 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_bytes": 0, 2024-07-24T22:20:01.354 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_items": 0, 2024-07-24T22:20:01.354 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_bytes": 0, 2024-07-24T22:20:01.354 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_items": 0, 2024-07-24T22:20:01.354 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_bytes": 0, 2024-07-24T22:20:01.354 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_items": 0, 2024-07-24T22:20:01.354 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_bytes": 0, 2024-07-24T22:20:01.354 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_items": 0, 2024-07-24T22:20:01.354 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_bytes": 0, 2024-07-24T22:20:01.354 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_items": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_bytes": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_items": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_bytes": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_items": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_bytes": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_items": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_bytes": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_items": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_bytes": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_items": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_bytes": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_items": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_bytes": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_items": 0, 2024-07-24T22:20:01.355 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_bytes": 0, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_items": 0, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_bytes": 0, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_items": 0, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_bytes": 0, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_items": 0, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_bytes": 0, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_items": 0, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_bytes": 0, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_items": 0, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_bytes": 327955, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_items": 132, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_bytes": 0, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_items": 0, 2024-07-24T22:20:01.356 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_bytes": 0, 2024-07-24T22:20:01.357 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_items": 0, 2024-07-24T22:20:01.357 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_bytes": 0, 2024-07-24T22:20:01.357 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_items": 0, 2024-07-24T22:20:01.357 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_bytes": 0, 2024-07-24T22:20:01.357 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_items": 0, 2024-07-24T22:20:01.357 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_bytes": 8360, 2024-07-24T22:20:01.357 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_items": 185, 2024-07-24T22:20:01.357 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_bytes": 0, 2024-07-24T22:20:01.357 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_items": 0, 2024-07-24T22:20:01.357 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_bytes": 0, 2024-07-24T22:20:01.357 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_items": 0, 2024-07-24T22:20:01.357 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_bytes": 342910, 2024-07-24T22:20:01.357 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_items": 3145, 2024-07-24T22:20:01.358 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_bytes": 0, 2024-07-24T22:20:01.358 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_items": 0, 2024-07-24T22:20:01.358 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_bytes": 0, 2024-07-24T22:20:01.358 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_items": 0 2024-07-24T22:20:01.358 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.358 INFO:teuthology.orchestra.run.smithi188.stdout: "objecter": { 2024-07-24T22:20:01.358 INFO:teuthology.orchestra.run.smithi188.stdout: "op_active": 0, 2024-07-24T22:20:01.358 INFO:teuthology.orchestra.run.smithi188.stdout: "op_laggy": 0, 2024-07-24T22:20:01.358 INFO:teuthology.orchestra.run.smithi188.stdout: "op_send": 10610, 2024-07-24T22:20:01.358 INFO:teuthology.orchestra.run.smithi188.stdout: "op_send_bytes": 450045129, 2024-07-24T22:20:01.358 INFO:teuthology.orchestra.run.smithi188.stdout: "op_resend": 37, 2024-07-24T22:20:01.358 INFO:teuthology.orchestra.run.smithi188.stdout: "op_reply": 10610, 2024-07-24T22:20:01.358 INFO:teuthology.orchestra.run.smithi188.stdout: "op_latency": { 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 10610, 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 4072.304980066, 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.383817623 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: "op_inflight": 0, 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: "oplen_avg": { 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 10610, 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 11012 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: "op": 10610, 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: "op_r": 699, 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: "op_w": 9911, 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: "op_rmw": 0, 2024-07-24T22:20:01.359 INFO:teuthology.orchestra.run.smithi188.stdout: "op_pg": 0, 2024-07-24T22:20:01.360 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_stat": 127, 2024-07-24T22:20:01.360 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_create": 49, 2024-07-24T22:20:01.360 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_read": 24, 2024-07-24T22:20:01.360 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_write": 5993, 2024-07-24T22:20:01.360 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_writefull": 174, 2024-07-24T22:20:01.360 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_writesame": 0, 2024-07-24T22:20:01.360 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_append": 0, 2024-07-24T22:20:01.360 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_zero": 0, 2024-07-24T22:20:01.360 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_truncate": 0, 2024-07-24T22:20:01.360 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_delete": 3304, 2024-07-24T22:20:01.360 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_mapext": 0, 2024-07-24T22:20:01.360 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_sparse_read": 0, 2024-07-24T22:20:01.361 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_clonerange": 0, 2024-07-24T22:20:01.361 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_getxattr": 675, 2024-07-24T22:20:01.361 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_setxattr": 98, 2024-07-24T22:20:01.361 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_cmpxattr": 0, 2024-07-24T22:20:01.361 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_rmxattr": 0, 2024-07-24T22:20:01.361 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_resetxattrs": 0, 2024-07-24T22:20:01.361 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_call": 0, 2024-07-24T22:20:01.361 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_watch": 0, 2024-07-24T22:20:01.361 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_notify": 0, 2024-07-24T22:20:01.361 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_src_cmpxattr": 0, 2024-07-24T22:20:01.361 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_pgls": 0, 2024-07-24T22:20:01.361 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_pgls_filter": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "osdop_other": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_active": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_send": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_resend": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "linger_ping": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_active": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_send": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "poolop_resend": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_active": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_send": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "poolstat_resend": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_active": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_send": 0, 2024-07-24T22:20:01.362 INFO:teuthology.orchestra.run.smithi188.stdout: "statfs_resend": 0, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "command_active": 0, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "command_send": 0, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "command_resend": 0, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "map_epoch": 99, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "map_full": 0, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "map_inc": 18, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_sessions": 12, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_session_open": 12, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_session_close": 0, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_laggy": 0, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_wr": 543, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_rd": 0, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_del": 25 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.363 INFO:teuthology.orchestra.run.smithi188.stdout: "oft": { 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_objs": 1, 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_kv_pairs": 0, 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_updates": 0, 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: "omap_total_removes": 0 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: "osd-slow-ops": { 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: "slow_ops_count": 265 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: "purge_queue": { 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_ops": 0, 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_ops_high_water": 521, 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing": 0, 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executing_high_water": 9, 2024-07-24T22:20:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executed_ops": 2578, 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_executed": 18, 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: "pq_item_in_journal": 0 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 153672, 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 40013287, 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 153672, 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-07-24T22:20:01.365 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 153672, 2024-07-24T22:20:01.366 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 40013287, 2024-07-24T22:20:01.366 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-07-24T22:20:01.366 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.366 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.366 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.366 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:20:01.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.366 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-objecter_bytes": { 2024-07-24T22:20:01.366 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-07-24T22:20:01.366 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 10610, 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 450047811, 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 10610, 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 450047811, 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.367 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-objecter_ops": { 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 1024, 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 0, 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 0, 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 0, 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 10610, 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 10610, 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 10610, 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 10610, 2024-07-24T22:20:01.368 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-write_buf_throttle": { 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 3758096384, 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 18, 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 2682, 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 18, 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-07-24T22:20:01.369 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-07-24T22:20:01.370 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 1, 2024-07-24T22:20:01.370 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 2682, 2024-07-24T22:20:01.370 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-07-24T22:20:01.370 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.370 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.370 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.370 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:20:01.370 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:01.370 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-write_buf_throttle-0x55e7cdf2a6e0": { 2024-07-24T22:20:01.370 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 84, 2024-07-24T22:20:01.370 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 3758096384, 2024-07-24T22:20:01.370 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-07-24T22:20:01.370 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 141018, 2024-07-24T22:20:01.371 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 449454348, 2024-07-24T22:20:01.371 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-07-24T22:20:01.371 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 141018, 2024-07-24T22:20:01.371 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-07-24T22:20:01.371 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-07-24T22:20:01.371 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 5992, 2024-07-24T22:20:01.371 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 449454264, 2024-07-24T22:20:01.371 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-07-24T22:20:01.371 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:01.371 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:01.371 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:01.371 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:20:01.371 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:20:01.372 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-07-24T22:20:01.770 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:01 smithi188 ceph-mon[37380]: pgmap v764: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:20:01.813 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:01 smithi183 ceph-mon[37007]: pgmap v764: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:20:01.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:01 smithi047 ceph-mon[32551]: pgmap v764: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-24T22:20:02.099 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-07-24T22:20:02.099 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=14 2024-07-24T22:20:02.099 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=8 2024-07-24T22:20:02.099 DEBUG:tasks.check_counter:Getting stats from l 2024-07-24T22:20:02.099 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph daemon mds.l perf dump 2024-07-24T22:20:02.353 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.c/config 2024-07-24T22:20:03.734 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:03 smithi188 ceph-mon[37380]: pgmap v765: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-07-24T22:20:03.739 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:03 smithi047 ceph-mon[32551]: pgmap v765: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-07-24T22:20:03.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:03 smithi183 ceph-mon[37007]: pgmap v765: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-07-24T22:20:03.964 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-07-24T22:20:03.964 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-0": { 2024-07-24T22:20:03.964 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 0, 2024-07-24T22:20:03.964 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 2, 2024-07-24T22:20:03.964 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 0, 2024-07-24T22:20:03.964 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 0, 2024-07-24T22:20:03.964 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 4, 2024-07-24T22:20:03.965 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 0, 2024-07-24T22:20:03.965 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.001065402, 2024-07-24T22:20:03.965 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.000000000, 2024-07-24T22:20:03.965 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.000270015, 2024-07-24T22:20:03.965 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:20:03.965 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:20:03.965 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:03.965 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:03.965 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:03.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:03.965 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:20:03.965 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:03.965 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:03.966 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:03.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:03.966 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 0, 2024-07-24T22:20:03.966 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 0 2024-07-24T22:20:03.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:03.966 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-1": { 2024-07-24T22:20:03.966 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 2, 2024-07-24T22:20:03.966 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 208, 2024-07-24T22:20:03.966 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 320, 2024-07-24T22:20:03.966 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 195520, 2024-07-24T22:20:03.966 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 4, 2024-07-24T22:20:03.966 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 2, 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.013189939, 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.009682813, 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.001169673, 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 206, 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.016985094, 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000082451 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:03.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:03.968 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 320, 2024-07-24T22:20:03.968 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 195520 2024-07-24T22:20:03.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:03.968 INFO:teuthology.orchestra.run.smithi188.stdout: "AsyncMessenger::Worker-2": { 2024-07-24T22:20:03.968 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_messages": 283, 2024-07-24T22:20:03.968 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages": 275, 2024-07-24T22:20:03.968 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_bytes": 990976, 2024-07-24T22:20:03.968 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_bytes": 168352, 2024-07-24T22:20:03.968 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_created_connections": 2, 2024-07-24T22:20:03.968 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_active_connections": 1, 2024-07-24T22:20:03.968 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_total_time": 0.045410626, 2024-07-24T22:20:03.968 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_send_time": 0.018559918, 2024-07-24T22:20:03.968 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_recv_time": 0.035586328, 2024-07-24T22:20:03.969 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-07-24T22:20:03.969 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_messages_queue_lat": { 2024-07-24T22:20:03.969 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 275, 2024-07-24T22:20:03.969 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.022128353, 2024-07-24T22:20:03.969 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000080466 2024-07-24T22:20:03.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:03.969 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_handle_ack_lat": { 2024-07-24T22:20:03.969 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:03.969 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:03.969 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:03.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:03.970 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_recv_encrypted_bytes": 990976, 2024-07-24T22:20:03.970 INFO:teuthology.orchestra.run.smithi188.stdout: "msgr_send_encrypted_bytes": 168352 2024-07-24T22:20:03.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:03.970 INFO:teuthology.orchestra.run.smithi188.stdout: "cct": { 2024-07-24T22:20:03.970 INFO:teuthology.orchestra.run.smithi188.stdout: "total_workers": 0, 2024-07-24T22:20:03.970 INFO:teuthology.orchestra.run.smithi188.stdout: "unhealthy_workers": 0 2024-07-24T22:20:03.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:03.970 INFO:teuthology.orchestra.run.smithi188.stdout: "mempool": { 2024-07-24T22:20:03.970 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_bytes": 0, 2024-07-24T22:20:03.970 INFO:teuthology.orchestra.run.smithi188.stdout: "bloom_filter_items": 0, 2024-07-24T22:20:03.970 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_bytes": 0, 2024-07-24T22:20:03.970 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_alloc_items": 0, 2024-07-24T22:20:03.971 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_bytes": 0, 2024-07-24T22:20:03.971 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_data_items": 0, 2024-07-24T22:20:03.971 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_bytes": 0, 2024-07-24T22:20:03.971 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_onode_items": 0, 2024-07-24T22:20:03.971 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_bytes": 0, 2024-07-24T22:20:03.971 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_meta_items": 0, 2024-07-24T22:20:03.971 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_bytes": 0, 2024-07-24T22:20:03.971 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_other_items": 0, 2024-07-24T22:20:03.971 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_bytes": 0, 2024-07-24T22:20:03.971 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_cache_buffer_items": 0, 2024-07-24T22:20:03.971 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_bytes": 0, 2024-07-24T22:20:03.971 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_extent_items": 0, 2024-07-24T22:20:03.971 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_bytes": 0, 2024-07-24T22:20:03.972 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_blob_items": 0, 2024-07-24T22:20:03.972 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_bytes": 0, 2024-07-24T22:20:03.972 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_shared_blob_items": 0, 2024-07-24T22:20:03.972 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_bytes": 0, 2024-07-24T22:20:03.972 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_inline_bl_items": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_bytes": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_fsck_items": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_bytes": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_txc_items": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_bytes": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_deferred_items": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_bytes": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluestore_writing_items": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_bytes": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_items": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_bytes": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_reader_items": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_bytes": 0, 2024-07-24T22:20:03.973 INFO:teuthology.orchestra.run.smithi188.stdout: "bluefs_file_writer_items": 0, 2024-07-24T22:20:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_bytes": 148704, 2024-07-24T22:20:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_anon_items": 29, 2024-07-24T22:20:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_bytes": 0, 2024-07-24T22:20:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: "buffer_meta_items": 0, 2024-07-24T22:20:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_bytes": 0, 2024-07-24T22:20:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_items": 0, 2024-07-24T22:20:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_bytes": 0, 2024-07-24T22:20:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_mapbl_items": 0, 2024-07-24T22:20:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_bytes": 0, 2024-07-24T22:20:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_pglog_items": 0, 2024-07-24T22:20:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_bytes": 0, 2024-07-24T22:20:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_items": 0, 2024-07-24T22:20:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_bytes": 0, 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: "osdmap_mapping_items": 0, 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_bytes": 0, 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: "pgmap_items": 0, 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_bytes": 928, 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_co_items": 2, 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_bytes": 0, 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_1_items": 0, 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_bytes": 0, 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: "unittest_2_items": 0 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: "val": 0, 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: "max": 104857600, 2024-07-24T22:20:03.975 INFO:teuthology.orchestra.run.smithi188.stdout: "get_started": 0, 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: "get": 281, 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: "get_sum": 948618, 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_fail": 0, 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: "get_or_fail_success": 281, 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: "take": 0, 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: "take_sum": 0, 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: "put": 281, 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: "put_sum": 948618, 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: "wait": { 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: "avgcount": 0, 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: "sum": 0.000000000, 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: "avgtime": 0.000000000 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:20:03.976 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-07-24T22:20:03.977 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-07-24T22:20:04.613 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-07-24T22:20:04.613 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-07-24T22:20:04.613 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-07-24T22:20:04.613 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-07-24T22:20:04.624 INFO:tasks.kclient:Unmounting kernel clients... 2024-07-24T22:20:04.624 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T22:20:04.624 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T22:20:04.644 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-07-24T22:20:04.644 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T22:20:04.700 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd blocklist ls 2024-07-24T22:20:05.009 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:20:05.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:05 smithi047 ceph-mon[32551]: pgmap v766: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-07-24T22:20:05.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:05 smithi188 ceph-mon[37380]: pgmap v766: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-07-24T22:20:05.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:05 smithi183 ceph-mon[37007]: pgmap v766: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-07-24T22:20:06.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.785+0000 7fba73546640 1 -- 172.21.15.47:0/3084699795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba6c102790 msgr2=0x7fba6c102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:06.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.785+0000 7fba73546640 1 --2- 172.21.15.47:0/3084699795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba6c102790 0x7fba6c102b70 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009ca0 tx=0x7fba5c02a8c0 comp rx=0 tx=0).stop 2024-07-24T22:20:06.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.785+0000 7fba73546640 1 -- 172.21.15.47:0/3084699795 shutdown_connections 2024-07-24T22:20:06.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.785+0000 7fba73546640 1 --2- 172.21.15.47:0/3084699795 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba6c108b20 0x7fba6c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:06.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.785+0000 7fba73546640 1 --2- 172.21.15.47:0/3084699795 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba6c1081a0 0x7fba6c1085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:06.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.785+0000 7fba73546640 1 --2- 172.21.15.47:0/3084699795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba6c102790 0x7fba6c102b70 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:06.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.785+0000 7fba73546640 1 -- 172.21.15.47:0/3084699795 >> 172.21.15.47:0/3084699795 conn(0x7fba6c0fe200 msgr2=0x7fba6c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:06.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.785+0000 7fba73546640 1 -- 172.21.15.47:0/3084699795 shutdown_connections 2024-07-24T22:20:06.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.785+0000 7fba73546640 1 -- 172.21.15.47:0/3084699795 wait complete. 2024-07-24T22:20:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.786+0000 7fba73546640 1 Processor -- start 2024-07-24T22:20:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.786+0000 7fba73546640 1 -- start start 2024-07-24T22:20:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.786+0000 7fba73546640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba6c102790 0x7fba6c19ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.786+0000 7fba73546640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba6c1081a0 0x7fba6c19b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.786+0000 7fba73546640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba6c108b20 0x7fba6c1a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.786+0000 7fba73546640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c1127a0 con 0x7fba6c108b20 2024-07-24T22:20:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.786+0000 7fba73546640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c112620 con 0x7fba6c1081a0 2024-07-24T22:20:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.786+0000 7fba73546640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c112920 con 0x7fba6c102790 2024-07-24T22:20:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.786+0000 7fba71ae3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba6c108b20 0x7fba6c1a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.786+0000 7fba71ae3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba6c108b20 0x7fba6c1a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35734/0 (socket says 172.21.15.47:35734) 2024-07-24T22:20:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.786+0000 7fba71ae3640 1 -- 172.21.15.47:0/2452100165 learned_addr learned my addr 172.21.15.47:0/2452100165 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:20:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.786+0000 7fba712e2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba6c102790 0x7fba6c19ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.786+0000 7fba70ae1640 1 --2- 172.21.15.47:0/2452100165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba6c1081a0 0x7fba6c19b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.787+0000 7fba71ae3640 1 -- 172.21.15.47:0/2452100165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba6c102790 msgr2=0x7fba6c19ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.787+0000 7fba71ae3640 1 --2- 172.21.15.47:0/2452100165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba6c102790 0x7fba6c19ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.787+0000 7fba71ae3640 1 -- 172.21.15.47:0/2452100165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba6c1081a0 msgr2=0x7fba6c19b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.787+0000 7fba71ae3640 1 --2- 172.21.15.47:0/2452100165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba6c1081a0 0x7fba6c19b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.787+0000 7fba71ae3640 1 -- 172.21.15.47:0/2452100165 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c1a0f40 con 0x7fba6c108b20 2024-07-24T22:20:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.787+0000 7fba71ae3640 1 --2- 172.21.15.47:0/2452100165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba6c108b20 0x7fba6c1a0770 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fba6400c970 tx=0x7fba6400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.787+0000 7fba6a7fc640 1 -- 172.21.15.47:0/2452100165 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64007bb0 con 0x7fba6c108b20 2024-07-24T22:20:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.787+0000 7fba6a7fc640 1 -- 172.21.15.47:0/2452100165 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba64007d50 con 0x7fba6c108b20 2024-07-24T22:20:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.787+0000 7fba73546640 1 -- 172.21.15.47:0/2452100165 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6c1a1230 con 0x7fba6c108b20 2024-07-24T22:20:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.787+0000 7fba6a7fc640 1 -- 172.21.15.47:0/2452100165 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64018660 con 0x7fba6c108b20 2024-07-24T22:20:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.787+0000 7fba73546640 1 -- 172.21.15.47:0/2452100165 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6c1a7970 con 0x7fba6c108b20 2024-07-24T22:20:06.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.788+0000 7fba73546640 1 -- 172.21.15.47:0/2452100165 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba6c102b70 con 0x7fba6c108b20 2024-07-24T22:20:06.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.789+0000 7fba6a7fc640 1 -- 172.21.15.47:0/2452100165 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fba6400f450 con 0x7fba6c108b20 2024-07-24T22:20:06.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.790+0000 7fba6a7fc640 1 --2- 172.21.15.47:0/2452100165 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fba540b3d40 0x7fba540b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:06.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.790+0000 7fba712e2640 1 --2- 172.21.15.47:0/2452100165 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fba540b3d40 0x7fba540b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:06.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.790+0000 7fba6a7fc640 1 -- 172.21.15.47:0/2452100165 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7fba640e4050 con 0x7fba6c108b20 2024-07-24T22:20:06.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.791+0000 7fba712e2640 1 --2- 172.21.15.47:0/2452100165 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fba540b3d40 0x7fba540b6200 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0098d0 tx=0x7fba5c009900 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:06.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:06.794+0000 7fba6a7fc640 1 -- 172.21.15.47:0/2452100165 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fba64014030 con 0x7fba6c108b20 2024-07-24T22:20:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.003+0000 7fba73546640 1 -- 172.21.15.47:0/2452100165 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fba6c02e000 con 0x7fba6c108b20 2024-07-24T22:20:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.003+0000 7fba6a7fc640 1 -- 172.21.15.47:0/2452100165 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v99) ==== 81+0+886 (secure 0 0 0) 0x7fba640ab330 con 0x7fba6c108b20 2024-07-24T22:20:07.006 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3499235566 2024-07-25T21:57:25.995502+0000 2024-07-24T22:20:07.006 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2112533111 2024-07-25T21:55:50.643046+0000 2024-07-24T22:20:07.006 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2714360830 2024-07-25T21:56:15.044564+0000 2024-07-24T22:20:07.006 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/507334607 2024-07-25T21:57:25.995502+0000 2024-07-24T22:20:07.006 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/2524786594 2024-07-25T21:57:25.995502+0000 2024-07-24T22:20:07.006 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/1004458106 2024-07-25T21:55:50.643046+0000 2024-07-24T22:20:07.006 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/1185381011 2024-07-25T21:55:50.643046+0000 2024-07-24T22:20:07.007 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/1185381011 2024-07-25T21:55:50.643046+0000 2024-07-24T22:20:07.007 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/1046677443 2024-07-25T21:55:50.643046+0000 2024-07-24T22:20:07.007 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/4239008956 2024-07-25T21:56:15.044564+0000 2024-07-24T22:20:07.007 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/899235864 2024-07-25T21:56:15.044564+0000 2024-07-24T22:20:07.007 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/4239008956 2024-07-25T21:56:15.044564+0000 2024-07-24T22:20:07.007 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3057769442 2024-07-25T21:56:15.044564+0000 2024-07-24T22:20:07.007 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2596054312 2024-07-25T21:57:25.995502+0000 2024-07-24T22:20:07.007 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/2524786594 2024-07-25T21:57:25.995502+0000 2024-07-24T22:20:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:listed 15 entries 2024-07-24T22:20:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.005+0000 7fba73546640 1 -- 172.21.15.47:0/2452100165 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fba540b3d40 msgr2=0x7fba540b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.005+0000 7fba73546640 1 --2- 172.21.15.47:0/2452100165 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fba540b3d40 0x7fba540b6200 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0098d0 tx=0x7fba5c009900 comp rx=0 tx=0).stop 2024-07-24T22:20:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.005+0000 7fba73546640 1 -- 172.21.15.47:0/2452100165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba6c108b20 msgr2=0x7fba6c1a0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.005+0000 7fba73546640 1 --2- 172.21.15.47:0/2452100165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba6c108b20 0x7fba6c1a0770 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fba6400c970 tx=0x7fba6400cd70 comp rx=0 tx=0).stop 2024-07-24T22:20:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.005+0000 7fba73546640 1 -- 172.21.15.47:0/2452100165 shutdown_connections 2024-07-24T22:20:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.005+0000 7fba73546640 1 --2- 172.21.15.47:0/2452100165 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fba540b3d40 0x7fba540b6200 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.005+0000 7fba73546640 1 --2- 172.21.15.47:0/2452100165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba6c108b20 0x7fba6c1a0770 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.005+0000 7fba73546640 1 --2- 172.21.15.47:0/2452100165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba6c1081a0 0x7fba6c19b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.005+0000 7fba73546640 1 --2- 172.21.15.47:0/2452100165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba6c102790 0x7fba6c19ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:07.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.005+0000 7fba73546640 1 -- 172.21.15.47:0/2452100165 >> 172.21.15.47:0/2452100165 conn(0x7fba6c0fe200 msgr2=0x7fba6c104750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:07.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.006+0000 7fba73546640 1 -- 172.21.15.47:0/2452100165 shutdown_connections 2024-07-24T22:20:07.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:07.006+0000 7fba73546640 1 -- 172.21.15.47:0/2452100165 wait complete. 2024-07-24T22:20:07.653 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-07-24T22:20:07.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:20:07.654 DEBUG:teuthology.orchestra.run.smithi047:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-07-24T22:20:07.696 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-07-24T22:20:07.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:20:07.696 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-07-24T22:20:07.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:20:07.773 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-07-24T22:20:07.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:07 smithi188 ceph-mon[37380]: pgmap v767: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-07-24T22:20:07.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:07 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2452100165' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-24T22:20:07.830 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-07-24T22:20:07.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:20:07.830 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-24T22:20:07.893 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:07 smithi047 ceph-mon[32551]: pgmap v767: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-07-24T22:20:07.893 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:07 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2452100165' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-24T22:20:07.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T22:20:07.898 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-07-24T22:20:07.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:07 smithi183 ceph-mon[37007]: pgmap v767: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-07-24T22:20:07.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:07 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2452100165' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-24T22:20:07.994 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-07-24T22:20:08.005 INFO:tasks.cephadm:Teardown begin 2024-07-24T22:20:08.005 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-07-24T22:20:08.005 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:20:08.274 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:20:09.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:09 smithi047 ceph-mon[32551]: pgmap v768: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-07-24T22:20:09.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:09 smithi188 ceph-mon[37380]: pgmap v768: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-07-24T22:20:09.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:09 smithi183 ceph-mon[37007]: pgmap v768: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-07-24T22:20:09.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.959+0000 7f23252bf640 1 -- 172.21.15.47:0/13627705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2320102790 msgr2=0x7f2320102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:09.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.959+0000 7f23252bf640 1 --2- 172.21.15.47:0/13627705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2320102790 0x7f2320102b70 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f2310009900 tx=0x7f231002a410 comp rx=0 tx=0).stop 2024-07-24T22:20:09.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.959+0000 7f23252bf640 1 -- 172.21.15.47:0/13627705 shutdown_connections 2024-07-24T22:20:09.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.959+0000 7f23252bf640 1 --2- 172.21.15.47:0/13627705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2320108b20 0x7f232010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:09.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.959+0000 7f23252bf640 1 --2- 172.21.15.47:0/13627705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23201081a0 0x7f23201085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:09.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.959+0000 7f23252bf640 1 --2- 172.21.15.47:0/13627705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2320102790 0x7f2320102b70 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:09.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.959+0000 7f23252bf640 1 -- 172.21.15.47:0/13627705 >> 172.21.15.47:0/13627705 conn(0x7f23200fe200 msgr2=0x7f2320100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:09.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.959+0000 7f23252bf640 1 -- 172.21.15.47:0/13627705 shutdown_connections 2024-07-24T22:20:09.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.959+0000 7f23252bf640 1 -- 172.21.15.47:0/13627705 wait complete. 2024-07-24T22:20:09.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.960+0000 7f23252bf640 1 Processor -- start 2024-07-24T22:20:09.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.960+0000 7f23252bf640 1 -- start start 2024-07-24T22:20:09.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.960+0000 7f23252bf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2320102790 0x7f2320074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:09.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.960+0000 7f23252bf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23201081a0 0x7f23200753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:09.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.960+0000 7f23252bf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2320108b20 0x7f2320075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:09.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.960+0000 7f23252bf640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2320112720 con 0x7f2320102790 2024-07-24T22:20:09.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.960+0000 7f23252bf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f23201125a0 con 0x7f23201081a0 2024-07-24T22:20:09.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f23252bf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f23201128a0 con 0x7f2320108b20 2024-07-24T22:20:09.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f231effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2320102790 0x7f2320074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:09.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f231effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2320102790 0x7f2320074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35746/0 (socket says 172.21.15.47:35746) 2024-07-24T22:20:09.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f231effd640 1 -- 172.21.15.47:0/1919145875 learned_addr learned my addr 172.21.15.47:0/1919145875 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:20:09.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f231f7fe640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2320108b20 0x7f2320075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:09.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f231e7fc640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23201081a0 0x7f23200753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:09.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f231effd640 1 -- 172.21.15.47:0/1919145875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2320108b20 msgr2=0x7f2320075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:09.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f231effd640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2320108b20 0x7f2320075910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:09.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f231effd640 1 -- 172.21.15.47:0/1919145875 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23201081a0 msgr2=0x7f23200753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:09.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f231effd640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23201081a0 0x7f23200753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:09.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f231effd640 1 -- 172.21.15.47:0/1919145875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23201a7050 con 0x7f2320102790 2024-07-24T22:20:09.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f231e7fc640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23201081a0 0x7f23200753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T22:20:09.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f231effd640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2320102790 0x7f2320074e90 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f2310005940 tx=0x7f23100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:09.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f2307fff640 1 -- 172.21.15.47:0/1919145875 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231003f030 con 0x7f2320102790 2024-07-24T22:20:09.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f23252bf640 1 -- 172.21.15.47:0/1919145875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23201a72e0 con 0x7f2320102790 2024-07-24T22:20:09.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f2307fff640 1 -- 172.21.15.47:0/1919145875 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2310003cb0 con 0x7f2320102790 2024-07-24T22:20:09.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f2307fff640 1 -- 172.21.15.47:0/1919145875 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310035070 con 0x7f2320102790 2024-07-24T22:20:09.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.961+0000 7f23252bf640 1 -- 172.21.15.47:0/1919145875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23201a7810 con 0x7f2320102790 2024-07-24T22:20:09.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.962+0000 7f23252bf640 1 -- 172.21.15.47:0/1919145875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2320102b70 con 0x7f2320102790 2024-07-24T22:20:09.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.964+0000 7f2307fff640 1 -- 172.21.15.47:0/1919145875 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f2310042030 con 0x7f2320102790 2024-07-24T22:20:09.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.964+0000 7f2307fff640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f23080b3d40 0x7f23080b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:09.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.965+0000 7f231e7fc640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f23080b3d40 0x7f23080b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:09.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.965+0000 7f2307fff640 1 -- 172.21.15.47:0/1919145875 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8565+0+0 (secure 0 0 0) 0x7f2310104c10 con 0x7f2320102790 2024-07-24T22:20:09.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.965+0000 7f231e7fc640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f23080b3d40 0x7f23080b6200 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f23140058c0 tx=0x7f2314005850 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:09.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:09.967+0000 7f2307fff640 1 -- 172.21.15.47:0/1919145875 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f23100cbe90 con 0x7f2320102790 2024-07-24T22:20:10.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.201+0000 7f23252bf640 1 -- 172.21.15.47:0/1919145875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2320076190 con 0x7f2320102790 2024-07-24T22:20:10.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.202+0000 7f2307fff640 1 -- 172.21.15.47:0/1919145875 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7f23100cb790 con 0x7f2320102790 2024-07-24T22:20:10.205 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:20:10.205 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:20:10.205 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:20:10.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.204+0000 7f23252bf640 1 -- 172.21.15.47:0/1919145875 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f23080b3d40 msgr2=0x7f23080b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:10.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.204+0000 7f23252bf640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f23080b3d40 0x7f23080b6200 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f23140058c0 tx=0x7f2314005850 comp rx=0 tx=0).stop 2024-07-24T22:20:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.204+0000 7f23252bf640 1 -- 172.21.15.47:0/1919145875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2320102790 msgr2=0x7f2320074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.204+0000 7f23252bf640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2320102790 0x7f2320074e90 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f2310005940 tx=0x7f23100042f0 comp rx=0 tx=0).stop 2024-07-24T22:20:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.204+0000 7f23252bf640 1 -- 172.21.15.47:0/1919145875 shutdown_connections 2024-07-24T22:20:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.204+0000 7f23252bf640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f23080b3d40 0x7f23080b6200 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.204+0000 7f23252bf640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2320108b20 0x7f2320075910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.204+0000 7f23252bf640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23201081a0 0x7f23200753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.204+0000 7f23252bf640 1 --2- 172.21.15.47:0/1919145875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2320102790 0x7f2320074e90 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.204+0000 7f23252bf640 1 -- 172.21.15.47:0/1919145875 >> 172.21.15.47:0/1919145875 conn(0x7f23200fe200 msgr2=0x7f23200feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.204+0000 7f23252bf640 1 -- 172.21.15.47:0/1919145875 shutdown_connections 2024-07-24T22:20:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:10.204+0000 7f23252bf640 1 -- 172.21.15.47:0/1919145875 wait complete. 2024-07-24T22:20:10.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:10 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1919145875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:20:10.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:10 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1919145875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:20:10.887 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs dump --format=json 2024-07-24T22:20:10.911 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:10 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1919145875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:20:11.271 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:20:11.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:11 smithi047 ceph-mon[32551]: pgmap v769: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-07-24T22:20:11.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:11 smithi047 ceph-mon[32551]: osdmap e100: 12 total, 12 up, 12 in 2024-07-24T22:20:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:11 smithi188 ceph-mon[37380]: pgmap v769: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-07-24T22:20:11.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:11 smithi188 ceph-mon[37380]: osdmap e100: 12 total, 12 up, 12 in 2024-07-24T22:20:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:11 smithi183 ceph-mon[37007]: pgmap v769: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-07-24T22:20:11.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:11 smithi183 ceph-mon[37007]: osdmap e100: 12 total, 12 up, 12 in 2024-07-24T22:20:13.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.052+0000 7ff87d595640 1 -- 172.21.15.47:0/910090168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8781036a0 msgr2=0x7ff878103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:13.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.052+0000 7ff87d595640 1 --2- 172.21.15.47:0/910090168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8781036a0 0x7ff878103a80 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7ff868009900 tx=0x7ff86802a410 comp rx=0 tx=0).stop 2024-07-24T22:20:13.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.052+0000 7ff87d595640 1 -- 172.21.15.47:0/910090168 shutdown_connections 2024-07-24T22:20:13.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.052+0000 7ff87d595640 1 --2- 172.21.15.47:0/910090168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff87810cb00 0x7ff87810ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:13.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.052+0000 7ff87d595640 1 --2- 172.21.15.47:0/910090168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff878103fc0 0x7ff87810c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:13.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.052+0000 7ff87d595640 1 --2- 172.21.15.47:0/910090168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8781036a0 0x7ff878103a80 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:13.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.052+0000 7ff87d595640 1 -- 172.21.15.47:0/910090168 >> 172.21.15.47:0/910090168 conn(0x7ff8780fd100 msgr2=0x7ff8780ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:13.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.052+0000 7ff87d595640 1 -- 172.21.15.47:0/910090168 shutdown_connections 2024-07-24T22:20:13.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.052+0000 7ff87d595640 1 -- 172.21.15.47:0/910090168 wait complete. 2024-07-24T22:20:13.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.052+0000 7ff87d595640 1 Processor -- start 2024-07-24T22:20:13.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff87d595640 1 -- start start 2024-07-24T22:20:13.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff87d595640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8781036a0 0x7ff878198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:13.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff87d595640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff878103fc0 0x7ff8781991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:13.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff87d595640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff87810cb00 0x7ff87819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:13.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff87d595640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff878112740 con 0x7ff8781036a0 2024-07-24T22:20:13.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff87d595640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff8781125c0 con 0x7ff878103fc0 2024-07-24T22:20:13.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff87d595640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff8781128c0 con 0x7ff87810cb00 2024-07-24T22:20:13.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff876ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8781036a0 0x7ff878198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:13.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff876ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8781036a0 0x7ff878198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35770/0 (socket says 172.21.15.47:35770) 2024-07-24T22:20:13.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff876ffd640 1 -- 172.21.15.47:0/3951681958 learned_addr learned my addr 172.21.15.47:0/3951681958 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:20:13.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff8767fc640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff878103fc0 0x7ff8781991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:13.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff8777fe640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff87810cb00 0x7ff87819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:13.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff876ffd640 1 -- 172.21.15.47:0/3951681958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff87810cb00 msgr2=0x7ff87819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:13.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff876ffd640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff87810cb00 0x7ff87819e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:13.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff876ffd640 1 -- 172.21.15.47:0/3951681958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff878103fc0 msgr2=0x7ff8781991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:13.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff876ffd640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff878103fc0 0x7ff8781991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:13.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.053+0000 7ff876ffd640 1 -- 172.21.15.47:0/3951681958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87819ed20 con 0x7ff8781036a0 2024-07-24T22:20:13.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.054+0000 7ff876ffd640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8781036a0 0x7ff878198c70 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7ff868005940 tx=0x7ff8680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:13.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.054+0000 7ff85ffff640 1 -- 172.21.15.47:0/3951681958 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86803f030 con 0x7ff8781036a0 2024-07-24T22:20:13.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.054+0000 7ff85ffff640 1 -- 172.21.15.47:0/3951681958 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff868003cb0 con 0x7ff8781036a0 2024-07-24T22:20:13.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.054+0000 7ff87d595640 1 -- 172.21.15.47:0/3951681958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87819efb0 con 0x7ff8781036a0 2024-07-24T22:20:13.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.054+0000 7ff85ffff640 1 -- 172.21.15.47:0/3951681958 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff868035070 con 0x7ff8781036a0 2024-07-24T22:20:13.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.054+0000 7ff87d595640 1 -- 172.21.15.47:0/3951681958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8781a56d0 con 0x7ff8781036a0 2024-07-24T22:20:13.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.055+0000 7ff87d595640 1 -- 172.21.15.47:0/3951681958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff878103a80 con 0x7ff8781036a0 2024-07-24T22:20:13.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.056+0000 7ff85ffff640 1 -- 172.21.15.47:0/3951681958 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7ff868042030 con 0x7ff8781036a0 2024-07-24T22:20:13.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.057+0000 7ff85ffff640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff8600b3d40 0x7ff8600b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:13.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.057+0000 7ff8767fc640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff8600b3d40 0x7ff8600b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:13.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.057+0000 7ff85ffff640 1 -- 172.21.15.47:0/3951681958 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8609+0+0 (secure 0 0 0) 0x7ff8681045b0 con 0x7ff8781036a0 2024-07-24T22:20:13.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.058+0000 7ff8767fc640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff8600b3d40 0x7ff8600b6200 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff87810f220 tx=0x7ff86c00b2e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:13.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.061+0000 7ff85ffff640 1 -- 172.21.15.47:0/3951681958 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7ff8680cb800 con 0x7ff8781036a0 2024-07-24T22:20:13.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.294+0000 7ff87d595640 1 -- 172.21.15.47:0/3951681958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff87802e000 con 0x7ff8781036a0 2024-07-24T22:20:13.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.295+0000 7ff85ffff640 1 -- 172.21.15.47:0/3951681958 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11856 (secure 0 0 0) 0x7ff8680cb100 con 0x7ff8781036a0 2024-07-24T22:20:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:20:13.297 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"btime":"2024-07-24T22:04:10:448158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14706,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2008479600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2008479600},{"type":"v1","addr":"172.21.15.47:6835","nonce":2008479600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3498135783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":3498135783},{"type":"v1","addr":"172.21.15.47:6837","nonce":3498135783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14766,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3216013409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3216013409},{"type":"v1","addr":"172.21.15.47:6839","nonce":3216013409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/516348946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":516348946},{"type":"v1","addr":"172.21.15.47:6841","nonce":516348946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2401857175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2401857175},{"type":"v1","addr":"172.21.15.183:6833","nonce":2401857175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/740841820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":740841820},{"type":"v1","addr":"172.21.15.183:6835","nonce":740841820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24557,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2532099121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":2532099121},{"type":"v1","addr":"172.21.15.183:6837","nonce":2532099121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3861632765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3861632765},{"type":"v1","addr":"172.21.15.188:6833","nonce":3861632765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/2872116437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":2872116437},{"type":"v1","addr":"172.21.15.183:6839","nonce":2872116437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/3246894203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3246894203},{"type":"v1","addr":"172.21.15.188:6835","nonce":3246894203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-24T22:03:54.960171+0000","modified":"2024-07-24T22:04:10.197477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24610":{"gid":24610,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.188:6837/749102233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":749102233},{"type":"v1","addr":"172.21.15.188:6837","nonce":749102233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.188:6839/3781670075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6838","nonce":3781670075},{"type":"v1","addr":"172.21.15.188:6839","nonce":3781670075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24628,"qdb_cluster":[24628]},"id":1}]} 2024-07-24T22:20:13.297 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-07-24T22:20:13.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.297+0000 7ff87d595640 1 -- 172.21.15.47:0/3951681958 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff8600b3d40 msgr2=0x7ff8600b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:13.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.297+0000 7ff87d595640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff8600b3d40 0x7ff8600b6200 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff87810f220 tx=0x7ff86c00b2e0 comp rx=0 tx=0).stop 2024-07-24T22:20:13.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.297+0000 7ff87d595640 1 -- 172.21.15.47:0/3951681958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8781036a0 msgr2=0x7ff878198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:13.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.297+0000 7ff87d595640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8781036a0 0x7ff878198c70 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7ff868005940 tx=0x7ff8680042f0 comp rx=0 tx=0).stop 2024-07-24T22:20:13.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.297+0000 7ff87d595640 1 -- 172.21.15.47:0/3951681958 shutdown_connections 2024-07-24T22:20:13.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.297+0000 7ff87d595640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7ff8600b3d40 0x7ff8600b6200 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:13.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.297+0000 7ff87d595640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff87810cb00 0x7ff87819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:13.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.297+0000 7ff87d595640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff878103fc0 0x7ff8781991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:13.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.297+0000 7ff87d595640 1 --2- 172.21.15.47:0/3951681958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8781036a0 0x7ff878198c70 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:13.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.297+0000 7ff87d595640 1 -- 172.21.15.47:0/3951681958 >> 172.21.15.47:0/3951681958 conn(0x7ff8780fd100 msgr2=0x7ff8780fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:13.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.297+0000 7ff87d595640 1 -- 172.21.15.47:0/3951681958 shutdown_connections 2024-07-24T22:20:13.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:13.297+0000 7ff87d595640 1 -- 172.21.15.47:0/3951681958 wait complete. 2024-07-24T22:20:13.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:13 smithi047 ceph-mon[32551]: pgmap v771: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:20:13.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:13 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3951681958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:20:13.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:13 smithi188 ceph-mon[37380]: pgmap v771: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:20:13.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:13 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3951681958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:20:13.872 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd dump --format=json 2024-07-24T22:20:13.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:13 smithi183 ceph-mon[37007]: pgmap v771: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-07-24T22:20:13.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:13 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3951681958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-24T22:20:14.143 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:20:15.581 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:15 smithi047 ceph-mon[32551]: pgmap v772: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-07-24T22:20:15.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:15 smithi188 ceph-mon[37380]: pgmap v772: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-07-24T22:20:15.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.783+0000 7f5021ada640 1 -- 172.21.15.47:0/3140054623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f501c1070a0 msgr2=0x7f501c1074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:15.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.783+0000 7f5021ada640 1 --2- 172.21.15.47:0/3140054623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f501c1070a0 0x7f501c1074e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f5010009900 tx=0x7f501002a410 comp rx=0 tx=0).stop 2024-07-24T22:20:15.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.783+0000 7f5021ada640 1 -- 172.21.15.47:0/3140054623 shutdown_connections 2024-07-24T22:20:15.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.783+0000 7f5021ada640 1 --2- 172.21.15.47:0/3140054623 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f501c107a20 0x7f501c10e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:15.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.783+0000 7f5021ada640 1 --2- 172.21.15.47:0/3140054623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f501c1070a0 0x7f501c1074e0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:15.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.783+0000 7f5021ada640 1 --2- 172.21.15.47:0/3140054623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f501c101690 0x7f501c101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:15.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.783+0000 7f5021ada640 1 -- 172.21.15.47:0/3140054623 >> 172.21.15.47:0/3140054623 conn(0x7f501c0fd100 msgr2=0x7f501c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:15.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.783+0000 7f5021ada640 1 -- 172.21.15.47:0/3140054623 shutdown_connections 2024-07-24T22:20:15.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.783+0000 7f5021ada640 1 -- 172.21.15.47:0/3140054623 wait complete. 2024-07-24T22:20:15.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.784+0000 7f5021ada640 1 Processor -- start 2024-07-24T22:20:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.784+0000 7f5021ada640 1 -- start start 2024-07-24T22:20:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.784+0000 7f5021ada640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f501c101690 0x7f501c197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.784+0000 7f5021ada640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f501c1070a0 0x7f501c198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.784+0000 7f5021ada640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f501c107a20 0x7f501c19d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.784+0000 7f5021ada640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f501c1116a0 con 0x7f501c107a20 2024-07-24T22:20:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.784+0000 7f5021ada640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f501c111520 con 0x7f501c101690 2024-07-24T22:20:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.784+0000 7f5021ada640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f501c111820 con 0x7f501c1070a0 2024-07-24T22:20:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.784+0000 7f501bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f501c107a20 0x7f501c19d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.784+0000 7f501bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f501c107a20 0x7f501c19d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44640/0 (socket says 172.21.15.47:44640) 2024-07-24T22:20:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.784+0000 7f501bfff640 1 -- 172.21.15.47:0/1055162105 learned_addr learned my addr 172.21.15.47:0/1055162105 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:20:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.785+0000 7f501b7fe640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f501c101690 0x7f501c197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.785+0000 7f501affd640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f501c1070a0 0x7f501c198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.785+0000 7f501bfff640 1 -- 172.21.15.47:0/1055162105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f501c1070a0 msgr2=0x7f501c198150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.785+0000 7f501bfff640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f501c1070a0 0x7f501c198150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.785+0000 7f501bfff640 1 -- 172.21.15.47:0/1055162105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f501c101690 msgr2=0x7f501c197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.785+0000 7f501bfff640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f501c101690 0x7f501c197c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.785+0000 7f501bfff640 1 -- 172.21.15.47:0/1055162105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c19dcc0 con 0x7f501c107a20 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.785+0000 7f501bfff640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f501c107a20 0x7f501c19d4f0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f501400db90 tx=0x7f501400dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.785+0000 7f5018ff9640 1 -- 172.21.15.47:0/1055162105 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501400e980 con 0x7f501c107a20 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.785+0000 7f5018ff9640 1 -- 172.21.15.47:0/1055162105 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5014009580 con 0x7f501c107a20 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.785+0000 7f5018ff9640 1 -- 172.21.15.47:0/1055162105 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014016650 con 0x7f501c107a20 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.785+0000 7f5021ada640 1 -- 172.21.15.47:0/1055162105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501c19df50 con 0x7f501c107a20 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.785+0000 7f5021ada640 1 -- 172.21.15.47:0/1055162105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501c06ae50 con 0x7f501c107a20 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.786+0000 7f5021ada640 1 -- 172.21.15.47:0/1055162105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f501c102940 con 0x7f501c107a20 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.788+0000 7f5018ff9640 1 -- 172.21.15.47:0/1055162105 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f5014009730 con 0x7f501c107a20 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.788+0000 7f5018ff9640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50040b3dc0 0x7f50040b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.789+0000 7f501b7fe640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50040b3dc0 0x7f50040b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:15.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.789+0000 7f5018ff9640 1 -- 172.21.15.47:0/1055162105 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8609+0+0 (secure 0 0 0) 0x7f50140e55f0 con 0x7f501c107a20 2024-07-24T22:20:15.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.789+0000 7f501b7fe640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50040b3dc0 0x7f50040b6280 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f500c0058c0 tx=0x7f500c00a2d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:15.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.792+0000 7f5018ff9640 1 -- 172.21.15.47:0/1055162105 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f50140ac950 con 0x7f501c107a20 2024-07-24T22:20:15.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:15 smithi183 ceph-mon[37007]: pgmap v772: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-07-24T22:20:15.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.987+0000 7f5021ada640 1 -- 172.21.15.47:0/1055162105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f501c06b870 con 0x7f501c107a20 2024-07-24T22:20:15.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.988+0000 7f5018ff9640 1 -- 172.21.15.47:0/1055162105 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+23300 (secure 0 0 0) 0x7f50140ac250 con 0x7f501c107a20 2024-07-24T22:20:15.990 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-07-24T22:20:15.990 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":100,"fsid":"46bf760a-4a07-11ef-bcad-c7b262605968","created":"2024-07-24T21:55:28.945912+0000","modified":"2024-07-24T22:20:10.493688+0000","last_up_change":"2024-07-24T22:02:55.044691+0000","last_in_change":"2024-07-24T22:02:35.671256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T21:59:32.066678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T22:03:49.331120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T22:03:52.034826+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":100,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60de2c3d-e4b7-4878-bdbb-ce3257e3706c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6803","nonce":2665889913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6805","nonce":2665889913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6809","nonce":2665889913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2665889913},{"type":"v1","addr":"172.21.15.47:6807","nonce":2665889913}]},"public_addr":"172.21.15.47:6803/2665889913","cluster_addr":"172.21.15.47:6805/2665889913","heartbeat_back_addr":"172.21.15.47:6809/2665889913","heartbeat_front_addr":"172.21.15.47:6807/2665889913","state":["exists","up"]},{"osd":1,"uuid":"7f086675-3bed-47ca-a93f-fab9580068b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6801","nonce":3486494228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6803","nonce":3486494228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6807","nonce":3486494228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3486494228},{"type":"v1","addr":"172.21.15.183:6805","nonce":3486494228}]},"public_addr":"172.21.15.183:6801/3486494228","cluster_addr":"172.21.15.183:6803/3486494228","heartbeat_back_addr":"172.21.15.183:6807/3486494228","heartbeat_front_addr":"172.21.15.183:6805/3486494228","state":["exists","up"]},{"osd":2,"uuid":"040fff27-6fa6-48de-9365-fcced8f89e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6801","nonce":2245903281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6803","nonce":2245903281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6807","nonce":2245903281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":2245903281},{"type":"v1","addr":"172.21.15.188:6805","nonce":2245903281}]},"public_addr":"172.21.15.188:6801/2245903281","cluster_addr":"172.21.15.188:6803/2245903281","heartbeat_back_addr":"172.21.15.188:6807/2245903281","heartbeat_front_addr":"172.21.15.188:6805/2245903281","state":["exists","up"]},{"osd":3,"uuid":"e129321a-9566-4bea-b982-34f7ddd1ae1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6811","nonce":236749130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6813","nonce":236749130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6817","nonce":236749130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":236749130},{"type":"v1","addr":"172.21.15.47:6815","nonce":236749130}]},"public_addr":"172.21.15.47:6811/236749130","cluster_addr":"172.21.15.47:6813/236749130","heartbeat_back_addr":"172.21.15.47:6817/236749130","heartbeat_front_addr":"172.21.15.47:6815/236749130","state":["exists","up"]},{"osd":4,"uuid":"f969fba7-b0ff-4ea6-83bd-38aba32b1be1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6809","nonce":3978122107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6811","nonce":3978122107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6815","nonce":3978122107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":3978122107},{"type":"v1","addr":"172.21.15.183:6813","nonce":3978122107}]},"public_addr":"172.21.15.183:6809/3978122107","cluster_addr":"172.21.15.183:6811/3978122107","heartbeat_back_addr":"172.21.15.183:6815/3978122107","heartbeat_front_addr":"172.21.15.183:6813/3978122107","state":["exists","up"]},{"osd":5,"uuid":"3799c912-3d9f-4efd-9b36-569c385e4c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6809","nonce":2097128083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6811","nonce":2097128083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6815","nonce":2097128083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":2097128083},{"type":"v1","addr":"172.21.15.188:6813","nonce":2097128083}]},"public_addr":"172.21.15.188:6809/2097128083","cluster_addr":"172.21.15.188:6811/2097128083","heartbeat_back_addr":"172.21.15.188:6815/2097128083","heartbeat_front_addr":"172.21.15.188:6813/2097128083","state":["exists","up"]},{"osd":6,"uuid":"1a38cf12-619f-4e82-a7a5-21ee2014038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6819","nonce":2288252980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6821","nonce":2288252980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6825","nonce":2288252980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2288252980},{"type":"v1","addr":"172.21.15.47:6823","nonce":2288252980}]},"public_addr":"172.21.15.47:6819/2288252980","cluster_addr":"172.21.15.47:6821/2288252980","heartbeat_back_addr":"172.21.15.47:6825/2288252980","heartbeat_front_addr":"172.21.15.47:6823/2288252980","state":["exists","up"]},{"osd":7,"uuid":"6c3f3d5e-9f6d-40cd-a2d4-22d4ec606309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6817","nonce":465426514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6819","nonce":465426514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6823","nonce":465426514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":465426514},{"type":"v1","addr":"172.21.15.183:6821","nonce":465426514}]},"public_addr":"172.21.15.183:6817/465426514","cluster_addr":"172.21.15.183:6819/465426514","heartbeat_back_addr":"172.21.15.183:6823/465426514","heartbeat_front_addr":"172.21.15.183:6821/465426514","state":["exists","up"]},{"osd":8,"uuid":"6dfd7252-61a6-423d-8498-cbcfa41ae1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6817","nonce":2247055658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6819","nonce":2247055658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6823","nonce":2247055658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":2247055658},{"type":"v1","addr":"172.21.15.188:6821","nonce":2247055658}]},"public_addr":"172.21.15.188:6817/2247055658","cluster_addr":"172.21.15.188:6819/2247055658","heartbeat_back_addr":"172.21.15.188:6823/2247055658","heartbeat_front_addr":"172.21.15.188:6821/2247055658","state":["exists","up"]},{"osd":9,"uuid":"abd93c5e-283e-4873-a241-1056f2894116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6827","nonce":2628721884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6829","nonce":2628721884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6833","nonce":2628721884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":2628721884},{"type":"v1","addr":"172.21.15.47:6831","nonce":2628721884}]},"public_addr":"172.21.15.47:6827/2628721884","cluster_addr":"172.21.15.47:6829/2628721884","heartbeat_back_addr":"172.21.15.47:6833/2628721884","heartbeat_front_addr":"172.21.15.47:6831/2628721884","state":["exists","up"]},{"osd":10,"uuid":"bc967f8f-ce27-4230-be70-e36927f89fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6825","nonce":3509332199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6827","nonce":3509332199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6831","nonce":3509332199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3509332199},{"type":"v1","addr":"172.21.15.183:6829","nonce":3509332199}]},"public_addr":"172.21.15.183:6825/3509332199","cluster_addr":"172.21.15.183:6827/3509332199","heartbeat_back_addr":"172.21.15.183:6831/3509332199","heartbeat_front_addr":"172.21.15.183:6829/3509332199","state":["exists","up"]},{"osd":11,"uuid":"8b379865-3a5c-4a2d-aa74-a4f215027fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6825","nonce":3725107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6827","nonce":3725107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6831","nonce":3725107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":3725107101},{"type":"v1","addr":"172.21.15.188:6829","nonce":3725107101}]},"public_addr":"172.21.15.188:6825/3725107101","cluster_addr":"172.21.15.188:6827/3725107101","heartbeat_back_addr":"172.21.15.188:6831/3725107101","heartbeat_front_addr":"172.21.15.188:6829/3725107101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:58:44.413660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:06.554842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:28.651418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T21:59:50.995466+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:13.906535+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:36.632662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:00:59.003224+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:21.701327+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:01:44.017943+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:06.400895+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:29.625920+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T22:02:52.323223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3499235566":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/2112533111":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/2714360830":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/507334607":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6800/2524786594":"2024-07-25T21:57:25.995502+0000","172.21.15.47:0/1004458106":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6800/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/1185381011":"2024-07-25T21:55:50.643046+0000","172.21.15.47:0/1046677443":"2024-07-25T21:55:50.643046+0000","172.21.15.47:6801/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/899235864":"2024-07-25T21:56:15.044564+0000","172.21.15.47:6800/4239008956":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/3057769442":"2024-07-25T21:56:15.044564+0000","172.21.15.47:0/2596054312":"2024-07-25T21:57:25.995502+0000","172.21.15.47:6801/2524786594":"2024-07-25T21:57:25.995502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T22:20:15.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.990+0000 7f5021ada640 1 -- 172.21.15.47:0/1055162105 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50040b3dc0 msgr2=0x7f50040b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:15.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.990+0000 7f5021ada640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50040b3dc0 0x7f50040b6280 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f500c0058c0 tx=0x7f500c00a2d0 comp rx=0 tx=0).stop 2024-07-24T22:20:15.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.990+0000 7f5021ada640 1 -- 172.21.15.47:0/1055162105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f501c107a20 msgr2=0x7f501c19d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:15.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.990+0000 7f5021ada640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f501c107a20 0x7f501c19d4f0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f501400db90 tx=0x7f501400dc80 comp rx=0 tx=0).stop 2024-07-24T22:20:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.990+0000 7f5021ada640 1 -- 172.21.15.47:0/1055162105 shutdown_connections 2024-07-24T22:20:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.990+0000 7f5021ada640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f50040b3dc0 0x7f50040b6280 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.990+0000 7f5021ada640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f501c107a20 0x7f501c19d4f0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.990+0000 7f5021ada640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f501c1070a0 0x7f501c198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.990+0000 7f5021ada640 1 --2- 172.21.15.47:0/1055162105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f501c101690 0x7f501c197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.990+0000 7f5021ada640 1 -- 172.21.15.47:0/1055162105 >> 172.21.15.47:0/1055162105 conn(0x7f501c0fd100 msgr2=0x7f501c0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.990+0000 7f5021ada640 1 -- 172.21.15.47:0/1055162105 shutdown_connections 2024-07-24T22:20:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:15.990+0000 7f5021ada640 1 -- 172.21.15.47:0/1055162105 wait complete. 2024-07-24T22:20:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:16 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1055162105' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:20:16.619 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs fail cephfs 2024-07-24T22:20:16.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:16 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1055162105' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:20:16.886 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:20:16.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:16 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1055162105' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-24T22:20:17.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:17 smithi047 ceph-mon[32551]: pgmap v773: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-07-24T22:20:17.798 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:17 smithi188 ceph-mon[37380]: pgmap v773: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-07-24T22:20:17.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:17 smithi183 ceph-mon[37007]: pgmap v773: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-07-24T22:20:18.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.532+0000 7fd6eb06d640 1 -- 172.21.15.47:0/2663889231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e410cb00 msgr2=0x7fd6e410ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:18.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.532+0000 7fd6eb06d640 1 --2- 172.21.15.47:0/2663889231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e410cb00 0x7fd6e410ef60 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009900 tx=0x7fd6dc02a410 comp rx=0 tx=0).stop 2024-07-24T22:20:18.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.532+0000 7fd6eb06d640 1 -- 172.21.15.47:0/2663889231 shutdown_connections 2024-07-24T22:20:18.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.532+0000 7fd6eb06d640 1 --2- 172.21.15.47:0/2663889231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e410cb00 0x7fd6e410ef60 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:18.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.532+0000 7fd6eb06d640 1 --2- 172.21.15.47:0/2663889231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6e4103fc0 0x7fd6e410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:18.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.532+0000 7fd6eb06d640 1 --2- 172.21.15.47:0/2663889231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6e41036a0 0x7fd6e4103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:18.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.532+0000 7fd6eb06d640 1 -- 172.21.15.47:0/2663889231 >> 172.21.15.47:0/2663889231 conn(0x7fd6e40fd100 msgr2=0x7fd6e40ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:18.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.532+0000 7fd6eb06d640 1 -- 172.21.15.47:0/2663889231 shutdown_connections 2024-07-24T22:20:18.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.532+0000 7fd6eb06d640 1 -- 172.21.15.47:0/2663889231 wait complete. 2024-07-24T22:20:18.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.533+0000 7fd6eb06d640 1 Processor -- start 2024-07-24T22:20:18.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.533+0000 7fd6eb06d640 1 -- start start 2024-07-24T22:20:18.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.533+0000 7fd6eb06d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6e41036a0 0x7fd6e4198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:18.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.533+0000 7fd6eb06d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6e4103fc0 0x7fd6e41990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:18.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.533+0000 7fd6eb06d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e410cb00 0x7fd6e419e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:18.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.533+0000 7fd6eb06d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e4112750 con 0x7fd6e410cb00 2024-07-24T22:20:18.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.533+0000 7fd6eb06d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e41125d0 con 0x7fd6e41036a0 2024-07-24T22:20:18.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.533+0000 7fd6eb06d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e41128d0 con 0x7fd6e4103fc0 2024-07-24T22:20:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.533+0000 7fd6e960a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e410cb00 0x7fd6e419e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.533+0000 7fd6e960a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e410cb00 0x7fd6e419e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44658/0 (socket says 172.21.15.47:44658) 2024-07-24T22:20:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.533+0000 7fd6e960a640 1 -- 172.21.15.47:0/1379816728 learned_addr learned my addr 172.21.15.47:0/1379816728 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:20:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.533+0000 7fd6e3fff640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6e4103fc0 0x7fd6e41990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.533+0000 7fd6e8e09640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6e41036a0 0x7fd6e4198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.534+0000 7fd6e960a640 1 -- 172.21.15.47:0/1379816728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6e4103fc0 msgr2=0x7fd6e41990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.534+0000 7fd6e960a640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6e4103fc0 0x7fd6e41990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.534+0000 7fd6e960a640 1 -- 172.21.15.47:0/1379816728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6e41036a0 msgr2=0x7fd6e4198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.534+0000 7fd6e960a640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6e41036a0 0x7fd6e4198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.534+0000 7fd6e960a640 1 -- 172.21.15.47:0/1379816728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e419ec50 con 0x7fd6e410cb00 2024-07-24T22:20:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.534+0000 7fd6e960a640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e410cb00 0x7fd6e419e480 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc004770 tx=0x7fd6dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.534+0000 7fd6e1ffb640 1 -- 172.21.15.47:0/1379816728 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc03f030 con 0x7fd6e410cb00 2024-07-24T22:20:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.534+0000 7fd6e1ffb640 1 -- 172.21.15.47:0/1379816728 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6dc003aa0 con 0x7fd6e410cb00 2024-07-24T22:20:18.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.534+0000 7fd6eb06d640 1 -- 172.21.15.47:0/1379816728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e419eee0 con 0x7fd6e410cb00 2024-07-24T22:20:18.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.534+0000 7fd6e1ffb640 1 -- 172.21.15.47:0/1379816728 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc035070 con 0x7fd6e410cb00 2024-07-24T22:20:18.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.534+0000 7fd6eb06d640 1 -- 172.21.15.47:0/1379816728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e41a5600 con 0x7fd6e410cb00 2024-07-24T22:20:18.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.535+0000 7fd6eb06d640 1 -- 172.21.15.47:0/1379816728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e4103a80 con 0x7fd6e410cb00 2024-07-24T22:20:18.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.537+0000 7fd6e1ffb640 1 -- 172.21.15.47:0/1379816728 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fd6dc042030 con 0x7fd6e410cb00 2024-07-24T22:20:18.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.537+0000 7fd6e1ffb640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd6d00b3d40 0x7fd6d00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:18.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.537+0000 7fd6e8e09640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd6d00b3d40 0x7fd6d00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:18.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.538+0000 7fd6e1ffb640 1 -- 172.21.15.47:0/1379816728 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8609+0+0 (secure 0 0 0) 0x7fd6dc104990 con 0x7fd6e410cb00 2024-07-24T22:20:18.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.538+0000 7fd6e8e09640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd6d00b3d40 0x7fd6d00b6200 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4007ec0 tx=0x7fd6d40075b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:18.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.540+0000 7fd6e1ffb640 1 -- 172.21.15.47:0/1379816728 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fd6dc0cb5f0 con 0x7fd6e410cb00 2024-07-24T22:20:18.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.775+0000 7fd6eb06d640 1 -- 172.21.15.47:0/1379816728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd6e41a5890 con 0x7fd6e410cb00 2024-07-24T22:20:18.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.777+0000 7fd6e1ffb640 1 -- 172.21.15.47:0/1379816728 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) ==== 161+0+0 (secure 0 0 0) 0x7fd6dc0cfb40 con 0x7fd6e410cb00 2024-07-24T22:20:18.779 INFO:teuthology.orchestra.run.smithi047.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-07-24T22:20:18.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.781+0000 7fd6eb06d640 1 -- 172.21.15.47:0/1379816728 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd6d00b3d40 msgr2=0x7fd6d00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:18.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.781+0000 7fd6eb06d640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd6d00b3d40 0x7fd6d00b6200 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4007ec0 tx=0x7fd6d40075b0 comp rx=0 tx=0).stop 2024-07-24T22:20:18.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.781+0000 7fd6eb06d640 1 -- 172.21.15.47:0/1379816728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e410cb00 msgr2=0x7fd6e419e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:18.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.781+0000 7fd6eb06d640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e410cb00 0x7fd6e419e480 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc004770 tx=0x7fd6dc004270 comp rx=0 tx=0).stop 2024-07-24T22:20:18.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.781+0000 7fd6eb06d640 1 -- 172.21.15.47:0/1379816728 shutdown_connections 2024-07-24T22:20:18.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.781+0000 7fd6eb06d640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fd6d00b3d40 0x7fd6d00b6200 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:18.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.781+0000 7fd6eb06d640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e410cb00 0x7fd6e419e480 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:18.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.781+0000 7fd6eb06d640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6e4103fc0 0x7fd6e41990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:18.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.781+0000 7fd6eb06d640 1 --2- 172.21.15.47:0/1379816728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6e41036a0 0x7fd6e4198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:18.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.781+0000 7fd6eb06d640 1 -- 172.21.15.47:0/1379816728 >> 172.21.15.47:0/1379816728 conn(0x7fd6e40fd100 msgr2=0x7fd6e410ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:18.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.781+0000 7fd6eb06d640 1 -- 172.21.15.47:0/1379816728 shutdown_connections 2024-07-24T22:20:18.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:18.781+0000 7fd6eb06d640 1 -- 172.21.15.47:0/1379816728 wait complete. 2024-07-24T22:20:19.102 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:18 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a[32547]: 2024-07-24T22:20:18.776+0000 7fe071ac0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-24T22:20:19.299 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:20:18 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-c[69223]: ignoring --setuser ceph since I am not root 2024-07-24T22:20:19.299 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:20:18 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-c[69223]: ignoring --setgroup ceph since I am not root 2024-07-24T22:20:19.299 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:20:18 smithi188 ceph-mds[69227]: -- 172.21.15.188:0/1240752193 <== mon.1 v2:172.21.15.188:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5579cd435c20 con 0x5579cd413400 2024-07-24T22:20:19.299 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:20:18 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-c[69223]: starting mds.c at 2024-07-24T22:20:19.300 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:20:18 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-i[69536]: ignoring --setuser ceph since I am not root 2024-07-24T22:20:19.300 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:20:18 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-i[69536]: ignoring --setgroup ceph since I am not root 2024-07-24T22:20:19.300 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:20:18 smithi188 ceph-mds[69540]: -- 172.21.15.188:0/784670751 <== mon.2 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5577677f9860 con 0x5577677d7000 2024-07-24T22:20:19.300 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:20:18 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-i[69536]: starting mds.i at 2024-07-24T22:20:19.433 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-07-24T22:20:19.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:19 smithi047 ceph-mon[32551]: pgmap v774: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-07-24T22:20:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:19 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1379816728' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-07-24T22:20:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:19 smithi047 ceph-mon[32551]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-24T22:20:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:19 smithi047 ceph-mon[32551]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-24T22:20:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:19 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1379816728' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-07-24T22:20:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:19 smithi047 ceph-mon[32551]: osdmap e101: 12 total, 12 up, 12 in 2024-07-24T22:20:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:19 smithi047 ceph-mon[32551]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-07-24T22:20:19.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:19 smithi047 ceph-mon[32551]: osdmap e102: 12 total, 12 up, 12 in 2024-07-24T22:20:19.701 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:20:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:19 smithi188 ceph-mon[37380]: pgmap v774: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-07-24T22:20:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:19 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1379816728' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-07-24T22:20:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:19 smithi188 ceph-mon[37380]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-24T22:20:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:19 smithi188 ceph-mon[37380]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-24T22:20:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:19 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1379816728' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-07-24T22:20:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:19 smithi188 ceph-mon[37380]: osdmap e101: 12 total, 12 up, 12 in 2024-07-24T22:20:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:19 smithi188 ceph-mon[37380]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-07-24T22:20:19.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:19 smithi188 ceph-mon[37380]: osdmap e102: 12 total, 12 up, 12 in 2024-07-24T22:20:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:19 smithi183 ceph-mon[37007]: pgmap v774: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-07-24T22:20:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:19 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1379816728' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-07-24T22:20:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:19 smithi183 ceph-mon[37007]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-24T22:20:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:19 smithi183 ceph-mon[37007]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-24T22:20:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:19 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1379816728' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-07-24T22:20:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:19 smithi183 ceph-mon[37007]: osdmap e101: 12 total, 12 up, 12 in 2024-07-24T22:20:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:19 smithi183 ceph-mon[37007]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-07-24T22:20:19.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:19 smithi183 ceph-mon[37007]: osdmap e102: 12 total, 12 up, 12 in 2024-07-24T22:20:21.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:20 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.188:6836/1718746550,v1:172.21.15.188:6838/1718746550] up:boot 2024-07-24T22:20:21.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:20 smithi188 ceph-mon[37380]: mds.? [v2:172.21.15.188:6837/102862712,v1:172.21.15.188:6839/102862712] up:boot 2024-07-24T22:20:21.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:20 smithi188 ceph-mon[37380]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-07-24T22:20:21.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-24T22:20:21.050 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:20 smithi188 ceph-mon[37380]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-24T22:20:21.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:20 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.188:6836/1718746550,v1:172.21.15.188:6838/1718746550] up:boot 2024-07-24T22:20:21.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:20 smithi047 ceph-mon[32551]: mds.? [v2:172.21.15.188:6837/102862712,v1:172.21.15.188:6839/102862712] up:boot 2024-07-24T22:20:21.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:20 smithi047 ceph-mon[32551]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-07-24T22:20:21.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-24T22:20:21.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:20 smithi047 ceph-mon[32551]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-24T22:20:21.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:20 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.188:6836/1718746550,v1:172.21.15.188:6838/1718746550] up:boot 2024-07-24T22:20:21.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:20 smithi183 ceph-mon[37007]: mds.? [v2:172.21.15.188:6837/102862712,v1:172.21.15.188:6839/102862712] up:boot 2024-07-24T22:20:21.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:20 smithi183 ceph-mon[37007]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-07-24T22:20:21.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-24T22:20:21.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:20 smithi183 ceph-mon[37007]: from='mgr.14214 172.21.15.47:0/2217416880' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-24T22:20:21.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.288+0000 7f2292796640 1 -- 172.21.15.47:0/294286473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f228c10ad00 msgr2=0x7f228c111500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.288+0000 7f2292796640 1 --2- 172.21.15.47:0/294286473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f228c10ad00 0x7f228c111500 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f2284009ca0 tx=0x7f228402a8c0 comp rx=0 tx=0).stop 2024-07-24T22:20:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.288+0000 7f2292796640 1 -- 172.21.15.47:0/294286473 shutdown_connections 2024-07-24T22:20:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.288+0000 7f2292796640 1 --2- 172.21.15.47:0/294286473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f228c10ad00 0x7f228c111500 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.288+0000 7f2292796640 1 --2- 172.21.15.47:0/294286473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f228c10a380 0x7f228c10a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.288+0000 7f2292796640 1 --2- 172.21.15.47:0/294286473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f228c104970 0x7f228c104d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.288+0000 7f2292796640 1 -- 172.21.15.47:0/294286473 >> 172.21.15.47:0/294286473 conn(0x7f228c1003e0 msgr2=0x7f228c102800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.288+0000 7f2292796640 1 -- 172.21.15.47:0/294286473 shutdown_connections 2024-07-24T22:20:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.288+0000 7f2292796640 1 -- 172.21.15.47:0/294286473 wait complete. 2024-07-24T22:20:21.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.289+0000 7f2292796640 1 Processor -- start 2024-07-24T22:20:21.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.289+0000 7f2292796640 1 -- start start 2024-07-24T22:20:21.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.289+0000 7f2292796640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f228c104970 0x7f228c19adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:21.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.289+0000 7f2292796640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f228c10a380 0x7f228c19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:21.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.289+0000 7f2292796640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f228c10ad00 0x7f228c1a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:21.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.289+0000 7f2292796640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1149c0 con 0x7f228c104970 2024-07-24T22:20:21.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.289+0000 7f2292796640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f228c114840 con 0x7f228c10a380 2024-07-24T22:20:21.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.289+0000 7f2292796640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f228c114b40 con 0x7f228c10ad00 2024-07-24T22:20:21.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.289+0000 7f228bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f228c104970 0x7f228c19adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:21.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f228bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f228c104970 0x7f228c19adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44668/0 (socket says 172.21.15.47:44668) 2024-07-24T22:20:21.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f228bfff640 1 -- 172.21.15.47:0/3062173724 learned_addr learned my addr 172.21.15.47:0/3062173724 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:20:21.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f2290d33640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f228c10ad00 0x7f228c1a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:21.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f228b7fe640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f228c10a380 0x7f228c19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:21.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f228bfff640 1 -- 172.21.15.47:0/3062173724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f228c10ad00 msgr2=0x7f228c1a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:21.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f228bfff640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f228c10ad00 0x7f228c1a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:21.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f228bfff640 1 -- 172.21.15.47:0/3062173724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f228c10a380 msgr2=0x7f228c19b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:21.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f228bfff640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f228c10a380 0x7f228c19b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:21.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f228bfff640 1 -- 172.21.15.47:0/3062173724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c1a0e60 con 0x7f228c104970 2024-07-24T22:20:21.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f228bfff640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f228c104970 0x7f228c19adb0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f227c00d770 tx=0x7f227c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:21.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f22897fa640 1 -- 172.21.15.47:0/3062173724 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c017070 con 0x7f228c104970 2024-07-24T22:20:21.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f22897fa640 1 -- 172.21.15.47:0/3062173724 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f227c0054d0 con 0x7f228c104970 2024-07-24T22:20:21.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f2292796640 1 -- 172.21.15.47:0/3062173724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c1a1150 con 0x7f228c104970 2024-07-24T22:20:21.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f22897fa640 1 -- 172.21.15.47:0/3062173724 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c004c30 con 0x7f228c104970 2024-07-24T22:20:21.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.290+0000 7f2292796640 1 -- 172.21.15.47:0/3062173724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c1a7810 con 0x7f228c104970 2024-07-24T22:20:21.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.292+0000 7f2292796640 1 -- 172.21.15.47:0/3062173724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c104d50 con 0x7f228c104970 2024-07-24T22:20:21.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.293+0000 7f22897fa640 1 -- 172.21.15.47:0/3062173724 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f227c004eb0 con 0x7f228c104970 2024-07-24T22:20:21.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.294+0000 7f22897fa640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f22740b3d40 0x7f22740b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:21.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.294+0000 7f228b7fe640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f22740b3d40 0x7f22740b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:21.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.294+0000 7f22897fa640 1 -- 172.21.15.47:0/3062173724 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8651+0+0 (secure 0 0 0) 0x7f227c0e3b00 con 0x7f228c104970 2024-07-24T22:20:21.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.294+0000 7f228b7fe640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f22740b3d40 0x7f22740b6200 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f228c109e40 tx=0x7f2280005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:21.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.298+0000 7f22897fa640 1 -- 172.21.15.47:0/3062173724 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f227c0aa740 con 0x7f228c104970 2024-07-24T22:20:21.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.531+0000 7f2292796640 1 -- 172.21.15.47:0/3062173724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f228c10c550 con 0x7f228c104970 2024-07-24T22:20:21.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.786+0000 7f22897fa640 1 -- 172.21.15.47:0/3062173724 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f227c0aec90 con 0x7f228c104970 2024-07-24T22:20:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.788+0000 7f2292796640 1 -- 172.21.15.47:0/3062173724 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f22740b3d40 msgr2=0x7f22740b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.788+0000 7f2292796640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f22740b3d40 0x7f22740b6200 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f228c109e40 tx=0x7f2280005f90 comp rx=0 tx=0).stop 2024-07-24T22:20:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.788+0000 7f2292796640 1 -- 172.21.15.47:0/3062173724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f228c104970 msgr2=0x7f228c19adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.788+0000 7f2292796640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f228c104970 0x7f228c19adb0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f227c00d770 tx=0x7f227c00dc30 comp rx=0 tx=0).stop 2024-07-24T22:20:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.789+0000 7f2292796640 1 -- 172.21.15.47:0/3062173724 shutdown_connections 2024-07-24T22:20:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.789+0000 7f2292796640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f22740b3d40 0x7f22740b6200 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.789+0000 7f2292796640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f228c10ad00 0x7f228c1a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.789+0000 7f2292796640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f228c10a380 0x7f228c19b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.789+0000 7f2292796640 1 --2- 172.21.15.47:0/3062173724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f228c104970 0x7f228c19adb0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.789+0000 7f2292796640 1 -- 172.21.15.47:0/3062173724 >> 172.21.15.47:0/3062173724 conn(0x7f228c1003e0 msgr2=0x7f228c1027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:21.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.789+0000 7f2292796640 1 -- 172.21.15.47:0/3062173724 shutdown_connections 2024-07-24T22:20:21.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:21.789+0000 7f2292796640 1 -- 172.21.15.47:0/3062173724 wait complete. 2024-07-24T22:20:22.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:21 smithi188 ceph-mon[37380]: pgmap v777: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-07-24T22:20:22.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:21 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3062173724' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-07-24T22:20:22.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:21 smithi047 ceph-mon[32551]: pgmap v777: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-07-24T22:20:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:21 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3062173724' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-07-24T22:20:22.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:21 smithi183 ceph-mon[37007]: pgmap v777: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-07-24T22:20:22.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:21 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3062173724' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-07-24T22:20:22.382 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-07-24T22:20:22.651 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:20:23.036 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:22 smithi047 ceph-mon[32551]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-24T22:20:23.037 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:22 smithi047 ceph-mon[32551]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-07-24T22:20:23.037 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:22 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/3062173724' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-07-24T22:20:23.037 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:22 smithi047 ceph-mon[32551]: fsmap 12 up:standby 2024-07-24T22:20:23.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:22 smithi188 ceph-mon[37380]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-24T22:20:23.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:22 smithi188 ceph-mon[37380]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-07-24T22:20:23.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:22 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/3062173724' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-07-24T22:20:23.049 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:22 smithi188 ceph-mon[37380]: fsmap 12 up:standby 2024-07-24T22:20:23.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:22 smithi183 ceph-mon[37007]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-24T22:20:23.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:22 smithi183 ceph-mon[37007]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-07-24T22:20:23.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:22 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/3062173724' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-07-24T22:20:23.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:22 smithi183 ceph-mon[37007]: fsmap 12 up:standby 2024-07-24T22:20:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:23 smithi047 ceph-mon[32551]: pgmap v778: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 127 B/s wr, 1 op/s 2024-07-24T22:20:24.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:23 smithi183 ceph-mon[37007]: pgmap v778: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 127 B/s wr, 1 op/s 2024-07-24T22:20:24.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:23 smithi188 ceph-mon[37380]: pgmap v778: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 127 B/s wr, 1 op/s 2024-07-24T22:20:24.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.314+0000 7fb870384640 1 -- 172.21.15.47:0/3808895566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8681011e0 msgr2=0x7fb8681015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:24.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.314+0000 7fb870384640 1 --2- 172.21.15.47:0/3808895566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8681011e0 0x7fb8681015c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fb864009900 tx=0x7fb86402a410 comp rx=0 tx=0).stop 2024-07-24T22:20:24.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.314+0000 7fb870384640 1 -- 172.21.15.47:0/3808895566 shutdown_connections 2024-07-24T22:20:24.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.314+0000 7fb870384640 1 --2- 172.21.15.47:0/3808895566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb868107190 0x7fb86810d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:24.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.314+0000 7fb870384640 1 --2- 172.21.15.47:0/3808895566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb868106810 0x7fb868106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:24.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.314+0000 7fb870384640 1 --2- 172.21.15.47:0/3808895566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8681011e0 0x7fb8681015c0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:24.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.314+0000 7fb870384640 1 -- 172.21.15.47:0/3808895566 >> 172.21.15.47:0/3808895566 conn(0x7fb868076940 msgr2=0x7fb868076d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:24.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.314+0000 7fb870384640 1 -- 172.21.15.47:0/3808895566 shutdown_connections 2024-07-24T22:20:24.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.314+0000 7fb870384640 1 -- 172.21.15.47:0/3808895566 wait complete. 2024-07-24T22:20:24.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.314+0000 7fb870384640 1 Processor -- start 2024-07-24T22:20:24.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.314+0000 7fb870384640 1 -- start start 2024-07-24T22:20:24.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb870384640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8681011e0 0x7fb8680fe080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:24.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb870384640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb868106810 0x7fb8680fe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:24.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb870384640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb868107190 0x7fb8680feb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:24.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb870384640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681116d0 con 0x7fb868106810 2024-07-24T22:20:24.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb870384640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb868111550 con 0x7fb868107190 2024-07-24T22:20:24.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb870384640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb868111850 con 0x7fb8681011e0 2024-07-24T22:20:24.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb86d91f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb868106810 0x7fb8680fe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:24.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb86d91f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb868106810 0x7fb8680fe5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44682/0 (socket says 172.21.15.47:44682) 2024-07-24T22:20:24.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb86d91f640 1 -- 172.21.15.47:0/2716520206 learned_addr learned my addr 172.21.15.47:0/2716520206 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:20:24.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb86e120640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8681011e0 0x7fb8680fe080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:24.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb86e921640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb868107190 0x7fb8680feb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:24.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb86d91f640 1 -- 172.21.15.47:0/2716520206 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8681011e0 msgr2=0x7fb8680fe080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:24.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb86d91f640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8681011e0 0x7fb8680fe080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb86d91f640 1 -- 172.21.15.47:0/2716520206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb868107190 msgr2=0x7fb8680feb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb86d91f640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb868107190 0x7fb8680feb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb86d91f640 1 -- 172.21.15.47:0/2716520206 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8681a7130 con 0x7fb868106810 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb86e921640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb868107190 0x7fb8680feb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb86d91f640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb868106810 0x7fb8680fe5c0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c970 tx=0x7fb85800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb85f7fe640 1 -- 172.21.15.47:0/2716520206 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858007bb0 con 0x7fb868106810 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb870384640 1 -- 172.21.15.47:0/2716520206 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8681a7420 con 0x7fb868106810 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb85f7fe640 1 -- 172.21.15.47:0/2716520206 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb858007d50 con 0x7fb868106810 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.315+0000 7fb85f7fe640 1 -- 172.21.15.47:0/2716520206 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85800f450 con 0x7fb868106810 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.316+0000 7fb870384640 1 -- 172.21.15.47:0/2716520206 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8681a7960 con 0x7fb868106810 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.317+0000 7fb870384640 1 -- 172.21.15.47:0/2716520206 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8681015c0 con 0x7fb868106810 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.318+0000 7fb85f7fe640 1 -- 172.21.15.47:0/2716520206 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7fb858004f20 con 0x7fb868106810 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.319+0000 7fb85f7fe640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb8540b3d40 0x7fb8540b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:24.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.319+0000 7fb86e120640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb8540b3d40 0x7fb8540b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:24.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.319+0000 7fb85f7fe640 1 -- 172.21.15.47:0/2716520206 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8651+0+0 (secure 0 0 0) 0x7fb8580e3e70 con 0x7fb868106810 2024-07-24T22:20:24.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.319+0000 7fb86e120640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb8540b3d40 0x7fb8540b6200 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb864006010 tx=0x7fb864000bc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:24.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.323+0000 7fb85f7fe640 1 -- 172.21.15.47:0/2716520206 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7fb858014030 con 0x7fb868106810 2024-07-24T22:20:24.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.518+0000 7fb870384640 1 -- 172.21.15.47:0/2716520206 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb86802e000 con 0x7fb868106810 2024-07-24T22:20:24.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.804+0000 7fb85f7fe640 1 -- 172.21.15.47:0/2716520206 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v103) ==== 181+0+0 (secure 0 0 0) 0x7fb8580ab100 con 0x7fb868106810 2024-07-24T22:20:24.807 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' removed 2024-07-24T22:20:24.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.808+0000 7fb870384640 1 -- 172.21.15.47:0/2716520206 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb8540b3d40 msgr2=0x7fb8540b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:24.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.808+0000 7fb870384640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb8540b3d40 0x7fb8540b6200 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb864006010 tx=0x7fb864000bc0 comp rx=0 tx=0).stop 2024-07-24T22:20:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.808+0000 7fb870384640 1 -- 172.21.15.47:0/2716520206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb868106810 msgr2=0x7fb8680fe5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.808+0000 7fb870384640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb868106810 0x7fb8680fe5c0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c970 tx=0x7fb85800ce30 comp rx=0 tx=0).stop 2024-07-24T22:20:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.808+0000 7fb870384640 1 -- 172.21.15.47:0/2716520206 shutdown_connections 2024-07-24T22:20:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.808+0000 7fb870384640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7fb8540b3d40 0x7fb8540b6200 secure :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb864006010 tx=0x7fb864000bc0 comp rx=0 tx=0).stop 2024-07-24T22:20:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.808+0000 7fb870384640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb868107190 0x7fb8680feb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.808+0000 7fb870384640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb868106810 0x7fb8680fe5c0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.808+0000 7fb870384640 1 --2- 172.21.15.47:0/2716520206 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8681011e0 0x7fb8680fe080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.808+0000 7fb870384640 1 -- 172.21.15.47:0/2716520206 >> 172.21.15.47:0/2716520206 conn(0x7fb868076940 msgr2=0x7fb86810e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.808+0000 7fb870384640 1 -- 172.21.15.47:0/2716520206 shutdown_connections 2024-07-24T22:20:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:24.808+0000 7fb870384640 1 -- 172.21.15.47:0/2716520206 wait complete. 2024-07-24T22:20:25.097 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:24 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2716520206' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-24T22:20:25.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:24 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2716520206' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-24T22:20:25.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:24 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2716520206' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-24T22:20:25.442 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2 shell --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-07-24T22:20:25.718 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/mon.a/config 2024-07-24T22:20:26.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:25 smithi047 ceph-mon[32551]: pgmap v779: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 127 B/s wr, 1 op/s 2024-07-24T22:20:26.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:25 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/2716520206' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-07-24T22:20:26.084 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:25 smithi047 ceph-mon[32551]: osdmap e103: 12 total, 12 up, 12 in 2024-07-24T22:20:26.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:25 smithi183 ceph-mon[37007]: pgmap v779: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 127 B/s wr, 1 op/s 2024-07-24T22:20:26.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:25 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/2716520206' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-07-24T22:20:26.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:25 smithi183 ceph-mon[37007]: osdmap e103: 12 total, 12 up, 12 in 2024-07-24T22:20:26.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:25 smithi188 ceph-mon[37380]: pgmap v779: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 127 B/s wr, 1 op/s 2024-07-24T22:20:26.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:25 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/2716520206' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-07-24T22:20:26.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:25 smithi188 ceph-mon[37380]: osdmap e103: 12 total, 12 up, 12 in 2024-07-24T22:20:27.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.368+0000 7f0022ef9640 1 -- 172.21.15.47:0/2893111247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c1036a0 msgr2=0x7f001c103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:27.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.368+0000 7f0022ef9640 1 --2- 172.21.15.47:0/2893111247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c1036a0 0x7f001c103a80 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f0010009900 tx=0x7f001002a410 comp rx=0 tx=0).stop 2024-07-24T22:20:27.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.368+0000 7f0022ef9640 1 -- 172.21.15.47:0/2893111247 shutdown_connections 2024-07-24T22:20:27.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.368+0000 7f0022ef9640 1 --2- 172.21.15.47:0/2893111247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f001c10cb00 0x7f001c10ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:27.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.368+0000 7f0022ef9640 1 --2- 172.21.15.47:0/2893111247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f001c103fc0 0x7f001c10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:27.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.368+0000 7f0022ef9640 1 --2- 172.21.15.47:0/2893111247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c1036a0 0x7f001c103a80 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:27.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.368+0000 7f0022ef9640 1 -- 172.21.15.47:0/2893111247 >> 172.21.15.47:0/2893111247 conn(0x7f001c0fd100 msgr2=0x7f001c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:27.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.368+0000 7f0022ef9640 1 -- 172.21.15.47:0/2893111247 shutdown_connections 2024-07-24T22:20:27.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.368+0000 7f0022ef9640 1 -- 172.21.15.47:0/2893111247 wait complete. 2024-07-24T22:20:27.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.369+0000 7f0022ef9640 1 Processor -- start 2024-07-24T22:20:27.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.369+0000 7f0022ef9640 1 -- start start 2024-07-24T22:20:27.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.369+0000 7f0022ef9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f001c1036a0 0x7f001c101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:27.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.369+0000 7f0022ef9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f001c103fc0 0x7f001c101890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:27.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.369+0000 7f0022ef9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10cb00 0x7f001c101dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:27.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.369+0000 7f0022ef9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f001c112740 con 0x7f001c10cb00 2024-07-24T22:20:27.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.369+0000 7f0022ef9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f001c1125c0 con 0x7f001c103fc0 2024-07-24T22:20:27.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.369+0000 7f0022ef9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f001c1128c0 con 0x7f001c1036a0 2024-07-24T22:20:27.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.369+0000 7f0021496640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10cb00 0x7f001c101dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:27.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.369+0000 7f0021496640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10cb00 0x7f001c101dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41284/0 (socket says 172.21.15.47:41284) 2024-07-24T22:20:27.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.369+0000 7f0021496640 1 -- 172.21.15.47:0/1291560070 learned_addr learned my addr 172.21.15.47:0/1291560070 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-07-24T22:20:27.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.369+0000 7f0020c95640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f001c1036a0 0x7f001c101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:27.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.369+0000 7f001bfff640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f001c103fc0 0x7f001c101890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:27.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.370+0000 7f0021496640 1 -- 172.21.15.47:0/1291560070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f001c1036a0 msgr2=0x7f001c101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:27.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.370+0000 7f0021496640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f001c1036a0 0x7f001c101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:27.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.370+0000 7f0021496640 1 -- 172.21.15.47:0/1291560070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f001c103fc0 msgr2=0x7f001c101890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.370+0000 7f0021496640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f001c103fc0 0x7f001c101890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.370+0000 7f0021496640 1 -- 172.21.15.47:0/1291560070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c1a7090 con 0x7f001c10cb00 2024-07-24T22:20:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.370+0000 7f0021496640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10cb00 0x7f001c101dd0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f001400cad0 tx=0x7f001400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.370+0000 7f0019ffb640 1 -- 172.21.15.47:0/1291560070 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001400ae20 con 0x7f001c10cb00 2024-07-24T22:20:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.370+0000 7f0019ffb640 1 -- 172.21.15.47:0/1291560070 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0014005020 con 0x7f001c10cb00 2024-07-24T22:20:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.370+0000 7f0022ef9640 1 -- 172.21.15.47:0/1291560070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001c1a7380 con 0x7f001c10cb00 2024-07-24T22:20:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.370+0000 7f0019ffb640 1 -- 172.21.15.47:0/1291560070 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001400f6b0 con 0x7f001c10cb00 2024-07-24T22:20:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.370+0000 7f0022ef9640 1 -- 172.21.15.47:0/1291560070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001c1a78c0 con 0x7f001c10cb00 2024-07-24T22:20:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.371+0000 7f0022ef9640 1 -- 172.21.15.47:0/1291560070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001c103a80 con 0x7f001c10cb00 2024-07-24T22:20:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.373+0000 7f0019ffb640 1 -- 172.21.15.47:0/1291560070 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 151190+0+0 (secure 0 0 0) 0x7f00140051d0 con 0x7f001c10cb00 2024-07-24T22:20:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.374+0000 7f0019ffb640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f000c0b3dc0 0x7f000c0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T22:20:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.374+0000 7f0020c95640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f000c0b3dc0 0x7f000c0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T22:20:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.374+0000 7f0019ffb640 1 -- 172.21.15.47:0/1291560070 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8045+0+0 (secure 0 0 0) 0x7f00140e4170 con 0x7f001c10cb00 2024-07-24T22:20:27.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.374+0000 7f0020c95640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f000c0b3dc0 0x7f000c0b6280 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0010031440 tx=0x7f0010005e80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T22:20:27.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.377+0000 7f0019ffb640 1 -- 172.21.15.47:0/1291560070 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+193992 (secure 0 0 0) 0x7f0014014030 con 0x7f001c10cb00 2024-07-24T22:20:27.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.572+0000 7f0022ef9640 1 -- 172.21.15.47:0/1291560070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f001c02e000 con 0x7f001c10cb00 2024-07-24T22:20:27.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.809+0000 7f0019ffb640 1 -- 172.21.15.47:0/1291560070 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v104) ==== 169+0+0 (secure 0 0 0) 0x7f00140ab040 con 0x7f001c10cb00 2024-07-24T22:20:27.811 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' removed 2024-07-24T22:20:27.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.813+0000 7f0022ef9640 1 -- 172.21.15.47:0/1291560070 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f000c0b3dc0 msgr2=0x7f000c0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:27.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.813+0000 7f0022ef9640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f000c0b3dc0 0x7f000c0b6280 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0010031440 tx=0x7f0010005e80 comp rx=0 tx=0).stop 2024-07-24T22:20:27.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.813+0000 7f0022ef9640 1 -- 172.21.15.47:0/1291560070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10cb00 msgr2=0x7f001c101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T22:20:27.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.813+0000 7f0022ef9640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10cb00 0x7f001c101dd0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f001400cad0 tx=0x7f001400cf90 comp rx=0 tx=0).stop 2024-07-24T22:20:27.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.813+0000 7f0022ef9640 1 -- 172.21.15.47:0/1291560070 shutdown_connections 2024-07-24T22:20:27.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.813+0000 7f0022ef9640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.47:6800/4198530936,v1:172.21.15.47:6801/4198530936] conn(0x7f000c0b3dc0 0x7f000c0b6280 secure :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0010031440 tx=0x7f0010005e80 comp rx=0 tx=0).stop 2024-07-24T22:20:27.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.813+0000 7f0022ef9640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c10cb00 0x7f001c101dd0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:27.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.813+0000 7f0022ef9640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f001c103fc0 0x7f001c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:27.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.813+0000 7f0022ef9640 1 --2- 172.21.15.47:0/1291560070 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f001c1036a0 0x7f001c101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T22:20:27.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.813+0000 7f0022ef9640 1 -- 172.21.15.47:0/1291560070 >> 172.21.15.47:0/1291560070 conn(0x7f001c0fd100 msgr2=0x7f001c0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T22:20:27.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.814+0000 7f0022ef9640 1 -- 172.21.15.47:0/1291560070 shutdown_connections 2024-07-24T22:20:27.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-07-24T22:20:27.814+0000 7f0022ef9640 1 -- 172.21.15.47:0/1291560070 wait complete. 2024-07-24T22:20:27.832 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:27 smithi047 ceph-mon[32551]: pgmap v781: 65 pgs: 65 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:20:27.832 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:27 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1291560070' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-24T22:20:28.101 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:27 smithi188 ceph-mon[37380]: pgmap v781: 65 pgs: 65 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:20:28.101 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:27 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1291560070' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-24T22:20:28.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:27 smithi183 ceph-mon[37007]: pgmap v781: 65 pgs: 65 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail 2024-07-24T22:20:28.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:27 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1291560070' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-07-24T22:20:28.608 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-07-24T22:20:28.646 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-07-24T22:20:28.675 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-07-24T22:20:28.702 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-07-24T22:20:28.702 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-07-24T22:20:28.724 DEBUG:teuthology.orchestra.run.smithi183:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-07-24T22:20:28.738 DEBUG:teuthology.orchestra.run.smithi188:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-07-24T22:20:28.756 INFO:tasks.cephadm:Stopping all daemons... 2024-07-24T22:20:28.757 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-07-24T22:20:28.757 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.a 2024-07-24T22:20:28.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:28 smithi047 systemd[1]: Stopping Ceph mon.a for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:20:29.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:28 smithi188 ceph-mon[37380]: from='client.? 172.21.15.47:0/1291560070' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-07-24T22:20:29.048 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:28 smithi188 ceph-mon[37380]: osdmap e104: 12 total, 12 up, 12 in 2024-07-24T22:20:29.119 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:28 smithi047 ceph-mon[32551]: from='client.? 172.21.15.47:0/1291560070' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-07-24T22:20:29.119 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:28 smithi047 ceph-mon[32551]: osdmap e104: 12 total, 12 up, 12 in 2024-07-24T22:20:29.161 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:28 smithi183 ceph-mon[37007]: from='client.? 172.21.15.47:0/1291560070' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-07-24T22:20:29.162 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:28 smithi183 ceph-mon[37007]: osdmap e104: 12 total, 12 up, 12 in 2024-07-24T22:20:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:29 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a[32547]: 2024-07-24T22:20:29.116+0000 7fe0772cb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:20:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:29 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a[32547]: 2024-07-24T22:20:29.116+0000 7fe0772cb640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-07-24T22:20:29.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:29 smithi047 podman[126662]: 2024-07-24 22:20:29.280354001 +0000 UTC m=+0.290139146 container died 12081d7d286632835344303506eeda503a8f0642777a6906bf64cc3a68d4e135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0) 2024-07-24T22:20:29.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:29 smithi047 podman[126662]: 2024-07-24 22:20:29.72430783 +0000 UTC m=+0.734092975 container cleanup 12081d7d286632835344303506eeda503a8f0642777a6906bf64cc3a68d4e135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a, org.label-schema.build-date=20240716, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-07-24T22:20:29.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Jul 24 22:20:29 smithi047 bash[126662]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-a 2024-07-24T22:20:30.201 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.a.service' 2024-07-24T22:20:30.247 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:20:30.247 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-07-24T22:20:30.247 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-07-24T22:20:30.247 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.b 2024-07-24T22:20:30.574 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:30 smithi183 systemd[1]: Stopping Ceph mon.b for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:20:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:30 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-b[37003]: 2024-07-24T22:20:30.571+0000 7f51c2ff0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:20:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:30 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-b[37003]: 2024-07-24T22:20:30.571+0000 7f51c2ff0640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-07-24T22:20:30.912 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:30 smithi183 podman[72672]: 2024-07-24 22:20:30.653038985 +0000 UTC m=+0.215688970 container died c19ff3c845192e37187780cff5bd6eb2b22be7c51b2b5df37c77a444c51dd92e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, RELEASE=main-86385b1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-07-24T22:20:31.233 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:31 smithi183 podman[72672]: 2024-07-24 22:20:31.046972089 +0000 UTC m=+0.609622072 container cleanup c19ff3c845192e37187780cff5bd6eb2b22be7c51b2b5df37c77a444c51dd92e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-b, org.label-schema.build-date=20240716, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1) 2024-07-24T22:20:31.233 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:31 smithi183 bash[72672]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-b 2024-07-24T22:20:31.483 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.b.service' 2024-07-24T22:20:31.503 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:31 smithi183 podman[72684]: 2024-07-24 22:20:31.23190634 +0000 UTC m=+0.569045526 container remove c19ff3c845192e37187780cff5bd6eb2b22be7c51b2b5df37c77a444c51dd92e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240716, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=main-86385b1, ceph=True) 2024-07-24T22:20:31.504 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:31 smithi183 systemd[1]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.b.service: Deactivated successfully. 2024-07-24T22:20:31.504 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:31 smithi183 systemd[1]: Stopped Ceph mon.b for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:20:31.504 INFO:journalctl@ceph.mon.b.smithi183.stdout:Jul 24 22:20:31 smithi183 systemd[1]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.b.service: Consumed 13.509s CPU time. 2024-07-24T22:20:31.526 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:20:31.526 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-07-24T22:20:31.527 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-07-24T22:20:31.527 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.c 2024-07-24T22:20:31.799 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:31 smithi188 systemd[1]: Stopping Ceph mon.c for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:20:32.203 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:31 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-c[37376]: 2024-07-24T22:20:31.849+0000 7f4e9c542640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:20:32.203 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:31 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-c[37376]: 2024-07-24T22:20:31.849+0000 7f4e9c542640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-07-24T22:20:32.203 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:31 smithi188 podman[74460]: 2024-07-24 22:20:31.921655673 +0000 UTC m=+0.195706220 container died 6e0df7c9206f07fa44440cb8425426c626e124f47ef3c1fe6a3719c93aab76a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-c, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240716, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-07-24T22:20:32.550 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:32 smithi188 podman[74460]: 2024-07-24 22:20:32.292661117 +0000 UTC m=+0.566711663 container cleanup 6e0df7c9206f07fa44440cb8425426c626e124f47ef3c1fe6a3719c93aab76a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-c, org.label-schema.build-date=20240716, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=main-86385b1, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-07-24T22:20:32.551 INFO:journalctl@ceph.mon.c.smithi188.stdout:Jul 24 22:20:32 smithi188 bash[74460]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mon-c 2024-07-24T22:20:32.728 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mon.c.service' 2024-07-24T22:20:32.772 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:20:32.772 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-07-24T22:20:32.772 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-07-24T22:20:32.772 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.x 2024-07-24T22:20:33.097 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:20:32 smithi047 systemd[1]: Stopping Ceph mgr.x for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:20:33.387 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:20:33 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T22:20:33.095+0000 7ff1dcca1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:20:33.388 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:20:33 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x[32778]: 2024-07-24T22:20:33.095+0000 7ff1dcca1640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-07-24T22:20:33.388 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:20:33 smithi047 podman[126784]: 2024-07-24 22:20:33.126743065 +0000 UTC m=+0.147774603 container died f03081798de4079aba41f78865391d842126d12d801825db6d5154818dae4cc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=main-86385b1, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-07-24T22:20:33.686 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:20:33 smithi047 podman[126784]: 2024-07-24 22:20:33.596705517 +0000 UTC m=+0.617737047 container cleanup f03081798de4079aba41f78865391d842126d12d801825db6d5154818dae4cc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-07-24T22:20:33.686 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:20:33 smithi047 bash[126784]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x 2024-07-24T22:20:34.035 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.x.service' 2024-07-24T22:20:34.058 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:20:33 smithi047 podman[126797]: 2024-07-24 22:20:33.798584872 +0000 UTC m=+0.666938853 container remove f03081798de4079aba41f78865391d842126d12d801825db6d5154818dae4cc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:86385b1daf5235400bbcd34a02515d168bde88e2, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-x, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0) 2024-07-24T22:20:34.058 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:20:34 smithi047 systemd[1]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.x.service: Deactivated successfully. 2024-07-24T22:20:34.059 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:20:34 smithi047 systemd[1]: Stopped Ceph mgr.x for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:20:34.059 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Jul 24 22:20:34 smithi047 systemd[1]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.x.service: Consumed 59.855s CPU time. 2024-07-24T22:20:34.074 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:20:34.074 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-07-24T22:20:34.074 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-07-24T22:20:34.074 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.y 2024-07-24T22:20:34.412 INFO:journalctl@ceph.mgr.y.smithi183.stdout:Jul 24 22:20:34 smithi183 systemd[1]: Stopping Ceph mgr.y for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:20:34.738 INFO:journalctl@ceph.mgr.y.smithi183.stdout:Jul 24 22:20:34 smithi183 podman[72808]: 2024-07-24 22:20:34.414835113 +0000 UTC m=+0.154826797 container died 6f53b628aace57fb90833805a7267c4e0d3737ac6d13524f0f1a1b583cf71de3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=main-86385b1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS) 2024-07-24T22:20:35.072 INFO:journalctl@ceph.mgr.y.smithi183.stdout:Jul 24 22:20:34 smithi183 podman[72808]: 2024-07-24 22:20:34.819111982 +0000 UTC m=+0.559103660 container cleanup 6f53b628aace57fb90833805a7267c4e0d3737ac6d13524f0f1a1b583cf71de3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240716, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, ceph=True) 2024-07-24T22:20:35.072 INFO:journalctl@ceph.mgr.y.smithi183.stdout:Jul 24 22:20:34 smithi183 bash[72808]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-y 2024-07-24T22:20:35.246 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.y.service' 2024-07-24T22:20:35.281 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:20:35.281 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-07-24T22:20:35.282 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-07-24T22:20:35.282 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.z 2024-07-24T22:20:35.610 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Jul 24 22:20:35 smithi188 systemd[1]: Stopping Ceph mgr.z for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:20:35.906 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Jul 24 22:20:35 smithi188 podman[74581]: 2024-07-24 22:20:35.609404113 +0000 UTC m=+0.142742095 container died 1ea1a7fc455fdff6cf67c5d295aad769c07cd53028aca9e85cec86cbd1ede924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-z, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-07-24T22:20:36.158 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Jul 24 22:20:35 smithi188 podman[74581]: 2024-07-24 22:20:35.905385547 +0000 UTC m=+0.438723537 container cleanup 1ea1a7fc455fdff6cf67c5d295aad769c07cd53028aca9e85cec86cbd1ede924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-z, ceph=True, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=main-86385b1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T22:20:36.158 INFO:journalctl@ceph.mgr.z.smithi188.stdout:Jul 24 22:20:35 smithi188 bash[74581]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mgr-z 2024-07-24T22:20:36.343 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mgr.z.service' 2024-07-24T22:20:36.378 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:20:36.378 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-07-24T22:20:36.378 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-07-24T22:20:36.379 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.0 2024-07-24T22:20:36.686 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:36 smithi047 systemd[1]: Stopping Ceph osd.0 for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:20:37.187 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:36 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0[52403]: 2024-07-24T22:20:36.709+0000 7f00ccc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:20:37.187 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:36 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0[52403]: 2024-07-24T22:20:36.709+0000 7f00ccc00640 -1 osd.0 104 *** Got signal Terminated *** 2024-07-24T22:20:37.187 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:36 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0[52403]: 2024-07-24T22:20:36.709+0000 7f00ccc00640 -1 osd.0 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-24T22:20:42.413 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:42 smithi047 podman[126914]: 2024-07-24 22:20:42.140096788 +0000 UTC m=+5.550350339 container died 87cbeeacd017198681a9ceae3ad3b7d8b501e3a0f65f8901a113fbaa73feb2ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=main-86385b1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-24T22:20:42.686 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:42 smithi047 podman[126914]: 2024-07-24 22:20:42.593783917 +0000 UTC m=+6.004037465 container cleanup 87cbeeacd017198681a9ceae3ad3b7d8b501e3a0f65f8901a113fbaa73feb2ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=main-86385b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0) 2024-07-24T22:20:42.686 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:42 smithi047 bash[126914]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0 2024-07-24T22:20:43.183 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:42 smithi047 podman[126931]: 2024-07-24 22:20:42.853493368 +0000 UTC m=+0.716312742 container remove 87cbeeacd017198681a9ceae3ad3b7d8b501e3a0f65f8901a113fbaa73feb2ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716, RELEASE=main-86385b1) 2024-07-24T22:20:43.436 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:43 smithi047 podman[127022]: 2024-07-24 22:20:43.085167293 +0000 UTC m=+0.017986367 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:20:43.436 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:43 smithi047 podman[127022]: 2024-07-24 22:20:43.187414369 +0000 UTC m=+0.120233441 container create 67a939092c6a951cbc09f59ecd34eade9c9ff065528d6d667096329726635242 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-24T22:20:43.436 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:43 smithi047 podman[127022]: 2024-07-24 22:20:43.431590267 +0000 UTC m=+0.364409352 container init 67a939092c6a951cbc09f59ecd34eade9c9ff065528d6d667096329726635242 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-07-24T22:20:43.436 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:43 smithi047 podman[127022]: 2024-07-24 22:20:43.435140463 +0000 UTC m=+0.367959538 container start 67a939092c6a951cbc09f59ecd34eade9c9ff065528d6d667096329726635242 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-07-24T22:20:43.686 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:43 smithi047 podman[127022]: 2024-07-24 22:20:43.565214172 +0000 UTC m=+0.498033252 container attach 67a939092c6a951cbc09f59ecd34eade9c9ff065528d6d667096329726635242 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0-deactivate, RELEASE=main-86385b1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-07-24T22:20:43.687 INFO:journalctl@ceph.osd.0.smithi047.stdout:Jul 24 22:20:43 smithi047 podman[127022]: 2024-07-24 22:20:43.629667964 +0000 UTC m=+0.562487039 container died 67a939092c6a951cbc09f59ecd34eade9c9ff065528d6d667096329726635242 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-24T22:20:44.402 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.0.service' 2024-07-24T22:20:44.451 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:20:44.451 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-07-24T22:20:44.451 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-07-24T22:20:44.451 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.1 2024-07-24T22:20:44.741 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:44 smithi183 systemd[1]: Stopping Ceph osd.1 for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:20:45.162 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:44 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1[42876]: 2024-07-24T22:20:44.738+0000 7f9aa3307640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:20:45.162 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:44 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1[42876]: 2024-07-24T22:20:44.738+0000 7f9aa3307640 -1 osd.1 104 *** Got signal Terminated *** 2024-07-24T22:20:45.162 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:44 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1[42876]: 2024-07-24T22:20:44.738+0000 7f9aa3307640 -1 osd.1 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-24T22:20:50.608 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:50 smithi183 podman[72934]: 2024-07-24 22:20:50.287648782 +0000 UTC m=+5.647845498 container died 51e8422f804a4eea79d849db475b4256b2a430fdec36f3f2efc91a18d23f6ff4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240716, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=main-86385b1) 2024-07-24T22:20:50.908 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:50 smithi183 podman[72934]: 2024-07-24 22:20:50.681471333 +0000 UTC m=+6.041668036 container cleanup 51e8422f804a4eea79d849db475b4256b2a430fdec36f3f2efc91a18d23f6ff4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T22:20:50.909 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:50 smithi183 bash[72934]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1 2024-07-24T22:20:51.162 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:50 smithi183 podman[72949]: 2024-07-24 22:20:50.907701259 +0000 UTC m=+0.619370501 container remove 51e8422f804a4eea79d849db475b4256b2a430fdec36f3f2efc91a18d23f6ff4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240716, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-07-24T22:20:51.512 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:51 smithi183 podman[73039]: 2024-07-24 22:20:51.126339751 +0000 UTC m=+0.017065452 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:20:51.513 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:51 smithi183 podman[73039]: 2024-07-24 22:20:51.250338087 +0000 UTC m=+0.141063777 container create 5943ff1cb958607c54731dba437a2cb4e1ae1b9575901c8b0752d3c9aef1c793 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240716, RELEASE=main-86385b1, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T22:20:51.513 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:51 smithi183 podman[73039]: 2024-07-24 22:20:51.511084919 +0000 UTC m=+0.401810620 container init 5943ff1cb958607c54731dba437a2cb4e1ae1b9575901c8b0752d3c9aef1c793 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240716, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-07-24T22:20:51.912 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:51 smithi183 podman[73039]: 2024-07-24 22:20:51.514461111 +0000 UTC m=+0.405186809 container start 5943ff1cb958607c54731dba437a2cb4e1ae1b9575901c8b0752d3c9aef1c793 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, RELEASE=main-86385b1, org.label-schema.schema-version=1.0) 2024-07-24T22:20:51.912 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:51 smithi183 podman[73039]: 2024-07-24 22:20:51.602926934 +0000 UTC m=+0.493652637 container attach 5943ff1cb958607c54731dba437a2cb4e1ae1b9575901c8b0752d3c9aef1c793 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=) 2024-07-24T22:20:51.912 INFO:journalctl@ceph.osd.1.smithi183.stdout:Jul 24 22:20:51 smithi183 podman[73039]: 2024-07-24 22:20:51.704473839 +0000 UTC m=+0.595199532 container died 5943ff1cb958607c54731dba437a2cb4e1ae1b9575901c8b0752d3c9aef1c793 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-07-24T22:20:52.280 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.1.service' 2024-07-24T22:20:52.317 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:20:52.317 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-07-24T22:20:52.318 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-07-24T22:20:52.318 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.2 2024-07-24T22:20:52.651 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:52 smithi188 systemd[1]: Stopping Ceph osd.2 for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:20:53.048 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:52 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2[43766]: 2024-07-24T22:20:52.649+0000 7f28a3301640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:20:53.049 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:52 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2[43766]: 2024-07-24T22:20:52.649+0000 7f28a3301640 -1 osd.2 104 *** Got signal Terminated *** 2024-07-24T22:20:53.049 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:52 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2[43766]: 2024-07-24T22:20:52.649+0000 7f28a3301640 -1 osd.2 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-24T22:20:58.402 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:58 smithi188 podman[74704]: 2024-07-24 22:20:58.140457593 +0000 UTC m=+5.621631770 container died cd7ebcd6f1e0e4ec1c497addae353a6aac033f479ba9c2c0e5501b90d7f9faa6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2, org.label-schema.build-date=20240716, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, ceph=True) 2024-07-24T22:20:58.785 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:58 smithi188 podman[74704]: 2024-07-24 22:20:58.490918441 +0000 UTC m=+5.972092649 container cleanup cd7ebcd6f1e0e4ec1c497addae353a6aac033f479ba9c2c0e5501b90d7f9faa6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-07-24T22:20:58.786 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:58 smithi188 bash[74704]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2 2024-07-24T22:20:59.049 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:58 smithi188 podman[74723]: 2024-07-24 22:20:58.783832227 +0000 UTC m=+0.638096565 container remove cd7ebcd6f1e0e4ec1c497addae353a6aac033f479ba9c2c0e5501b90d7f9faa6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=main-86385b1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-07-24T22:20:59.447 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:59 smithi188 podman[74812]: 2024-07-24 22:20:59.021311511 +0000 UTC m=+0.017455652 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:20:59.447 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:59 smithi188 podman[74812]: 2024-07-24 22:20:59.126485671 +0000 UTC m=+0.122629835 container create 1a303cbe33e7a1e3ba722ecb1d5d630380670995dbd0d9c7f44283136c20e7cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2-deactivate, RELEASE=main-86385b1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-07-24T22:20:59.447 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:59 smithi188 podman[74812]: 2024-07-24 22:20:59.353703863 +0000 UTC m=+0.349847985 container init 1a303cbe33e7a1e3ba722ecb1d5d630380670995dbd0d9c7f44283136c20e7cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240716, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T22:20:59.447 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:59 smithi188 podman[74812]: 2024-07-24 22:20:59.356932044 +0000 UTC m=+0.353076177 container start 1a303cbe33e7a1e3ba722ecb1d5d630380670995dbd0d9c7f44283136c20e7cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True) 2024-07-24T22:20:59.798 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:59 smithi188 podman[74812]: 2024-07-24 22:20:59.445347152 +0000 UTC m=+0.441491285 container attach 1a303cbe33e7a1e3ba722ecb1d5d630380670995dbd0d9c7f44283136c20e7cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2-deactivate, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-07-24T22:20:59.799 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:20:59 smithi188 podman[74812]: 2024-07-24 22:20:59.548622787 +0000 UTC m=+0.544766911 container died 1a303cbe33e7a1e3ba722ecb1d5d630380670995dbd0d9c7f44283136c20e7cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2-deactivate, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-07-24T22:21:00.109 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.2.service' 2024-07-24T22:21:00.110 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:21:00 smithi188 podman[74835]: 2024-07-24 22:21:00.082722983 +0000 UTC m=+0.528306591 container remove 1a303cbe33e7a1e3ba722ecb1d5d630380670995dbd0d9c7f44283136c20e7cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-86385b1, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-24T22:21:00.110 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:21:00 smithi188 systemd[1]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.2.service: Deactivated successfully. 2024-07-24T22:21:00.111 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:21:00 smithi188 systemd[1]: Stopped Ceph osd.2 for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:21:00.111 INFO:journalctl@ceph.osd.2.smithi188.stdout:Jul 24 22:21:00 smithi188 systemd[1]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.2.service: Consumed 2min 23.874s CPU time. 2024-07-24T22:21:00.148 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:21:00.148 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-07-24T22:21:00.148 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-07-24T22:21:00.148 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.3 2024-07-24T22:21:00.436 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:00 smithi047 systemd[1]: Stopping Ceph osd.3 for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:21:00.936 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:00 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3[59008]: 2024-07-24T22:21:00.454+0000 7ff33a62d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:21:00.936 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:00 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3[59008]: 2024-07-24T22:21:00.454+0000 7ff33a62d640 -1 osd.3 104 *** Got signal Terminated *** 2024-07-24T22:21:00.936 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:00 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3[59008]: 2024-07-24T22:21:00.454+0000 7ff33a62d640 -1 osd.3 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-24T22:21:02.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:02 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:02.449+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:03.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:03 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:03.427+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:03.798 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:03 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:03.456+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:04.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:04 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:04.140+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:04.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:04 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:04.434+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:04.798 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:04 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:04.406+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:05.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:05 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:05.117+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:05.799 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:05 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:05.391+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:05.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:05 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:05.454+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:06.248 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:05 smithi047 podman[127139]: 2024-07-24 22:21:05.976758243 +0000 UTC m=+5.625056008 container died 5136eecd53f17afd04a885a1d8be420eb89987ce28be11b932d2670c21818a85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-07-24T22:21:06.298 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:05 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:05.804+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:06.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:06 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:06.143+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:06.608 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:06 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:06.420+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:06.608 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:06 smithi047 podman[127139]: 2024-07-24 22:21:06.338435252 +0000 UTC m=+5.986733017 container cleanup 5136eecd53f17afd04a885a1d8be420eb89987ce28be11b932d2670c21818a85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240716, RELEASE=main-86385b1, GIT_CLEAN=True) 2024-07-24T22:21:06.608 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:06 smithi047 bash[127139]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3 2024-07-24T22:21:06.798 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:06 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:06.428+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:06.936 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:06 smithi047 podman[127155]: 2024-07-24 22:21:06.606461332 +0000 UTC m=+0.629013015 container remove 5136eecd53f17afd04a885a1d8be420eb89987ce28be11b932d2670c21818a85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, io.buildah.version=1.36.0, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-07-24T22:21:07.286 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:07 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:07.096+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:07.286 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:06 smithi047 podman[127243]: 2024-07-24 22:21:06.888294079 +0000 UTC m=+0.018049694 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:21:07.286 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:06 smithi047 podman[127243]: 2024-07-24 22:21:06.9905981 +0000 UTC m=+0.120353698 container create 0573cc52bca9e41ba59f691d0f4ad21b19674788fd59d7e7d7941d70fac8cecc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, RELEASE=main-86385b1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-07-24T22:21:07.287 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:07 smithi047 podman[127243]: 2024-07-24 22:21:07.209692287 +0000 UTC m=+0.339447900 container init 0573cc52bca9e41ba59f691d0f4ad21b19674788fd59d7e7d7941d70fac8cecc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240716, maintainer=Guillaume Abrioux , RELEASE=main-86385b1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-07-24T22:21:07.287 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:07 smithi047 podman[127243]: 2024-07-24 22:21:07.213165793 +0000 UTC m=+0.342921396 container start 0573cc52bca9e41ba59f691d0f4ad21b19674788fd59d7e7d7941d70fac8cecc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240716, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-07-24T22:21:07.298 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:06 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:06.806+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:07.411 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:07 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:07.094+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:07.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:07 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:07.470+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:07.687 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:07 smithi047 podman[127243]: 2024-07-24 22:21:07.284449514 +0000 UTC m=+0.414205124 container attach 0573cc52bca9e41ba59f691d0f4ad21b19674788fd59d7e7d7941d70fac8cecc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-07-24T22:21:07.687 INFO:journalctl@ceph.osd.3.smithi047.stdout:Jul 24 22:21:07 smithi047 podman[127243]: 2024-07-24 22:21:07.41443132 +0000 UTC m=+0.544186929 container died 0573cc52bca9e41ba59f691d0f4ad21b19674788fd59d7e7d7941d70fac8cecc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD) 2024-07-24T22:21:07.798 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:07 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:07.392+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:07.986 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.3.service' 2024-07-24T22:21:08.027 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:21:08.027 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-07-24T22:21:08.028 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-07-24T22:21:08.028 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.4 2024-07-24T22:21:08.298 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:07 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:07.809+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:08.343 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:08 smithi183 systemd[1]: Stopping Ceph osd.4 for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:21:08.344 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:08 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:08.122+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:08.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:08 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:08.102+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:08.662 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:08 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4[49350]: 2024-07-24T22:21:08.342+0000 7f2b4877a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:21:08.662 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:08 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4[49350]: 2024-07-24T22:21:08.342+0000 7f2b4877a640 -1 osd.4 104 *** Got signal Terminated *** 2024-07-24T22:21:08.662 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:08 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4[49350]: 2024-07-24T22:21:08.342+0000 7f2b4877a640 -1 osd.4 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-24T22:21:08.783 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:08 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:08.363+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:08.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:08 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:08.510+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:09.048 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:08 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:08.781+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:09.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:09 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:09.092+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:09.437 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:09 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:09.129+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:09.780 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:09 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:09.376+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:09.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:09 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:09.464+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:10.048 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:09 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:09.778+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:10.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:10 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:10.110+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:10.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:10 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:10.102+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:10.761 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:10 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:10.404+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:10.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:10 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:10.493+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:11.048 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:10 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:10.759+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:11.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:11 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:11.150+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:11.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:11 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:11.150+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:11.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:11 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:11.073+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:11.719 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:11 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:11.414+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:11.720 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:11 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:11.414+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.676481+0000 front 2024-07-24T22:20:45.676187+0000 (oldest deadline 2024-07-24T22:21:10.976275+0000) 2024-07-24T22:21:11.912 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:11 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4[49350]: 2024-07-24T22:21:11.598+0000 7f2b44d8f640 -1 osd.4 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.137386+0000 front 2024-07-24T22:20:46.137357+0000 (oldest deadline 2024-07-24T22:21:11.437494+0000) 2024-07-24T22:21:11.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:11 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:11.454+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:12.048 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:11 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:11.717+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:12.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:11 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:11.968+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:12.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:12 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:12.107+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:12.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:12 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:12.107+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:12.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:12 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:12.034+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:12.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:12 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:12.034+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:12.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:12 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:12.699+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:12.799 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:12 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:12.458+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:12.799 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:12 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:12.458+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.676481+0000 front 2024-07-24T22:20:45.676187+0000 (oldest deadline 2024-07-24T22:21:10.976275+0000) 2024-07-24T22:21:12.912 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:12 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4[49350]: 2024-07-24T22:21:12.635+0000 7f2b44d8f640 -1 osd.4 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.137386+0000 front 2024-07-24T22:20:46.137357+0000 (oldest deadline 2024-07-24T22:21:11.437494+0000) 2024-07-24T22:21:12.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:12 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:12.444+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:13.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:12 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:12.959+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:13.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:13 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:13.100+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:13.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:13 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:13.100+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:13.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:13 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:13.005+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:13.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:13 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:13.005+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:13.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:13 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:13.661+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:13.799 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:13 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:13.457+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:13.799 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:13 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:13.457+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.676481+0000 front 2024-07-24T22:20:45.676187+0000 (oldest deadline 2024-07-24T22:21:10.976275+0000) 2024-07-24T22:21:13.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:13 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:13.473+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:14.019 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:13 smithi183 podman[73152]: 2024-07-24 22:21:13.744988913 +0000 UTC m=+5.520818955 container died 17d8fb0b0b75596f4b04994c46b8026d1a0537d34efa3cb0b2383b8f36efc20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, org.label-schema.build-date=20240716, io.buildah.version=1.36.0) 2024-07-24T22:21:14.019 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:13 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:13.990+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:14.298 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:13 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:13.851+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:14.386 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:14 smithi183 podman[73152]: 2024-07-24 22:21:14.116748537 +0000 UTC m=+5.892578585 container cleanup 17d8fb0b0b75596f4b04994c46b8026d1a0537d34efa3cb0b2383b8f36efc20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T22:21:14.386 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:14 smithi183 bash[73152]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4 2024-07-24T22:21:14.386 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:14 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:14.062+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:14.387 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:14 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:14.062+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:14.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:14 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:14.032+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:14.437 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:14 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:14.032+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:14.662 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:14 smithi183 podman[73168]: 2024-07-24 22:21:14.385060633 +0000 UTC m=+0.635535171 container remove 17d8fb0b0b75596f4b04994c46b8026d1a0537d34efa3cb0b2383b8f36efc20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-24T22:21:14.707 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:14 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:14.438+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:14.707 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:14 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:14.438+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.676481+0000 front 2024-07-24T22:20:45.676187+0000 (oldest deadline 2024-07-24T22:21:10.976275+0000) 2024-07-24T22:21:14.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:14 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:14.520+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:15.015 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:14 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:14.948+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:15.016 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:14 smithi183 podman[73258]: 2024-07-24 22:21:14.635630306 +0000 UTC m=+0.017392636 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:21:15.016 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:14 smithi183 podman[73258]: 2024-07-24 22:21:14.735793661 +0000 UTC m=+0.117556042 container create b3af24a84885d506fab0c866acf9ee2e722312bf77b064bab3915ad166bbdeb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240716, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-07-24T22:21:15.016 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:14 smithi183 podman[73258]: 2024-07-24 22:21:14.937981725 +0000 UTC m=+0.319744051 container init b3af24a84885d506fab0c866acf9ee2e722312bf77b064bab3915ad166bbdeb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-07-24T22:21:15.017 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:14 smithi183 podman[73258]: 2024-07-24 22:21:14.941116834 +0000 UTC m=+0.322879153 container start b3af24a84885d506fab0c866acf9ee2e722312bf77b064bab3915ad166bbdeb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=main-86385b1, GIT_BRANCH=HEAD) 2024-07-24T22:21:15.017 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:15 smithi183 podman[73258]: 2024-07-24 22:21:15.013032929 +0000 UTC m=+0.394795256 container attach b3af24a84885d506fab0c866acf9ee2e722312bf77b064bab3915ad166bbdeb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-07-24T22:21:15.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:14 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:14.863+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:15.050 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:14 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:14.705+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:15.050 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:14 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:14.705+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:15.412 INFO:journalctl@ceph.osd.4.smithi183.stdout:Jul 24 22:21:15 smithi183 podman[73258]: 2024-07-24 22:21:15.133676957 +0000 UTC m=+0.515439281 container died b3af24a84885d506fab0c866acf9ee2e722312bf77b064bab3915ad166bbdeb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-07-24T22:21:15.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:15 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:15.074+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:15.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:15 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:15.074+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:15.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:15 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:15.028+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:15.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:15 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:15.028+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:15.743 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:15 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:15.484+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:15.743 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:15 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:15.484+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.676481+0000 front 2024-07-24T22:20:45.676187+0000 (oldest deadline 2024-07-24T22:21:10.976275+0000) 2024-07-24T22:21:15.765 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.4.service' 2024-07-24T22:21:15.804 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:21:15.804 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-07-24T22:21:15.804 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-07-24T22:21:15.804 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.5 2024-07-24T22:21:15.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:15 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:15.513+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:15.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:15 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:15.513+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:16.049 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:15 smithi188 systemd[1]: Stopping Ceph osd.5 for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:21:16.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:15 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:15.904+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:16.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:15 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:15.741+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:16.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:15 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:15.741+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:16.080 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:15 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:15.904+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:16.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:16 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:16.078+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:16.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:16 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:16.078+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:16.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:16.066+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:16.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:16.066+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:16.463 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:16 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:16.133+0000 7ff4aa548640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:21:16.463 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:16 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:16.133+0000 7ff4aa548640 -1 osd.5 104 *** Got signal Terminated *** 2024-07-24T22:21:16.463 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:16 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:16.133+0000 7ff4aa548640 -1 osd.5 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-24T22:21:16.463 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:16 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:16.461+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:16.463 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:16 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:16.461+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.676481+0000 front 2024-07-24T22:20:45.676187+0000 (oldest deadline 2024-07-24T22:21:10.976275+0000) 2024-07-24T22:21:16.798 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:16 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:16.691+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:16.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:16 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:16.691+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:16.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:16.483+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:16.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:16 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:16.483+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:17.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:16 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:16.877+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:17.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:17 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:17.080+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:17.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:17 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:17.080+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:17.298 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:16 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:16.943+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:17.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:17 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:17.073+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:17.437 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:17 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:17.073+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:17.799 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:17 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:17.442+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:17.799 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:17 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:17.442+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.676481+0000 front 2024-07-24T22:20:45.676187+0000 (oldest deadline 2024-07-24T22:21:10.976275+0000) 2024-07-24T22:21:17.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:17 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:17.646+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:17.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:17 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:17.646+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:17.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:17 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:17.455+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:17.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:17 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:17.455+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:18.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:17 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:17.896+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:18.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:18 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:18.050+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:18.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:18 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:18.050+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:18.298 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:17 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:17.931+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:18.438 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:18 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:18.080+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:18.438 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:18 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:18.080+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:18.799 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:18 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:18.470+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:18.799 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:18 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:18.470+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.676481+0000 front 2024-07-24T22:20:45.676187+0000 (oldest deadline 2024-07-24T22:21:10.976275+0000) 2024-07-24T22:21:18.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:18 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:18.685+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:18.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:18 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:18.685+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:18.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:18 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:18.465+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:18.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:18 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:18.465+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:19.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:18 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:18.874+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:19.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:19 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:19.065+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:19.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:19 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:19.065+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:19.298 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:18 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:18.969+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:19.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:19 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:19.115+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:19.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:19 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:19.115+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:19.798 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:19 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:19.426+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:19.799 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:19 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:19.426+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.676481+0000 front 2024-07-24T22:20:45.676187+0000 (oldest deadline 2024-07-24T22:21:10.976275+0000) 2024-07-24T22:21:19.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:19 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:19.666+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:19.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:19 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:19.666+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:19.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:19 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:19.666+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:19.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:19 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:19.512+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:19.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:19 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:19.512+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:20.088 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:19 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:19.834+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:20.088 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:19 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:19.834+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:20.298 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:19 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:19.929+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:20.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:19 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:19.929+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:20.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:20 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:20.086+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:20.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:20 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:20.086+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:20.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:20 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:20.164+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:20.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:20 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:20.164+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:20.437 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:20 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:20.164+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:54.211436+0000 front 2024-07-24T22:20:54.211577+0000 (oldest deadline 2024-07-24T22:21:19.511458+0000) 2024-07-24T22:21:20.713 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:20 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:20.416+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.675070+0000 front 2024-07-24T22:20:41.674958+0000 (oldest deadline 2024-07-24T22:21:03.375123+0000) 2024-07-24T22:21:20.713 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:20 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:20.416+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.676481+0000 front 2024-07-24T22:20:45.676187+0000 (oldest deadline 2024-07-24T22:21:10.976275+0000) 2024-07-24T22:21:20.713 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:20 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5[50269]: 2024-07-24T22:21:20.416+0000 7ff4a6b5d640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.477826+0000 front 2024-07-24T22:20:55.477846+0000 (oldest deadline 2024-07-24T22:21:19.577914+0000) 2024-07-24T22:21:20.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:20 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:20.492+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:20.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:20 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:20.492+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:21.048 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:20 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:20.908+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:21.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:20 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:20.908+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:21.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:20 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:20.710+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:21.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:20 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:20.710+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:21.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:20 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:20.710+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:21.130 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:20 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:20.819+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:21.130 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:20 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:20.819+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:21.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:21 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:21.128+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:21.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:21 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:21.128+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:21.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:21 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:21.128+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:21.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:21 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:21.168+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:21.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:21 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:21.168+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:21.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:21 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:21.168+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:54.211436+0000 front 2024-07-24T22:20:54.211577+0000 (oldest deadline 2024-07-24T22:21:19.511458+0000) 2024-07-24T22:21:21.902 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:21 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:21.732+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:21.902 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:21 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:21.732+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:21.902 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:21 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:21.732+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:21.903 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:21 smithi188 podman[74928]: 2024-07-24 22:21:21.609404226 +0000 UTC m=+5.607702692 container stop 92b469681a59e36399a5518322637e9f075f62ce0fb009ccd3b920aa23db9c4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5, RELEASE=main-86385b1, org.label-schema.build-date=20240716, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-07-24T22:21:21.903 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:21 smithi188 podman[74928]: 2024-07-24 22:21:21.635097759 +0000 UTC m=+5.633396215 container died 92b469681a59e36399a5518322637e9f075f62ce0fb009ccd3b920aa23db9c4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=main-86385b1, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716) 2024-07-24T22:21:21.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:21 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:21.510+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:21.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:21 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:21.510+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:21.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:21 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:21.510+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:22.141 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:21 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:21.840+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:22.141 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:21 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:21.840+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:22.153 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:21 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:21.956+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:22.153 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:21 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:21.956+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:22.153 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:22 smithi188 podman[74928]: 2024-07-24 22:21:22.000392079 +0000 UTC m=+5.998690544 container cleanup 92b469681a59e36399a5518322637e9f075f62ce0fb009ccd3b920aa23db9c4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=main-86385b1, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-07-24T22:21:22.153 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:22 smithi188 bash[74928]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5 2024-07-24T22:21:22.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:22 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:22.138+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:22.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:22 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:22.138+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:22.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:22 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:22.138+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:22.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:22 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:22.123+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:22.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:22 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:22.123+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:22.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:22 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:22.123+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:54.211436+0000 front 2024-07-24T22:20:54.211577+0000 (oldest deadline 2024-07-24T22:21:19.511458+0000) 2024-07-24T22:21:22.548 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:22 smithi188 podman[74947]: 2024-07-24 22:21:22.151733862 +0000 UTC m=+0.535597545 container remove 92b469681a59e36399a5518322637e9f075f62ce0fb009ccd3b920aa23db9c4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=main-86385b1) 2024-07-24T22:21:22.848 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:22 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:22.690+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:22.848 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:22 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:22.690+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:22.848 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:22 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:22.690+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:22.848 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:22 smithi188 podman[75039]: 2024-07-24 22:21:22.461986984 +0000 UTC m=+0.017047986 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:21:22.849 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:22 smithi188 podman[75039]: 2024-07-24 22:21:22.560712101 +0000 UTC m=+0.115773103 container create 3fa10aab94524a5757827f72cc1b785b23797292461d5c31e16d6e6b0f80dba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=main-86385b1, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-07-24T22:21:22.849 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:22 smithi188 podman[75039]: 2024-07-24 22:21:22.847038726 +0000 UTC m=+0.402099732 container init 3fa10aab94524a5757827f72cc1b785b23797292461d5c31e16d6e6b0f80dba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, RELEASE=main-86385b1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716) 2024-07-24T22:21:22.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:22 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:22.534+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:22.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:22 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:22.534+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:22.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:22 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:22.534+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:23.131 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:22 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:22.859+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:23.132 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:22 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:22.859+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:23.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:22 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:22.969+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:23.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:22 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:22.969+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:23.299 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:22 smithi188 podman[75039]: 2024-07-24 22:21:22.850393071 +0000 UTC m=+0.405454083 container start 3fa10aab94524a5757827f72cc1b785b23797292461d5c31e16d6e6b0f80dba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, RELEASE=main-86385b1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-07-24T22:21:23.299 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:22 smithi188 podman[75039]: 2024-07-24 22:21:22.929992143 +0000 UTC m=+0.485053152 container attach 3fa10aab94524a5757827f72cc1b785b23797292461d5c31e16d6e6b0f80dba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=main-86385b1) 2024-07-24T22:21:23.299 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:23 smithi188 podman[75039]: 2024-07-24 22:21:23.047085077 +0000 UTC m=+0.602146080 container died 3fa10aab94524a5757827f72cc1b785b23797292461d5c31e16d6e6b0f80dba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=main-86385b1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716) 2024-07-24T22:21:23.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:23 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:23.129+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:23.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:23 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:23.129+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:23.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:23 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:23.129+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:23.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:23 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:23.139+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:23.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:23 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:23.139+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:23.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:23 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:23.139+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:54.211436+0000 front 2024-07-24T22:20:54.211577+0000 (oldest deadline 2024-07-24T22:21:19.511458+0000) 2024-07-24T22:21:23.593 INFO:journalctl@ceph.osd.5.smithi188.stdout:Jul 24 22:21:23 smithi188 podman[75061]: 2024-07-24 22:21:23.574897626 +0000 UTC m=+0.517035476 container remove 3fa10aab94524a5757827f72cc1b785b23797292461d5c31e16d6e6b0f80dba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T22:21:23.599 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.5.service' 2024-07-24T22:21:23.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:21:23.636 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-07-24T22:21:23.636 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-07-24T22:21:23.636 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.6 2024-07-24T22:21:23.931 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:23 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:23.665+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:23.931 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:23 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:23.665+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:23.932 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:23 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:23.665+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:23.932 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:23 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:23.929+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:23.932 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:23 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:23.929+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:23.936 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:23 smithi047 systemd[1]: Stopping Ceph osd.6 for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:21:23.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:23 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:23.522+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:23.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:23 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:23.522+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:23.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:23 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:23.522+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:24.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:23 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:23.845+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:24.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:23 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:23.845+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:24.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:24 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:24.092+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:24.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:24 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:24.092+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:24.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:24 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:24.092+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:24.437 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:24 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:24.007+0000 7f794bf24640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:21:24.437 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:24 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:24.007+0000 7f794bf24640 -1 osd.6 104 *** Got signal Terminated *** 2024-07-24T22:21:24.437 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:24 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:24.007+0000 7f794bf24640 -1 osd.6 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-24T22:21:24.437 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:24 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:24.106+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:24.437 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:24 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:24.106+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:24.438 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:24 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:24.106+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:54.211436+0000 front 2024-07-24T22:20:54.211577+0000 (oldest deadline 2024-07-24T22:21:19.511458+0000) 2024-07-24T22:21:24.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:24 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:24.569+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:24.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:24 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:24.569+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:24.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:24 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:24.569+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:25.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:24 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:24.697+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:25.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:24 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:24.697+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:25.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:24 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:24.697+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:25.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:24 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:24.921+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:25.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:24 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:24.921+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:25.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:24 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:24.854+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:25.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:24 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:24.854+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:25.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:25 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:25.084+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:25.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:25 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:25.084+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:25.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:25 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:25.084+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:25.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:25 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:25.056+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:25.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:25 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:25.056+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:25.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:25 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:25.056+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:54.211436+0000 front 2024-07-24T22:20:54.211577+0000 (oldest deadline 2024-07-24T22:21:19.511458+0000) 2024-07-24T22:21:25.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:25 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:25.612+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:25.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:25 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:25.612+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:25.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:25 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:25.612+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:26.048 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:25 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:25.918+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:26.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:25 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:25.918+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:26.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:25 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:25.678+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:26.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:25 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:25.678+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:26.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:25 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:25.678+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:26.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:25 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:25.822+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:26.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:25 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:25.822+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:26.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:26 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:26.062+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:26.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:26 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:26.062+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:26.163 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:26 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:26.062+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:26.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:26 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:26.062+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:26.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:26 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:26.062+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:26.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:26 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:26.062+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:54.211436+0000 front 2024-07-24T22:20:54.211577+0000 (oldest deadline 2024-07-24T22:21:19.511458+0000) 2024-07-24T22:21:26.911 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:26 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:26.642+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:26.911 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:26 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:26.642+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:26.911 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:26 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:26.642+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:26.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:26 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:26.627+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:26.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:26 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:26.627+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:26.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:26 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:26.627+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:26.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:26 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:26.627+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:27.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:26 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:26.858+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:27.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:26 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:26.858+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:27.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:26 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:26.858+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:05.179364+0000 front 2024-07-24T22:21:05.179349+0000 (oldest deadline 2024-07-24T22:21:26.279445+0000) 2024-07-24T22:21:27.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:27 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:27.097+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:27.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:27 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:27.097+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:27.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:27 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:27.097+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:27.298 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:26 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:26.908+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:27.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:26 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:26.908+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:27.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:27 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:27.058+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:27.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:27 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:27.058+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:27.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:27 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:27.058+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:54.211436+0000 front 2024-07-24T22:20:54.211577+0000 (oldest deadline 2024-07-24T22:21:19.511458+0000) 2024-07-24T22:21:27.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:27 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:27.658+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:27.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:27 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:27.658+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:27.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:27 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:27.658+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:27.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:27 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:27.658+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:28.048 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:27 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:27.909+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:28.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:27 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:27.909+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:28.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:27 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:27.678+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:28.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:27 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:27.678+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:28.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:27 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:27.678+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:28.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:27 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:27.877+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:28.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:27 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:27.877+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:28.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:27 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:27.877+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:05.179364+0000 front 2024-07-24T22:21:05.179349+0000 (oldest deadline 2024-07-24T22:21:26.279445+0000) 2024-07-24T22:21:28.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:28 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:28.048+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:28.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:28 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:28.048+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:28.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:28 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:28.048+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:28.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:28.059+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:40.908829+0000 front 2024-07-24T22:20:40.908901+0000 (oldest deadline 2024-07-24T22:21:06.208940+0000) 2024-07-24T22:21:28.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:28.059+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:49.010537+0000 front 2024-07-24T22:20:49.010664+0000 (oldest deadline 2024-07-24T22:21:11.910350+0000) 2024-07-24T22:21:28.437 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6[65795]: 2024-07-24T22:21:28.059+0000 7f7944531640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:54.211436+0000 front 2024-07-24T22:20:54.211577+0000 (oldest deadline 2024-07-24T22:21:19.511458+0000) 2024-07-24T22:21:28.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:28.623+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:28.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:28.623+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:28.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:28.623+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:28.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:28 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:28.623+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:29.048 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:28 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:28.717+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:29.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:28 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:28.717+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:29.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:28 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:28.717+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:29.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:28 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:28.940+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:29.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:28 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:28.940+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:29.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:28 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:28.920+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:29.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:28 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:28.921+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:29.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:28 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:28.921+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:05.179364+0000 front 2024-07-24T22:21:05.179349+0000 (oldest deadline 2024-07-24T22:21:26.279445+0000) 2024-07-24T22:21:29.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:29 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:29.032+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:29.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:29 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:29.032+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:29.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:29 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:29.032+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:29.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:29 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:29.032+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:29.826 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:29 smithi047 podman[127345]: 2024-07-24 22:21:29.566174108 +0000 UTC m=+5.725376345 container died a0b03b7fa6b6faf7a09ba253fca6a008897c9200ffb0198cd510b0e214d5acaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-07-24T22:21:29.827 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:29 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:29.587+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:29.827 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:29 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:29.587+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:29.827 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:29 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:29.587+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:29.827 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:29 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:29.587+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:30.048 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:29 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:29.725+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:30.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:29 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:29.725+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:30.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:29 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:29.725+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:30.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:29 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:29.925+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:30.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:29 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:29.925+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:30.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:29 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:29.925+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:30.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:29 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:29.934+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:30.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:29 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:29.934+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:30.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:29 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:29.934+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:05.179364+0000 front 2024-07-24T22:21:05.179349+0000 (oldest deadline 2024-07-24T22:21:26.279445+0000) 2024-07-24T22:21:30.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:30 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:30.054+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:30.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:30 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:30.054+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:30.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:30 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:30.054+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:30.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:30 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:30.054+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:30.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:30 smithi047 podman[127345]: 2024-07-24 22:21:30.12399121 +0000 UTC m=+6.283193449 container cleanup a0b03b7fa6b6faf7a09ba253fca6a008897c9200ffb0198cd510b0e214d5acaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=main-86385b1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-24T22:21:30.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:30 smithi047 bash[127345]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6 2024-07-24T22:21:30.773 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:30 smithi047 podman[127360]: 2024-07-24 22:21:30.44205139 +0000 UTC m=+0.873244691 container remove a0b03b7fa6b6faf7a09ba253fca6a008897c9200ffb0198cd510b0e214d5acaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240716, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-24T22:21:30.773 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:30 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:30.572+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:30.773 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:30 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:30.572+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:30.773 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:30 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:30.572+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:30.773 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:30 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:30.572+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:31.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:30 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:30.714+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:31.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:30 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:30.714+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:31.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:30 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:30.714+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:31.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:30 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:30.922+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:31.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:30 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:30.922+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:31.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:30 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:30.922+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:31.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:30 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:30.907+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:31.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:30 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:30.907+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:31.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:30 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:30.907+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:05.179364+0000 front 2024-07-24T22:21:05.179349+0000 (oldest deadline 2024-07-24T22:21:26.279445+0000) 2024-07-24T22:21:31.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:31 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:31.056+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:31.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:31 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:31.056+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:31.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:31 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:31.056+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:31.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:31 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:31.056+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:31.171 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:30 smithi047 podman[127451]: 2024-07-24 22:21:30.674539945 +0000 UTC m=+0.017869828 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:21:31.171 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:30 smithi047 podman[127451]: 2024-07-24 22:21:30.801291095 +0000 UTC m=+0.144620963 container create f14e788e124cb4a48ffd6f4bbc1a0f8fd0ddb077359ab28e912b388d5c86817f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6-deactivate, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-07-24T22:21:31.171 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:31 smithi047 podman[127451]: 2024-07-24 22:21:31.170378805 +0000 UTC m=+0.513708674 container init f14e788e124cb4a48ffd6f4bbc1a0f8fd0ddb077359ab28e912b388d5c86817f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240716, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-07-24T22:21:31.436 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:31 smithi047 podman[127451]: 2024-07-24 22:21:31.174423518 +0000 UTC m=+0.517753394 container start f14e788e124cb4a48ffd6f4bbc1a0f8fd0ddb077359ab28e912b388d5c86817f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240716, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-24T22:21:31.437 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:31 smithi047 podman[127451]: 2024-07-24 22:21:31.262028644 +0000 UTC m=+0.605358539 container attach f14e788e124cb4a48ffd6f4bbc1a0f8fd0ddb077359ab28e912b388d5c86817f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6-deactivate, RELEASE=main-86385b1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, org.label-schema.vendor=CentOS) 2024-07-24T22:21:31.437 INFO:journalctl@ceph.osd.6.smithi047.stdout:Jul 24 22:21:31 smithi047 podman[127451]: 2024-07-24 22:21:31.379531697 +0000 UTC m=+0.722861576 container died f14e788e124cb4a48ffd6f4bbc1a0f8fd0ddb077359ab28e912b388d5c86817f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=main-86385b1, org.label-schema.build-date=20240716, maintainer=Guillaume Abrioux ) 2024-07-24T22:21:31.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:31 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:31.622+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:31.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:31 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:31.622+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:31.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:31 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:31.622+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:31.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:31 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:31.622+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:32.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:31 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:31.749+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:32.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:31 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:31.749+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:32.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:31 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:31.749+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:32.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:31 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:31.950+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:32.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:31 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:31.950+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:32.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:31 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:31.950+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:32.050 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.6.service' 2024-07-24T22:21:32.090 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:21:32.090 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-07-24T22:21:32.090 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-07-24T22:21:32.090 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.7 2024-07-24T22:21:32.118 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:31 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:31.865+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:32.118 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:31 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:31.865+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:32.118 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:31 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:31.865+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:05.179364+0000 front 2024-07-24T22:21:05.179349+0000 (oldest deadline 2024-07-24T22:21:26.279445+0000) 2024-07-24T22:21:32.119 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:32 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:32.018+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:32.119 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:32 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:32.018+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:32.119 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:32 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:32.018+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:32.119 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:32 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:32.018+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:32.403 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:32 smithi183 systemd[1]: Stopping Ceph osd.7 for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:21:32.662 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:32 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:32.400+0000 7f4bb104e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:21:32.662 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:32 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:32.400+0000 7f4bb104e640 -1 osd.7 104 *** Got signal Terminated *** 2024-07-24T22:21:32.662 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:32 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:32.400+0000 7f4bb104e640 -1 osd.7 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-24T22:21:32.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:32 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:32.579+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:32.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:32 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:32.579+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:32.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:32 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:32.579+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:32.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:32 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:32.579+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:33.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:32 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:32.908+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:33.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:32 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:32.908+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:33.049 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:32 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:32.908+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:33.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:32 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:32.728+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:33.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:32 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:32.728+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:33.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:32 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:32.728+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:33.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:32 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:32.868+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:33.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:32 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:32.868+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:33.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:32 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:32.868+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:05.179364+0000 front 2024-07-24T22:21:05.179349+0000 (oldest deadline 2024-07-24T22:21:26.279445+0000) 2024-07-24T22:21:33.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:33 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:33.049+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:33.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:33 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:33.049+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:33.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:33 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:33.049+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:33.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:33 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:33.049+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:33.838 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:33 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:33.553+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:33.839 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:33 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:33.553+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:33.839 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:33 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:33.553+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:33.839 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:33 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:33.553+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:33.960 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:33 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:33.702+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:33.960 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:33 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:33.702+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:33.960 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:33 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:33.702+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:34.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:33 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:33.861+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:34.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:33 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:33.861+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:34.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:33 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:33.861+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:05.179364+0000 front 2024-07-24T22:21:05.179349+0000 (oldest deadline 2024-07-24T22:21:26.279445+0000) 2024-07-24T22:21:34.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:34 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:34.084+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:34.163 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:34 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:34.084+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:34.163 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:34 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:34.084+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:34.163 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:34 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:34.084+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:34.298 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:33 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:33.958+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:34.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:33 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:33.958+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:34.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:33 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:33.958+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:34.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:34 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:34.511+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:34.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:34 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:34.511+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:34.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:34 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:34.511+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:34.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:34 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:34.511+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:34.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:34 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:34.511+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:35.009 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:34 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:34.675+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:35.009 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:34 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:34.675+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:35.009 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:34 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:34.675+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:35.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:34 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:34.899+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:35.162 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:34 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:34.899+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:35.163 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:34 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:34.899+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:05.179364+0000 front 2024-07-24T22:21:05.179349+0000 (oldest deadline 2024-07-24T22:21:26.279445+0000) 2024-07-24T22:21:35.163 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:35 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:35.072+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:35.163 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:35 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:35.072+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:35.163 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:35 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:35.072+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:35.163 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:35 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:35.072+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:35.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:35 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:35.007+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:35.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:35 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:35.007+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:35.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:35 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:35.007+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:35.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:35 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:35.007+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.198328+0000 front 2024-07-24T22:21:09.198306+0000 (oldest deadline 2024-07-24T22:21:34.498325+0000) 2024-07-24T22:21:35.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:35 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:35.474+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:35.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:35 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:35.474+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:35.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:35 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:35.474+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:35.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:35 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:35.474+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:35.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:35 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:35.474+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:36.048 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:35 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:35.647+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:36.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:35 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:35.647+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:36.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:35 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:35.647+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:36.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:35 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:35.921+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:36.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:35 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:35.921+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:36.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:35 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:35.921+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:05.179364+0000 front 2024-07-24T22:21:05.179349+0000 (oldest deadline 2024-07-24T22:21:26.279445+0000) 2024-07-24T22:21:36.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:36 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:36.090+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:36.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:36 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:36.090+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:36.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:36 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:36.090+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:36.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:36 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:36.090+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:36.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:36 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:36.090+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:36.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:36 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:36.049+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:36.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:36 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:36.049+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:36.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:36 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:36.049+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:36.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:36 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:36.049+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.198328+0000 front 2024-07-24T22:21:09.198306+0000 (oldest deadline 2024-07-24T22:21:34.498325+0000) 2024-07-24T22:21:36.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:36 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:36.431+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:36.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:36 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:36.431+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:36.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:36 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:36.431+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:36.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:36 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:36.431+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:36.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:36 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:36.431+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:37.021 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:36 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:36.675+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:37.021 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:36 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:36.675+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:37.021 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:36 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:36.675+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:37.022 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:36 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:36.675+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:37.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:37 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:37.020+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:37.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:37 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:37.020+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:37.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:37 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:37.020+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:37.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:37 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:37.020+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.198328+0000 front 2024-07-24T22:21:09.198306+0000 (oldest deadline 2024-07-24T22:21:34.498325+0000) 2024-07-24T22:21:37.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:36 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:36.930+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:45.376374+0000 front 2024-07-24T22:20:45.376434+0000 (oldest deadline 2024-07-24T22:21:11.276513+0000) 2024-07-24T22:21:37.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:36 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:36.930+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.377682+0000 front 2024-07-24T22:20:55.377559+0000 (oldest deadline 2024-07-24T22:21:19.477447+0000) 2024-07-24T22:21:37.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:36 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:36.930+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:05.179364+0000 front 2024-07-24T22:21:05.179349+0000 (oldest deadline 2024-07-24T22:21:26.279445+0000) 2024-07-24T22:21:37.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:36 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7[56011]: 2024-07-24T22:21:36.930+0000 7f4bad663640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:10.380338+0000 front 2024-07-24T22:21:10.380425+0000 (oldest deadline 2024-07-24T22:21:36.280435+0000) 2024-07-24T22:21:37.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:37 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:37.087+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:37.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:37 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:37.087+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:37.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:37 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:37.087+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:37.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:37 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:37.087+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:37.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:37 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:37.087+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:37.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:37 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:37.479+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:37.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:37 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:37.479+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:37.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:37 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:37.479+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:37.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:37 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:37.479+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:37.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:37 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:37.479+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:38.012 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:37 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:37.646+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:38.012 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:37 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:37.646+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:38.012 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:37 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:37.646+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:38.012 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:37 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:37.646+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:38.228 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:37 smithi183 podman[73364]: 2024-07-24 22:21:37.947564824 +0000 UTC m=+5.660133886 container died b159ce3d4da9335eab6bd3ef04f5a11a9130096500476abce27bdb672c7386a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240716, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-07-24T22:21:38.229 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:38 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:38.132+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:38.229 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:38 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:38.132+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:38.229 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:38 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:38.132+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:38.229 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:38 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:38.132+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:38.229 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:38 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:38.132+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:38.298 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:38 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:38.010+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:38.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:38 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:38.010+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:38.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:38 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:38.010+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:38.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:38 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:38.010+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.198328+0000 front 2024-07-24T22:21:09.198306+0000 (oldest deadline 2024-07-24T22:21:34.498325+0000) 2024-07-24T22:21:38.570 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:38 smithi183 podman[73364]: 2024-07-24 22:21:38.318504569 +0000 UTC m=+6.031073622 container cleanup b159ce3d4da9335eab6bd3ef04f5a11a9130096500476abce27bdb672c7386a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T22:21:38.571 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:38 smithi183 bash[73364]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7 2024-07-24T22:21:38.900 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:38 smithi183 podman[73392]: 2024-07-24 22:21:38.569545253 +0000 UTC m=+0.619736795 container remove b159ce3d4da9335eab6bd3ef04f5a11a9130096500476abce27bdb672c7386a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240716, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=main-86385b1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-07-24T22:21:38.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:38 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:38.445+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:38.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:38 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:38.445+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:38.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:38 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:38.445+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:38.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:38 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:38.445+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:38.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:38 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:38.445+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:38.985 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:38 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:38.601+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:38.985 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:38 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:38.601+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:38.986 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:38 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:38.601+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:38.986 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:38 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:38.601+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:39.157 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:38 smithi183 podman[73480]: 2024-07-24 22:21:38.801922382 +0000 UTC m=+0.017592412 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:21:39.157 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:38 smithi183 podman[73480]: 2024-07-24 22:21:38.912141441 +0000 UTC m=+0.127811502 container create bb15b8a18964d27683540350df2c4420ecc357d994c2442d71cce17a77783978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=main-86385b1, io.buildah.version=1.36.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716) 2024-07-24T22:21:39.157 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:39 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:39.137+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:39.158 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:39 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:39.137+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:39.158 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:39 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:39.137+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:39.158 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:39 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:39.137+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:39.158 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:39 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:39.137+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:39.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:38 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:38.983+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:39.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:38 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:38.983+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:39.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:38 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:38.983+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:39.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:38 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:38.983+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.198328+0000 front 2024-07-24T22:21:09.198306+0000 (oldest deadline 2024-07-24T22:21:34.498325+0000) 2024-07-24T22:21:39.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:39 smithi183 podman[73480]: 2024-07-24 22:21:39.156135344 +0000 UTC m=+0.371805363 container init bb15b8a18964d27683540350df2c4420ecc357d994c2442d71cce17a77783978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-24T22:21:39.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:39 smithi183 podman[73480]: 2024-07-24 22:21:39.15940991 +0000 UTC m=+0.375079933 container start bb15b8a18964d27683540350df2c4420ecc357d994c2442d71cce17a77783978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7-deactivate, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=main-86385b1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-07-24T22:21:39.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:39 smithi183 podman[73480]: 2024-07-24 22:21:39.273581866 +0000 UTC m=+0.489251898 container attach bb15b8a18964d27683540350df2c4420ecc357d994c2442d71cce17a77783978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7-deactivate, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240716, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T22:21:39.412 INFO:journalctl@ceph.osd.7.smithi183.stdout:Jul 24 22:21:39 smithi183 podman[73480]: 2024-07-24 22:21:39.344803388 +0000 UTC m=+0.560473416 container died bb15b8a18964d27683540350df2c4420ecc357d994c2442d71cce17a77783978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, RELEASE=main-86385b1, org.label-schema.vendor=CentOS) 2024-07-24T22:21:39.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:39 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:39.473+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:39.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:39 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:39.473+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:39.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:39 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:39.473+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:39.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:39 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:39.473+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:39.937 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:39 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:39.473+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:39.966 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:39 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:39.613+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:39.966 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:39 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:39.613+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:39.966 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:39 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:39.613+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:39.966 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:39 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:39.613+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:40.006 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.7.service' 2024-07-24T22:21:40.086 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:21:40.087 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-07-24T22:21:40.087 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-07-24T22:21:40.087 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.8 2024-07-24T22:21:40.298 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:39 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:39.964+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:40.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:39 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:39.964+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:40.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:39 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:39.964+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:40.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:39 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:39.964+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.198328+0000 front 2024-07-24T22:21:09.198306+0000 (oldest deadline 2024-07-24T22:21:34.498325+0000) 2024-07-24T22:21:40.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:40 smithi188 systemd[1]: Stopping Ceph osd.8 for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:21:40.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:40 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:40.116+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:40.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:40 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:40.116+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:40.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:40 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:40.116+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:40.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:40 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:40.116+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:40.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:40 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:40.116+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:40.798 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:40 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:40.400+0000 7f1172a5b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:21:40.799 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:40 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:40.400+0000 7f1172a5b640 -1 osd.8 104 *** Got signal Terminated *** 2024-07-24T22:21:40.799 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:40 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:40.400+0000 7f1172a5b640 -1 osd.8 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-24T22:21:40.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:40 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:40.573+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:40.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:40 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:40.573+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:40.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:40 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:40.573+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:40.800 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:40 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:40.573+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:40.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:40 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:40.460+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:40.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:40 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:40.460+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:40.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:40 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:40.460+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:40.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:40 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:40.460+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:40.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:40 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:40.460+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:41.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:41 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:41.002+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:41.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:41 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:41.002+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:41.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:41 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:41.002+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:41.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:41 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:41.002+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.198328+0000 front 2024-07-24T22:21:09.198306+0000 (oldest deadline 2024-07-24T22:21:34.498325+0000) 2024-07-24T22:21:41.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:41 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:41.097+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:41.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:41 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:41.097+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:41.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:41 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:41.097+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:41.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:41 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:41.097+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:41.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:41 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:41.097+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:41.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:41 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:41.439+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:41.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:41 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:41.439+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:41.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:41 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:41.439+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:41.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:41 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:41.439+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:41.936 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:41 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:41.439+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:42.008 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:41 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:41.611+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:42.009 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:41 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:41.611+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:42.009 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:41 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:41.611+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:42.009 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:41 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:41.611+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:42.298 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:42 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:42.007+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:42.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:42 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:42.007+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:42.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:42 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:42.007+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:42.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:42 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:42.007+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.198328+0000 front 2024-07-24T22:21:09.198306+0000 (oldest deadline 2024-07-24T22:21:34.498325+0000) 2024-07-24T22:21:42.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:42 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:42.082+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:42.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:42 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:42.082+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:42.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:42 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:42.082+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:42.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:42 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:42.082+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:42.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:42 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:42.082+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:42.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:42 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:42.082+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:42.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:42 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:42.433+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:42.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:42 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:42.433+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:42.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:42 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:42.433+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:42.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:42 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:42.433+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:42.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:42 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:42.433+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:43.048 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:42 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:42.647+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:43.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:42 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:42.647+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:43.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:42 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:42.647+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:43.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:42 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:42.647+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:43.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:43 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:43.108+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:43.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:43 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:43.108+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:43.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:43 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:43.108+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:43.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:43 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:43.108+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:43.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:43 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:43.108+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:43.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:43 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:43.108+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:43.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:43 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:43.048+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:43.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:43 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:43.048+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:43.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:43 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:43.048+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:43.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:43 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:43.048+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.198328+0000 front 2024-07-24T22:21:09.198306+0000 (oldest deadline 2024-07-24T22:21:34.498325+0000) 2024-07-24T22:21:43.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:43 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:43.411+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:43.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:43 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:43.411+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:43.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:43 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:43.411+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:43.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:43 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:43.411+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:43.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:43 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:43.411+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:44.030 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:43 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:43.600+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:44.030 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:43 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:43.600+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:44.030 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:43 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:43.600+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:44.030 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:43 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:43.600+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:44.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:44 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:44.028+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:44.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:44 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:44.028+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:44.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:44 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:44.028+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:44.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:44 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:44.028+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.198328+0000 front 2024-07-24T22:21:09.198306+0000 (oldest deadline 2024-07-24T22:21:34.498325+0000) 2024-07-24T22:21:44.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:44 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:44.096+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:44.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:44 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:44.096+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:44.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:44 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:44.096+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:44.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:44 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:44.096+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:44.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:44 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:44.096+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:44.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:44 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:44.096+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:44.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:44 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:44.369+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:44.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:44 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:44.369+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:44.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:44 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:44.369+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:44.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:44 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:44.369+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:44.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:44 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:44.369+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:45.020 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:44 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:44.649+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:45.020 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:44 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:44.649+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:45.020 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:44 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:44.649+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:45.020 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:44 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:44.649+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:45.020 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:44 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:44.649+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:45.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:45 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:45.115+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:45.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:45 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:45.115+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:45.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:45 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:45.115+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:45.162 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:45 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:45.115+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:45.163 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:45 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:45.115+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:45.163 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:45 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:45.115+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:45.298 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:45 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:45.018+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.994729+0000 front 2024-07-24T22:20:46.994746+0000 (oldest deadline 2024-07-24T22:21:12.894736+0000) 2024-07-24T22:21:45.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:45 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:45.018+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.896577+0000 front 2024-07-24T22:20:56.896547+0000 (oldest deadline 2024-07-24T22:21:19.796669+0000) 2024-07-24T22:21:45.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:45 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:45.018+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.897801+0000 front 2024-07-24T22:21:03.897774+0000 (oldest deadline 2024-07-24T22:21:29.197797+0000) 2024-07-24T22:21:45.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:45 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:45.018+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.198328+0000 front 2024-07-24T22:21:09.198306+0000 (oldest deadline 2024-07-24T22:21:34.498325+0000) 2024-07-24T22:21:45.299 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:45 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8[56813]: 2024-07-24T22:21:45.018+0000 7f116b068640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:20.399235+0000 front 2024-07-24T22:21:20.399258+0000 (oldest deadline 2024-07-24T22:21:44.499280+0000) 2024-07-24T22:21:45.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:45 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:45.330+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:45.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:45 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:45.330+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:45.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:45 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:45.330+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:45.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:45 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:45.330+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:45.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:45 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:45.330+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:45.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:45 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:45.635+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:45.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:45 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:45.635+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:45.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:45 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:45.635+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:45.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:45 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:45.635+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:45.968 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:45 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:45.635+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:46.259 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:45 smithi188 podman[75151]: 2024-07-24 22:21:45.966481878 +0000 UTC m=+5.687413977 container died d710a231dd213379b4e57bc356c6af16f0ee166fc7353c990abc0964621fdd42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240716, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-07-24T22:21:46.260 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:46 smithi188 podman[75151]: 2024-07-24 22:21:46.258610459 +0000 UTC m=+5.979542544 container cleanup d710a231dd213379b4e57bc356c6af16f0ee166fc7353c990abc0964621fdd42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=main-86385b1, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-07-24T22:21:46.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:46 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:46.074+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:46.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:46 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:46.074+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:46.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:46 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:46.074+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:46.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:46 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:46.074+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:46.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:46 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:46.074+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:46.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:46 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:46.074+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:46.548 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:46 smithi188 bash[75151]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8 2024-07-24T22:21:46.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:46 smithi188 podman[75167]: 2024-07-24 22:21:46.476361785 +0000 UTC m=+0.506900844 container remove d710a231dd213379b4e57bc356c6af16f0ee166fc7353c990abc0964621fdd42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-07-24T22:21:46.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:46 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:46.320+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:46.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:46 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:46.320+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:46.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:46 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:46.320+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:46.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:46 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:46.320+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:46.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:46 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:46.320+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:46.930 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:46 smithi188 podman[75255]: 2024-07-24 22:21:46.706991282 +0000 UTC m=+0.017469138 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:21:46.930 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:46 smithi188 podman[75255]: 2024-07-24 22:21:46.810402208 +0000 UTC m=+0.120880058 container create d26deb57d159ae58d6d8ad50a87d8284b04cd55e9241118101d742bd1903ea84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240716, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=main-86385b1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-07-24T22:21:46.930 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:46 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:46.637+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:46.930 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:46 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:46.637+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:46.930 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:46 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:46.637+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:46.930 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:46 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:46.637+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:46.930 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:46 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:46.637+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:47.241 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:47 smithi188 podman[75255]: 2024-07-24 22:21:47.046630103 +0000 UTC m=+0.357107963 container init d26deb57d159ae58d6d8ad50a87d8284b04cd55e9241118101d742bd1903ea84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240716, RELEASE=main-86385b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-07-24T22:21:47.241 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:47 smithi188 podman[75255]: 2024-07-24 22:21:47.049792983 +0000 UTC m=+0.360270842 container start d26deb57d159ae58d6d8ad50a87d8284b04cd55e9241118101d742bd1903ea84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8-deactivate, RELEASE=main-86385b1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-07-24T22:21:47.241 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:47 smithi188 podman[75255]: 2024-07-24 22:21:47.121529749 +0000 UTC m=+0.432007611 container attach d26deb57d159ae58d6d8ad50a87d8284b04cd55e9241118101d742bd1903ea84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8-deactivate, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, maintainer=Guillaume Abrioux ) 2024-07-24T22:21:47.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:47 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:47.118+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:47.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:47 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:47.118+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:47.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:47 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:47.118+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:47.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:47 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:47.118+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:47.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:47 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:47.118+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:47.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:47 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:47.118+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:47.548 INFO:journalctl@ceph.osd.8.smithi188.stdout:Jul 24 22:21:47 smithi188 podman[75255]: 2024-07-24 22:21:47.239867754 +0000 UTC m=+0.550345615 container died d26deb57d159ae58d6d8ad50a87d8284b04cd55e9241118101d742bd1903ea84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=main-86385b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-07-24T22:21:47.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:47 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:47.356+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:47.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:47 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:47.356+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:47.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:47 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:47.356+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:47.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:47 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:47.356+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:47.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:47 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:47.356+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:47.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:47 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:47.356+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:16.742527+0000 front 2024-07-24T22:21:16.742406+0000 (oldest deadline 2024-07-24T22:21:46.743050+0000) 2024-07-24T22:21:47.792 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.8.service' 2024-07-24T22:21:47.829 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:47 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:47.606+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:47.829 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:47 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:47.606+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:47.829 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:47 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:47.606+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:47.829 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:47 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:47.606+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:47.829 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:47 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:47.606+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:47.830 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:21:47.830 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-07-24T22:21:47.831 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-07-24T22:21:47.831 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.9 2024-07-24T22:21:48.136 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:47 smithi047 systemd[1]: Stopping Ceph osd.9 for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:21:48.137 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:48 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:48.134+0000 7f949cb10640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:21:48.137 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:48 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:48.134+0000 7f949cb10640 -1 osd.9 104 *** Got signal Terminated *** 2024-07-24T22:21:48.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:48 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:48.106+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:48.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:48 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:48.106+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:48.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:48 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:48.106+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:48.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:48 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:48.106+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:48.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:48 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:48.106+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:48.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:48 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:48.106+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:48.436 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:48 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:48.134+0000 7f949cb10640 -1 osd.9 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-24T22:21:48.436 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:48 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:48.307+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:48.436 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:48 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:48.307+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:48.436 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:48 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:48.307+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:48.437 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:48 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:48.307+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:48.437 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:48 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:48.307+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:48.437 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:48 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:48.307+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:16.742527+0000 front 2024-07-24T22:21:16.742406+0000 (oldest deadline 2024-07-24T22:21:46.743050+0000) 2024-07-24T22:21:49.048 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:48 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:48.640+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:49.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:48 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:48.641+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:49.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:48 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:48.641+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:49.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:48 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:48.641+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:49.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:48 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:48.641+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:49.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:49 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:49.112+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:49.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:49 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:49.112+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:49.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:49 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:49.112+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:49.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:49 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:49.112+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:49.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:49 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:49.112+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:49.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:49 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:49.112+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:49.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:49 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:49.313+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:49.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:49 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:49.313+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:49.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:49 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:49.313+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:49.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:49 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:49.313+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:49.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:49 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:49.313+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:49.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:49 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:49.313+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:16.742527+0000 front 2024-07-24T22:21:16.742406+0000 (oldest deadline 2024-07-24T22:21:46.743050+0000) 2024-07-24T22:21:50.048 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:49 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:49.666+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:50.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:49 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:49.666+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:50.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:49 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:49.666+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:50.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:49 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:49.666+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:50.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:49 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:49.666+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:50.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:50 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:50.070+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:50.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:50 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:50.070+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:50.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:50 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:50.070+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:50.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:50 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:50.070+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:50.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:50 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:50.070+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:50.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:50 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:50.070+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:50.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:50 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:50.315+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:50.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:50 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:50.315+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:50.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:50 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:50.315+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:50.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:50 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:50.315+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:50.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:50 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:50.315+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:50.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:50 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:50.315+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:16.742527+0000 front 2024-07-24T22:21:16.742406+0000 (oldest deadline 2024-07-24T22:21:46.743050+0000) 2024-07-24T22:21:50.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:50 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:50.315+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:26.743443+0000 front 2024-07-24T22:21:26.743467+0000 (oldest deadline 2024-07-24T22:21:50.243461+0000) 2024-07-24T22:21:51.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:50 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:50.656+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:51.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:50 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:50.656+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:51.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:50 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:50.656+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:51.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:50 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:50.656+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:51.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:50 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:50.656+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:51.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:51 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:51.101+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:51.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:51 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:51.101+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:51.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:51 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:51.101+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:51.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:51 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:51.101+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:51.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:51 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:51.101+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:51.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:51 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:51.101+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:51.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:51 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:51.101+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:25.959685+0000 front 2024-07-24T22:21:25.959738+0000 (oldest deadline 2024-07-24T22:21:50.659506+0000) 2024-07-24T22:21:51.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:51 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:51.322+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:51.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:51 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:51.322+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:51.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:51 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:51.322+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:51.686 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:51 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:51.322+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:51.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:51 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:51.322+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:51.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:51 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:51.322+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:16.742527+0000 front 2024-07-24T22:21:16.742406+0000 (oldest deadline 2024-07-24T22:21:46.743050+0000) 2024-07-24T22:21:51.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:51 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:51.322+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:26.743443+0000 front 2024-07-24T22:21:26.743467+0000 (oldest deadline 2024-07-24T22:21:50.243461+0000) 2024-07-24T22:21:52.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:51 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:51.607+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:52.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:51 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:51.607+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:52.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:51 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:51.607+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:52.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:51 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:51.607+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:52.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:51 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:51.607+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:52.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:52 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:52.060+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:52.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:52 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:52.060+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:52.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:52 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:52.060+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:52.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:52 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:52.060+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:52.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:52 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:52.060+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:52.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:52 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:52.060+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:52.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:52 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:52.060+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:25.959685+0000 front 2024-07-24T22:21:25.959738+0000 (oldest deadline 2024-07-24T22:21:50.659506+0000) 2024-07-24T22:21:52.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:52 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:52.354+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:39.436418+0000 front 2024-07-24T22:20:39.436517+0000 (oldest deadline 2024-07-24T22:21:02.336601+0000) 2024-07-24T22:21:52.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:52 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:52.354+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:46.937963+0000 front 2024-07-24T22:20:46.938080+0000 (oldest deadline 2024-07-24T22:21:15.138742+0000) 2024-07-24T22:21:52.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:52 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:52.354+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:55.139393+0000 front 2024-07-24T22:20:55.139493+0000 (oldest deadline 2024-07-24T22:21:21.039464+0000) 2024-07-24T22:21:52.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:52 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:52.354+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.340506+0000 front 2024-07-24T22:21:03.340691+0000 (oldest deadline 2024-07-24T22:21:26.240676+0000) 2024-07-24T22:21:52.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:52 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:52.354+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:09.741751+0000 front 2024-07-24T22:21:09.741810+0000 (oldest deadline 2024-07-24T22:21:34.441564+0000) 2024-07-24T22:21:52.687 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:52 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:52.354+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:16.742527+0000 front 2024-07-24T22:21:16.742406+0000 (oldest deadline 2024-07-24T22:21:46.743050+0000) 2024-07-24T22:21:52.688 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:52 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9[72356]: 2024-07-24T22:21:52.354+0000 7f949511d640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:26.743443+0000 front 2024-07-24T22:21:26.743467+0000 (oldest deadline 2024-07-24T22:21:50.243461+0000) 2024-07-24T22:21:53.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:52 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:52.582+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:53.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:52 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:52.582+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:53.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:52 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:52.582+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:53.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:52 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:52.582+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:53.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:52 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:52.582+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:53.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:52 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:52.582+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:21:53.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:53 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:53.053+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:53.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:53 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:53.053+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:53.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:53 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:53.053+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:53.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:53 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:53.053+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:53.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:53 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:53.053+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:53.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:53 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:53.053+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:53.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:53 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:53.053+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:25.959685+0000 front 2024-07-24T22:21:25.959738+0000 (oldest deadline 2024-07-24T22:21:50.659506+0000) 2024-07-24T22:21:53.786 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:53 smithi047 podman[127565]: 2024-07-24 22:21:53.528816955 +0000 UTC m=+5.496361539 container died b337cc136848ab7a28a03e28a7e4ef04c7327b5cf75882e011158e6544f8b49c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240716, RELEASE=main-86385b1, ceph=True, maintainer=Guillaume Abrioux ) 2024-07-24T22:21:54.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:53 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:53.549+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:54.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:53 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:53.549+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:54.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:53 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:53.549+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:54.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:53 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:53.549+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:54.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:53 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:53.549+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:54.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:53 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:53.549+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:21:54.186 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:53 smithi047 podman[127565]: 2024-07-24 22:21:53.917816015 +0000 UTC m=+5.885360598 container cleanup b337cc136848ab7a28a03e28a7e4ef04c7327b5cf75882e011158e6544f8b49c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240716, maintainer=Guillaume Abrioux , RELEASE=main-86385b1, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-07-24T22:21:54.187 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:53 smithi047 bash[127565]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9 2024-07-24T22:21:54.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:54 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:54.030+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:54.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:54 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:54.030+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:54.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:54 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:54.030+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:54.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:54 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:54.030+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:54.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:54 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:54.030+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:54.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:54 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:54.030+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:54.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:54 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:54.030+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:25.959685+0000 front 2024-07-24T22:21:25.959738+0000 (oldest deadline 2024-07-24T22:21:50.659506+0000) 2024-07-24T22:21:54.537 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:54 smithi047 podman[127581]: 2024-07-24 22:21:54.202369554 +0000 UTC m=+0.667591943 container remove b337cc136848ab7a28a03e28a7e4ef04c7327b5cf75882e011158e6544f8b49c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-07-24T22:21:54.840 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:54 smithi047 podman[127671]: 2024-07-24 22:21:54.536597937 +0000 UTC m=+0.104203505 container create da4a415df343e0b943efaaa1ea2dbd0cbbbc1ad7e7f14b1f1a03d62ff6da0ba8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS) 2024-07-24T22:21:54.840 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:54 smithi047 podman[127671]: 2024-07-24 22:21:54.450218722 +0000 UTC m=+0.017824291 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:21:54.840 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:54 smithi047 podman[127671]: 2024-07-24 22:21:54.755521662 +0000 UTC m=+0.323127241 container init da4a415df343e0b943efaaa1ea2dbd0cbbbc1ad7e7f14b1f1a03d62ff6da0ba8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, ceph=True, GIT_BRANCH=HEAD, RELEASE=main-86385b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-07-24T22:21:54.840 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:54 smithi047 podman[127671]: 2024-07-24 22:21:54.758870031 +0000 UTC m=+0.326475599 container start da4a415df343e0b943efaaa1ea2dbd0cbbbc1ad7e7f14b1f1a03d62ff6da0ba8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240716, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=main-86385b1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T22:21:54.840 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:54 smithi047 podman[127671]: 2024-07-24 22:21:54.838686223 +0000 UTC m=+0.406291801 container attach da4a415df343e0b943efaaa1ea2dbd0cbbbc1ad7e7f14b1f1a03d62ff6da0ba8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-07-24T22:21:55.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:54 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:54.561+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:55.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:54 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:54.561+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:55.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:54 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:54.561+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:55.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:54 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:54.561+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:55.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:54 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:54.561+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:55.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:54 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:54.561+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:21:55.186 INFO:journalctl@ceph.osd.9.smithi047.stdout:Jul 24 22:21:54 smithi047 podman[127671]: 2024-07-24 22:21:54.953550719 +0000 UTC m=+0.521156296 container died da4a415df343e0b943efaaa1ea2dbd0cbbbc1ad7e7f14b1f1a03d62ff6da0ba8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-24T22:21:55.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:55 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:55.059+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:55.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:55 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:55.059+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:55.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:55 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:55.059+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:55.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:55 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:55.059+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:55.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:55 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:55.059+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:55.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:55 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:55.059+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:55.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:55 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:55.059+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:25.959685+0000 front 2024-07-24T22:21:25.959738+0000 (oldest deadline 2024-07-24T22:21:50.659506+0000) 2024-07-24T22:21:55.687 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.9.service' 2024-07-24T22:21:55.734 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:21:55.734 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-07-24T22:21:55.735 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-07-24T22:21:55.735 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.10 2024-07-24T22:21:55.798 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:55 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:55.527+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:55.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:55 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:55.527+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:55.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:55 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:55.527+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:55.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:55 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:55.527+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:55.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:55 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:55.527+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:55.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:55 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:55.527+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:21:56.045 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:55 smithi183 systemd[1]: Stopping Ceph osd.10 for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:21:56.045 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:56 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:56.043+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:56.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:56 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:56.043+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:56.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:56 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:56.043+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:56.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:56 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:56.043+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:56.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:56 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:56.043+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:56.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:56 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:56.043+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:56.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:56 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:56.043+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:25.959685+0000 front 2024-07-24T22:21:25.959738+0000 (oldest deadline 2024-07-24T22:21:50.659506+0000) 2024-07-24T22:21:56.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:56 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:56.064+0000 7f37ad348640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:21:56.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:56 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:56.064+0000 7f37ad348640 -1 osd.10 104 *** Got signal Terminated *** 2024-07-24T22:21:56.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:56 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:56.064+0000 7f37ad348640 -1 osd.10 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-24T22:21:56.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:56 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:56.496+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:56.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:56 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:56.496+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:56.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:56 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:56.496+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:56.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:56 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:56.496+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:56.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:56 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:56.496+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:56.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:56 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:56.496+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:21:57.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:57 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:57.062+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:57.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:57 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:57.062+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:57.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:57 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:57.062+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:57.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:57 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:57.062+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:57.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:57 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:57.062+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:57.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:57 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:57.062+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:57.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:57 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:57.062+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:25.959685+0000 front 2024-07-24T22:21:25.959738+0000 (oldest deadline 2024-07-24T22:21:50.659506+0000) 2024-07-24T22:21:57.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:57 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:57.519+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:57.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:57 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:57.519+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:57.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:57 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:57.519+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:57.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:57 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:57.519+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:57.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:57 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:57.519+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:57.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:57 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:57.519+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:21:58.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:58 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:58.080+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:58.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:58 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:58.080+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:58.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:58 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:58.080+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:58.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:58 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:58.080+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:58.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:58 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:58.080+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:58.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:58 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:58.080+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:58.413 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:58 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:58.080+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:25.959685+0000 front 2024-07-24T22:21:25.959738+0000 (oldest deadline 2024-07-24T22:21:50.659506+0000) 2024-07-24T22:21:58.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:58 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:58.521+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:21:58.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:58 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:58.521+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:21:58.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:58 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:58.521+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:21:58.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:58 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:58.521+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:21:58.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:58 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:58.521+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:21:58.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:58 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:58.521+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:21:59.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:59 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:59.100+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:21:59.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:59 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:59.100+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:21:59.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:59 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:59.100+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:21:59.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:59 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:59.100+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:21:59.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:59 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:59.100+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:21:59.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:59 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:59.100+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:21:59.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:21:59 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:21:59.100+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:25.959685+0000 front 2024-07-24T22:21:25.959738+0000 (oldest deadline 2024-07-24T22:21:50.659506+0000) 2024-07-24T22:22:00.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:59 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:59.566+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:22:00.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:59 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:59.566+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:22:00.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:59 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:59.566+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:22:00.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:59 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:59.566+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:22:00.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:59 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:59.566+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:22:00.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:21:59 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:21:59.566+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:22:00.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:00 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:22:00.140+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:41.352144+0000 front 2024-07-24T22:20:41.352314+0000 (oldest deadline 2024-07-24T22:21:03.652073+0000) 2024-07-24T22:22:00.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:00 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:22:00.140+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.952854+0000 front 2024-07-24T22:20:48.952882+0000 (oldest deadline 2024-07-24T22:21:10.653046+0000) 2024-07-24T22:22:00.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:00 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:22:00.140+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:56.454578+0000 front 2024-07-24T22:20:56.454556+0000 (oldest deadline 2024-07-24T22:21:20.554680+0000) 2024-07-24T22:22:00.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:00 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:22:00.140+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-07-24T22:21:03.856270+0000 front 2024-07-24T22:21:03.856428+0000 (oldest deadline 2024-07-24T22:21:28.556311+0000) 2024-07-24T22:22:00.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:00 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:22:00.140+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.858022+0000 front 2024-07-24T22:21:11.858037+0000 (oldest deadline 2024-07-24T22:21:35.958152+0000) 2024-07-24T22:22:00.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:00 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:22:00.140+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:15.958640+0000 front 2024-07-24T22:21:15.958559+0000 (oldest deadline 2024-07-24T22:21:41.858577+0000) 2024-07-24T22:22:00.412 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:00 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10[62858]: 2024-07-24T22:22:00.140+0000 7f37a995d640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:25.959685+0000 front 2024-07-24T22:21:25.959738+0000 (oldest deadline 2024-07-24T22:21:50.659506+0000) 2024-07-24T22:22:01.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:00 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:00.610+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:22:01.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:00 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:00.610+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:22:01.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:00 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:00.610+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:22:01.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:00 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:00.610+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:22:01.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:00 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:00.610+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:22:01.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:00 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:00.610+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:22:01.954 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:01 smithi183 podman[73583]: 2024-07-24 22:22:01.67162283 +0000 UTC m=+5.740571820 container died 9cb06d2fdf7884fc67ccf3ef672cc647afe10999cd132d5c8fbcd5c502fd1274 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=main-86385b1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240716, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-24T22:22:02.048 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:01 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:01.630+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:22:02.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:01 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:01.630+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:22:02.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:01 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:01.630+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:22:02.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:01 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:01.630+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:22:02.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:01 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:01.630+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:22:02.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:01 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:01.630+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:22:02.297 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:02 smithi183 podman[73583]: 2024-07-24 22:22:02.052597491 +0000 UTC m=+6.121546473 container cleanup 9cb06d2fdf7884fc67ccf3ef672cc647afe10999cd132d5c8fbcd5c502fd1274 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10, org.label-schema.build-date=20240716, RELEASE=main-86385b1, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-07-24T22:22:02.297 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:02 smithi183 bash[73583]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10 2024-07-24T22:22:02.624 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:02 smithi183 podman[73600]: 2024-07-24 22:22:02.295628751 +0000 UTC m=+0.618812934 container remove 9cb06d2fdf7884fc67ccf3ef672cc647afe10999cd132d5c8fbcd5c502fd1274 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240716, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, org.label-schema.license=GPLv2) 2024-07-24T22:22:02.912 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:02 smithi183 podman[73687]: 2024-07-24 22:22:02.525296659 +0000 UTC m=+0.016956954 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:22:02.912 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:02 smithi183 podman[73687]: 2024-07-24 22:22:02.638142503 +0000 UTC m=+0.129802823 container create 686fc02e97a2f5ae0d175099e6420a26e26d2caee39578fd13ae013a827f1c42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240716, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-07-24T22:22:02.912 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:02 smithi183 podman[73687]: 2024-07-24 22:22:02.848581168 +0000 UTC m=+0.340241447 container init 686fc02e97a2f5ae0d175099e6420a26e26d2caee39578fd13ae013a827f1c42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=main-86385b1, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240716, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-07-24T22:22:02.912 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:02 smithi183 podman[73687]: 2024-07-24 22:22:02.851697863 +0000 UTC m=+0.343358147 container start 686fc02e97a2f5ae0d175099e6420a26e26d2caee39578fd13ae013a827f1c42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.build-date=20240716, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-07-24T22:22:03.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:02 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:02.608+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:22:03.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:02 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:02.608+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:22:03.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:02 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:02.608+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:22:03.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:02 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:02.608+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:22:03.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:02 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:02.608+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:22:03.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:02 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:02.608+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:22:03.335 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:02 smithi183 podman[73687]: 2024-07-24 22:22:02.936725261 +0000 UTC m=+0.428385540 container attach 686fc02e97a2f5ae0d175099e6420a26e26d2caee39578fd13ae013a827f1c42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, RELEASE=main-86385b1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-07-24T22:22:03.336 INFO:journalctl@ceph.osd.10.smithi183.stdout:Jul 24 22:22:03 smithi183 podman[73687]: 2024-07-24 22:22:03.041115845 +0000 UTC m=+0.532776123 container died 686fc02e97a2f5ae0d175099e6420a26e26d2caee39578fd13ae013a827f1c42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240716, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=main-86385b1) 2024-07-24T22:22:03.660 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.10.service' 2024-07-24T22:22:03.696 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:22:03.696 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-07-24T22:22:03.696 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-07-24T22:22:03.696 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.11 2024-07-24T22:22:04.003 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:03 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:03.562+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:22:04.003 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:03 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:03.562+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:22:04.003 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:03 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:03.562+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:22:04.003 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:03 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:03.562+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:22:04.003 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:03 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:03.562+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:22:04.003 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:03 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:03.562+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:22:04.003 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:03 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:03.562+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6820 osd.7 since back 2024-07-24T22:21:31.725499+0000 front 2024-07-24T22:21:31.725639+0000 (oldest deadline 2024-07-24T22:22:02.925752+0000) 2024-07-24T22:22:04.003 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:03 smithi188 systemd[1]: Stopping Ceph osd.11 for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:22:04.003 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:04 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:04.000+0000 7fa8cea8c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:22:04.003 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:04 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:04.000+0000 7fa8cea8c640 -1 osd.11 104 *** Got signal Terminated *** 2024-07-24T22:22:04.004 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:04 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:04.000+0000 7fa8cea8c640 -1 osd.11 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-07-24T22:22:05.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:04 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:04.551+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:22:05.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:04 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:04.551+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:22:05.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:04 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:04.551+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:22:05.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:04 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:04.551+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:22:05.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:04 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:04.551+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:22:05.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:04 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:04.551+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:22:05.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:04 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:04.551+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6820 osd.7 since back 2024-07-24T22:21:31.725499+0000 front 2024-07-24T22:21:31.725639+0000 (oldest deadline 2024-07-24T22:22:02.925752+0000) 2024-07-24T22:22:05.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:05 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:05.537+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:22:05.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:05 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:05.537+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:22:05.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:05 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:05.537+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:22:05.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:05 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:05.537+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:22:05.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:05 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:05.537+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:22:05.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:05 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:05.537+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:22:05.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:05 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:05.537+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6820 osd.7 since back 2024-07-24T22:21:31.725499+0000 front 2024-07-24T22:21:31.725639+0000 (oldest deadline 2024-07-24T22:22:02.925752+0000) 2024-07-24T22:22:06.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:06 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:06.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:22:06.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:06 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:06.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:22:06.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:06 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:06.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:22:06.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:06 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:06.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:22:06.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:06 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:06.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:22:06.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:06 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:06.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:22:06.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:06 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:06.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6820 osd.7 since back 2024-07-24T22:21:31.725499+0000 front 2024-07-24T22:21:31.725639+0000 (oldest deadline 2024-07-24T22:22:02.925752+0000) 2024-07-24T22:22:07.801 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:07 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:07.544+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:22:07.801 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:07 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:07.544+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:22:07.801 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:07 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:07.544+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:22:07.801 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:07 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:07.544+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:22:07.802 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:07 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:07.544+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:22:07.802 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:07 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:07.544+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:22:07.802 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:07 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:07.544+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6820 osd.7 since back 2024-07-24T22:21:31.725499+0000 front 2024-07-24T22:21:31.725639+0000 (oldest deadline 2024-07-24T22:22:02.925752+0000) 2024-07-24T22:22:07.802 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:07 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:07.544+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6820 osd.8 since back 2024-07-24T22:21:42.926227+0000 front 2024-07-24T22:21:42.926256+0000 (oldest deadline 2024-07-24T22:22:07.026366+0000) 2024-07-24T22:22:08.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:08 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:08.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-07-24T22:20:36.118287+0000 front 2024-07-24T22:20:36.118270+0000 (oldest deadline 2024-07-24T22:21:05.518828+0000) 2024-07-24T22:22:08.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:08 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:08.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6804 osd.1 since back 2024-07-24T22:20:48.419843+0000 front 2024-07-24T22:20:48.419919+0000 (oldest deadline 2024-07-24T22:21:13.719854+0000) 2024-07-24T22:22:08.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:08 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:08.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6804 osd.2 since back 2024-07-24T22:20:53.720388+0000 front 2024-07-24T22:20:53.720480+0000 (oldest deadline 2024-07-24T22:21:19.620500+0000) 2024-07-24T22:22:08.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:08 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:08.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6812 osd.4 since back 2024-07-24T22:21:11.322857+0000 front 2024-07-24T22:21:11.322779+0000 (oldest deadline 2024-07-24T22:21:36.022793+0000) 2024-07-24T22:22:08.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:08 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:08.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6812 osd.5 since back 2024-07-24T22:21:18.323607+0000 front 2024-07-24T22:21:18.323636+0000 (oldest deadline 2024-07-24T22:21:43.623763+0000) 2024-07-24T22:22:08.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:08 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:08.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.47:6822 osd.6 since back 2024-07-24T22:21:27.625002+0000 front 2024-07-24T22:21:27.625060+0000 (oldest deadline 2024-07-24T22:21:51.724995+0000) 2024-07-24T22:22:08.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:08 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:08.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.183:6820 osd.7 since back 2024-07-24T22:21:31.725499+0000 front 2024-07-24T22:21:31.725639+0000 (oldest deadline 2024-07-24T22:22:02.925752+0000) 2024-07-24T22:22:08.799 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:08 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11[63808]: 2024-07-24T22:22:08.533+0000 7fa8c7099640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.188:6820 osd.8 since back 2024-07-24T22:21:42.926227+0000 front 2024-07-24T22:21:42.926256+0000 (oldest deadline 2024-07-24T22:22:07.026366+0000) 2024-07-24T22:22:09.736 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:09 smithi188 podman[75372]: 2024-07-24 22:22:09.467432809 +0000 UTC m=+5.575914521 container died 7a4e2a9d83c2655450201cc83f6e829680da7db8ca8c02ea6468b4072bb08795 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240716, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-07-24T22:22:10.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:09 smithi188 podman[75372]: 2024-07-24 22:22:09.808897511 +0000 UTC m=+5.917379221 container cleanup 7a4e2a9d83c2655450201cc83f6e829680da7db8ca8c02ea6468b4072bb08795 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, RELEASE=main-86385b1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-24T22:22:10.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:09 smithi188 bash[75372]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11 2024-07-24T22:22:10.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:09 smithi188 podman[75387]: 2024-07-24 22:22:09.976584224 +0000 UTC m=+0.507771384 container remove 7a4e2a9d83c2655450201cc83f6e829680da7db8ca8c02ea6468b4072bb08795 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11, RELEASE=main-86385b1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0) 2024-07-24T22:22:10.714 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:10 smithi188 podman[75478]: 2024-07-24 22:22:10.41900951 +0000 UTC m=+0.107133450 container create 78246cadb3a40a8103b633ee740a8fb079395b792c813cdcb6153bd907591e70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11-deactivate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, RELEASE=main-86385b1, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-24T22:22:10.714 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:10 smithi188 podman[75478]: 2024-07-24 22:22:10.32878622 +0000 UTC m=+0.016910179 image pull 2e906353c5e5862501954d038b33a590403821502f8379d78db37da9c924b2a0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb 2024-07-24T22:22:10.714 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:10 smithi188 podman[75478]: 2024-07-24 22:22:10.638077447 +0000 UTC m=+0.326201388 container init 78246cadb3a40a8103b633ee740a8fb079395b792c813cdcb6153bd907591e70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240716, maintainer=Guillaume Abrioux , RELEASE=main-86385b1, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-07-24T22:22:10.715 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:10 smithi188 podman[75478]: 2024-07-24 22:22:10.641274101 +0000 UTC m=+0.329398045 container start 78246cadb3a40a8103b633ee740a8fb079395b792c813cdcb6153bd907591e70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, GIT_CLEAN=True, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T22:22:10.715 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:10 smithi188 podman[75478]: 2024-07-24 22:22:10.712923657 +0000 UTC m=+0.401047598 container attach 78246cadb3a40a8103b633ee740a8fb079395b792c813cdcb6153bd907591e70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240716, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=main-86385b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-07-24T22:22:11.049 INFO:journalctl@ceph.osd.11.smithi188.stdout:Jul 24 22:22:10 smithi188 podman[75478]: 2024-07-24 22:22:10.83665605 +0000 UTC m=+0.524780000 container died 78246cadb3a40a8103b633ee740a8fb079395b792c813cdcb6153bd907591e70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, RELEASE=main-86385b1) 2024-07-24T22:22:11.335 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@osd.11.service' 2024-07-24T22:22:11.372 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:22:11.373 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-07-24T22:22:11.373 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-07-24T22:22:11.373 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.a 2024-07-24T22:22:11.686 INFO:journalctl@ceph.mds.a.smithi047.stdout:Jul 24 22:22:11 smithi047 systemd[1]: Stopping Ceph mds.a for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:22:12.186 INFO:journalctl@ceph.mds.a.smithi047.stdout:Jul 24 22:22:11 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-a[79799]: 2024-07-24T22:22:11.702+0000 7f610c998640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:22:12.186 INFO:journalctl@ceph.mds.a.smithi047.stdout:Jul 24 22:22:11 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-a[79799]: 2024-07-24T22:22:11.702+0000 7f610c998640 -1 mds.a *** got signal Terminated *** 2024-07-24T22:22:14.236 INFO:journalctl@ceph.mds.a.smithi047.stdout:Jul 24 22:22:13 smithi047 podman[127774]: 2024-07-24 22:22:13.968392327 +0000 UTC m=+2.388971343 container died 58ebd81e3185d5cf71f2c4c96f96759c06eb4f1c5b2dd7543f8401cb7d1afb92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, RELEASE=main-86385b1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-24T22:22:14.679 INFO:journalctl@ceph.mds.a.smithi047.stdout:Jul 24 22:22:14 smithi047 podman[127774]: 2024-07-24 22:22:14.435354023 +0000 UTC m=+2.855933093 container cleanup 58ebd81e3185d5cf71f2c4c96f96759c06eb4f1c5b2dd7543f8401cb7d1afb92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=main-86385b1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0) 2024-07-24T22:22:14.679 INFO:journalctl@ceph.mds.a.smithi047.stdout:Jul 24 22:22:14 smithi047 bash[127774]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-a 2024-07-24T22:22:14.827 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.a.service' 2024-07-24T22:22:14.865 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:22:14.865 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-07-24T22:22:14.866 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-07-24T22:22:14.866 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.d 2024-07-24T22:22:15.186 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:22:14 smithi047 systemd[1]: Stopping Ceph mds.d for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:22:15.686 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:22:15 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-d[78570]: 2024-07-24T22:22:15.305+0000 7fbe632a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:22:15.686 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:22:15 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-d[78570]: 2024-07-24T22:22:15.305+0000 7fbe632a9640 -1 mds.d *** got signal Terminated *** 2024-07-24T22:22:18.141 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:22:17 smithi047 podman[127906]: 2024-07-24 22:22:17.882523263 +0000 UTC m=+2.783125397 container died 6f824af4f09cbc64371a916dc235a77a98b6d86714f0168aeb528f6a65b1b277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240716, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-24T22:22:18.436 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:22:18 smithi047 podman[127906]: 2024-07-24 22:22:18.322676675 +0000 UTC m=+3.223278799 container cleanup 6f824af4f09cbc64371a916dc235a77a98b6d86714f0168aeb528f6a65b1b277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-d, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716) 2024-07-24T22:22:18.436 INFO:journalctl@ceph.mds.d.smithi047.stdout:Jul 24 22:22:18 smithi047 bash[127906]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-d 2024-07-24T22:22:18.761 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.d.service' 2024-07-24T22:22:18.796 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:22:18.796 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-07-24T22:22:18.797 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-07-24T22:22:18.797 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.g 2024-07-24T22:22:19.128 INFO:journalctl@ceph.mds.g.smithi047.stdout:Jul 24 22:22:18 smithi047 systemd[1]: Stopping Ceph mds.g for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:22:19.436 INFO:journalctl@ceph.mds.g.smithi047.stdout:Jul 24 22:22:19 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-g[79382]: 2024-07-24T22:22:19.125+0000 7f8250889640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:22:19.436 INFO:journalctl@ceph.mds.g.smithi047.stdout:Jul 24 22:22:19 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-g[79382]: 2024-07-24T22:22:19.125+0000 7f8250889640 -1 mds.g *** got signal Terminated *** 2024-07-24T22:22:22.612 INFO:journalctl@ceph.mds.g.smithi047.stdout:Jul 24 22:22:22 smithi047 podman[128027]: 2024-07-24 22:22:22.360235611 +0000 UTC m=+3.341712267 container died c40b95a1e50174795c4b7f631496c2038b989c2efb79530edee38ed297b76bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-g, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-24T22:22:22.936 INFO:journalctl@ceph.mds.g.smithi047.stdout:Jul 24 22:22:22 smithi047 podman[128027]: 2024-07-24 22:22:22.701526044 +0000 UTC m=+3.683002696 container cleanup c40b95a1e50174795c4b7f631496c2038b989c2efb79530edee38ed297b76bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-g, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, RELEASE=main-86385b1, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T22:22:22.936 INFO:journalctl@ceph.mds.g.smithi047.stdout:Jul 24 22:22:22 smithi047 bash[128027]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-g 2024-07-24T22:22:23.269 INFO:journalctl@ceph.mds.g.smithi047.stdout:Jul 24 22:22:22 smithi047 podman[128039]: 2024-07-24 22:22:22.977568036 +0000 UTC m=+0.614803219 container remove c40b95a1e50174795c4b7f631496c2038b989c2efb79530edee38ed297b76bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=main-86385b1, io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-07-24T22:22:23.289 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.g.service' 2024-07-24T22:22:23.323 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:22:23.323 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-07-24T22:22:23.323 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-07-24T22:22:23.324 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.j 2024-07-24T22:22:23.648 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:22:23 smithi047 systemd[1]: Stopping Ceph mds.j for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:22:23.936 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:22:23 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-j[78145]: 2024-07-24T22:22:23.646+0000 7fb5c8477640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:22:23.936 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:22:23 smithi047 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-j[78145]: 2024-07-24T22:22:23.646+0000 7fb5c8477640 -1 mds.j *** got signal Terminated *** 2024-07-24T22:22:26.507 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:22:26 smithi047 podman[128148]: 2024-07-24 22:22:26.234434199 +0000 UTC m=+2.687668314 container died b6d50e5740e36b7ea6df3688394cff799fa3118c10b1a8e3e33a2cdd5caabb62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-j, GIT_CLEAN=True, RELEASE=main-86385b1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2) 2024-07-24T22:22:26.858 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:22:26 smithi047 podman[128148]: 2024-07-24 22:22:26.630406178 +0000 UTC m=+3.083640336 container cleanup b6d50e5740e36b7ea6df3688394cff799fa3118c10b1a8e3e33a2cdd5caabb62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-j, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, org.label-schema.vendor=CentOS) 2024-07-24T22:22:26.858 INFO:journalctl@ceph.mds.j.smithi047.stdout:Jul 24 22:22:26 smithi047 bash[128148]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-j 2024-07-24T22:22:26.983 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.j.service' 2024-07-24T22:22:27.016 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:22:27.016 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-07-24T22:22:27.016 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-07-24T22:22:27.016 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.b 2024-07-24T22:22:27.404 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:22:27 smithi183 systemd[1]: Stopping Ceph mds.b for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:22:27.661 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:22:27 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-b[68061]: 2024-07-24T22:22:27.402+0000 7f41e47e7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:22:27.662 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:22:27 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-b[68061]: 2024-07-24T22:22:27.402+0000 7f41e47e7640 -1 mds.b *** got signal Terminated *** 2024-07-24T22:22:31.662 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:22:31 smithi183 podman[73800]: 2024-07-24 22:22:31.409465425 +0000 UTC m=+4.199362957 container died 579e77367107a856498ef5f05c4524b07d0808d92a6af0838ddcd62aecd75e68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-b, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-07-24T22:22:32.062 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:22:31 smithi183 podman[73800]: 2024-07-24 22:22:31.80211777 +0000 UTC m=+4.592015345 container cleanup 579e77367107a856498ef5f05c4524b07d0808d92a6af0838ddcd62aecd75e68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-b, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=main-86385b1, GIT_CLEAN=True) 2024-07-24T22:22:32.063 INFO:journalctl@ceph.mds.b.smithi183.stdout:Jul 24 22:22:31 smithi183 bash[73800]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-b 2024-07-24T22:22:32.224 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.b.service' 2024-07-24T22:22:32.259 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:22:32.259 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-07-24T22:22:32.259 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-07-24T22:22:32.260 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.e 2024-07-24T22:22:32.582 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:22:32 smithi183 systemd[1]: Stopping Ceph mds.e for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:22:32.912 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:22:32 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-e[67438]: 2024-07-24T22:22:32.579+0000 7f52de8b9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:22:32.912 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:22:32 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-e[67438]: 2024-07-24T22:22:32.579+0000 7f52de8b9640 -1 mds.e *** got signal Terminated *** 2024-07-24T22:22:36.662 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:22:36 smithi183 podman[73921]: 2024-07-24 22:22:36.367609609 +0000 UTC m=+3.892864528 container died 39578ef40e61813865d05fa82008c1d1781c7419ec989a46159551e37262041a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-07-24T22:22:37.109 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:22:36 smithi183 podman[73921]: 2024-07-24 22:22:36.831040704 +0000 UTC m=+4.356295615 container cleanup 39578ef40e61813865d05fa82008c1d1781c7419ec989a46159551e37262041a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.build-date=20240716, GIT_CLEAN=True, RELEASE=main-86385b1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-24T22:22:37.109 INFO:journalctl@ceph.mds.e.smithi183.stdout:Jul 24 22:22:36 smithi183 bash[73921]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-e 2024-07-24T22:22:37.275 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.e.service' 2024-07-24T22:22:37.308 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:22:37.308 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-07-24T22:22:37.309 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-07-24T22:22:37.309 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.h 2024-07-24T22:22:37.645 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:22:37 smithi183 systemd[1]: Stopping Ceph mds.h for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:22:37.912 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:22:37 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-h[67745]: 2024-07-24T22:22:37.642+0000 7f0ec22b2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:22:37.912 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:22:37 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-h[67745]: 2024-07-24T22:22:37.642+0000 7f0ec22b2640 -1 mds.h *** got signal Terminated *** 2024-07-24T22:22:39.912 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:22:39 smithi183 podman[74051]: 2024-07-24 22:22:39.657887995 +0000 UTC m=+2.106703684 container died 94f9561d55138f8f31d05f697797e412de92fe2f560871d0559b1d84bf01c3be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=main-86385b1, org.label-schema.build-date=20240716) 2024-07-24T22:22:40.586 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:22:40 smithi183 podman[74051]: 2024-07-24 22:22:40.309632856 +0000 UTC m=+2.758448543 container cleanup 94f9561d55138f8f31d05f697797e412de92fe2f560871d0559b1d84bf01c3be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-h, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=main-86385b1, ceph=True, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-07-24T22:22:40.587 INFO:journalctl@ceph.mds.h.smithi183.stdout:Jul 24 22:22:40 smithi183 bash[74051]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-h 2024-07-24T22:22:40.747 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.h.service' 2024-07-24T22:22:40.780 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:22:40.780 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-07-24T22:22:40.780 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-07-24T22:22:40.780 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.k 2024-07-24T22:22:41.090 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:22:40 smithi183 systemd[1]: Stopping Ceph mds.k for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:22:41.411 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:22:41 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-k[67125]: 2024-07-24T22:22:41.087+0000 7fa42430f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:22:41.412 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:22:41 smithi183 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-k[67125]: 2024-07-24T22:22:41.087+0000 7fa42430f640 -1 mds.k *** got signal Terminated *** 2024-07-24T22:22:42.662 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:22:42 smithi183 podman[74174]: 2024-07-24 22:22:42.409173681 +0000 UTC m=+1.409372664 container died 5127c2528a071da2248bc717cf21d0b6f4431cab0fefacc563dacc3fb55472e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-k, GIT_CLEAN=True, RELEASE=main-86385b1, org.label-schema.build-date=20240716, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-07-24T22:22:43.032 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:22:42 smithi183 podman[74174]: 2024-07-24 22:22:42.763652678 +0000 UTC m=+1.763851663 container cleanup 5127c2528a071da2248bc717cf21d0b6f4431cab0fefacc563dacc3fb55472e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-k, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716) 2024-07-24T22:22:43.032 INFO:journalctl@ceph.mds.k.smithi183.stdout:Jul 24 22:22:42 smithi183 bash[74174]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-k 2024-07-24T22:22:43.182 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.k.service' 2024-07-24T22:22:43.214 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:22:43.214 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-07-24T22:22:43.214 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-07-24T22:22:43.214 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.c 2024-07-24T22:22:43.548 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:22:43 smithi188 systemd[1]: Stopping Ceph mds.c for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:22:43.807 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:22:43 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-c[69223]: 2024-07-24T22:22:43.588+0000 7fcb9d007640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:22:43.807 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:22:43 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-c[69223]: 2024-07-24T22:22:43.588+0000 7fcb9d007640 -1 mds.c *** got signal Terminated *** 2024-07-24T22:22:47.198 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:22:46 smithi188 podman[75582]: 2024-07-24 22:22:46.837419409 +0000 UTC m=+3.429920020 container died 87e54b1f238b09b097525e5b6c2eec9306a89390967b01c58a53d57d2792a941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.build-date=20240716, GIT_CLEAN=True, ceph=True, RELEASE=main-86385b1, GIT_BRANCH=HEAD) 2024-07-24T22:22:47.448 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:22:47 smithi188 podman[75582]: 2024-07-24 22:22:47.271074125 +0000 UTC m=+3.863574740 container cleanup 87e54b1f238b09b097525e5b6c2eec9306a89390967b01c58a53d57d2792a941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=main-86385b1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240716, maintainer=Guillaume Abrioux ) 2024-07-24T22:22:47.449 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:22:47 smithi188 bash[75582]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-c 2024-07-24T22:22:47.701 INFO:journalctl@ceph.mds.c.smithi188.stdout:Jul 24 22:22:47 smithi188 podman[75608]: 2024-07-24 22:22:47.447142953 +0000 UTC m=+0.605502588 container remove 87e54b1f238b09b097525e5b6c2eec9306a89390967b01c58a53d57d2792a941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=main-86385b1, GIT_CLEAN=True, org.label-schema.build-date=20240716, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-07-24T22:22:47.706 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.c.service' 2024-07-24T22:22:47.739 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:22:47.739 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-07-24T22:22:47.740 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-07-24T22:22:47.740 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.f 2024-07-24T22:22:48.048 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:22:47 smithi188 systemd[1]: Stopping Ceph mds.f for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:22:48.548 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:22:48 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-f[68922]: 2024-07-24T22:22:48.049+0000 7f2dbde54640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:22:48.548 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:22:48 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-f[68922]: 2024-07-24T22:22:48.049+0000 7f2dbde54640 -1 mds.f *** got signal Terminated *** 2024-07-24T22:22:50.909 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:22:50 smithi188 podman[75714]: 2024-07-24 22:22:50.634935067 +0000 UTC m=+2.680006326 container died a9844a4d3e413affe91dedbd168a3dbf208ceec2c00aa440158c911fc71624a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-07-24T22:22:51.260 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:22:51 smithi188 podman[75714]: 2024-07-24 22:22:51.03277834 +0000 UTC m=+3.077849658 container cleanup a9844a4d3e413affe91dedbd168a3dbf208ceec2c00aa440158c911fc71624a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=main-86385b1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-07-24T22:22:51.260 INFO:journalctl@ceph.mds.f.smithi188.stdout:Jul 24 22:22:51 smithi188 bash[75714]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-f 2024-07-24T22:22:51.393 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.f.service' 2024-07-24T22:22:51.425 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:22:51.425 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-07-24T22:22:51.426 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-07-24T22:22:51.426 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.i 2024-07-24T22:22:51.798 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:22:51 smithi188 systemd[1]: Stopping Ceph mds.i for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:22:51.799 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:22:51 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-i[69536]: 2024-07-24T22:22:51.736+0000 7f7b19d77640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:22:51.799 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:22:51 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-i[69536]: 2024-07-24T22:22:51.736+0000 7f7b19d77640 -1 mds.i *** got signal Terminated *** 2024-07-24T22:22:55.105 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:22:54 smithi188 podman[75837]: 2024-07-24 22:22:54.836277524 +0000 UTC m=+3.188020808 container died 3a9a1b23bfb79e76b6dd2997403e0cf3c830b9fc5e09c9e6b57c8365a714b8a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-86385b1, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-24T22:22:55.455 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:22:55 smithi188 podman[75837]: 2024-07-24 22:22:55.203375445 +0000 UTC m=+3.555118717 container cleanup 3a9a1b23bfb79e76b6dd2997403e0cf3c830b9fc5e09c9e6b57c8365a714b8a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-i, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240716, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-07-24T22:22:55.455 INFO:journalctl@ceph.mds.i.smithi188.stdout:Jul 24 22:22:55 smithi188 bash[75837]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-i 2024-07-24T22:22:55.587 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.i.service' 2024-07-24T22:22:55.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:22:55.618 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-07-24T22:22:55.618 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-07-24T22:22:55.618 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.l 2024-07-24T22:22:55.798 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:22:55 smithi188 systemd[1]: Stopping Ceph mds.l for 46bf760a-4a07-11ef-bcad-c7b262605968... 2024-07-24T22:22:56.298 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:22:56 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-l[68618]: 2024-07-24T22:22:56.039+0000 7f6c093dd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-07-24T22:22:56.299 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:22:56 smithi188 ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-l[68618]: 2024-07-24T22:22:56.039+0000 7f6c093dd640 -1 mds.l *** got signal Terminated *** 2024-07-24T22:23:00.049 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:22:59 smithi188 podman[75959]: 2024-07-24 22:22:59.776481077 +0000 UTC m=+3.933671667 container died eb134e71fb4edff7d5a357e6c9850bfb812945afcd08ed08cf501d5ae9cdbfad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, RELEASE=main-86385b1) 2024-07-24T22:23:00.392 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:23:00 smithi188 podman[75959]: 2024-07-24 22:23:00.198085969 +0000 UTC m=+4.355276547 container cleanup eb134e71fb4edff7d5a357e6c9850bfb812945afcd08ed08cf501d5ae9cdbfad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-86385b1, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-07-24T22:23:00.392 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:23:00 smithi188 bash[75959]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-l 2024-07-24T22:23:00.628 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.l.service' 2024-07-24T22:23:00.648 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:23:00 smithi188 podman[75972]: 2024-07-24 22:23:00.390570085 +0000 UTC m=+0.610391208 container remove eb134e71fb4edff7d5a357e6c9850bfb812945afcd08ed08cf501d5ae9cdbfad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af9a789bf27d9163de7a71d6f7d1087cc5b5534cc45ac7ad0b7b3df8cafcb1eb, name=ceph-46bf760a-4a07-11ef-bcad-c7b262605968-mds-l, org.label-schema.build-date=20240716, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=main-86385b1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-07-24T22:23:00.648 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:23:00 smithi188 systemd[1]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.l.service: Deactivated successfully. 2024-07-24T22:23:00.648 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:23:00 smithi188 systemd[1]: Stopped Ceph mds.l for 46bf760a-4a07-11ef-bcad-c7b262605968. 2024-07-24T22:23:00.648 INFO:journalctl@ceph.mds.l.smithi188.stdout:Jul 24 22:23:00 smithi188 systemd[1]: ceph-46bf760a-4a07-11ef-bcad-c7b262605968@mds.l.service: Consumed 1.095s CPU time. 2024-07-24T22:23:00.659 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-07-24T22:23:00.659 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-07-24T22:23:00.659 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 --force --keep-logs 2024-07-24T22:23:00.877 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T22:23:03.429 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 --force --keep-logs 2024-07-24T22:23:03.632 INFO:teuthology.orchestra.run.smithi183.stdout:Deleting cluster with fsid: 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T22:23:05.943 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 --force --keep-logs 2024-07-24T22:23:06.149 INFO:teuthology.orchestra.run.smithi188.stdout:Deleting cluster with fsid: 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T22:23:08.441 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-07-24T22:23:08.474 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-07-24T22:23:08.501 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-07-24T22:23:08.527 INFO:tasks.cephadm:Archiving crash dumps... 2024-07-24T22:23:08.529 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816857/remote/smithi047/crash 2024-07-24T22:23:08.530 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/crash -- . 2024-07-24T22:23:08.559 INFO:teuthology.orchestra.run.smithi047.stderr:tar: /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/crash: Cannot open: No such file or directory 2024-07-24T22:23:08.559 INFO:teuthology.orchestra.run.smithi047.stderr:tar: Error is not recoverable: exiting now 2024-07-24T22:23:08.561 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816857/remote/smithi183/crash 2024-07-24T22:23:08.561 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/crash -- . 2024-07-24T22:23:08.675 INFO:teuthology.orchestra.run.smithi183.stderr:tar: /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/crash: Cannot open: No such file or directory 2024-07-24T22:23:08.675 INFO:teuthology.orchestra.run.smithi183.stderr:tar: Error is not recoverable: exiting now 2024-07-24T22:23:08.676 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816857/remote/smithi188/crash 2024-07-24T22:23:08.677 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/crash -- . 2024-07-24T22:23:08.721 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /var/lib/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/crash: Cannot open: No such file or directory 2024-07-24T22:23:08.721 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2024-07-24T22:23:08.722 INFO:tasks.cephadm:Checking cluster log for badness... 2024-07-24T22:23:08.723 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-07-24T22:23:08.765 INFO:teuthology.orchestra.run.smithi047.stdout:2024-07-24T22:11:48.398555+0000 mon.a (mon.0) 1240 : cluster [WRN] Health check failed: 2 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-07-24T22:23:08.766 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-07-24T22:23:08.766 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[SEC\]' /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-07-24T22:23:08.845 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]' /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-07-24T22:23:08.923 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[WRN\]' /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-07-24T22:23:09.001 INFO:teuthology.orchestra.run.smithi047.stdout:2024-07-24T22:11:48.398555+0000 mon.a (mon.0) 1240 : cluster [WRN] Health check failed: 2 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-07-24T22:23:09.002 INFO:tasks.cephadm:Compressing logs... 2024-07-24T22:23:09.002 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-07-24T22:23:09.044 DEBUG:teuthology.orchestra.run.smithi183:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-07-24T22:23:09.047 DEBUG:teuthology.orchestra.run.smithi188:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-07-24T22:23:09.069 INFO:teuthology.orchestra.run.smithi183.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-07-24T22:23:09.069 INFO:teuthology.orchestra.run.smithi183.stderr:: No such file or directory 2024-07-24T22:23:09.069 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.log 2024-07-24T22:23:09.069 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.audit.log 2024-07-24T22:23:09.069 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.7.log 2024-07-24T22:23:09.069 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.b.log 2024-07-24T22:23:09.087 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.4.log 2024-07-24T22:23:09.087 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.7.log: /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.1.log 2024-07-24T22:23:09.088 INFO:teuthology.orchestra.run.smithi183.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-07-24T22:23:09.088 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mgr.y.log 2024-07-24T22:23:09.088 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.h.log 2024-07-24T22:23:09.088 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.10.log 2024-07-24T22:23:09.088 INFO:teuthology.orchestra.run.smithi183.stderr: 87.0% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.log.gz/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.h.log: 2024-07-24T22:23:09.088 INFO:teuthology.orchestra.run.smithi183.stderr: 90.4%gzip -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.audit.log.gz 2024-07-24T22:23:09.088 INFO:teuthology.orchestra.run.smithi183.stderr: -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.cephadm.log 2024-07-24T22:23:09.088 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.e.log 2024-07-24T22:23:09.088 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.cephadm.log: 81.3% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.cephadm.log.gz 2024-07-24T22:23:09.088 INFO:teuthology.orchestra.run.smithi183.stderr: 94.5% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.b.log.gz 2024-07-24T22:23:09.088 INFO:teuthology.orchestra.run.smithi183.stderr: 94.5% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.h.log.gz 2024-07-24T22:23:09.088 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-volume.log 2024-07-24T22:23:09.088 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mon.b.log 2024-07-24T22:23:09.089 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.k.log 2024-07-24T22:23:09.089 INFO:teuthology.orchestra.run.smithi183.stderr: 93.0% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mgr.y.log.gz 2024-07-24T22:23:09.089 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mon.b.log: 94.4% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.e.log.gz 2024-07-24T22:23:09.090 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.k.log: 94.4% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.k.log.gz 2024-07-24T22:23:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-07-24T22:23:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:: No such file or directory 2024-07-24T22:23:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.log 2024-07-24T22:23:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.audit.log 2024-07-24T22:23:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.g.log 2024-07-24T22:23:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.j.log 2024-07-24T22:23:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.3.log 2024-07-24T22:23:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.g.log: /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.0.log 2024-07-24T22:23:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mgr.x.log 2024-07-24T22:23:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mon.a.log 2024-07-24T22:23:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mgr.x.log: 87.0% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.log.gz 2024-07-24T22:23:09.091 INFO:teuthology.orchestra.run.smithi047.stderr: 90.2% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.audit.log.gz 2024-07-24T22:23:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.6.log 2024-07-24T22:23:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.cephadm.log 2024-07-24T22:23:09.091 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.6.log: 94.5% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.g.log.gz 2024-07-24T22:23:09.091 INFO:teuthology.orchestra.run.smithi047.stderr: 94.6% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.j.log.gz 2024-07-24T22:23:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.a.log 2024-07-24T22:23:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-volume.log 2024-07-24T22:23:09.092 INFO:teuthology.orchestra.run.smithi047.stderr: 95.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-07-24T22:23:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.a.log: 84.1% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.cephadm.log.gz 2024-07-24T22:23:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.d.log 2024-07-24T22:23:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.9.log 2024-07-24T22:23:09.092 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.d.log: 94.6% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.a.log.gz 2024-07-24T22:23:09.092 INFO:teuthology.orchestra.run.smithi047.stderr: 94.5% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.d.log.gz 2024-07-24T22:23:09.093 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-07-24T22:23:09.093 INFO:teuthology.orchestra.run.smithi188.stderr:: No such file or directory 2024-07-24T22:23:09.093 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.log 2024-07-24T22:23:09.093 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.2.log 2024-07-24T22:23:09.093 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.f.log 2024-07-24T22:23:09.093 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.log: /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.audit.log 2024-07-24T22:23:09.093 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.5.log 2024-07-24T22:23:09.094 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.f.log: /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.c.log 2024-07-24T22:23:09.094 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.5.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-07-24T22:23:09.094 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mon.c.log 2024-07-24T22:23:09.094 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mgr.z.log 2024-07-24T22:23:09.094 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.i.log 2024-07-24T22:23:09.094 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mgr.z.log: 87.0% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.log.gz 2024-07-24T22:23:09.094 INFO:teuthology.orchestra.run.smithi188.stderr: 90.4% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.audit.log.gz 2024-07-24T22:23:09.094 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.cephadm.log 2024-07-24T22:23:09.094 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.11.log 2024-07-24T22:23:09.094 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.cephadm.log: 81.3% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph.cephadm.log.gz 2024-07-24T22:23:09.094 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.8.log 2024-07-24T22:23:09.094 INFO:teuthology.orchestra.run.smithi188.stderr: 94.6% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.f.log.gz 2024-07-24T22:23:09.094 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.11.log: 93.1% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mgr.z.log.gz 2024-07-24T22:23:09.095 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-volume.log 2024-07-24T22:23:09.095 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.l.log 2024-07-24T22:23:09.095 INFO:teuthology.orchestra.run.smithi183.stderr: 91.0% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-volume.log.gz 2024-07-24T22:23:09.096 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.9.log: 91.0% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-volume.log.gz 2024-07-24T22:23:09.101 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-volume.log: /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.l.log: 91.0% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-volume.log.gz 2024-07-24T22:23:09.101 INFO:teuthology.orchestra.run.smithi188.stderr: 94.6% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.l.log.gz 2024-07-24T22:23:09.395 INFO:teuthology.orchestra.run.smithi188.stderr: 91.7% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mon.c.log.gz 2024-07-24T22:23:09.494 INFO:teuthology.orchestra.run.smithi047.stderr: 90.3% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mgr.x.log.gz 2024-07-24T22:23:09.553 INFO:teuthology.orchestra.run.smithi183.stderr: 91.7% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mon.b.log.gz 2024-07-24T22:23:10.192 INFO:teuthology.orchestra.run.smithi047.stderr: 90.3% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mon.a.log.gz 2024-07-24T22:23:11.349 INFO:teuthology.orchestra.run.smithi183.stderr: 93.2% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.4.log.gz 2024-07-24T22:23:12.142 INFO:teuthology.orchestra.run.smithi047.stderr: 93.4% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.9.log.gz 2024-07-24T22:23:12.370 INFO:teuthology.orchestra.run.smithi188.stderr: 93.3% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.8.log.gz 2024-07-24T22:23:12.528 INFO:teuthology.orchestra.run.smithi047.stderr: 93.4% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.6.log.gz 2024-07-24T22:23:12.556 INFO:teuthology.orchestra.run.smithi183.stderr: 93.3% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.10.log.gz 2024-07-24T22:23:12.854 INFO:teuthology.orchestra.run.smithi183.stderr: 93.2% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.1.log.gz 2024-07-24T22:23:12.874 INFO:teuthology.orchestra.run.smithi183.stderr: 93.4% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.7.log.gz 2024-07-24T22:23:12.876 INFO:teuthology.orchestra.run.smithi183.stderr: 2024-07-24T22:23:12.876 INFO:teuthology.orchestra.run.smithi183.stderr:real 0m3.817s 2024-07-24T22:23:12.876 INFO:teuthology.orchestra.run.smithi183.stderr:user 0m13.341s 2024-07-24T22:23:12.876 INFO:teuthology.orchestra.run.smithi183.stderr:sys 0m0.539s 2024-07-24T22:23:12.925 INFO:teuthology.orchestra.run.smithi047.stderr: 93.3% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.0.log.gz 2024-07-24T22:23:13.534 INFO:teuthology.orchestra.run.smithi047.stderr: 93.4% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.3.log.gz 2024-07-24T22:23:13.536 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-07-24T22:23:13.536 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m4.478s 2024-07-24T22:23:13.536 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m15.829s 2024-07-24T22:23:13.536 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m0.583s 2024-07-24T22:23:13.698 INFO:teuthology.orchestra.run.smithi188.stderr: 93.3% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.2.log.gz 2024-07-24T22:23:13.839 INFO:teuthology.orchestra.run.smithi188.stderr: 93.3% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.5.log.gz 2024-07-24T22:23:13.847 INFO:teuthology.orchestra.run.smithi188.stderr: 93.3% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-osd.11.log.gz 2024-07-24T22:23:14.440 INFO:teuthology.orchestra.run.smithi188.stderr: 97.5% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.c.log.gz 2024-07-24T22:23:58.316 INFO:teuthology.orchestra.run.smithi188.stderr: 94.5% -- replaced with /var/log/ceph/46bf760a-4a07-11ef-bcad-c7b262605968/ceph-mds.i.log.gz 2024-07-24T22:23:58.317 INFO:teuthology.orchestra.run.smithi188.stderr: 2024-07-24T22:23:58.318 INFO:teuthology.orchestra.run.smithi188.stderr:real 0m49.256s 2024-07-24T22:23:58.318 INFO:teuthology.orchestra.run.smithi188.stderr:user 1m9.820s 2024-07-24T22:23:58.318 INFO:teuthology.orchestra.run.smithi188.stderr:sys 0m2.443s 2024-07-24T22:23:58.318 INFO:tasks.cephadm:Archiving logs... 2024-07-24T22:23:58.319 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816857/remote/smithi047/log 2024-07-24T22:23:58.320 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-07-24T22:24:00.479 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816857/remote/smithi183/log 2024-07-24T22:24:00.480 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2024-07-24T22:24:02.495 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816857/remote/smithi188/log 2024-07-24T22:24:02.496 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/log/ceph -- . 2024-07-24T22:24:11.409 INFO:tasks.cephadm:Removing cluster... 2024-07-24T22:24:11.409 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 --force 2024-07-24T22:24:11.630 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T22:24:11.920 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 --force 2024-07-24T22:24:12.127 INFO:teuthology.orchestra.run.smithi183.stdout:Deleting cluster with fsid: 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T22:24:12.414 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 46bf760a-4a07-11ef-bcad-c7b262605968 --force 2024-07-24T22:24:12.620 INFO:teuthology.orchestra.run.smithi188.stdout:Deleting cluster with fsid: 46bf760a-4a07-11ef-bcad-c7b262605968 2024-07-24T22:24:12.964 INFO:tasks.cephadm:Removing cephadm ... 2024-07-24T22:24:12.965 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/cephadm 2024-07-24T22:24:12.984 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf /home/ubuntu/cephtest/cephadm 2024-07-24T22:24:13.002 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf /home/ubuntu/cephtest/cephadm 2024-07-24T22:24:13.017 INFO:tasks.cephadm:Teardown complete 2024-07-24T22:24:13.017 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-07-24T22:24:13.029 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-07-24T22:24:13.029 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-07-24T22:24:13.031 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-07-24T22:24:13.044 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-07-24T22:24:13.142 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-07-24T22:24:13.154 INFO:teuthology.task.clock:Checking final clock skew... 2024-07-24T22:24:13.154 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-24T22:24:13.157 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-24T22:24:13.159 DEBUG:teuthology.orchestra.run.smithi188:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-24T22:24:13.173 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-07-24T22:24:13.173 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2024-07-24T22:24:13.173 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2024-07-24T22:24:13.178 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-24T22:24:13.178 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2024-07-24T22:24:13.178 INFO:teuthology.orchestra.run.smithi188.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 -559us[ -539us] +/- 43ms 2024-07-24T22:24:13.178 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -482us[ -462us] +/- 62ms 2024-07-24T22:24:13.178 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +1666us[+1687us] +/- 74ms 2024-07-24T22:24:13.178 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T22:24:13.178 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-24T22:24:13.178 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-07-24T22:24:13.179 INFO:teuthology.orchestra.run.smithi183.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 -572us[ -543us] +/- 43ms 2024-07-24T22:24:13.179 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 -509us[ -509us] +/- 62ms 2024-07-24T22:24:13.179 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +1636us[+1636us] +/- 74ms 2024-07-24T22:24:13.179 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T22:24:13.180 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-24T22:24:13.180 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-07-24T22:24:13.180 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 -554us[ -535us] +/- 43ms 2024-07-24T22:24:13.180 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 -482us[ -482us] +/- 62ms 2024-07-24T22:24:13.180 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +1663us[+1663us] +/- 74ms 2024-07-24T22:24:13.180 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T22:24:13.180 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-07-24T22:24:13.191 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-07-24T22:24:13.192 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-07-24T22:24:13.233 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-07-24T22:24:13.329 DEBUG:teuthology.orchestra.run.smithi183:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-07-24T22:24:13.402 DEBUG:teuthology.orchestra.run.smithi188:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-07-24T22:24:13.467 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-24T22:24:13.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T22:24:13.500 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-24T22:24:13.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T22:24:13.735 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-24T22:24:13.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T22:24:13.768 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-07-24T22:24:13.801 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-07-24T22:24:13.851 INFO:teuthology.task.internal:Duration was 2173.255821 seconds 2024-07-24T22:24:13.851 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-07-24T22:24:13.884 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-07-24T22:24:13.884 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-07-24T22:24:13.889 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-07-24T22:24:13.895 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-07-24T22:24:13.934 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-24T22:24:13.935 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-24T22:24:13.936 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-24T22:24:14.459 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-07-24T22:24:14.459 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-07-24T22:24:14.460 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-07-24T22:24:14.486 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2024-07-24T22:24:14.486 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-07-24T22:24:14.525 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi188.front.sepia.ceph.com 2024-07-24T22:24:14.525 DEBUG:teuthology.orchestra.run.smithi188:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-07-24T22:24:14.553 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-07-24T22:24:14.553 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-07-24T22:24:14.556 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-07-24T22:24:14.567 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-07-24T22:24:14.619 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-07-24T22:24:14.619 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-07-24T22:24:14.629 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-07-24T22:24:14.634 DEBUG:teuthology.orchestra.run.smithi188:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-07-24T22:24:15.800 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-07-24T22:24:15.813 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-07-24T22:24:15.814 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-07-24T22:24:15.842 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-07-24T22:24:15.871 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-07-24T22:24:15.899 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-07-24T22:24:15.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-07-24T22:24:15.913 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-07-24T22:24:15.915 DEBUG:teuthology.orchestra.run.smithi188:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-07-24T22:24:15.935 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-07-24T22:24:15.939 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2024-07-24T22:24:15.964 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = core 2024-07-24T22:24:15.996 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-07-24T22:24:16.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T22:24:16.011 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2024-07-24T22:24:16.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T22:24:16.027 DEBUG:teuthology.orchestra.run.smithi188:> test -e /home/ubuntu/cephtest/archive/coredump 2024-07-24T22:24:16.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T22:24:16.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-07-24T22:24:16.067 INFO:teuthology.task.internal:Transferring archived files... 2024-07-24T22:24:16.067 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816857/remote/smithi047 2024-07-24T22:24:16.068 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-07-24T22:24:16.132 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816857/remote/smithi183 2024-07-24T22:24:16.132 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-07-24T22:24:16.169 DEBUG:teuthology.misc:Transferring archived files from smithi188:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816857/remote/smithi188 2024-07-24T22:24:16.169 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-07-24T22:24:16.205 INFO:teuthology.task.internal:Removing archive directory... 2024-07-24T22:24:16.206 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-07-24T22:24:16.208 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2024-07-24T22:24:16.211 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf -- /home/ubuntu/cephtest/archive 2024-07-24T22:24:16.256 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-07-24T22:24:16.270 INFO:teuthology.task.internal:Not uploading archives. 2024-07-24T22:24:16.270 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-07-24T22:24:16.311 INFO:teuthology.task.internal:Tidying up after the test... 2024-07-24T22:24:16.311 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-07-24T22:24:16.314 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-07-24T22:24:16.316 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-07-24T22:24:16.327 INFO:teuthology.orchestra.run.smithi047.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 24 22:24 /home/ubuntu/cephtest 2024-07-24T22:24:16.329 INFO:teuthology.orchestra.run.smithi183.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 24 22:24 /home/ubuntu/cephtest 2024-07-24T22:24:16.331 INFO:teuthology.orchestra.run.smithi188.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 24 22:24 /home/ubuntu/cephtest 2024-07-24T22:24:16.332 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-07-24T22:24:16.344 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-07-24T22:24:16.419 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iogen}} duration: 2173.2558205127716 failure_reason: '"2024-07-24T22:11:48.398555+0000 mon.a (mon.0) 1240 : cluster [WRN] Health check failed: 2 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log' flavor: default owner: scheduled_vshankar@teuthology success: false 2024-07-24T22:24:16.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-07-24T22:24:16.512 INFO:teuthology.run:FAIL